-- Logs begin at Tue 2022-10-04 17:15:25 UTC, end at Tue 2022-10-04 19:57:50 UTC. -- Oct 04 17:50:03.424017 n-d-850499-14 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 17:50:03.435019 n-d-850499-14 devstack@n-api.service[106258]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 17:50:03 2022] *** Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: nodename: n-d-850499-14 Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: machine: x86_64 Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: clock source: unix Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: pcre jit disabled Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: detected number of CPU cores: 4 Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: current working directory: / Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: detected binary path: /usr/bin/uwsgi-core Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: your processes number limit is 47680 Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: your memory page size is 4096 bytes Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: detected max file descriptor number: 2048 Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: lock engine: pthread robust mutexes Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: thunder lock: enabled Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 17:50:03.437339 n-d-850499-14 devstack@n-api.service[106258]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 17:50:03.475435 n-d-850499-14 devstack@n-api.service[106258]: Python main interpreter initialized at 0x555781abf9c0 Oct 04 17:50:03.475435 n-d-850499-14 devstack@n-api.service[106258]: python threads support enabled Oct 04 17:50:03.475435 n-d-850499-14 devstack@n-api.service[106258]: your server socket listen backlog is limited to 100 connections Oct 04 17:50:03.475435 n-d-850499-14 devstack@n-api.service[106258]: your mercy for graceful operations on workers is 90 seconds Oct 04 17:50:03.476101 n-d-850499-14 devstack@n-api.service[106258]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 17:50:03.476185 n-d-850499-14 devstack@n-api.service[106258]: *** Operational MODE: preforking *** Oct 04 17:50:03.476387 n-d-850499-14 devstack@n-api.service[106258]: *** uWSGI is running in multiple interpreter mode *** Oct 04 17:50:03.476387 n-d-850499-14 devstack@n-api.service[106258]: spawned uWSGI master process (pid: 106258) Oct 04 17:50:03.476604 n-d-850499-14 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 17:50:03.477164 n-d-850499-14 devstack@n-api.service[106258]: spawned uWSGI worker 1 (pid: 106259, cores: 1) Oct 04 17:50:03.479001 n-d-850499-14 devstack@n-api.service[106258]: spawned uWSGI worker 2 (pid: 106260, cores: 1) Oct 04 17:50:03.479001 n-d-850499-14 devstack@n-api.service[106258]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 17:50:04.136562 n-d-850499-14 devstack@n-api.service[106260]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:50:04.137173 n-d-850499-14 devstack@n-api.service[106259]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:50:05.225606 n-d-850499-14 devstack@n-api.service[106259]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:50:05.225606 n-d-850499-14 devstack@n-api.service[106259]: from cryptography.utils import int_from_bytes Oct 04 17:50:05.227051 n-d-850499-14 devstack@n-api.service[106259]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:50:05.227051 n-d-850499-14 devstack@n-api.service[106259]: from cryptography.utils import int_from_bytes Oct 04 17:50:05.227562 n-d-850499-14 devstack@n-api.service[106260]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:50:05.227562 n-d-850499-14 devstack@n-api.service[106260]: from cryptography.utils import int_from_bytes Oct 04 17:50:05.227959 n-d-850499-14 devstack@n-api.service[106260]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:50:05.227959 n-d-850499-14 devstack@n-api.service[106260]: from cryptography.utils import int_from_bytes Oct 04 17:50:07.716429 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:50:07.717049 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:50:07.717141 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:50:07.717141 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:50:07.717547 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:50:07.717641 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:50:07.717734 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:50:07.717734 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:50:07.717889 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:50:07.718041 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:50:07.718167 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.718407 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.718511 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.718732 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.718825 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.719079 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.719194 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.719399 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.719488 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.719711 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.719798 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.720031 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.720117 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.720350 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.720436 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.720669 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.720755 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.720927 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.721021 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.721243 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.721343 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.721556 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.721663 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850499-14 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.721877 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.721964 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850499-14 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.722175 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.722265 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.722491 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.722593 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.722802 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.722891 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.723137 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.723225 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.723455 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.723555 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.723760 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.723854 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.724071 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.724269 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.724584 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.724722 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.724899 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.725017 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.725206 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.725334 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.725515 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.725699 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.725888 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.726067 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.726227 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.727335 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.727527 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.727677 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.727856 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.728032 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.728283 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.728474 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.728655 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.728868 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.729088 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.729288 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850499-14 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.729440 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850499-14 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.729661 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.729847 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.730044 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.730194 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.730380 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.730597 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.730754 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.730943 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.731172 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.731307 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.731463 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.731610 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.731744 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.731909 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.732033 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.732156 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.732277 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.732409 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.732561 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.732919 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.733049 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.733173 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.733304 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.733441 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.733567 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.733690 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.733820 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.733975 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.734109 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.734243 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.734374 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.734498 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.734621 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.734752 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.734889 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.735037 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.735161 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.735298 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.735423 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.735552 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.735689 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.735813 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.735991 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.736125 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.736257 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.736388 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.736581 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.736720 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.736856 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.736991 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.737124 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.737259 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.737397 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.737529 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.737653 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.737778 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.737910 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.738041 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.738165 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.738288 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.738420 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.738551 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.738684 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.738809 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.738931 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.739136 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.739270 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.739394 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.739526 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.739650 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.739774 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.739905 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.740029 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.740158 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.740295 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.740419 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.740549 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.740673 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.740795 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.740931 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.741056 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.741191 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.741396 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.741570 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.741698 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.741831 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.741957 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.742715 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.743153 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.743284 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.743422 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.743571 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.743697 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.743820 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.743951 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.744083 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.744217 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.744355 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.744524 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.744647 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.744770 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.744915 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.745054 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.745225 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.745353 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.745551 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.745679 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.745892 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.746028 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.746153 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.746284 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.746438 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.746576 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.746744 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.746885 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.747074 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.747201 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.747389 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.747523 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.747696 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.747830 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.748001 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.748126 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.748306 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.748442 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.748610 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.748747 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.748915 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.749041 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.749222 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.749351 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.749529 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.749665 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.749834 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.749966 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.750138 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.750272 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.750443 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.750569 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.750749 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.750876 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.751088 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.751214 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.751378 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.751505 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.751682 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.751807 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.752003 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.752130 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.752309 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.752443 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.752617 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.752827 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.753047 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.753362 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.753498 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.753631 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.753755 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.753878 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.754000 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.754130 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.754263 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.754388 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.754517 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.754641 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.754763 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.754894 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.755094 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.755221 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.755345 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.755477 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.755608 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.755733 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.755916 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.756045 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.756226 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.756361 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.756526 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.756663 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.756834 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.756960 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.757138 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.757265 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.757450 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.758069 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.758292 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.758421 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.758600 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.758712 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.758902 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.759069 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.759247 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.759379 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.759511 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.759636 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.759820 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.759957 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.760126 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.760252 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.760424 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.760550 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.760726 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.760853 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.761046 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.761187 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.761352 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.761479 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.761661 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.761798 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.761965 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.762099 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.762273 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.762400 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.762596 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:50:07.762724 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.762925 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.763156 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.763491 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.763618 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.763618 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.763862 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.763987 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.764110 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.764233 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.764368 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.764536 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.764664 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.764854 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.764990 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.765170 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.765316 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.765491 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.765619 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.765802 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.765929 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.766118 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.766261 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.766429 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.766562 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.766747 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.766875 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.767091 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.767240 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.767413 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.767548 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.767728 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.767862 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.768045 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.768184 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.768362 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.768488 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.768674 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.768807 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.768988 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.769124 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.769304 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.769446 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.769623 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.769758 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.769937 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.770065 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.770250 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.770375 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.770593 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.770720 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.770909 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.771191 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.771350 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.771476 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.771612 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.771729 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.771863 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.771988 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.772166 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.772297 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.772479 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.772617 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.772789 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.772915 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.773237 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.774041 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.774169 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.774303 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.774430 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.774554 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.774677 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.774801 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.774923 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.775180 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.775308 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.775434 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.775558 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.775681 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.775804 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.775937 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.776122 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.776252 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.776437 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.776567 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.776761 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.776898 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.777075 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.777202 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.777398 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.777528 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.777718 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.777846 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.778031 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.778167 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.778344 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.778478 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.778655 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.778790 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.778980 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.779122 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.779302 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.779462 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.779596 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.779721 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.779904 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.780030 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.780210 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.780335 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.780517 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.780643 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.780824 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.780958 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.781131 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.781264 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.781454 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.781580 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.781761 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.781885 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.782079 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.782214 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.782390 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.782515 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.782706 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.782839 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.783039 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.783184 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.783393 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.783536 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.783662 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.783784 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.784104 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.784250 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.784386 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.784511 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.784511 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.784744 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.784869 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.784999 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.785124 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.785254 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.785429 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.785558 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.785736 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.785870 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.786048 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.786182 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.786355 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.786480 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.786665 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.786794 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.787001 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.787132 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.787311 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.787440 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.787624 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.787751 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.787933 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.788073 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.788243 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.788378 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.788567 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.788693 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.788904 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.789042 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.789216 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.789352 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.789551 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.789682 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.789858 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.789993 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.790178 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.790313 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.790506 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.790627 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.790820 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.790947 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.791158 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.791301 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.791463 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.791597 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.791767 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.791901 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.792070 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.792209 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.792373 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.792499 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.792676 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.792801 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.792979 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.793116 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.793282 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.793497 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.793628 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.793751 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.793888 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.794013 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.794349 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.794474 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.794474 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.794715 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.794849 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.795033 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.795160 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.795296 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.795423 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.795560 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.795686 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.795810 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.795966 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.796092 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.796286 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.796427 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.796602 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.796729 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.796945 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.797073 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.797264 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.797400 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.797588 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.797722 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.797900 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.798033 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.798217 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.798352 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.798528 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.798654 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.798841 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.799006 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.799181 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.799317 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.799493 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.799654 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.799810 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.799938 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.800121 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.800248 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.800435 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.800561 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.800744 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.800869 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.801058 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.801193 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.801371 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.801497 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.801684 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.801809 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.801988 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.802115 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.802305 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.802431 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.802625 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.802753 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.803000 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.803215 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.803338 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.803461 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.803672 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.803883 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.804010 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.804336 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.804469 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.804605 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.804731 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.804869 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.804995 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.805125 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.805261 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.805386 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.805509 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.805642 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.805767 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.805892 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.806014 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.806145 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.806335 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.806473 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.806649 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.806777 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.806989 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.807119 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.807297 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.807434 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.807612 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.807738 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.807916 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.808044 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.808227 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.808361 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.808545 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.808673 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.808876 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.809012 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.809188 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.809325 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.809501 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.809629 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.809796 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.809922 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.810121 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.810250 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.810430 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.810558 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.810741 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.810867 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.811070 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.811200 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.811379 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.811507 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.811684 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.811819 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.811998 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.812126 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.812312 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.812446 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.812623 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.812758 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.812928 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.813054 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.813233 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.813367 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.813542 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.813753 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.814008 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.814150 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.814478 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.814608 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.814740 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.814874 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.814874 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.815292 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.815292 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.815527 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.815527 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.815767 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.815897 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.816021 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.816021 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.816249 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.816382 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.816506 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.816629 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.816750 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.816872 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.816993 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.817173 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.817308 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.817479 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.817603 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.817782 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.817908 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.818084 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.818210 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.818427 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.818554 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.818732 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.818870 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.819059 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.819202 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.819383 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.819511 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.819692 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.819862 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.820516 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.820650 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.820841 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.820967 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.821151 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.821287 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.821465 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.821594 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.821778 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.821912 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.822090 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.822227 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.822400 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.822526 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.822707 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.822834 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.823040 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.823170 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.823355 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.823481 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.823666 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.823869 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.824007 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.824140 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.824272 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.824591 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.824738 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.824864 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.824996 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.825121 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.825251 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.825375 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.825497 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.825620 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.825794 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.826031 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.826367 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.826502 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.826684 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.826820 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.827028 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.827160 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.827353 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.827488 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.827680 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.827821 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.828007 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.828149 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.828404 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.828540 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.828679 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.828804 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.828929 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.829052 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.829233 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.829362 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.829541 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.829668 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.829849 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.829992 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.830153 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.830280 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.830458 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.830584 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.830763 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.830903 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.831078 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.831201 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.831391 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.831518 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.831694 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.831833 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.832000 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.832127 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.832301 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.832428 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.832604 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.832739 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.832912 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.833040 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.833215 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.833341 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.833519 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.833653 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.833821 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.834146 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.834146 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.834483 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.834483 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.834906 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.835065 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.835193 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.835317 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.835440 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.835572 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.835716 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.835716 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.836464 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.836588 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.836710 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.836843 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.836966 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.837137 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.837264 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.837465 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.837612 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.837777 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.837904 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.838085 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.838212 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.838398 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.838533 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.838710 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.838842 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.839040 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.839169 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.839349 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.839490 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.839658 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.839785 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.839949 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.840082 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.840258 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.840395 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.840562 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.840687 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.840869 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.840997 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.841177 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.841304 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.841486 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.841612 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.841790 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.841924 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.842093 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.842219 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.842397 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.842524 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.842702 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.842837 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.843034 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.843173 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.843331 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.843458 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.843634 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.843759 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.843941 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.844163 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.844301 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.844425 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.844589 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.845014 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.845153 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.845279 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.845402 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.845527 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.845650 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.845788 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.845914 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.846038 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.846162 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.846286 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.846409 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.846541 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.846667 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.846800 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.846926 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.847073 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.847197 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.847334 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.847511 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.847649 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.847827 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.847955 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.848139 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.848274 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.848443 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.848569 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.848746 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.848874 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.849049 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.849176 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.849351 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.849477 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.849657 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.849784 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.849998 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.850132 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.850284 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.850410 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.850589 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.850725 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.850893 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.851055 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.851223 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.851373 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.851961 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.852110 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.852287 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.852415 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.852600 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.852736 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.852916 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.853060 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.853226 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.853356 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.853534 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.853662 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.853841 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.853984 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.854150 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.854362 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.854487 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.854611 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.854774 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.855193 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.855318 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.855424 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.855424 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.855660 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.855792 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.855926 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.856051 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.856175 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.856306 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.856471 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.856668 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.856798 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.856980 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.857115 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.857300 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.857428 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.857627 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.857753 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.857923 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.858051 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.858236 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.858374 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.858558 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.858687 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.858867 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.859057 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.859213 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.859354 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.859528 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.859656 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.859841 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.859968 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.860129 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.860265 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.860437 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.860573 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.860740 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.860866 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.861063 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.861203 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.861374 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.861502 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.861690 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.861824 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.862010 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.862146 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.862332 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.862466 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.862635 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.862761 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.862946 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.863103 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.863279 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.863405 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.863589 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.863717 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.863900 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.864027 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.864208 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.864416 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.864545 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.864678 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.864821 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.864947 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.865211 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.865339 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.865577 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.865710 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.865844 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.865978 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.866103 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.866234 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.866359 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.866482 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.866620 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.866747 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.867403 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.867536 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.867735 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.867877 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.868050 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.868186 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.868360 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.868487 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.868668 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.868806 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.868974 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.869108 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.869279 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.869404 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.869583 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.869723 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.869886 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.870021 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.870317 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.870456 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.870630 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.870758 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.870941 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.871130 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.871366 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.871508 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.871643 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.871775 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.871901 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.872024 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.872157 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.872281 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.872476 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.872604 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.872786 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.872922 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.873193 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.873319 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.873505 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.873634 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.873816 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.873942 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.874122 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.874261 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.874477 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.874612 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.874736 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.874858 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.875052 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.875329 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.875468 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.875582 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.875707 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.875838 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.875962 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.876100 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.876257 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.876389 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.876562 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.876688 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.876874 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.877008 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.877200 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.877326 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.877593 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.877717 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.877903 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.878037 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.878215 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.878347 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.878625 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.878757 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.878935 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.879096 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.879271 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.879412 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.879597 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.879723 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.879921 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.880045 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.880236 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.880371 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.880536 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.880663 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.880846 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.880972 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.881158 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.881292 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.881485 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.881612 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.881798 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.881926 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.882109 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.882236 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.882414 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.882559 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.882783 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.882911 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.883135 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.883264 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.883457 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.883588 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.883772 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.883913 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.884099 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.884228 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.884500 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.884704 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.884831 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.884969 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.885126 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.885397 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.885538 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.885670 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.885795 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.885931 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.886056 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.886180 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.886342 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.886470 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.886651 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.886789 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.886978 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.887111 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.887284 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.887412 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.887601 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.887730 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.887906 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.888033 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.888217 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.888343 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.888528 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.888656 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.888832 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.888973 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.889137 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.889264 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.889445 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.889575 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.889749 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.889881 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.890062 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.890188 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.890363 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.890490 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.890685 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.890815 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.891029 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.891171 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.891337 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.891466 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.891651 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.891780 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.891963 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.892104 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.892273 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.892403 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.892579 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.892706 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.892883 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.893023 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.893186 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.893312 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.893521 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.893648 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.893826 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.893962 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.894147 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.894276 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.894474 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.894601 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.894811 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.894948 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.895126 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.895248 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.895510 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.895655 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.895921 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.896054 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.896054 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.896289 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.896520 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.896649 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.896798 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.897040 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.897170 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.897295 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.897419 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.897596 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.897724 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.897848 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.897971 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.898101 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.898724 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.898859 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.899021 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.899151 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.899276 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.899444 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.899572 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.899759 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.899895 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.900068 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.900197 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.900403 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.900536 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.900670 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.900794 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.900996 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.901124 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.901305 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.901441 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.901631 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.901760 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.901943 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.902078 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.902249 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.902385 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.902558 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.902693 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.902865 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.903014 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.903226 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.903367 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.903536 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.903664 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.903859 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.903993 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.904170 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.904305 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.904486 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.904612 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.904803 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.904978 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.905179 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.905305 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.905430 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.905668 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.905792 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.905921 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.906119 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.906246 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.906369 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.906494 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.906617 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.906750 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.906930 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.907125 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.907275 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.907403 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.907647 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.907824 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.907966 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.908159 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.908478 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.908615 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.908803 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.908932 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.909119 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.909248 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.909434 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.909562 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.909749 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.909885 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.910065 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.910191 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.910377 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.910540 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.910675 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.910813 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.911353 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.911488 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.911613 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.911751 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.911879 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.912012 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.912253 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.912386 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.912386 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.912630 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.912831 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.912960 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.913091 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.913217 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.913341 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.913471 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.913610 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.913736 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.913881 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.914262 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.914412 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.914549 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.914682 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.914807 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.914942 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.915114 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.915238 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.915380 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.915507 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.915718 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.915845 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.915970 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.916118 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.916315 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.916443 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.916567 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.916699 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.916825 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.916959 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.917114 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.917243 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.917432 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.917560 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.917748 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.917886 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.918061 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.918190 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.918379 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.918501 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.918759 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.918888 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.919113 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.919242 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.919434 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.919571 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.919754 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.919888 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.920070 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.920278 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.920406 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.920595 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.920737 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.920933 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.921208 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.921337 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.921527 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.921664 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.921866 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.921995 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.922185 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.922320 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.922511 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.922647 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.922818 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.923003 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.923144 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.923272 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.923456 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.923598 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.923768 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.923898 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.924076 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.924204 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.924397 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.924536 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.924709 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.924836 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.925013 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.925149 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.925335 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.925464 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.925644 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.925847 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.925974 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.926183 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.926342 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.926532 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.926659 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.926840 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.927100 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.927230 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.927454 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.927586 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.927777 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.927904 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.928108 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.928235 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.928439 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.928586 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.928742 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.928871 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.929049 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.929190 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.929363 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.930002 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.930238 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.930347 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.930472 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.930646 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.930776 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.930906 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.931105 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.931237 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.931412 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.931557 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.931716 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.931843 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.932030 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.932157 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.932334 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.932469 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.932638 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.932766 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.932954 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.933081 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.933260 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.933388 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.933569 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.933696 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.933881 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.934016 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.934190 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.934317 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.934499 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.934627 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.934806 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.934935 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.935139 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.935267 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.935450 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.935577 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.935755 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.935966 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.936109 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.936231 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.936356 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.936479 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.936678 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.936820 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.936945 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.937068 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.937242 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.937369 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.937558 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.937693 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.937903 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.938030 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.938210 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.938338 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.938515 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.938654 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.938838 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.939000 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.939178 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.939304 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.939502 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.939646 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.939817 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.939944 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.940130 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.940256 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.940458 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.940586 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.940763 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.940899 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.941075 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.941306 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.941446 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.941642 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.941770 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.941967 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.942253 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.942382 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.942585 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.942719 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.942900 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.943048 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.943235 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.943375 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.943545 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.943674 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.943874 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.944007 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.944185 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.944323 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.944498 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.944665 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.944812 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.944940 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.945149 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.945288 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.945492 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.945619 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.945804 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.945944 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.946135 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.946272 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.946399 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.946532 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.946736 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.946871 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.947039 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.947166 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.947341 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.947480 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.947652 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.947787 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.947961 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.948089 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.948271 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.948406 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.948585 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.948722 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.948898 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.949028 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.949209 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.949338 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.949525 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.949666 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.949843 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.949972 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.950164 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.950292 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.950477 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.950615 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.950802 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.950942 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.951122 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.951245 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.951420 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.951567 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.951730 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.951858 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.952042 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.952170 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.952355 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.952492 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.952661 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.952787 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.952995 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.953312 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.953446 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.953621 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.953754 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.953964 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.954289 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.954415 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.954603 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.954733 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.954929 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.955079 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.955280 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.955415 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.955592 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.955720 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.955914 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.956043 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.956250 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.956388 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.956538 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.956672 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.956875 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.957020 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.957173 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.957311 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.957501 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.957628 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.957810 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.957941 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.958117 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.958255 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.958424 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.958553 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.958743 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.958879 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.959163 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.959306 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.959430 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.959561 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.959686 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.959809 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.959971 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.960100 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.960281 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.960409 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.960586 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.961250 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.961410 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.961540 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.961720 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.961856 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.962027 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.962154 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.962334 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.962462 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.962639 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.962768 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.962946 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.963103 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.963275 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.963402 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.963580 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.963715 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.963882 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.964023 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.964186 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.964319 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.964493 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.964621 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.964796 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.964932 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.965098 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.965225 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.965399 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.965526 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.965702 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.965837 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.966004 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.966131 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.966342 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.966529 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.966673 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.966800 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.966938 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.967184 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.967312 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.967437 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.967576 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.967692 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.967877 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.968006 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.968202 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.968329 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.968516 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.968644 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.968842 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.968978 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.969154 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.969288 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.969462 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.969590 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.969788 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.969914 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.970098 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.970236 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.970408 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.970534 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.970720 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.970847 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.971058 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.971349 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.971481 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.971607 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.971730 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.971853 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.971976 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.972187 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.972325 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.972450 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.972585 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.972711 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.972886 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.973023 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.973210 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.973345 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.973516 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.973652 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.973834 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.973969 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.974148 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.974276 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.974466 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.974708 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.974845 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.975030 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.975158 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.975280 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.975415 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.975550 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.975677 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.975809 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.975992 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.976119 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.976329 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.976558 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.976698 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.977074 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.977278 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.977405 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.977527 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.977660 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.977828 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.977956 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.978155 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.978289 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.978472 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.978599 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.978789 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.978915 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.979143 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.979280 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.979473 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.979599 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.979784 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.979910 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.980113 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.980240 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.980443 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.980578 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.980771 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.980896 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.981089 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.981217 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.981392 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.981521 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.981696 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.981824 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.981958 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:50:07.982098 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.982347 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.982655 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:50:07.982901 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:50:08.135809 n-d-850499-14 devstack@n-api.service[106260]: INFO dbcounter [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Registered counter for database nova_api Oct 04 17:50:08.138218 n-d-850499-14 devstack@n-api.service[106259]: INFO dbcounter [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Registered counter for database nova_api Oct 04 17:50:08.156899 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_db.sqlalchemy.engines [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:50:08.158747 n-d-850499-14 devstack@n-api.service[106259]: DEBUG oslo_db.sqlalchemy.engines [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:50:08.163609 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writer thread running {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:50:08.166058 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writer thread running {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:50:08.220785 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.context [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) {{(pid=106260) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:50:08.221907 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.context [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) {{(pid=106259) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:50:08.224598 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.225095 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.225738 n-d-850499-14 devstack@n-api.service[106259]: DEBUG oslo_concurrency.lockutils [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.226212 n-d-850499-14 devstack@n-api.service[106259]: DEBUG oslo_concurrency.lockutils [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.227573 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.228309 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.228587 n-d-850499-14 devstack@n-api.service[106259]: DEBUG oslo_concurrency.lockutils [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.228758 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.229341 n-d-850499-14 devstack@n-api.service[106259]: DEBUG oslo_concurrency.lockutils [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.229785 n-d-850499-14 devstack@n-api.service[106259]: DEBUG oslo_concurrency.lockutils [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.230744 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.231789 n-d-850499-14 devstack@n-api.service[106259]: DEBUG oslo_concurrency.lockutils [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.232752 n-d-850499-14 devstack@n-api.service[106260]: INFO dbcounter [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Registered counter for database nova_cell0 Oct 04 17:50:08.233804 n-d-850499-14 devstack@n-api.service[106259]: INFO dbcounter [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Registered counter for database nova_cell0 Oct 04 17:50:08.236776 n-d-850499-14 devstack@n-api.service[106260]: INFO dbcounter [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Registered counter for database nova_cell1 Oct 04 17:50:08.237816 n-d-850499-14 devstack@n-api.service[106259]: INFO dbcounter [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Registered counter for database nova_cell1 Oct 04 17:50:08.244262 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_db.sqlalchemy.engines [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:50:08.247410 n-d-850499-14 devstack@n-api.service[106259]: DEBUG oslo_db.sqlalchemy.engines [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:50:08.247552 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_db.sqlalchemy.engines [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:50:08.250600 n-d-850499-14 devstack@n-api.service[106259]: DEBUG oslo_db.sqlalchemy.engines [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:50:08.253561 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writer thread running {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:50:08.254793 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writer thread running {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:50:08.257069 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writer thread running {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:50:08.401770 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writer thread running {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:50:08.411005 n-d-850499-14 devstack@n-api.service[106259]: INFO dbcounter [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Registered counter for database nova_cell0 Oct 04 17:50:08.417513 n-d-850499-14 devstack@n-api.service[106260]: INFO dbcounter [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Registered counter for database nova_cell0 Oct 04 17:50:08.418745 n-d-850499-14 devstack@n-api.service[106259]: DEBUG oslo_db.sqlalchemy.engines [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:50:08.423288 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writer thread running {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:50:08.426122 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_db.sqlalchemy.engines [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:50:08.431248 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writer thread running {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:50:08.764167 n-d-850499-14 devstack@n-api.service[106259]: WARNING keystonemiddleware.auth_token [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:50:08.765114 n-d-850499-14 devstack@n-api.service[106260]: WARNING keystonemiddleware.auth_token [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:50:08.771637 n-d-850499-14 devstack@n-api.service[106259]: WARNING keystonemiddleware.auth_token [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:50:08.772505 n-d-850499-14 devstack@n-api.service[106260]: WARNING keystonemiddleware.auth_token [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:50:09.111979 n-d-850499-14 devstack@n-api.service[106259]: WARNING keystonemiddleware.auth_token [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:50:09.116553 n-d-850499-14 devstack@n-api.service[106260]: WARNING keystonemiddleware.auth_token [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:50:09.117983 n-d-850499-14 devstack@n-api.service[106259]: WARNING keystonemiddleware.auth_token [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:50:09.122586 n-d-850499-14 devstack@n-api.service[106260]: WARNING keystonemiddleware.auth_token [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:50:09.123524 n-d-850499-14 devstack@n-api.service[106259]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555781abf9c0 pid: 106259 (default app) Oct 04 17:50:09.126433 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.127647 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-b252c3f9-19d8-4fce-a390-6274d785104d None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001786 Oct 04 17:50:09.127859 n-d-850499-14 devstack@n-api.service[106260]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555781abf9c0 pid: 106260 (default app) Oct 04 17:50:09.128067 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Tue Oct 4 17:50:09 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:30.765870 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:30.768113 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003079 Oct 04 17:51:30.769019 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:51:30 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:30.788177 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writing DB stats nova_api:SELECT=3 {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:30.790285 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writing DB stats nova_cell0:SELECT=3 {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:30.791345 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writing DB stats nova_cell1:SELECT=3 {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:30.792611 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:31.730785 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-12b1a59b-a201-468e-b4ac-e1b7d3436b27 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:31.763941 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-12b1a59b-a201-468e-b4ac-e1b7d3436b27 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.987787 Oct 04 17:51:31.764719 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 4 17:51:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:34.388167 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:34.389216 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-a23e0936-935e-40a6-94f7-656e5998007a None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 04 17:51:34.389932 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:34.890540 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-7d4b93e7-d346-45ad-9548-9af4a6f95935 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:34.947495 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-7d4b93e7-d346-45ad-9548-9af4a6f95935 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.551384 Oct 04 17:51:34.948065 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 4 17:51:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:35.171770 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-c7c1211a-2a69-4027-aca3-87aa1d4fdf5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:35.178846 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writing DB stats nova_api:SELECT=3 {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:35.179959 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writing DB stats nova_cell1:SELECT=3 {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:35.180750 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writing DB stats nova_cell0:SELECT=3 {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:35.181501 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:35.247021 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-c7c1211a-2a69-4027-aca3-87aa1d4fdf5a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290322 Oct 04 17:51:35.247647 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Oct 4 17:51:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:37.929922 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-7d4b93e7-d346-45ad-9548-9af4a6f95935 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:37.930941 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-7d4b93e7-d346-45ad-9548-9af4a6f95935 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 04 17:51:37.931370 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:38.807491 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-b43bd036-c589-4543-aabc-3acfa6399e58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:38.856623 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-b43bd036-c589-4543-aabc-3acfa6399e58 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.918506 Oct 04 17:51:38.857819 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 4 17:51:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:38.872926 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-d56152b9-aed2-4709-8e9c-2a7365d64859 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:38.933056 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-d56152b9-aed2-4709-8e9c-2a7365d64859 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064681 Oct 04 17:51:38.933977 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Oct 4 17:51:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:41.905819 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-b43bd036-c589-4543-aabc-3acfa6399e58 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:41.906771 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-b43bd036-c589-4543-aabc-3acfa6399e58 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 04 17:51:41.909966 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:42.500493 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-a8e3400b-d790-47e3-8e12-a6087bf45e9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "swap": 0, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:42.523446 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-a8e3400b-d790-47e3-8e12-a6087bf45e9c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.603520 Oct 04 17:51:42.527428 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 4 17:51:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:42.536028 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-fe0fa3d1-086f-4371-8440-63ec6a801ff4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:42.577368 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-fe0fa3d1-086f-4371-8440-63ec6a801ff4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044638 Oct 04 17:51:42.578472 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Oct 4 17:51:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:45.240216 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-a8e3400b-d790-47e3-8e12-a6087bf45e9c admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:45.241889 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-a8e3400b-d790-47e3-8e12-a6087bf45e9c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002125 Oct 04 17:51:45.242533 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:45.752456 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-b135214a-305f-4f3d-b478-a83e1bd70dbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3"}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:45.778160 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-b135214a-305f-4f3d-b478-a83e1bd70dbc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529417 Oct 04 17:51:45.778716 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 4 17:51:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:45.792991 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-9735de1b-08e4-4026-b3fe-a83ff1629927 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:45.823771 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-9735de1b-08e4-4026-b3fe-a83ff1629927 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035559 Oct 04 17:51:45.827038 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Oct 4 17:51:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:48.628613 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-b135214a-305f-4f3d-b478-a83e1bd70dbc admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.629623 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-b135214a-305f-4f3d-b478-a83e1bd70dbc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Oct 04 17:51:48.640316 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:51:48 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:49.117590 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-c3f0dfd3-d738-49bb-a441-f92f721da783 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:49.140138 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-c3f0dfd3-d738-49bb-a441-f92f721da783 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503886 Oct 04 17:51:49.141037 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 4 17:51:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:49.154048 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-c1a33088-0884-40ec-9e5a-893f12f171af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:49.183520 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-c1a33088-0884-40ec-9e5a-893f12f171af admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033252 Oct 04 17:51:49.184348 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Oct 4 17:51:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:52.002214 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-c3f0dfd3-d738-49bb-a441-f92f721da783 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:52.003313 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-c3f0dfd3-d738-49bb-a441-f92f721da783 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 04 17:51:52.003907 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:51:52.504629 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-02375b5d-3f9d-49a6-a88d-0e3603ae2bf1 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:52.529532 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-02375b5d-3f9d-49a6-a88d-0e3603ae2bf1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.519399 Oct 04 17:51:52.530086 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 4 17:51:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:55.182259 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-c3f0dfd3-d738-49bb-a441-f92f721da783 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:55.183345 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-c3f0dfd3-d738-49bb-a441-f92f721da783 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 04 17:51:55.183771 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:51:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:55.675666 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-c7bf6332-d484-4c44-ac4c-bb431ba78555 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:55.698007 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-c7bf6332-d484-4c44-ac4c-bb431ba78555 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.505092 Oct 04 17:51:55.698483 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 4 17:51:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:55.712644 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-2d45871e-e615-4649-a6a4-1c69ad03b149 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:55.745296 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-2d45871e-e615-4649-a6a4-1c69ad03b149 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037890 Oct 04 17:51:55.745989 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Oct 4 17:51:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:58.923854 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-c7bf6332-d484-4c44-ac4c-bb431ba78555 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:58.924864 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-c7bf6332-d484-4c44-ac4c-bb431ba78555 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Oct 04 17:51:58.925272 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:59.336665 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-bb519107-5bf1-4bdf-87e1-966c4c05d605 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:59.356957 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-bb519107-5bf1-4bdf-87e1-966c4c05d605 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.425316 Oct 04 17:51:59.358117 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 4 17:51:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:59.370624 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-c1cf5186-c0ed-40b6-b672-a082cc834802 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:59.397730 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-c1cf5186-c0ed-40b6-b672-a082cc834802 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030789 Oct 04 17:51:59.398312 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Oct 4 17:51:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:02.066120 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-bb519107-5bf1-4bdf-87e1-966c4c05d605 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:02.067720 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-bb519107-5bf1-4bdf-87e1-966c4c05d605 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Oct 04 17:52:02.068348 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:02.480219 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-20b0d698-02e7-417e-8cc5-6f7d4e4bbaa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "id": "3"}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:02.503417 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-20b0d698-02e7-417e-8cc5-6f7d4e4bbaa7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.428514 Oct 04 17:52:02.503962 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 4 17:52:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:52:02.516561 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-3037d563-76e0-43a4-91ca-d6bb52bf790a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:02.521421 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:02.548218 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-3037d563-76e0-43a4-91ca-d6bb52bf790a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035704 Oct 04 17:52:02.548821 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Oct 4 17:52:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:05.172154 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-20b0d698-02e7-417e-8cc5-6f7d4e4bbaa7 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:05.173171 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-20b0d698-02e7-417e-8cc5-6f7d4e4bbaa7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 04 17:52:05.173772 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:05.663693 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-cb52acf5-78b0-461b-82c1-b8a2689b96cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "ram": 8192, "vcpus": 4}} {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:05.686373 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-cb52acf5-78b0-461b-82c1-b8a2689b96cb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506222 Oct 04 17:52:05.687175 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 4 17:52:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:52:05.703479 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-8576a427-fb68-4342-9a87-c956323c58d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:05.712124 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:05.739245 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-8576a427-fb68-4342-9a87-c956323c58d0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042709 Oct 04 17:52:05.739749 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Oct 4 17:52:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:08.440849 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-cb52acf5-78b0-461b-82c1-b8a2689b96cb admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:08.441963 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-cb52acf5-78b0-461b-82c1-b8a2689b96cb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Oct 04 17:52:08.442373 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:52:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:08.893597 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-03f82ab9-03ae-4e96-b2bc-1380463ae4d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "swap": 0, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:08.916649 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-03f82ab9-03ae-4e96-b2bc-1380463ae4d7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.467954 Oct 04 17:52:08.917212 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 4 17:52:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:52:08.929724 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-12e589b2-1cd9-47d1-8045-af269910ddd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:08.956535 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-12e589b2-1cd9-47d1-8045-af269910ddd3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030276 Oct 04 17:52:08.957316 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Oct 4 17:52:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:30.274331 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-03f82ab9-03ae-4e96-b2bc-1380463ae4d7 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.275434 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-03f82ab9-03ae-4e96-b2bc-1380463ae4d7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Oct 04 17:52:30.275846 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:30.287332 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:30.707225 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-cdee575f-c542-4321-83ad-cef80ac5e362 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.726498 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-cdee575f-c542-4321-83ad-cef80ac5e362 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.443681 Oct 04 17:52:30.727144 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:52:32.099194 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-03f82ab9-03ae-4e96-b2bc-1380463ae4d7 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.100212 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-03f82ab9-03ae-4e96-b2bc-1380463ae4d7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Oct 04 17:52:32.100623 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:32.690583 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-3c3d4460-dffc-44db-a9d5-0ccf111f9d3f admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.696025 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.wsgi [None req-3c3d4460-dffc-44db-a9d5-0ccf111f9d3f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-3c3d4460-dffc-44db-a9d5-0ccf111f9d3f admin admin] Request method failure captured: Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: Accept: application/json Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: Accept-Encoding: gzip, deflate Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: Connection: keep-alive Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: Content-Length: 0 Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: Host: 10.222.0.18 Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: Openstack-Api-Version: compute 2.92 Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: Openstack-System-Scope: None Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: User-Agent: python-novaclient Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Auth-Token: gAAAAABjPHLf0HIM94mEfvsbOm3GT9umphobD96rFBEGO-aQlHK9YWqa1lhIltwdXR1dYa2iCnJQxrJnPQmPbZS189mYRMpy-CW19PsahCaDhAOl8cfI2AZ-Qxq6qQLR29RSE892Ut0xzH817-woFvEH6ictpbl08oNhk-Erj9G3a3PdsoVOiYo Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Domain-Id: None Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Domain-Name: None Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Identity-Status: Confirmed Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Is-Admin-Project: True Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Domain-Id: default Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Domain-Name: Default Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Name: admin Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Role: reader,member,admin Oct 04 17:52:32.699291 n-d-850499-14 devstack@n-api.service[106259]: X-Roles: reader,member,admin Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}] Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: X-Tenant: admin Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: X-Tenant-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: X-Tenant-Name: admin Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: X-User: admin Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: X-User-Domain-Id: default Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: X-User-Domain-Name: Default Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: X-User-Id: 2af95042c9134379b947e339ec86e213 Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: X-User-Name: admin Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: method: > Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: exception: Flavor 42 could not be found. Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: action_args: {'id': '42'} Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:32.701019 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:32.703192 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.704614 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-3c3d4460-dffc-44db-a9d5-0ccf111f9d3f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:32.706026 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-3c3d4460-dffc-44db-a9d5-0ccf111f9d3f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.425128 Oct 04 17:52:32.706026 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 17:52:32.711235 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-b6c7ec0a-4723-40ee-ac9d-bb65cef3ed2b admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.715370 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:32.736258 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-b6c7ec0a-4723-40ee-ac9d-bb65cef3ed2b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029191 Oct 04 17:52:32.736846 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:52:32.755303 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-5890919e-d8c7-4b98-9369-467b04a32b4a admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.779752 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-5890919e-d8c7-4b98-9369-467b04a32b4a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029306 Oct 04 17:52:32.780322 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:52:32.791332 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-07b6dd01-d9d5-493e-8c72-b0761066f2e0 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.796971 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.wsgi [None req-07b6dd01-d9d5-493e-8c72-b0761066f2e0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-07b6dd01-d9d5-493e-8c72-b0761066f2e0 admin admin] Request method failure captured: Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: Accept: application/json Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: Accept-Encoding: gzip, deflate Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: Connection: keep-alive Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: Content-Length: 0 Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: Host: 10.222.0.18 Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: Openstack-Api-Version: compute 2.92 Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: Openstack-System-Scope: None Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: User-Agent: python-novaclient Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Auth-Token: gAAAAABjPHLf0HIM94mEfvsbOm3GT9umphobD96rFBEGO-aQlHK9YWqa1lhIltwdXR1dYa2iCnJQxrJnPQmPbZS189mYRMpy-CW19PsahCaDhAOl8cfI2AZ-Qxq6qQLR29RSE892Ut0xzH817-woFvEH6ictpbl08oNhk-Erj9G3a3PdsoVOiYo Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Domain-Id: None Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Domain-Name: None Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Identity-Status: Confirmed Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Is-Admin-Project: True Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Domain-Id: default Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Domain-Name: Default Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Name: admin Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Role: reader,member,admin Oct 04 17:52:32.800296 n-d-850499-14 devstack@n-api.service[106260]: X-Roles: reader,member,admin Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}] Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: X-Tenant: admin Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: X-Tenant-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: X-Tenant-Name: admin Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: X-User: admin Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: X-User-Domain-Id: default Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: X-User-Domain-Name: Default Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: X-User-Id: 2af95042c9134379b947e339ec86e213 Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: X-User-Name: admin Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: method: > Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: exception: Flavor 42 could not be found. Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: action_args: {'id': '42'} Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:32.801710 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:32.802624 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.803846 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-07b6dd01-d9d5-493e-8c72-b0761066f2e0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:32.804943 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-07b6dd01-d9d5-493e-8c72-b0761066f2e0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015052 Oct 04 17:52:32.804943 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:52:34.069073 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-5890919e-d8c7-4b98-9369-467b04a32b4a admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.071400 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-5890919e-d8c7-4b98-9369-467b04a32b4a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002909 Oct 04 17:52:34.071808 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:34.615200 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-e4ba6f56-7c1a-49b2-a652-05803a78f980 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.620820 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.wsgi [None req-e4ba6f56-7c1a-49b2-a652-05803a78f980 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-e4ba6f56-7c1a-49b2-a652-05803a78f980 admin admin] Request method failure captured: Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: Accept: application/json Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: Accept-Encoding: gzip, deflate Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: Connection: keep-alive Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: Content-Length: 0 Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: Host: 10.222.0.18 Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: Openstack-Api-Version: compute 2.92 Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: Openstack-System-Scope: None Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: User-Agent: python-novaclient Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Auth-Token: gAAAAABjPHLh_WomWTc7Jn_trjp-sx5TVJtLQh7iCsRfX5G0mQl6yKMQOGu9vgF-RgKdvNz1WIJi2xYbdNIaiJHo4Ccd4jU8N7TpFS9G9_MLZu3saslqJ9oBma6aYYve_IH6tAgff4j9KcK6AJ8UnZj1n9RbdOrpAojXe_u5iLtfVRgQ8DumIMM Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Domain-Id: None Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Domain-Name: None Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Identity-Status: Confirmed Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Is-Admin-Project: True Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Domain-Id: default Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Domain-Name: Default Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Name: admin Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Role: reader,member,admin Oct 04 17:52:34.622325 n-d-850499-14 devstack@n-api.service[106260]: X-Roles: reader,member,admin Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}] Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: X-Tenant: admin Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: X-Tenant-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: X-Tenant-Name: admin Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: X-User: admin Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: X-User-Domain-Id: default Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: X-User-Domain-Name: Default Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: X-User-Id: 2af95042c9134379b947e339ec86e213 Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: X-User-Name: admin Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: method: > Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: exception: Flavor 84 could not be found. Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: action_args: {'id': '84'} Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:34.623883 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:34.624980 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.626388 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-e4ba6f56-7c1a-49b2-a652-05803a78f980 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:34.627671 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-e4ba6f56-7c1a-49b2-a652-05803a78f980 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.414429 Oct 04 17:52:34.627671 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:52:34.633594 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-a768ebd9-d10c-4d37-b953-f7e0bfb185e8 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.648674 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-a768ebd9-d10c-4d37-b953-f7e0bfb185e8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018714 Oct 04 17:52:34.649253 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:52:34.658869 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-e1f39726-2ebf-4af4-93b1-3d188ceb4d3d admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.674645 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-e1f39726-2ebf-4af4-93b1-3d188ceb4d3d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019316 Oct 04 17:52:34.675212 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:52:34.685182 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-ffdba113-171e-43c3-99f1-286b702da8cb admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.690049 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.wsgi [None req-ffdba113-171e-43c3-99f1-286b702da8cb admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-ffdba113-171e-43c3-99f1-286b702da8cb admin admin] Request method failure captured: Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: Accept: application/json Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: Accept-Encoding: gzip, deflate Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: Connection: keep-alive Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: Content-Length: 0 Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: Host: 10.222.0.18 Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: Openstack-Api-Version: compute 2.92 Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: Openstack-System-Scope: None Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: User-Agent: python-novaclient Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Auth-Token: gAAAAABjPHLh_WomWTc7Jn_trjp-sx5TVJtLQh7iCsRfX5G0mQl6yKMQOGu9vgF-RgKdvNz1WIJi2xYbdNIaiJHo4Ccd4jU8N7TpFS9G9_MLZu3saslqJ9oBma6aYYve_IH6tAgff4j9KcK6AJ8UnZj1n9RbdOrpAojXe_u5iLtfVRgQ8DumIMM Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Domain-Id: None Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Domain-Name: None Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Identity-Status: Confirmed Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Is-Admin-Project: True Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Domain-Id: default Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Domain-Name: Default Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Name: admin Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Role: reader,member,admin Oct 04 17:52:34.691598 n-d-850499-14 devstack@n-api.service[106259]: X-Roles: reader,member,admin Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}] Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: X-Tenant: admin Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: X-Tenant-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: X-Tenant-Name: admin Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: X-User: admin Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: X-User-Domain-Id: default Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: X-User-Domain-Name: Default Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: X-User-Id: 2af95042c9134379b947e339ec86e213 Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: X-User-Name: admin Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: method: > Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: exception: Flavor 84 could not be found. Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: action_args: {'id': '84'} Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:34.693102 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:34.694150 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.695583 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-ffdba113-171e-43c3-99f1-286b702da8cb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:34.696815 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-ffdba113-171e-43c3-99f1-286b702da8cb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011297 Oct 04 17:52:34.696815 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:52:35.949662 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-e1f39726-2ebf-4af4-93b1-3d188ceb4d3d admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.950683 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-e1f39726-2ebf-4af4-93b1-3d188ceb4d3d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 04 17:52:35.951123 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:36.525212 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-64155b8c-437a-4314-8120-22f781f0e4aa admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.531603 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.wsgi [None req-64155b8c-437a-4314-8120-22f781f0e4aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-64155b8c-437a-4314-8120-22f781f0e4aa admin admin] Request method failure captured: Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: Accept: application/json Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: Accept-Encoding: gzip, deflate Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: Connection: keep-alive Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: Content-Length: 0 Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: Host: 10.222.0.18 Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: Openstack-Api-Version: compute 2.92 Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: Openstack-System-Scope: None Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: User-Agent: python-novaclient Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Auth-Token: gAAAAABjPHLjc5_N_uDEGiFYepA_Zd4VUW80OP8wMAGuyvQxtwrzbOSTUPx7w5iCdojk6ARt4Q2lfLEMzS09WnXhEJMyOTiJL2OSB504q3IUUcWeItBMmQzlrhfibOHnyZGrIgMT80DpcMHja6_jHQRixSD0RLIke7H8Uqxwod8NLuxkrMUFhag Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Domain-Id: None Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Domain-Name: None Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Identity-Status: Confirmed Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Is-Admin-Project: True Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Domain-Id: default Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Domain-Name: Default Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Project-Name: admin Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Role: reader,member,admin Oct 04 17:52:36.533142 n-d-850499-14 devstack@n-api.service[106259]: X-Roles: reader,member,admin Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}] Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: X-Tenant: admin Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: X-Tenant-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: X-Tenant-Name: admin Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: X-User: admin Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: X-User-Domain-Id: default Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: X-User-Domain-Name: Default Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: X-User-Id: 2af95042c9134379b947e339ec86e213 Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: X-User-Name: admin Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: method: > Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: exception: Flavor 451 could not be found. Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: action_args: {'id': '451'} Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:36.534652 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:36.535813 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: ERROR nova.api.openstack.wsgi Oct 04 17:52:36.537849 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-64155b8c-437a-4314-8120-22f781f0e4aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:36.539805 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-64155b8c-437a-4314-8120-22f781f0e4aa admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.436167 Oct 04 17:52:36.539805 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:52:36.544658 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-37078ba8-ccf3-4cab-ba9f-281e68135c7d admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.560696 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-37078ba8-ccf3-4cab-ba9f-281e68135c7d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019573 Oct 04 17:52:36.561259 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:52:36.571944 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.587344 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019703 Oct 04 17:52:36.587913 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:52:36.597722 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-7875e98f-4a5f-48bf-885a-488f39daff5e admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.603409 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.wsgi [None req-7875e98f-4a5f-48bf-885a-488f39daff5e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-7875e98f-4a5f-48bf-885a-488f39daff5e admin admin] Request method failure captured: Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: Accept: application/json Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: Accept-Encoding: gzip, deflate Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: Connection: keep-alive Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: Content-Length: 0 Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: Host: 10.222.0.18 Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: Openstack-Api-Version: compute 2.92 Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: Openstack-System-Scope: None Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: User-Agent: python-novaclient Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Auth-Token: gAAAAABjPHLjc5_N_uDEGiFYepA_Zd4VUW80OP8wMAGuyvQxtwrzbOSTUPx7w5iCdojk6ARt4Q2lfLEMzS09WnXhEJMyOTiJL2OSB504q3IUUcWeItBMmQzlrhfibOHnyZGrIgMT80DpcMHja6_jHQRixSD0RLIke7H8Uqxwod8NLuxkrMUFhag Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Domain-Id: None Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Domain-Name: None Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Identity-Status: Confirmed Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Is-Admin-Project: True Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Domain-Id: default Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Domain-Name: Default Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Project-Name: admin Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Role: reader,member,admin Oct 04 17:52:36.604964 n-d-850499-14 devstack@n-api.service[106260]: X-Roles: reader,member,admin Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee3b7fd7fbb64041b5df9332064d06b3"}]}] Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: X-Tenant: admin Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: X-Tenant-Id: ee3b7fd7fbb64041b5df9332064d06b3 Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: X-Tenant-Name: admin Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: X-User: admin Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: X-User-Domain-Id: default Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: X-User-Domain-Name: Default Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: X-User-Id: 2af95042c9134379b947e339ec86e213 Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: X-User-Name: admin Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: method: > Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: exception: Flavor 451 could not be found. Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: action_args: {'id': '451'} Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:36.606584 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:36.607654 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: ERROR nova.api.openstack.wsgi Oct 04 17:52:36.609047 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-7875e98f-4a5f-48bf-885a-488f39daff5e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:36.610268 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-7875e98f-4a5f-48bf-885a-488f39daff5e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012381 Oct 04 17:52:36.610268 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:52:37.883701 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:37.884727 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 04 17:52:37.885140 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 4 17:52:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:38.483231 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-ea5cf052-32c9-43c7-8741-c3c4941964d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:38.504660 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-ea5cf052-32c9-43c7-8741-c3c4941964d7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.470423 Oct 04 17:52:38.505388 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 4 17:52:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:52:39.759300 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.760315 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 04 17:52:39.760721 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:40.347944 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-2e080ae5-858f-4927-b14a-94957264ddb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:40.374344 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-2e080ae5-858f-4927-b14a-94957264ddb5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.475780 Oct 04 17:52:40.375352 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 4 17:52:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:52:41.639692 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:41.640715 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 04 17:52:41.641148 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 4 17:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:42.181829 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-317cf590-79db-47d8-be7a-0cdde1047d0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:42.201444 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-317cf590-79db-47d8-be7a-0cdde1047d0e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.422885 Oct 04 17:52:42.201998 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 4 17:52:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:52:43.444072 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:43.445085 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 Oct 04 17:52:43.445480 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 4 17:52:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:43.978596 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-e79df2d6-7efd-47a9-85da-8803562d8f70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:44.000424 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-e79df2d6-7efd-47a9-85da-8803562d8f70 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.416480 Oct 04 17:52:44.000976 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 4 17:52:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:52:45.250322 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:45.251387 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 04 17:52:45.251820 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 4 17:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:45.801634 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-4ba80e05-835e-455b-898c-967a971fe1bd admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:45.822844 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-4ba80e05-835e-455b-898c-967a971fe1bd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.432227 Oct 04 17:52:45.823438 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Oct 4 17:52:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:44.303494 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:44.304516 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-483743ca-0d78-4f3c-91e4-c67a99e71676 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Oct 04 17:53:44.304917 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 4 17:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:44.316041 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:44.710132 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-782ecb98-ec20-45ba-ad2e-92f3d1c48782 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:44.731259 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-782ecb98-ec20-45ba-ad2e-92f3d1c48782 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420148 Oct 04 17:53:44.731826 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 4 17:53:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:53:44.752917 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writing DB stats nova_api:SELECT=14 {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:44.756646 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-916271a0-4344-4831-9ece-ac821c6c1b45 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:44.764290 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-916271a0-4344-4831-9ece-ac821c6c1b45 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013170 Oct 04 17:53:44.764842 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Oct 4 17:53:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:44.777846 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-05c61072-061d-4460-a924-6260333b589e admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:44.786034 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-05c61072-061d-4460-a924-6260333b589e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012131 Oct 04 17:53:44.786581 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Oct 4 17:53:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:44.798898 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-be3fa34a-8183-495a-b2c7-3298eddeb456 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:44.806794 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-be3fa34a-8183-495a-b2c7-3298eddeb456 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011756 Oct 04 17:53:44.807313 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Oct 4 17:53:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:44.819170 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-d4878df1-c06a-4b87-a72c-6bfa052433a8 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:44.827004 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-d4878df1-c06a-4b87-a72c-6bfa052433a8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011394 Oct 04 17:53:44.827551 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Oct 4 17:53:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:17.557562 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-be3fa34a-8183-495a-b2c7-3298eddeb456 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.558613 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-be3fa34a-8183-495a-b2c7-3298eddeb456 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 04 17:59:17.559042 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 4 17:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:59:17.702579 n-d-850499-14 devstack@n-api.service[106260]: DEBUG dbcounter [-] [106260] Writing DB stats nova_api:SELECT=6 {{(pid=106260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:17.880313 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-57c388b6-ff73-4b91-b785-f364a1c02cd7 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.885275 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-57c388b6-ff73-4b91-b785-f364a1c02cd7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.885763 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-57c388b6-ff73-4b91-b785-f364a1c02cd7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.886198 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-57c388b6-ff73-4b91-b785-f364a1c02cd7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.886985 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-57c388b6-ff73-4b91-b785-f364a1c02cd7 admin admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.887434 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-57c388b6-ff73-4b91-b785-f364a1c02cd7 admin admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.887853 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-57c388b6-ff73-4b91-b785-f364a1c02cd7 admin admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.927984 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-57c388b6-ff73-4b91-b785-f364a1c02cd7 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.226837 Oct 04 17:59:17.928566 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 4 17:59:17 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:19.015874 n-d-850499-14 devstack@n-api.service[106259]: DEBUG nova.api.openstack.wsgi [None req-be3fa34a-8183-495a-b2c7-3298eddeb456 admin admin] Calling method '>' {{(pid=106259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:19.017478 n-d-850499-14 devstack@n-api.service[106259]: INFO nova.api.openstack.requestlog [None req-be3fa34a-8183-495a-b2c7-3298eddeb456 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 04 17:59:19.017879 n-d-850499-14 devstack@n-api.service[106259]: [pid: 106259|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 4 17:59:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:19.206342 n-d-850499-14 devstack@n-api.service[106260]: DEBUG nova.api.openstack.wsgi [None req-0b11a501-60e4-4453-b726-83c7c7f4daa0 admin admin] Calling method '>' {{(pid=106260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:19.209918 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-0b11a501-60e4-4453-b726-83c7c7f4daa0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.210391 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-0b11a501-60e4-4453-b726-83c7c7f4daa0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.210821 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-0b11a501-60e4-4453-b726-83c7c7f4daa0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.211564 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-0b11a501-60e4-4453-b726-83c7c7f4daa0 admin admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.212012 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-0b11a501-60e4-4453-b726-83c7c7f4daa0 admin admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.212431 n-d-850499-14 devstack@n-api.service[106260]: DEBUG oslo_concurrency.lockutils [None req-0b11a501-60e4-4453-b726-83c7c7f4daa0 admin admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.235879 n-d-850499-14 devstack@n-api.service[106260]: INFO nova.api.openstack.requestlog [None req-0b11a501-60e4-4453-b726-83c7c7f4daa0 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.080950 Oct 04 17:59:19.236434 n-d-850499-14 devstack@n-api.service[106260]: [pid: 106260|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 4 17:59:19 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:05.778563 n-d-850499-14 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 18:00:05.779381 n-d-850499-14 devstack@n-api.service[106258]: Tue Oct 4 18:00:05 2022 - graceful shutdown triggered... Oct 04 18:00:05.779849 n-d-850499-14 devstack@n-api.service[106259]: Gracefully killing worker 1 (pid: 106259)... Oct 04 18:00:05.780211 n-d-850499-14 devstack@n-api.service[106260]: Gracefully killing worker 2 (pid: 106260)... Oct 04 18:00:05.905542 n-d-850499-14 devstack@n-api.service[106259]: DEBUG dbcounter [-] [106259] Writing DB stats nova_api:SELECT=4 {{(pid=106259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:06.779623 n-d-850499-14 devstack@n-api.service[106258]: worker 1 buried after 1 seconds Oct 04 18:00:06.779623 n-d-850499-14 devstack@n-api.service[106258]: worker 2 buried after 1 seconds Oct 04 18:00:06.779623 n-d-850499-14 devstack@n-api.service[106258]: goodbye to uWSGI. Oct 04 18:00:06.781333 n-d-850499-14 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 18:00:06.781908 n-d-850499-14 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 18:00:06.784743 n-d-850499-14 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 18:00:06.805220 n-d-850499-14 devstack@n-api.service[122323]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 18:00:06 2022] *** Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: nodename: n-d-850499-14 Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: machine: x86_64 Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: clock source: unix Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: pcre jit disabled Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: detected number of CPU cores: 4 Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: current working directory: / Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: detected binary path: /usr/bin/uwsgi-core Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: your processes number limit is 47680 Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: your memory page size is 4096 bytes Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: detected max file descriptor number: 2048 Oct 04 18:00:06.852249 n-d-850499-14 devstack@n-api.service[122323]: lock engine: pthread robust mutexes Oct 04 18:00:06.853441 n-d-850499-14 devstack@n-api.service[122323]: thunder lock: enabled Oct 04 18:00:06.853441 n-d-850499-14 devstack@n-api.service[122323]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 18:00:06.853441 n-d-850499-14 devstack@n-api.service[122323]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 18:00:06.892925 n-d-850499-14 devstack@n-api.service[122323]: Python main interpreter initialized at 0x55a55ba8b9c0 Oct 04 18:00:06.892925 n-d-850499-14 devstack@n-api.service[122323]: python threads support enabled Oct 04 18:00:06.892925 n-d-850499-14 devstack@n-api.service[122323]: your server socket listen backlog is limited to 100 connections Oct 04 18:00:06.892925 n-d-850499-14 devstack@n-api.service[122323]: your mercy for graceful operations on workers is 90 seconds Oct 04 18:00:06.893312 n-d-850499-14 devstack@n-api.service[122323]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 18:00:06.893401 n-d-850499-14 devstack@n-api.service[122323]: *** Operational MODE: preforking *** Oct 04 18:00:06.893632 n-d-850499-14 devstack@n-api.service[122323]: *** uWSGI is running in multiple interpreter mode *** Oct 04 18:00:06.893632 n-d-850499-14 devstack@n-api.service[122323]: spawned uWSGI master process (pid: 122323) Oct 04 18:00:06.893832 n-d-850499-14 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 18:00:06.895513 n-d-850499-14 devstack@n-api.service[122323]: spawned uWSGI worker 1 (pid: 122331, cores: 1) Oct 04 18:00:06.895513 n-d-850499-14 devstack@n-api.service[122323]: spawned uWSGI worker 2 (pid: 122332, cores: 1) Oct 04 18:00:06.895513 n-d-850499-14 devstack@n-api.service[122323]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 18:00:07.558594 n-d-850499-14 devstack@n-api.service[122331]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:00:07.559252 n-d-850499-14 devstack@n-api.service[122332]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:00:08.717974 n-d-850499-14 devstack@n-api.service[122332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:00:08.717974 n-d-850499-14 devstack@n-api.service[122332]: from cryptography.utils import int_from_bytes Oct 04 18:00:08.718694 n-d-850499-14 devstack@n-api.service[122332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:00:08.718694 n-d-850499-14 devstack@n-api.service[122332]: from cryptography.utils import int_from_bytes Oct 04 18:00:08.719162 n-d-850499-14 devstack@n-api.service[122331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:00:08.719162 n-d-850499-14 devstack@n-api.service[122331]: from cryptography.utils import int_from_bytes Oct 04 18:00:08.719607 n-d-850499-14 devstack@n-api.service[122331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:00:08.719607 n-d-850499-14 devstack@n-api.service[122331]: from cryptography.utils import int_from_bytes Oct 04 18:00:11.156313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:00:11.156994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:00:11.156994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:00:11.157322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:00:11.157589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:00:11.158522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.158853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.159202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.159683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.160020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.160337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.160664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.160991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.161324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.161591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.161908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.162238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850499-14 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.162565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.162878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.163222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.163547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.163855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.164180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.164501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.165005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.165709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.166024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.166494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.166680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.167022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.167337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.167665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.167985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.168313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.168625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.169029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850499-14 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.169351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.169671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.169988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.170405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.170511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:00:11.170870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.171149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:00:11.171253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.171356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:00:11.171466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.171650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:00:11.171891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.172004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:00:11.172112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.172293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.172412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.172618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.172719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.172943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.173041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.173265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.173394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.173622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.173782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.173946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.174105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.174248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.174438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.174571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.174770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.174870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.175132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.175239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.175402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.175502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.175727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.175829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.176051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.176152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850499-14 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.176376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.176476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.176694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.176870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.176972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.177065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.177191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.177322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.177515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.177622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.177838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.177937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.178157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.178255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.178474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.178758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.178869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.179099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.179207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.179408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.179518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.179718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.179828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.180025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.180126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.180335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.180440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.180660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.180752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.180978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.181068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.181289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.181389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.181601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.181699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.181923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.182024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.182341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850499-14 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.182450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.182560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.182655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.182875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.183056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.183243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.183390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.183567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.183682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.183878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.184000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.184200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.184304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.184526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.184617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.184837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.184940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.185146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.185284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.185453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.185586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.185775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.185870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.186109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.186200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.186418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.186551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.186774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.186864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.187010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.187161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.187293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.187510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.187616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.187786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.187879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.188096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.188196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.188406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.188507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.188662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.188753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.188974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.189075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.189820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.189927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.190147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.190238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.190459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.190557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.190728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.190822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.190991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.191087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.191365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.191483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.191679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.191816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.191990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.192084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.192298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.192405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.192624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.192724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.192957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.193158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.193290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.193407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.193585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.193741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.193896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.194003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.194210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.194303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.194531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.194630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.194844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.194965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.195184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.195305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.195509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.195609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.195817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.195916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.196127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.196227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.196451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.196558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.196761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.196866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.197068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.197220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.197389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.197501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.197692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.197792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.198009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.198107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.198334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.198442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.198643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.198733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.198975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.199124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.199262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.199404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.199576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.199709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.199883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.199983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.200190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.200289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.200460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.200557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.200768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.200868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.201078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.201170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.201400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.201498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.201714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.201812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.202024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.202123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.202331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.202430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.202635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.202779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.202947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.203201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.203289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.203373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.203575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.203710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.203887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.204005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.204198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.204302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.204506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.204614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.204878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.204979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.205198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.205337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.205511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.205612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.205825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.205918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.206155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.206248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.206482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.206584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.206798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.206898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.207165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.207266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.207492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.207598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.207815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.207916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.208142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.208237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.208453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.208554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.208767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.208869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.209090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.209182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.209401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.209503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.209713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.209819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.210039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.210146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.210354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.210473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.210667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.210793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.211010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.211127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.211317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.211412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.211629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.211722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.211959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.212067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.212273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.212377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.212583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.212676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.212895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.213000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.213206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.213317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.213513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.213614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.213823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.213915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.214137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.214316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.214511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.214733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.214895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.215074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.215183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.215271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.215408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.215515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.215726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.215818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.216042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.216133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.216358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.216526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.216671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.216761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:00:11.217013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.217112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.217329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.217461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.217655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.217749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.217983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.218074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.218299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.218400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.218708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.218817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.218974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.219078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.219265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.219359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.219579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.219671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.219887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.219987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.220195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.220288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.221038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.221136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.221355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.221460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.221665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.221765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.221989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.222082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.222325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.222434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.222658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.222759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.222987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.223081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.223311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.223417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.223627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.223739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.223945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.224063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.224261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.224378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.224569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.224672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.224888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.225027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.225204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.225302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.225514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.225613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.225843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.225935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.226159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.226275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.226470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.226588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.226792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.226904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.227130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.227260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.227444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.227585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.227767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.227913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.228090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.228232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.228406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.228538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.228722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.228865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.229039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.229170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.229366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.229507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.229683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.229811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.229995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.230126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.230311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.230449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.230629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.230771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.230947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.231132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.231298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.231423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.231623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.231764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.231941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.232081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.232251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.232384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.232566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.232699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.232875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.233017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.233215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.233350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.233491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.233636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.233773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.233900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.234085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.234216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.234559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.234714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.234834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.234998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.235127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.235237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.235384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.235523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.235713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.235911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.236128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.236303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.237629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.237836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.238008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.238132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.238294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.238445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.238445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.239389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.239573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.239712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.239826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.239956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.240092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.240203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.240203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.240417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.240528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.240638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.240748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.240858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.240984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.241131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.241268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.241406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.241535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.241662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.241797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.241939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.242110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.242267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.242382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.242510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.242672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.242877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.243050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.243182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.243321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.243458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.243597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.243727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.243866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.244001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.244138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.244275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.244418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.244575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.244784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.244908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.245018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.245145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.245287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.245423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.245552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.245677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.245815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.245953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.246082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.246209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.246344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.246468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.246605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.246801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.246922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.247144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.247286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.247423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.247551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.247684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.247801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.247910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.248037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.248164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.248299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.248439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.248568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.248693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.248847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.248986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.249147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.249369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.249545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.249666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.249778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.250007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.250112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.250345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.250447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.250664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.250799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.251135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.251326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.251474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.251680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.251873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.252010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.252166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.252273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.252440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.252597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.252723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.252859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.253006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.253153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.253370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.253551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.253690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.253808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.253934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.254087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.254280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.254420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.254650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.254801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.254913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.255110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.255249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.255418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.255567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.256048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.256187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.256299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.256409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.256526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.256646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.256765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.256895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.257015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.257135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.257435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.257607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.257734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.257874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.258004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.258139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.258276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.258414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.258583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.258742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.258907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.259099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.259263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.259368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.259573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.259676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.259882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.259980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.260215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.260306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.260532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.260623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.260844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.260938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.261161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.261262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.261480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.261583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.261795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.261930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.262111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.262210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.262426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.262524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.262744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.262842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.263096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.263213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.263418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.263512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.263734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.263828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.264045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.264152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.264357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.264455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.264672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.264779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.264988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.265094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.265314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.265406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.265615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.265718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.265931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.266032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.266246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.266344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.266556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.266648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.266872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.267013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.267250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.267352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.267613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.267842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.267947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.268184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.268286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.268505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.268649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.268829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.268937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.269155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.269246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.269481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.269583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.269797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.269898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.270112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.270205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.270425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.270526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.270734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.270879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.271062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.271196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.271374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.271509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.271684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.271789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.272000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.272125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.272310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.272401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.272620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.272719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.272928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.273033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.273242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.273429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.273589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.273692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.273824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.273968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.274132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.274275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.274439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.274531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.274756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.274928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.275097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.275198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.275394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.275527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.275705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.275807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.276031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.276137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.276348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.276449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.276655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.276767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.276967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.277132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.277296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.277437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.277608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.277776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.277918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.278063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.278215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.278367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.278535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.278673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.278861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.279008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.279203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.279506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.279612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.279698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.279843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.279938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.280163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.280303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.280472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.280568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.280782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.280882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.281199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.281317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.281412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.281497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.281705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.281994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.282099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.282320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.282412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.282635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.282736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.283483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.283609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.283795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.283938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.284108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.284218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.284417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.284518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.284738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.284830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.285057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.285150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.285366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.285467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.285675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.285767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.285991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.286092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.286303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.286394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.286610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.286702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.286938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.287102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.287258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.287356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.287569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.287661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.287882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.287974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.288193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.288292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.288506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.288617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.288820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.288960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.289130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.289231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.289437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.289543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.289753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.289852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.290067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.290182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.290374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.290732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.290934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.291106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.291268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.291362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.291577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.291728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.291885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.291979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.292196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.292296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.292522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.292635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.292842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.292943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.293150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.293288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.293464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.293607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.293772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.293867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.294085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.294210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.294392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.294499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.294706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.294807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.295034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.295144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.295344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.295446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.295650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.295749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.295958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.296105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.296266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.296358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.296592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.296692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.296901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.297000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.297199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.297300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.297508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.297600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.297814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.297916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.298124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.298217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.298445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.298616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.299334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.299514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.299668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.299817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.299991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.300083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.300304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.300407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.300618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.300709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.300935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.301026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.301249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.301349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.301558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.301656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.301876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.301967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.302187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.302281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.302505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.302595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.302817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.302908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.303151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.303252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.303461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.303561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.303782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.303948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.304108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.304261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.304408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.304559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.304738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.304854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.305058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.305160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.305372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.305472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.305683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.305788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.305999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.306115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.306309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.306417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.306618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.306798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.306934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.307072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.307274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.307385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.307592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.307695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.307903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.307995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.308218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.308317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.308528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.308625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.308837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.308958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.309148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.309254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.309458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.309559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.309770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.309946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.310090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.310235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.310388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.310544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.310685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.310826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.311016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.311156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.311319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.311472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.311615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.311755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.311913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.312015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.312223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.312448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.312585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.312697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.312873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.312984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.313187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.313287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.313552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.313651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.313866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.314038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.314209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.314311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.314532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.314652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.314843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.314976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.315182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.315299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.315505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.315603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.315818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.315914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.316143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.316235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.316461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.316560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.316783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.316884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.317105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.317197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.317418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.317521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.317728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.317820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.318036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.318128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.318346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.318476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.318683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.318826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.319004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.319111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.319334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.319441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.319651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.319750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.319970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.320114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.320289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.320396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.320607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.320785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.320927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.321108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.321248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.321428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.321569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.321759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.321889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.322153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.322245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.322493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.322646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.322804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.322912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.323154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.323388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.323482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.323789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.323959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.324120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.324436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.324536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.324758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.325069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.325167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.325447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.325705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.325809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.326092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.326315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.326415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.326836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.326937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.327194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.327513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.327604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.327844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.328139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.328264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.328487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.328757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.328894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.329102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.329361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.329464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.329729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.330092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.330231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.330378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.330696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.330857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.331105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.331424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.331568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.331734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.332045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.332189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.332375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.332684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.332785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.333012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.333334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.333433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.333663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.333953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.334046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.334291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.334584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.334676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.334922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.335218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.335320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.335553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.335861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.336050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.336208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.337145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.337304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.337422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.337422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.337657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.337754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.337847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.337945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.338120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.338457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.338549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.338783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.339106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.339219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.339442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.339732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.339825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.340076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.340388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.340494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.340687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.340937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.341039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.341331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.341432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.341759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.341893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.342151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.342346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.342616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.342775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.342930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.343124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.343275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.343580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.343872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.343872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.344256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.344387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.344489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.344620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.344891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.345000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.345104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.345183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.345300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.345992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.346285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.346380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.346603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.346735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.346941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.347163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.347337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.347450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.347601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.347785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.347929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.348114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.348241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.348456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.348556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.348798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.348891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.349125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.349227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.349457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.349600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.349777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.349871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.350106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.350198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.350434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.350592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.350756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.350863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.351105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.351201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.351542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.351653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.351883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.351987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.352210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.352304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.352550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.352644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.352895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.352997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.353211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.353303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.353530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.353630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.353848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.353955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.354164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.354264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.354483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.354621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.354792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.354929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.355149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.355279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.355475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.355569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.355801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.355903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.356124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.356218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.377936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.378342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.378591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.378728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.378728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.380004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.380175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.380522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.380687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.380911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.381104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.381238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.381361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.381505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.381621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.381750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.381865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.381981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.382093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.382093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.382300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.382428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.382535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.382639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.382732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.382823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.383016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.383126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.383219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.383310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.383400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.383499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.383592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.383712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.383827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.383953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.384129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.384260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.384390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.384535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.384535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.386681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.389035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.389214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.389343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.389470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.389470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.389689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.389813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.389928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.390039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.390154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.390277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.390402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.390542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.390671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.390800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.390800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.391195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.391767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.391767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.392144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.392346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.392478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.392561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.392736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.392867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.392945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.393110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.393280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.393441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.393573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.393670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.393770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.393880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.393952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.394894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.395066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.395302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.395378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.395462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.395533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.395649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.395723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.395791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.395858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.395970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.396926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.397951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.398926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.399968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.400997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.401952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.402988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.403985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.404949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.405999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.406995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.407154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.407254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.407342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.407415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.407484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.407552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.407649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.407761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.407856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.408481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.408578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.408672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.408765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.408867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.408963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.409969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.410866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.411946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.412013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.412112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.412276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.412435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.412587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.412750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.412897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.413088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.413207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.413406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.413533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.413827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.413956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.414242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.414353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.414506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.414591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.414816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.414900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.415163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.415268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.415723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.415815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.416032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.416110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.416342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.416418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.416682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.416943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.417036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.417294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.417387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.417626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.417704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.417959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.418034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.418288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.418364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.418609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.418686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.418927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.419036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.419274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.419422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.419593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.419675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.419910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.419986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.420236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.420310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.420554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.420704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.420871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.420951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.421189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.421267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.421506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.421585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.421842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.421930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.422139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.422219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.422458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.422534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.422779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.422858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.423130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.423232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.423448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.423570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.424406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.424552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.424635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.424708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.424960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.425050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.425277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.425373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.425613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.425701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.425933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.426021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.426250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.426346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.426567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.426654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.426884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.427006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.427227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.427332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.427546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.427632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.427859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.427945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.428176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.428265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.428504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.428591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.428825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.428912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.429139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.429226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.429479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.429600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.431893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.432573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.432666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.432729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.432787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.432844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.432916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.432978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:00:11.433166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.436857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.436857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.436857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.436857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.436857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.436857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.436857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.436857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.437949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.437949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.437949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.437949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.437949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.437949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.437949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.438365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.438365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.438675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.439016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.439348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.439665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.439978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.440295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.440607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.440919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.441232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.441545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.441856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.442200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.442544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.442873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.443230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.443549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.443883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.444204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.444536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.444868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.445197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.445514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.445857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.446179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.446497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.446829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.447159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.447478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.447800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.448140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.448480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.448797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.449185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.449457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.449787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.450113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.450434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.450772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.451116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.451441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.451761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.452080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.452398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.452722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.453039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.453361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.453683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.454006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.454344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.454679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.455071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.455411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.455744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.456103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.456424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.456783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.457130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.457455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.457779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.458093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:00:11.458361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:00:11.494718 n-d-850499-14 devstack@n-api.service[122331]: INFO dbcounter [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Registered counter for database nova_api Oct 04 18:00:11.515049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_db.sqlalchemy.engines [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:00:11.520759 n-d-850499-14 devstack@n-api.service[122332]: INFO dbcounter [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Registered counter for database nova_api Oct 04 18:00:11.522164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writer thread running {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:00:11.550578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_db.sqlalchemy.engines [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:00:11.557283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writer thread running {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:00:11.578459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.context [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) {{(pid=122331) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:00:11.583026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.583505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.585095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.586132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.586584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.588599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.590598 n-d-850499-14 devstack@n-api.service[122331]: INFO dbcounter [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Registered counter for database nova_cell0 Oct 04 18:00:11.594717 n-d-850499-14 devstack@n-api.service[122331]: INFO dbcounter [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Registered counter for database nova_cell1 Oct 04 18:00:11.602116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_db.sqlalchemy.engines [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:00:11.603721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_db.sqlalchemy.engines [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:00:11.609256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writer thread running {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:00:11.612644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writer thread running {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:00:11.613832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.context [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) {{(pid=122332) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:00:11.617915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.618401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.620021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.620769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.621226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.623262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.625290 n-d-850499-14 devstack@n-api.service[122332]: INFO dbcounter [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Registered counter for database nova_cell0 Oct 04 18:00:11.629934 n-d-850499-14 devstack@n-api.service[122332]: INFO dbcounter [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Registered counter for database nova_cell1 Oct 04 18:00:11.637310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_db.sqlalchemy.engines [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:00:11.639029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_db.sqlalchemy.engines [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:00:11.645018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writer thread running {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:00:11.646635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writer thread running {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:00:11.764922 n-d-850499-14 devstack@n-api.service[122331]: INFO dbcounter [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Registered counter for database nova_cell0 Oct 04 18:00:11.771702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_db.sqlalchemy.engines [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:00:11.776497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writer thread running {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:00:11.800420 n-d-850499-14 devstack@n-api.service[122332]: INFO dbcounter [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Registered counter for database nova_cell0 Oct 04 18:00:11.809387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_db.sqlalchemy.engines [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:00:11.814070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writer thread running {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:00:12.096994 n-d-850499-14 devstack@n-api.service[122331]: WARNING keystonemiddleware.auth_token [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:00:12.104464 n-d-850499-14 devstack@n-api.service[122331]: WARNING keystonemiddleware.auth_token [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:00:12.138152 n-d-850499-14 devstack@n-api.service[122332]: WARNING keystonemiddleware.auth_token [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:00:12.146303 n-d-850499-14 devstack@n-api.service[122332]: WARNING keystonemiddleware.auth_token [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:00:12.451363 n-d-850499-14 devstack@n-api.service[122331]: WARNING keystonemiddleware.auth_token [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:00:12.457951 n-d-850499-14 devstack@n-api.service[122331]: WARNING keystonemiddleware.auth_token [None req-90b887eb-b49f-4610-8cd2-9365c476977f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:00:12.463318 n-d-850499-14 devstack@n-api.service[122331]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a55ba8b9c0 pid: 122331 (default app) Oct 04 18:00:12.494652 n-d-850499-14 devstack@n-api.service[122332]: WARNING keystonemiddleware.auth_token [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:00:12.500731 n-d-850499-14 devstack@n-api.service[122332]: WARNING keystonemiddleware.auth_token [None req-ecf49e8e-8e24-416a-baa5-5b12f62828f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:00:12.506667 n-d-850499-14 devstack@n-api.service[122332]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a55ba8b9c0 pid: 122332 (default app) Oct 04 18:00:55.537480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:55.542140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:55.544485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:55.546262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:55.580982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:55.582196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:55.583540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:55.584570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:57.303617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c7a9f9e6-da4f-4606-9514-2758307e75d9 tempest-InstanceUsageAuditLogTestJSON-523256164 tempest-InstanceUsageAuditLogTestJSON-523256164-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:57.341508 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c7a9f9e6-da4f-4606-9514-2758307e75d9 tempest-InstanceUsageAuditLogTestJSON-523256164 tempest-InstanceUsageAuditLogTestJSON-523256164-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 18:00:55" status: 200 len: 318 microversion: 2.1 time: 1.815362 Oct 04 18:00:57.342471 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1/1] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:00:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018%3A00%3A55 => generated 318 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:57.442435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '.version_select at 0x7fd4d39b0040>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:57.451816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) {{(pid=122332) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 18:00:57.452972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.453693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.454594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.494052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.494932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.495469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.515468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.516298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.517817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.528838 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22bfcb1c-c5ea-4c32-9142-46b6e921a039 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.958403 Oct 04 18:00:57.531115 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 4 18:00:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:57.621538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Calling method '.version_select at 0x7fd4d39b3280>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:57.638785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) {{(pid=122331) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 18:00:57.639554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.640261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.640896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.669639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.670373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.670984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.685704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.686202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.686633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.698681 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6a0377d7-76cf-4257-ac4b-f34b2ec62be5 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.354673 Oct 04 18:00:57.699481 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1208 bytes} [Tue Oct 4 18:00:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:57.841884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-898f6f3e-2906-42be-b81b-b501df3f16c1 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:57.844500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-898f6f3e-2906-42be-b81b-b501df3f16c1 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.846151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-898f6f3e-2906-42be-b81b-b501df3f16c1 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.849632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-898f6f3e-2906-42be-b81b-b501df3f16c1 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.851335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-898f6f3e-2906-42be-b81b-b501df3f16c1 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.853123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-898f6f3e-2906-42be-b81b-b501df3f16c1 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.853689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-898f6f3e-2906-42be-b81b-b501df3f16c1 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.915922 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-898f6f3e-2906-42be-b81b-b501df3f16c1 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.382894 Oct 04 18:00:57.917439 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1164 bytes} [Tue Oct 4 18:00:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:00:58.104997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2050515685", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:58.118904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bdea3537-cde7-41a5-a417-98138af419da tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-811138495", "id": 519836209, "os-flavor-access:is_public": "False"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:58.211000 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bdea3537-cde7-41a5-a417-98138af419da tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.509170 Oct 04 18:00:58.220972 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3/5] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:57 2022] POST /compute/v2.1/flavors => generated 427 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:58.226290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-33e89381-3a61-481a-aa2e-3bef37b1f969 tempest-InstanceUsageAuditLogTestJSON-523256164 tempest-InstanceUsageAuditLogTestJSON-523256164-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:58.241203 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-33e89381-3a61-481a-aa2e-3bef37b1f969 tempest-InstanceUsageAuditLogTestJSON-523256164 tempest-InstanceUsageAuditLogTestJSON-523256164-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.018318 Oct 04 18:00:58.251307 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4/6] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 4 18:00:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:58.257595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d3dd2b8d-21b5-4304-bdc0-aa8d19893b94 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1309640148", "name": "tempest-test_aggregate-664593380"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:58.280330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-d3dd2b8d-21b5-4304-bdc0-aa8d19893b94 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Generated uuid 6c8afafb-7110-4313-b259-c931743df69c for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:00:58.383275 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d3dd2b8d-21b5-4304-bdc0-aa8d19893b94 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.128709 Oct 04 18:00:58.385258 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 5/7] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 4 18:00:58 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:58.398538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7215fbe7-0f72-42ec-aca6-162d47c4be26 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:58.401386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7215fbe7-0f72-42ec-aca6-162d47c4be26 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:58.402233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7215fbe7-0f72-42ec-aca6-162d47c4be26 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:58.402873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7215fbe7-0f72-42ec-aca6-162d47c4be26 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:58.403952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7215fbe7-0f72-42ec-aca6-162d47c4be26 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:58.404629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7215fbe7-0f72-42ec-aca6-162d47c4be26 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:58.405187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7215fbe7-0f72-42ec-aca6-162d47c4be26 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:58.457899 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7215fbe7-0f72-42ec-aca6-162d47c4be26 tempest-AZAdminV2TestJSON-2128578800 tempest-AZAdminV2TestJSON-2128578800-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.071193 Oct 04 18:00:58.463288 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 6/8] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 4 18:00:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:58.473276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e7621e1a-107a-4382-9980-9d8eaaf00d47 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "007ab67174dc46f8b31ae23d68e0f91c"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:59.228068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:00:59.548918 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e7621e1a-107a-4382-9980-9d8eaaf00d47 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/519836209/action" status: 200 len: 96 microversion: 2.1 time: 1.082936 Oct 04 18:00:59.562385 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 7/9] 10.222.0.18 () {60 vars in 1197 bytes} [Tue Oct 4 18:00:58 2022] POST /compute/v2.1/flavors/519836209/action => generated 96 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:00:59.575711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b09ac769-0c13-47f2-b800-954765f9f0af tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:59.615007 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b09ac769-0c13-47f2-b800-954765f9f0af tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.048655 Oct 04 18:00:59.617216 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 8/10] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:00:59 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:59.823924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:00:59.824359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:00:59.824838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:00:59.825311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:00:59.825731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:00:59.841127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:59.841624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:59.842398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:59.843537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:59.844214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:59.845093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:59.857757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d93c13f6-578c-4d3a-b814-1589e19a358a tempest-FlavorsAccessTestJSON-902134575 tempest-FlavorsAccessTestJSON-902134575-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:59.880311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Getting quotas for project 503b4405932b44a1849afd220dab32e0. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:59.889715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Getting quotas for user c625dcc139fa4de8a866970b4c0a1cd0 and project 503b4405932b44a1849afd220dab32e0. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:59.914308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:00:59.918067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:00:59.966053 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d93c13f6-578c-4d3a-b814-1589e19a358a tempest-FlavorsAccessTestJSON-902134575 tempest-FlavorsAccessTestJSON-902134575-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.338984 Oct 04 18:00:59.966898 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 9/11] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:00:59 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:59.973169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b4a6c345-3065-4ab4-93e3-f6fac250b8ec tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:00.000852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4a6c345-3065-4ab4-93e3-f6fac250b8ec tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:00.002240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4a6c345-3065-4ab4-93e3-f6fac250b8ec tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:00.013666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4a6c345-3065-4ab4-93e3-f6fac250b8ec tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:00.028820 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-be4a2766-082b-42ee-98fc-a5f02a47f2ad tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.108828 Oct 04 18:01:00.030871 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3/12] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:01:00.044301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f406dcd2-de3f-45c9-a26a-4e9c71cf1f3f tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "007ab67174dc46f8b31ae23d68e0f91c"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:00.613827 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f406dcd2-de3f-45c9-a26a-4e9c71cf1f3f tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/519836209/action" status: 200 len: 21 microversion: 2.1 time: 0.581416 Oct 04 18:01:00.615512 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4/13] 10.222.0.18 () {60 vars in 1197 bytes} [Tue Oct 4 18:01:00 2022] POST /compute/v2.1/flavors/519836209/action => generated 21 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:01:00.622232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a16e4904-1fbd-4dd3-9ecf-d8ea012940c7 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:00.623790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a16e4904-1fbd-4dd3-9ecf-d8ea012940c7 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:00.839863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a16e4904-1fbd-4dd3-9ecf-d8ea012940c7 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:00.870816 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a16e4904-1fbd-4dd3-9ecf-d8ea012940c7 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1220 microversion: 2.1 time: 0.253780 Oct 04 18:01:00.871506 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 5/14] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:00 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1220 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:01.381804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-132c875c-9c75-4c86-865d-142acac12967 tempest-AZAdminNegativeTestJSON-1352559505 tempest-AZAdminNegativeTestJSON-1352559505-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.383356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-132c875c-9c75-4c86-865d-142acac12967 tempest-AZAdminNegativeTestJSON-1352559505 tempest-AZAdminNegativeTestJSON-1352559505-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '2dfc0fb818644015b4ff068b5ba105e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4532e46f7be94653a43fbbb72df31c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-132c875c-9c75-4c86-865d-142acac12967 tempest-AZAdminNegativeTestJSON-1352559505 tempest-AZAdminNegativeTestJSON-1352559505-project] Request method failure captured: Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTaANWhyxXXYnurS7cMEwPTEPcSbQ35KBBq8x8uMmoHZ2bk53sZxKycs8XDsHoSyfwGN4JJCTmKVdvaahxDG3UA2Oqbm8vhICkJIZL4xYQXTcQnQfte_gNEb3ju2deiAhXVefj-6qcFDSL9aM46cqyANT_sSUsmWkvLN2XDWYChVjM Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 4532e46f7be94653a43fbbb72df31c80 Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1352559505 Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:01.389036 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4532e46f7be94653a43fbbb72df31c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4532e46f7be94653a43fbbb72df31c80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4532e46f7be94653a43fbbb72df31c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4532e46f7be94653a43fbbb72df31c80"}]}] Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AZAdminNegativeTestJSON-1352559505 Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 4532e46f7be94653a43fbbb72df31c80 Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1352559505 Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AZAdminNegativeTestJSON-1352559505-project Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 2dfc0fb818644015b4ff068b5ba105e6 Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AZAdminNegativeTestJSON-1352559505-project Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:01:01.390396 n-d-850499-14 devstack@n-api.service[122332]: action_args: {} Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:01.391090 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:01.392195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-132c875c-9c75-4c86-865d-142acac12967 tempest-AZAdminNegativeTestJSON-1352559505 tempest-AZAdminNegativeTestJSON-1352559505-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:01.393846 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-132c875c-9c75-4c86-865d-142acac12967 tempest-AZAdminNegativeTestJSON-1352559505 tempest-AZAdminNegativeTestJSON-1352559505-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.519583 Oct 04 18:01:01.394278 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 6/15] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 4 18:01:00 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 522 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:01.402852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c4fa6957-54a2-4ca1-bad4-602304cdd213 tempest-FlavorsAccessTestJSON-902134575 tempest-FlavorsAccessTestJSON-902134575-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.469291 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c4fa6957-54a2-4ca1-bad4-602304cdd213 tempest-FlavorsAccessTestJSON-902134575 tempest-FlavorsAccessTestJSON-902134575-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073056 Oct 04 18:01:01.471145 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 7/16] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:01.511200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a66f753d-f38b-4d97-acd0-c13873b66233 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.592102 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a66f753d-f38b-4d97-acd0-c13873b66233 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/519836209" status: 202 len: 0 microversion: 2.1 time: 0.101921 Oct 04 18:01:01.593268 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 8/17] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:01:01 2022] DELETE /compute/v2.1/flavors/519836209 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:01.604625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ddd7987-4cc5-4e4f-a1dd-87fc1d5b2779 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.649964 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b4a6c345-3065-4ab4-93e3-f6fac250b8ec tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.681300 Oct 04 18:01:01.673932 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 10/18] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 4 18:00:59 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:01.674665 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ddd7987-4cc5-4e4f-a1dd-87fc1d5b2779 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077131 Oct 04 18:01:01.676341 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 9/19] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:01.708260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94dd51d9-ad8d-4351-a410-e90e6e83177c tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-77774603", "id": 1012357667, "os-flavor-access:is_public": "False"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:01.737612 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-94dd51d9-ad8d-4351-a410-e90e6e83177c tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.036520 Oct 04 18:01:01.738938 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:01 2022] POST /compute/v2.1/flavors => generated 429 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:01.752473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bbbb3dbd-e418-49ef-805e-520d838a9fb2 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.779993 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bbbb3dbd-e418-49ef-805e-520d838a9fb2 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1012357667/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.032445 Oct 04 18:01:01.780608 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 10/21] 10.222.0.18 () {58 vars in 1209 bytes} [Tue Oct 4 18:01:01 2022] GET /compute/v2.1/flavors/1012357667/os-flavor-access => generated 21 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:01:01.792210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-51edb5fb-e2fc-4d76-9393-16727b949d85 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.862004 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-51edb5fb-e2fc-4d76-9393-16727b949d85 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1012357667" status: 202 len: 0 microversion: 2.1 time: 0.074368 Oct 04 18:01:01.867521 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 12/22] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:01:01 2022] DELETE /compute/v2.1/flavors/1012357667 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:01:01.871730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-65a34603-3d91-4a77-8949-889bdaf03158 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.899344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b1689002-fc3e-4b34-b65b-b8f33a52796b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:01.900567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b1689002-fc3e-4b34-b65b-b8f33a52796b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:01.922629 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-65a34603-3d91-4a77-8949-889bdaf03158 tempest-FlavorsAccessTestJSON-702763275 tempest-FlavorsAccessTestJSON-702763275-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032981 Oct 04 18:01:01.933210 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:03.050853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-13313793", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "availability_zone": "tempest-test_az-1309640148"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:03.089076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:03.091129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:03.092997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:03.094167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:03.098812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:03.099634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:03.283087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:01:04.422152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1689002-fc3e-4b34-b65b-b8f33a52796b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:04.450182 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b1689002-fc3e-4b34-b65b-b8f33a52796b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1220 microversion: 2.1 time: 2.556943 Oct 04 18:01:04.453538 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 13/24] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:01 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1220 bytes in 2561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:05.121733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:05.122890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:05.123980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:05.124596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:05.125149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:05.162731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:05.163347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:05.163964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.166245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:05.171346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:05.172162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.241811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Getting quotas for project 9d5e6b123c054021aaea2e02aa5dcec7. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:05.265618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Getting quotas for user 8bf35f8a9af242e8877d4c8432e44771 and project 9d5e6b123c054021aaea2e02aa5dcec7. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:05.309962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:01:05.312213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:01:05.485687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d5404cc0-1d7a-44ad-9508-2ad0824da10f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:05.486938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d5404cc0-1d7a-44ad-9508-2ad0824da10f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:05.556614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5404cc0-1d7a-44ad-9508-2ad0824da10f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:05.557485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5404cc0-1d7a-44ad-9508-2ad0824da10f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:05.563284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5404cc0-1d7a-44ad-9508-2ad0824da10f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.572012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5404cc0-1d7a-44ad-9508-2ad0824da10f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:05.573349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5404cc0-1d7a-44ad-9508-2ad0824da10f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:05.574261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5404cc0-1d7a-44ad-9508-2ad0824da10f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.610237 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-368d7b15-a112-4692-9d86-3a9b5743ab51 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.362607 Oct 04 18:01:05.615413 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 12/25] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:01:05.646521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3dc090da-f0c5-4ebe-8836-e4b069cfc921 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:05.656350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3dc090da-f0c5-4ebe-8836-e4b069cfc921 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:06.112687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3dc090da-f0c5-4ebe-8836-e4b069cfc921 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:06.159897 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3dc090da-f0c5-4ebe-8836-e4b069cfc921 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1241 microversion: 2.1 time: 0.538040 Oct 04 18:01:06.167648 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 13/26] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:05 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1241 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:06.348893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d5404cc0-1d7a-44ad-9508-2ad0824da10f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:06.378138 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d5404cc0-1d7a-44ad-9508-2ad0824da10f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1300 microversion: 2.1 time: 0.902950 Oct 04 18:01:06.378736 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:05 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1300 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:07.190407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ddfdbc2f-3382-4449-9a04-38f3a17fae9f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:07.191357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ddfdbc2f-3382-4449-9a04-38f3a17fae9f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:07.434091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b61875ab-b822-4c36-b4f4-1fd11b72f156 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:07.435426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b61875ab-b822-4c36-b4f4-1fd11b72f156 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:07.446703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b61875ab-b822-4c36-b4f4-1fd11b72f156 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:07.447589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b61875ab-b822-4c36-b4f4-1fd11b72f156 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:07.448494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b61875ab-b822-4c36-b4f4-1fd11b72f156 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:07.449364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b61875ab-b822-4c36-b4f4-1fd11b72f156 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:07.449974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b61875ab-b822-4c36-b4f4-1fd11b72f156 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:07.450551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b61875ab-b822-4c36-b4f4-1fd11b72f156 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:07.592054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ddfdbc2f-3382-4449-9a04-38f3a17fae9f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:07.602650 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ddfdbc2f-3382-4449-9a04-38f3a17fae9f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1241 microversion: 2.1 time: 0.416720 Oct 04 18:01:07.603854 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 14/28] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:07 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1241 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:07.894314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b61875ab-b822-4c36-b4f4-1fd11b72f156 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:07.904510 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b61875ab-b822-4c36-b4f4-1fd11b72f156 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1300 microversion: 2.1 time: 0.476140 Oct 04 18:01:07.934810 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 15/29] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:07 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1300 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:08.634519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c3504466-40c3-47da-aa0a-ea187d5abcbb tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:08.636113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c3504466-40c3-47da-aa0a-ea187d5abcbb tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:08.660299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3504466-40c3-47da-aa0a-ea187d5abcbb tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:08.666562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3504466-40c3-47da-aa0a-ea187d5abcbb tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:08.667911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3504466-40c3-47da-aa0a-ea187d5abcbb tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:08.675318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3504466-40c3-47da-aa0a-ea187d5abcbb tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:08.676610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3504466-40c3-47da-aa0a-ea187d5abcbb tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:08.682207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3504466-40c3-47da-aa0a-ea187d5abcbb tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:08.954877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2820985-4e8d-49d4-b29f-aa2f9a575905 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:08.960230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a2820985-4e8d-49d4-b29f-aa2f9a575905 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:08.975777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:09.018013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2820985-4e8d-49d4-b29f-aa2f9a575905 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:09.027843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2820985-4e8d-49d4-b29f-aa2f9a575905 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:09.030037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2820985-4e8d-49d4-b29f-aa2f9a575905 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:09.031747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2820985-4e8d-49d4-b29f-aa2f9a575905 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:09.033172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2820985-4e8d-49d4-b29f-aa2f9a575905 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:09.035452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2820985-4e8d-49d4-b29f-aa2f9a575905 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:09.619257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c3504466-40c3-47da-aa0a-ea187d5abcbb tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:09.665983 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c3504466-40c3-47da-aa0a-ea187d5abcbb tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1289 microversion: 2.1 time: 1.043834 Oct 04 18:01:09.691505 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 15/30] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:08 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1289 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:09.786679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a2820985-4e8d-49d4-b29f-aa2f9a575905 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:09.800313 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a2820985-4e8d-49d4-b29f-aa2f9a575905 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.868109 Oct 04 18:01:09.808591 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 16/31] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:08 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:10.712968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-412883f7-e1f9-423e-8531-acc26a6e4d6a tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:10.713905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-412883f7-e1f9-423e-8531-acc26a6e4d6a tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:10.749487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-412883f7-e1f9-423e-8531-acc26a6e4d6a tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:10.752068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-412883f7-e1f9-423e-8531-acc26a6e4d6a tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:10.752544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-412883f7-e1f9-423e-8531-acc26a6e4d6a tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:10.754159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-412883f7-e1f9-423e-8531-acc26a6e4d6a tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:10.757387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-412883f7-e1f9-423e-8531-acc26a6e4d6a tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:10.758112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-412883f7-e1f9-423e-8531-acc26a6e4d6a tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:10.844936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b39f598-dd1e-44fd-b5c5-fe348192c796 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:10.845792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3b39f598-dd1e-44fd-b5c5-fe348192c796 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:10.875059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b39f598-dd1e-44fd-b5c5-fe348192c796 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:10.875700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b39f598-dd1e-44fd-b5c5-fe348192c796 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:10.876181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b39f598-dd1e-44fd-b5c5-fe348192c796 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:10.889156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b39f598-dd1e-44fd-b5c5-fe348192c796 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:10.889832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b39f598-dd1e-44fd-b5c5-fe348192c796 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:10.890320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b39f598-dd1e-44fd-b5c5-fe348192c796 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:11.216204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-412883f7-e1f9-423e-8531-acc26a6e4d6a tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:11.236730 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-412883f7-e1f9-423e-8531-acc26a6e4d6a tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1295 microversion: 2.1 time: 0.544265 Oct 04 18:01:11.266774 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 16/32] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:10 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1295 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:11.649592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b39f598-dd1e-44fd-b5c5-fe348192c796 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:11.713406 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b39f598-dd1e-44fd-b5c5-fe348192c796 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.865646 Oct 04 18:01:11.727485 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 17/33] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:10 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:12.266840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ad183aef-1032-49d5-ac03-ade93b61da1d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:12.268589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ad183aef-1032-49d5-ac03-ade93b61da1d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:12.312760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad183aef-1032-49d5-ac03-ade93b61da1d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:12.313429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad183aef-1032-49d5-ac03-ade93b61da1d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:12.317457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad183aef-1032-49d5-ac03-ade93b61da1d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:12.319390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad183aef-1032-49d5-ac03-ade93b61da1d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:12.320139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad183aef-1032-49d5-ac03-ade93b61da1d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:12.321082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad183aef-1032-49d5-ac03-ade93b61da1d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:12.474360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ad183aef-1032-49d5-ac03-ade93b61da1d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:12.536768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ad183aef-1032-49d5-ac03-ade93b61da1d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1295 microversion: 2.1 time: 0.269713 Oct 04 18:01:12.558981 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 17/34] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:12 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1295 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:12.744741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34005cc8-52c3-4c11-80c8-63d3e219e09f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:12.745494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34005cc8-52c3-4c11-80c8-63d3e219e09f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:12.757224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34005cc8-52c3-4c11-80c8-63d3e219e09f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:12.757910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34005cc8-52c3-4c11-80c8-63d3e219e09f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:12.759618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34005cc8-52c3-4c11-80c8-63d3e219e09f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:12.771677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34005cc8-52c3-4c11-80c8-63d3e219e09f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:12.774284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34005cc8-52c3-4c11-80c8-63d3e219e09f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:12.774939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34005cc8-52c3-4c11-80c8-63d3e219e09f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:13.291233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34005cc8-52c3-4c11-80c8-63d3e219e09f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:13.302133 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34005cc8-52c3-4c11-80c8-63d3e219e09f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.561910 Oct 04 18:01:13.315248 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 18/35] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:12 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:13.577158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4870f978-6028-4bed-91cf-bf34d71db47d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:13.586627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4870f978-6028-4bed-91cf-bf34d71db47d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:13.617323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4870f978-6028-4bed-91cf-bf34d71db47d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:13.621065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4870f978-6028-4bed-91cf-bf34d71db47d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:13.621975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4870f978-6028-4bed-91cf-bf34d71db47d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:13.626421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4870f978-6028-4bed-91cf-bf34d71db47d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:13.627390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4870f978-6028-4bed-91cf-bf34d71db47d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:13.631641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4870f978-6028-4bed-91cf-bf34d71db47d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:13.785347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4870f978-6028-4bed-91cf-bf34d71db47d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:13.798301 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4870f978-6028-4bed-91cf-bf34d71db47d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1295 microversion: 2.1 time: 0.235332 Oct 04 18:01:13.798808 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 19/36] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:13 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1295 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:14.427054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96ad7630-2dec-49cd-8725-809f3c4c5897 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d2d86ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:14.450698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:14.729515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-82a077db-e060-4b4f-9eeb-cec0f5057f20 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-241215480", "id": 434520629, "os-flavor-access:is_public": "False"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:14.813186 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-82a077db-e060-4b4f-9eeb-cec0f5057f20 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.902598 Oct 04 18:01:14.818703 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 20/37] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:13 2022] POST /compute/v2.1/flavors => generated 435 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:14.841836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbe664db-2cad-40e1-8580-08e8742c60a9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:14.843159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bbe664db-2cad-40e1-8580-08e8742c60a9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:14.859958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe664db-2cad-40e1-8580-08e8742c60a9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:14.863637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe664db-2cad-40e1-8580-08e8742c60a9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:14.864651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe664db-2cad-40e1-8580-08e8742c60a9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:14.866294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe664db-2cad-40e1-8580-08e8742c60a9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:14.867669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe664db-2cad-40e1-8580-08e8742c60a9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:14.868518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe664db-2cad-40e1-8580-08e8742c60a9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:14.869367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ad7630-2dec-49cd-8725-809f3c4c5897 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:14.869863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ad7630-2dec-49cd-8725-809f3c4c5897 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:14.870300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ad7630-2dec-49cd-8725-809f3c4c5897 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:14.871083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ad7630-2dec-49cd-8725-809f3c4c5897 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:14.880336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ad7630-2dec-49cd-8725-809f3c4c5897 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:14.880741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ad7630-2dec-49cd-8725-809f3c4c5897 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:15.108354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:15.142633 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96ad7630-2dec-49cd-8725-809f3c4c5897 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/80e4842c800040c5af818b9717c4c60b" status: 200 len: 148 microversion: 2.57 time: 1.582653 Oct 04 18:01:15.148724 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 18/38] 10.222.0.18 () {62 vars in 1303 bytes} [Tue Oct 4 18:01:13 2022] PUT /compute/v2.1/os-quota-sets/80e4842c800040c5af818b9717c4c60b => generated 148 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:01:15.184374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-83c2ab2d-50b1-49c2-8a12-3b654edbcbd3 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e8f4430029dc4526a06ebc4138491601"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:16.072818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bbe664db-2cad-40e1-8580-08e8742c60a9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:16.101091 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bbe664db-2cad-40e1-8580-08e8742c60a9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 1.279548 Oct 04 18:01:16.111518 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 21/39] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:14 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:16.139258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0df45a41-e0a9-4b3e-b32f-deccc2814533 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:16.140278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0df45a41-e0a9-4b3e-b32f-deccc2814533 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:16.171713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0df45a41-e0a9-4b3e-b32f-deccc2814533 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:16.181274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0df45a41-e0a9-4b3e-b32f-deccc2814533 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:16.183192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0df45a41-e0a9-4b3e-b32f-deccc2814533 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:16.185959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0df45a41-e0a9-4b3e-b32f-deccc2814533 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:16.189660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0df45a41-e0a9-4b3e-b32f-deccc2814533 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:16.190658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0df45a41-e0a9-4b3e-b32f-deccc2814533 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:16.552572 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-83c2ab2d-50b1-49c2-8a12-3b654edbcbd3 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/434520629/action" status: 200 len: 96 microversion: 2.1 time: 1.395386 Oct 04 18:01:16.566113 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 19/40] 10.222.0.18 () {60 vars in 1197 bytes} [Tue Oct 4 18:01:15 2022] POST /compute/v2.1/flavors/434520629/action => generated 96 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:01:16.574899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef7efa2d-edae-477d-9e9c-ed9a77a965f7 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Calling method '.version_select at 0x7fd4d2e67310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:17.184458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0df45a41-e0a9-4b3e-b32f-deccc2814533 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:17.208405 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0df45a41-e0a9-4b3e-b32f-deccc2814533 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 1.094519 Oct 04 18:01:17.214662 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 22/41] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:16 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:17.385708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef7efa2d-edae-477d-9e9c-ed9a77a965f7 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.387740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef7efa2d-edae-477d-9e9c-ed9a77a965f7 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.389082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef7efa2d-edae-477d-9e9c-ed9a77a965f7 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.394770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef7efa2d-edae-477d-9e9c-ed9a77a965f7 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.395997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef7efa2d-edae-477d-9e9c-ed9a77a965f7 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.397516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef7efa2d-edae-477d-9e9c-ed9a77a965f7 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.459581 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ef7efa2d-edae-477d-9e9c-ed9a77a965f7 tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/80e4842c800040c5af818b9717c4c60b/detail" status: 200 len: 463 microversion: 2.57 time: 0.891800 Oct 04 18:01:17.472448 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 20/42] 10.222.0.18 () {60 vars in 1304 bytes} [Tue Oct 4 18:01:16 2022] GET /compute/v2.1/os-quota-sets/80e4842c800040c5af818b9717c4c60b/detail => generated 463 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:01:17.485573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c17b53ca-893f-40c0-9fa3-3d02586183ec tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e8f4430029dc4526a06ebc4138491601"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:17.791196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4e1425b5-029b-470b-bbe4-3812737451ab req-4600a8b4-0bf6-4ecd-b5ad-1407f2ad15c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43863d88-b381-47c7-bcca-437f6f58d2af", "tag": "781006ab-7324-4a24-a0d7-aa8e1a5bd3e1"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:17.866102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4e1425b5-029b-470b-bbe4-3812737451ab req-4600a8b4-0bf6-4ecd-b5ad-1407f2ad15c7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.867042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4e1425b5-029b-470b-bbe4-3812737451ab req-4600a8b4-0bf6-4ecd-b5ad-1407f2ad15c7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.867617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4e1425b5-029b-470b-bbe4-3812737451ab req-4600a8b4-0bf6-4ecd-b5ad-1407f2ad15c7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.964754 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4e1425b5-029b-470b-bbe4-3812737451ab req-4600a8b4-0bf6-4ecd-b5ad-1407f2ad15c7 service nova] Creating event network-changed:781006ab-7324-4a24-a0d7-aa8e1a5bd3e1 for instance 43863d88-b381-47c7-bcca-437f6f58d2af on n-h1-850499-14 Oct 04 18:01:17.966160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4e1425b5-029b-470b-bbe4-3812737451ab req-4600a8b4-0bf6-4ecd-b5ad-1407f2ad15c7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:01:17.968828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4e1425b5-029b-470b-bbe4-3812737451ab req-4600a8b4-0bf6-4ecd-b5ad-1407f2ad15c7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:01:17.971231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8af96ac-7057-46a9-880c-cbc6f877d45b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.972103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8af96ac-7057-46a9-880c-cbc6f877d45b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.975587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8af96ac-7057-46a9-880c-cbc6f877d45b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.980450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8af96ac-7057-46a9-880c-cbc6f877d45b None None] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.981271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8af96ac-7057-46a9-880c-cbc6f877d45b None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.981920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8af96ac-7057-46a9-880c-cbc6f877d45b None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.992194 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.compute.rpcapi [None req-a8af96ac-7057-46a9-880c-cbc6f877d45b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 18:01:17.993442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8af96ac-7057-46a9-880c-cbc6f877d45b None None] Releasing lock "compute-rpcapi-router" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:01:18.014821 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a8af96ac-7057-46a9-880c-cbc6f877d45b None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.797328 Oct 04 18:01:18.037627 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 23/43] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:18.060775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-10dfb083-d8d9-4b02-a885-981addfa3e57 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:18.067323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-10dfb083-d8d9-4b02-a885-981addfa3e57 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:18.084872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10dfb083-d8d9-4b02-a885-981addfa3e57 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:18.085702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10dfb083-d8d9-4b02-a885-981addfa3e57 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:18.088720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10dfb083-d8d9-4b02-a885-981addfa3e57 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:18.090122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10dfb083-d8d9-4b02-a885-981addfa3e57 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:18.092619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10dfb083-d8d9-4b02-a885-981addfa3e57 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:18.093297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10dfb083-d8d9-4b02-a885-981addfa3e57 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:18.802913 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-c17b53ca-893f-40c0-9fa3-3d02586183ec tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project e8f4430029dc4526a06ebc4138491601 combination. Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c17b53ca-893f-40c0-9fa3-3d02586183ec tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Request method failure captured: Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/flavors/434520629/action HTTP/1.1 Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 67 Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTmWqkhulrHQVhnrstZAmq_WlVWVWBS6D5EjEDRiYztnCxHoQaiTuecgVX5C1MGFU3CwavxOs9s7h0YhjgTrMSpzzpRPM8_VyhcSzS0cMwQ8MMr9Ecfq8gj517VlCBV_ODlEmzeFYwL7dC4vxtbE1z_Adcn1kSG1fu5wrtM-5i23sw Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 237e3bb154774893945f12282bbba852 Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-639171033 Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:18.853600 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_237e3bb154774893945f12282bbba852"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/237e3bb154774893945f12282bbba852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/237e3bb154774893945f12282bbba852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/237e3bb154774893945f12282bbba852"}]}] Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-639171033 Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 237e3bb154774893945f12282bbba852 Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-639171033 Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5451303ac7c6430b89e2adf7abbdf42d Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: {"addTenantAccess": {"tenant": "e8f4430029dc4526a06ebc4138491601"}} Oct 04 18:01:18.854827 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: exception: Flavor access already exists for flavor 17 and project e8f4430029dc4526a06ebc4138491601 combination. Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '434520629', 'body': {'addTenantAccess': {'tenant': 'e8f4430029dc4526a06ebc4138491601'}}} Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:01:18.855586 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-e8f4430029dc4526a06ebc4138491601' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:01:18.856577 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:01:18.857593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:01:18.858678 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-e8f4430029dc4526a06ebc4138491601' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 1, 18, 789892), 'updated_at': None, 'flavor_id': 17, 'project_id': 'e8f4430029dc4526a06ebc4138491601'}] Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:18.861261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project e8f4430029dc4526a06ebc4138491601 combination. Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:18.863081 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project e8f4430029dc4526a06ebc4138491601 combination. Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:18.864419 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:18.867684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project e8f4430029dc4526a06ebc4138491601 combination. Oct 04 18:01:18.867684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:18.867684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c17b53ca-893f-40c0-9fa3-3d02586183ec tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project e8f4430029dc4526a06ebc4138491601 combination. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:18.867684 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c17b53ca-893f-40c0-9fa3-3d02586183ec tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/434520629/action" status: 409 len: 152 microversion: 2.1 time: 1.380951 Oct 04 18:01:18.867684 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 21/44] 10.222.0.18 () {60 vars in 1197 bytes} [Tue Oct 4 18:01:17 2022] POST /compute/v2.1/flavors/434520629/action => generated 152 bytes in 1385 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:18.876542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1af76e5d-1a5e-448c-a640-6fd3cd0061d6 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:18.877250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1af76e5d-1a5e-448c-a640-6fd3cd0061d6 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:18.881830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-10dfb083-d8d9-4b02-a885-981addfa3e57 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:18.892563 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-10dfb083-d8d9-4b02-a885-981addfa3e57 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.847313 Oct 04 18:01:18.895372 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 24/45] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:18 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:18.923612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1af76e5d-1a5e-448c-a640-6fd3cd0061d6 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:18.924187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1af76e5d-1a5e-448c-a640-6fd3cd0061d6 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:18.924624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1af76e5d-1a5e-448c-a640-6fd3cd0061d6 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:18.930552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1af76e5d-1a5e-448c-a640-6fd3cd0061d6 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:18.931091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1af76e5d-1a5e-448c-a640-6fd3cd0061d6 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:18.933236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1af76e5d-1a5e-448c-a640-6fd3cd0061d6 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.118917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-733a58fe-84c1-410c-88c5-f2b06ba6d385 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Calling method '.version_select at 0x7fd4d2d4e4c0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:19.122946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-733a58fe-84c1-410c-88c5-f2b06ba6d385 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:19.123688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-733a58fe-84c1-410c-88c5-f2b06ba6d385 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:19.125974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-733a58fe-84c1-410c-88c5-f2b06ba6d385 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.130686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-733a58fe-84c1-410c-88c5-f2b06ba6d385 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:19.131383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-733a58fe-84c1-410c-88c5-f2b06ba6d385 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:19.131925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-733a58fe-84c1-410c-88c5-f2b06ba6d385 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.279939 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-733a58fe-84c1-410c-88c5-f2b06ba6d385 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.383336 Oct 04 18:01:19.288818 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 25/46] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 4 18:01:18 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:19.295259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce1359ca-d5a9-4f89-a2fd-bd80676b3f0a tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e8f4430029dc4526a06ebc4138491601"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:19.458391 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce1359ca-d5a9-4f89-a2fd-bd80676b3f0a tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/434520629/action" status: 200 len: 21 microversion: 2.1 time: 0.167626 Oct 04 18:01:19.467030 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 26/47] 10.222.0.18 () {60 vars in 1197 bytes} [Tue Oct 4 18:01:19 2022] POST /compute/v2.1/flavors/434520629/action => generated 21 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:01:19.471693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d2e20b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:19.651837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:19.652407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:19.652864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.655101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:19.655566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:19.659631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.680462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1af76e5d-1a5e-448c-a640-6fd3cd0061d6 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:19.700427 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1af76e5d-1a5e-448c-a640-6fd3cd0061d6 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.837991 Oct 04 18:01:19.715442 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 22/48] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:18 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:19.718066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7553fb0-7ef9-4397-9fc5-834c96039eb0 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Calling method '.version_select at 0x7fd4d2ab9ee0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:19.732458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7553fb0-7ef9-4397-9fc5-834c96039eb0 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:19.735907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7553fb0-7ef9-4397-9fc5-834c96039eb0 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:19.736533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7553fb0-7ef9-4397-9fc5-834c96039eb0 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.737566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7553fb0-7ef9-4397-9fc5-834c96039eb0 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:19.740457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7553fb0-7ef9-4397-9fc5-834c96039eb0 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:19.740996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7553fb0-7ef9-4397-9fc5-834c96039eb0 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.761915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:19.842934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:19.843616 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b7553fb0-7ef9-4397-9fc5-834c96039eb0 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.137927 Oct 04 18:01:19.845358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:19.845987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.846521 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 23/49] 10.222.0.18 () {58 vars in 1139 bytes} [Tue Oct 4 18:01:19 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:19.855029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:19.855866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:19.856458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.961527 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17a285e0-8af3-4104-bc97-35a8b3e04e4e tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/80e4842c800040c5af818b9717c4c60b?user_id=56dc7179ce564212ac54acb424084258" status: 200 len: 148 microversion: 2.57 time: 0.497395 Oct 04 18:01:19.962928 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 27/50] 10.222.0.18 () {62 vars in 1384 bytes} [Tue Oct 4 18:01:19 2022] PUT /compute/v2.1/os-quota-sets/80e4842c800040c5af818b9717c4c60b?user_id=56dc7179ce564212ac54acb424084258 => generated 148 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:01:19.967781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93fbe2c7-ad7f-4435-a272-dfe14e23d591 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:20.012448 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-93fbe2c7-ad7f-4435-a272-dfe14e23d591 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/434520629" status: 202 len: 0 microversion: 2.1 time: 0.048106 Oct 04 18:01:20.013485 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 28/51] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:01:19 2022] DELETE /compute/v2.1/flavors/434520629 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:20.022901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ea5e4b1-8f4d-49bf-be92-fe62ba04334c tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Calling method '.version_select at 0x7fd4d2dc58b0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:20.024733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-861803679", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:20.027854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ea5e4b1-8f4d-49bf-be92-fe62ba04334c tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.028538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ea5e4b1-8f4d-49bf-be92-fe62ba04334c tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.029219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ea5e4b1-8f4d-49bf-be92-fe62ba04334c tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.039342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ea5e4b1-8f4d-49bf-be92-fe62ba04334c tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.044116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ea5e4b1-8f4d-49bf-be92-fe62ba04334c tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.044987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ea5e4b1-8f4d-49bf-be92-fe62ba04334c tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.098727 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ea5e4b1-8f4d-49bf-be92-fe62ba04334c tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.080521 Oct 04 18:01:20.103458 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 29/52] 10.222.0.18 () {58 vars in 1145 bytes} [Tue Oct 4 18:01:20 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:01:20.119613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-56e084c4-2ff6-4aa9-a1de-dd29785a0c2d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:20.131939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-56e084c4-2ff6-4aa9-a1de-dd29785a0c2d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:20.147160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56e084c4-2ff6-4aa9-a1de-dd29785a0c2d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.155445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56e084c4-2ff6-4aa9-a1de-dd29785a0c2d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.157864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56e084c4-2ff6-4aa9-a1de-dd29785a0c2d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.160902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56e084c4-2ff6-4aa9-a1de-dd29785a0c2d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.161949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56e084c4-2ff6-4aa9-a1de-dd29785a0c2d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.163607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56e084c4-2ff6-4aa9-a1de-dd29785a0c2d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.167213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:01:20.715911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-56e084c4-2ff6-4aa9-a1de-dd29785a0c2d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:20.724177 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-56e084c4-2ff6-4aa9-a1de-dd29785a0c2d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.619396 Oct 04 18:01:20.739367 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 30/53] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:20 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:20.746411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7b25878-830d-453e-a340-9835cf1ae1bb tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] Calling method '.version_select at 0x7fd4d2ce9550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:20.782566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:20.783432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:20.783923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:20.784421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:20.784848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:20.794104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.794919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.795385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.796121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.796790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.797429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.822216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Getting quotas for project d6615b8b1c0f43d7a2cee777f8ab891a. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:20.827001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Getting quotas for user 8dedbf6bf8d745c8a7a3706086365ee1 and project d6615b8b1c0f43d7a2cee777f8ab891a. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:20.840916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:01:20.843609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:01:20.848570 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a7b25878-830d-453e-a340-9835cf1ae1bb tempest-QuotasAdminTestV257-695538722 tempest-QuotasAdminTestV257-695538722-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/80e4842c800040c5af818b9717c4c60b?user_id=56dc7179ce564212ac54acb424084258" status: 200 len: 190 microversion: 2.57 time: 0.107670 Oct 04 18:01:20.855515 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 31/54] 10.222.0.18 () {60 vars in 1364 bytes} [Tue Oct 4 18:01:20 2022] GET /compute/v2.1/os-quota-sets/80e4842c800040c5af818b9717c4c60b?user_id=56dc7179ce564212ac54acb424084258 => generated 190 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:01:20.860254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4823fe90-05e8-497b-b0cd-8de541ff18a1 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:20.902699 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4823fe90-05e8-497b-b0cd-8de541ff18a1 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052240 Oct 04 18:01:20.909239 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fd67ef60-49bb-4665-be48-e3f04142a73b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059770 Oct 04 18:01:20.910303 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 24/55] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:01:20.914895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-46e176d6-2c76-4a51-9cb7-4a9733f055bc req-c13a1424-8493-42f8-80de-7197f25afa7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f5e4bb-4f92-4506-bec4-f5f639e970af", "tag": "45d98871-0168-4ce3-a251-dae1e8a74f06"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:20.915741 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 32/56] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:20.924333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fe2e698a-0cf9-474b-90be-ea04d5b34a66 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:20.925132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fe2e698a-0cf9-474b-90be-ea04d5b34a66 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:20.932629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe2e698a-0cf9-474b-90be-ea04d5b34a66 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.933490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe2e698a-0cf9-474b-90be-ea04d5b34a66 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.934132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe2e698a-0cf9-474b-90be-ea04d5b34a66 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.935609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-46e176d6-2c76-4a51-9cb7-4a9733f055bc req-c13a1424-8493-42f8-80de-7197f25afa7f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.938013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-46e176d6-2c76-4a51-9cb7-4a9733f055bc req-c13a1424-8493-42f8-80de-7197f25afa7f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.938669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-46e176d6-2c76-4a51-9cb7-4a9733f055bc req-c13a1424-8493-42f8-80de-7197f25afa7f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.972260 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-46e176d6-2c76-4a51-9cb7-4a9733f055bc req-c13a1424-8493-42f8-80de-7197f25afa7f service nova] Creating event network-changed:45d98871-0168-4ce3-a251-dae1e8a74f06 for instance 22f5e4bb-4f92-4506-bec4-f5f639e970af on n-h1-850499-14 Oct 04 18:01:20.974609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe2e698a-0cf9-474b-90be-ea04d5b34a66 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.975696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe2e698a-0cf9-474b-90be-ea04d5b34a66 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.975873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-46e176d6-2c76-4a51-9cb7-4a9733f055bc req-c13a1424-8493-42f8-80de-7197f25afa7f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:01:20.976357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-46e176d6-2c76-4a51-9cb7-4a9733f055bc req-c13a1424-8493-42f8-80de-7197f25afa7f service nova] Acquired lock "compute-rpcapi-router" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:01:20.976968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe2e698a-0cf9-474b-90be-ea04d5b34a66 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.977957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-138c58be-e546-43d0-ac93-232997555ab3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.978495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-138c58be-e546-43d0-ac93-232997555ab3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.980817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-138c58be-e546-43d0-ac93-232997555ab3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.981672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-138c58be-e546-43d0-ac93-232997555ab3 None None] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.987390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-138c58be-e546-43d0-ac93-232997555ab3 None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.988736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-138c58be-e546-43d0-ac93-232997555ab3 None None] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:21.004723 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.compute.rpcapi [None req-138c58be-e546-43d0-ac93-232997555ab3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 18:01:21.009611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-138c58be-e546-43d0-ac93-232997555ab3 None None] Releasing lock "compute-rpcapi-router" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:01:21.044680 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-138c58be-e546-43d0-ac93-232997555ab3 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132706 Oct 04 18:01:21.046150 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 25/57] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:21.053849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-86b210ba-4a24-4f75-9be1-56e7ebf5ae22 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:21.055270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-86b210ba-4a24-4f75-9be1-56e7ebf5ae22 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:21.291845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86b210ba-4a24-4f75-9be1-56e7ebf5ae22 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:21.307575 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-86b210ba-4a24-4f75-9be1-56e7ebf5ae22 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1218 microversion: 2.1 time: 0.258903 Oct 04 18:01:21.309964 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 26/58] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:21 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1218 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:21.317956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-917574a3-b1c5-4914-83a9-242ad2de7640 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-299241361", "id": 798571096, "os-flavor-access:is_public": "True"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:21.352923 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-917574a3-b1c5-4914-83a9-242ad2de7640 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.040526 Oct 04 18:01:21.354344 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 27/59] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:21 2022] POST /compute/v2.1/flavors => generated 434 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:21.367113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3e04d2dc-5a81-4d34-9ed7-c27a59d933a8 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:21.381287 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-3e04d2dc-5a81-4d34-9ed7-c27a59d933a8 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3e04d2dc-5a81-4d34-9ed7-c27a59d933a8 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Request method failure captured: Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/flavors/798571096/os-flavor-access HTTP/1.1 Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTmWqkhulrHQVhnrstZAmq_WlVWVWBS6D5EjEDRiYztnCxHoQaiTuecgVX5C1MGFU3CwavxOs9s7h0YhjgTrMSpzzpRPM8_VyhcSzS0cMwQ8MMr9Ecfq8gj517VlCBV_ODlEmzeFYwL7dC4vxtbE1z_Adcn1kSG1fu5wrtM-5i23sw Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 237e3bb154774893945f12282bbba852 Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-639171033 Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:21.383259 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_237e3bb154774893945f12282bbba852"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/237e3bb154774893945f12282bbba852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/237e3bb154774893945f12282bbba852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/237e3bb154774893945f12282bbba852"}]}] Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-639171033 Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 237e3bb154774893945f12282bbba852 Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-639171033 Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5451303ac7c6430b89e2adf7abbdf42d Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: exception: Access list not available for public flavors. Oct 04 18:01:21.384413 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'flavor_id': '798571096'} Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 18:01:21.385093 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:21.388270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3e04d2dc-5a81-4d34-9ed7-c27a59d933a8 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:21.391433 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3e04d2dc-5a81-4d34-9ed7-c27a59d933a8 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/798571096/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029137 Oct 04 18:01:21.396550 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 28/60] 10.222.0.18 () {58 vars in 1206 bytes} [Tue Oct 4 18:01:21 2022] GET /compute/v2.1/flavors/798571096/os-flavor-access => generated 91 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:21.404327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1585a0b-e8a1-4a8c-b4dd-805f27e55421 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:21.437891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fe2e698a-0cf9-474b-90be-ea04d5b34a66 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:21.441122 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1585a0b-e8a1-4a8c-b4dd-805f27e55421 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/798571096" status: 202 len: 0 microversion: 2.1 time: 0.041293 Oct 04 18:01:21.444388 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 29/61] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:01:21 2022] DELETE /compute/v2.1/flavors/798571096 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:21.450647 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fe2e698a-0cf9-474b-90be-ea04d5b34a66 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.533738 Oct 04 18:01:21.451283 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 33/62] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:20 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:21.466689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d6fe4b0-ca84-4cd5-b390-0784c11ca988 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:21.519408 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d6fe4b0-ca84-4cd5-b390-0784c11ca988 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069879 Oct 04 18:01:21.520571 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 30/63] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:21.547686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-714e03ff-3489-4cf2-b656-af70abcc378e tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1433309462", "id": 270723238, "os-flavor-access:is_public": "False"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:21.572650 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-714e03ff-3489-4cf2-b656-af70abcc378e tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.030508 Oct 04 18:01:21.573087 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 34/64] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:21 2022] POST /compute/v2.1/flavors => generated 436 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:21.751886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-68bf70c4-ee08-4132-b2d4-0a79b038cd6c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:21.752515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-68bf70c4-ee08-4132-b2d4-0a79b038cd6c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:21.764373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68bf70c4-ee08-4132-b2d4-0a79b038cd6c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:21.765705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68bf70c4-ee08-4132-b2d4-0a79b038cd6c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:21.768154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68bf70c4-ee08-4132-b2d4-0a79b038cd6c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:21.769701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68bf70c4-ee08-4132-b2d4-0a79b038cd6c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:21.772088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68bf70c4-ee08-4132-b2d4-0a79b038cd6c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:21.772674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68bf70c4-ee08-4132-b2d4-0a79b038cd6c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:21.902875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-021a9018-191e-4c6c-87df-c51087886332 tempest-FlavorsAccessNegativeTestJSON-91019655 tempest-FlavorsAccessNegativeTestJSON-91019655-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e8f4430029dc4526a06ebc4138491601"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:21.907173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-021a9018-191e-4c6c-87df-c51087886332 tempest-FlavorsAccessNegativeTestJSON-91019655 tempest-FlavorsAccessNegativeTestJSON-91019655-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'dc8064d1f55246fd905e81c43c31113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f4430029dc4526a06ebc4138491601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-021a9018-191e-4c6c-87df-c51087886332 tempest-FlavorsAccessNegativeTestJSON-91019655 tempest-FlavorsAccessNegativeTestJSON-91019655-project] Request method failure captured: Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/flavors/270723238/action HTTP/1.1 Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 67 Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTigqXyc4TqX4HzzzwqT8VRJ7wIZqERtWVrz-gNX5Xp4P6LEfvLcXXNnnAgssMFmJ40-EpN__00wMHLfwkGibqhnqYNUIjqa5SjWgCvU-QNTRVhDDttpzejJcSOLKd7hLGYVTm8v68VsX8RdDc4JRBSfxNTmMu9TK845Tduvwl7mOQ Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: e8f4430029dc4526a06ebc4138491601 Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-91019655 Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:21.909003 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e8f4430029dc4526a06ebc4138491601"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e8f4430029dc4526a06ebc4138491601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e8f4430029dc4526a06ebc4138491601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e8f4430029dc4526a06ebc4138491601"}]}] Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-91019655 Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: e8f4430029dc4526a06ebc4138491601 Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-91019655 Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FlavorsAccessNegativeTestJSON-91019655-project Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: dc8064d1f55246fd905e81c43c31113b Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-91019655-project Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: {"addTenantAccess": {"tenant": "e8f4430029dc4526a06ebc4138491601"}} Oct 04 18:01:21.911414 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '270723238', 'body': {'addTenantAccess': {'tenant': 'e8f4430029dc4526a06ebc4138491601'}}} Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:21.912058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:01:21.913055 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:21.914065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-021a9018-191e-4c6c-87df-c51087886332 tempest-FlavorsAccessNegativeTestJSON-91019655 tempest-FlavorsAccessNegativeTestJSON-91019655-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:21.914065 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-021a9018-191e-4c6c-87df-c51087886332 tempest-FlavorsAccessNegativeTestJSON-91019655 tempest-FlavorsAccessNegativeTestJSON-91019655-project] 10.222.0.18 "POST /compute/v2.1/flavors/270723238/action" status: 403 len: 130 microversion: 2.1 time: 0.329349 Oct 04 18:01:21.915978 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 31/65] 10.222.0.18 () {60 vars in 1197 bytes} [Tue Oct 4 18:01:21 2022] POST /compute/v2.1/flavors/270723238/action => generated 130 bytes in 335 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:01:21.921163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c219d1e8-2d94-47e0-99f7-48b840f2eb45 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:21.944200 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c219d1e8-2d94-47e0-99f7-48b840f2eb45 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/270723238" status: 202 len: 0 microversion: 2.1 time: 0.027032 Oct 04 18:01:21.944747 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 32/66] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:01:21 2022] DELETE /compute/v2.1/flavors/270723238 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:21.953835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-42218d1e-a504-4b65-9d95-3288b4315f5b tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:21.977768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-42218d1e-a504-4b65-9d95-3288b4315f5b tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028206 Oct 04 18:01:21.978994 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 33/67] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:21.999452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e679b2e1-dc42-4b24-bd7a-2dea8cc31136 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-460060184", "id": 1422097097, "os-flavor-access:is_public": "False"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:22.023608 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e679b2e1-dc42-4b24-bd7a-2dea8cc31136 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.027913 Oct 04 18:01:22.025371 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:21 2022] POST /compute/v2.1/flavors => generated 438 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:22.039953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1b9c063-1bee-4071-b702-c0382fc40802 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e8f4430029dc4526a06ebc4138491601"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:22.119526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-68bf70c4-ee08-4132-b2d4-0a79b038cd6c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:22.138459 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-68bf70c4-ee08-4132-b2d4-0a79b038cd6c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.390815 Oct 04 18:01:22.142058 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 35/69] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:21 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:22.336723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-de0e8af5-3da3-4965-970c-21b626dde124 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:22.337448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-de0e8af5-3da3-4965-970c-21b626dde124 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:22.349549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0e8af5-3da3-4965-970c-21b626dde124 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:22.350056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0e8af5-3da3-4965-970c-21b626dde124 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:22.350498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0e8af5-3da3-4965-970c-21b626dde124 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:22.351274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0e8af5-3da3-4965-970c-21b626dde124 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:22.351741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0e8af5-3da3-4965-970c-21b626dde124 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:22.352167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0e8af5-3da3-4965-970c-21b626dde124 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:22.358118 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1b9c063-1bee-4071-b702-c0382fc40802 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1422097097/action" status: 200 len: 97 microversion: 2.1 time: 0.323815 Oct 04 18:01:22.358818 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1200 bytes} [Tue Oct 4 18:01:22 2022] POST /compute/v2.1/flavors/1422097097/action => generated 97 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:01:22.368643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:22.371234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-88bce9d3-fa05-4af2-b7ca-59e5ce890a86 tempest-FlavorsAccessNegativeTestJSON-91019655 tempest-FlavorsAccessNegativeTestJSON-91019655-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e8f4430029dc4526a06ebc4138491601"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:22.375633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-88bce9d3-fa05-4af2-b7ca-59e5ce890a86 tempest-FlavorsAccessNegativeTestJSON-91019655 tempest-FlavorsAccessNegativeTestJSON-91019655-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'dc8064d1f55246fd905e81c43c31113b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f4430029dc4526a06ebc4138491601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-88bce9d3-fa05-4af2-b7ca-59e5ce890a86 tempest-FlavorsAccessNegativeTestJSON-91019655 tempest-FlavorsAccessNegativeTestJSON-91019655-project] Request method failure captured: Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/flavors/1422097097/action HTTP/1.1 Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 70 Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTigqXyc4TqX4HzzzwqT8VRJ7wIZqERtWVrz-gNX5Xp4P6LEfvLcXXNnnAgssMFmJ40-EpN__00wMHLfwkGibqhnqYNUIjqa5SjWgCvU-QNTRVhDDttpzejJcSOLKd7hLGYVTm8v68VsX8RdDc4JRBSfxNTmMu9TK845Tduvwl7mOQ Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: e8f4430029dc4526a06ebc4138491601 Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-91019655 Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:22.378839 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e8f4430029dc4526a06ebc4138491601"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e8f4430029dc4526a06ebc4138491601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e8f4430029dc4526a06ebc4138491601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e8f4430029dc4526a06ebc4138491601"}]}] Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-91019655 Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: e8f4430029dc4526a06ebc4138491601 Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-91019655 Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FlavorsAccessNegativeTestJSON-91019655-project Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: dc8064d1f55246fd905e81c43c31113b Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-91019655-project Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: {"removeTenantAccess": {"tenant": "e8f4430029dc4526a06ebc4138491601"}} Oct 04 18:01:22.379998 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '1422097097', 'body': {'removeTenantAccess': {'tenant': 'e8f4430029dc4526a06ebc4138491601'}}} Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can( Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:22.380612 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:01:22.383671 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:22.384637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-88bce9d3-fa05-4af2-b7ca-59e5ce890a86 tempest-FlavorsAccessNegativeTestJSON-91019655 tempest-FlavorsAccessNegativeTestJSON-91019655-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:22.384637 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-88bce9d3-fa05-4af2-b7ca-59e5ce890a86 tempest-FlavorsAccessNegativeTestJSON-91019655 tempest-FlavorsAccessNegativeTestJSON-91019655-project] 10.222.0.18 "POST /compute/v2.1/flavors/1422097097/action" status: 403 len: 133 microversion: 2.1 time: 0.014795 Oct 04 18:01:22.384637 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 36/71] 10.222.0.18 () {60 vars in 1200 bytes} [Tue Oct 4 18:01:22 2022] POST /compute/v2.1/flavors/1422097097/action => generated 133 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:22.391470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-586acbd2-55d3-4fd0-9cdf-d61ed0ed66e7 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e8f4430029dc4526a06ebc4138491601"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:22.430294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-de0e8af5-3da3-4965-970c-21b626dde124 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:22.443840 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-de0e8af5-3da3-4965-970c-21b626dde124 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1270 microversion: 2.1 time: 0.113161 Oct 04 18:01:22.451796 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 36/72] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:22 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:22.477559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ae5b308-168a-4043-b7fe-57cb381b03b5 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:22.478466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3ae5b308-168a-4043-b7fe-57cb381b03b5 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:22.485002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ae5b308-168a-4043-b7fe-57cb381b03b5 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:22.485497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ae5b308-168a-4043-b7fe-57cb381b03b5 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:22.486005 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-586acbd2-55d3-4fd0-9cdf-d61ed0ed66e7 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1422097097/action" status: 200 len: 21 microversion: 2.1 time: 0.099333 Oct 04 18:01:22.486148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ae5b308-168a-4043-b7fe-57cb381b03b5 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:22.486860 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 37/73] 10.222.0.18 () {60 vars in 1200 bytes} [Tue Oct 4 18:01:22 2022] POST /compute/v2.1/flavors/1422097097/action => generated 21 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:01:22.487082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ae5b308-168a-4043-b7fe-57cb381b03b5 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:22.487378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ae5b308-168a-4043-b7fe-57cb381b03b5 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:22.487885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ae5b308-168a-4043-b7fe-57cb381b03b5 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:22.497603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84863173-5c22-4a54-b9c9-a81f78cc90e1 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:22.522887 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84863173-5c22-4a54-b9c9-a81f78cc90e1 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1422097097" status: 202 len: 0 microversion: 2.1 time: 0.028826 Oct 04 18:01:22.524349 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 38/74] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:01:22 2022] DELETE /compute/v2.1/flavors/1422097097 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:22.533063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29ce5a63-337a-403e-bc4b-7ed683a4a993 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:22.557697 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29ce5a63-337a-403e-bc4b-7ed683a4a993 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028456 Oct 04 18:01:22.558594 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 39/75] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:22.578780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b26a8e24-01c9-41dd-9cac-604916d08dd8 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-222601881", "id": 1284358446, "os-flavor-access:is_public": "False"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:22.599977 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b26a8e24-01c9-41dd-9cac-604916d08dd8 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.024781 Oct 04 18:01:22.605886 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 40/76] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:22 2022] POST /compute/v2.1/flavors => generated 438 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:22.614089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9e5517eb-9519-44bf-8129-67f0f308a81c tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "96bbf41f70d540f5bc6ea01824862f9e"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:22.686416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3ae5b308-168a-4043-b7fe-57cb381b03b5 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:22.697035 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ae5b308-168a-4043-b7fe-57cb381b03b5 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.223764 Oct 04 18:01:22.702996 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 37/77] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:22 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:22.732182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9,nova_api:DELETE=10 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:22.737441 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-9e5517eb-9519-44bf-8129-67f0f308a81c tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] HTTP exception thrown: Flavor access not found for 21 / 96bbf41f70d540f5bc6ea01824862f9e combination. Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9e5517eb-9519-44bf-8129-67f0f308a81c tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Request method failure captured: Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/flavors/1284358446/action HTTP/1.1 Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 70 Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTmWqkhulrHQVhnrstZAmq_WlVWVWBS6D5EjEDRiYztnCxHoQaiTuecgVX5C1MGFU3CwavxOs9s7h0YhjgTrMSpzzpRPM8_VyhcSzS0cMwQ8MMr9Ecfq8gj517VlCBV_ODlEmzeFYwL7dC4vxtbE1z_Adcn1kSG1fu5wrtM-5i23sw Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 237e3bb154774893945f12282bbba852 Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-639171033 Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:22.741391 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_237e3bb154774893945f12282bbba852"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/237e3bb154774893945f12282bbba852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/237e3bb154774893945f12282bbba852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/237e3bb154774893945f12282bbba852"}]}] Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-639171033 Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 237e3bb154774893945f12282bbba852 Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-639171033 Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5451303ac7c6430b89e2adf7abbdf42d Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: {"removeTenantAccess": {"tenant": "96bbf41f70d540f5bc6ea01824862f9e"}} Oct 04 18:01:22.743519 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: exception: Flavor access not found for 21 / 96bbf41f70d540f5bc6ea01824862f9e combination. Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '1284358446', 'body': {'removeTenantAccess': {'tenant': '96bbf41f70d540f5bc6ea01824862f9e'}}} Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 18:01:22.744672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / 96bbf41f70d540f5bc6ea01824862f9e combination. Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / 96bbf41f70d540f5bc6ea01824862f9e combination. Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:22.746499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:22.748370 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:22.748370 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:22.748370 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:22.748370 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:22.748370 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / 96bbf41f70d540f5bc6ea01824862f9e combination. Oct 04 18:01:22.748370 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:22.751446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9e5517eb-9519-44bf-8129-67f0f308a81c tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Returning 404 to user: Flavor access not found for 21 / 96bbf41f70d540f5bc6ea01824862f9e combination. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:22.752785 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9e5517eb-9519-44bf-8129-67f0f308a81c tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1284358446/action" status: 404 len: 124 microversion: 2.1 time: 0.142600 Oct 04 18:01:22.754550 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 41/78] 10.222.0.18 () {60 vars in 1200 bytes} [Tue Oct 4 18:01:22 2022] POST /compute/v2.1/flavors/1284358446/action => generated 124 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:22.763140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c72718bc-e113-4b95-be56-d8feea28e2a3 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:22.793490 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c72718bc-e113-4b95-be56-d8feea28e2a3 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1284358446" status: 202 len: 0 microversion: 2.1 time: 0.034158 Oct 04 18:01:22.794105 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 38/79] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:01:22 2022] DELETE /compute/v2.1/flavors/1284358446 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:01:22.805615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7371e07e-2360-4873-a166-fe087fe9b239 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:22.854154 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7371e07e-2360-4873-a166-fe087fe9b239 tempest-FlavorsAccessNegativeTestJSON-639171033 tempest-FlavorsAccessNegativeTestJSON-639171033-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054817 Oct 04 18:01:22.856086 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 42/80] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:23.169344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d65696a6-68a0-4ec4-8d50-1ef5448dd7ff tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:23.170639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d65696a6-68a0-4ec4-8d50-1ef5448dd7ff tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:23.211510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d65696a6-68a0-4ec4-8d50-1ef5448dd7ff tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:23.216623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d65696a6-68a0-4ec4-8d50-1ef5448dd7ff tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:23.217839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d65696a6-68a0-4ec4-8d50-1ef5448dd7ff tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:23.220654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d65696a6-68a0-4ec4-8d50-1ef5448dd7ff tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:23.225198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d65696a6-68a0-4ec4-8d50-1ef5448dd7ff tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:23.226024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d65696a6-68a0-4ec4-8d50-1ef5448dd7ff tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:23.474435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29da2a56-5ed9-426a-aa20-b8c2b36a6cfa tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:23.476340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-29da2a56-5ed9-426a-aa20-b8c2b36a6cfa tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:23.517048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29da2a56-5ed9-426a-aa20-b8c2b36a6cfa tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:23.523906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29da2a56-5ed9-426a-aa20-b8c2b36a6cfa tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:23.524927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29da2a56-5ed9-426a-aa20-b8c2b36a6cfa tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:23.526341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29da2a56-5ed9-426a-aa20-b8c2b36a6cfa tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:23.536888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29da2a56-5ed9-426a-aa20-b8c2b36a6cfa tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:23.537848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29da2a56-5ed9-426a-aa20-b8c2b36a6cfa tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:23.562877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d65696a6-68a0-4ec4-8d50-1ef5448dd7ff tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:23.575160 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d65696a6-68a0-4ec4-8d50-1ef5448dd7ff tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.415012 Oct 04 18:01:23.585852 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 39/81] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:23 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:23.708949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29da2a56-5ed9-426a-aa20-b8c2b36a6cfa tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:23.719406 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29da2a56-5ed9-426a-aa20-b8c2b36a6cfa tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1276 microversion: 2.1 time: 0.251466 Oct 04 18:01:23.724257 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 43/82] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:23 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:23.740847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f315505-3752-4360-be5f-cb2f6a072f0d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:23.742050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f315505-3752-4360-be5f-cb2f6a072f0d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:23.764920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f315505-3752-4360-be5f-cb2f6a072f0d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:23.767214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f315505-3752-4360-be5f-cb2f6a072f0d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:23.768105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f315505-3752-4360-be5f-cb2f6a072f0d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:23.770517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f315505-3752-4360-be5f-cb2f6a072f0d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:23.771673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f315505-3752-4360-be5f-cb2f6a072f0d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:23.772582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f315505-3752-4360-be5f-cb2f6a072f0d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:24.071933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f315505-3752-4360-be5f-cb2f6a072f0d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:24.084515 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f315505-3752-4360-be5f-cb2f6a072f0d tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.365088 Oct 04 18:01:24.085398 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 40/83] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:23 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:24.600470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b860d51-0f4b-4c60-bdcd-2830ec777454 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:24.601296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b860d51-0f4b-4c60-bdcd-2830ec777454 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:24.607612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b860d51-0f4b-4c60-bdcd-2830ec777454 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:24.608567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b860d51-0f4b-4c60-bdcd-2830ec777454 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:24.609017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b860d51-0f4b-4c60-bdcd-2830ec777454 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:24.609736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b860d51-0f4b-4c60-bdcd-2830ec777454 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:24.610191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b860d51-0f4b-4c60-bdcd-2830ec777454 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:24.610784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b860d51-0f4b-4c60-bdcd-2830ec777454 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:24.764151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d7e796c-db84-43c7-9eb9-b689a731a986 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:24.765619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9d7e796c-db84-43c7-9eb9-b689a731a986 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:24.777016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d7e796c-db84-43c7-9eb9-b689a731a986 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:24.777884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d7e796c-db84-43c7-9eb9-b689a731a986 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:24.778700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d7e796c-db84-43c7-9eb9-b689a731a986 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:24.780046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d7e796c-db84-43c7-9eb9-b689a731a986 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:24.780987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d7e796c-db84-43c7-9eb9-b689a731a986 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:24.781637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d7e796c-db84-43c7-9eb9-b689a731a986 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:24.894983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7b860d51-0f4b-4c60-bdcd-2830ec777454 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:24.909749 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b860d51-0f4b-4c60-bdcd-2830ec777454 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.312400 Oct 04 18:01:24.911663 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 44/84] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:24 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:24.934145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9d7e796c-db84-43c7-9eb9-b689a731a986 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:24.958486 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9d7e796c-db84-43c7-9eb9-b689a731a986 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1276 microversion: 2.1 time: 0.202309 Oct 04 18:01:24.964163 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 41/85] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:24 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:25.126505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d2442da-24c1-40cf-bd98-190095e29d3f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:25.129665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d2442da-24c1-40cf-bd98-190095e29d3f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:25.150274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2442da-24c1-40cf-bd98-190095e29d3f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:25.151650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2442da-24c1-40cf-bd98-190095e29d3f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:25.152950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2442da-24c1-40cf-bd98-190095e29d3f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:25.155175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2442da-24c1-40cf-bd98-190095e29d3f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:25.159081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2442da-24c1-40cf-bd98-190095e29d3f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:25.160441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2442da-24c1-40cf-bd98-190095e29d3f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:25.530447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d2442da-24c1-40cf-bd98-190095e29d3f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:25.561136 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d2442da-24c1-40cf-bd98-190095e29d3f tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.453320 Oct 04 18:01:25.562774 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 45/86] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:25 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:25.935017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-97b52776-f771-48b9-8e1f-e2e8c01e04e9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:25.936170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-97b52776-f771-48b9-8e1f-e2e8c01e04e9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:25.953028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97b52776-f771-48b9-8e1f-e2e8c01e04e9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:25.954434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97b52776-f771-48b9-8e1f-e2e8c01e04e9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:25.955462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97b52776-f771-48b9-8e1f-e2e8c01e04e9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:25.959045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97b52776-f771-48b9-8e1f-e2e8c01e04e9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:25.960239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97b52776-f771-48b9-8e1f-e2e8c01e04e9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:25.961592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97b52776-f771-48b9-8e1f-e2e8c01e04e9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:25.996602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4363f73d-6ea7-48ff-938e-27ab49974492 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:25.997550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4363f73d-6ea7-48ff-938e-27ab49974492 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:26.018508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4363f73d-6ea7-48ff-938e-27ab49974492 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:26.021096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4363f73d-6ea7-48ff-938e-27ab49974492 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:26.024778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4363f73d-6ea7-48ff-938e-27ab49974492 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:26.027461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4363f73d-6ea7-48ff-938e-27ab49974492 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:26.029373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4363f73d-6ea7-48ff-938e-27ab49974492 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:26.030079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4363f73d-6ea7-48ff-938e-27ab49974492 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:26.040263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=69 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:26.227020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4363f73d-6ea7-48ff-938e-27ab49974492 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:26.241518 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4363f73d-6ea7-48ff-938e-27ab49974492 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1276 microversion: 2.1 time: 0.251633 Oct 04 18:01:26.252354 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 46/87] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:25 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:26.303586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-97b52776-f771-48b9-8e1f-e2e8c01e04e9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:26.314108 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-97b52776-f771-48b9-8e1f-e2e8c01e04e9 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.384116 Oct 04 18:01:26.323655 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 42/88] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:25 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:26.601857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-360d1906-feef-44e9-8109-4ba70e7962c3 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:26.603460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-360d1906-feef-44e9-8109-4ba70e7962c3 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:26.620847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-360d1906-feef-44e9-8109-4ba70e7962c3 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:26.622530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-360d1906-feef-44e9-8109-4ba70e7962c3 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:26.623378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-360d1906-feef-44e9-8109-4ba70e7962c3 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:26.624790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-360d1906-feef-44e9-8109-4ba70e7962c3 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:26.628723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-360d1906-feef-44e9-8109-4ba70e7962c3 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:26.629660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-360d1906-feef-44e9-8109-4ba70e7962c3 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:26.848987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-360d1906-feef-44e9-8109-4ba70e7962c3 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:26.857442 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-360d1906-feef-44e9-8109-4ba70e7962c3 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.269185 Oct 04 18:01:26.873081 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 47/89] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:26 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:27.282656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-23dc73ee-220b-46b7-9d9c-f088a5b6da57 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:27.283493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-23dc73ee-220b-46b7-9d9c-f088a5b6da57 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:27.294436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dc73ee-220b-46b7-9d9c-f088a5b6da57 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.295705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dc73ee-220b-46b7-9d9c-f088a5b6da57 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.296385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dc73ee-220b-46b7-9d9c-f088a5b6da57 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.297350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dc73ee-220b-46b7-9d9c-f088a5b6da57 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.297970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dc73ee-220b-46b7-9d9c-f088a5b6da57 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.298767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dc73ee-220b-46b7-9d9c-f088a5b6da57 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.354859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9b1182e8-e88e-433d-89ea-9dd7a7f210e1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:27.355514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9b1182e8-e88e-433d-89ea-9dd7a7f210e1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:27.376163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b1182e8-e88e-433d-89ea-9dd7a7f210e1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.378813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b1182e8-e88e-433d-89ea-9dd7a7f210e1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.379390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b1182e8-e88e-433d-89ea-9dd7a7f210e1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.380222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b1182e8-e88e-433d-89ea-9dd7a7f210e1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.382076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b1182e8-e88e-433d-89ea-9dd7a7f210e1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.384696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b1182e8-e88e-433d-89ea-9dd7a7f210e1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.392610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23dc73ee-220b-46b7-9d9c-f088a5b6da57 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:27.404991 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-23dc73ee-220b-46b7-9d9c-f088a5b6da57 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1276 microversion: 2.1 time: 0.132086 Oct 04 18:01:27.405808 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 43/90] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:27 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:27.679830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9b1182e8-e88e-433d-89ea-9dd7a7f210e1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:27.689922 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9b1182e8-e88e-433d-89ea-9dd7a7f210e1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.342092 Oct 04 18:01:27.692576 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 48/91] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:27 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:27.881568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-86fb432e-1ff5-4b55-96ae-bc346598ac36 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:27.882255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-86fb432e-1ff5-4b55-96ae-bc346598ac36 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:27.889619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86fb432e-1ff5-4b55-96ae-bc346598ac36 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.891128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86fb432e-1ff5-4b55-96ae-bc346598ac36 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.891770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86fb432e-1ff5-4b55-96ae-bc346598ac36 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.893305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86fb432e-1ff5-4b55-96ae-bc346598ac36 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.893999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86fb432e-1ff5-4b55-96ae-bc346598ac36 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.895059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86fb432e-1ff5-4b55-96ae-bc346598ac36 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:28.106207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-86fb432e-1ff5-4b55-96ae-bc346598ac36 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:28.116337 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-86fb432e-1ff5-4b55-96ae-bc346598ac36 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.238706 Oct 04 18:01:28.117272 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 44/92] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:27 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:28.442240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dd006f3b-de1c-45a4-b65b-9fcbd517ab90 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:28.443586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dd006f3b-de1c-45a4-b65b-9fcbd517ab90 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:28.459111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd006f3b-de1c-45a4-b65b-9fcbd517ab90 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:28.459926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd006f3b-de1c-45a4-b65b-9fcbd517ab90 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:28.460526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd006f3b-de1c-45a4-b65b-9fcbd517ab90 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:28.461436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd006f3b-de1c-45a4-b65b-9fcbd517ab90 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:28.462618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd006f3b-de1c-45a4-b65b-9fcbd517ab90 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:28.463626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd006f3b-de1c-45a4-b65b-9fcbd517ab90 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:28.645135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd006f3b-de1c-45a4-b65b-9fcbd517ab90 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:28.659975 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dd006f3b-de1c-45a4-b65b-9fcbd517ab90 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1276 microversion: 2.1 time: 0.225478 Oct 04 18:01:28.660879 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 49/93] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:28 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1276 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:28.719039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ca80e68-8b8a-49eb-ad26-8ca29515e3bd tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:28.720398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ca80e68-8b8a-49eb-ad26-8ca29515e3bd tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:28.732350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca80e68-8b8a-49eb-ad26-8ca29515e3bd tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:28.735898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca80e68-8b8a-49eb-ad26-8ca29515e3bd tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:28.736553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca80e68-8b8a-49eb-ad26-8ca29515e3bd tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:28.737859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca80e68-8b8a-49eb-ad26-8ca29515e3bd tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:28.738661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca80e68-8b8a-49eb-ad26-8ca29515e3bd tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:28.740274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca80e68-8b8a-49eb-ad26-8ca29515e3bd tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:28.973936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1ca80e68-8b8a-49eb-ad26-8ca29515e3bd tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:28.982787 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ca80e68-8b8a-49eb-ad26-8ca29515e3bd tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.267719 Oct 04 18:01:28.983400 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 45/94] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:28 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:29.141499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f3548ca8-aab9-4548-94d1-aae91288e1aa tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:29.142197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f3548ca8-aab9-4548-94d1-aae91288e1aa tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:29.152470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3548ca8-aab9-4548-94d1-aae91288e1aa tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.152972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3548ca8-aab9-4548-94d1-aae91288e1aa tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.153417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3548ca8-aab9-4548-94d1-aae91288e1aa tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.154146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3548ca8-aab9-4548-94d1-aae91288e1aa tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.154608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3548ca8-aab9-4548-94d1-aae91288e1aa tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.155068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3548ca8-aab9-4548-94d1-aae91288e1aa tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.408970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f3548ca8-aab9-4548-94d1-aae91288e1aa tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:29.421639 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f3548ca8-aab9-4548-94d1-aae91288e1aa tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.285169 Oct 04 18:01:29.422505 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 50/95] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:29 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:29.703122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d52796c-a5b2-430b-a265-fe4846985e09 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:29.703969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4d52796c-a5b2-430b-a265-fe4846985e09 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:29.712611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d52796c-a5b2-430b-a265-fe4846985e09 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.713529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d52796c-a5b2-430b-a265-fe4846985e09 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.714230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d52796c-a5b2-430b-a265-fe4846985e09 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.715450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d52796c-a5b2-430b-a265-fe4846985e09 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.716131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d52796c-a5b2-430b-a265-fe4846985e09 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.716736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d52796c-a5b2-430b-a265-fe4846985e09 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.748742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-6ca02e40-9641-4b3f-b642-02c3bcb8f7ec req-c9d309d3-4727-452f-bc94-702f6054b2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43863d88-b381-47c7-bcca-437f6f58d2af", "name": "network-vif-plugged", "status": "completed", "tag": "781006ab-7324-4a24-a0d7-aa8e1a5bd3e1"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:29.779751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6ca02e40-9641-4b3f-b642-02c3bcb8f7ec req-c9d309d3-4727-452f-bc94-702f6054b2cc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.783178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6ca02e40-9641-4b3f-b642-02c3bcb8f7ec req-c9d309d3-4727-452f-bc94-702f6054b2cc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.783986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6ca02e40-9641-4b3f-b642-02c3bcb8f7ec req-c9d309d3-4727-452f-bc94-702f6054b2cc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.799063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4d52796c-a5b2-430b-a265-fe4846985e09 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:29.815304 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4d52796c-a5b2-430b-a265-fe4846985e09 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1276 microversion: 2.1 time: 0.132566 Oct 04 18:01:29.821279 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-6ca02e40-9641-4b3f-b642-02c3bcb8f7ec req-c9d309d3-4727-452f-bc94-702f6054b2cc service nova] Creating event network-vif-plugged:781006ab-7324-4a24-a0d7-aa8e1a5bd3e1 for instance 43863d88-b381-47c7-bcca-437f6f58d2af on n-h1-850499-14 Oct 04 18:01:29.822013 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 51/96] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:29 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:29.828162 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-6ca02e40-9641-4b3f-b642-02c3bcb8f7ec req-c9d309d3-4727-452f-bc94-702f6054b2cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219853 Oct 04 18:01:29.829557 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 46/97] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:30.006837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2bda57dc-9674-4d12-b89b-5aabaab8b823 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:30.007948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2bda57dc-9674-4d12-b89b-5aabaab8b823 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:30.018887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2bda57dc-9674-4d12-b89b-5aabaab8b823 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.020563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2bda57dc-9674-4d12-b89b-5aabaab8b823 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.021851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2bda57dc-9674-4d12-b89b-5aabaab8b823 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.023077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2bda57dc-9674-4d12-b89b-5aabaab8b823 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.025078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2bda57dc-9674-4d12-b89b-5aabaab8b823 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.026187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2bda57dc-9674-4d12-b89b-5aabaab8b823 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.238019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2bda57dc-9674-4d12-b89b-5aabaab8b823 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:30.264811 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2bda57dc-9674-4d12-b89b-5aabaab8b823 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.261342 Oct 04 18:01:30.265903 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 52/98] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:30 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:30.452130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1447b07a-da15-4def-8b36-70b6297d0a2e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:30.452950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1447b07a-da15-4def-8b36-70b6297d0a2e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:30.459413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=11 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:30.465428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1447b07a-da15-4def-8b36-70b6297d0a2e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.465428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1447b07a-da15-4def-8b36-70b6297d0a2e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.465428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1447b07a-da15-4def-8b36-70b6297d0a2e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.465428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1447b07a-da15-4def-8b36-70b6297d0a2e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.465873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1447b07a-da15-4def-8b36-70b6297d0a2e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.465873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1447b07a-da15-4def-8b36-70b6297d0a2e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.716666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1447b07a-da15-4def-8b36-70b6297d0a2e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:30.726861 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1447b07a-da15-4def-8b36-70b6297d0a2e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.278984 Oct 04 18:01:30.728557 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 47/99] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:30 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:30.840747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-95ae589d-bdcd-42f5-8866-ece21821a6f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:30.841458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-95ae589d-bdcd-42f5-8866-ece21821a6f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:30.853696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95ae589d-bdcd-42f5-8866-ece21821a6f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.854643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95ae589d-bdcd-42f5-8866-ece21821a6f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.855133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95ae589d-bdcd-42f5-8866-ece21821a6f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.857201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95ae589d-bdcd-42f5-8866-ece21821a6f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.866796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95ae589d-bdcd-42f5-8866-ece21821a6f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.867661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95ae589d-bdcd-42f5-8866-ece21821a6f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.005133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95ae589d-bdcd-42f5-8866-ece21821a6f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:31.013359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=18 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:31.021149 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-95ae589d-bdcd-42f5-8866-ece21821a6f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1276 microversion: 2.1 time: 0.184467 Oct 04 18:01:31.021777 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 53/100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:30 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1276 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:31.089619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=16 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:31.290117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-220f6a15-9c61-4e8d-8a68-62a880a7eb9b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:31.291651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-220f6a15-9c61-4e8d-8a68-62a880a7eb9b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:31.307523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-220f6a15-9c61-4e8d-8a68-62a880a7eb9b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.313200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-220f6a15-9c61-4e8d-8a68-62a880a7eb9b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.313808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-220f6a15-9c61-4e8d-8a68-62a880a7eb9b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.314682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-220f6a15-9c61-4e8d-8a68-62a880a7eb9b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.315187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-220f6a15-9c61-4e8d-8a68-62a880a7eb9b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.315691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-220f6a15-9c61-4e8d-8a68-62a880a7eb9b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.316514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=36 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:31.484272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e6946b8-fde2-4614-9442-c4b77b897c72 tempest-FlavorMetadataValidation-1677461824 tempest-FlavorMetadataValidation-1677461824-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-596873317", "id": 540444334, "os-flavor-access:is_public": "True"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:31.513149 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e6946b8-fde2-4614-9442-c4b77b897c72 tempest-FlavorMetadataValidation-1677461824 tempest-FlavorMetadataValidation-1677461824-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.430271 Oct 04 18:01:31.522537 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 48/101] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:01:31 2022] POST /compute/v2.1/flavors => generated 467 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:01:31.528427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98a35fda-7265-49d9-991d-56202a626dc8 tempest-FlavorMetadataValidation-1677461824 tempest-FlavorMetadataValidation-1677461824-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:31.569437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-220f6a15-9c61-4e8d-8a68-62a880a7eb9b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:31.577214 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-220f6a15-9c61-4e8d-8a68-62a880a7eb9b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1342 microversion: 2.1 time: 0.293009 Oct 04 18:01:31.577919 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 54/102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:31 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1342 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:31.772429 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-98a35fda-7265-49d9-991d-56202a626dc8 tempest-FlavorMetadataValidation-1677461824 tempest-FlavorMetadataValidation-1677461824-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/540444334/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.243167 Oct 04 18:01:31.773054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-21b0eef5-3c2b-49b2-8bbd-d9adfaca06e7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:31.774105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-21b0eef5-3c2b-49b2-8bbd-d9adfaca06e7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:31.774938 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 49/103] 10.222.0.18 () {62 vars in 1262 bytes} [Tue Oct 4 18:01:31 2022] POST /compute/v2.1/flavors/540444334/os-extra_specs => generated 62 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:31.787901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21b0eef5-3c2b-49b2-8bbd-d9adfaca06e7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.788860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21b0eef5-3c2b-49b2-8bbd-d9adfaca06e7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.792866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21b0eef5-3c2b-49b2-8bbd-d9adfaca06e7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.793948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f90003ca-73ab-4759-a1ca-334b35d81f5b tempest-FlavorMetadataValidation-1677461824 tempest-FlavorMetadataValidation-1677461824-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:31.796058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21b0eef5-3c2b-49b2-8bbd-d9adfaca06e7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.797059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21b0eef5-3c2b-49b2-8bbd-d9adfaca06e7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.797794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21b0eef5-3c2b-49b2-8bbd-d9adfaca06e7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.821048 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f90003ca-73ab-4759-a1ca-334b35d81f5b tempest-FlavorMetadataValidation-1677461824 tempest-FlavorMetadataValidation-1677461824-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/540444334" status: 202 len: 0 microversion: 2.86 time: 0.035664 Oct 04 18:01:31.822368 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 50/104] 10.222.0.18 () {60 vars in 1199 bytes} [Tue Oct 4 18:01:31 2022] DELETE /compute/v2.1/flavors/540444334 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:31.838145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c6fb33a-8e73-480e-a59c-7b4a9270ce53 tempest-FlavorMetadataValidation-1677461824 tempest-FlavorMetadataValidation-1677461824-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:31.872613 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c6fb33a-8e73-480e-a59c-7b4a9270ce53 tempest-FlavorMetadataValidation-1677461824 tempest-FlavorMetadataValidation-1677461824-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.043885 Oct 04 18:01:31.876731 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 51/105] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 4 18:01:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:31.882234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5a2b83be-aa3d-4309-9270-8bbcde901b1d req-56bd97fb-5905-4966-be50-c84468e62f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f5e4bb-4f92-4506-bec4-f5f639e970af", "name": "network-vif-plugged", "status": "completed", "tag": "45d98871-0168-4ce3-a251-dae1e8a74f06"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:31.891725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5,nova_api:DELETE=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:31.895038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5a2b83be-aa3d-4309-9270-8bbcde901b1d req-56bd97fb-5905-4966-be50-c84468e62f83 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.895797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5a2b83be-aa3d-4309-9270-8bbcde901b1d req-56bd97fb-5905-4966-be50-c84468e62f83 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.897589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5a2b83be-aa3d-4309-9270-8bbcde901b1d req-56bd97fb-5905-4966-be50-c84468e62f83 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.925465 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5a2b83be-aa3d-4309-9270-8bbcde901b1d req-56bd97fb-5905-4966-be50-c84468e62f83 service nova] Creating event network-vif-plugged:45d98871-0168-4ce3-a251-dae1e8a74f06 for instance 22f5e4bb-4f92-4506-bec4-f5f639e970af on n-h1-850499-14 Oct 04 18:01:31.933447 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5a2b83be-aa3d-4309-9270-8bbcde901b1d req-56bd97fb-5905-4966-be50-c84468e62f83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055331 Oct 04 18:01:31.934361 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 52/106] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:32.012166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-21b0eef5-3c2b-49b2-8bbd-d9adfaca06e7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:32.022971 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-21b0eef5-3c2b-49b2-8bbd-d9adfaca06e7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.264954 Oct 04 18:01:32.023875 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 55/107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:31 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:32.059661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a1035bf-0da8-4229-b5b4-2b9a877a8c98 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:32.060529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a1035bf-0da8-4229-b5b4-2b9a877a8c98 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:32.076237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a1035bf-0da8-4229-b5b4-2b9a877a8c98 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:32.076858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a1035bf-0da8-4229-b5b4-2b9a877a8c98 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:32.077509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a1035bf-0da8-4229-b5b4-2b9a877a8c98 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:32.079461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a1035bf-0da8-4229-b5b4-2b9a877a8c98 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:32.080698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a1035bf-0da8-4229-b5b4-2b9a877a8c98 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:32.081146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a1035bf-0da8-4229-b5b4-2b9a877a8c98 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:32.187169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9a1035bf-0da8-4229-b5b4-2b9a877a8c98 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:32.197059 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a1035bf-0da8-4229-b5b4-2b9a877a8c98 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1276 microversion: 2.1 time: 0.146610 Oct 04 18:01:32.202302 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 53/108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:32 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:32.602752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98b2e21f-3978-4fc1-b4d1-27c8ed84c7d5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:32.603811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-98b2e21f-3978-4fc1-b4d1-27c8ed84c7d5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:32.617926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98b2e21f-3978-4fc1-b4d1-27c8ed84c7d5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:32.619810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98b2e21f-3978-4fc1-b4d1-27c8ed84c7d5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:32.620561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98b2e21f-3978-4fc1-b4d1-27c8ed84c7d5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:32.626865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98b2e21f-3978-4fc1-b4d1-27c8ed84c7d5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:32.627400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98b2e21f-3978-4fc1-b4d1-27c8ed84c7d5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:32.629289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98b2e21f-3978-4fc1-b4d1-27c8ed84c7d5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:32.906549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2118319919", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": "none"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:32.930101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-98b2e21f-3978-4fc1-b4d1-27c8ed84c7d5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:32.978766 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-98b2e21f-3978-4fc1-b4d1-27c8ed84c7d5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1492 microversion: 2.1 time: 0.373827 Oct 04 18:01:32.992080 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 54/109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:32 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1492 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:33.100304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:33.100828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:33.101177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:33.101755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:33.102359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:33.112398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.113234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.113808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.114705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.115359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.116086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.145383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Getting quotas for project 5cf3ffc97aa74dc1a6140c9a7e8fc881. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:33.154079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Getting quotas for user f459cbfd4cb2409fb48da66a0942e073 and project 5cf3ffc97aa74dc1a6140c9a7e8fc881. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:33.169541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:01:33.172241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:01:33.262781 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ab8214c4-8b9e-464c-8e2d-2cd89918bb74 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.770743 Oct 04 18:01:33.263822 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 56/110] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:01:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:01:33.270098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2921be4-1fc5-43ae-b8ad-1a20a00b9245 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:33.270730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2921be4-1fc5-43ae-b8ad-1a20a00b9245 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:33.278785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2921be4-1fc5-43ae-b8ad-1a20a00b9245 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.279723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2921be4-1fc5-43ae-b8ad-1a20a00b9245 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.280572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2921be4-1fc5-43ae-b8ad-1a20a00b9245 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.281593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2921be4-1fc5-43ae-b8ad-1a20a00b9245 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.282081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2921be4-1fc5-43ae-b8ad-1a20a00b9245 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.282688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2921be4-1fc5-43ae-b8ad-1a20a00b9245 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.474663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-15e27a07-d940-4a9e-9350-c38fa8a434b1 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:33.476849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15e27a07-d940-4a9e-9350-c38fa8a434b1 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:33.499943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e27a07-d940-4a9e-9350-c38fa8a434b1 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.501672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e27a07-d940-4a9e-9350-c38fa8a434b1 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.502517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e27a07-d940-4a9e-9350-c38fa8a434b1 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.506632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e27a07-d940-4a9e-9350-c38fa8a434b1 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.507255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e27a07-d940-4a9e-9350-c38fa8a434b1 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.507767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e27a07-d940-4a9e-9350-c38fa8a434b1 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.544482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2921be4-1fc5-43ae-b8ad-1a20a00b9245 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:33.559333 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2921be4-1fc5-43ae-b8ad-1a20a00b9245 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1337 microversion: 2.1 time: 0.294391 Oct 04 18:01:33.561282 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 57/111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:33 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1337 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:33.571085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5cae1fe-1c76-47be-8a7b-8c1259f6699a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:33.572072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5cae1fe-1c76-47be-8a7b-8c1259f6699a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:33.583049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5cae1fe-1c76-47be-8a7b-8c1259f6699a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.583813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5cae1fe-1c76-47be-8a7b-8c1259f6699a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.584262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5cae1fe-1c76-47be-8a7b-8c1259f6699a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.585379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5cae1fe-1c76-47be-8a7b-8c1259f6699a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.586166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5cae1fe-1c76-47be-8a7b-8c1259f6699a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.587410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5cae1fe-1c76-47be-8a7b-8c1259f6699a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.593087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15e27a07-d940-4a9e-9350-c38fa8a434b1 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:01:33.832781 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-15e27a07-d940-4a9e-9350-c38fa8a434b1 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 204 len: 0 microversion: 2.1 time: 0.819510 Oct 04 18:01:33.837371 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 55/112] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:33 2022] DELETE /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 0 bytes in 822 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:33.852374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b40e137-edc9-44bb-a66a-2e428cbbaa3e tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:33.859027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3b40e137-edc9-44bb-a66a-2e428cbbaa3e tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:34.088065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b40e137-edc9-44bb-a66a-2e428cbbaa3e tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.096249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b40e137-edc9-44bb-a66a-2e428cbbaa3e tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.098286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b40e137-edc9-44bb-a66a-2e428cbbaa3e tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.106249 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b40e137-edc9-44bb-a66a-2e428cbbaa3e tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "PUT /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1359 microversion: 2.75 time: 0.267243 Oct 04 18:01:34.120012 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 56/113] 10.222.0.18 () {62 vars in 1297 bytes} [Tue Oct 4 18:01:33 2022] PUT /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:34.137346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-44b9396f-43da-4ab4-897a-8ce2c496b4ef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.138364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-44b9396f-43da-4ab4-897a-8ce2c496b4ef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:34.146042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44b9396f-43da-4ab4-897a-8ce2c496b4ef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.146927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44b9396f-43da-4ab4-897a-8ce2c496b4ef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.147900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44b9396f-43da-4ab4-897a-8ce2c496b4ef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.148846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44b9396f-43da-4ab4-897a-8ce2c496b4ef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.149490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44b9396f-43da-4ab4-897a-8ce2c496b4ef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.150191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44b9396f-43da-4ab4-897a-8ce2c496b4ef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.162458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5cae1fe-1c76-47be-8a7b-8c1259f6699a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.174728 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5cae1fe-1c76-47be-8a7b-8c1259f6699a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1318 microversion: 2.1 time: 0.611416 Oct 04 18:01:34.176416 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 58/114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:33 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:34.189205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.195095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:34.209538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.211798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.214078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.214882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.215401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.215846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.370318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.384130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.386020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.396555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-44b9396f-43da-4ab4-897a-8ce2c496b4ef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.401311 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f00c98d2-a56c-4d5d-a450-d503e10b9d71 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1355 microversion: 2.75 time: 0.222330 Oct 04 18:01:34.403498 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 59/115] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:34 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1355 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:34.406085 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-44b9396f-43da-4ab4-897a-8ce2c496b4ef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1498 microversion: 2.1 time: 0.284657 Oct 04 18:01:34.419309 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 57/116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:34 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1498 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:34.581853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-36b66007-7c25-4a42-8161-396c99b6ecce tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.582475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-36b66007-7c25-4a42-8161-396c99b6ecce tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:34.590919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36b66007-7c25-4a42-8161-396c99b6ecce tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.591655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36b66007-7c25-4a42-8161-396c99b6ecce tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.592253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36b66007-7c25-4a42-8161-396c99b6ecce tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.593218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36b66007-7c25-4a42-8161-396c99b6ecce tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.593925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36b66007-7c25-4a42-8161-396c99b6ecce tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.594441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36b66007-7c25-4a42-8161-396c99b6ecce tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.747135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-36b66007-7c25-4a42-8161-396c99b6ecce tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.757992 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-36b66007-7c25-4a42-8161-396c99b6ecce tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1486 microversion: 2.1 time: 0.179789 Oct 04 18:01:34.758732 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 60/117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:34 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1486 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:34.783361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a54f386-c3b7-4a72-8933-8c1796409eb9 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.784664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a54f386-c3b7-4a72-8933-8c1796409eb9 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:34.791259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a54f386-c3b7-4a72-8933-8c1796409eb9 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.792595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a54f386-c3b7-4a72-8933-8c1796409eb9 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.793233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a54f386-c3b7-4a72-8933-8c1796409eb9 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.794162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a54f386-c3b7-4a72-8933-8c1796409eb9 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.794781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a54f386-c3b7-4a72-8933-8c1796409eb9 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.795741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a54f386-c3b7-4a72-8933-8c1796409eb9 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.980957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d8950590-280e-43a5-afd4-7e0999740432 req-12b82194-8928-449d-a442-804d402e032d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7009eab7-c0a7-49a5-a792-57a7d67ebc00", "tag": "880a9913-72e3-4fb2-b738-75f05677aad8"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:34.999456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d8950590-280e-43a5-afd4-7e0999740432 req-12b82194-8928-449d-a442-804d402e032d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.000342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d8950590-280e-43a5-afd4-7e0999740432 req-12b82194-8928-449d-a442-804d402e032d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.001197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d8950590-280e-43a5-afd4-7e0999740432 req-12b82194-8928-449d-a442-804d402e032d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.017970 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d8950590-280e-43a5-afd4-7e0999740432 req-12b82194-8928-449d-a442-804d402e032d service nova] Creating event network-changed:880a9913-72e3-4fb2-b738-75f05677aad8 for instance 7009eab7-c0a7-49a5-a792-57a7d67ebc00 on n-h2-850499-14 Oct 04 18:01:35.025388 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d8950590-280e-43a5-afd4-7e0999740432 req-12b82194-8928-449d-a442-804d402e032d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048437 Oct 04 18:01:35.026591 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 61/118] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:35.207756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4e9c24b9-b7ad-4d73-bf78-78f2b82b9ba4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:35.209530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4e9c24b9-b7ad-4d73-bf78-78f2b82b9ba4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.227392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e9c24b9-b7ad-4d73-bf78-78f2b82b9ba4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.233022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e9c24b9-b7ad-4d73-bf78-78f2b82b9ba4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.235262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e9c24b9-b7ad-4d73-bf78-78f2b82b9ba4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.237386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e9c24b9-b7ad-4d73-bf78-78f2b82b9ba4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.239896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e9c24b9-b7ad-4d73-bf78-78f2b82b9ba4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.243549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e9c24b9-b7ad-4d73-bf78-78f2b82b9ba4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.292158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:35.303908 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a54f386-c3b7-4a72-8933-8c1796409eb9 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1639 microversion: 2.1 time: 0.524985 Oct 04 18:01:35.318998 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 58/119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:34 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1639 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:35.327866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b64a5c63-a576-45a6-97d5-4fd5951ada7e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:35.328448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b64a5c63-a576-45a6-97d5-4fd5951ada7e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.337877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64a5c63-a576-45a6-97d5-4fd5951ada7e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.338431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64a5c63-a576-45a6-97d5-4fd5951ada7e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.338923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64a5c63-a576-45a6-97d5-4fd5951ada7e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.340536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64a5c63-a576-45a6-97d5-4fd5951ada7e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.341073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64a5c63-a576-45a6-97d5-4fd5951ada7e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.341528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64a5c63-a576-45a6-97d5-4fd5951ada7e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.380011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b64a5c63-a576-45a6-97d5-4fd5951ada7e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:01:35.484397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4e9c24b9-b7ad-4d73-bf78-78f2b82b9ba4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:35.510440 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4e9c24b9-b7ad-4d73-bf78-78f2b82b9ba4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1318 microversion: 2.1 time: 0.311610 Oct 04 18:01:35.512637 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 62/120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:35 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:35.529739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bc597c54-c680-4294-b2f3-8e9a62221537 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:35.531594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bc597c54-c680-4294-b2f3-8e9a62221537 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.549934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc597c54-c680-4294-b2f3-8e9a62221537 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.553403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc597c54-c680-4294-b2f3-8e9a62221537 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.555974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc597c54-c680-4294-b2f3-8e9a62221537 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.556988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc597c54-c680-4294-b2f3-8e9a62221537 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.558835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc597c54-c680-4294-b2f3-8e9a62221537 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.561010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc597c54-c680-4294-b2f3-8e9a62221537 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.798836 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b64a5c63-a576-45a6-97d5-4fd5951ada7e tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "DELETE /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 204 len: 0 microversion: 2.1 time: 0.474664 Oct 04 18:01:35.799787 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 59/121] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:35 2022] DELETE /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:01:35.816737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:35.818451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.841847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.842633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.843705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.849330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.851454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.855801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.863353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bc597c54-c680-4294-b2f3-8e9a62221537 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:35.872996 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bc597c54-c680-4294-b2f3-8e9a62221537 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1498 microversion: 2.1 time: 0.356568 Oct 04 18:01:35.879025 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 63/122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:35 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1498 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:35.880405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a38295e-35d9-4e8d-b9dc-b03804ac5ec7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:35.881188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a38295e-35d9-4e8d-b9dc-b03804ac5ec7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.888529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a38295e-35d9-4e8d-b9dc-b03804ac5ec7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.889613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a38295e-35d9-4e8d-b9dc-b03804ac5ec7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.890491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a38295e-35d9-4e8d-b9dc-b03804ac5ec7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.891593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a38295e-35d9-4e8d-b9dc-b03804ac5ec7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.892276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a38295e-35d9-4e8d-b9dc-b03804ac5ec7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.892949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a38295e-35d9-4e8d-b9dc-b03804ac5ec7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.909248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:36.075407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:36.093911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:36.099778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:36.114581 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f92635e-3cd1-4963-ab97-fa6cb300f46a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1417 microversion: 2.75 time: 0.311323 Oct 04 18:01:36.116655 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 60/123] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:35 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1417 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:36.153976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a38295e-35d9-4e8d-b9dc-b03804ac5ec7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:36.188124 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a38295e-35d9-4e8d-b9dc-b03804ac5ec7 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1492 microversion: 2.1 time: 0.312825 Oct 04 18:01:36.190123 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 64/124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:35 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1492 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:36.546428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca4dbcad-a044-46eb-a468-5a656e4c08c9 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.549606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ca4dbcad-a044-46eb-a468-5a656e4c08c9 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.571899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca4dbcad-a044-46eb-a468-5a656e4c08c9 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.576923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca4dbcad-a044-46eb-a468-5a656e4c08c9 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.577556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca4dbcad-a044-46eb-a468-5a656e4c08c9 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.578335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca4dbcad-a044-46eb-a468-5a656e4c08c9 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.578877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca4dbcad-a044-46eb-a468-5a656e4c08c9 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.579430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca4dbcad-a044-46eb-a468-5a656e4c08c9 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.873249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ca4dbcad-a044-46eb-a468-5a656e4c08c9 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:36.890802 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca4dbcad-a044-46eb-a468-5a656e4c08c9 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1318 microversion: 2.1 time: 0.357823 Oct 04 18:01:36.891778 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 61/125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:36.912443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f0cf73e-1d80-4a71-be57-903747aa6d4d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.916150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f0cf73e-1d80-4a71-be57-903747aa6d4d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.932358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f0cf73e-1d80-4a71-be57-903747aa6d4d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.933247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f0cf73e-1d80-4a71-be57-903747aa6d4d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.933960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f0cf73e-1d80-4a71-be57-903747aa6d4d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.934975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f0cf73e-1d80-4a71-be57-903747aa6d4d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.935793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f0cf73e-1d80-4a71-be57-903747aa6d4d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.936422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f0cf73e-1d80-4a71-be57-903747aa6d4d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.067103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1f0cf73e-1d80-4a71-be57-903747aa6d4d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.080358 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f0cf73e-1d80-4a71-be57-903747aa6d4d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 200 len: 1456 microversion: 2.1 time: 0.173253 Oct 04 18:01:37.082280 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 65/126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 1456 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:37.087511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-34e9b4de-f676-4ba1-95d8-5ba51b0af81b req-37a10080-b039-41c2-943b-10aca01a7bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43863d88-b381-47c7-bcca-437f6f58d2af", "name": "network-vif-deleted", "tag": "781006ab-7324-4a24-a0d7-aa8e1a5bd3e1"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:37.097669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-34e9b4de-f676-4ba1-95d8-5ba51b0af81b req-37a10080-b039-41c2-943b-10aca01a7bb1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.098713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-34e9b4de-f676-4ba1-95d8-5ba51b0af81b req-37a10080-b039-41c2-943b-10aca01a7bb1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.099236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-34e9b4de-f676-4ba1-95d8-5ba51b0af81b req-37a10080-b039-41c2-943b-10aca01a7bb1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.113376 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-34e9b4de-f676-4ba1-95d8-5ba51b0af81b req-37a10080-b039-41c2-943b-10aca01a7bb1 service nova] Creating event network-vif-deleted:781006ab-7324-4a24-a0d7-aa8e1a5bd3e1 for instance 43863d88-b381-47c7-bcca-437f6f58d2af on n-h1-850499-14 Oct 04 18:01:37.120273 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-34e9b4de-f676-4ba1-95d8-5ba51b0af81b req-37a10080-b039-41c2-943b-10aca01a7bb1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036473 Oct 04 18:01:37.121506 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 66/127] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:37.159199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.159960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:37.167132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.168427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.169050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.169938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.171119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.171703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.200166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Calling method '.version_select at 0x7fd4d3b580d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.204564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.205055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.205620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.226899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.227680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.228270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.301016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.304323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.306661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.325280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.337376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.338275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.338921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.376909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.386216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.388478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.389153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.389744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.398574 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e67885a1-8f80-4189-9939-4b3c1c708036 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1919 microversion: 2.53 time: 0.403606 Oct 04 18:01:37.400019 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 62/128] 10.222.0.18 () {60 vars in 1243 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1919 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:37.407334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-83f0f40b-c7cd-4d1c-b82d-c284cd267f4b tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.409356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-83f0f40b-c7cd-4d1c-b82d-c284cd267f4b tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:37.417398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83f0f40b-c7cd-4d1c-b82d-c284cd267f4b tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.418153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83f0f40b-c7cd-4d1c-b82d-c284cd267f4b tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.418834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83f0f40b-c7cd-4d1c-b82d-c284cd267f4b tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.419907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83f0f40b-c7cd-4d1c-b82d-c284cd267f4b tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.423271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83f0f40b-c7cd-4d1c-b82d-c284cd267f4b tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.424725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83f0f40b-c7cd-4d1c-b82d-c284cd267f4b tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.428438 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-670cc9a0-a9e2-4181-a7b4-92e6f59fd016 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1417 microversion: 2.75 time: 0.273671 Oct 04 18:01:37.429537 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 67/129] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1417 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:01:37.438325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Calling method '.version_select at 0x7fd4d2a3e0d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.443609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.444369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.445028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.464597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.465454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.466284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.513206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.513850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.514377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.525428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.526235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.526895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.554835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.555715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.556536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.564741 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ba31dff-82ed-4950-96ab-df5eb0872066 tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 609 microversion: 2.53 time: 0.133735 Oct 04 18:01:37.565690 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 68/130] 10.222.0.18 () {60 vars in 1222 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 609 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:01:37.584145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-71775cb2-3079-4c13-8aa6-8f78f67aa5da tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Calling method '.version_select at 0x7fd4d2a3ed30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.588083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71775cb2-3079-4c13-8aa6-8f78f67aa5da tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.588802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71775cb2-3079-4c13-8aa6-8f78f67aa5da tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.589473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71775cb2-3079-4c13-8aa6-8f78f67aa5da tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.617233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71775cb2-3079-4c13-8aa6-8f78f67aa5da tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.618205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71775cb2-3079-4c13-8aa6-8f78f67aa5da tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.618904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71775cb2-3079-4c13-8aa6-8f78f67aa5da tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.625898 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-71775cb2-3079-4c13-8aa6-8f78f67aa5da tempest-HypervisorAdminV253TestBase-1895509713 tempest-HypervisorAdminV253TestBase-1895509713-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/f454fd4a-875d-4b28-8ad6-1e0e84f4e42d" status: 200 len: 794 microversion: 2.53 time: 0.047180 Oct 04 18:01:37.627231 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 69/131] 10.222.0.18 () {60 vars in 1298 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/os-hypervisors/f454fd4a-875d-4b28-8ad6-1e0e84f4e42d => generated 794 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:01:37.796625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-83f0f40b-c7cd-4d1c-b82d-c284cd267f4b tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.809788 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-83f0f40b-c7cd-4d1c-b82d-c284cd267f4b tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1492 microversion: 2.1 time: 0.408160 Oct 04 18:01:37.811854 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 63/132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1492 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:37.915954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b9d6bd1-088e-4c6e-b784-a1bf900110c1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.917263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1b9d6bd1-088e-4c6e-b784-a1bf900110c1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:37.930212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b9d6bd1-088e-4c6e-b784-a1bf900110c1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.932268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b9d6bd1-088e-4c6e-b784-a1bf900110c1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.933062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b9d6bd1-088e-4c6e-b784-a1bf900110c1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.935841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b9d6bd1-088e-4c6e-b784-a1bf900110c1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.937598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b9d6bd1-088e-4c6e-b784-a1bf900110c1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.938930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b9d6bd1-088e-4c6e-b784-a1bf900110c1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.114808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:38.116181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:38.132614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.134621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.136093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.139613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.162513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.164043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.233133 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] HTTP exception thrown: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Request method failure captured: Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af HTTP/1.1 Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHTVhS5a6I-Dtev_ylFYTuTQx6JF5ANMofBIr_V75ORVy_LasPiELccUedL1eEkyyx5cWEhbw3aH9tZPC_L6Qd9nBtI69igLTN9701n6nGOgZsAt5FyZwptaBm-0oRl1HiQyG5g9Z8CNJ9R5QwnRCMNbFtARswbygnzS2kxENJJaVi4 Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:01:38.255732 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_503b4405932b44a1849afd220dab32e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/503b4405932b44a1849afd220dab32e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}] Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: c625dcc139fa4de8a866970b4c0a1cd0 Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:01:38.257751 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '43863d88-b381-47c7-bcca-437f6f58d2af'} Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:38.258828 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:01:38.262169 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:38.269894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Returning 404 to user: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:38.271656 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b942c307-4617-4676-bf63-7a6604eda890 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 404 len: 111 microversion: 2.1 time: 0.161428 Oct 04 18:01:38.272910 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 64/133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:38 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:01:38.306746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1b9d6bd1-088e-4c6e-b784-a1bf900110c1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:38.325929 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b9d6bd1-088e-4c6e-b784-a1bf900110c1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1318 microversion: 2.1 time: 0.413911 Oct 04 18:01:38.329344 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 70/134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:38.483601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:38.484497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:38.509878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.510649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.511342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.512565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.513178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.513832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.524648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1022515128", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:38.633288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:01:38.965721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:38.980301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:38.981760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:38.988354 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c7f81d30-7d14-4201-adf3-cfe400e732ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1417 microversion: 2.75 time: 0.512101 Oct 04 18:01:38.989101 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 65/135] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:38 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1417 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:38.994001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:38.994619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:39.007537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.008283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.008881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.009728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.010320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.010879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.073993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.074785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.080417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.081212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lazy-loading 'fault' on Instance uuid 22f5e4bb-4f92-4506-bec4-f5f639e970af {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:39.194543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf35f8a9af242e8877d4c8432e44771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e6b123c054021aaea2e02aa5dcec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:39.210254 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c07a271d-8280-4694-8d0f-6485fc66ce07 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 200 len: 1327 microversion: 2.1 time: 0.218990 Oct 04 18:01:39.223953 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 66/136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:38 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 1327 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:39.223953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fccffec0-a92d-4a18-a107-feeca8a614f0 req-328c5231-ef2c-4928-84d2-7bdeaea83f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f5e4bb-4f92-4506-bec4-f5f639e970af", "name": "network-vif-deleted", "tag": "45d98871-0168-4ce3-a251-dae1e8a74f06"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:39.250122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fccffec0-a92d-4a18-a107-feeca8a614f0 req-328c5231-ef2c-4928-84d2-7bdeaea83f6d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.250774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fccffec0-a92d-4a18-a107-feeca8a614f0 req-328c5231-ef2c-4928-84d2-7bdeaea83f6d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.251714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fccffec0-a92d-4a18-a107-feeca8a614f0 req-328c5231-ef2c-4928-84d2-7bdeaea83f6d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.277637 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fccffec0-a92d-4a18-a107-feeca8a614f0 req-328c5231-ef2c-4928-84d2-7bdeaea83f6d service nova] Creating event network-vif-deleted:45d98871-0168-4ce3-a251-dae1e8a74f06 for instance 22f5e4bb-4f92-4506-bec4-f5f639e970af on n-h1-850499-14 Oct 04 18:01:39.286160 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fccffec0-a92d-4a18-a107-feeca8a614f0 req-328c5231-ef2c-4928-84d2-7bdeaea83f6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068958 Oct 04 18:01:39.288285 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 67/137] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:39.307715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:39.308920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:39.309549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:39.310105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:39.310664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:39.325425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.325913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.326350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.327112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.337967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.338453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.358177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Getting quotas for project 503b4405932b44a1849afd220dab32e0. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:39.363560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Getting quotas for user c625dcc139fa4de8a866970b4c0a1cd0 and project 503b4405932b44a1849afd220dab32e0. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:39.365584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2aa72583-f026-45b4-b72b-f88f3feaf7ed tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:39.367052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2aa72583-f026-45b4-b72b-f88f3feaf7ed tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:39.374125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aa72583-f026-45b4-b72b-f88f3feaf7ed tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.374888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aa72583-f026-45b4-b72b-f88f3feaf7ed tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.375555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aa72583-f026-45b4-b72b-f88f3feaf7ed tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.376712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aa72583-f026-45b4-b72b-f88f3feaf7ed tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.377353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aa72583-f026-45b4-b72b-f88f3feaf7ed tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.377793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aa72583-f026-45b4-b72b-f88f3feaf7ed tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.393529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:01:39.397062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:01:39.460997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:39.507743 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f5db553c-74ce-4838-b7bd-6b1b31bd0eef tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989592 Oct 04 18:01:39.512595 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 71/138] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:01:39.527229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac04f34f-e3c9-4949-9e8e-e87bbc5234e6 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:39.527859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac04f34f-e3c9-4949-9e8e-e87bbc5234e6 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:39.731841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ac04f34f-e3c9-4949-9e8e-e87bbc5234e6 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:39.742153 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac04f34f-e3c9-4949-9e8e-e87bbc5234e6 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1220 microversion: 2.1 time: 0.222946 Oct 04 18:01:39.744992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 72/139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:39 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1220 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:39.858439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2aa72583-f026-45b4-b72b-f88f3feaf7ed tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:39.866993 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2aa72583-f026-45b4-b72b-f88f3feaf7ed tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1318 microversion: 2.1 time: 0.507125 Oct 04 18:01:39.867579 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 68/140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:39 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:40.028943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:40.029609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:40.048187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.048695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.049136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.049842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.063747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.064453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.202765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.246727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.250621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:40.251828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:40.255869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.267594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.268058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.268313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.269718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.275895 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dadfe669-6f3f-4431-9c82-99e45fea4cba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1417 microversion: 2.75 time: 0.251042 Oct 04 18:01:40.278123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.278738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.291756 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 73/141] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:40 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1417 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:40.306413 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] HTTP exception thrown: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Request method failure captured: Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af HTTP/1.1 Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHTUS_Gv1Sh3_XRJMfa34Iwt28wiP9kS4Z77cTbfMYuLgOBkli7YmG4-e1AfakIa7qUuzEzhcXqRdNkv79PMaTrwF_xggwvnewaLWvCnVyBSptyRMzKINjAyemrm5EIDoZRsIoXlARcYkrhXZe4yMFtytUSB7RBNQEK5xZ9beEo6slQ Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9d5e6b123c054021aaea2e02aa5dcec7 Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminTestJSON-894200978 Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:01:40.308082 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9d5e6b123c054021aaea2e02aa5dcec7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9d5e6b123c054021aaea2e02aa5dcec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d5e6b123c054021aaea2e02aa5dcec7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d5e6b123c054021aaea2e02aa5dcec7"}]}] Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminTestJSON-894200978 Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9d5e6b123c054021aaea2e02aa5dcec7 Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-894200978 Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminTestJSON-894200978-project Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 8bf35f8a9af242e8877d4c8432e44771 Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminTestJSON-894200978-project Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:40.309368 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '22f5e4bb-4f92-4506-bec4-f5f639e970af'} Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:40.310018 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:40.311069 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:40.322234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Returning 404 to user: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:40.326338 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-59eecf17-98a3-48fe-a3c8-de5180cb532c tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 404 len: 111 microversion: 2.1 time: 0.079676 Oct 04 18:01:40.327916 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 69/142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:40 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:01:40.337731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b20b7a31-d95a-4a39-88a9-7db85031cfa5 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-14"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:40.391226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b20b7a31-d95a-4a39-88a9-7db85031cfa5 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.391738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b20b7a31-d95a-4a39-88a9-7db85031cfa5 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.395266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b20b7a31-d95a-4a39-88a9-7db85031cfa5 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.770158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5b3c59bc-15a9-4a8c-b718-eea30d677879 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:40.770791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5b3c59bc-15a9-4a8c-b718-eea30d677879 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:40.791732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b3c59bc-15a9-4a8c-b718-eea30d677879 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.793024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b3c59bc-15a9-4a8c-b718-eea30d677879 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.797001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b3c59bc-15a9-4a8c-b718-eea30d677879 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.798435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b3c59bc-15a9-4a8c-b718-eea30d677879 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.799132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b3c59bc-15a9-4a8c-b718-eea30d677879 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.799562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b3c59bc-15a9-4a8c-b718-eea30d677879 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.991228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b3c59bc-15a9-4a8c-b718-eea30d677879 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:41.014425 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5b3c59bc-15a9-4a8c-b718-eea30d677879 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1294 microversion: 2.1 time: 0.248655 Oct 04 18:01:41.028981 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 70/143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:40 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1294 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:41.075956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b53d51dc-3659-4149-aa18-73199bbe1e40 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:41.077008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b53d51dc-3659-4149-aa18-73199bbe1e40 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:41.090624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b53d51dc-3659-4149-aa18-73199bbe1e40 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.091777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b53d51dc-3659-4149-aa18-73199bbe1e40 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.092890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b53d51dc-3659-4149-aa18-73199bbe1e40 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:41.095569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b53d51dc-3659-4149-aa18-73199bbe1e40 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.098530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b53d51dc-3659-4149-aa18-73199bbe1e40 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.099619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b53d51dc-3659-4149-aa18-73199bbe1e40 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:41.105709 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b20b7a31-d95a-4a39-88a9-7db85031cfa5 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.771013 Oct 04 18:01:41.107436 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 74/144] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 4 18:01:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:41.121473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e7407ff4-eef1-4e4a-8a5b-f9672ef3dc80 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:41.175050 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e7407ff4-eef1-4e4a-8a5b-f9672ef3dc80 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.059113 Oct 04 18:01:41.176661 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 75/145] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:41 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 18:01:41.188589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-75b196dc-9adb-43e7-a5e7-84d9f3883bbf tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1177161337"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:41.193169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.aggregate [None req-75b196dc-9adb-43e7-a5e7-84d9f3883bbf tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Generated uuid a4c7de29-b64c-4be6-8c5d-5d61dd54242f for aggregate {{(pid=122332) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:41.258555 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-75b196dc-9adb-43e7-a5e7-84d9f3883bbf tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.072953 Oct 04 18:01:41.261066 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 76/146] 10.222.0.18 () {62 vars in 1205 bytes} [Tue Oct 4 18:01:41 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:01:41.276032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-64afbdbe-2521-4667-adfb-1492fb3513b6 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-112511476"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:41.751836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b53d51dc-3659-4149-aa18-73199bbe1e40 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:41.762469 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b53d51dc-3659-4149-aa18-73199bbe1e40 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1318 microversion: 2.1 time: 0.725838 Oct 04 18:01:41.775439 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 71/147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:41 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1318 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:41.785401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:41.790030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:41.808195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.808624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.809077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:41.809790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.810423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.811020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:41.823548 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-64afbdbe-2521-4667-adfb-1492fb3513b6 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/2" status: 200 len: 298 microversion: 2.41 time: 0.551097 Oct 04 18:01:41.825387 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 77/148] 10.222.0.18 () {62 vars in 1210 bytes} [Tue Oct 4 18:01:41 2022] PUT /compute/v2.1/os-aggregates/2 => generated 298 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:01:41.844114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9dfb072d-fc62-4006-9b20-359607a2391e tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:41.864685 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9dfb072d-fc62-4006-9b20-359607a2391e tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 298 microversion: 2.41 time: 0.030489 Oct 04 18:01:41.866886 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 78/149] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 4 18:01:41 2022] GET /compute/v2.1/os-aggregates/2 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:01:41.880373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c9978532-be0f-4344-8ee0-66ea22a996b1 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-14"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:41.942930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9978532-be0f-4344-8ee0-66ea22a996b1 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.946992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9978532-be0f-4344-8ee0-66ea22a996b1 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.947529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9978532-be0f-4344-8ee0-66ea22a996b1 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.008901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:42.041090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:42.042666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:42.060511 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7cebbf39-2f75-4668-8ae4-a48a98a76917 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1417 microversion: 2.75 time: 0.282847 Oct 04 18:01:42.074356 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 72/150] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:41 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1417 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:42.086086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01a82ffa-912b-4c30-980e-f0262d4d5a17 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:42.087452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01a82ffa-912b-4c30-980e-f0262d4d5a17 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:42.099095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a82ffa-912b-4c30-980e-f0262d4d5a17 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.100150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a82ffa-912b-4c30-980e-f0262d4d5a17 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.138103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a82ffa-912b-4c30-980e-f0262d4d5a17 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.138103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a82ffa-912b-4c30-980e-f0262d4d5a17 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.138103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a82ffa-912b-4c30-980e-f0262d4d5a17 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.138103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a82ffa-912b-4c30-980e-f0262d4d5a17 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.222888 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c9978532-be0f-4344-8ee0-66ea22a996b1 tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.41 time: 0.348072 Oct 04 18:01:42.224543 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 79/151] 10.222.0.18 () {62 vars in 1232 bytes} [Tue Oct 4 18:01:41 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:01:42.239378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-da242075-b116-47b6-9c92-c257a5ad802b tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-14"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:42.261743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da242075-b116-47b6-9c92-c257a5ad802b tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.264359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da242075-b116-47b6-9c92-c257a5ad802b tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.264887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da242075-b116-47b6-9c92-c257a5ad802b tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.352142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01a82ffa-912b-4c30-980e-f0262d4d5a17 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:42.381738 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01a82ffa-912b-4c30-980e-f0262d4d5a17 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1278 microversion: 2.1 time: 0.305385 Oct 04 18:01:42.387135 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 73/152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:42 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1278 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:42.604268 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-da242075-b116-47b6-9c92-c257a5ad802b tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.41 time: 0.370158 Oct 04 18:01:42.606603 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 80/153] 10.222.0.18 () {62 vars in 1232 bytes} [Tue Oct 4 18:01:42 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:01:42.620134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ca7a7d7-42d1-41ed-bc5c-2abb5d92430d tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:42.679445 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ca7a7d7-42d1-41ed-bc5c-2abb5d92430d tempest-AggregatesAdminTestV241-1467990545 tempest-AggregatesAdminTestV241-1467990545-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.41 time: 0.064106 Oct 04 18:01:42.680107 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 74/154] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 4 18:01:42 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:42.721577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52cb689b-2fc0-4b48-940a-9fe9c0dc6f9e tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Calling method '.version_select at 0x7fd4d2adb160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:42.726256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52cb689b-2fc0-4b48-940a-9fe9c0dc6f9e tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.727104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52cb689b-2fc0-4b48-940a-9fe9c0dc6f9e tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.727725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52cb689b-2fc0-4b48-940a-9fe9c0dc6f9e tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.728639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52cb689b-2fc0-4b48-940a-9fe9c0dc6f9e tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.729260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52cb689b-2fc0-4b48-940a-9fe9c0dc6f9e tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.729846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52cb689b-2fc0-4b48-940a-9fe9c0dc6f9e tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.792069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6432fbd2-3e29-475d-9f90-42ccb6667cd1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:42.792863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6432fbd2-3e29-475d-9f90-42ccb6667cd1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:42.795856 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-52cb689b-2fc0-4b48-940a-9fe9c0dc6f9e tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.079072 Oct 04 18:01:42.796480 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 81/155] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 4 18:01:42 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:42.812240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6432fbd2-3e29-475d-9f90-42ccb6667cd1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.812968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6432fbd2-3e29-475d-9f90-42ccb6667cd1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.813693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6432fbd2-3e29-475d-9f90-42ccb6667cd1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.814409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6432fbd2-3e29-475d-9f90-42ccb6667cd1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.814874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6432fbd2-3e29-475d-9f90-42ccb6667cd1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.816880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99376ee4-5391-4ed9-a40b-61392540a45a tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Calling method '.version_select at 0x7fd4d299c9d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:42.817784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6432fbd2-3e29-475d-9f90-42ccb6667cd1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.827782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99376ee4-5391-4ed9-a40b-61392540a45a tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.828338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99376ee4-5391-4ed9-a40b-61392540a45a tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.828720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99376ee4-5391-4ed9-a40b-61392540a45a tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.829492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99376ee4-5391-4ed9-a40b-61392540a45a tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.830013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99376ee4-5391-4ed9-a40b-61392540a45a tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.830441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99376ee4-5391-4ed9-a40b-61392540a45a tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.841216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:42.904700 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-99376ee4-5391-4ed9-a40b-61392540a45a tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.092443 Oct 04 18:01:42.905296 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 82/156] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:01:42 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:42.932265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1c33da7-164b-4c4a-a050-d2b6cfffba85 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Calling method '.version_select at 0x7fd4d2a3e040>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:42.937280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1c33da7-164b-4c4a-a050-d2b6cfffba85 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.940268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1c33da7-164b-4c4a-a050-d2b6cfffba85 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.941527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1c33da7-164b-4c4a-a050-d2b6cfffba85 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.944027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1c33da7-164b-4c4a-a050-d2b6cfffba85 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.946215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1c33da7-164b-4c4a-a050-d2b6cfffba85 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.947138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1c33da7-164b-4c4a-a050-d2b6cfffba85 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.981800 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1c33da7-164b-4c4a-a050-d2b6cfffba85 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.056997 Oct 04 18:01:42.982786 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 83/157] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 4 18:01:42 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:42.994994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-35d2554d-ff45-4fda-8fb1-6640d113c80f tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1340426187"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:42.998886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.aggregate [None req-35d2554d-ff45-4fda-8fb1-6640d113c80f tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Generated uuid b7595c65-3ab1-41e3-b309-d713dc055d86 for aggregate {{(pid=122332) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:43.031515 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-35d2554d-ff45-4fda-8fb1-6640d113c80f tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039291 Oct 04 18:01:43.033218 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 84/158] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:43.041603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b54b19f7-d6ba-48d4-b4e0-2a97dd97d660 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Calling method '.version_select at 0x7fd4d2aa2700>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:43.055141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b54b19f7-d6ba-48d4-b4e0-2a97dd97d660 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.056238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b54b19f7-d6ba-48d4-b4e0-2a97dd97d660 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.057094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b54b19f7-d6ba-48d4-b4e0-2a97dd97d660 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.082389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b54b19f7-d6ba-48d4-b4e0-2a97dd97d660 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.085610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b54b19f7-d6ba-48d4-b4e0-2a97dd97d660 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.086517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b54b19f7-d6ba-48d4-b4e0-2a97dd97d660 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.126574 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b54b19f7-d6ba-48d4-b4e0-2a97dd97d660 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-h1-850499-14" status: 200 len: 471 microversion: 2.1 time: 0.090978 Oct 04 18:01:43.127211 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 85/159] 10.222.0.18 () {58 vars in 1173 bytes} [Tue Oct 4 18:01:43 2022] GET /compute/v2.1/os-hosts/n-h1-850499-14 => generated 471 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:43.138494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b86ba2d5-3002-46e4-9da7-adab3f1921cb tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-14"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:43.163078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b86ba2d5-3002-46e4-9da7-adab3f1921cb tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.167471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b86ba2d5-3002-46e4-9da7-adab3f1921cb tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.168679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b86ba2d5-3002-46e4-9da7-adab3f1921cb tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.343377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6432fbd2-3e29-475d-9f90-42ccb6667cd1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:43.354854 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6432fbd2-3e29-475d-9f90-42ccb6667cd1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1318 microversion: 2.1 time: 0.567698 Oct 04 18:01:43.373306 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 75/160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:42 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:43.384681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:43.385781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:43.398479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.399388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.400217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.401196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.402026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.403224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.456744 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b86ba2d5-3002-46e4-9da7-adab3f1921cb tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.326036 Oct 04 18:01:43.465240 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 86/161] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 4 18:01:43 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:43.475494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef84b38c-1121-4951-b0ab-a24dab1e8d92 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Calling method '.version_select at 0x7fd4d2de4ee0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:43.525275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef84b38c-1121-4951-b0ab-a24dab1e8d92 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.525275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef84b38c-1121-4951-b0ab-a24dab1e8d92 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.533599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef84b38c-1121-4951-b0ab-a24dab1e8d92 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.567615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef84b38c-1121-4951-b0ab-a24dab1e8d92 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.569263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef84b38c-1121-4951-b0ab-a24dab1e8d92 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.570253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef84b38c-1121-4951-b0ab-a24dab1e8d92 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.601621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:43.614620 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ef84b38c-1121-4951-b0ab-a24dab1e8d92 tempest-HostsAdminTestJSON-816272380 tempest-HostsAdminTestJSON-816272380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-h2-850499-14" status: 200 len: 603 microversion: 2.1 time: 0.146810 Oct 04 18:01:43.619352 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 87/162] 10.222.0.18 () {58 vars in 1173 bytes} [Tue Oct 4 18:01:43 2022] GET /compute/v2.1/os-hosts/n-h2-850499-14 => generated 603 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:43.624674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ff50d0da-27e6-46aa-bc31-94c508e2239d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:43.625633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ff50d0da-27e6-46aa-bc31-94c508e2239d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:43.629047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:43.643669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff50d0da-27e6-46aa-bc31-94c508e2239d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.644491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff50d0da-27e6-46aa-bc31-94c508e2239d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.645101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff50d0da-27e6-46aa-bc31-94c508e2239d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.646030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff50d0da-27e6-46aa-bc31-94c508e2239d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.646358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:43.647063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff50d0da-27e6-46aa-bc31-94c508e2239d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.648602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff50d0da-27e6-46aa-bc31-94c508e2239d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.676498 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cee5eb48-b0ec-4a8d-aadb-f764cb77fa53 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1438 microversion: 2.75 time: 0.294550 Oct 04 18:01:43.679280 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 76/163] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:43 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1438 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:43.692714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04ac3da6-f274-4f14-9e2a-4892af5fd6fd tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:43.725536 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04ac3da6-f274-4f14-9e2a-4892af5fd6fd tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 243 microversion: 2.1 time: 0.045144 Oct 04 18:01:43.730841 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 77/164] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:01:43 2022] GET /compute/v2.1/os-aggregates/3 => generated 243 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:43.742496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:43.751628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:43.766773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.776456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.777242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.778717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.781030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.782071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.975065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:43.976282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:43.977066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:43.977759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:43.978486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:44.105917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:44.140524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:44.152061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.152862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.155218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.156711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.159031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.159920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.440501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.457097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.463148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.472643 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f7f729e-4eb8-455f-8b93-52cfef9493b3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "POST /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13/action" status: 202 len: 1495 microversion: 2.75 time: 0.738708 Oct 04 18:01:44.473840 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 78/165] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:01:43 2022] POST /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13/action => generated 1495 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:01:44.479162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac4ee620-7918-497a-b185-9dad095c7044 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:44.494873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:44.504383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac4ee620-7918-497a-b185-9dad095c7044 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.507345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac4ee620-7918-497a-b185-9dad095c7044 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.508051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac4ee620-7918-497a-b185-9dad095c7044 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.716829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ff50d0da-27e6-46aa-bc31-94c508e2239d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.743586 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ac4ee620-7918-497a-b185-9dad095c7044 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.267817 Oct 04 18:01:44.746947 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ff50d0da-27e6-46aa-bc31-94c508e2239d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1320 microversion: 2.1 time: 1.124787 Oct 04 18:01:44.748639 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 88/166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:43 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1320 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:44.751284 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 79/167] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 4 18:01:44 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:44.771921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3e7ed798-931c-447a-9a2f-42b0505d3fc2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:44.775359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3e7ed798-931c-447a-9a2f-42b0505d3fc2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:44.786247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e7ed798-931c-447a-9a2f-42b0505d3fc2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.786895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e7ed798-931c-447a-9a2f-42b0505d3fc2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.787391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e7ed798-931c-447a-9a2f-42b0505d3fc2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.788992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e7ed798-931c-447a-9a2f-42b0505d3fc2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.789528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e7ed798-931c-447a-9a2f-42b0505d3fc2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.789969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e7ed798-931c-447a-9a2f-42b0505d3fc2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.115539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04ebf51e-66d6-49a0-bdfe-d59e8967ac3c tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Calling method '.version_select at 0x7fd4d2aa2670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.117861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-04ebf51e-66d6-49a0-bdfe-d59e8967ac3c tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '5d65e73f7c6b47288a644e352eeef869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358385b3b1f544699516c8ce95099bb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04ebf51e-66d6-49a0-bdfe-d59e8967ac3c tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Request method failure captured: Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUGzq1jjZDB_ZK6DXeoJAIDbmkf_EpEBuiPXMVU-KIXd1DHdQnUYH11nX-4IFuQes11vO4mX80aruPAY4UmYbm-3vtxN8njKxXCCRKt72A32WzOYbLEiaHDh1JasgU5LOL0HUFn5Rt3o51lW6nZObeLG6nwyEVxhiWayqkjIZEioEk Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 358385b3b1f544699516c8ce95099bb1 Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:45.120217 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_358385b3b1f544699516c8ce95099bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/358385b3b1f544699516c8ce95099bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/358385b3b1f544699516c8ce95099bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/358385b3b1f544699516c8ce95099bb1"}]}] Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 358385b3b1f544699516c8ce95099bb1 Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HypervisorAdminNegativeTestJSON-1828141381-project Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5d65e73f7c6b47288a644e352eeef869 Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381-project Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: action_args: {} Oct 04 18:01:45.121677 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:45.122593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:01:45.123893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.130677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04ebf51e-66d6-49a0-bdfe-d59e8967ac3c tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:45.131826 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-04ebf51e-66d6-49a0-bdfe-d59e8967ac3c tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.381947 Oct 04 18:01:45.134739 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 89/168] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 4 18:01:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 385 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:45.146523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.147229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:45.154289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.154791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.155256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.156124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.156767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.157200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.226305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3e7ed798-931c-447a-9a2f-42b0505d3fc2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:45.252071 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3e7ed798-931c-447a-9a2f-42b0505d3fc2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1318 microversion: 2.1 time: 0.499265 Oct 04 18:01:45.253175 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 80/169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:44 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:45.263189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b8041eb9-0c55-4157-a2b9-3aeb99bc9f3b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.292420 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b8041eb9-0c55-4157-a2b9-3aeb99bc9f3b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.037384 Oct 04 18:01:45.293904 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 81/170] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:45 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:45.300129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-703c12b6-7b23-4216-9a8d-1b3707a9fd5c tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Calling method '.version_select at 0x7fd4d2905f70>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.303506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-703c12b6-7b23-4216-9a8d-1b3707a9fd5c tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '5d65e73f7c6b47288a644e352eeef869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358385b3b1f544699516c8ce95099bb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-703c12b6-7b23-4216-9a8d-1b3707a9fd5c tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Request method failure captured: Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUGzq1jjZDB_ZK6DXeoJAIDbmkf_EpEBuiPXMVU-KIXd1DHdQnUYH11nX-4IFuQes11vO4mX80aruPAY4UmYbm-3vtxN8njKxXCCRKt72A32WzOYbLEiaHDh1JasgU5LOL0HUFn5Rt3o51lW6nZObeLG6nwyEVxhiWayqkjIZEioEk Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 358385b3b1f544699516c8ce95099bb1 Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:01:45.309631 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_358385b3b1f544699516c8ce95099bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/358385b3b1f544699516c8ce95099bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/358385b3b1f544699516c8ce95099bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/358385b3b1f544699516c8ce95099bb1"}]}] Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 358385b3b1f544699516c8ce95099bb1 Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-HypervisorAdminNegativeTestJSON-1828141381-project Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 5d65e73f7c6b47288a644e352eeef869 Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381-project Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: action_args: {} Oct 04 18:01:45.311343 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:45.312171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:01:45.313519 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.317065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-703c12b6-7b23-4216-9a8d-1b3707a9fd5c tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:45.318208 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-703c12b6-7b23-4216-9a8d-1b3707a9fd5c tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.023115 Oct 04 18:01:45.319280 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 82/171] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:45 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:45.323034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:45.331300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40c88529-96ff-45ab-9d92-52c7e8bc3a9b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-3301366"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:45.335899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:45.339814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:45.354856 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d74ff345-d7d5-4dd5-ac50-6e95ad601081 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.213200 Oct 04 18:01:45.355580 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 90/172] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:45 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:45.360048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-40c88529-96ff-45ab-9d92-52c7e8bc3a9b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Generated uuid c841f214-e8a8-410c-beca-2a7f08691648 for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:45.365408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-258d67c2-2e20-4f52-ad82-a7c03c3350f7 tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Calling method '.version_select at 0x7fd4d299c9d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.367278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-258d67c2-2e20-4f52-ad82-a7c03c3350f7 tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '5d65e73f7c6b47288a644e352eeef869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358385b3b1f544699516c8ce95099bb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-258d67c2-2e20-4f52-ad82-a7c03c3350f7 tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Request method failure captured: Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUGzq1jjZDB_ZK6DXeoJAIDbmkf_EpEBuiPXMVU-KIXd1DHdQnUYH11nX-4IFuQes11vO4mX80aruPAY4UmYbm-3vtxN8njKxXCCRKt72A32WzOYbLEiaHDh1JasgU5LOL0HUFn5Rt3o51lW6nZObeLG6nwyEVxhiWayqkjIZEioEk Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 358385b3b1f544699516c8ce95099bb1 Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:45.372959 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_358385b3b1f544699516c8ce95099bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/358385b3b1f544699516c8ce95099bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/358385b3b1f544699516c8ce95099bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/358385b3b1f544699516c8ce95099bb1"}]}] Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 358385b3b1f544699516c8ce95099bb1 Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HypervisorAdminNegativeTestJSON-1828141381-project Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5d65e73f7c6b47288a644e352eeef869 Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381-project Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: action_args: {} Oct 04 18:01:45.374437 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:45.375362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:01:45.376571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.378635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-258d67c2-2e20-4f52-ad82-a7c03c3350f7 tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:45.384471 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-258d67c2-2e20-4f52-ad82-a7c03c3350f7 tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.027738 Oct 04 18:01:45.385207 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 91/173] 10.222.0.18 () {58 vars in 1179 bytes} [Tue Oct 4 18:01:45 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:45.428483 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40c88529-96ff-45ab-9d92-52c7e8bc3a9b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 195 microversion: 2.1 time: 0.107939 Oct 04 18:01:45.431231 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 83/174] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:45 2022] POST /compute/v2.1/os-aggregates => generated 195 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:45.454231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d2c80c9-2d6d-40d8-95a5-8f954c139f16 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:45.489404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2c80c9-2d6d-40d8-95a5-8f954c139f16 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.490211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2c80c9-2d6d-40d8-95a5-8f954c139f16 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.491144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2c80c9-2d6d-40d8-95a5-8f954c139f16 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.734274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Calling method '.version_select at 0x7fd4d2f11700>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.737519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.738587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.740343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.791021 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d2c80c9-2d6d-40d8-95a5-8f954c139f16 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 240 microversion: 2.1 time: 0.351750 Oct 04 18:01:45.799083 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 84/175] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 4 18:01:45 2022] POST /compute/v2.1/os-aggregates/4/action => generated 240 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:45.800423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.803143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.803610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.805847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bdcac3cd-4742-4ad2-a803-ba9df1e48ab8 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.807032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bdcac3cd-4742-4ad2-a803-ba9df1e48ab8 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:45.811191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:45.819989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdcac3cd-4742-4ad2-a803-ba9df1e48ab8 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.820506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdcac3cd-4742-4ad2-a803-ba9df1e48ab8 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.820950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdcac3cd-4742-4ad2-a803-ba9df1e48ab8 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.821676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdcac3cd-4742-4ad2-a803-ba9df1e48ab8 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.822142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdcac3cd-4742-4ad2-a803-ba9df1e48ab8 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.822568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdcac3cd-4742-4ad2-a803-ba9df1e48ab8 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.839157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.839924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.840595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.850704 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00823bfa-97d3-4c3a-816b-8b27d04804ce tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.460067 Oct 04 18:01:45.851941 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 92/176] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:45.857837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1442307-239d-44f5-ac09-49466861ccdc tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.874372 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1442307-239d-44f5-ac09-49466861ccdc tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 243 microversion: 2.1 time: 0.021019 Oct 04 18:01:45.875229 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 93/177] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:01:45 2022] GET /compute/v2.1/os-aggregates => generated 243 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:45.882254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-73428cb8-c2b4-4ad5-9007-38bb001b095f tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Calling method '.version_select at 0x7fd4d2da38b0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.885415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-73428cb8-c2b4-4ad5-9007-38bb001b095f tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '5d65e73f7c6b47288a644e352eeef869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358385b3b1f544699516c8ce95099bb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-73428cb8-c2b4-4ad5-9007-38bb001b095f tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Request method failure captured: Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUGzq1jjZDB_ZK6DXeoJAIDbmkf_EpEBuiPXMVU-KIXd1DHdQnUYH11nX-4IFuQes11vO4mX80aruPAY4UmYbm-3vtxN8njKxXCCRKt72A32WzOYbLEiaHDh1JasgU5LOL0HUFn5Rt3o51lW6nZObeLG6nwyEVxhiWayqkjIZEioEk Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 358385b3b1f544699516c8ce95099bb1 Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:45.897519 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_358385b3b1f544699516c8ce95099bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/358385b3b1f544699516c8ce95099bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/358385b3b1f544699516c8ce95099bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/358385b3b1f544699516c8ce95099bb1"}]}] Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 358385b3b1f544699516c8ce95099bb1 Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HypervisorAdminNegativeTestJSON-1828141381-project Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5d65e73f7c6b47288a644e352eeef869 Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381-project Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '1'} Oct 04 18:01:45.899069 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:45.904765 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:01:45.906235 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.907824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-73428cb8-c2b4-4ad5-9007-38bb001b095f tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:45.907824 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-73428cb8-c2b4-4ad5-9007-38bb001b095f tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.021997 Oct 04 18:01:45.907824 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 94/178] 10.222.0.18 () {58 vars in 1173 bytes} [Tue Oct 4 18:01:45 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:45.912749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ffcb6df7-655a-41e2-b57f-f033c397ce73 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-14"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:45.932217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffcb6df7-655a-41e2-b57f-f033c397ce73 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.938423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffcb6df7-655a-41e2-b57f-f033c397ce73 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.939045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffcb6df7-655a-41e2-b57f-f033c397ce73 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.159211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:46.192878 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ffcb6df7-655a-41e2-b57f-f033c397ce73 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 224 microversion: 2.1 time: 0.292124 Oct 04 18:01:46.201064 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 95/179] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 4 18:01:45 2022] POST /compute/v2.1/os-aggregates/4/action => generated 224 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:46.232632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-37fbf01f-1c05-40ab-b24d-8c8d07a5b0a6 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Calling method '.version_select at 0x7fd4d38059d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:46.235615 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-37fbf01f-1c05-40ab-b24d-8c8d07a5b0a6 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] HTTP exception thrown: Hypervisor with ID '5bddd0cb-3a6a-4f21-a4dd-0a65cb615e1a' could not be found. Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-37fbf01f-1c05-40ab-b24d-8c8d07a5b0a6 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Request method failure captured: Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hypervisors/5bddd0cb-3a6a-4f21-a4dd-0a65cb615e1a/uptime HTTP/1.1 Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUHddadgSobpqNWYSg11uxgOjVeS4Bx4HfdgL9vA_7FDRRWHIE2Wo9q4HJNlahDNSquZlMcGU58tXsFy8X3om7JwqloSgiJpJexUyx0_kC6RI8_3Cr3yLAJ_328Av4ppAlGPwmNnNTWr9V_TnOqPRj52Ui34J8oVFbFIRtlP9pT_Mk Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: faede13a3ffb494ba6eb1bf1820aa6e2 Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-953216502 Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:46.243830 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_faede13a3ffb494ba6eb1bf1820aa6e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/faede13a3ffb494ba6eb1bf1820aa6e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faede13a3ffb494ba6eb1bf1820aa6e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faede13a3ffb494ba6eb1bf1820aa6e2"}]}] Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-953216502 Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: faede13a3ffb494ba6eb1bf1820aa6e2 Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-953216502 Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: f3795ebe2357425987d94bf287b87855 Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: exception: Hypervisor with ID '5bddd0cb-3a6a-4f21-a4dd-0a65cb615e1a' could not be found. Oct 04 18:01:46.245100 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '5bddd0cb-3a6a-4f21-a4dd-0a65cb615e1a'} Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '5bddd0cb-3a6a-4f21-a4dd-0a65cb615e1a' Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 18:01:46.245775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '5bddd0cb-3a6a-4f21-a4dd-0a65cb615e1a' could not be found. Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:46.247033 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.250923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.250923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:46.250923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:46.250923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:46.250923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:46.250923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '5bddd0cb-3a6a-4f21-a4dd-0a65cb615e1a' could not be found. Oct 04 18:01:46.250923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.253422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-37fbf01f-1c05-40ab-b24d-8c8d07a5b0a6 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Returning 404 to user: Hypervisor with ID '5bddd0cb-3a6a-4f21-a4dd-0a65cb615e1a' could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:46.255813 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-37fbf01f-1c05-40ab-b24d-8c8d07a5b0a6 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/5bddd0cb-3a6a-4f21-a4dd-0a65cb615e1a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.043800 Oct 04 18:01:46.257340 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 96/180] 10.222.0.18 () {58 vars in 1278 bytes} [Tue Oct 4 18:01:46 2022] GET /compute/v2.1/os-hypervisors/5bddd0cb-3a6a-4f21-a4dd-0a65cb615e1a/uptime => generated 123 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:46.268226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-79139d30-e48b-46ce-9c2b-788468c0d57f req-6a491a2a-e35c-49d0-86a8-856c7b94d9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7009eab7-c0a7-49a5-a792-57a7d67ebc00", "name": "network-vif-plugged", "status": "completed", "tag": "880a9913-72e3-4fb2-b738-75f05677aad8"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:46.286868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-79139d30-e48b-46ce-9c2b-788468c0d57f req-6a491a2a-e35c-49d0-86a8-856c7b94d9d2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.288608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-79139d30-e48b-46ce-9c2b-788468c0d57f req-6a491a2a-e35c-49d0-86a8-856c7b94d9d2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.291344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-79139d30-e48b-46ce-9c2b-788468c0d57f req-6a491a2a-e35c-49d0-86a8-856c7b94d9d2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.304719 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-79139d30-e48b-46ce-9c2b-788468c0d57f req-6a491a2a-e35c-49d0-86a8-856c7b94d9d2 service nova] Creating event network-vif-plugged:880a9913-72e3-4fb2-b738-75f05677aad8 for instance 7009eab7-c0a7-49a5-a792-57a7d67ebc00 on n-h2-850499-14 Oct 04 18:01:46.310752 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-79139d30-e48b-46ce-9c2b-788468c0d57f req-6a491a2a-e35c-49d0-86a8-856c7b94d9d2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051863 Oct 04 18:01:46.311684 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 97/181] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:46.324917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-240b4f5c-1fee-43f9-a1f1-0f6a4623c231 req-ffa02929-c155-4d59-8e6f-de080863eb95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d00075-7e6e-4930-963c-eed6b842bcc3", "tag": "5e474ddd-81ed-4e23-8a91-97f48a6cd567"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:46.338131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-240b4f5c-1fee-43f9-a1f1-0f6a4623c231 req-ffa02929-c155-4d59-8e6f-de080863eb95 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.339266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-240b4f5c-1fee-43f9-a1f1-0f6a4623c231 req-ffa02929-c155-4d59-8e6f-de080863eb95 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.339852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-240b4f5c-1fee-43f9-a1f1-0f6a4623c231 req-ffa02929-c155-4d59-8e6f-de080863eb95 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.368149 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-240b4f5c-1fee-43f9-a1f1-0f6a4623c231 req-ffa02929-c155-4d59-8e6f-de080863eb95 service nova] Creating event network-changed:5e474ddd-81ed-4e23-8a91-97f48a6cd567 for instance 62d00075-7e6e-4930-963c-eed6b842bcc3 on n-h1-850499-14 Oct 04 18:01:46.375334 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-240b4f5c-1fee-43f9-a1f1-0f6a4623c231 req-ffa02929-c155-4d59-8e6f-de080863eb95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060670 Oct 04 18:01:46.376206 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 98/182] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:46.383523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-25cee9d1-cb58-48d2-b86f-f1c6af026dbb tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:46.411289 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-25cee9d1-cb58-48d2-b86f-f1c6af026dbb tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.033630 Oct 04 18:01:46.412631 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 99/183] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:46 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:46.424504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Calling method '.version_select at 0x7fd4d2aa2e50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:46.426910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.427728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.428337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.448842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.450349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.450979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.468138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.468881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.469904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.483631 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1210be03-0976-4e57-8288-3d32d6fc7df0 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.068290 Oct 04 18:01:46.486206 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 100/184] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:46.503057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fda20e6d-9060-4db3-abea-977902255e1c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:46.504340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fda20e6d-9060-4db3-abea-977902255e1c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:46.521965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fda20e6d-9060-4db3-abea-977902255e1c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.522462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fda20e6d-9060-4db3-abea-977902255e1c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.528462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fda20e6d-9060-4db3-abea-977902255e1c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.529475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fda20e6d-9060-4db3-abea-977902255e1c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.530269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fda20e6d-9060-4db3-abea-977902255e1c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.530857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fda20e6d-9060-4db3-abea-977902255e1c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.531250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bdcac3cd-4742-4ad2-a803-ba9df1e48ab8 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:46.546673 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bdcac3cd-4742-4ad2-a803-ba9df1e48ab8 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1320 microversion: 2.1 time: 0.745800 Oct 04 18:01:46.551050 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 85/185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:45 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1320 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:46.559624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:46.560623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:46.579037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.582378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.583057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.585704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.587554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.588155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.710496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fda20e6d-9060-4db3-abea-977902255e1c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:46.721755 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fda20e6d-9060-4db3-abea-977902255e1c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1318 microversion: 2.1 time: 0.233835 Oct 04 18:01:46.723485 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 101/186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:46 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:46.732297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b032af25-d8b5-4709-8ce3-6185e62d9f89 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-274844892"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:46.742654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.aggregate [None req-b032af25-d8b5-4709-8ce3-6185e62d9f89 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Generated uuid f1810122-757c-4d90-87af-f906c2b18c43 for aggregate {{(pid=122332) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:46.744601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:46.760919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:46.762642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:46.770045 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1cb9010-fecd-45ef-ba95-123a697c96ce tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.217224 Oct 04 18:01:46.772307 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 86/187] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:46 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:46.778710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a3f366d4-f994-451e-984e-94c5ca0d6e2e tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Calling method '.version_select at 0x7fd4d295a1f0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:46.780697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a3f366d4-f994-451e-984e-94c5ca0d6e2e tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '5d65e73f7c6b47288a644e352eeef869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358385b3b1f544699516c8ce95099bb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a3f366d4-f994-451e-984e-94c5ca0d6e2e tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Request method failure captured: Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUGzq1jjZDB_ZK6DXeoJAIDbmkf_EpEBuiPXMVU-KIXd1DHdQnUYH11nX-4IFuQes11vO4mX80aruPAY4UmYbm-3vtxN8njKxXCCRKt72A32WzOYbLEiaHDh1JasgU5LOL0HUFn5Rt3o51lW6nZObeLG6nwyEVxhiWayqkjIZEioEk Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 358385b3b1f544699516c8ce95099bb1 Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:01:46.782282 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_358385b3b1f544699516c8ce95099bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/358385b3b1f544699516c8ce95099bb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/358385b3b1f544699516c8ce95099bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/358385b3b1f544699516c8ce95099bb1"}]}] Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 358385b3b1f544699516c8ce95099bb1 Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381 Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-HypervisorAdminNegativeTestJSON-1828141381-project Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 5d65e73f7c6b47288a644e352eeef869 Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1828141381-project Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '1'} Oct 04 18:01:46.783575 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:46.784313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:01:46.785468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.786540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a3f366d4-f994-451e-984e-94c5ca0d6e2e tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:46.786540 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a3f366d4-f994-451e-984e-94c5ca0d6e2e tempest-HypervisorAdminNegativeTestJSON-1828141381 tempest-HypervisorAdminNegativeTestJSON-1828141381-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.010004 Oct 04 18:01:46.786540 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 87/188] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:46 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:46.796828 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b032af25-d8b5-4709-8ce3-6185e62d9f89 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.072179 Oct 04 18:01:46.797448 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 102/189] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:46 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:46.809885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84bcd1f1-e217-48cd-89b1-8e805ccb377e tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-14"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:46.811680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f90cb8d1-6311-4325-b146-e67fa6a3f7d3 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Calling method '.version_select at 0x7fd4d2c68040>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:46.814183 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-f90cb8d1-6311-4325-b146-e67fa6a3f7d3 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] HTTP exception thrown: Hypervisor with ID 'fafa3e30-a83c-4efa-b2a9-e83046d9b457' could not be found. Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f90cb8d1-6311-4325-b146-e67fa6a3f7d3 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Request method failure captured: Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-hypervisors/fafa3e30-a83c-4efa-b2a9-e83046d9b457 HTTP/1.1 Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUHddadgSobpqNWYSg11uxgOjVeS4Bx4HfdgL9vA_7FDRRWHIE2Wo9q4HJNlahDNSquZlMcGU58tXsFy8X3om7JwqloSgiJpJexUyx0_kC6RI8_3Cr3yLAJ_328Av4ppAlGPwmNnNTWr9V_TnOqPRj52Ui34J8oVFbFIRtlP9pT_Mk Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: faede13a3ffb494ba6eb1bf1820aa6e2 Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-953216502 Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:46.818507 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_faede13a3ffb494ba6eb1bf1820aa6e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/faede13a3ffb494ba6eb1bf1820aa6e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faede13a3ffb494ba6eb1bf1820aa6e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faede13a3ffb494ba6eb1bf1820aa6e2"}]}] Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-953216502 Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: faede13a3ffb494ba6eb1bf1820aa6e2 Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-953216502 Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: f3795ebe2357425987d94bf287b87855 Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: exception: Hypervisor with ID 'fafa3e30-a83c-4efa-b2a9-e83046d9b457' could not be found. Oct 04 18:01:46.819755 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'fafa3e30-a83c-4efa-b2a9-e83046d9b457'} Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'fafa3e30-a83c-4efa-b2a9-e83046d9b457' Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 18:01:46.820399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:01:46.821540 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'fafa3e30-a83c-4efa-b2a9-e83046d9b457' could not be found. Oct 04 18:01:46.826299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.826299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:46.826299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.826299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:46.826299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:46.826299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:46.826299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:46.826299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:46.826299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'fafa3e30-a83c-4efa-b2a9-e83046d9b457' could not be found. Oct 04 18:01:46.826299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:46.831175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f90cb8d1-6311-4325-b146-e67fa6a3f7d3 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] Returning 404 to user: Hypervisor with ID 'fafa3e30-a83c-4efa-b2a9-e83046d9b457' could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:46.832495 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f90cb8d1-6311-4325-b146-e67fa6a3f7d3 tempest-HypervisorAdminNegativeTestJSON-953216502 tempest-HypervisorAdminNegativeTestJSON-953216502-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/fafa3e30-a83c-4efa-b2a9-e83046d9b457" status: 404 len: 123 microversion: 2.1 time: 0.033549 Oct 04 18:01:46.834851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84bcd1f1-e217-48cd-89b1-8e805ccb377e tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.835786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84bcd1f1-e217-48cd-89b1-8e805ccb377e tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.835901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84bcd1f1-e217-48cd-89b1-8e805ccb377e tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.844206 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 88/190] 10.222.0.18 () {58 vars in 1257 bytes} [Tue Oct 4 18:01:46 2022] GET /compute/v2.1/os-hypervisors/fafa3e30-a83c-4efa-b2a9-e83046d9b457 => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:47.006492 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84bcd1f1-e217-48cd-89b1-8e805ccb377e tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.200097 Oct 04 18:01:47.007888 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 103/191] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 4 18:01:46 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:47.034481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d795fe7a-42fb-49aa-a9a9-2e8c52e3c47f tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:47.066931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d795fe7a-42fb-49aa-a9a9-2e8c52e3c47f tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.070630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d795fe7a-42fb-49aa-a9a9-2e8c52e3c47f tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.071758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d795fe7a-42fb-49aa-a9a9-2e8c52e3c47f tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.351793 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d795fe7a-42fb-49aa-a9a9-2e8c52e3c47f tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.329884 Oct 04 18:01:47.352309 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 89/192] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 4 18:01:47 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:47.365806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f7121af-d687-4824-b4bb-ed44b6b2138b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:47.422236 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f7121af-d687-4824-b4bb-ed44b6b2138b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.061692 Oct 04 18:01:47.426424 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 104/193] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:47 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:47.433709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1242b434-59f1-4de0-ad91-7f5f630817a0 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-743648673"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:47.438387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-1242b434-59f1-4de0-ad91-7f5f630817a0 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Generated uuid d7801ff7-ee0c-4801-b876-7ee94d6340f9 for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:47.484354 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1242b434-59f1-4de0-ad91-7f5f630817a0 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.052370 Oct 04 18:01:47.492331 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 90/194] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:47 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:47.513712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4bd873fe-d51a-44bf-9eae-ca810a68fd04 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:47.566267 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4bd873fe-d51a-44bf-9eae-ca810a68fd04 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.064619 Oct 04 18:01:47.568319 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 105/195] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:47 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:47.577397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a437c014-8cd4-4c46-ab8e-b8e0496dfcf2 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:47.596990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-acc48e75-94e9-4e44-8d3b-22afe2e475ac tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:47.598495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-acc48e75-94e9-4e44-8d3b-22afe2e475ac tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:47.599251 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-a437c014-8cd4-4c46-ab8e-b8e0496dfcf2 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a437c014-8cd4-4c46-ab8e-b8e0496dfcf2 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Request method failure captured: Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHTXTpL8vBlxmBDbmIPE2rY3My6wyc7PRiR5ot396giuOUCcsX84CRJ3NQgoSQBqk70HafQztOGvDIpf7u2HfDZIZ7YnTpxBzInm10EH-AO6kH4jLmoR_G_eKgA9Y7PqvQ39hQvZ_ocKuTajLmh5XCl97mgXu3BkLBX2_ZVPIQDBPzo Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 46dd51d0ab3c4578accd91f265f31190 Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:47.609579 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46dd51d0ab3c4578accd91f265f31190"}]}] Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 46dd51d0ab3c4578accd91f265f31190 Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminTestJSON-406448390-project-admin Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: f8f9afd8b1304834b1d7435453c7566c Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminTestJSON-406448390-project-admin Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: exception: Aggregate 6 could not be found. Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '6'} Oct 04 18:01:47.611068 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:47.611901 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 04 18:01:47.613643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:47.615729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a437c014-8cd4-4c46-ab8e-b8e0496dfcf2 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:47.616775 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a437c014-8cd4-4c46-ab8e-b8e0496dfcf2 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.043613 Oct 04 18:01:47.619983 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 91/196] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:01:47 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:47.620810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acc48e75-94e9-4e44-8d3b-22afe2e475ac tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.624801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acc48e75-94e9-4e44-8d3b-22afe2e475ac tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.627989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acc48e75-94e9-4e44-8d3b-22afe2e475ac tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.629644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acc48e75-94e9-4e44-8d3b-22afe2e475ac tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.630266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acc48e75-94e9-4e44-8d3b-22afe2e475ac tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.630817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acc48e75-94e9-4e44-8d3b-22afe2e475ac tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.632618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-940a6c56-cd0f-4eaf-a7da-b4844fe3b61b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:47.669669 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-940a6c56-cd0f-4eaf-a7da-b4844fe3b61b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-940a6c56-cd0f-4eaf-a7da-b4844fe3b61b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Request method failure captured: Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHTXTpL8vBlxmBDbmIPE2rY3My6wyc7PRiR5ot396giuOUCcsX84CRJ3NQgoSQBqk70HafQztOGvDIpf7u2HfDZIZ7YnTpxBzInm10EH-AO6kH4jLmoR_G_eKgA9Y7PqvQ39hQvZ_ocKuTajLmh5XCl97mgXu3BkLBX2_ZVPIQDBPzo Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 46dd51d0ab3c4578accd91f265f31190 Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:47.672570 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46dd51d0ab3c4578accd91f265f31190"}]}] Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 46dd51d0ab3c4578accd91f265f31190 Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminTestJSON-406448390-project-admin Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: f8f9afd8b1304834b1d7435453c7566c Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminTestJSON-406448390-project-admin Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: exception: Aggregate 6 could not be found. Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '6'} Oct 04 18:01:47.673715 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:47.674420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:47.676003 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:47.678943 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:47.678943 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:47.678943 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:47.678943 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 04 18:01:47.678943 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:47.680493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-940a6c56-cd0f-4eaf-a7da-b4844fe3b61b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:47.681625 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-940a6c56-cd0f-4eaf-a7da-b4844fe3b61b tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.057869 Oct 04 18:01:47.682381 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 92/197] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:47 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:47.692880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b69de45a-757a-4e83-856a-974116bac640 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2052243913", "name": "tempest-test_aggregate-1347628548"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:47.718918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-b69de45a-757a-4e83-856a-974116bac640 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Generated uuid 9ccbdd81-6961-487e-81ee-a370dde1fe69 for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:47.755458 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b69de45a-757a-4e83-856a-974116bac640 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.066586 Oct 04 18:01:47.756612 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 93/198] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 4 18:01:47 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:47.763220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-66dd6252-862f-4744-9da1-0be11e0907b1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:47.764169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-66dd6252-862f-4744-9da1-0be11e0907b1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:47.774930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-66dd6252-862f-4744-9da1-0be11e0907b1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.777166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-66dd6252-862f-4744-9da1-0be11e0907b1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.778110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-66dd6252-862f-4744-9da1-0be11e0907b1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.780076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-66dd6252-862f-4744-9da1-0be11e0907b1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.781289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-66dd6252-862f-4744-9da1-0be11e0907b1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.782248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-66dd6252-862f-4744-9da1-0be11e0907b1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.953794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-acc48e75-94e9-4e44-8d3b-22afe2e475ac tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:47.965220 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-acc48e75-94e9-4e44-8d3b-22afe2e475ac tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1320 microversion: 2.1 time: 0.383728 Oct 04 18:01:47.966020 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 106/199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:47 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1320 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:47.980817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-14a56ff9-91a4-4ba6-a14d-190febd91f7a tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.035980 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-14a56ff9-91a4-4ba6-a14d-190febd91f7a tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.068690 Oct 04 18:01:48.037087 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 107/200] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:47 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:48.047267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.048016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:48.067728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:48.068577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:48.070177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:48.071222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:48.072769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-66dd6252-862f-4744-9da1-0be11e0907b1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:48.073475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:48.074790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:48.082435 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-66dd6252-862f-4744-9da1-0be11e0907b1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1318 microversion: 2.1 time: 0.324400 Oct 04 18:01:48.083369 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 94/201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:47 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:48.111174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b7ceef1-c68a-48ac-ba99-aefc8396e010 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.122845 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-9b7ceef1-c68a-48ac-ba99-aefc8396e010 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b7ceef1-c68a-48ac-ba99-aefc8396e010 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Request method failure captured: Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHTXTpL8vBlxmBDbmIPE2rY3My6wyc7PRiR5ot396giuOUCcsX84CRJ3NQgoSQBqk70HafQztOGvDIpf7u2HfDZIZ7YnTpxBzInm10EH-AO6kH4jLmoR_G_eKgA9Y7PqvQ39hQvZ_ocKuTajLmh5XCl97mgXu3BkLBX2_ZVPIQDBPzo Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 46dd51d0ab3c4578accd91f265f31190 Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:48.125432 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46dd51d0ab3c4578accd91f265f31190"}]}] Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 46dd51d0ab3c4578accd91f265f31190 Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminTestJSON-406448390-project-admin Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: f8f9afd8b1304834b1d7435453c7566c Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminTestJSON-406448390-project-admin Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: exception: Aggregate 7 could not be found. Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '7'} Oct 04 18:01:48.126819 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:48.127815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 04 18:01:48.130753 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:48.134331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b7ceef1-c68a-48ac-ba99-aefc8396e010 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:48.135518 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b7ceef1-c68a-48ac-ba99-aefc8396e010 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.050961 Oct 04 18:01:48.137205 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 95/202] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:01:48 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:48.153501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c7fbf279-c3d0-42b7-ac5b-472715cf9b5a tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.186415 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c7fbf279-c3d0-42b7-ac5b-472715cf9b5a tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c7fbf279-c3d0-42b7-ac5b-472715cf9b5a tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Request method failure captured: Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHTXTpL8vBlxmBDbmIPE2rY3My6wyc7PRiR5ot396giuOUCcsX84CRJ3NQgoSQBqk70HafQztOGvDIpf7u2HfDZIZ7YnTpxBzInm10EH-AO6kH4jLmoR_G_eKgA9Y7PqvQ39hQvZ_ocKuTajLmh5XCl97mgXu3BkLBX2_ZVPIQDBPzo Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 46dd51d0ab3c4578accd91f265f31190 Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:48.188435 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46dd51d0ab3c4578accd91f265f31190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46dd51d0ab3c4578accd91f265f31190"}]}] Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 46dd51d0ab3c4578accd91f265f31190 Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-406448390 Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminTestJSON-406448390-project-admin Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: f8f9afd8b1304834b1d7435453c7566c Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminTestJSON-406448390-project-admin Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: exception: Aggregate 7 could not be found. Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '7'} Oct 04 18:01:48.190358 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:48.192134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:48.193162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:48.194230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:48.194230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:48.194230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:48.194230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 04 18:01:48.194230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:48.197603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c7fbf279-c3d0-42b7-ac5b-472715cf9b5a tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:48.199370 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c7fbf279-c3d0-42b7-ac5b-472715cf9b5a tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.056503 Oct 04 18:01:48.200764 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 96/203] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:48 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:48.204780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:48.215074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:48.215328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f315e596-37c8-4c02-a1cc-cf2b515be198 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1813623245"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:48.220835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-f315e596-37c8-4c02-a1cc-cf2b515be198 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Generated uuid 50cdf16a-0b9d-4e09-ad61-ecd2082b198e for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:48.224261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:48.237458 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-91824b06-694a-4ad5-8664-e9e964b9b670 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.197953 Oct 04 18:01:48.252167 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 108/204] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:48 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:48.257489 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f315e596-37c8-4c02-a1cc-cf2b515be198 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050836 Oct 04 18:01:48.258836 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 97/205] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:48.271623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f561cdd-e986-4010-ab92-4067944b754d tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.287148 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f561cdd-e986-4010-ab92-4067944b754d tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.020833 Oct 04 18:01:48.302236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d92c44d3-2235-4bf4-95bb-ef085b55157c tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:48.307020 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 109/206] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:01:48 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:48.345985 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d92c44d3-2235-4bf4-95bb-ef085b55157c tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.049113 Oct 04 18:01:48.347155 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 98/207] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 4 18:01:48 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:48.361273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29a22665-638f-44c6-88fd-53a2fbe3f005 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.371314 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29a22665-638f-44c6-88fd-53a2fbe3f005 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.014513 Oct 04 18:01:48.372300 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 110/208] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:01:48 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:48.390876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ffa8eba8-a11a-4b04-b4bb-eeb1ffadde96 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.424447 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ffa8eba8-a11a-4b04-b4bb-eeb1ffadde96 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.044007 Oct 04 18:01:48.425075 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 99/209] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:48 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 18:01:48.436956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-683184ee-32da-49a6-b97c-1c823b30ab66 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1601675913", "availability_zone": "tempest-test_az-1257686709"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:48.469370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.aggregate [None req-683184ee-32da-49a6-b97c-1c823b30ab66 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Generated uuid 43a828ac-a832-4708-b31f-23d0fe2aa790 for aggregate {{(pid=122332) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:48.561507 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-683184ee-32da-49a6-b97c-1c823b30ab66 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.124192 Oct 04 18:01:48.564212 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 111/210] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 4 18:01:48 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:48.577244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-25ecb5e3-718d-444a-8c25-77fea48f8700 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1601675913_new", "availability_zone": "tempest-test_az-1257686709_new"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:48.854722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ecb5e3-718d-444a-8c25-77fea48f8700 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:48.856939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ecb5e3-718d-444a-8c25-77fea48f8700 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:48.858263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ecb5e3-718d-444a-8c25-77fea48f8700 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:48.932989 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-25ecb5e3-718d-444a-8c25-77fea48f8700 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.361092 Oct 04 18:01:48.935334 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 100/211] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:01:48 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:48.947097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3cb9e338-f51f-417c-87de-1a074c9a32bd tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.956775 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3cb9e338-f51f-417c-87de-1a074c9a32bd tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.013356 Oct 04 18:01:48.957362 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 112/212] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:01:48 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:48.971244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aede17da-55d6-45d4-bc8a-18e88c9fe983 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.994601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-65e5e199-35fe-4e3b-a0d7-56ebac2be1a4 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.995612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-65e5e199-35fe-4e3b-a0d7-56ebac2be1a4 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:49.021076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65e5e199-35fe-4e3b-a0d7-56ebac2be1a4 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.021951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65e5e199-35fe-4e3b-a0d7-56ebac2be1a4 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.023139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65e5e199-35fe-4e3b-a0d7-56ebac2be1a4 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.024855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65e5e199-35fe-4e3b-a0d7-56ebac2be1a4 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.025678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65e5e199-35fe-4e3b-a0d7-56ebac2be1a4 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.026546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65e5e199-35fe-4e3b-a0d7-56ebac2be1a4 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.047395 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aede17da-55d6-45d4-bc8a-18e88c9fe983 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.079993 Oct 04 18:01:49.053852 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 101/213] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:48 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:49.059952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8b002830-d979-48fb-a5a3-251c834216d7 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-771012046"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:49.064104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-8b002830-d979-48fb-a5a3-251c834216d7 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Generated uuid d84ff6a8-42c9-4511-b55e-d8a6b38aa4cc for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:49.099276 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8b002830-d979-48fb-a5a3-251c834216d7 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044232 Oct 04 18:01:49.109532 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 102/214] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:49.122008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-38b7ee0a-b509-4913-ae41-adc550c2d19c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:49.123265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-38b7ee0a-b509-4913-ae41-adc550c2d19c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:49.134994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=8,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:49.137933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b7ee0a-b509-4913-ae41-adc550c2d19c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.138634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b7ee0a-b509-4913-ae41-adc550c2d19c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.139741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b7ee0a-b509-4913-ae41-adc550c2d19c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.147299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b7ee0a-b509-4913-ae41-adc550c2d19c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.147299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b7ee0a-b509-4913-ae41-adc550c2d19c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.147299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b7ee0a-b509-4913-ae41-adc550c2d19c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.648656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-65e5e199-35fe-4e3b-a0d7-56ebac2be1a4 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:49.662130 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-65e5e199-35fe-4e3b-a0d7-56ebac2be1a4 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1320 microversion: 2.1 time: 0.676275 Oct 04 18:01:49.663028 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 113/215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:48 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1320 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:49.676507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3551c1f7-7dd7-4734-bc8e-baf0d870de12 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:49.683004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-38b7ee0a-b509-4913-ae41-adc550c2d19c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:49.699988 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-38b7ee0a-b509-4913-ae41-adc550c2d19c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1468 microversion: 2.1 time: 0.587284 Oct 04 18:01:49.701276 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 103/216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:49 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1468 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:49.712358 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3551c1f7-7dd7-4734-bc8e-baf0d870de12 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.047863 Oct 04 18:01:49.713639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:49.714484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:49.716011 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 114/217] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:01:49 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:49.732231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.732729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.733181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.734031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.734869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.735393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.737863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=14 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:49.890266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:49.904767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:49.906798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:49.927519 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f54181e-3736-4c5b-81d9-1e27d8d21f0d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.223083 Oct 04 18:01:49.930454 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 104/218] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:49 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:49.936463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c84d3b63-4179-4cb3-b59b-17b703259298 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:49.989376 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c84d3b63-4179-4cb3-b59b-17b703259298 tempest-AggregatesAdminTestJSON-406448390 tempest-AggregatesAdminTestJSON-406448390-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.054085 Oct 04 18:01:49.990755 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 105/219] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:01:49 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:50.005843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:50.006818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:50.020619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.025194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.026020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.028082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.033694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.034309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.063042 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] HTTP exception thrown: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Request method failure captured: Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af HTTP/1.1 Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHTUS_Gv1Sh3_XRJMfa34Iwt28wiP9kS4Z77cTbfMYuLgOBkli7YmG4-e1AfakIa7qUuzEzhcXqRdNkv79PMaTrwF_xggwvnewaLWvCnVyBSptyRMzKINjAyemrm5EIDoZRsIoXlARcYkrhXZe4yMFtytUSB7RBNQEK5xZ9beEo6slQ Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9d5e6b123c054021aaea2e02aa5dcec7 Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminTestJSON-894200978 Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:01:50.067225 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9d5e6b123c054021aaea2e02aa5dcec7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9d5e6b123c054021aaea2e02aa5dcec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d5e6b123c054021aaea2e02aa5dcec7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d5e6b123c054021aaea2e02aa5dcec7"}]}] Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminTestJSON-894200978 Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9d5e6b123c054021aaea2e02aa5dcec7 Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-894200978 Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminTestJSON-894200978-project Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 8bf35f8a9af242e8877d4c8432e44771 Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminTestJSON-894200978-project Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:50.069148 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '22f5e4bb-4f92-4506-bec4-f5f639e970af'} Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:50.070146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:50.071716 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:50.077946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Returning 404 to user: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:50.077946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a3e18c3-2f6d-4b3a-ad31-956cc65370b8 tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "DELETE /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 404 len: 111 microversion: 2.1 time: 0.073453 Oct 04 18:01:50.077946 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 106/220] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:49 2022] DELETE /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:01:50.084117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:50.084877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] [instance: 22f5e4bb-4f92-4506-bec4-f5f639e970af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:50.094702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.094702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.095141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.095830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.096278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.096991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.113904 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] HTTP exception thrown: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Request method failure captured: Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af HTTP/1.1 Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHTUS_Gv1Sh3_XRJMfa34Iwt28wiP9kS4Z77cTbfMYuLgOBkli7YmG4-e1AfakIa7qUuzEzhcXqRdNkv79PMaTrwF_xggwvnewaLWvCnVyBSptyRMzKINjAyemrm5EIDoZRsIoXlARcYkrhXZe4yMFtytUSB7RBNQEK5xZ9beEo6slQ Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9d5e6b123c054021aaea2e02aa5dcec7 Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminTestJSON-894200978 Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:01:50.115563 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9d5e6b123c054021aaea2e02aa5dcec7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9d5e6b123c054021aaea2e02aa5dcec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d5e6b123c054021aaea2e02aa5dcec7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d5e6b123c054021aaea2e02aa5dcec7"}]}] Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminTestJSON-894200978 Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9d5e6b123c054021aaea2e02aa5dcec7 Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-894200978 Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminTestJSON-894200978-project Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 8bf35f8a9af242e8877d4c8432e44771 Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminTestJSON-894200978-project Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:50.116751 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '22f5e4bb-4f92-4506-bec4-f5f639e970af'} Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:50.117394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. Oct 04 18:01:50.121874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:50.123089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] Returning 404 to user: Instance 22f5e4bb-4f92-4506-bec4-f5f639e970af could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:50.123089 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1e8f55e2-c8d7-409b-aaf7-a2facc2626be tempest-AggregatesAdminTestJSON-894200978 tempest-AggregatesAdminTestJSON-894200978-project] 10.222.0.18 "GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af" status: 404 len: 111 microversion: 2.1 time: 0.039659 Oct 04 18:01:50.123089 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 107/221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:50 2022] GET /compute/v2.1/servers/22f5e4bb-4f92-4506-bec4-f5f639e970af => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:50.537127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-884234046", "block_migration": true, "disk_over_commit": false}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:50.540955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:50.557851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.558689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.561399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.562196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.562677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.563828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.690164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1fd7582a-a4af-4ee0-a6a0-e40f8e15e8a0 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:50.690840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1fd7582a-a4af-4ee0-a6a0-e40f8e15e8a0 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:50.701689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fd7582a-a4af-4ee0-a6a0-e40f8e15e8a0 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.702511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fd7582a-a4af-4ee0-a6a0-e40f8e15e8a0 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.703955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fd7582a-a4af-4ee0-a6a0-e40f8e15e8a0 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.705607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fd7582a-a4af-4ee0-a6a0-e40f8e15e8a0 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.706079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fd7582a-a4af-4ee0-a6a0-e40f8e15e8a0 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.707663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fd7582a-a4af-4ee0-a6a0-e40f8e15e8a0 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.177710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1fd7582a-a4af-4ee0-a6a0-e40f8e15e8a0 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:51.194936 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1fd7582a-a4af-4ee0-a6a0-e40f8e15e8a0 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1320 microversion: 2.1 time: 0.509232 Oct 04 18:01:51.199703 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 108/222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:50 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1320 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:51.222773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.223789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:51.233544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.235714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.239307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.240498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.241299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.241938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.407628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:51.423569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:51.426072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:51.442790 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df5bcb26-0d40-474e-826b-8f73cd500d0b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.225317 Oct 04 18:01:51.459815 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 109/223] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:51 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:51.689462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lazy-loading 'flavor' on Instance uuid 7009eab7-c0a7-49a5-a792-57a7d67ebc00 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:51.761880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Going to try to live migrate instance to tempest-host-884234046 {{(pid=122332) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:01:51.773123 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] HTTP exception thrown: Compute host tempest-host-884234046 could not be found. Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Request method failure captured: Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00/action HTTP/1.1 Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 106 Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTuYLl5ZkqvcULM0Zn4itcczALLyqXcpSTTyQrkQNmF1wshfIJ6c0V6Y3EsP3L7-Gv7dZ8dkJ4VJ8Hyu89GvpGBn6iayp2Nzx5412JZWYJNHOkQhWtBYgMYhix51K74lAb3UkmFQVzg0ZQzlKx6IdAnUceEWj6ZVIbExL0Llghj9d0 Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: aad3835b07104d8cb465cbed0f85c69b Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-LiveMigrationNegativeTest-1383445139 Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:51.781378 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aad3835b07104d8cb465cbed0f85c69b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aad3835b07104d8cb465cbed0f85c69b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aad3835b07104d8cb465cbed0f85c69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aad3835b07104d8cb465cbed0f85c69b"}]}] Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-LiveMigrationNegativeTest-1383445139 Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: aad3835b07104d8cb465cbed0f85c69b Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1383445139 Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-LiveMigrationNegativeTest-1383445139-project-admin Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: fed4b84294b246b28bd89a9b4f153b73 Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-LiveMigrationNegativeTest-1383445139-project-admin Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: {"os-migrateLive": {"host": "tempest-host-884234046", "block_migration": true, "disk_over_commit": false}} Oct 04 18:01:51.786809 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: exception: Compute host tempest-host-884234046 could not be found. Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '7009eab7-c0a7-49a5-a792-57a7d67ebc00', 'body': {'os-migrateLive': {'host': 'tempest-host-884234046', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:01:51.787879 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-884234046 could not be found. Oct 04 18:01:51.789225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-884234046 could not be found. Oct 04 18:01:51.790859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.793185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.793185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.793185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.793185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.793185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.793185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:51.793185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:51.793185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-884234046 could not be found. Oct 04 18:01:51.793185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.795768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Returning 400 to user: Compute host tempest-host-884234046 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:51.797274 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e17aaf52-f8f0-49ae-ae0b-61f819e0017e tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00/action" status: 400 len: 99 microversion: 2.1 time: 2.072362 Oct 04 18:01:51.799265 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 115/224] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 4 18:01:49 2022] POST /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00/action => generated 99 bytes in 2075 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:01:51.813891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dd720216-6df3-4613-940d-7d62a090ab9e tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.819065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dd720216-6df3-4613-940d-7d62a090ab9e tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:51.828532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd720216-6df3-4613-940d-7d62a090ab9e tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.832350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd720216-6df3-4613-940d-7d62a090ab9e tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.832893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd720216-6df3-4613-940d-7d62a090ab9e tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.835566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd720216-6df3-4613-940d-7d62a090ab9e tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.836233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd720216-6df3-4613-940d-7d62a090ab9e tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.837020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd720216-6df3-4613-940d-7d62a090ab9e tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.854248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:52.161595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dd720216-6df3-4613-940d-7d62a090ab9e tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:52.185273 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dd720216-6df3-4613-940d-7d62a090ab9e tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1468 microversion: 2.1 time: 0.378668 Oct 04 18:01:52.189615 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 110/225] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:51 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1468 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:52.235909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4382d0b9-87fa-4861-b48f-56555eee04a1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:52.236551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4382d0b9-87fa-4861-b48f-56555eee04a1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:52.257990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4382d0b9-87fa-4861-b48f-56555eee04a1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:52.258504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4382d0b9-87fa-4861-b48f-56555eee04a1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:52.258945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4382d0b9-87fa-4861-b48f-56555eee04a1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:52.264722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4382d0b9-87fa-4861-b48f-56555eee04a1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:52.265217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4382d0b9-87fa-4861-b48f-56555eee04a1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:52.265661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4382d0b9-87fa-4861-b48f-56555eee04a1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:52.395985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22f089c1-9e2d-49fb-94c7-124085464bc7 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Calling method '.version_select at 0x7fd4d2758b80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:52.409165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22f089c1-9e2d-49fb-94c7-124085464bc7 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:52.409693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22f089c1-9e2d-49fb-94c7-124085464bc7 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:52.411420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22f089c1-9e2d-49fb-94c7-124085464bc7 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:52.412445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22f089c1-9e2d-49fb-94c7-124085464bc7 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:52.415579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22f089c1-9e2d-49fb-94c7-124085464bc7 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:52.416730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22f089c1-9e2d-49fb-94c7-124085464bc7 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:52.527280 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22f089c1-9e2d-49fb-94c7-124085464bc7 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.636728 Oct 04 18:01:52.548582 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 116/226] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 4 18:01:51 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:52.563330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:52.563330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:52.585989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:52.587878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:52.589150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:52.590253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:52.592079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:52.592753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:52.947508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:52.969084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:52.971482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:53.013741 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d247654b-dc95-448a-aef5-1211a3e4f3ea tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.463407 Oct 04 18:01:53.014715 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 117/227] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:52 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:53.196546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4382d0b9-87fa-4861-b48f-56555eee04a1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:53.210103 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4382d0b9-87fa-4861-b48f-56555eee04a1 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1320 microversion: 2.1 time: 0.985251 Oct 04 18:01:53.210709 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 111/228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:52 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1320 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:53.223949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1765301928", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:53.334884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:01:53.461824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8da74e4-6353-4f28-9048-ce76d54eb60c tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Calling method '.version_select at 0x7fd4d2725430>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:53.467106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8da74e4-6353-4f28-9048-ce76d54eb60c tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '30af1c3d969048bb93c480fcfa6603be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e67563e18740088b8532daebbc104e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8da74e4-6353-4f28-9048-ce76d54eb60c tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Request method failure captured: Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUNxEtI0zIkooMyje7he2fQl6pPAyE24unNpqSl18SngOL-n8_Yfb_RAVVNJgUlk-gwM8DzypVQKk0Mswhx0aDZPpz3-JTdfZlpvZ4P3icOrSyplNZaS3dzTqPEbx_QlL9y8EDCcc1q2N4NGl-SMferPgPKrnaHIKKcbHd6cd7DBCk Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:53.476540 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a2e67563e18740088b8532daebbc104e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a2e67563e18740088b8532daebbc104e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}] Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 30af1c3d969048bb93c480fcfa6603be Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: action_args: {} Oct 04 18:01:53.477894 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:53.478629 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:01:53.479793 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:53.482324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8da74e4-6353-4f28-9048-ce76d54eb60c tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:53.482324 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e8da74e4-6353-4f28-9048-ce76d54eb60c tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.453144 Oct 04 18:01:53.482324 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 118/229] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 4 18:01:53 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 455 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:53.485173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-518bb85d-93d5-45ce-ac9d-50fcdb2d366e req-b97f45f5-403b-47e3-b2a3-57f217995cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d00075-7e6e-4930-963c-eed6b842bcc3", "name": "network-vif-plugged", "status": "completed", "tag": "5e474ddd-81ed-4e23-8a91-97f48a6cd567"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:53.500858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-518bb85d-93d5-45ce-ac9d-50fcdb2d366e req-b97f45f5-403b-47e3-b2a3-57f217995cf8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:53.501375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-518bb85d-93d5-45ce-ac9d-50fcdb2d366e req-b97f45f5-403b-47e3-b2a3-57f217995cf8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:53.501812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-518bb85d-93d5-45ce-ac9d-50fcdb2d366e req-b97f45f5-403b-47e3-b2a3-57f217995cf8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:53.520046 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-518bb85d-93d5-45ce-ac9d-50fcdb2d366e req-b97f45f5-403b-47e3-b2a3-57f217995cf8 service nova] Creating event network-vif-plugged:5e474ddd-81ed-4e23-8a91-97f48a6cd567 for instance 62d00075-7e6e-4930-963c-eed6b842bcc3 on n-h1-850499-14 Oct 04 18:01:53.527305 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-518bb85d-93d5-45ce-ac9d-50fcdb2d366e req-b97f45f5-403b-47e3-b2a3-57f217995cf8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046272 Oct 04 18:01:53.529385 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 119/230] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:53.917120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:53.917547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:53.918201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:53.918783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:53.919375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:53.936143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:53.936887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:53.937567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:53.938567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:53.939116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:53.939556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:53.967799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Getting quotas for project d6615b8b1c0f43d7a2cee777f8ab891a. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:53.973275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Getting quotas for user 8dedbf6bf8d745c8a7a3706086365ee1 and project d6615b8b1c0f43d7a2cee777f8ab891a. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:53.990061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:01:53.993916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:01:54.063406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0b280bc4-b6a2-45f2-9215-472bfc858aaf tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:54.068578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b280bc4-b6a2-45f2-9215-472bfc858aaf tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.070525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b280bc4-b6a2-45f2-9215-472bfc858aaf tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.072496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b280bc4-b6a2-45f2-9215-472bfc858aaf tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.073301 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f537e802-4ef7-47c1-bf5a-649e2d4e2ea3 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861044 Oct 04 18:01:54.074354 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 112/231] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:01:54.081400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b280bc4-b6a2-45f2-9215-472bfc858aaf tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.082077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b280bc4-b6a2-45f2-9215-472bfc858aaf tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.082446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b280bc4-b6a2-45f2-9215-472bfc858aaf tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.094518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-afbd78f8-46b8-4402-88dd-9917db1b36ac tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Calling method '.version_select at 0x7fd4d289fa60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:54.101010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-afbd78f8-46b8-4402-88dd-9917db1b36ac tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '30af1c3d969048bb93c480fcfa6603be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e67563e18740088b8532daebbc104e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-afbd78f8-46b8-4402-88dd-9917db1b36ac tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Request method failure captured: Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-hosts/n-d-850499-14/reboot HTTP/1.1 Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUNxEtI0zIkooMyje7he2fQl6pPAyE24unNpqSl18SngOL-n8_Yfb_RAVVNJgUlk-gwM8DzypVQKk0Mswhx0aDZPpz3-JTdfZlpvZ4P3icOrSyplNZaS3dzTqPEbx_QlL9y8EDCcc1q2N4NGl-SMferPgPKrnaHIKKcbHd6cd7DBCk Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:01:54.106043 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a2e67563e18740088b8532daebbc104e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a2e67563e18740088b8532daebbc104e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}] Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 30af1c3d969048bb93c480fcfa6603be Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'n-d-850499-14'} Oct 04 18:01:54.107498 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:54.108219 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:01:54.109228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.111698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-afbd78f8-46b8-4402-88dd-9917db1b36ac tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:54.111698 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-afbd78f8-46b8-4402-88dd-9917db1b36ac tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-850499-14/reboot" status: 403 len: 111 microversion: 2.1 time: 0.032023 Oct 04 18:01:54.111698 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 113/232] 10.222.0.18 () {58 vars in 1191 bytes} [Tue Oct 4 18:01:54 2022] GET /compute/v2.1/os-hosts/n-d-850499-14/reboot => generated 111 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:54.126725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:54.127476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:54.150329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.150838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.151311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.152552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.153009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.153430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.161858 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0b280bc4-b6a2-45f2-9215-472bfc858aaf tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.630461 Oct 04 18:01:54.171867 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 120/233] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 4 18:01:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:54.181723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3b560830-283c-48c4-8a9b-19798845aadd tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:54.182486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3b560830-283c-48c4-8a9b-19798845aadd tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:54.351193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.362693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.368904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.376941 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3d6930b1-2284-461b-b0e3-eb30378c6ca3 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.265057 Oct 04 18:01:54.378269 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 114/234] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:54 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:54.400390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-29a8b9cd-082a-4251-a7db-038923340545 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Calling method '.version_select at 0x7fd4d2954280>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:54.428892 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-29a8b9cd-082a-4251-a7db-038923340545 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-29a8b9cd-082a-4251-a7db-038923340545 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Request method failure captured: Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUPHLT9XYczS9Apq4uiQqg7sqMsFbIePkNFtWCyQYZ0WtnuDoJd17miWeXAHwp7TfNVYEDHPABVHorst6ygzZVFLSOIL2c55ECzP1qMYTCfG3tmvY6zVnkWDc5V6YGjBW7TXt7yG51koLjBYLllB7MIYMUwRjhWxAxIed2eoEhw-ao Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:54.430918 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}] Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ef84ab155943439784d1793f31a30244 Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:01:54.432356 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:54.433257 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:01:54.434534 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-29a8b9cd-082a-4251-a7db-038923340545 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-29a8b9cd-082a-4251-a7db-038923340545 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.055407 Oct 04 18:01:54.435814 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 115/235] 10.222.0.18 () {58 vars in 1212 bytes} [Tue Oct 4 18:01:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:54.461095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-100398f8-d5ac-4ad4-86b9-4493262d5d9a tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-214938303"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:54.475932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3b560830-283c-48c4-8a9b-19798845aadd tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.480836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-100398f8-d5ac-4ad4-86b9-4493262d5d9a tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Generated uuid 710e4f29-ec3a-41da-831c-b36ef47eb5a6 for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:54.485778 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3b560830-283c-48c4-8a9b-19798845aadd tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1219 microversion: 2.1 time: 0.318723 Oct 04 18:01:54.486201 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 121/236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:54 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1219 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:54.538192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d57d703c-869c-46fb-8700-4270c5a2dd07 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:54.540605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d57d703c-869c-46fb-8700-4270c5a2dd07 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:54.553659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d57d703c-869c-46fb-8700-4270c5a2dd07 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.557311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d57d703c-869c-46fb-8700-4270c5a2dd07 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.566020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d57d703c-869c-46fb-8700-4270c5a2dd07 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.567284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d57d703c-869c-46fb-8700-4270c5a2dd07 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.569222 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-100398f8-d5ac-4ad4-86b9-4493262d5d9a tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.120087 Oct 04 18:01:54.569990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d57d703c-869c-46fb-8700-4270c5a2dd07 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.577863 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 116/237] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:54.578649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d57d703c-869c-46fb-8700-4270c5a2dd07 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.588224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57df53b5-f1e2-405d-9b17-314b27f09ef5 tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Calling method '.version_select at 0x7fd4d27c2a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:54.593847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-57df53b5-f1e2-405d-9b17-314b27f09ef5 tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '30af1c3d969048bb93c480fcfa6603be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e67563e18740088b8532daebbc104e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57df53b5-f1e2-405d-9b17-314b27f09ef5 tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Request method failure captured: Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-hosts/n-d-850499-14 HTTP/1.1 Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUNxEtI0zIkooMyje7he2fQl6pPAyE24unNpqSl18SngOL-n8_Yfb_RAVVNJgUlk-gwM8DzypVQKk0Mswhx0aDZPpz3-JTdfZlpvZ4P3icOrSyplNZaS3dzTqPEbx_QlL9y8EDCcc1q2N4NGl-SMferPgPKrnaHIKKcbHd6cd7DBCk Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:01:54.596812 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a2e67563e18740088b8532daebbc104e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a2e67563e18740088b8532daebbc104e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}] Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 30af1c3d969048bb93c480fcfa6603be Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'n-d-850499-14'} Oct 04 18:01:54.598789 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:54.599588 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:01:54.600727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:54.602523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57df53b5-f1e2-405d-9b17-314b27f09ef5 tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:54.603745 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-57df53b5-f1e2-405d-9b17-314b27f09ef5 tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-850499-14" status: 403 len: 109 microversion: 2.1 time: 0.031344 Oct 04 18:01:54.606611 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 117/238] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 4 18:01:54 2022] GET /compute/v2.1/os-hosts/n-d-850499-14 => generated 109 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:54.617224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17becc0e-b318-42f2-8f4d-63890caa708f tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:54.649900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17becc0e-b318-42f2-8f4d-63890caa708f tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.650725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17becc0e-b318-42f2-8f4d-63890caa708f tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.651397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17becc0e-b318-42f2-8f4d-63890caa708f tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.925360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d57d703c-869c-46fb-8700-4270c5a2dd07 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.936894 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d57d703c-869c-46fb-8700-4270c5a2dd07 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1320 microversion: 2.1 time: 0.446451 Oct 04 18:01:54.939661 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 122/239] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:54 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1320 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:54.953547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dfb86c65-c9c4-491c-a17c-d237cf6dc0c0 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Calling method '.version_select at 0x7fd4d2758af0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:54.988930 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-dfb86c65-c9c4-491c-a17c-d237cf6dc0c0 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:54.997739 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17becc0e-b318-42f2-8f4d-63890caa708f tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.389825 Oct 04 18:01:54.998346 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 118/240] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:01:54 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dfb86c65-c9c4-491c-a17c-d237cf6dc0c0 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Request method failure captured: Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUPHLT9XYczS9Apq4uiQqg7sqMsFbIePkNFtWCyQYZ0WtnuDoJd17miWeXAHwp7TfNVYEDHPABVHorst6ygzZVFLSOIL2c55ECzP1qMYTCfG3tmvY6zVnkWDc5V6YGjBW7TXt7yG51koLjBYLllB7MIYMUwRjhWxAxIed2eoEhw-ao Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:54.999642 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}] Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ef84ab155943439784d1793f31a30244 Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:01:55.000828 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.001625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.002684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.007596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dfb86c65-c9c4-491c-a17c-d237cf6dc0c0 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.010270 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dfb86c65-c9c4-491c-a17c-d237cf6dc0c0 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.069165 Oct 04 18:01:55.012016 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 123/241] 10.222.0.18 () {58 vars in 1191 bytes} [Tue Oct 4 18:01:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:55.014027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fab6722e-2e52-4e9e-a80f-0b250ab83075 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:55.031441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea9f617b-c108-418f-b50b-d44851b54f6f tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Calling method '.version_select at 0x7fd4d2725ee0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:55.038934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ea9f617b-c108-418f-b50b-d44851b54f6f tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '30af1c3d969048bb93c480fcfa6603be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e67563e18740088b8532daebbc104e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea9f617b-c108-418f-b50b-d44851b54f6f tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Request method failure captured: Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hosts/n-d-850499-14/shutdown HTTP/1.1 Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUNxEtI0zIkooMyje7he2fQl6pPAyE24unNpqSl18SngOL-n8_Yfb_RAVVNJgUlk-gwM8DzypVQKk0Mswhx0aDZPpz3-JTdfZlpvZ4P3icOrSyplNZaS3dzTqPEbx_QlL9y8EDCcc1q2N4NGl-SMferPgPKrnaHIKKcbHd6cd7DBCk Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:55.044312 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a2e67563e18740088b8532daebbc104e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a2e67563e18740088b8532daebbc104e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}] Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 30af1c3d969048bb93c480fcfa6603be Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'n-d-850499-14'} Oct 04 18:01:55.045682 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:55.046683 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:01:55.047785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.055553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fab6722e-2e52-4e9e-a80f-0b250ab83075 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:55.056069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fab6722e-2e52-4e9e-a80f-0b250ab83075 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:55.056518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fab6722e-2e52-4e9e-a80f-0b250ab83075 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:55.058331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea9f617b-c108-418f-b50b-d44851b54f6f tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.061570 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ea9f617b-c108-418f-b50b-d44851b54f6f tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-850499-14/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.044412 Oct 04 18:01:55.065868 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 124/242] 10.222.0.18 () {58 vars in 1197 bytes} [Tue Oct 4 18:01:55 2022] GET /compute/v2.1/os-hosts/n-d-850499-14/shutdown => generated 113 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:55.082555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-375d4910-abd9-4d2d-90c5-6fdc67804c72 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Calling method '.version_select at 0x7fd4d29ba1f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:55.109277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:55.130196 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-375d4910-abd9-4d2d-90c5-6fdc67804c72 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-375d4910-abd9-4d2d-90c5-6fdc67804c72 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Request method failure captured: Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUPHLT9XYczS9Apq4uiQqg7sqMsFbIePkNFtWCyQYZ0WtnuDoJd17miWeXAHwp7TfNVYEDHPABVHorst6ygzZVFLSOIL2c55ECzP1qMYTCfG3tmvY6zVnkWDc5V6YGjBW7TXt7yG51koLjBYLllB7MIYMUwRjhWxAxIed2eoEhw-ao Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:55.141833 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}] Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ef84ab155943439784d1793f31a30244 Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:01:55.143150 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:55.143859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:01:55.145411 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.146557 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.150259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-375d4910-abd9-4d2d-90c5-6fdc67804c72 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.156453 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-375d4910-abd9-4d2d-90c5-6fdc67804c72 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.081115 Oct 04 18:01:55.157360 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 125/243] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 4 18:01:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:55.166869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85b1be42-dc69-4d14-80dc-9fd7f4854b7b tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Calling method '.version_select at 0x7fd4d27250d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:55.169983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-85b1be42-dc69-4d14-80dc-9fd7f4854b7b tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '30af1c3d969048bb93c480fcfa6603be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e67563e18740088b8532daebbc104e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:55.172244 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-fab6722e-2e52-4e9e-a80f-0b250ab83075 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-850499-14. Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85b1be42-dc69-4d14-80dc-9fd7f4854b7b tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Request method failure captured: Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hosts/n-d-850499-14/startup HTTP/1.1 Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUNxEtI0zIkooMyje7he2fQl6pPAyE24unNpqSl18SngOL-n8_Yfb_RAVVNJgUlk-gwM8DzypVQKk0Mswhx0aDZPpz3-JTdfZlpvZ4P3icOrSyplNZaS3dzTqPEbx_QlL9y8EDCcc1q2N4NGl-SMferPgPKrnaHIKKcbHd6cd7DBCk Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:55.179338 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a2e67563e18740088b8532daebbc104e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a2e67563e18740088b8532daebbc104e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}] Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 30af1c3d969048bb93c480fcfa6603be Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'n-d-850499-14'} Oct 04 18:01:55.180584 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:55.181382 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:01:55.182488 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.186560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85b1be42-dc69-4d14-80dc-9fd7f4854b7b tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.188511 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-85b1be42-dc69-4d14-80dc-9fd7f4854b7b tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-850499-14/startup" status: 403 len: 110 microversion: 2.1 time: 0.025740 Oct 04 18:01:55.193886 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 126/244] 10.222.0.18 () {58 vars in 1194 bytes} [Tue Oct 4 18:01:55 2022] GET /compute/v2.1/os-hosts/n-d-850499-14/startup => generated 110 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:01:55.220654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a6cd593-b426-4270-ba4b-71da48d1428f tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Calling method '.version_select at 0x7fd4d271c820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fab6722e-2e52-4e9e-a80f-0b250ab83075 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Request method failure captured: Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 40 Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUQ8Rd8nYxrjg7bNCeiB58RHJCEdvt0LF2P1SWZO4jqBhO9euWXOTS56hXpaao_UVy0P284wOMsr3RE7sspw2Z-P0k9hIswIJlI5Z1gSQTineCTtYxSl4cxGwqDuNNvCQqP6Q1dyLAbnivnlIcZ8OsU3PLjOrzC1wyw2Rfa54zAFik Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:55.236298 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}] Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d05599626db140ff8f9966b37f0cbe1a Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: {"add_host": {"host": "n-h1-850499-14"}} Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:55.237865 n-d-850499-14 devstack@n-api.service[122331]: exception: Aggregate 11 already has host n-h1-850499-14. Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-850499-14'}}} Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:01:55.239338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-850499-14-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:01:55.240600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:01:55.241838 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:01:55.243143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-850499-14-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 1, 55, 145841), 'updated_at': None, 'host': 'n-h1-850499-14', 'aggregate_id': 11}] Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.245649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-850499-14. Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.246787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-850499-14. Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:55.248101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:55.249936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-850499-14. Oct 04 18:01:55.249936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.249936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fab6722e-2e52-4e9e-a80f-0b250ab83075 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-850499-14. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.249936 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fab6722e-2e52-4e9e-a80f-0b250ab83075 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.229151 Oct 04 18:01:55.249936 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 119/245] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:01:55 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 231 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 18:01:55.262239 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-9a6cd593-b426-4270-ba4b-71da48d1428f tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.265432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f76c64ad-b28b-466e-aa5c-53380b6fef56 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a6cd593-b426-4270-ba4b-71da48d1428f tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Request method failure captured: Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUPHLT9XYczS9Apq4uiQqg7sqMsFbIePkNFtWCyQYZ0WtnuDoJd17miWeXAHwp7TfNVYEDHPABVHorst6ygzZVFLSOIL2c55ECzP1qMYTCfG3tmvY6zVnkWDc5V6YGjBW7TXt7yG51koLjBYLllB7MIYMUwRjhWxAxIed2eoEhw-ao Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:55.271789 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}] Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ef84ab155943439784d1793f31a30244 Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:01:55.273309 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:55.274173 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:01:55.275457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.276748 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.280281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a6cd593-b426-4270-ba4b-71da48d1428f tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.281931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f76c64ad-b28b-466e-aa5c-53380b6fef56 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:55.282490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f76c64ad-b28b-466e-aa5c-53380b6fef56 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:55.283099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f76c64ad-b28b-466e-aa5c-53380b6fef56 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:55.284619 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a6cd593-b426-4270-ba4b-71da48d1428f tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.086521 Oct 04 18:01:55.289978 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 127/246] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Oct 4 18:01:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:55.307097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02333e0c-45ce-42cd-ae1c-aa9d74d47556 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d27251f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02333e0c-45ce-42cd-ae1c-aa9d74d47556 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Request method failure captured: Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: request: PUT /compute/v2.1/os-hosts/n-d-850499-14 HTTP/1.1 Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 51 Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUPHLT9XYczS9Apq4uiQqg7sqMsFbIePkNFtWCyQYZ0WtnuDoJd17miWeXAHwp7TfNVYEDHPABVHorst6ygzZVFLSOIL2c55ECzP1qMYTCfG3tmvY6zVnkWDc5V6YGjBW7TXt7yG51koLjBYLllB7MIYMUwRjhWxAxIed2eoEhw-ao Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:55.340018 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}] Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ef84ab155943439784d1793f31a30244 Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:55.341737 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'n-d-850499-14', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.342572 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.344417 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.345425 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.345425 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:01:55.345425 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:01:55.345425 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:01:55.345425 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.345425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02333e0c-45ce-42cd-ae1c-aa9d74d47556 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.345425 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-02333e0c-45ce-42cd-ae1c-aa9d74d47556 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-850499-14" status: 400 len: 199 microversion: 2.1 time: 0.050453 Oct 04 18:01:55.345425 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 128/247] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 4 18:01:55 2022] PUT /compute/v2.1/os-hosts/n-d-850499-14 => generated 199 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:01:55.358623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d3bdf4c-01e4-4ced-92c6-133e0c44e78c tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d271c0d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d3bdf4c-01e4-4ced-92c6-133e0c44e78c tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Request method failure captured: Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: request: PUT /compute/v2.1/os-hosts/n-d-850499-14 HTTP/1.1 Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 51 Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUPHLT9XYczS9Apq4uiQqg7sqMsFbIePkNFtWCyQYZ0WtnuDoJd17miWeXAHwp7TfNVYEDHPABVHorst6ygzZVFLSOIL2c55ECzP1qMYTCfG3tmvY6zVnkWDc5V6YGjBW7TXt7yG51koLjBYLllB7MIYMUwRjhWxAxIed2eoEhw-ao Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:55.375131 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}] Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ef84ab155943439784d1793f31a30244 Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:55.376581 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'n-d-850499-14', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.377448 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.379129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.380530 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.380530 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:01:55.380530 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:01:55.380530 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:01:55.380530 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.380530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d3bdf4c-01e4-4ced-92c6-133e0c44e78c tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.380530 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4d3bdf4c-01e4-4ced-92c6-133e0c44e78c tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-850499-14" status: 400 len: 189 microversion: 2.1 time: 0.030311 Oct 04 18:01:55.381104 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 129/248] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 4 18:01:55 2022] PUT /compute/v2.1/os-hosts/n-d-850499-14 => generated 189 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:01:55.393078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8fddbe33-1757-482c-9524-98c3766b0ecf tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Action: 'update', calling method: .version_select at 0x7fd4d2ab99d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:55.399066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8fddbe33-1757-482c-9524-98c3766b0ecf tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '30af1c3d969048bb93c480fcfa6603be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e67563e18740088b8532daebbc104e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8fddbe33-1757-482c-9524-98c3766b0ecf tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Request method failure captured: Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: request: PUT /compute/v2.1/os-hosts/n-d-850499-14 HTTP/1.1 Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 50 Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUNxEtI0zIkooMyje7he2fQl6pPAyE24unNpqSl18SngOL-n8_Yfb_RAVVNJgUlk-gwM8DzypVQKk0Mswhx0aDZPpz3-JTdfZlpvZ4P3icOrSyplNZaS3dzTqPEbx_QlL9y8EDCcc1q2N4NGl-SMferPgPKrnaHIKKcbHd6cd7DBCk Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:55.406871 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a2e67563e18740088b8532daebbc104e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a2e67563e18740088b8532daebbc104e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2e67563e18740088b8532daebbc104e"}]}] Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: a2e67563e18740088b8532daebbc104e Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-512673485 Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 30af1c3d969048bb93c480fcfa6603be Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HostsAdminNegativeTestJSON-512673485-project Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:01:55.408092 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'n-d-850499-14', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:55.408971 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:01:55.410095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.416892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8fddbe33-1757-482c-9524-98c3766b0ecf tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.419387 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8fddbe33-1757-482c-9524-98c3766b0ecf tempest-HostsAdminNegativeTestJSON-512673485 tempest-HostsAdminNegativeTestJSON-512673485-project] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-850499-14" status: 403 len: 111 microversion: 2.1 time: 0.034148 Oct 04 18:01:55.423920 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 130/249] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 4 18:01:55 2022] PUT /compute/v2.1/os-hosts/n-d-850499-14 => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:55.447543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:55.451319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:55.465211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:55.470385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:55.472921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:55.474081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:55.474786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:55.478824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:55.580790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:55.590070 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f76c64ad-b28b-466e-aa5c-53380b6fef56 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.345032 Oct 04 18:01:55.592373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:55.593217 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 120/250] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:01:55 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:55.594442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:55.601085 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-32c36e35-7dc4-4e1d-b701-711ef2d84f27 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.160369 Oct 04 18:01:55.602000 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 131/251] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:55 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:55.606987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ab933e9-753e-4a51-9753-df297b8d339a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:55.607810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ab933e9-753e-4a51-9753-df297b8d339a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:55.608187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cedafea8-426e-4955-ae76-51563f737a95 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d25d4a60>, body: {"status": null, "maintenance_mode": null} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:55.614591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ab933e9-753e-4a51-9753-df297b8d339a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:55.615328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ab933e9-753e-4a51-9753-df297b8d339a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:55.615903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ab933e9-753e-4a51-9753-df297b8d339a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:55.617255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ab933e9-753e-4a51-9753-df297b8d339a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:55.617784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ab933e9-753e-4a51-9753-df297b8d339a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:55.618224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ab933e9-753e-4a51-9753-df297b8d339a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cedafea8-426e-4955-ae76-51563f737a95 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Request method failure captured: Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/os-hosts/n-d-850499-14 HTTP/1.1 Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 42 Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUPHLT9XYczS9Apq4uiQqg7sqMsFbIePkNFtWCyQYZ0WtnuDoJd17miWeXAHwp7TfNVYEDHPABVHorst6ygzZVFLSOIL2c55ECzP1qMYTCfG3tmvY6zVnkWDc5V6YGjBW7TXt7yG51koLjBYLllB7MIYMUwRjhWxAxIed2eoEhw-ao Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:55.624482 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}] Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ef84ab155943439784d1793f31a30244 Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: {"status": null, "maintenance_mode": null} Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:01:55.625940 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'n-d-850499-14', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi None Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.626916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.629398 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.630613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:01:55.630613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:01:55.630613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:01:55.630613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.636681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cedafea8-426e-4955-ae76-51563f737a95 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.639511 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cedafea8-426e-4955-ae76-51563f737a95 tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-850499-14" status: 400 len: 127 microversion: 2.1 time: 0.044349 Oct 04 18:01:55.641367 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 121/252] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 4 18:01:55 2022] PUT /compute/v2.1/os-hosts/n-d-850499-14 => generated 127 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:01:55.735817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ab933e9-753e-4a51-9753-df297b8d339a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:55.748549 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ab933e9-753e-4a51-9753-df297b8d339a tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1215 microversion: 2.1 time: 0.145389 Oct 04 18:01:55.749694 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 132/253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:55 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:55.759802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-422953f8-025d-415a-b0a1-a96f2ca30c28 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:55.806475 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-422953f8-025d-415a-b0a1-a96f2ca30c28 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.054086 Oct 04 18:01:55.808785 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 133/254] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:01:55 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:55.822643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-42170da2-d18d-4b6c-8d95-a682048f56fb tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d2758b80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:55.826609 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.hosts [None req-42170da2-d18d-4b6c-8d95-a682048f56fb tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Enabling host nonexistent_hostname. Oct 04 18:01:55.836371 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-42170da2-d18d-4b6c-8d95-a682048f56fb tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-42170da2-d18d-4b6c-8d95-a682048f56fb tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Request method failure captured: Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 50 Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUPHLT9XYczS9Apq4uiQqg7sqMsFbIePkNFtWCyQYZ0WtnuDoJd17miWeXAHwp7TfNVYEDHPABVHorst6ygzZVFLSOIL2c55ECzP1qMYTCfG3tmvY6zVnkWDc5V6YGjBW7TXt7yG51koLjBYLllB7MIYMUwRjhWxAxIed2eoEhw-ao Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:55.838437 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dfc72160764a4b37ab2bfae1d70c0e1c"}]}] Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: dfc72160764a4b37ab2bfae1d70c0e1c Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-777129592 Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ef84ab155943439784d1793f31a30244 Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HostsAdminNegativeTestJSON-777129592-project-admin Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.839910 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:01:55.840701 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:55.841680 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:01:55.842760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:55.845435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-42170da2-d18d-4b6c-8d95-a682048f56fb tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:55.846532 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-42170da2-d18d-4b6c-8d95-a682048f56fb tempest-HostsAdminNegativeTestJSON-777129592 tempest-HostsAdminNegativeTestJSON-777129592-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.029069 Oct 04 18:01:55.847367 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 134/255] 10.222.0.18 () {60 vars in 1211 bytes} [Tue Oct 4 18:01:55 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:55.855181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f85cae4-495f-4da0-925c-6672c32cb14b tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-309082445"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:55.859029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.aggregate [None req-4f85cae4-495f-4da0-925c-6672c32cb14b tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Generated uuid 72306b06-eeb1-4ab7-b6c2-a036f16669bc for aggregate {{(pid=122332) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:55.896002 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f85cae4-495f-4da0-925c-6672c32cb14b tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046707 Oct 04 18:01:55.896612 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 135/256] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:56.109595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0045fe83-66a4-4709-bb53-c932b6a832b6 tempest-NetworksTest-1977718548 tempest-NetworksTest-1977718548-project-admin] Calling method '.version_select at 0x7fd4d25e1700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:56.439779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ccb8c615-f886-427e-a6e6-9c23cd97617a tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-14"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:56.446932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ccb8c615-f886-427e-a6e6-9c23cd97617a tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0851b5b9a23f440e97b5e2b376acaa22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78206a7056c143a9956ca565738dc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ccb8c615-f886-427e-a6e6-9c23cd97617a tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Request method failure captured: Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 40 Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUOH2n8Hqni_1BgdSGbVKtzg4d7dgXxol5SxqpILD60VTSxUGwRRB2ReBd_6hB6oN5-XRzp4RFWpWSLaFcXlt7bR0AEdQD1lpCNuICIYMDVx1cXI0MKS6It5VgxKS40_zLQBSR7-bJ-QHJq_Dr05k-TsykW6QZY9tlM07HEYJbi4iA Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:56.448923 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_78206a7056c143a9956ca565738dc05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/78206a7056c143a9956ca565738dc05f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}] Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0851b5b9a23f440e97b5e2b376acaa22 Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: {"add_host": {"host": "n-h1-850499-14"}} Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:01:56.451354 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-850499-14'}}} Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:56.452789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:01:56.455539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:56.459109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ccb8c615-f886-427e-a6e6-9c23cd97617a tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:56.459109 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ccb8c615-f886-427e-a6e6-9c23cd97617a tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.545624 Oct 04 18:01:56.460375 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 136/257] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:01:55 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 556 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:56.484887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a9e551b-ba1c-44d8-ae1e-8cbb9d35676b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:56.485606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3a9e551b-ba1c-44d8-ae1e-8cbb9d35676b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:56.498404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a9e551b-ba1c-44d8-ae1e-8cbb9d35676b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:56.499524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a9e551b-ba1c-44d8-ae1e-8cbb9d35676b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:56.500235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a9e551b-ba1c-44d8-ae1e-8cbb9d35676b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:56.501788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a9e551b-ba1c-44d8-ae1e-8cbb9d35676b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:56.507780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a9e551b-ba1c-44d8-ae1e-8cbb9d35676b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:56.508678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a9e551b-ba1c-44d8-ae1e-8cbb9d35676b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:56.795814 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0045fe83-66a4-4709-bb53-c932b6a832b6 tempest-NetworksTest-1977718548 tempest-NetworksTest-1977718548-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 3296 microversion: 2.1 time: 1.149899 Oct 04 18:01:56.796974 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 122/258] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:01:55 2022] GET /compute/v2.1/os-networks => generated 3296 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:56.802209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-913ca39d-b96a-4f76-98c8-a37385f8a8ee tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:56.864252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-913ca39d-b96a-4f76-98c8-a37385f8a8ee tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.065503 Oct 04 18:01:56.870515 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 123/259] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:01:56 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:56.883653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:56.887610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:56.902889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:56.903650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:56.906928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:56.908077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:56.908640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:56.909157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.021341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3a9e551b-ba1c-44d8-ae1e-8cbb9d35676b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.037547 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3a9e551b-ba1c-44d8-ae1e-8cbb9d35676b tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1470 microversion: 2.1 time: 0.576119 Oct 04 18:01:57.046619 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 137/260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:56 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1470 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:57.062366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f1643fe8-5386-4c8e-ad44-345abc0cdbc1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:57.063026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f1643fe8-5386-4c8e-ad44-345abc0cdbc1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:57.072373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f1643fe8-5386-4c8e-ad44-345abc0cdbc1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.072872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f1643fe8-5386-4c8e-ad44-345abc0cdbc1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.073314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f1643fe8-5386-4c8e-ad44-345abc0cdbc1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.074058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f1643fe8-5386-4c8e-ad44-345abc0cdbc1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.075009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.082434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f1643fe8-5386-4c8e-ad44-345abc0cdbc1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.082889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f1643fe8-5386-4c8e-ad44-345abc0cdbc1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.084396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.086027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.099097 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-77b80995-c55a-4cf0-9840-ad858a837d0a tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.226475 Oct 04 18:01:57.099966 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 124/261] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:56 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:57.127577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d8802f6d-efd8-4635-a260-ab982853dda5 tempest-NetworksTest-1977718548 tempest-NetworksTest-1977718548-project-admin] Calling method '.version_select at 0x7fd4d25e1a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:57.262095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f1643fe8-5386-4c8e-ad44-345abc0cdbc1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.274238 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f1643fe8-5386-4c8e-ad44-345abc0cdbc1 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1277 microversion: 2.1 time: 0.225014 Oct 04 18:01:57.290130 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 138/262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:57 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:57.297438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-357f788a-8414-489e-8177-824bd4c943a1 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2021299439"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:57.303374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.aggregate [None req-357f788a-8414-489e-8177-824bd4c943a1 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Generated uuid e9ea7092-b19f-4a8a-8e9c-895e76c2cb22 for aggregate {{(pid=122332) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:57.344004 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-357f788a-8414-489e-8177-824bd4c943a1 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052448 Oct 04 18:01:57.344889 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 139/263] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:57.357742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2c56eb80-a721-44af-be04-c216ecd88377 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:57.360955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2c56eb80-a721-44af-be04-c216ecd88377 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:57.375197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c56eb80-a721-44af-be04-c216ecd88377 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.375737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c56eb80-a721-44af-be04-c216ecd88377 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.376331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c56eb80-a721-44af-be04-c216ecd88377 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.377064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c56eb80-a721-44af-be04-c216ecd88377 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.377529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c56eb80-a721-44af-be04-c216ecd88377 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.377963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c56eb80-a721-44af-be04-c216ecd88377 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.389938 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d8802f6d-efd8-4635-a260-ab982853dda5 tempest-NetworksTest-1977718548 tempest-NetworksTest-1977718548-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks/051703dd-ddec-4a3f-9646-26fd6a546c44" status: 200 len: 652 microversion: 2.1 time: 0.277175 Oct 04 18:01:57.390529 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 125/264] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:01:57 2022] GET /compute/v2.1/os-networks/051703dd-ddec-4a3f-9646-26fd6a546c44 => generated 652 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:57.474278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:57.556580 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2c56eb80-a721-44af-be04-c216ecd88377 tempest-DeleteServersAdminTestJSON-1759475383 tempest-DeleteServersAdminTestJSON-1759475383-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3/action" status: 202 len: 0 microversion: 2.1 time: 0.210027 Oct 04 18:01:57.557473 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 140/265] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:57 2022] POST /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:01:57.570129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-440023021"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:57.583969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.584663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.585545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.594706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.595447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.596075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.606402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Calling method '.version_select at 0x7fd4d25d49d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:57.606535 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-440023021 could not be found. Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Request method failure captured: Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 57 Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUQ8Rd8nYxrjg7bNCeiB58RHJCEdvt0LF2P1SWZO4jqBhO9euWXOTS56hXpaao_UVy0P284wOMsr3RE7sspw2Z-P0k9hIswIJlI5Z1gSQTineCTtYxSl4cxGwqDuNNvCQqP6Q1dyLAbnivnlIcZ8OsU3PLjOrzC1wyw2Rfa54zAFik Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:01:57.608659 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}] Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: d05599626db140ff8f9966b37f0cbe1a Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: {"add_host": {"host": "tempest-nonexist_host-440023021"}} Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:01:57.610056 n-d-850499-14 devstack@n-api.service[122332]: exception: Compute host tempest-nonexist_host-440023021 could not be found. Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-440023021'}}} Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-440023021' is not mapped to any cell Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:57.610775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 18:01:57.611964 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-440023021 could not be found. Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-440023021 could not be found. Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:57.613604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:57.615641 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:57.615641 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:57.615641 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:57.615641 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:57.615641 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:57.615641 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-440023021 could not be found. Oct 04 18:01:57.615641 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:57.616345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.616345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.616345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.622759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-440023021 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:57.622759 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9506e1ad-1a94-4487-ab0d-cec7e46ede9c tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.053684 Oct 04 18:01:57.622759 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 141/266] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:01:57 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:57.628549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa09da0c-bbd5-4c1a-9994-6b79db4c4f49 tempest-NetworksTest-1977718548 tempest-NetworksTest-1977718548-project-admin] Calling method '.version_select at 0x7fd4d26e0e50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:57.676699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.686004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.687381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.722853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.725187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.729016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.748452 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f0bacc21-8a17-473b-9236-8e6ceef45734 tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.351166 Oct 04 18:01:57.749413 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 126/267] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:57.762568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:57.765804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:57.778140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.778650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.779236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.779986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.784321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.785438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.821056 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa09da0c-bbd5-4c1a-9994-6b79db4c4f49 tempest-NetworksTest-1977718548 tempest-NetworksTest-1977718548-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 3296 microversion: 2.1 time: 0.196115 Oct 04 18:01:57.825761 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 142/268] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:01:57 2022] GET /compute/v2.1/os-networks => generated 3296 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:57.828643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c895b7bc-fd08-4e91-84cc-2e85c783c352 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:57.833850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.840952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.841944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.842745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lazy-loading 'fault' on Instance uuid 62d00075-7e6e-4930-963c-eed6b842bcc3 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:57.857833 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c895b7bc-fd08-4e91-84cc-2e85c783c352 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.034332 Oct 04 18:01:57.859741 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 143/269] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:01:57 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:58.044385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:58.061233 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aeb6589f-3f52-4673-86ea-c5cd98ffe19f tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1453 microversion: 2.1 time: 0.302849 Oct 04 18:01:58.062943 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 127/270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:57 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1453 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:58.074179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e9b79ec-4300-4fce-9103-bd26afe1c9d6 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e9b79ec-4300-4fce-9103-bd26afe1c9d6 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Request method failure captured: Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 283 Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUQ8Rd8nYxrjg7bNCeiB58RHJCEdvt0LF2P1SWZO4jqBhO9euWXOTS56hXpaao_UVy0P284wOMsr3RE7sspw2Z-P0k9hIswIJlI5Z1gSQTineCTtYxSl4cxGwqDuNNvCQqP6Q1dyLAbnivnlIcZ8OsU3PLjOrzC1wyw2Rfa54zAFik Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:58.101137 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:58.102441 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}] Oct 04 18:01:58.102441 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:58.102441 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:01:58.102441 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:58.102441 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:01:58.102441 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:58.102441 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:58.102441 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d05599626db140ff8f9966b37f0cbe1a Oct 04 18:01:58.102441 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:01:58.102441 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:01:58.103063 n-d-850499-14 devstack@n-api.service[122331]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:01:58.103063 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:58.103063 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:01:58.103063 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:01:58.103063 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:58.103063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:58.103063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:01:58.103063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:01:58.103063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:01:58.103063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:58.104188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:58.106136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:58.107021 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:01:58.107021 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:01:58.107021 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:01:58.107021 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.107021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e9b79ec-4300-4fce-9103-bd26afe1c9d6 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:58.108116 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1e9b79ec-4300-4fce-9103-bd26afe1c9d6 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.038831 Oct 04 18:01:58.108116 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 128/271] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 4 18:01:58 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:01:58.118331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f04397a-b464-40e1-b510-565483504929 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:58.123449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2f04397a-b464-40e1-b510-565483504929 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:58.146582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f04397a-b464-40e1-b510-565483504929 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.147409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f04397a-b464-40e1-b510-565483504929 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.147963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f04397a-b464-40e1-b510-565483504929 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.148867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f04397a-b464-40e1-b510-565483504929 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.149469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f04397a-b464-40e1-b510-565483504929 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.150445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f04397a-b464-40e1-b510-565483504929 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.183855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2f04397a-b464-40e1-b510-565483504929 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:01:58.373726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=5,nova_api:INSERT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:58.398541 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2f04397a-b464-40e1-b510-565483504929 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "DELETE /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 204 len: 0 microversion: 2.1 time: 0.289219 Oct 04 18:01:58.402771 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 129/272] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:58 2022] DELETE /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:58.408490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-81f33155-adc4-469d-b9b0-4e0463c6f433 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-81f33155-adc4-469d-b9b0-4e0463c6f433 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Request method failure captured: Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 27 Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUQ8Rd8nYxrjg7bNCeiB58RHJCEdvt0LF2P1SWZO4jqBhO9euWXOTS56hXpaao_UVy0P284wOMsr3RE7sspw2Z-P0k9hIswIJlI5Z1gSQTineCTtYxSl4cxGwqDuNNvCQqP6Q1dyLAbnivnlIcZ8OsU3PLjOrzC1wyw2Rfa54zAFik Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:58.412318 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}] Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d05599626db140ff8f9966b37f0cbe1a Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: {"aggregate": {"name": ""}} Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:58.413565 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi '' Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:58.414310 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:01:58.415593 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.425248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-81f33155-adc4-469d-b9b0-4e0463c6f433 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:58.426864 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-81f33155-adc4-469d-b9b0-4e0463c6f433 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.022546 Oct 04 18:01:58.433734 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 130/273] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:58 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:01:58.440170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:58.442137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:58.473522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.474466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.474917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.475674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.477593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.478703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.578767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9171083d-2daf-48a5-86e9-5e5f56ebda62 tempest-HypervisorAdminNegativeUnderV252Test-1857177233 tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project] Calling method '.version_select at 0x7fd4d2862820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:58.580633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9171083d-2daf-48a5-86e9-5e5f56ebda62 tempest-HypervisorAdminNegativeUnderV252Test-1857177233 tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '692a2fd018d84e9ea321506c11d72e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9064c773ff7949a58281e0b5e6e7cfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9171083d-2daf-48a5-86e9-5e5f56ebda62 tempest-HypervisorAdminNegativeUnderV252Test-1857177233 tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project] Request method failure captured: Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-hypervisors/n-h1-850499-14/search HTTP/1.1 Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUTbcE67BXv3n4EAVRB77X9SPQxSSVUFgmjJT13hPhKSlusfkDASXuL2VHDHKuD_h1IVe8ZAqBK5ejN_hV8UtVZzBZBXThaYwTKUxtVVTPLDnX11azE4nCE83fLvJG55mcPEG_2me3KtWTY2KSBzzqynFBSgCxyQWmadskSuvNffdA Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9064c773ff7949a58281e0b5e6e7cfed Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1857177233 Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:58.582255 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9064c773ff7949a58281e0b5e6e7cfed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9064c773ff7949a58281e0b5e6e7cfed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9064c773ff7949a58281e0b5e6e7cfed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9064c773ff7949a58281e0b5e6e7cfed"}]}] Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1857177233 Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9064c773ff7949a58281e0b5e6e7cfed Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1857177233 Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 692a2fd018d84e9ea321506c11d72e46 Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:01:58.583748 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'n-h1-850499-14'} Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:58.584526 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:01:58.585581 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:58.586754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9171083d-2daf-48a5-86e9-5e5f56ebda62 tempest-HypervisorAdminNegativeUnderV252Test-1857177233 tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:58.586754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9171083d-2daf-48a5-86e9-5e5f56ebda62 tempest-HypervisorAdminNegativeUnderV252Test-1857177233 tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/n-h1-850499-14/search" status: 403 len: 117 microversion: 2.1 time: 0.722924 Oct 04 18:01:58.586754 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 144/274] 10.222.0.18 () {58 vars in 1212 bytes} [Tue Oct 4 18:01:57 2022] GET /compute/v2.1/os-hypervisors/n-h1-850499-14/search => generated 117 bytes in 726 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:58.609966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f678b997-6220-4410-9441-ea1b9f03e3d6 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:58.614913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f678b997-6220-4410-9441-ea1b9f03e3d6 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:58.630610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f678b997-6220-4410-9441-ea1b9f03e3d6 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.631147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f678b997-6220-4410-9441-ea1b9f03e3d6 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.633744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f678b997-6220-4410-9441-ea1b9f03e3d6 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.635955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f678b997-6220-4410-9441-ea1b9f03e3d6 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.638068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f678b997-6220-4410-9441-ea1b9f03e3d6 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.638925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f678b997-6220-4410-9441-ea1b9f03e3d6 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.641544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:58.655383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:58.659926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:58.675290 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dc682226-95a3-4d7f-879a-436152397065 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.240014 Oct 04 18:01:58.678104 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 131/275] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:58 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:58.685470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:58.686073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:58.700611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.701193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.701741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.702740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.703457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.703898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.782828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.786016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.788546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.789273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lazy-loading 'fault' on Instance uuid 62d00075-7e6e-4930-963c-eed6b842bcc3 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:59.226497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f678b997-6220-4410-9441-ea1b9f03e3d6 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:59.240349 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f678b997-6220-4410-9441-ea1b9f03e3d6 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.650017 Oct 04 18:01:59.263612 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 145/276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:58 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:59.272660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1057cfe-9849-407c-8dd4-86f96ffaabb1 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-341176026"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:59.298302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:59.301850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b1057cfe-9849-407c-8dd4-86f96ffaabb1 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0851b5b9a23f440e97b5e2b376acaa22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78206a7056c143a9956ca565738dc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1057cfe-9849-407c-8dd4-86f96ffaabb1 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Request method failure captured: Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 59 Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUOH2n8Hqni_1BgdSGbVKtzg4d7dgXxol5SxqpILD60VTSxUGwRRB2ReBd_6hB6oN5-XRzp4RFWpWSLaFcXlt7bR0AEdQD1lpCNuICIYMDVx1cXI0MKS6It5VgxKS40_zLQBSR7-bJ-QHJq_Dr05k-TsykW6QZY9tlM07HEYJbi4iA Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:01:59.306577 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_78206a7056c143a9956ca565738dc05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/78206a7056c143a9956ca565738dc05f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}] Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0851b5b9a23f440e97b5e2b376acaa22 Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: {"aggregate": {"name": "tempest-test_aggregate-341176026"}} Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:01:59.308142 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-341176026'}}} Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:59.309226 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:59.310375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:01:59.312415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.312535 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-94f2ca9a-824a-40f7-914f-01ed7c64e93c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1459 microversion: 2.1 time: 0.626058 Oct 04 18:01:59.312535 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 132/277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:58 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1459 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:59.312720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1057cfe-9849-407c-8dd4-86f96ffaabb1 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:59.312720 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b1057cfe-9849-407c-8dd4-86f96ffaabb1 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.045753 Oct 04 18:01:59.319400 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 146/278] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:59 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:59.328168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e338da18-7e13-4029-8607-5dad22fd94fd tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Calling method '.version_select at 0x7fd4d2588280>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:59.330666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e338da18-7e13-4029-8607-5dad22fd94fd tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:59.331435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e338da18-7e13-4029-8607-5dad22fd94fd tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:59.332022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e338da18-7e13-4029-8607-5dad22fd94fd tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:59.348619 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-e338da18-7e13-4029-8607-5dad22fd94fd tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e338da18-7e13-4029-8607-5dad22fd94fd tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Request method failure captured: Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUVVd_ik_koY6CWJVAC6CJk1huVFxq8Lj8CMhUeKANvmoxIJB-SYbdmKwsnha8sMQY72o-Gb0of1cYppooyo6sFmNFwX5fkgGqw46k2hb79sdeUrRBLdQNqLSEqFumxS8ulrXWYp4JybWt0kLy8HQzpZl56XaZe4Yk-9ljv3Ua1kYY Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 65f99acfe0c145d09869449892ee3d0a Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-602798393 Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:59.350585 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_65f99acfe0c145d09869449892ee3d0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/65f99acfe0c145d09869449892ee3d0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65f99acfe0c145d09869449892ee3d0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65f99acfe0c145d09869449892ee3d0a"}]}] Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-602798393 Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 65f99acfe0c145d09869449892ee3d0a Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-602798393 Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 9bd87100c64e4a9e89fccb6e372be0d0 Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:01:59.351910 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.352563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:59.353645 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:59.353645 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:59.353645 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:59.353645 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:01:59.353645 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.353645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e338da18-7e13-4029-8607-5dad22fd94fd tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:59.353645 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e338da18-7e13-4029-8607-5dad22fd94fd tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.043010 Oct 04 18:01:59.358668 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 133/279] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:01:59 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:59.364198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc142e6d-6bb4-4384-a824-66527d3b121b tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-546765601"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:59.369811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-bc142e6d-6bb4-4384-a824-66527d3b121b tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Generated uuid fc089b2b-4bfa-4b8d-838a-c5921f7d4f9d for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:59.442514 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc142e6d-6bb4-4384-a824-66527d3b121b tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082423 Oct 04 18:01:59.445763 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 134/280] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:59.462348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Calling method '.version_select at 0x7fd4d2535430>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:59.466136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:59.469565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:59.472277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:59.498028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:59.498526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:59.499040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:59.512078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:59.512568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:59.513006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:59.521940 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9c9e8eb3-01e6-42cf-9b56-a930301c6edf tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.072483 Oct 04 18:01:59.523164 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 135/281] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:01:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:59.529102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5aa770ea-da07-47c9-a1de-b82d2ca0b35e tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-546765601"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:59.534625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-5aa770ea-da07-47c9-a1de-b82d2ca0b35e tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Generated uuid 2548eaa6-6676-4b72-bf78-bfb449270702 for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:01:59.550635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1313351336", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "a2884286-aa9a-463d-8f10-555c5aa8fb7e"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:59.567096 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-5aa770ea-da07-47c9-a1de-b82d2ca0b35e tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-546765601 already exists. Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5aa770ea-da07-47c9-a1de-b82d2ca0b35e tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Request method failure captured: Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 59 Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUQ8Rd8nYxrjg7bNCeiB58RHJCEdvt0LF2P1SWZO4jqBhO9euWXOTS56hXpaao_UVy0P284wOMsr3RE7sspw2Z-P0k9hIswIJlI5Z1gSQTineCTtYxSl4cxGwqDuNNvCQqP6Q1dyLAbnivnlIcZ8OsU3PLjOrzC1wyw2Rfa54zAFik Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:59.570449 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}] Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d05599626db140ff8f9966b37f0cbe1a Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: {"aggregate": {"name": "tempest-test_aggregate-546765601"}} Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:01:59.573005 n-d-850499-14 devstack@n-api.service[122331]: exception: Aggregate tempest-test_aggregate-546765601 already exists. Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-546765601'}}} Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 18:01:59.574724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-546765601 already exists. Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:01:59.577950 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-546765601 already exists. Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-546765601 already exists. Oct 04 18:01:59.583969 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.587340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5aa770ea-da07-47c9-a1de-b82d2ca0b35e tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-546765601 already exists. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:59.589145 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5aa770ea-da07-47c9-a1de-b82d2ca0b35e tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.064410 Oct 04 18:01:59.590392 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 136/282] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:01:59 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:01:59.623953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-583bc594-a9c4-4c40-a53a-c638a2490d82 tempest-HypervisorAdminNegativeUnderV252Test-1857177233 tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project] Calling method '.version_select at 0x7fd4d253e0d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:59.634655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-583bc594-a9c4-4c40-a53a-c638a2490d82 tempest-HypervisorAdminNegativeUnderV252Test-1857177233 tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '692a2fd018d84e9ea321506c11d72e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9064c773ff7949a58281e0b5e6e7cfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-583bc594-a9c4-4c40-a53a-c638a2490d82 tempest-HypervisorAdminNegativeUnderV252Test-1857177233 tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project] Request method failure captured: Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUTbcE67BXv3n4EAVRB77X9SPQxSSVUFgmjJT13hPhKSlusfkDASXuL2VHDHKuD_h1IVe8ZAqBK5ejN_hV8UtVZzBZBXThaYwTKUxtVVTPLDnX11azE4nCE83fLvJG55mcPEG_2me3KtWTY2KSBzzqynFBSgCxyQWmadskSuvNffdA Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9064c773ff7949a58281e0b5e6e7cfed Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1857177233 Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:01:59.649121 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9064c773ff7949a58281e0b5e6e7cfed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9064c773ff7949a58281e0b5e6e7cfed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9064c773ff7949a58281e0b5e6e7cfed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9064c773ff7949a58281e0b5e6e7cfed"}]}] Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1857177233 Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9064c773ff7949a58281e0b5e6e7cfed Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1857177233 Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 692a2fd018d84e9ea321506c11d72e46 Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:01:59.651391 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '1'} Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:01:59.652679 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:01:59.654659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.656918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-583bc594-a9c4-4c40-a53a-c638a2490d82 tempest-HypervisorAdminNegativeUnderV252Test-1857177233 tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:59.665687 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-583bc594-a9c4-4c40-a53a-c638a2490d82 tempest-HypervisorAdminNegativeUnderV252Test-1857177233 tempest-HypervisorAdminNegativeUnderV252Test-1857177233-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.071124 Oct 04 18:01:59.666287 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 137/283] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 4 18:01:59 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:59.703813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be74c414-4b1a-4091-a021-2a93577e02b9 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:59.714597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] validate_networks() for [('a2884286-aa9a-463d-8f10-555c5aa8fb7e', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:01:59.794065 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be74c414-4b1a-4091-a021-2a93577e02b9 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.115917 Oct 04 18:01:59.807046 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 138/284] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:01:59 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:01:59.819239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-daceff61-53d3-4ed1-949e-0539cd08e6bb tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Calling method '.version_select at 0x7fd4d2588ee0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:59.831722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daceff61-53d3-4ed1-949e-0539cd08e6bb tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:59.832625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daceff61-53d3-4ed1-949e-0539cd08e6bb tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:59.833342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daceff61-53d3-4ed1-949e-0539cd08e6bb tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:59.868001 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-daceff61-53d3-4ed1-949e-0539cd08e6bb tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] HTTP exception thrown: No hypervisor matching '205cba3b-1899-4b56-8eec-b23368a1189f' could be found. Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-daceff61-53d3-4ed1-949e-0539cd08e6bb tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Request method failure captured: Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-hypervisors/205cba3b-1899-4b56-8eec-b23368a1189f/servers HTTP/1.1 Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUVVd_ik_koY6CWJVAC6CJk1huVFxq8Lj8CMhUeKANvmoxIJB-SYbdmKwsnha8sMQY72o-Gb0of1cYppooyo6sFmNFwX5fkgGqw46k2hb79sdeUrRBLdQNqLSEqFumxS8ulrXWYp4JybWt0kLy8HQzpZl56XaZe4Yk-9ljv3Ua1kYY Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 65f99acfe0c145d09869449892ee3d0a Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-602798393 Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:01:59.872402 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_65f99acfe0c145d09869449892ee3d0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/65f99acfe0c145d09869449892ee3d0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65f99acfe0c145d09869449892ee3d0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65f99acfe0c145d09869449892ee3d0a"}]}] Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-602798393 Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 65f99acfe0c145d09869449892ee3d0a Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-602798393 Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 9bd87100c64e4a9e89fccb6e372be0d0 Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: exception: No hypervisor matching '205cba3b-1899-4b56-8eec-b23368a1189f' could be found. Oct 04 18:01:59.873578 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '205cba3b-1899-4b56-8eec-b23368a1189f'} Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '205cba3b-1899-4b56-8eec-b23368a1189f' could be found. Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.874227 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:59.875304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:59.875304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:59.875304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:59.875304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:59.875304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '205cba3b-1899-4b56-8eec-b23368a1189f' could be found. Oct 04 18:01:59.875304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:01:59.875304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-daceff61-53d3-4ed1-949e-0539cd08e6bb tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] Returning 404 to user: No hypervisor matching '205cba3b-1899-4b56-8eec-b23368a1189f' could be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:59.879429 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-daceff61-53d3-4ed1-949e-0539cd08e6bb tempest-HypervisorAdminNegativeUnderV252Test-602798393 tempest-HypervisorAdminNegativeUnderV252Test-602798393-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/205cba3b-1899-4b56-8eec-b23368a1189f/servers" status: 404 len: 123 microversion: 2.1 time: 0.065875 Oct 04 18:01:59.880455 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 139/285] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 4 18:01:59 2022] GET /compute/v2.1/os-hypervisors/205cba3b-1899-4b56-8eec-b23368a1189f/servers => generated 123 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:59.901013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:59.902078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:59.924341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:59.926339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:59.936150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:59.937568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:59.938705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:59.939465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:00.151296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:00.160572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:00.169020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:00.190673 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8e9658e2-65ce-4a01-a4ae-689f7e0261e7 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.308775 Oct 04 18:02:00.195522 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 140/286] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:59 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:00.205839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4f56e10f-873a-478b-97bd-a7be251dab97 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1035097918"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:00.209184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-4f56e10f-873a-478b-97bd-a7be251dab97 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Generated uuid 8b07fa2b-4486-49a1-b73e-c584480250a9 for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:02:00.258346 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4f56e10f-873a-478b-97bd-a7be251dab97 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061732 Oct 04 18:02:00.259021 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 141/287] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:02:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:00.272847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-07221b4f-9853-4bd7-a5ac-fa58adaa3d91 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:00.282149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-07221b4f-9853-4bd7-a5ac-fa58adaa3d91 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:00.300773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07221b4f-9853-4bd7-a5ac-fa58adaa3d91 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:00.302028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07221b4f-9853-4bd7-a5ac-fa58adaa3d91 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:00.303554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07221b4f-9853-4bd7-a5ac-fa58adaa3d91 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:00.307522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07221b4f-9853-4bd7-a5ac-fa58adaa3d91 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:00.308248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07221b4f-9853-4bd7-a5ac-fa58adaa3d91 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:00.308894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07221b4f-9853-4bd7-a5ac-fa58adaa3d91 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:00.716731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-07221b4f-9853-4bd7-a5ac-fa58adaa3d91 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:00.724955 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-07221b4f-9853-4bd7-a5ac-fa58adaa3d91 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.458333 Oct 04 18:02:00.727590 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 142/288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:00 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:02:00.748199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a01184fc-91db-4d1a-bace-5aece591309b tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:00.749900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a01184fc-91db-4d1a-bace-5aece591309b tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0851b5b9a23f440e97b5e2b376acaa22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78206a7056c143a9956ca565738dc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a01184fc-91db-4d1a-bace-5aece591309b tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Request method failure captured: Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUOH2n8Hqni_1BgdSGbVKtzg4d7dgXxol5SxqpILD60VTSxUGwRRB2ReBd_6hB6oN5-XRzp4RFWpWSLaFcXlt7bR0AEdQD1lpCNuICIYMDVx1cXI0MKS6It5VgxKS40_zLQBSR7-bJ-QHJq_Dr05k-TsykW6QZY9tlM07HEYJbi4iA Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:00.753541 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_78206a7056c143a9956ca565738dc05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/78206a7056c143a9956ca565738dc05f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}] Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0851b5b9a23f440e97b5e2b376acaa22 Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:02:00.755398 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '15'} Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:02:00.756078 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:00.757149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a01184fc-91db-4d1a-bace-5aece591309b tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:00.761909 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a01184fc-91db-4d1a-bace-5aece591309b tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.025205 Oct 04 18:02:00.765425 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 143/289] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:02:00 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:00.772103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:00.772649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:00.800999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:00.801503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:00.801935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:00.802653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:00.811006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:00.811547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:00.858372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:00.882709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:00.883594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:00.884392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:00.885043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lazy-loading 'fault' on Instance uuid 62d00075-7e6e-4930-963c-eed6b842bcc3 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:01.010829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.021108 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d6b06a2-f022-4048-83f9-2dd9b0d7e3a5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1417 microversion: 2.1 time: 0.257713 Oct 04 18:02:01.023435 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 144/290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:00 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1417 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:01.031327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-86c88421-6829-4983-9d82-8e6ed83dd091 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.104851 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-86c88421-6829-4983-9d82-8e6ed83dd091 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.076690 Oct 04 18:02:01.109234 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 145/291] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:02:01 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:02:01.114629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5e8ffeb-3e87-4f7a-a2fe-cc1cee63d011 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.142748 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-a5e8ffeb-3e87-4f7a-a2fe-cc1cee63d011 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5e8ffeb-3e87-4f7a-a2fe-cc1cee63d011 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Request method failure captured: Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUQ8Rd8nYxrjg7bNCeiB58RHJCEdvt0LF2P1SWZO4jqBhO9euWXOTS56hXpaao_UVy0P284wOMsr3RE7sspw2Z-P0k9hIswIJlI5Z1gSQTineCTtYxSl4cxGwqDuNNvCQqP6Q1dyLAbnivnlIcZ8OsU3PLjOrzC1wyw2Rfa54zAFik Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:02:01.145114 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}] Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d05599626db140ff8f9966b37f0cbe1a Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: exception: Aggregate -1 could not be found. Oct 04 18:02:01.146328 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '-1'} Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:02:01.147381 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.148421 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:01.149556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:01.149556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:01.149556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:01.149556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:01.149556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 18:02:01.149556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.149556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5e8ffeb-3e87-4f7a-a2fe-cc1cee63d011 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:01.149556 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a5e8ffeb-3e87-4f7a-a2fe-cc1cee63d011 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036108 Oct 04 18:02:01.149556 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 146/292] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:02:01 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:02:01.155694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f1b1fe1f-46c1-4eb9-8089-46fd89392133 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1186495364"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:01.170618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-f1b1fe1f-46c1-4eb9-8089-46fd89392133 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Generated uuid 809bb1d7-f8db-4655-9f0f-91f4f170d22c for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:02:01.205461 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f1b1fe1f-46c1-4eb9-8089-46fd89392133 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053280 Oct 04 18:02:01.206062 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 147/293] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:02:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:01.213098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:01.213098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:01.213098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:01.213098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:01.213098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:01.222065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dae344ef-8a84-41c6-b911-c184c07f3c13 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.228127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dae344ef-8a84-41c6-b911-c184c07f3c13 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0851b5b9a23f440e97b5e2b376acaa22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78206a7056c143a9956ca565738dc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.234660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.235187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.235634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.236380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.236832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.237259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dae344ef-8a84-41c6-b911-c184c07f3c13 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Request method failure captured: Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUOH2n8Hqni_1BgdSGbVKtzg4d7dgXxol5SxqpILD60VTSxUGwRRB2ReBd_6hB6oN5-XRzp4RFWpWSLaFcXlt7bR0AEdQD1lpCNuICIYMDVx1cXI0MKS6It5VgxKS40_zLQBSR7-bJ-QHJq_Dr05k-TsykW6QZY9tlM07HEYJbi4iA Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:01.247851 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_78206a7056c143a9956ca565738dc05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/78206a7056c143a9956ca565738dc05f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}] Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0851b5b9a23f440e97b5e2b376acaa22 Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:02:01.249280 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '16'} Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:02:01.249951 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:02:01.251406 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.259096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dae344ef-8a84-41c6-b911-c184c07f3c13 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:01.260172 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dae344ef-8a84-41c6-b911-c184c07f3c13 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.043760 Oct 04 18:02:01.261969 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 148/294] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:02:01 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:01.275619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.279754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:01.294612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.297790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.298470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.299458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.300226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.302309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.346797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Getting quotas for project bc4df90b761348c082e7787ff4925299. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:01.353217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Getting quotas for user 327e7f9ab3d74ff4a4d1bb86d15ad8fc and project bc4df90b761348c082e7787ff4925299. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:01.400877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:01.403955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:01.426450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.438476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.441755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.452481 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d4a05b54-dd5b-47ea-a87c-2760e96d6550 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.189106 Oct 04 18:02:01.454166 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 149/295] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:01 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:01.458902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ae204ef4-d97a-4ce2-a6a4-5d6f1126f4bb tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.521489 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2d51bbb5-ff06-4902-99ec-44eae0282db2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.194893 Oct 04 18:02:01.524603 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ae204ef4-d97a-4ce2-a6a4-5d6f1126f4bb tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.069079 Oct 04 18:02:01.527112 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 147/296] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:02:01.531278 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 150/297] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:02:01 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:02:01.534626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7b3a75ee-240f-4b80-9cd4-35c2479765b9 req-cfbf480d-3290-469e-bcc3-39dad9c84287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d00075-7e6e-4930-963c-eed6b842bcc3", "name": "network-vif-deleted", "tag": "5e474ddd-81ed-4e23-8a91-97f48a6cd567"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:01.540317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f1290a6-7230-4d55-9939-070a4febe776 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.556401 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-6f1290a6-7230-4d55-9939-070a4febe776 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f1290a6-7230-4d55-9939-070a4febe776 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Request method failure captured: Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUQ8Rd8nYxrjg7bNCeiB58RHJCEdvt0LF2P1SWZO4jqBhO9euWXOTS56hXpaao_UVy0P284wOMsr3RE7sspw2Z-P0k9hIswIJlI5Z1gSQTineCTtYxSl4cxGwqDuNNvCQqP6Q1dyLAbnivnlIcZ8OsU3PLjOrzC1wyw2Rfa54zAFik Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:02:01.558314 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}] Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d05599626db140ff8f9966b37f0cbe1a Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: exception: Aggregate -1 could not be found. Oct 04 18:02:01.559542 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '-1'} Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:01.560199 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 18:02:01.561264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.563234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7b3a75ee-240f-4b80-9cd4-35c2479765b9 req-cfbf480d-3290-469e-bcc3-39dad9c84287 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.564110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7b3a75ee-240f-4b80-9cd4-35c2479765b9 req-cfbf480d-3290-469e-bcc3-39dad9c84287 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.564735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7b3a75ee-240f-4b80-9cd4-35c2479765b9 req-cfbf480d-3290-469e-bcc3-39dad9c84287 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.565709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f1290a6-7230-4d55-9939-070a4febe776 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:01.567336 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f1290a6-7230-4d55-9939-070a4febe776 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034592 Oct 04 18:02:01.568415 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 151/298] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:02:01 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:02:01.575363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2219d39-2773-495c-9eb7-05385becf59c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.576307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a2219d39-2773-495c-9eb7-05385becf59c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:01.603438 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7b3a75ee-240f-4b80-9cd4-35c2479765b9 req-cfbf480d-3290-469e-bcc3-39dad9c84287 service nova] Creating event network-vif-deleted:5e474ddd-81ed-4e23-8a91-97f48a6cd567 for instance 62d00075-7e6e-4930-963c-eed6b842bcc3 on n-h1-850499-14 Oct 04 18:02:01.621485 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7b3a75ee-240f-4b80-9cd4-35c2479765b9 req-cfbf480d-3290-469e-bcc3-39dad9c84287 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095071 Oct 04 18:02:01.625393 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 148/299] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:01.639400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cafb0e31-1b3b-49da-9b81-720b75c37cd4 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.640980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cafb0e31-1b3b-49da-9b81-720b75c37cd4 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0851b5b9a23f440e97b5e2b376acaa22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78206a7056c143a9956ca565738dc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cafb0e31-1b3b-49da-9b81-720b75c37cd4 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Request method failure captured: Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUOH2n8Hqni_1BgdSGbVKtzg4d7dgXxol5SxqpILD60VTSxUGwRRB2ReBd_6hB6oN5-XRzp4RFWpWSLaFcXlt7bR0AEdQD1lpCNuICIYMDVx1cXI0MKS6It5VgxKS40_zLQBSR7-bJ-QHJq_Dr05k-TsykW6QZY9tlM07HEYJbi4iA Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:02:01.642655 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_78206a7056c143a9956ca565738dc05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/78206a7056c143a9956ca565738dc05f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}] Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0851b5b9a23f440e97b5e2b376acaa22 Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:02:01.644039 n-d-850499-14 devstack@n-api.service[122332]: action_args: {} Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:02:01.644864 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:02:01.645909 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:01.661011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cafb0e31-1b3b-49da-9b81-720b75c37cd4 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:01.665212 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cafb0e31-1b3b-49da-9b81-720b75c37cd4 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.038461 Oct 04 18:02:01.666739 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 149/300] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:02:01 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:01.686054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b261ecd0-3ae1-41f2-8d8a-b4f21b4c0f29 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-388822864"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:01.689738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.aggregate [None req-b261ecd0-3ae1-41f2-8d8a-b4f21b4c0f29 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Generated uuid 706e876f-a93a-4156-b29d-60309485b06b for aggregate {{(pid=122332) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:02:01.700596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a2219d39-2773-495c-9eb7-05385becf59c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.708787 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a2219d39-2773-495c-9eb7-05385becf59c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1211 microversion: 2.1 time: 0.139112 Oct 04 18:02:01.710818 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 152/301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:01 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1211 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:01.745778 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b261ecd0-3ae1-41f2-8d8a-b4f21b4c0f29 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072725 Oct 04 18:02:01.746660 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 150/302] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:02:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:01.759492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e6501319-addf-4b09-873a-3fbd78186294 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:01.801727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67494617-cc8d-487c-9540-9e331e1e9abf tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.802593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67494617-cc8d-487c-9540-9e331e1e9abf tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:01.805996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6501319-addf-4b09-873a-3fbd78186294 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.806285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6501319-addf-4b09-873a-3fbd78186294 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.806729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6501319-addf-4b09-873a-3fbd78186294 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.830736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67494617-cc8d-487c-9540-9e331e1e9abf tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.831276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67494617-cc8d-487c-9540-9e331e1e9abf tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.831723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67494617-cc8d-487c-9540-9e331e1e9abf tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.832970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67494617-cc8d-487c-9540-9e331e1e9abf tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.845034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67494617-cc8d-487c-9540-9e331e1e9abf tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.851434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67494617-cc8d-487c-9540-9e331e1e9abf tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:02.172013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-67494617-cc8d-487c-9540-9e331e1e9abf tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.184718 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67494617-cc8d-487c-9540-9e331e1e9abf tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.413307 Oct 04 18:02:02.188256 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 151/303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:01 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:02.198295 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e6501319-addf-4b09-873a-3fbd78186294 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.442535 Oct 04 18:02:02.199074 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 153/304] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:02:01 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:02.202269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:02.205797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:02.211696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d21be02-ac7b-4e51-9fff-3d6585474a81 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:02.215306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0d21be02-ac7b-4e51-9fff-3d6585474a81 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0851b5b9a23f440e97b5e2b376acaa22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78206a7056c143a9956ca565738dc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d21be02-ac7b-4e51-9fff-3d6585474a81 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Request method failure captured: Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 43 Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUOH2n8Hqni_1BgdSGbVKtzg4d7dgXxol5SxqpILD60VTSxUGwRRB2ReBd_6hB6oN5-XRzp4RFWpWSLaFcXlt7bR0AEdQD1lpCNuICIYMDVx1cXI0MKS6It5VgxKS40_zLQBSR7-bJ-QHJq_Dr05k-TsykW6QZY9tlM07HEYJbi4iA Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:02.220003 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_78206a7056c143a9956ca565738dc05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/78206a7056c143a9956ca565738dc05f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78206a7056c143a9956ca565738dc05f"}]}] Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 78206a7056c143a9956ca565738dc05f Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-126193206 Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0851b5b9a23f440e97b5e2b376acaa22 Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-126193206-project Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: {"remove_host": {"host": "n-h1-850499-14"}} Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:02.221374 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-850499-14'}}} Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:02:02.222129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:02:02.225698 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:02.228786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d21be02-ac7b-4e51-9fff-3d6585474a81 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:02.228786 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0d21be02-ac7b-4e51-9fff-3d6585474a81 tempest-AggregatesAdminNegativeTestJSON-126193206 tempest-AggregatesAdminNegativeTestJSON-126193206-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.014472 Oct 04 18:02:02.228786 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 154/305] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:02:02 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:02:02.229195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:02.229777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:02.229945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:02.238632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:02.241033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-11cdb3d6-96a2-4b9d-897a-eb842bae7fba tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:02.241267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:02.242074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:02.273101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11cdb3d6-96a2-4b9d-897a-eb842bae7fba tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:02.273889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11cdb3d6-96a2-4b9d-897a-eb842bae7fba tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:02.274574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11cdb3d6-96a2-4b9d-897a-eb842bae7fba tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:02.337050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:02.337694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:02.339744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:02.340330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lazy-loading 'fault' on Instance uuid 62d00075-7e6e-4930-963c-eed6b842bcc3 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:02.412088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625dcc139fa4de8a866970b4c0a1cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503b4405932b44a1849afd220dab32e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.426711 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d1e8627a-acd9-418e-a5e1-39cd3043257c tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 200 len: 1310 microversion: 2.1 time: 0.233361 Oct 04 18:02:02.428094 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 152/306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:02 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 1310 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:02.482329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:02.483641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:02.493182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:02.503278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:02.505259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:02.506433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:02.508021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:02.509915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:02.582515 n-d-850499-14 devstack@n-api.service[122331]: WARNING nova.scheduler.client.report [None req-11cdb3d6-96a2-4b9d-897a-eb842bae7fba tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] [req-80be9325-4b28-42d6-bb6d-86c73f5c8d2c] Failed to update aggregates to [] for resource provider with UUID f454fd4a-875d-4b28-8ad6-1e0e84f4e42d. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-80be9325-4b28-42d6-bb6d-86c73f5c8d2c"}]} Oct 04 18:02:02.612409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.624521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.626524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.633510 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4dc65fcc-d56b-4d73-a220-d9e9ae7883d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.155323 Oct 04 18:02:02.648484 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 153/307] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:02 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:02.746381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b035fe04-2fb2-4d4c-a558-609c0c074655 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:02.747353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b035fe04-2fb2-4d4c-a558-609c0c074655 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:02.779896 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-11cdb3d6-96a2-4b9d-897a-eb842bae7fba tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.546809 Oct 04 18:02:02.783213 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 155/308] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:02:02 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:02.794707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-869b3e5d-4905-4f52-a5bc-53e3f95e747d tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:02.860362 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-869b3e5d-4905-4f52-a5bc-53e3f95e747d tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.052742 Oct 04 18:02:02.864123 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 156/309] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:02:02 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:02:02.875891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c1ecc49a-2306-4d48-bfbe-9aaad3801333 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-776171482"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:02.895242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.aggregate [None req-c1ecc49a-2306-4d48-bfbe-9aaad3801333 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Generated uuid e3565f9f-7b06-488f-89f2-7d5a162d6006 for aggregate {{(pid=122331) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:02:02.915977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b035fe04-2fb2-4d4c-a558-609c0c074655 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.923817 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b035fe04-2fb2-4d4c-a558-609c0c074655 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1211 microversion: 2.1 time: 0.188568 Oct 04 18:02:02.928918 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 154/310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:02 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1211 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:02.999529 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c1ecc49a-2306-4d48-bfbe-9aaad3801333 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.127271 Oct 04 18:02:03.003780 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 157/311] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:02:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:02:03.016431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:03.042763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.043491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.044039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.047762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=19 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:03.056302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.057167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.057783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.076717 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.compute.aggregates [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 18:02:03.077010 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Request method failure captured: Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 42 Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUQ8Rd8nYxrjg7bNCeiB58RHJCEdvt0LF2P1SWZO4jqBhO9euWXOTS56hXpaao_UVy0P284wOMsr3RE7sspw2Z-P0k9hIswIJlI5Z1gSQTineCTtYxSl4cxGwqDuNNvCQqP6Q1dyLAbnivnlIcZ8OsU3PLjOrzC1wyw2Rfa54zAFik Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:02:03.089229 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb28eb7b69f540288b36881b89636ec2"}]}] Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: cb28eb7b69f540288b36881b89636ec2 Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-760946772 Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: d05599626db140ff8f9966b37f0cbe1a Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: {"remove_host": {"host": "nonexist_host"}} Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:03.090688 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 18:02:03.091693 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 18:02:03.093665 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.095598 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.097172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.097172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.097172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:03.097172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:03.097172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:02:03.097172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.111011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:03.118946 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-51222a79-5a8a-4208-a7c7-b3040979d557 tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.104933 Oct 04 18:02:03.120661 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 155/312] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:02:03 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:02:03.132546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f981b293-b151-4c8f-a175-c2ecb8ec726d tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.167612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:03.207041 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f981b293-b151-4c8f-a175-c2ecb8ec726d tempest-AggregatesAdminNegativeTestJSON-760946772 tempest-AggregatesAdminNegativeTestJSON-760946772-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.079733 Oct 04 18:02:03.210880 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 158/313] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:02:03 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:02:03.213386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bde9c2c1-4764-4a5b-ae30-403a14331b3b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.214251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bde9c2c1-4764-4a5b-ae30-403a14331b3b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:03.232362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bde9c2c1-4764-4a5b-ae30-403a14331b3b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.233296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bde9c2c1-4764-4a5b-ae30-403a14331b3b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.233440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bde9c2c1-4764-4a5b-ae30-403a14331b3b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.238944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bde9c2c1-4764-4a5b-ae30-403a14331b3b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.246550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bde9c2c1-4764-4a5b-ae30-403a14331b3b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.246991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bde9c2c1-4764-4a5b-ae30-403a14331b3b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.460057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.461216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:03.473828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.476402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.477552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.479823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.480997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.481461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.499786 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] HTTP exception thrown: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Request method failure captured: Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 HTTP/1.1 Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHTVhS5a6I-Dtev_ylFYTuTQx6JF5ANMofBIr_V75ORVy_LasPiELccUedL1eEkyyx5cWEhbw3aH9tZPC_L6Qd9nBtI69igLTN9701n6nGOgZsAt5FyZwptaBm-0oRl1HiQyG5g9Z8CNJ9R5QwnRCMNbFtARswbygnzS2kxENJJaVi4 Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:03.501602 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_503b4405932b44a1849afd220dab32e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/503b4405932b44a1849afd220dab32e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}] Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: c625dcc139fa4de8a866970b4c0a1cd0 Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.502859 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '62d00075-7e6e-4930-963c-eed6b842bcc3'} Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:03.503559 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.505282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.506323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Returning 404 to user: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:03.506323 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d8c45f0d-78a5-4225-ac12-ebaf79909355 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 404 len: 111 microversion: 2.1 time: 0.048937 Oct 04 18:02:03.516020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bde9c2c1-4764-4a5b-ae30-403a14331b3b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:03.516335 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 159/314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:03 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:03.522599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.523462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:03.530902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.531682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.532329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.533170 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bde9c2c1-4764-4a5b-ae30-403a14331b3b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.326760 Oct 04 18:02:03.533415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.533754 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 156/315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:03 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:03.534245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.534880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.553731 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] HTTP exception thrown: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Request method failure captured: Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 HTTP/1.1 Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHTVhS5a6I-Dtev_ylFYTuTQx6JF5ANMofBIr_V75ORVy_LasPiELccUedL1eEkyyx5cWEhbw3aH9tZPC_L6Qd9nBtI69igLTN9701n6nGOgZsAt5FyZwptaBm-0oRl1HiQyG5g9Z8CNJ9R5QwnRCMNbFtARswbygnzS2kxENJJaVi4 Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:03.555671 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_503b4405932b44a1849afd220dab32e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/503b4405932b44a1849afd220dab32e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}] Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: c625dcc139fa4de8a866970b4c0a1cd0 Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.557325 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '62d00075-7e6e-4930-963c-eed6b842bcc3'} Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:03.558101 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.559326 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.561598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Returning 404 to user: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:03.562479 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f5b31734-1e72-4385-87ac-51c76563c49d tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "DELETE /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 404 len: 111 microversion: 2.1 time: 0.044985 Oct 04 18:02:03.563048 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 160/316] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:02:03 2022] DELETE /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:03.572009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.572896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 62d00075-7e6e-4930-963c-eed6b842bcc3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:03.579265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.580316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.581339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.582904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.583635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.584286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.631084 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] HTTP exception thrown: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Request method failure captured: Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 HTTP/1.1 Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTVhS5a6I-Dtev_ylFYTuTQx6JF5ANMofBIr_V75ORVy_LasPiELccUedL1eEkyyx5cWEhbw3aH9tZPC_L6Qd9nBtI69igLTN9701n6nGOgZsAt5FyZwptaBm-0oRl1HiQyG5g9Z8CNJ9R5QwnRCMNbFtARswbygnzS2kxENJJaVi4 Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:02:03.633841 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_503b4405932b44a1849afd220dab32e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/503b4405932b44a1849afd220dab32e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}] Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: c625dcc139fa4de8a866970b4c0a1cd0 Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.635070 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '62d00075-7e6e-4930-963c-eed6b842bcc3'} Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:03.635744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. Oct 04 18:02:03.636827 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.639740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Returning 404 to user: Instance 62d00075-7e6e-4930-963c-eed6b842bcc3 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:03.641405 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c41f94fd-e2c2-4241-9e04-f3e0d6f731f5 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3" status: 404 len: 111 microversion: 2.1 time: 0.073815 Oct 04 18:02:03.665174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.665934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:03.669478 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 157/317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:03 2022] GET /compute/v2.1/servers/62d00075-7e6e-4930-963c-eed6b842bcc3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:03.681253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.682790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:03.684348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.684840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.685290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.686011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.686472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.686899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.699943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.701360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.701811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.708458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.708964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.710568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.772659 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] HTTP exception thrown: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Request method failure captured: Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af HTTP/1.1 Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTVhS5a6I-Dtev_ylFYTuTQx6JF5ANMofBIr_V75ORVy_LasPiELccUedL1eEkyyx5cWEhbw3aH9tZPC_L6Qd9nBtI69igLTN9701n6nGOgZsAt5FyZwptaBm-0oRl1HiQyG5g9Z8CNJ9R5QwnRCMNbFtARswbygnzS2kxENJJaVi4 Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:02:03.775341 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_503b4405932b44a1849afd220dab32e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/503b4405932b44a1849afd220dab32e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}] Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: c625dcc139fa4de8a866970b4c0a1cd0 Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:02:03.776653 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '43863d88-b381-47c7-bcca-437f6f58d2af'} Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:03.777307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:02:03.780569 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.787389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Returning 404 to user: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:03.790482 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c3564698-501a-42c5-a226-78aad9bf3365 tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "DELETE /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 404 len: 111 microversion: 2.1 time: 0.119752 Oct 04 18:02:03.794043 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 158/318] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:02:03 2022] DELETE /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:03.807669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-2d240c8b-9d41-4440-a0cc-a0a455547aee req-3da2f976-ded0-4416-8c17-7282f620630b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d9639a-f27a-499b-9ce8-d84427abf106", "tag": "6bfeaeb7-8851-4adf-823e-b3978471323b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:03.820570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2d240c8b-9d41-4440-a0cc-a0a455547aee req-3da2f976-ded0-4416-8c17-7282f620630b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.821271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2d240c8b-9d41-4440-a0cc-a0a455547aee req-3da2f976-ded0-4416-8c17-7282f620630b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.822069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2d240c8b-9d41-4440-a0cc-a0a455547aee req-3da2f976-ded0-4416-8c17-7282f620630b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.851821 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-2d240c8b-9d41-4440-a0cc-a0a455547aee req-3da2f976-ded0-4416-8c17-7282f620630b service nova] Creating event network-changed:6bfeaeb7-8851-4adf-823e-b3978471323b for instance 05d9639a-f27a-499b-9ce8-d84427abf106 on n-h1-850499-14 Oct 04 18:02:03.860280 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-2d240c8b-9d41-4440-a0cc-a0a455547aee req-3da2f976-ded0-4416-8c17-7282f620630b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064446 Oct 04 18:02:03.862074 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 159/319] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:03.877333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.878258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] [instance: 43863d88-b381-47c7-bcca-437f6f58d2af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:03.882503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:03.886871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.887781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.888424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.890089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.891175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.892111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.893480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:03.895351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:03.911914 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c190a5ec-8173-425b-87a5-a96f2f673b45 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.251795 Oct 04 18:02:03.912577 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 161/320] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:03 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:03.922491 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] HTTP exception thrown: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Request method failure captured: Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af HTTP/1.1 Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTVhS5a6I-Dtev_ylFYTuTQx6JF5ANMofBIr_V75ORVy_LasPiELccUedL1eEkyyx5cWEhbw3aH9tZPC_L6Qd9nBtI69igLTN9701n6nGOgZsAt5FyZwptaBm-0oRl1HiQyG5g9Z8CNJ9R5QwnRCMNbFtARswbygnzS2kxENJJaVi4 Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:02:03.924383 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_503b4405932b44a1849afd220dab32e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/503b4405932b44a1849afd220dab32e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/503b4405932b44a1849afd220dab32e0"}]}] Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 503b4405932b44a1849afd220dab32e0 Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-613421343 Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: c625dcc139fa4de8a866970b4c0a1cd0 Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersAdminTestJSON-613421343-project Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:02:03.925933 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '43863d88-b381-47c7-bcca-437f6f58d2af'} Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:03.926726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. Oct 04 18:02:03.928172 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.929760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] Returning 404 to user: Instance 43863d88-b381-47c7-bcca-437f6f58d2af could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:03.929760 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c9bf33a-02a3-47a0-b55d-7bbd9aed2dca tempest-DeleteServersAdminTestJSON-613421343 tempest-DeleteServersAdminTestJSON-613421343-project] 10.222.0.18 "GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af" status: 404 len: 111 microversion: 2.1 time: 0.062632 Oct 04 18:02:03.929760 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 160/321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:03 2022] GET /compute/v2.1/servers/43863d88-b381-47c7-bcca-437f6f58d2af => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:03.950354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c11e4982-ed21-4858-9a14-080dcbd3e1db tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.951048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c11e4982-ed21-4858-9a14-080dcbd3e1db tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:03.957391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:03.962986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11e4982-ed21-4858-9a14-080dcbd3e1db tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.963495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11e4982-ed21-4858-9a14-080dcbd3e1db tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.963936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11e4982-ed21-4858-9a14-080dcbd3e1db tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.964736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11e4982-ed21-4858-9a14-080dcbd3e1db tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.974239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11e4982-ed21-4858-9a14-080dcbd3e1db tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.974937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11e4982-ed21-4858-9a14-080dcbd3e1db tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:04.236206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c11e4982-ed21-4858-9a14-080dcbd3e1db tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:04.248046 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c11e4982-ed21-4858-9a14-080dcbd3e1db tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1263 microversion: 2.1 time: 0.301976 Oct 04 18:02:04.263192 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 162/322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:03 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1263 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:04.559191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-59504686-a683-4eb4-8ec2-d777bbcd7aec tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:04.560036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-59504686-a683-4eb4-8ec2-d777bbcd7aec tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:04.578682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59504686-a683-4eb4-8ec2-d777bbcd7aec tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:04.579769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59504686-a683-4eb4-8ec2-d777bbcd7aec tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:04.580434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59504686-a683-4eb4-8ec2-d777bbcd7aec tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:04.581630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59504686-a683-4eb4-8ec2-d777bbcd7aec tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:04.582685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59504686-a683-4eb4-8ec2-d777bbcd7aec tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:04.583455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59504686-a683-4eb4-8ec2-d777bbcd7aec tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:04.767809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-343482641", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:04.867127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-59504686-a683-4eb4-8ec2-d777bbcd7aec tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:04.876496 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-59504686-a683-4eb4-8ec2-d777bbcd7aec tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.323762 Oct 04 18:02:04.882396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:02:04.888134 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 163/323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:04 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:04.945480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:04.946723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:04.954186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:04.957149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:04.959428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:04.964023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:04.967169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:04.967887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:05.193217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:05.208416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:05.211962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:05.219903 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ab07443-3cba-4614-9325-7554d8042cec tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.280232 Oct 04 18:02:05.235421 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 164/324] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:04 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:05.283532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eeb020f0-e384-40c6-af9b-f12da064fdff tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:05.284507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eeb020f0-e384-40c6-af9b-f12da064fdff tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:05.302544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb020f0-e384-40c6-af9b-f12da064fdff tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:05.303185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb020f0-e384-40c6-af9b-f12da064fdff tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:05.311515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb020f0-e384-40c6-af9b-f12da064fdff tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:05.312644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb020f0-e384-40c6-af9b-f12da064fdff tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:05.315290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb020f0-e384-40c6-af9b-f12da064fdff tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:05.318442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb020f0-e384-40c6-af9b-f12da064fdff tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:05.513958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eeb020f0-e384-40c6-af9b-f12da064fdff tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:05.526409 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eeb020f0-e384-40c6-af9b-f12da064fdff tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1269 microversion: 2.1 time: 0.255959 Oct 04 18:02:05.539667 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 165/325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:05 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1269 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:05.595524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:05.596267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:05.596757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:05.597215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:05.598436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:05.609538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:05.610118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:05.610567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:05.611684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:05.612246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:05.612857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:05.634188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Getting quotas for project 6e60a416d16a409f9ad18fb144bb388a. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:05.638223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:05.639798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Getting quotas for user 6c0e7f7155a5438f927987d48736c31d and project 6e60a416d16a409f9ad18fb144bb388a. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:05.659608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:05.662492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:05.725857 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c1b29da-107e-4afb-8166-5d4952216775 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662915 Oct 04 18:02:05.726527 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 161/326] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:02:05.742268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-713860ab-31a7-4cf5-81a9-6b46f9f6f9ec tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:05.743289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-713860ab-31a7-4cf5-81a9-6b46f9f6f9ec tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:05.831832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-713860ab-31a7-4cf5-81a9-6b46f9f6f9ec tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:05.840188 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-713860ab-31a7-4cf5-81a9-6b46f9f6f9ec tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1221 microversion: 2.1 time: 0.106092 Oct 04 18:02:05.840733 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 166/327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:05 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:05.914736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-745fc0ca-1e3a-4298-a3b9-748520d6bc46 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:05.915388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-745fc0ca-1e3a-4298-a3b9-748520d6bc46 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:05.924853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-745fc0ca-1e3a-4298-a3b9-748520d6bc46 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:05.929232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-745fc0ca-1e3a-4298-a3b9-748520d6bc46 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:05.929919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-745fc0ca-1e3a-4298-a3b9-748520d6bc46 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:05.930823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-745fc0ca-1e3a-4298-a3b9-748520d6bc46 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:05.931946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-745fc0ca-1e3a-4298-a3b9-748520d6bc46 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:05.932391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-745fc0ca-1e3a-4298-a3b9-748520d6bc46 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:06.250030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:06.251256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:06.270152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:06.274012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:06.275839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:06.275839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:06.276191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:06.278793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:06.311049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-745fc0ca-1e3a-4298-a3b9-748520d6bc46 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:06.325034 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-745fc0ca-1e3a-4298-a3b9-748520d6bc46 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.412860 Oct 04 18:02:06.326650 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 162/328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:05 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:06.436668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:06.449721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:06.451197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:06.462751 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f434c98b-90d3-4096-bdb0-f6a8ad3ddaf8 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.216555 Oct 04 18:02:06.484380 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 167/329] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:06 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:02:06.552033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a541eaba-0c54-4a56-a03e-98071acf1d7c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:06.552636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a541eaba-0c54-4a56-a03e-98071acf1d7c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:06.564006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a541eaba-0c54-4a56-a03e-98071acf1d7c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:06.564509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a541eaba-0c54-4a56-a03e-98071acf1d7c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:06.564954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a541eaba-0c54-4a56-a03e-98071acf1d7c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:06.571982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a541eaba-0c54-4a56-a03e-98071acf1d7c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:06.576537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a541eaba-0c54-4a56-a03e-98071acf1d7c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:06.577011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a541eaba-0c54-4a56-a03e-98071acf1d7c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:06.701828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a541eaba-0c54-4a56-a03e-98071acf1d7c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:06.714247 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a541eaba-0c54-4a56-a03e-98071acf1d7c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1269 microversion: 2.1 time: 0.166945 Oct 04 18:02:06.715964 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 163/330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:06 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:06.865448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-51affd97-5ce7-426b-aefb-fcbd8c81fdb5 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:06.866176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-51affd97-5ce7-426b-aefb-fcbd8c81fdb5 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:06.876411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51affd97-5ce7-426b-aefb-fcbd8c81fdb5 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:06.878275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51affd97-5ce7-426b-aefb-fcbd8c81fdb5 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:06.880820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51affd97-5ce7-426b-aefb-fcbd8c81fdb5 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:06.881593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51affd97-5ce7-426b-aefb-fcbd8c81fdb5 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:06.882188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51affd97-5ce7-426b-aefb-fcbd8c81fdb5 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:06.882483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51affd97-5ce7-426b-aefb-fcbd8c81fdb5 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.055116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-51affd97-5ce7-426b-aefb-fcbd8c81fdb5 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:07.069221 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-51affd97-5ce7-426b-aefb-fcbd8c81fdb5 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1217 microversion: 2.1 time: 0.208110 Oct 04 18:02:07.069799 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 168/331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:06 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:07.151846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af7ea1ed-c8b6-48c0-b9ab-904dff9995af tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:07.156695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7ea1ed-c8b6-48c0-b9ab-904dff9995af tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.157124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7ea1ed-c8b6-48c0-b9ab-904dff9995af tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.157572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7ea1ed-c8b6-48c0-b9ab-904dff9995af tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.158468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7ea1ed-c8b6-48c0-b9ab-904dff9995af tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.158773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7ea1ed-c8b6-48c0-b9ab-904dff9995af tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.170268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7ea1ed-c8b6-48c0-b9ab-904dff9995af tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.259863 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-af7ea1ed-c8b6-48c0-b9ab-904dff9995af tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.359132 Oct 04 18:02:07.260839 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 164/332] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:02:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:07.275126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c72ae7c7-4623-4819-a439-3ddeffced28e tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:07.280890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c72ae7c7-4623-4819-a439-3ddeffced28e tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.281597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c72ae7c7-4623-4819-a439-3ddeffced28e tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.284447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c72ae7c7-4623-4819-a439-3ddeffced28e tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.286451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c72ae7c7-4623-4819-a439-3ddeffced28e tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.289502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c72ae7c7-4623-4819-a439-3ddeffced28e tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.294912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c72ae7c7-4623-4819-a439-3ddeffced28e tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.358334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a80bab05-7742-482d-ad27-1bd0bd51a246 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:07.359122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a80bab05-7742-482d-ad27-1bd0bd51a246 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:07.367406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a80bab05-7742-482d-ad27-1bd0bd51a246 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.368004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a80bab05-7742-482d-ad27-1bd0bd51a246 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.368790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a80bab05-7742-482d-ad27-1bd0bd51a246 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.370362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a80bab05-7742-482d-ad27-1bd0bd51a246 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.372096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a80bab05-7742-482d-ad27-1bd0bd51a246 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.374229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a80bab05-7742-482d-ad27-1bd0bd51a246 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.412561 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c72ae7c7-4623-4819-a439-3ddeffced28e tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=n-d-850499-14" status: 200 len: 581 microversion: 2.1 time: 0.141471 Oct 04 18:02:07.414561 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 169/333] 10.222.0.18 () {58 vars in 1174 bytes} [Tue Oct 4 18:02:07 2022] GET /compute/v2.1/os-services?host=n-d-850499-14 => generated 581 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:02:07.427798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5e89061-6e36-45b6-805c-9d5316de08ef tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:07.452242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5e89061-6e36-45b6-805c-9d5316de08ef tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.452997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5e89061-6e36-45b6-805c-9d5316de08ef tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.453632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5e89061-6e36-45b6-805c-9d5316de08ef tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.455824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5e89061-6e36-45b6-805c-9d5316de08ef tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.456489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5e89061-6e36-45b6-805c-9d5316de08ef tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.457173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5e89061-6e36-45b6-805c-9d5316de08ef tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.486369 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a5e89061-6e36-45b6-805c-9d5316de08ef tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.062750 Oct 04 18:02:07.489101 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 170/334] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 4 18:02:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:02:07.521968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:07.521968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:07.537249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.540665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.541409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.543444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.548954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.549690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.617827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a80bab05-7742-482d-ad27-1bd0bd51a246 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:07.627259 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a80bab05-7742-482d-ad27-1bd0bd51a246 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.276697 Oct 04 18:02:07.630176 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 165/335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:07 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:07.638602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7131ed24-19f7-4a6e-bf54-2218a0eb5b08 tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:07.646399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7131ed24-19f7-4a6e-bf54-2218a0eb5b08 tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.646910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7131ed24-19f7-4a6e-bf54-2218a0eb5b08 tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.647363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7131ed24-19f7-4a6e-bf54-2218a0eb5b08 tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.648103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7131ed24-19f7-4a6e-bf54-2218a0eb5b08 tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.648563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7131ed24-19f7-4a6e-bf54-2218a0eb5b08 tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.648984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7131ed24-19f7-4a6e-bf54-2218a0eb5b08 tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.702885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:07.710469 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7131ed24-19f7-4a6e-bf54-2218a0eb5b08 tempest-ServicesAdminTestJSON-1630988874 tempest-ServicesAdminTestJSON-1630988874-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.074595 Oct 04 18:02:07.712810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:07.715141 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 166/336] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:02:07 2022] GET /compute/v2.1/os-services => generated 949 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:07.734319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:07.738320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b141a82e-c61a-4ef1-b5f0-73a736052c89 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:07.738999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b141a82e-c61a-4ef1-b5f0-73a736052c89 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:07.743892 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-afcdc88d-406a-4e1f-aefb-861fdabf6ae9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.244088 Oct 04 18:02:07.748359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b141a82e-c61a-4ef1-b5f0-73a736052c89 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.749506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b141a82e-c61a-4ef1-b5f0-73a736052c89 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.750056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b141a82e-c61a-4ef1-b5f0-73a736052c89 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.750745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b141a82e-c61a-4ef1-b5f0-73a736052c89 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.751246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b141a82e-c61a-4ef1-b5f0-73a736052c89 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.751685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b141a82e-c61a-4ef1-b5f0-73a736052c89 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.766399 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 171/337] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:07 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:07.979426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b141a82e-c61a-4ef1-b5f0-73a736052c89 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:07.991303 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b141a82e-c61a-4ef1-b5f0-73a736052c89 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1311 microversion: 2.1 time: 0.256578 Oct 04 18:02:07.992476 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 167/338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:07 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1311 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:02:08.092850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e7a9c6fb-0e57-4069-90b6-368e4d38efe3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:08.093462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e7a9c6fb-0e57-4069-90b6-368e4d38efe3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:08.099714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a9c6fb-0e57-4069-90b6-368e4d38efe3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:08.100420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a9c6fb-0e57-4069-90b6-368e4d38efe3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:08.101023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a9c6fb-0e57-4069-90b6-368e4d38efe3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:08.101909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a9c6fb-0e57-4069-90b6-368e4d38efe3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:08.102522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a9c6fb-0e57-4069-90b6-368e4d38efe3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:08.103133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a9c6fb-0e57-4069-90b6-368e4d38efe3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:08.181650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7a9c6fb-0e57-4069-90b6-368e4d38efe3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:08.191475 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e7a9c6fb-0e57-4069-90b6-368e4d38efe3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1279 microversion: 2.1 time: 0.102123 Oct 04 18:02:08.196194 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 172/339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:08 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1279 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:08.653093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-644a8d81-2947-403c-a606-10a75d7c8114 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:08.653713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-644a8d81-2947-403c-a606-10a75d7c8114 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:08.670505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-644a8d81-2947-403c-a606-10a75d7c8114 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:08.672717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-644a8d81-2947-403c-a606-10a75d7c8114 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:08.674840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-644a8d81-2947-403c-a606-10a75d7c8114 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:08.684057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-644a8d81-2947-403c-a606-10a75d7c8114 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:08.684844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-644a8d81-2947-403c-a606-10a75d7c8114 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:08.685300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-644a8d81-2947-403c-a606-10a75d7c8114 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:08.781589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:08.782250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:08.794220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:08.794877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:08.795388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:08.796381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:08.797951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:08.798750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:09.060871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:09.077055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:09.079518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:09.087114 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ed4889b3-f033-4048-9ccd-a606d98e53cf tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.310828 Oct 04 18:02:09.097168 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 173/340] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:08 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:02:09.109570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-354ced15-ae49-4c5e-a8c8-31acb3dcd610 req-632044f1-b724-4aad-84d0-d71bb17b7313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0d4381-3fce-4a7d-918e-755cd5123531", "tag": "17b6dffb-7626-47e5-838a-8ecf72593ec8"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:09.134348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-644a8d81-2947-403c-a606-10a75d7c8114 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:09.137663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-354ced15-ae49-4c5e-a8c8-31acb3dcd610 req-632044f1-b724-4aad-84d0-d71bb17b7313 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:09.138332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-354ced15-ae49-4c5e-a8c8-31acb3dcd610 req-632044f1-b724-4aad-84d0-d71bb17b7313 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:09.138980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-354ced15-ae49-4c5e-a8c8-31acb3dcd610 req-632044f1-b724-4aad-84d0-d71bb17b7313 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:09.142907 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-644a8d81-2947-403c-a606-10a75d7c8114 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.493766 Oct 04 18:02:09.146874 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 168/341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:08 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:09.158946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-354ced15-ae49-4c5e-a8c8-31acb3dcd610 req-632044f1-b724-4aad-84d0-d71bb17b7313 service nova] Creating event network-changed:17b6dffb-7626-47e5-838a-8ecf72593ec8 for instance ea0d4381-3fce-4a7d-918e-755cd5123531 on n-h1-850499-14 Oct 04 18:02:09.160815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-18e90ae5-4487-41f0-8c39-183830d0a626 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:09.165103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-18e90ae5-4487-41f0-8c39-183830d0a626 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:09.166387 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-354ced15-ae49-4c5e-a8c8-31acb3dcd610 req-632044f1-b724-4aad-84d0-d71bb17b7313 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066236 Oct 04 18:02:09.167848 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 174/342] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:09.198407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18e90ae5-4487-41f0-8c39-183830d0a626 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:09.200535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18e90ae5-4487-41f0-8c39-183830d0a626 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:09.202719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18e90ae5-4487-41f0-8c39-183830d0a626 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:09.207943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18e90ae5-4487-41f0-8c39-183830d0a626 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:09.208531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18e90ae5-4487-41f0-8c39-183830d0a626 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:09.208980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18e90ae5-4487-41f0-8c39-183830d0a626 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:09.218677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1fa7b9f4-76d7-4325-a5a5-c816226b8a56 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:09.219424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1fa7b9f4-76d7-4325-a5a5-c816226b8a56 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:09.232871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fa7b9f4-76d7-4325-a5a5-c816226b8a56 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:09.234514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fa7b9f4-76d7-4325-a5a5-c816226b8a56 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:09.235158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fa7b9f4-76d7-4325-a5a5-c816226b8a56 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:09.239347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fa7b9f4-76d7-4325-a5a5-c816226b8a56 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:09.239892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fa7b9f4-76d7-4325-a5a5-c816226b8a56 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:09.240339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fa7b9f4-76d7-4325-a5a5-c816226b8a56 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:09.378621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1fa7b9f4-76d7-4325-a5a5-c816226b8a56 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:09.390696 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1fa7b9f4-76d7-4325-a5a5-c816226b8a56 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1279 microversion: 2.1 time: 0.176512 Oct 04 18:02:09.404106 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 175/343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:09 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:09.505655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-18e90ae5-4487-41f0-8c39-183830d0a626 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:09.509908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:09.515560 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-18e90ae5-4487-41f0-8c39-183830d0a626 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1311 microversion: 2.1 time: 0.364723 Oct 04 18:02:09.516308 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 169/344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:09 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1311 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:10.118984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:10.119851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:10.141588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.142351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.142980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.143999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.145135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.145786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.249650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:10.263646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:10.265750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:10.275654 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6ea51ef6-9529-4e5d-a715-2a1ffbfa09d9 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.163306 Oct 04 18:02:10.276757 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 170/345] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:10 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:10.283435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-054991a6-92f8-4204-bdd3-b73d36010bbc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:10.284287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-054991a6-92f8-4204-bdd3-b73d36010bbc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:10.291492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054991a6-92f8-4204-bdd3-b73d36010bbc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.293505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054991a6-92f8-4204-bdd3-b73d36010bbc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.294463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054991a6-92f8-4204-bdd3-b73d36010bbc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.295607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054991a6-92f8-4204-bdd3-b73d36010bbc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.296289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054991a6-92f8-4204-bdd3-b73d36010bbc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.297063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054991a6-92f8-4204-bdd3-b73d36010bbc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.513774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1246937476", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:10.591776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:02:10.780281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-054991a6-92f8-4204-bdd3-b73d36010bbc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:10.791867 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-054991a6-92f8-4204-bdd3-b73d36010bbc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.513272 Oct 04 18:02:10.794589 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 171/346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:10 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:10.802098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-135d9a8b-b62d-4816-b5f6-d9c6a2781c64 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:10.807599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-135d9a8b-b62d-4816-b5f6-d9c6a2781c64 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:10.818055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135d9a8b-b62d-4816-b5f6-d9c6a2781c64 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.823419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135d9a8b-b62d-4816-b5f6-d9c6a2781c64 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.824243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135d9a8b-b62d-4816-b5f6-d9c6a2781c64 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.825706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135d9a8b-b62d-4816-b5f6-d9c6a2781c64 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.826214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135d9a8b-b62d-4816-b5f6-d9c6a2781c64 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.826649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135d9a8b-b62d-4816-b5f6-d9c6a2781c64 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.167710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-135d9a8b-b62d-4816-b5f6-d9c6a2781c64 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:11.175029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:11.175463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:11.175969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:11.177597 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-135d9a8b-b62d-4816-b5f6-d9c6a2781c64 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1321 microversion: 2.1 time: 0.381889 Oct 04 18:02:11.190986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:11.190986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:11.193369 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 172/347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:10 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:11.200972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1be806c7-f9f0-4c31-8c71-a5ab09949f57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:11.202220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1be806c7-f9f0-4c31-8c71-a5ab09949f57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:11.210137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be806c7-f9f0-4c31-8c71-a5ab09949f57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:11.211056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be806c7-f9f0-4c31-8c71-a5ab09949f57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:11.211803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be806c7-f9f0-4c31-8c71-a5ab09949f57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.212140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:11.212902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:11.213061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be806c7-f9f0-4c31-8c71-a5ab09949f57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:11.213395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.213912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be806c7-f9f0-4c31-8c71-a5ab09949f57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:11.214464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be806c7-f9f0-4c31-8c71-a5ab09949f57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.214671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:11.215174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:11.215655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.262172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:11.269623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for user d7458740d4be4cedaa01bea94ba992d2 and project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:11.297151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:11.299781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:11.362564 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dfc2b7d1-5dcb-47f6-9f71-0cf8e2a6c7dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446458 Oct 04 18:02:11.364555 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 176/348] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:02:11.376086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c8ce7813-87ac-4471-8d12-fa23042b6765 req-09fb3498-397f-4a38-85cb-a8d1f906e55c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d9639a-f27a-499b-9ce8-d84427abf106", "name": "network-vif-plugged", "status": "completed", "tag": "6bfeaeb7-8851-4adf-823e-b3978471323b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:11.417042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c8ce7813-87ac-4471-8d12-fa23042b6765 req-09fb3498-397f-4a38-85cb-a8d1f906e55c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:11.418448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c8ce7813-87ac-4471-8d12-fa23042b6765 req-09fb3498-397f-4a38-85cb-a8d1f906e55c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:11.418884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c8ce7813-87ac-4471-8d12-fa23042b6765 req-09fb3498-397f-4a38-85cb-a8d1f906e55c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.421138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1be806c7-f9f0-4c31-8c71-a5ab09949f57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:11.422025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:11.435850 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c8ce7813-87ac-4471-8d12-fa23042b6765 req-09fb3498-397f-4a38-85cb-a8d1f906e55c service nova] Creating event network-vif-plugged:6bfeaeb7-8851-4adf-823e-b3978471323b for instance 05d9639a-f27a-499b-9ce8-d84427abf106 on n-h1-850499-14 Oct 04 18:02:11.443924 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1be806c7-f9f0-4c31-8c71-a5ab09949f57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1311 microversion: 2.1 time: 0.236382 Oct 04 18:02:11.446344 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c8ce7813-87ac-4471-8d12-fa23042b6765 req-09fb3498-397f-4a38-85cb-a8d1f906e55c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077489 Oct 04 18:02:11.447605 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 177/349] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:11.463956 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 173/350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:11 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1311 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:11.470173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:11.471301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:11.480498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:11.481524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:11.482131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.483650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:11.484286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:11.484897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.579149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:11.601041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:11.604026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:11.611494 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29f5c49f-e319-4a65-bcd9-84881f0f558f tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.145823 Oct 04 18:02:11.626988 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 174/351] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:11 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:11.634939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9ad3ad0-d67a-4744-9e22-edfc27637667 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:11.638035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9ad3ad0-d67a-4744-9e22-edfc27637667 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:11.767602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9ad3ad0-d67a-4744-9e22-edfc27637667 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:11.778434 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9ad3ad0-d67a-4744-9e22-edfc27637667 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1213 microversion: 2.1 time: 0.163935 Oct 04 18:02:11.779218 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 175/352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:11 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1213 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:11.787695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-240c6235-c7e6-4199-8516-c8c41303509f req-e6dfb94e-55ef-47d0-8766-9c141d31ff89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa216bb-86aa-4a96-b668-db3f973d0308", "tag": "e54c97e3-e2ac-49bd-bcc9-d3f5a69e1d8c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:11.809043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-240c6235-c7e6-4199-8516-c8c41303509f req-e6dfb94e-55ef-47d0-8766-9c141d31ff89 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:11.809844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-240c6235-c7e6-4199-8516-c8c41303509f req-e6dfb94e-55ef-47d0-8766-9c141d31ff89 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:11.810796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-240c6235-c7e6-4199-8516-c8c41303509f req-e6dfb94e-55ef-47d0-8766-9c141d31ff89 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.827086 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-240c6235-c7e6-4199-8516-c8c41303509f req-e6dfb94e-55ef-47d0-8766-9c141d31ff89 service nova] Creating event network-changed:e54c97e3-e2ac-49bd-bcc9-d3f5a69e1d8c for instance cfa216bb-86aa-4a96-b668-db3f973d0308 on n-h2-850499-14 Oct 04 18:02:11.838299 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-240c6235-c7e6-4199-8516-c8c41303509f req-e6dfb94e-55ef-47d0-8766-9c141d31ff89 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056963 Oct 04 18:02:11.840003 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 176/353] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:11.848243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-46b589ae-8181-4a0c-a4cc-7ccd231d8ccc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:11.849178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-46b589ae-8181-4a0c-a4cc-7ccd231d8ccc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:11.858346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b589ae-8181-4a0c-a4cc-7ccd231d8ccc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:11.859245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b589ae-8181-4a0c-a4cc-7ccd231d8ccc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:11.859833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b589ae-8181-4a0c-a4cc-7ccd231d8ccc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.860840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b589ae-8181-4a0c-a4cc-7ccd231d8ccc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:11.861519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b589ae-8181-4a0c-a4cc-7ccd231d8ccc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:11.862415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b589ae-8181-4a0c-a4cc-7ccd231d8ccc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.092452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-400ae6a5-4eaf-4aa0-abc5-99a254bdca93 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-72730979", "ram": 512, "vcpus": 1, "disk": 10, "id": 1608500789, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:12.126094 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-400ae6a5-4eaf-4aa0-abc5-99a254bdca93 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.676621 Oct 04 18:02:12.130526 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 178/354] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:11 2022] POST /compute/v2.1/flavors => generated 414 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:12.143816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6225e2f6-27b9-4887-acc0-ee8df3ca03dc tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:12.171891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-46b589ae-8181-4a0c-a4cc-7ccd231d8ccc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:12.186294 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6225e2f6-27b9-4887-acc0-ee8df3ca03dc tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1608500789/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047620 Oct 04 18:02:12.187864 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 179/355] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 4 18:02:12 2022] POST /compute/v2.1/flavors/1608500789/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:02:12.196167 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-46b589ae-8181-4a0c-a4cc-7ccd231d8ccc tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.354701 Oct 04 18:02:12.197348 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 177/356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:11 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:12.216750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bf3af467-db95-4015-8fac-387591904a31 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:12.217841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bf3af467-db95-4015-8fac-387591904a31 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:12.237204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf3af467-db95-4015-8fac-387591904a31 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.237975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf3af467-db95-4015-8fac-387591904a31 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.238639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf3af467-db95-4015-8fac-387591904a31 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.240195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf3af467-db95-4015-8fac-387591904a31 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.241066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf3af467-db95-4015-8fac-387591904a31 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.242066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf3af467-db95-4015-8fac-387591904a31 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.604657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3f1e2538-1fad-4b46-ac79-555ed412927d tempest-FlavorsExtraSpecsTestJSON-1944284697 tempest-FlavorsExtraSpecsTestJSON-1944284697-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:12.616547 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3f1e2538-1fad-4b46-ac79-555ed412927d tempest-FlavorsExtraSpecsTestJSON-1944284697 tempest-FlavorsExtraSpecsTestJSON-1944284697-project] 10.222.0.18 "GET /compute/v2.1/flavors/1608500789/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.421856 Oct 04 18:02:12.622265 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 180/357] 10.222.0.18 () {58 vars in 1203 bytes} [Tue Oct 4 18:02:12 2022] GET /compute/v2.1/flavors/1608500789/os-extra_specs => generated 66 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:12.631740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-867b920d-fdb8-4f2b-a77f-d1d91cc6aec9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:12.636799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-867b920d-fdb8-4f2b-a77f-d1d91cc6aec9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:12.647070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-867b920d-fdb8-4f2b-a77f-d1d91cc6aec9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.649112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-867b920d-fdb8-4f2b-a77f-d1d91cc6aec9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.650831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-867b920d-fdb8-4f2b-a77f-d1d91cc6aec9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.652069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-867b920d-fdb8-4f2b-a77f-d1d91cc6aec9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.653428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-867b920d-fdb8-4f2b-a77f-d1d91cc6aec9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.654779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-867b920d-fdb8-4f2b-a77f-d1d91cc6aec9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.681756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bf3af467-db95-4015-8fac-387591904a31 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:12.692474 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bf3af467-db95-4015-8fac-387591904a31 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1321 microversion: 2.1 time: 0.488529 Oct 04 18:02:12.714301 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 178/358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:12 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1321 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:12.725522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f93692c-75db-431e-bbe8-3a5decf7217c tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:12.784418 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f93692c-75db-431e-bbe8-3a5decf7217c tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1608500789/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068407 Oct 04 18:02:12.786925 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 179/359] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 4 18:02:12 2022] POST /compute/v2.1/flavors/1608500789/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:12.791889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:12.792783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:12.802718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.804160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.805011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.806894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.807695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.808864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.933578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:12.948699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:12.951696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:12.964709 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-085d8877-4f11-4e82-b26c-6c89e266b7ba tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.176452 Oct 04 18:02:12.967073 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 180/360] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:12 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:12.976459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f828d3f2-8dd1-4ea5-8949-08bd59f63040 tempest-FlavorsExtraSpecsTestJSON-1944284697 tempest-FlavorsExtraSpecsTestJSON-1944284697-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:12.993870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-867b920d-fdb8-4f2b-a77f-d1d91cc6aec9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:12.994086 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f828d3f2-8dd1-4ea5-8949-08bd59f63040 tempest-FlavorsExtraSpecsTestJSON-1944284697 tempest-FlavorsExtraSpecsTestJSON-1944284697-project] 10.222.0.18 "GET /compute/v2.1/flavors/1608500789/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.026460 Oct 04 18:02:12.999721 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 181/361] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:02:12 2022] GET /compute/v2.1/flavors/1608500789/os-extra_specs/hw:numa_nodes => generated 22 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:13.006461 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-867b920d-fdb8-4f2b-a77f-d1d91cc6aec9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1311 microversion: 2.1 time: 0.379516 Oct 04 18:02:13.006461 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 181/362] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:12 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1311 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:13.017736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-138874bc-3fd7-4d8d-b45a-2f65c1a0d8c3 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:13.026999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7115fdf4-d708-4aaf-9904-ad3ae59f4a47 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.027829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7115fdf4-d708-4aaf-9904-ad3ae59f4a47 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:13.040288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7115fdf4-d708-4aaf-9904-ad3ae59f4a47 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.040783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7115fdf4-d708-4aaf-9904-ad3ae59f4a47 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.041237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7115fdf4-d708-4aaf-9904-ad3ae59f4a47 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.047758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7115fdf4-d708-4aaf-9904-ad3ae59f4a47 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.048264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7115fdf4-d708-4aaf-9904-ad3ae59f4a47 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.048702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7115fdf4-d708-4aaf-9904-ad3ae59f4a47 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.063321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=84,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:13.091739 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-138874bc-3fd7-4d8d-b45a-2f65c1a0d8c3 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1608500789/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083580 Oct 04 18:02:13.092971 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 182/363] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 4 18:02:13 2022] POST /compute/v2.1/flavors/1608500789/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:13.102904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2336a21f-f596-47de-88b9-509924e79de6 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.111628 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2336a21f-f596-47de-88b9-509924e79de6 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1608500789/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012730 Oct 04 18:02:13.112472 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 183/364] 10.222.0.18 () {58 vars in 1203 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/flavors/1608500789/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:13.127967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8ec289ae-dd78-491e-a08b-05aa773a664b tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:13.256937 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8ec289ae-dd78-491e-a08b-05aa773a664b tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1608500789/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.136405 Oct 04 18:02:13.267659 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 184/365] 10.222.0.18 () {60 vars in 1265 bytes} [Tue Oct 4 18:02:13 2022] PUT /compute/v2.1/flavors/1608500789/os-extra_specs/hw:numa_nodes => generated 22 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:13.291256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c5298e79-4ac4-4bec-a83e-ebc651afc7ae tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.294001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c5298e79-4ac4-4bec-a83e-ebc651afc7ae tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:13.294420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7115fdf4-d708-4aaf-9904-ad3ae59f4a47 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:13.316758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5298e79-4ac4-4bec-a83e-ebc651afc7ae tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.320399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5298e79-4ac4-4bec-a83e-ebc651afc7ae tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.323504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5298e79-4ac4-4bec-a83e-ebc651afc7ae tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.328780 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7115fdf4-d708-4aaf-9904-ad3ae59f4a47 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1265 microversion: 2.1 time: 0.327901 Oct 04 18:02:13.329275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5298e79-4ac4-4bec-a83e-ebc651afc7ae tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.329391 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 182/366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:12 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:13.330415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5298e79-4ac4-4bec-a83e-ebc651afc7ae tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.331213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5298e79-4ac4-4bec-a83e-ebc651afc7ae tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.349070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7803a2c9-689d-4efb-8517-edced06c0792 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.386665 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7803a2c9-689d-4efb-8517-edced06c0792 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1608500789/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056159 Oct 04 18:02:13.396236 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 183/367] 10.222.0.18 () {58 vars in 1203 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/flavors/1608500789/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:13.419180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa5d0807-2653-453d-9057-290315e550d8 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.545908 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa5d0807-2653-453d-9057-290315e550d8 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1608500789/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.148489 Oct 04 18:02:13.550860 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 184/368] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:02:13 2022] DELETE /compute/v2.1/flavors/1608500789/os-extra_specs/hw:numa_nodes => generated 0 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:02:13.573235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-41a2e887-8fde-4640-afac-edb3756bd5a9 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.611330 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-41a2e887-8fde-4640-afac-edb3756bd5a9 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1608500789/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.058304 Oct 04 18:02:13.615707 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 185/369] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:02:13 2022] DELETE /compute/v2.1/flavors/1608500789/os-extra_specs/hw:cpu_policy => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:02:13.623848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c5298e79-4ac4-4bec-a83e-ebc651afc7ae tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:13.629457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-23b8cae0-deed-4af0-beb5-3165e8ddd0b5 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.640839 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c5298e79-4ac4-4bec-a83e-ebc651afc7ae tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1319 microversion: 2.1 time: 0.371595 Oct 04 18:02:13.641341 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 185/370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:13.644064 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-23b8cae0-deed-4af0-beb5-3165e8ddd0b5 tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1608500789/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026807 Oct 04 18:02:13.652557 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 186/371] 10.222.0.18 () {58 vars in 1203 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/flavors/1608500789/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:13.656223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-efda92c9-3a13-487a-80d0-de8a8a32dc2d tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.681926 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-efda92c9-3a13-487a-80d0-de8a8a32dc2d tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1608500789" status: 202 len: 0 microversion: 2.1 time: 0.029246 Oct 04 18:02:13.682517 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 186/372] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:02:13 2022] DELETE /compute/v2.1/flavors/1608500789 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:13.690802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0632daf6-4640-42e9-ad17-983a44cccdeb tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.716446 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0632daf6-4640-42e9-ad17-983a44cccdeb tempest-FlavorsExtraSpecsTestJSON-79129754 tempest-FlavorsExtraSpecsTestJSON-79129754-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029773 Oct 04 18:02:13.717327 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 187/373] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:13.720264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a011b37-de91-4191-835b-e168d7eca2be tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.721113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a011b37-de91-4191-835b-e168d7eca2be tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:13.744043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a011b37-de91-4191-835b-e168d7eca2be tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.745060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a011b37-de91-4191-835b-e168d7eca2be tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.745502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a011b37-de91-4191-835b-e168d7eca2be tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.746769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a011b37-de91-4191-835b-e168d7eca2be tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:13.747717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a011b37-de91-4191-835b-e168d7eca2be tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:13.748546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a011b37-de91-4191-835b-e168d7eca2be tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.993942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:13.994560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:14.000629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.001118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.001556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.002255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.002710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.003177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.156332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:14.168961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:14.171327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:14.175381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9a011b37-de91-4191-835b-e168d7eca2be tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:14.188976 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a011b37-de91-4191-835b-e168d7eca2be tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1321 microversion: 2.1 time: 0.470986 Oct 04 18:02:14.190239 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 187/374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:02:14.194878 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bf52df79-68f7-4bad-bbb6-b9b3a28d3cef tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.204701 Oct 04 18:02:14.214689 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 188/375] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:13 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:02:14.220157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0075ae84-c3d0-4718-b3c7-e54713f07c70 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:14.220157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0075ae84-c3d0-4718-b3c7-e54713f07c70 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:14.228231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0075ae84-c3d0-4718-b3c7-e54713f07c70 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.228863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0075ae84-c3d0-4718-b3c7-e54713f07c70 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.229412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0075ae84-c3d0-4718-b3c7-e54713f07c70 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.230630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0075ae84-c3d0-4718-b3c7-e54713f07c70 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.231759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0075ae84-c3d0-4718-b3c7-e54713f07c70 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.232346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0075ae84-c3d0-4718-b3c7-e54713f07c70 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.492127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d2c68e50>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:14.495765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.496259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.496885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.505500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.505991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.506425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.514554 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] HTTP exception thrown: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Request method failure captured: Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/os-services/948edf80-8c8c-40e9-86bd-71cf2657f4c4 HTTP/1.1 Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 56 Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUlslZ8uY1mBmrLMnNCyLB1B8uf4UYSsM6Y_HNA2gx3I5YEobphEhe4PbXWGtqI-NGnLr7oBIWEoXRemzNSoGXIthiOsRTlgdVwIi1JldAqNmuqEK4KMIRorZC2N8J0fVQdzY1yYdSi2CJ2wPpwJFSKsZ73dK0_WiPyUeQq8G7VQHM Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 281a7e8151d74605af8d1d2e0a0f4b0a Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1410525606 Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:02:14.517046 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_281a7e8151d74605af8d1d2e0a0f4b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/281a7e8151d74605af8d1d2e0a0f4b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/281a7e8151d74605af8d1d2e0a0f4b0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/281a7e8151d74605af8d1d2e0a0f4b0a"}]}] Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1410525606 Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 281a7e8151d74605af8d1d2e0a0f4b0a Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1410525606 Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0370793806664fb6a800480d86d428d1 Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:02:14.518375 n-d-850499-14 devstack@n-api.service[122331]: exception: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '948edf80-8c8c-40e9-86bd-71cf2657f4c4', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.519598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:14.522520 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:14.524903 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:14.524903 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.524903 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.524903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Returning 404 to user: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:14.524903 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca0ddb18-5687-484b-92e8-2e8346e3526b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/948edf80-8c8c-40e9-86bd-71cf2657f4c4" status: 404 len: 110 microversion: 2.53 time: 0.322777 Oct 04 18:02:14.524903 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 188/376] 10.222.0.18 () {62 vars in 1309 bytes} [Tue Oct 4 18:02:14 2022] PUT /compute/v2.1/os-services/948edf80-8c8c-40e9-86bd-71cf2657f4c4 => generated 110 bytes in 333 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:14.529698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c5831808-af66-443b-a128-4a4d4749ec1f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:14.530393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c5831808-af66-443b-a128-4a4d4749ec1f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:14.540225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5831808-af66-443b-a128-4a4d4749ec1f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.541096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5831808-af66-443b-a128-4a4d4749ec1f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.542115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5831808-af66-443b-a128-4a4d4749ec1f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.543013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5831808-af66-443b-a128-4a4d4749ec1f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.543900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5831808-af66-443b-a128-4a4d4749ec1f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.544857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5831808-af66-443b-a128-4a4d4749ec1f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.694093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c5831808-af66-443b-a128-4a4d4749ec1f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:14.712102 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c5831808-af66-443b-a128-4a4d4749ec1f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1271 microversion: 2.1 time: 0.185839 Oct 04 18:02:14.712932 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 189/377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:14 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:14.721583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d24fc670>, body: {"status": "disabled"} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:14.733483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.735008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.736061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.738979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0075ae84-c3d0-4718-b3c7-e54713f07c70 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:14.745763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.746747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.747725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.750418 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0075ae84-c3d0-4718-b3c7-e54713f07c70 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1311 microversion: 2.1 time: 0.538020 Oct 04 18:02:14.756108 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] HTTP exception thrown: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Request method failure captured: Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/os-services/948edf80-8c8c-40e9-86bd-71cf2657f4c4 HTTP/1.1 Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 22 Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUlslZ8uY1mBmrLMnNCyLB1B8uf4UYSsM6Y_HNA2gx3I5YEobphEhe4PbXWGtqI-NGnLr7oBIWEoXRemzNSoGXIthiOsRTlgdVwIi1JldAqNmuqEK4KMIRorZC2N8J0fVQdzY1yYdSi2CJ2wPpwJFSKsZ73dK0_WiPyUeQq8G7VQHM Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 281a7e8151d74605af8d1d2e0a0f4b0a Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1410525606 Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:02:14.758309 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_281a7e8151d74605af8d1d2e0a0f4b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/281a7e8151d74605af8d1d2e0a0f4b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/281a7e8151d74605af8d1d2e0a0f4b0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/281a7e8151d74605af8d1d2e0a0f4b0a"}]}] Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1410525606 Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 281a7e8151d74605af8d1d2e0a0f4b0a Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1410525606 Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0370793806664fb6a800480d86d428d1 Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: {"status": "disabled"} Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: exception: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.759841 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '948edf80-8c8c-40e9-86bd-71cf2657f4c4', 'body': {'status': 'disabled'}} Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.760624 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:14.762277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:14.764724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.764724 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.766156 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 189/378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:14 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1311 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:14.768078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Returning 404 to user: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:14.769046 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e536f0a4-1f41-41d4-b1e5-dc033c9e264a tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/948edf80-8c8c-40e9-86bd-71cf2657f4c4" status: 404 len: 110 microversion: 2.53 time: 0.053977 Oct 04 18:02:14.769802 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 190/379] 10.222.0.18 () {62 vars in 1309 bytes} [Tue Oct 4 18:02:14 2022] PUT /compute/v2.1/os-services/948edf80-8c8c-40e9-86bd-71cf2657f4c4 => generated 110 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:14.776051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc2b7ef6-2384-48eb-9c2f-6b4b087f47e5 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:14.776991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc2b7ef6-2384-48eb-9c2f-6b4b087f47e5 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:14.779241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:DELETE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:14.787734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc2b7ef6-2384-48eb-9c2f-6b4b087f47e5 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.788313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc2b7ef6-2384-48eb-9c2f-6b4b087f47e5 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.788962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc2b7ef6-2384-48eb-9c2f-6b4b087f47e5 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.789753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d25541f0>, body: {"status": "enabled"} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:14.789880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc2b7ef6-2384-48eb-9c2f-6b4b087f47e5 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.790430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc2b7ef6-2384-48eb-9c2f-6b4b087f47e5 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.790871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc2b7ef6-2384-48eb-9c2f-6b4b087f47e5 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.793781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.800384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.801442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.821240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.821652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.822101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.839317 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] HTTP exception thrown: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Request method failure captured: Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/os-services/948edf80-8c8c-40e9-86bd-71cf2657f4c4 HTTP/1.1 Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 21 Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUlslZ8uY1mBmrLMnNCyLB1B8uf4UYSsM6Y_HNA2gx3I5YEobphEhe4PbXWGtqI-NGnLr7oBIWEoXRemzNSoGXIthiOsRTlgdVwIi1JldAqNmuqEK4KMIRorZC2N8J0fVQdzY1yYdSi2CJ2wPpwJFSKsZ73dK0_WiPyUeQq8G7VQHM Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 281a7e8151d74605af8d1d2e0a0f4b0a Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1410525606 Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:02:14.848363 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_281a7e8151d74605af8d1d2e0a0f4b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/281a7e8151d74605af8d1d2e0a0f4b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/281a7e8151d74605af8d1d2e0a0f4b0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/281a7e8151d74605af8d1d2e0a0f4b0a"}]}] Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1410525606 Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 281a7e8151d74605af8d1d2e0a0f4b0a Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1410525606 Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0370793806664fb6a800480d86d428d1 Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: {"status": "enabled"} Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: exception: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.849666 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '948edf80-8c8c-40e9-86bd-71cf2657f4c4', 'body': {'status': 'enabled'}} Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.850437 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:14.852079 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:14.853229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. Oct 04 18:02:14.853229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:14.855823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Returning 404 to user: Service 948edf80-8c8c-40e9-86bd-71cf2657f4c4 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:14.857487 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dcde7b4c-965b-4257-8382-c2a08659d118 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/948edf80-8c8c-40e9-86bd-71cf2657f4c4" status: 404 len: 110 microversion: 2.53 time: 0.081331 Oct 04 18:02:14.858497 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 191/380] 10.222.0.18 () {62 vars in 1309 bytes} [Tue Oct 4 18:02:14 2022] PUT /compute/v2.1/os-services/948edf80-8c8c-40e9-86bd-71cf2657f4c4 => generated 110 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:14.872027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3dfe90f0-d077-41e9-a2fa-b7e99f27ea1b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:14.877272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dfe90f0-d077-41e9-a2fa-b7e99f27ea1b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.878425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dfe90f0-d077-41e9-a2fa-b7e99f27ea1b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.879328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dfe90f0-d077-41e9-a2fa-b7e99f27ea1b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.880987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dfe90f0-d077-41e9-a2fa-b7e99f27ea1b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.881697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dfe90f0-d077-41e9-a2fa-b7e99f27ea1b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.882444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dfe90f0-d077-41e9-a2fa-b7e99f27ea1b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.918375 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3dfe90f0-d077-41e9-a2fa-b7e99f27ea1b tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.054611 Oct 04 18:02:14.928008 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 192/381] 10.222.0.18 () {60 vars in 1178 bytes} [Tue Oct 4 18:02:14 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:14.933668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1551fe41-e36c-4563-a825-277c2c4f3e34 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:14.937984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1551fe41-e36c-4563-a825-277c2c4f3e34 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.938482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1551fe41-e36c-4563-a825-277c2c4f3e34 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.938930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1551fe41-e36c-4563-a825-277c2c4f3e34 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.940409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1551fe41-e36c-4563-a825-277c2c4f3e34 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.940876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1551fe41-e36c-4563-a825-277c2c4f3e34 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.942359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1551fe41-e36c-4563-a825-277c2c4f3e34 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.971345 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1551fe41-e36c-4563-a825-277c2c4f3e34 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.042139 Oct 04 18:02:14.971972 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 193/382] 10.222.0.18 () {60 vars in 1211 bytes} [Tue Oct 4 18:02:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:14.985869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5efac442-0595-4270-9eb7-80373735cc12 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:14.989710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efac442-0595-4270-9eb7-80373735cc12 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.990151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efac442-0595-4270-9eb7-80373735cc12 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.990662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efac442-0595-4270-9eb7-80373735cc12 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.991647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efac442-0595-4270-9eb7-80373735cc12 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.992033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efac442-0595-4270-9eb7-80373735cc12 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.992455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efac442-0595-4270-9eb7-80373735cc12 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.022294 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5efac442-0595-4270-9eb7-80373735cc12 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.040167 Oct 04 18:02:15.031141 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 194/383] 10.222.0.18 () {60 vars in 1178 bytes} [Tue Oct 4 18:02:14 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:15.039485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d6d850a6-dff2-4acb-a203-301799ccab2d tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:15.042721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d850a6-dff2-4acb-a203-301799ccab2d tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.043256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d850a6-dff2-4acb-a203-301799ccab2d tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.043703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d850a6-dff2-4acb-a203-301799ccab2d tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.044438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d850a6-dff2-4acb-a203-301799ccab2d tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.044898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d850a6-dff2-4acb-a203-301799ccab2d tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.045324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d850a6-dff2-4acb-a203-301799ccab2d tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.070486 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d6d850a6-dff2-4acb-a203-301799ccab2d tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=n-d-850499-14&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038011 Oct 04 18:02:15.078155 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 195/384] 10.222.0.18 () {60 vars in 1237 bytes} [Tue Oct 4 18:02:15 2022] GET /compute/v2.1/os-services?host=n-d-850499-14&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:15.084527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5925dc77-27ae-43b3-9eb2-cccacf10296e tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:15.094718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5925dc77-27ae-43b3-9eb2-cccacf10296e tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.096934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5925dc77-27ae-43b3-9eb2-cccacf10296e tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.097591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5925dc77-27ae-43b3-9eb2-cccacf10296e tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.102947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5925dc77-27ae-43b3-9eb2-cccacf10296e tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.104545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5925dc77-27ae-43b3-9eb2-cccacf10296e tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.105158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5925dc77-27ae-43b3-9eb2-cccacf10296e tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.133447 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5925dc77-27ae-43b3-9eb2-cccacf10296e tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.052865 Oct 04 18:02:15.134727 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 196/385] 10.222.0.18 () {60 vars in 1178 bytes} [Tue Oct 4 18:02:15 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:15.147971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dc2b7ef6-2384-48eb-9c2f-6b4b087f47e5 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:15.148271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ff5f2c3-4a67-480d-b9dd-8368f9ad7eb9 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:15.156071 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc2b7ef6-2384-48eb-9c2f-6b4b087f47e5 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1468 microversion: 2.1 time: 0.388540 Oct 04 18:02:15.156340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ff5f2c3-4a67-480d-b9dd-8368f9ad7eb9 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.159352 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 190/386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:14 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1468 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:15.172175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ff5f2c3-4a67-480d-b9dd-8368f9ad7eb9 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.173025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ff5f2c3-4a67-480d-b9dd-8368f9ad7eb9 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.173874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ff5f2c3-4a67-480d-b9dd-8368f9ad7eb9 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.174361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ff5f2c3-4a67-480d-b9dd-8368f9ad7eb9 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.174795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ff5f2c3-4a67-480d-b9dd-8368f9ad7eb9 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.183873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4b162711-4fcf-45f3-b774-9b1a893cffe9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:15.184665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4b162711-4fcf-45f3-b774-9b1a893cffe9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:15.194525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b162711-4fcf-45f3-b774-9b1a893cffe9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.197902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b162711-4fcf-45f3-b774-9b1a893cffe9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.198546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b162711-4fcf-45f3-b774-9b1a893cffe9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.202945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b162711-4fcf-45f3-b774-9b1a893cffe9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.203945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b162711-4fcf-45f3-b774-9b1a893cffe9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.204579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b162711-4fcf-45f3-b774-9b1a893cffe9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.243738 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ff5f2c3-4a67-480d-b9dd-8368f9ad7eb9 tempest-ServicesAdminNegativeV253TestJSON-1410525606 tempest-ServicesAdminNegativeV253TestJSON-1410525606-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.099267 Oct 04 18:02:15.245327 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 197/387] 10.222.0.18 () {60 vars in 1239 bytes} [Tue Oct 4 18:02:15 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:15.258079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93bd0597-ec0d-427f-a26b-0ed9125b8b25 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:15.261513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-93bd0597-ec0d-427f-a26b-0ed9125b8b25 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:15.282089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93bd0597-ec0d-427f-a26b-0ed9125b8b25 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.282872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93bd0597-ec0d-427f-a26b-0ed9125b8b25 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.283808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93bd0597-ec0d-427f-a26b-0ed9125b8b25 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.286014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93bd0597-ec0d-427f-a26b-0ed9125b8b25 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.286645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93bd0597-ec0d-427f-a26b-0ed9125b8b25 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.291233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93bd0597-ec0d-427f-a26b-0ed9125b8b25 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.292426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-4b162711-4fcf-45f3-b774-9b1a893cffe9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lazy-loading 'flavor' on Instance uuid 05d9639a-f27a-499b-9ce8-d84427abf106 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:15.472784 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4b162711-4fcf-45f3-b774-9b1a893cffe9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106/action" status: 202 len: 0 microversion: 2.1 time: 0.292001 Oct 04 18:02:15.477032 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 191/388] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:15 2022] POST /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:15.483528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:15.484433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:15.498018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.498755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.499900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.500784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.501588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.502163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.630545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93bd0597-ec0d-427f-a26b-0ed9125b8b25 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:15.644041 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-93bd0597-ec0d-427f-a26b-0ed9125b8b25 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1321 microversion: 2.1 time: 0.397155 Oct 04 18:02:15.645181 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 198/389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:15 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:15.666515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:15.702788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:15.709062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:15.728802 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bcbab8cd-a84f-4888-a240-9f0b9749f427 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1447 microversion: 2.75 time: 0.252452 Oct 04 18:02:15.735789 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 192/390] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:15 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1447 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:15.762235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-8827f030-74cb-4d08-a416-b0b90899ad80 req-d56e9c49-249a-433f-8f71-812c2223b3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0d4381-3fce-4a7d-918e-755cd5123531", "name": "network-vif-plugged", "status": "completed", "tag": "17b6dffb-7626-47e5-838a-8ecf72593ec8"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:15.797875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8827f030-74cb-4d08-a416-b0b90899ad80 req-d56e9c49-249a-433f-8f71-812c2223b3d3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.798370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8827f030-74cb-4d08-a416-b0b90899ad80 req-d56e9c49-249a-433f-8f71-812c2223b3d3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.798813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8827f030-74cb-4d08-a416-b0b90899ad80 req-d56e9c49-249a-433f-8f71-812c2223b3d3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.830287 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-8827f030-74cb-4d08-a416-b0b90899ad80 req-d56e9c49-249a-433f-8f71-812c2223b3d3 service nova] Creating event network-vif-plugged:17b6dffb-7626-47e5-838a-8ecf72593ec8 for instance ea0d4381-3fce-4a7d-918e-755cd5123531 on n-h1-850499-14 Oct 04 18:02:15.845111 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-8827f030-74cb-4d08-a416-b0b90899ad80 req-d56e9c49-249a-433f-8f71-812c2223b3d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107912 Oct 04 18:02:15.849092 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 193/391] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:15.861702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb38cc5a-064b-4a98-83ef-b8bccafd3464 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:15.862424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb38cc5a-064b-4a98-83ef-b8bccafd3464 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:15.884003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb38cc5a-064b-4a98-83ef-b8bccafd3464 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.884760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb38cc5a-064b-4a98-83ef-b8bccafd3464 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.885359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb38cc5a-064b-4a98-83ef-b8bccafd3464 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.886238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb38cc5a-064b-4a98-83ef-b8bccafd3464 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:15.886878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb38cc5a-064b-4a98-83ef-b8bccafd3464 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:15.887489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb38cc5a-064b-4a98-83ef-b8bccafd3464 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.892257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:16.150201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb38cc5a-064b-4a98-83ef-b8bccafd3464 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:16.161619 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb38cc5a-064b-4a98-83ef-b8bccafd3464 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1476 microversion: 2.1 time: 0.311197 Oct 04 18:02:16.162205 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 194/392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:15 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1476 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:16.178977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-82794b4c-fc85-42b2-8d31-f681f25e2311 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:16.179606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-82794b4c-fc85-42b2-8d31-f681f25e2311 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:16.189574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82794b4c-fc85-42b2-8d31-f681f25e2311 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.190308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82794b4c-fc85-42b2-8d31-f681f25e2311 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.190906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82794b4c-fc85-42b2-8d31-f681f25e2311 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.191835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82794b4c-fc85-42b2-8d31-f681f25e2311 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.192449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82794b4c-fc85-42b2-8d31-f681f25e2311 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.195356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82794b4c-fc85-42b2-8d31-f681f25e2311 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.263991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-920b8134-4128-4265-b2ec-68b1740c8511 tempest-ServicesAdminNegativeV253TestJSON-929201084 tempest-ServicesAdminNegativeV253TestJSON-929201084-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:16.268479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-920b8134-4128-4265-b2ec-68b1740c8511 tempest-ServicesAdminNegativeV253TestJSON-929201084 tempest-ServicesAdminNegativeV253TestJSON-929201084-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '97c17f6aa6304f78b67193658c0eb583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc08c8a64574dbb8777a78e8ad0da9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-920b8134-4128-4265-b2ec-68b1740c8511 tempest-ServicesAdminNegativeV253TestJSON-929201084 tempest-ServicesAdminNegativeV253TestJSON-929201084-project] Request method failure captured: Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUk-hERkURnrdKfUG3hL7pzkTwUXZbycP85RI6RvYRmZNqGClp_yx19U1iU5C4Xw7fnqXbuJp2ZbafzHWqdDAAOgqLxp5lN_vcSc0gUm7kIjtp6YwaQ6jSbh7DuOOcOWCQ9vr7wDERbKQ6n_EznMWOEQJs_lhOH9DpSwUtLX57fSyI Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 0fc08c8a64574dbb8777a78e8ad0da9a Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-929201084 Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:16.270207 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0fc08c8a64574dbb8777a78e8ad0da9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0fc08c8a64574dbb8777a78e8ad0da9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fc08c8a64574dbb8777a78e8ad0da9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fc08c8a64574dbb8777a78e8ad0da9a"}]}] Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-929201084 Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 0fc08c8a64574dbb8777a78e8ad0da9a Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-929201084 Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServicesAdminNegativeV253TestJSON-929201084-project Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 97c17f6aa6304f78b67193658c0eb583 Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-929201084-project Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:02:16.271774 n-d-850499-14 devstack@n-api.service[122331]: action_args: {} Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:02:16.272452 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:02:16.273491 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:16.274616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-920b8134-4128-4265-b2ec-68b1740c8511 tempest-ServicesAdminNegativeV253TestJSON-929201084 tempest-ServicesAdminNegativeV253TestJSON-929201084-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:16.277265 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-920b8134-4128-4265-b2ec-68b1740c8511 tempest-ServicesAdminNegativeV253TestJSON-929201084 tempest-ServicesAdminNegativeV253TestJSON-929201084-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.630529 Oct 04 18:02:16.277863 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 199/393] 10.222.0.18 () {60 vars in 1178 bytes} [Tue Oct 4 18:02:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 632 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:16.310295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d1226da9-04b8-4782-a0f6-5471f2fb5871 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:16.310846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d1226da9-04b8-4782-a0f6-5471f2fb5871 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:16.331288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1226da9-04b8-4782-a0f6-5471f2fb5871 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.331794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1226da9-04b8-4782-a0f6-5471f2fb5871 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.332763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1226da9-04b8-4782-a0f6-5471f2fb5871 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.333477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1226da9-04b8-4782-a0f6-5471f2fb5871 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.333935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1226da9-04b8-4782-a0f6-5471f2fb5871 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.334365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1226da9-04b8-4782-a0f6-5471f2fb5871 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.393674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-82794b4c-fc85-42b2-8d31-f681f25e2311 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:16.405832 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-82794b4c-fc85-42b2-8d31-f681f25e2311 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1271 microversion: 2.1 time: 0.242452 Oct 04 18:02:16.406514 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 195/394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:16 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:16.670104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e1003d6-5259-44d5-ae7d-1eced6d25f90 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:16.670729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6e1003d6-5259-44d5-ae7d-1eced6d25f90 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:16.679896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e1003d6-5259-44d5-ae7d-1eced6d25f90 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.680402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e1003d6-5259-44d5-ae7d-1eced6d25f90 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.680844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e1003d6-5259-44d5-ae7d-1eced6d25f90 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.681562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e1003d6-5259-44d5-ae7d-1eced6d25f90 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.682185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e1003d6-5259-44d5-ae7d-1eced6d25f90 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.682617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e1003d6-5259-44d5-ae7d-1eced6d25f90 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.743356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d1226da9-04b8-4782-a0f6-5471f2fb5871 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:16.759894 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d1226da9-04b8-4782-a0f6-5471f2fb5871 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1311 microversion: 2.1 time: 0.470313 Oct 04 18:02:16.773780 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 200/395] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:16 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1311 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:16.779688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:16.794706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:16.818654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.821337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.824133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.826611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.827917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.829389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.955379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:16.975100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:16.976681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:17.009343 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2b0e69a9-ab8e-43bd-90b2-f85db254be79 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1453 microversion: 2.75 time: 0.233924 Oct 04 18:02:17.026778 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 201/396] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:16 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1453 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:17.161927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6e1003d6-5259-44d5-ae7d-1eced6d25f90 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:17.171729 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e1003d6-5259-44d5-ae7d-1eced6d25f90 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1321 microversion: 2.1 time: 0.505349 Oct 04 18:02:17.175023 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 196/397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:16 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:17.196176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-573b35b7-7fe0-4ab9-a029-b038a3a6fd9b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:17.197878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-573b35b7-7fe0-4ab9-a029-b038a3a6fd9b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:17.218460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-573b35b7-7fe0-4ab9-a029-b038a3a6fd9b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.219268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-573b35b7-7fe0-4ab9-a029-b038a3a6fd9b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.223285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-573b35b7-7fe0-4ab9-a029-b038a3a6fd9b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.224490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-573b35b7-7fe0-4ab9-a029-b038a3a6fd9b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.227527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-573b35b7-7fe0-4ab9-a029-b038a3a6fd9b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.230408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-573b35b7-7fe0-4ab9-a029-b038a3a6fd9b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.433933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9ef84cb9-1b4a-45e6-88d6-345173f37608 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:17.435108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9ef84cb9-1b4a-45e6-88d6-345173f37608 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:17.451691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ef84cb9-1b4a-45e6-88d6-345173f37608 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.453423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ef84cb9-1b4a-45e6-88d6-345173f37608 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.454581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ef84cb9-1b4a-45e6-88d6-345173f37608 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.456567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ef84cb9-1b4a-45e6-88d6-345173f37608 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.457350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ef84cb9-1b4a-45e6-88d6-345173f37608 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.458010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ef84cb9-1b4a-45e6-88d6-345173f37608 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.572220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-573b35b7-7fe0-4ab9-a029-b038a3a6fd9b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:17.585219 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-573b35b7-7fe0-4ab9-a029-b038a3a6fd9b tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1459 microversion: 2.1 time: 0.394141 Oct 04 18:02:17.600549 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 202/398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:17 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1459 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:17.611854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42c6dc31-1260-458d-9bb0-6d768595fdcc tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:17.612736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42c6dc31-1260-458d-9bb0-6d768595fdcc tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:17.623031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c6dc31-1260-458d-9bb0-6d768595fdcc tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.623885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c6dc31-1260-458d-9bb0-6d768595fdcc tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.624529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c6dc31-1260-458d-9bb0-6d768595fdcc tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.626492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c6dc31-1260-458d-9bb0-6d768595fdcc tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.627245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c6dc31-1260-458d-9bb0-6d768595fdcc tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.628028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c6dc31-1260-458d-9bb0-6d768595fdcc tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.675759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=7 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:17.725231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9ef84cb9-1b4a-45e6-88d6-345173f37608 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:17.745803 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9ef84cb9-1b4a-45e6-88d6-345173f37608 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1313 microversion: 2.1 time: 0.316978 Oct 04 18:02:17.746493 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 197/399] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:17 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:17.798478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b6b39643-2e99-4988-81a3-520913c1e0cb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:17.799447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b6b39643-2e99-4988-81a3-520913c1e0cb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:17.808512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b39643-2e99-4988-81a3-520913c1e0cb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.812747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b39643-2e99-4988-81a3-520913c1e0cb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.814119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b39643-2e99-4988-81a3-520913c1e0cb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.815112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b39643-2e99-4988-81a3-520913c1e0cb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:17.815747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b39643-2e99-4988-81a3-520913c1e0cb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:17.816388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b39643-2e99-4988-81a3-520913c1e0cb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.168902 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42c6dc31-1260-458d-9bb0-6d768595fdcc tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1612 microversion: 2.1 time: 0.562648 Oct 04 18:02:18.171565 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 203/400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:17 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1612 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:18.182947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6b39643-2e99-4988-81a3-520913c1e0cb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:18.198498 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b6b39643-2e99-4988-81a3-520913c1e0cb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1495 microversion: 2.1 time: 0.411944 Oct 04 18:02:18.200203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:18.201789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:18.211251 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 198/401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:17 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1495 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:18.227528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eba09a0a-d0a6-4562-b67c-fdefd5e1947a tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:18.231435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eba09a0a-d0a6-4562-b67c-fdefd5e1947a tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.231934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eba09a0a-d0a6-4562-b67c-fdefd5e1947a tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.232376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eba09a0a-d0a6-4562-b67c-fdefd5e1947a tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.233118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eba09a0a-d0a6-4562-b67c-fdefd5e1947a tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.234722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.235246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.235684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.236395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.236897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.237349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.242454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eba09a0a-d0a6-4562-b67c-fdefd5e1947a tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.243023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eba09a0a-d0a6-4562-b67c-fdefd5e1947a tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.305274 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eba09a0a-d0a6-4562-b67c-fdefd5e1947a tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.097217 Oct 04 18:02:18.313833 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 199/402] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 4 18:02:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:18.321158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc0fcbcb-ca42-49fe-b25d-c5abc1e6e88c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:18.323281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc0fcbcb-ca42-49fe-b25d-c5abc1e6e88c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:18.331959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0fcbcb-ca42-49fe-b25d-c5abc1e6e88c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.333412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0fcbcb-ca42-49fe-b25d-c5abc1e6e88c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.334144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0fcbcb-ca42-49fe-b25d-c5abc1e6e88c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.335444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0fcbcb-ca42-49fe-b25d-c5abc1e6e88c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.336018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0fcbcb-ca42-49fe-b25d-c5abc1e6e88c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.336866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0fcbcb-ca42-49fe-b25d-c5abc1e6e88c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.352551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:18.361783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:18.364652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:18.374198 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fe721a1d-d469-45ca-b60c-d2fc0f2ab28d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1453 microversion: 2.75 time: 0.196783 Oct 04 18:02:18.375404 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 204/403] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:18 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:18.676419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dc0fcbcb-ca42-49fe-b25d-c5abc1e6e88c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:18.704898 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc0fcbcb-ca42-49fe-b25d-c5abc1e6e88c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1321 microversion: 2.1 time: 0.388255 Oct 04 18:02:18.723494 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 200/404] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:18 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:18.730026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850499-14", "block_migration": true, "disk_over_commit": false}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:18.732869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:18.755045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.755795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.757264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.758186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.759158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.759908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.796916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Lazy-loading 'flavor' on Instance uuid 05d9639a-f27a-499b-9ce8-d84427abf106 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:18.814945 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 05d9639a-f27a-499b-9ce8-d84427abf106 while it is in vm_state suspended Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Request method failure captured: Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106/action HTTP/1.1 Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 98 Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTuYLl5ZkqvcULM0Zn4itcczALLyqXcpSTTyQrkQNmF1wshfIJ6c0V6Y3EsP3L7-Gv7dZ8dkJ4VJ8Hyu89GvpGBn6iayp2Nzx5412JZWYJNHOkQhWtBYgMYhix51K74lAb3UkmFQVzg0ZQzlKx6IdAnUceEWj6ZVIbExL0Llghj9d0 Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: aad3835b07104d8cb465cbed0f85c69b Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-LiveMigrationNegativeTest-1383445139 Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:02:18.817773 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aad3835b07104d8cb465cbed0f85c69b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aad3835b07104d8cb465cbed0f85c69b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aad3835b07104d8cb465cbed0f85c69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aad3835b07104d8cb465cbed0f85c69b"}]}] Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-LiveMigrationNegativeTest-1383445139 Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: aad3835b07104d8cb465cbed0f85c69b Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1383445139 Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-LiveMigrationNegativeTest-1383445139-project-admin Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: fed4b84294b246b28bd89a9b4f153b73 Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-LiveMigrationNegativeTest-1383445139-project-admin Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: {"os-migrateLive": {"host": "n-h2-850499-14", "block_migration": true, "disk_over_commit": false}} Oct 04 18:02:18.819233 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'os-migrateLive' instance 05d9639a-f27a-499b-9ce8-d84427abf106 while it is in vm_state suspended Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '05d9639a-f27a-499b-9ce8-d84427abf106', 'body': {'os-migrateLive': {'host': 'n-h2-850499-14', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:02:18.820110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05d9639a-f27a-499b-9ce8-d84427abf106 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:18.821320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 05d9639a-f27a-499b-9ce8-d84427abf106 while it is in vm_state suspended Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 05d9639a-f27a-499b-9ce8-d84427abf106 while it is in vm_state suspended Oct 04 18:02:18.822790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:18.823992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 05d9639a-f27a-499b-9ce8-d84427abf106 while it is in vm_state suspended {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:18.823992 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ca43441c-f216-43e7-a385-557dab3e2bd9 tempest-LiveMigrationNegativeTest-1383445139 tempest-LiveMigrationNegativeTest-1383445139-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106/action" status: 409 len: 155 microversion: 2.1 time: 0.094533 Oct 04 18:02:18.823992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 201/405] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:18 2022] POST /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106/action => generated 155 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:02:18.830601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7b4d8d0f-5f73-4523-a341-c70e23664239 req-92417c3c-5116-420c-b5e2-458e75d477da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa216bb-86aa-4a96-b668-db3f973d0308", "name": "network-vif-plugged", "status": "completed", "tag": "e54c97e3-e2ac-49bd-bcc9-d3f5a69e1d8c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:18.844088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7b4d8d0f-5f73-4523-a341-c70e23664239 req-92417c3c-5116-420c-b5e2-458e75d477da service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.844564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7b4d8d0f-5f73-4523-a341-c70e23664239 req-92417c3c-5116-420c-b5e2-458e75d477da service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.845180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7b4d8d0f-5f73-4523-a341-c70e23664239 req-92417c3c-5116-420c-b5e2-458e75d477da service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.869049 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7b4d8d0f-5f73-4523-a341-c70e23664239 req-92417c3c-5116-420c-b5e2-458e75d477da service nova] Creating event network-vif-plugged:e54c97e3-e2ac-49bd-bcc9-d3f5a69e1d8c for instance cfa216bb-86aa-4a96-b668-db3f973d0308 on n-h2-850499-14 Oct 04 18:02:18.880591 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7b4d8d0f-5f73-4523-a341-c70e23664239 req-92417c3c-5116-420c-b5e2-458e75d477da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058744 Oct 04 18:02:18.881441 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 202/406] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:18.889653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-90656e0b-8e98-409d-8a7d-9dc966e66a18 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:18.890579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-90656e0b-8e98-409d-8a7d-9dc966e66a18 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:18.899047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90656e0b-8e98-409d-8a7d-9dc966e66a18 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.899790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90656e0b-8e98-409d-8a7d-9dc966e66a18 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.900233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90656e0b-8e98-409d-8a7d-9dc966e66a18 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.901350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90656e0b-8e98-409d-8a7d-9dc966e66a18 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.902152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90656e0b-8e98-409d-8a7d-9dc966e66a18 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.903034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90656e0b-8e98-409d-8a7d-9dc966e66a18 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.084143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e25f098-e5b5-4115-92db-b76f06b0af06 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:19.084730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e25f098-e5b5-4115-92db-b76f06b0af06 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:19.096215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e25f098-e5b5-4115-92db-b76f06b0af06 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.101772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e25f098-e5b5-4115-92db-b76f06b0af06 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.102429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e25f098-e5b5-4115-92db-b76f06b0af06 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.103403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e25f098-e5b5-4115-92db-b76f06b0af06 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.104122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e25f098-e5b5-4115-92db-b76f06b0af06 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.105971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e25f098-e5b5-4115-92db-b76f06b0af06 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.108309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90656e0b-8e98-409d-8a7d-9dc966e66a18 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:19.120658 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-90656e0b-8e98-409d-8a7d-9dc966e66a18 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1313 microversion: 2.1 time: 0.237800 Oct 04 18:02:19.139461 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 203/407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:18 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:19.148284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1dbb6b8-977f-4829-9381-6a74d6707ab8 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:19.150255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1dbb6b8-977f-4829-9381-6a74d6707ab8 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:19.157817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1dbb6b8-977f-4829-9381-6a74d6707ab8 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.158729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1dbb6b8-977f-4829-9381-6a74d6707ab8 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.159367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1dbb6b8-977f-4829-9381-6a74d6707ab8 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.160236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1dbb6b8-977f-4829-9381-6a74d6707ab8 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.161416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1dbb6b8-977f-4829-9381-6a74d6707ab8 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.162146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1dbb6b8-977f-4829-9381-6a74d6707ab8 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.193622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1dbb6b8-977f-4829-9381-6a74d6707ab8 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:02:19.308394 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e25f098-e5b5-4115-92db-b76f06b0af06 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1648 microversion: 2.1 time: 0.931749 Oct 04 18:02:19.324137 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 205/408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:18 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1648 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:19.340950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d3369e13-2ac4-4486-b6fc-df6bb2920f86 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:19.344714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d3369e13-2ac4-4486-b6fc-df6bb2920f86 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:19.356654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3369e13-2ac4-4486-b6fc-df6bb2920f86 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.358534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3369e13-2ac4-4486-b6fc-df6bb2920f86 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.361165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3369e13-2ac4-4486-b6fc-df6bb2920f86 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.362096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3369e13-2ac4-4486-b6fc-df6bb2920f86 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.362720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3369e13-2ac4-4486-b6fc-df6bb2920f86 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.364060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3369e13-2ac4-4486-b6fc-df6bb2920f86 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.441267 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1dbb6b8-977f-4829-9381-6a74d6707ab8 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "DELETE /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 204 len: 0 microversion: 2.1 time: 0.292422 Oct 04 18:02:19.443887 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 204/409] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:02:19 2022] DELETE /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:02:19.460620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:19.463658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:19.471012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.472126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.473438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.474397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.475523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.476195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.709697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:19.718369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:19.719875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:19.738709 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a49232a-c305-4dd7-996e-2d82ff3f5e9b tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1453 microversion: 2.75 time: 0.291047 Oct 04 18:02:19.739834 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 205/410] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:19 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1453 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:19.746384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-88c51224-190b-445f-9296-322f418f0c4c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:19.748309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-88c51224-190b-445f-9296-322f418f0c4c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:19.759543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c51224-190b-445f-9296-322f418f0c4c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.760042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c51224-190b-445f-9296-322f418f0c4c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.760631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c51224-190b-445f-9296-322f418f0c4c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.761197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c51224-190b-445f-9296-322f418f0c4c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.761662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c51224-190b-445f-9296-322f418f0c4c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.762884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c51224-190b-445f-9296-322f418f0c4c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.891849 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d3369e13-2ac4-4486-b6fc-df6bb2920f86 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1648 microversion: 2.1 time: 0.561912 Oct 04 18:02:19.894013 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 206/411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:19 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1648 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:19.921994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-bc2d2c33-9e45-41b1-9077-5185f5efdf03 req-61bed7cf-6894-4491-bc07-04b338f74996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4b0323-60bc-47aa-8c5e-142573d6c375", "tag": "c0d7f40e-b90b-492b-bffc-13171692063a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:19.948913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bc2d2c33-9e45-41b1-9077-5185f5efdf03 req-61bed7cf-6894-4491-bc07-04b338f74996 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.949411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bc2d2c33-9e45-41b1-9077-5185f5efdf03 req-61bed7cf-6894-4491-bc07-04b338f74996 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.949852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bc2d2c33-9e45-41b1-9077-5185f5efdf03 req-61bed7cf-6894-4491-bc07-04b338f74996 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.976771 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-bc2d2c33-9e45-41b1-9077-5185f5efdf03 req-61bed7cf-6894-4491-bc07-04b338f74996 service nova] Creating event network-changed:c0d7f40e-b90b-492b-bffc-13171692063a for instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 on n-h1-850499-14 Oct 04 18:02:19.982751 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-bc2d2c33-9e45-41b1-9077-5185f5efdf03 req-61bed7cf-6894-4491-bc07-04b338f74996 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086775 Oct 04 18:02:19.983904 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 207/412] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:19.991789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f9185454-e711-4af7-9e82-6c6b2a1498fb tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:19.992689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f9185454-e711-4af7-9e82-6c6b2a1498fb tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:20.000340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9185454-e711-4af7-9e82-6c6b2a1498fb tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.001241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9185454-e711-4af7-9e82-6c6b2a1498fb tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.001772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9185454-e711-4af7-9e82-6c6b2a1498fb tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.002719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9185454-e711-4af7-9e82-6c6b2a1498fb tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.003428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9185454-e711-4af7-9e82-6c6b2a1498fb tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.004075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9185454-e711-4af7-9e82-6c6b2a1498fb tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.070272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-88c51224-190b-445f-9296-322f418f0c4c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:20.081966 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-88c51224-190b-445f-9296-322f418f0c4c tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1465 microversion: 2.1 time: 0.341075 Oct 04 18:02:20.083491 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 206/413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:19 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1465 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:20.090764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80ae5567-8839-49f2-85dc-6bfc04c532b9 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:20.095680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ae5567-8839-49f2-85dc-6bfc04c532b9 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.096364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ae5567-8839-49f2-85dc-6bfc04c532b9 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.097491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ae5567-8839-49f2-85dc-6bfc04c532b9 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.098509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ae5567-8839-49f2-85dc-6bfc04c532b9 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.099409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ae5567-8839-49f2-85dc-6bfc04c532b9 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.100297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ae5567-8839-49f2-85dc-6bfc04c532b9 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.130498 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80ae5567-8839-49f2-85dc-6bfc04c532b9 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.044057 Oct 04 18:02:20.147192 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 207/414] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 4 18:02:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:20.150683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-50295565-f49f-41ee-ae98-055c7a5caa45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:20.152963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-50295565-f49f-41ee-ae98-055c7a5caa45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:20.159952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50295565-f49f-41ee-ae98-055c7a5caa45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.161365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50295565-f49f-41ee-ae98-055c7a5caa45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.162036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50295565-f49f-41ee-ae98-055c7a5caa45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.162988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50295565-f49f-41ee-ae98-055c7a5caa45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.163683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50295565-f49f-41ee-ae98-055c7a5caa45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.164324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50295565-f49f-41ee-ae98-055c7a5caa45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.278531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f9185454-e711-4af7-9e82-6c6b2a1498fb tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:20.288990 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f9185454-e711-4af7-9e82-6c6b2a1498fb tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1321 microversion: 2.1 time: 0.303351 Oct 04 18:02:20.289588 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 208/415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:19 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:20.294449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850499-14", "block_migration": true, "disk_over_commit": false}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:20.297327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:20.303937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.304541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.304982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.305684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.306161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.306582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.358316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:20.374007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-50295565-f49f-41ee-ae98-055c7a5caa45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:20.384447 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-50295565-f49f-41ee-ae98-055c7a5caa45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1313 microversion: 2.1 time: 0.243240 Oct 04 18:02:20.384953 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 208/416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:20 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:20.553574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Calling method '.version_select at 0x7fd4d2630310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:20.555421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.555917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.556762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.582385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.583255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.584419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.597921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.598422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.598866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.605233 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-969297cf-4a58-41f7-9947-54d987f7e356 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.219291 Oct 04 18:02:20.605808 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 209/417] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 4 18:02:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:02:20.612718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lazy-loading 'flavor' on Instance uuid ea0d4381-3fce-4a7d-918e-755cd5123531 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:20.619243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04814002-f2c6-497e-8396-dd412ae49051 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Calling method '.version_select at 0x7fd4d26308b0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:20.621251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04814002-f2c6-497e-8396-dd412ae49051 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.621740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04814002-f2c6-497e-8396-dd412ae49051 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.622394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04814002-f2c6-497e-8396-dd412ae49051 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.641955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04814002-f2c6-497e-8396-dd412ae49051 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.642748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04814002-f2c6-497e-8396-dd412ae49051 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.643585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04814002-f2c6-497e-8396-dd412ae49051 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.652338 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-04814002-f2c6-497e-8396-dd412ae49051 tempest-HypervisorAdminV228Test-1918435250 tempest-HypervisorAdminV228Test-1918435250-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.036854 Oct 04 18:02:20.653585 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 210/418] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 4 18:02:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:02:20.703715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Going to try to live migrate instance to n-h2-850499-14 {{(pid=122331) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:02:20.770947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:20.771709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:20.778741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.779261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.779701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.780804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.782807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.784983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.831006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:20.963415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:20.976811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:20.977405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:20.984836 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-401e7ccf-192d-4cf8-bbf3-07d02f4c9556 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1453 microversion: 2.75 time: 0.222308 Oct 04 18:02:21.011622 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 211/419] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:20 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1453 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:21.108085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c32b74b0-a20b-4959-9284-7945db373510 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:21.108317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c32b74b0-a20b-4959-9284-7945db373510 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:21.123037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32b74b0-a20b-4959-9284-7945db373510 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.128962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32b74b0-a20b-4959-9284-7945db373510 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.130058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32b74b0-a20b-4959-9284-7945db373510 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.133509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32b74b0-a20b-4959-9284-7945db373510 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.134024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32b74b0-a20b-4959-9284-7945db373510 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.136051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32b74b0-a20b-4959-9284-7945db373510 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.281927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=16 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:21.471313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c32b74b0-a20b-4959-9284-7945db373510 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:21.480989 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c32b74b0-a20b-4959-9284-7945db373510 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1465 microversion: 2.1 time: 0.378848 Oct 04 18:02:21.495960 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 212/420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:21 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1465 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:21.513120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4e0c1fb1-331b-4a65-bd7a-ce9618b2724b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:21.517147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4e0c1fb1-331b-4a65-bd7a-ce9618b2724b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:21.533258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e0c1fb1-331b-4a65-bd7a-ce9618b2724b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.539575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e0c1fb1-331b-4a65-bd7a-ce9618b2724b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.540675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e0c1fb1-331b-4a65-bd7a-ce9618b2724b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.542137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e0c1fb1-331b-4a65-bd7a-ce9618b2724b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.543178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e0c1fb1-331b-4a65-bd7a-ce9618b2724b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.544139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e0c1fb1-331b-4a65-bd7a-ce9618b2724b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.777370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=18 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:21.902562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4e0c1fb1-331b-4a65-bd7a-ce9618b2724b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:21.911682 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4e0c1fb1-331b-4a65-bd7a-ce9618b2724b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1321 microversion: 2.1 time: 0.414308 Oct 04 18:02:21.913850 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 213/421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:21 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:21.936463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-54e24939-27ed-49f2-8f12-ff8de9aaf02f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:21.937333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-54e24939-27ed-49f2-8f12-ff8de9aaf02f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:21.965901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54e24939-27ed-49f2-8f12-ff8de9aaf02f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.966420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54e24939-27ed-49f2-8f12-ff8de9aaf02f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.966859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54e24939-27ed-49f2-8f12-ff8de9aaf02f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.967607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54e24939-27ed-49f2-8f12-ff8de9aaf02f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.968082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54e24939-27ed-49f2-8f12-ff8de9aaf02f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.968498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54e24939-27ed-49f2-8f12-ff8de9aaf02f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:22.498934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-54e24939-27ed-49f2-8f12-ff8de9aaf02f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:22.510124 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-54e24939-27ed-49f2-8f12-ff8de9aaf02f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1313 microversion: 2.1 time: 0.594979 Oct 04 18:02:22.510721 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 214/422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:21 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:22.522711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:22.524541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:22.572528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:22.573243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:22.573864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:22.574876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:22.575640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:22.576278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:22.755205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:22.764201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:22.766529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:22.783657 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6bd242c7-d407-42ea-bcea-db5f5d153e33 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1438 microversion: 2.75 time: 0.271643 Oct 04 18:02:22.788135 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 215/423] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:22 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1438 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:23.286918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-77f5ca3f-8ce2-47c3-8cc0-8f2e092331a5 tempest-AbsoluteLimitsTestJSON-758351340 tempest-AbsoluteLimitsTestJSON-758351340-project] Calling method '.version_select at 0x7fd4d24be4c0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:23.306437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f5ca3f-8ce2-47c3-8cc0-8f2e092331a5 tempest-AbsoluteLimitsTestJSON-758351340 tempest-AbsoluteLimitsTestJSON-758351340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:23.307504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f5ca3f-8ce2-47c3-8cc0-8f2e092331a5 tempest-AbsoluteLimitsTestJSON-758351340 tempest-AbsoluteLimitsTestJSON-758351340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:23.307949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f5ca3f-8ce2-47c3-8cc0-8f2e092331a5 tempest-AbsoluteLimitsTestJSON-758351340 tempest-AbsoluteLimitsTestJSON-758351340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:23.311893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f5ca3f-8ce2-47c3-8cc0-8f2e092331a5 tempest-AbsoluteLimitsTestJSON-758351340 tempest-AbsoluteLimitsTestJSON-758351340-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:23.312395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f5ca3f-8ce2-47c3-8cc0-8f2e092331a5 tempest-AbsoluteLimitsTestJSON-758351340 tempest-AbsoluteLimitsTestJSON-758351340-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:23.313995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f5ca3f-8ce2-47c3-8cc0-8f2e092331a5 tempest-AbsoluteLimitsTestJSON-758351340 tempest-AbsoluteLimitsTestJSON-758351340-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:23.371568 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-77f5ca3f-8ce2-47c3-8cc0-8f2e092331a5 tempest-AbsoluteLimitsTestJSON-758351340 tempest-AbsoluteLimitsTestJSON-758351340-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.578257 Oct 04 18:02:23.383005 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 216/424] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 4 18:02:22 2022] GET /compute/v2.1/limits => generated 511 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:23.384225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:23.384225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:23.403392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:23.403896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:23.409852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:23.410714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:23.411211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:23.411655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:23.482137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:23.482628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:23.483128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:23.487333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lazy-loading 'fault' on Instance uuid 05d9639a-f27a-499b-9ce8-d84427abf106 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:23.587385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:23.595087 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7bd51336-94dc-4947-8d62-8cc8839ffd59 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 200 len: 1309 microversion: 2.1 time: 0.221071 Oct 04 18:02:23.595664 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 217/425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:23 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 1309 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:23.605900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d85e8d8a-52d4-46f7-8ae6-d930e81c3d65 req-2f4cc833-b96e-42cc-80f5-db8718083ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d9639a-f27a-499b-9ce8-d84427abf106", "name": "network-vif-deleted", "tag": "6bfeaeb7-8851-4adf-823e-b3978471323b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:23.645958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d85e8d8a-52d4-46f7-8ae6-d930e81c3d65 req-2f4cc833-b96e-42cc-80f5-db8718083ea3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:23.647936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d85e8d8a-52d4-46f7-8ae6-d930e81c3d65 req-2f4cc833-b96e-42cc-80f5-db8718083ea3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:23.650243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d85e8d8a-52d4-46f7-8ae6-d930e81c3d65 req-2f4cc833-b96e-42cc-80f5-db8718083ea3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:23.677935 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d85e8d8a-52d4-46f7-8ae6-d930e81c3d65 req-2f4cc833-b96e-42cc-80f5-db8718083ea3 service nova] Creating event network-vif-deleted:6bfeaeb7-8851-4adf-823e-b3978471323b for instance 05d9639a-f27a-499b-9ce8-d84427abf106 on n-h1-850499-14 Oct 04 18:02:23.688841 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d85e8d8a-52d4-46f7-8ae6-d930e81c3d65 req-2f4cc833-b96e-42cc-80f5-db8718083ea3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088130 Oct 04 18:02:23.692774 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 218/426] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:24.209928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:24.219985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:24.250206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.250710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.251174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:24.251955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.252412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.252844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:24.424114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:24.424606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:24.425137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:24.425554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:24.426831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:24.511288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:24.524048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.525876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.530243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:24.533217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.534991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.537029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:24.864857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:24.939035 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-73a635e4-0e11-4eb8-9d79-4cf78b92866b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531/action" status: 202 len: 0 microversion: 2.1 time: 4.648273 Oct 04 18:02:24.944391 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 209/427] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:20 2022] POST /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531/action => generated 0 bytes in 4654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:24.950224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-889fe372-c522-41e0-b66b-24a49dc76633 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:24.950943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-889fe372-c522-41e0-b66b-24a49dc76633 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:24.976812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-889fe372-c522-41e0-b66b-24a49dc76633 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.977818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-889fe372-c522-41e0-b66b-24a49dc76633 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.980032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-889fe372-c522-41e0-b66b-24a49dc76633 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:24.980958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-889fe372-c522-41e0-b66b-24a49dc76633 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.982407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-889fe372-c522-41e0-b66b-24a49dc76633 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.983662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-889fe372-c522-41e0-b66b-24a49dc76633 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.069391 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8731f041-cb7f-48a4-a37b-fa499d5f4fff tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13/action" status: 202 len: 1944 microversion: 2.75 time: 1.371988 Oct 04 18:02:25.071281 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 219/428] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:02:23 2022] POST /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13/action => generated 1944 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:02:25.083100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c22defb3-5993-4441-906a-6a13b7d8c777 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:25.083740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c22defb3-5993-4441-906a-6a13b7d8c777 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:25.091037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c22defb3-5993-4441-906a-6a13b7d8c777 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.092028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c22defb3-5993-4441-906a-6a13b7d8c777 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.092841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c22defb3-5993-4441-906a-6a13b7d8c777 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.093805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c22defb3-5993-4441-906a-6a13b7d8c777 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.094558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c22defb3-5993-4441-906a-6a13b7d8c777 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.095098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c22defb3-5993-4441-906a-6a13b7d8c777 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.190404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=24 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:25.550534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c22defb3-5993-4441-906a-6a13b7d8c777 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:25.563518 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c22defb3-5993-4441-906a-6a13b7d8c777 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1313 microversion: 2.1 time: 0.490271 Oct 04 18:02:25.564641 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 220/429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:25 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:25.572693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:25.573626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 05d9639a-f27a-499b-9ce8-d84427abf106] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:25.586480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-889fe372-c522-41e0-b66b-24a49dc76633 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:25.595350 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-889fe372-c522-41e0-b66b-24a49dc76633 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1470 microversion: 2.1 time: 0.649522 Oct 04 18:02:25.595944 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 210/430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:24 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1470 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:25.611327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f6fca1f-044b-4879-818d-98c1d0fe133d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:25.611952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f6fca1f-044b-4879-818d-98c1d0fe133d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:25.620730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.620730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.620730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.621295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.621938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.622549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.631466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f6fca1f-044b-4879-818d-98c1d0fe133d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.632236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f6fca1f-044b-4879-818d-98c1d0fe133d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.634802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f6fca1f-044b-4879-818d-98c1d0fe133d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.636001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f6fca1f-044b-4879-818d-98c1d0fe133d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.648035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f6fca1f-044b-4879-818d-98c1d0fe133d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.650798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f6fca1f-044b-4879-818d-98c1d0fe133d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.668312 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] HTTP exception thrown: Instance 05d9639a-f27a-499b-9ce8-d84427abf106 could not be found. Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Request method failure captured: Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 HTTP/1.1 Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTrr-4jocxBslukSgYECUSmgMW8Mtv4GTgQ-0TiK1UBrX6zhwe9BtdGZc1DJ5CjxQmy2B-iASXNRTa1k699rvj40ocsCQYO0lz6sU3KPFZG-VY2KON6YhClfE0n90x2spuccZCgQ7TTQbMMCAu-obIzerwQmZQo9Z_cPr-sZdsErFI Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: d6615b8b1c0f43d7a2cee777f8ab891a Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-LiveMigrationNegativeTest-1498319361 Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:02:25.671264 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d6615b8b1c0f43d7a2cee777f8ab891a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d6615b8b1c0f43d7a2cee777f8ab891a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d6615b8b1c0f43d7a2cee777f8ab891a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d6615b8b1c0f43d7a2cee777f8ab891a"}]}] Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-LiveMigrationNegativeTest-1498319361 Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: d6615b8b1c0f43d7a2cee777f8ab891a Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1498319361 Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-LiveMigrationNegativeTest-1498319361-project Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 8dedbf6bf8d745c8a7a3706086365ee1 Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-LiveMigrationNegativeTest-1498319361-project Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 05d9639a-f27a-499b-9ce8-d84427abf106 could not be found. Oct 04 18:02:25.672706 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '05d9639a-f27a-499b-9ce8-d84427abf106'} Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d9639a-f27a-499b-9ce8-d84427abf106 could not be found. Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:25.673736 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d9639a-f27a-499b-9ce8-d84427abf106 could not be found. Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d9639a-f27a-499b-9ce8-d84427abf106 could not be found. Oct 04 18:02:25.674941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:25.676096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Returning 404 to user: Instance 05d9639a-f27a-499b-9ce8-d84427abf106 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:25.676096 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f37a4546-0b2c-4afa-b378-0059654065f0 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106" status: 404 len: 111 microversion: 2.1 time: 0.106846 Oct 04 18:02:25.676096 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 221/431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:25 2022] GET /compute/v2.1/servers/05d9639a-f27a-499b-9ce8-d84427abf106 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:25.697894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fd887ea2-d55f-4b54-bf90-b343a3a0f20d tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:25.701714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fd887ea2-d55f-4b54-bf90-b343a3a0f20d tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:25.719739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd887ea2-d55f-4b54-bf90-b343a3a0f20d tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.720950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd887ea2-d55f-4b54-bf90-b343a3a0f20d tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.721404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd887ea2-d55f-4b54-bf90-b343a3a0f20d tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.724404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd887ea2-d55f-4b54-bf90-b343a3a0f20d tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.725596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd887ea2-d55f-4b54-bf90-b343a3a0f20d tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.726049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd887ea2-d55f-4b54-bf90-b343a3a0f20d tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.899785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-fd887ea2-d55f-4b54-bf90-b343a3a0f20d tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:25.913709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f6fca1f-044b-4879-818d-98c1d0fe133d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:25.926819 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f6fca1f-044b-4879-818d-98c1d0fe133d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1505 microversion: 2.1 time: 0.328985 Oct 04 18:02:25.928409 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 211/432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:25 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:25.951160 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fd887ea2-d55f-4b54-bf90-b343a3a0f20d tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.275891 Oct 04 18:02:25.956030 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 222/433] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:25 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:25.967366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-073bda9f-c64f-4cfc-99ff-d2daf1b8c0eb tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:25.967868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-073bda9f-c64f-4cfc-99ff-d2daf1b8c0eb tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:25.981253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:25.982942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-073bda9f-c64f-4cfc-99ff-d2daf1b8c0eb tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.983572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-073bda9f-c64f-4cfc-99ff-d2daf1b8c0eb tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.984290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-073bda9f-c64f-4cfc-99ff-d2daf1b8c0eb tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.985035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-073bda9f-c64f-4cfc-99ff-d2daf1b8c0eb tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.985846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-073bda9f-c64f-4cfc-99ff-d2daf1b8c0eb tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.986384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-073bda9f-c64f-4cfc-99ff-d2daf1b8c0eb tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:26.023117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-073bda9f-c64f-4cfc-99ff-d2daf1b8c0eb tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:02:26.168329 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-073bda9f-c64f-4cfc-99ff-d2daf1b8c0eb tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 204 len: 0 microversion: 2.1 time: 0.208205 Oct 04 18:02:26.171793 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 223/434] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:02:25 2022] DELETE /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:02:26.185395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0525afda-9fde-4993-9ee7-7b39a52516e4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:26.186515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0525afda-9fde-4993-9ee7-7b39a52516e4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:26.196546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0525afda-9fde-4993-9ee7-7b39a52516e4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:26.197149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0525afda-9fde-4993-9ee7-7b39a52516e4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:26.197685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0525afda-9fde-4993-9ee7-7b39a52516e4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:26.198653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0525afda-9fde-4993-9ee7-7b39a52516e4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:26.199379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0525afda-9fde-4993-9ee7-7b39a52516e4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:26.203799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0525afda-9fde-4993-9ee7-7b39a52516e4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:26.565102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-603430b8-eea9-4740-9e78-1716c6b06623 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:26.565955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-603430b8-eea9-4740-9e78-1716c6b06623 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] [instance: ecd9d268-1397-44f3-85e4-b744e5a7f2c3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:26.568261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0525afda-9fde-4993-9ee7-7b39a52516e4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:26.575114 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-603430b8-eea9-4740-9e78-1716c6b06623 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] HTTP exception thrown: Instance ecd9d268-1397-44f3-85e4-b744e5a7f2c3 could not be found. Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-603430b8-eea9-4740-9e78-1716c6b06623 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Request method failure captured: Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/ecd9d268-1397-44f3-85e4-b744e5a7f2c3/action HTTP/1.1 Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 15 Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUbO3zEGEf3vLeo_0O9zoWw-E7PsKqViKO9tXWGgjwDmYlDhMWd5CkE_55VE-Z3gO3nGBLf89M3wReKMNuUZBIh8c33ucfp_y0XjVtqRZ56FbrRsbKvhk3PzuV2OpKajzdf_ddgo_p8uL1-UKQAbrCMnnMpcaJo7lgEqh0NTx1uLvE Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5ffd3c23e7394152a7f53709b3c01e14 Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:02:26.582081 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ffd3c23e7394152a7f53709b3c01e14"}]}] Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5ffd3c23e7394152a7f53709b3c01e14 Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersAdminNegativeTestJSON-455994400-project-admin Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 8489fb7e58214f4289ae745f6c9e12cc Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersAdminNegativeTestJSON-455994400-project-admin Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: {"migrate": {}} Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:26.583950 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance ecd9d268-1397-44f3-85e4-b744e5a7f2c3 could not be found. Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'ecd9d268-1397-44f3-85e4-b744e5a7f2c3', 'body': {'migrate': {}}} Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd9d268-1397-44f3-85e4-b744e5a7f2c3 could not be found. Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:26.584815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd9d268-1397-44f3-85e4-b744e5a7f2c3 could not be found. Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd9d268-1397-44f3-85e4-b744e5a7f2c3 could not be found. Oct 04 18:02:26.586639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:26.587674 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0525afda-9fde-4993-9ee7-7b39a52516e4 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1474 microversion: 2.1 time: 0.406384 Oct 04 18:02:26.589333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-603430b8-eea9-4740-9e78-1716c6b06623 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Returning 404 to user: Instance ecd9d268-1397-44f3-85e4-b744e5a7f2c3 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:26.590581 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-603430b8-eea9-4740-9e78-1716c6b06623 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/ecd9d268-1397-44f3-85e4-b744e5a7f2c3/action" status: 404 len: 111 microversion: 2.1 time: 0.660530 Oct 04 18:02:26.591680 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 212/435] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:25 2022] POST /compute/v2.1/servers/ecd9d268-1397-44f3-85e4-b744e5a7f2c3/action => generated 111 bytes in 662 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:26.597761 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 224/436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:26 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1474 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:26.604514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17c66732-ed32-4e60-8f5f-ca3f67fd9638 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:26.605150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17c66732-ed32-4e60-8f5f-ca3f67fd9638 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:26.633250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17c66732-ed32-4e60-8f5f-ca3f67fd9638 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:26.634498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17c66732-ed32-4e60-8f5f-ca3f67fd9638 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:26.635612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17c66732-ed32-4e60-8f5f-ca3f67fd9638 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:26.636850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17c66732-ed32-4e60-8f5f-ca3f67fd9638 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:26.637327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17c66732-ed32-4e60-8f5f-ca3f67fd9638 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:26.637773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17c66732-ed32-4e60-8f5f-ca3f67fd9638 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:26.880541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1741039971", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:26.898264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17c66732-ed32-4e60-8f5f-ca3f67fd9638 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:26.909589 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17c66732-ed32-4e60-8f5f-ca3f67fd9638 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1313 microversion: 2.1 time: 0.314811 Oct 04 18:02:26.927784 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 213/437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:26 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:26.969278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5eef7378-86d9-4b21-9e5d-80dc49914aee tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:26.970722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5eef7378-86d9-4b21-9e5d-80dc49914aee tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:27.002286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eef7378-86d9-4b21-9e5d-80dc49914aee tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.007776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eef7378-86d9-4b21-9e5d-80dc49914aee tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.008947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eef7378-86d9-4b21-9e5d-80dc49914aee tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.010123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eef7378-86d9-4b21-9e5d-80dc49914aee tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.015195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eef7378-86d9-4b21-9e5d-80dc49914aee tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.015913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eef7378-86d9-4b21-9e5d-80dc49914aee tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.032018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:02:27.725869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:27.726575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:27.727854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:27.728565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:27.729290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:27.756582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5eef7378-86d9-4b21-9e5d-80dc49914aee tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:27.762157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.763357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.769074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.771680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.772862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.775535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.791662 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5eef7378-86d9-4b21-9e5d-80dc49914aee tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1505 microversion: 2.1 time: 0.836666 Oct 04 18:02:27.802500 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 214/438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:26 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1505 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:27.819277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc5610df-bdb5-4e50-8a0f-bbae07489856 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:27.821757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc5610df-bdb5-4e50-8a0f-bbae07489856 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:27.832507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:27.846424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5610df-bdb5-4e50-8a0f-bbae07489856 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.847147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5610df-bdb5-4e50-8a0f-bbae07489856 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.847617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5610df-bdb5-4e50-8a0f-bbae07489856 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.848916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5610df-bdb5-4e50-8a0f-bbae07489856 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.850810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5610df-bdb5-4e50-8a0f-bbae07489856 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.851867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5610df-bdb5-4e50-8a0f-bbae07489856 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.867382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Getting quotas for project 6e60a416d16a409f9ad18fb144bb388a. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:27.876105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Getting quotas for user 6c0e7f7155a5438f927987d48736c31d and project 6e60a416d16a409f9ad18fb144bb388a. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:27.916513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:27.922799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:28.033340 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f020472f-deee-4d0e-ae66-d1336c80a2af tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.157264 Oct 04 18:02:28.036110 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 225/439] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:02:28.466978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-bc5610df-bdb5-4e50-8a0f-bbae07489856 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:28.605229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-58510450-6218-4765-b8e9-a08f903e3143 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Action: 'create', calling method: .version_select at 0x7fd4d28623a0>, body: {"keypair": {"name": "tempest-keypair-149235583", "type": "ssh", "user_id": "c07d160590a54e378d7c12abfbcaa170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyRA7iyx61sb6HlQ0lHSsynLfPUoVr+/Q+KQq+wmRXotvG2oIIAgUblgOdjL97oRJZlBC648mZ2AHYJwjo9pp8iSXup/TtAJrZ2ZjRaD8ZOryRGAxLrVaOdcFhNTrJByg=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:28.672553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-58510450-6218-4765-b8e9-a08f903e3143 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Getting quotas for project b44e58e2108b435cac8c6d74046d7cc7. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:28.683172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-58510450-6218-4765-b8e9-a08f903e3143 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Getting quotas for user 2bb2254827c24fd1b4206fa3f43101da and project b44e58e2108b435cac8c6d74046d7cc7. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:28.692582 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc5610df-bdb5-4e50-8a0f-bbae07489856 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.886536 Oct 04 18:02:28.693927 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 215/440] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:27 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:28.743964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6dd7f276-d49b-4487-96cf-4ce5a49698e2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:28.748541 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-58510450-6218-4765-b8e9-a08f903e3143 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.710223 Oct 04 18:02:28.759943 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 226/441] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 4 18:02:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 714 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:02:28.769205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6dd7f276-d49b-4487-96cf-4ce5a49698e2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:28.779060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a49d9b5a-7847-4589-9cbf-34e85eaf488d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:28.785862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd7f276-d49b-4487-96cf-4ce5a49698e2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:28.786642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a49d9b5a-7847-4589-9cbf-34e85eaf488d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:28.787259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd7f276-d49b-4487-96cf-4ce5a49698e2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:28.788269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd7f276-d49b-4487-96cf-4ce5a49698e2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:28.789755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd7f276-d49b-4487-96cf-4ce5a49698e2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:28.790763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd7f276-d49b-4487-96cf-4ce5a49698e2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:28.791765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd7f276-d49b-4487-96cf-4ce5a49698e2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:28.806789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a49d9b5a-7847-4589-9cbf-34e85eaf488d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:28.807335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a49d9b5a-7847-4589-9cbf-34e85eaf488d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:28.807785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a49d9b5a-7847-4589-9cbf-34e85eaf488d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:28.808505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a49d9b5a-7847-4589-9cbf-34e85eaf488d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:28.808965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a49d9b5a-7847-4589-9cbf-34e85eaf488d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:28.809398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a49d9b5a-7847-4589-9cbf-34e85eaf488d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:29.995951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a49d9b5a-7847-4589-9cbf-34e85eaf488d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:30.002324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6dd7f276-d49b-4487-96cf-4ce5a49698e2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dedbf6bf8d745c8a7a3706086365ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6615b8b1c0f43d7a2cee777f8ab891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:30.020375 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6dd7f276-d49b-4487-96cf-4ce5a49698e2 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 200 len: 1474 microversion: 2.1 time: 1.303957 Oct 04 18:02:30.021261 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 216/442] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:28 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 1474 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:30.029237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2660d2b1-a912-40b0-8dc9-6941ad7d1f36 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:30.031030 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a49d9b5a-7847-4589-9cbf-34e85eaf488d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1313 microversion: 2.1 time: 1.261504 Oct 04 18:02:30.035194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2660d2b1-a912-40b0-8dc9-6941ad7d1f36 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:30.047537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2660d2b1-a912-40b0-8dc9-6941ad7d1f36 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.050010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2660d2b1-a912-40b0-8dc9-6941ad7d1f36 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.051069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2660d2b1-a912-40b0-8dc9-6941ad7d1f36 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.053726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2660d2b1-a912-40b0-8dc9-6941ad7d1f36 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.054348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2660d2b1-a912-40b0-8dc9-6941ad7d1f36 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.057598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2660d2b1-a912-40b0-8dc9-6941ad7d1f36 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.068551 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 227/443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:28 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1313 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:30.103352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef4f9bf9-bf79-4f1f-80f0-aae56313b2e4 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Action: 'create', calling method: .version_select at 0x7fd4d2538790>, body: {"keypair": {"name": "tempest-keypair-475032023", "type": "ssh", "user_id": "c07d160590a54e378d7c12abfbcaa170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVU7G8N7hbfcSwRWT0gklhqExE/Ce9qkScJybA690lFKgysxk7c8cyZ7b06fYANsH58ooss+j+V9yT1LDp+wAGD7TXWWzZJ6r8eKi4rHdK9l/pvtjna/KLArwtt3x81TA=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:30.171476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ef4f9bf9-bf79-4f1f-80f0-aae56313b2e4 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Getting quotas for project b44e58e2108b435cac8c6d74046d7cc7. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:30.188694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ef4f9bf9-bf79-4f1f-80f0-aae56313b2e4 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Getting quotas for user 2bb2254827c24fd1b4206fa3f43101da and project b44e58e2108b435cac8c6d74046d7cc7. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:30.277092 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ef4f9bf9-bf79-4f1f-80f0-aae56313b2e4 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.206872 Oct 04 18:02:30.285023 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 228/444] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 4 18:02:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:02:30.317805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f33354db-a228-4752-9045-173c65519a7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:30.320026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f33354db-a228-4752-9045-173c65519a7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:30.357073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2660d2b1-a912-40b0-8dc9-6941ad7d1f36 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:30.369688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f33354db-a228-4752-9045-173c65519a7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.370703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f33354db-a228-4752-9045-173c65519a7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.376468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f33354db-a228-4752-9045-173c65519a7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.381454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f33354db-a228-4752-9045-173c65519a7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.381621 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2660d2b1-a912-40b0-8dc9-6941ad7d1f36 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1274 microversion: 2.1 time: 0.357071 Oct 04 18:02:30.386176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f33354db-a228-4752-9045-173c65519a7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.386415 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 217/445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:30 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1274 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:30.387607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f33354db-a228-4752-9045-173c65519a7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.406683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fa62707d-eefe-4cc0-bee5-ab02f181930f req-59dc9fed-12ba-47bc-a900-15c3eaf06184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7009eab7-c0a7-49a5-a792-57a7d67ebc00", "name": "network-vif-deleted", "tag": "880a9913-72e3-4fb2-b738-75f05677aad8"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:30.453516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fa62707d-eefe-4cc0-bee5-ab02f181930f req-59dc9fed-12ba-47bc-a900-15c3eaf06184 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.455009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fa62707d-eefe-4cc0-bee5-ab02f181930f req-59dc9fed-12ba-47bc-a900-15c3eaf06184 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.455992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fa62707d-eefe-4cc0-bee5-ab02f181930f req-59dc9fed-12ba-47bc-a900-15c3eaf06184 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.505342 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fa62707d-eefe-4cc0-bee5-ab02f181930f req-59dc9fed-12ba-47bc-a900-15c3eaf06184 service nova] Creating event network-vif-deleted:880a9913-72e3-4fb2-b738-75f05677aad8 for instance 7009eab7-c0a7-49a5-a792-57a7d67ebc00 on n-h2-850499-14 Oct 04 18:02:30.518267 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fa62707d-eefe-4cc0-bee5-ab02f181930f req-59dc9fed-12ba-47bc-a900-15c3eaf06184 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129076 Oct 04 18:02:30.528083 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 218/446] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:30.558976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c6dcdbeb-5327-4b0d-9f12-6d6fbffa856c req-3791e88e-2700-405b-931e-d6b9cf69f2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4b0323-60bc-47aa-8c5e-142573d6c375", "name": "network-vif-plugged", "status": "completed", "tag": "c0d7f40e-b90b-492b-bffc-13171692063a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:30.600870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=92,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:30.633616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c6dcdbeb-5327-4b0d-9f12-6d6fbffa856c req-3791e88e-2700-405b-931e-d6b9cf69f2ce service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.637177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c6dcdbeb-5327-4b0d-9f12-6d6fbffa856c req-3791e88e-2700-405b-931e-d6b9cf69f2ce service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.641513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c6dcdbeb-5327-4b0d-9f12-6d6fbffa856c req-3791e88e-2700-405b-931e-d6b9cf69f2ce service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.703572 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c6dcdbeb-5327-4b0d-9f12-6d6fbffa856c req-3791e88e-2700-405b-931e-d6b9cf69f2ce service nova] Creating event network-vif-plugged:c0d7f40e-b90b-492b-bffc-13171692063a for instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 on n-h1-850499-14 Oct 04 18:02:30.727137 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c6dcdbeb-5327-4b0d-9f12-6d6fbffa856c req-3791e88e-2700-405b-931e-d6b9cf69f2ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197287 Oct 04 18:02:30.728468 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 219/447] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:30.751240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f1b2fd7e-78d9-4990-8e93-dbe3caef5e96 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:30.756934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f1b2fd7e-78d9-4990-8e93-dbe3caef5e96 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:30.780489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b2fd7e-78d9-4990-8e93-dbe3caef5e96 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.782324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f33354db-a228-4752-9045-173c65519a7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:30.782943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b2fd7e-78d9-4990-8e93-dbe3caef5e96 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.785482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b2fd7e-78d9-4990-8e93-dbe3caef5e96 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.790463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b2fd7e-78d9-4990-8e93-dbe3caef5e96 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.791747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b2fd7e-78d9-4990-8e93-dbe3caef5e96 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.793251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b2fd7e-78d9-4990-8e93-dbe3caef5e96 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.812290 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f33354db-a228-4752-9045-173c65519a7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1505 microversion: 2.1 time: 0.518253 Oct 04 18:02:30.829758 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 229/448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:30 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:30.868678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a69efc8-6318-47f5-a03a-b284d8657b72 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Calling method '.version_select at 0x7fd4d2630790>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:30.914349 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a69efc8-6318-47f5-a03a-b284d8657b72 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-149235583?user_id=c07d160590a54e378d7c12abfbcaa170" status: 200 len: 511 microversion: 2.10 time: 0.082991 Oct 04 18:02:30.917482 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 230/449] 10.222.0.18 () {60 vars in 1337 bytes} [Tue Oct 4 18:02:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-149235583?user_id=c07d160590a54e378d7c12abfbcaa170 => generated 511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:02:30.937438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b883dfa8-0d17-4399-a6d6-4d07a3273dee tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Action: 'create', calling method: .version_select at 0x7fd4d2630310>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1332701341", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlUF5IOKh+y7tvy9WH1cSFjbUhCp6srHGj/T1No+oasLzU/K5nadFqg9y+3M+KSPCRCPC3wop8PtkHpLAM6327u/ieNhQ4YaCBZtcv+qAtqfk9wRp8fBywXSKyvC/Lgkg=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:31.004785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b883dfa8-0d17-4399-a6d6-4d07a3273dee tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Getting quotas for project b44e58e2108b435cac8c6d74046d7cc7. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:31.027530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b883dfa8-0d17-4399-a6d6-4d07a3273dee tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Getting quotas for user 2bb2254827c24fd1b4206fa3f43101da and project b44e58e2108b435cac8c6d74046d7cc7. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:31.054408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-f1b2fd7e-78d9-4990-8e93-dbe3caef5e96 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:31.100500 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b883dfa8-0d17-4399-a6d6-4d07a3273dee tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.171834 Oct 04 18:02:31.102797 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 231/450] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 4 18:02:30 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 18:02:31.121074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:31.122454 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f1b2fd7e-78d9-4990-8e93-dbe3caef5e96 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.389522 Oct 04 18:02:31.123835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] [instance: 7009eab7-c0a7-49a5-a792-57a7d67ebc00] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:31.125037 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 220/451] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:30 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:31.138044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:31.145566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:31.146130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fc14a25b-1e81-408e-9363-fd4cf50eb8b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:31.146606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:31.147821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fc14a25b-1e81-408e-9363-fd4cf50eb8b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:31.148030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:31.148889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:31.156278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:31.171630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc14a25b-1e81-408e-9363-fd4cf50eb8b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:31.174390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc14a25b-1e81-408e-9363-fd4cf50eb8b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:31.177079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc14a25b-1e81-408e-9363-fd4cf50eb8b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:31.178532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc14a25b-1e81-408e-9363-fd4cf50eb8b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:31.182193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc14a25b-1e81-408e-9363-fd4cf50eb8b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:31.193256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc14a25b-1e81-408e-9363-fd4cf50eb8b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:31.211050 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] HTTP exception thrown: Instance 7009eab7-c0a7-49a5-a792-57a7d67ebc00 could not be found. Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Request method failure captured: Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 HTTP/1.1 Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHTrr-4jocxBslukSgYECUSmgMW8Mtv4GTgQ-0TiK1UBrX6zhwe9BtdGZc1DJ5CjxQmy2B-iASXNRTa1k699rvj40ocsCQYO0lz6sU3KPFZG-VY2KON6YhClfE0n90x2spuccZCgQ7TTQbMMCAu-obIzerwQmZQo9Z_cPr-sZdsErFI Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: d6615b8b1c0f43d7a2cee777f8ab891a Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-LiveMigrationNegativeTest-1498319361 Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:02:31.222100 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d6615b8b1c0f43d7a2cee777f8ab891a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d6615b8b1c0f43d7a2cee777f8ab891a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d6615b8b1c0f43d7a2cee777f8ab891a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d6615b8b1c0f43d7a2cee777f8ab891a"}]}] Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-LiveMigrationNegativeTest-1498319361 Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: d6615b8b1c0f43d7a2cee777f8ab891a Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1498319361 Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-LiveMigrationNegativeTest-1498319361-project Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 8dedbf6bf8d745c8a7a3706086365ee1 Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-LiveMigrationNegativeTest-1498319361-project Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 7009eab7-c0a7-49a5-a792-57a7d67ebc00 could not be found. Oct 04 18:02:31.224290 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '7009eab7-c0a7-49a5-a792-57a7d67ebc00'} Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7009eab7-c0a7-49a5-a792-57a7d67ebc00 could not be found. Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:31.225136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7009eab7-c0a7-49a5-a792-57a7d67ebc00 could not be found. Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7009eab7-c0a7-49a5-a792-57a7d67ebc00 could not be found. Oct 04 18:02:31.226470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:31.228935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] Returning 404 to user: Instance 7009eab7-c0a7-49a5-a792-57a7d67ebc00 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:31.230518 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-85012957-fa25-4123-9e36-e0dd56b27b78 tempest-LiveMigrationNegativeTest-1498319361 tempest-LiveMigrationNegativeTest-1498319361-project] 10.222.0.18 "GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00" status: 404 len: 111 microversion: 2.1 time: 0.125888 Oct 04 18:02:31.238843 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 232/452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:31 2022] GET /compute/v2.1/servers/7009eab7-c0a7-49a5-a792-57a7d67ebc00 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:31.253081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e69508e6-2652-49c2-b07e-50a5fbb95b81 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Calling method '.version_select at 0x7fd4d245b430>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:31.268981 n-d-850499-14 devstack@n-api.service[122332]: WARNING oslo_db.sqlalchemy.utils [None req-e69508e6-2652-49c2-b07e-50a5fbb95b81 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:02:31.295697 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e69508e6-2652-49c2-b07e-50a5fbb95b81 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs?user_id=c07d160590a54e378d7c12abfbcaa170" status: 200 len: 724 microversion: 2.10 time: 0.053622 Oct 04 18:02:31.304494 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 233/453] 10.222.0.18 () {60 vars in 1259 bytes} [Tue Oct 4 18:02:31 2022] GET /compute/v2.1/os-keypairs?user_id=c07d160590a54e378d7c12abfbcaa170 => generated 724 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:02:31.325194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1c286f9f-419a-4a2c-88e5-8bf28740ef15 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Calling method '.version_select at 0x7fd4d250ddc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:31.390475 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1c286f9f-419a-4a2c-88e5-8bf28740ef15 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1332701341" status: 204 len: 0 microversion: 2.10 time: 0.083198 Oct 04 18:02:31.394906 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 234/454] 10.222.0.18 () {60 vars in 1325 bytes} [Tue Oct 4 18:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1332701341 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:02:31.404699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03e013b1-a7d8-4e85-b8e6-5159643996a3 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Calling method '.version_select at 0x7fd4d250d0d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:31.476684 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-03e013b1-a7d8-4e85-b8e6-5159643996a3 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475032023?user_id=c07d160590a54e378d7c12abfbcaa170" status: 204 len: 0 microversion: 2.10 time: 0.079975 Oct 04 18:02:31.477284 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 235/455] 10.222.0.18 () {60 vars in 1340 bytes} [Tue Oct 4 18:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475032023?user_id=c07d160590a54e378d7c12abfbcaa170 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:02:31.496747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f510512f-ca6f-4221-bb27-fce840b2f1c2 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:31.497403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f510512f-ca6f-4221-bb27-fce840b2f1c2 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:31.523809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f510512f-ca6f-4221-bb27-fce840b2f1c2 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:31.527041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f510512f-ca6f-4221-bb27-fce840b2f1c2 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:31.527514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f510512f-ca6f-4221-bb27-fce840b2f1c2 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:31.528257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f510512f-ca6f-4221-bb27-fce840b2f1c2 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:31.529036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f510512f-ca6f-4221-bb27-fce840b2f1c2 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:31.529160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f510512f-ca6f-4221-bb27-fce840b2f1c2 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.322678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f510512f-ca6f-4221-bb27-fce840b2f1c2 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:32.335501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f510512f-ca6f-4221-bb27-fce840b2f1c2 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1280 microversion: 2.1 time: 0.854357 Oct 04 18:02:32.336264 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 236/456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:31 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1280 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:32.349838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00b3907c-f75c-4f53-a0ad-0fc2bdea1094 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] Calling method '.version_select at 0x7fd4d2394c10>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:32.388934 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00b3907c-f75c-4f53-a0ad-0fc2bdea1094 tempest-KeyPairsV210TestJSON-432865669 tempest-KeyPairsV210TestJSON-432865669-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-149235583?user_id=c07d160590a54e378d7c12abfbcaa170" status: 204 len: 0 microversion: 2.10 time: 0.051501 Oct 04 18:02:32.389793 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 237/457] 10.222.0.18 () {60 vars in 1340 bytes} [Tue Oct 4 18:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-149235583?user_id=c07d160590a54e378d7c12abfbcaa170 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:02:32.395206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5f401e93-477a-456c-b232-9029aa722237 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:32.397427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5f401e93-477a-456c-b232-9029aa722237 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:32.412007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f401e93-477a-456c-b232-9029aa722237 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.414326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f401e93-477a-456c-b232-9029aa722237 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.415009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f401e93-477a-456c-b232-9029aa722237 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.419451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f401e93-477a-456c-b232-9029aa722237 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.420143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f401e93-477a-456c-b232-9029aa722237 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.420974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f401e93-477a-456c-b232-9029aa722237 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.451082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fc14a25b-1e81-408e-9363-fd4cf50eb8b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:32.492433 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fc14a25b-1e81-408e-9363-fd4cf50eb8b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1313 microversion: 2.1 time: 1.360500 Oct 04 18:02:32.511358 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 221/458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:31 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1313 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:32.533451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1388b082-e7df-4e91-993b-c556b1fb37d2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:32.534468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1388b082-e7df-4e91-993b-c556b1fb37d2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:32.543270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1388b082-e7df-4e91-993b-c556b1fb37d2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.544065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1388b082-e7df-4e91-993b-c556b1fb37d2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.544671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1388b082-e7df-4e91-993b-c556b1fb37d2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.545564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1388b082-e7df-4e91-993b-c556b1fb37d2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.546176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1388b082-e7df-4e91-993b-c556b1fb37d2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.546763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1388b082-e7df-4e91-993b-c556b1fb37d2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.827647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-1388b082-e7df-4e91-993b-c556b1fb37d2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:32.878212 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1388b082-e7df-4e91-993b-c556b1fb37d2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.365296 Oct 04 18:02:32.883578 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 222/459] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:32 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:32.888640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-24269ac1-287a-42da-9566-bd61166b767f req-30a165d3-2a2d-49db-bf54-4dabc97fb804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0d4381-3fce-4a7d-918e-755cd5123531", "name": "network-vif-unplugged", "status": "completed", "tag": "17b6dffb-7626-47e5-838a-8ecf72593ec8"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:32.928895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24269ac1-287a-42da-9566-bd61166b767f req-30a165d3-2a2d-49db-bf54-4dabc97fb804 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.931667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24269ac1-287a-42da-9566-bd61166b767f req-30a165d3-2a2d-49db-bf54-4dabc97fb804 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.932295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24269ac1-287a-42da-9566-bd61166b767f req-30a165d3-2a2d-49db-bf54-4dabc97fb804 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.955284 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-24269ac1-287a-42da-9566-bd61166b767f req-30a165d3-2a2d-49db-bf54-4dabc97fb804 service nova] Creating event network-vif-unplugged:17b6dffb-7626-47e5-838a-8ecf72593ec8 for instance ea0d4381-3fce-4a7d-918e-755cd5123531 on n-h1-850499-14 Oct 04 18:02:32.968952 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-24269ac1-287a-42da-9566-bd61166b767f req-30a165d3-2a2d-49db-bf54-4dabc97fb804 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076177 Oct 04 18:02:32.977077 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 223/460] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:32.983358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f401e93-477a-456c-b232-9029aa722237 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:33.022925 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5f401e93-477a-456c-b232-9029aa722237 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1505 microversion: 2.1 time: 0.629766 Oct 04 18:02:33.024070 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 238/461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:32 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1505 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:33.366821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20c97968-3d77-442f-90f5-89be302160aa tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:33.367822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20c97968-3d77-442f-90f5-89be302160aa tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:33.385218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c97968-3d77-442f-90f5-89be302160aa tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:33.390544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c97968-3d77-442f-90f5-89be302160aa tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:33.392566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c97968-3d77-442f-90f5-89be302160aa tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:33.393453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c97968-3d77-442f-90f5-89be302160aa tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:33.397075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c97968-3d77-442f-90f5-89be302160aa tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:33.397644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c97968-3d77-442f-90f5-89be302160aa tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:33.534478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8aa8d3e6-5ee1-44b8-b640-57fcd6fbe2c2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:33.535822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8aa8d3e6-5ee1-44b8-b640-57fcd6fbe2c2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:33.549538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8aa8d3e6-5ee1-44b8-b640-57fcd6fbe2c2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:33.564417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8aa8d3e6-5ee1-44b8-b640-57fcd6fbe2c2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:33.567821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8aa8d3e6-5ee1-44b8-b640-57fcd6fbe2c2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:33.569493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8aa8d3e6-5ee1-44b8-b640-57fcd6fbe2c2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:33.571383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8aa8d3e6-5ee1-44b8-b640-57fcd6fbe2c2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:33.572502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8aa8d3e6-5ee1-44b8-b640-57fcd6fbe2c2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:34.221213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8aa8d3e6-5ee1-44b8-b640-57fcd6fbe2c2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:34.241540 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8aa8d3e6-5ee1-44b8-b640-57fcd6fbe2c2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1461 microversion: 2.1 time: 0.706210 Oct 04 18:02:34.243959 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 239/462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:33 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1461 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:34.250043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7ca97da7-db63-4d7e-b05c-45159944479e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:34.265729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7ca97da7-db63-4d7e-b05c-45159944479e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:34.278881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ca97da7-db63-4d7e-b05c-45159944479e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:34.280342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ca97da7-db63-4d7e-b05c-45159944479e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:34.281059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ca97da7-db63-4d7e-b05c-45159944479e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:34.283273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ca97da7-db63-4d7e-b05c-45159944479e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:34.286847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ca97da7-db63-4d7e-b05c-45159944479e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:34.289411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ca97da7-db63-4d7e-b05c-45159944479e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:34.329786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-20c97968-3d77-442f-90f5-89be302160aa tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:34.349340 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20c97968-3d77-442f-90f5-89be302160aa tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1322 microversion: 2.1 time: 0.986267 Oct 04 18:02:34.351022 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 224/463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:33 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1322 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:02:34.386327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9859e5f6-5b22-4f6e-b1b1-34222f6ad8e9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:34.388986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9859e5f6-5b22-4f6e-b1b1-34222f6ad8e9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:34.413708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9859e5f6-5b22-4f6e-b1b1-34222f6ad8e9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:34.415009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9859e5f6-5b22-4f6e-b1b1-34222f6ad8e9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:34.416363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9859e5f6-5b22-4f6e-b1b1-34222f6ad8e9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:34.418609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9859e5f6-5b22-4f6e-b1b1-34222f6ad8e9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:34.421010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9859e5f6-5b22-4f6e-b1b1-34222f6ad8e9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:34.421637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9859e5f6-5b22-4f6e-b1b1-34222f6ad8e9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:34.608888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-7ca97da7-db63-4d7e-b05c-45159944479e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:34.664551 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7ca97da7-db63-4d7e-b05c-45159944479e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.418677 Oct 04 18:02:34.665176 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 240/464] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:34 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:35.462150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04e06dfa-5d17-4410-a974-47ca89ba996d tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:35.463191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-04e06dfa-5d17-4410-a974-47ca89ba996d tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:35.474586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04e06dfa-5d17-4410-a974-47ca89ba996d tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:35.479737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04e06dfa-5d17-4410-a974-47ca89ba996d tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:35.481664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04e06dfa-5d17-4410-a974-47ca89ba996d tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:35.485390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04e06dfa-5d17-4410-a974-47ca89ba996d tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:35.486067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04e06dfa-5d17-4410-a974-47ca89ba996d tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:35.488196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04e06dfa-5d17-4410-a974-47ca89ba996d tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:35.725426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9859e5f6-5b22-4f6e-b1b1-34222f6ad8e9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:35.728032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:35.736388 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9859e5f6-5b22-4f6e-b1b1-34222f6ad8e9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1505 microversion: 2.1 time: 1.377361 Oct 04 18:02:35.738237 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 225/465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:34 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1505 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:35.750291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f13347e6-8ca9-42c6-946e-c98e85ae5a72 req-030ebabc-fcd0-4063-8331-613365c298a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0d4381-3fce-4a7d-918e-755cd5123531", "tag": "17b6dffb-7626-47e5-838a-8ecf72593ec8"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:35.773163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f13347e6-8ca9-42c6-946e-c98e85ae5a72 req-030ebabc-fcd0-4063-8331-613365c298a1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:35.773661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f13347e6-8ca9-42c6-946e-c98e85ae5a72 req-030ebabc-fcd0-4063-8331-613365c298a1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:35.783043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f13347e6-8ca9-42c6-946e-c98e85ae5a72 req-030ebabc-fcd0-4063-8331-613365c298a1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:35.813105 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f13347e6-8ca9-42c6-946e-c98e85ae5a72 req-030ebabc-fcd0-4063-8331-613365c298a1 service nova] Creating event network-changed:17b6dffb-7626-47e5-838a-8ecf72593ec8 for instance ea0d4381-3fce-4a7d-918e-755cd5123531 on n-h1-850499-14 Oct 04 18:02:35.820482 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f13347e6-8ca9-42c6-946e-c98e85ae5a72 req-030ebabc-fcd0-4063-8331-613365c298a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074939 Oct 04 18:02:35.821090 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 226/466] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:35.835127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-056f5ce7-2f6b-4359-a2e8-039920975a02 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:35.836040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-056f5ce7-2f6b-4359-a2e8-039920975a02 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:35.853262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056f5ce7-2f6b-4359-a2e8-039920975a02 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:35.859034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056f5ce7-2f6b-4359-a2e8-039920975a02 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:35.859747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056f5ce7-2f6b-4359-a2e8-039920975a02 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:35.860764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056f5ce7-2f6b-4359-a2e8-039920975a02 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:35.861438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056f5ce7-2f6b-4359-a2e8-039920975a02 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:35.862297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056f5ce7-2f6b-4359-a2e8-039920975a02 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:36.447557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-056f5ce7-2f6b-4359-a2e8-039920975a02 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:36.461015 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-056f5ce7-2f6b-4359-a2e8-039920975a02 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1322 microversion: 2.1 time: 0.636623 Oct 04 18:02:36.461852 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 227/467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:35 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1322 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:36.463985 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-04e06dfa-5d17-4410-a974-47ca89ba996d tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1614 microversion: 2.1 time: 1.787389 Oct 04 18:02:36.465181 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 241/468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:34 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1614 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:36.479882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb5d3d04-5687-4b02-af3b-3735a0fa0b63 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:36.480509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb5d3d04-5687-4b02-af3b-3735a0fa0b63 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:36.486818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5d3d04-5687-4b02-af3b-3735a0fa0b63 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.500171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5d3d04-5687-4b02-af3b-3735a0fa0b63 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.500470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:36.501019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5d3d04-5687-4b02-af3b-3735a0fa0b63 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:36.502508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5d3d04-5687-4b02-af3b-3735a0fa0b63 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.502967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5d3d04-5687-4b02-af3b-3735a0fa0b63 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.503417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5d3d04-5687-4b02-af3b-3735a0fa0b63 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:36.509794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:36.538409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.543320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.548156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:36.549502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.550003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.550974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:36.654991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-cb5d3d04-5687-4b02-af3b-3735a0fa0b63 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:36.716427 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb5d3d04-5687-4b02-af3b-3735a0fa0b63 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.253456 Oct 04 18:02:36.717032 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 228/469] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:36 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:36.758847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e6e24f05339f436f8828a49f3d305a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e148e2e0d4b25b3d2603006aa729d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:36.759682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] flavor_id is None. Assuming migration. {{(pid=122332) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:02:36.760400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122332) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:02:36.766867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d54ea8be-b415-438b-a855-8eccfd3becbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:36.768868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d54ea8be-b415-438b-a855-8eccfd3becbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:36.793401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d54ea8be-b415-438b-a855-8eccfd3becbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.812830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d54ea8be-b415-438b-a855-8eccfd3becbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.813817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d54ea8be-b415-438b-a855-8eccfd3becbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:36.815360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d54ea8be-b415-438b-a855-8eccfd3becbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:36.816417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d54ea8be-b415-438b-a855-8eccfd3becbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:36.819948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d54ea8be-b415-438b-a855-8eccfd3becbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.072619 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-30b176b1-286d-4052-8cfb-9c5fa9067fa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375/action" status: 202 len: 0 microversion: 2.1 time: 0.585783 Oct 04 18:02:37.074044 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 242/470] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:36 2022] POST /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:37.096087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-183692a5-4359-4d9a-abae-0bbb82856de7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:37.097212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-183692a5-4359-4d9a-abae-0bbb82856de7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:37.102756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:37.129000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183692a5-4359-4d9a-abae-0bbb82856de7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:37.130482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183692a5-4359-4d9a-abae-0bbb82856de7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:37.139704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183692a5-4359-4d9a-abae-0bbb82856de7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.140861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183692a5-4359-4d9a-abae-0bbb82856de7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:37.141984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183692a5-4359-4d9a-abae-0bbb82856de7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:37.142679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183692a5-4359-4d9a-abae-0bbb82856de7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.763592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d54ea8be-b415-438b-a855-8eccfd3becbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:37.779505 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d54ea8be-b415-438b-a855-8eccfd3becbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1505 microversion: 2.1 time: 1.019289 Oct 04 18:02:37.783705 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 229/471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:36 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1505 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:37.792149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5590a1bc-cec8-4891-a417-fb70231ad611 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:37.796513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5590a1bc-cec8-4891-a417-fb70231ad611 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:37.810231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-183692a5-4359-4d9a-abae-0bbb82856de7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:37.811893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5590a1bc-cec8-4891-a417-fb70231ad611 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:37.812715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5590a1bc-cec8-4891-a417-fb70231ad611 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:37.813171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5590a1bc-cec8-4891-a417-fb70231ad611 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.814748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5590a1bc-cec8-4891-a417-fb70231ad611 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:37.815290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5590a1bc-cec8-4891-a417-fb70231ad611 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:37.815723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5590a1bc-cec8-4891-a417-fb70231ad611 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.820098 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-183692a5-4359-4d9a-abae-0bbb82856de7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1470 microversion: 2.1 time: 0.741282 Oct 04 18:02:37.820680 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 243/472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:37 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1470 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:37.832999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d3c01a6-f6d5-4413-9bcf-821ad9efdc7e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:37.833961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d3c01a6-f6d5-4413-9bcf-821ad9efdc7e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:37.840238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:37.843324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c01a6-f6d5-4413-9bcf-821ad9efdc7e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:37.845670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c01a6-f6d5-4413-9bcf-821ad9efdc7e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:37.846643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c01a6-f6d5-4413-9bcf-821ad9efdc7e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.847906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c01a6-f6d5-4413-9bcf-821ad9efdc7e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:37.849184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c01a6-f6d5-4413-9bcf-821ad9efdc7e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:37.850233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c01a6-f6d5-4413-9bcf-821ad9efdc7e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:37.984243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-0d3c01a6-f6d5-4413-9bcf-821ad9efdc7e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:38.014754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d3c01a6-f6d5-4413-9bcf-821ad9efdc7e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.185528 Oct 04 18:02:38.015854 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 244/473] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:37 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:38.100222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5590a1bc-cec8-4891-a417-fb70231ad611 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:38.111891 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5590a1bc-cec8-4891-a417-fb70231ad611 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1322 microversion: 2.1 time: 0.326178 Oct 04 18:02:38.113505 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 230/474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:37 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:38.502932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-430beea0-0eb9-4722-a6aa-34fe57438726 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:38.525381 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-430beea0-0eb9-4722-a6aa-34fe57438726 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.507497 Oct 04 18:02:38.526165 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 245/475] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:02:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:38.640146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9a212251-d714-4bcf-96e6-a00b3a51400e req-c3560ca4-7ec5-44a8-9630-f18f9bec0fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a", "tag": "057cd609-d245-4f7e-b933-11104556327b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:38.690904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9a212251-d714-4bcf-96e6-a00b3a51400e req-c3560ca4-7ec5-44a8-9630-f18f9bec0fd7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:38.691593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9a212251-d714-4bcf-96e6-a00b3a51400e req-c3560ca4-7ec5-44a8-9630-f18f9bec0fd7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:38.693009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9a212251-d714-4bcf-96e6-a00b3a51400e req-c3560ca4-7ec5-44a8-9630-f18f9bec0fd7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:38.732789 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9a212251-d714-4bcf-96e6-a00b3a51400e req-c3560ca4-7ec5-44a8-9630-f18f9bec0fd7 service nova] Creating event network-changed:057cd609-d245-4f7e-b933-11104556327b for instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a on n-h1-850499-14 Oct 04 18:02:38.739509 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9a212251-d714-4bcf-96e6-a00b3a51400e req-c3560ca4-7ec5-44a8-9630-f18f9bec0fd7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105652 Oct 04 18:02:38.741080 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 246/476] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:38.841311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bbb5cab4-07c2-4207-88c0-57a4c4561d5f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:38.845915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bbb5cab4-07c2-4207-88c0-57a4c4561d5f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:38.876305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbb5cab4-07c2-4207-88c0-57a4c4561d5f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:38.881468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbb5cab4-07c2-4207-88c0-57a4c4561d5f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:38.882585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbb5cab4-07c2-4207-88c0-57a4c4561d5f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:38.883859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbb5cab4-07c2-4207-88c0-57a4c4561d5f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:38.884401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbb5cab4-07c2-4207-88c0-57a4c4561d5f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:38.884910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbb5cab4-07c2-4207-88c0-57a4c4561d5f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:39.263243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ede507e1-978a-49cb-93e5-accae9998763 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-200207447", "id": 1781652487, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:39.318018 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ede507e1-978a-49cb-93e5-accae9998763 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.773724 Oct 04 18:02:39.329716 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 231/477] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:38 2022] POST /compute/v2.1/flavors => generated 424 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:39.341667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7dd33581-c098-48fc-8a20-acf794dd4096 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:39.344197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7dd33581-c098-48fc-8a20-acf794dd4096 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:39.358898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dd33581-c098-48fc-8a20-acf794dd4096 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:39.359537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dd33581-c098-48fc-8a20-acf794dd4096 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:39.361874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dd33581-c098-48fc-8a20-acf794dd4096 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:39.362719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dd33581-c098-48fc-8a20-acf794dd4096 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:39.364788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dd33581-c098-48fc-8a20-acf794dd4096 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:39.365504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dd33581-c098-48fc-8a20-acf794dd4096 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:39.683530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bbb5cab4-07c2-4207-88c0-57a4c4561d5f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:39.697449 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bbb5cab4-07c2-4207-88c0-57a4c4561d5f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1505 microversion: 2.1 time: 0.884153 Oct 04 18:02:39.710307 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 247/478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:38 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1505 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:02:39.715370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc8aabec-1d3b-4c18-b662-cd80b4b3638c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:39.723602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc8aabec-1d3b-4c18-b662-cd80b4b3638c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:39.740295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc8aabec-1d3b-4c18-b662-cd80b4b3638c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:39.741129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc8aabec-1d3b-4c18-b662-cd80b4b3638c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:39.741941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc8aabec-1d3b-4c18-b662-cd80b4b3638c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:39.743967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc8aabec-1d3b-4c18-b662-cd80b4b3638c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:39.746536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc8aabec-1d3b-4c18-b662-cd80b4b3638c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:39.747540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc8aabec-1d3b-4c18-b662-cd80b4b3638c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:39.951022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-dc8aabec-1d3b-4c18-b662-cd80b4b3638c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:39.963510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7dd33581-c098-48fc-8a20-acf794dd4096 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:39.977506 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7dd33581-c098-48fc-8a20-acf794dd4096 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1470 microversion: 2.1 time: 0.643414 Oct 04 18:02:39.978656 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 232/479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:39 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1470 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:39.990712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f2d0c5e-7ac3-401d-9a27-ceef60fb21bd tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:39.996491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f2d0c5e-7ac3-401d-9a27-ceef60fb21bd tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:40.003949 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc8aabec-1d3b-4c18-b662-cd80b4b3638c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.292159 Oct 04 18:02:40.007368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2d0c5e-7ac3-401d-9a27-ceef60fb21bd tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:40.010365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2d0c5e-7ac3-401d-9a27-ceef60fb21bd tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:40.010825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2d0c5e-7ac3-401d-9a27-ceef60fb21bd tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:40.011602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2d0c5e-7ac3-401d-9a27-ceef60fb21bd tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:40.012072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2d0c5e-7ac3-401d-9a27-ceef60fb21bd tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:40.012511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2d0c5e-7ac3-401d-9a27-ceef60fb21bd tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:40.014429 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 248/480] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:39 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:40.047200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59675469-255d-4365-9b7b-a141aac6d18f tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:40.056909 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59675469-255d-4365-9b7b-a141aac6d18f tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021223 Oct 04 18:02:40.058151 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 249/481] 10.222.0.18 () {58 vars in 1182 bytes} [Tue Oct 4 18:02:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:40.067875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02cf316e-3116-4f1c-8f54-fb49efa38b99 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1187760767", "id": 1718480545, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:40.097521 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-02cf316e-3116-4f1c-8f54-fb49efa38b99 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.034132 Oct 04 18:02:40.098985 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 250/482] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:40 2022] POST /compute/v2.1/flavors => generated 425 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:40.112379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0abc9fe6-a76a-44ff-bd25-1d617987b9f4 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:40.138473 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0abc9fe6-a76a-44ff-bd25-1d617987b9f4 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029752 Oct 04 18:02:40.140533 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 251/483] 10.222.0.18 () {58 vars in 1182 bytes} [Tue Oct 4 18:02:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:02:40.157617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d66be72e-b2ad-44c8-86b0-ed44afea9332 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Action: 'create', calling method: .version_select at 0x7fd4d28623a0>, body: {"keypair": {"name": "tempest-keypair-1320746582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFH18ETjIZBSDDaTQebnm2TvX8UZITjn+IkSLfhxieuAwiD2uyAFV0IEiavMe8xApB+Tla2sNNJqqWAQ4H9BFuKW7j9368PLzJnzUgbbdUJUFUcLWIg8uHveOhY2OeBETQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:40.196464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d66be72e-b2ad-44c8-86b0-ed44afea9332 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Getting quotas for project bb0f422348f8418a862f7ef518071bf5. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:40.207228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d66be72e-b2ad-44c8-86b0-ed44afea9332 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Getting quotas for user ad3bc1eee7134c2083f937e1f859220c and project bb0f422348f8418a862f7ef518071bf5. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:40.266012 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d66be72e-b2ad-44c8-86b0-ed44afea9332 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115790 Oct 04 18:02:40.266639 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 252/484] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:02:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:40.612525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f2d0c5e-7ac3-401d-9a27-ceef60fb21bd tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:40.627931 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f2d0c5e-7ac3-401d-9a27-ceef60fb21bd tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1322 microversion: 2.1 time: 0.647103 Oct 04 18:02:40.631822 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 233/485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:39 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1322 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:40.730021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df0f7a3b-e1f6-47d6-8da7-6becb8156dcd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:40.730650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-df0f7a3b-e1f6-47d6-8da7-6becb8156dcd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:40.756040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0f7a3b-e1f6-47d6-8da7-6becb8156dcd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:40.756715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0f7a3b-e1f6-47d6-8da7-6becb8156dcd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:40.757182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0f7a3b-e1f6-47d6-8da7-6becb8156dcd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:40.760977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0f7a3b-e1f6-47d6-8da7-6becb8156dcd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:40.761661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0f7a3b-e1f6-47d6-8da7-6becb8156dcd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:40.762330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0f7a3b-e1f6-47d6-8da7-6becb8156dcd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:41.093056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-df0f7a3b-e1f6-47d6-8da7-6becb8156dcd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:41.103690 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-df0f7a3b-e1f6-47d6-8da7-6becb8156dcd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1505 microversion: 2.1 time: 0.377759 Oct 04 18:02:41.109303 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 253/486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:40 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:41.122253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d3a2cab-1336-4dbd-bd55-1cc2b92981c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:41.123979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4d3a2cab-1336-4dbd-bd55-1cc2b92981c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:41.138615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d3a2cab-1336-4dbd-bd55-1cc2b92981c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:41.139323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d3a2cab-1336-4dbd-bd55-1cc2b92981c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:41.141101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d3a2cab-1336-4dbd-bd55-1cc2b92981c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:41.144004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d3a2cab-1336-4dbd-bd55-1cc2b92981c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:41.145947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d3a2cab-1336-4dbd-bd55-1cc2b92981c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:41.146687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d3a2cab-1336-4dbd-bd55-1cc2b92981c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:41.158728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:41.602132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8fe14a72-7fd1-49ec-8241-88fa42177969 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Calling method '.version_select at 0x7fd4d24fc310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:41.704408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4d3a2cab-1336-4dbd-bd55-1cc2b92981c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:41.724799 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4d3a2cab-1336-4dbd-bd55-1cc2b92981c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1470 microversion: 2.1 time: 0.605006 Oct 04 18:02:41.725572 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 254/487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:41 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1470 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:41.732445 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8fe14a72-7fd1-49ec-8241-88fa42177969 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/85876f148fa74514b34bd7d339bb96d1" status: 200 len: 371 microversion: 2.1 time: 0.773464 Oct 04 18:02:41.735618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74fb1583-6059-4345-b4f9-b59d0ffb1b3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:41.736440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-74fb1583-6059-4345-b4f9-b59d0ffb1b3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:41.743756 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 234/488] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 4 18:02:40 2022] GET /compute/v2.1/os-quota-sets/85876f148fa74514b34bd7d339bb96d1 => generated 371 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:02:41.761837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7166573c-bc89-466b-b649-5d76cb6919c3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:41.762469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7166573c-bc89-466b-b649-5d76cb6919c3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:41.763406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74fb1583-6059-4345-b4f9-b59d0ffb1b3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:41.763987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74fb1583-6059-4345-b4f9-b59d0ffb1b3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:41.764450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74fb1583-6059-4345-b4f9-b59d0ffb1b3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:41.765202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74fb1583-6059-4345-b4f9-b59d0ffb1b3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:41.765665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74fb1583-6059-4345-b4f9-b59d0ffb1b3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:41.766092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74fb1583-6059-4345-b4f9-b59d0ffb1b3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:41.780093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7166573c-bc89-466b-b649-5d76cb6919c3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:41.780661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7166573c-bc89-466b-b649-5d76cb6919c3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:41.781172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7166573c-bc89-466b-b649-5d76cb6919c3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:41.781894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7166573c-bc89-466b-b649-5d76cb6919c3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:41.782402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7166573c-bc89-466b-b649-5d76cb6919c3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:41.782779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7166573c-bc89-466b-b649-5d76cb6919c3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:42.228359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-74fb1583-6059-4345-b4f9-b59d0ffb1b3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:42.279818 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74fb1583-6059-4345-b4f9-b59d0ffb1b3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.552546 Oct 04 18:02:42.290152 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 255/489] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:41 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:42.306835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-11aa8e99-2000-40a0-9bd6-156671640529 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d23dbdc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:42.615936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7166573c-bc89-466b-b649-5d76cb6919c3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:42.632948 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7166573c-bc89-466b-b649-5d76cb6919c3 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1322 microversion: 2.1 time: 0.886206 Oct 04 18:02:42.635219 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 235/490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:41 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1322 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:42.649240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-634e3d6b-2627-4f79-92a5-ab549ef87ab8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:42.652611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-634e3d6b-2627-4f79-92a5-ab549ef87ab8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:42.693238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-634e3d6b-2627-4f79-92a5-ab549ef87ab8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:42.694133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-634e3d6b-2627-4f79-92a5-ab549ef87ab8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:42.694766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-634e3d6b-2627-4f79-92a5-ab549ef87ab8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:42.695850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-634e3d6b-2627-4f79-92a5-ab549ef87ab8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:42.696483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-634e3d6b-2627-4f79-92a5-ab549ef87ab8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:42.698422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-634e3d6b-2627-4f79-92a5-ab549ef87ab8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:42.777835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11aa8e99-2000-40a0-9bd6-156671640529 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:42.778317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11aa8e99-2000-40a0-9bd6-156671640529 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:42.778771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11aa8e99-2000-40a0-9bd6-156671640529 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:42.779591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11aa8e99-2000-40a0-9bd6-156671640529 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:42.780070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11aa8e99-2000-40a0-9bd6-156671640529 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:42.780513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11aa8e99-2000-40a0-9bd6-156671640529 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:42.869989 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-11aa8e99-2000-40a0-9bd6-156671640529 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/85876f148fa74514b34bd7d339bb96d1" status: 200 len: 328 microversion: 2.1 time: 0.578141 Oct 04 18:02:42.871473 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 256/491] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:02:42 2022] PUT /compute/v2.1/os-quota-sets/85876f148fa74514b34bd7d339bb96d1 => generated 328 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:42.882946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78a4d0f0-8fb0-41fc-aea6-698ba39fa195 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:42.883984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78a4d0f0-8fb0-41fc-aea6-698ba39fa195 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:42.892248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78a4d0f0-8fb0-41fc-aea6-698ba39fa195 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:42.893051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78a4d0f0-8fb0-41fc-aea6-698ba39fa195 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:42.894616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78a4d0f0-8fb0-41fc-aea6-698ba39fa195 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:42.896822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78a4d0f0-8fb0-41fc-aea6-698ba39fa195 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:42.898730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78a4d0f0-8fb0-41fc-aea6-698ba39fa195 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:42.901571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78a4d0f0-8fb0-41fc-aea6-698ba39fa195 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:43.558430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-634e3d6b-2627-4f79-92a5-ab549ef87ab8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:43.594636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78a4d0f0-8fb0-41fc-aea6-698ba39fa195 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:43.607413 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-634e3d6b-2627-4f79-92a5-ab549ef87ab8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1505 microversion: 2.1 time: 0.970403 Oct 04 18:02:43.609525 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78a4d0f0-8fb0-41fc-aea6-698ba39fa195 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1470 microversion: 2.1 time: 0.736710 Oct 04 18:02:43.623929 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 257/492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:42 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1470 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:43.627446 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 236/493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:42 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1505 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:43.634875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52439f70-a382-41a8-888b-220cdbfb89d1 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:43.646552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d93645a3-84f1-4350-a783-0ced55561b56 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:43.647230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d93645a3-84f1-4350-a783-0ced55561b56 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:43.672165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-52439f70-a382-41a8-888b-220cdbfb89d1 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-quota-sets/85876f148fa74514b34bd7d339bb96d1" status: 202 len: 0 microversion: 2.1 time: 0.043826 Oct 04 18:02:43.673029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d93645a3-84f1-4350-a783-0ced55561b56 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:43.673541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d93645a3-84f1-4350-a783-0ced55561b56 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:43.673977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d93645a3-84f1-4350-a783-0ced55561b56 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:43.675979 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 258/494] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:02:43 2022] DELETE /compute/v2.1/os-quota-sets/85876f148fa74514b34bd7d339bb96d1 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:43.681987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d93645a3-84f1-4350-a783-0ced55561b56 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:43.682557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d93645a3-84f1-4350-a783-0ced55561b56 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:43.683035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d93645a3-84f1-4350-a783-0ced55561b56 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:43.686204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d6a1bee-85f7-469d-b773-b0a7d439c933 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:43.687113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d6a1bee-85f7-469d-b773-b0a7d439c933 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:43.701874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d6a1bee-85f7-469d-b773-b0a7d439c933 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:43.704408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d6a1bee-85f7-469d-b773-b0a7d439c933 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:43.710103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d6a1bee-85f7-469d-b773-b0a7d439c933 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:43.710913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d6a1bee-85f7-469d-b773-b0a7d439c933 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:43.713264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d6a1bee-85f7-469d-b773-b0a7d439c933 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:43.713722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d6a1bee-85f7-469d-b773-b0a7d439c933 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:43.906431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-d93645a3-84f1-4350-a783-0ced55561b56 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:43.947837 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d93645a3-84f1-4350-a783-0ced55561b56 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.320472 Oct 04 18:02:43.949932 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 237/495] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:43 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:43.968452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3396c1c9-7d46-4db4-b168-9f345181765d tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Calling method '.version_select at 0x7fd4d2350f70>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:44.165737 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3396c1c9-7d46-4db4-b168-9f345181765d tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/85876f148fa74514b34bd7d339bb96d1" status: 200 len: 371 microversion: 2.1 time: 0.213769 Oct 04 18:02:44.174806 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 238/496] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 4 18:02:43 2022] GET /compute/v2.1/os-quota-sets/85876f148fa74514b34bd7d339bb96d1 => generated 371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:44.195884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d6a1bee-85f7-469d-b773-b0a7d439c933 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:44.205307 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d6a1bee-85f7-469d-b773-b0a7d439c933 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1322 microversion: 2.1 time: 0.527861 Oct 04 18:02:44.206036 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 259/497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:43 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:44.400344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d48d4fe3-901e-4142-8d4c-226787595c7b tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Calling method '.version_select at 0x7fd4d23a4dc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:44.639502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c221b967-5447-435b-8305-df839fbf51b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:44.640606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c221b967-5447-435b-8305-df839fbf51b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:44.657780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221b967-5447-435b-8305-df839fbf51b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:44.658645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221b967-5447-435b-8305-df839fbf51b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:44.659449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221b967-5447-435b-8305-df839fbf51b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:44.667768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221b967-5447-435b-8305-df839fbf51b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:44.669752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221b967-5447-435b-8305-df839fbf51b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:44.670909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221b967-5447-435b-8305-df839fbf51b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:44.681271 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d48d4fe3-901e-4142-8d4c-226787595c7b tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/e503dc09695d46ddba252caa4d6b35ac/defaults" status: 200 len: 371 microversion: 2.1 time: 0.285974 Oct 04 18:02:44.693831 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 239/498] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:02:44 2022] GET /compute/v2.1/os-quota-sets/e503dc09695d46ddba252caa4d6b35ac/defaults => generated 371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:44.706007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-331d1d3d-2091-4e7b-89c7-cf4c845a2fe3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:44.706824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-331d1d3d-2091-4e7b-89c7-cf4c845a2fe3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:44.727571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-331d1d3d-2091-4e7b-89c7-cf4c845a2fe3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:44.728843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-331d1d3d-2091-4e7b-89c7-cf4c845a2fe3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:44.729586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-331d1d3d-2091-4e7b-89c7-cf4c845a2fe3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:44.732036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-331d1d3d-2091-4e7b-89c7-cf4c845a2fe3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:44.733254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-331d1d3d-2091-4e7b-89c7-cf4c845a2fe3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:44.735972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-331d1d3d-2091-4e7b-89c7-cf4c845a2fe3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:45.159473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c221b967-5447-435b-8305-df839fbf51b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:45.173713 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c221b967-5447-435b-8305-df839fbf51b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.541478 Oct 04 18:02:45.174749 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 260/499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:44 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:02:45.184966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4b12ce72-da5f-4869-bbf3-c17b3773a3ca tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:45.185573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4b12ce72-da5f-4869-bbf3-c17b3773a3ca tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:45.199397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-331d1d3d-2091-4e7b-89c7-cf4c845a2fe3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:45.202532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b12ce72-da5f-4869-bbf3-c17b3773a3ca tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:45.203134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b12ce72-da5f-4869-bbf3-c17b3773a3ca tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:45.203669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b12ce72-da5f-4869-bbf3-c17b3773a3ca tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:45.205143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b12ce72-da5f-4869-bbf3-c17b3773a3ca tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:45.205610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b12ce72-da5f-4869-bbf3-c17b3773a3ca tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:45.208920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b12ce72-da5f-4869-bbf3-c17b3773a3ca tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:45.224790 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-331d1d3d-2091-4e7b-89c7-cf4c845a2fe3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1505 microversion: 2.1 time: 0.528123 Oct 04 18:02:45.225404 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 240/500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:44 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:45.231608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-519685c7-f5e0-44d4-82e5-239e26041087 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d23a4ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:45.399627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-4b12ce72-da5f-4869-bbf3-c17b3773a3ca tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:45.440675 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4b12ce72-da5f-4869-bbf3-c17b3773a3ca tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.259757 Oct 04 18:02:45.442454 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 261/501] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:45 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:45.484804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-29b1b523-c9ee-4581-b92b-9d64d895aeb8 req-b92897ba-a584-4df7-80d5-e5856a5b14ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a", "name": "network-vif-plugged", "status": "completed", "tag": "057cd609-d245-4f7e-b933-11104556327b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:45.500000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-29b1b523-c9ee-4581-b92b-9d64d895aeb8 req-b92897ba-a584-4df7-80d5-e5856a5b14ed service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:45.500494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-29b1b523-c9ee-4581-b92b-9d64d895aeb8 req-b92897ba-a584-4df7-80d5-e5856a5b14ed service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:45.500935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-29b1b523-c9ee-4581-b92b-9d64d895aeb8 req-b92897ba-a584-4df7-80d5-e5856a5b14ed service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:45.517121 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-29b1b523-c9ee-4581-b92b-9d64d895aeb8 req-b92897ba-a584-4df7-80d5-e5856a5b14ed service nova] Creating event network-vif-plugged:057cd609-d245-4f7e-b933-11104556327b for instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a on n-h1-850499-14 Oct 04 18:02:45.522909 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-29b1b523-c9ee-4581-b92b-9d64d895aeb8 req-b92897ba-a584-4df7-80d5-e5856a5b14ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061439 Oct 04 18:02:45.523785 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 262/502] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:45.529622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519685c7-f5e0-44d4-82e5-239e26041087 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:45.530402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519685c7-f5e0-44d4-82e5-239e26041087 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:45.531119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519685c7-f5e0-44d4-82e5-239e26041087 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:45.532058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f9a3d53-dcb7-4bff-9ba7-4c4330bfb33c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:45.532310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519685c7-f5e0-44d4-82e5-239e26041087 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:45.532971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519685c7-f5e0-44d4-82e5-239e26041087 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:45.533350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f9a3d53-dcb7-4bff-9ba7-4c4330bfb33c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:45.533840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519685c7-f5e0-44d4-82e5-239e26041087 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:45.547104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9a3d53-dcb7-4bff-9ba7-4c4330bfb33c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:45.548233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9a3d53-dcb7-4bff-9ba7-4c4330bfb33c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:45.549058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9a3d53-dcb7-4bff-9ba7-4c4330bfb33c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:45.552170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9a3d53-dcb7-4bff-9ba7-4c4330bfb33c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:45.553945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9a3d53-dcb7-4bff-9ba7-4c4330bfb33c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:45.554754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9a3d53-dcb7-4bff-9ba7-4c4330bfb33c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:45.599107 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-519685c7-f5e0-44d4-82e5-239e26041087 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/f60189d1edb94aaaa39a9c159912a721" status: 200 len: 328 microversion: 2.1 time: 0.371809 Oct 04 18:02:45.600563 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 241/503] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:02:45 2022] PUT /compute/v2.1/os-quota-sets/f60189d1edb94aaaa39a9c159912a721 => generated 328 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:45.607354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-664064863", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "1718480545", "adminPass": "***", "networks": [{"uuid": "38a451c8-3e5c-46d1-a0e4-69cbacf2de2d"}], "security_groups": [{"name": "tempest-securitygroup--298989717"}], "key_name": "tempest-keypair-1320746582", "user_data": "}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:45.877790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] validate_networks() for [('38a451c8-3e5c-46d1-a0e4-69cbacf2de2d', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:02:46.014367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1f9a3d53-dcb7-4bff-9ba7-4c4330bfb33c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:46.024282 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f9a3d53-dcb7-4bff-9ba7-4c4330bfb33c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1322 microversion: 2.1 time: 0.499048 Oct 04 18:02:46.025506 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 263/504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:45 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:46.112523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3aa02816-8a8d-415f-b33f-334f33bfca15 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d2630790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-216051487", "description": "tempest-description-1599933380"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:46.711287 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3aa02816-8a8d-415f-b33f-334f33bfca15 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.684038 Oct 04 18:02:46.711898 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 264/505] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:46 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:46.719661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06a20e70-f046-412b-bfe7-f63139d3640f tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Calling method '.version_select at 0x7fd4d23921f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:46.802433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06a20e70-f046-412b-bfe7-f63139d3640f tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.803828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06a20e70-f046-412b-bfe7-f63139d3640f tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.804709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06a20e70-f046-412b-bfe7-f63139d3640f tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.806088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06a20e70-f046-412b-bfe7-f63139d3640f tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.807031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06a20e70-f046-412b-bfe7-f63139d3640f tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.807907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06a20e70-f046-412b-bfe7-f63139d3640f tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.815837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:46.816270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:46.816746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:46.818628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:46.819227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:46.828486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.828988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.829561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.830652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.831153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.831874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.841871 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-06a20e70-f046-412b-bfe7-f63139d3640f tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f60189d1edb94aaaa39a9c159912a721/detail" status: 200 len: 916 microversion: 2.1 time: 0.127284 Oct 04 18:02:46.843018 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 265/506] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:02:46 2022] GET /compute/v2.1/os-quota-sets/f60189d1edb94aaaa39a9c159912a721/detail => generated 916 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:46.851989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Getting quotas for project bb0f422348f8418a862f7ef518071bf5. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:46.852846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb59318e-db18-4dff-b728-c7e9842f3db2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:46.854288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb59318e-db18-4dff-b728-c7e9842f3db2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:46.856164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Getting quotas for user ad3bc1eee7134c2083f937e1f859220c and project bb0f422348f8418a862f7ef518071bf5. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:46.865948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb59318e-db18-4dff-b728-c7e9842f3db2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.867240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb59318e-db18-4dff-b728-c7e9842f3db2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.868274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb59318e-db18-4dff-b728-c7e9842f3db2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.869748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb59318e-db18-4dff-b728-c7e9842f3db2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.870762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb59318e-db18-4dff-b728-c7e9842f3db2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.871869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb59318e-db18-4dff-b728-c7e9842f3db2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.874485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:46.877097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:46.941022 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bf89f9e8-eab4-46f4-a3fc-de7c42452676 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.339059 Oct 04 18:02:46.941931 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 242/507] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:02:46.946987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6482263b-b7e6-47b0-a0f8-1ef8bc1b74e5 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:46.948015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6482263b-b7e6-47b0-a0f8-1ef8bc1b74e5 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:46.955031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6482263b-b7e6-47b0-a0f8-1ef8bc1b74e5 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.955864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6482263b-b7e6-47b0-a0f8-1ef8bc1b74e5 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.956645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6482263b-b7e6-47b0-a0f8-1ef8bc1b74e5 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.957575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6482263b-b7e6-47b0-a0f8-1ef8bc1b74e5 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.959072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6482263b-b7e6-47b0-a0f8-1ef8bc1b74e5 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.959615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6482263b-b7e6-47b0-a0f8-1ef8bc1b74e5 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:47.351234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6482263b-b7e6-47b0-a0f8-1ef8bc1b74e5 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:47.360454 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6482263b-b7e6-47b0-a0f8-1ef8bc1b74e5 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1495 microversion: 2.1 time: 0.417358 Oct 04 18:02:47.361593 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 243/508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:46 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1495 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:47.363293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb59318e-db18-4dff-b728-c7e9842f3db2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:47.376954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c8ae8904-639a-467c-9ae9-15568dfd8189 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:47.381593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c8ae8904-639a-467c-9ae9-15568dfd8189 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:47.389041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8ae8904-639a-467c-9ae9-15568dfd8189 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:47.389545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8ae8904-639a-467c-9ae9-15568dfd8189 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:47.389989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8ae8904-639a-467c-9ae9-15568dfd8189 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:47.391209 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb59318e-db18-4dff-b728-c7e9842f3db2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.546377 Oct 04 18:02:47.391650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8ae8904-639a-467c-9ae9-15568dfd8189 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:47.392130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8ae8904-639a-467c-9ae9-15568dfd8189 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:47.392562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8ae8904-639a-467c-9ae9-15568dfd8189 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:47.393325 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 266/509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:46 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:47.398517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-34346dda-cd44-4338-9fa6-5c7327747b94 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d2630dc0>, body: {"security_group_rule": {"parent_group_id": "1e67d385-ad87-4bd9-b652-570539ab2ea6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:47.527700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-c8ae8904-639a-467c-9ae9-15568dfd8189 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:47.546898 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c8ae8904-639a-467c-9ae9-15568dfd8189 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.174083 Oct 04 18:02:47.547887 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 244/510] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:47 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:47.554662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eef1bae4-4b79-4e47-bad3-fd8bc5e519f0 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:47.555601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eef1bae4-4b79-4e47-bad3-fd8bc5e519f0 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:47.822728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eef1bae4-4b79-4e47-bad3-fd8bc5e519f0 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:47.831364 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eef1bae4-4b79-4e47-bad3-fd8bc5e519f0 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 200 len: 1264 microversion: 2.1 time: 0.281898 Oct 04 18:02:47.847679 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 245/511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:47 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 1264 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:47.854812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bad659f6-e069-4935-bd18-a74c2da07676 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:47.855914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bad659f6-e069-4935-bd18-a74c2da07676 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:47.859472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:47.865217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad659f6-e069-4935-bd18-a74c2da07676 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:47.865788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad659f6-e069-4935-bd18-a74c2da07676 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:47.866231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad659f6-e069-4935-bd18-a74c2da07676 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:47.867187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad659f6-e069-4935-bd18-a74c2da07676 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:47.868173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad659f6-e069-4935-bd18-a74c2da07676 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:47.868812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad659f6-e069-4935-bd18-a74c2da07676 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:47.940344 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-34346dda-cd44-4338-9fa6-5c7327747b94 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.544690 Oct 04 18:02:47.941820 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 267/512] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:47.953317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d250d310>, body: {"quota_set": {"ram": "2048"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:48.075827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.076368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.076872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.077614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.078078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.078511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.113620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bad659f6-e069-4935-bd18-a74c2da07676 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:48.117302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.118878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.119512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.120871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.121511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.121950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.130782 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bad659f6-e069-4935-bd18-a74c2da07676 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1472 microversion: 2.1 time: 0.281028 Oct 04 18:02:48.132566 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 246/513] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:47 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1472 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:48.156441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-122b7fef-6a45-4b10-bb9b-ed8f052f8f60 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '.version_select at 0x7fd4d2535820>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:48.173361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-122b7fef-6a45-4b10-bb9b-ed8f052f8f60 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.174887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-122b7fef-6a45-4b10-bb9b-ed8f052f8f60 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.177237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-122b7fef-6a45-4b10-bb9b-ed8f052f8f60 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.196669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:48.212402 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-122b7fef-6a45-4b10-bb9b-ed8f052f8f60 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.077496 Oct 04 18:02:48.214423 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 247/514] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:02:48 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:48.226853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4763cc03-082b-4dd3-9c04-ad599f31813e tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d2535b80>, body: {"security_group_rule": {"parent_group_id": "1e67d385-ad87-4bd9-b652-570539ab2ea6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:48.271348 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a62f11ff-1ff8-4d6b-a00b-6cba1452547e tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/f60189d1edb94aaaa39a9c159912a721?user_id=477d9dec479c4d628d36b960bc3e6440" status: 200 len: 328 microversion: 2.1 time: 0.327854 Oct 04 18:02:48.285856 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 268/515] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:02:47 2022] PUT /compute/v2.1/os-quota-sets/f60189d1edb94aaaa39a9c159912a721?user_id=477d9dec479c4d628d36b960bc3e6440 => generated 328 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:48.285856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-73a01b77-62f2-429f-897d-f68a95e846f3 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:48.285856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-73a01b77-62f2-429f-897d-f68a95e846f3 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:48.286349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73a01b77-62f2-429f-897d-f68a95e846f3 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.286716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73a01b77-62f2-429f-897d-f68a95e846f3 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.287088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73a01b77-62f2-429f-897d-f68a95e846f3 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.287985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73a01b77-62f2-429f-897d-f68a95e846f3 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.288434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73a01b77-62f2-429f-897d-f68a95e846f3 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.288860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73a01b77-62f2-429f-897d-f68a95e846f3 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.327551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-73a01b77-62f2-429f-897d-f68a95e846f3 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lazy-loading 'flavor' on Instance uuid 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:48.391805 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4763cc03-082b-4dd3-9c04-ad599f31813e tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] HTTP exception thrown: This rule already exists in group 1e67d385-ad87-4bd9-b652-570539ab2ea6 Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4763cc03-082b-4dd3-9c04-ad599f31813e tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Request method failure captured: Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 138 Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVF9r9_NLZgjFvcg6W0iq6ZPqfPt47RUnvOAlKzXLFLmzfNqPYKEtHPz8wW-Y1ua9j9PYutYEbmzs9cQ_Oq5h6g7DWfiOtoDEx8eLsE9B6p7eTzsTqhZX6xej96JsmpoOyHo13CYhL21KGwJU9h1p0Xlp-USn6isiZDuzf_ngcoq-k Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:48.395775 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}] Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 7c85928717d74560a1c8ddd0f2fc4ca8 Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: {"security_group_rule": {"parent_group_id": "1e67d385-ad87-4bd9-b652-570539ab2ea6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:02:48.397066 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: exception: This rule already exists in group 1e67d385-ad87-4bd9-b652-570539ab2ea6 Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1e67d385-ad87-4bd9-b652-570539ab2ea6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 1e67d385-ad87-4bd9-b652-570539ab2ea6 Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:48.397799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 1e67d385-ad87-4bd9-b652-570539ab2ea6 Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 1e67d385-ad87-4bd9-b652-570539ab2ea6 Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:48.399025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4763cc03-082b-4dd3-9c04-ad599f31813e tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Returning 400 to user: This rule already exists in group 1e67d385-ad87-4bd9-b652-570539ab2ea6 {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:48.401739 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4763cc03-082b-4dd3-9c04-ad599f31813e tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.181359 Oct 04 18:02:48.409548 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 248/516] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:48 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:48.435594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b2feaf6a-1db2-48ef-8f2b-f8ead31d3a80 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:48.435594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b2feaf6a-1db2-48ef-8f2b-f8ead31d3a80 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:48.458659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2feaf6a-1db2-48ef-8f2b-f8ead31d3a80 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.460823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2feaf6a-1db2-48ef-8f2b-f8ead31d3a80 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.473450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2feaf6a-1db2-48ef-8f2b-f8ead31d3a80 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.476452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2feaf6a-1db2-48ef-8f2b-f8ead31d3a80 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.477502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2feaf6a-1db2-48ef-8f2b-f8ead31d3a80 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.478300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2feaf6a-1db2-48ef-8f2b-f8ead31d3a80 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.485751 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-73a01b77-62f2-429f-897d-f68a95e846f3 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a/action" status: 202 len: 0 microversion: 2.1 time: 0.210726 Oct 04 18:02:48.487119 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 269/517] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:48 2022] POST /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:48.496542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3992a123-50ca-430d-a3e4-5d3360b9720a tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Calling method '.version_select at 0x7fd4d2394550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:48.607390 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3992a123-50ca-430d-a3e4-5d3360b9720a tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f60189d1edb94aaaa39a9c159912a721?user_id=477d9dec479c4d628d36b960bc3e6440" status: 200 len: 370 microversion: 2.1 time: 0.118733 Oct 04 18:02:48.608562 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 270/518] 10.222.0.18 () {58 vars in 1323 bytes} [Tue Oct 4 18:02:48 2022] GET /compute/v2.1/os-quota-sets/f60189d1edb94aaaa39a9c159912a721?user_id=477d9dec479c4d628d36b960bc3e6440 => generated 370 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:48.613527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74d61d29-8742-4aea-96fd-73c67c681ccf tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Calling method '.version_select at 0x7fd4d23925e0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:48.827803 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b2feaf6a-1db2-48ef-8f2b-f8ead31d3a80 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1648 microversion: 2.1 time: 0.416112 Oct 04 18:02:48.828999 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 249/519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:48 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1648 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:48.846041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3587f9c2-74b9-41a1-9024-4532dd03f4c0 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:48.846851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3587f9c2-74b9-41a1-9024-4532dd03f4c0 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:48.857684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3587f9c2-74b9-41a1-9024-4532dd03f4c0 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.858565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3587f9c2-74b9-41a1-9024-4532dd03f4c0 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.859310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3587f9c2-74b9-41a1-9024-4532dd03f4c0 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.860182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3587f9c2-74b9-41a1-9024-4532dd03f4c0 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.860798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3587f9c2-74b9-41a1-9024-4532dd03f4c0 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.861403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3587f9c2-74b9-41a1-9024-4532dd03f4c0 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.864558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:48.948168 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74d61d29-8742-4aea-96fd-73c67c681ccf tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/d98f7d7c-4932-4be2-b807-133856fb3e5f" status: 202 len: 0 microversion: 2.1 time: 0.336970 Oct 04 18:02:48.953535 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 271/520] 10.222.0.18 () {58 vars in 1287 bytes} [Tue Oct 4 18:02:48 2022] DELETE /compute/v2.1/os-security-group-rules/d98f7d7c-4932-4be2-b807-133856fb3e5f => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:48.978101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2afda389-2184-412a-ada3-3e100e5fef90 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:48.979369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2afda389-2184-412a-ada3-3e100e5fef90 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:49.004325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2afda389-2184-412a-ada3-3e100e5fef90 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:49.010469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2afda389-2184-412a-ada3-3e100e5fef90 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:49.011541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2afda389-2184-412a-ada3-3e100e5fef90 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:49.012970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2afda389-2184-412a-ada3-3e100e5fef90 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:49.014059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2afda389-2184-412a-ada3-3e100e5fef90 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:49.015084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2afda389-2184-412a-ada3-3e100e5fef90 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:49.365134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3587f9c2-74b9-41a1-9024-4532dd03f4c0 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:49.376258 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3587f9c2-74b9-41a1-9024-4532dd03f4c0 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.542731 Oct 04 18:02:49.379887 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 250/521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:48 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:49.403724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-267e1fa5-bd32-49ae-bb6e-5d1c1c1483f2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:49.404335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-267e1fa5-bd32-49ae-bb6e-5d1c1c1483f2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:49.419816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-267e1fa5-bd32-49ae-bb6e-5d1c1c1483f2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:49.420322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-267e1fa5-bd32-49ae-bb6e-5d1c1c1483f2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:49.422926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-267e1fa5-bd32-49ae-bb6e-5d1c1c1483f2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:49.424723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-267e1fa5-bd32-49ae-bb6e-5d1c1c1483f2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:49.427013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-267e1fa5-bd32-49ae-bb6e-5d1c1c1483f2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:49.428460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-267e1fa5-bd32-49ae-bb6e-5d1c1c1483f2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:49.621706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-267e1fa5-bd32-49ae-bb6e-5d1c1c1483f2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:49.650039 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-267e1fa5-bd32-49ae-bb6e-5d1c1c1483f2 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.261426 Oct 04 18:02:49.663306 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 251/522] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:49 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:49.679505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d92366e1-f60a-40bd-bade-e5f0e0dd86f8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:49.683076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d92366e1-f60a-40bd-bade-e5f0e0dd86f8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:49.692070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d92366e1-f60a-40bd-bade-e5f0e0dd86f8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:49.692832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d92366e1-f60a-40bd-bade-e5f0e0dd86f8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:49.693432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d92366e1-f60a-40bd-bade-e5f0e0dd86f8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:49.694752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d92366e1-f60a-40bd-bade-e5f0e0dd86f8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:49.695551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d92366e1-f60a-40bd-bade-e5f0e0dd86f8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:49.696227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d92366e1-f60a-40bd-bade-e5f0e0dd86f8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:49.697365 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2afda389-2184-412a-ada3-3e100e5fef90 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1633 microversion: 2.1 time: 0.735189 Oct 04 18:02:49.697963 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 272/523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:48 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1633 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:49.725075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a25c3154-1a10-4e5c-afdc-5db7b8d6b22c tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d24bedc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1958148107", "description": "tempest-description-39857477"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:49.782746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d92366e1-f60a-40bd-bade-e5f0e0dd86f8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:49.792640 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d92366e1-f60a-40bd-bade-e5f0e0dd86f8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 200 len: 1322 microversion: 2.1 time: 0.129820 Oct 04 18:02:49.793670 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 252/524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:49 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 1322 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:49.800685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-646946551", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "a2884286-aa9a-463d-8f10-555c5aa8fb7e"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:49.869648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] validate_networks() for [('a2884286-aa9a-463d-8f10-555c5aa8fb7e', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:02:50.022702 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a25c3154-1a10-4e5c-afdc-5db7b8d6b22c tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.323656 Oct 04 18:02:50.023699 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 273/525] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:49 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:50.044990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d7e6298-7056-48e8-aa68-9d634a9674b4 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Calling method '.version_select at 0x7fd4d22841f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:50.305237 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3d7e6298-7056-48e8-aa68-9d634a9674b4 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/e503dc09695d46ddba252caa4d6b35ac/defaults" status: 200 len: 371 microversion: 2.1 time: 0.272602 Oct 04 18:02:50.306189 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 274/526] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:02:50 2022] GET /compute/v2.1/os-quota-sets/e503dc09695d46ddba252caa4d6b35ac/defaults => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:50.324987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-58ca563a-62d5-42fb-9926-8bf33bdfe49a tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d2538790>, body: {"security_group_rule": {"parent_group_id": "88308f9d-429b-492d-8ee4-678e30922e86", "ip_protocol": "tcp", "from_port": 627184979, "to_port": 22}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:50.404947 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-58ca563a-62d5-42fb-9926-8bf33bdfe49a tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] HTTP exception thrown: Invalid port range 627184979:22. Former value cannot be greater than the later Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-58ca563a-62d5-42fb-9926-8bf33bdfe49a tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Request method failure captured: Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 145 Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHVF9r9_NLZgjFvcg6W0iq6ZPqfPt47RUnvOAlKzXLFLmzfNqPYKEtHPz8wW-Y1ua9j9PYutYEbmzs9cQ_Oq5h6g7DWfiOtoDEx8eLsE9B6p7eTzsTqhZX6xej96JsmpoOyHo13CYhL21KGwJU9h1p0Xlp-USn6isiZDuzf_ngcoq-k Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:02:50.410816 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}] Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 7c85928717d74560a1c8ddd0f2fc4ca8 Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: {"security_group_rule": {"parent_group_id": "88308f9d-429b-492d-8ee4-678e30922e86", "ip_protocol": "tcp", "from_port": 627184979, "to_port": 22}} Oct 04 18:02:50.412959 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid port range 627184979:22. Former value cannot be greater than the later Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'security_group_rule': {'parent_group_id': '88308f9d-429b-492d-8ee4-678e30922e86', 'ip_protocol': 'tcp', 'from_port': 627184979, 'to_port': 22}}} Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 627184979:22. Former value cannot be greater than the later Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:50.413789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 627184979:22. Former value cannot be greater than the later Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 627184979:22. Former value cannot be greater than the later Oct 04 18:02:50.415073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:50.417407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-58ca563a-62d5-42fb-9926-8bf33bdfe49a tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Returning 400 to user: Invalid port range 627184979:22. Former value cannot be greater than the later {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:50.417407 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-58ca563a-62d5-42fb-9926-8bf33bdfe49a tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.105396 Oct 04 18:02:50.423349 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 275/527] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:50 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:50.439849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f08e1624-5470-40a1-b3b4-d70cd0f5bd93 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d2394940>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:50.448223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:50.450491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:50.451622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:50.452555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:50.453237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:50.467944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:50.468982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:50.469928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.471474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:50.472223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:50.472935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.505253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Getting quotas for project bc4df90b761348c082e7787ff4925299. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:50.512994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Getting quotas for user 327e7f9ab3d74ff4a4d1bb86d15ad8fc and project bc4df90b761348c082e7787ff4925299. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:50.532673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:50.539217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:50.548891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f08e1624-5470-40a1-b3b4-d70cd0f5bd93 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:50.549880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f08e1624-5470-40a1-b3b4-d70cd0f5bd93 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:50.550467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f08e1624-5470-40a1-b3b4-d70cd0f5bd93 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.552165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f08e1624-5470-40a1-b3b4-d70cd0f5bd93 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:50.553100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f08e1624-5470-40a1-b3b4-d70cd0f5bd93 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:50.553876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f08e1624-5470-40a1-b3b4-d70cd0f5bd93 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.600396 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fb179be7-b95b-4075-b49c-d82aaf8a8451 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805392 Oct 04 18:02:50.608031 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 253/528] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:02:50.615015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e21b3842-aea0-4f66-868d-8dabb5a5d588 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:50.615774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e21b3842-aea0-4f66-868d-8dabb5a5d588 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:50.623558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e21b3842-aea0-4f66-868d-8dabb5a5d588 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:50.624065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e21b3842-aea0-4f66-868d-8dabb5a5d588 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:50.624515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e21b3842-aea0-4f66-868d-8dabb5a5d588 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.625217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e21b3842-aea0-4f66-868d-8dabb5a5d588 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:50.625882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e21b3842-aea0-4f66-868d-8dabb5a5d588 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:50.627565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e21b3842-aea0-4f66-868d-8dabb5a5d588 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.828338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e21b3842-aea0-4f66-868d-8dabb5a5d588 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:50.841545 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e21b3842-aea0-4f66-868d-8dabb5a5d588 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.231766 Oct 04 18:02:50.855021 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 254/529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:50 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:50.856983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-37619428-2c9e-40bf-a4e6-3495a83e6170 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d2429040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1622348743", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-37619428-2c9e-40bf-a4e6-3495a83e6170 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] HTTP exception thrown: Security group id should be uuid Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-37619428-2c9e-40bf-a4e6-3495a83e6170 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Request method failure captured: Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 131 Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVF9r9_NLZgjFvcg6W0iq6ZPqfPt47RUnvOAlKzXLFLmzfNqPYKEtHPz8wW-Y1ua9j9PYutYEbmzs9cQ_Oq5h6g7DWfiOtoDEx8eLsE9B6p7eTzsTqhZX6xej96JsmpoOyHo13CYhL21KGwJU9h1p0Xlp-USn6isiZDuzf_ngcoq-k Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:50.867056 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}] Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 7c85928717d74560a1c8ddd0f2fc4ca8 Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1622348743", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:02:50.886436 n-d-850499-14 devstack@n-api.service[122331]: exception: Security group id should be uuid Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1622348743', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:50.898848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-37619428-2c9e-40bf-a4e6-3495a83e6170 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Returning 400 to user: Security group id should be uuid {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:50.904548 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-37619428-2c9e-40bf-a4e6-3495a83e6170 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.020496 Oct 04 18:02:50.907594 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 255/530] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:50 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:02:50.907594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65b52873-f62e-4010-bd8b-c0f8b683ec69 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:50.907594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65b52873-f62e-4010-bd8b-c0f8b683ec69 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:50.972324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65b52873-f62e-4010-bd8b-c0f8b683ec69 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:50.983316 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65b52873-f62e-4010-bd8b-c0f8b683ec69 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1210 microversion: 2.1 time: 0.106073 Oct 04 18:02:50.995063 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 256/531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:50 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:50.999383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-68d527d3-bd58-4443-8e94-820782928719 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:51.000012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-68d527d3-bd58-4443-8e94-820782928719 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:51.006942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d527d3-bd58-4443-8e94-820782928719 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.007472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d527d3-bd58-4443-8e94-820782928719 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.008065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d527d3-bd58-4443-8e94-820782928719 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.008767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d527d3-bd58-4443-8e94-820782928719 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.009728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d527d3-bd58-4443-8e94-820782928719 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.010247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d527d3-bd58-4443-8e94-820782928719 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.011903 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f08e1624-5470-40a1-b3b4-d70cd0f5bd93 tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/e503dc09695d46ddba252caa4d6b35ac" status: 200 len: 329 microversion: 2.1 time: 0.587098 Oct 04 18:02:51.019793 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 276/532] 10.222.0.18 () {60 vars in 1263 bytes} [Tue Oct 4 18:02:50 2022] PUT /compute/v2.1/os-quota-sets/e503dc09695d46ddba252caa4d6b35ac => generated 329 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:51.019793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02238c66-e125-492d-a2cf-e898b29947f7 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:51.019793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-02238c66-e125-492d-a2cf-e898b29947f7 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:51.025275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02238c66-e125-492d-a2cf-e898b29947f7 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.025770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02238c66-e125-492d-a2cf-e898b29947f7 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.026212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02238c66-e125-492d-a2cf-e898b29947f7 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.026922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02238c66-e125-492d-a2cf-e898b29947f7 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.027428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02238c66-e125-492d-a2cf-e898b29947f7 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.027831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02238c66-e125-492d-a2cf-e898b29947f7 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.146312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-68d527d3-bd58-4443-8e94-820782928719 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:51.177357 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-68d527d3-bd58-4443-8e94-820782928719 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.190983 Oct 04 18:02:51.179850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 257/533] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:50 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:51.187219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8cb2a17f-1829-47b4-9c83-467771fc8288 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:51.187852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8cb2a17f-1829-47b4-9c83-467771fc8288 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:51.204313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cb2a17f-1829-47b4-9c83-467771fc8288 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.204817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cb2a17f-1829-47b4-9c83-467771fc8288 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.205260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cb2a17f-1829-47b4-9c83-467771fc8288 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.206020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cb2a17f-1829-47b4-9c83-467771fc8288 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.206440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cb2a17f-1829-47b4-9c83-467771fc8288 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.206866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cb2a17f-1829-47b4-9c83-467771fc8288 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.235076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-02238c66-e125-492d-a2cf-e898b29947f7 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1616 microversion: 2.1 time: 0.219483 Oct 04 18:02:51.236876 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 277/534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:51 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1616 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:51.248506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a33a63b-0919-4ea2-8e84-ccd48bdc2828 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d23db8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-738868438", "description": "tempest-description-1803530079"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:51.616116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8cb2a17f-1829-47b4-9c83-467771fc8288 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:51.627493 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8cb2a17f-1829-47b4-9c83-467771fc8288 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 200 len: 1389 microversion: 2.1 time: 0.446252 Oct 04 18:02:51.628684 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 258/535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:51 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 1389 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:51.630842 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a33a63b-0919-4ea2-8e84-ccd48bdc2828 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.391659 Oct 04 18:02:51.631568 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 278/536] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:51 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:51.645083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:51.646038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc682dcd-4869-4562-9e70-03e3a7dd397c tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d238edc0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:51.646300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:51.669574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.669991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.670188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.671057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.673557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.674230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.715212 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] HTTP exception thrown: Cannot 'migrate' instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a while it is in vm_state suspended Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Request method failure captured: Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a/action HTTP/1.1 Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 15 Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUbO3zEGEf3vLeo_0O9zoWw-E7PsKqViKO9tXWGgjwDmYlDhMWd5CkE_55VE-Z3gO3nGBLf89M3wReKMNuUZBIh8c33ucfp_y0XjVtqRZ56FbrRsbKvhk3PzuV2OpKajzdf_ddgo_p8uL1-UKQAbrCMnnMpcaJo7lgEqh0NTx1uLvE Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 5ffd3c23e7394152a7f53709b3c01e14 Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:02:51.717562 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ffd3c23e7394152a7f53709b3c01e14"}]}] Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 5ffd3c23e7394152a7f53709b3c01e14 Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersAdminNegativeTestJSON-455994400-project-admin Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 8489fb7e58214f4289ae745f6c9e12cc Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersAdminNegativeTestJSON-455994400-project-admin Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: {"migrate": {}} Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:51.719141 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'migrate' instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a while it is in vm_state suspended Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a', 'body': {'migrate': {}}} Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.720094 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a while it is in vm_state suspended Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:51.721432 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:51.722571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:51.722571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:51.722571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a while it is in vm_state suspended Oct 04 18:02:51.722571 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.724515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Returning 409 to user: Cannot 'migrate' instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a while it is in vm_state suspended {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:51.725389 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ee7f99a-f05a-44c3-b64f-f3eab23a5a16 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a/action" status: 409 len: 148 microversion: 2.1 time: 0.092814 Oct 04 18:02:51.727057 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 279/537] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:51 2022] POST /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a/action => generated 148 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:02:51.732518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-65fdce14-c7ce-4ee8-afc4-0a785f93d2d6 req-49f8160e-751d-427a-b549-19a893edbf49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeedbae9-0976-4ec6-9479-7b2a15f6ab62", "tag": "2ab28775-1d8a-4368-8ae8-a885b0ab183e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:51.745886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-65fdce14-c7ce-4ee8-afc4-0a785f93d2d6 req-49f8160e-751d-427a-b549-19a893edbf49 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.746842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-65fdce14-c7ce-4ee8-afc4-0a785f93d2d6 req-49f8160e-751d-427a-b549-19a893edbf49 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.747719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-65fdce14-c7ce-4ee8-afc4-0a785f93d2d6 req-49f8160e-751d-427a-b549-19a893edbf49 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.762284 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-65fdce14-c7ce-4ee8-afc4-0a785f93d2d6 req-49f8160e-751d-427a-b549-19a893edbf49 service nova] Creating event network-changed:2ab28775-1d8a-4368-8ae8-a885b0ab183e for instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 on n-h1-850499-14 Oct 04 18:02:51.768941 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-65fdce14-c7ce-4ee8-afc4-0a785f93d2d6 req-49f8160e-751d-427a-b549-19a893edbf49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041785 Oct 04 18:02:51.772330 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 280/538] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:51.783018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c12b91e8-1840-4980-801f-792736c19e70 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d22e1d30>, body: {"security_group_rule": {"parent_group_id": "9df282a2-25cd-4c82-b382-822e6a2b3b6a", "ip_protocol": "tempest-999-52742291", "from_port": 22, "to_port": 22}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:51.812601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc682dcd-4869-4562-9e70-03e3a7dd397c tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.812601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc682dcd-4869-4562-9e70-03e3a7dd397c tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.813014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc682dcd-4869-4562-9e70-03e3a7dd397c tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.813868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc682dcd-4869-4562-9e70-03e3a7dd397c tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:51.814316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc682dcd-4869-4562-9e70-03e3a7dd397c tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:51.814813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc682dcd-4869-4562-9e70-03e3a7dd397c tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:51.863332 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-c12b91e8-1840-4980-801f-792736c19e70 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] HTTP exception thrown: Invalid IP protocol tempest-999-52742291. Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c12b91e8-1840-4980-801f-792736c19e70 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Request method failure captured: Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 155 Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHVF9r9_NLZgjFvcg6W0iq6ZPqfPt47RUnvOAlKzXLFLmzfNqPYKEtHPz8wW-Y1ua9j9PYutYEbmzs9cQ_Oq5h6g7DWfiOtoDEx8eLsE9B6p7eTzsTqhZX6xej96JsmpoOyHo13CYhL21KGwJU9h1p0Xlp-USn6isiZDuzf_ngcoq-k Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:02:51.868339 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}] Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 7c85928717d74560a1c8ddd0f2fc4ca8 Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: {"security_group_rule": {"parent_group_id": "9df282a2-25cd-4c82-b382-822e6a2b3b6a", "ip_protocol": "tempest-999-52742291", "from_port": 22, "to_port": 22}} Oct 04 18:02:51.869681 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid IP protocol tempest-999-52742291. Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9df282a2-25cd-4c82-b382-822e6a2b3b6a', 'ip_protocol': 'tempest-999-52742291', 'from_port': 22, 'to_port': 22}}} Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-52742291. Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:51.870405 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-52742291. Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-52742291. Oct 04 18:02:51.872620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.874816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c12b91e8-1840-4980-801f-792736c19e70 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Returning 400 to user: Invalid IP protocol tempest-999-52742291. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:51.874816 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c12b91e8-1840-4980-801f-792736c19e70 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.096938 Oct 04 18:02:51.876818 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 281/539] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:51 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:02:51.893612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aab1d63c-e718-4e1f-88cf-65dd23e4f598 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aab1d63c-e718-4e1f-88cf-65dd23e4f598 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Request method failure captured: Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308/action HTTP/1.1 Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 39 Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUbO3zEGEf3vLeo_0O9zoWw-E7PsKqViKO9tXWGgjwDmYlDhMWd5CkE_55VE-Z3gO3nGBLf89M3wReKMNuUZBIh8c33ucfp_y0XjVtqRZ56FbrRsbKvhk3PzuV2OpKajzdf_ddgo_p8uL1-UKQAbrCMnnMpcaJo7lgEqh0NTx1uLvE Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 5ffd3c23e7394152a7f53709b3c01e14 Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:02:51.904396 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ffd3c23e7394152a7f53709b3c01e14"}]}] Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 5ffd3c23e7394152a7f53709b3c01e14 Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersAdminNegativeTestJSON-455994400-project-admin Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 8489fb7e58214f4289ae745f6c9e12cc Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersAdminNegativeTestJSON-455994400-project-admin Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: {"os-resetState": {"state": "invalid"}} Oct 04 18:02:51.907300 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'cfa216bb-86aa-4a96-b668-db3f973d0308', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:51.908786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:02:51.913402 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:02:51.918025 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:51.918999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aab1d63c-e718-4e1f-88cf-65dd23e4f598 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:51.920134 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aab1d63c-e718-4e1f-88cf-65dd23e4f598 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308/action" status: 400 len: 144 microversion: 2.1 time: 0.041479 Oct 04 18:02:51.922992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 282/540] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:51 2022] POST /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308/action => generated 144 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:51.936594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9bb27a01-95f5-4940-b033-4a75da6ca613 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d2668550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1652407232", "description": "tempest-description-224461146"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:52.147854 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9bb27a01-95f5-4940-b033-4a75da6ca613 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.225069 Oct 04 18:02:52.149073 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 283/541] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:51 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:52.160698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5a1b91d7-8b10-4e25-ad04-91c0441f02e4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:52.162488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5a1b91d7-8b10-4e25-ad04-91c0441f02e4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:52.170459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a1b91d7-8b10-4e25-ad04-91c0441f02e4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:52.171268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a1b91d7-8b10-4e25-ad04-91c0441f02e4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:52.172220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a1b91d7-8b10-4e25-ad04-91c0441f02e4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:52.173139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a1b91d7-8b10-4e25-ad04-91c0441f02e4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:52.173597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a1b91d7-8b10-4e25-ad04-91c0441f02e4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:52.174062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a1b91d7-8b10-4e25-ad04-91c0441f02e4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:52.190705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=17,nova_api:UPDATE=13 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:52.201130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:52.225954 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc682dcd-4869-4562-9e70-03e3a7dd397c tempest-QuotasAdminTestJSON-1144088821 tempest-QuotasAdminTestJSON-1144088821-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/e503dc09695d46ddba252caa4d6b35ac" status: 200 len: 329 microversion: 2.1 time: 0.595687 Oct 04 18:02:52.226917 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 259/542] 10.222.0.18 () {60 vars in 1263 bytes} [Tue Oct 4 18:02:51 2022] PUT /compute/v2.1/os-quota-sets/e503dc09695d46ddba252caa4d6b35ac => generated 329 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:52.236951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7528682e-2be9-4106-878c-0f0bdac890a2 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7528682e-2be9-4106-878c-0f0bdac890a2 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Request method failure captured: Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308/action HTTP/1.1 Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 31 Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUbO3zEGEf3vLeo_0O9zoWw-E7PsKqViKO9tXWGgjwDmYlDhMWd5CkE_55VE-Z3gO3nGBLf89M3wReKMNuUZBIh8c33ucfp_y0XjVtqRZ56FbrRsbKvhk3PzuV2OpKajzdf_ddgo_p8uL1-UKQAbrCMnnMpcaJo7lgEqh0NTx1uLvE Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5ffd3c23e7394152a7f53709b3c01e14 Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:02:52.241921 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ffd3c23e7394152a7f53709b3c01e14"}]}] Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5ffd3c23e7394152a7f53709b3c01e14 Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersAdminNegativeTestJSON-455994400-project-admin Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 8489fb7e58214f4289ae745f6c9e12cc Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersAdminNegativeTestJSON-455994400-project-admin Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: {"os-resetState": {"state": 1}} Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:52.243566 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'cfa216bb-86aa-4a96-b668-db3f973d0308', 'body': {'os-resetState': {'state': 1}}} Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 1 Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:52.244327 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:02:52.245655 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.248071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7528682e-2be9-4106-878c-0f0bdac890a2 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:52.248071 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7528682e-2be9-4106-878c-0f0bdac890a2 tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308/action" status: 400 len: 120 microversion: 2.1 time: 0.015411 Oct 04 18:02:52.250763 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 260/543] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:52 2022] POST /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308/action => generated 120 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:52.256234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb623c7a-8f93-4900-9246-177c274ece3d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:52.256885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bb623c7a-8f93-4900-9246-177c274ece3d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:52.265270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb623c7a-8f93-4900-9246-177c274ece3d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:52.265862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb623c7a-8f93-4900-9246-177c274ece3d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:52.266406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb623c7a-8f93-4900-9246-177c274ece3d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:52.267475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb623c7a-8f93-4900-9246-177c274ece3d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:52.267862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb623c7a-8f93-4900-9246-177c274ece3d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:52.268294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb623c7a-8f93-4900-9246-177c274ece3d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:52.362766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bb623c7a-8f93-4900-9246-177c274ece3d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:52.380718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb623c7a-8f93-4900-9246-177c274ece3d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1262 microversion: 2.1 time: 0.127740 Oct 04 18:02:52.381931 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 261/544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:52 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1262 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:52.396147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-53550e58-6f9d-4119-8b15-234ce7d4c196 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d22b43a0>, body: {"security_group_rule": {"parent_group_id": "b4ddda77-4ff3-4733-b428-13c98f4c0848", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:52.402709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5a1b91d7-8b10-4e25-ad04-91c0441f02e4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:52.411858 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5a1b91d7-8b10-4e25-ad04-91c0441f02e4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.261307 Oct 04 18:02:52.412460 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 284/545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:52 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:52.417758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-863ded5d-cb57-4032-8179-9d299f4e5155 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:52.418384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-863ded5d-cb57-4032-8179-9d299f4e5155 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:52.425636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-863ded5d-cb57-4032-8179-9d299f4e5155 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:52.426205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-863ded5d-cb57-4032-8179-9d299f4e5155 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:52.426684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-863ded5d-cb57-4032-8179-9d299f4e5155 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:52.427436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-863ded5d-cb57-4032-8179-9d299f4e5155 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:52.427904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-863ded5d-cb57-4032-8179-9d299f4e5155 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:52.428387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-863ded5d-cb57-4032-8179-9d299f4e5155 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:52.543673 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-53550e58-6f9d-4119-8b15-234ce7d4c196 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-53550e58-6f9d-4119-8b15-234ce7d4c196 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Request method failure captured: Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 138 Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVF9r9_NLZgjFvcg6W0iq6ZPqfPt47RUnvOAlKzXLFLmzfNqPYKEtHPz8wW-Y1ua9j9PYutYEbmzs9cQ_Oq5h6g7DWfiOtoDEx8eLsE9B6p7eTzsTqhZX6xej96JsmpoOyHo13CYhL21KGwJU9h1p0Xlp-USn6isiZDuzf_ngcoq-k Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:52.546458 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}] Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 7c85928717d74560a1c8ddd0f2fc4ca8 Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: {"security_group_rule": {"parent_group_id": "b4ddda77-4ff3-4733-b428-13c98f4c0848", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 18:02:52.548024 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b4ddda77-4ff3-4733-b428-13c98f4c0848', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:52.548754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:02:52.550194 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.557837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-53550e58-6f9d-4119-8b15-234ce7d4c196 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:52.557837 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-53550e58-6f9d-4119-8b15-234ce7d4c196 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.165828 Oct 04 18:02:52.557837 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 262/546] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:52 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:52.563572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9899341f-b3d6-4bfd-9609-7df7ae70382c tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:52.568139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9899341f-b3d6-4bfd-9609-7df7ae70382c tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Failed to fetch instance by id 999 {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:02:52.568984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-9899341f-b3d6-4bfd-9609-7df7ae70382c tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9899341f-b3d6-4bfd-9609-7df7ae70382c tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Request method failure captured: Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 37 Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUbO3zEGEf3vLeo_0O9zoWw-E7PsKqViKO9tXWGgjwDmYlDhMWd5CkE_55VE-Z3gO3nGBLf89M3wReKMNuUZBIh8c33ucfp_y0XjVtqRZ56FbrRsbKvhk3PzuV2OpKajzdf_ddgo_p8uL1-UKQAbrCMnnMpcaJo7lgEqh0NTx1uLvE Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5ffd3c23e7394152a7f53709b3c01e14 Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:02:52.572516 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ffd3c23e7394152a7f53709b3c01e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ffd3c23e7394152a7f53709b3c01e14"}]}] Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5ffd3c23e7394152a7f53709b3c01e14 Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-455994400 Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersAdminNegativeTestJSON-455994400-project-admin Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 8489fb7e58214f4289ae745f6c9e12cc Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersAdminNegativeTestJSON-455994400-project-admin Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: {"os-resetState": {"state": "error"}} Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:02:52.573814 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 999 could not be found. Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:02:52.574607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 18:02:52.576563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:52.577949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-863ded5d-cb57-4032-8179-9d299f4e5155 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:52.578121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9899341f-b3d6-4bfd-9609-7df7ae70382c tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:52.578121 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9899341f-b3d6-4bfd-9609-7df7ae70382c tempest-ServersAdminNegativeTestJSON-455994400 tempest-ServersAdminNegativeTestJSON-455994400-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.022600 Oct 04 18:02:52.578121 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 263/547] 10.222.0.18 () {60 vars in 1179 bytes} [Tue Oct 4 18:02:52 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:02:52.614393 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-863ded5d-cb57-4032-8179-9d299f4e5155 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.199924 Oct 04 18:02:52.620085 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 285/548] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:52 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:52.626349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d0a9efd-38ce-4de1-8b3b-78a62aaf68cb tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d22e1d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1962935035", "description": "tempest-description-1634866357"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:52.883860 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d0a9efd-38ce-4de1-8b3b-78a62aaf68cb tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.262227 Oct 04 18:02:52.885676 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 286/549] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:52 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:52.898628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8614e220-88ed-45dd-a71a-4e71dc1e1e8b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:52.899420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8614e220-88ed-45dd-a71a-4e71dc1e1e8b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:52.909703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8614e220-88ed-45dd-a71a-4e71dc1e1e8b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:52.917857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8614e220-88ed-45dd-a71a-4e71dc1e1e8b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:52.921516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8614e220-88ed-45dd-a71a-4e71dc1e1e8b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:52.923227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8614e220-88ed-45dd-a71a-4e71dc1e1e8b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:52.924213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8614e220-88ed-45dd-a71a-4e71dc1e1e8b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:52.925668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8614e220-88ed-45dd-a71a-4e71dc1e1e8b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:52.927567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e40c7a6a-cc43-4aab-9dd7-98c7fa704f0a tempest-QuotaClassesAdmin257Test-2006500580 tempest-QuotaClassesAdmin257Test-2006500580-project-admin] Calling method '.version_select at 0x7fd4d22b40d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:52.943012 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e40c7a6a-cc43-4aab-9dd7-98c7fa704f0a tempest-QuotaClassesAdmin257Test-2006500580 tempest-QuotaClassesAdmin257Test-2006500580-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.365838 Oct 04 18:02:52.943586 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 264/550] 10.222.0.18 () {60 vars in 1226 bytes} [Tue Oct 4 18:02:52 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:02:52.949044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65bfa8b5-afcf-4e1b-b604-0eec14a2d4e8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:52.949754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65bfa8b5-afcf-4e1b-b604-0eec14a2d4e8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:52.956079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65bfa8b5-afcf-4e1b-b604-0eec14a2d4e8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:52.956748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65bfa8b5-afcf-4e1b-b604-0eec14a2d4e8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:52.957199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65bfa8b5-afcf-4e1b-b604-0eec14a2d4e8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:52.958462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65bfa8b5-afcf-4e1b-b604-0eec14a2d4e8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:52.958933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65bfa8b5-afcf-4e1b-b604-0eec14a2d4e8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:52.959398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65bfa8b5-afcf-4e1b-b604-0eec14a2d4e8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:52.985609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8614e220-88ed-45dd-a71a-4e71dc1e1e8b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:02:53.136165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8614e220-88ed-45dd-a71a-4e71dc1e1e8b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 204 len: 0 microversion: 2.1 time: 0.245516 Oct 04 18:02:53.138737 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 287/551] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:02:52 2022] DELETE /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:02:53.151611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f38b1a4f-c683-4970-a55a-fda9e63122d7 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d24be3a0>, body: {"security_group_rule": {"parent_group_id": "2e779261-01e9-4d86-b3eb-91b34efe3623", "ip_protocol": "tcp", "from_port": 22, "to_port": 1317888010}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:53.316915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65bfa8b5-afcf-4e1b-b604-0eec14a2d4e8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:53.337005 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65bfa8b5-afcf-4e1b-b604-0eec14a2d4e8 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 200 len: 1389 microversion: 2.1 time: 0.391637 Oct 04 18:02:53.338240 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 265/552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:52 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 1389 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:53.372273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-08a195fc-06e5-49de-a81b-f307ccb63458 tempest-QuotaClassesAdmin257Test-2006500580 tempest-QuotaClassesAdmin257Test-2006500580-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d2350430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:53.402536 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-f38b1a4f-c683-4970-a55a-fda9e63122d7 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] HTTP exception thrown: Invalid port range 22:1317888010. Valid TCP ports should be between 1-65535 Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f38b1a4f-c683-4970-a55a-fda9e63122d7 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Request method failure captured: Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 146 Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHVF9r9_NLZgjFvcg6W0iq6ZPqfPt47RUnvOAlKzXLFLmzfNqPYKEtHPz8wW-Y1ua9j9PYutYEbmzs9cQ_Oq5h6g7DWfiOtoDEx8eLsE9B6p7eTzsTqhZX6xej96JsmpoOyHo13CYhL21KGwJU9h1p0Xlp-USn6isiZDuzf_ngcoq-k Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:02:53.407565 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}] Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 7c85928717d74560a1c8ddd0f2fc4ca8 Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: {"security_group_rule": {"parent_group_id": "2e779261-01e9-4d86-b3eb-91b34efe3623", "ip_protocol": "tcp", "from_port": 22, "to_port": 1317888010}} Oct 04 18:02:53.408910 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid port range 22:1317888010. Valid TCP ports should be between 1-65535 Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2e779261-01e9-4d86-b3eb-91b34efe3623', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1317888010}}} Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1317888010. Valid TCP ports should be between 1-65535 Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:53.409720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1317888010. Valid TCP ports should be between 1-65535 Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1317888010. Valid TCP ports should be between 1-65535 Oct 04 18:02:53.410815 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.411952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f38b1a4f-c683-4970-a55a-fda9e63122d7 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Returning 400 to user: Invalid port range 22:1317888010. Valid TCP ports should be between 1-65535 {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:53.411952 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f38b1a4f-c683-4970-a55a-fda9e63122d7 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.269171 Oct 04 18:02:53.417151 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 288/553] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:53 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 278 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:53.461208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00510c55-39f2-413f-9385-884b8ab97ae6 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:53.465289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00510c55-39f2-413f-9385-884b8ab97ae6 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:53.489797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00510c55-39f2-413f-9385-884b8ab97ae6 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.493900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00510c55-39f2-413f-9385-884b8ab97ae6 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.495813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00510c55-39f2-413f-9385-884b8ab97ae6 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.501458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00510c55-39f2-413f-9385-884b8ab97ae6 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.502548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00510c55-39f2-413f-9385-884b8ab97ae6 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.503668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00510c55-39f2-413f-9385-884b8ab97ae6 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.773509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00510c55-39f2-413f-9385-884b8ab97ae6 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:53.783714 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00510c55-39f2-413f-9385-884b8ab97ae6 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1469 microversion: 2.1 time: 0.362960 Oct 04 18:02:53.784858 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 289/554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:53 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1469 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:53.796370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea5c6aaa-6de6-404f-bb4a-628272319c79 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:53.797395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ea5c6aaa-6de6-404f-bb4a-628272319c79 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:53.804772 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-08a195fc-06e5-49de-a81b-f307ccb63458 tempest-QuotaClassesAdmin257Test-2006500580 tempest-QuotaClassesAdmin257Test-2006500580-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.447310 Oct 04 18:02:53.806505 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 266/555] 10.222.0.18 () {62 vars in 1247 bytes} [Tue Oct 4 18:02:53 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:02:53.816055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42185df8-9737-46dc-ab93-11e58b1cc145 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Action: 'create', calling method: .version_select at 0x7fd4d2288e50>, body: {"security_group_rule": {"parent_group_id": "d1bab986-acc0-4a05-8d28-cf132ea86128", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:53.819340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5c6aaa-6de6-404f-bb4a-628272319c79 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.823449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5c6aaa-6de6-404f-bb4a-628272319c79 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.823917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5c6aaa-6de6-404f-bb4a-628272319c79 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.824662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5c6aaa-6de6-404f-bb4a-628272319c79 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.825133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5c6aaa-6de6-404f-bb4a-628272319c79 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.825567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5c6aaa-6de6-404f-bb4a-628272319c79 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.860422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-42185df8-9737-46dc-ab93-11e58b1cc145 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1bab986-acc0-4a05-8d28-cf132ea86128 does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:02:53.861034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-42185df8-9737-46dc-ab93-11e58b1cc145 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Neutron security group d1bab986-acc0-4a05-8d28-cf132ea86128 not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:02:53.861570 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-42185df8-9737-46dc-ab93-11e58b1cc145 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] HTTP exception thrown: Security group d1bab986-acc0-4a05-8d28-cf132ea86128 does not exist Oct 04 18:02:53.861570 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-80512263-c13e-4e66-bb6b-a228bba8d460'] Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42185df8-9737-46dc-ab93-11e58b1cc145 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Request method failure captured: Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 138 Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVF9r9_NLZgjFvcg6W0iq6ZPqfPt47RUnvOAlKzXLFLmzfNqPYKEtHPz8wW-Y1ua9j9PYutYEbmzs9cQ_Oq5h6g7DWfiOtoDEx8eLsE9B6p7eTzsTqhZX6xej96JsmpoOyHo13CYhL21KGwJU9h1p0Xlp-USn6isiZDuzf_ngcoq-k Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:53.877076 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}] Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 7c85928717d74560a1c8ddd0f2fc4ca8 Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: {"security_group_rule": {"parent_group_id": "d1bab986-acc0-4a05-8d28-cf132ea86128", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:02:53.878576 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: exception: Security group d1bab986-acc0-4a05-8d28-cf132ea86128 does not exist Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-80512263-c13e-4e66-bb6b-a228bba8d460'] Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd1bab986-acc0-4a05-8d28-cf132ea86128', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:02:53.879365 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1bab986-acc0-4a05-8d28-cf132ea86128 does not exist Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80512263-c13e-4e66-bb6b-a228bba8d460'] Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 18:02:53.880639 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1bab986-acc0-4a05-8d28-cf132ea86128 does not exist Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80512263-c13e-4e66-bb6b-a228bba8d460'] Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1bab986-acc0-4a05-8d28-cf132ea86128 does not exist Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80512263-c13e-4e66-bb6b-a228bba8d460'] Oct 04 18:02:53.881769 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1bab986-acc0-4a05-8d28-cf132ea86128 does not exist Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80512263-c13e-4e66-bb6b-a228bba8d460'] Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42185df8-9737-46dc-ab93-11e58b1cc145 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Returning 404 to user: Security group d1bab986-acc0-4a05-8d28-cf132ea86128 does not exist Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-80512263-c13e-4e66-bb6b-a228bba8d460'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:53.882923 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42185df8-9737-46dc-ab93-11e58b1cc145 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.073858 Oct 04 18:02:53.883970 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 267/556] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:02:53 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:53.908327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab17c93e-6160-4f40-a3a5-25721e58a837 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:53.911202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ab17c93e-6160-4f40-a3a5-25721e58a837 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:53.940326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab17c93e-6160-4f40-a3a5-25721e58a837 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.940326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab17c93e-6160-4f40-a3a5-25721e58a837 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.940326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab17c93e-6160-4f40-a3a5-25721e58a837 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.941059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab17c93e-6160-4f40-a3a5-25721e58a837 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.941059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab17c93e-6160-4f40-a3a5-25721e58a837 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.941424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab17c93e-6160-4f40-a3a5-25721e58a837 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:54.148035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ea5c6aaa-6de6-404f-bb4a-628272319c79 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:54.162091 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ea5c6aaa-6de6-404f-bb4a-628272319c79 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.375129 Oct 04 18:02:54.163487 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 290/557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:53 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:54.175999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-223ae018-cc50-4b7c-a8f4-f0e8923aadb7 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:54.178625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-223ae018-cc50-4b7c-a8f4-f0e8923aadb7 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:54.183911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ab17c93e-6160-4f40-a3a5-25721e58a837 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:54.196377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-223ae018-cc50-4b7c-a8f4-f0e8923aadb7 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:54.197131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-223ae018-cc50-4b7c-a8f4-f0e8923aadb7 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:54.197322 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ab17c93e-6160-4f40-a3a5-25721e58a837 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.311515 Oct 04 18:02:54.197825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-223ae018-cc50-4b7c-a8f4-f0e8923aadb7 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:54.198660 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 268/558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:53 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:54.198872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-223ae018-cc50-4b7c-a8f4-f0e8923aadb7 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:54.199791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-223ae018-cc50-4b7c-a8f4-f0e8923aadb7 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:54.200709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-223ae018-cc50-4b7c-a8f4-f0e8923aadb7 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:54.204540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a083715c-776b-411d-aabb-abc6609e03f7 tempest-QuotaClassesAdmin257Test-2006500580 tempest-QuotaClassesAdmin257Test-2006500580-project-admin] Calling method '.version_select at 0x7fd4d2288e50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:54.218001 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a083715c-776b-411d-aabb-abc6609e03f7 tempest-QuotaClassesAdmin257Test-2006500580 tempest-QuotaClassesAdmin257Test-2006500580-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.017767 Oct 04 18:02:54.219795 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 269/559] 10.222.0.18 () {60 vars in 1226 bytes} [Tue Oct 4 18:02:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:02:54.226997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e364e4b4-a35d-4440-affb-d1565f82e11b tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Calling method '.version_select at 0x7fd4d2535820>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:54.251956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-e364e4b4-a35d-4440-affb-d1565f82e11b tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 1fc4fc5c-e683-482f-ab9b-3faec1c37269 does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:02:54.252784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-e364e4b4-a35d-4440-affb-d1565f82e11b tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Neutron security group rule 1fc4fc5c-e683-482f-ab9b-3faec1c37269 not found {{(pid=122331) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 18:02:54.253655 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-e364e4b4-a35d-4440-affb-d1565f82e11b tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] HTTP exception thrown: Security group rule 1fc4fc5c-e683-482f-ab9b-3faec1c37269 does not exist Oct 04 18:02:54.253655 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-ce5b5551-f677-4a51-a161-d84d370dd0cf'] Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e364e4b4-a35d-4440-affb-d1565f82e11b tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Request method failure captured: Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-security-group-rules/1fc4fc5c-e683-482f-ab9b-3faec1c37269 HTTP/1.1 Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVF9r9_NLZgjFvcg6W0iq6ZPqfPt47RUnvOAlKzXLFLmzfNqPYKEtHPz8wW-Y1ua9j9PYutYEbmzs9cQ_Oq5h6g7DWfiOtoDEx8eLsE9B6p7eTzsTqhZX6xej96JsmpoOyHo13CYhL21KGwJU9h1p0Xlp-USn6isiZDuzf_ngcoq-k Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:02:54.256428 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b395c295d75b45ddb1cbc5a61d69a5d4"}]}] Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: b395c295d75b45ddb1cbc5a61d69a5d4 Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102 Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 7c85928717d74560a1c8ddd0f2fc4ca8 Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-215550102-project Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: exception: Security group rule 1fc4fc5c-e683-482f-ab9b-3faec1c37269 does not exist Oct 04 18:02:54.257714 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-ce5b5551-f677-4a51-a161-d84d370dd0cf'] Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '1fc4fc5c-e683-482f-ab9b-3faec1c37269'} Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:54.258463 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 1fc4fc5c-e683-482f-ab9b-3faec1c37269 does not exist Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce5b5551-f677-4a51-a161-d84d370dd0cf'] Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 18:02:54.259570 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 1fc4fc5c-e683-482f-ab9b-3faec1c37269 does not exist Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce5b5551-f677-4a51-a161-d84d370dd0cf'] Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 1fc4fc5c-e683-482f-ab9b-3faec1c37269 does not exist Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce5b5551-f677-4a51-a161-d84d370dd0cf'] Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:54.260600 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:54.261888 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:54.261888 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:54.261888 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:54.261888 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:54.261888 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:54.261888 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:54.261888 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 1fc4fc5c-e683-482f-ab9b-3faec1c37269 does not exist Oct 04 18:02:54.261888 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce5b5551-f677-4a51-a161-d84d370dd0cf'] Oct 04 18:02:54.261888 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:02:54.263561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e364e4b4-a35d-4440-affb-d1565f82e11b tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Returning 404 to user: Security group rule 1fc4fc5c-e683-482f-ab9b-3faec1c37269 does not exist Oct 04 18:02:54.263561 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-ce5b5551-f677-4a51-a161-d84d370dd0cf'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:54.264706 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e364e4b4-a35d-4440-affb-d1565f82e11b tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/1fc4fc5c-e683-482f-ab9b-3faec1c37269" status: 404 len: 199 microversion: 2.1 time: 0.043585 Oct 04 18:02:54.271797 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 270/560] 10.222.0.18 () {58 vars in 1287 bytes} [Tue Oct 4 18:02:54 2022] DELETE /compute/v2.1/os-security-group-rules/1fc4fc5c-e683-482f-ab9b-3faec1c37269 => generated 199 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:54.277247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef876c2d-8ca1-4336-9ab4-f4de3af17fd6 tempest-QuotaClassesAdmin257Test-2006500580 tempest-QuotaClassesAdmin257Test-2006500580-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d2211790>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:54.338112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-223ae018-cc50-4b7c-a8f4-f0e8923aadb7 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:54.369744 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-223ae018-cc50-4b7c-a8f4-f0e8923aadb7 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.203859 Oct 04 18:02:54.375105 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 291/561] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:54 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:54.379452 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef876c2d-8ca1-4336-9ab4-f4de3af17fd6 tempest-QuotaClassesAdmin257Test-2006500580 tempest-QuotaClassesAdmin257Test-2006500580-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.105808 Oct 04 18:02:54.380718 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 271/562] 10.222.0.18 () {62 vars in 1247 bytes} [Tue Oct 4 18:02:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:02:54.388591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3e39a8f1-8aab-4dc0-a7e9-f6fba6811e9c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:54.388777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fd0c6b37-9ca0-4ae0-a75e-1ca818850daa tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Calling method '.version_select at 0x7fd4d2284310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:54.389680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3e39a8f1-8aab-4dc0-a7e9-f6fba6811e9c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:54.399298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e39a8f1-8aab-4dc0-a7e9-f6fba6811e9c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:54.400133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e39a8f1-8aab-4dc0-a7e9-f6fba6811e9c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:54.400811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e39a8f1-8aab-4dc0-a7e9-f6fba6811e9c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:54.401765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e39a8f1-8aab-4dc0-a7e9-f6fba6811e9c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:54.402414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e39a8f1-8aab-4dc0-a7e9-f6fba6811e9c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:54.403799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e39a8f1-8aab-4dc0-a7e9-f6fba6811e9c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:54.646670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3e39a8f1-8aab-4dc0-a7e9-f6fba6811e9c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:54.664760 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3e39a8f1-8aab-4dc0-a7e9-f6fba6811e9c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 200 len: 1389 microversion: 2.1 time: 0.282340 Oct 04 18:02:54.667753 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 272/563] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:54 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 1389 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:54.793367 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fd0c6b37-9ca0-4ae0-a75e-1ca818850daa tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/2e779261-01e9-4d86-b3eb-91b34efe3623" status: 202 len: 0 microversion: 2.1 time: 0.415601 Oct 04 18:02:54.795152 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 292/564] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:02:54 2022] DELETE /compute/v2.1/os-security-groups/2e779261-01e9-4d86-b3eb-91b34efe3623 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:54.813808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-11ad850e-e695-46af-8467-4b30eca7b0d7 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Calling method '.version_select at 0x7fd4d2211310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:54.832931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-14c11eb6-ec68-4027-b084-b6c355c0e06c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:54.834078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-14c11eb6-ec68-4027-b084-b6c355c0e06c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:54.846185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14c11eb6-ec68-4027-b084-b6c355c0e06c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:54.849606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14c11eb6-ec68-4027-b084-b6c355c0e06c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:54.852030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14c11eb6-ec68-4027-b084-b6c355c0e06c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:54.853071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14c11eb6-ec68-4027-b084-b6c355c0e06c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:54.855245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14c11eb6-ec68-4027-b084-b6c355c0e06c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:54.856065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14c11eb6-ec68-4027-b084-b6c355c0e06c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:55.365887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-14c11eb6-ec68-4027-b084-b6c355c0e06c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:55.379777 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-14c11eb6-ec68-4027-b084-b6c355c0e06c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1469 microversion: 2.1 time: 0.552630 Oct 04 18:02:55.396006 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 293/565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:54 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1469 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:55.401923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-36c2c5d9-40a5-4cf5-835c-b7eb7f501c05 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:55.402864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-36c2c5d9-40a5-4cf5-835c-b7eb7f501c05 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:55.411075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c2c5d9-40a5-4cf5-835c-b7eb7f501c05 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:55.412090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c2c5d9-40a5-4cf5-835c-b7eb7f501c05 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:55.412752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c2c5d9-40a5-4cf5-835c-b7eb7f501c05 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:55.413938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c2c5d9-40a5-4cf5-835c-b7eb7f501c05 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:55.414611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c2c5d9-40a5-4cf5-835c-b7eb7f501c05 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:55.415682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c2c5d9-40a5-4cf5-835c-b7eb7f501c05 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.128601 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-11ad850e-e695-46af-8467-4b30eca7b0d7 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/b4ddda77-4ff3-4733-b428-13c98f4c0848" status: 202 len: 0 microversion: 2.1 time: 1.324483 Oct 04 18:02:56.130862 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 273/566] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:02:54 2022] DELETE /compute/v2.1/os-security-groups/b4ddda77-4ff3-4733-b428-13c98f4c0848 => generated 0 bytes in 1330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:56.146264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e00ac988-36df-4254-be6a-098c59c27554 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:56.163240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-36c2c5d9-40a5-4cf5-835c-b7eb7f501c05 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:56.163913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e00ac988-36df-4254-be6a-098c59c27554 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:56.173711 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-36c2c5d9-40a5-4cf5-835c-b7eb7f501c05 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.775840 Oct 04 18:02:56.174288 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 294/567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:55 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:56.183674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-271d7748-7174-4706-9588-9e88e4235c3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:56.187770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-271d7748-7174-4706-9588-9e88e4235c3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:56.202853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-271d7748-7174-4706-9588-9e88e4235c3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.203745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-271d7748-7174-4706-9588-9e88e4235c3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.204362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-271d7748-7174-4706-9588-9e88e4235c3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.205660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-271d7748-7174-4706-9588-9e88e4235c3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.206329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-271d7748-7174-4706-9588-9e88e4235c3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.206927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-271d7748-7174-4706-9588-9e88e4235c3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.236263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e00ac988-36df-4254-be6a-098c59c27554 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.240583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e00ac988-36df-4254-be6a-098c59c27554 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.250419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e00ac988-36df-4254-be6a-098c59c27554 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.257105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e00ac988-36df-4254-be6a-098c59c27554 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.259534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e00ac988-36df-4254-be6a-098c59c27554 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.263077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e00ac988-36df-4254-be6a-098c59c27554 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.423861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-271d7748-7174-4706-9588-9e88e4235c3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:56.472205 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-271d7748-7174-4706-9588-9e88e4235c3c tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1931 microversion: 2.75 time: 0.291821 Oct 04 18:02:56.474237 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 295/568] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:56 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1931 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:56.480362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6431906f-a42e-4805-ad9c-6d069095c927 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:56.482316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6431906f-a42e-4805-ad9c-6d069095c927 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:56.490398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6431906f-a42e-4805-ad9c-6d069095c927 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.491531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6431906f-a42e-4805-ad9c-6d069095c927 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.493099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6431906f-a42e-4805-ad9c-6d069095c927 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.494310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6431906f-a42e-4805-ad9c-6d069095c927 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.494940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6431906f-a42e-4805-ad9c-6d069095c927 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.495614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6431906f-a42e-4805-ad9c-6d069095c927 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.650635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e00ac988-36df-4254-be6a-098c59c27554 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:56.667548 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e00ac988-36df-4254-be6a-098c59c27554 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.534839 Oct 04 18:02:56.669772 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 274/569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:56 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:56.688867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7299e838-8ae0-41dd-a28f-30155928400b req-9a86642c-1c79-4a25-9f3f-a1c4e6bdd2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b090a0-2ada-4af7-be73-c21ed69a3720", "tag": "55fe455b-5dcd-4805-b03b-0514147b4e32"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:56.711550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7299e838-8ae0-41dd-a28f-30155928400b req-9a86642c-1c79-4a25-9f3f-a1c4e6bdd2e1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.712306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7299e838-8ae0-41dd-a28f-30155928400b req-9a86642c-1c79-4a25-9f3f-a1c4e6bdd2e1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.713224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7299e838-8ae0-41dd-a28f-30155928400b req-9a86642c-1c79-4a25-9f3f-a1c4e6bdd2e1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.761638 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7299e838-8ae0-41dd-a28f-30155928400b req-9a86642c-1c79-4a25-9f3f-a1c4e6bdd2e1 service nova] Creating event network-changed:55fe455b-5dcd-4805-b03b-0514147b4e32 for instance 27b090a0-2ada-4af7-be73-c21ed69a3720 on n-h2-850499-14 Oct 04 18:02:56.791607 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7299e838-8ae0-41dd-a28f-30155928400b req-9a86642c-1c79-4a25-9f3f-a1c4e6bdd2e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119891 Oct 04 18:02:56.793738 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 275/570] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:56.815173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b2a3f390-c5d7-43fa-9dfc-352072586c02 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Calling method '.version_select at 0x7fd4d2211af0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:56.953097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6431906f-a42e-4805-ad9c-6d069095c927 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:56.968400 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6431906f-a42e-4805-ad9c-6d069095c927 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 200 len: 1389 microversion: 2.1 time: 0.486719 Oct 04 18:02:56.969708 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 296/571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:56 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 1389 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:57.000372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-95b96bd1-03b5-4d14-b584-188773be7c33 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:57.002402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-95b96bd1-03b5-4d14-b584-188773be7c33 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:57.019523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b96bd1-03b5-4d14-b584-188773be7c33 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.020490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b96bd1-03b5-4d14-b584-188773be7c33 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.022264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b96bd1-03b5-4d14-b584-188773be7c33 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.025987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b96bd1-03b5-4d14-b584-188773be7c33 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.026799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b96bd1-03b5-4d14-b584-188773be7c33 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.027636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b96bd1-03b5-4d14-b584-188773be7c33 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.204334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95b96bd1-03b5-4d14-b584-188773be7c33 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:57.216426 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-95b96bd1-03b5-4d14-b584-188773be7c33 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 200 len: 1298 microversion: 2.1 time: 0.243630 Oct 04 18:02:57.228078 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 297/572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:56 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 1298 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:57.243594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5100425d-f597-4d1c-9869-c0220da23399 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:57.244637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5100425d-f597-4d1c-9869-c0220da23399 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:57.282259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5100425d-f597-4d1c-9869-c0220da23399 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.283213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5100425d-f597-4d1c-9869-c0220da23399 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.284029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5100425d-f597-4d1c-9869-c0220da23399 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.285367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5100425d-f597-4d1c-9869-c0220da23399 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.286296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5100425d-f597-4d1c-9869-c0220da23399 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.307696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5100425d-f597-4d1c-9869-c0220da23399 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.662312 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b2a3f390-c5d7-43fa-9dfc-352072586c02 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9df282a2-25cd-4c82-b382-822e6a2b3b6a" status: 202 len: 0 microversion: 2.1 time: 0.862034 Oct 04 18:02:57.663692 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 276/573] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:02:56 2022] DELETE /compute/v2.1/os-security-groups/9df282a2-25cd-4c82-b382-822e6a2b3b6a => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:57.670868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ec8cc47-e1a2-465f-8508-23889a82e199 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:57.679769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4ec8cc47-e1a2-465f-8508-23889a82e199 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:57.699633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec8cc47-e1a2-465f-8508-23889a82e199 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.703650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec8cc47-e1a2-465f-8508-23889a82e199 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.704444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec8cc47-e1a2-465f-8508-23889a82e199 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.707646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec8cc47-e1a2-465f-8508-23889a82e199 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.709469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec8cc47-e1a2-465f-8508-23889a82e199 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.715048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec8cc47-e1a2-465f-8508-23889a82e199 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.779616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5100425d-f597-4d1c-9869-c0220da23399 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:57.793841 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5100425d-f597-4d1c-9869-c0220da23399 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.564347 Oct 04 18:02:57.794677 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 298/574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:57 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:57.914155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b912c07a-3263-4289-ad0e-31c3dea2f3d6 req-ead652aa-9ed2-401c-93c4-4c3472e3b6ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a", "name": "network-vif-deleted", "tag": "057cd609-d245-4f7e-b933-11104556327b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:57.919720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=14,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:57.920046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-4ec8cc47-e1a2-465f-8508-23889a82e199 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:57.929767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b912c07a-3263-4289-ad0e-31c3dea2f3d6 req-ead652aa-9ed2-401c-93c4-4c3472e3b6ff service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.930257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b912c07a-3263-4289-ad0e-31c3dea2f3d6 req-ead652aa-9ed2-401c-93c4-4c3472e3b6ff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.930689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b912c07a-3263-4289-ad0e-31c3dea2f3d6 req-ead652aa-9ed2-401c-93c4-4c3472e3b6ff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.949057 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b912c07a-3263-4289-ad0e-31c3dea2f3d6 req-ead652aa-9ed2-401c-93c4-4c3472e3b6ff service nova] Creating event network-vif-deleted:057cd609-d245-4f7e-b933-11104556327b for instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a on n-h1-850499-14 Oct 04 18:02:57.955263 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b912c07a-3263-4289-ad0e-31c3dea2f3d6 req-ead652aa-9ed2-401c-93c4-4c3472e3b6ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145701 Oct 04 18:02:57.957119 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 299/575] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:57.961394 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4ec8cc47-e1a2-465f-8508-23889a82e199 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1937 microversion: 2.75 time: 0.296501 Oct 04 18:02:57.974995 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 277/576] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:57 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1937 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:57.975205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67605a25-23f6-4fc0-911c-09b1b7f73b7d tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Calling method '.version_select at 0x7fd4d22b08b0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:57.975327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eaf8c204-a6a3-4eca-a27d-50944c70164c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:57.975327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eaf8c204-a6a3-4eca-a27d-50944c70164c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:57.977563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf8c204-a6a3-4eca-a27d-50944c70164c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.978066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf8c204-a6a3-4eca-a27d-50944c70164c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.978502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf8c204-a6a3-4eca-a27d-50944c70164c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.979387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf8c204-a6a3-4eca-a27d-50944c70164c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.979845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf8c204-a6a3-4eca-a27d-50944c70164c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.980305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf8c204-a6a3-4eca-a27d-50944c70164c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.214629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eaf8c204-a6a3-4eca-a27d-50944c70164c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:58.224082 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eaf8c204-a6a3-4eca-a27d-50944c70164c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.260616 Oct 04 18:02:58.224671 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 278/577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:57 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:58.229235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-6cb21846-f6e0-4e00-be15-8d4709ba531c req-77b192b5-b510-4de6-9478-0cda970c246b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeedbae9-0976-4ec6-9479-7b2a15f6ab62", "name": "network-vif-plugged", "status": "completed", "tag": "2ab28775-1d8a-4368-8ae8-a885b0ab183e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:58.245290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6cb21846-f6e0-4e00-be15-8d4709ba531c req-77b192b5-b510-4de6-9478-0cda970c246b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.246246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6cb21846-f6e0-4e00-be15-8d4709ba531c req-77b192b5-b510-4de6-9478-0cda970c246b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.246722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6cb21846-f6e0-4e00-be15-8d4709ba531c req-77b192b5-b510-4de6-9478-0cda970c246b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.258766 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-6cb21846-f6e0-4e00-be15-8d4709ba531c req-77b192b5-b510-4de6-9478-0cda970c246b service nova] Creating event network-vif-plugged:2ab28775-1d8a-4368-8ae8-a885b0ab183e for instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 on n-h1-850499-14 Oct 04 18:02:58.263870 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-6cb21846-f6e0-4e00-be15-8d4709ba531c req-77b192b5-b510-4de6-9478-0cda970c246b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038023 Oct 04 18:02:58.264668 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 279/578] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:58.438029 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67605a25-23f6-4fc0-911c-09b1b7f73b7d tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/88308f9d-429b-492d-8ee4-678e30922e86" status: 202 len: 0 microversion: 2.1 time: 0.478791 Oct 04 18:02:58.438394 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 300/579] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:02:57 2022] DELETE /compute/v2.1/os-security-groups/88308f9d-429b-492d-8ee4-678e30922e86 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:58.443923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e5894d3c-0527-480f-8e82-c0750af42202 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:58.444666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e5894d3c-0527-480f-8e82-c0750af42202 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:58.450920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5894d3c-0527-480f-8e82-c0750af42202 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.451444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5894d3c-0527-480f-8e82-c0750af42202 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.451881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5894d3c-0527-480f-8e82-c0750af42202 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.452577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5894d3c-0527-480f-8e82-c0750af42202 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.453240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5894d3c-0527-480f-8e82-c0750af42202 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.453858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5894d3c-0527-480f-8e82-c0750af42202 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.482602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-241896766", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:58.541686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:02:58.743750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e5894d3c-0527-480f-8e82-c0750af42202 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:58.753861 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e5894d3c-0527-480f-8e82-c0750af42202 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 200 len: 1389 microversion: 2.1 time: 0.314205 Oct 04 18:02:58.756026 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 301/580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:58 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 1389 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:58.762101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:58.763146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:58.773067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.773695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.774233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.775293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.775799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.776554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.800809 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] HTTP exception thrown: Instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a could not be found. Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Request method failure captured: Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a HTTP/1.1 Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUZlHELASAgk3LQy4cyp_IJEw6eK9zl2wLCJtkCvjCspfFdVKFw3rG7vjBkwccpgKhBEwmu1Nuwy55v1JHHxBMr4h_RolD5Tr2wUIy96JDq_CqhrNNQizRze1JtWYwZguSYRMbKFiCZGmwjXwQyp-Cmew-bojWbECHB4FuQZ51xQIw Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6e60a416d16a409f9ad18fb144bb388a Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-610644967 Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:02:58.807548 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6e60a416d16a409f9ad18fb144bb388a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6e60a416d16a409f9ad18fb144bb388a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e60a416d16a409f9ad18fb144bb388a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e60a416d16a409f9ad18fb144bb388a"}]}] Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersAdminNegativeTestJSON-610644967 Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6e60a416d16a409f9ad18fb144bb388a Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-610644967 Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersAdminNegativeTestJSON-610644967-project Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6c0e7f7155a5438f927987d48736c31d Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersAdminNegativeTestJSON-610644967-project Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a could not be found. Oct 04 18:02:58.809085 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a'} Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a could not be found. Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:58.810022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a could not be found. Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a could not be found. Oct 04 18:02:58.811442 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:02:58.812833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Returning 404 to user: Instance 0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:58.815202 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d4f53e29-ebc8-423d-8961-2d03b7cb6990 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a" status: 404 len: 111 microversion: 2.1 time: 0.054959 Oct 04 18:02:58.815901 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 302/581] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:58 2022] GET /compute/v2.1/servers/0c4efc0b-c295-4ad8-81b8-3d5b05c0ff3a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:02:58.823433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d00726ea-6ee7-47ec-921c-9f85820ebc40 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] Calling method '.version_select at 0x7fd4d22b05e0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:58.848714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:58.849214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:58.849617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:58.850083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:58.850538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:58.857524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:58.861251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.861749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.862184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.862925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.863437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.863865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.889117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:58.894622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:58.908769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:58.911460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:58.970330 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bfd5477a-0b1b-49c6-b141-29711b3cbf63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704532 Oct 04 18:02:58.971678 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 280/582] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:02:58.981154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f39ef9dc-7017-4dc5-be03-f7db261c1fee tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:58.982414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f39ef9dc-7017-4dc5-be03-f7db261c1fee tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:58.984661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=15,nova_api:INSERT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:58.994149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f39ef9dc-7017-4dc5-be03-f7db261c1fee tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.994665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f39ef9dc-7017-4dc5-be03-f7db261c1fee tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.995164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f39ef9dc-7017-4dc5-be03-f7db261c1fee tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.995948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f39ef9dc-7017-4dc5-be03-f7db261c1fee tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.996413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f39ef9dc-7017-4dc5-be03-f7db261c1fee tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.996874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f39ef9dc-7017-4dc5-be03-f7db261c1fee tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:59.025009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f39ef9dc-7017-4dc5-be03-f7db261c1fee tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:02:59.039780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:59.048813 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d00726ea-6ee7-47ec-921c-9f85820ebc40 tempest-SecurityGroupRulesNegativeTestJSON-215550102 tempest-SecurityGroupRulesNegativeTestJSON-215550102-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/1e67d385-ad87-4bd9-b652-570539ab2ea6" status: 202 len: 0 microversion: 2.1 time: 0.232006 Oct 04 18:02:59.049392 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 303/583] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:02:58 2022] DELETE /compute/v2.1/os-security-groups/1e67d385-ad87-4bd9-b652-570539ab2ea6 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:59.059090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-90132474-c140-4612-b298-06d92732dbce tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:59.059714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-90132474-c140-4612-b298-06d92732dbce tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:59.073515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90132474-c140-4612-b298-06d92732dbce tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:59.073871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90132474-c140-4612-b298-06d92732dbce tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:59.074406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90132474-c140-4612-b298-06d92732dbce tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:59.075043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90132474-c140-4612-b298-06d92732dbce tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:59.079657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90132474-c140-4612-b298-06d92732dbce tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:59.080819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90132474-c140-4612-b298-06d92732dbce tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:59.119436 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f39ef9dc-7017-4dc5-be03-f7db261c1fee tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 204 len: 0 microversion: 2.1 time: 0.145917 Oct 04 18:02:59.120173 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 281/584] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:02:58 2022] DELETE /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:02:59.127741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cafb54cf-a05d-4e8f-a486-e0c663251681 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:59.128630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cafb54cf-a05d-4e8f-a486-e0c663251681 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:59.281235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cafb54cf-a05d-4e8f-a486-e0c663251681 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:59.295868 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cafb54cf-a05d-4e8f-a486-e0c663251681 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1216 microversion: 2.1 time: 0.174306 Oct 04 18:02:59.308738 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 282/585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:59 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1216 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:59.313666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ea33b2f8-90b9-4263-954d-7b4bf3d6e71e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:59.315770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ea33b2f8-90b9-4263-954d-7b4bf3d6e71e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:59.324457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea33b2f8-90b9-4263-954d-7b4bf3d6e71e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:59.325471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea33b2f8-90b9-4263-954d-7b4bf3d6e71e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:59.326630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea33b2f8-90b9-4263-954d-7b4bf3d6e71e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:59.327497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea33b2f8-90b9-4263-954d-7b4bf3d6e71e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:59.327993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea33b2f8-90b9-4263-954d-7b4bf3d6e71e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:59.328537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea33b2f8-90b9-4263-954d-7b4bf3d6e71e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:59.611312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90132474-c140-4612-b298-06d92732dbce tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:59.614989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:59.616117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-ea33b2f8-90b9-4263-954d-7b4bf3d6e71e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:59.625263 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-90132474-c140-4612-b298-06d92732dbce tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.570243 Oct 04 18:02:59.626079 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 304/586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:59 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:59.632848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2e879843-f1f9-4fd4-a673-d26190559861 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:59.633622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2e879843-f1f9-4fd4-a673-d26190559861 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:59.641547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e879843-f1f9-4fd4-a673-d26190559861 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:59.642436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e879843-f1f9-4fd4-a673-d26190559861 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:59.643118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e879843-f1f9-4fd4-a673-d26190559861 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:59.643900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e879843-f1f9-4fd4-a673-d26190559861 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:59.644516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e879843-f1f9-4fd4-a673-d26190559861 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:59.645104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e879843-f1f9-4fd4-a673-d26190559861 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:59.657770 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ea33b2f8-90b9-4263-954d-7b4bf3d6e71e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1937 microversion: 2.75 time: 0.347645 Oct 04 18:02:59.659120 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 283/587] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:59 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1937 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:59.665274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9c24357e-d3ff-461c-9f88-a35022f2dcd6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:59.666786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9c24357e-d3ff-461c-9f88-a35022f2dcd6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:59.705715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c24357e-d3ff-461c-9f88-a35022f2dcd6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:59.707637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c24357e-d3ff-461c-9f88-a35022f2dcd6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:59.710128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c24357e-d3ff-461c-9f88-a35022f2dcd6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:59.713414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c24357e-d3ff-461c-9f88-a35022f2dcd6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:59.714653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c24357e-d3ff-461c-9f88-a35022f2dcd6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:59.715597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c24357e-d3ff-461c-9f88-a35022f2dcd6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.046995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2e879843-f1f9-4fd4-a673-d26190559861 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:00.061582 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2e879843-f1f9-4fd4-a673-d26190559861 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1476 microversion: 2.1 time: 0.434080 Oct 04 18:03:00.063093 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 305/588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:59 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1476 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:00.064601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9c24357e-d3ff-461c-9f88-a35022f2dcd6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:00.069288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-539281f3-a105-446c-8afd-74015ac5734a tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:00.070074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-539281f3-a105-446c-8afd-74015ac5734a tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:00.086569 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9c24357e-d3ff-461c-9f88-a35022f2dcd6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.426220 Oct 04 18:03:00.087452 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 284/589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:59 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:00.089360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539281f3-a105-446c-8afd-74015ac5734a tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:00.089989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539281f3-a105-446c-8afd-74015ac5734a tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:00.090439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539281f3-a105-446c-8afd-74015ac5734a tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.091178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539281f3-a105-446c-8afd-74015ac5734a tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:00.092706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539281f3-a105-446c-8afd-74015ac5734a tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:00.093272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539281f3-a105-446c-8afd-74015ac5734a tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.319923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17176224-e3d6-4313-80d7-3ccb857d85dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:00.320544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17176224-e3d6-4313-80d7-3ccb857d85dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:00.327590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17176224-e3d6-4313-80d7-3ccb857d85dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:00.328080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17176224-e3d6-4313-80d7-3ccb857d85dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:00.328570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17176224-e3d6-4313-80d7-3ccb857d85dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.329225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17176224-e3d6-4313-80d7-3ccb857d85dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:00.329688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17176224-e3d6-4313-80d7-3ccb857d85dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:00.330117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17176224-e3d6-4313-80d7-3ccb857d85dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.366425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-539281f3-a105-446c-8afd-74015ac5734a tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:00.383220 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-539281f3-a105-446c-8afd-74015ac5734a tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 200 len: 1589 microversion: 2.1 time: 0.318858 Oct 04 18:03:00.384165 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 306/590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:00 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 1589 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:00.409232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-61623fde-246d-4a67-9994-a2fc41a27160 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:00.409875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-61623fde-246d-4a67-9994-a2fc41a27160 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:00.417251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61623fde-246d-4a67-9994-a2fc41a27160 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:00.417967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61623fde-246d-4a67-9994-a2fc41a27160 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:00.418517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61623fde-246d-4a67-9994-a2fc41a27160 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.419390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61623fde-246d-4a67-9994-a2fc41a27160 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:00.419954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61623fde-246d-4a67-9994-a2fc41a27160 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:00.420874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61623fde-246d-4a67-9994-a2fc41a27160 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.435556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17176224-e3d6-4313-80d7-3ccb857d85dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:00.447210 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17176224-e3d6-4313-80d7-3ccb857d85dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1268 microversion: 2.1 time: 0.131392 Oct 04 18:03:00.448821 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 285/591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:00 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1268 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:00.559727 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-61623fde-246d-4a67-9994-a2fc41a27160 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155186 Oct 04 18:03:00.560408 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 307/592] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:03:00 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:00.650695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=11 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:00.656284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78033ef7-2377-4e15-bc97-6f9ee76c8fc4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:00.657200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78033ef7-2377-4e15-bc97-6f9ee76c8fc4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:00.664896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78033ef7-2377-4e15-bc97-6f9ee76c8fc4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:00.665554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78033ef7-2377-4e15-bc97-6f9ee76c8fc4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:00.666115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78033ef7-2377-4e15-bc97-6f9ee76c8fc4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.666917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78033ef7-2377-4e15-bc97-6f9ee76c8fc4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:00.667052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2132683368", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:00.667602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78033ef7-2377-4e15-bc97-6f9ee76c8fc4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:00.668137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78033ef7-2377-4e15-bc97-6f9ee76c8fc4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.749630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:01.005951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=84 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:01.222265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78033ef7-2377-4e15-bc97-6f9ee76c8fc4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:01.231397 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78033ef7-2377-4e15-bc97-6f9ee76c8fc4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.581609 Oct 04 18:03:01.242981 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 308/593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:00 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:01.242981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-569e3f24-d42d-4a52-b272-632c00cf3767 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:01.242981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-569e3f24-d42d-4a52-b272-632c00cf3767 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:01.248602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569e3f24-d42d-4a52-b272-632c00cf3767 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:01.248602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569e3f24-d42d-4a52-b272-632c00cf3767 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:01.248602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569e3f24-d42d-4a52-b272-632c00cf3767 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:01.248602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569e3f24-d42d-4a52-b272-632c00cf3767 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:01.248967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569e3f24-d42d-4a52-b272-632c00cf3767 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:01.248967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569e3f24-d42d-4a52-b272-632c00cf3767 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:01.601458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-569e3f24-d42d-4a52-b272-632c00cf3767 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:03:01.628207 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-569e3f24-d42d-4a52-b272-632c00cf3767 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1937 microversion: 2.75 time: 0.394277 Oct 04 18:03:01.628812 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 309/594] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:01 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1937 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:01.634038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db4485d2-f6da-4d82-9270-eefd4ef8264f tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:01.634659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-db4485d2-f6da-4d82-9270-eefd4ef8264f tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:01.640936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db4485d2-f6da-4d82-9270-eefd4ef8264f tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:01.641440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db4485d2-f6da-4d82-9270-eefd4ef8264f tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:01.641884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db4485d2-f6da-4d82-9270-eefd4ef8264f tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:01.642633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db4485d2-f6da-4d82-9270-eefd4ef8264f tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:01.643084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db4485d2-f6da-4d82-9270-eefd4ef8264f tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:01.643523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db4485d2-f6da-4d82-9270-eefd4ef8264f tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:01.700815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:01.701339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:01.702068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:01.702926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:01.703629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:01.714122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:01.714710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:01.715253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:01.716047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:01.716569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:01.717060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:01.740572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Getting quotas for project 7a024b1909ca4616a8aa9c071435ad5d. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:01.746226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Getting quotas for user b1386c3bfc454ab1b14c4cf905264a20 and project 7a024b1909ca4616a8aa9c071435ad5d. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:01.760914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:01.763271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:01.812306 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb84cf07-8e29-4e3e-9716-f90a1cf533b2 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.265001 Oct 04 18:03:01.819755 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 286/595] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:03:01.823117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f774ae5-14a0-4cc0-8eba-74dac3f56949 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:01.823796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2f774ae5-14a0-4cc0-8eba-74dac3f56949 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:01.830121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f774ae5-14a0-4cc0-8eba-74dac3f56949 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:01.830989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f774ae5-14a0-4cc0-8eba-74dac3f56949 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:01.831207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f774ae5-14a0-4cc0-8eba-74dac3f56949 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:01.831862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f774ae5-14a0-4cc0-8eba-74dac3f56949 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:01.832332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f774ae5-14a0-4cc0-8eba-74dac3f56949 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:01.832759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f774ae5-14a0-4cc0-8eba-74dac3f56949 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.270044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-db4485d2-f6da-4d82-9270-eefd4ef8264f tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:02.280858 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-db4485d2-f6da-4d82-9270-eefd4ef8264f tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1476 microversion: 2.1 time: 0.650984 Oct 04 18:03:02.281842 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 310/596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:01 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1476 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:02.288660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-86213258-42bf-4850-a6e9-4e7acef3e100 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:02.289538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-86213258-42bf-4850-a6e9-4e7acef3e100 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:02.298083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86213258-42bf-4850-a6e9-4e7acef3e100 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.298769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86213258-42bf-4850-a6e9-4e7acef3e100 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.299603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86213258-42bf-4850-a6e9-4e7acef3e100 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.300911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86213258-42bf-4850-a6e9-4e7acef3e100 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.301381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86213258-42bf-4850-a6e9-4e7acef3e100 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.302341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86213258-42bf-4850-a6e9-4e7acef3e100 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.434779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86213258-42bf-4850-a6e9-4e7acef3e100 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:02.442287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2f774ae5-14a0-4cc0-8eba-74dac3f56949 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:02.447116 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-86213258-42bf-4850-a6e9-4e7acef3e100 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1274 microversion: 2.1 time: 0.163913 Oct 04 18:03:02.448706 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 311/597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:02 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:02.454725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f02167a-94bd-4cc3-93bf-46902d85313e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:02.456235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f02167a-94bd-4cc3-93bf-46902d85313e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:02.470143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f02167a-94bd-4cc3-93bf-46902d85313e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.470384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f02167a-94bd-4cc3-93bf-46902d85313e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.471039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f02167a-94bd-4cc3-93bf-46902d85313e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.471757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f02167a-94bd-4cc3-93bf-46902d85313e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.472216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f02167a-94bd-4cc3-93bf-46902d85313e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.472638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f02167a-94bd-4cc3-93bf-46902d85313e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.476291 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2f774ae5-14a0-4cc0-8eba-74dac3f56949 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.662185 Oct 04 18:03:02.476887 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 287/598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:01 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:02.497839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0fdfb916-2347-42a4-a36e-05cd611b3514 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:02.498723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0fdfb916-2347-42a4-a36e-05cd611b3514 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:02.505805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fdfb916-2347-42a4-a36e-05cd611b3514 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.506540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fdfb916-2347-42a4-a36e-05cd611b3514 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.507170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fdfb916-2347-42a4-a36e-05cd611b3514 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.508045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fdfb916-2347-42a4-a36e-05cd611b3514 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.508511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fdfb916-2347-42a4-a36e-05cd611b3514 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.508941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fdfb916-2347-42a4-a36e-05cd611b3514 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.620008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1f02167a-94bd-4cc3-93bf-46902d85313e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:02.629501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f02167a-94bd-4cc3-93bf-46902d85313e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1210 microversion: 2.1 time: 0.179365 Oct 04 18:03:02.630231 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 312/599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:02 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1210 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:02.659582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-01fbfbee-f9cd-4718-9d04-8c5558e2eb69 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:02.660202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-01fbfbee-f9cd-4718-9d04-8c5558e2eb69 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:02.667166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01fbfbee-f9cd-4718-9d04-8c5558e2eb69 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.667664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01fbfbee-f9cd-4718-9d04-8c5558e2eb69 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.668116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01fbfbee-f9cd-4718-9d04-8c5558e2eb69 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.668826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01fbfbee-f9cd-4718-9d04-8c5558e2eb69 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.669287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01fbfbee-f9cd-4718-9d04-8c5558e2eb69 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.669719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01fbfbee-f9cd-4718-9d04-8c5558e2eb69 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.800527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-01fbfbee-f9cd-4718-9d04-8c5558e2eb69 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:03:02.816463 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-01fbfbee-f9cd-4718-9d04-8c5558e2eb69 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1937 microversion: 2.75 time: 0.161632 Oct 04 18:03:02.817040 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 313/600] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:02 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1937 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:03:03.272841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0fdfb916-2347-42a4-a36e-05cd611b3514 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:03.281506 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0fdfb916-2347-42a4-a36e-05cd611b3514 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.789411 Oct 04 18:03:03.282346 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 288/601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:02 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:03.306613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a2842360-256d-48c3-b5ed-e02da2ab7678 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:03.307158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a2842360-256d-48c3-b5ed-e02da2ab7678 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:03.313166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2842360-256d-48c3-b5ed-e02da2ab7678 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:03.314345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2842360-256d-48c3-b5ed-e02da2ab7678 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:03.314998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2842360-256d-48c3-b5ed-e02da2ab7678 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:03.315867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2842360-256d-48c3-b5ed-e02da2ab7678 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:03.316494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2842360-256d-48c3-b5ed-e02da2ab7678 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:03.317083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2842360-256d-48c3-b5ed-e02da2ab7678 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:03.477011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1f1a1d90-98fa-4599-a8be-1ce19b5f8af2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:03.478003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1f1a1d90-98fa-4599-a8be-1ce19b5f8af2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:03.485775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f1a1d90-98fa-4599-a8be-1ce19b5f8af2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:03.486819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f1a1d90-98fa-4599-a8be-1ce19b5f8af2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:03.487481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f1a1d90-98fa-4599-a8be-1ce19b5f8af2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:03.488348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f1a1d90-98fa-4599-a8be-1ce19b5f8af2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:03.489093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f1a1d90-98fa-4599-a8be-1ce19b5f8af2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:03.490243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f1a1d90-98fa-4599-a8be-1ce19b5f8af2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:03.597366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1f1a1d90-98fa-4599-a8be-1ce19b5f8af2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:03.607728 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1f1a1d90-98fa-4599-a8be-1ce19b5f8af2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1274 microversion: 2.1 time: 0.135524 Oct 04 18:03:03.609458 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 289/602] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:03 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1274 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:03.615491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-245c5575-d0c1-4b9f-bd89-3323e91d6a3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:03.616110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-245c5575-d0c1-4b9f-bd89-3323e91d6a3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:03.622782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-245c5575-d0c1-4b9f-bd89-3323e91d6a3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:03.623314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-245c5575-d0c1-4b9f-bd89-3323e91d6a3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:03.623773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-245c5575-d0c1-4b9f-bd89-3323e91d6a3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:03.624594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-245c5575-d0c1-4b9f-bd89-3323e91d6a3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:03.625427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-245c5575-d0c1-4b9f-bd89-3323e91d6a3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:03.626227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-245c5575-d0c1-4b9f-bd89-3323e91d6a3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:03.789228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a2842360-256d-48c3-b5ed-e02da2ab7678 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:03.804228 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a2842360-256d-48c3-b5ed-e02da2ab7678 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1476 microversion: 2.1 time: 0.502126 Oct 04 18:03:03.820119 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 314/603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:03 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1476 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:03.820119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd0812d7-8632-4e08-9e06-ddd57c0cef7d tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:03.820119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cd0812d7-8632-4e08-9e06-ddd57c0cef7d tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:03.820119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd0812d7-8632-4e08-9e06-ddd57c0cef7d tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:03.820661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd0812d7-8632-4e08-9e06-ddd57c0cef7d tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:03.821283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd0812d7-8632-4e08-9e06-ddd57c0cef7d tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:03.823201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd0812d7-8632-4e08-9e06-ddd57c0cef7d tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:03.823823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd0812d7-8632-4e08-9e06-ddd57c0cef7d tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:03.824406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd0812d7-8632-4e08-9e06-ddd57c0cef7d tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:03.982114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cd0812d7-8632-4e08-9e06-ddd57c0cef7d tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:03.991548 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cd0812d7-8632-4e08-9e06-ddd57c0cef7d tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1272 microversion: 2.1 time: 0.185482 Oct 04 18:03:03.992501 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 315/604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:03 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:03.998681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c8ae6b2d-3007-48a3-bc24-c4a03d5dbd01 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:03.999320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c8ae6b2d-3007-48a3-bc24-c4a03d5dbd01 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:04.007043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8ae6b2d-3007-48a3-bc24-c4a03d5dbd01 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.007325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8ae6b2d-3007-48a3-bc24-c4a03d5dbd01 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.007793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8ae6b2d-3007-48a3-bc24-c4a03d5dbd01 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.008500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8ae6b2d-3007-48a3-bc24-c4a03d5dbd01 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.009270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8ae6b2d-3007-48a3-bc24-c4a03d5dbd01 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.009870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8ae6b2d-3007-48a3-bc24-c4a03d5dbd01 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.100543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-245c5575-d0c1-4b9f-bd89-3323e91d6a3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:04.113977 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-245c5575-d0c1-4b9f-bd89-3323e91d6a3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.503230 Oct 04 18:03:04.130054 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 290/605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:03 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:04.145202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-c8ae6b2d-3007-48a3-bc24-c4a03d5dbd01 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:03:04.184249 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c8ae6b2d-3007-48a3-bc24-c4a03d5dbd01 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1937 microversion: 2.75 time: 0.190423 Oct 04 18:03:04.185091 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 316/606] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:03 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1937 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:04.248758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fa030ccb-b77b-44b9-93e7-1d9a829cfd10 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:04.249542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fa030ccb-b77b-44b9-93e7-1d9a829cfd10 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:04.263473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa030ccb-b77b-44b9-93e7-1d9a829cfd10 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.269237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa030ccb-b77b-44b9-93e7-1d9a829cfd10 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.269940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa030ccb-b77b-44b9-93e7-1d9a829cfd10 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.271641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa030ccb-b77b-44b9-93e7-1d9a829cfd10 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.271836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-4e7295b2-0317-4cf5-85e8-004888045168 req-9a9f2d56-d71c-4b61-a92d-6d9c1ec7fa8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeedbae9-0976-4ec6-9479-7b2a15f6ab62", "tag": "2ab28775-1d8a-4368-8ae8-a885b0ab183e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:04.274410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa030ccb-b77b-44b9-93e7-1d9a829cfd10 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.274993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa030ccb-b77b-44b9-93e7-1d9a829cfd10 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.297705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4e7295b2-0317-4cf5-85e8-004888045168 req-9a9f2d56-d71c-4b61-a92d-6d9c1ec7fa8a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.299818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4e7295b2-0317-4cf5-85e8-004888045168 req-9a9f2d56-d71c-4b61-a92d-6d9c1ec7fa8a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.299818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4e7295b2-0317-4cf5-85e8-004888045168 req-9a9f2d56-d71c-4b61-a92d-6d9c1ec7fa8a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.334144 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-4e7295b2-0317-4cf5-85e8-004888045168 req-9a9f2d56-d71c-4b61-a92d-6d9c1ec7fa8a service nova] Creating event network-changed:2ab28775-1d8a-4368-8ae8-a885b0ab183e for instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 on n-h1-850499-14 Oct 04 18:03:04.351681 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-4e7295b2-0317-4cf5-85e8-004888045168 req-9a9f2d56-d71c-4b61-a92d-6d9c1ec7fa8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085374 Oct 04 18:03:04.356972 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 317/607] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:04.366488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b2413d61-1502-44a9-aced-14197cc18b3c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:04.377867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b2413d61-1502-44a9-aced-14197cc18b3c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:04.389917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2413d61-1502-44a9-aced-14197cc18b3c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.390771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2413d61-1502-44a9-aced-14197cc18b3c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.391426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2413d61-1502-44a9-aced-14197cc18b3c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.392308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2413d61-1502-44a9-aced-14197cc18b3c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.395900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2413d61-1502-44a9-aced-14197cc18b3c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.396540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2413d61-1502-44a9-aced-14197cc18b3c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.735360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fa030ccb-b77b-44b9-93e7-1d9a829cfd10 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:04.746258 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fa030ccb-b77b-44b9-93e7-1d9a829cfd10 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 200 len: 1589 microversion: 2.1 time: 0.501906 Oct 04 18:03:04.750650 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 291/608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:04 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 1589 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:04.756295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80ba9ea9-29e5-44ab-a452-252920f31372 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:04.762293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80ba9ea9-29e5-44ab-a452-252920f31372 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:04.782589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80ba9ea9-29e5-44ab-a452-252920f31372 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.783392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80ba9ea9-29e5-44ab-a452-252920f31372 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.784027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80ba9ea9-29e5-44ab-a452-252920f31372 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.784929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80ba9ea9-29e5-44ab-a452-252920f31372 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.785738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80ba9ea9-29e5-44ab-a452-252920f31372 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.786357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80ba9ea9-29e5-44ab-a452-252920f31372 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.857837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b2413d61-1502-44a9-aced-14197cc18b3c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:04.868473 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b2413d61-1502-44a9-aced-14197cc18b3c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.508958 Oct 04 18:03:04.876146 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 318/609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:04 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:04.881770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-31e1b572-01db-4f6a-bb98-7501dcd3f31b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:04.899958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-31e1b572-01db-4f6a-bb98-7501dcd3f31b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:04.906590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e1b572-01db-4f6a-bb98-7501dcd3f31b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.907200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e1b572-01db-4f6a-bb98-7501dcd3f31b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.907651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e1b572-01db-4f6a-bb98-7501dcd3f31b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:04.908512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e1b572-01db-4f6a-bb98-7501dcd3f31b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:04.908815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e1b572-01db-4f6a-bb98-7501dcd3f31b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:04.909249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e1b572-01db-4f6a-bb98-7501dcd3f31b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.210806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-31e1b572-01db-4f6a-bb98-7501dcd3f31b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:05.228742 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-31e1b572-01db-4f6a-bb98-7501dcd3f31b tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1476 microversion: 2.1 time: 0.350547 Oct 04 18:03:05.229940 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 319/610] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:04 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:05.247761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9ee974d-8295-487b-8ea1-f72921b17846 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:05.248991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9ee974d-8295-487b-8ea1-f72921b17846 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:05.262055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ee974d-8295-487b-8ea1-f72921b17846 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.262789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ee974d-8295-487b-8ea1-f72921b17846 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.263386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ee974d-8295-487b-8ea1-f72921b17846 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.264208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ee974d-8295-487b-8ea1-f72921b17846 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.264793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ee974d-8295-487b-8ea1-f72921b17846 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.265324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ee974d-8295-487b-8ea1-f72921b17846 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.441961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-80ba9ea9-29e5-44ab-a452-252920f31372 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:05.458310 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-80ba9ea9-29e5-44ab-a452-252920f31372 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1316 microversion: 2.1 time: 0.706133 Oct 04 18:03:05.462585 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 292/611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:04 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1316 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:05.475765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12e1fa3b-806a-4507-a7d2-66e75729183d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:05.479456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-12e1fa3b-806a-4507-a7d2-66e75729183d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:05.487289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1fa3b-806a-4507-a7d2-66e75729183d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.488155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1fa3b-806a-4507-a7d2-66e75729183d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.488817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1fa3b-806a-4507-a7d2-66e75729183d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.489820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1fa3b-806a-4507-a7d2-66e75729183d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.490497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1fa3b-806a-4507-a7d2-66e75729183d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.491202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1fa3b-806a-4507-a7d2-66e75729183d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.622592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9ee974d-8295-487b-8ea1-f72921b17846 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:05.634569 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9ee974d-8295-487b-8ea1-f72921b17846 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1314 microversion: 2.1 time: 0.403181 Oct 04 18:03:05.636491 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 320/612] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:05 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:05.642102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-92a0ea41-26be-4bbb-9e7a-6795335e6c53 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:05.643325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-92a0ea41-26be-4bbb-9e7a-6795335e6c53 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:05.650341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a0ea41-26be-4bbb-9e7a-6795335e6c53 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.651127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a0ea41-26be-4bbb-9e7a-6795335e6c53 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.651830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a0ea41-26be-4bbb-9e7a-6795335e6c53 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.652821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a0ea41-26be-4bbb-9e7a-6795335e6c53 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.653463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a0ea41-26be-4bbb-9e7a-6795335e6c53 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.654078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a0ea41-26be-4bbb-9e7a-6795335e6c53 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.683426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:05.814346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-92a0ea41-26be-4bbb-9e7a-6795335e6c53 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:03:05.837644 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-92a0ea41-26be-4bbb-9e7a-6795335e6c53 tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1937 microversion: 2.75 time: 0.199838 Oct 04 18:03:05.838677 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 321/613] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:05 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1937 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:05.898906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f95f71a-aaf4-43f2-ab27-1f34a64cedca tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:05.900307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4f95f71a-aaf4-43f2-ab27-1f34a64cedca tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:05.912540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f95f71a-aaf4-43f2-ab27-1f34a64cedca tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.913656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f95f71a-aaf4-43f2-ab27-1f34a64cedca tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.914332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f95f71a-aaf4-43f2-ab27-1f34a64cedca tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.915649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f95f71a-aaf4-43f2-ab27-1f34a64cedca tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.916381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f95f71a-aaf4-43f2-ab27-1f34a64cedca tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.917035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f95f71a-aaf4-43f2-ab27-1f34a64cedca tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.264720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-12e1fa3b-806a-4507-a7d2-66e75729183d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:06.272718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12e1fa3b-806a-4507-a7d2-66e75729183d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1475 microversion: 2.1 time: 0.806452 Oct 04 18:03:06.287476 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 293/614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:05 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1475 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:06.294222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cff25fc6-5aa8-4c6b-8673-17a6e386bb52 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:06.294762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cff25fc6-5aa8-4c6b-8673-17a6e386bb52 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:06.301094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cff25fc6-5aa8-4c6b-8673-17a6e386bb52 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.302390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cff25fc6-5aa8-4c6b-8673-17a6e386bb52 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.303122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cff25fc6-5aa8-4c6b-8673-17a6e386bb52 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.304046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cff25fc6-5aa8-4c6b-8673-17a6e386bb52 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.304700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cff25fc6-5aa8-4c6b-8673-17a6e386bb52 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.305331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cff25fc6-5aa8-4c6b-8673-17a6e386bb52 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.400563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4f95f71a-aaf4-43f2-ab27-1f34a64cedca tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:06.410844 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f95f71a-aaf4-43f2-ab27-1f34a64cedca tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.516626 Oct 04 18:03:06.423669 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 322/615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:05 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:06.487408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-341b0b69-17e0-4e31-9296-0d3b6ba4ab13 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:06.488067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-341b0b69-17e0-4e31-9296-0d3b6ba4ab13 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:06.495520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-341b0b69-17e0-4e31-9296-0d3b6ba4ab13 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.496157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-341b0b69-17e0-4e31-9296-0d3b6ba4ab13 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.496951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-341b0b69-17e0-4e31-9296-0d3b6ba4ab13 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.497671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-341b0b69-17e0-4e31-9296-0d3b6ba4ab13 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.498132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-341b0b69-17e0-4e31-9296-0d3b6ba4ab13 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.498564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-341b0b69-17e0-4e31-9296-0d3b6ba4ab13 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.563465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cff25fc6-5aa8-4c6b-8673-17a6e386bb52 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:06.574249 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cff25fc6-5aa8-4c6b-8673-17a6e386bb52 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1476 microversion: 2.1 time: 0.285226 Oct 04 18:03:06.577533 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 294/616] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:06 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1476 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:06.660983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39aa91b0-2141-4ed6-bc01-eae5cace7427 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:06.662046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39aa91b0-2141-4ed6-bc01-eae5cace7427 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:06.670433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39aa91b0-2141-4ed6-bc01-eae5cace7427 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.671391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39aa91b0-2141-4ed6-bc01-eae5cace7427 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.672265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39aa91b0-2141-4ed6-bc01-eae5cace7427 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.673881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39aa91b0-2141-4ed6-bc01-eae5cace7427 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.676224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39aa91b0-2141-4ed6-bc01-eae5cace7427 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.677211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39aa91b0-2141-4ed6-bc01-eae5cace7427 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.884892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-341b0b69-17e0-4e31-9296-0d3b6ba4ab13 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:06.902426 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-341b0b69-17e0-4e31-9296-0d3b6ba4ab13 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1316 microversion: 2.1 time: 0.420453 Oct 04 18:03:06.905976 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 323/617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:06 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:06.913273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51230955-21dd-4901-889d-1323c819f90e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:06.919943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-51230955-21dd-4901-889d-1323c819f90e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:06.931064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51230955-21dd-4901-889d-1323c819f90e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.934080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51230955-21dd-4901-889d-1323c819f90e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.934781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51230955-21dd-4901-889d-1323c819f90e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.935870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51230955-21dd-4901-889d-1323c819f90e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.936544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51230955-21dd-4901-889d-1323c819f90e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.937206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51230955-21dd-4901-889d-1323c819f90e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.118160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-39aa91b0-2141-4ed6-bc01-eae5cace7427 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:07.135292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-51230955-21dd-4901-889d-1323c819f90e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] Lazy-loading 'services' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:03:07.149349 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39aa91b0-2141-4ed6-bc01-eae5cace7427 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1314 microversion: 2.1 time: 0.493222 Oct 04 18:03:07.152969 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 295/618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:06 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:07.169003 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-51230955-21dd-4901-889d-1323c819f90e tempest-ServersAdmin275Test-163040662 tempest-ServersAdmin275Test-163040662-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1922 microversion: 2.75 time: 0.261679 Oct 04 18:03:07.178884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2ee6581d-ce20-4deb-a587-bad0d8204fa3 req-9e0054c4-e03c-4f0f-a76b-8017204feb6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa79c4dc-6409-43e7-85da-46dde9db68bd", "tag": "49406afb-3f01-47c9-934a-32a6e95c4e60"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:07.183748 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 324/619] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:06 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1922 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:07.192321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2ee6581d-ce20-4deb-a587-bad0d8204fa3 req-9e0054c4-e03c-4f0f-a76b-8017204feb6c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.193553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2ee6581d-ce20-4deb-a587-bad0d8204fa3 req-9e0054c4-e03c-4f0f-a76b-8017204feb6c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.194511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2ee6581d-ce20-4deb-a587-bad0d8204fa3 req-9e0054c4-e03c-4f0f-a76b-8017204feb6c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.213958 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2ee6581d-ce20-4deb-a587-bad0d8204fa3 req-9e0054c4-e03c-4f0f-a76b-8017204feb6c service nova] Creating event network-changed:49406afb-3f01-47c9-934a-32a6e95c4e60 for instance aa79c4dc-6409-43e7-85da-46dde9db68bd on n-h1-850499-14 Oct 04 18:03:07.221241 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2ee6581d-ce20-4deb-a587-bad0d8204fa3 req-9e0054c4-e03c-4f0f-a76b-8017204feb6c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049751 Oct 04 18:03:07.222209 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 296/620] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:07.234889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6fb6b432-66d4-40ff-b44b-2b5deb1702ab tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:07.235563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6fb6b432-66d4-40ff-b44b-2b5deb1702ab tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:07.249368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb6b432-66d4-40ff-b44b-2b5deb1702ab tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.254197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb6b432-66d4-40ff-b44b-2b5deb1702ab tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.255556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb6b432-66d4-40ff-b44b-2b5deb1702ab tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.258812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb6b432-66d4-40ff-b44b-2b5deb1702ab tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.259642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb6b432-66d4-40ff-b44b-2b5deb1702ab tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.260667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb6b432-66d4-40ff-b44b-2b5deb1702ab tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.302116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f5d2e12d-ed51-4a9b-a17a-2d93188645a1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:07.303090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f5d2e12d-ed51-4a9b-a17a-2d93188645a1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:07.313690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5d2e12d-ed51-4a9b-a17a-2d93188645a1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.320633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5d2e12d-ed51-4a9b-a17a-2d93188645a1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.321538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5d2e12d-ed51-4a9b-a17a-2d93188645a1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.323048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5d2e12d-ed51-4a9b-a17a-2d93188645a1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.323740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5d2e12d-ed51-4a9b-a17a-2d93188645a1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.324389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5d2e12d-ed51-4a9b-a17a-2d93188645a1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.344149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6fb6b432-66d4-40ff-b44b-2b5deb1702ab tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:03:07.538315 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6fb6b432-66d4-40ff-b44b-2b5deb1702ab tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 204 len: 0 microversion: 2.75 time: 0.308081 Oct 04 18:03:07.538909 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 325/621] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:03:07 2022] DELETE /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:03:07.557650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-60d0bfc8-b169-4724-8c9c-35414c8d8ffb req-726852b9-7fe2-42ff-91f7-8d39d10faf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b090a0-2ada-4af7-be73-c21ed69a3720", "name": "network-vif-plugged", "status": "completed", "tag": "55fe455b-5dcd-4805-b03b-0514147b4e32"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:07.610725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-60d0bfc8-b169-4724-8c9c-35414c8d8ffb req-726852b9-7fe2-42ff-91f7-8d39d10faf78 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.611436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-60d0bfc8-b169-4724-8c9c-35414c8d8ffb req-726852b9-7fe2-42ff-91f7-8d39d10faf78 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.611850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-60d0bfc8-b169-4724-8c9c-35414c8d8ffb req-726852b9-7fe2-42ff-91f7-8d39d10faf78 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.641486 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-60d0bfc8-b169-4724-8c9c-35414c8d8ffb req-726852b9-7fe2-42ff-91f7-8d39d10faf78 service nova] Creating event network-vif-plugged:55fe455b-5dcd-4805-b03b-0514147b4e32 for instance 27b090a0-2ada-4af7-be73-c21ed69a3720 on n-h2-850499-14 Oct 04 18:03:07.650018 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-60d0bfc8-b169-4724-8c9c-35414c8d8ffb req-726852b9-7fe2-42ff-91f7-8d39d10faf78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108440 Oct 04 18:03:07.651075 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 326/622] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:07.679772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1dbf437b-c8be-4a2e-a440-2415b3523504 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:07.680524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1dbf437b-c8be-4a2e-a440-2415b3523504 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:07.694061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dbf437b-c8be-4a2e-a440-2415b3523504 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.695539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dbf437b-c8be-4a2e-a440-2415b3523504 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.696325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dbf437b-c8be-4a2e-a440-2415b3523504 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.697401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dbf437b-c8be-4a2e-a440-2415b3523504 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.698605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dbf437b-c8be-4a2e-a440-2415b3523504 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.699088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dbf437b-c8be-4a2e-a440-2415b3523504 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.745786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f5d2e12d-ed51-4a9b-a17a-2d93188645a1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:07.764605 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f5d2e12d-ed51-4a9b-a17a-2d93188645a1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1474 microversion: 2.1 time: 0.467960 Oct 04 18:03:07.775501 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 297/623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:07 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1474 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:07.786736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:07.787380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:07.794115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.794614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.795109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.795821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.796311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.796740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.937278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:07.946602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:07.948079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:07.954208 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0b6efcb8-8089-4a87-a263-5292e6572a67 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1444 microversion: 2.75 time: 0.177208 Oct 04 18:03:07.955067 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 298/624] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:07 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1444 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:07.960388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6e58abf0-33c2-405d-9832-1b3a630fa69c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:07.961221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6e58abf0-33c2-405d-9832-1b3a630fa69c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:07.968460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e58abf0-33c2-405d-9832-1b3a630fa69c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.969420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e58abf0-33c2-405d-9832-1b3a630fa69c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.970131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e58abf0-33c2-405d-9832-1b3a630fa69c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.971556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e58abf0-33c2-405d-9832-1b3a630fa69c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:07.972445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e58abf0-33c2-405d-9832-1b3a630fa69c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:07.973198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e58abf0-33c2-405d-9832-1b3a630fa69c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:07.976717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:08.130323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6e58abf0-33c2-405d-9832-1b3a630fa69c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0e7f7155a5438f927987d48736c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e60a416d16a409f9ad18fb144bb388a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:08.133560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1dbf437b-c8be-4a2e-a440-2415b3523504 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:08.141560 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6e58abf0-33c2-405d-9832-1b3a630fa69c tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 200 len: 1434 microversion: 2.1 time: 0.185213 Oct 04 18:03:08.143923 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1dbf437b-c8be-4a2e-a440-2415b3523504 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.475702 Oct 04 18:03:08.144992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 327/625] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:07 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:08.151786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e56c9931-f8e6-4e01-ada0-30042791ad62 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.152394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e56c9931-f8e6-4e01-ada0-30042791ad62 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:08.164476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56c9931-f8e6-4e01-ada0-30042791ad62 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.167506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56c9931-f8e6-4e01-ada0-30042791ad62 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.169838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56c9931-f8e6-4e01-ada0-30042791ad62 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.172870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56c9931-f8e6-4e01-ada0-30042791ad62 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.175572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56c9931-f8e6-4e01-ada0-30042791ad62 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.175717 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 299/626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:07 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 1434 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:08.176016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56c9931-f8e6-4e01-ada0-30042791ad62 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.188210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-429663fc-e303-4f73-8967-82273a7dab1d req-229d6339-6d3e-4d34-8785-1356ec9a00f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa216bb-86aa-4a96-b668-db3f973d0308", "name": "network-vif-deleted", "tag": "e54c97e3-e2ac-49bd-bcc9-d3f5a69e1d8c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:08.217276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-429663fc-e303-4f73-8967-82273a7dab1d req-229d6339-6d3e-4d34-8785-1356ec9a00f2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.219128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-429663fc-e303-4f73-8967-82273a7dab1d req-229d6339-6d3e-4d34-8785-1356ec9a00f2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.220020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-429663fc-e303-4f73-8967-82273a7dab1d req-229d6339-6d3e-4d34-8785-1356ec9a00f2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.239389 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-429663fc-e303-4f73-8967-82273a7dab1d req-229d6339-6d3e-4d34-8785-1356ec9a00f2 service nova] Creating event network-vif-deleted:e54c97e3-e2ac-49bd-bcc9-d3f5a69e1d8c for instance cfa216bb-86aa-4a96-b668-db3f973d0308 on n-h2-850499-14 Oct 04 18:03:08.247172 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-429663fc-e303-4f73-8967-82273a7dab1d req-229d6339-6d3e-4d34-8785-1356ec9a00f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069632 Oct 04 18:03:08.248822 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 300/627] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:08.258474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b3ea7fda-2f01-40ad-8a83-5ba098024fdc tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.259890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b3ea7fda-2f01-40ad-8a83-5ba098024fdc tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:08.269716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3ea7fda-2f01-40ad-8a83-5ba098024fdc tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.272095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3ea7fda-2f01-40ad-8a83-5ba098024fdc tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.273014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3ea7fda-2f01-40ad-8a83-5ba098024fdc tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.274400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3ea7fda-2f01-40ad-8a83-5ba098024fdc tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.275890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3ea7fda-2f01-40ad-8a83-5ba098024fdc tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.277038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3ea7fda-2f01-40ad-8a83-5ba098024fdc tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.548830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e56c9931-f8e6-4e01-ada0-30042791ad62 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:08.558279 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e56c9931-f8e6-4e01-ada0-30042791ad62 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1316 microversion: 2.1 time: 0.411111 Oct 04 18:03:08.559146 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 328/628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:08.564677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3ea7fda-2f01-40ad-8a83-5ba098024fdc tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:08.573705 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b3ea7fda-2f01-40ad-8a83-5ba098024fdc tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1314 microversion: 2.1 time: 0.323024 Oct 04 18:03:08.574296 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 301/629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:08.794281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74d7582f-86a7-4c65-a806-c146305d00ce tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.794896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-74d7582f-86a7-4c65-a806-c146305d00ce tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:08.801841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d7582f-86a7-4c65-a806-c146305d00ce tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.802379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d7582f-86a7-4c65-a806-c146305d00ce tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.802961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d7582f-86a7-4c65-a806-c146305d00ce tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.803749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d7582f-86a7-4c65-a806-c146305d00ce tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.804210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d7582f-86a7-4c65-a806-c146305d00ce tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.804634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d7582f-86a7-4c65-a806-c146305d00ce tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.946106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-74d7582f-86a7-4c65-a806-c146305d00ce tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:08.954020 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74d7582f-86a7-4c65-a806-c146305d00ce tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1474 microversion: 2.1 time: 0.164627 Oct 04 18:03:08.954596 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 329/630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1474 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:08.989844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.990410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:08.996939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.997432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.997873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.998573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.999072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.999500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.065410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:09.074610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:09.076096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:09.080937 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-414dbd3f-3d57-4809-84ad-d3947d518a91 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1444 microversion: 2.75 time: 0.095244 Oct 04 18:03:09.081688 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 302/631] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:09.168334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:09.169619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] [instance: cfa216bb-86aa-4a96-b668-db3f973d0308] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:09.169742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9239889f-fafd-47b8-9ac4-08b8342fac6d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:09.170307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9239889f-fafd-47b8-9ac4-08b8342fac6d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:09.177152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9239889f-fafd-47b8-9ac4-08b8342fac6d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.177479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.177627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9239889f-fafd-47b8-9ac4-08b8342fac6d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.178058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9239889f-fafd-47b8-9ac4-08b8342fac6d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.178421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.178872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9239889f-fafd-47b8-9ac4-08b8342fac6d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.179366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9239889f-fafd-47b8-9ac4-08b8342fac6d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.179562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.179790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9239889f-fafd-47b8-9ac4-08b8342fac6d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.180577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.181264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.182403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.199237 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] HTTP exception thrown: Instance cfa216bb-86aa-4a96-b668-db3f973d0308 could not be found. Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Request method failure captured: Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 HTTP/1.1 Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUZlHELASAgk3LQy4cyp_IJEw6eK9zl2wLCJtkCvjCspfFdVKFw3rG7vjBkwccpgKhBEwmu1Nuwy55v1JHHxBMr4h_RolD5Tr2wUIy96JDq_CqhrNNQizRze1JtWYwZguSYRMbKFiCZGmwjXwQyp-Cmew-bojWbECHB4FuQZ51xQIw Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6e60a416d16a409f9ad18fb144bb388a Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-610644967 Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:03:09.201280 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6e60a416d16a409f9ad18fb144bb388a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6e60a416d16a409f9ad18fb144bb388a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e60a416d16a409f9ad18fb144bb388a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e60a416d16a409f9ad18fb144bb388a"}]}] Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersAdminNegativeTestJSON-610644967 Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6e60a416d16a409f9ad18fb144bb388a Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-610644967 Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersAdminNegativeTestJSON-610644967-project Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6c0e7f7155a5438f927987d48736c31d Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersAdminNegativeTestJSON-610644967-project Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance cfa216bb-86aa-4a96-b668-db3f973d0308 could not be found. Oct 04 18:03:09.202676 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'cfa216bb-86aa-4a96-b668-db3f973d0308'} Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa216bb-86aa-4a96-b668-db3f973d0308 could not be found. Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:03:09.206256 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa216bb-86aa-4a96-b668-db3f973d0308 could not be found. Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa216bb-86aa-4a96-b668-db3f973d0308 could not be found. Oct 04 18:03:09.208046 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:09.211548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] Returning 404 to user: Instance cfa216bb-86aa-4a96-b668-db3f973d0308 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:03:09.213289 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-97e9253b-35a4-4f64-8109-137aa8c4fd00 tempest-ServersAdminNegativeTestJSON-610644967 tempest-ServersAdminNegativeTestJSON-610644967-project] 10.222.0.18 "GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308" status: 404 len: 111 microversion: 2.1 time: 0.049364 Oct 04 18:03:09.216701 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 330/632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:09 2022] GET /compute/v2.1/servers/cfa216bb-86aa-4a96-b668-db3f973d0308 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:03:09.521691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9239889f-fafd-47b8-9ac4-08b8342fac6d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:09.544974 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9239889f-fafd-47b8-9ac4-08b8342fac6d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.376977 Oct 04 18:03:09.548036 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 303/633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:09 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:09.583394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e90c4f16-dbc7-4d6c-83b8-5114c2c19dec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:09.584313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e90c4f16-dbc7-4d6c-83b8-5114c2c19dec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:09.597590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b4d32ea2-8d68-45b7-8c79-75ceb5a48da0 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:09.598557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b4d32ea2-8d68-45b7-8c79-75ceb5a48da0 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:09.605621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e90c4f16-dbc7-4d6c-83b8-5114c2c19dec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.607392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4d32ea2-8d68-45b7-8c79-75ceb5a48da0 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.608474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4d32ea2-8d68-45b7-8c79-75ceb5a48da0 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.609448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4d32ea2-8d68-45b7-8c79-75ceb5a48da0 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.609636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e90c4f16-dbc7-4d6c-83b8-5114c2c19dec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.610263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e90c4f16-dbc7-4d6c-83b8-5114c2c19dec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.610812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4d32ea2-8d68-45b7-8c79-75ceb5a48da0 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.611723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4d32ea2-8d68-45b7-8c79-75ceb5a48da0 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.612456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4d32ea2-8d68-45b7-8c79-75ceb5a48da0 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.612816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e90c4f16-dbc7-4d6c-83b8-5114c2c19dec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.614232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e90c4f16-dbc7-4d6c-83b8-5114c2c19dec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.619135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e90c4f16-dbc7-4d6c-83b8-5114c2c19dec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.984891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b4d32ea2-8d68-45b7-8c79-75ceb5a48da0 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:09.996335 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b4d32ea2-8d68-45b7-8c79-75ceb5a48da0 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1314 microversion: 2.1 time: 0.403804 Oct 04 18:03:09.997890 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 304/634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:09 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:10.006340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2eb2aa2d-32d8-4f01-b6b6-ef5d6270e8bc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:10.007406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2eb2aa2d-32d8-4f01-b6b6-ef5d6270e8bc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:10.015427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e90c4f16-dbc7-4d6c-83b8-5114c2c19dec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.015752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eb2aa2d-32d8-4f01-b6b6-ef5d6270e8bc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.016424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eb2aa2d-32d8-4f01-b6b6-ef5d6270e8bc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.016868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eb2aa2d-32d8-4f01-b6b6-ef5d6270e8bc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.017939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eb2aa2d-32d8-4f01-b6b6-ef5d6270e8bc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.019168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eb2aa2d-32d8-4f01-b6b6-ef5d6270e8bc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.019795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eb2aa2d-32d8-4f01-b6b6-ef5d6270e8bc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.023780 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e90c4f16-dbc7-4d6c-83b8-5114c2c19dec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1316 microversion: 2.1 time: 0.445907 Oct 04 18:03:10.026814 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 331/635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:09 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:10.108555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:10.109175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:10.115246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.115732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.116173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.116877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.117343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.117771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.235951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.245841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.247913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.252882 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c579413-3bfd-4bc2-b5ba-a6ffc6c0f290 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1444 microversion: 2.75 time: 0.148581 Oct 04 18:03:10.253596 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 332/636] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:10 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:03:10.346221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2eb2aa2d-32d8-4f01-b6b6-ef5d6270e8bc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.355682 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2eb2aa2d-32d8-4f01-b6b6-ef5d6270e8bc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1474 microversion: 2.1 time: 0.356085 Oct 04 18:03:10.356715 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 305/637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:09 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:10.361435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-bc4904bb-e906-4efe-8da9-3a03a89a3c4b req-262d44c7-0405-49e8-b1ec-aa981050eec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4b0323-60bc-47aa-8c5e-142573d6c375", "name": "network-vif-unplugged", "status": "completed", "tag": "c0d7f40e-b90b-492b-bffc-13171692063a"}, {"name": "network-changed", "server_uuid": "990802fe-4649-4012-aed3-c69104cea9f0", "tag": "e90faa84-86bb-4130-9b65-4e1e754b1c48"}, {"name": "network-changed", "server_uuid": "5a4b0323-60bc-47aa-8c5e-142573d6c375", "tag": "c0d7f40e-b90b-492b-bffc-13171692063a"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:10.373384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bc4904bb-e906-4efe-8da9-3a03a89a3c4b req-262d44c7-0405-49e8-b1ec-aa981050eec3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.374017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bc4904bb-e906-4efe-8da9-3a03a89a3c4b req-262d44c7-0405-49e8-b1ec-aa981050eec3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.374551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bc4904bb-e906-4efe-8da9-3a03a89a3c4b req-262d44c7-0405-49e8-b1ec-aa981050eec3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.394263 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-bc4904bb-e906-4efe-8da9-3a03a89a3c4b req-262d44c7-0405-49e8-b1ec-aa981050eec3 service nova] Creating event network-vif-unplugged:c0d7f40e-b90b-492b-bffc-13171692063a for instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 on n-h2-850499-14 Oct 04 18:03:10.394981 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-bc4904bb-e906-4efe-8da9-3a03a89a3c4b req-262d44c7-0405-49e8-b1ec-aa981050eec3 service nova] Creating event network-changed:e90faa84-86bb-4130-9b65-4e1e754b1c48 for instance 990802fe-4649-4012-aed3-c69104cea9f0 on n-h1-850499-14 Oct 04 18:03:10.395928 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-bc4904bb-e906-4efe-8da9-3a03a89a3c4b req-262d44c7-0405-49e8-b1ec-aa981050eec3 service nova] Creating event network-changed:c0d7f40e-b90b-492b-bffc-13171692063a for instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 on n-h2-850499-14 Oct 04 18:03:10.412407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-bc4904bb-e906-4efe-8da9-3a03a89a3c4b req-262d44c7-0405-49e8-b1ec-aa981050eec3 service nova] Instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:03:10.426709 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-bc4904bb-e906-4efe-8da9-3a03a89a3c4b req-262d44c7-0405-49e8-b1ec-aa981050eec3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.072559 Oct 04 18:03:10.428354 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 333/638] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:03:10.570308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8af09f1-6224-4152-8268-936fb0168b3a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:10.570916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e8af09f1-6224-4152-8268-936fb0168b3a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:10.577484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8af09f1-6224-4152-8268-936fb0168b3a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.578236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8af09f1-6224-4152-8268-936fb0168b3a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.578686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8af09f1-6224-4152-8268-936fb0168b3a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.579430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8af09f1-6224-4152-8268-936fb0168b3a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.579891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8af09f1-6224-4152-8268-936fb0168b3a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.580599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8af09f1-6224-4152-8268-936fb0168b3a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.735546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8af09f1-6224-4152-8268-936fb0168b3a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.744285 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e8af09f1-6224-4152-8268-936fb0168b3a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1310 microversion: 2.1 time: 0.178485 Oct 04 18:03:10.744856 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 306/639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:10 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1310 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:11.022992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d4eab6f-d118-4abe-856d-063d8466fc2a tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:11.023987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1d4eab6f-d118-4abe-856d-063d8466fc2a tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:11.032056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4eab6f-d118-4abe-856d-063d8466fc2a tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.032560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4eab6f-d118-4abe-856d-063d8466fc2a tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.033504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4eab6f-d118-4abe-856d-063d8466fc2a tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.034374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4eab6f-d118-4abe-856d-063d8466fc2a tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.035337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4eab6f-d118-4abe-856d-063d8466fc2a tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.035954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4eab6f-d118-4abe-856d-063d8466fc2a tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.046773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ee656dd-2ef7-40e6-9e09-9f059445b737 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:11.047466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ee656dd-2ef7-40e6-9e09-9f059445b737 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:11.061214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee656dd-2ef7-40e6-9e09-9f059445b737 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.061909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee656dd-2ef7-40e6-9e09-9f059445b737 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.062288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee656dd-2ef7-40e6-9e09-9f059445b737 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.063128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee656dd-2ef7-40e6-9e09-9f059445b737 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.063590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee656dd-2ef7-40e6-9e09-9f059445b737 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.064108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee656dd-2ef7-40e6-9e09-9f059445b737 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.726456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=12 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:11.755744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=12 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:11.921291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d4eab6f-d118-4abe-856d-063d8466fc2a tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:11.934524 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d4eab6f-d118-4abe-856d-063d8466fc2a tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1314 microversion: 2.1 time: 0.916837 Oct 04 18:03:11.935464 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 334/640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:11 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:11.950381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:11.951334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:11.955250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ee656dd-2ef7-40e6-9e09-9f059445b737 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:11.964159 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ee656dd-2ef7-40e6-9e09-9f059445b737 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1316 microversion: 2.1 time: 0.921949 Oct 04 18:03:11.966377 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 307/641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:11 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1316 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:11.971552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1f39f74-c5b5-4bea-9274-68788c23921b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:11.974468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e1f39f74-c5b5-4bea-9274-68788c23921b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:11.981610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1f39f74-c5b5-4bea-9274-68788c23921b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.982421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1f39f74-c5b5-4bea-9274-68788c23921b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.983106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1f39f74-c5b5-4bea-9274-68788c23921b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.983630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.984271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1f39f74-c5b5-4bea-9274-68788c23921b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.984386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.984821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.985262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1f39f74-c5b5-4bea-9274-68788c23921b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.985759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1f39f74-c5b5-4bea-9274-68788c23921b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.988361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.988860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.989772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.041028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.041526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.042112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.042575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lazy-loading 'fault' on Instance uuid f1b89df3-2184-442a-99a7-62eafd29ad13 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:03:12.106267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:12.120667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:12.122030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f459cbfd4cb2409fb48da66a0942e073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf3ffc97aa74dc1a6140c9a7e8fc881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:12.127286 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0c1a3793-c2a1-4283-98e4-b0bdd693147d tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 200 len: 1449 microversion: 2.75 time: 0.190488 Oct 04 18:03:12.128133 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 335/642] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:11 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 1449 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:12.154460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e822b595-dcfd-4e4c-9a67-09decd2e0991 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:12.155567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e822b595-dcfd-4e4c-9a67-09decd2e0991 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:12.164060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e822b595-dcfd-4e4c-9a67-09decd2e0991 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.164872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e822b595-dcfd-4e4c-9a67-09decd2e0991 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.166293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e822b595-dcfd-4e4c-9a67-09decd2e0991 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.166592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1f39f74-c5b5-4bea-9274-68788c23921b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:12.167185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e822b595-dcfd-4e4c-9a67-09decd2e0991 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.167743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e822b595-dcfd-4e4c-9a67-09decd2e0991 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.168349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e822b595-dcfd-4e4c-9a67-09decd2e0991 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.177776 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1f39f74-c5b5-4bea-9274-68788c23921b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1474 microversion: 2.1 time: 0.209952 Oct 04 18:03:12.178424 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 308/643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:11 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1474 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:12.344075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e822b595-dcfd-4e4c-9a67-09decd2e0991 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:12.353602 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e822b595-dcfd-4e4c-9a67-09decd2e0991 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1494 microversion: 2.1 time: 0.223081 Oct 04 18:03:12.354926 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 336/644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:12 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1494 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:12.381441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8aa98682-cf17-47fa-a81c-14b25242d56c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:12.382188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8aa98682-cf17-47fa-a81c-14b25242d56c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:12.390559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8aa98682-cf17-47fa-a81c-14b25242d56c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.391306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8aa98682-cf17-47fa-a81c-14b25242d56c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.392099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8aa98682-cf17-47fa-a81c-14b25242d56c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.393056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8aa98682-cf17-47fa-a81c-14b25242d56c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.394053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8aa98682-cf17-47fa-a81c-14b25242d56c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.395295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8aa98682-cf17-47fa-a81c-14b25242d56c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.579234 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8aa98682-cf17-47fa-a81c-14b25242d56c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1647 microversion: 2.1 time: 0.205709 Oct 04 18:03:12.580047 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 309/645] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:12 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1647 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:12.602500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9b37cde4-cc21-4406-941e-536d0bb47301 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:12.603152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9b37cde4-cc21-4406-941e-536d0bb47301 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:12.609921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b37cde4-cc21-4406-941e-536d0bb47301 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.610411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b37cde4-cc21-4406-941e-536d0bb47301 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.611179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b37cde4-cc21-4406-941e-536d0bb47301 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.612036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b37cde4-cc21-4406-941e-536d0bb47301 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.612683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b37cde4-cc21-4406-941e-536d0bb47301 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.614005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b37cde4-cc21-4406-941e-536d0bb47301 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.618208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:12.784132 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9b37cde4-cc21-4406-941e-536d0bb47301 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1647 microversion: 2.1 time: 0.185403 Oct 04 18:03:12.784725 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 337/646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:12 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1647 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:12.807296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5531066e-5611-4de7-88ff-c4624509691c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:12.811246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5531066e-5611-4de7-88ff-c4624509691c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.811917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5531066e-5611-4de7-88ff-c4624509691c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.812524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5531066e-5611-4de7-88ff-c4624509691c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.813820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5531066e-5611-4de7-88ff-c4624509691c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.814508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5531066e-5611-4de7-88ff-c4624509691c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.815756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5531066e-5611-4de7-88ff-c4624509691c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.850170 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5531066e-5611-4de7-88ff-c4624509691c tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.046978 Oct 04 18:03:12.851294 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 310/647] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 4 18:03:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:03:12.863669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-afa46360-188b-469b-9c93-0a8d4ebee915 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:12.864718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-afa46360-188b-469b-9c93-0a8d4ebee915 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:12.871897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa46360-188b-469b-9c93-0a8d4ebee915 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.872996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa46360-188b-469b-9c93-0a8d4ebee915 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.873656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa46360-188b-469b-9c93-0a8d4ebee915 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.875139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa46360-188b-469b-9c93-0a8d4ebee915 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.875825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa46360-188b-469b-9c93-0a8d4ebee915 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.876471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa46360-188b-469b-9c93-0a8d4ebee915 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.959399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc62fd0b-2d15-4484-ad18-379eeff42dbe tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:12.960711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dc62fd0b-2d15-4484-ad18-379eeff42dbe tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:12.976799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc62fd0b-2d15-4484-ad18-379eeff42dbe tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.977933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc62fd0b-2d15-4484-ad18-379eeff42dbe tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.978786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc62fd0b-2d15-4484-ad18-379eeff42dbe tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.979788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc62fd0b-2d15-4484-ad18-379eeff42dbe tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.980648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc62fd0b-2d15-4484-ad18-379eeff42dbe tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.989802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc62fd0b-2d15-4484-ad18-379eeff42dbe tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.992790 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-afa46360-188b-469b-9c93-0a8d4ebee915 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720/action" status: 202 len: 0 microversion: 2.1 time: 0.132600 Oct 04 18:03:12.994274 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 338/648] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:03:12 2022] POST /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:13.001395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-38fa3132-d7d0-41be-ab63-52428996f993 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.002787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-38fa3132-d7d0-41be-ab63-52428996f993 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:13.011848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38fa3132-d7d0-41be-ab63-52428996f993 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.012316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38fa3132-d7d0-41be-ab63-52428996f993 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.012764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38fa3132-d7d0-41be-ab63-52428996f993 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.013479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38fa3132-d7d0-41be-ab63-52428996f993 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.013937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38fa3132-d7d0-41be-ab63-52428996f993 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.014368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38fa3132-d7d0-41be-ab63-52428996f993 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.278446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-38fa3132-d7d0-41be-ab63-52428996f993 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.286819 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-38fa3132-d7d0-41be-ab63-52428996f993 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1316 microversion: 2.1 time: 0.290921 Oct 04 18:03:13.287926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc62fd0b-2d15-4484-ad18-379eeff42dbe tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.288833 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 339/649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:12 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:13.299093 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dc62fd0b-2d15-4484-ad18-379eeff42dbe tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1314 microversion: 2.1 time: 0.344767 Oct 04 18:03:13.301858 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 311/650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:12 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:13.307166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-465caf4f-cf1c-4ed0-8171-cdddd3c3e8fb tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.309765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-465caf4f-cf1c-4ed0-8171-cdddd3c3e8fb tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:13.316722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-465caf4f-cf1c-4ed0-8171-cdddd3c3e8fb tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.317502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-465caf4f-cf1c-4ed0-8171-cdddd3c3e8fb tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.318111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-465caf4f-cf1c-4ed0-8171-cdddd3c3e8fb tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.319619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-465caf4f-cf1c-4ed0-8171-cdddd3c3e8fb tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.321085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-465caf4f-cf1c-4ed0-8171-cdddd3c3e8fb tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.322023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-465caf4f-cf1c-4ed0-8171-cdddd3c3e8fb tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.450865 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-558bec11-118b-446e-bc40-4deb490f9eaf tempest-TenantUsagesNegativeTestJSON-453670367 tempest-TenantUsagesNegativeTestJSON-453670367-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T18%3A03%3A12.989993&end=2022-10-05T18%3A03%3A12.989993" status: 404 len: 112 microversion: - time: 0.160768 Oct 04 18:03:13.452374 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 340/651] 10.222.0.18 () {58 vars in 1316 bytes} [Tue Oct 4 18:03:13 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T18%3A03%3A12.989993&end=2022-10-05T18%3A03%3A12.989993 => generated 112 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:03:13.456671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.458169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] [instance: f1b89df3-2184-442a-99a7-62eafd29ad13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:13.460206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:13.465785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.466311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.466754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.467780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.468264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.468832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.485422 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] HTTP exception thrown: Instance f1b89df3-2184-442a-99a7-62eafd29ad13 could not be found. Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Request method failure captured: Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 HTTP/1.1 Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHT7nchlkNd7RGOqfZRW0dn8iSseI_XEFoR8vBdYFxTTLqZZHHxM9elwrgH92NMtloD-y_GwZwLxe2ZC1C4qYEWq6o0IwchxdFG-H0wWee5FFBOQbXuhlNaGlWcJOgMoby2VokhYIWju-IUepSvhx48-Kx22JGV8yrz-vaFI2L21EqU Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 5cf3ffc97aa74dc1a6140c9a7e8fc881 Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersAdmin275Test-134339239 Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:03:13.487373 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5cf3ffc97aa74dc1a6140c9a7e8fc881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5cf3ffc97aa74dc1a6140c9a7e8fc881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf3ffc97aa74dc1a6140c9a7e8fc881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cf3ffc97aa74dc1a6140c9a7e8fc881"}]}] Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersAdmin275Test-134339239 Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 5cf3ffc97aa74dc1a6140c9a7e8fc881 Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersAdmin275Test-134339239 Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersAdmin275Test-134339239-project Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: f459cbfd4cb2409fb48da66a0942e073 Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersAdmin275Test-134339239-project Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance f1b89df3-2184-442a-99a7-62eafd29ad13 could not be found. Oct 04 18:03:13.488813 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'f1b89df3-2184-442a-99a7-62eafd29ad13'} Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b89df3-2184-442a-99a7-62eafd29ad13 could not be found. Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:03:13.489566 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b89df3-2184-442a-99a7-62eafd29ad13 could not be found. Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b89df3-2184-442a-99a7-62eafd29ad13 could not be found. Oct 04 18:03:13.490772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.491948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] Returning 404 to user: Instance f1b89df3-2184-442a-99a7-62eafd29ad13 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:03:13.491948 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d40b5266-7de5-496c-8545-aab08b454d32 tempest-ServersAdmin275Test-134339239 tempest-ServersAdmin275Test-134339239-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13" status: 404 len: 111 microversion: 2.75 time: 0.035521 Oct 04 18:03:13.494247 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 341/652] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:13 2022] GET /compute/v2.1/servers/f1b89df3-2184-442a-99a7-62eafd29ad13 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:03:13.498977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f642fdb2-588f-4c91-83f7-9b43f0738271 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.499593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f642fdb2-588f-4c91-83f7-9b43f0738271 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:13.506041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f642fdb2-588f-4c91-83f7-9b43f0738271 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.506562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f642fdb2-588f-4c91-83f7-9b43f0738271 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.506981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f642fdb2-588f-4c91-83f7-9b43f0738271 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.507721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f642fdb2-588f-4c91-83f7-9b43f0738271 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.508179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f642fdb2-588f-4c91-83f7-9b43f0738271 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.508603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f642fdb2-588f-4c91-83f7-9b43f0738271 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.554528 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-465caf4f-cf1c-4ed0-8171-cdddd3c3e8fb tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1652 microversion: 2.1 time: 0.251356 Oct 04 18:03:13.558898 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 312/653] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:13 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1652 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:13.564684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-dc38ea44-fbf3-457b-b30f-d5fcb8c6e0ae req-d5f9f142-bd6e-48a2-a99a-ea2a200cdc02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa79c4dc-6409-43e7-85da-46dde9db68bd", "name": "network-vif-plugged", "status": "completed", "tag": "49406afb-3f01-47c9-934a-32a6e95c4e60"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:13.575543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dc38ea44-fbf3-457b-b30f-d5fcb8c6e0ae req-d5f9f142-bd6e-48a2-a99a-ea2a200cdc02 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.576333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dc38ea44-fbf3-457b-b30f-d5fcb8c6e0ae req-d5f9f142-bd6e-48a2-a99a-ea2a200cdc02 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.576987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dc38ea44-fbf3-457b-b30f-d5fcb8c6e0ae req-d5f9f142-bd6e-48a2-a99a-ea2a200cdc02 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.589625 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-dc38ea44-fbf3-457b-b30f-d5fcb8c6e0ae req-d5f9f142-bd6e-48a2-a99a-ea2a200cdc02 service nova] Creating event network-vif-plugged:49406afb-3f01-47c9-934a-32a6e95c4e60 for instance aa79c4dc-6409-43e7-85da-46dde9db68bd on n-h1-850499-14 Oct 04 18:03:13.602138 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-dc38ea44-fbf3-457b-b30f-d5fcb8c6e0ae req-d5f9f142-bd6e-48a2-a99a-ea2a200cdc02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041191 Oct 04 18:03:13.603444 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 313/654] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:13.610275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eeda7fe6-a4e4-480d-97e2-ffb415f0e960 tempest-TenantUsagesNegativeTestJSON-453670367 tempest-TenantUsagesNegativeTestJSON-453670367-project-admin] Calling method '.version_select at 0x7fd4d222c5e0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.618217 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-eeda7fe6-a4e4-480d-97e2-ffb415f0e960 tempest-TenantUsagesNegativeTestJSON-453670367 tempest-TenantUsagesNegativeTestJSON-453670367-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eeda7fe6-a4e4-480d-97e2-ffb415f0e960 tempest-TenantUsagesNegativeTestJSON-453670367 tempest-TenantUsagesNegativeTestJSON-453670367-project-admin] Request method failure captured: Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-simple-tenant-usage/8c1e8c1de4f54afba7b596fb5daa6669?start=2022-10-05T18%3A03%3A12.989993&end=2022-10-03T18%3A03%3A12.989993 HTTP/1.1 Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVgVMWubpUT1S71E7yDNwdYoPB6y3DqaGCOt0vyo6-bjlS-enJHWeDXEf9dTzncnchjduSc0sB4hbxcB3bkyQuzzr82W-2mBQnvMVRk3HCuDwuUjCv4BPb4nwKoc0s5CKxzsDzr1XiodWz0ufRGOfakSQw6i-jPH6_g__wAVQHsaYI Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5ddccb9bca0c4e9bbe55b0f598bcb867 Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-453670367 Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:03:13.620754 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ddccb9bca0c4e9bbe55b0f598bcb867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ddccb9bca0c4e9bbe55b0f598bcb867"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ddccb9bca0c4e9bbe55b0f598bcb867"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ddccb9bca0c4e9bbe55b0f598bcb867"}]}] Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-453670367 Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5ddccb9bca0c4e9bbe55b0f598bcb867 Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-453670367 Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TenantUsagesNegativeTestJSON-453670367-project-admin Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: aed8fba90bf347998ecbdfba8bc1d852 Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-453670367-project-admin Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 18:03:13.622042 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '8c1e8c1de4f54afba7b596fb5daa6669'} Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:03:13.622815 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 18:03:13.624146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.624146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:13.624146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.624146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:13.624146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:13.624146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:13.624146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:03:13.624146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:03:13.624146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 18:03:13.624146 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.626175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eeda7fe6-a4e4-480d-97e2-ffb415f0e960 tempest-TenantUsagesNegativeTestJSON-453670367 tempest-TenantUsagesNegativeTestJSON-453670367-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:03:13.627238 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eeda7fe6-a4e4-480d-97e2-ffb415f0e960 tempest-TenantUsagesNegativeTestJSON-453670367 tempest-TenantUsagesNegativeTestJSON-453670367-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/8c1e8c1de4f54afba7b596fb5daa6669?start=2022-10-05T18%3A03%3A12.989993&end=2022-10-03T18%3A03%3A12.989993" status: 400 len: 111 microversion: 2.1 time: 0.022457 Oct 04 18:03:13.629764 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 314/655] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Oct 4 18:03:13 2022] GET /compute/v2.1/os-simple-tenant-usage/8c1e8c1de4f54afba7b596fb5daa6669?start=2022-10-05T18%3A03%3A12.989993&end=2022-10-03T18%3A03%3A12.989993 => generated 111 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:03:13.801847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7733d71a-4517-441f-8c6d-f60e535d297e tempest-TenantUsagesNegativeTestJSON-1866101397 tempest-TenantUsagesNegativeTestJSON-1866101397-project] Calling method '.version_select at 0x7fd4d21c7940>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.808264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7733d71a-4517-441f-8c6d-f60e535d297e tempest-TenantUsagesNegativeTestJSON-1866101397 tempest-TenantUsagesNegativeTestJSON-1866101397-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '0154ae27377343c8874b58263ccee110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1e8c1de4f54afba7b596fb5daa6669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7733d71a-4517-441f-8c6d-f60e535d297e tempest-TenantUsagesNegativeTestJSON-1866101397 tempest-TenantUsagesNegativeTestJSON-1866101397-project] Request method failure captured: Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A03%3A12.989993&end=2022-10-05T18%3A03%3A12.989993&detailed=1 HTTP/1.1 Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVg7hKYX_uDr1Q4_UGtSd8Ap0Lp3sCjiFk_5gkdWZl5D2AM8W1ezN8wXxhU1wSs2N7vnsA7Hdj-OyWZlz8XxZ7uD-8zkK5Kts-kyM3uZ_Iqdn9WEB3iob0DMER4O3PokXedO4l10R7DhOPBtWXJcE9ff5dz-xBfvaMGPhRppzk4oqc Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 8c1e8c1de4f54afba7b596fb5daa6669 Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1866101397 Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:03:13.811244 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c1e8c1de4f54afba7b596fb5daa6669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c1e8c1de4f54afba7b596fb5daa6669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c1e8c1de4f54afba7b596fb5daa6669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c1e8c1de4f54afba7b596fb5daa6669"}]}] Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1866101397 Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 8c1e8c1de4f54afba7b596fb5daa6669 Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1866101397 Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TenantUsagesNegativeTestJSON-1866101397-project Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0154ae27377343c8874b58263ccee110 Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1866101397-project Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: action_args: {} Oct 04 18:03:13.812875 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:03:13.813850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:03:13.815256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:03:13.817215 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:03:13.817215 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:03:13.819853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7733d71a-4517-441f-8c6d-f60e535d297e tempest-TenantUsagesNegativeTestJSON-1866101397 tempest-TenantUsagesNegativeTestJSON-1866101397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:03:13.820985 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7733d71a-4517-441f-8c6d-f60e535d297e tempest-TenantUsagesNegativeTestJSON-1866101397 tempest-TenantUsagesNegativeTestJSON-1866101397-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A03%3A12.989993&end=2022-10-05T18%3A03%3A12.989993&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.185421 Oct 04 18:03:13.822065 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 315/656] 10.222.0.18 () {58 vars in 1335 bytes} [Tue Oct 4 18:03:13 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A03%3A12.989993&end=2022-10-05T18%3A03%3A12.989993&detailed=1 => generated 123 bytes in 187 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:03:13.837536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f642fdb2-588f-4c91-83f7-9b43f0738271 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.853650 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f642fdb2-588f-4c91-83f7-9b43f0738271 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1472 microversion: 2.1 time: 0.358285 Oct 04 18:03:13.854371 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 342/657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:13 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:14.311892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-48296cc8-24d6-4d8a-8732-0f58935b9999 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:14.312370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-48296cc8-24d6-4d8a-8732-0f58935b9999 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:14.325194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2428296a-10e5-4ae0-875c-0bd953d01da3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:14.326506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2428296a-10e5-4ae0-875c-0bd953d01da3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:14.326885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48296cc8-24d6-4d8a-8732-0f58935b9999 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.328054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48296cc8-24d6-4d8a-8732-0f58935b9999 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.328504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48296cc8-24d6-4d8a-8732-0f58935b9999 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.329232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48296cc8-24d6-4d8a-8732-0f58935b9999 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.329698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48296cc8-24d6-4d8a-8732-0f58935b9999 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.330142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48296cc8-24d6-4d8a-8732-0f58935b9999 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.335180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2428296a-10e5-4ae0-875c-0bd953d01da3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.335974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2428296a-10e5-4ae0-875c-0bd953d01da3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.336603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2428296a-10e5-4ae0-875c-0bd953d01da3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.337529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2428296a-10e5-4ae0-875c-0bd953d01da3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.338220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2428296a-10e5-4ae0-875c-0bd953d01da3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.339130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2428296a-10e5-4ae0-875c-0bd953d01da3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.698650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2428296a-10e5-4ae0-875c-0bd953d01da3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:14.717840 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2428296a-10e5-4ae0-875c-0bd953d01da3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1314 microversion: 2.1 time: 0.397057 Oct 04 18:03:14.718611 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 343/658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:14 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:14.723396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1aeb862-b646-4b57-b9ef-4f04878f2311 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:14.723998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1aeb862-b646-4b57-b9ef-4f04878f2311 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:14.748256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1aeb862-b646-4b57-b9ef-4f04878f2311 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.749059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1aeb862-b646-4b57-b9ef-4f04878f2311 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.749695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1aeb862-b646-4b57-b9ef-4f04878f2311 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.750509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-48296cc8-24d6-4d8a-8732-0f58935b9999 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:14.750840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1aeb862-b646-4b57-b9ef-4f04878f2311 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.751533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1aeb862-b646-4b57-b9ef-4f04878f2311 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.752127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1aeb862-b646-4b57-b9ef-4f04878f2311 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.763341 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-48296cc8-24d6-4d8a-8732-0f58935b9999 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1316 microversion: 2.1 time: 0.457062 Oct 04 18:03:14.763934 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 316/659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:14 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:14.880658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ca6df0c-6e4b-4a94-8b09-b3ac6bf8895d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:14.881883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ca6df0c-6e4b-4a94-8b09-b3ac6bf8895d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:14.895208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca6df0c-6e4b-4a94-8b09-b3ac6bf8895d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.913147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca6df0c-6e4b-4a94-8b09-b3ac6bf8895d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.913791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca6df0c-6e4b-4a94-8b09-b3ac6bf8895d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.914599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca6df0c-6e4b-4a94-8b09-b3ac6bf8895d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.919645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca6df0c-6e4b-4a94-8b09-b3ac6bf8895d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.920364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca6df0c-6e4b-4a94-8b09-b3ac6bf8895d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:15.132377 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1aeb862-b646-4b57-b9ef-4f04878f2311 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1652 microversion: 2.1 time: 0.412386 Oct 04 18:03:15.148442 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 344/660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:14 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1652 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:15.281006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ca6df0c-6e4b-4a94-8b09-b3ac6bf8895d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:15.293761 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ca6df0c-6e4b-4a94-8b09-b3ac6bf8895d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1472 microversion: 2.1 time: 0.418822 Oct 04 18:03:15.309297 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 317/661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:14 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1472 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:15.660473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7ba5c250-8dc8-4b05-8618-cd978bacd699 req-1c912908-b8a7-4b1e-8a01-d8090d3ef05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990802fe-4649-4012-aed3-c69104cea9f0", "name": "network-vif-plugged", "status": "completed", "tag": "e90faa84-86bb-4130-9b65-4e1e754b1c48"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:15.686766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7ba5c250-8dc8-4b05-8618-cd978bacd699 req-1c912908-b8a7-4b1e-8a01-d8090d3ef05f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:15.688286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7ba5c250-8dc8-4b05-8618-cd978bacd699 req-1c912908-b8a7-4b1e-8a01-d8090d3ef05f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:15.688810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7ba5c250-8dc8-4b05-8618-cd978bacd699 req-1c912908-b8a7-4b1e-8a01-d8090d3ef05f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:15.726663 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7ba5c250-8dc8-4b05-8618-cd978bacd699 req-1c912908-b8a7-4b1e-8a01-d8090d3ef05f service nova] Creating event network-vif-plugged:e90faa84-86bb-4130-9b65-4e1e754b1c48 for instance 990802fe-4649-4012-aed3-c69104cea9f0 on n-h1-850499-14 Oct 04 18:03:15.749591 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7ba5c250-8dc8-4b05-8618-cd978bacd699 req-1c912908-b8a7-4b1e-8a01-d8090d3ef05f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092894 Oct 04 18:03:15.749812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-08dca0d4-1bef-46c4-bae9-adf12412722e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:15.751017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08dca0d4-1bef-46c4-bae9-adf12412722e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:15.751613 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 345/662] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:15.762523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:15.764557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08dca0d4-1bef-46c4-bae9-adf12412722e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:15.765408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08dca0d4-1bef-46c4-bae9-adf12412722e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:15.767777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08dca0d4-1bef-46c4-bae9-adf12412722e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:15.770512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08dca0d4-1bef-46c4-bae9-adf12412722e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:15.772333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08dca0d4-1bef-46c4-bae9-adf12412722e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:15.773949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08dca0d4-1bef-46c4-bae9-adf12412722e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:15.792095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a0e0a66-32ab-4c21-b05e-546e96a6a50c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:15.794772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a0e0a66-32ab-4c21-b05e-546e96a6a50c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:15.822412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0e0a66-32ab-4c21-b05e-546e96a6a50c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:15.824375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0e0a66-32ab-4c21-b05e-546e96a6a50c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:15.825045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0e0a66-32ab-4c21-b05e-546e96a6a50c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:15.825970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0e0a66-32ab-4c21-b05e-546e96a6a50c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:15.827681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0e0a66-32ab-4c21-b05e-546e96a6a50c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:15.828344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0e0a66-32ab-4c21-b05e-546e96a6a50c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.259432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-08dca0d4-1bef-46c4-bae9-adf12412722e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:16.274466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9a0e0a66-32ab-4c21-b05e-546e96a6a50c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:16.284056 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-08dca0d4-1bef-46c4-bae9-adf12412722e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1314 microversion: 2.1 time: 0.542182 Oct 04 18:03:16.285915 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a0e0a66-32ab-4c21-b05e-546e96a6a50c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1465 microversion: 2.1 time: 0.498897 Oct 04 18:03:16.287163 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 318/663] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:15 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:16.288992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 346/664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:15 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1465 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:16.294067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5b6c907a-77d9-4276-a8eb-39cb6a7fbc15 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:16.295012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5b6c907a-77d9-4276-a8eb-39cb6a7fbc15 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:16.306524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b6c907a-77d9-4276-a8eb-39cb6a7fbc15 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:16.307067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b6c907a-77d9-4276-a8eb-39cb6a7fbc15 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:16.307560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b6c907a-77d9-4276-a8eb-39cb6a7fbc15 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.308259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b6c907a-77d9-4276-a8eb-39cb6a7fbc15 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:16.308879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b6c907a-77d9-4276-a8eb-39cb6a7fbc15 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:16.309460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b6c907a-77d9-4276-a8eb-39cb6a7fbc15 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.588758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:16.599151 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5b6c907a-77d9-4276-a8eb-39cb6a7fbc15 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1632 microversion: 2.1 time: 0.310665 Oct 04 18:03:16.601050 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 319/665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:16 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1632 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:16.613999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cacc2db1-3e64-4df2-905c-628b16f00941 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:16.617884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cacc2db1-3e64-4df2-905c-628b16f00941 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:16.629224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cacc2db1-3e64-4df2-905c-628b16f00941 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:16.629720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cacc2db1-3e64-4df2-905c-628b16f00941 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:16.633428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cacc2db1-3e64-4df2-905c-628b16f00941 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.634175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cacc2db1-3e64-4df2-905c-628b16f00941 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:16.634669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cacc2db1-3e64-4df2-905c-628b16f00941 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:16.636046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cacc2db1-3e64-4df2-905c-628b16f00941 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.699643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2767c6ef-1dea-4b3c-9283-1fca5d192b7b tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:16.700244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2767c6ef-1dea-4b3c-9283-1fca5d192b7b tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:16.706706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2767c6ef-1dea-4b3c-9283-1fca5d192b7b tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:16.707418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2767c6ef-1dea-4b3c-9283-1fca5d192b7b tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:16.708033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2767c6ef-1dea-4b3c-9283-1fca5d192b7b tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.708885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2767c6ef-1dea-4b3c-9283-1fca5d192b7b tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:16.709491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2767c6ef-1dea-4b3c-9283-1fca5d192b7b tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:16.710066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2767c6ef-1dea-4b3c-9283-1fca5d192b7b tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.880089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cacc2db1-3e64-4df2-905c-628b16f00941 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:16.888388 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cacc2db1-3e64-4df2-905c-628b16f00941 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1469 microversion: 2.1 time: 0.285496 Oct 04 18:03:16.896726 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 320/666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:16 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1469 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:16.917640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850499-14", "block_migration": true, "disk_over_commit": false}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:16.927710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:16.947073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:16.947859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:16.948321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.949196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:16.949817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:16.950387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:17.008407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lazy-loading 'flavor' on Instance uuid 27b090a0-2ada-4af7-be73-c21ed69a3720 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:03:17.044344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Going to try to live migrate instance to n-h1-850499-14 {{(pid=122331) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:03:17.152587 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2767c6ef-1dea-4b3c-9283-1fca5d192b7b tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1618 microversion: 2.1 time: 0.839285 Oct 04 18:03:17.177771 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 347/667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:16 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1618 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:17.186260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5b46346e-b2b1-43b3-9eae-9f5e74f5f374 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:17.186815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5b46346e-b2b1-43b3-9eae-9f5e74f5f374 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:17.225565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b46346e-b2b1-43b3-9eae-9f5e74f5f374 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:17.226075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b46346e-b2b1-43b3-9eae-9f5e74f5f374 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:17.226515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b46346e-b2b1-43b3-9eae-9f5e74f5f374 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:17.227254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b46346e-b2b1-43b3-9eae-9f5e74f5f374 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:17.227708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b46346e-b2b1-43b3-9eae-9f5e74f5f374 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:17.228132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b46346e-b2b1-43b3-9eae-9f5e74f5f374 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:17.334148 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5b46346e-b2b1-43b3-9eae-9f5e74f5f374 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375/action" status: 204 len: 0 microversion: 2.1 time: 0.154619 Oct 04 18:03:17.336315 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 348/668] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:03:17 2022] POST /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375/action => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:03:17.356575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-caf7bc0f-c8dd-440b-8b63-07f3d7f039de tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Action: 'create', calling method: .version_select at 0x7fd4d22849d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-528860700", "policies": ["affinity"]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:17.406507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-caf7bc0f-c8dd-440b-8b63-07f3d7f039de tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:17.422938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-caf7bc0f-c8dd-440b-8b63-07f3d7f039de tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:17.554914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-caf7bc0f-c8dd-440b-8b63-07f3d7f039de tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:17.564222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-caf7bc0f-c8dd-440b-8b63-07f3d7f039de tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:17.610555 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-caf7bc0f-c8dd-440b-8b63-07f3d7f039de tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.272331 Oct 04 18:03:17.613794 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 349/669] 10.222.0.18 () {60 vars in 1174 bytes} [Tue Oct 4 18:03:17 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:17.630145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a913a276-d44b-4639-bc76-ef816b8aaf43 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:17.631166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a913a276-d44b-4639-bc76-ef816b8aaf43 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:17.643228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a913a276-d44b-4639-bc76-ef816b8aaf43 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:17.649326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a913a276-d44b-4639-bc76-ef816b8aaf43 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:17.650896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a913a276-d44b-4639-bc76-ef816b8aaf43 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:17.652969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a913a276-d44b-4639-bc76-ef816b8aaf43 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:17.655071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a913a276-d44b-4639-bc76-ef816b8aaf43 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:17.656598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a913a276-d44b-4639-bc76-ef816b8aaf43 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:18.029298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a913a276-d44b-4639-bc76-ef816b8aaf43 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:18.047730 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a913a276-d44b-4639-bc76-ef816b8aaf43 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1314 microversion: 2.1 time: 0.432546 Oct 04 18:03:18.048320 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 350/670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:17 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:18.061968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db9cc6ff-ea88-4d85-8163-34ba7472a9fe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:18.062914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-db9cc6ff-ea88-4d85-8163-34ba7472a9fe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:18.081282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db9cc6ff-ea88-4d85-8163-34ba7472a9fe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:18.082133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db9cc6ff-ea88-4d85-8163-34ba7472a9fe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:18.082736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db9cc6ff-ea88-4d85-8163-34ba7472a9fe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:18.083644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db9cc6ff-ea88-4d85-8163-34ba7472a9fe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:18.085702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db9cc6ff-ea88-4d85-8163-34ba7472a9fe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:18.089506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db9cc6ff-ea88-4d85-8163-34ba7472a9fe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:18.574970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-db9cc6ff-ea88-4d85-8163-34ba7472a9fe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:18.583366 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-db9cc6ff-ea88-4d85-8163-34ba7472a9fe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1469 microversion: 2.1 time: 0.533985 Oct 04 18:03:18.583947 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 351/671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:18 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1469 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:18.595802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2114973886", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1ac34048-0a16-40a7-9526-17415b175fb8"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:18.709364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:19.636797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:19.638444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:19.643143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:19.644428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:19.645735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:19.687512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:19.688876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:19.691283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:19.692677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:19.694331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:19.695253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:19.743679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:19.757418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:19.779051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Going to run 2 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:19.782981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:19.873295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122332) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 18:03:19.934440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:19.955976 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c83fc6b0-d4fc-4532-9925-8faa7d86abc4 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720/action" status: 202 len: 0 microversion: 2.1 time: 3.057859 Oct 04 18:03:19.956857 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 321/672] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:03:16 2022] POST /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720/action => generated 0 bytes in 3059 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:19.962914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5dde9460-77b3-4c39-a71a-8443967bdaa3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:19.964455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5dde9460-77b3-4c39-a71a-8443967bdaa3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:19.988773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dde9460-77b3-4c39-a71a-8443967bdaa3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:19.989453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dde9460-77b3-4c39-a71a-8443967bdaa3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:19.990103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dde9460-77b3-4c39-a71a-8443967bdaa3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:19.990913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dde9460-77b3-4c39-a71a-8443967bdaa3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:19.991867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dde9460-77b3-4c39-a71a-8443967bdaa3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:19.992412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dde9460-77b3-4c39-a71a-8443967bdaa3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:20.233457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:20.316341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:20.325825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:20.363598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=c31b2e2a-3ff2-4f05-b2c5-071a392b21ea,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:20.371344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5dde9460-77b3-4c39-a71a-8443967bdaa3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:20.384681 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5dde9460-77b3-4c39-a71a-8443967bdaa3 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1464 microversion: 2.1 time: 0.426650 Oct 04 18:03:20.387286 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 322/673] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:19 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1464 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:20.398844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-28188aa9-4d6a-405d-ad03-80b8d04246d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:20.399751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-28188aa9-4d6a-405d-ad03-80b8d04246d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:20.417952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28188aa9-4d6a-405d-ad03-80b8d04246d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:20.422682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28188aa9-4d6a-405d-ad03-80b8d04246d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:20.423479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28188aa9-4d6a-405d-ad03-80b8d04246d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:20.424737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28188aa9-4d6a-405d-ad03-80b8d04246d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:20.427829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28188aa9-4d6a-405d-ad03-80b8d04246d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:20.428667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28188aa9-4d6a-405d-ad03-80b8d04246d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:20.460904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:20.466991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:20.468093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:20.528689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:20.533680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:20.579699 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b976d75-de6b-45b4-9fb1-38d4dc8f4252 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.987540 Oct 04 18:03:20.580457 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 352/674] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:18 2022] POST /compute/v2.1/servers => generated 32 bytes in 1996 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:03:20.586716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-57482d75-b5f8-4b3a-90ae-41cfd10a4971 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:20.588145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57482d75-b5f8-4b3a-90ae-41cfd10a4971 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:20.625797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57482d75-b5f8-4b3a-90ae-41cfd10a4971 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:20.629076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57482d75-b5f8-4b3a-90ae-41cfd10a4971 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:20.636463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57482d75-b5f8-4b3a-90ae-41cfd10a4971 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:20.637479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57482d75-b5f8-4b3a-90ae-41cfd10a4971 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:20.638020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57482d75-b5f8-4b3a-90ae-41cfd10a4971 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:20.638762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57482d75-b5f8-4b3a-90ae-41cfd10a4971 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.220331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-28188aa9-4d6a-405d-ad03-80b8d04246d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:21.245586 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-28188aa9-4d6a-405d-ad03-80b8d04246d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1469 microversion: 2.1 time: 0.855853 Oct 04 18:03:21.248144 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 323/675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:20 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1469 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:21.261556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-95f08eaf-4d9a-4160-b5bb-f4a8f4f0e674 req-e228356f-0c2e-409c-9960-340a7ea6db45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4b0323-60bc-47aa-8c5e-142573d6c375", "name": "network-vif-plugged", "status": "completed", "tag": "c0d7f40e-b90b-492b-bffc-13171692063a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:21.283408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-95f08eaf-4d9a-4160-b5bb-f4a8f4f0e674 req-e228356f-0c2e-409c-9960-340a7ea6db45 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.283911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-95f08eaf-4d9a-4160-b5bb-f4a8f4f0e674 req-e228356f-0c2e-409c-9960-340a7ea6db45 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.284397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-95f08eaf-4d9a-4160-b5bb-f4a8f4f0e674 req-e228356f-0c2e-409c-9960-340a7ea6db45 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.321387 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-95f08eaf-4d9a-4160-b5bb-f4a8f4f0e674 req-e228356f-0c2e-409c-9960-340a7ea6db45 service nova] Creating event network-vif-plugged:c0d7f40e-b90b-492b-bffc-13171692063a for instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 on n-h2-850499-14 Oct 04 18:03:21.334718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-95f08eaf-4d9a-4160-b5bb-f4a8f4f0e674 req-e228356f-0c2e-409c-9960-340a7ea6db45 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084421 Oct 04 18:03:21.338891 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 324/676] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:21.472547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-57482d75-b5f8-4b3a-90ae-41cfd10a4971 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:21.483405 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-57482d75-b5f8-4b3a-90ae-41cfd10a4971 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 0.901362 Oct 04 18:03:21.484000 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 353/677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:20 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:21.497432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:21.510248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:21.517219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Searching by: {'deleted': False, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:03:21.554233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.554730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.555199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.560907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.561412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.561856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.786734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ab48121-6d2e-4dd5-86de-0c939a501613 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Calling method '.version_select at 0x7fd4d2350dc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:21.823245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:03:21.831410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ab48121-6d2e-4dd5-86de-0c939a501613 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.834348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ab48121-6d2e-4dd5-86de-0c939a501613 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.836617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ab48121-6d2e-4dd5-86de-0c939a501613 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.900037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ab48121-6d2e-4dd5-86de-0c939a501613 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.901673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ab48121-6d2e-4dd5-86de-0c939a501613 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.904097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ab48121-6d2e-4dd5-86de-0c939a501613 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.946209 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ab48121-6d2e-4dd5-86de-0c939a501613 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/7a024b1909ca4616a8aa9c071435ad5d?start=2022-10-03T18%3A03%3A20.400803&end=2022-10-05T18%3A03%3A20.400803" status: 200 len: 695 microversion: 2.1 time: 0.604282 Oct 04 18:03:21.950728 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 325/678] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Oct 4 18:03:21 2022] GET /compute/v2.1/os-simple-tenant-usage/7a024b1909ca4616a8aa9c071435ad5d?start=2022-10-03T18%3A03%3A20.400803&end=2022-10-05T18%3A03%3A20.400803 => generated 695 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:21.988438 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e9731c9f-d35b-4e01-ad44-057c99def77a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.503358 Oct 04 18:03:21.989078 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 354/679] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:03:21 2022] GET /compute/v2.1/servers => generated 1003 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:22.000867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-38a14793-003c-4f44-a6c5-3802e1c1794e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '.version_select at 0x7fd4d2758af0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:22.028715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38a14793-003c-4f44-a6c5-3802e1c1794e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.029474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38a14793-003c-4f44-a6c5-3802e1c1794e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.034477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38a14793-003c-4f44-a6c5-3802e1c1794e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.085298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-92d14ed9-89c7-425f-95e7-a2e5cbb59125 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Action: 'create', calling method: .version_select at 0x7fd4d21a58b0>, body: {"keypair": {"name": "tempest-keypair-1867673379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsscHCpCvUNrLzMrxWdN780TW5d9oF49tSVfWIppdMYotrIPq0qJW/+MOS6QOpOecgSFcDBwJQ9GqI5VuCbH67EeizKEyeZt90L+eOJbBHt8ZIXLLgzQXvlBOCz1gwR/g=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:22.106847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38a14793-003c-4f44-a6c5-3802e1c1794e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.112608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38a14793-003c-4f44-a6c5-3802e1c1794e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.116508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38a14793-003c-4f44-a6c5-3802e1c1794e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.153014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-92d14ed9-89c7-425f-95e7-a2e5cbb59125 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Getting quotas for project ec29258aab154d4aaf11ff64931a4fbe. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:22.162273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:22.163212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-92d14ed9-89c7-425f-95e7-a2e5cbb59125 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Getting quotas for user b6d1205c1bd748c6845643ae231bf19a and project ec29258aab154d4aaf11ff64931a4fbe. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:22.172131 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-38a14793-003c-4f44-a6c5-3802e1c1794e tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/7a024b1909ca4616a8aa9c071435ad5d?start=2022-10-03T18%3A03%3A20.400803&end=2022-10-05T18%3A03%3A20.400803" status: 200 len: 694 microversion: 2.1 time: 0.178078 Oct 04 18:03:22.186777 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 355/680] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Oct 4 18:03:21 2022] GET /compute/v2.1/os-simple-tenant-usage/7a024b1909ca4616a8aa9c071435ad5d?start=2022-10-03T18%3A03%3A20.400803&end=2022-10-05T18%3A03%3A20.400803 => generated 694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:22.203923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-91681c7a-dff2-4550-87dc-5b4114e4419d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:22.207581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-91681c7a-dff2-4550-87dc-5b4114e4419d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:22.220483 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-92d14ed9-89c7-425f-95e7-a2e5cbb59125 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.267090 Oct 04 18:03:22.230791 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 326/681] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:03:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:22.234853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91681c7a-dff2-4550-87dc-5b4114e4419d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.235932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91681c7a-dff2-4550-87dc-5b4114e4419d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.237758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91681c7a-dff2-4550-87dc-5b4114e4419d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.241443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91681c7a-dff2-4550-87dc-5b4114e4419d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.242480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9c9a3699-5456-43a3-95ef-eb27de61c720 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Calling method '.version_select at 0x7fd4d21c7c10>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:22.243038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91681c7a-dff2-4550-87dc-5b4114e4419d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.245149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91681c7a-dff2-4550-87dc-5b4114e4419d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.263682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9a3699-5456-43a3-95ef-eb27de61c720 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.264172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9a3699-5456-43a3-95ef-eb27de61c720 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.264612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9a3699-5456-43a3-95ef-eb27de61c720 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.304341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9a3699-5456-43a3-95ef-eb27de61c720 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.304842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9a3699-5456-43a3-95ef-eb27de61c720 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.305808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9a3699-5456-43a3-95ef-eb27de61c720 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.405422 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9c9a3699-5456-43a3-95ef-eb27de61c720 tempest-TenantUsagesTestJSON-1134870441 tempest-TenantUsagesTestJSON-1134870441-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A03%3A20.400803&end=2022-10-05T18%3A03%3A20.400803&detailed=1" status: 200 len: 8481 microversion: 2.1 time: 0.172863 Oct 04 18:03:22.411331 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 327/682] 10.222.0.18 () {58 vars in 1335 bytes} [Tue Oct 4 18:03:22 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A03%3A20.400803&end=2022-10-05T18%3A03%3A20.400803&detailed=1 => generated 8481 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:22.426670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-528770ff-2ef9-489f-ab80-e40f523e8bd4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:22.428187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-528770ff-2ef9-489f-ab80-e40f523e8bd4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:22.439270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-528770ff-2ef9-489f-ab80-e40f523e8bd4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.440163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-528770ff-2ef9-489f-ab80-e40f523e8bd4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.441504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-528770ff-2ef9-489f-ab80-e40f523e8bd4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.442410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-528770ff-2ef9-489f-ab80-e40f523e8bd4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.442879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-528770ff-2ef9-489f-ab80-e40f523e8bd4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.443465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-528770ff-2ef9-489f-ab80-e40f523e8bd4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.533308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91681c7a-dff2-4550-87dc-5b4114e4419d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:22.551183 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-91681c7a-dff2-4550-87dc-5b4114e4419d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1223 microversion: 2.1 time: 0.362622 Oct 04 18:03:22.552269 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 356/683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:22 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1223 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:22.556880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52d29ead-bc0c-4cad-ba32-7d6ee717cb1f tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:22.561585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-52d29ead-bc0c-4cad-ba32-7d6ee717cb1f tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:22.575779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d29ead-bc0c-4cad-ba32-7d6ee717cb1f tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.582413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d29ead-bc0c-4cad-ba32-7d6ee717cb1f tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.583135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d29ead-bc0c-4cad-ba32-7d6ee717cb1f tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.584065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d29ead-bc0c-4cad-ba32-7d6ee717cb1f tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.588181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d29ead-bc0c-4cad-ba32-7d6ee717cb1f tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.588860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d29ead-bc0c-4cad-ba32-7d6ee717cb1f tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.709972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-52d29ead-bc0c-4cad-ba32-7d6ee717cb1f tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:03:22.775067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-528770ff-2ef9-489f-ab80-e40f523e8bd4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:22.787623 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-528770ff-2ef9-489f-ab80-e40f523e8bd4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1461 microversion: 2.1 time: 0.375143 Oct 04 18:03:22.804273 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 328/684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:22 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1461 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:22.804273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a633579-0628-4b69-888b-f9c00559745e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:22.804273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a633579-0628-4b69-888b-f9c00559745e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:22.836785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a633579-0628-4b69-888b-f9c00559745e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.839312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a633579-0628-4b69-888b-f9c00559745e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.840217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a633579-0628-4b69-888b-f9c00559745e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.842270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a633579-0628-4b69-888b-f9c00559745e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.843725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a633579-0628-4b69-888b-f9c00559745e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.845863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a633579-0628-4b69-888b-f9c00559745e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.960315 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-52d29ead-bc0c-4cad-ba32-7d6ee717cb1f tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "DELETE /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 204 len: 0 microversion: 2.1 time: 0.406640 Oct 04 18:03:22.965370 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 357/685] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:03:22 2022] DELETE /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:03:22.970974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b67f9f4b-7148-40eb-b7ea-867aadf7c7aa tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:22.971661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b67f9f4b-7148-40eb-b7ea-867aadf7c7aa tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:22.980297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b67f9f4b-7148-40eb-b7ea-867aadf7c7aa tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.980989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b67f9f4b-7148-40eb-b7ea-867aadf7c7aa tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.983376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b67f9f4b-7148-40eb-b7ea-867aadf7c7aa tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.992094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b67f9f4b-7148-40eb-b7ea-867aadf7c7aa tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:22.992575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b67f9f4b-7148-40eb-b7ea-867aadf7c7aa tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:22.993034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b67f9f4b-7148-40eb-b7ea-867aadf7c7aa tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:23.338992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a633579-0628-4b69-888b-f9c00559745e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:23.350581 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a633579-0628-4b69-888b-f9c00559745e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 0.552010 Oct 04 18:03:23.373407 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 329/686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:22 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:23.389120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-846a48ab-be41-43b3-9158-daa0cddfbd27 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:23.392251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-846a48ab-be41-43b3-9158-daa0cddfbd27 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:23.394901 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b67f9f4b-7148-40eb-b7ea-867aadf7c7aa tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1614 microversion: 2.1 time: 0.428134 Oct 04 18:03:23.397059 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 358/687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:22 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1614 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:23.429014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-846a48ab-be41-43b3-9158-daa0cddfbd27 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:23.429229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ced2075-b219-4c5b-b506-863ffe99f657 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '.version_select at 0x7fd4d29111f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:23.432468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-846a48ab-be41-43b3-9158-daa0cddfbd27 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:23.435565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-846a48ab-be41-43b3-9158-daa0cddfbd27 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:23.436621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-846a48ab-be41-43b3-9158-daa0cddfbd27 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:23.437323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-846a48ab-be41-43b3-9158-daa0cddfbd27 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:23.438009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-846a48ab-be41-43b3-9158-daa0cddfbd27 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:23.451801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ced2075-b219-4c5b-b506-863ffe99f657 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:23.465651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ced2075-b219-4c5b-b506-863ffe99f657 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:23.466351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ced2075-b219-4c5b-b506-863ffe99f657 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:23.499310 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ced2075-b219-4c5b-b506-863ffe99f657 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1189 microversion: 2.1 time: 0.073645 Oct 04 18:03:23.507178 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 359/688] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:03:23 2022] GET /compute/v2.1/os-migrations => generated 1189 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:23.578965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e494adc8-6fe9-4ab9-9992-1c72d1dba8b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:23.580105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e494adc8-6fe9-4ab9-9992-1c72d1dba8b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:23.592552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e494adc8-6fe9-4ab9-9992-1c72d1dba8b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:23.593050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e494adc8-6fe9-4ab9-9992-1c72d1dba8b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:23.593495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e494adc8-6fe9-4ab9-9992-1c72d1dba8b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:23.594242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e494adc8-6fe9-4ab9-9992-1c72d1dba8b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:23.594701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e494adc8-6fe9-4ab9-9992-1c72d1dba8b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:23.595110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e494adc8-6fe9-4ab9-9992-1c72d1dba8b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:23.834075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-846a48ab-be41-43b3-9158-daa0cddfbd27 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:23.844358 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-846a48ab-be41-43b3-9158-daa0cddfbd27 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1470 microversion: 2.1 time: 0.469254 Oct 04 18:03:23.860578 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 330/689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:23 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1470 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:23.879257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-480069793", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:23.914117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e494adc8-6fe9-4ab9-9992-1c72d1dba8b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:23.925647 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e494adc8-6fe9-4ab9-9992-1c72d1dba8b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1271 microversion: 2.1 time: 0.350196 Oct 04 18:03:23.926932 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 360/690] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:23 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1271 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:23.959956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:24.391410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ba82f4a-e8a6-42fd-8e2a-ccd6ea9a9b62 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:24.392911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ba82f4a-e8a6-42fd-8e2a-ccd6ea9a9b62 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:24.405955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba82f4a-e8a6-42fd-8e2a-ccd6ea9a9b62 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:24.410697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba82f4a-e8a6-42fd-8e2a-ccd6ea9a9b62 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:24.411424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba82f4a-e8a6-42fd-8e2a-ccd6ea9a9b62 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:24.416335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba82f4a-e8a6-42fd-8e2a-ccd6ea9a9b62 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:24.428842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba82f4a-e8a6-42fd-8e2a-ccd6ea9a9b62 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:24.458283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba82f4a-e8a6-42fd-8e2a-ccd6ea9a9b62 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.134177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:25.134924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:25.135949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:25.136872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:25.138117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:25.159374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:25.160323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:25.160997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.162504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:25.165667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:25.166504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.194706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:25.201448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for user d7458740d4be4cedaa01bea94ba992d2 and project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:25.227762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:25.231939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:25.296916 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-76b859d1-9292-4375-a6b7-4fc49cf41c15 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.423147 Oct 04 18:03:25.299002 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 331/691] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:25.308386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-140fb7c2-4501-404e-906f-c6633be33365 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:25.309351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-140fb7c2-4501-404e-906f-c6633be33365 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:25.320420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-140fb7c2-4501-404e-906f-c6633be33365 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:25.337248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-140fb7c2-4501-404e-906f-c6633be33365 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:25.337922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-140fb7c2-4501-404e-906f-c6633be33365 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.341405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-140fb7c2-4501-404e-906f-c6633be33365 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:25.344668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-140fb7c2-4501-404e-906f-c6633be33365 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:25.346413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-140fb7c2-4501-404e-906f-c6633be33365 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.346547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ba82f4a-e8a6-42fd-8e2a-ccd6ea9a9b62 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:25.373989 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ba82f4a-e8a6-42fd-8e2a-ccd6ea9a9b62 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 0.990163 Oct 04 18:03:25.386993 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 361/692] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:24 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:25.386993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-523b99d6-33b7-4a07-8d40-2a52e59cc59e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:25.386993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-523b99d6-33b7-4a07-8d40-2a52e59cc59e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:25.417368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523b99d6-33b7-4a07-8d40-2a52e59cc59e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:25.418038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523b99d6-33b7-4a07-8d40-2a52e59cc59e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:25.418292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523b99d6-33b7-4a07-8d40-2a52e59cc59e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.419031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523b99d6-33b7-4a07-8d40-2a52e59cc59e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:25.420209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523b99d6-33b7-4a07-8d40-2a52e59cc59e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:25.420646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523b99d6-33b7-4a07-8d40-2a52e59cc59e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.918631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-523b99d6-33b7-4a07-8d40-2a52e59cc59e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:25.945025 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-523b99d6-33b7-4a07-8d40-2a52e59cc59e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1277 microversion: 2.1 time: 0.568784 Oct 04 18:03:25.955626 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 362/693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:25 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1277 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:25.983336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b5644098-2da0-44ff-b578-ac867b761347 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:25.984295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b5644098-2da0-44ff-b578-ac867b761347 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:26.501193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b5644098-2da0-44ff-b578-ac867b761347 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:26.514693 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b5644098-2da0-44ff-b578-ac867b761347 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1212 microversion: 2.1 time: 0.535951 Oct 04 18:03:26.516121 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 363/694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:25 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1212 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:26.526450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0e968714-cd82-47c7-beba-ed006097d934 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:26.531597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0e968714-cd82-47c7-beba-ed006097d934 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:26.543502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e968714-cd82-47c7-beba-ed006097d934 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:26.543953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e968714-cd82-47c7-beba-ed006097d934 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:26.544406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e968714-cd82-47c7-beba-ed006097d934 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:26.545148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e968714-cd82-47c7-beba-ed006097d934 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:26.545614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e968714-cd82-47c7-beba-ed006097d934 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:26.546048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e968714-cd82-47c7-beba-ed006097d934 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:26.820941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-140fb7c2-4501-404e-906f-c6633be33365 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:26.833635 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-140fb7c2-4501-404e-906f-c6633be33365 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1470 microversion: 2.1 time: 1.530725 Oct 04 18:03:26.853670 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 332/695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:25 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1470 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:26.863628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e9aeb07a-1860-4777-83c8-c88ec7337123 req-774d9855-a305-4ed2-9826-c18b2260b1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b090a0-2ada-4af7-be73-c21ed69a3720", "name": "network-vif-unplugged", "status": "completed", "tag": "55fe455b-5dcd-4805-b03b-0514147b4e32"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:26.878227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e9aeb07a-1860-4777-83c8-c88ec7337123 req-774d9855-a305-4ed2-9826-c18b2260b1fe service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:26.879443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e9aeb07a-1860-4777-83c8-c88ec7337123 req-774d9855-a305-4ed2-9826-c18b2260b1fe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:26.880091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e9aeb07a-1860-4777-83c8-c88ec7337123 req-774d9855-a305-4ed2-9826-c18b2260b1fe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:26.896174 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e9aeb07a-1860-4777-83c8-c88ec7337123 req-774d9855-a305-4ed2-9826-c18b2260b1fe service nova] Creating event network-vif-unplugged:55fe455b-5dcd-4805-b03b-0514147b4e32 for instance 27b090a0-2ada-4af7-be73-c21ed69a3720 on n-h2-850499-14 Oct 04 18:03:26.904422 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e9aeb07a-1860-4777-83c8-c88ec7337123 req-774d9855-a305-4ed2-9826-c18b2260b1fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048648 Oct 04 18:03:26.906544 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 333/696] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:26.975326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7bc768b6-bcfe-4f31-b770-e3d6c0248561 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:26.981372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7bc768b6-bcfe-4f31-b770-e3d6c0248561 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:27.017048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bc768b6-bcfe-4f31-b770-e3d6c0248561 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.019234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bc768b6-bcfe-4f31-b770-e3d6c0248561 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.020318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bc768b6-bcfe-4f31-b770-e3d6c0248561 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.021294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bc768b6-bcfe-4f31-b770-e3d6c0248561 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.023572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bc768b6-bcfe-4f31-b770-e3d6c0248561 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.024345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bc768b6-bcfe-4f31-b770-e3d6c0248561 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.235188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7bc768b6-bcfe-4f31-b770-e3d6c0248561 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:27.255592 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7bc768b6-bcfe-4f31-b770-e3d6c0248561 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1277 microversion: 2.1 time: 0.287959 Oct 04 18:03:27.270991 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 334/697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:26 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1277 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:27.412834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e9a53652-d02b-499f-88f5-2a2b0709f308 req-e63d0715-f86b-4691-a648-bfd780c5a5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990802fe-4649-4012-aed3-c69104cea9f0", "name": "network-vif-deleted", "tag": "e90faa84-86bb-4130-9b65-4e1e754b1c48"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:27.455866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e9a53652-d02b-499f-88f5-2a2b0709f308 req-e63d0715-f86b-4691-a648-bfd780c5a5a5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.465795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e9a53652-d02b-499f-88f5-2a2b0709f308 req-e63d0715-f86b-4691-a648-bfd780c5a5a5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.466322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e9a53652-d02b-499f-88f5-2a2b0709f308 req-e63d0715-f86b-4691-a648-bfd780c5a5a5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.592029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0e968714-cd82-47c7-beba-ed006097d934 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:27.626200 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0e968714-cd82-47c7-beba-ed006097d934 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 1.108581 Oct 04 18:03:27.629329 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 364/698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:26 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:27.652274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-336703d0-ee57-4e34-8ba6-36c625af2d84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:27.668885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-336703d0-ee57-4e34-8ba6-36c625af2d84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:27.698382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-336703d0-ee57-4e34-8ba6-36c625af2d84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.707427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-336703d0-ee57-4e34-8ba6-36c625af2d84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.713285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-336703d0-ee57-4e34-8ba6-36c625af2d84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.717981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-336703d0-ee57-4e34-8ba6-36c625af2d84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.718605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-336703d0-ee57-4e34-8ba6-36c625af2d84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.721780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-336703d0-ee57-4e34-8ba6-36c625af2d84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.927595 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e9a53652-d02b-499f-88f5-2a2b0709f308 req-e63d0715-f86b-4691-a648-bfd780c5a5a5 service nova] Creating event network-vif-deleted:e90faa84-86bb-4130-9b65-4e1e754b1c48 for instance 990802fe-4649-4012-aed3-c69104cea9f0 on n-h1-850499-14 Oct 04 18:03:27.931887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-336703d0-ee57-4e34-8ba6-36c625af2d84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:27.946018 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-336703d0-ee57-4e34-8ba6-36c625af2d84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1264 microversion: 2.1 time: 0.311451 Oct 04 18:03:27.946867 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 365/699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:27 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1264 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:27.950782 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e9a53652-d02b-499f-88f5-2a2b0709f308 req-e63d0715-f86b-4691-a648-bfd780c5a5a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.537874 Oct 04 18:03:27.951500 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 335/700] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:27.957725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:27.971219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:27.984344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.985332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.985992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.987854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.988517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.989116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.041782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.042727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.043368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.044251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lazy-loading 'fault' on Instance uuid 990802fe-4649-4012-aed3-c69104cea9f0 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:03:28.286436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8ad6e2e3-4f15-4952-a132-f8911bba2dbf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:28.287177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8ad6e2e3-4f15-4952-a132-f8911bba2dbf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:28.302101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad6e2e3-4f15-4952-a132-f8911bba2dbf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.302855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad6e2e3-4f15-4952-a132-f8911bba2dbf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.304015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad6e2e3-4f15-4952-a132-f8911bba2dbf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.308378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad6e2e3-4f15-4952-a132-f8911bba2dbf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.313954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad6e2e3-4f15-4952-a132-f8911bba2dbf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.314840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad6e2e3-4f15-4952-a132-f8911bba2dbf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.489734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1386c3bfc454ab1b14c4cf905264a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a024b1909ca4616a8aa9c071435ad5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:28.529410 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-46c6a9ba-defa-4bfc-9860-d9b63e514c59 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 200 len: 1304 microversion: 2.1 time: 0.580319 Oct 04 18:03:28.540580 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 366/701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:27 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 1304 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:28.655436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f562578a-bb32-4fea-9feb-ce7796d9c5af tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:28.656043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f562578a-bb32-4fea-9feb-ce7796d9c5af tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:28.668096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f562578a-bb32-4fea-9feb-ce7796d9c5af tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.668594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f562578a-bb32-4fea-9feb-ce7796d9c5af tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.669028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f562578a-bb32-4fea-9feb-ce7796d9c5af tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.669749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f562578a-bb32-4fea-9feb-ce7796d9c5af tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.670187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f562578a-bb32-4fea-9feb-ce7796d9c5af tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.670823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f562578a-bb32-4fea-9feb-ce7796d9c5af tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.953960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8ad6e2e3-4f15-4952-a132-f8911bba2dbf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:28.969083 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8ad6e2e3-4f15-4952-a132-f8911bba2dbf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 0.688531 Oct 04 18:03:28.969670 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 336/702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:28 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:28.974510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-eb711be6-547d-412c-94a2-3de15ed5762f req-7f748292-ee09-4f99-b6b6-278343339936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b090a0-2ada-4af7-be73-c21ed69a3720", "tag": "55fe455b-5dcd-4805-b03b-0514147b4e32"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:29.000263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eb711be6-547d-412c-94a2-3de15ed5762f req-7f748292-ee09-4f99-b6b6-278343339936 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.000757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eb711be6-547d-412c-94a2-3de15ed5762f req-7f748292-ee09-4f99-b6b6-278343339936 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.001187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eb711be6-547d-412c-94a2-3de15ed5762f req-7f748292-ee09-4f99-b6b6-278343339936 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.036831 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-eb711be6-547d-412c-94a2-3de15ed5762f req-7f748292-ee09-4f99-b6b6-278343339936 service nova] Creating event network-changed:55fe455b-5dcd-4805-b03b-0514147b4e32 for instance 27b090a0-2ada-4af7-be73-c21ed69a3720 on n-h2-850499-14 Oct 04 18:03:29.052901 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-eb711be6-547d-412c-94a2-3de15ed5762f req-7f748292-ee09-4f99-b6b6-278343339936 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081924 Oct 04 18:03:29.058912 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 337/703] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:29.064460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04318d39-98b6-4a65-899c-e45edb022730 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:29.067854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-04318d39-98b6-4a65-899c-e45edb022730 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:29.079070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04318d39-98b6-4a65-899c-e45edb022730 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.084025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04318d39-98b6-4a65-899c-e45edb022730 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.085034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04318d39-98b6-4a65-899c-e45edb022730 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.086408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04318d39-98b6-4a65-899c-e45edb022730 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.087539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04318d39-98b6-4a65-899c-e45edb022730 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.088615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04318d39-98b6-4a65-899c-e45edb022730 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.311044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f562578a-bb32-4fea-9feb-ce7796d9c5af tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:29.324769 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f562578a-bb32-4fea-9feb-ce7796d9c5af tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 0.673145 Oct 04 18:03:29.338981 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 367/704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:28 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:29.339216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-04318d39-98b6-4a65-899c-e45edb022730 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:29.351426 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04318d39-98b6-4a65-899c-e45edb022730 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1270 microversion: 2.1 time: 0.283841 Oct 04 18:03:29.352755 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 338/705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:29 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1270 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:29.554225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:29.555139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] [instance: 990802fe-4649-4012-aed3-c69104cea9f0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:29.569491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.570240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.570864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.571767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.572372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.572954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.598174 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] HTTP exception thrown: Instance 990802fe-4649-4012-aed3-c69104cea9f0 could not be found. Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Request method failure captured: Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 HTTP/1.1 Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHVTIOOkM6MyJ184qR-9YKelHxHB3QuuoGz0xOPYGbnPGz1mcSeMpLZquU2wi3PB3slr1aINNM56vROMkCX7bF1kenLvKRFmTSngpGvZpBAFVK4jQJJs0xGBvVm6XmEAgkIjFLLXDXqtAFwN4euBSNzXUmu2Ltj7NqPLn91JU9m-GD0 Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 7a024b1909ca4616a8aa9c071435ad5d Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TenantUsagesTestJSON-1608048308 Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:03:29.608734 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a024b1909ca4616a8aa9c071435ad5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a024b1909ca4616a8aa9c071435ad5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a024b1909ca4616a8aa9c071435ad5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a024b1909ca4616a8aa9c071435ad5d"}]}] Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TenantUsagesTestJSON-1608048308 Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 7a024b1909ca4616a8aa9c071435ad5d Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1608048308 Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TenantUsagesTestJSON-1608048308-project Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b1386c3bfc454ab1b14c4cf905264a20 Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TenantUsagesTestJSON-1608048308-project Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 990802fe-4649-4012-aed3-c69104cea9f0 could not be found. Oct 04 18:03:29.610440 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '990802fe-4649-4012-aed3-c69104cea9f0'} Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990802fe-4649-4012-aed3-c69104cea9f0 could not be found. Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:03:29.611440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990802fe-4649-4012-aed3-c69104cea9f0 could not be found. Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990802fe-4649-4012-aed3-c69104cea9f0 could not be found. Oct 04 18:03:29.613007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:03:29.614338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] Returning 404 to user: Instance 990802fe-4649-4012-aed3-c69104cea9f0 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:03:29.614338 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-52e455e0-c019-4d74-850b-fcbf8c10d446 tempest-TenantUsagesTestJSON-1608048308 tempest-TenantUsagesTestJSON-1608048308-project] 10.222.0.18 "GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0" status: 404 len: 111 microversion: 2.1 time: 0.060093 Oct 04 18:03:29.614338 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 368/706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:29 2022] GET /compute/v2.1/servers/990802fe-4649-4012-aed3-c69104cea9f0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:03:29.996697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-918ee993-1f90-4b1d-bb61-c195c346a017 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:29.997972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-918ee993-1f90-4b1d-bb61-c195c346a017 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:30.013696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-918ee993-1f90-4b1d-bb61-c195c346a017 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.015500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-918ee993-1f90-4b1d-bb61-c195c346a017 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.018558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-918ee993-1f90-4b1d-bb61-c195c346a017 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.021622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-918ee993-1f90-4b1d-bb61-c195c346a017 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.022187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-918ee993-1f90-4b1d-bb61-c195c346a017 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.024047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-918ee993-1f90-4b1d-bb61-c195c346a017 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.353984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96d03e5c-da81-475d-afd5-ad821c27c3f7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:30.355528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96d03e5c-da81-475d-afd5-ad821c27c3f7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:30.368852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d03e5c-da81-475d-afd5-ad821c27c3f7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.372246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d03e5c-da81-475d-afd5-ad821c27c3f7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.373129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d03e5c-da81-475d-afd5-ad821c27c3f7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.374125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d03e5c-da81-475d-afd5-ad821c27c3f7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.377793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d03e5c-da81-475d-afd5-ad821c27c3f7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.380162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d03e5c-da81-475d-afd5-ad821c27c3f7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.782832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-918ee993-1f90-4b1d-bb61-c195c346a017 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:30.797361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-918ee993-1f90-4b1d-bb61-c195c346a017 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 0.804370 Oct 04 18:03:30.798062 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 339/707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:29 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:30.804335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c2334949-6a40-44f2-8fa9-e873801c79c5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:30.819947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c2334949-6a40-44f2-8fa9-e873801c79c5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:30.834448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2334949-6a40-44f2-8fa9-e873801c79c5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.839947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2334949-6a40-44f2-8fa9-e873801c79c5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.840673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2334949-6a40-44f2-8fa9-e873801c79c5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.841654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2334949-6a40-44f2-8fa9-e873801c79c5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.842477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2334949-6a40-44f2-8fa9-e873801c79c5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.851658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2334949-6a40-44f2-8fa9-e873801c79c5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.858053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:31.083709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c2334949-6a40-44f2-8fa9-e873801c79c5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:31.098905 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c2334949-6a40-44f2-8fa9-e873801c79c5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1270 microversion: 2.1 time: 0.298204 Oct 04 18:03:31.099850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 340/708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:30 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1270 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:31.106695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96d03e5c-da81-475d-afd5-ad821c27c3f7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:31.116083 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96d03e5c-da81-475d-afd5-ad821c27c3f7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 0.767555 Oct 04 18:03:31.135442 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 369/709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:30 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:31.836857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1035e4c8-51f9-46ea-93e4-a514ecc07202 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:31.837484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1035e4c8-51f9-46ea-93e4-a514ecc07202 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:31.869555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1035e4c8-51f9-46ea-93e4-a514ecc07202 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.872217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1035e4c8-51f9-46ea-93e4-a514ecc07202 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.873613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1035e4c8-51f9-46ea-93e4-a514ecc07202 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.879166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1035e4c8-51f9-46ea-93e4-a514ecc07202 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.879987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1035e4c8-51f9-46ea-93e4-a514ecc07202 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.883119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1035e4c8-51f9-46ea-93e4-a514ecc07202 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.126338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fc30ce31-6893-438f-94f2-e8f37c98eb84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:32.129819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fc30ce31-6893-438f-94f2-e8f37c98eb84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:32.159145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:32.160757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc30ce31-6893-438f-94f2-e8f37c98eb84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.162897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc30ce31-6893-438f-94f2-e8f37c98eb84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.165023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc30ce31-6893-438f-94f2-e8f37c98eb84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.165955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc30ce31-6893-438f-94f2-e8f37c98eb84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.175380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc30ce31-6893-438f-94f2-e8f37c98eb84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.176197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc30ce31-6893-438f-94f2-e8f37c98eb84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.885751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fc30ce31-6893-438f-94f2-e8f37c98eb84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.905607 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fc30ce31-6893-438f-94f2-e8f37c98eb84 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1270 microversion: 2.1 time: 0.783717 Oct 04 18:03:32.928352 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 370/710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:32 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1270 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:32.942662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-facb064d-a914-42f4-95c3-90115e8c93ba tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:32.943657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-facb064d-a914-42f4-95c3-90115e8c93ba tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:32.950629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facb064d-a914-42f4-95c3-90115e8c93ba tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.951606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facb064d-a914-42f4-95c3-90115e8c93ba tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.952405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facb064d-a914-42f4-95c3-90115e8c93ba tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.953355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facb064d-a914-42f4-95c3-90115e8c93ba tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.954038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facb064d-a914-42f4-95c3-90115e8c93ba tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.954788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facb064d-a914-42f4-95c3-90115e8c93ba tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:33.150627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1035e4c8-51f9-46ea-93e4-a514ecc07202 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:33.160767 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1035e4c8-51f9-46ea-93e4-a514ecc07202 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 1.334510 Oct 04 18:03:33.186079 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 341/711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:31 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:33.234020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c331677f-ad86-4560-a7f7-a06a0bea8fb7 req-ccb8b59d-8db0-4a2c-9f4a-485a724a5775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0bc7d77-c5ab-428c-8714-c9ae8292a8b6", "tag": "7e6bf0d1-c58d-4b4d-bbda-48efc495a4ce"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:33.264662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c331677f-ad86-4560-a7f7-a06a0bea8fb7 req-ccb8b59d-8db0-4a2c-9f4a-485a724a5775 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:33.265374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c331677f-ad86-4560-a7f7-a06a0bea8fb7 req-ccb8b59d-8db0-4a2c-9f4a-485a724a5775 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:33.266127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c331677f-ad86-4560-a7f7-a06a0bea8fb7 req-ccb8b59d-8db0-4a2c-9f4a-485a724a5775 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:33.304596 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c331677f-ad86-4560-a7f7-a06a0bea8fb7 req-ccb8b59d-8db0-4a2c-9f4a-485a724a5775 service nova] Creating event network-changed:7e6bf0d1-c58d-4b4d-bbda-48efc495a4ce for instance e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 on n-h2-850499-14 Oct 04 18:03:33.314137 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c331677f-ad86-4560-a7f7-a06a0bea8fb7 req-ccb8b59d-8db0-4a2c-9f4a-485a724a5775 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085295 Oct 04 18:03:33.318170 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 342/712] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:33.475344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-facb064d-a914-42f4-95c3-90115e8c93ba tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:33.496123 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-facb064d-a914-42f4-95c3-90115e8c93ba tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 0.559753 Oct 04 18:03:33.498264 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 371/713] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:32 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:33.934800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f193f96f-f3f2-4961-92ea-36571d7d756b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:33.935687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f193f96f-f3f2-4961-92ea-36571d7d756b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:33.973864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f193f96f-f3f2-4961-92ea-36571d7d756b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:33.980299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f193f96f-f3f2-4961-92ea-36571d7d756b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:33.987620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f193f96f-f3f2-4961-92ea-36571d7d756b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:33.989321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f193f96f-f3f2-4961-92ea-36571d7d756b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:33.993822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f193f96f-f3f2-4961-92ea-36571d7d756b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:33.994286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f193f96f-f3f2-4961-92ea-36571d7d756b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.194430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6feb1d14-7485-43cc-8fee-58a1e8ec1c95 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:34.195311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6feb1d14-7485-43cc-8fee-58a1e8ec1c95 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:34.207573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6feb1d14-7485-43cc-8fee-58a1e8ec1c95 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.210281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6feb1d14-7485-43cc-8fee-58a1e8ec1c95 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.211486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6feb1d14-7485-43cc-8fee-58a1e8ec1c95 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.219589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6feb1d14-7485-43cc-8fee-58a1e8ec1c95 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.222284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6feb1d14-7485-43cc-8fee-58a1e8ec1c95 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.222912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6feb1d14-7485-43cc-8fee-58a1e8ec1c95 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.698806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f193f96f-f3f2-4961-92ea-36571d7d756b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.709467 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f193f96f-f3f2-4961-92ea-36571d7d756b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 0.779534 Oct 04 18:03:34.713070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6feb1d14-7485-43cc-8fee-58a1e8ec1c95 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.723352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:34.731005 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6feb1d14-7485-43cc-8fee-58a1e8ec1c95 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 0.538855 Oct 04 18:03:34.733689 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 343/714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:33 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:34.738938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c63f68fe-4d42-40d1-a131-75c6f851ef0e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:34.744733 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 372/715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:34 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:34.749419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c63f68fe-4d42-40d1-a131-75c6f851ef0e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:34.763538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63f68fe-4d42-40d1-a131-75c6f851ef0e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.764695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63f68fe-4d42-40d1-a131-75c6f851ef0e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.768097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63f68fe-4d42-40d1-a131-75c6f851ef0e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.769093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63f68fe-4d42-40d1-a131-75c6f851ef0e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.769763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63f68fe-4d42-40d1-a131-75c6f851ef0e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.770214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63f68fe-4d42-40d1-a131-75c6f851ef0e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.183934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:35.217117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:35.279800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c63f68fe-4d42-40d1-a131-75c6f851ef0e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:35.299789 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c63f68fe-4d42-40d1-a131-75c6f851ef0e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 0.563772 Oct 04 18:03:35.300662 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 344/716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:34 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:35.741432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-28d545c4-594c-4f5a-821b-3c9254e58738 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:35.742041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-28d545c4-594c-4f5a-821b-3c9254e58738 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:35.758637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a8f6e23-ff3d-4724-801d-2801a0383bbc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:35.759288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a8f6e23-ff3d-4724-801d-2801a0383bbc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:35.761586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28d545c4-594c-4f5a-821b-3c9254e58738 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.762200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28d545c4-594c-4f5a-821b-3c9254e58738 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.762650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28d545c4-594c-4f5a-821b-3c9254e58738 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.763426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28d545c4-594c-4f5a-821b-3c9254e58738 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.763887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28d545c4-594c-4f5a-821b-3c9254e58738 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.769358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8f6e23-ff3d-4724-801d-2801a0383bbc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.771786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8f6e23-ff3d-4724-801d-2801a0383bbc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.772263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8f6e23-ff3d-4724-801d-2801a0383bbc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.772518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28d545c4-594c-4f5a-821b-3c9254e58738 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.780002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8f6e23-ff3d-4724-801d-2801a0383bbc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.781180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8f6e23-ff3d-4724-801d-2801a0383bbc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.781872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8f6e23-ff3d-4724-801d-2801a0383bbc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.276783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-28d545c4-594c-4f5a-821b-3c9254e58738 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:36.305654 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-28d545c4-594c-4f5a-821b-3c9254e58738 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 0.551876 Oct 04 18:03:36.308924 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 373/717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:35 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:36.366493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e9358174-4edd-4b0d-aee5-99db26e48ff7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:36.375940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e9358174-4edd-4b0d-aee5-99db26e48ff7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:36.404163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9358174-4edd-4b0d-aee5-99db26e48ff7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.404671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9358174-4edd-4b0d-aee5-99db26e48ff7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.405136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9358174-4edd-4b0d-aee5-99db26e48ff7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.405849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9358174-4edd-4b0d-aee5-99db26e48ff7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.406382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9358174-4edd-4b0d-aee5-99db26e48ff7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.410298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9a8f6e23-ff3d-4724-801d-2801a0383bbc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:36.419766 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a8f6e23-ff3d-4724-801d-2801a0383bbc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 0.665039 Oct 04 18:03:36.420411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9358174-4edd-4b0d-aee5-99db26e48ff7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.423565 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 345/718] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:35 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:36.509638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=32 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:36.664627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e9358174-4edd-4b0d-aee5-99db26e48ff7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:36.681396 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e9358174-4edd-4b0d-aee5-99db26e48ff7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 0.327935 Oct 04 18:03:36.696323 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 374/719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:36 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:37.320554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-430283204", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "fc465217-3f76-4e72-b563-acf6a711ee75"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:37.334497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-09bff769-836a-4f8e-9f0f-3adb690053ad tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:37.336120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-09bff769-836a-4f8e-9f0f-3adb690053ad tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:37.351963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09bff769-836a-4f8e-9f0f-3adb690053ad tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:37.354390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09bff769-836a-4f8e-9f0f-3adb690053ad tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:37.357704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09bff769-836a-4f8e-9f0f-3adb690053ad tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:37.358656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09bff769-836a-4f8e-9f0f-3adb690053ad tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:37.359586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09bff769-836a-4f8e-9f0f-3adb690053ad tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:37.361056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09bff769-836a-4f8e-9f0f-3adb690053ad tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:37.487434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] validate_networks() for [('fc465217-3f76-4e72-b563-acf6a711ee75', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:38.165230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-09bff769-836a-4f8e-9f0f-3adb690053ad tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:38.180114 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-09bff769-836a-4f8e-9f0f-3adb690053ad tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 0.847461 Oct 04 18:03:38.182714 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 375/720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:37 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:38.190814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e864eeca-d491-449c-a8b8-9918c422bcec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:38.194311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e864eeca-d491-449c-a8b8-9918c422bcec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:38.205913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e864eeca-d491-449c-a8b8-9918c422bcec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:38.210327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e864eeca-d491-449c-a8b8-9918c422bcec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:38.211447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e864eeca-d491-449c-a8b8-9918c422bcec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:38.222677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e864eeca-d491-449c-a8b8-9918c422bcec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:38.225299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e864eeca-d491-449c-a8b8-9918c422bcec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:38.225983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e864eeca-d491-449c-a8b8-9918c422bcec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:38.591504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:38.592273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:38.592577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:38.593346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:38.593933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:38.617556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:38.619636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:38.620102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:38.620894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:38.621368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:38.621809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:38.681398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Getting quotas for project 283fc113c40342dc9387fb7c84e00b2c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:38.704330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Getting quotas for user 93c7e45ffec94520a28696fe6f9016ce and project 283fc113c40342dc9387fb7c84e00b2c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:38.732482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:38.735654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:38.888508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e864eeca-d491-449c-a8b8-9918c422bcec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:38.904824 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e864eeca-d491-449c-a8b8-9918c422bcec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 0.720415 Oct 04 18:03:38.906089 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 376/721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:38 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:38.913132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-133db3d7-ee2d-46a7-a1fe-c1daf12e6c46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:38.914231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-133db3d7-ee2d-46a7-a1fe-c1daf12e6c46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:38.918223 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39f90881-065a-4cd5-b25a-5d28b3128ecf tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.888439 Oct 04 18:03:38.925249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133db3d7-ee2d-46a7-a1fe-c1daf12e6c46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:38.926084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133db3d7-ee2d-46a7-a1fe-c1daf12e6c46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:38.926710 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 346/722] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:38.927041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133db3d7-ee2d-46a7-a1fe-c1daf12e6c46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:38.928265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133db3d7-ee2d-46a7-a1fe-c1daf12e6c46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:38.928893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133db3d7-ee2d-46a7-a1fe-c1daf12e6c46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:38.929487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133db3d7-ee2d-46a7-a1fe-c1daf12e6c46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:38.933170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3fcdb920-f45c-4fd3-8911-866b547a44ab req-d326addd-5465-4e34-a5a2-35740a8a2b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c31b2e2a-3ff2-4f05-b2c5-071a392b21ea", "tag": "63e5138e-54a8-464b-a808-cf8ff8e32709"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:38.970349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3fcdb920-f45c-4fd3-8911-866b547a44ab req-d326addd-5465-4e34-a5a2-35740a8a2b1b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:38.970839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3fcdb920-f45c-4fd3-8911-866b547a44ab req-d326addd-5465-4e34-a5a2-35740a8a2b1b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:38.973560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3fcdb920-f45c-4fd3-8911-866b547a44ab req-d326addd-5465-4e34-a5a2-35740a8a2b1b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:39.025734 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3fcdb920-f45c-4fd3-8911-866b547a44ab req-d326addd-5465-4e34-a5a2-35740a8a2b1b service nova] Creating event network-changed:63e5138e-54a8-464b-a808-cf8ff8e32709 for instance c31b2e2a-3ff2-4f05-b2c5-071a392b21ea on n-h2-850499-14 Oct 04 18:03:39.042191 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3fcdb920-f45c-4fd3-8911-866b547a44ab req-d326addd-5465-4e34-a5a2-35740a8a2b1b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111692 Oct 04 18:03:39.044529 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 347/723] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:39.062683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b59c5d4a-99ab-453e-8330-e1afbcb96dc1 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:39.064998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b59c5d4a-99ab-453e-8330-e1afbcb96dc1 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:39.072572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:39.569453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b59c5d4a-99ab-453e-8330-e1afbcb96dc1 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:39.592187 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b59c5d4a-99ab-453e-8330-e1afbcb96dc1 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1231 microversion: 2.1 time: 0.544434 Oct 04 18:03:39.616782 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 348/724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:39 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1231 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:39.623742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b97adfe6-4449-41e3-85b2-ef6d9857a057 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:39.624390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b97adfe6-4449-41e3-85b2-ef6d9857a057 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:39.653337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b97adfe6-4449-41e3-85b2-ef6d9857a057 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:39.653854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b97adfe6-4449-41e3-85b2-ef6d9857a057 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:39.654318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b97adfe6-4449-41e3-85b2-ef6d9857a057 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:39.655876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b97adfe6-4449-41e3-85b2-ef6d9857a057 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:39.657038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b97adfe6-4449-41e3-85b2-ef6d9857a057 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:39.657986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b97adfe6-4449-41e3-85b2-ef6d9857a057 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.018683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-133db3d7-ee2d-46a7-a1fe-c1daf12e6c46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:40.072128 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-133db3d7-ee2d-46a7-a1fe-c1daf12e6c46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 1.164114 Oct 04 18:03:40.073850 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 377/725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:38 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:40.083628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d0670e20-ce06-4c57-9e6e-31087f2fd917 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:40.085705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d0670e20-ce06-4c57-9e6e-31087f2fd917 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:40.099881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0670e20-ce06-4c57-9e6e-31087f2fd917 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.101941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0670e20-ce06-4c57-9e6e-31087f2fd917 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.105233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0670e20-ce06-4c57-9e6e-31087f2fd917 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.106543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0670e20-ce06-4c57-9e6e-31087f2fd917 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.109219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0670e20-ce06-4c57-9e6e-31087f2fd917 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.111799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0670e20-ce06-4c57-9e6e-31087f2fd917 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.812654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d0670e20-ce06-4c57-9e6e-31087f2fd917 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:40.830461 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d0670e20-ce06-4c57-9e6e-31087f2fd917 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 0.755097 Oct 04 18:03:40.841563 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 378/726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:40 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:40.869496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3167d250-34b6-43a8-b1f5-af5a76066949 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:40.870575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3167d250-34b6-43a8-b1f5-af5a76066949 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:40.873150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b97adfe6-4449-41e3-85b2-ef6d9857a057 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:40.878138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3167d250-34b6-43a8-b1f5-af5a76066949 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.879689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3167d250-34b6-43a8-b1f5-af5a76066949 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.883567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3167d250-34b6-43a8-b1f5-af5a76066949 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.884858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3167d250-34b6-43a8-b1f5-af5a76066949 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.885579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3167d250-34b6-43a8-b1f5-af5a76066949 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.886245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3167d250-34b6-43a8-b1f5-af5a76066949 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.890994 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b97adfe6-4449-41e3-85b2-ef6d9857a057 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 1.271662 Oct 04 18:03:40.893436 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 349/727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:39 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:41.103514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6807902-6817-42ca-a529-97194cf794f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:41.104140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f6807902-6817-42ca-a529-97194cf794f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:41.114229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6807902-6817-42ca-a529-97194cf794f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.127164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6807902-6817-42ca-a529-97194cf794f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.127758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6807902-6817-42ca-a529-97194cf794f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.128531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6807902-6817-42ca-a529-97194cf794f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.129017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6807902-6817-42ca-a529-97194cf794f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.129448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6807902-6817-42ca-a529-97194cf794f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.289160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3167d250-34b6-43a8-b1f5-af5a76066949 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:41.307620 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3167d250-34b6-43a8-b1f5-af5a76066949 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1283 microversion: 2.1 time: 0.441213 Oct 04 18:03:41.308804 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 379/728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:40 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1283 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:41.393634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-22aa4ac6-8b65-495c-803f-98755d7ca1a2 req-224a933b-3cc7-4375-86cd-dda1fc080ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51903294-696f-4e13-adb2-d63862de1a52", "tag": "ade6ab7a-2609-411b-8d9e-c2fe5c446530"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:41.427630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-22aa4ac6-8b65-495c-803f-98755d7ca1a2 req-224a933b-3cc7-4375-86cd-dda1fc080ae3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.430414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-22aa4ac6-8b65-495c-803f-98755d7ca1a2 req-224a933b-3cc7-4375-86cd-dda1fc080ae3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.431064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-22aa4ac6-8b65-495c-803f-98755d7ca1a2 req-224a933b-3cc7-4375-86cd-dda1fc080ae3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.465870 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-22aa4ac6-8b65-495c-803f-98755d7ca1a2 req-224a933b-3cc7-4375-86cd-dda1fc080ae3 service nova] Creating event network-changed:ade6ab7a-2609-411b-8d9e-c2fe5c446530 for instance 51903294-696f-4e13-adb2-d63862de1a52 on n-h2-850499-14 Oct 04 18:03:41.481577 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-22aa4ac6-8b65-495c-803f-98755d7ca1a2 req-224a933b-3cc7-4375-86cd-dda1fc080ae3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103733 Oct 04 18:03:41.482518 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 380/729] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:41.865531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-15b817de-14dc-43e9-95df-4ea385a3b0b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:41.866276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-15b817de-14dc-43e9-95df-4ea385a3b0b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:41.875358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15b817de-14dc-43e9-95df-4ea385a3b0b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.876287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15b817de-14dc-43e9-95df-4ea385a3b0b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.879050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15b817de-14dc-43e9-95df-4ea385a3b0b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.880017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15b817de-14dc-43e9-95df-4ea385a3b0b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.881345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15b817de-14dc-43e9-95df-4ea385a3b0b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.882651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15b817de-14dc-43e9-95df-4ea385a3b0b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.498664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f6807902-6817-42ca-a529-97194cf794f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:42.513252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6807902-6817-42ca-a529-97194cf794f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 1.413903 Oct 04 18:03:42.520341 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 350/730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:41 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:42.526115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f5dee68e-51cd-411e-96b8-872cad74de98 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:42.531469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f5dee68e-51cd-411e-96b8-872cad74de98 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:42.546239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5dee68e-51cd-411e-96b8-872cad74de98 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.546999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5dee68e-51cd-411e-96b8-872cad74de98 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.547599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5dee68e-51cd-411e-96b8-872cad74de98 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.548798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5dee68e-51cd-411e-96b8-872cad74de98 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.551116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5dee68e-51cd-411e-96b8-872cad74de98 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.551727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5dee68e-51cd-411e-96b8-872cad74de98 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.187008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-15b817de-14dc-43e9-95df-4ea385a3b0b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:43.197301 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-15b817de-14dc-43e9-95df-4ea385a3b0b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 1.336567 Oct 04 18:03:43.198006 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 381/731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:41 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:43.236665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-34d7be5f-67f7-4bd1-82db-988fa9455e88 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:43.238880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-34d7be5f-67f7-4bd1-82db-988fa9455e88 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:43.272676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34d7be5f-67f7-4bd1-82db-988fa9455e88 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.275547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34d7be5f-67f7-4bd1-82db-988fa9455e88 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.276197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34d7be5f-67f7-4bd1-82db-988fa9455e88 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.277140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34d7be5f-67f7-4bd1-82db-988fa9455e88 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.281400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34d7be5f-67f7-4bd1-82db-988fa9455e88 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.282098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34d7be5f-67f7-4bd1-82db-988fa9455e88 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.703244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f5dee68e-51cd-411e-96b8-872cad74de98 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:43.712943 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f5dee68e-51cd-411e-96b8-872cad74de98 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 1.191283 Oct 04 18:03:43.713735 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 351/732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:42 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:43.723208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d8fdfe40-b941-427e-a71d-79205b911374 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:43.730193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d8fdfe40-b941-427e-a71d-79205b911374 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:43.753447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fdfe40-b941-427e-a71d-79205b911374 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.754735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fdfe40-b941-427e-a71d-79205b911374 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.761813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fdfe40-b941-427e-a71d-79205b911374 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.762755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fdfe40-b941-427e-a71d-79205b911374 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.763373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fdfe40-b941-427e-a71d-79205b911374 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.765408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fdfe40-b941-427e-a71d-79205b911374 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.796436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d8fdfe40-b941-427e-a71d-79205b911374 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:03:43.909758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-34d7be5f-67f7-4bd1-82db-988fa9455e88 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:43.928060 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-34d7be5f-67f7-4bd1-82db-988fa9455e88 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1331 microversion: 2.1 time: 0.726631 Oct 04 18:03:43.929307 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 382/733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:43 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1331 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:43.942488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f5c57757-29d8-47e6-b067-75c478f40d65 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:43.946627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f5c57757-29d8-47e6-b067-75c478f40d65 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:43.972758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5c57757-29d8-47e6-b067-75c478f40d65 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.983126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5c57757-29d8-47e6-b067-75c478f40d65 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.984011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5c57757-29d8-47e6-b067-75c478f40d65 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.985600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5c57757-29d8-47e6-b067-75c478f40d65 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.991218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5c57757-29d8-47e6-b067-75c478f40d65 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.992036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5c57757-29d8-47e6-b067-75c478f40d65 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.997168 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d8fdfe40-b941-427e-a71d-79205b911374 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 204 len: 0 microversion: 2.1 time: 0.279949 Oct 04 18:03:44.011307 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 352/734] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:03:43 2022] DELETE /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:03:44.224725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b610b56a-df87-473c-88c5-a11e127f6139 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:44.225752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b610b56a-df87-473c-88c5-a11e127f6139 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:44.250369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b610b56a-df87-473c-88c5-a11e127f6139 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.250973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b610b56a-df87-473c-88c5-a11e127f6139 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.251901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b610b56a-df87-473c-88c5-a11e127f6139 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.252616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b610b56a-df87-473c-88c5-a11e127f6139 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.265047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b610b56a-df87-473c-88c5-a11e127f6139 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.265641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b610b56a-df87-473c-88c5-a11e127f6139 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.434147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f5c57757-29d8-47e6-b067-75c478f40d65 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:44.458436 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f5c57757-29d8-47e6-b067-75c478f40d65 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1504 microversion: 2.1 time: 0.526156 Oct 04 18:03:44.463941 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 383/735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:43 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:44.477835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1034626638", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "1781652487", "adminPass": "***", "networks": [{"uuid": "38a451c8-3e5c-46d1-a0e4-69cbacf2de2d"}], "security_groups": [{"name": "tempest-securitygroup--298989717"}], "key_name": "tempest-keypair-1320746582", "user_data": "}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:44.809156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] validate_networks() for [('38a451c8-3e5c-46d1-a0e4-69cbacf2de2d', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:44.865091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b610b56a-df87-473c-88c5-a11e127f6139 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:44.885700 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b610b56a-df87-473c-88c5-a11e127f6139 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 0.666051 Oct 04 18:03:44.899048 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 353/736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:44 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:44.904722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34148cae-3f97-406e-ab67-f064c4c69ce4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:44.905352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34148cae-3f97-406e-ab67-f064c4c69ce4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:44.915613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34148cae-3f97-406e-ab67-f064c4c69ce4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.916111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34148cae-3f97-406e-ab67-f064c4c69ce4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.919604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34148cae-3f97-406e-ab67-f064c4c69ce4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.920666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34148cae-3f97-406e-ab67-f064c4c69ce4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.925904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34148cae-3f97-406e-ab67-f064c4c69ce4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.927628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34148cae-3f97-406e-ab67-f064c4c69ce4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.582673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34148cae-3f97-406e-ab67-f064c4c69ce4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:45.598868 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34148cae-3f97-406e-ab67-f064c4c69ce4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 0.711122 Oct 04 18:03:45.599527 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 354/737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:44 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:45.604261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-953bb1c1-1b45-4385-8465-8880f7ccdd0a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:45.604882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-953bb1c1-1b45-4385-8465-8880f7ccdd0a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:45.627431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-953bb1c1-1b45-4385-8465-8880f7ccdd0a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:45.627948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-953bb1c1-1b45-4385-8465-8880f7ccdd0a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:45.628397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-953bb1c1-1b45-4385-8465-8880f7ccdd0a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.629143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-953bb1c1-1b45-4385-8465-8880f7ccdd0a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:45.629609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-953bb1c1-1b45-4385-8465-8880f7ccdd0a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:45.630046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-953bb1c1-1b45-4385-8465-8880f7ccdd0a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.446579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-953bb1c1-1b45-4385-8465-8880f7ccdd0a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:46.455722 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-953bb1c1-1b45-4385-8465-8880f7ccdd0a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1331 microversion: 2.1 time: 0.855128 Oct 04 18:03:46.456314 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 355/738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:45 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1331 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:46.472278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-1ddd7c03-6c92-4e9d-9705-a13ef34e6ee6 req-08db0eb4-3d18-4889-be0d-eea85bf90cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d25ec92-5335-4444-83ba-2c92abef1832", "tag": "ae5a66c4-f24e-47ae-bcad-abe0df6b2f41"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:46.493398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1ddd7c03-6c92-4e9d-9705-a13ef34e6ee6 req-08db0eb4-3d18-4889-be0d-eea85bf90cdd service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.494005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1ddd7c03-6c92-4e9d-9705-a13ef34e6ee6 req-08db0eb4-3d18-4889-be0d-eea85bf90cdd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.494442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1ddd7c03-6c92-4e9d-9705-a13ef34e6ee6 req-08db0eb4-3d18-4889-be0d-eea85bf90cdd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.539590 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1ddd7c03-6c92-4e9d-9705-a13ef34e6ee6 req-08db0eb4-3d18-4889-be0d-eea85bf90cdd service nova] Creating event network-changed:ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 for instance 0d25ec92-5335-4444-83ba-2c92abef1832 on n-h1-850499-14 Oct 04 18:03:46.545122 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-1ddd7c03-6c92-4e9d-9705-a13ef34e6ee6 req-08db0eb4-3d18-4889-be0d-eea85bf90cdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076725 Oct 04 18:03:46.545737 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 356/739] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:46.554291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb9c56f0-e962-43ab-9c9f-4dea99722093 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:46.555035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb9c56f0-e962-43ab-9c9f-4dea99722093 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:46.570775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9c56f0-e962-43ab-9c9f-4dea99722093 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.573066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9c56f0-e962-43ab-9c9f-4dea99722093 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.573535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9c56f0-e962-43ab-9c9f-4dea99722093 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.574276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9c56f0-e962-43ab-9c9f-4dea99722093 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.574746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9c56f0-e962-43ab-9c9f-4dea99722093 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.577446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9c56f0-e962-43ab-9c9f-4dea99722093 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.134437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:47.134993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:47.135357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:47.135937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:47.136521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:47.153976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.154471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.154912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.155679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.156138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.156864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.177066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Getting quotas for project bb0f422348f8418a862f7ef518071bf5. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:47.183865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Getting quotas for user ad3bc1eee7134c2083f937e1f859220c and project bb0f422348f8418a862f7ef518071bf5. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:47.189277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:47.201808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:47.205550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:47.253865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cb9c56f0-e962-43ab-9c9f-4dea99722093 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:47.270825 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb9c56f0-e962-43ab-9c9f-4dea99722093 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1479 microversion: 2.1 time: 0.721581 Oct 04 18:03:47.272439 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 357/740] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:46 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1479 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:47.292910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d50d2043-9e3f-4b62-831e-57c5e7b9d37a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:47.294198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d50d2043-9e3f-4b62-831e-57c5e7b9d37a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:47.314449 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f4b30604-76fd-43c1-85c5-64f1e16e809f tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.847017 Oct 04 18:03:47.322709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50d2043-9e3f-4b62-831e-57c5e7b9d37a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.323342 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 384/741] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 2858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:47.324404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50d2043-9e3f-4b62-831e-57c5e7b9d37a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.326099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50d2043-9e3f-4b62-831e-57c5e7b9d37a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.327800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50d2043-9e3f-4b62-831e-57c5e7b9d37a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.330472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50d2043-9e3f-4b62-831e-57c5e7b9d37a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.331355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50d2043-9e3f-4b62-831e-57c5e7b9d37a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.335330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e90abe27-4e2a-4dd9-a0bf-1b9cae3f4df5 req-cbf27d50-f85c-4b6d-93c6-56bcebe408a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0bc7d77-c5ab-428c-8714-c9ae8292a8b6", "name": "network-vif-plugged", "status": "completed", "tag": "7e6bf0d1-c58d-4b4d-bbda-48efc495a4ce"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:47.363799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e90abe27-4e2a-4dd9-a0bf-1b9cae3f4df5 req-cbf27d50-f85c-4b6d-93c6-56bcebe408a2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.364530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e90abe27-4e2a-4dd9-a0bf-1b9cae3f4df5 req-cbf27d50-f85c-4b6d-93c6-56bcebe408a2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.366655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e90abe27-4e2a-4dd9-a0bf-1b9cae3f4df5 req-cbf27d50-f85c-4b6d-93c6-56bcebe408a2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.389388 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e90abe27-4e2a-4dd9-a0bf-1b9cae3f4df5 req-cbf27d50-f85c-4b6d-93c6-56bcebe408a2 service nova] Creating event network-vif-plugged:7e6bf0d1-c58d-4b4d-bbda-48efc495a4ce for instance e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 on n-h2-850499-14 Oct 04 18:03:47.402150 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e90abe27-4e2a-4dd9-a0bf-1b9cae3f4df5 req-cbf27d50-f85c-4b6d-93c6-56bcebe408a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076523 Oct 04 18:03:47.403059 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 385/742] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:47.414783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-14b6f2ac-4532-453f-be81-3bf02df94635 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:47.426850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-14b6f2ac-4532-453f-be81-3bf02df94635 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:47.445878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14b6f2ac-4532-453f-be81-3bf02df94635 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.446595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14b6f2ac-4532-453f-be81-3bf02df94635 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.447252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14b6f2ac-4532-453f-be81-3bf02df94635 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.448147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14b6f2ac-4532-453f-be81-3bf02df94635 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.448770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14b6f2ac-4532-453f-be81-3bf02df94635 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.449362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14b6f2ac-4532-453f-be81-3bf02df94635 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.654697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:48.760361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d50d2043-9e3f-4b62-831e-57c5e7b9d37a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.763090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:48.780356 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d50d2043-9e3f-4b62-831e-57c5e7b9d37a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 1.502845 Oct 04 18:03:48.802627 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 358/743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:47 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:48.811136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bedb4401-78bc-4be8-84e7-69b9a0c5260d tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '.version_select at 0x7fd4d232f8b0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:48.821514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bedb4401-78bc-4be8-84e7-69b9a0c5260d tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.822029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bedb4401-78bc-4be8-84e7-69b9a0c5260d tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.822471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bedb4401-78bc-4be8-84e7-69b9a0c5260d tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.844553 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bedb4401-78bc-4be8-84e7-69b9a0c5260d tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1187 microversion: 2.1 time: 0.040377 Oct 04 18:03:48.845738 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 359/744] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:03:48 2022] GET /compute/v2.1/os-migrations => generated 1187 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:48.850471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f66d8708-50ac-4d64-9b56-b8589f146a8e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:48.851830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f66d8708-50ac-4d64-9b56-b8589f146a8e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:48.858942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66d8708-50ac-4d64-9b56-b8589f146a8e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.859714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66d8708-50ac-4d64-9b56-b8589f146a8e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.860840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66d8708-50ac-4d64-9b56-b8589f146a8e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.861943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66d8708-50ac-4d64-9b56-b8589f146a8e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.862557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66d8708-50ac-4d64-9b56-b8589f146a8e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.863180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66d8708-50ac-4d64-9b56-b8589f146a8e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.887381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-14b6f2ac-4532-453f-be81-3bf02df94635 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.896125 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-14b6f2ac-4532-453f-be81-3bf02df94635 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 1.488523 Oct 04 18:03:48.896715 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 386/745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:47 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:48.909258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-71cac157-f5b4-4a3d-adc4-4edb4426f21d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:48.909885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-71cac157-f5b4-4a3d-adc4-4edb4426f21d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:48.938583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71cac157-f5b4-4a3d-adc4-4edb4426f21d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.947359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71cac157-f5b4-4a3d-adc4-4edb4426f21d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.947925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71cac157-f5b4-4a3d-adc4-4edb4426f21d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.948812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71cac157-f5b4-4a3d-adc4-4edb4426f21d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.949161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71cac157-f5b4-4a3d-adc4-4edb4426f21d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.949599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71cac157-f5b4-4a3d-adc4-4edb4426f21d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.101074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f66d8708-50ac-4d64-9b56-b8589f146a8e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:49.111913 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f66d8708-50ac-4d64-9b56-b8589f146a8e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1269 microversion: 2.1 time: 0.264972 Oct 04 18:03:49.113332 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 360/746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:48 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:49.120242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-9e270a47-967f-4c18-ba27-50bc62466799 req-ba33cb57-e8ee-4555-a23f-567dfe842152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeedbae9-0976-4ec6-9479-7b2a15f6ab62", "name": "network-vif-deleted", "tag": "2ab28775-1d8a-4368-8ae8-a885b0ab183e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:49.136556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9e270a47-967f-4c18-ba27-50bc62466799 req-ba33cb57-e8ee-4555-a23f-567dfe842152 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.137533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9e270a47-967f-4c18-ba27-50bc62466799 req-ba33cb57-e8ee-4555-a23f-567dfe842152 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.138603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9e270a47-967f-4c18-ba27-50bc62466799 req-ba33cb57-e8ee-4555-a23f-567dfe842152 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.159232 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9e270a47-967f-4c18-ba27-50bc62466799 req-ba33cb57-e8ee-4555-a23f-567dfe842152 service nova] Creating event network-vif-deleted:2ab28775-1d8a-4368-8ae8-a885b0ab183e for instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 on n-h1-850499-14 Oct 04 18:03:49.166847 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-9e270a47-967f-4c18-ba27-50bc62466799 req-ba33cb57-e8ee-4555-a23f-567dfe842152 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051869 Oct 04 18:03:49.168136 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 361/747] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:49.174880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a2d2b43-fd6f-4b29-87df-e2cf92faff73 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:49.175943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3a2d2b43-fd6f-4b29-87df-e2cf92faff73 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:49.191611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b43-fd6f-4b29-87df-e2cf92faff73 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.191611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b43-fd6f-4b29-87df-e2cf92faff73 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.191876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b43-fd6f-4b29-87df-e2cf92faff73 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.192621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b43-fd6f-4b29-87df-e2cf92faff73 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.193831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b43-fd6f-4b29-87df-e2cf92faff73 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.193831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a2d2b43-fd6f-4b29-87df-e2cf92faff73 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.466835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-71cac157-f5b4-4a3d-adc4-4edb4426f21d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:49.487751 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-71cac157-f5b4-4a3d-adc4-4edb4426f21d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1331 microversion: 2.1 time: 0.583443 Oct 04 18:03:49.489372 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 387/748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:48 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1331 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:49.590456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:49.743879 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a2d2b43-fd6f-4b29-87df-e2cf92faff73 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1632 microversion: 2.1 time: 0.573650 Oct 04 18:03:49.745177 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 362/749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:49 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1632 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:49.778807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-39b9a1d2-1b02-4e6c-8cd4-3a8635bc90de tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Action: 'create', calling method: .version_select at 0x7fd4d220aaf0>, body: {"keypair": {"name": "tempest-keypair-1033798269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJoQ4//FhIx/cuR1Sg9dq8P+J9u5SxZt73BNXhL2Ixk7vsugDU+FlIZE6vGhEnoMdPZmMmeKZ9rsKmMoeYy0EBmXzu5mXLvMR4/v8IQ/Nar5puy90NjrkAplM6izJtbQQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:49.806695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8c3c700d-a884-45a6-b776-cb7ad3ab4333 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:49.807654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c3c700d-a884-45a6-b776-cb7ad3ab4333 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:49.814521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-39b9a1d2-1b02-4e6c-8cd4-3a8635bc90de tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Getting quotas for project bc4df90b761348c082e7787ff4925299. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:49.820213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c3c700d-a884-45a6-b776-cb7ad3ab4333 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.820730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c3c700d-a884-45a6-b776-cb7ad3ab4333 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.821181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c3c700d-a884-45a6-b776-cb7ad3ab4333 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.821911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c3c700d-a884-45a6-b776-cb7ad3ab4333 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.828558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c3c700d-a884-45a6-b776-cb7ad3ab4333 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.829380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c3c700d-a884-45a6-b776-cb7ad3ab4333 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.840560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-39b9a1d2-1b02-4e6c-8cd4-3a8635bc90de tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Getting quotas for user 327e7f9ab3d74ff4a4d1bb86d15ad8fc and project bc4df90b761348c082e7787ff4925299. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:49.887829 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-39b9a1d2-1b02-4e6c-8cd4-3a8635bc90de tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114294 Oct 04 18:03:49.895181 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 388/750] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:03:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:49.920476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a28ccb6-93e9-4b42-91ab-f6fc79bb2239 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:49.921477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3a28ccb6-93e9-4b42-91ab-f6fc79bb2239 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:49.931850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a28ccb6-93e9-4b42-91ab-f6fc79bb2239 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.932365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a28ccb6-93e9-4b42-91ab-f6fc79bb2239 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.932947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a28ccb6-93e9-4b42-91ab-f6fc79bb2239 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.933703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a28ccb6-93e9-4b42-91ab-f6fc79bb2239 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.937437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a28ccb6-93e9-4b42-91ab-f6fc79bb2239 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.938457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a28ccb6-93e9-4b42-91ab-f6fc79bb2239 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.554444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8c3c700d-a884-45a6-b776-cb7ad3ab4333 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:50.572268 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8c3c700d-a884-45a6-b776-cb7ad3ab4333 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1319 microversion: 2.1 time: 0.770163 Oct 04 18:03:50.577272 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 363/751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:49 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1319 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:50.589285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-040f5632-9a79-43fc-99c4-1a1fc5c9357b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:50.591707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-040f5632-9a79-43fc-99c4-1a1fc5c9357b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:50.636645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-040f5632-9a79-43fc-99c4-1a1fc5c9357b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.644284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-040f5632-9a79-43fc-99c4-1a1fc5c9357b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.648356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-040f5632-9a79-43fc-99c4-1a1fc5c9357b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.649825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-040f5632-9a79-43fc-99c4-1a1fc5c9357b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.652571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-040f5632-9a79-43fc-99c4-1a1fc5c9357b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.653342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-040f5632-9a79-43fc-99c4-1a1fc5c9357b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.950058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-040f5632-9a79-43fc-99c4-1a1fc5c9357b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:50.960448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3a28ccb6-93e9-4b42-91ab-f6fc79bb2239 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:50.964590 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-040f5632-9a79-43fc-99c4-1a1fc5c9357b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1317 microversion: 2.1 time: 0.386074 Oct 04 18:03:50.980854 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3a28ccb6-93e9-4b42-91ab-f6fc79bb2239 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 1.058553 Oct 04 18:03:50.980854 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 389/752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:49 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:50.983524 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 364/753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:50 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:50.988593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b33db66f-d0f3-4c9c-a76e-e4fef9405d54 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:50.990237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b33db66f-d0f3-4c9c-a76e-e4fef9405d54 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:51.005778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b33db66f-d0f3-4c9c-a76e-e4fef9405d54 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.006376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b33db66f-d0f3-4c9c-a76e-e4fef9405d54 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.007072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b33db66f-d0f3-4c9c-a76e-e4fef9405d54 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.007857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b33db66f-d0f3-4c9c-a76e-e4fef9405d54 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.008397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b33db66f-d0f3-4c9c-a76e-e4fef9405d54 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.008901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b33db66f-d0f3-4c9c-a76e-e4fef9405d54 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.600581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20817b13-13f0-453f-8ea2-1d5bd9b10d3d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:51.601553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20817b13-13f0-453f-8ea2-1d5bd9b10d3d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:51.614026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20817b13-13f0-453f-8ea2-1d5bd9b10d3d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.616386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20817b13-13f0-453f-8ea2-1d5bd9b10d3d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.617202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20817b13-13f0-453f-8ea2-1d5bd9b10d3d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.619647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20817b13-13f0-453f-8ea2-1d5bd9b10d3d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.620418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20817b13-13f0-453f-8ea2-1d5bd9b10d3d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.623646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20817b13-13f0-453f-8ea2-1d5bd9b10d3d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.625975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b33db66f-d0f3-4c9c-a76e-e4fef9405d54 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:52.640647 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b33db66f-d0f3-4c9c-a76e-e4fef9405d54 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1331 microversion: 2.1 time: 1.657622 Oct 04 18:03:52.663527 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 390/754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:50 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1331 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:52.669511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-699ef57b-9b12-4a05-bffc-7a08560a7db9 req-bfb4cc46-2ecf-49d6-8c3e-dacc97313b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c31b2e2a-3ff2-4f05-b2c5-071a392b21ea", "name": "network-vif-plugged", "status": "completed", "tag": "63e5138e-54a8-464b-a808-cf8ff8e32709"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:52.703157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-699ef57b-9b12-4a05-bffc-7a08560a7db9 req-bfb4cc46-2ecf-49d6-8c3e-dacc97313b56 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:52.714876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-699ef57b-9b12-4a05-bffc-7a08560a7db9 req-bfb4cc46-2ecf-49d6-8c3e-dacc97313b56 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:52.715596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-699ef57b-9b12-4a05-bffc-7a08560a7db9 req-bfb4cc46-2ecf-49d6-8c3e-dacc97313b56 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.747666 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-699ef57b-9b12-4a05-bffc-7a08560a7db9 req-bfb4cc46-2ecf-49d6-8c3e-dacc97313b56 service nova] Creating event network-vif-plugged:63e5138e-54a8-464b-a808-cf8ff8e32709 for instance c31b2e2a-3ff2-4f05-b2c5-071a392b21ea on n-h2-850499-14 Oct 04 18:03:52.768761 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-699ef57b-9b12-4a05-bffc-7a08560a7db9 req-bfb4cc46-2ecf-49d6-8c3e-dacc97313b56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103810 Oct 04 18:03:52.783213 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 391/755] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:52.794165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa6a580b-7330-4f0b-9d81-a1c27270f1b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:52.794749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aa6a580b-7330-4f0b-9d81-a1c27270f1b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:52.804689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6a580b-7330-4f0b-9d81-a1c27270f1b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:52.805071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6a580b-7330-4f0b-9d81-a1c27270f1b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:52.805799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6a580b-7330-4f0b-9d81-a1c27270f1b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.806730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6a580b-7330-4f0b-9d81-a1c27270f1b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:52.807454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6a580b-7330-4f0b-9d81-a1c27270f1b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:52.808032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6a580b-7330-4f0b-9d81-a1c27270f1b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.962418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-20817b13-13f0-453f-8ea2-1d5bd9b10d3d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:52.991614 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20817b13-13f0-453f-8ea2-1d5bd9b10d3d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1469 microversion: 2.1 time: 1.394852 Oct 04 18:03:52.993596 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 365/756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:51 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1469 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:53.005529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-03c6cf19-220a-4407-b2a6-2b218c4817b5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:53.008754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-03c6cf19-220a-4407-b2a6-2b218c4817b5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:53.018303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c6cf19-220a-4407-b2a6-2b218c4817b5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.019111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c6cf19-220a-4407-b2a6-2b218c4817b5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.019884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c6cf19-220a-4407-b2a6-2b218c4817b5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.021148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c6cf19-220a-4407-b2a6-2b218c4817b5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.025472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aa6a580b-7330-4f0b-9d81-a1c27270f1b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:53.035278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c6cf19-220a-4407-b2a6-2b218c4817b5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.036185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c6cf19-220a-4407-b2a6-2b218c4817b5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.037851 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa6a580b-7330-4f0b-9d81-a1c27270f1b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1323 microversion: 2.1 time: 0.252384 Oct 04 18:03:53.041380 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 392/757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:52 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:53.068967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e77d9934-2f7c-4517-81d1-96c85ef8c5f7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:53.071899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e77d9934-2f7c-4517-81d1-96c85ef8c5f7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:53.081346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e77d9934-2f7c-4517-81d1-96c85ef8c5f7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.082387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e77d9934-2f7c-4517-81d1-96c85ef8c5f7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.083112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e77d9934-2f7c-4517-81d1-96c85ef8c5f7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.084008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e77d9934-2f7c-4517-81d1-96c85ef8c5f7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.084635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e77d9934-2f7c-4517-81d1-96c85ef8c5f7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.086296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e77d9934-2f7c-4517-81d1-96c85ef8c5f7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.091919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:53.552743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-03c6cf19-220a-4407-b2a6-2b218c4817b5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:53.563506 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-03c6cf19-220a-4407-b2a6-2b218c4817b5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 0.568504 Oct 04 18:03:53.564123 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 366/758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:52 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:53.667291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef21ff35-449b-4dbd-bee9-3479e148d4df tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:53.667927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef21ff35-449b-4dbd-bee9-3479e148d4df tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:53.680418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef21ff35-449b-4dbd-bee9-3479e148d4df tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.682084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef21ff35-449b-4dbd-bee9-3479e148d4df tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.682744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef21ff35-449b-4dbd-bee9-3479e148d4df tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.683730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef21ff35-449b-4dbd-bee9-3479e148d4df tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.684407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef21ff35-449b-4dbd-bee9-3479e148d4df tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.685063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef21ff35-449b-4dbd-bee9-3479e148d4df tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.755839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e77d9934-2f7c-4517-81d1-96c85ef8c5f7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:53.769567 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e77d9934-2f7c-4517-81d1-96c85ef8c5f7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 200 len: 1319 microversion: 2.1 time: 0.716356 Oct 04 18:03:53.770424 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 393/759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:53 2022] GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 1319 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:53.987142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-800637155", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "a2884286-aa9a-463d-8f10-555c5aa8fb7e"}], "security_groups": [{"name": "tempest-securitygroup--1642706100"}], "key_name": "tempest-keypair-1033798269", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:54.134090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef21ff35-449b-4dbd-bee9-3479e148d4df tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:54.144053 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef21ff35-449b-4dbd-bee9-3479e148d4df tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1331 microversion: 2.1 time: 0.480817 Oct 04 18:03:54.144650 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 367/760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:53 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1331 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:54.157591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6dce0b7d-93a9-437c-809f-856ba6003f7d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:54.159184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6dce0b7d-93a9-437c-809f-856ba6003f7d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:54.167468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dce0b7d-93a9-437c-809f-856ba6003f7d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:54.168292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dce0b7d-93a9-437c-809f-856ba6003f7d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:54.168952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dce0b7d-93a9-437c-809f-856ba6003f7d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:54.169917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dce0b7d-93a9-437c-809f-856ba6003f7d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:54.170579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dce0b7d-93a9-437c-809f-856ba6003f7d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:54.171435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dce0b7d-93a9-437c-809f-856ba6003f7d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:54.326363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6dce0b7d-93a9-437c-809f-856ba6003f7d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:54.337032 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6dce0b7d-93a9-437c-809f-856ba6003f7d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1323 microversion: 2.1 time: 0.183299 Oct 04 18:03:54.340673 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 368/761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:54 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:54.419945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] validate_networks() for [('a2884286-aa9a-463d-8f10-555c5aa8fb7e', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:54.588831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d9890a5f-e684-4359-a421-355092cccec5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:54.589466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d9890a5f-e684-4359-a421-355092cccec5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:54.600223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9890a5f-e684-4359-a421-355092cccec5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:54.604140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9890a5f-e684-4359-a421-355092cccec5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:54.606242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9890a5f-e684-4359-a421-355092cccec5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:54.607360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9890a5f-e684-4359-a421-355092cccec5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:54.614975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9890a5f-e684-4359-a421-355092cccec5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:54.630654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9890a5f-e684-4359-a421-355092cccec5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:55.172986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d9890a5f-e684-4359-a421-355092cccec5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:55.197232 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d9890a5f-e684-4359-a421-355092cccec5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 0.605246 Oct 04 18:03:55.197974 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 369/762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:54 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:55.214973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1958b771-7f60-4db2-9518-c7a3b96b0b8b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:55.216583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1958b771-7f60-4db2-9518-c7a3b96b0b8b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:55.232921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1958b771-7f60-4db2-9518-c7a3b96b0b8b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:55.233444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1958b771-7f60-4db2-9518-c7a3b96b0b8b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:55.243751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1958b771-7f60-4db2-9518-c7a3b96b0b8b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:55.245690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1958b771-7f60-4db2-9518-c7a3b96b0b8b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:55.246669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1958b771-7f60-4db2-9518-c7a3b96b0b8b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:55.248906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1958b771-7f60-4db2-9518-c7a3b96b0b8b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:55.955603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1958b771-7f60-4db2-9518-c7a3b96b0b8b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:55.970868 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1958b771-7f60-4db2-9518-c7a3b96b0b8b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 200 len: 1468 microversion: 2.1 time: 0.771767 Oct 04 18:03:55.971664 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 370/763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:55 2022] GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 1468 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:55.987141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-82660f14-08fd-416d-9030-a9e91824a57e req-c45d8527-2e54-4b46-91df-a5effc888a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d25ec92-5335-4444-83ba-2c92abef1832", "name": "network-vif-plugged", "status": "completed", "tag": "ae5a66c4-f24e-47ae-bcad-abe0df6b2f41"}, {"server_uuid": "51903294-696f-4e13-adb2-d63862de1a52", "name": "network-vif-plugged", "status": "completed", "tag": "ade6ab7a-2609-411b-8d9e-c2fe5c446530"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:56.010984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-82660f14-08fd-416d-9030-a9e91824a57e req-c45d8527-2e54-4b46-91df-a5effc888a54 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.011712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-82660f14-08fd-416d-9030-a9e91824a57e req-c45d8527-2e54-4b46-91df-a5effc888a54 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.012320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-82660f14-08fd-416d-9030-a9e91824a57e req-c45d8527-2e54-4b46-91df-a5effc888a54 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.046154 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-82660f14-08fd-416d-9030-a9e91824a57e req-c45d8527-2e54-4b46-91df-a5effc888a54 service nova] Creating event network-vif-plugged:ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 for instance 0d25ec92-5335-4444-83ba-2c92abef1832 on n-h1-850499-14 Oct 04 18:03:56.047381 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-82660f14-08fd-416d-9030-a9e91824a57e req-c45d8527-2e54-4b46-91df-a5effc888a54 service nova] Creating event network-vif-plugged:ade6ab7a-2609-411b-8d9e-c2fe5c446530 for instance 51903294-696f-4e13-adb2-d63862de1a52 on n-h2-850499-14 Oct 04 18:03:56.067668 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-82660f14-08fd-416d-9030-a9e91824a57e req-c45d8527-2e54-4b46-91df-a5effc888a54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093524 Oct 04 18:03:56.078896 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 371/764] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:56.094531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab9e207b-e2cb-433a-9a8e-4ed9f0958563 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:56.095849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ab9e207b-e2cb-433a-9a8e-4ed9f0958563 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:56.123732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9e207b-e2cb-433a-9a8e-4ed9f0958563 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.125508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9e207b-e2cb-433a-9a8e-4ed9f0958563 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.126257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9e207b-e2cb-433a-9a8e-4ed9f0958563 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.131476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9e207b-e2cb-433a-9a8e-4ed9f0958563 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.133666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9e207b-e2cb-433a-9a8e-4ed9f0958563 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.136356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9e207b-e2cb-433a-9a8e-4ed9f0958563 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.888425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:56.889173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:56.889771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:56.890296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:56.890881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:56.900998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.901593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.902331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.903312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.903883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.904473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.923759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Getting quotas for project bc4df90b761348c082e7787ff4925299. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:56.929703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Getting quotas for user 327e7f9ab3d74ff4a4d1bb86d15ad8fc and project bc4df90b761348c082e7787ff4925299. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:56.945074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:56.947711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:57.008101 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5e7fcf8-2ce7-4756-83b2-b35563640556 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.027335 Oct 04 18:03:57.009460 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 394/765] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 3029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:03:57.014863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-701aa396-7842-4494-a832-dd8e03c0b074 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.015895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-701aa396-7842-4494-a832-dd8e03c0b074 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:57.023071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-701aa396-7842-4494-a832-dd8e03c0b074 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.023967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-701aa396-7842-4494-a832-dd8e03c0b074 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.024665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-701aa396-7842-4494-a832-dd8e03c0b074 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.025673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-701aa396-7842-4494-a832-dd8e03c0b074 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.026358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-701aa396-7842-4494-a832-dd8e03c0b074 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.027097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-701aa396-7842-4494-a832-dd8e03c0b074 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.212074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ab9e207b-e2cb-433a-9a8e-4ed9f0958563 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.234820 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ab9e207b-e2cb-433a-9a8e-4ed9f0958563 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1331 microversion: 2.1 time: 1.150794 Oct 04 18:03:57.236522 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 372/766] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:56 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1331 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:57.241503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.267966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.268270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Searching by: {'reservation_id': 'r-8t9alvhf', 'deleted': False, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:03:57.288637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.289226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.289698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.290422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.290871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.291329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.537444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-701aa396-7842-4494-a832-dd8e03c0b074 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.564034 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-701aa396-7842-4494-a832-dd8e03c0b074 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1390 microversion: 2.1 time: 0.553008 Oct 04 18:03:57.567219 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 395/767] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:57 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1390 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:57.596750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33ed4905-fb40-4c07-85ef-39b37a1e72a8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.616415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33ed4905-fb40-4c07-85ef-39b37a1e72a8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:57.665362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ed4905-fb40-4c07-85ef-39b37a1e72a8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.672808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:03:57.676963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ed4905-fb40-4c07-85ef-39b37a1e72a8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.678601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ed4905-fb40-4c07-85ef-39b37a1e72a8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.685761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ed4905-fb40-4c07-85ef-39b37a1e72a8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.689892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ed4905-fb40-4c07-85ef-39b37a1e72a8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.692173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ed4905-fb40-4c07-85ef-39b37a1e72a8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.050078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.088261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.089405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.090015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.487502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-33ed4905-fb40-4c07-85ef-39b37a1e72a8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.501330 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33ed4905-fb40-4c07-85ef-39b37a1e72a8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1312 microversion: 2.1 time: 0.930848 Oct 04 18:03:58.506399 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 396/768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:57 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1312 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:58.513911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f41e57a2-7a49-4192-9745-59a706e485d9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:58.514701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f41e57a2-7a49-4192-9745-59a706e485d9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.545318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f41e57a2-7a49-4192-9745-59a706e485d9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.546300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f41e57a2-7a49-4192-9745-59a706e485d9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.548417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f41e57a2-7a49-4192-9745-59a706e485d9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.549385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f41e57a2-7a49-4192-9745-59a706e485d9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.551134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f41e57a2-7a49-4192-9745-59a706e485d9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.551746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f41e57a2-7a49-4192-9745-59a706e485d9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.696686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f41e57a2-7a49-4192-9745-59a706e485d9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.709936 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f41e57a2-7a49-4192-9745-59a706e485d9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1286 microversion: 2.1 time: 0.201553 Oct 04 18:03:58.714926 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 397/769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:58.732864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e73adb33-aba3-458c-aca7-cb6ed5f2e278 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:58.733771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e73adb33-aba3-458c-aca7-cb6ed5f2e278 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.744213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e73adb33-aba3-458c-aca7-cb6ed5f2e278 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.744728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e73adb33-aba3-458c-aca7-cb6ed5f2e278 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.745174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e73adb33-aba3-458c-aca7-cb6ed5f2e278 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.745883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e73adb33-aba3-458c-aca7-cb6ed5f2e278 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.748576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e73adb33-aba3-458c-aca7-cb6ed5f2e278 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.755504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e73adb33-aba3-458c-aca7-cb6ed5f2e278 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.760501 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7c540f18-633b-4812-98f3-cf41a90a80ab tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-8t9alvhf" status: 200 len: 2930 microversion: 2.1 time: 1.522499 Oct 04 18:03:58.778987 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 373/770] 10.222.0.18 () {58 vars in 1197 bytes} [Tue Oct 4 18:03:57 2022] GET /compute/v2.1/servers/detail?reservation_id=r-8t9alvhf => generated 2930 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:58.784216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-60247886-2401-4880-a740-7e3168b1d587 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:58.785357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-60247886-2401-4880-a740-7e3168b1d587 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.800528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60247886-2401-4880-a740-7e3168b1d587 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.801494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60247886-2401-4880-a740-7e3168b1d587 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.803505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60247886-2401-4880-a740-7e3168b1d587 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.804553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60247886-2401-4880-a740-7e3168b1d587 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.807306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60247886-2401-4880-a740-7e3168b1d587 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.809107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60247886-2401-4880-a740-7e3168b1d587 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.422745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-60247886-2401-4880-a740-7e3168b1d587 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.448197 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-60247886-2401-4880-a740-7e3168b1d587 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1390 microversion: 2.1 time: 0.682774 Oct 04 18:03:59.448790 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 374/771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1390 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:59.466908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6aa59544-6d83-467a-a18d-4fce9e2a1df5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:59.508223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.server_groups [None req-6aa59544-6d83-467a-a18d-4fce9e2a1df5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Querying cell c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) for 2 instances {{(pid=122331) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:03:59.509164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aa59544-6d83-467a-a18d-4fce9e2a1df5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.510222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aa59544-6d83-467a-a18d-4fce9e2a1df5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.510926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aa59544-6d83-467a-a18d-4fce9e2a1df5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.567440 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6aa59544-6d83-467a-a18d-4fce9e2a1df5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/1ac34048-0a16-40a7-9526-17415b175fb8" status: 200 len: 265 microversion: 2.1 time: 0.117370 Oct 04 18:03:59.568411 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 375/772] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:03:59 2022] GET /compute/v2.1/os-server-groups/1ac34048-0a16-40a7-9526-17415b175fb8 => generated 265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:59.573944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-066a436a-f852-45be-901f-649bfb3ae0a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:59.574582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-066a436a-f852-45be-901f-649bfb3ae0a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:59.591054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-066a436a-f852-45be-901f-649bfb3ae0a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.591763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-066a436a-f852-45be-901f-649bfb3ae0a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.592381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-066a436a-f852-45be-901f-649bfb3ae0a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.593340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-066a436a-f852-45be-901f-649bfb3ae0a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.596936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-066a436a-f852-45be-901f-649bfb3ae0a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.597893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-066a436a-f852-45be-901f-649bfb3ae0a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.840399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e73adb33-aba3-458c-aca7-cb6ed5f2e278 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.854479 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e73adb33-aba3-458c-aca7-cb6ed5f2e278 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1535 microversion: 2.1 time: 1.138044 Oct 04 18:03:59.867305 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 398/773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1535 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:59.875258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0380fc3c-92aa-4135-96f7-605768b91b47 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:59.875258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0380fc3c-92aa-4135-96f7-605768b91b47 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:59.884858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0380fc3c-92aa-4135-96f7-605768b91b47 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.885639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0380fc3c-92aa-4135-96f7-605768b91b47 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.888172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0380fc3c-92aa-4135-96f7-605768b91b47 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.889152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0380fc3c-92aa-4135-96f7-605768b91b47 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.889792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0380fc3c-92aa-4135-96f7-605768b91b47 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.894490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0380fc3c-92aa-4135-96f7-605768b91b47 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.330359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-066a436a-f852-45be-901f-649bfb3ae0a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.342394 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-066a436a-f852-45be-901f-649bfb3ae0a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1462 microversion: 2.1 time: 0.772822 Oct 04 18:04:00.344595 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 376/774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:59 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1462 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:00.350172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a33b9fe7-0552-4b4e-ab14-6d3e28304a0c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:00.351237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a33b9fe7-0552-4b4e-ab14-6d3e28304a0c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:00.360561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a33b9fe7-0552-4b4e-ab14-6d3e28304a0c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.361522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a33b9fe7-0552-4b4e-ab14-6d3e28304a0c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.362219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a33b9fe7-0552-4b4e-ab14-6d3e28304a0c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.363203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a33b9fe7-0552-4b4e-ab14-6d3e28304a0c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.363932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a33b9fe7-0552-4b4e-ab14-6d3e28304a0c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.364905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a33b9fe7-0552-4b4e-ab14-6d3e28304a0c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.370579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:00.592703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a33b9fe7-0552-4b4e-ab14-6d3e28304a0c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.610397 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a33b9fe7-0552-4b4e-ab14-6d3e28304a0c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1292 microversion: 2.1 time: 0.264248 Oct 04 18:04:00.611597 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 377/775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:00 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1292 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:00.618902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-84176bdf-b746-4be6-8be0-984810f60d6d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Action: 'create', calling method: .version_select at 0x7fd4d2448f70>, body: {"pool": "051703dd-ddec-4a3f-9646-26fd6a546c44"} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:01.198787 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0380fc3c-92aa-4135-96f7-605768b91b47 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 200 len: 1622 microversion: 2.1 time: 1.340767 Oct 04 18:04:01.206357 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 399/776] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:59 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 1622 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:01.219725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-279dc38a-5035-4dc2-8b0b-713cb3de0793 req-0cd56daa-42ac-4c15-b30f-c253881d3ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cae794e-563d-417b-ba78-9c6982b5b2e8", "tag": "e0a54cf7-155d-4176-bcef-b24b91c382ab"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:01.265620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-279dc38a-5035-4dc2-8b0b-713cb3de0793 req-0cd56daa-42ac-4c15-b30f-c253881d3ecf service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.266258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-279dc38a-5035-4dc2-8b0b-713cb3de0793 req-0cd56daa-42ac-4c15-b30f-c253881d3ecf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.266902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-279dc38a-5035-4dc2-8b0b-713cb3de0793 req-0cd56daa-42ac-4c15-b30f-c253881d3ecf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:01.295381 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-279dc38a-5035-4dc2-8b0b-713cb3de0793 req-0cd56daa-42ac-4c15-b30f-c253881d3ecf service nova] Creating event network-changed:e0a54cf7-155d-4176-bcef-b24b91c382ab for instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 on n-h1-850499-14 Oct 04 18:04:01.306266 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-279dc38a-5035-4dc2-8b0b-713cb3de0793 req-0cd56daa-42ac-4c15-b30f-c253881d3ecf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097301 Oct 04 18:04:01.307200 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 400/777] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:01.330826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:01.334257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:01.345733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.351948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.357967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:01.377344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.380199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.385832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:01.916792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:01.926328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Old instance type m1.heat2, new instance type m1.heat {{(pid=122332) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:04:01.998374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:02.003786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:02.005473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:02.009125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:02.011040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:02.479082 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-98fbbdce-7f97-4165-882f-c9b60a5b6013 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52/action" status: 202 len: 0 microversion: 2.1 time: 1.169904 Oct 04 18:04:02.485017 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 401/778] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:01 2022] POST /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52/action => generated 0 bytes in 1177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:02.504816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-41440840-e378-47d1-81d5-76f9f3fff18e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:02.514904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-41440840-e378-47d1-81d5-76f9f3fff18e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:02.548289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41440840-e378-47d1-81d5-76f9f3fff18e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.556895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41440840-e378-47d1-81d5-76f9f3fff18e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.558634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41440840-e378-47d1-81d5-76f9f3fff18e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.560301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41440840-e378-47d1-81d5-76f9f3fff18e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.563909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41440840-e378-47d1-81d5-76f9f3fff18e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.564772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41440840-e378-47d1-81d5-76f9f3fff18e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.197747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-41440840-e378-47d1-81d5-76f9f3fff18e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:04.223779 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-41440840-e378-47d1-81d5-76f9f3fff18e tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1390 microversion: 2.1 time: 1.737393 Oct 04 18:04:04.239554 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 402/779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:02 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1390 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:04.255650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-75c8b95c-b061-4362-8663-5bb43cfe7f2c tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:04.256591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-75c8b95c-b061-4362-8663-5bb43cfe7f2c tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:04.268885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75c8b95c-b061-4362-8663-5bb43cfe7f2c tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.269650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75c8b95c-b061-4362-8663-5bb43cfe7f2c tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.270766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75c8b95c-b061-4362-8663-5bb43cfe7f2c tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.271870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75c8b95c-b061-4362-8663-5bb43cfe7f2c tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.272495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75c8b95c-b061-4362-8663-5bb43cfe7f2c tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.275034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75c8b95c-b061-4362-8663-5bb43cfe7f2c tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.264005 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-75c8b95c-b061-4362-8663-5bb43cfe7f2c tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 200 len: 1621 microversion: 2.1 time: 1.022913 Oct 04 18:04:05.264673 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 403/780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:04 2022] GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 1621 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:05.286509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-72f3921d-1155-4d74-b643-4d2f09dbed9c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:05.296423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-72f3921d-1155-4d74-b643-4d2f09dbed9c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:05.340326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72f3921d-1155-4d74-b643-4d2f09dbed9c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.348323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72f3921d-1155-4d74-b643-4d2f09dbed9c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.349858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72f3921d-1155-4d74-b643-4d2f09dbed9c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.352876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72f3921d-1155-4d74-b643-4d2f09dbed9c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.368595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72f3921d-1155-4d74-b643-4d2f09dbed9c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.371733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72f3921d-1155-4d74-b643-4d2f09dbed9c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.913971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:06.937984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=16 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:07.116988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-72f3921d-1155-4d74-b643-4d2f09dbed9c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.132454 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-72f3921d-1155-4d74-b643-4d2f09dbed9c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1360 microversion: 2.1 time: 1.866697 Oct 04 18:04:07.133059 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 404/781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:05 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1360 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:07.159358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8fd037f-1f80-4c64-b204-23e18af4e71c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:07.159981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f8fd037f-1f80-4c64-b204-23e18af4e71c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:07.191844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8fd037f-1f80-4c64-b204-23e18af4e71c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.192289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8fd037f-1f80-4c64-b204-23e18af4e71c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.192970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8fd037f-1f80-4c64-b204-23e18af4e71c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.199994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8fd037f-1f80-4c64-b204-23e18af4e71c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.200503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8fd037f-1f80-4c64-b204-23e18af4e71c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.200949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8fd037f-1f80-4c64-b204-23e18af4e71c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.400755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:08.043184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:08.063763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f8fd037f-1f80-4c64-b204-23e18af4e71c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.075397 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8fd037f-1f80-4c64-b204-23e18af4e71c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1471 microversion: 2.1 time: 0.941194 Oct 04 18:04:08.078216 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 405/782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:07 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1471 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:08.098143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-972048520", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8cbae431-f983-4f62-a73e-95994feacd54"}], "security_groups": [{"name": "tempest-securitygroup--925827975"}], "key_name": "tempest-keypair-1867673379", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "17e56ddd-0108-461a-9500-6fb1719c2077", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:08.259182 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-84176bdf-b746-4be6-8be0-984810f60d6d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.645720 Oct 04 18:04:08.269648 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 378/783] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:04:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:08.280546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c093016c-b6ab-4dc9-bc45-76b22545e0ce tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:08.282025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c093016c-b6ab-4dc9-bc45-76b22545e0ce tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:08.296366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c093016c-b6ab-4dc9-bc45-76b22545e0ce tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.297631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c093016c-b6ab-4dc9-bc45-76b22545e0ce tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.299092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c093016c-b6ab-4dc9-bc45-76b22545e0ce tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.300232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c093016c-b6ab-4dc9-bc45-76b22545e0ce tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.303619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c093016c-b6ab-4dc9-bc45-76b22545e0ce tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.304705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c093016c-b6ab-4dc9-bc45-76b22545e0ce tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.502264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] validate_networks() for [('8cbae431-f983-4f62-a73e-95994feacd54', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:08.709833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c093016c-b6ab-4dc9-bc45-76b22545e0ce tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.722946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c093016c-b6ab-4dc9-bc45-76b22545e0ce tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1390 microversion: 2.1 time: 0.451276 Oct 04 18:04:08.742606 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 379/784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:08 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1390 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:08.764771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eb992f9c-7ee7-4585-b080-8cc81c1befbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Action: 'create', calling method: .version_select at 0x7fd4d24fc4c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1897046340", "policies": ["anti-affinity"]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:08.808709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-eb992f9c-7ee7-4585-b080-8cc81c1befbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:08.824918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-eb992f9c-7ee7-4585-b080-8cc81c1befbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:08.970832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-eb992f9c-7ee7-4585-b080-8cc81c1befbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:08.978273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-eb992f9c-7ee7-4585-b080-8cc81c1befbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:08.998509 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eb992f9c-7ee7-4585-b080-8cc81c1befbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.254008 Oct 04 18:04:08.999731 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 380/785] 10.222.0.18 () {60 vars in 1174 bytes} [Tue Oct 4 18:04:08 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:09.006542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-47649e37-ebbd-4dcf-a91a-632cc1ab066c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.020897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-47649e37-ebbd-4dcf-a91a-632cc1ab066c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:09.024012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:09.038438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47649e37-ebbd-4dcf-a91a-632cc1ab066c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.040990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47649e37-ebbd-4dcf-a91a-632cc1ab066c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.042417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47649e37-ebbd-4dcf-a91a-632cc1ab066c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.043672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47649e37-ebbd-4dcf-a91a-632cc1ab066c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.046714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47649e37-ebbd-4dcf-a91a-632cc1ab066c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.047416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47649e37-ebbd-4dcf-a91a-632cc1ab066c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.415011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Getting quotas for project ec29258aab154d4aaf11ff64931a4fbe. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:09.420511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Getting quotas for user b6d1205c1bd748c6845643ae231bf19a and project ec29258aab154d4aaf11ff64931a4fbe. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:09.467347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:09.468308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:09.468791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:09.469208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:09.483054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:09.493046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.493552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.494001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.494743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.495246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.495682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.501966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-47649e37-ebbd-4dcf-a91a-632cc1ab066c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:09.520728 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-47649e37-ebbd-4dcf-a91a-632cc1ab066c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1360 microversion: 2.1 time: 0.519291 Oct 04 18:04:09.543183 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 381/786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:08 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1360 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:09.549282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Getting quotas for project ec29258aab154d4aaf11ff64931a4fbe. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:09.552235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Action: 'action', calling method: .version_select at 0x7fd4d3ba7d30>, body: {"addFloatingIp": {"address": "172.25.4.110"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:09.557124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Getting quotas for user b6d1205c1bd748c6845643ae231bf19a and project ec29258aab154d4aaf11ff64931a4fbe. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:09.561955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:09.568658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:09.576889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.577400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.577842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.578555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.583647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.591762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.648515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:09.654756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17e56ddd-0108-461a-9500-6fb1719c2077',volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:09.741929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:04:09.742490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquired lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:04:09.922432 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8c1603e6-627e-4777-a1d8-de9dc78105a1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.840326 Oct 04 18:04:09.924700 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 406/787] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:09.937301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9dd4408-675a-4ff6-951f-692f5a6ff510 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.938984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9dd4408-675a-4ff6-951f-692f5a6ff510 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:09.956066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9dd4408-675a-4ff6-951f-692f5a6ff510 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.956659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9dd4408-675a-4ff6-951f-692f5a6ff510 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.964390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9dd4408-675a-4ff6-951f-692f5a6ff510 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.966171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9dd4408-675a-4ff6-951f-692f5a6ff510 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.966742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9dd4408-675a-4ff6-951f-692f5a6ff510 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.968805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9dd4408-675a-4ff6-951f-692f5a6ff510 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.341587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9dd4408-675a-4ff6-951f-692f5a6ff510 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:10.353050 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9dd4408-675a-4ff6-951f-692f5a6ff510 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1471 microversion: 2.1 time: 0.425010 Oct 04 18:04:10.367651 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 407/788] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:09 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:10.379549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-219162309", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ac2be6be-9103-49c4-9b7e-c4eba285ae5c"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:10.465675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:11.923415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:11.924650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:11.925267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:11.925722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:11.926138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:11.956193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.956595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.957031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.957754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.958205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.958629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.032438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:12.044565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:12.077367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Going to run 2 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:12.083621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:12.201151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:12.212461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:12.260571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:12.268734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:12.290678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: cd85fc2b-0943-4616-8b69-f8e5825e400a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=587dc93d-6601-457a-b25d-8b88eb79ab15,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:12.360508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:12.366572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:12.418269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:12.426182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:12.538452 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a3afd3a-1864-494e-b7dd-70f696b6270d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.169336 Oct 04 18:04:12.543487 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 408/789] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 2175 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:04:12.549985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e760e113-87ff-4360-b076-24e45560d1c2 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:12.550174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e760e113-87ff-4360-b076-24e45560d1c2 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:12.565350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e760e113-87ff-4360-b076-24e45560d1c2 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.565843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e760e113-87ff-4360-b076-24e45560d1c2 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.566398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e760e113-87ff-4360-b076-24e45560d1c2 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.567403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e760e113-87ff-4360-b076-24e45560d1c2 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.567859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e760e113-87ff-4360-b076-24e45560d1c2 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.568285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e760e113-87ff-4360-b076-24e45560d1c2 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.900454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e760e113-87ff-4360-b076-24e45560d1c2 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.918802 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e760e113-87ff-4360-b076-24e45560d1c2 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1390 microversion: 2.1 time: 0.373557 Oct 04 18:04:12.922136 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 409/790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:12 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1390 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:12.941967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-4713fd49-106d-4553-8d21-62524f886657 req-c2ad975e-cb40-4bd2-924f-87e07be68b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513fb23f-209f-4de1-add7-84c46117aace", "tag": "ae27d040-17cf-482a-b391-3a571eec78cd"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:12.978321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4713fd49-106d-4553-8d21-62524f886657 req-c2ad975e-cb40-4bd2-924f-87e07be68b0b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.978807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4713fd49-106d-4553-8d21-62524f886657 req-c2ad975e-cb40-4bd2-924f-87e07be68b0b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.979267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4713fd49-106d-4553-8d21-62524f886657 req-c2ad975e-cb40-4bd2-924f-87e07be68b0b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.044339 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-4713fd49-106d-4553-8d21-62524f886657 req-c2ad975e-cb40-4bd2-924f-87e07be68b0b service nova] Creating event network-changed:ae27d040-17cf-482a-b391-3a571eec78cd for instance 513fb23f-209f-4de1-add7-84c46117aace on n-h1-850499-14 Oct 04 18:04:13.052488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Building network info cache for instance {{(pid=122331) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:04:13.065882 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-4713fd49-106d-4553-8d21-62524f886657 req-c2ad975e-cb40-4bd2-924f-87e07be68b0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141657 Oct 04 18:04:13.067466 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 410/791] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:13.080598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e03c3167-be86-4af9-a688-136364d16e1d req-68a12548-d506-41bb-9dc0-da2ede92e184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cae794e-563d-417b-ba78-9c6982b5b2e8", "name": "network-vif-plugged", "status": "completed", "tag": "e0a54cf7-155d-4176-bcef-b24b91c382ab"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:13.117554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e03c3167-be86-4af9-a688-136364d16e1d req-68a12548-d506-41bb-9dc0-da2ede92e184 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.119161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e03c3167-be86-4af9-a688-136364d16e1d req-68a12548-d506-41bb-9dc0-da2ede92e184 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.123608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e03c3167-be86-4af9-a688-136364d16e1d req-68a12548-d506-41bb-9dc0-da2ede92e184 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.167850 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e03c3167-be86-4af9-a688-136364d16e1d req-68a12548-d506-41bb-9dc0-da2ede92e184 service nova] Creating event network-vif-plugged:e0a54cf7-155d-4176-bcef-b24b91c382ab for instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 on n-h1-850499-14 Oct 04 18:04:13.187571 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e03c3167-be86-4af9-a688-136364d16e1d req-68a12548-d506-41bb-9dc0-da2ede92e184 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118429 Oct 04 18:04:13.191949 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 411/792] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:13.219058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8cc441a7-406d-4146-b240-954b8bdf96bf tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.219898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8cc441a7-406d-4146-b240-954b8bdf96bf tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:13.240804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc441a7-406d-4146-b240-954b8bdf96bf tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.241300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc441a7-406d-4146-b240-954b8bdf96bf tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.241745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc441a7-406d-4146-b240-954b8bdf96bf tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.242551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc441a7-406d-4146-b240-954b8bdf96bf tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.267645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc441a7-406d-4146-b240-954b8bdf96bf tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.268222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc441a7-406d-4146-b240-954b8bdf96bf tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.346370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:13.548214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8cc441a7-406d-4146-b240-954b8bdf96bf tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:13.571975 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8cc441a7-406d-4146-b240-954b8bdf96bf tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1237 microversion: 2.1 time: 0.376742 Oct 04 18:04:13.579127 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 412/793] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:13 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1237 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:13.587073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-178c8146-e7f3-4e67-9ca3-fb7333ee3756 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.587073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-178c8146-e7f3-4e67-9ca3-fb7333ee3756 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:13.612146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-178c8146-e7f3-4e67-9ca3-fb7333ee3756 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.612665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-178c8146-e7f3-4e67-9ca3-fb7333ee3756 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.617942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-178c8146-e7f3-4e67-9ca3-fb7333ee3756 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.627779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-178c8146-e7f3-4e67-9ca3-fb7333ee3756 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.627779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-178c8146-e7f3-4e67-9ca3-fb7333ee3756 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.627779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-178c8146-e7f3-4e67-9ca3-fb7333ee3756 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.096574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-178c8146-e7f3-4e67-9ca3-fb7333ee3756 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:14.128171 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-178c8146-e7f3-4e67-9ca3-fb7333ee3756 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1360 microversion: 2.1 time: 0.552458 Oct 04 18:04:14.131267 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 413/794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:13 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1360 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:14.142787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c8fc2c1-892b-45d7-bbdc-c68fc8736479 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:14.146315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c8fc2c1-892b-45d7-bbdc-c68fc8736479 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:14.158249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2c1-892b-45d7-bbdc-c68fc8736479 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.164189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2c1-892b-45d7-bbdc-c68fc8736479 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.165537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2c1-892b-45d7-bbdc-c68fc8736479 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.168544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2c1-892b-45d7-bbdc-c68fc8736479 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.169310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2c1-892b-45d7-bbdc-c68fc8736479 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.194297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2c1-892b-45d7-bbdc-c68fc8736479 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.708582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4c8fc2c1-892b-45d7-bbdc-c68fc8736479 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:14.723653 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c8fc2c1-892b-45d7-bbdc-c68fc8736479 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1476 microversion: 2.1 time: 0.590150 Oct 04 18:04:14.741860 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 414/795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:14 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1476 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:14.776654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:14.791027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:14.799318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Searching by: {'deleted': False, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:14.813272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.814158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.817402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.826161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.827829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.828514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.903143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:14.962918 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ee31899-1ea0-47f1-a8d5-86b3b241067e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.218915 Oct 04 18:04:14.971615 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 415/796] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:04:14 2022] GET /compute/v2.1/servers => generated 1663 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:14.973066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-51336655-0318-4bd1-8172-7bbfbdc0e390 req-31f5a7fc-20a4-4baf-bd22-148440af50f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d25ec92-5335-4444-83ba-2c92abef1832", "tag": "ae5a66c4-f24e-47ae-bcad-abe0df6b2f41"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:14.996019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-51336655-0318-4bd1-8172-7bbfbdc0e390 req-31f5a7fc-20a4-4baf-bd22-148440af50f4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.999223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-51336655-0318-4bd1-8172-7bbfbdc0e390 req-31f5a7fc-20a4-4baf-bd22-148440af50f4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.999686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-51336655-0318-4bd1-8172-7bbfbdc0e390 req-31f5a7fc-20a4-4baf-bd22-148440af50f4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.034269 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-51336655-0318-4bd1-8172-7bbfbdc0e390 req-31f5a7fc-20a4-4baf-bd22-148440af50f4 service nova] Creating event network-changed:ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 for instance 0d25ec92-5335-4444-83ba-2c92abef1832 on n-h1-850499-14 Oct 04 18:04:15.060900 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-51336655-0318-4bd1-8172-7bbfbdc0e390 req-31f5a7fc-20a4-4baf-bd22-148440af50f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095606 Oct 04 18:04:15.064850 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 416/797] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:15.090038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6f7daee2-e7a1-4c16-b828-e6c3143b93fb tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:15.091123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6f7daee2-e7a1-4c16-b828-e6c3143b93fb tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:15.117510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f7daee2-e7a1-4c16-b828-e6c3143b93fb tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:15.118851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f7daee2-e7a1-4c16-b828-e6c3143b93fb tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:15.119577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f7daee2-e7a1-4c16-b828-e6c3143b93fb tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.128069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f7daee2-e7a1-4c16-b828-e6c3143b93fb tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:15.128953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f7daee2-e7a1-4c16-b828-e6c3143b93fb tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:15.129647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f7daee2-e7a1-4c16-b828-e6c3143b93fb tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.698368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Updating instance_info_cache with network_info: [{"id": "ae5a66c4-f24e-47ae-bcad-abe0df6b2f41", "address": "fa:16:3e:07:25:7e", "network": {"id": "fc465217-3f76-4e72-b563-acf6a711ee75", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1977363954-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "283fc113c40342dc9387fb7c84e00b2c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapae5a66c4-f2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122331) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:04:15.726929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Releasing lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:04:15.728360 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-73f917c5-4753-4acd-934b-90d8b6af88d3 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action" status: 202 len: 0 microversion: 2.1 time: 6.183469 Oct 04 18:04:15.741463 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 382/798] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:09 2022] POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action => generated 0 bytes in 6197 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:04:15.764084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-feb863db-722c-4e40-a290-0594b3ebba5f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:15.768418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-feb863db-722c-4e40-a290-0594b3ebba5f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:15.785088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feb863db-722c-4e40-a290-0594b3ebba5f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:15.789384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feb863db-722c-4e40-a290-0594b3ebba5f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:15.790800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feb863db-722c-4e40-a290-0594b3ebba5f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.792597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feb863db-722c-4e40-a290-0594b3ebba5f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:15.798095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feb863db-722c-4e40-a290-0594b3ebba5f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:15.798816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feb863db-722c-4e40-a290-0594b3ebba5f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.105757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6f7daee2-e7a1-4c16-b828-e6c3143b93fb tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.111239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-feb863db-722c-4e40-a290-0594b3ebba5f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.121396 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6f7daee2-e7a1-4c16-b828-e6c3143b93fb tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1390 microversion: 2.1 time: 1.054957 Oct 04 18:04:16.122588 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 417/799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:15 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1390 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:16.137348 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-feb863db-722c-4e40-a290-0594b3ebba5f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1237 microversion: 2.1 time: 0.385921 Oct 04 18:04:16.137496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-73409865-00d2-4232-89b7-1226b0f30b63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.137496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-73409865-00d2-4232-89b7-1226b0f30b63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:16.141263 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 383/800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:15 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1237 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:16.146082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73409865-00d2-4232-89b7-1226b0f30b63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.146587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73409865-00d2-4232-89b7-1226b0f30b63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.147061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73409865-00d2-4232-89b7-1226b0f30b63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.152009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73409865-00d2-4232-89b7-1226b0f30b63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.152443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73409865-00d2-4232-89b7-1226b0f30b63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.162157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73409865-00d2-4232-89b7-1226b0f30b63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.171934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a8370aa-7022-43e3-b195-5a896b2eb2b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.172636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a8370aa-7022-43e3-b195-5a896b2eb2b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:16.185369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8370aa-7022-43e3-b195-5a896b2eb2b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.186226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8370aa-7022-43e3-b195-5a896b2eb2b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.187187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8370aa-7022-43e3-b195-5a896b2eb2b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.190186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8370aa-7022-43e3-b195-5a896b2eb2b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.192352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8370aa-7022-43e3-b195-5a896b2eb2b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.194101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8370aa-7022-43e3-b195-5a896b2eb2b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.295181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-73409865-00d2-4232-89b7-1226b0f30b63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.307460 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-73409865-00d2-4232-89b7-1226b0f30b63 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1270 microversion: 2.1 time: 0.181411 Oct 04 18:04:16.310006 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 418/801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:16 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1270 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:16.321552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9dfac231-00b4-42c2-93a4-311c70fc723d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Action: 'create', calling method: .version_select at 0x7fd4d1f51160>, body: {"pool": "051703dd-ddec-4a3f-9646-26fd6a546c44"} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:17.032317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9a8370aa-7022-43e3-b195-5a896b2eb2b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.048293 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a8370aa-7022-43e3-b195-5a896b2eb2b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1360 microversion: 2.1 time: 0.905805 Oct 04 18:04:17.048894 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 384/802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:16 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1360 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:17.083227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-490b3174-8771-4a68-b89c-5b7a550d0453 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.083912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-490b3174-8771-4a68-b89c-5b7a550d0453 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:17.105754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490b3174-8771-4a68-b89c-5b7a550d0453 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.106258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490b3174-8771-4a68-b89c-5b7a550d0453 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.106707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490b3174-8771-4a68-b89c-5b7a550d0453 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.115366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490b3174-8771-4a68-b89c-5b7a550d0453 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.117022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490b3174-8771-4a68-b89c-5b7a550d0453 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.119563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490b3174-8771-4a68-b89c-5b7a550d0453 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.866000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-490b3174-8771-4a68-b89c-5b7a550d0453 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.880005 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-490b3174-8771-4a68-b89c-5b7a550d0453 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1476 microversion: 2.1 time: 0.830032 Oct 04 18:04:17.880595 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 385/803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:17 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1476 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:17.895284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1a709c78-3606-40af-9a31-bdf015e5a728 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.913152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1a709c78-3606-40af-9a31-bdf015e5a728 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:17.920285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a709c78-3606-40af-9a31-bdf015e5a728 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.921572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a709c78-3606-40af-9a31-bdf015e5a728 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.922385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a709c78-3606-40af-9a31-bdf015e5a728 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.924092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a709c78-3606-40af-9a31-bdf015e5a728 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.925404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a709c78-3606-40af-9a31-bdf015e5a728 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.926137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a709c78-3606-40af-9a31-bdf015e5a728 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.742083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1a709c78-3606-40af-9a31-bdf015e5a728 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:18.762521 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1a709c78-3606-40af-9a31-bdf015e5a728 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1589 microversion: 2.1 time: 0.870948 Oct 04 18:04:18.774983 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 386/804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:17 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1589 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:18.786163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a33f10e-7c87-4475-b422-0bf07dfb26f1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.787849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a33f10e-7c87-4475-b422-0bf07dfb26f1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:18.804143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a33f10e-7c87-4475-b422-0bf07dfb26f1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.804654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a33f10e-7c87-4475-b422-0bf07dfb26f1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.805099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a33f10e-7c87-4475-b422-0bf07dfb26f1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.809106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a33f10e-7c87-4475-b422-0bf07dfb26f1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.810364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a33f10e-7c87-4475-b422-0bf07dfb26f1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.811591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a33f10e-7c87-4475-b422-0bf07dfb26f1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.989657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:19.073825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9a33f10e-7c87-4475-b422-0bf07dfb26f1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:19.084273 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a33f10e-7c87-4475-b422-0bf07dfb26f1 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1304 microversion: 2.1 time: 0.317820 Oct 04 18:04:19.098872 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 387/805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:18 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1304 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:19.475694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d57f651-5c67-448d-8756-764a046e7c69 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Action: 'create', calling method: .version_select at 0x7fd4d28aea60>, body: {"keypair": {"name": "tempest-keypair-1387470139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgg8/3rDjoiP3GdY2oPeCz5IJ5o0SJC7TOF6a4/GfmnYixK96CDm10cpcXoPEbmtX3pLnjPnvFy8eXj7xlz0upCnV/h2IMCT4K0UXhiPr81cI4rgj82zFXJtSBLqmUSSA=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:19.515473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-5d57f651-5c67-448d-8756-764a046e7c69 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Getting quotas for project ae47a898442347e294b846831590285f. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:19.527941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-5d57f651-5c67-448d-8756-764a046e7c69 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Getting quotas for user 46c8316f57dd4741af0df67f141f2205 and project ae47a898442347e294b846831590285f. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:19.587988 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d57f651-5c67-448d-8756-764a046e7c69 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.501082 Oct 04 18:04:19.597290 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 388/806] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:04:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:19.612123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e819487e-0359-401f-b7db-6a8bfa3ebb80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.613112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e819487e-0359-401f-b7db-6a8bfa3ebb80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:19.627637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e819487e-0359-401f-b7db-6a8bfa3ebb80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.628977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e819487e-0359-401f-b7db-6a8bfa3ebb80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.629594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e819487e-0359-401f-b7db-6a8bfa3ebb80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.632630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e819487e-0359-401f-b7db-6a8bfa3ebb80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.635647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e819487e-0359-401f-b7db-6a8bfa3ebb80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.636305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e819487e-0359-401f-b7db-6a8bfa3ebb80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.987442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e819487e-0359-401f-b7db-6a8bfa3ebb80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:20.002281 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e819487e-0359-401f-b7db-6a8bfa3ebb80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1276 microversion: 2.1 time: 0.403525 Oct 04 18:04:20.022738 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 389/807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:19 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1276 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:20.038006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4677fc15-05b5-43f3-ae9d-02339feed912 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.040245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4677fc15-05b5-43f3-ae9d-02339feed912 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:20.053784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4677fc15-05b5-43f3-ae9d-02339feed912 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.058243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4677fc15-05b5-43f3-ae9d-02339feed912 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.059183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4677fc15-05b5-43f3-ae9d-02339feed912 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.064242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4677fc15-05b5-43f3-ae9d-02339feed912 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.065171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4677fc15-05b5-43f3-ae9d-02339feed912 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.067594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4677fc15-05b5-43f3-ae9d-02339feed912 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.498287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4677fc15-05b5-43f3-ae9d-02339feed912 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:20.511372 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4677fc15-05b5-43f3-ae9d-02339feed912 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1360 microversion: 2.1 time: 0.486805 Oct 04 18:04:20.512177 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 390/808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:20 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1360 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:20.526234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-37858601-941e-48e4-932e-187948f864ad req-3fee4f30-a1a0-4111-a1ce-2e96b550f8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513fb23f-209f-4de1-add7-84c46117aace", "name": "network-vif-plugged", "status": "completed", "tag": "ae27d040-17cf-482a-b391-3a571eec78cd"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:20.554582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-37858601-941e-48e4-932e-187948f864ad req-3fee4f30-a1a0-4111-a1ce-2e96b550f8e5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.555114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-37858601-941e-48e4-932e-187948f864ad req-3fee4f30-a1a0-4111-a1ce-2e96b550f8e5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.555583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-37858601-941e-48e4-932e-187948f864ad req-3fee4f30-a1a0-4111-a1ce-2e96b550f8e5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.586796 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-37858601-941e-48e4-932e-187948f864ad req-3fee4f30-a1a0-4111-a1ce-2e96b550f8e5 service nova] Creating event network-vif-plugged:ae27d040-17cf-482a-b391-3a571eec78cd for instance 513fb23f-209f-4de1-add7-84c46117aace on n-h1-850499-14 Oct 04 18:04:20.605108 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-37858601-941e-48e4-932e-187948f864ad req-3fee4f30-a1a0-4111-a1ce-2e96b550f8e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088434 Oct 04 18:04:20.606161 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 391/809] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:20.615446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1b3a906f-0926-451b-9b7e-4e94d3dd5459 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.616307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1b3a906f-0926-451b-9b7e-4e94d3dd5459 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:20.653732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b3a906f-0926-451b-9b7e-4e94d3dd5459 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.654773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b3a906f-0926-451b-9b7e-4e94d3dd5459 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.655247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b3a906f-0926-451b-9b7e-4e94d3dd5459 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.655983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b3a906f-0926-451b-9b7e-4e94d3dd5459 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.656450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b3a906f-0926-451b-9b7e-4e94d3dd5459 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.656879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b3a906f-0926-451b-9b7e-4e94d3dd5459 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.451988 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1b3a906f-0926-451b-9b7e-4e94d3dd5459 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.844522 Oct 04 18:04:21.452985 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 392/810] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:04:20 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8/os-interface => generated 284 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:21.458261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-691b260c-88d3-4af4-97a4-d3057eb0193b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:21.459258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-691b260c-88d3-4af4-97a4-d3057eb0193b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:21.472099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691b260c-88d3-4af4-97a4-d3057eb0193b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.477138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691b260c-88d3-4af4-97a4-d3057eb0193b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.553407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691b260c-88d3-4af4-97a4-d3057eb0193b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.562843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691b260c-88d3-4af4-97a4-d3057eb0193b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.578291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691b260c-88d3-4af4-97a4-d3057eb0193b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.586709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691b260c-88d3-4af4-97a4-d3057eb0193b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.619827 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9dfac231-00b4-42c2-93a4-311c70fc723d tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.307564 Oct 04 18:04:21.629153 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 419/811] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:04:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:21.635155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-030d8287-aada-41bc-a97f-9efbb70bd687 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:21.635788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-030d8287-aada-41bc-a97f-9efbb70bd687 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:21.661791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-030d8287-aada-41bc-a97f-9efbb70bd687 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.662573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-030d8287-aada-41bc-a97f-9efbb70bd687 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.663361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-030d8287-aada-41bc-a97f-9efbb70bd687 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.664252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-030d8287-aada-41bc-a97f-9efbb70bd687 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.664872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-030d8287-aada-41bc-a97f-9efbb70bd687 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.665510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-030d8287-aada-41bc-a97f-9efbb70bd687 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.416944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-030d8287-aada-41bc-a97f-9efbb70bd687 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:22.432234 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-030d8287-aada-41bc-a97f-9efbb70bd687 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1304 microversion: 2.1 time: 0.796096 Oct 04 18:04:22.448179 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 420/812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:21 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1304 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:22.455749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-910081b2-697f-4d22-b5ae-153b920531b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:22.464758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-910081b2-697f-4d22-b5ae-153b920531b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:22.479356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=32 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:22.480291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:22.485201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-910081b2-697f-4d22-b5ae-153b920531b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.488837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-910081b2-697f-4d22-b5ae-153b920531b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.489624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-910081b2-697f-4d22-b5ae-153b920531b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.490509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-910081b2-697f-4d22-b5ae-153b920531b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.493273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-910081b2-697f-4d22-b5ae-153b920531b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.493918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-910081b2-697f-4d22-b5ae-153b920531b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.701574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-691b260c-88d3-4af4-97a4-d3057eb0193b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:22.712128 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-691b260c-88d3-4af4-97a4-d3057eb0193b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1476 microversion: 2.1 time: 1.257890 Oct 04 18:04:22.739679 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 393/813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:21 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1476 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:22.752502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-606de04f-6b47-4b31-b7bf-5780e5f13fbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:22.753115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-606de04f-6b47-4b31-b7bf-5780e5f13fbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:22.785595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606de04f-6b47-4b31-b7bf-5780e5f13fbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.786680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606de04f-6b47-4b31-b7bf-5780e5f13fbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.789665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606de04f-6b47-4b31-b7bf-5780e5f13fbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.790358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606de04f-6b47-4b31-b7bf-5780e5f13fbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.795327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606de04f-6b47-4b31-b7bf-5780e5f13fbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.796092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606de04f-6b47-4b31-b7bf-5780e5f13fbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.379750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-910081b2-697f-4d22-b5ae-153b920531b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.391313 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-910081b2-697f-4d22-b5ae-153b920531b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.941062 Oct 04 18:04:23.402711 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 421/814] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:22 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:23.423325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Action: 'action', calling method: .version_select at 0x7fd4d3ba5d30>, body: {"addFloatingIp": {"address": "172.25.4.224"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:23.426218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:23.465015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.465520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.467700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.472142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.474562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.475247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.662428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-606de04f-6b47-4b31-b7bf-5780e5f13fbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.672707 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-606de04f-6b47-4b31-b7bf-5780e5f13fbb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1360 microversion: 2.1 time: 0.931768 Oct 04 18:04:23.684285 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 394/815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:22 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1360 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:23.697604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:04:23.698011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquired lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:04:23.706020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ceedd49-be9b-42ef-9cd2-bb19de5b7f8b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:23.711969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ceedd49-be9b-42ef-9cd2-bb19de5b7f8b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:23.719371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ceedd49-be9b-42ef-9cd2-bb19de5b7f8b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.720139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ceedd49-be9b-42ef-9cd2-bb19de5b7f8b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.720743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ceedd49-be9b-42ef-9cd2-bb19de5b7f8b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.723221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ceedd49-be9b-42ef-9cd2-bb19de5b7f8b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.723931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ceedd49-be9b-42ef-9cd2-bb19de5b7f8b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.724518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ceedd49-be9b-42ef-9cd2-bb19de5b7f8b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.116212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ceedd49-be9b-42ef-9cd2-bb19de5b7f8b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.136035 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ceedd49-be9b-42ef-9cd2-bb19de5b7f8b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1304 microversion: 2.1 time: 0.440822 Oct 04 18:04:24.153210 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 395/816] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:23 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1304 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:24.177202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5935887c-24cb-4c9e-8d18-a922aac92e70 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.179754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5935887c-24cb-4c9e-8d18-a922aac92e70 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:24.199476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5935887c-24cb-4c9e-8d18-a922aac92e70 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.202753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5935887c-24cb-4c9e-8d18-a922aac92e70 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.204305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5935887c-24cb-4c9e-8d18-a922aac92e70 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.205577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5935887c-24cb-4c9e-8d18-a922aac92e70 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.209542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5935887c-24cb-4c9e-8d18-a922aac92e70 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.212190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5935887c-24cb-4c9e-8d18-a922aac92e70 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.800029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5935887c-24cb-4c9e-8d18-a922aac92e70 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.803658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:24.815634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.224 (8c2e6787-a0e5-4f2a-a850-6e8c4556b5dd) with port ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 051703dd-ddec-4a3f-9646-26fd6a546c44.", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:04:24.816109 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5935887c-24cb-4c9e-8d18-a922aac92e70 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1476 microversion: 2.1 time: 0.657399 Oct 04 18:04:24.816224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Releasing lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:04:24.817397 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.224 (8c2e6787-a0e5-4f2a-a850-6e8c4556b5dd) with port ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 051703dd-ddec-4a3f-9646-26fd6a546c44. Oct 04 18:04:24.817397 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-460cde0f-345a-4a4d-95ec-d8bc6acefb1f'] Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Request method failure captured: Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action HTTP/1.1 Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 46 Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHV4TMmIITnFy4jF3k0U34yPsN9Hk7dg0y1ywL_8YYgOlX9JOxArxMCnkN-mTeWd_mBAB2R2X2YBLQO3lOQ4NB-gZZTJi44Jjtk7HNi-WcJfVo6c_5Z2PyT5DTVSdECOn6l-Ufyk59XhISlF15me4fgZAvt_YHtKw9nX5GpnJ2_8rHA Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 283fc113c40342dc9387fb7c84e00b2c Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:04:24.832404 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/283fc113c40342dc9387fb7c84e00b2c"}]}] Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 283fc113c40342dc9387fb7c84e00b2c Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 93c7e45ffec94520a28696fe6f9016ce Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: {"addFloatingIp": {"address": "172.25.4.224"}} Oct 04 18:04:24.834201 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot associate floating IP 172.25.4.224 (8c2e6787-a0e5-4f2a-a850-6e8c4556b5dd) with port ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 051703dd-ddec-4a3f-9646-26fd6a546c44. Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-460cde0f-345a-4a4d-95ec-d8bc6acefb1f'] Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '0d25ec92-5335-4444-83ba-2c92abef1832', 'body': {'addFloatingIp': {'address': '172.25.4.224'}}} Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.835143 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:04:24.836406 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.224 (8c2e6787-a0e5-4f2a-a850-6e8c4556b5dd) with port ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 051703dd-ddec-4a3f-9646-26fd6a546c44. Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-460cde0f-345a-4a4d-95ec-d8bc6acefb1f'] Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.224 (8c2e6787-a0e5-4f2a-a850-6e8c4556b5dd) with port ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 051703dd-ddec-4a3f-9646-26fd6a546c44. Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-460cde0f-345a-4a4d-95ec-d8bc6acefb1f'] Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.837550 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.224 (8c2e6787-a0e5-4f2a-a850-6e8c4556b5dd) with port ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 051703dd-ddec-4a3f-9646-26fd6a546c44. Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-460cde0f-345a-4a4d-95ec-d8bc6acefb1f'] Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.838733 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.840267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.840267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.840267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.840267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.840267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:24.840267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:24.840267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.224 (8c2e6787-a0e5-4f2a-a850-6e8c4556b5dd) with port ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 051703dd-ddec-4a3f-9646-26fd6a546c44. Oct 04 18:04:24.840267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-460cde0f-345a-4a4d-95ec-d8bc6acefb1f'] Oct 04 18:04:24.840267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.840933 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 396/817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1476 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:24.842019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Returning 400 to user: Cannot associate floating IP 172.25.4.224 (8c2e6787-a0e5-4f2a-a850-6e8c4556b5dd) with port ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 051703dd-ddec-4a3f-9646-26fd6a546c44. Oct 04 18:04:24.842019 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-460cde0f-345a-4a4d-95ec-d8bc6acefb1f'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.842414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-0246b78a-1328-4c86-8a54-8ce2be0c1f07 req-9521e463-74a9-4280-a407-06e2606a69d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b911ede1-8b72-4521-a647-8ea9dd3232ed", "tag": "52faaf09-6573-4cc6-8bc9-5bdc801746cc"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:24.843348 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a5056365-6009-4d11-81ec-f1ef59dc9238 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action" status: 400 len: 381 microversion: 2.1 time: 1.439446 Oct 04 18:04:24.847842 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 422/818] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:23 2022] POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action => generated 381 bytes in 1444 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:24.852961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1587a81e-3379-4908-8ddd-548851c4bfbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.853786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1587a81e-3379-4908-8ddd-548851c4bfbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:24.856017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:24.863272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1587a81e-3379-4908-8ddd-548851c4bfbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.864971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1587a81e-3379-4908-8ddd-548851c4bfbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.865909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1587a81e-3379-4908-8ddd-548851c4bfbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.867478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1587a81e-3379-4908-8ddd-548851c4bfbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.868817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1587a81e-3379-4908-8ddd-548851c4bfbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.870170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1587a81e-3379-4908-8ddd-548851c4bfbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.877542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0246b78a-1328-4c86-8a54-8ce2be0c1f07 req-9521e463-74a9-4280-a407-06e2606a69d6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.878244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0246b78a-1328-4c86-8a54-8ce2be0c1f07 req-9521e463-74a9-4280-a407-06e2606a69d6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.878244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0246b78a-1328-4c86-8a54-8ce2be0c1f07 req-9521e463-74a9-4280-a407-06e2606a69d6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.908636 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-0246b78a-1328-4c86-8a54-8ce2be0c1f07 req-9521e463-74a9-4280-a407-06e2606a69d6 service nova] Creating event network-changed:52faaf09-6573-4cc6-8bc9-5bdc801746cc for instance b911ede1-8b72-4521-a647-8ea9dd3232ed on n-h2-850499-14 Oct 04 18:04:24.918923 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-0246b78a-1328-4c86-8a54-8ce2be0c1f07 req-9521e463-74a9-4280-a407-06e2606a69d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083605 Oct 04 18:04:24.923746 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 397/819] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:24.940732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e3e4368d-0918-42df-97af-cb18b040b020 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.941929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e3e4368d-0918-42df-97af-cb18b040b020 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:24.955490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e4368d-0918-42df-97af-cb18b040b020 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.956207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e4368d-0918-42df-97af-cb18b040b020 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.956656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e4368d-0918-42df-97af-cb18b040b020 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.957384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e4368d-0918-42df-97af-cb18b040b020 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.957979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e4368d-0918-42df-97af-cb18b040b020 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.958417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e4368d-0918-42df-97af-cb18b040b020 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.417355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1587a81e-3379-4908-8ddd-548851c4bfbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:25.429540 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1587a81e-3379-4908-8ddd-548851c4bfbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.580355 Oct 04 18:04:25.455224 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 423/820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:25.465834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e3e4368d-0918-42df-97af-cb18b040b020 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:25.467749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-992fc673-0eff-4d14-a09b-e9230f6a9824 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '.version_select at 0x7fd4d1e40280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:25.483716 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e3e4368d-0918-42df-97af-cb18b040b020 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1544 microversion: 2.1 time: 0.558628 Oct 04 18:04:25.517133 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 398/821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1544 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:25.526268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-81a0436d-5d50-45dc-9a80-e69602a027b2 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:25.527177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-81a0436d-5d50-45dc-9a80-e69602a027b2 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:25.538720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81a0436d-5d50-45dc-9a80-e69602a027b2 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.539464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81a0436d-5d50-45dc-9a80-e69602a027b2 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.540058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81a0436d-5d50-45dc-9a80-e69602a027b2 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.541640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81a0436d-5d50-45dc-9a80-e69602a027b2 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.542268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81a0436d-5d50-45dc-9a80-e69602a027b2 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.542855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81a0436d-5d50-45dc-9a80-e69602a027b2 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.304588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-81a0436d-5d50-45dc-9a80-e69602a027b2 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:26.340572 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-81a0436d-5d50-45dc-9a80-e69602a027b2 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1304 microversion: 2.1 time: 0.822149 Oct 04 18:04:26.347685 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 399/822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:25 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1304 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:26.354870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a89261df-848b-443e-8418-1c2be4550608 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:26.355773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a89261df-848b-443e-8418-1c2be4550608 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:26.387271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89261df-848b-443e-8418-1c2be4550608 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.387767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89261df-848b-443e-8418-1c2be4550608 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.388746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89261df-848b-443e-8418-1c2be4550608 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.389487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89261df-848b-443e-8418-1c2be4550608 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.389951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89261df-848b-443e-8418-1c2be4550608 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.390381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89261df-848b-443e-8418-1c2be4550608 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.679543 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a89261df-848b-443e-8418-1c2be4550608 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.330325 Oct 04 18:04:26.680380 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 400/823] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:04:26 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-interface => generated 285 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:26.685840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b70265ec-3738-4d9e-b39e-a78dc22fabcd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:26.686709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b70265ec-3738-4d9e-b39e-a78dc22fabcd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:26.706513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b70265ec-3738-4d9e-b39e-a78dc22fabcd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.707049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b70265ec-3738-4d9e-b39e-a78dc22fabcd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.707499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b70265ec-3738-4d9e-b39e-a78dc22fabcd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.708255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b70265ec-3738-4d9e-b39e-a78dc22fabcd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.708725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b70265ec-3738-4d9e-b39e-a78dc22fabcd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.709166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b70265ec-3738-4d9e-b39e-a78dc22fabcd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.244084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b70265ec-3738-4d9e-b39e-a78dc22fabcd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:27.262477 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b70265ec-3738-4d9e-b39e-a78dc22fabcd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1476 microversion: 2.1 time: 0.580673 Oct 04 18:04:27.263979 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 401/824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:26 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1476 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:27.281169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c8c8afd0-e1e8-48ca-b812-ad75b3bc1563 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.282096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c8c8afd0-e1e8-48ca-b812-ad75b3bc1563 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:27.288622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8c8afd0-e1e8-48ca-b812-ad75b3bc1563 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.289424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8c8afd0-e1e8-48ca-b812-ad75b3bc1563 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.290039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8c8afd0-e1e8-48ca-b812-ad75b3bc1563 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.290936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8c8afd0-e1e8-48ca-b812-ad75b3bc1563 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.291586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8c8afd0-e1e8-48ca-b812-ad75b3bc1563 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.292731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8c8afd0-e1e8-48ca-b812-ad75b3bc1563 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.768942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c8c8afd0-e1e8-48ca-b812-ad75b3bc1563 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:27.783214 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c8c8afd0-e1e8-48ca-b812-ad75b3bc1563 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.502626 Oct 04 18:04:27.793103 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 402/825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:27 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:27.808548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2a7540da-5024-49b7-9445-4223e6bce7fd req-bd77f6b7-9172-4489-9fc4-40c82dd28914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587dc93d-6601-457a-b25d-8b88eb79ab15", "tag": "9cac6fd6-3881-4d94-b5ec-b76381ebf1d6"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:27.852773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2a7540da-5024-49b7-9445-4223e6bce7fd req-bd77f6b7-9172-4489-9fc4-40c82dd28914 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.853255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2a7540da-5024-49b7-9445-4223e6bce7fd req-bd77f6b7-9172-4489-9fc4-40c82dd28914 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.853693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2a7540da-5024-49b7-9445-4223e6bce7fd req-bd77f6b7-9172-4489-9fc4-40c82dd28914 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.879071 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2a7540da-5024-49b7-9445-4223e6bce7fd req-bd77f6b7-9172-4489-9fc4-40c82dd28914 service nova] Creating event network-changed:9cac6fd6-3881-4d94-b5ec-b76381ebf1d6 for instance 587dc93d-6601-457a-b25d-8b88eb79ab15 on n-h2-850499-14 Oct 04 18:04:27.892310 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2a7540da-5024-49b7-9445-4223e6bce7fd req-bd77f6b7-9172-4489-9fc4-40c82dd28914 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093153 Oct 04 18:04:27.892632 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 403/826] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:27.918322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-109cc94a-5c25-4e16-8ce2-c69cff57fe0f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.919138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-109cc94a-5c25-4e16-8ce2-c69cff57fe0f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:27.938797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-109cc94a-5c25-4e16-8ce2-c69cff57fe0f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.939882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-109cc94a-5c25-4e16-8ce2-c69cff57fe0f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.941296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-109cc94a-5c25-4e16-8ce2-c69cff57fe0f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.945376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-109cc94a-5c25-4e16-8ce2-c69cff57fe0f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.947163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-109cc94a-5c25-4e16-8ce2-c69cff57fe0f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.947856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-109cc94a-5c25-4e16-8ce2-c69cff57fe0f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.644633 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-992fc673-0eff-4d14-a09b-e9230f6a9824 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/8c2e6787-a0e5-4f2a-a850-6e8c4556b5dd" status: 202 len: 0 microversion: 2.1 time: 3.187956 Oct 04 18:04:28.649291 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 424/827] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:04:25 2022] DELETE /compute/v2.1/os-floating-ips/8c2e6787-a0e5-4f2a-a850-6e8c4556b5dd => generated 0 bytes in 3193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:28.655915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-41a35963-7c62-43f9-b4f7-e01374b1131c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.656946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-41a35963-7c62-43f9-b4f7-e01374b1131c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:28.676636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41a35963-7c62-43f9-b4f7-e01374b1131c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.677134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41a35963-7c62-43f9-b4f7-e01374b1131c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.677581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41a35963-7c62-43f9-b4f7-e01374b1131c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.678316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41a35963-7c62-43f9-b4f7-e01374b1131c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.678774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41a35963-7c62-43f9-b4f7-e01374b1131c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.679229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41a35963-7c62-43f9-b4f7-e01374b1131c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.801562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-109cc94a-5c25-4e16-8ce2-c69cff57fe0f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:28.822079 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-109cc94a-5c25-4e16-8ce2-c69cff57fe0f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 0.925120 Oct 04 18:04:28.831298 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 404/828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:27 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:28.836007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-32ac4dca-56d9-4986-98c8-c112bff5020b req-f9eb9dab-40fb-43c8-a8c8-6ac6f8d07350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cae794e-563d-417b-ba78-9c6982b5b2e8", "tag": "e0a54cf7-155d-4176-bcef-b24b91c382ab"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:28.851803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-32ac4dca-56d9-4986-98c8-c112bff5020b req-f9eb9dab-40fb-43c8-a8c8-6ac6f8d07350 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.852884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-32ac4dca-56d9-4986-98c8-c112bff5020b req-f9eb9dab-40fb-43c8-a8c8-6ac6f8d07350 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.853328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-32ac4dca-56d9-4986-98c8-c112bff5020b req-f9eb9dab-40fb-43c8-a8c8-6ac6f8d07350 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.866554 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-32ac4dca-56d9-4986-98c8-c112bff5020b req-f9eb9dab-40fb-43c8-a8c8-6ac6f8d07350 service nova] Creating event network-changed:e0a54cf7-155d-4176-bcef-b24b91c382ab for instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 on n-h1-850499-14 Oct 04 18:04:28.879038 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-32ac4dca-56d9-4986-98c8-c112bff5020b req-f9eb9dab-40fb-43c8-a8c8-6ac6f8d07350 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046293 Oct 04 18:04:28.880217 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 405/829] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:28.886296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1030816265", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "7b189823-babe-4aab-95c8-7413e2c1cca2"}], "security_groups": [{"name": "tempest-securitygroup--1562788132"}], "key_name": "tempest-keypair-1387470139", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:29.051921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-41a35963-7c62-43f9-b4f7-e01374b1131c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:29.075895 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-41a35963-7c62-43f9-b4f7-e01374b1131c tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1589 microversion: 2.1 time: 0.425075 Oct 04 18:04:29.077738 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 425/830] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1589 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:29.093399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] validate_networks() for [('7b189823-babe-4aab-95c8-7413e2c1cca2', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:29.095879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e4264581-bbac-45b4-995f-3e67852d2e87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:29.096930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e4264581-bbac-45b4-995f-3e67852d2e87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:29.111623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4264581-bbac-45b4-995f-3e67852d2e87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.112329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4264581-bbac-45b4-995f-3e67852d2e87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.113992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4264581-bbac-45b4-995f-3e67852d2e87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.118071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4264581-bbac-45b4-995f-3e67852d2e87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.120318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4264581-bbac-45b4-995f-3e67852d2e87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.121857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4264581-bbac-45b4-995f-3e67852d2e87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.547614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:29.572298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e4264581-bbac-45b4-995f-3e67852d2e87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:29.585369 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e4264581-bbac-45b4-995f-3e67852d2e87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1476 microversion: 2.1 time: 0.504013 Oct 04 18:04:29.616448 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 426/831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:29 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1476 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:29.631755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Action: 'action', calling method: .version_select at 0x7fd4d3ba5ca0>, body: {"removeFloatingIp": {"address": "172.25.4.110"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:29.874938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:29.884509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.885019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.885461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.886182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.887536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.888112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.958682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:29.959340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:29.960751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:29.961402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:29.961828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:29.978556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.979376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.980379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.981307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.982154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.982746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.014681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Getting quotas for project ae47a898442347e294b846831590285f. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:30.022866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Getting quotas for user 46c8316f57dd4741af0df67f141f2205 and project ae47a898442347e294b846831590285f. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:30.042094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:30.045407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:30.109227 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-095e4bb7-e50d-4e19-9479-3c1848f9feec tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.227424 Oct 04 18:04:30.110520 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 406/832] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:30.116967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6efc66c6-85eb-4f5c-801c-d3a849cfbf1c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:30.117810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6efc66c6-85eb-4f5c-801c-d3a849cfbf1c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:30.127845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6efc66c6-85eb-4f5c-801c-d3a849cfbf1c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.128685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6efc66c6-85eb-4f5c-801c-d3a849cfbf1c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.129324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6efc66c6-85eb-4f5c-801c-d3a849cfbf1c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.130206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6efc66c6-85eb-4f5c-801c-d3a849cfbf1c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.130818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6efc66c6-85eb-4f5c-801c-d3a849cfbf1c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.131531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6efc66c6-85eb-4f5c-801c-d3a849cfbf1c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.408966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:04:30.409378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquired lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:04:30.777830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6efc66c6-85eb-4f5c-801c-d3a849cfbf1c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:30.792841 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6efc66c6-85eb-4f5c-801c-d3a849cfbf1c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.680845 Oct 04 18:04:30.793485 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 407/833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:30 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:30.815331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a0d31080-8db1-4118-a904-39d7062f44b0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:30.816988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a0d31080-8db1-4118-a904-39d7062f44b0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:30.823871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d31080-8db1-4118-a904-39d7062f44b0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.824934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d31080-8db1-4118-a904-39d7062f44b0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.826196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d31080-8db1-4118-a904-39d7062f44b0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.827260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d31080-8db1-4118-a904-39d7062f44b0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.828041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d31080-8db1-4118-a904-39d7062f44b0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.828857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d31080-8db1-4118-a904-39d7062f44b0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.197026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a0d31080-8db1-4118-a904-39d7062f44b0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:31.207860 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a0d31080-8db1-4118-a904-39d7062f44b0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 0.399332 Oct 04 18:04:31.222288 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 408/834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:30 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:31.230379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e06b3e9b-a5c8-4532-b8ed-d869a78d28d4 req-5cc77ad6-eee0-4c33-9845-e8685310010c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd85fc2b-0943-4616-8b69-f8e5825e400a", "tag": "fc1d34ff-022f-4682-b2ba-b4f782843867"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:31.248043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e06b3e9b-a5c8-4532-b8ed-d869a78d28d4 req-5cc77ad6-eee0-4c33-9845-e8685310010c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.248907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e06b3e9b-a5c8-4532-b8ed-d869a78d28d4 req-5cc77ad6-eee0-4c33-9845-e8685310010c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.249964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e06b3e9b-a5c8-4532-b8ed-d869a78d28d4 req-5cc77ad6-eee0-4c33-9845-e8685310010c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.275756 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e06b3e9b-a5c8-4532-b8ed-d869a78d28d4 req-5cc77ad6-eee0-4c33-9845-e8685310010c service nova] Creating event network-changed:fc1d34ff-022f-4682-b2ba-b4f782843867 for instance cd85fc2b-0943-4616-8b69-f8e5825e400a on n-h1-850499-14 Oct 04 18:04:31.282718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e06b3e9b-a5c8-4532-b8ed-d869a78d28d4 req-5cc77ad6-eee0-4c33-9845-e8685310010c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057948 Oct 04 18:04:31.284284 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 409/835] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:31.295364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4092aea4-0aac-48c4-b600-7f68c3696141 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:31.297496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4092aea4-0aac-48c4-b600-7f68c3696141 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:31.307542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4092aea4-0aac-48c4-b600-7f68c3696141 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.308929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4092aea4-0aac-48c4-b600-7f68c3696141 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.310437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4092aea4-0aac-48c4-b600-7f68c3696141 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.312794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4092aea4-0aac-48c4-b600-7f68c3696141 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.314200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4092aea4-0aac-48c4-b600-7f68c3696141 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.315397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4092aea4-0aac-48c4-b600-7f68c3696141 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.413191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4092aea4-0aac-48c4-b600-7f68c3696141 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:31.427042 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4092aea4-0aac-48c4-b600-7f68c3696141 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1246 microversion: 2.1 time: 0.140466 Oct 04 18:04:31.427907 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 410/836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:31 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1246 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:31.443097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a1da1c24-42af-404c-a9b8-6000b89df9aa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:31.443586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a1da1c24-42af-404c-a9b8-6000b89df9aa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:31.449891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1da1c24-42af-404c-a9b8-6000b89df9aa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.450815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1da1c24-42af-404c-a9b8-6000b89df9aa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.451451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1da1c24-42af-404c-a9b8-6000b89df9aa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.452370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1da1c24-42af-404c-a9b8-6000b89df9aa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.452993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1da1c24-42af-404c-a9b8-6000b89df9aa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.453791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1da1c24-42af-404c-a9b8-6000b89df9aa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.787664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a1da1c24-42af-404c-a9b8-6000b89df9aa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:31.798348 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a1da1c24-42af-404c-a9b8-6000b89df9aa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1476 microversion: 2.1 time: 0.369483 Oct 04 18:04:31.804114 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 411/837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:31 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1476 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:31.812437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c5cb90de-5dca-4831-af23-b57bf62d355b req-9a1338f9-1606-45c0-b62a-3e2477d61d0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513fb23f-209f-4de1-add7-84c46117aace", "tag": "ae27d040-17cf-482a-b391-3a571eec78cd"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:31.827808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c5cb90de-5dca-4831-af23-b57bf62d355b req-9a1338f9-1606-45c0-b62a-3e2477d61d0d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.829196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c5cb90de-5dca-4831-af23-b57bf62d355b req-9a1338f9-1606-45c0-b62a-3e2477d61d0d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.829733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c5cb90de-5dca-4831-af23-b57bf62d355b req-9a1338f9-1606-45c0-b62a-3e2477d61d0d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.848966 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c5cb90de-5dca-4831-af23-b57bf62d355b req-9a1338f9-1606-45c0-b62a-3e2477d61d0d service nova] Creating event network-changed:ae27d040-17cf-482a-b391-3a571eec78cd for instance 513fb23f-209f-4de1-add7-84c46117aace on n-h1-850499-14 Oct 04 18:04:31.854948 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c5cb90de-5dca-4831-af23-b57bf62d355b req-9a1338f9-1606-45c0-b62a-3e2477d61d0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048459 Oct 04 18:04:31.856069 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 412/838] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:31.862177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c228fa7-8a31-4a1c-971d-8d111ac91def tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:31.863976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4c228fa7-8a31-4a1c-971d-8d111ac91def tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:31.870434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c228fa7-8a31-4a1c-971d-8d111ac91def tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.871127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c228fa7-8a31-4a1c-971d-8d111ac91def tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.871679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c228fa7-8a31-4a1c-971d-8d111ac91def tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.872625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c228fa7-8a31-4a1c-971d-8d111ac91def tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.873198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c228fa7-8a31-4a1c-971d-8d111ac91def tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.873929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c228fa7-8a31-4a1c-971d-8d111ac91def tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.069188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Building network info cache for instance {{(pid=122332) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:04:32.474552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4c228fa7-8a31-4a1c-971d-8d111ac91def tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:32.484578 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c228fa7-8a31-4a1c-971d-8d111ac91def tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.626559 Oct 04 18:04:32.485534 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 413/839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:31 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:32.491010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0087ca98-3640-4068-891e-1034cad5aab9 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:32.491957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0087ca98-3640-4068-891e-1034cad5aab9 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:32.523857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0087ca98-3640-4068-891e-1034cad5aab9 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.525301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0087ca98-3640-4068-891e-1034cad5aab9 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.526192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0087ca98-3640-4068-891e-1034cad5aab9 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.529381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0087ca98-3640-4068-891e-1034cad5aab9 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.531481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0087ca98-3640-4068-891e-1034cad5aab9 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.534433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0087ca98-3640-4068-891e-1034cad5aab9 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.502362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0087ca98-3640-4068-891e-1034cad5aab9 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:33.514918 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0087ca98-3640-4068-891e-1034cad5aab9 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 1.027611 Oct 04 18:04:33.529064 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 414/840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:32 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:33.542921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a0ed0ef6-e392-43e1-9803-bbbc58ce5f50 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:33.544968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a0ed0ef6-e392-43e1-9803-bbbc58ce5f50 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:33.557903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0ed0ef6-e392-43e1-9803-bbbc58ce5f50 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.558747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0ed0ef6-e392-43e1-9803-bbbc58ce5f50 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.560284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0ed0ef6-e392-43e1-9803-bbbc58ce5f50 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.566357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0ed0ef6-e392-43e1-9803-bbbc58ce5f50 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.567273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0ed0ef6-e392-43e1-9803-bbbc58ce5f50 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.567934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0ed0ef6-e392-43e1-9803-bbbc58ce5f50 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.713611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a0ed0ef6-e392-43e1-9803-bbbc58ce5f50 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:33.726412 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a0ed0ef6-e392-43e1-9803-bbbc58ce5f50 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1294 microversion: 2.1 time: 0.195903 Oct 04 18:04:33.743892 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 415/841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:33 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1294 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:33.743892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6385ff43-7e55-4773-a785-7cdf3dcbceb5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:33.743892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6385ff43-7e55-4773-a785-7cdf3dcbceb5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:33.756986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6385ff43-7e55-4773-a785-7cdf3dcbceb5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.757701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6385ff43-7e55-4773-a785-7cdf3dcbceb5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.761053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6385ff43-7e55-4773-a785-7cdf3dcbceb5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.762029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6385ff43-7e55-4773-a785-7cdf3dcbceb5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.763175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6385ff43-7e55-4773-a785-7cdf3dcbceb5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.765438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6385ff43-7e55-4773-a785-7cdf3dcbceb5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.411190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6385ff43-7e55-4773-a785-7cdf3dcbceb5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:34.424398 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6385ff43-7e55-4773-a785-7cdf3dcbceb5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1475 microversion: 2.1 time: 0.687505 Oct 04 18:04:34.432116 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 416/842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:33 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1475 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:34.452031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-410f3628-d4d8-48d6-a176-90617752de02 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:34.457442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-410f3628-d4d8-48d6-a176-90617752de02 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:34.464516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-410f3628-d4d8-48d6-a176-90617752de02 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.465305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-410f3628-d4d8-48d6-a176-90617752de02 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.465778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-410f3628-d4d8-48d6-a176-90617752de02 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.466522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-410f3628-d4d8-48d6-a176-90617752de02 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.467196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-410f3628-d4d8-48d6-a176-90617752de02 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.467766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-410f3628-d4d8-48d6-a176-90617752de02 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.757629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-410f3628-d4d8-48d6-a176-90617752de02 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:34.761520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:34.768151 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-410f3628-d4d8-48d6-a176-90617752de02 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.326231 Oct 04 18:04:34.768735 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 417/843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:34 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:34.784556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7087a001-8cc8-46df-8fc7-60647402d677 req-ca1f2490-9f7a-4cb6-b3d7-839cfd5cccfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd85fc2b-0943-4616-8b69-f8e5825e400a", "name": "network-vif-plugged", "status": "completed", "tag": "fc1d34ff-022f-4682-b2ba-b4f782843867"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:34.801871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:34.818763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7087a001-8cc8-46df-8fc7-60647402d677 req-ca1f2490-9f7a-4cb6-b3d7-839cfd5cccfc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.819314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7087a001-8cc8-46df-8fc7-60647402d677 req-ca1f2490-9f7a-4cb6-b3d7-839cfd5cccfc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.819757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7087a001-8cc8-46df-8fc7-60647402d677 req-ca1f2490-9f7a-4cb6-b3d7-839cfd5cccfc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.851058 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7087a001-8cc8-46df-8fc7-60647402d677 req-ca1f2490-9f7a-4cb6-b3d7-839cfd5cccfc service nova] Creating event network-vif-plugged:fc1d34ff-022f-4682-b2ba-b4f782843867 for instance cd85fc2b-0943-4616-8b69-f8e5825e400a on n-h1-850499-14 Oct 04 18:04:34.855600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Updating instance_info_cache with network_info: [{"id": "ae5a66c4-f24e-47ae-bcad-abe0df6b2f41", "address": "fa:16:3e:07:25:7e", "network": {"id": "fc465217-3f76-4e72-b563-acf6a711ee75", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1977363954-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "283fc113c40342dc9387fb7c84e00b2c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapae5a66c4-f2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122332) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:04:34.857392 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7087a001-8cc8-46df-8fc7-60647402d677 req-ca1f2490-9f7a-4cb6-b3d7-839cfd5cccfc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080007 Oct 04 18:04:34.858021 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 418/844] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:34.863438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3977b256-1836-44a5-a3af-ae37ae939c69 req-937148a6-9cb7-4b24-9f72-f9f07ae97015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d25ec92-5335-4444-83ba-2c92abef1832", "tag": "ae5a66c4-f24e-47ae-bcad-abe0df6b2f41"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:34.876080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3977b256-1836-44a5-a3af-ae37ae939c69 req-937148a6-9cb7-4b24-9f72-f9f07ae97015 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.876325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Releasing lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:04:34.876740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3977b256-1836-44a5-a3af-ae37ae939c69 req-937148a6-9cb7-4b24-9f72-f9f07ae97015 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.877199 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d8cccc7b-164b-47d2-97a2-2fdc32601f51 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action" status: 202 len: 0 microversion: 2.1 time: 5.258820 Oct 04 18:04:34.877738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3977b256-1836-44a5-a3af-ae37ae939c69 req-937148a6-9cb7-4b24-9f72-f9f07ae97015 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.886833 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 427/845] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:29 2022] POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action => generated 0 bytes in 5269 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:04:34.892344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9889f61d-b7a6-4311-bf3b-87c187b7af02 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:34.897326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9889f61d-b7a6-4311-bf3b-87c187b7af02 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:34.897611 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3977b256-1836-44a5-a3af-ae37ae939c69 req-937148a6-9cb7-4b24-9f72-f9f07ae97015 service nova] Creating event network-changed:ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 for instance 0d25ec92-5335-4444-83ba-2c92abef1832 on n-h1-850499-14 Oct 04 18:04:34.907236 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3977b256-1836-44a5-a3af-ae37ae939c69 req-937148a6-9cb7-4b24-9f72-f9f07ae97015 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047023 Oct 04 18:04:34.913505 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 419/846] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:34.920879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e15543fb-14aa-4eaa-b074-b0cc6c04e787 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:34.921596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e15543fb-14aa-4eaa-b074-b0cc6c04e787 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:34.921822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9889f61d-b7a6-4311-bf3b-87c187b7af02 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.922401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9889f61d-b7a6-4311-bf3b-87c187b7af02 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.922848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9889f61d-b7a6-4311-bf3b-87c187b7af02 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.923634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9889f61d-b7a6-4311-bf3b-87c187b7af02 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.924090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9889f61d-b7a6-4311-bf3b-87c187b7af02 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.924515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9889f61d-b7a6-4311-bf3b-87c187b7af02 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.929856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e15543fb-14aa-4eaa-b074-b0cc6c04e787 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.930525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e15543fb-14aa-4eaa-b074-b0cc6c04e787 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.931000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e15543fb-14aa-4eaa-b074-b0cc6c04e787 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.931857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e15543fb-14aa-4eaa-b074-b0cc6c04e787 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.932329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e15543fb-14aa-4eaa-b074-b0cc6c04e787 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.933584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e15543fb-14aa-4eaa-b074-b0cc6c04e787 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.079477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e15543fb-14aa-4eaa-b074-b0cc6c04e787 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:35.087722 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e15543fb-14aa-4eaa-b074-b0cc6c04e787 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1300 microversion: 2.1 time: 0.172765 Oct 04 18:04:35.088824 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 420/847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:34 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:35.094620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b9c1439b-b612-4678-b759-b2c4485aa7da tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '.version_select at 0x7fd4d214c790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:35.620842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9889f61d-b7a6-4311-bf3b-87c187b7af02 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:35.638886 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9889f61d-b7a6-4311-bf3b-87c187b7af02 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 0.750522 Oct 04 18:04:35.661085 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 428/848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:34 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:35.672573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a68da349-1169-46a0-beaa-3f25c06e7582 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:35.673393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a68da349-1169-46a0-beaa-3f25c06e7582 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:35.699970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a68da349-1169-46a0-beaa-3f25c06e7582 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.700541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a68da349-1169-46a0-beaa-3f25c06e7582 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.700993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a68da349-1169-46a0-beaa-3f25c06e7582 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.701770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a68da349-1169-46a0-beaa-3f25c06e7582 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.702257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a68da349-1169-46a0-beaa-3f25c06e7582 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.702658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a68da349-1169-46a0-beaa-3f25c06e7582 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.135244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a68da349-1169-46a0-beaa-3f25c06e7582 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.143753 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a68da349-1169-46a0-beaa-3f25c06e7582 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1475 microversion: 2.1 time: 0.481345 Oct 04 18:04:36.155428 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 429/849] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:35 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1475 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:36.177287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d7a30bb-eeaf-4ac1-9e3d-41092fa63f5f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.177914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4d7a30bb-eeaf-4ac1-9e3d-41092fa63f5f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.198848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d7a30bb-eeaf-4ac1-9e3d-41092fa63f5f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.214409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d7a30bb-eeaf-4ac1-9e3d-41092fa63f5f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.215035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d7a30bb-eeaf-4ac1-9e3d-41092fa63f5f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.215875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d7a30bb-eeaf-4ac1-9e3d-41092fa63f5f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.216345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d7a30bb-eeaf-4ac1-9e3d-41092fa63f5f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.216769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d7a30bb-eeaf-4ac1-9e3d-41092fa63f5f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.634745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4d7a30bb-eeaf-4ac1-9e3d-41092fa63f5f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.647324 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4d7a30bb-eeaf-4ac1-9e3d-41092fa63f5f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.490638 Oct 04 18:04:36.648992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 430/850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:36.663970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dbb4b2be-f9dd-4ad8-86ad-aa508f2ccc8b tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.665256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dbb4b2be-f9dd-4ad8-86ad-aa508f2ccc8b tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.683553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbb4b2be-f9dd-4ad8-86ad-aa508f2ccc8b tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.685017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbb4b2be-f9dd-4ad8-86ad-aa508f2ccc8b tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.685728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbb4b2be-f9dd-4ad8-86ad-aa508f2ccc8b tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.686796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbb4b2be-f9dd-4ad8-86ad-aa508f2ccc8b tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.687577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbb4b2be-f9dd-4ad8-86ad-aa508f2ccc8b tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.688243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbb4b2be-f9dd-4ad8-86ad-aa508f2ccc8b tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.693680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:36.938042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dbb4b2be-f9dd-4ad8-86ad-aa508f2ccc8b tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.947934 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dbb4b2be-f9dd-4ad8-86ad-aa508f2ccc8b tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.295509 Oct 04 18:04:36.951432 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 431/851] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:36.965959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dda11b63-0e52-45d0-85bd-de1ac31063e0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.966602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dda11b63-0e52-45d0-85bd-de1ac31063e0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.980599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dda11b63-0e52-45d0-85bd-de1ac31063e0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.981923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dda11b63-0e52-45d0-85bd-de1ac31063e0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.983099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dda11b63-0e52-45d0-85bd-de1ac31063e0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.984049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dda11b63-0e52-45d0-85bd-de1ac31063e0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.984733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dda11b63-0e52-45d0-85bd-de1ac31063e0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.985389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dda11b63-0e52-45d0-85bd-de1ac31063e0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.117411 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b9c1439b-b612-4678-b759-b2c4485aa7da tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/6b84a44c-371a-49a7-9dcb-b96088beeb82" status: 202 len: 0 microversion: 2.1 time: 2.026974 Oct 04 18:04:37.118991 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 421/852] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:04:35 2022] DELETE /compute/v2.1/os-floating-ips/6b84a44c-371a-49a7-9dcb-b96088beeb82 => generated 0 bytes in 2029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:37.124759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-1fc03931-b345-4511-8ab3-5d409c2c5769 req-a040c8b6-1079-4c44-880e-5cc24f282754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587dc93d-6601-457a-b25d-8b88eb79ab15", "name": "network-vif-plugged", "status": "completed", "tag": "9cac6fd6-3881-4d94-b5ec-b76381ebf1d6"}, {"server_uuid": "51903294-696f-4e13-adb2-d63862de1a52", "name": "network-vif-unplugged", "status": "completed", "tag": "ade6ab7a-2609-411b-8d9e-c2fe5c446530"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:37.141867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1fc03931-b345-4511-8ab3-5d409c2c5769 req-a040c8b6-1079-4c44-880e-5cc24f282754 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.142719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1fc03931-b345-4511-8ab3-5d409c2c5769 req-a040c8b6-1079-4c44-880e-5cc24f282754 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.143482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1fc03931-b345-4511-8ab3-5d409c2c5769 req-a040c8b6-1079-4c44-880e-5cc24f282754 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.176475 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1fc03931-b345-4511-8ab3-5d409c2c5769 req-a040c8b6-1079-4c44-880e-5cc24f282754 service nova] Creating event network-vif-plugged:9cac6fd6-3881-4d94-b5ec-b76381ebf1d6 for instance 587dc93d-6601-457a-b25d-8b88eb79ab15 on n-h2-850499-14 Oct 04 18:04:37.177358 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1fc03931-b345-4511-8ab3-5d409c2c5769 req-a040c8b6-1079-4c44-880e-5cc24f282754 service nova] Creating event network-vif-unplugged:ade6ab7a-2609-411b-8d9e-c2fe5c446530 for instance 51903294-696f-4e13-adb2-d63862de1a52 on n-h2-850499-14 Oct 04 18:04:37.196793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dda11b63-0e52-45d0-85bd-de1ac31063e0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:37.198295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-1fc03931-b345-4511-8ab3-5d409c2c5769 req-a040c8b6-1079-4c44-880e-5cc24f282754 service nova] Instance 51903294-696f-4e13-adb2-d63862de1a52 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:04:37.207085 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dda11b63-0e52-45d0-85bd-de1ac31063e0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 0.254289 Oct 04 18:04:37.209201 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-1fc03931-b345-4511-8ab3-5d409c2c5769 req-a040c8b6-1079-4c44-880e-5cc24f282754 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.088727 Oct 04 18:04:37.210342 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 422/853] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:37.219617 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 432/854] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:37.220805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da58e0a6-1239-4c89-a330-1af658fafa23 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da58e0a6-1239-4c89-a330-1af658fafa23 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Request method failure captured: Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action HTTP/1.1 Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 34 Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHV4TMmIITnFy4jF3k0U34yPsN9Hk7dg0y1ywL_8YYgOlX9JOxArxMCnkN-mTeWd_mBAB2R2X2YBLQO3lOQ4NB-gZZTJi44Jjtk7HNi-WcJfVo6c_5Z2PyT5DTVSdECOn6l-Ufyk59XhISlF15me4fgZAvt_YHtKw9nX5GpnJ2_8rHA Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 283fc113c40342dc9387fb7c84e00b2c Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:04:37.225192 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/283fc113c40342dc9387fb7c84e00b2c"}]}] Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 283fc113c40342dc9387fb7c84e00b2c Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 93c7e45ffec94520a28696fe6f9016ce Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: {"addFloatingIp": {"address": ""}} Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:04:37.226782 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '0d25ec92-5335-4444-83ba-2c92abef1832', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi '' Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:37.227730 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:37.229832 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:37.231148 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:04:37.231148 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.231148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da58e0a6-1239-4c89-a330-1af658fafa23 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:37.231148 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-da58e0a6-1239-4c89-a330-1af658fafa23 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action" status: 400 len: 142 microversion: 2.1 time: 0.011956 Oct 04 18:04:37.231148 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 423/855] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:37 2022] POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action => generated 142 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:37.232380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e22b4342-bb37-4eab-a5fd-951944da097b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:37.233080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e22b4342-bb37-4eab-a5fd-951944da097b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:37.240634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22b4342-bb37-4eab-a5fd-951944da097b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.240853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:37.241592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22b4342-bb37-4eab-a5fd-951944da097b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.242310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22b4342-bb37-4eab-a5fd-951944da097b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.243129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22b4342-bb37-4eab-a5fd-951944da097b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.243709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22b4342-bb37-4eab-a5fd-951944da097b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.244211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22b4342-bb37-4eab-a5fd-951944da097b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.244788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:37.258753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.262982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.263446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.264353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.264988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.265414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.291529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:04:37.291925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquired lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:04:37.461904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Releasing lock "refresh_cache-0d25ec92-5335-4444-83ba-2c92abef1832" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:04:37.462468 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] HTTP exception thrown: floating IP not found Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Request method failure captured: Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action HTTP/1.1 Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 41 Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHV4TMmIITnFy4jF3k0U34yPsN9Hk7dg0y1ywL_8YYgOlX9JOxArxMCnkN-mTeWd_mBAB2R2X2YBLQO3lOQ4NB-gZZTJi44Jjtk7HNi-WcJfVo6c_5Z2PyT5DTVSdECOn6l-Ufyk59XhISlF15me4fgZAvt_YHtKw9nX5GpnJ2_8rHA Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 283fc113c40342dc9387fb7c84e00b2c Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:04:37.464360 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/283fc113c40342dc9387fb7c84e00b2c"}]}] Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 283fc113c40342dc9387fb7c84e00b2c Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 93c7e45ffec94520a28696fe6f9016ce Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:04:37.466983 n-d-850499-14 devstack@n-api.service[122331]: exception: floating IP not found Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '0d25ec92-5335-4444-83ba-2c92abef1832', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:37.468611 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 18:04:37.470785 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.473260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Returning 404 to user: floating IP not found {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:37.473260 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a7d41d5f-4176-4d0b-81a3-d1d00791d52a tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action" status: 404 len: 67 microversion: 2.1 time: 0.230714 Oct 04 18:04:37.473260 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 424/856] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:37 2022] POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action => generated 67 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:37.479062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3bbe6e53-1211-4337-be29-63e9525f8470 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Action: 'action', calling method: .version_select at 0x7fd4d3ba7ca0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:37.533304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-3bbe6e53-1211-4337-be29-63e9525f8470 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3bbe6e53-1211-4337-be29-63e9525f8470 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Request method failure captured: Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action HTTP/1.1 Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 44 Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHV4TMmIITnFy4jF3k0U34yPsN9Hk7dg0y1ywL_8YYgOlX9JOxArxMCnkN-mTeWd_mBAB2R2X2YBLQO3lOQ4NB-gZZTJi44Jjtk7HNi-WcJfVo6c_5Z2PyT5DTVSdECOn6l-Ufyk59XhISlF15me4fgZAvt_YHtKw9nX5GpnJ2_8rHA Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 283fc113c40342dc9387fb7c84e00b2c Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:04:37.534881 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/283fc113c40342dc9387fb7c84e00b2c"}]}] Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 283fc113c40342dc9387fb7c84e00b2c Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 93c7e45ffec94520a28696fe6f9016ce Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:04:37.536261 n-d-850499-14 devstack@n-api.service[122331]: exception: Floating IP not found for address 0.0.0.0. Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '0d25ec92-5335-4444-83ba-2c92abef1832', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:37.537065 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 18:04:37.544682 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:04:37.546195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3bbe6e53-1211-4337-be29-63e9525f8470 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:37.546195 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3bbe6e53-1211-4337-be29-63e9525f8470 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action" status: 404 len: 88 microversion: 2.1 time: 0.064780 Oct 04 18:04:37.546195 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 425/857] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:37 2022] POST /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832/action => generated 88 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:37.551259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b5a2db60-d3cb-4208-ab76-7391d454edd5 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:37.551792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b5a2db60-d3cb-4208-ab76-7391d454edd5 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:37.560586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a2db60-d3cb-4208-ab76-7391d454edd5 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.561141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a2db60-d3cb-4208-ab76-7391d454edd5 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.561591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a2db60-d3cb-4208-ab76-7391d454edd5 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.562391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a2db60-d3cb-4208-ab76-7391d454edd5 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.562864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a2db60-d3cb-4208-ab76-7391d454edd5 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.563325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a2db60-d3cb-4208-ab76-7391d454edd5 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.573796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e22b4342-bb37-4eab-a5fd-951944da097b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:37.584431 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e22b4342-bb37-4eab-a5fd-951944da097b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1475 microversion: 2.1 time: 0.363635 Oct 04 18:04:37.586223 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 433/858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:37 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1475 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:37.598468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b5a2db60-d3cb-4208-ab76-7391d454edd5 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:04:37.684730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33e989a0-8708-439a-acb1-5e03eb457010 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:37.685359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33e989a0-8708-439a-acb1-5e03eb457010 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:37.691748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33e989a0-8708-439a-acb1-5e03eb457010 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.692616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33e989a0-8708-439a-acb1-5e03eb457010 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.693800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33e989a0-8708-439a-acb1-5e03eb457010 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.694681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33e989a0-8708-439a-acb1-5e03eb457010 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.695425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33e989a0-8708-439a-acb1-5e03eb457010 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.696352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33e989a0-8708-439a-acb1-5e03eb457010 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.712325 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b5a2db60-d3cb-4208-ab76-7391d454edd5 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 204 len: 0 microversion: 2.1 time: 0.168417 Oct 04 18:04:37.714114 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 426/859] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:04:37 2022] DELETE /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:04:37.725055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f8012cac-1fcb-4c20-ac98-6cecdf2ebdc9 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:37.726103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f8012cac-1fcb-4c20-ac98-6cecdf2ebdc9 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:37.733104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8012cac-1fcb-4c20-ac98-6cecdf2ebdc9 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.733710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8012cac-1fcb-4c20-ac98-6cecdf2ebdc9 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.734224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8012cac-1fcb-4c20-ac98-6cecdf2ebdc9 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.735059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8012cac-1fcb-4c20-ac98-6cecdf2ebdc9 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.735601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8012cac-1fcb-4c20-ac98-6cecdf2ebdc9 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.736105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8012cac-1fcb-4c20-ac98-6cecdf2ebdc9 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.937334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f8012cac-1fcb-4c20-ac98-6cecdf2ebdc9 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:37.951495 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f8012cac-1fcb-4c20-ac98-6cecdf2ebdc9 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1541 microversion: 2.1 time: 0.231197 Oct 04 18:04:37.952440 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 427/860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:37 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1541 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:37.969029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-33e989a0-8708-439a-acb1-5e03eb457010 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:37.980251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-61cc857a-f09a-4422-82f7-d44d27f91c84 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:37.981923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-61cc857a-f09a-4422-82f7-d44d27f91c84 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:37.982364 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33e989a0-8708-439a-acb1-5e03eb457010 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.302163 Oct 04 18:04:37.982981 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 434/861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:37 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:38.016909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61cc857a-f09a-4422-82f7-d44d27f91c84 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.019901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61cc857a-f09a-4422-82f7-d44d27f91c84 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.023044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61cc857a-f09a-4422-82f7-d44d27f91c84 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.024305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61cc857a-f09a-4422-82f7-d44d27f91c84 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.026918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61cc857a-f09a-4422-82f7-d44d27f91c84 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.027475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61cc857a-f09a-4422-82f7-d44d27f91c84 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.198133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61cc857a-f09a-4422-82f7-d44d27f91c84 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.210188 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-61cc857a-f09a-4422-82f7-d44d27f91c84 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.236184 Oct 04 18:04:38.211766 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 428/862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:37 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:38.236546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7c30722b-8fdd-41d1-b4c3-309afd5c6120 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.237547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7c30722b-8fdd-41d1-b4c3-309afd5c6120 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:38.247237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c30722b-8fdd-41d1-b4c3-309afd5c6120 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.250308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c30722b-8fdd-41d1-b4c3-309afd5c6120 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.253346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c30722b-8fdd-41d1-b4c3-309afd5c6120 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.254442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c30722b-8fdd-41d1-b4c3-309afd5c6120 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.255166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c30722b-8fdd-41d1-b4c3-309afd5c6120 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.255817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c30722b-8fdd-41d1-b4c3-309afd5c6120 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.408466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7c30722b-8fdd-41d1-b4c3-309afd5c6120 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.418080 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7c30722b-8fdd-41d1-b4c3-309afd5c6120 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 0.188271 Oct 04 18:04:38.435330 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 435/863] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:38 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:38.609917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c93c27f4-d0b9-4254-aaa6-f16bcaba4bed tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.610759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c93c27f4-d0b9-4254-aaa6-f16bcaba4bed tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:38.618336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c93c27f4-d0b9-4254-aaa6-f16bcaba4bed tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.618832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c93c27f4-d0b9-4254-aaa6-f16bcaba4bed tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.619756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c93c27f4-d0b9-4254-aaa6-f16bcaba4bed tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.620340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c93c27f4-d0b9-4254-aaa6-f16bcaba4bed tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.620798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c93c27f4-d0b9-4254-aaa6-f16bcaba4bed tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.621397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c93c27f4-d0b9-4254-aaa6-f16bcaba4bed tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.779419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c93c27f4-d0b9-4254-aaa6-f16bcaba4bed tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.788428 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c93c27f4-d0b9-4254-aaa6-f16bcaba4bed tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1473 microversion: 2.1 time: 0.183502 Oct 04 18:04:38.788942 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 429/864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:38 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:38.805101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c84e7ea5-cb59-408d-b050-94784ff00f91 req-b3e31a31-2982-43de-8e06-c22c02ba11f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2505e8f7-6362-487e-9099-1dfe07254a31", "tag": "c85dbcc1-f6de-40b4-b2fa-919f947c77f4"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:38.816132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c84e7ea5-cb59-408d-b050-94784ff00f91 req-b3e31a31-2982-43de-8e06-c22c02ba11f4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.816622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c84e7ea5-cb59-408d-b050-94784ff00f91 req-b3e31a31-2982-43de-8e06-c22c02ba11f4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.817056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c84e7ea5-cb59-408d-b050-94784ff00f91 req-b3e31a31-2982-43de-8e06-c22c02ba11f4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.829023 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c84e7ea5-cb59-408d-b050-94784ff00f91 req-b3e31a31-2982-43de-8e06-c22c02ba11f4 service nova] Creating event network-changed:c85dbcc1-f6de-40b4-b2fa-919f947c77f4 for instance 2505e8f7-6362-487e-9099-1dfe07254a31 on n-h2-850499-14 Oct 04 18:04:38.834006 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c84e7ea5-cb59-408d-b050-94784ff00f91 req-b3e31a31-2982-43de-8e06-c22c02ba11f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032987 Oct 04 18:04:38.834614 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 430/865] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:38.907034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d304e36a-3e24-46b7-b495-2dc8c884a0ee tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Action: 'create', calling method: .version_select at 0x7fd4d1e4a790>, body: {"keypair": {"name": "tempest-keypair-101376571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANC2je/I2QJ2XSYZN2UNI9r7rqf1B0/E2K5YcYUuBC5z+RcCSXqW4KrGe8Wmnd6oTA/GVVd6h4v4p02lUgVjsrcKHhfq/E/hPJn820QlWX/QBcYFfjEQvo6oEZWQtbR4g=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:38.923111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d304e36a-3e24-46b7-b495-2dc8c884a0ee tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Getting quotas for project 1aa1267514574b10b88edc89c547c727. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:38.927853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d304e36a-3e24-46b7-b495-2dc8c884a0ee tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Getting quotas for user 72d2223fbb374de8bf6792e8187e9c08 and project 1aa1267514574b10b88edc89c547c727. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:38.954342 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d304e36a-3e24-46b7-b495-2dc8c884a0ee tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.202002 Oct 04 18:04:38.954988 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 436/866] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:04:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:38.980465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4044548c-3178-41c5-bb23-e88a07c8166c tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.982009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4044548c-3178-41c5-bb23-e88a07c8166c tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:38.989089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4044548c-3178-41c5-bb23-e88a07c8166c tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.989663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4044548c-3178-41c5-bb23-e88a07c8166c tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.990179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4044548c-3178-41c5-bb23-e88a07c8166c tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.990913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4044548c-3178-41c5-bb23-e88a07c8166c tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.991416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4044548c-3178-41c5-bb23-e88a07c8166c tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.991875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4044548c-3178-41c5-bb23-e88a07c8166c tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.009781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e48b3024-0f17-45d5-b763-1b1f3dfec5b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.010404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e48b3024-0f17-45d5-b763-1b1f3dfec5b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:39.017568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48b3024-0f17-45d5-b763-1b1f3dfec5b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.018390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48b3024-0f17-45d5-b763-1b1f3dfec5b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.018820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48b3024-0f17-45d5-b763-1b1f3dfec5b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.019618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48b3024-0f17-45d5-b763-1b1f3dfec5b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.020103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48b3024-0f17-45d5-b763-1b1f3dfec5b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.020588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48b3024-0f17-45d5-b763-1b1f3dfec5b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.567754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4044548c-3178-41c5-bb23-e88a07c8166c tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:39.577367 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4044548c-3178-41c5-bb23-e88a07c8166c tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1541 microversion: 2.1 time: 0.601683 Oct 04 18:04:39.578199 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 431/867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:38 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1541 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:39.583860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb335381-ad4c-452e-8a42-67a2466e1555 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.584771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb335381-ad4c-452e-8a42-67a2466e1555 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:39.592265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb335381-ad4c-452e-8a42-67a2466e1555 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.593143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb335381-ad4c-452e-8a42-67a2466e1555 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.593808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb335381-ad4c-452e-8a42-67a2466e1555 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.594535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb335381-ad4c-452e-8a42-67a2466e1555 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.595200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb335381-ad4c-452e-8a42-67a2466e1555 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.595858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb335381-ad4c-452e-8a42-67a2466e1555 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.606006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e48b3024-0f17-45d5-b763-1b1f3dfec5b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:39.615991 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e48b3024-0f17-45d5-b763-1b1f3dfec5b3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.610586 Oct 04 18:04:39.617875 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 437/868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:39.623877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b3261c05-7d34-4f2a-bce0-13c4846ac953 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.624718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b3261c05-7d34-4f2a-bce0-13c4846ac953 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:39.633158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3261c05-7d34-4f2a-bce0-13c4846ac953 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.633838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3261c05-7d34-4f2a-bce0-13c4846ac953 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.634456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3261c05-7d34-4f2a-bce0-13c4846ac953 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.635368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3261c05-7d34-4f2a-bce0-13c4846ac953 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.636049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3261c05-7d34-4f2a-bce0-13c4846ac953 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.636731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3261c05-7d34-4f2a-bce0-13c4846ac953 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.949226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cb335381-ad4c-452e-8a42-67a2466e1555 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:39.959613 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb335381-ad4c-452e-8a42-67a2466e1555 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.380064 Oct 04 18:04:39.960219 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 432/869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:39.965433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65e67398-014d-46e9-b340-1e1804725ccc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.965973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65e67398-014d-46e9-b340-1e1804725ccc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:39.975102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65e67398-014d-46e9-b340-1e1804725ccc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.975760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b3261c05-7d34-4f2a-bce0-13c4846ac953 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:39.976128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65e67398-014d-46e9-b340-1e1804725ccc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.976776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65e67398-014d-46e9-b340-1e1804725ccc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.977725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65e67398-014d-46e9-b340-1e1804725ccc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.978326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65e67398-014d-46e9-b340-1e1804725ccc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.979503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65e67398-014d-46e9-b340-1e1804725ccc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.984339 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b3261c05-7d34-4f2a-bce0-13c4846ac953 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 0.364908 Oct 04 18:04:40.000903 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 438/870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:40.001801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:40.035851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:40.209855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65e67398-014d-46e9-b340-1e1804725ccc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.220809 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65e67398-014d-46e9-b340-1e1804725ccc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1473 microversion: 2.1 time: 0.259159 Oct 04 18:04:40.221652 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 433/871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1473 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:40.421499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1ff58392-35cb-41df-bf50-03a6cf90d02c req-15842348-4872-4c7d-bb2a-c249e3ab9085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d25ec92-5335-4444-83ba-2c92abef1832", "name": "network-vif-deleted", "tag": "ae5a66c4-f24e-47ae-bcad-abe0df6b2f41"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:40.444891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1ff58392-35cb-41df-bf50-03a6cf90d02c req-15842348-4872-4c7d-bb2a-c249e3ab9085 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.445542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1ff58392-35cb-41df-bf50-03a6cf90d02c req-15842348-4872-4c7d-bb2a-c249e3ab9085 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.446052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1ff58392-35cb-41df-bf50-03a6cf90d02c req-15842348-4872-4c7d-bb2a-c249e3ab9085 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.461057 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1ff58392-35cb-41df-bf50-03a6cf90d02c req-15842348-4872-4c7d-bb2a-c249e3ab9085 service nova] Creating event network-vif-deleted:ae5a66c4-f24e-47ae-bcad-abe0df6b2f41 for instance 0d25ec92-5335-4444-83ba-2c92abef1832 on n-h1-850499-14 Oct 04 18:04:40.474863 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1ff58392-35cb-41df-bf50-03a6cf90d02c req-15842348-4872-4c7d-bb2a-c249e3ab9085 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050593 Oct 04 18:04:40.474863 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 439/872] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:40.603586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:40.604350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:40.611232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.611742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.612793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.613528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.613992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.617848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.651888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9380a3f-3407-480e-b63c-d77d15e47671 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:40.652635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9380a3f-3407-480e-b63c-d77d15e47671 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:40.655356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.656134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.656747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.657350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lazy-loading 'fault' on Instance uuid 0d25ec92-5335-4444-83ba-2c92abef1832 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:40.661758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9380a3f-3407-480e-b63c-d77d15e47671 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.662213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9380a3f-3407-480e-b63c-d77d15e47671 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.662660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9380a3f-3407-480e-b63c-d77d15e47671 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.663407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9380a3f-3407-480e-b63c-d77d15e47671 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.663868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9380a3f-3407-480e-b63c-d77d15e47671 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.664369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9380a3f-3407-480e-b63c-d77d15e47671 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.716924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93c7e45ffec94520a28696fe6f9016ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283fc113c40342dc9387fb7c84e00b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.731451 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34240b24-4a5f-4291-84d0-215714625493 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 200 len: 1321 microversion: 2.1 time: 0.131519 Oct 04 18:04:40.731973 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 434/873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:40 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 1321 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:40.904860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9380a3f-3407-480e-b63c-d77d15e47671 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.913769 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9380a3f-3407-480e-b63c-d77d15e47671 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.267438 Oct 04 18:04:40.914611 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 440/874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:40 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:40.939314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1373261853", "imageRef": "97cf7fa5-af31-442b-bb31-7e159c8525e2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7eb25c79-d47f-446a-8567-e60bf85eb353"}], "security_groups": [{"name": "tempest-securitygroup--1973910874"}], "key_name": "tempest-keypair-101376571", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:40.987497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b8939dd3-3fc1-4100-8a78-1ee099c2de35 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:40.988858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b8939dd3-3fc1-4100-8a78-1ee099c2de35 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:40.999349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8939dd3-3fc1-4100-8a78-1ee099c2de35 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.999870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8939dd3-3fc1-4100-8a78-1ee099c2de35 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.000473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8939dd3-3fc1-4100-8a78-1ee099c2de35 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.001200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8939dd3-3fc1-4100-8a78-1ee099c2de35 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.003262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8939dd3-3fc1-4100-8a78-1ee099c2de35 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.003713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8939dd3-3fc1-4100-8a78-1ee099c2de35 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.102153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] validate_networks() for [('7eb25c79-d47f-446a-8567-e60bf85eb353', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:41.229589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b8939dd3-3fc1-4100-8a78-1ee099c2de35 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.239500 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b8939dd3-3fc1-4100-8a78-1ee099c2de35 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.257874 Oct 04 18:04:41.251452 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 441/875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:40 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:41.261262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e6a34a10-f9a1-4693-9be8-71be1e28ee01 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.261882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e6a34a10-f9a1-4693-9be8-71be1e28ee01 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.269630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a34a10-f9a1-4693-9be8-71be1e28ee01 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.270409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a34a10-f9a1-4693-9be8-71be1e28ee01 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.271040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a34a10-f9a1-4693-9be8-71be1e28ee01 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.271917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a34a10-f9a1-4693-9be8-71be1e28ee01 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.272529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a34a10-f9a1-4693-9be8-71be1e28ee01 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.273119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a34a10-f9a1-4693-9be8-71be1e28ee01 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.507611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e6a34a10-f9a1-4693-9be8-71be1e28ee01 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.515974 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e6a34a10-f9a1-4693-9be8-71be1e28ee01 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 0.263288 Oct 04 18:04:41.516561 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 442/876] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:41.523915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1821072b-c1da-4580-aea4-99bad911b7d2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.524603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1821072b-c1da-4580-aea4-99bad911b7d2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.530665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1821072b-c1da-4580-aea4-99bad911b7d2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.531197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1821072b-c1da-4580-aea4-99bad911b7d2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.531828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1821072b-c1da-4580-aea4-99bad911b7d2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.532554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1821072b-c1da-4580-aea4-99bad911b7d2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.533014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1821072b-c1da-4580-aea4-99bad911b7d2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.533443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1821072b-c1da-4580-aea4-99bad911b7d2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.693113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:41.694012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:41.694147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:41.694575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:41.695024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:41.704952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.705452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.713197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.713197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.713197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.713197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.727053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Getting quotas for project 1aa1267514574b10b88edc89c547c727. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:41.727626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1821072b-c1da-4580-aea4-99bad911b7d2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.732956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Getting quotas for user 72d2223fbb374de8bf6792e8187e9c08 and project 1aa1267514574b10b88edc89c547c727. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:41.736863 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1821072b-c1da-4580-aea4-99bad911b7d2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1473 microversion: 2.1 time: 0.219234 Oct 04 18:04:41.737473 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 443/877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1473 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:41.747934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:41.750275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97cf7fa5-af31-442b-bb31-7e159c8525e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:41.766376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.766905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] [instance: 0d25ec92-5335-4444-83ba-2c92abef1832] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.773361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.773839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.774276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.774998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.775456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.775875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.792327 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] HTTP exception thrown: Instance 0d25ec92-5335-4444-83ba-2c92abef1832 could not be found. Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Request method failure captured: Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 HTTP/1.1 Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHV4TMmIITnFy4jF3k0U34yPsN9Hk7dg0y1ywL_8YYgOlX9JOxArxMCnkN-mTeWd_mBAB2R2X2YBLQO3lOQ4NB-gZZTJi44Jjtk7HNi-WcJfVo6c_5Z2PyT5DTVSdECOn6l-Ufyk59XhISlF15me4fgZAvt_YHtKw9nX5GpnJ2_8rHA Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 283fc113c40342dc9387fb7c84e00b2c Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:04:41.793982 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/283fc113c40342dc9387fb7c84e00b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/283fc113c40342dc9387fb7c84e00b2c"}]}] Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 283fc113c40342dc9387fb7c84e00b2c Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476 Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 93c7e45ffec94520a28696fe6f9016ce Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 0d25ec92-5335-4444-83ba-2c92abef1832 could not be found. Oct 04 18:04:41.796053 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '0d25ec92-5335-4444-83ba-2c92abef1832'} Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d25ec92-5335-4444-83ba-2c92abef1832 could not be found. Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:41.796807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d25ec92-5335-4444-83ba-2c92abef1832 could not be found. Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d25ec92-5335-4444-83ba-2c92abef1832 could not be found. Oct 04 18:04:41.798041 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:04:41.799183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] Returning 404 to user: Instance 0d25ec92-5335-4444-83ba-2c92abef1832 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:41.799183 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e215eaa3-1e32-401e-a8f4-a9adfb800579 tempest-FloatingIPsAssociationNegativeTestJSON-30677476 tempest-FloatingIPsAssociationNegativeTestJSON-30677476-project] 10.222.0.18 "GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832" status: 404 len: 111 microversion: 2.1 time: 0.033645 Oct 04 18:04:41.799183 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 444/878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/0d25ec92-5335-4444-83ba-2c92abef1832 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:41.800804 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e2b0017b-0c30-4142-a847-89528c3ea5c1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.865661 Oct 04 18:04:41.801603 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 435/879] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:04:41.815344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-53a3debe-2c19-4d9b-82fe-5ea89f17c9c8 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.816303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-53a3debe-2c19-4d9b-82fe-5ea89f17c9c8 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.878666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-53a3debe-2c19-4d9b-82fe-5ea89f17c9c8 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.885759 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-53a3debe-2c19-4d9b-82fe-5ea89f17c9c8 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1245 microversion: 2.1 time: 0.076918 Oct 04 18:04:41.904025 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 445/880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:41.939268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dde540ff-2abd-45be-8383-68d5be2887f3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.939914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dde540ff-2abd-45be-8383-68d5be2887f3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.946652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dde540ff-2abd-45be-8383-68d5be2887f3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.947637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dde540ff-2abd-45be-8383-68d5be2887f3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.948154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dde540ff-2abd-45be-8383-68d5be2887f3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.948967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dde540ff-2abd-45be-8383-68d5be2887f3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.950069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dde540ff-2abd-45be-8383-68d5be2887f3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.950734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dde540ff-2abd-45be-8383-68d5be2887f3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.127742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dde540ff-2abd-45be-8383-68d5be2887f3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.141592 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dde540ff-2abd-45be-8383-68d5be2887f3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.206295 Oct 04 18:04:42.143591 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 436/881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:42.266412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3b298b03-14d3-48bd-9c1a-78f40bbd77d3 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.267413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3b298b03-14d3-48bd-9c1a-78f40bbd77d3 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.276170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b298b03-14d3-48bd-9c1a-78f40bbd77d3 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.276706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b298b03-14d3-48bd-9c1a-78f40bbd77d3 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.277209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b298b03-14d3-48bd-9c1a-78f40bbd77d3 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.278797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b298b03-14d3-48bd-9c1a-78f40bbd77d3 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.279500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b298b03-14d3-48bd-9c1a-78f40bbd77d3 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.279930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b298b03-14d3-48bd-9c1a-78f40bbd77d3 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.474138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3b298b03-14d3-48bd-9c1a-78f40bbd77d3 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.486165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3b298b03-14d3-48bd-9c1a-78f40bbd77d3 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.224004 Oct 04 18:04:42.487345 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 446/882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:42.537854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c87560ef-c546-4cbc-834b-be8876aaacdc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.538486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c87560ef-c546-4cbc-834b-be8876aaacdc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.544809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c87560ef-c546-4cbc-834b-be8876aaacdc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.545566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c87560ef-c546-4cbc-834b-be8876aaacdc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.546306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c87560ef-c546-4cbc-834b-be8876aaacdc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.547068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c87560ef-c546-4cbc-834b-be8876aaacdc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.547531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c87560ef-c546-4cbc-834b-be8876aaacdc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.548126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c87560ef-c546-4cbc-834b-be8876aaacdc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.705037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c87560ef-c546-4cbc-834b-be8876aaacdc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.715118 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c87560ef-c546-4cbc-834b-be8876aaacdc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 0.179045 Oct 04 18:04:42.715744 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 437/883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:42.763387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a69a1d10-a1bb-4cb0-a500-6868810fbf45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.765423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a69a1d10-a1bb-4cb0-a500-6868810fbf45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.772976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69a1d10-a1bb-4cb0-a500-6868810fbf45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.773949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69a1d10-a1bb-4cb0-a500-6868810fbf45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.775086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69a1d10-a1bb-4cb0-a500-6868810fbf45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.776861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69a1d10-a1bb-4cb0-a500-6868810fbf45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.777907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69a1d10-a1bb-4cb0-a500-6868810fbf45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.778497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69a1d10-a1bb-4cb0-a500-6868810fbf45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.829314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8113c810-dd2f-4d27-8fb3-85254da7c6d9 req-0aa3eb46-d1a6-479e-9da4-b8e345459c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b911ede1-8b72-4521-a647-8ea9dd3232ed", "name": "network-vif-plugged", "status": "completed", "tag": "52faaf09-6573-4cc6-8bc9-5bdc801746cc"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:42.843731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8113c810-dd2f-4d27-8fb3-85254da7c6d9 req-0aa3eb46-d1a6-479e-9da4-b8e345459c64 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.844298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8113c810-dd2f-4d27-8fb3-85254da7c6d9 req-0aa3eb46-d1a6-479e-9da4-b8e345459c64 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.844789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8113c810-dd2f-4d27-8fb3-85254da7c6d9 req-0aa3eb46-d1a6-479e-9da4-b8e345459c64 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.857993 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8113c810-dd2f-4d27-8fb3-85254da7c6d9 req-0aa3eb46-d1a6-479e-9da4-b8e345459c64 service nova] Creating event network-vif-plugged:52faaf09-6573-4cc6-8bc9-5bdc801746cc for instance b911ede1-8b72-4521-a647-8ea9dd3232ed on n-h2-850499-14 Oct 04 18:04:42.863666 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8113c810-dd2f-4d27-8fb3-85254da7c6d9 req-0aa3eb46-d1a6-479e-9da4-b8e345459c64 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038440 Oct 04 18:04:42.864648 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 438/884] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:42.923507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-29934583-8d30-4f21-aa24-7d438381ce8a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.926316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-29934583-8d30-4f21-aa24-7d438381ce8a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.936044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29934583-8d30-4f21-aa24-7d438381ce8a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.938508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29934583-8d30-4f21-aa24-7d438381ce8a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.939169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29934583-8d30-4f21-aa24-7d438381ce8a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.940122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29934583-8d30-4f21-aa24-7d438381ce8a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.940750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29934583-8d30-4f21-aa24-7d438381ce8a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.942000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29934583-8d30-4f21-aa24-7d438381ce8a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.967259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:43.038768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-29934583-8d30-4f21-aa24-7d438381ce8a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.060739 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-29934583-8d30-4f21-aa24-7d438381ce8a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1297 microversion: 2.1 time: 0.148744 Oct 04 18:04:43.062495 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 439/885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1297 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:43.131689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a69a1d10-a1bb-4cb0-a500-6868810fbf45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.145133 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a69a1d10-a1bb-4cb0-a500-6868810fbf45 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1473 microversion: 2.1 time: 0.388556 Oct 04 18:04:43.145725 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 447/886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1473 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:43.165753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-47cd3e71-33f3-438a-afa1-4a2929c0ad7b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:43.166386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-47cd3e71-33f3-438a-afa1-4a2929c0ad7b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:43.181245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47cd3e71-33f3-438a-afa1-4a2929c0ad7b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.181757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47cd3e71-33f3-438a-afa1-4a2929c0ad7b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.182301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47cd3e71-33f3-438a-afa1-4a2929c0ad7b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.183052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47cd3e71-33f3-438a-afa1-4a2929c0ad7b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.183515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47cd3e71-33f3-438a-afa1-4a2929c0ad7b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.184464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47cd3e71-33f3-438a-afa1-4a2929c0ad7b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.427640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-47cd3e71-33f3-438a-afa1-4a2929c0ad7b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.440545 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-47cd3e71-33f3-438a-afa1-4a2929c0ad7b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1318 microversion: 2.1 time: 0.278677 Oct 04 18:04:43.441980 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 440/887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:43 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:43.509009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a7feb36-22a9-47e1-8a08-1003061eecc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:43.509731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a7feb36-22a9-47e1-8a08-1003061eecc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:43.518524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7feb36-22a9-47e1-8a08-1003061eecc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.520749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7feb36-22a9-47e1-8a08-1003061eecc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.521651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7feb36-22a9-47e1-8a08-1003061eecc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.524223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7feb36-22a9-47e1-8a08-1003061eecc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.525135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7feb36-22a9-47e1-8a08-1003061eecc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.525993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7feb36-22a9-47e1-8a08-1003061eecc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.742426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5955704d-dcfe-47a6-94a0-727c6136d3a0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:43.743495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5955704d-dcfe-47a6-94a0-727c6136d3a0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:43.750182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5955704d-dcfe-47a6-94a0-727c6136d3a0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.757841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5955704d-dcfe-47a6-94a0-727c6136d3a0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.762992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5955704d-dcfe-47a6-94a0-727c6136d3a0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.763884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5955704d-dcfe-47a6-94a0-727c6136d3a0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.764380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5955704d-dcfe-47a6-94a0-727c6136d3a0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.764827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5955704d-dcfe-47a6-94a0-727c6136d3a0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.795662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9a7feb36-22a9-47e1-8a08-1003061eecc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.807586 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a7feb36-22a9-47e1-8a08-1003061eecc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.300517 Oct 04 18:04:43.812800 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 448/888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:43 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:43.997689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5955704d-dcfe-47a6-94a0-727c6136d3a0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.005812 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5955704d-dcfe-47a6-94a0-727c6136d3a0 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 0.269727 Oct 04 18:04:44.009124 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 441/889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:43 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:44.093099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1fc7859a-165f-46bc-8c98-c8fd5ea92d23 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.094376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1fc7859a-165f-46bc-8c98-c8fd5ea92d23 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:44.110241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1fc7859a-165f-46bc-8c98-c8fd5ea92d23 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.110802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1fc7859a-165f-46bc-8c98-c8fd5ea92d23 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.111556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1fc7859a-165f-46bc-8c98-c8fd5ea92d23 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.112667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1fc7859a-165f-46bc-8c98-c8fd5ea92d23 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.113588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1fc7859a-165f-46bc-8c98-c8fd5ea92d23 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.114891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1fc7859a-165f-46bc-8c98-c8fd5ea92d23 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.176864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d9000051-b316-4ec4-bfd8-06a3d032edfd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.178110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d9000051-b316-4ec4-bfd8-06a3d032edfd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:44.194375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9000051-b316-4ec4-bfd8-06a3d032edfd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.197853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9000051-b316-4ec4-bfd8-06a3d032edfd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.198647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9000051-b316-4ec4-bfd8-06a3d032edfd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.199988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9000051-b316-4ec4-bfd8-06a3d032edfd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.200476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9000051-b316-4ec4-bfd8-06a3d032edfd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.200928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9000051-b316-4ec4-bfd8-06a3d032edfd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.312866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1fc7859a-165f-46bc-8c98-c8fd5ea92d23 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.332213 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1fc7859a-165f-46bc-8c98-c8fd5ea92d23 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1303 microversion: 2.1 time: 0.245913 Oct 04 18:04:44.347133 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 449/890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1303 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:44.466531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-245f1633-6a96-40d7-932a-f44c11556de9 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.467832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-245f1633-6a96-40d7-932a-f44c11556de9 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:44.479928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-245f1633-6a96-40d7-932a-f44c11556de9 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.481284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-245f1633-6a96-40d7-932a-f44c11556de9 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.482713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-245f1633-6a96-40d7-932a-f44c11556de9 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.486431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-245f1633-6a96-40d7-932a-f44c11556de9 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.487582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-245f1633-6a96-40d7-932a-f44c11556de9 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.488824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-245f1633-6a96-40d7-932a-f44c11556de9 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.033364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-245f1633-6a96-40d7-932a-f44c11556de9 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.057094 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-245f1633-6a96-40d7-932a-f44c11556de9 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1468 microversion: 2.1 time: 0.595644 Oct 04 18:04:45.058184 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 450/891] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1468 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:45.063921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4357a22a-5273-4832-aecb-6ed32d8d28c4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.070856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4357a22a-5273-4832-aecb-6ed32d8d28c4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.082629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4357a22a-5273-4832-aecb-6ed32d8d28c4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.083623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4357a22a-5273-4832-aecb-6ed32d8d28c4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.084069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4357a22a-5273-4832-aecb-6ed32d8d28c4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.085915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4357a22a-5273-4832-aecb-6ed32d8d28c4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.091460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4357a22a-5273-4832-aecb-6ed32d8d28c4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.092045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4357a22a-5273-4832-aecb-6ed32d8d28c4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.131341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:45.134336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d9000051-b316-4ec4-bfd8-06a3d032edfd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.147851 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d9000051-b316-4ec4-bfd8-06a3d032edfd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1470 microversion: 2.1 time: 0.975459 Oct 04 18:04:45.152265 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 442/892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1470 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:45.158934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3e6ac1f9-dbdc-46b9-8b52-00b434eb6625 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.160616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3e6ac1f9-dbdc-46b9-8b52-00b434eb6625 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.188011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e6ac1f9-dbdc-46b9-8b52-00b434eb6625 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.188919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e6ac1f9-dbdc-46b9-8b52-00b434eb6625 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.189711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e6ac1f9-dbdc-46b9-8b52-00b434eb6625 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.190679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e6ac1f9-dbdc-46b9-8b52-00b434eb6625 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.191412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e6ac1f9-dbdc-46b9-8b52-00b434eb6625 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.192072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e6ac1f9-dbdc-46b9-8b52-00b434eb6625 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.720303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3e6ac1f9-dbdc-46b9-8b52-00b434eb6625 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.729472 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3e6ac1f9-dbdc-46b9-8b52-00b434eb6625 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1292 microversion: 2.1 time: 0.575224 Oct 04 18:04:45.729987 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 443/893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1292 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:45.740678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4357a22a-5273-4832-aecb-6ed32d8d28c4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.745240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0893f9a0-10ca-4fa1-bbff-effdfbf4716b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.748407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0893f9a0-10ca-4fa1-bbff-effdfbf4716b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: cd85fc2b-0943-4616-8b69-f8e5825e400a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.761165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4357a22a-5273-4832-aecb-6ed32d8d28c4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.701092 Oct 04 18:04:45.761588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0893f9a0-10ca-4fa1-bbff-effdfbf4716b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.762168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0893f9a0-10ca-4fa1-bbff-effdfbf4716b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.770985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0893f9a0-10ca-4fa1-bbff-effdfbf4716b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.771420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0893f9a0-10ca-4fa1-bbff-effdfbf4716b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.772037 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 451/894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:45.772278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0893f9a0-10ca-4fa1-bbff-effdfbf4716b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.772679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0893f9a0-10ca-4fa1-bbff-effdfbf4716b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.787759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe1be6d7-cf21-467d-8077-cc79376bfd50 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:45.788646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fe1be6d7-cf21-467d-8077-cc79376bfd50 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.797071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe1be6d7-cf21-467d-8077-cc79376bfd50 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.797907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe1be6d7-cf21-467d-8077-cc79376bfd50 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.798561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe1be6d7-cf21-467d-8077-cc79376bfd50 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.799548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe1be6d7-cf21-467d-8077-cc79376bfd50 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.800247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe1be6d7-cf21-467d-8077-cc79376bfd50 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.800894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe1be6d7-cf21-467d-8077-cc79376bfd50 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.927813 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fe1be6d7-cf21-467d-8077-cc79376bfd50 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52/action" status: 204 len: 0 microversion: 2.1 time: 0.143342 Oct 04 18:04:45.929149 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 452/895] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:45 2022] POST /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52/action => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:04:45.944011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fc1cd3b7-f862-46ee-9e1b-b229c270e374 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.944863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fc1cd3b7-f862-46ee-9e1b-b229c270e374 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.964163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1cd3b7-f862-46ee-9e1b-b229c270e374 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.964690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1cd3b7-f862-46ee-9e1b-b229c270e374 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.973833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1cd3b7-f862-46ee-9e1b-b229c270e374 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.974879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1cd3b7-f862-46ee-9e1b-b229c270e374 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.975408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1cd3b7-f862-46ee-9e1b-b229c270e374 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.975942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1cd3b7-f862-46ee-9e1b-b229c270e374 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.280699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0893f9a0-10ca-4fa1-bbff-effdfbf4716b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.301805 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0893f9a0-10ca-4fa1-bbff-effdfbf4716b tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a" status: 200 len: 1467 microversion: 2.1 time: 0.566634 Oct 04 18:04:46.303772 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 444/896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a => generated 1467 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:46.319817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57403d6d-1c96-4074-aff1-aecf9506569d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:46.322678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-57403d6d-1c96-4074-aff1-aecf9506569d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:46.343671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57403d6d-1c96-4074-aff1-aecf9506569d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.344500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57403d6d-1c96-4074-aff1-aecf9506569d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.345163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57403d6d-1c96-4074-aff1-aecf9506569d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.346196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57403d6d-1c96-4074-aff1-aecf9506569d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.346862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57403d6d-1c96-4074-aff1-aecf9506569d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.347502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57403d6d-1c96-4074-aff1-aecf9506569d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.834128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fc1cd3b7-f862-46ee-9e1b-b229c270e374 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.854238 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fc1cd3b7-f862-46ee-9e1b-b229c270e374 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.917507 Oct 04 18:04:46.858067 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 453/897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:46.870294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-352df9be-17e4-477c-97fb-8a48f8bfcc15 req-21dc7130-1132-4f6b-ba07-aa0fef667c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51903294-696f-4e13-adb2-d63862de1a52", "name": "network-vif-plugged", "status": "completed", "tag": "ade6ab7a-2609-411b-8d9e-c2fe5c446530"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:46.883414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-352df9be-17e4-477c-97fb-8a48f8bfcc15 req-21dc7130-1132-4f6b-ba07-aa0fef667c49 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.883893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-352df9be-17e4-477c-97fb-8a48f8bfcc15 req-21dc7130-1132-4f6b-ba07-aa0fef667c49 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.884519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-352df9be-17e4-477c-97fb-8a48f8bfcc15 req-21dc7130-1132-4f6b-ba07-aa0fef667c49 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.908232 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-352df9be-17e4-477c-97fb-8a48f8bfcc15 req-21dc7130-1132-4f6b-ba07-aa0fef667c49 service nova] Creating event network-vif-plugged:ade6ab7a-2609-411b-8d9e-c2fe5c446530 for instance 51903294-696f-4e13-adb2-d63862de1a52 on n-h2-850499-14 Oct 04 18:04:46.923336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-352df9be-17e4-477c-97fb-8a48f8bfcc15 req-21dc7130-1132-4f6b-ba07-aa0fef667c49 service nova] Instance 51903294-696f-4e13-adb2-d63862de1a52 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:04:46.933350 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-352df9be-17e4-477c-97fb-8a48f8bfcc15 req-21dc7130-1132-4f6b-ba07-aa0fef667c49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072592 Oct 04 18:04:46.934896 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 454/898] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:46.942805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:46.950007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.951399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Searching by: {'reservation_id': 'r-4hgkug66', 'deleted': False, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:04:46.959714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.960391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.960928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.961855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.962421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.962934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.149649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:04:47.211990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-57403d6d-1c96-4074-aff1-aecf9506569d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.226390 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-57403d6d-1c96-4074-aff1-aecf9506569d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1470 microversion: 2.1 time: 0.920773 Oct 04 18:04:47.237940 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 445/899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1470 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:47.241085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-595995f5-2f92-4760-96bc-91dd7a294107 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.253710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-595995f5-2f92-4760-96bc-91dd7a294107 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:47.265936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-595995f5-2f92-4760-96bc-91dd7a294107 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.272226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-595995f5-2f92-4760-96bc-91dd7a294107 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.273519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-595995f5-2f92-4760-96bc-91dd7a294107 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.275017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-595995f5-2f92-4760-96bc-91dd7a294107 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.276193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-595995f5-2f92-4760-96bc-91dd7a294107 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.277747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-595995f5-2f92-4760-96bc-91dd7a294107 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.297640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.327224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.328585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.329576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.021546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-595995f5-2f92-4760-96bc-91dd7a294107 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.028566 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e81d9b2a-3007-4f9e-921a-c449ac39b108 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-4hgkug66" status: 200 len: 2928 microversion: 2.1 time: 1.090037 Oct 04 18:04:48.029404 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 455/900] 10.222.0.18 () {58 vars in 1197 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/servers/detail?reservation_id=r-4hgkug66 => generated 2928 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:48.030064 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-595995f5-2f92-4760-96bc-91dd7a294107 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1482 microversion: 2.1 time: 0.800880 Oct 04 18:04:48.030810 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 446/901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1482 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:48.034846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ab534d64-d373-47da-b620-787340f5ae41 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.035717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ab534d64-d373-47da-b620-787340f5ae41 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.036283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f059657-fc7a-40fa-a519-f3f784bd78b1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.037335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f059657-fc7a-40fa-a519-f3f784bd78b1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.042832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab534d64-d373-47da-b620-787340f5ae41 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.043711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab534d64-d373-47da-b620-787340f5ae41 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.044372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab534d64-d373-47da-b620-787340f5ae41 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.045561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab534d64-d373-47da-b620-787340f5ae41 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.046235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab534d64-d373-47da-b620-787340f5ae41 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.046879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab534d64-d373-47da-b620-787340f5ae41 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.056235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f059657-fc7a-40fa-a519-f3f784bd78b1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.056741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f059657-fc7a-40fa-a519-f3f784bd78b1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.057368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f059657-fc7a-40fa-a519-f3f784bd78b1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.058253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f059657-fc7a-40fa-a519-f3f784bd78b1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.059445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f059657-fc7a-40fa-a519-f3f784bd78b1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.060036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f059657-fc7a-40fa-a519-f3f784bd78b1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.445108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ab534d64-d373-47da-b620-787340f5ae41 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.454220 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ab534d64-d373-47da-b620-787340f5ae41 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.423127 Oct 04 18:04:48.454816 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 456/902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:48.459560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f045903-1e78-41a5-b084-3ba93d2c86bc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.460060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4f045903-1e78-41a5-b084-3ba93d2c86bc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.461749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f059657-fc7a-40fa-a519-f3f784bd78b1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.468507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f045903-1e78-41a5-b084-3ba93d2c86bc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.468507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f045903-1e78-41a5-b084-3ba93d2c86bc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.468507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f045903-1e78-41a5-b084-3ba93d2c86bc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.468842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f045903-1e78-41a5-b084-3ba93d2c86bc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.469107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f045903-1e78-41a5-b084-3ba93d2c86bc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.469541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f045903-1e78-41a5-b084-3ba93d2c86bc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.478442 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f059657-fc7a-40fa-a519-f3f784bd78b1 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.446143 Oct 04 18:04:48.480006 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 447/903] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:48.487582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8e943e95-2ec0-46ee-b088-293d790ed829 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.506637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.server_groups [None req-8e943e95-2ec0-46ee-b088-293d790ed829 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Querying cell c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) for 2 instances {{(pid=122331) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:04:48.507312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e943e95-2ec0-46ee-b088-293d790ed829 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.508268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e943e95-2ec0-46ee-b088-293d790ed829 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.508268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e943e95-2ec0-46ee-b088-293d790ed829 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.542975 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8e943e95-2ec0-46ee-b088-293d790ed829 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/ac2be6be-9103-49c4-9b7e-c4eba285ae5c" status: 200 len: 271 microversion: 2.1 time: 0.061295 Oct 04 18:04:48.549421 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 448/904] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/os-server-groups/ac2be6be-9103-49c4-9b7e-c4eba285ae5c => generated 271 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:48.550075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-330b82c5-babd-476d-ab39-e2deee289fb8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.550685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-330b82c5-babd-476d-ab39-e2deee289fb8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.558324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-330b82c5-babd-476d-ab39-e2deee289fb8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.558861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-330b82c5-babd-476d-ab39-e2deee289fb8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.559345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-330b82c5-babd-476d-ab39-e2deee289fb8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.560121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-330b82c5-babd-476d-ab39-e2deee289fb8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.560585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-330b82c5-babd-476d-ab39-e2deee289fb8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.563777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-330b82c5-babd-476d-ab39-e2deee289fb8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.713770 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f045903-1e78-41a5-b084-3ba93d2c86bc tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257745 Oct 04 18:04:48.715543 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 457/905] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed/os-interface => generated 284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:48.721741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b158158e-10f5-4ce5-8905-0915be34fda2 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.722663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b158158e-10f5-4ce5-8905-0915be34fda2 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.731903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b158158e-10f5-4ce5-8905-0915be34fda2 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.732608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b158158e-10f5-4ce5-8905-0915be34fda2 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.733209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b158158e-10f5-4ce5-8905-0915be34fda2 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.734117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b158158e-10f5-4ce5-8905-0915be34fda2 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.735413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b158158e-10f5-4ce5-8905-0915be34fda2 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.736022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b158158e-10f5-4ce5-8905-0915be34fda2 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.077094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-330b82c5-babd-476d-ab39-e2deee289fb8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:49.093460 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-330b82c5-babd-476d-ab39-e2deee289fb8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1470 microversion: 2.1 time: 0.548474 Oct 04 18:04:49.094294 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 449/906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1470 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:49.117756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fb79f94f-bf74-4703-a1b7-9272c6089b04 req-6a724c85-808e-4936-9147-3e94fd89ffb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc68e22-19de-42cd-aae6-efc5d6218e8c", "tag": "c2427d5a-9159-4150-8502-801eeb7afc45"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:49.140959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fb79f94f-bf74-4703-a1b7-9272c6089b04 req-6a724c85-808e-4936-9147-3e94fd89ffb7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.141449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fb79f94f-bf74-4703-a1b7-9272c6089b04 req-6a724c85-808e-4936-9147-3e94fd89ffb7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.141879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fb79f94f-bf74-4703-a1b7-9272c6089b04 req-6a724c85-808e-4936-9147-3e94fd89ffb7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.166214 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fb79f94f-bf74-4703-a1b7-9272c6089b04 req-6a724c85-808e-4936-9147-3e94fd89ffb7 service nova] Creating event network-changed:c2427d5a-9159-4150-8502-801eeb7afc45 for instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c on n-h1-850499-14 Oct 04 18:04:49.184239 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fb79f94f-bf74-4703-a1b7-9272c6089b04 req-6a724c85-808e-4936-9147-3e94fd89ffb7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068390 Oct 04 18:04:49.185744 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 450/907] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:49.341191 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b158158e-10f5-4ce5-8905-0915be34fda2 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 200 len: 1621 microversion: 2.1 time: 0.624321 Oct 04 18:04:49.367972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce1443f8-c8af-4e9f-a6d6-49e5f9cb3ee4 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.369105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ce1443f8-c8af-4e9f-a6d6-49e5f9cb3ee4 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] [instance: cd85fc2b-0943-4616-8b69-f8e5825e400a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:49.374550 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 458/908] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 1621 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:49.376978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce1443f8-c8af-4e9f-a6d6-49e5f9cb3ee4 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.377680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce1443f8-c8af-4e9f-a6d6-49e5f9cb3ee4 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.378290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce1443f8-c8af-4e9f-a6d6-49e5f9cb3ee4 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.379197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce1443f8-c8af-4e9f-a6d6-49e5f9cb3ee4 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.383617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce1443f8-c8af-4e9f-a6d6-49e5f9cb3ee4 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.384537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce1443f8-c8af-4e9f-a6d6-49e5f9cb3ee4 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.477520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bfe36e98-2804-4cb4-a10e-c39880ec61db tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.478083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bfe36e98-2804-4cb4-a10e-c39880ec61db tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:49.486557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe36e98-2804-4cb4-a10e-c39880ec61db tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.487148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe36e98-2804-4cb4-a10e-c39880ec61db tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.487553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe36e98-2804-4cb4-a10e-c39880ec61db tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.488262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe36e98-2804-4cb4-a10e-c39880ec61db tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.488721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe36e98-2804-4cb4-a10e-c39880ec61db tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.489149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe36e98-2804-4cb4-a10e-c39880ec61db tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.752965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bfe36e98-2804-4cb4-a10e-c39880ec61db tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:49.767380 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce1443f8-c8af-4e9f-a6d6-49e5f9cb3ee4 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a" status: 200 len: 1620 microversion: 2.1 time: 0.397752 Oct 04 18:04:49.768660 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 451/909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a => generated 1620 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:49.776240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac805d9b-3c22-478b-988a-b1aa91df2cd0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.779133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ac805d9b-3c22-478b-988a-b1aa91df2cd0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:49.786428 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bfe36e98-2804-4cb4-a10e-c39880ec61db tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.312609 Oct 04 18:04:49.796808 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 459/910] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:49.812252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac805d9b-3c22-478b-988a-b1aa91df2cd0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.812869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac805d9b-3c22-478b-988a-b1aa91df2cd0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.813324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac805d9b-3c22-478b-988a-b1aa91df2cd0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.822989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac805d9b-3c22-478b-988a-b1aa91df2cd0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.823690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac805d9b-3c22-478b-988a-b1aa91df2cd0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.824239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac805d9b-3c22-478b-988a-b1aa91df2cd0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.983730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-201442264", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "aa79c4dc-6409-43e7-85da-46dde9db68bd"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:50.052690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:50.149654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ac805d9b-3c22-478b-988a-b1aa91df2cd0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.159472 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ac805d9b-3c22-478b-988a-b1aa91df2cd0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.389403 Oct 04 18:04:50.170843 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 452/911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:50.176248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eff9ea22-7830-4599-af49-142aa6f63796 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:50.177232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eff9ea22-7830-4599-af49-142aa6f63796 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:50.193535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff9ea22-7830-4599-af49-142aa6f63796 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.194460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff9ea22-7830-4599-af49-142aa6f63796 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.195160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff9ea22-7830-4599-af49-142aa6f63796 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.196194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff9ea22-7830-4599-af49-142aa6f63796 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.196909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff9ea22-7830-4599-af49-142aa6f63796 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.197586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff9ea22-7830-4599-af49-142aa6f63796 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.555187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eff9ea22-7830-4599-af49-142aa6f63796 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.565600 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eff9ea22-7830-4599-af49-142aa6f63796 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1470 microversion: 2.1 time: 0.393137 Oct 04 18:04:50.568854 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 453/912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:50 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1470 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:50.646899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:50.650156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:50.650886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:50.651552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:50.652897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:50.689770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.694670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.695327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.697505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.698171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.698818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.749882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:50.761051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:50.798247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:50.800524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:50.817467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:50.819919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-067c9a52-dd36-447d-9fa8-a16b92e10d0f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:50.821945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-067c9a52-dd36-447d-9fa8-a16b92e10d0f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:50.836796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-067c9a52-dd36-447d-9fa8-a16b92e10d0f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.837672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-067c9a52-dd36-447d-9fa8-a16b92e10d0f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.839570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-067c9a52-dd36-447d-9fa8-a16b92e10d0f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.840614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-067c9a52-dd36-447d-9fa8-a16b92e10d0f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.841600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-067c9a52-dd36-447d-9fa8-a16b92e10d0f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.844711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-067c9a52-dd36-447d-9fa8-a16b92e10d0f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.923690 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10a70bd8-300e-4cd2-83ac-6cca2181fdbb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945008 Oct 04 18:04:50.925897 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 460/913] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:50.965812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-61449578-ce44-46fc-8a46-81ab27f58425 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:50.967105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-61449578-ce44-46fc-8a46-81ab27f58425 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.140990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61449578-ce44-46fc-8a46-81ab27f58425 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:51.156395 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-61449578-ce44-46fc-8a46-81ab27f58425 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1216 microversion: 2.1 time: 0.215750 Oct 04 18:04:51.157815 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 461/914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:50 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1216 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:51.209125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4fce201-9dee-40fc-bf8b-2224ed286cdf tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.210121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f4fce201-9dee-40fc-bf8b-2224ed286cdf tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.224788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4fce201-9dee-40fc-bf8b-2224ed286cdf tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.227847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4fce201-9dee-40fc-bf8b-2224ed286cdf tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.228868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4fce201-9dee-40fc-bf8b-2224ed286cdf tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.229680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4fce201-9dee-40fc-bf8b-2224ed286cdf tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.230899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4fce201-9dee-40fc-bf8b-2224ed286cdf tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.232825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4fce201-9dee-40fc-bf8b-2224ed286cdf tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.299465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-067c9a52-dd36-447d-9fa8-a16b92e10d0f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:51.307486 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-067c9a52-dd36-447d-9fa8-a16b92e10d0f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.495845 Oct 04 18:04:51.308171 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 454/915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:50 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:51.563881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f4fce201-9dee-40fc-bf8b-2224ed286cdf tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:51.576828 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f4fce201-9dee-40fc-bf8b-2224ed286cdf tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.381979 Oct 04 18:04:51.588102 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 462/916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:51 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:51.601639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-15a76295-cde3-4446-b46d-6fbe2d5c10b1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.602619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15a76295-cde3-4446-b46d-6fbe2d5c10b1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.612403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a76295-cde3-4446-b46d-6fbe2d5c10b1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.617734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ac591f0-dd03-4b96-8dfa-64b51988f079 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.618840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a76295-cde3-4446-b46d-6fbe2d5c10b1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.623435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a76295-cde3-4446-b46d-6fbe2d5c10b1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.625524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a76295-cde3-4446-b46d-6fbe2d5c10b1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.625524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a76295-cde3-4446-b46d-6fbe2d5c10b1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.625524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a76295-cde3-4446-b46d-6fbe2d5c10b1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.628370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8ac591f0-dd03-4b96-8dfa-64b51988f079 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.648958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ac591f0-dd03-4b96-8dfa-64b51988f079 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.649623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ac591f0-dd03-4b96-8dfa-64b51988f079 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.649894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ac591f0-dd03-4b96-8dfa-64b51988f079 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.650617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ac591f0-dd03-4b96-8dfa-64b51988f079 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.664874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ac591f0-dd03-4b96-8dfa-64b51988f079 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.665450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ac591f0-dd03-4b96-8dfa-64b51988f079 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.717484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:51.741586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:52.253273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8ac591f0-dd03-4b96-8dfa-64b51988f079 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:52.276721 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8ac591f0-dd03-4b96-8dfa-64b51988f079 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1482 microversion: 2.1 time: 0.660657 Oct 04 18:04:52.279410 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 463/917] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:51 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1482 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:52.298867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6947da38-dc71-47d0-a485-a83fdf938ede req-d2133c72-8a6f-4544-8f5e-15d3a554abe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b911ede1-8b72-4521-a647-8ea9dd3232ed", "tag": "52faaf09-6573-4cc6-8bc9-5bdc801746cc"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:52.344317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6947da38-dc71-47d0-a485-a83fdf938ede req-d2133c72-8a6f-4544-8f5e-15d3a554abe3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.346734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6947da38-dc71-47d0-a485-a83fdf938ede req-d2133c72-8a6f-4544-8f5e-15d3a554abe3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.348080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6947da38-dc71-47d0-a485-a83fdf938ede req-d2133c72-8a6f-4544-8f5e-15d3a554abe3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.396133 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6947da38-dc71-47d0-a485-a83fdf938ede req-d2133c72-8a6f-4544-8f5e-15d3a554abe3 service nova] Creating event network-changed:52faaf09-6573-4cc6-8bc9-5bdc801746cc for instance b911ede1-8b72-4521-a647-8ea9dd3232ed on n-h2-850499-14 Oct 04 18:04:52.409404 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6947da38-dc71-47d0-a485-a83fdf938ede req-d2133c72-8a6f-4544-8f5e-15d3a554abe3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128363 Oct 04 18:04:52.410793 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 464/918] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:52.422167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0e569fed-8c5d-4256-80f8-c8dde7fa926c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:52.423044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0e569fed-8c5d-4256-80f8-c8dde7fa926c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:52.430363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e569fed-8c5d-4256-80f8-c8dde7fa926c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.431051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e569fed-8c5d-4256-80f8-c8dde7fa926c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.431760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e569fed-8c5d-4256-80f8-c8dde7fa926c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.432662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e569fed-8c5d-4256-80f8-c8dde7fa926c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.433679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e569fed-8c5d-4256-80f8-c8dde7fa926c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.434227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e569fed-8c5d-4256-80f8-c8dde7fa926c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.704331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-15a76295-cde3-4446-b46d-6fbe2d5c10b1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:52.717183 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-15a76295-cde3-4446-b46d-6fbe2d5c10b1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1470 microversion: 2.1 time: 1.120411 Oct 04 18:04:52.718461 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 455/919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:51 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1470 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:52.739018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-028a8756-8f32-4798-bc3e-b801bc49ae93 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:52.739635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-028a8756-8f32-4798-bc3e-b801bc49ae93 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:52.756711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028a8756-8f32-4798-bc3e-b801bc49ae93 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.759593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028a8756-8f32-4798-bc3e-b801bc49ae93 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.760326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028a8756-8f32-4798-bc3e-b801bc49ae93 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.762483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028a8756-8f32-4798-bc3e-b801bc49ae93 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.764474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028a8756-8f32-4798-bc3e-b801bc49ae93 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.766075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028a8756-8f32-4798-bc3e-b801bc49ae93 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.771953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0e569fed-8c5d-4256-80f8-c8dde7fa926c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:52.782492 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0e569fed-8c5d-4256-80f8-c8dde7fa926c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1212 microversion: 2.1 time: 0.369820 Oct 04 18:04:52.783802 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 465/920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:52 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1212 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:52.788775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0b4afa02-c444-4d2e-8e68-f259e7f7ed25 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:52.789604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0b4afa02-c444-4d2e-8e68-f259e7f7ed25 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:52.796244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b4afa02-c444-4d2e-8e68-f259e7f7ed25 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.796982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b4afa02-c444-4d2e-8e68-f259e7f7ed25 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.797672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b4afa02-c444-4d2e-8e68-f259e7f7ed25 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.798551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b4afa02-c444-4d2e-8e68-f259e7f7ed25 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.799205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b4afa02-c444-4d2e-8e68-f259e7f7ed25 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.799786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b4afa02-c444-4d2e-8e68-f259e7f7ed25 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.233749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-028a8756-8f32-4798-bc3e-b801bc49ae93 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:53.246401 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-028a8756-8f32-4798-bc3e-b801bc49ae93 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.523723 Oct 04 18:04:53.247567 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 456/921] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:52 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:53.252838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0b4afa02-c444-4d2e-8e68-f259e7f7ed25 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:53.280156 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0b4afa02-c444-4d2e-8e68-f259e7f7ed25 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.494832 Oct 04 18:04:53.281537 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 466/922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:52 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:53.742747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c2723659-fac3-4f91-a42e-91b79c0fd29a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:53.743688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c2723659-fac3-4f91-a42e-91b79c0fd29a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:53.757135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2723659-fac3-4f91-a42e-91b79c0fd29a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.759519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2723659-fac3-4f91-a42e-91b79c0fd29a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.760833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2723659-fac3-4f91-a42e-91b79c0fd29a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.762573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2723659-fac3-4f91-a42e-91b79c0fd29a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.765017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2723659-fac3-4f91-a42e-91b79c0fd29a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.766807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2723659-fac3-4f91-a42e-91b79c0fd29a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.773233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:53.810312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-028bdf01-13c8-4da2-b7a4-7bdbca34d71d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:53.813101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-028bdf01-13c8-4da2-b7a4-7bdbca34d71d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:53.837740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-028bdf01-13c8-4da2-b7a4-7bdbca34d71d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.838613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-028bdf01-13c8-4da2-b7a4-7bdbca34d71d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.839144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-028bdf01-13c8-4da2-b7a4-7bdbca34d71d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.844924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-028bdf01-13c8-4da2-b7a4-7bdbca34d71d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.845436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-028bdf01-13c8-4da2-b7a4-7bdbca34d71d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.845887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-028bdf01-13c8-4da2-b7a4-7bdbca34d71d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.115498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-028bdf01-13c8-4da2-b7a4-7bdbca34d71d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.126155 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-028bdf01-13c8-4da2-b7a4-7bdbca34d71d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1268 microversion: 2.1 time: 0.322879 Oct 04 18:04:54.126973 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 467/923] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:53 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1268 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:54.309396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f14a94b-081e-4034-88d4-c1422c01c762 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:54.312370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7f14a94b-081e-4034-88d4-c1422c01c762 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:54.336000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c2723659-fac3-4f91-a42e-91b79c0fd29a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.345394 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c2723659-fac3-4f91-a42e-91b79c0fd29a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1462 microversion: 2.1 time: 0.606842 Oct 04 18:04:54.350525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f14a94b-081e-4034-88d4-c1422c01c762 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.351175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f14a94b-081e-4034-88d4-c1422c01c762 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.353414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f14a94b-081e-4034-88d4-c1422c01c762 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.355119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f14a94b-081e-4034-88d4-c1422c01c762 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.356226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f14a94b-081e-4034-88d4-c1422c01c762 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.357273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f14a94b-081e-4034-88d4-c1422c01c762 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.363808 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 457/924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:53 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1462 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:54.385874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-202fb51f-ecc8-4a09-9a60-114a7b6160bc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:54.387704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-202fb51f-ecc8-4a09-9a60-114a7b6160bc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:54.397087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:54.413385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202fb51f-ecc8-4a09-9a60-114a7b6160bc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.415651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202fb51f-ecc8-4a09-9a60-114a7b6160bc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.416577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202fb51f-ecc8-4a09-9a60-114a7b6160bc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.420290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202fb51f-ecc8-4a09-9a60-114a7b6160bc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.424915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202fb51f-ecc8-4a09-9a60-114a7b6160bc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.425616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202fb51f-ecc8-4a09-9a60-114a7b6160bc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.878380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-202fb51f-ecc8-4a09-9a60-114a7b6160bc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.887158 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-202fb51f-ecc8-4a09-9a60-114a7b6160bc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.521517 Oct 04 18:04:54.887736 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 458/925] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:54 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:54.893019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01bae9c9-a665-4c04-bc7a-55098e20c2fa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:54.893720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01bae9c9-a665-4c04-bc7a-55098e20c2fa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:54.905430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01bae9c9-a665-4c04-bc7a-55098e20c2fa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.906348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01bae9c9-a665-4c04-bc7a-55098e20c2fa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.907053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01bae9c9-a665-4c04-bc7a-55098e20c2fa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.908013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01bae9c9-a665-4c04-bc7a-55098e20c2fa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.908698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01bae9c9-a665-4c04-bc7a-55098e20c2fa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.909349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01bae9c9-a665-4c04-bc7a-55098e20c2fa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.913463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f14a94b-081e-4034-88d4-c1422c01c762 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.918844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:54.931303 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f14a94b-081e-4034-88d4-c1422c01c762 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.646216 Oct 04 18:04:54.954351 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 468/926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:54 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:54.960786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a0c61ee3-cb76-4a50-b70b-247fa96bdeee req-814d6334-ca61-475c-b335-a965a85ab69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2505e8f7-6362-487e-9099-1dfe07254a31", "name": "network-vif-plugged", "status": "completed", "tag": "c85dbcc1-f6de-40b4-b2fa-919f947c77f4"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:54.975775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a0c61ee3-cb76-4a50-b70b-247fa96bdeee req-814d6334-ca61-475c-b335-a965a85ab69b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.976511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a0c61ee3-cb76-4a50-b70b-247fa96bdeee req-814d6334-ca61-475c-b335-a965a85ab69b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.977167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a0c61ee3-cb76-4a50-b70b-247fa96bdeee req-814d6334-ca61-475c-b335-a965a85ab69b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.997775 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a0c61ee3-cb76-4a50-b70b-247fa96bdeee req-814d6334-ca61-475c-b335-a965a85ab69b service nova] Creating event network-vif-plugged:c85dbcc1-f6de-40b4-b2fa-919f947c77f4 for instance 2505e8f7-6362-487e-9099-1dfe07254a31 on n-h2-850499-14 Oct 04 18:04:55.010682 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a0c61ee3-cb76-4a50-b70b-247fa96bdeee req-814d6334-ca61-475c-b335-a965a85ab69b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054546 Oct 04 18:04:55.015009 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 469/927] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:55.159430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2e4d4eac-ed9e-44b8-9144-47479a8e3ef4 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:55.161178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2e4d4eac-ed9e-44b8-9144-47479a8e3ef4 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:55.170813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e4d4eac-ed9e-44b8-9144-47479a8e3ef4 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.172084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e4d4eac-ed9e-44b8-9144-47479a8e3ef4 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.172901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e4d4eac-ed9e-44b8-9144-47479a8e3ef4 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.173999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e4d4eac-ed9e-44b8-9144-47479a8e3ef4 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.174809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e4d4eac-ed9e-44b8-9144-47479a8e3ef4 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.175556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e4d4eac-ed9e-44b8-9144-47479a8e3ef4 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.424437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2e4d4eac-ed9e-44b8-9144-47479a8e3ef4 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:55.441047 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2e4d4eac-ed9e-44b8-9144-47479a8e3ef4 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1274 microversion: 2.1 time: 0.285951 Oct 04 18:04:55.442273 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 470/928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:55 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1274 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:55.537630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01bae9c9-a665-4c04-bc7a-55098e20c2fa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:55.547813 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01bae9c9-a665-4c04-bc7a-55098e20c2fa tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1462 microversion: 2.1 time: 0.658514 Oct 04 18:04:55.556839 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 459/929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:54 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1462 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:55.586120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed207ba1-5215-4fda-ba04-ca696203c4da tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'create', calling method: .version_select at 0x7fd4d1e4a0d0>, body: {"keypair": {"name": "tempest-keypair-430049581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjc23vOkimbVKFa7YOthleby9aQ3eG57ZoIalwrEEGQUedX2Mh/zP9slSUkgTbYDELMCQtlGMEgoARSLIvhEP8SHlJkEQVO49nvRxviIW8oVTEP7KHXCnsZha1NiICXNA=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:55.608870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ed207ba1-5215-4fda-ba04-ca696203c4da tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:55.615773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ed207ba1-5215-4fda-ba04-ca696203c4da tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for user d7458740d4be4cedaa01bea94ba992d2 and project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:55.649554 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed207ba1-5215-4fda-ba04-ca696203c4da tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067350 Oct 04 18:04:55.651458 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 471/930] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:04:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:55.912474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94ba8a22-d732-4494-968b-4da31606ca0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:55.913060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-94ba8a22-d732-4494-968b-4da31606ca0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:55.923481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94ba8a22-d732-4494-968b-4da31606ca0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.924948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94ba8a22-d732-4494-968b-4da31606ca0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.925743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94ba8a22-d732-4494-968b-4da31606ca0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.926921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94ba8a22-d732-4494-968b-4da31606ca0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.927873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94ba8a22-d732-4494-968b-4da31606ca0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.928468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94ba8a22-d732-4494-968b-4da31606ca0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.961953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-491ab29f-bdb7-4add-aa27-e4e7073d08bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:55.962742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-491ab29f-bdb7-4add-aa27-e4e7073d08bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:55.972877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-491ab29f-bdb7-4add-aa27-e4e7073d08bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.973382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-491ab29f-bdb7-4add-aa27-e4e7073d08bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.973827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-491ab29f-bdb7-4add-aa27-e4e7073d08bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.974542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-491ab29f-bdb7-4add-aa27-e4e7073d08bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.975021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-491ab29f-bdb7-4add-aa27-e4e7073d08bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.975449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-491ab29f-bdb7-4add-aa27-e4e7073d08bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.332853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-94ba8a22-d732-4494-968b-4da31606ca0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:56.373597 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-94ba8a22-d732-4494-968b-4da31606ca0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.465691 Oct 04 18:04:56.380384 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 460/931] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:55 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:56.397087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-491ab29f-bdb7-4add-aa27-e4e7073d08bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:56.407213 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-491ab29f-bdb7-4add-aa27-e4e7073d08bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1368 microversion: 2.1 time: 0.449282 Oct 04 18:04:56.419463 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 472/932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:55 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1368 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:56.466841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d500965-2d6e-4288-a14d-2c9fe2ca4b7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:56.467790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5d500965-2d6e-4288-a14d-2c9fe2ca4b7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:56.475169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d500965-2d6e-4288-a14d-2c9fe2ca4b7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.475937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d500965-2d6e-4288-a14d-2c9fe2ca4b7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.476557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d500965-2d6e-4288-a14d-2c9fe2ca4b7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.477694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d500965-2d6e-4288-a14d-2c9fe2ca4b7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.478334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d500965-2d6e-4288-a14d-2c9fe2ca4b7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.479170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d500965-2d6e-4288-a14d-2c9fe2ca4b7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.720507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d500965-2d6e-4288-a14d-2c9fe2ca4b7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:56.742034 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d500965-2d6e-4288-a14d-2c9fe2ca4b7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1316 microversion: 2.1 time: 0.279354 Oct 04 18:04:56.744299 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 461/933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:56 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:57.403168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e008d4b-e1d4-4c43-a621-058a53733d4d tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.405268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6e008d4b-e1d4-4c43-a621-058a53733d4d tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:57.415496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e008d4b-e1d4-4c43-a621-058a53733d4d tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.416006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e008d4b-e1d4-4c43-a621-058a53733d4d tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.416461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e008d4b-e1d4-4c43-a621-058a53733d4d tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.417217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e008d4b-e1d4-4c43-a621-058a53733d4d tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.417688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e008d4b-e1d4-4c43-a621-058a53733d4d tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.418121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e008d4b-e1d4-4c43-a621-058a53733d4d tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.438346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fcf1d63b-5a7c-468a-b506-28b393142e31 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.439599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fcf1d63b-5a7c-468a-b506-28b393142e31 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:57.447316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf1d63b-5a7c-468a-b506-28b393142e31 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.447813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf1d63b-5a7c-468a-b506-28b393142e31 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.448975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf1d63b-5a7c-468a-b506-28b393142e31 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.449860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf1d63b-5a7c-468a-b506-28b393142e31 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.450487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf1d63b-5a7c-468a-b506-28b393142e31 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.451109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf1d63b-5a7c-468a-b506-28b393142e31 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.938584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6e008d4b-e1d4-4c43-a621-058a53733d4d tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:57.949541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fcf1d63b-5a7c-468a-b506-28b393142e31 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:57.968017 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fcf1d63b-5a7c-468a-b506-28b393142e31 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1557 microversion: 2.1 time: 0.530989 Oct 04 18:04:57.969791 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e008d4b-e1d4-4c43-a621-058a53733d4d tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.569883 Oct 04 18:04:57.971725 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 462/934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1557 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:57.973574 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 473/935] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:57.977943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9007b480-302a-42b0-88be-18299b9ba8da tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.979279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9007b480-302a-42b0-88be-18299b9ba8da tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:57.986712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9007b480-302a-42b0-88be-18299b9ba8da tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.987644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9007b480-302a-42b0-88be-18299b9ba8da tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.988302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9007b480-302a-42b0-88be-18299b9ba8da tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.990254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9007b480-302a-42b0-88be-18299b9ba8da tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.991059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9007b480-302a-42b0-88be-18299b9ba8da tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.991748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9007b480-302a-42b0-88be-18299b9ba8da tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.016337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bf8bcc82-4520-4209-a817-8f5822fc8cc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:58.017498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bf8bcc82-4520-4209-a817-8f5822fc8cc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:58.040100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf8bcc82-4520-4209-a817-8f5822fc8cc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.041414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf8bcc82-4520-4209-a817-8f5822fc8cc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.042402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf8bcc82-4520-4209-a817-8f5822fc8cc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.045035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf8bcc82-4520-4209-a817-8f5822fc8cc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.048392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf8bcc82-4520-4209-a817-8f5822fc8cc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.052769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf8bcc82-4520-4209-a817-8f5822fc8cc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.220640 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bf8bcc82-4520-4209-a817-8f5822fc8cc6 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211875 Oct 04 18:04:58.221258 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 474/936] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:04:58 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:58.437754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9007b480-302a-42b0-88be-18299b9ba8da tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:58.460626 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9007b480-302a-42b0-88be-18299b9ba8da tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1316 microversion: 2.1 time: 0.487361 Oct 04 18:04:58.465055 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 463/937] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:58.502396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1b9fb0ba-9a7a-4c0f-b31d-b186e10f8de8 req-a2e547d6-c19e-467a-b5b8-534a3905533a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae9ebd3-ad90-4235-a6c0-58bb69a748d4", "tag": "9ed1f26f-430d-4158-be06-f80de6cb8a8e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:58.516636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1b9fb0ba-9a7a-4c0f-b31d-b186e10f8de8 req-a2e547d6-c19e-467a-b5b8-534a3905533a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.517469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1b9fb0ba-9a7a-4c0f-b31d-b186e10f8de8 req-a2e547d6-c19e-467a-b5b8-534a3905533a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.518387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1b9fb0ba-9a7a-4c0f-b31d-b186e10f8de8 req-a2e547d6-c19e-467a-b5b8-534a3905533a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.556081 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1b9fb0ba-9a7a-4c0f-b31d-b186e10f8de8 req-a2e547d6-c19e-467a-b5b8-534a3905533a service nova] Creating event network-changed:9ed1f26f-430d-4158-be06-f80de6cb8a8e for instance 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 on n-h2-850499-14 Oct 04 18:04:58.581440 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1b9fb0ba-9a7a-4c0f-b31d-b186e10f8de8 req-a2e547d6-c19e-467a-b5b8-534a3905533a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082343 Oct 04 18:04:58.583717 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 475/938] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:59.004338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7571a7b4-6e3a-4508-8cd5-db430df88397 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.006479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7571a7b4-6e3a-4508-8cd5-db430df88397 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:59.022906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7571a7b4-6e3a-4508-8cd5-db430df88397 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.033738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7571a7b4-6e3a-4508-8cd5-db430df88397 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.034430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7571a7b4-6e3a-4508-8cd5-db430df88397 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.036778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7571a7b4-6e3a-4508-8cd5-db430df88397 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.049415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7571a7b4-6e3a-4508-8cd5-db430df88397 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.050704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7571a7b4-6e3a-4508-8cd5-db430df88397 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.293562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d76429a2-ed07-4f80-b218-4f4f8b16b677 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '.version_select at 0x7fd4d1fd0f70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.297375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d76429a2-ed07-4f80-b218-4f4f8b16b677 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.297869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d76429a2-ed07-4f80-b218-4f4f8b16b677 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.298307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d76429a2-ed07-4f80-b218-4f4f8b16b677 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.320473 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d76429a2-ed07-4f80-b218-4f4f8b16b677 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1586 microversion: 2.1 time: 0.031799 Oct 04 18:04:59.331402 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 476/939] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/os-migrations => generated 1586 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:59.350660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b48e60a6-d742-4045-bc35-5bea5d5653d8 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.359904 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b48e60a6-d742-4045-bc35-5bea5d5653d8 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015365 Oct 04 18:04:59.360482 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 477/940] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:59.374526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d2367f76-6e30-4d7b-bc6b-624c64542780 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1822935054", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:59.382630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7571a7b4-6e3a-4508-8cd5-db430df88397 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:59.402389 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7571a7b4-6e3a-4508-8cd5-db430df88397 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.404781 Oct 04 18:04:59.404308 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 464/941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:58 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:59.442031 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d2367f76-6e30-4d7b-bc6b-624c64542780 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.072090 Oct 04 18:04:59.449929 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 478/942] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 4 18:04:59 2022] POST /compute/v2.1/flavors => generated 499 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:59.457280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aa7eb130-615d-481e-9a73-6458b204caa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.467796 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aa7eb130-615d-481e-9a73-6458b204caa2 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016526 Oct 04 18:04:59.473679 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 465/943] 10.222.0.18 () {58 vars in 1182 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:59.489930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f37aba17-2774-498d-bb94-f4b862ee44b1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.490670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f37aba17-2774-498d-bb94-f4b862ee44b1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:59.497909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37aba17-2774-498d-bb94-f4b862ee44b1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.498404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37aba17-2774-498d-bb94-f4b862ee44b1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.499059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37aba17-2774-498d-bb94-f4b862ee44b1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.500055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37aba17-2774-498d-bb94-f4b862ee44b1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.500667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37aba17-2774-498d-bb94-f4b862ee44b1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.501369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f37aba17-2774-498d-bb94-f4b862ee44b1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.629345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2117243509", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:59.698758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:59.874687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f37aba17-2774-498d-bb94-f4b862ee44b1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:59.891323 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f37aba17-2774-498d-bb94-f4b862ee44b1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1316 microversion: 2.1 time: 0.405255 Oct 04 18:04:59.893922 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 479/944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:00.452854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-89c2064b-fa9d-47e4-91f4-7d4029964784 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.454216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-89c2064b-fa9d-47e4-91f4-7d4029964784 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:00.462911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89c2064b-fa9d-47e4-91f4-7d4029964784 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.464025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89c2064b-fa9d-47e4-91f4-7d4029964784 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.464729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89c2064b-fa9d-47e4-91f4-7d4029964784 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.465860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89c2064b-fa9d-47e4-91f4-7d4029964784 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.467360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89c2064b-fa9d-47e4-91f4-7d4029964784 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.470300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89c2064b-fa9d-47e4-91f4-7d4029964784 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.520932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:00.521556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:00.522148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:00.522603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:00.523315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:00.543708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.544201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.544896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.551431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.552019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.555593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.618771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:00.631637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for user d7458740d4be4cedaa01bea94ba992d2 and project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:00.649676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:00.653914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:00.721879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:00.733676 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20df0e12-c6f3-4a2a-8eb5-3c087972da46 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.109043 Oct 04 18:05:00.735447 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 466/945] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:00.748210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17bd0fce-2775-4b72-8cdb-a7e9e448b71e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.750112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17bd0fce-2775-4b72-8cdb-a7e9e448b71e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:00.902588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17bd0fce-2775-4b72-8cdb-a7e9e448b71e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.925490 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17bd0fce-2775-4b72-8cdb-a7e9e448b71e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1279 microversion: 2.1 time: 0.179812 Oct 04 18:05:00.926691 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 467/946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:00 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1279 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:00.936399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a10a58e1-eb8b-4964-8108-948b2f136160 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.937483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a10a58e1-eb8b-4964-8108-948b2f136160 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:00.943200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-89c2064b-fa9d-47e4-91f4-7d4029964784 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.950101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10a58e1-eb8b-4964-8108-948b2f136160 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.950745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10a58e1-eb8b-4964-8108-948b2f136160 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.952365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10a58e1-eb8b-4964-8108-948b2f136160 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.953209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10a58e1-eb8b-4964-8108-948b2f136160 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.956470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10a58e1-eb8b-4964-8108-948b2f136160 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.959197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10a58e1-eb8b-4964-8108-948b2f136160 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.961776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-89c2064b-fa9d-47e4-91f4-7d4029964784 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.539121 Oct 04 18:05:00.962434 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 480/947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:00 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:00.970345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ffb787d8-579d-4c68-8fc5-134a6371f703 req-3164e416-3900-4f14-8962-b0706c7413d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2505e8f7-6362-487e-9099-1dfe07254a31", "tag": "c85dbcc1-f6de-40b4-b2fa-919f947c77f4"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:01.016350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ffb787d8-579d-4c68-8fc5-134a6371f703 req-3164e416-3900-4f14-8962-b0706c7413d4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.016864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ffb787d8-579d-4c68-8fc5-134a6371f703 req-3164e416-3900-4f14-8962-b0706c7413d4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.017383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ffb787d8-579d-4c68-8fc5-134a6371f703 req-3164e416-3900-4f14-8962-b0706c7413d4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.053519 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ffb787d8-579d-4c68-8fc5-134a6371f703 req-3164e416-3900-4f14-8962-b0706c7413d4 service nova] Creating event network-changed:c85dbcc1-f6de-40b4-b2fa-919f947c77f4 for instance 2505e8f7-6362-487e-9099-1dfe07254a31 on n-h2-850499-14 Oct 04 18:05:01.062707 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ffb787d8-579d-4c68-8fc5-134a6371f703 req-3164e416-3900-4f14-8962-b0706c7413d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095314 Oct 04 18:05:01.079412 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 481/948] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:01.220044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a10a58e1-eb8b-4964-8108-948b2f136160 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:01.259263 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a10a58e1-eb8b-4964-8108-948b2f136160 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1316 microversion: 2.1 time: 0.330603 Oct 04 18:05:01.278149 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 468/949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:00 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:01.955181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b4d765bd-104b-453e-a6c2-a329a2fbdd21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.958306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4d765bd-104b-453e-a6c2-a329a2fbdd21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:01.974618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4d765bd-104b-453e-a6c2-a329a2fbdd21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.975276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4d765bd-104b-453e-a6c2-a329a2fbdd21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.976216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4d765bd-104b-453e-a6c2-a329a2fbdd21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.977462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4d765bd-104b-453e-a6c2-a329a2fbdd21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.978297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4d765bd-104b-453e-a6c2-a329a2fbdd21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.979178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4d765bd-104b-453e-a6c2-a329a2fbdd21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.997396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-63620eb1-45dd-4aec-9bd8-3a914ed0abb0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.998086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-63620eb1-45dd-4aec-9bd8-3a914ed0abb0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.012321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-63620eb1-45dd-4aec-9bd8-3a914ed0abb0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.015164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-63620eb1-45dd-4aec-9bd8-3a914ed0abb0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.017535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-63620eb1-45dd-4aec-9bd8-3a914ed0abb0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.022528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-63620eb1-45dd-4aec-9bd8-3a914ed0abb0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.023653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-63620eb1-45dd-4aec-9bd8-3a914ed0abb0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.029064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-63620eb1-45dd-4aec-9bd8-3a914ed0abb0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.169972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b4d765bd-104b-453e-a6c2-a329a2fbdd21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.180992 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b4d765bd-104b-453e-a6c2-a329a2fbdd21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1331 microversion: 2.1 time: 0.234378 Oct 04 18:05:02.181575 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 482/950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1331 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:02.209206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d6751334-27a7-4081-a7fb-95efd54ff606 req-4632bb90-abe9-4b75-af75-0c720b414252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc68e22-19de-42cd-aae6-efc5d6218e8c", "name": "network-vif-plugged", "status": "completed", "tag": "c2427d5a-9159-4150-8502-801eeb7afc45"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:02.237527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d6751334-27a7-4081-a7fb-95efd54ff606 req-4632bb90-abe9-4b75-af75-0c720b414252 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.239362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d6751334-27a7-4081-a7fb-95efd54ff606 req-4632bb90-abe9-4b75-af75-0c720b414252 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.243179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d6751334-27a7-4081-a7fb-95efd54ff606 req-4632bb90-abe9-4b75-af75-0c720b414252 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.273865 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d6751334-27a7-4081-a7fb-95efd54ff606 req-4632bb90-abe9-4b75-af75-0c720b414252 service nova] Creating event network-vif-plugged:c2427d5a-9159-4150-8502-801eeb7afc45 for instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c on n-h1-850499-14 Oct 04 18:05:02.287557 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d6751334-27a7-4081-a7fb-95efd54ff606 req-4632bb90-abe9-4b75-af75-0c720b414252 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092194 Oct 04 18:05:02.290363 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 483/951] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:02.332075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b89faba0-940a-492c-b012-94b97cf40b34 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.332699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b89faba0-940a-492c-b012-94b97cf40b34 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.351431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b89faba0-940a-492c-b012-94b97cf40b34 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.351935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b89faba0-940a-492c-b012-94b97cf40b34 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.358982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b89faba0-940a-492c-b012-94b97cf40b34 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.360009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b89faba0-940a-492c-b012-94b97cf40b34 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.361314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b89faba0-940a-492c-b012-94b97cf40b34 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.361951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b89faba0-940a-492c-b012-94b97cf40b34 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.395194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-63620eb1-45dd-4aec-9bd8-3a914ed0abb0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.412826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b89faba0-940a-492c-b012-94b97cf40b34 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:02.427862 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-63620eb1-45dd-4aec-9bd8-3a914ed0abb0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.435793 Oct 04 18:05:02.437195 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 469/952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:02.454493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab5d7a74-4ab0-4749-8497-79cfe108df32 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.458854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ab5d7a74-4ab0-4749-8497-79cfe108df32 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.469224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab5d7a74-4ab0-4749-8497-79cfe108df32 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.470455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab5d7a74-4ab0-4749-8497-79cfe108df32 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.471531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab5d7a74-4ab0-4749-8497-79cfe108df32 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.473309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab5d7a74-4ab0-4749-8497-79cfe108df32 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.474043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab5d7a74-4ab0-4749-8497-79cfe108df32 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.474488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab5d7a74-4ab0-4749-8497-79cfe108df32 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.554740 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b89faba0-940a-492c-b012-94b97cf40b34 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 204 len: 0 microversion: 2.1 time: 0.259622 Oct 04 18:05:02.561808 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 484/953] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:02 2022] DELETE /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:02.579975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-01d86be8-5035-40ab-9f39-d24613789bdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.581783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-01d86be8-5035-40ab-9f39-d24613789bdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.591561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d86be8-5035-40ab-9f39-d24613789bdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.592104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d86be8-5035-40ab-9f39-d24613789bdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.592604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d86be8-5035-40ab-9f39-d24613789bdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.593337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d86be8-5035-40ab-9f39-d24613789bdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.593852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d86be8-5035-40ab-9f39-d24613789bdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.594289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d86be8-5035-40ab-9f39-d24613789bdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.654251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ab5d7a74-4ab0-4749-8497-79cfe108df32 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.662048 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ab5d7a74-4ab0-4749-8497-79cfe108df32 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1316 microversion: 2.1 time: 0.224796 Oct 04 18:05:02.662625 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 470/954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:02 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:02.818377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-01d86be8-5035-40ab-9f39-d24613789bdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.829986 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-01d86be8-5035-40ab-9f39-d24613789bdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1714 microversion: 2.1 time: 0.265520 Oct 04 18:05:02.830591 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 485/955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:02 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1714 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:02.856840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4ecc783-a174-42ba-8dc5-4ceb6e7cfc35 tempest-FloatingIPDetailsNegativeTestJSON-1379376654 tempest-FloatingIPDetailsNegativeTestJSON-1379376654-project] Calling method '.version_select at 0x7fd4d1f8af70>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.903581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-e4ecc783-a174-42ba-8dc5-4ceb6e7cfc35 tempest-FloatingIPDetailsNegativeTestJSON-1379376654 tempest-FloatingIPDetailsNegativeTestJSON-1379376654-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5c657181-4703-4db8-917d-aa0e22bda493 could not be found", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:05:02.904284 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-e4ecc783-a174-42ba-8dc5-4ceb6e7cfc35 tempest-FloatingIPDetailsNegativeTestJSON-1379376654 tempest-FloatingIPDetailsNegativeTestJSON-1379376654-project] HTTP exception thrown: Floating IP not found for ID 5c657181-4703-4db8-917d-aa0e22bda493 Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4ecc783-a174-42ba-8dc5-4ceb6e7cfc35 tempest-FloatingIPDetailsNegativeTestJSON-1379376654 tempest-FloatingIPDetailsNegativeTestJSON-1379376654-project] Request method failure captured: Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-floating-ips/5c657181-4703-4db8-917d-aa0e22bda493 HTTP/1.1 Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHXO10eMRMU4WXKH83pBQ3tJMN8p5DI8zU2wGWsi7jAmG1lotXgmlbZUrQEsa88lG-Tabv-NTGRksC7ZlZ5A8xHpP_sGHFCNRB3Pjs8szEb8U5dDUnb-pcPrrNSIlK30L3qCkmypaeKwL40MEsr5GJwNbZthfiZdH6j65b7s4dT8y2E Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 93489a5e152746b3b1d0390a28317cfa Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1379376654 Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:05:02.906218 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_93489a5e152746b3b1d0390a28317cfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/93489a5e152746b3b1d0390a28317cfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/93489a5e152746b3b1d0390a28317cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/93489a5e152746b3b1d0390a28317cfa"}]}] Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1379376654 Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 93489a5e152746b3b1d0390a28317cfa Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1379376654 Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1379376654-project Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6cc8b0f84ced4d6ba5e6343dbc6f4876 Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1379376654-project Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: exception: Floating IP not found for ID 5c657181-4703-4db8-917d-aa0e22bda493 Oct 04 18:05:02.907925 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '5c657181-4703-4db8-917d-aa0e22bda493'} Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:02.908764 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5c657181-4703-4db8-917d-aa0e22bda493 could not be found Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-013d981d-ac1b-489e-bd23-e801bb625c8a'] Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5c657181-4703-4db8-917d-aa0e22bda493. Oct 04 18:05:02.910248 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5c657181-4703-4db8-917d-aa0e22bda493 Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:02.911778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:02.913689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:02.913689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5c657181-4703-4db8-917d-aa0e22bda493 Oct 04 18:05:02.913689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:02.913689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4ecc783-a174-42ba-8dc5-4ceb6e7cfc35 tempest-FloatingIPDetailsNegativeTestJSON-1379376654 tempest-FloatingIPDetailsNegativeTestJSON-1379376654-project] Returning 404 to user: Floating IP not found for ID 5c657181-4703-4db8-917d-aa0e22bda493 {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:02.913689 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e4ecc783-a174-42ba-8dc5-4ceb6e7cfc35 tempest-FloatingIPDetailsNegativeTestJSON-1379376654 tempest-FloatingIPDetailsNegativeTestJSON-1379376654-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/5c657181-4703-4db8-917d-aa0e22bda493" status: 404 len: 111 microversion: 2.1 time: 0.244071 Oct 04 18:05:02.913689 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 471/956] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:05:02 2022] GET /compute/v2.1/os-floating-ips/5c657181-4703-4db8-917d-aa0e22bda493 => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:03.209846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78bad39f-af46-43dd-a975-314fecd48fee tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.210635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78bad39f-af46-43dd-a975-314fecd48fee tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.227451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bad39f-af46-43dd-a975-314fecd48fee tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.227951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bad39f-af46-43dd-a975-314fecd48fee tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.228395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bad39f-af46-43dd-a975-314fecd48fee tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.229270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bad39f-af46-43dd-a975-314fecd48fee tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.230193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bad39f-af46-43dd-a975-314fecd48fee tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.230669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bad39f-af46-43dd-a975-314fecd48fee tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.350488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78bad39f-af46-43dd-a975-314fecd48fee tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:03.360197 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78bad39f-af46-43dd-a975-314fecd48fee tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1339 microversion: 2.1 time: 0.154195 Oct 04 18:05:03.361052 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 486/957] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:03 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1339 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:03.460392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf67acb7-1d1d-44e0-bdc7-533a71947241 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.462513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf67acb7-1d1d-44e0-bdc7-533a71947241 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.470517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf67acb7-1d1d-44e0-bdc7-533a71947241 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.471056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf67acb7-1d1d-44e0-bdc7-533a71947241 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.471685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf67acb7-1d1d-44e0-bdc7-533a71947241 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.472415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf67acb7-1d1d-44e0-bdc7-533a71947241 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.472883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf67acb7-1d1d-44e0-bdc7-533a71947241 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.473352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf67acb7-1d1d-44e0-bdc7-533a71947241 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.658702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cf67acb7-1d1d-44e0-bdc7-533a71947241 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:03.673256 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf67acb7-1d1d-44e0-bdc7-533a71947241 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.216968 Oct 04 18:05:03.674597 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 472/958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:03 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:03.685794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3b2bb6e1-99f2-4331-ba93-ed95e1f9020a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.686676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3b2bb6e1-99f2-4331-ba93-ed95e1f9020a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.693625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6e1-99f2-4331-ba93-ed95e1f9020a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.694340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6e1-99f2-4331-ba93-ed95e1f9020a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.694991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6e1-99f2-4331-ba93-ed95e1f9020a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.695877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6e1-99f2-4331-ba93-ed95e1f9020a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.696492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6e1-99f2-4331-ba93-ed95e1f9020a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.697083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b2bb6e1-99f2-4331-ba93-ed95e1f9020a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.865411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-122c9a8b-f732-43c5-ae9a-7d90764d92b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.872561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-122c9a8b-f732-43c5-ae9a-7d90764d92b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.882735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-122c9a8b-f732-43c5-ae9a-7d90764d92b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.884408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3b2bb6e1-99f2-4331-ba93-ed95e1f9020a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:03.885520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-122c9a8b-f732-43c5-ae9a-7d90764d92b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.886289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-122c9a8b-f732-43c5-ae9a-7d90764d92b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.888691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-122c9a8b-f732-43c5-ae9a-7d90764d92b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.889689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-122c9a8b-f732-43c5-ae9a-7d90764d92b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.891255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-122c9a8b-f732-43c5-ae9a-7d90764d92b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.897095 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3b2bb6e1-99f2-4331-ba93-ed95e1f9020a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1316 microversion: 2.1 time: 0.214233 Oct 04 18:05:03.898316 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 487/959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:03 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:04.098776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-122c9a8b-f732-43c5-ae9a-7d90764d92b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:04.111220 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-122c9a8b-f732-43c5-ae9a-7d90764d92b1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1714 microversion: 2.1 time: 0.253755 Oct 04 18:05:04.119040 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 473/960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:03 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1714 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:04.384489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-393bb6ad-a666-4da5-80b8-cde74fe9fe90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:04.385253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-393bb6ad-a666-4da5-80b8-cde74fe9fe90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:04.392400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-393bb6ad-a666-4da5-80b8-cde74fe9fe90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.392964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-393bb6ad-a666-4da5-80b8-cde74fe9fe90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.393669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-393bb6ad-a666-4da5-80b8-cde74fe9fe90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.394442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-393bb6ad-a666-4da5-80b8-cde74fe9fe90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.395158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-393bb6ad-a666-4da5-80b8-cde74fe9fe90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.395796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-393bb6ad-a666-4da5-80b8-cde74fe9fe90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.485649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-393bb6ad-a666-4da5-80b8-cde74fe9fe90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:04.496475 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-393bb6ad-a666-4da5-80b8-cde74fe9fe90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1339 microversion: 2.1 time: 0.116177 Oct 04 18:05:04.512786 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 488/961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:04 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1339 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:04.701076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-25ac0a29-9e2f-4597-bb89-f78ca2fe7c1a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:04.701654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-25ac0a29-9e2f-4597-bb89-f78ca2fe7c1a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:04.708351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ac0a29-9e2f-4597-bb89-f78ca2fe7c1a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.709510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ac0a29-9e2f-4597-bb89-f78ca2fe7c1a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.710162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ac0a29-9e2f-4597-bb89-f78ca2fe7c1a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.711396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ac0a29-9e2f-4597-bb89-f78ca2fe7c1a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.711924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ac0a29-9e2f-4597-bb89-f78ca2fe7c1a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.712418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ac0a29-9e2f-4597-bb89-f78ca2fe7c1a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.905912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-25ac0a29-9e2f-4597-bb89-f78ca2fe7c1a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:04.925433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a11f450-3314-405e-a9be-1e952dc4f941 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:04.926052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4a11f450-3314-405e-a9be-1e952dc4f941 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:04.938362 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-25ac0a29-9e2f-4597-bb89-f78ca2fe7c1a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1371 microversion: 2.1 time: 0.242134 Oct 04 18:05:04.941444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a11f450-3314-405e-a9be-1e952dc4f941 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.942701 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 474/962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:04 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:04.943312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a11f450-3314-405e-a9be-1e952dc4f941 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.943831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a11f450-3314-405e-a9be-1e952dc4f941 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.944631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a11f450-3314-405e-a9be-1e952dc4f941 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.945304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a11f450-3314-405e-a9be-1e952dc4f941 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.945803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a11f450-3314-405e-a9be-1e952dc4f941 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.134183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca0ae566-b6b6-4024-87e2-e7c07de7bc06 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:05.134812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ca0ae566-b6b6-4024-87e2-e7c07de7bc06 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:05.154038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ae566-b6b6-4024-87e2-e7c07de7bc06 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.154550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ae566-b6b6-4024-87e2-e7c07de7bc06 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.155218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ae566-b6b6-4024-87e2-e7c07de7bc06 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.156314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ae566-b6b6-4024-87e2-e7c07de7bc06 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.157000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ae566-b6b6-4024-87e2-e7c07de7bc06 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.157602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca0ae566-b6b6-4024-87e2-e7c07de7bc06 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.390229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4a11f450-3314-405e-a9be-1e952dc4f941 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:05.416708 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4a11f450-3314-405e-a9be-1e952dc4f941 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1316 microversion: 2.1 time: 0.496646 Oct 04 18:05:05.418308 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 489/963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:04 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:05.522857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2052e6e4-3ba7-4a8b-ad37-f873c164d958 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:05.523959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2052e6e4-3ba7-4a8b-ad37-f873c164d958 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:05.538626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2052e6e4-3ba7-4a8b-ad37-f873c164d958 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.540481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2052e6e4-3ba7-4a8b-ad37-f873c164d958 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.542009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2052e6e4-3ba7-4a8b-ad37-f873c164d958 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.543876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2052e6e4-3ba7-4a8b-ad37-f873c164d958 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.545318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2052e6e4-3ba7-4a8b-ad37-f873c164d958 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.546591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2052e6e4-3ba7-4a8b-ad37-f873c164d958 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.572408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:05.599636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ca0ae566-b6b6-4024-87e2-e7c07de7bc06 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:05.625251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=20 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:05.630811 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca0ae566-b6b6-4024-87e2-e7c07de7bc06 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1714 microversion: 2.1 time: 0.500317 Oct 04 18:05:05.644510 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 475/964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:05 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1714 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:05.688332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2052e6e4-3ba7-4a8b-ad37-f873c164d958 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:05.703369 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2052e6e4-3ba7-4a8b-ad37-f873c164d958 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1337 microversion: 2.1 time: 0.183923 Oct 04 18:05:05.705206 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 490/965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:05 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1337 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:05.966177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3422819f-8069-4228-a193-273716201b86 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:05.966799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3422819f-8069-4228-a193-273716201b86 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:05.978287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3422819f-8069-4228-a193-273716201b86 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.979146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3422819f-8069-4228-a193-273716201b86 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.980094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3422819f-8069-4228-a193-273716201b86 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.981022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3422819f-8069-4228-a193-273716201b86 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.982447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3422819f-8069-4228-a193-273716201b86 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.983137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3422819f-8069-4228-a193-273716201b86 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.300212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3422819f-8069-4228-a193-273716201b86 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:06.310721 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3422819f-8069-4228-a193-273716201b86 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1557 microversion: 2.1 time: 0.348767 Oct 04 18:05:06.311349 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 476/966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:05 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1557 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:06.339353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-62bdc392-bcf6-4757-aef2-0462b98076a0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:06.339856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-62bdc392-bcf6-4757-aef2-0462b98076a0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:06.359189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bdc392-bcf6-4757-aef2-0462b98076a0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.360229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bdc392-bcf6-4757-aef2-0462b98076a0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.360688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bdc392-bcf6-4757-aef2-0462b98076a0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.361430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bdc392-bcf6-4757-aef2-0462b98076a0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.362057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bdc392-bcf6-4757-aef2-0462b98076a0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.363792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bdc392-bcf6-4757-aef2-0462b98076a0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.471658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94f60b48-cdd3-4b21-b749-09fc1f57f0dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:06.473869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-94f60b48-cdd3-4b21-b749-09fc1f57f0dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:06.483912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f60b48-cdd3-4b21-b749-09fc1f57f0dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.484917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f60b48-cdd3-4b21-b749-09fc1f57f0dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.486262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f60b48-cdd3-4b21-b749-09fc1f57f0dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.490825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f60b48-cdd3-4b21-b749-09fc1f57f0dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.491985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f60b48-cdd3-4b21-b749-09fc1f57f0dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.492794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f60b48-cdd3-4b21-b749-09fc1f57f0dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.522912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:06.620353 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-62bdc392-bcf6-4757-aef2-0462b98076a0 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.287072 Oct 04 18:05:06.621507 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 491/967] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:05:06 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-interface => generated 285 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:06.672352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-95dae389-665e-46ac-ac61-45986995b430 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:06.673249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-95dae389-665e-46ac-ac61-45986995b430 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:06.681340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dae389-665e-46ac-ac61-45986995b430 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.682204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dae389-665e-46ac-ac61-45986995b430 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.683040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dae389-665e-46ac-ac61-45986995b430 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.684003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dae389-665e-46ac-ac61-45986995b430 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.684860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dae389-665e-46ac-ac61-45986995b430 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.685736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dae389-665e-46ac-ac61-45986995b430 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.923474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95dae389-665e-46ac-ac61-45986995b430 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:06.944072 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-95dae389-665e-46ac-ac61-45986995b430 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1647 microversion: 2.1 time: 0.277162 Oct 04 18:05:06.945438 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 492/968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:06 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1647 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:06.956286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e7384ec-8d0d-4df8-a582-d5a5a129a87b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:06.956930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e7384ec-8d0d-4df8-a582-d5a5a129a87b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:06.974577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e7384ec-8d0d-4df8-a582-d5a5a129a87b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.975102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e7384ec-8d0d-4df8-a582-d5a5a129a87b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.975537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e7384ec-8d0d-4df8-a582-d5a5a129a87b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.977736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e7384ec-8d0d-4df8-a582-d5a5a129a87b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.978405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e7384ec-8d0d-4df8-a582-d5a5a129a87b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.979420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e7384ec-8d0d-4df8-a582-d5a5a129a87b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.209141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-94f60b48-cdd3-4b21-b749-09fc1f57f0dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:07.221957 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-94f60b48-cdd3-4b21-b749-09fc1f57f0dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1316 microversion: 2.1 time: 0.783880 Oct 04 18:05:07.241607 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 477/969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:06 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1316 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:07.861300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e7384ec-8d0d-4df8-a582-d5a5a129a87b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:07.869695 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e7384ec-8d0d-4df8-a582-d5a5a129a87b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1379 microversion: 2.1 time: 0.922853 Oct 04 18:05:07.872235 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 493/970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:06 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1379 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:07.967947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a693701d-6b60-4f26-b121-3df0f30f4ee1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:07.968566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a693701d-6b60-4f26-b121-3df0f30f4ee1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:07.977845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a693701d-6b60-4f26-b121-3df0f30f4ee1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.980035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a693701d-6b60-4f26-b121-3df0f30f4ee1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.981543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a693701d-6b60-4f26-b121-3df0f30f4ee1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.983111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a693701d-6b60-4f26-b121-3df0f30f4ee1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.985541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a693701d-6b60-4f26-b121-3df0f30f4ee1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.986181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a693701d-6b60-4f26-b121-3df0f30f4ee1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.121124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6ba98e7c-6f53-4035-b678-07f04d5dc2d5 req-3c2268c9-8f55-4101-8b84-653cad89b39f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cae794e-563d-417b-ba78-9c6982b5b2e8", "name": "network-vif-deleted", "tag": "e0a54cf7-155d-4176-bcef-b24b91c382ab"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:08.146273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6ba98e7c-6f53-4035-b678-07f04d5dc2d5 req-3c2268c9-8f55-4101-8b84-653cad89b39f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.147360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6ba98e7c-6f53-4035-b678-07f04d5dc2d5 req-3c2268c9-8f55-4101-8b84-653cad89b39f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.148075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6ba98e7c-6f53-4035-b678-07f04d5dc2d5 req-3c2268c9-8f55-4101-8b84-653cad89b39f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.163511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a693701d-6b60-4f26-b121-3df0f30f4ee1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3bc1eee7134c2083f937e1f859220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0f422348f8418a862f7ef518071bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.183465 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6ba98e7c-6f53-4035-b678-07f04d5dc2d5 req-3c2268c9-8f55-4101-8b84-653cad89b39f service nova] Creating event network-vif-deleted:e0a54cf7-155d-4176-bcef-b24b91c382ab for instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 on n-h1-850499-14 Oct 04 18:05:08.185450 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a693701d-6b60-4f26-b121-3df0f30f4ee1 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 200 len: 1647 microversion: 2.1 time: 0.221316 Oct 04 18:05:08.186265 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 478/971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:07 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 1647 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:08.195212 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6ba98e7c-6f53-4035-b678-07f04d5dc2d5 req-3c2268c9-8f55-4101-8b84-653cad89b39f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078209 Oct 04 18:05:08.196745 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 494/972] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:08.229032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-68343851-f47b-4cee-8776-140f069245e7 req-e9aae6d5-0494-4e82-bed2-601ce4009e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70", "tag": "c24ea2e8-e606-476d-b4d4-83e53aad9183"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:08.252011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-68343851-f47b-4cee-8776-140f069245e7 req-e9aae6d5-0494-4e82-bed2-601ce4009e8d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.252889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-68343851-f47b-4cee-8776-140f069245e7 req-e9aae6d5-0494-4e82-bed2-601ce4009e8d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.254982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-68343851-f47b-4cee-8776-140f069245e7 req-e9aae6d5-0494-4e82-bed2-601ce4009e8d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.259723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6cc8f62d-deae-42a1-9ff1-c3ca618e3004 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:08.261368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6cc8f62d-deae-42a1-9ff1-c3ca618e3004 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:08.281738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cc8f62d-deae-42a1-9ff1-c3ca618e3004 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.282274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cc8f62d-deae-42a1-9ff1-c3ca618e3004 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.283540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cc8f62d-deae-42a1-9ff1-c3ca618e3004 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.286141 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-68343851-f47b-4cee-8776-140f069245e7 req-e9aae6d5-0494-4e82-bed2-601ce4009e8d service nova] Creating event network-changed:c24ea2e8-e606-476d-b4d4-83e53aad9183 for instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 on n-h1-850499-14 Oct 04 18:05:08.287406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cc8f62d-deae-42a1-9ff1-c3ca618e3004 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.288853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cc8f62d-deae-42a1-9ff1-c3ca618e3004 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.291325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cc8f62d-deae-42a1-9ff1-c3ca618e3004 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.303586 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-68343851-f47b-4cee-8776-140f069245e7 req-e9aae6d5-0494-4e82-bed2-601ce4009e8d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081435 Oct 04 18:05:08.305903 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 479/973] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:08.605564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ec05a816-4243-47d8-afa7-9394bfc4d2b5 req-b0a83304-0e94-440b-b37d-409bd8410634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae9ebd3-ad90-4235-a6c0-58bb69a748d4", "name": "network-vif-plugged", "status": "completed", "tag": "9ed1f26f-430d-4158-be06-f80de6cb8a8e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:08.622276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ec05a816-4243-47d8-afa7-9394bfc4d2b5 req-b0a83304-0e94-440b-b37d-409bd8410634 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.622777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ec05a816-4243-47d8-afa7-9394bfc4d2b5 req-b0a83304-0e94-440b-b37d-409bd8410634 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.623243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ec05a816-4243-47d8-afa7-9394bfc4d2b5 req-b0a83304-0e94-440b-b37d-409bd8410634 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.651972 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ec05a816-4243-47d8-afa7-9394bfc4d2b5 req-b0a83304-0e94-440b-b37d-409bd8410634 service nova] Creating event network-vif-plugged:9ed1f26f-430d-4158-be06-f80de6cb8a8e for instance 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 on n-h2-850499-14 Oct 04 18:05:08.657565 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ec05a816-4243-47d8-afa7-9394bfc4d2b5 req-b0a83304-0e94-440b-b37d-409bd8410634 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056772 Oct 04 18:05:08.658714 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 480/974] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:08.814509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6cc8f62d-deae-42a1-9ff1-c3ca618e3004 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.838287 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6cc8f62d-deae-42a1-9ff1-c3ca618e3004 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1316 microversion: 2.1 time: 0.584502 Oct 04 18:05:08.851056 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 495/975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:08 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:08.895249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-deb8bd33-1100-4dba-a0cd-c9c1977718e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:08.895978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-deb8bd33-1100-4dba-a0cd-c9c1977718e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:08.903313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb8bd33-1100-4dba-a0cd-c9c1977718e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.903822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb8bd33-1100-4dba-a0cd-c9c1977718e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.904731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb8bd33-1100-4dba-a0cd-c9c1977718e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.906033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb8bd33-1100-4dba-a0cd-c9c1977718e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.906511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb8bd33-1100-4dba-a0cd-c9c1977718e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.906977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb8bd33-1100-4dba-a0cd-c9c1977718e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.212144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.214399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.220726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.221548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.222094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.222913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.223789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.224464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.242824 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] HTTP exception thrown: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Request method failure captured: Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 HTTP/1.1 Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUtXvaldyNYa8M9BOct8Sx5Jg0JZQeY_P3jvso9q5lY5BZ3n3bECwlo1y6VX_oQ1BTN2aiM11oLDn-GVfxCRQgiuIU-EFbAHAfuJg09L6GBsMOpV2WK66sH8Sb1PeeI-Ry_dvpyD851guY3s3g53d_Z48MWceLGK-PLDMJaF8sUTro Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:09.246327 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}] Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ad3bc1eee7134c2083f937e1f859220c Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:09.249164 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '5cae794e-563d-417b-ba78-9c6982b5b2e8'} Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:09.250761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:09.254635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.257222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Returning 404 to user: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:09.257222 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-54b5049e-c338-4b1f-905b-5ee60523493d tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 404 len: 111 microversion: 2.1 time: 0.040742 Oct 04 18:05:09.257222 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 496/976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:09 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:05:09.258623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.259734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.265981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.266472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.266912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.267652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.268107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.268534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.285145 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] HTTP exception thrown: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Request method failure captured: Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 HTTP/1.1 Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUtXvaldyNYa8M9BOct8Sx5Jg0JZQeY_P3jvso9q5lY5BZ3n3bECwlo1y6VX_oQ1BTN2aiM11oLDn-GVfxCRQgiuIU-EFbAHAfuJg09L6GBsMOpV2WK66sH8Sb1PeeI-Ry_dvpyD851guY3s3g53d_Z48MWceLGK-PLDMJaF8sUTro Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:09.286706 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}] Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ad3bc1eee7134c2083f937e1f859220c Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:09.288174 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'eeedbae9-0976-4ec6-9479-7b2a15f6ab62'} Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:09.289018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:09.290284 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.292915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Returning 404 to user: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:09.292915 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fb007acb-923b-4314-90a8-5b2f17bd6dc6 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 404 len: 111 microversion: 2.1 time: 0.033480 Oct 04 18:05:09.292915 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 497/977] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:09 2022] DELETE /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:09.297539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.298364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.304751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.305242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.305679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.306625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.307816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.308409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.325554 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] HTTP exception thrown: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Request method failure captured: Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 HTTP/1.1 Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUtXvaldyNYa8M9BOct8Sx5Jg0JZQeY_P3jvso9q5lY5BZ3n3bECwlo1y6VX_oQ1BTN2aiM11oLDn-GVfxCRQgiuIU-EFbAHAfuJg09L6GBsMOpV2WK66sH8Sb1PeeI-Ry_dvpyD851guY3s3g53d_Z48MWceLGK-PLDMJaF8sUTro Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:09.327149 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}] Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ad3bc1eee7134c2083f937e1f859220c Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:09.328493 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'eeedbae9-0976-4ec6-9479-7b2a15f6ab62'} Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:09.329230 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:09.330450 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:09.331593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Returning 404 to user: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:09.331593 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b711ca1-e3e9-41df-bb7e-bb70b1f44cdf tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 404 len: 111 microversion: 2.1 time: 0.035132 Oct 04 18:05:09.332733 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 498/978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:09 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:09.337571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c3bd0857-4cf1-4530-81de-83b07244fec7 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '.version_select at 0x7fd4d1e4e160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.347861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:09.360614 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c3bd0857-4cf1-4530-81de-83b07244fec7 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320746582" status: 202 len: 0 microversion: 2.1 time: 0.026755 Oct 04 18:05:09.361755 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 499/979] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:05:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320746582 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:09.397038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-deb8bd33-1100-4dba-a0cd-c9c1977718e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:09.405582 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-deb8bd33-1100-4dba-a0cd-c9c1977718e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1379 microversion: 2.1 time: 0.515365 Oct 04 18:05:09.422342 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 481/980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:08 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1379 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:09.877995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-998ce54e-bad1-4442-92c9-eb0dd2d64e46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.878633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-998ce54e-bad1-4442-92c9-eb0dd2d64e46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.886182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-998ce54e-bad1-4442-92c9-eb0dd2d64e46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.886680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-998ce54e-bad1-4442-92c9-eb0dd2d64e46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.887671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-998ce54e-bad1-4442-92c9-eb0dd2d64e46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.888574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-998ce54e-bad1-4442-92c9-eb0dd2d64e46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.889207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-998ce54e-bad1-4442-92c9-eb0dd2d64e46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.889834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-998ce54e-bad1-4442-92c9-eb0dd2d64e46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.217918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-998ce54e-bad1-4442-92c9-eb0dd2d64e46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:10.235389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1dba301a-a2b2-48e3-87b1-5abdc3854dd2 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.240419 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-998ce54e-bad1-4442-92c9-eb0dd2d64e46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1316 microversion: 2.1 time: 0.353841 Oct 04 18:05:10.241079 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 500/981] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:09 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:10.262475 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1dba301a-a2b2-48e3-87b1-5abdc3854dd2 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1718480545" status: 202 len: 0 microversion: 2.1 time: 0.033070 Oct 04 18:05:10.263878 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 482/982] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:10 2022] DELETE /compute/v2.1/flavors/1718480545 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:05:10.275069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e834359-ed7a-4902-b510-1d8b4018b986 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.306910 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e834359-ed7a-4902-b510-1d8b4018b986 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5894 microversion: 2.1 time: 0.038117 Oct 04 18:05:10.308855 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 501/983] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:10 2022] GET /compute/v2.1/flavors/detail => generated 5894 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:10.343017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba4d4943-488a-4033-8816-559e7288da7a tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.359434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-93846c05-6e57-4fce-a698-ae032d8d8cc2 req-6cbb19fe-4933-49fb-8237-cad41d830c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc68e22-19de-42cd-aae6-efc5d6218e8c", "tag": "c2427d5a-9159-4150-8502-801eeb7afc45"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:10.372689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-93846c05-6e57-4fce-a698-ae032d8d8cc2 req-6cbb19fe-4933-49fb-8237-cad41d830c34 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.373427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-93846c05-6e57-4fce-a698-ae032d8d8cc2 req-6cbb19fe-4933-49fb-8237-cad41d830c34 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.374061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-93846c05-6e57-4fce-a698-ae032d8d8cc2 req-6cbb19fe-4933-49fb-8237-cad41d830c34 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.394510 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-93846c05-6e57-4fce-a698-ae032d8d8cc2 req-6cbb19fe-4933-49fb-8237-cad41d830c34 service nova] Creating event network-changed:c2427d5a-9159-4150-8502-801eeb7afc45 for instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c on n-h1-850499-14 Oct 04 18:05:10.401738 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-93846c05-6e57-4fce-a698-ae032d8d8cc2 req-6cbb19fe-4933-49fb-8237-cad41d830c34 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046308 Oct 04 18:05:10.402996 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 502/984] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:10.407973 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba4d4943-488a-4033-8816-559e7288da7a tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1781652487" status: 202 len: 0 microversion: 2.1 time: 0.069185 Oct 04 18:05:10.425704 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 483/985] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:10 2022] DELETE /compute/v2.1/flavors/1781652487 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:10.430316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d473d431-a625-4b07-9477-4b877159b764 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.451337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f7ecb32-4f3d-44d3-9dea-7f5f167ed537 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.451965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f7ecb32-4f3d-44d3-9dea-7f5f167ed537 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:10.462901 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d473d431-a625-4b07-9477-4b877159b764 tempest-ServersWithSpecificFlavorTestJSON-758357025 tempest-ServersWithSpecificFlavorTestJSON-758357025-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.037835 Oct 04 18:05:10.470252 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 503/986] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:10 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:10.481507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f7ecb32-4f3d-44d3-9dea-7f5f167ed537 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.482515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f7ecb32-4f3d-44d3-9dea-7f5f167ed537 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.483724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f7ecb32-4f3d-44d3-9dea-7f5f167ed537 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.485620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f7ecb32-4f3d-44d3-9dea-7f5f167ed537 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.487921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f7ecb32-4f3d-44d3-9dea-7f5f167ed537 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.489624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f7ecb32-4f3d-44d3-9dea-7f5f167ed537 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.518530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.519564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:10.530576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.531401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.532118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.533370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.534174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.534838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.553128 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] HTTP exception thrown: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Request method failure captured: Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 HTTP/1.1 Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUtXvaldyNYa8M9BOct8Sx5Jg0JZQeY_P3jvso9q5lY5BZ3n3bECwlo1y6VX_oQ1BTN2aiM11oLDn-GVfxCRQgiuIU-EFbAHAfuJg09L6GBsMOpV2WK66sH8Sb1PeeI-Ry_dvpyD851guY3s3g53d_Z48MWceLGK-PLDMJaF8sUTro Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:10.555440 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}] Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ad3bc1eee7134c2083f937e1f859220c Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:10.556760 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '5cae794e-563d-417b-ba78-9c6982b5b2e8'} Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:10.558106 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:10.559401 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.562376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Returning 404 to user: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:10.563520 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2d8e5192-20f3-4064-85a9-af83a8d75f32 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 404 len: 111 microversion: 2.1 time: 0.050582 Oct 04 18:05:10.564770 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 504/987] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:10 2022] DELETE /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:10.573900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.574531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: 5cae794e-563d-417b-ba78-9c6982b5b2e8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:10.581135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.582303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.583180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.584099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.584337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:10.585223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.585818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.603118 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] HTTP exception thrown: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Request method failure captured: Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 HTTP/1.1 Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUtXvaldyNYa8M9BOct8Sx5Jg0JZQeY_P3jvso9q5lY5BZ3n3bECwlo1y6VX_oQ1BTN2aiM11oLDn-GVfxCRQgiuIU-EFbAHAfuJg09L6GBsMOpV2WK66sH8Sb1PeeI-Ry_dvpyD851guY3s3g53d_Z48MWceLGK-PLDMJaF8sUTro Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:10.608758 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}] Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ad3bc1eee7134c2083f937e1f859220c Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:10.610369 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '5cae794e-563d-417b-ba78-9c6982b5b2e8'} Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:10.611293 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. Oct 04 18:05:10.612761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.614483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Returning 404 to user: Instance 5cae794e-563d-417b-ba78-9c6982b5b2e8 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:10.615634 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dcc40064-2f17-4285-9df2-3bee63bb32e3 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8" status: 404 len: 111 microversion: 2.1 time: 0.046453 Oct 04 18:05:10.616661 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 505/988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:10 2022] GET /compute/v2.1/servers/5cae794e-563d-417b-ba78-9c6982b5b2e8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:05:10.625065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.625567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:10.631694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.632191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.632634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.633349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.633805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.634230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.651183 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] HTTP exception thrown: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Request method failure captured: Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 HTTP/1.1 Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUtXvaldyNYa8M9BOct8Sx5Jg0JZQeY_P3jvso9q5lY5BZ3n3bECwlo1y6VX_oQ1BTN2aiM11oLDn-GVfxCRQgiuIU-EFbAHAfuJg09L6GBsMOpV2WK66sH8Sb1PeeI-Ry_dvpyD851guY3s3g53d_Z48MWceLGK-PLDMJaF8sUTro Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:10.652608 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}] Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ad3bc1eee7134c2083f937e1f859220c Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:10.655802 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'eeedbae9-0976-4ec6-9479-7b2a15f6ab62'} Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:10.657422 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:10.661545 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.664171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Returning 404 to user: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:10.664171 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-60d473b8-1ee3-4d35-afc0-cd8377099d9b tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 404 len: 111 microversion: 2.1 time: 0.033523 Oct 04 18:05:10.664171 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 506/989] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:10 2022] DELETE /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:05:10.664171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.664723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] [instance: eeedbae9-0976-4ec6-9479-7b2a15f6ab62] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:10.671575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.672983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.672983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.673577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.674035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.674860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.697662 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] HTTP exception thrown: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Request method failure captured: Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 HTTP/1.1 Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUtXvaldyNYa8M9BOct8Sx5Jg0JZQeY_P3jvso9q5lY5BZ3n3bECwlo1y6VX_oQ1BTN2aiM11oLDn-GVfxCRQgiuIU-EFbAHAfuJg09L6GBsMOpV2WK66sH8Sb1PeeI-Ry_dvpyD851guY3s3g53d_Z48MWceLGK-PLDMJaF8sUTro Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:10.701156 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb0f422348f8418a862f7ef518071bf5"}]}] Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bb0f422348f8418a862f7ef518071bf5 Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772 Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ad3bc1eee7134c2083f937e1f859220c Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1245772-project Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:10.703844 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'eeedbae9-0976-4ec6-9479-7b2a15f6ab62'} Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:10.705233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. Oct 04 18:05:10.711136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:10.718315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] Returning 404 to user: Instance eeedbae9-0976-4ec6-9479-7b2a15f6ab62 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:10.720491 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d11f8e12-fe78-4a22-98b9-e3596ce4e740 tempest-ServersWithSpecificFlavorTestJSON-1245772 tempest-ServersWithSpecificFlavorTestJSON-1245772-project] 10.222.0.18 "GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62" status: 404 len: 111 microversion: 2.1 time: 0.060618 Oct 04 18:05:10.726476 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 507/990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:10 2022] GET /compute/v2.1/servers/eeedbae9-0976-4ec6-9479-7b2a15f6ab62 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:10.922912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:11.265210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3e69c09c-cead-4358-9045-b7e58b9880e1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:11.265822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3e69c09c-cead-4358-9045-b7e58b9880e1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:11.290583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e69c09c-cead-4358-9045-b7e58b9880e1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.293047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e69c09c-cead-4358-9045-b7e58b9880e1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.295604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e69c09c-cead-4358-9045-b7e58b9880e1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.296548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e69c09c-cead-4358-9045-b7e58b9880e1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.300521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e69c09c-cead-4358-9045-b7e58b9880e1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.301370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e69c09c-cead-4358-9045-b7e58b9880e1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.322271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f7ecb32-4f3d-44d3-9dea-7f5f167ed537 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:11.334542 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f7ecb32-4f3d-44d3-9dea-7f5f167ed537 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1379 microversion: 2.1 time: 0.907522 Oct 04 18:05:11.335705 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 484/991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:10 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1379 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:11.756603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3e69c09c-cead-4358-9045-b7e58b9880e1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:11.771416 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3e69c09c-cead-4358-9045-b7e58b9880e1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1465 microversion: 2.1 time: 0.510833 Oct 04 18:05:11.783204 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 508/992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:11 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1465 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:11.798088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1f6d0a95-ab19-4b72-a7fb-978b5a70b3ce tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:11.799400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1f6d0a95-ab19-4b72-a7fb-978b5a70b3ce tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:11.808388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f6d0a95-ab19-4b72-a7fb-978b5a70b3ce tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.808894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f6d0a95-ab19-4b72-a7fb-978b5a70b3ce tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.809478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f6d0a95-ab19-4b72-a7fb-978b5a70b3ce tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.813260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f6d0a95-ab19-4b72-a7fb-978b5a70b3ce tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.813755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f6d0a95-ab19-4b72-a7fb-978b5a70b3ce tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.814385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f6d0a95-ab19-4b72-a7fb-978b5a70b3ce tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.179517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3dcc73a3-9414-421d-a20e-974729cc2d4a tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:12.180142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3dcc73a3-9414-421d-a20e-974729cc2d4a tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:12.186439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc73a3-9414-421d-a20e-974729cc2d4a tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.187301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc73a3-9414-421d-a20e-974729cc2d4a tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.187301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc73a3-9414-421d-a20e-974729cc2d4a tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.187987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc73a3-9414-421d-a20e-974729cc2d4a tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.188766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc73a3-9414-421d-a20e-974729cc2d4a tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.189203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc73a3-9414-421d-a20e-974729cc2d4a tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.261014 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1f6d0a95-ab19-4b72-a7fb-978b5a70b3ce tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1618 microversion: 2.1 time: 0.469708 Oct 04 18:05:12.261603 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 485/993] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:11 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1618 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:12.363795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3f0d3d8b-5d66-4515-9a55-c208125c0cdf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:12.364657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3f0d3d8b-5d66-4515-9a55-c208125c0cdf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:12.376947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f0d3d8b-5d66-4515-9a55-c208125c0cdf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.379669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f0d3d8b-5d66-4515-9a55-c208125c0cdf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.380894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f0d3d8b-5d66-4515-9a55-c208125c0cdf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.384159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f0d3d8b-5d66-4515-9a55-c208125c0cdf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.386856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f0d3d8b-5d66-4515-9a55-c208125c0cdf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.389124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f0d3d8b-5d66-4515-9a55-c208125c0cdf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.568005 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3dcc73a3-9414-421d-a20e-974729cc2d4a tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1816 microversion: 2.1 time: 0.393826 Oct 04 18:05:12.571520 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 509/994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:12 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1816 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:12.579791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1497645597", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["aa79c4dc-6409-43e7-85da-46dde9db68bd"]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:12.644556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:12.723483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3f0d3d8b-5d66-4515-9a55-c208125c0cdf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:12.732338 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3f0d3d8b-5d66-4515-9a55-c208125c0cdf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1379 microversion: 2.1 time: 0.377204 Oct 04 18:05:12.733230 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 486/995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:12 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1379 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:12.738788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b6a792f-7912-4ab0-b934-c8eaa4a6315b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:12.743068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a792f-7912-4ab0-b934-c8eaa4a6315b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.743828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a792f-7912-4ab0-b934-c8eaa4a6315b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.744466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a792f-7912-4ab0-b934-c8eaa4a6315b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.745449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a792f-7912-4ab0-b934-c8eaa4a6315b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.746172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a792f-7912-4ab0-b934-c8eaa4a6315b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.746817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a792f-7912-4ab0-b934-c8eaa4a6315b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.773554 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b6a792f-7912-4ab0-b934-c8eaa4a6315b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.039026 Oct 04 18:05:12.774180 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 487/996] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 4 18:05:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:13.089981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:13.092586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:13.093195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:13.093910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:13.094369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:13.112934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.113218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.113728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.115591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.116402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.117076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.180140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:13.191322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:13.218467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:13.223826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:13.292455 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-02253549-f157-4afe-a3d6-d7b25552a01e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720262 Oct 04 18:05:13.294288 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 510/997] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:13.305462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-583daf00-c5fe-41b6-b4e9-29f8c6e16d49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:13.306180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-583daf00-c5fe-41b6-b4e9-29f8c6e16d49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:13.466992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-583daf00-c5fe-41b6-b4e9-29f8c6e16d49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:13.490647 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-583daf00-c5fe-41b6-b4e9-29f8c6e16d49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1217 microversion: 2.1 time: 0.189105 Oct 04 18:05:13.491503 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 488/998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:13 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:13.756537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3f3c6051-327f-4960-8221-3e5831c5006c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:13.757615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3f3c6051-327f-4960-8221-3e5831c5006c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:13.770557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f3c6051-327f-4960-8221-3e5831c5006c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.773231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f3c6051-327f-4960-8221-3e5831c5006c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.773848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f3c6051-327f-4960-8221-3e5831c5006c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.777369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f3c6051-327f-4960-8221-3e5831c5006c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.779615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f3c6051-327f-4960-8221-3e5831c5006c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.780154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f3c6051-327f-4960-8221-3e5831c5006c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.000719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-640877283", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:14.103199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:14.347378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3f3c6051-327f-4960-8221-3e5831c5006c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.356040 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3f3c6051-327f-4960-8221-3e5831c5006c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1379 microversion: 2.1 time: 0.604223 Oct 04 18:05:14.357308 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 489/999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:13 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1379 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.365018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-954d93e4-1fd6-44a7-b236-558e8d71d11e req-b333827f-792e-475a-a26b-a59343530ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70", "name": "network-vif-plugged", "status": "completed", "tag": "c24ea2e8-e606-476d-b4d4-83e53aad9183"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:14.380905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-954d93e4-1fd6-44a7-b236-558e8d71d11e req-b333827f-792e-475a-a26b-a59343530ebd service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.381485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-954d93e4-1fd6-44a7-b236-558e8d71d11e req-b333827f-792e-475a-a26b-a59343530ebd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.382108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-954d93e4-1fd6-44a7-b236-558e8d71d11e req-b333827f-792e-475a-a26b-a59343530ebd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.423169 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-954d93e4-1fd6-44a7-b236-558e8d71d11e req-b333827f-792e-475a-a26b-a59343530ebd service nova] Creating event network-vif-plugged:c24ea2e8-e606-476d-b4d4-83e53aad9183 for instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 on n-h1-850499-14 Oct 04 18:05:14.451739 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-954d93e4-1fd6-44a7-b236-558e8d71d11e req-b333827f-792e-475a-a26b-a59343530ebd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092735 Oct 04 18:05:14.452364 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 490/1000] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:14.520097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5cf1f07b-2b8f-47f9-ae29-7b85a7d79406 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.522339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5cf1f07b-2b8f-47f9-ae29-7b85a7d79406 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:14.544923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cf1f07b-2b8f-47f9-ae29-7b85a7d79406 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.545935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cf1f07b-2b8f-47f9-ae29-7b85a7d79406 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.548941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cf1f07b-2b8f-47f9-ae29-7b85a7d79406 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.550096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cf1f07b-2b8f-47f9-ae29-7b85a7d79406 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.552110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:14.552812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:14.553478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:14.554060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:14.554931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cf1f07b-2b8f-47f9-ae29-7b85a7d79406 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.555432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:14.558721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cf1f07b-2b8f-47f9-ae29-7b85a7d79406 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.570336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.572410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.573963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.577215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.578509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.579473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.639785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Getting quotas for project 9347f6d02b614c0d85ece3ec91521bd4. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:14.648449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Getting quotas for user 424cdee7a8ef4100b600b8a59f8f7394 and project 9347f6d02b614c0d85ece3ec91521bd4. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:14.668787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:14.672160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:14.753963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5cf1f07b-2b8f-47f9-ae29-7b85a7d79406 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.758183 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-68d75ac2-7a60-4440-8ffb-fb4673da895b tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040781 Oct 04 18:05:14.765715 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 511/1001] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:14.770930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-43e6ebc6-874b-473b-a5f1-47d8b7995172 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.772065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-43e6ebc6-874b-473b-a5f1-47d8b7995172 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:14.794651 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5cf1f07b-2b8f-47f9-ae29-7b85a7d79406 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1269 microversion: 2.1 time: 0.278502 Oct 04 18:05:14.795707 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 491/1002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1269 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.870294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-43e6ebc6-874b-473b-a5f1-47d8b7995172 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.882558 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-43e6ebc6-874b-473b-a5f1-47d8b7995172 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1216 microversion: 2.1 time: 0.115574 Oct 04 18:05:14.886169 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 512/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:15.372987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-15053023-2e50-4b19-bcad-a0574466f15c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11223bcb-93bf-4c6b-a025-dd2799779f10", "device": "/dev/xvdb"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:15.376115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15053023-2e50-4b19-bcad-a0574466f15c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.383248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15053023-2e50-4b19-bcad-a0574466f15c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.383745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15053023-2e50-4b19-bcad-a0574466f15c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.384459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15053023-2e50-4b19-bcad-a0574466f15c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.385938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15053023-2e50-4b19-bcad-a0574466f15c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.386631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15053023-2e50-4b19-bcad-a0574466f15c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.387310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15053023-2e50-4b19-bcad-a0574466f15c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.389789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b56b19e3-e96b-4f1f-9c1a-7e778928aa9a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.390544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b56b19e3-e96b-4f1f-9c1a-7e778928aa9a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.399919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b56b19e3-e96b-4f1f-9c1a-7e778928aa9a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.401269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b56b19e3-e96b-4f1f-9c1a-7e778928aa9a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.401729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b56b19e3-e96b-4f1f-9c1a-7e778928aa9a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.402493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b56b19e3-e96b-4f1f-9c1a-7e778928aa9a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.403059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b56b19e3-e96b-4f1f-9c1a-7e778928aa9a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.403775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b56b19e3-e96b-4f1f-9c1a-7e778928aa9a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.592473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b56b19e3-e96b-4f1f-9c1a-7e778928aa9a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:15.600652 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b56b19e3-e96b-4f1f-9c1a-7e778928aa9a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1379 microversion: 2.1 time: 0.219953 Oct 04 18:05:15.601813 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 513/1004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1379 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:15.821042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de44bb7c-f6c8-451b-9776-ffe7573c7f97 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.822308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-de44bb7c-f6c8-451b-9776-ffe7573c7f97 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.832250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de44bb7c-f6c8-451b-9776-ffe7573c7f97 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.833212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de44bb7c-f6c8-451b-9776-ffe7573c7f97 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.833961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de44bb7c-f6c8-451b-9776-ffe7573c7f97 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.835120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de44bb7c-f6c8-451b-9776-ffe7573c7f97 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.835975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de44bb7c-f6c8-451b-9776-ffe7573c7f97 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.836410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de44bb7c-f6c8-451b-9776-ffe7573c7f97 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.916169 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-15053023-2e50-4b19-bcad-a0574466f15c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "POST /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.546333 Oct 04 18:05:15.917270 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 492/1005] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:05:15 2022] POST /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 194 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:15.928875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de44bb7c-f6c8-451b-9776-ffe7573c7f97 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:15.937916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45ba88b5-d833-44ac-a895-a19963510200 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.938684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45ba88b5-d833-44ac-a895-a19963510200 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.939818 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de44bb7c-f6c8-451b-9776-ffe7573c7f97 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1269 microversion: 2.1 time: 0.122803 Oct 04 18:05:15.940961 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 514/1006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1269 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:15.947525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ba88b5-d833-44ac-a895-a19963510200 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.948437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ba88b5-d833-44ac-a895-a19963510200 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.949048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ba88b5-d833-44ac-a895-a19963510200 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.949959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ba88b5-d833-44ac-a895-a19963510200 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.950584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ba88b5-d833-44ac-a895-a19963510200 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.951233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ba88b5-d833-44ac-a895-a19963510200 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.389673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-45ba88b5-d833-44ac-a895-a19963510200 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.398575 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45ba88b5-d833-44ac-a895-a19963510200 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1268 microversion: 2.1 time: 0.479859 Oct 04 18:05:16.408223 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 493/1007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1268 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:16.633857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-246b879e-7a02-4aff-b7c6-a729c03fc6a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.652289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-246b879e-7a02-4aff-b7c6-a729c03fc6a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.659496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246b879e-7a02-4aff-b7c6-a729c03fc6a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.660263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246b879e-7a02-4aff-b7c6-a729c03fc6a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.660908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246b879e-7a02-4aff-b7c6-a729c03fc6a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.662014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246b879e-7a02-4aff-b7c6-a729c03fc6a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.662682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246b879e-7a02-4aff-b7c6-a729c03fc6a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.663325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246b879e-7a02-4aff-b7c6-a729c03fc6a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.853334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-246b879e-7a02-4aff-b7c6-a729c03fc6a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.874544 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-246b879e-7a02-4aff-b7c6-a729c03fc6a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1529 microversion: 2.1 time: 0.244655 Oct 04 18:05:16.886392 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 515/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1529 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:16.908389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20277056-ab69-4af5-b6c5-c4b9e65dce37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.909284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20277056-ab69-4af5-b6c5-c4b9e65dce37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.923490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:16.930623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20277056-ab69-4af5-b6c5-c4b9e65dce37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.931218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20277056-ab69-4af5-b6c5-c4b9e65dce37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.931924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20277056-ab69-4af5-b6c5-c4b9e65dce37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.934923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20277056-ab69-4af5-b6c5-c4b9e65dce37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.936093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20277056-ab69-4af5-b6c5-c4b9e65dce37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.936641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20277056-ab69-4af5-b6c5-c4b9e65dce37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.966337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7da7e8c0-3065-4527-b6e9-3754ed6c6bca tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.966990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7da7e8c0-3065-4527-b6e9-3754ed6c6bca tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.979199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7e8c0-3065-4527-b6e9-3754ed6c6bca tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.984554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7e8c0-3065-4527-b6e9-3754ed6c6bca tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.989498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7e8c0-3065-4527-b6e9-3754ed6c6bca tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.991830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7e8c0-3065-4527-b6e9-3754ed6c6bca tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.994860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7e8c0-3065-4527-b6e9-3754ed6c6bca tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.996490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7e8c0-3065-4527-b6e9-3754ed6c6bca tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.313451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7da7e8c0-3065-4527-b6e9-3754ed6c6bca tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:17.322234 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7da7e8c0-3065-4527-b6e9-3754ed6c6bca tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1275 microversion: 2.1 time: 0.363097 Oct 04 18:05:17.335390 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 516/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1275 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.429820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b718330e-7d30-43c5-bb9f-925bb5b8c9e3 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.444440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b718330e-7d30-43c5-bb9f-925bb5b8c9e3 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.455623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b718330e-7d30-43c5-bb9f-925bb5b8c9e3 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.461913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b718330e-7d30-43c5-bb9f-925bb5b8c9e3 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.463417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b718330e-7d30-43c5-bb9f-925bb5b8c9e3 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.464486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b718330e-7d30-43c5-bb9f-925bb5b8c9e3 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.465410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b718330e-7d30-43c5-bb9f-925bb5b8c9e3 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.466083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b718330e-7d30-43c5-bb9f-925bb5b8c9e3 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.475443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-20277056-ab69-4af5-b6c5-c4b9e65dce37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:17.485867 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20277056-ab69-4af5-b6c5-c4b9e65dce37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1529 microversion: 2.1 time: 0.582790 Oct 04 18:05:17.497141 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 494/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1529 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.515173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e3c10c70-bba5-422e-ae8a-32db4bffcfd8 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.537772 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e3c10c70-bba5-422e-ae8a-32db4bffcfd8 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9" status: 202 len: 0 microversion: 2.1 time: 0.029078 Oct 04 18:05:17.538580 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 495/1011] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:17 2022] DELETE /compute/v2.1/flavors/e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:17.547211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5071b145-a552-49e1-af50-0559d9556bcc tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.579333 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5071b145-a552-49e1-af50-0559d9556bcc tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035970 Oct 04 18:05:17.581777 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 496/1012] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.601554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:17.604841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.612526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.613444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.613838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b718330e-7d30-43c5-bb9f-925bb5b8c9e3 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:17.614561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.615549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.616219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.616869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.632503 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b718330e-7d30-43c5-bb9f-925bb5b8c9e3 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1274 microversion: 2.1 time: 0.205218 Oct 04 18:05:17.633107 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 517/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.770157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:17.780633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Old instance type tempest-test_resize_flavor_-1822935054, new instance type m1.heat {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:05:17.795104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:17.796524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:17.797343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:17.798025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:17.798987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:17.970102 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-279f91ed-ad1d-4ce2-ae20-c2e1db0c16b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70/action" status: 202 len: 0 microversion: 2.1 time: 0.372301 Oct 04 18:05:17.972298 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 497/1014] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:17 2022] POST /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:05:17.980934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22bb6ca6-3a94-47e2-8cd3-105c0036bff7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.981734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-22bb6ca6-3a94-47e2-8cd3-105c0036bff7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.993748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bb6ca6-3a94-47e2-8cd3-105c0036bff7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.995465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bb6ca6-3a94-47e2-8cd3-105c0036bff7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.996337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bb6ca6-3a94-47e2-8cd3-105c0036bff7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.997361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bb6ca6-3a94-47e2-8cd3-105c0036bff7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.005863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bb6ca6-3a94-47e2-8cd3-105c0036bff7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.006874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22bb6ca6-3a94-47e2-8cd3-105c0036bff7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.210367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-22bb6ca6-3a94-47e2-8cd3-105c0036bff7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:18.215755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:18.232692 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22bb6ca6-3a94-47e2-8cd3-105c0036bff7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1538 microversion: 2.1 time: 0.253631 Oct 04 18:05:18.236528 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 518/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1538 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:18.362393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4a79ee11-9458-4ab6-8041-5bb7290ded35 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.363242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4a79ee11-9458-4ab6-8041-5bb7290ded35 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:18.426463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a79ee11-9458-4ab6-8041-5bb7290ded35 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.428481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a79ee11-9458-4ab6-8041-5bb7290ded35 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.428993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a79ee11-9458-4ab6-8041-5bb7290ded35 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.430931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a79ee11-9458-4ab6-8041-5bb7290ded35 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.432772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a79ee11-9458-4ab6-8041-5bb7290ded35 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.433310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a79ee11-9458-4ab6-8041-5bb7290ded35 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.657796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-abdd3ed6-4b4e-40a4-b124-827baf5df612 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.658766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-abdd3ed6-4b4e-40a4-b124-827baf5df612 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:18.675451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abdd3ed6-4b4e-40a4-b124-827baf5df612 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.676690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abdd3ed6-4b4e-40a4-b124-827baf5df612 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.678117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abdd3ed6-4b4e-40a4-b124-827baf5df612 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.682273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abdd3ed6-4b4e-40a4-b124-827baf5df612 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.683329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abdd3ed6-4b4e-40a4-b124-827baf5df612 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.684216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abdd3ed6-4b4e-40a4-b124-827baf5df612 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.852315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-abdd3ed6-4b4e-40a4-b124-827baf5df612 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:18.868066 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-abdd3ed6-4b4e-40a4-b124-827baf5df612 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1274 microversion: 2.1 time: 0.215306 Oct 04 18:05:18.872324 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 519/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1274 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:18.982989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4a79ee11-9458-4ab6-8041-5bb7290ded35 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.003403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4a79ee11-9458-4ab6-8041-5bb7290ded35 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.659030 Oct 04 18:05:19.003922 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 498/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:19.267688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-131f9ae7-09da-4ea3-8292-4613b4427245 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.268484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-131f9ae7-09da-4ea3-8292-4613b4427245 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.285466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-131f9ae7-09da-4ea3-8292-4613b4427245 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.288352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-131f9ae7-09da-4ea3-8292-4613b4427245 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.293397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-131f9ae7-09da-4ea3-8292-4613b4427245 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.295117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-131f9ae7-09da-4ea3-8292-4613b4427245 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.305208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-131f9ae7-09da-4ea3-8292-4613b4427245 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.305819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-131f9ae7-09da-4ea3-8292-4613b4427245 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.709764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-131f9ae7-09da-4ea3-8292-4613b4427245 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.735628 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-131f9ae7-09da-4ea3-8292-4613b4427245 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1538 microversion: 2.1 time: 0.473405 Oct 04 18:05:19.741187 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 520/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1538 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:19.898388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9cad9ae0-1991-4cde-a5f7-34c94833932c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.901370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9cad9ae0-1991-4cde-a5f7-34c94833932c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.926579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cad9ae0-1991-4cde-a5f7-34c94833932c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.928773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cad9ae0-1991-4cde-a5f7-34c94833932c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.932878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cad9ae0-1991-4cde-a5f7-34c94833932c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.935120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cad9ae0-1991-4cde-a5f7-34c94833932c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.939158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cad9ae0-1991-4cde-a5f7-34c94833932c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.939778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cad9ae0-1991-4cde-a5f7-34c94833932c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.990267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:20.038134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-36f085da-55a1-481f-b0e3-0f129b3e8985 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.039696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-36f085da-55a1-481f-b0e3-0f129b3e8985 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.052561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f085da-55a1-481f-b0e3-0f129b3e8985 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.054489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f085da-55a1-481f-b0e3-0f129b3e8985 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.056055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f085da-55a1-481f-b0e3-0f129b3e8985 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.061242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f085da-55a1-481f-b0e3-0f129b3e8985 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.062808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f085da-55a1-481f-b0e3-0f129b3e8985 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.065451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f085da-55a1-481f-b0e3-0f129b3e8985 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.238461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9cad9ae0-1991-4cde-a5f7-34c94833932c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:20.252161 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9cad9ae0-1991-4cde-a5f7-34c94833932c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1316 microversion: 2.1 time: 0.361532 Oct 04 18:05:20.252769 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 499/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:20.481874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-36f085da-55a1-481f-b0e3-0f129b3e8985 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:20.496187 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-36f085da-55a1-481f-b0e3-0f129b3e8985 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.465020 Oct 04 18:05:20.498143 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 521/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:20.775677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d7108536-57aa-4b60-9826-7b4550790a56 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.776415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d7108536-57aa-4b60-9826-7b4550790a56 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.800582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-39b8947f-060c-4984-9856-dac1cbb8dcc0 req-6335707c-6dc2-41a0-8bef-6c5778c0add4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de4dafc5-240b-4d3e-8fb4-71121b9a9e8a", "tag": "177c1fa2-47af-47d8-b025-616202d19293"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:20.804676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7108536-57aa-4b60-9826-7b4550790a56 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.809390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7108536-57aa-4b60-9826-7b4550790a56 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.809955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7108536-57aa-4b60-9826-7b4550790a56 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.810725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7108536-57aa-4b60-9826-7b4550790a56 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.811245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7108536-57aa-4b60-9826-7b4550790a56 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.811768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7108536-57aa-4b60-9826-7b4550790a56 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.830052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-39b8947f-060c-4984-9856-dac1cbb8dcc0 req-6335707c-6dc2-41a0-8bef-6c5778c0add4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.831813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-39b8947f-060c-4984-9856-dac1cbb8dcc0 req-6335707c-6dc2-41a0-8bef-6c5778c0add4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.832267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-39b8947f-060c-4984-9856-dac1cbb8dcc0 req-6335707c-6dc2-41a0-8bef-6c5778c0add4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.851095 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-39b8947f-060c-4984-9856-dac1cbb8dcc0 req-6335707c-6dc2-41a0-8bef-6c5778c0add4 service nova] Creating event network-changed:177c1fa2-47af-47d8-b025-616202d19293 for instance de4dafc5-240b-4d3e-8fb4-71121b9a9e8a on n-h2-850499-14 Oct 04 18:05:20.858128 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-39b8947f-060c-4984-9856-dac1cbb8dcc0 req-6335707c-6dc2-41a0-8bef-6c5778c0add4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062282 Oct 04 18:05:20.858895 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 522/1021] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:21.125540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d7108536-57aa-4b60-9826-7b4550790a56 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.140512 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d7108536-57aa-4b60-9826-7b4550790a56 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1538 microversion: 2.1 time: 0.374345 Oct 04 18:05:21.142382 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 500/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1538 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:21.285113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-935c47e9-6876-456e-80de-cebd6f2d4f84 req-e324fe5e-cd9a-4235-beba-d1b3b6efba56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9f193d-65a7-48df-96b4-ee57115149a2", "tag": "f53b385d-ad62-40bc-9e0f-d89171784dac"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:21.285930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9a2470a-b0b3-4801-bb54-db1af2de7710 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:21.286614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9a2470a-b0b3-4801-bb54-db1af2de7710 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:21.305544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a2470a-b0b3-4801-bb54-db1af2de7710 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.307170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a2470a-b0b3-4801-bb54-db1af2de7710 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.309953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-935c47e9-6876-456e-80de-cebd6f2d4f84 req-e324fe5e-cd9a-4235-beba-d1b3b6efba56 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.310895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a2470a-b0b3-4801-bb54-db1af2de7710 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.312066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a2470a-b0b3-4801-bb54-db1af2de7710 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.312718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a2470a-b0b3-4801-bb54-db1af2de7710 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.313481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-935c47e9-6876-456e-80de-cebd6f2d4f84 req-e324fe5e-cd9a-4235-beba-d1b3b6efba56 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.314134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a2470a-b0b3-4801-bb54-db1af2de7710 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.314773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-935c47e9-6876-456e-80de-cebd6f2d4f84 req-e324fe5e-cd9a-4235-beba-d1b3b6efba56 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.340749 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-935c47e9-6876-456e-80de-cebd6f2d4f84 req-e324fe5e-cd9a-4235-beba-d1b3b6efba56 service nova] Creating event network-changed:f53b385d-ad62-40bc-9e0f-d89171784dac for instance 3b9f193d-65a7-48df-96b4-ee57115149a2 on n-h1-850499-14 Oct 04 18:05:21.358159 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-935c47e9-6876-456e-80de-cebd6f2d4f84 req-e324fe5e-cd9a-4235-beba-d1b3b6efba56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084049 Oct 04 18:05:21.358828 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 523/1023] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:21.534840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c688bba-3ee9-4c93-bb20-55a689136b7c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:21.536499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c688bba-3ee9-4c93-bb20-55a689136b7c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:21.544109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c688bba-3ee9-4c93-bb20-55a689136b7c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.545154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c688bba-3ee9-4c93-bb20-55a689136b7c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.545753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c688bba-3ee9-4c93-bb20-55a689136b7c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.546693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c688bba-3ee9-4c93-bb20-55a689136b7c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.547348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c688bba-3ee9-4c93-bb20-55a689136b7c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.547936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c688bba-3ee9-4c93-bb20-55a689136b7c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.711658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9a2470a-b0b3-4801-bb54-db1af2de7710 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.721616 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9a2470a-b0b3-4801-bb54-db1af2de7710 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1316 microversion: 2.1 time: 0.444322 Oct 04 18:05:21.723254 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 501/1024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:21 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:21.859773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3c688bba-3ee9-4c93-bb20-55a689136b7c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.878648 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c688bba-3ee9-4c93-bb20-55a689136b7c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.348012 Oct 04 18:05:21.896531 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 524/1025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:21 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:22.171697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-86c08f78-8945-4a28-bc34-0ba8272ee838 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.173634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-86c08f78-8945-4a28-bc34-0ba8272ee838 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.186751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86c08f78-8945-4a28-bc34-0ba8272ee838 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.187290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86c08f78-8945-4a28-bc34-0ba8272ee838 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.188149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86c08f78-8945-4a28-bc34-0ba8272ee838 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.188914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86c08f78-8945-4a28-bc34-0ba8272ee838 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.189624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86c08f78-8945-4a28-bc34-0ba8272ee838 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.190484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86c08f78-8945-4a28-bc34-0ba8272ee838 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.382648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-86c08f78-8945-4a28-bc34-0ba8272ee838 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:22.393610 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-86c08f78-8945-4a28-bc34-0ba8272ee838 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1538 microversion: 2.1 time: 0.226149 Oct 04 18:05:22.408636 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 502/1026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1538 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:22.752177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a4d15987-7f79-4f9b-af98-8585700b0255 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.754138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a4d15987-7f79-4f9b-af98-8585700b0255 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.765021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4d15987-7f79-4f9b-af98-8585700b0255 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.765806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4d15987-7f79-4f9b-af98-8585700b0255 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.766418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4d15987-7f79-4f9b-af98-8585700b0255 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.767326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4d15987-7f79-4f9b-af98-8585700b0255 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.767937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4d15987-7f79-4f9b-af98-8585700b0255 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.768519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4d15987-7f79-4f9b-af98-8585700b0255 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.902899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:22.908519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9d1b812-da7c-4529-a4c9-781548f03f10 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.909805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9d1b812-da7c-4529-a4c9-781548f03f10 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.922837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9d1b812-da7c-4529-a4c9-781548f03f10 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.923300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9d1b812-da7c-4529-a4c9-781548f03f10 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.923705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9d1b812-da7c-4529-a4c9-781548f03f10 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.925143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9d1b812-da7c-4529-a4c9-781548f03f10 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.925919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9d1b812-da7c-4529-a4c9-781548f03f10 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.926356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9d1b812-da7c-4529-a4c9-781548f03f10 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.980411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a4d15987-7f79-4f9b-af98-8585700b0255 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:22.990165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a4d15987-7f79-4f9b-af98-8585700b0255 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1316 microversion: 2.1 time: 0.244156 Oct 04 18:05:22.991396 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 525/1027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:23.109789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9d1b812-da7c-4529-a4c9-781548f03f10 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:23.119701 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9d1b812-da7c-4529-a4c9-781548f03f10 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.216817 Oct 04 18:05:23.120591 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 503/1028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:23.419827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b9b04c4-d8c6-4797-839c-7da79fcbc88b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:23.420536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2b9b04c4-d8c6-4797-839c-7da79fcbc88b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:23.427779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b9b04c4-d8c6-4797-839c-7da79fcbc88b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.428492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b9b04c4-d8c6-4797-839c-7da79fcbc88b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.429024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b9b04c4-d8c6-4797-839c-7da79fcbc88b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.429850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b9b04c4-d8c6-4797-839c-7da79fcbc88b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.430393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b9b04c4-d8c6-4797-839c-7da79fcbc88b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.451416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b9b04c4-d8c6-4797-839c-7da79fcbc88b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.704255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b9b04c4-d8c6-4797-839c-7da79fcbc88b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:23.713771 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2b9b04c4-d8c6-4797-839c-7da79fcbc88b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1538 microversion: 2.1 time: 0.298912 Oct 04 18:05:23.730368 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 526/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:23 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1538 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:24.013874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-320dd645-0bc9-4e78-af0e-8d2967ad9335 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.014777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-320dd645-0bc9-4e78-af0e-8d2967ad9335 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.019497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:24.024602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-320dd645-0bc9-4e78-af0e-8d2967ad9335 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.025703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-320dd645-0bc9-4e78-af0e-8d2967ad9335 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.026149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-320dd645-0bc9-4e78-af0e-8d2967ad9335 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.027121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-320dd645-0bc9-4e78-af0e-8d2967ad9335 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.027833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-320dd645-0bc9-4e78-af0e-8d2967ad9335 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.028333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-320dd645-0bc9-4e78-af0e-8d2967ad9335 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.143321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de26b0ec-e2c0-45af-95d4-d1baa8902ce3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.144505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-de26b0ec-e2c0-45af-95d4-d1baa8902ce3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.152090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de26b0ec-e2c0-45af-95d4-d1baa8902ce3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.152916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de26b0ec-e2c0-45af-95d4-d1baa8902ce3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.153533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de26b0ec-e2c0-45af-95d4-d1baa8902ce3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.154436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de26b0ec-e2c0-45af-95d4-d1baa8902ce3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.155134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de26b0ec-e2c0-45af-95d4-d1baa8902ce3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.155733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de26b0ec-e2c0-45af-95d4-d1baa8902ce3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.205968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-320dd645-0bc9-4e78-af0e-8d2967ad9335 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.217687 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-320dd645-0bc9-4e78-af0e-8d2967ad9335 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1316 microversion: 2.1 time: 0.207728 Oct 04 18:05:24.218690 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 504/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:24.328623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de26b0ec-e2c0-45af-95d4-d1baa8902ce3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.336762 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de26b0ec-e2c0-45af-95d4-d1baa8902ce3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.197664 Oct 04 18:05:24.337867 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 527/1031] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:24.737377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-713e3a35-9027-41ea-8987-bbdc1051ab21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.738092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-713e3a35-9027-41ea-8987-bbdc1051ab21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.745126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713e3a35-9027-41ea-8987-bbdc1051ab21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.745634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713e3a35-9027-41ea-8987-bbdc1051ab21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.746073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713e3a35-9027-41ea-8987-bbdc1051ab21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.746792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713e3a35-9027-41ea-8987-bbdc1051ab21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.747281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713e3a35-9027-41ea-8987-bbdc1051ab21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.747708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713e3a35-9027-41ea-8987-bbdc1051ab21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.910074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-713e3a35-9027-41ea-8987-bbdc1051ab21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.919624 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-713e3a35-9027-41ea-8987-bbdc1051ab21 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.185812 Oct 04 18:05:24.920209 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 505/1032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:25.250835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ece2e397-85d9-4c3a-a887-4ccd25c0ab60 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.251904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ece2e397-85d9-4c3a-a887-4ccd25c0ab60 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.254030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:25.255141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=14 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:25.262744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ece2e397-85d9-4c3a-a887-4ccd25c0ab60 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.263558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ece2e397-85d9-4c3a-a887-4ccd25c0ab60 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.264064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ece2e397-85d9-4c3a-a887-4ccd25c0ab60 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.265020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ece2e397-85d9-4c3a-a887-4ccd25c0ab60 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.265528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ece2e397-85d9-4c3a-a887-4ccd25c0ab60 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.266047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ece2e397-85d9-4c3a-a887-4ccd25c0ab60 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.364488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e6a24da-164f-4ef8-9890-a68cf8616189 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.365125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e6a24da-164f-4ef8-9890-a68cf8616189 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.373928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e6a24da-164f-4ef8-9890-a68cf8616189 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.374498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e6a24da-164f-4ef8-9890-a68cf8616189 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.375001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e6a24da-164f-4ef8-9890-a68cf8616189 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.375749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e6a24da-164f-4ef8-9890-a68cf8616189 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.376214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e6a24da-164f-4ef8-9890-a68cf8616189 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.376653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e6a24da-164f-4ef8-9890-a68cf8616189 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.417050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ece2e397-85d9-4c3a-a887-4ccd25c0ab60 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.429250 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ece2e397-85d9-4c3a-a887-4ccd25c0ab60 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1316 microversion: 2.1 time: 0.182799 Oct 04 18:05:25.430208 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 528/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:25 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:25.591687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7e6a24da-164f-4ef8-9890-a68cf8616189 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.600449 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e6a24da-164f-4ef8-9890-a68cf8616189 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.241797 Oct 04 18:05:25.601641 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 506/1034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:25 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:25.945065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59e404e1-da1a-4727-a485-66ac8c759218 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.946074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59e404e1-da1a-4727-a485-66ac8c759218 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.954801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e404e1-da1a-4727-a485-66ac8c759218 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.956346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e404e1-da1a-4727-a485-66ac8c759218 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.957031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e404e1-da1a-4727-a485-66ac8c759218 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.958575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e404e1-da1a-4727-a485-66ac8c759218 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.959465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e404e1-da1a-4727-a485-66ac8c759218 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.960752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e404e1-da1a-4727-a485-66ac8c759218 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.146639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-59e404e1-da1a-4727-a485-66ac8c759218 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:26.157119 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59e404e1-da1a-4727-a485-66ac8c759218 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.216092 Oct 04 18:05:26.157708 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 529/1035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:25 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:26.459051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b22b40a5-265d-4886-b796-f7a48bef3209 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:26.460466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b22b40a5-265d-4886-b796-f7a48bef3209 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:26.469627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b22b40a5-265d-4886-b796-f7a48bef3209 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.470828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b22b40a5-265d-4886-b796-f7a48bef3209 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.471639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b22b40a5-265d-4886-b796-f7a48bef3209 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.472571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b22b40a5-265d-4886-b796-f7a48bef3209 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.473236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b22b40a5-265d-4886-b796-f7a48bef3209 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.473888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b22b40a5-265d-4886-b796-f7a48bef3209 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.625828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c9e50fb1-52f0-48f8-b713-d34ff1b42f07 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:26.626678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c9e50fb1-52f0-48f8-b713-d34ff1b42f07 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:26.633190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9e50fb1-52f0-48f8-b713-d34ff1b42f07 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.633502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b22b40a5-265d-4886-b796-f7a48bef3209 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:26.634068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9e50fb1-52f0-48f8-b713-d34ff1b42f07 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.634937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9e50fb1-52f0-48f8-b713-d34ff1b42f07 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.636770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9e50fb1-52f0-48f8-b713-d34ff1b42f07 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.637413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9e50fb1-52f0-48f8-b713-d34ff1b42f07 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.638057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9e50fb1-52f0-48f8-b713-d34ff1b42f07 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.642458 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b22b40a5-265d-4886-b796-f7a48bef3209 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1316 microversion: 2.1 time: 0.190161 Oct 04 18:05:26.643073 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 507/1036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:26 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:26.777073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c9e50fb1-52f0-48f8-b713-d34ff1b42f07 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:26.786137 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c9e50fb1-52f0-48f8-b713-d34ff1b42f07 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.164125 Oct 04 18:05:26.786805 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 530/1037] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:26 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:27.182170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-936c79f1-166a-44bf-89b8-ec7d50f3cdb4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.182792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-936c79f1-166a-44bf-89b8-ec7d50f3cdb4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:27.189171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936c79f1-166a-44bf-89b8-ec7d50f3cdb4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.189670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936c79f1-166a-44bf-89b8-ec7d50f3cdb4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.190147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936c79f1-166a-44bf-89b8-ec7d50f3cdb4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.191125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936c79f1-166a-44bf-89b8-ec7d50f3cdb4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.191585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936c79f1-166a-44bf-89b8-ec7d50f3cdb4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.192033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936c79f1-166a-44bf-89b8-ec7d50f3cdb4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.340510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-936c79f1-166a-44bf-89b8-ec7d50f3cdb4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:27.348913 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-936c79f1-166a-44bf-89b8-ec7d50f3cdb4 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.171272 Oct 04 18:05:27.349480 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 508/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:27.484117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1098f12a-b1e3-4784-8384-c8039a724f87 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-541939190", "id": 428011542, "os-flavor-access:is_public": "True"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:27.504864 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1098f12a-b1e3-4784-8384-c8039a724f87 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.139111 Oct 04 18:05:27.505462 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 531/1039] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:27 2022] POST /compute/v2.1/flavors => generated 426 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:27.517772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3f3cb5d5-eaa3-407a-ad2b-802393886e06 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.536734 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3f3cb5d5-eaa3-407a-ad2b-802393886e06 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/428011542" status: 202 len: 0 microversion: 2.1 time: 0.022355 Oct 04 18:05:27.538466 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 509/1040] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:27 2022] DELETE /compute/v2.1/flavors/428011542 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:27.546530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bd4ccf3e-a99f-4ffe-b25d-d950ffd3925d tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.552761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:27.567760 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bd4ccf3e-a99f-4ffe-b25d-d950ffd3925d tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025033 Oct 04 18:05:27.568352 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 532/1041] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:27.588003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ff3ad4c-ae33-438c-a91d-1d2d83e20a58 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-642298892", "id": 1292345072, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:27.607089 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ff3ad4c-ae33-438c-a91d-1d2d83e20a58 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.022923 Oct 04 18:05:27.607691 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 510/1042] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:27 2022] POST /compute/v2.1/flavors => generated 416 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:27.622909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70a41223-5e7c-40cf-8147-7ad925399652 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.643899 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70a41223-5e7c-40cf-8147-7ad925399652 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.026070 Oct 04 18:05:27.644554 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 533/1043] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:27.666098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c379266d-5dd1-420d-97ad-de7bee44d2d1 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.667277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d95621bb-aaa6-4c51-b891-6b027e2b7466 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.667890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d95621bb-aaa6-4c51-b891-6b027e2b7466 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:27.674375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d95621bb-aaa6-4c51-b891-6b027e2b7466 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.674870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d95621bb-aaa6-4c51-b891-6b027e2b7466 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.675342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d95621bb-aaa6-4c51-b891-6b027e2b7466 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.676466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d95621bb-aaa6-4c51-b891-6b027e2b7466 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.676598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d95621bb-aaa6-4c51-b891-6b027e2b7466 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.676932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d95621bb-aaa6-4c51-b891-6b027e2b7466 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.685305 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c379266d-5dd1-420d-97ad-de7bee44d2d1 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1292345072" status: 202 len: 0 microversion: 2.1 time: 0.022965 Oct 04 18:05:27.685995 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 511/1044] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:27 2022] DELETE /compute/v2.1/flavors/1292345072 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:27.694027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bec5b03c-6b35-4f64-b576-36a0b2eacac8 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.718093 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bec5b03c-6b35-4f64-b576-36a0b2eacac8 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027594 Oct 04 18:05:27.719653 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 512/1045] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:27.738353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-de21001c-18b8-4244-9d4c-79decde00ff6 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2033459399", "id": 1929148274, "os-flavor-access:is_public": "True"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:27.764578 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-de21001c-18b8-4244-9d4c-79decde00ff6 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.029727 Oct 04 18:05:27.765552 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 513/1046] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:27 2022] POST /compute/v2.1/flavors => generated 429 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:27.777617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c047e99-a939-4334-8f34-377cc638bc5c tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.804946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3c047e99-a939-4334-8f34-377cc638bc5c tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1929148274" status: 202 len: 0 microversion: 2.1 time: 0.030960 Oct 04 18:05:27.806586 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 514/1047] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:27 2022] DELETE /compute/v2.1/flavors/1929148274 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:05:27.812056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e07b3fe-300a-4d20-a9ed-3210a2779a76 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.812577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1e07b3fe-300a-4d20-a9ed-3210a2779a76 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:27.818995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e07b3fe-300a-4d20-a9ed-3210a2779a76 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.819521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e07b3fe-300a-4d20-a9ed-3210a2779a76 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.819961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e07b3fe-300a-4d20-a9ed-3210a2779a76 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.822591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e07b3fe-300a-4d20-a9ed-3210a2779a76 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.822591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e07b3fe-300a-4d20-a9ed-3210a2779a76 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.822591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e07b3fe-300a-4d20-a9ed-3210a2779a76 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.832441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d95621bb-aaa6-4c51-b891-6b027e2b7466 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:27.840989 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d95621bb-aaa6-4c51-b891-6b027e2b7466 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1316 microversion: 2.1 time: 0.177558 Oct 04 18:05:27.849580 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 534/1048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:27.859020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8e55774-2740-47c4-88e0-6d0dd890f4f3 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.890048 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8e55774-2740-47c4-88e0-6d0dd890f4f3 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038974 Oct 04 18:05:27.890907 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 535/1049] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:27.909820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1bb60152-7fda-4086-8f21-ea266795c9bf tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-553546282", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:27.937395 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1bb60152-7fda-4086-8f21-ea266795c9bf tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.031192 Oct 04 18:05:27.938004 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 536/1050] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:27 2022] POST /compute/v2.1/flavors => generated 506 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:27.952682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fa4ca961-f96a-4826-8896-5631320f093c tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.971385 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fa4ca961-f96a-4826-8896-5631320f093c tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/9c83364f-8595-49ac-90a6-d9d442293cbc" status: 202 len: 0 microversion: 2.1 time: 0.022540 Oct 04 18:05:27.971710 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 537/1051] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:27 2022] DELETE /compute/v2.1/flavors/9c83364f-8595-49ac-90a6-d9d442293cbc => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:27.981047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f5093553-0407-48dc-8eba-ca27de84bbb7 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.995792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1e07b3fe-300a-4d20-a9ed-3210a2779a76 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:28.005580 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f5093553-0407-48dc-8eba-ca27de84bbb7 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029147 Oct 04 18:05:28.005857 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1e07b3fe-300a-4d20-a9ed-3210a2779a76 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.197685 Oct 04 18:05:28.006192 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 538/1052] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.011819 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 515/1053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.015606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-fb507018-3ae0-4f91-a06f-bebd4c234570 req-43208ea6-eeea-4088-b2a8-0847b4aac29f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f193d-65a7-48df-96b4-ee57115149a2", "name": "network-vif-plugged", "status": "completed", "tag": "f53b385d-ad62-40bc-9e0f-d89171784dac"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:28.031028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-edefd837-f753-404c-969e-41c2876cc5f7 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2115798998", "id": "333df9a5-1420-4468-8205-a93e696318a4", "os-flavor-access:is_public": "True"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:28.031261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fb507018-3ae0-4f91-a06f-bebd4c234570 req-43208ea6-eeea-4088-b2a8-0847b4aac29f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.031261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fb507018-3ae0-4f91-a06f-bebd4c234570 req-43208ea6-eeea-4088-b2a8-0847b4aac29f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.031261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fb507018-3ae0-4f91-a06f-bebd4c234570 req-43208ea6-eeea-4088-b2a8-0847b4aac29f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.042253 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-fb507018-3ae0-4f91-a06f-bebd4c234570 req-43208ea6-eeea-4088-b2a8-0847b4aac29f service nova] Creating event network-vif-plugged:f53b385d-ad62-40bc-9e0f-d89171784dac for instance 3b9f193d-65a7-48df-96b4-ee57115149a2 on n-h1-850499-14 Oct 04 18:05:28.047722 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-fb507018-3ae0-4f91-a06f-bebd4c234570 req-43208ea6-eeea-4088-b2a8-0847b4aac29f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040365 Oct 04 18:05:28.048859 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 539/1054] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:28.061372 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-edefd837-f753-404c-969e-41c2876cc5f7 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.036913 Oct 04 18:05:28.070460 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 516/1055] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:28 2022] POST /compute/v2.1/flavors => generated 507 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:28.084980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2aa5f577-cf77-433f-9669-b3b304295501 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.107765 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2aa5f577-cf77-433f-9669-b3b304295501 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/333df9a5-1420-4468-8205-a93e696318a4" status: 202 len: 0 microversion: 2.1 time: 0.027966 Oct 04 18:05:28.108745 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 540/1056] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:28 2022] DELETE /compute/v2.1/flavors/333df9a5-1420-4468-8205-a93e696318a4 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:28.118173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d96dbb94-f9ab-4904-bae4-8de7b8cd7156 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.141565 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d96dbb94-f9ab-4904-bae4-8de7b8cd7156 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027146 Oct 04 18:05:28.142366 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 517/1057] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:28.163076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-280d425f-31ef-48c4-a6a5-7537dc8d7ec6 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-591801277", "id": 1412214518, "os-flavor-access:is_public": "True"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:28.181386 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-280d425f-31ef-48c4-a6a5-7537dc8d7ec6 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.021763 Oct 04 18:05:28.182392 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 541/1058] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:28 2022] POST /compute/v2.1/flavors => generated 413 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:28.196287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-594dfa52-aed6-46f0-84d1-8c95eb08b49e tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.204281 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-594dfa52-aed6-46f0-84d1-8c95eb08b49e tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1412214518" status: 200 len: 413 microversion: 2.1 time: 0.013031 Oct 04 18:05:28.204903 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 518/1059] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/1412214518 => generated 413 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:28.326815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d40e75ec-3110-4acd-aff5-22b5b4c0fd5b tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.350258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d40e75ec-3110-4acd-aff5-22b5b4c0fd5b tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.135688 Oct 04 18:05:28.350768 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 542/1060] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.369064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b759e8ee-4ddc-446c-9952-22a576873c82 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.371040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eb564224-4245-4ada-9704-6c86b5476d7a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.371789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eb564224-4245-4ada-9704-6c86b5476d7a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:28.378149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb564224-4245-4ada-9704-6c86b5476d7a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.378643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb564224-4245-4ada-9704-6c86b5476d7a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.379119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb564224-4245-4ada-9704-6c86b5476d7a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.379851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb564224-4245-4ada-9704-6c86b5476d7a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.380308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb564224-4245-4ada-9704-6c86b5476d7a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.380735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb564224-4245-4ada-9704-6c86b5476d7a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.387694 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b759e8ee-4ddc-446c-9952-22a576873c82 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1412214518" status: 202 len: 0 microversion: 2.1 time: 0.022230 Oct 04 18:05:28.388577 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 519/1061] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:28 2022] DELETE /compute/v2.1/flavors/1412214518 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:28.396297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a1825e27-1d2e-44f2-bbf5-45e8b715d55f tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.417014 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a1825e27-1d2e-44f2-bbf5-45e8b715d55f tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024249 Oct 04 18:05:28.417618 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 520/1062] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:28.440745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-05cd3062-be58-4d0c-a121-bf1f07f4b9d4 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1345970328", "id": 1663325741, "os-flavor-access:is_public": "False"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:28.459687 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-05cd3062-be58-4d0c-a121-bf1f07f4b9d4 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.025954 Oct 04 18:05:28.460308 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 521/1063] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:28 2022] POST /compute/v2.1/flavors => generated 430 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:28.475361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4da2f962-0ea1-44df-9770-598d7ec442b3 tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "1663325741"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:28.486567 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4da2f962-0ea1-44df-9770-598d7ec442b3 tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] HTTP exception thrown: Flavor 1663325741 could not be found. Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4da2f962-0ea1-44df-9770-598d7ec442b3 tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] Request method failure captured: Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 107 Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHXm3o8Ac3eps7EPh3y5bxUzMx2Sot0Q6yf8f0LeUdkteHMWCMPHkM-xPwjGYCebnX5XAJzoM_T-LFptJtOYaV0nE-5_LCwn0eUnnM20PxBOZReZW05cUoU5F29yRBwS4VHtzK343StOpl0STNb8Hp60Lp5oxM4RDWddMJP8gNasO_U Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 94d87dc1ab2c428d8426108d910fae72 Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FlavorsAdminTestJSON-1776273854 Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:05:28.492869 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_94d87dc1ab2c428d8426108d910fae72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/94d87dc1ab2c428d8426108d910fae72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/94d87dc1ab2c428d8426108d910fae72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/94d87dc1ab2c428d8426108d910fae72"}]}] Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FlavorsAdminTestJSON-1776273854 Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 94d87dc1ab2c428d8426108d910fae72 Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1776273854 Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FlavorsAdminTestJSON-1776273854-project Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 8631e9c3b73042bead3816086261466e Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FlavorsAdminTestJSON-1776273854-project Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "test", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "1663325741"}} Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:05:28.495204 n-d-850499-14 devstack@n-api.service[122331]: exception: Flavor 1663325741 could not be found. Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '1663325741'}}} Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1663325741 could not be found. Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:28.496211 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1663325741 could not be found. Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:28.497867 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:28.499407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:28.499407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:28.499407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:28.499407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1663325741 could not be found. Oct 04 18:05:28.499407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:28.499407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4da2f962-0ea1-44df-9770-598d7ec442b3 tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] Returning 400 to user: Flavor 1663325741 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:28.499407 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4da2f962-0ea1-44df-9770-598d7ec442b3 tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.023666 Oct 04 18:05:28.499407 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 522/1064] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:28 2022] POST /compute/v2.1/servers => generated 81 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:05:28.503553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6a16ac00-969a-4aea-a300-c1875c2ed4fa tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.516911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=18,nova_api:INSERT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:28.522896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eb564224-4245-4ada-9704-6c86b5476d7a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:28.525357 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6a16ac00-969a-4aea-a300-c1875c2ed4fa tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1663325741" status: 202 len: 0 microversion: 2.1 time: 0.025368 Oct 04 18:05:28.525952 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 523/1065] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:28 2022] DELETE /compute/v2.1/flavors/1663325741 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:28.531283 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eb564224-4245-4ada-9704-6c86b5476d7a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.163924 Oct 04 18:05:28.532071 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 543/1066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:28.535775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c080fd6-fc34-4b5b-bc52-117c97e754c2 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.557976 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c080fd6-fc34-4b5b-bc52-117c97e754c2 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025796 Oct 04 18:05:28.558567 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 524/1067] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.579760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06f735d9-2623-4cf4-b7c1-048ecddfbd56 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2098746370", "id": 2110959173, "os-flavor-access:is_public": "False"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:28.597925 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-06f735d9-2623-4cf4-b7c1-048ecddfbd56 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.021832 Oct 04 18:05:28.598517 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 544/1068] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:28 2022] POST /compute/v2.1/flavors => generated 415 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:28.611193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c0549e8-d59f-418b-81f4-7ab2148d0689 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-912515078", "id": 932538965, "os-flavor-access:is_public": "True"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:28.628793 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c0549e8-d59f-418b-81f4-7ab2148d0689 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.021949 Oct 04 18:05:28.629387 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 525/1069] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:28 2022] POST /compute/v2.1/flavors => generated 410 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:28.641520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f7c6464-68cb-48eb-a462-dd7999c6bc85 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.658852 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f7c6464-68cb-48eb-a462-dd7999c6bc85 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.020878 Oct 04 18:05:28.659613 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 545/1070] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:28.672784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e99e117e-9424-4eba-a2b2-0cd67d3d0930 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.690670 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e99e117e-9424-4eba-a2b2-0cd67d3d0930 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.021706 Oct 04 18:05:28.691289 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 526/1071] 10.222.0.18 () {58 vars in 1177 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:28.704923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-73bbcd33-9f51-4403-8681-423221f5bc37 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.714736 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-73bbcd33-9f51-4403-8681-423221f5bc37 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.013826 Oct 04 18:05:28.715415 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 546/1072] 10.222.0.18 () {58 vars in 1171 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:28.727852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-07a193bb-be18-4d8f-9bee-1761947554b9 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.737655 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-07a193bb-be18-4d8f-9bee-1761947554b9 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.013406 Oct 04 18:05:28.738205 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 527/1073] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:28.752495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bf2f7589-54ab-41c1-8a2b-7d5fc01b5d1f tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.775040 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bf2f7589-54ab-41c1-8a2b-7d5fc01b5d1f tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.026930 Oct 04 18:05:28.775578 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 547/1074] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.793902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-44a34d40-f9df-492c-a820-694b568a73c8 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.815617 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-44a34d40-f9df-492c-a820-694b568a73c8 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.025462 Oct 04 18:05:28.816218 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 528/1075] 10.222.0.18 () {58 vars in 1175 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.837491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f1ac8899-9eaa-436a-867d-50ecbe943c4d tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.862874 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f1ac8899-9eaa-436a-867d-50ecbe943c4d tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.029691 Oct 04 18:05:28.863928 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 548/1076] 10.222.0.18 () {58 vars in 1173 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.864740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ea268313-733f-45dc-9cf6-d3eeea3aaca5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.866354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ea268313-733f-45dc-9cf6-d3eeea3aaca5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:28.874245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea268313-733f-45dc-9cf6-d3eeea3aaca5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.874905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea268313-733f-45dc-9cf6-d3eeea3aaca5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.875564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea268313-733f-45dc-9cf6-d3eeea3aaca5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.876375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea268313-733f-45dc-9cf6-d3eeea3aaca5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.877172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea268313-733f-45dc-9cf6-d3eeea3aaca5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.877523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea268313-733f-45dc-9cf6-d3eeea3aaca5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.885028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a26c37a-8695-47fb-b40d-affd9dd3b04c tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.912500 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a26c37a-8695-47fb-b40d-affd9dd3b04c tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.030994 Oct 04 18:05:28.913193 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 549/1077] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:28.937630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3979e513-d4db-4ba4-8dc0-aebccb439b0a tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.961744 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3979e513-d4db-4ba4-8dc0-aebccb439b0a tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/932538965" status: 202 len: 0 microversion: 2.1 time: 0.029696 Oct 04 18:05:28.962262 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 550/1078] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:28 2022] DELETE /compute/v2.1/flavors/932538965 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:28.969735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10192f1a-5399-4643-b0b6-c6bdfdf0d1b8 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.991049 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10192f1a-5399-4643-b0b6-c6bdfdf0d1b8 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025004 Oct 04 18:05:29.000427 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 551/1079] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:29.033256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6644c501-e32a-407e-936d-5547458c3549 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.051067 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6644c501-e32a-407e-936d-5547458c3549 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2110959173" status: 202 len: 0 microversion: 2.1 time: 0.021844 Oct 04 18:05:29.051746 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 552/1080] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:29 2022] DELETE /compute/v2.1/flavors/2110959173 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:05:29.057330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a7b9364-2f22-403f-9bbe-ba55a747cf49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.057947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1a7b9364-2f22-403f-9bbe-ba55a747cf49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:29.065190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ea268313-733f-45dc-9cf6-d3eeea3aaca5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:29.067137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a7b9364-2f22-403f-9bbe-ba55a747cf49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.068069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a7b9364-2f22-403f-9bbe-ba55a747cf49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.068872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a7b9364-2f22-403f-9bbe-ba55a747cf49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.070155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a7b9364-2f22-403f-9bbe-ba55a747cf49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.071039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a7b9364-2f22-403f-9bbe-ba55a747cf49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.071919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a7b9364-2f22-403f-9bbe-ba55a747cf49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.073314 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ea268313-733f-45dc-9cf6-d3eeea3aaca5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1316 microversion: 2.1 time: 0.213475 Oct 04 18:05:29.073865 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 529/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:29.078318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8cbefee3-b0cf-4c57-8619-d56f3272b6ed tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.099584 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8cbefee3-b0cf-4c57-8619-d56f3272b6ed tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024393 Oct 04 18:05:29.100048 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 530/1082] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:29.138267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-540add37-b4bf-4e89-94a7-88e9dd65965c tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-157488734", "id": 1825438803, "os-flavor-access:is_public": "False"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:29.169959 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-540add37-b4bf-4e89-94a7-88e9dd65965c tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.038398 Oct 04 18:05:29.182990 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 531/1083] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:29 2022] POST /compute/v2.1/flavors => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:29.191447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4befc20a-c5a6-41a4-af2f-873544a3bdb5 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.218309 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4befc20a-c5a6-41a4-af2f-873544a3bdb5 tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025338 Oct 04 18:05:29.218309 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 532/1084] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:29.245793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e6c61cd5-8a68-4ee3-b2d2-8d0389553e5a tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.259178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1a7b9364-2f22-403f-9bbe-ba55a747cf49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:29.267737 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1a7b9364-2f22-403f-9bbe-ba55a747cf49 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.214962 Oct 04 18:05:29.268415 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 553/1085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:29.272075 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e6c61cd5-8a68-4ee3-b2d2-8d0389553e5a tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030701 Oct 04 18:05:29.272764 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 533/1086] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:29.300115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5f36efed-e8e5-4bce-a08f-763f4cb7958e tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.323131 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5f36efed-e8e5-4bce-a08f-763f4cb7958e tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1825438803" status: 202 len: 0 microversion: 2.1 time: 0.028846 Oct 04 18:05:29.323921 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 554/1087] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:29 2022] DELETE /compute/v2.1/flavors/1825438803 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:29.336795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da73f24e-c20c-4b28-8e4e-d0ad18eaae1c tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.369271 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-da73f24e-c20c-4b28-8e4e-d0ad18eaae1c tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039048 Oct 04 18:05:29.370052 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 534/1088] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:29.394243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-645da8e4-1968-466a-aebb-c762f22e05da tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2140998398", "id": 245206211, "os-flavor-access:is_public": "True"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:29.422640 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-645da8e4-1968-466a-aebb-c762f22e05da tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.035092 Oct 04 18:05:29.423272 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 555/1089] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:29 2022] POST /compute/v2.1/flavors => generated 411 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:29.437128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-873ee70b-d20f-4ecd-bbe0-ec2d8c16e8d3 tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.465710 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-873ee70b-d20f-4ecd-bbe0-ec2d8c16e8d3 tempest-FlavorsAdminTestJSON-1776273854 tempest-FlavorsAdminTestJSON-1776273854-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.033371 Oct 04 18:05:29.466460 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 535/1090] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:29.491319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b016b65-de8e-42a4-8553-cec77e98191a tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.509879 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b016b65-de8e-42a4-8553-cec77e98191a tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/245206211" status: 202 len: 0 microversion: 2.1 time: 0.022776 Oct 04 18:05:29.510479 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 556/1091] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:29 2022] DELETE /compute/v2.1/flavors/245206211 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:29.519330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f8798555-e789-480f-a88e-2d893a089bea tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.545405 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f8798555-e789-480f-a88e-2d893a089bea tempest-FlavorsAdminTestJSON-211385570 tempest-FlavorsAdminTestJSON-211385570-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030199 Oct 04 18:05:29.546178 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 536/1092] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:29.553805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-735d25ee-0e74-450d-89c8-1c636c36a24f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.554467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-735d25ee-0e74-450d-89c8-1c636c36a24f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:29.562241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-735d25ee-0e74-450d-89c8-1c636c36a24f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.563026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-735d25ee-0e74-450d-89c8-1c636c36a24f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.563772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-735d25ee-0e74-450d-89c8-1c636c36a24f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.564119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-735d25ee-0e74-450d-89c8-1c636c36a24f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.564622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-735d25ee-0e74-450d-89c8-1c636c36a24f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.564978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-735d25ee-0e74-450d-89c8-1c636c36a24f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.739444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-735d25ee-0e74-450d-89c8-1c636c36a24f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:29.748273 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-735d25ee-0e74-450d-89c8-1c636c36a24f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.198393 Oct 04 18:05:29.748886 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 557/1093] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:30.064988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-0ab20f24-2b77-499d-a465-11f9e93c8d4f req-e967de6a-aa0b-409e-8ec8-802606a1fdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4dafc5-240b-4d3e-8fb4-71121b9a9e8a", "name": "network-vif-plugged", "status": "completed", "tag": "177c1fa2-47af-47d8-b025-616202d19293"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:30.075646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0ab20f24-2b77-499d-a465-11f9e93c8d4f req-e967de6a-aa0b-409e-8ec8-802606a1fdf1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.076143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0ab20f24-2b77-499d-a465-11f9e93c8d4f req-e967de6a-aa0b-409e-8ec8-802606a1fdf1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.076564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0ab20f24-2b77-499d-a465-11f9e93c8d4f req-e967de6a-aa0b-409e-8ec8-802606a1fdf1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.088403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-0ab20f24-2b77-499d-a465-11f9e93c8d4f req-e967de6a-aa0b-409e-8ec8-802606a1fdf1 service nova] Creating event network-vif-plugged:177c1fa2-47af-47d8-b025-616202d19293 for instance de4dafc5-240b-4d3e-8fb4-71121b9a9e8a on n-h2-850499-14 Oct 04 18:05:30.093655 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-0ab20f24-2b77-499d-a465-11f9e93c8d4f req-e967de6a-aa0b-409e-8ec8-802606a1fdf1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032754 Oct 04 18:05:30.094428 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 537/1094] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:30.099768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1227992-c2e3-4428-a0b3-a3f451ecb2b6 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:30.100559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1227992-c2e3-4428-a0b3-a3f451ecb2b6 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:30.107018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1227992-c2e3-4428-a0b3-a3f451ecb2b6 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.107598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1227992-c2e3-4428-a0b3-a3f451ecb2b6 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.108150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1227992-c2e3-4428-a0b3-a3f451ecb2b6 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.109137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1227992-c2e3-4428-a0b3-a3f451ecb2b6 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.109709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1227992-c2e3-4428-a0b3-a3f451ecb2b6 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.110244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1227992-c2e3-4428-a0b3-a3f451ecb2b6 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.283231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1227992-c2e3-4428-a0b3-a3f451ecb2b6 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.294659 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1227992-c2e3-4428-a0b3-a3f451ecb2b6 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1316 microversion: 2.1 time: 0.199338 Oct 04 18:05:30.295517 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 558/1095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:30 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:30.307499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1288c0e0-a519-4a97-aace-28fac8912da5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:30.307499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1288c0e0-a519-4a97-aace-28fac8912da5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:30.315484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1288c0e0-a519-4a97-aace-28fac8912da5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.316226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1288c0e0-a519-4a97-aace-28fac8912da5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.316665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1288c0e0-a519-4a97-aace-28fac8912da5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.317457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1288c0e0-a519-4a97-aace-28fac8912da5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.317999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1288c0e0-a519-4a97-aace-28fac8912da5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.318435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1288c0e0-a519-4a97-aace-28fac8912da5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.496577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1288c0e0-a519-4a97-aace-28fac8912da5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.505464 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1288c0e0-a519-4a97-aace-28fac8912da5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.208060 Oct 04 18:05:30.506125 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 538/1096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:30 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:30.772865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ed286f8-f6bd-4872-8763-d43964ca5cd5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:30.773578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8ed286f8-f6bd-4872-8763-d43964ca5cd5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:30.780079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed286f8-f6bd-4872-8763-d43964ca5cd5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.780667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed286f8-f6bd-4872-8763-d43964ca5cd5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.781185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed286f8-f6bd-4872-8763-d43964ca5cd5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.781993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed286f8-f6bd-4872-8763-d43964ca5cd5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.782527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed286f8-f6bd-4872-8763-d43964ca5cd5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.783058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed286f8-f6bd-4872-8763-d43964ca5cd5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.804404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:30.997612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8ed286f8-f6bd-4872-8763-d43964ca5cd5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:31.006164 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8ed286f8-f6bd-4872-8763-d43964ca5cd5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.237193 Oct 04 18:05:31.006803 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 559/1097] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:30 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:31.319938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00ba0ac3-190e-49e3-ad52-90b839ac3f0a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:31.320568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00ba0ac3-190e-49e3-ad52-90b839ac3f0a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.328696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ba0ac3-190e-49e3-ad52-90b839ac3f0a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.329414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ba0ac3-190e-49e3-ad52-90b839ac3f0a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.329898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ba0ac3-190e-49e3-ad52-90b839ac3f0a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.330712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ba0ac3-190e-49e3-ad52-90b839ac3f0a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.331210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ba0ac3-190e-49e3-ad52-90b839ac3f0a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.331645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ba0ac3-190e-49e3-ad52-90b839ac3f0a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.499452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c08ef4ca-e171-4762-a0f5-6033b4c1ba74 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:31.499874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c08ef4ca-e171-4762-a0f5-6033b4c1ba74 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.507366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-00ba0ac3-190e-49e3-ad52-90b839ac3f0a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:31.507950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c08ef4ca-e171-4762-a0f5-6033b4c1ba74 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.508659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c08ef4ca-e171-4762-a0f5-6033b4c1ba74 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.509940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c08ef4ca-e171-4762-a0f5-6033b4c1ba74 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.510770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c08ef4ca-e171-4762-a0f5-6033b4c1ba74 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.511403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c08ef4ca-e171-4762-a0f5-6033b4c1ba74 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.512050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c08ef4ca-e171-4762-a0f5-6033b4c1ba74 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.516718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-00ba0ac3-190e-49e3-ad52-90b839ac3f0a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1466 microversion: 2.1 time: 0.201047 Oct 04 18:05:31.517312 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 539/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:31 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1466 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:31.529850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ead19cea-6803-4d52-bdd5-28c5ff6a23d8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:31.530471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ead19cea-6803-4d52-bdd5-28c5ff6a23d8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.538226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead19cea-6803-4d52-bdd5-28c5ff6a23d8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.539142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead19cea-6803-4d52-bdd5-28c5ff6a23d8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.539846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead19cea-6803-4d52-bdd5-28c5ff6a23d8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.540886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead19cea-6803-4d52-bdd5-28c5ff6a23d8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.541530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead19cea-6803-4d52-bdd5-28c5ff6a23d8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.542295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead19cea-6803-4d52-bdd5-28c5ff6a23d8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.767580 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c08ef4ca-e171-4762-a0f5-6033b4c1ba74 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1862 microversion: 2.1 time: 0.271739 Oct 04 18:05:31.769208 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 560/1099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:31 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1862 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:31.777293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ead19cea-6803-4d52-bdd5-28c5ff6a23d8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:31.789487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1049506666", "metadata": {"image_type": "test"}}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:31.792351 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ead19cea-6803-4d52-bdd5-28c5ff6a23d8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1317 microversion: 2.1 time: 0.266127 Oct 04 18:05:31.792944 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 540/1100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:31 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:31.797008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.805565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850499-14", "block_migration": true, "disk_over_commit": false}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:31.810883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.812069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.812888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.813859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.814943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.815866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.816857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.819610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.820405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.820990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.822146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.823148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.827014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.876488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lazy-loading 'flavor' on Instance uuid 513fb23f-209f-4de1-add7-84c46117aace {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:31.893107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Getting quotas for project 9347f6d02b614c0d85ece3ec91521bd4. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:31.896952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=18 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:31.902501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Going to try to live migrate instance to n-h2-850499-14 {{(pid=122331) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:05:31.904443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Getting quotas for user 424cdee7a8ef4100b600b8a59f8f7394 and project 9347f6d02b614c0d85ece3ec91521bd4. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:31.950572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:32.203653 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c63a5b6-06e6-405f-bbae-d06cdafb0b3f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "POST /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2/action" status: 202 len: 0 microversion: 2.1 time: 0.432307 Oct 04 18:05:32.204531 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 561/1101] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:31 2022] POST /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:05:32.210783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d714ec21-8d80-459f-bf69-765d49b87674 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:32.212557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d714ec21-8d80-459f-bf69-765d49b87674 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:32.224589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d714ec21-8d80-459f-bf69-765d49b87674 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.225434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d714ec21-8d80-459f-bf69-765d49b87674 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.226568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d714ec21-8d80-459f-bf69-765d49b87674 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.228025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d714ec21-8d80-459f-bf69-765d49b87674 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.228910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d714ec21-8d80-459f-bf69-765d49b87674 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.230012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d714ec21-8d80-459f-bf69-765d49b87674 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.435425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d714ec21-8d80-459f-bf69-765d49b87674 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:32.455978 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d714ec21-8d80-459f-bf69-765d49b87674 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.250002 Oct 04 18:05:32.456657 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 562/1102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:32 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:32.461736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b7f124a-270b-4ed5-a543-17834a05bf37 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e4af70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:32.533031 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6b7f124a-270b-4ed5-a543-17834a05bf37 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.074954 Oct 04 18:05:32.533729 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 563/1103] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:32 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:32.816886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33b811ac-1734-4fa2-8037-ff119753a475 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:32.817440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33b811ac-1734-4fa2-8037-ff119753a475 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:32.824668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33b811ac-1734-4fa2-8037-ff119753a475 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.825066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33b811ac-1734-4fa2-8037-ff119753a475 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.825474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33b811ac-1734-4fa2-8037-ff119753a475 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.826194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33b811ac-1734-4fa2-8037-ff119753a475 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.826667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33b811ac-1734-4fa2-8037-ff119753a475 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.827120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33b811ac-1734-4fa2-8037-ff119753a475 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.977848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-33b811ac-1734-4fa2-8037-ff119753a475 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:32.986122 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33b811ac-1734-4fa2-8037-ff119753a475 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1467 microversion: 2.1 time: 0.173196 Oct 04 18:05:32.986706 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 564/1104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:32 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1467 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:33.136886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0411d65a-6810-49a9-b808-a308607206fb tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1846054183", "ram": 512, "vcpus": 1, "disk": 10, "id": 1884758143, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:33.157697 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0411d65a-6810-49a9-b808-a308607206fb tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.169574 Oct 04 18:05:33.158180 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 565/1105] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:32 2022] POST /compute/v2.1/flavors => generated 416 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:33.163025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a8f7d07a-3ad0-4f4d-9e4a-7898666c6aa5 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.164309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a8f7d07a-3ad0-4f4d-9e4a-7898666c6aa5 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.171928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8f7d07a-3ad0-4f4d-9e4a-7898666c6aa5 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.172429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8f7d07a-3ad0-4f4d-9e4a-7898666c6aa5 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.172872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8f7d07a-3ad0-4f4d-9e4a-7898666c6aa5 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.173582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8f7d07a-3ad0-4f4d-9e4a-7898666c6aa5 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.174039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8f7d07a-3ad0-4f4d-9e4a-7898666c6aa5 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.179993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8f7d07a-3ad0-4f4d-9e4a-7898666c6aa5 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.670036 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a8f7d07a-3ad0-4f4d-9e4a-7898666c6aa5 tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1620 microversion: 2.1 time: 0.510358 Oct 04 18:05:33.670638 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 566/1106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1620 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:33.843139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9b881b27-cb9e-4863-afbc-681d43bfb5ef tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.856256 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-9b881b27-cb9e-4863-afbc-681d43bfb5ef tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] HTTP exception thrown: Flavor 1884758143 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9b881b27-cb9e-4863-afbc-681d43bfb5ef tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Request method failure captured: Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/flavors/1884758143/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHXrhdaJJ36UqzsH0z29JGd9Xeuvnbgz2jc0o9irSOxl71CRkNoXpO5qb-gJUmQ5_9qDJ7MGmp_q9nzpCbM_DLuZfUEKgDC2YwHmOr2X3jyNzt9ShkI28jCeb_HwTUUTN4uSyq50pmo-RJX-LWkutst6SE9QN-miVneQIych-aZ3enM Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ba491c99f22a491bbfb13adbc03e5706 Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:33.860672 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba491c99f22a491bbfb13adbc03e5706"}]}] Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ba491c99f22a491bbfb13adbc03e5706 Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 45111d7b5c4c43afa92462bebbb2e536 Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:05:33.862404 n-d-850499-14 devstack@n-api.service[122332]: exception: Flavor 1884758143 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'flavor_id': '1884758143', 'id': 'hw:cpu_thread_policy'} Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1884758143 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:33.863291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:33.865059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:33.865059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:33.865059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:33.865059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:33.865059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:33.865059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1884758143 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:05:33.865059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:33.865600 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7477a0fc-60db-404b-9325-f288ca305940 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/action" status: 202 len: 0 microversion: 2.1 time: 2.068757 Oct 04 18:05:33.866342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9b881b27-cb9e-4863-afbc-681d43bfb5ef tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Returning 404 to user: Flavor 1884758143 has no extra specs with key hw:cpu_thread_policy. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:33.866342 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9b881b27-cb9e-4863-afbc-681d43bfb5ef tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] 10.222.0.18 "GET /compute/v2.1/flavors/1884758143/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.193441 Oct 04 18:05:33.866342 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 567/1107] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/flavors/1884758143/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:33.866888 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 541/1108] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:31 2022] POST /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/action => generated 0 bytes in 2073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:33.874281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-744f905d-4d4a-4116-9bdd-5613da81a844 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1dd0430>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.878847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a08c9e81-489b-4200-97ca-73ce5ffaefae tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.880353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a08c9e81-489b-4200-97ca-73ce5ffaefae tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.893986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08c9e81-489b-4200-97ca-73ce5ffaefae tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.894498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08c9e81-489b-4200-97ca-73ce5ffaefae tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.895298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08c9e81-489b-4200-97ca-73ce5ffaefae tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.896099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08c9e81-489b-4200-97ca-73ce5ffaefae tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.896751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08c9e81-489b-4200-97ca-73ce5ffaefae tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.897211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08c9e81-489b-4200-97ca-73ce5ffaefae tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.935172 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-744f905d-4d4a-4116-9bdd-5613da81a844 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.066731 Oct 04 18:05:33.936034 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 542/1109] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:33.941361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12c08f79-381e-46ac-ac36-689bfa451fc7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.942183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-12c08f79-381e-46ac-ac36-689bfa451fc7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.949363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c08f79-381e-46ac-ac36-689bfa451fc7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.950104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c08f79-381e-46ac-ac36-689bfa451fc7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.950735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c08f79-381e-46ac-ac36-689bfa451fc7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.951659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c08f79-381e-46ac-ac36-689bfa451fc7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.952287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c08f79-381e-46ac-ac36-689bfa451fc7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.952885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c08f79-381e-46ac-ac36-689bfa451fc7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.145251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a08c9e81-489b-4200-97ca-73ce5ffaefae tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.149628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-12c08f79-381e-46ac-ac36-689bfa451fc7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.153813 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a08c9e81-489b-4200-97ca-73ce5ffaefae tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.281536 Oct 04 18:05:34.154486 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 568/1110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:34.159614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce07281d-6278-47ca-9079-df523e4b509b tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:34.163273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ce07281d-6278-47ca-9079-df523e4b509b tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '45111d7b5c4c43afa92462bebbb2e536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba491c99f22a491bbfb13adbc03e5706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce07281d-6278-47ca-9079-df523e4b509b tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Request method failure captured: Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/flavors/1884758143/os-extra_specs HTTP/1.1 Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 66 Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHXrhdaJJ36UqzsH0z29JGd9Xeuvnbgz2jc0o9irSOxl71CRkNoXpO5qb-gJUmQ5_9qDJ7MGmp_q9nzpCbM_DLuZfUEKgDC2YwHmOr2X3jyNzt9ShkI28jCeb_HwTUUTN4uSyq50pmo-RJX-LWkutst6SE9QN-miVneQIych-aZ3enM Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ba491c99f22a491bbfb13adbc03e5706 Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:34.164858 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba491c99f22a491bbfb13adbc03e5706"}]}] Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ba491c99f22a491bbfb13adbc03e5706 Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 45111d7b5c4c43afa92462bebbb2e536 Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 18:05:34.166756 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'flavor_id': '1884758143', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:34.167585 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:05:34.175804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.177304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce07281d-6278-47ca-9079-df523e4b509b tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:34.177304 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ce07281d-6278-47ca-9079-df523e4b509b tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] 10.222.0.18 "POST /compute/v2.1/flavors/1884758143/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.011117 Oct 04 18:05:34.177304 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 569/1111] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 4 18:05:34 2022] POST /compute/v2.1/flavors/1884758143/os-extra_specs => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:34.177304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-38247478", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "aa79c4dc-6409-43e7-85da-46dde9db68bd"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:34.182427 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12c08f79-381e-46ac-ac36-689bfa451fc7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.245122 Oct 04 18:05:34.183029 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 543/1112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:34.187681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d65bc342-7f17-40fa-bb28-325009f880fd tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:34.225382 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d65bc342-7f17-40fa-bb28-325009f880fd tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1884758143/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041083 Oct 04 18:05:34.232316 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 544/1113] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 4 18:05:34 2022] POST /compute/v2.1/flavors/1884758143/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:05:34.239349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ea38e93-d320-425b-b248-aa4652467492 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.241169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ea38e93-d320-425b-b248-aa4652467492 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '45111d7b5c4c43afa92462bebbb2e536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba491c99f22a491bbfb13adbc03e5706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ea38e93-d320-425b-b248-aa4652467492 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Request method failure captured: Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHXrhdaJJ36UqzsH0z29JGd9Xeuvnbgz2jc0o9irSOxl71CRkNoXpO5qb-gJUmQ5_9qDJ7MGmp_q9nzpCbM_DLuZfUEKgDC2YwHmOr2X3jyNzt9ShkI28jCeb_HwTUUTN4uSyq50pmo-RJX-LWkutst6SE9QN-miVneQIych-aZ3enM Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ba491c99f22a491bbfb13adbc03e5706 Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:05:34.244426 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba491c99f22a491bbfb13adbc03e5706"}]}] Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ba491c99f22a491bbfb13adbc03e5706 Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 45111d7b5c4c43afa92462bebbb2e536 Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:05:34.246105 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'flavor_id': '1884758143', 'id': 'hw:numa_nodes'} Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:34.246919 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:05:34.249048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.250243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:34.252017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ea38e93-d320-425b-b248-aa4652467492 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:34.253219 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ea38e93-d320-425b-b248-aa4652467492 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] 10.222.0.18 "DELETE /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.019175 Oct 04 18:05:34.257820 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 545/1114] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:05:34 2022] DELETE /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:34.263414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c24d0903-6512-40c5-a524-a433f486dd36 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:34.289066 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c24d0903-6512-40c5-a524-a433f486dd36 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1884758143/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029812 Oct 04 18:05:34.290607 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 546/1115] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 4 18:05:34 2022] POST /compute/v2.1/flavors/1884758143/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:05:34.300602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36ab2433-d34e-43f6-a131-3ae3cf22a363 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:34.303931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-36ab2433-d34e-43f6-a131-3ae3cf22a363 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '45111d7b5c4c43afa92462bebbb2e536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba491c99f22a491bbfb13adbc03e5706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36ab2433-d34e-43f6-a131-3ae3cf22a363 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Request method failure captured: Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 22 Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHXrhdaJJ36UqzsH0z29JGd9Xeuvnbgz2jc0o9irSOxl71CRkNoXpO5qb-gJUmQ5_9qDJ7MGmp_q9nzpCbM_DLuZfUEKgDC2YwHmOr2X3jyNzt9ShkI28jCeb_HwTUUTN4uSyq50pmo-RJX-LWkutst6SE9QN-miVneQIych-aZ3enM Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ba491c99f22a491bbfb13adbc03e5706 Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:05:34.305532 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba491c99f22a491bbfb13adbc03e5706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba491c99f22a491bbfb13adbc03e5706"}]}] Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ba491c99f22a491bbfb13adbc03e5706 Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 45111d7b5c4c43afa92462bebbb2e536 Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: {"hw:numa_nodes": "1"} Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:05:34.308729 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'flavor_id': '1884758143', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:34.310229 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:05:34.315233 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.321286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36ab2433-d34e-43f6-a131-3ae3cf22a363 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:34.321286 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-36ab2433-d34e-43f6-a131-3ae3cf22a363 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031 tempest-FlavorsExtraSpecsNegativeTestJSON-1193792031-project] 10.222.0.18 "PUT /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010914 Oct 04 18:05:34.321286 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 547/1116] 10.222.0.18 () {60 vars in 1265 bytes} [Tue Oct 4 18:05:34 2022] PUT /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:05:34.321286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13bfad5c-b8ca-4903-aa17-4d9909853f16 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.326414 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-13bfad5c-b8ca-4903-aa17-4d9909853f16 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] HTTP exception thrown: Flavor 1884758143 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13bfad5c-b8ca-4903-aa17-4d9909853f16 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Request method failure captured: Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/flavors/1884758143/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHXscqJrt-xx4xXnND5UGIE8dmq1whDpcZMS3RkJcp8HRdv2vU7-n6M3xSSHSlm71Mj3cWo597ZHYTwriF4fvqXZprX7mAIU2sMAeGLFwaZ96Jc1eqb11bSA-3oENfHGVbN4P983R7SBj9TKiBj2jL0_hfV42QY6yEgcPgtNvRLh7TY Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 129d406e15914432b69d5b2884204c6a Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:05:34.327868 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_129d406e15914432b69d5b2884204c6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/129d406e15914432b69d5b2884204c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d406e15914432b69d5b2884204c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d406e15914432b69d5b2884204c6a"}]}] Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 129d406e15914432b69d5b2884204c6a Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1c287f26c7da42759711654317543573 Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:05:34.330276 n-d-850499-14 devstack@n-api.service[122331]: exception: Flavor 1884758143 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'flavor_id': '1884758143', 'id': 'hw:cpu_thread_policy'} Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1884758143 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:34.331198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.333658 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.333658 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.333658 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.333658 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:34.333658 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:34.333658 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1884758143 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:05:34.333658 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.333658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13bfad5c-b8ca-4903-aa17-4d9909853f16 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Returning 404 to user: Flavor 1884758143 has no extra specs with key hw:cpu_thread_policy. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:34.333658 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-13bfad5c-b8ca-4903-aa17-4d9909853f16 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1884758143/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.015976 Oct 04 18:05:34.333658 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 548/1117] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:05:34 2022] DELETE /compute/v2.1/flavors/1884758143/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:34.344702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c263abf-890a-4f89-8b4f-0c59a25653b5 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:34.347540 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-2c263abf-890a-4f89-8b4f-0c59a25653b5 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c263abf-890a-4f89-8b4f-0c59a25653b5 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Request method failure captured: Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 27 Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHXscqJrt-xx4xXnND5UGIE8dmq1whDpcZMS3RkJcp8HRdv2vU7-n6M3xSSHSlm71Mj3cWo597ZHYTwriF4fvqXZprX7mAIU2sMAeGLFwaZ96Jc1eqb11bSA-3oENfHGVbN4P983R7SBj9TKiBj2jL0_hfV42QY6yEgcPgtNvRLh7TY Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 129d406e15914432b69d5b2884204c6a Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:05:34.348196 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_129d406e15914432b69d5b2884204c6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/129d406e15914432b69d5b2884204c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d406e15914432b69d5b2884204c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d406e15914432b69d5b2884204c6a"}]}] Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 129d406e15914432b69d5b2884204c6a Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1c287f26c7da42759711654317543573 Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: {"hw:cpu_policy": "shared"} Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:05:34.350458 n-d-850499-14 devstack@n-api.service[122331]: exception: Request body and URI mismatch Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'flavor_id': '1884758143', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.351480 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.354156 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:34.354156 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:34.354156 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 18:05:34.354156 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.354156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c263abf-890a-4f89-8b4f-0c59a25653b5 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:34.354156 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c263abf-890a-4f89-8b4f-0c59a25653b5 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.014374 Oct 04 18:05:34.355279 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 549/1118] 10.222.0.18 () {60 vars in 1265 bytes} [Tue Oct 4 18:05:34 2022] PUT /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes => generated 73 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:05:34.363800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c847d3c6-430c-486a-9dfa-e385e6b0c75a tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c847d3c6-430c-486a-9dfa-e385e6b0c75a tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Request method failure captured: Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 49 Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHXscqJrt-xx4xXnND5UGIE8dmq1whDpcZMS3RkJcp8HRdv2vU7-n6M3xSSHSlm71Mj3cWo597ZHYTwriF4fvqXZprX7mAIU2sMAeGLFwaZ96Jc1eqb11bSA-3oENfHGVbN4P983R7SBj9TKiBj2jL0_hfV42QY6yEgcPgtNvRLh7TY Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 129d406e15914432b69d5b2884204c6a Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:05:34.370791 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_129d406e15914432b69d5b2884204c6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/129d406e15914432b69d5b2884204c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d406e15914432b69d5b2884204c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/129d406e15914432b69d5b2884204c6a"}]}] Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 129d406e15914432b69d5b2884204c6a Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1c287f26c7da42759711654317543573 Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 18:05:34.372695 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'flavor_id': '1884758143', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 18:05:34.373591 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.376143 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.377711 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.377711 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.377711 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:05:34.377711 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:05:34.377711 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:05:34.377711 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.377711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c847d3c6-430c-486a-9dfa-e385e6b0c75a tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:34.377711 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c847d3c6-430c-486a-9dfa-e385e6b0c75a tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.015894 Oct 04 18:05:34.377711 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 550/1119] 10.222.0.18 () {60 vars in 1265 bytes} [Tue Oct 4 18:05:34 2022] PUT /compute/v2.1/flavors/1884758143/os-extra_specs/hw:numa_nodes => generated 117 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:05:34.387265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d2b5dc8f-5213-4b3e-aae6-08e1b0a763ce tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.420626 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d2b5dc8f-5213-4b3e-aae6-08e1b0a763ce tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1884758143" status: 202 len: 0 microversion: 2.1 time: 0.038741 Oct 04 18:05:34.422140 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 551/1120] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:34 2022] DELETE /compute/v2.1/flavors/1884758143 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:34.445991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36201164-c939-4eb1-8d70-e9fe483ec5c8 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.477343 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-36201164-c939-4eb1-8d70-e9fe483ec5c8 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642 tempest-FlavorsExtraSpecsNegativeTestJSON-94171642-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050710 Oct 04 18:05:34.478033 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 552/1121] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:34.547278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:34.547703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:34.548181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:34.548587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:34.548997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:34.561474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.562226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.562737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.563622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.564089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.564523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.587779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:34.594040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Getting quotas for user d5e7c7c7826b4660acf4a4276c3e829c and project 9006ab9b759d4fd58f50c8c721bcaa6c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:34.614264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:34.617544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:34.707333 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5b35a5af-1a06-4880-a972-1752134d6f27 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537505 Oct 04 18:05:34.711432 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 570/1122] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:34.730336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ff707bb2-47e0-4167-9136-f4f943feb102 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.731227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ff707bb2-47e0-4167-9136-f4f943feb102 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:34.790310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ff707bb2-47e0-4167-9136-f4f943feb102 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.797688 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ff707bb2-47e0-4167-9136-f4f943feb102 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1215 microversion: 2.1 time: 0.073408 Oct 04 18:05:34.799293 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 553/1123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:34.951163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8124068b-9061-404a-8466-b7886a7cd7e4 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e4a820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.025225 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8124068b-9061-404a-8466-b7886a7cd7e4 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.077947 Oct 04 18:05:35.025942 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 571/1124] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:35.180064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-86b8f958-4b16-491a-8c64-8efcd3be5e8f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.182636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-86b8f958-4b16-491a-8c64-8efcd3be5e8f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.197641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b8f958-4b16-491a-8c64-8efcd3be5e8f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.198479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b8f958-4b16-491a-8c64-8efcd3be5e8f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.199722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b8f958-4b16-491a-8c64-8efcd3be5e8f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.200665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b8f958-4b16-491a-8c64-8efcd3be5e8f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.201368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b8f958-4b16-491a-8c64-8efcd3be5e8f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.202206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b8f958-4b16-491a-8c64-8efcd3be5e8f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.212215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5f5c3cc8-5687-479e-b99b-d5a8e6d58e1f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.212834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5f5c3cc8-5687-479e-b99b-d5a8e6d58e1f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.244619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f5c3cc8-5687-479e-b99b-d5a8e6d58e1f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.251000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f5c3cc8-5687-479e-b99b-d5a8e6d58e1f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.255630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f5c3cc8-5687-479e-b99b-d5a8e6d58e1f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.256615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f5c3cc8-5687-479e-b99b-d5a8e6d58e1f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.258324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f5c3cc8-5687-479e-b99b-d5a8e6d58e1f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.259222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f5c3cc8-5687-479e-b99b-d5a8e6d58e1f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.515246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-86b8f958-4b16-491a-8c64-8efcd3be5e8f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.527648 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-86b8f958-4b16-491a-8c64-8efcd3be5e8f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.353921 Oct 04 18:05:35.529365 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 554/1125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:35 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:35.633268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f5c3cc8-5687-479e-b99b-d5a8e6d58e1f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.643237 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5f5c3cc8-5687-479e-b99b-d5a8e6d58e1f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.435536 Oct 04 18:05:35.660229 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 572/1126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:35 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:35.825203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd74d060-1106-4b4a-9420-f58e556d468d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.825982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd74d060-1106-4b4a-9420-f58e556d468d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.838639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd74d060-1106-4b4a-9420-f58e556d468d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.846917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd74d060-1106-4b4a-9420-f58e556d468d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.850575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd74d060-1106-4b4a-9420-f58e556d468d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.853026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd74d060-1106-4b4a-9420-f58e556d468d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.853515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd74d060-1106-4b4a-9420-f58e556d468d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.853948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd74d060-1106-4b4a-9420-f58e556d468d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.984807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fd74d060-1106-4b4a-9420-f58e556d468d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.995172 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd74d060-1106-4b4a-9420-f58e556d468d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1267 microversion: 2.1 time: 0.174300 Oct 04 18:05:36.013482 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 555/1127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:35 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:36.042883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cb4cc81f-ad1c-4e07-82ee-a36f87d277fb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1cd9790>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.143022 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cb4cc81f-ad1c-4e07-82ee-a36f87d277fb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.104696 Oct 04 18:05:36.144180 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 573/1128] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:36 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:36.553501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d6910d8-69b0-4fdc-b1f7-7b2414ab1397 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.554933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d6910d8-69b0-4fdc-b1f7-7b2414ab1397 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:36.567469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6910d8-69b0-4fdc-b1f7-7b2414ab1397 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.572392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6910d8-69b0-4fdc-b1f7-7b2414ab1397 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.573122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6910d8-69b0-4fdc-b1f7-7b2414ab1397 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.574280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6910d8-69b0-4fdc-b1f7-7b2414ab1397 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.575069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6910d8-69b0-4fdc-b1f7-7b2414ab1397 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.578265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d6910d8-69b0-4fdc-b1f7-7b2414ab1397 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.670302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f7ce20a0-536b-4fd6-8940-f2d607f44c8d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.671219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f7ce20a0-536b-4fd6-8940-f2d607f44c8d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:36.679132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce20a0-536b-4fd6-8940-f2d607f44c8d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.680196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce20a0-536b-4fd6-8940-f2d607f44c8d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.681021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce20a0-536b-4fd6-8940-f2d607f44c8d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.683124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce20a0-536b-4fd6-8940-f2d607f44c8d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.683796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce20a0-536b-4fd6-8940-f2d607f44c8d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.684577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce20a0-536b-4fd6-8940-f2d607f44c8d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.127674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d6910d8-69b0-4fdc-b1f7-7b2414ab1397 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:37.141113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f7ce20a0-536b-4fd6-8940-f2d607f44c8d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:37.141702 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3d6910d8-69b0-4fdc-b1f7-7b2414ab1397 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.592399 Oct 04 18:05:37.142074 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 556/1129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:36 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:37.155739 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f7ce20a0-536b-4fd6-8940-f2d607f44c8d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.488289 Oct 04 18:05:37.155739 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 574/1130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:36 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:37.165879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dbbaa108-2d49-4792-bbec-799361a245a2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.166501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dbbaa108-2d49-4792-bbec-799361a245a2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:37.175793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5dcf6d08-07d6-48ec-89b9-0416332f1c39 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1dd9dc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.184937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbaa108-2d49-4792-bbec-799361a245a2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.185455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbaa108-2d49-4792-bbec-799361a245a2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.185905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbaa108-2d49-4792-bbec-799361a245a2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.186630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbaa108-2d49-4792-bbec-799361a245a2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.187128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbaa108-2d49-4792-bbec-799361a245a2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.187558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbaa108-2d49-4792-bbec-799361a245a2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.256403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5dcf6d08-07d6-48ec-89b9-0416332f1c39 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.098534 Oct 04 18:05:37.266385 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 557/1131] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:37.402920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dbbaa108-2d49-4792-bbec-799361a245a2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:37.420344 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dbbaa108-2d49-4792-bbec-799361a245a2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1273 microversion: 2.1 time: 0.263575 Oct 04 18:05:37.421285 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 575/1132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:38.172209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8423cda1-8f44-44f6-baa4-f6cd023c507f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.172998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8423cda1-8f44-44f6-baa4-f6cd023c507f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.183600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cb2d8aba-ef08-4c28-b945-7b9efbd85378 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.184398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cb2d8aba-ef08-4c28-b945-7b9efbd85378 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.191341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb2d8aba-ef08-4c28-b945-7b9efbd85378 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.195137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8423cda1-8f44-44f6-baa4-f6cd023c507f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.199928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb2d8aba-ef08-4c28-b945-7b9efbd85378 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.202558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb2d8aba-ef08-4c28-b945-7b9efbd85378 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.203739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8423cda1-8f44-44f6-baa4-f6cd023c507f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.203999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8423cda1-8f44-44f6-baa4-f6cd023c507f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.204869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb2d8aba-ef08-4c28-b945-7b9efbd85378 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.214108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8423cda1-8f44-44f6-baa4-f6cd023c507f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.215010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb2d8aba-ef08-4c28-b945-7b9efbd85378 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.215599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb2d8aba-ef08-4c28-b945-7b9efbd85378 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.219208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8423cda1-8f44-44f6-baa4-f6cd023c507f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.219911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8423cda1-8f44-44f6-baa4-f6cd023c507f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.817422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8423cda1-8f44-44f6-baa4-f6cd023c507f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.826338 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8423cda1-8f44-44f6-baa4-f6cd023c507f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.659580 Oct 04 18:05:38.826931 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 558/1133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:38.838091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a9ad4e27-091f-4332-b9e4-51028fe7d244 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1dd9dc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.905886 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a9ad4e27-091f-4332-b9e4-51028fe7d244 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.077867 Oct 04 18:05:38.906984 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 559/1134] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:38.920252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-de6b277e-c652-4143-8145-8fd0fc13e3e7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.921135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-de6b277e-c652-4143-8145-8fd0fc13e3e7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.928030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de6b277e-c652-4143-8145-8fd0fc13e3e7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.928785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de6b277e-c652-4143-8145-8fd0fc13e3e7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.929450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de6b277e-c652-4143-8145-8fd0fc13e3e7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.930394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de6b277e-c652-4143-8145-8fd0fc13e3e7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.931118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de6b277e-c652-4143-8145-8fd0fc13e3e7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.931741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de6b277e-c652-4143-8145-8fd0fc13e3e7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.497009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cb2d8aba-ef08-4c28-b945-7b9efbd85378 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:39.514258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cb2d8aba-ef08-4c28-b945-7b9efbd85378 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 1.334660 Oct 04 18:05:39.515552 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 576/1135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:39.523276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-72c80215-cc32-4385-8f6a-b7280baead0b req-63c54f8e-23e6-4cb0-bb5b-8575ef174732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f193d-65a7-48df-96b4-ee57115149a2", "name": "network-vif-plugged", "status": "completed", "tag": "f53b385d-ad62-40bc-9e0f-d89171784dac"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:39.551776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-72c80215-cc32-4385-8f6a-b7280baead0b req-63c54f8e-23e6-4cb0-bb5b-8575ef174732 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.552557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-72c80215-cc32-4385-8f6a-b7280baead0b req-63c54f8e-23e6-4cb0-bb5b-8575ef174732 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.554147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-72c80215-cc32-4385-8f6a-b7280baead0b req-63c54f8e-23e6-4cb0-bb5b-8575ef174732 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.583375 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-72c80215-cc32-4385-8f6a-b7280baead0b req-63c54f8e-23e6-4cb0-bb5b-8575ef174732 service nova] Creating event network-vif-plugged:f53b385d-ad62-40bc-9e0f-d89171784dac for instance 3b9f193d-65a7-48df-96b4-ee57115149a2 on n-h1-850499-14 Oct 04 18:05:39.599936 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-72c80215-cc32-4385-8f6a-b7280baead0b req-63c54f8e-23e6-4cb0-bb5b-8575ef174732 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082488 Oct 04 18:05:39.608601 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 577/1136] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:39.689901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-de6b277e-c652-4143-8145-8fd0fc13e3e7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:39.708436 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-de6b277e-c652-4143-8145-8fd0fc13e3e7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1315 microversion: 2.1 time: 0.792176 Oct 04 18:05:39.709044 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 560/1137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:39.856508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a5b2b323-621c-45a9-9869-62baadaa5bd9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:39.857411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a5b2b323-621c-45a9-9869-62baadaa5bd9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:39.874855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5b2b323-621c-45a9-9869-62baadaa5bd9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.876512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5b2b323-621c-45a9-9869-62baadaa5bd9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.877604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5b2b323-621c-45a9-9869-62baadaa5bd9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.879695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5b2b323-621c-45a9-9869-62baadaa5bd9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.881101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5b2b323-621c-45a9-9869-62baadaa5bd9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.884394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5b2b323-621c-45a9-9869-62baadaa5bd9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.922319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-64b32bdd-1055-40a5-9e90-d5aa06b15a09 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1da4700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.016533 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-64b32bdd-1055-40a5-9e90-d5aa06b15a09 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.096503 Oct 04 18:05:40.019319 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 561/1138] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:39 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:40.150675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-9b829159-4980-46e4-874f-4a9a03e25d82 req-0935e4b5-3eaf-4093-95ef-51006fbffbaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9348f06-99a4-45a6-be27-b5cb7cb3cd37", "tag": "4def4e77-0d73-494f-967d-c9a8e911085b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:40.183076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9b829159-4980-46e4-874f-4a9a03e25d82 req-0935e4b5-3eaf-4093-95ef-51006fbffbaf service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.183906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9b829159-4980-46e4-874f-4a9a03e25d82 req-0935e4b5-3eaf-4093-95ef-51006fbffbaf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.184522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9b829159-4980-46e4-874f-4a9a03e25d82 req-0935e4b5-3eaf-4093-95ef-51006fbffbaf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.205822 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9b829159-4980-46e4-874f-4a9a03e25d82 req-0935e4b5-3eaf-4093-95ef-51006fbffbaf service nova] Creating event network-changed:4def4e77-0d73-494f-967d-c9a8e911085b for instance e9348f06-99a4-45a6-be27-b5cb7cb3cd37 on n-h1-850499-14 Oct 04 18:05:40.220832 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-9b829159-4980-46e4-874f-4a9a03e25d82 req-0935e4b5-3eaf-4093-95ef-51006fbffbaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074467 Oct 04 18:05:40.221726 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 562/1139] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:40.304651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a5b2b323-621c-45a9-9869-62baadaa5bd9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.312978 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a5b2b323-621c-45a9-9869-62baadaa5bd9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.462883 Oct 04 18:05:40.323117 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 578/1140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:39 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:40.468177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af4c60fc-a78e-43f4-8494-711248d5cfc6 tempest-FlavorsV255TestJSON-759884405 tempest-FlavorsV255TestJSON-759884405-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2009715649", "id": 1183712879, "os-flavor-access:is_public": "True"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:40.496865 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-af4c60fc-a78e-43f4-8494-711248d5cfc6 tempest-FlavorsV255TestJSON-759884405 tempest-FlavorsV255TestJSON-759884405-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.267784 Oct 04 18:05:40.497919 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 563/1141] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:05:40 2022] POST /compute/v2.1/flavors => generated 449 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:40.545022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-160019b1-3957-40ea-b333-9cf7b6259171 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.546081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-160019b1-3957-40ea-b333-9cf7b6259171 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:40.561301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-160019b1-3957-40ea-b333-9cf7b6259171 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.563557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-160019b1-3957-40ea-b333-9cf7b6259171 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.566452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-160019b1-3957-40ea-b333-9cf7b6259171 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.566869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-160019b1-3957-40ea-b333-9cf7b6259171 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.567426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-160019b1-3957-40ea-b333-9cf7b6259171 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.567803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-160019b1-3957-40ea-b333-9cf7b6259171 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.706125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0f59eff-480e-462e-a44e-2cf44c44315b tempest-FlavorsV255TestJSON-1353567668 tempest-FlavorsV255TestJSON-1353567668-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.716985 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f0f59eff-480e-462e-a44e-2cf44c44315b tempest-FlavorsV255TestJSON-1353567668 tempest-FlavorsV255TestJSON-1353567668-project] 10.222.0.18 "GET /compute/v2.1/flavors/1183712879" status: 200 len: 449 microversion: 2.55 time: 0.204831 Oct 04 18:05:40.717882 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 579/1142] 10.222.0.18 () {60 vars in 1199 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/flavors/1183712879 => generated 449 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:40.733506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fd49f710-3c9b-42a2-a1b6-9c33945db126 tempest-FlavorsV255TestJSON-759884405 tempest-FlavorsV255TestJSON-759884405-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d3d65670>, body: {"flavor": {"description": "new"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:40.797044 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fd49f710-3c9b-42a2-a1b6-9c33945db126 tempest-FlavorsV255TestJSON-759884405 tempest-FlavorsV255TestJSON-759884405-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1183712879" status: 200 len: 450 microversion: 2.55 time: 0.069423 Oct 04 18:05:40.798621 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 580/1143] 10.222.0.18 () {62 vars in 1219 bytes} [Tue Oct 4 18:05:40 2022] PUT /compute/v2.1/flavors/1183712879 => generated 450 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:40.810915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02c2a1c9-9835-46f0-aa68-e51d6779368f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.811806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-02c2a1c9-9835-46f0-aa68-e51d6779368f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:40.818844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c2a1c9-9835-46f0-aa68-e51d6779368f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.819650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c2a1c9-9835-46f0-aa68-e51d6779368f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.820273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c2a1c9-9835-46f0-aa68-e51d6779368f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.821264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c2a1c9-9835-46f0-aa68-e51d6779368f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.822432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c2a1c9-9835-46f0-aa68-e51d6779368f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.823049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c2a1c9-9835-46f0-aa68-e51d6779368f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.022471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-160019b1-3957-40ea-b333-9cf7b6259171 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.036081 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-160019b1-3957-40ea-b333-9cf7b6259171 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.493242 Oct 04 18:05:41.040606 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 564/1144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:41.048408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4087c73d-a5f2-447a-9811-48d1b42acf22 tempest-FlavorsV255TestJSON-1353567668 tempest-FlavorsV255TestJSON-1353567668-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.064461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:41.087247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4087c73d-a5f2-447a-9811-48d1b42acf22 tempest-FlavorsV255TestJSON-1353567668 tempest-FlavorsV255TestJSON-1353567668-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.045143 Oct 04 18:05:41.088134 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 565/1145] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:41.108436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1feb655f-7fbe-4333-bd3b-9c5ceefe08d7 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d94c10>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.162084 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1feb655f-7fbe-4333-bd3b-9c5ceefe08d7 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.072070 Oct 04 18:05:41.163697 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 566/1146] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:41.174595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-02c2a1c9-9835-46f0-aa68-e51d6779368f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.176831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5425c6db-53d7-4b73-b35d-bea674ee2cb2 tempest-FlavorsV255TestJSON-1353567668 tempest-FlavorsV255TestJSON-1353567668-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.184221 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-02c2a1c9-9835-46f0-aa68-e51d6779368f tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1315 microversion: 2.1 time: 0.384188 Oct 04 18:05:41.195136 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 581/1147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:41.201961 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5425c6db-53d7-4b73-b35d-bea674ee2cb2 tempest-FlavorsV255TestJSON-1353567668 tempest-FlavorsV255TestJSON-1353567668-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.035799 Oct 04 18:05:41.202929 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 567/1148] 10.222.0.18 () {60 vars in 1166 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:41.222362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c4b11ecc-0c09-4401-894d-34ea312bbdda tempest-FlavorsV255TestJSON-759884405 tempest-FlavorsV255TestJSON-759884405-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.246500 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c4b11ecc-0c09-4401-894d-34ea312bbdda tempest-FlavorsV255TestJSON-759884405 tempest-FlavorsV255TestJSON-759884405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1183712879" status: 202 len: 0 microversion: 2.55 time: 0.027759 Oct 04 18:05:41.247512 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 582/1149] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Oct 4 18:05:41 2022] DELETE /compute/v2.1/flavors/1183712879 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:41.257399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3fe6ee26-842c-422d-8fe4-ad9119b35efb tempest-FlavorsV255TestJSON-759884405 tempest-FlavorsV255TestJSON-759884405-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.290428 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3fe6ee26-842c-422d-8fe4-ad9119b35efb tempest-FlavorsV255TestJSON-759884405 tempest-FlavorsV255TestJSON-759884405-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.036208 Oct 04 18:05:41.291432 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 568/1150] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:41.339146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a57e2959-d3ec-419d-ab7b-784ef07ccb24 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.339923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a57e2959-d3ec-419d-ab7b-784ef07ccb24 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.356514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a57e2959-d3ec-419d-ab7b-784ef07ccb24 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.357022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a57e2959-d3ec-419d-ab7b-784ef07ccb24 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.357466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a57e2959-d3ec-419d-ab7b-784ef07ccb24 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.358182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a57e2959-d3ec-419d-ab7b-784ef07ccb24 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.358639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a57e2959-d3ec-419d-ab7b-784ef07ccb24 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.359106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a57e2959-d3ec-419d-ab7b-784ef07ccb24 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.560384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a57e2959-d3ec-419d-ab7b-784ef07ccb24 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.572896 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a57e2959-d3ec-419d-ab7b-784ef07ccb24 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.238780 Oct 04 18:05:41.575376 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 583/1151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:42.069122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc4185a2-9184-4705-aece-bec3cc9d0822 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.070473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc4185a2-9184-4705-aece-bec3cc9d0822 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.097960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc4185a2-9184-4705-aece-bec3cc9d0822 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.100499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc4185a2-9184-4705-aece-bec3cc9d0822 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.101468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc4185a2-9184-4705-aece-bec3cc9d0822 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.103300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc4185a2-9184-4705-aece-bec3cc9d0822 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.104134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc4185a2-9184-4705-aece-bec3cc9d0822 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.104815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc4185a2-9184-4705-aece-bec3cc9d0822 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.196742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7047dfe2-d055-48c5-ab66-af20fd9ecc00 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e4e670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.270251 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7047dfe2-d055-48c5-ab66-af20fd9ecc00 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.077558 Oct 04 18:05:42.271242 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 584/1152] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:42.278123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e283ca7f-e697-4145-8bdd-1358c2841e18 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.279534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e283ca7f-e697-4145-8bdd-1358c2841e18 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.287328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e283ca7f-e697-4145-8bdd-1358c2841e18 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.288406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e283ca7f-e697-4145-8bdd-1358c2841e18 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.289471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e283ca7f-e697-4145-8bdd-1358c2841e18 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.291029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e283ca7f-e697-4145-8bdd-1358c2841e18 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.291720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e283ca7f-e697-4145-8bdd-1358c2841e18 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.292357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e283ca7f-e697-4145-8bdd-1358c2841e18 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.330936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:42.530403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bc4185a2-9184-4705-aece-bec3cc9d0822 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.541350 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc4185a2-9184-4705-aece-bec3cc9d0822 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.477224 Oct 04 18:05:42.541946 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 569/1153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:42.598570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-60b58fba-6065-4503-b70c-5224f7f40bbe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.599218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-60b58fba-6065-4503-b70c-5224f7f40bbe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.615314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b58fba-6065-4503-b70c-5224f7f40bbe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.617385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b58fba-6065-4503-b70c-5224f7f40bbe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.618050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b58fba-6065-4503-b70c-5224f7f40bbe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.619178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b58fba-6065-4503-b70c-5224f7f40bbe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.623061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b58fba-6065-4503-b70c-5224f7f40bbe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.623664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b58fba-6065-4503-b70c-5224f7f40bbe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.706159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e283ca7f-e697-4145-8bdd-1358c2841e18 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.717495 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e283ca7f-e697-4145-8bdd-1358c2841e18 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1315 microversion: 2.1 time: 0.443489 Oct 04 18:05:42.718392 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 585/1154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:42.942551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-60b58fba-6065-4503-b70c-5224f7f40bbe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.952693 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-60b58fba-6065-4503-b70c-5224f7f40bbe tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.357828 Oct 04 18:05:42.954464 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 570/1155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:43.288161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99119642-657b-4929-9d8a-3b464884d198 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e4aaf0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.350347 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-99119642-657b-4929-9d8a-3b464884d198 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.059613 Oct 04 18:05:43.364317 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 586/1156] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:43.568921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00f7a807-7ac9-4157-91fa-d75e0e07f318 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.569555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00f7a807-7ac9-4157-91fa-d75e0e07f318 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.577802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f7a807-7ac9-4157-91fa-d75e0e07f318 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.578560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f7a807-7ac9-4157-91fa-d75e0e07f318 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.579236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f7a807-7ac9-4157-91fa-d75e0e07f318 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.580112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f7a807-7ac9-4157-91fa-d75e0e07f318 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.580736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f7a807-7ac9-4157-91fa-d75e0e07f318 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.581325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f7a807-7ac9-4157-91fa-d75e0e07f318 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.744532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d9e4992-fde7-4b94-8628-34da7d7161a0 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.746109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d9e4992-fde7-4b94-8628-34da7d7161a0 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.754110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d9e4992-fde7-4b94-8628-34da7d7161a0 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.756319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d9e4992-fde7-4b94-8628-34da7d7161a0 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.757254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d9e4992-fde7-4b94-8628-34da7d7161a0 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.758681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d9e4992-fde7-4b94-8628-34da7d7161a0 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.759190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d9e4992-fde7-4b94-8628-34da7d7161a0 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.759927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d9e4992-fde7-4b94-8628-34da7d7161a0 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.807287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-00f7a807-7ac9-4157-91fa-d75e0e07f318 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.820087 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-00f7a807-7ac9-4157-91fa-d75e0e07f318 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.255084 Oct 04 18:05:43.824223 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 571/1157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:43.965854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d9e4992-fde7-4b94-8628-34da7d7161a0 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.979224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b9f0ec1-d329-4365-bb9e-a5a9561049bf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.980110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9b9f0ec1-d329-4365-bb9e-a5a9561049bf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.980706 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d9e4992-fde7-4b94-8628-34da7d7161a0 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1315 microversion: 2.1 time: 0.240895 Oct 04 18:05:43.982125 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 587/1158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:44.001293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b9f0ec1-d329-4365-bb9e-a5a9561049bf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.002063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b9f0ec1-d329-4365-bb9e-a5a9561049bf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.002657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b9f0ec1-d329-4365-bb9e-a5a9561049bf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.003569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b9f0ec1-d329-4365-bb9e-a5a9561049bf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.004221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b9f0ec1-d329-4365-bb9e-a5a9561049bf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.004810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b9f0ec1-d329-4365-bb9e-a5a9561049bf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.280315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b9f0ec1-d329-4365-bb9e-a5a9561049bf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.292660 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b9f0ec1-d329-4365-bb9e-a5a9561049bf tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.318019 Oct 04 18:05:44.307618 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 572/1159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:44.370506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-229d818b-7d45-4030-b11b-4ddcc3b3b963 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1c9e670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.421150 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-229d818b-7d45-4030-b11b-4ddcc3b3b963 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.055014 Oct 04 18:05:44.421743 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 588/1160] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:44.850857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af92753c-ee7c-442e-a3ea-2748e164dc2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.851559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-af92753c-ee7c-442e-a3ea-2748e164dc2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:44.858128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:44.860179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af92753c-ee7c-442e-a3ea-2748e164dc2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.860885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af92753c-ee7c-442e-a3ea-2748e164dc2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.861686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af92753c-ee7c-442e-a3ea-2748e164dc2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.863104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af92753c-ee7c-442e-a3ea-2748e164dc2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.863911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af92753c-ee7c-442e-a3ea-2748e164dc2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.864504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af92753c-ee7c-442e-a3ea-2748e164dc2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.011744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0aabe7a-41eb-48a8-80ba-c9cb6c2cd3d6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.012664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f0aabe7a-41eb-48a8-80ba-c9cb6c2cd3d6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.018885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:45.021082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:45.042052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0aabe7a-41eb-48a8-80ba-c9cb6c2cd3d6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.044487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0aabe7a-41eb-48a8-80ba-c9cb6c2cd3d6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.045812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0aabe7a-41eb-48a8-80ba-c9cb6c2cd3d6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.050660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0aabe7a-41eb-48a8-80ba-c9cb6c2cd3d6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.051551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0aabe7a-41eb-48a8-80ba-c9cb6c2cd3d6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.052207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0aabe7a-41eb-48a8-80ba-c9cb6c2cd3d6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.073799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af92753c-ee7c-442e-a3ea-2748e164dc2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.087117 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-af92753c-ee7c-442e-a3ea-2748e164dc2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.240760 Oct 04 18:05:45.094515 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 573/1161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.263640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f0aabe7a-41eb-48a8-80ba-c9cb6c2cd3d6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.278266 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f0aabe7a-41eb-48a8-80ba-c9cb6c2cd3d6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1315 microversion: 2.1 time: 0.274184 Oct 04 18:05:45.278841 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 589/1162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.319660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fae08a11-4687-4a9a-8acd-3498be327b37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.320817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fae08a11-4687-4a9a-8acd-3498be327b37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.337500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fae08a11-4687-4a9a-8acd-3498be327b37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.338831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fae08a11-4687-4a9a-8acd-3498be327b37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.339531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fae08a11-4687-4a9a-8acd-3498be327b37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.340497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fae08a11-4687-4a9a-8acd-3498be327b37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.341284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fae08a11-4687-4a9a-8acd-3498be327b37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.341883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fae08a11-4687-4a9a-8acd-3498be327b37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.441389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10b5d15f-5b5a-4473-8c3b-2af62a92ee59 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d2c940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.501200 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10b5d15f-5b5a-4473-8c3b-2af62a92ee59 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.066186 Oct 04 18:05:45.513578 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 590/1163] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.592289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fae08a11-4687-4a9a-8acd-3498be327b37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.601300 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fae08a11-4687-4a9a-8acd-3498be327b37 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.287014 Oct 04 18:05:45.616485 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 574/1164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.781397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4725b693-21ae-4620-981d-01293bef2a90 tempest-FlavorsV261TestJSON-1247244136 tempest-FlavorsV261TestJSON-1247244136-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-971644993", "id": 199975215, "os-flavor-access:is_public": "True"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:45.805680 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4725b693-21ae-4620-981d-01293bef2a90 tempest-FlavorsV261TestJSON-1247244136 tempest-FlavorsV261TestJSON-1247244136-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.186331 Oct 04 18:05:45.806563 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 591/1165] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:05:45 2022] POST /compute/v2.1/flavors => generated 464 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:05:45.987912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f2eb51a-d7b7-436e-a812-623e442509df tempest-FlavorsV261TestJSON-892084394 tempest-FlavorsV261TestJSON-892084394-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.006910 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f2eb51a-d7b7-436e-a812-623e442509df tempest-FlavorsV261TestJSON-892084394 tempest-FlavorsV261TestJSON-892084394-project] 10.222.0.18 "GET /compute/v2.1/flavors/199975215" status: 200 len: 464 microversion: 2.61 time: 0.190467 Oct 04 18:05:46.008694 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 575/1166] 10.222.0.18 () {60 vars in 1196 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/flavors/199975215 => generated 464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:05:46.021515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-002c9978-0229-45d0-a558-583e7eae6f1d tempest-FlavorsV261TestJSON-1247244136 tempest-FlavorsV261TestJSON-1247244136-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:46.064183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-303b9b8b-b36c-4d91-8911-24bb94b88c3d req-1af11df8-cbd3-4f83-bbdd-1a387f86ed0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9348f06-99a4-45a6-be27-b5cb7cb3cd37", "name": "network-vif-plugged", "status": "completed", "tag": "4def4e77-0d73-494f-967d-c9a8e911085b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:46.075638 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-002c9978-0229-45d0-a558-583e7eae6f1d tempest-FlavorsV261TestJSON-1247244136 tempest-FlavorsV261TestJSON-1247244136-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/199975215" status: 200 len: 465 microversion: 2.61 time: 0.057635 Oct 04 18:05:46.079248 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 592/1167] 10.222.0.18 () {62 vars in 1216 bytes} [Tue Oct 4 18:05:46 2022] PUT /compute/v2.1/flavors/199975215 => generated 465 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:05:46.095425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1980abe-ddd3-4b52-97a2-389a0a4c82ec tempest-FlavorsV261TestJSON-892084394 tempest-FlavorsV261TestJSON-892084394-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.097097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-303b9b8b-b36c-4d91-8911-24bb94b88c3d req-1af11df8-cbd3-4f83-bbdd-1a387f86ed0d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.097643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-303b9b8b-b36c-4d91-8911-24bb94b88c3d req-1af11df8-cbd3-4f83-bbdd-1a387f86ed0d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.099564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-303b9b8b-b36c-4d91-8911-24bb94b88c3d req-1af11df8-cbd3-4f83-bbdd-1a387f86ed0d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.116480 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-303b9b8b-b36c-4d91-8911-24bb94b88c3d req-1af11df8-cbd3-4f83-bbdd-1a387f86ed0d service nova] Creating event network-vif-plugged:4def4e77-0d73-494f-967d-c9a8e911085b for instance e9348f06-99a4-45a6-be27-b5cb7cb3cd37 on n-h1-850499-14 Oct 04 18:05:46.122857 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-303b9b8b-b36c-4d91-8911-24bb94b88c3d req-1af11df8-cbd3-4f83-bbdd-1a387f86ed0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062614 Oct 04 18:05:46.124247 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 576/1168] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:46.127520 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b1980abe-ddd3-4b52-97a2-389a0a4c82ec tempest-FlavorsV261TestJSON-892084394 tempest-FlavorsV261TestJSON-892084394-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.036096 Oct 04 18:05:46.128142 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 593/1169] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:46.133482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7b75b533-17a8-4e4f-b42b-7d857ffda92e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.134621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7b75b533-17a8-4e4f-b42b-7d857ffda92e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.142502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b75b533-17a8-4e4f-b42b-7d857ffda92e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.143436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b75b533-17a8-4e4f-b42b-7d857ffda92e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.144174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b75b533-17a8-4e4f-b42b-7d857ffda92e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.145156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b75b533-17a8-4e4f-b42b-7d857ffda92e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.145873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b75b533-17a8-4e4f-b42b-7d857ffda92e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.146530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b75b533-17a8-4e4f-b42b-7d857ffda92e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.167579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aedab399-c013-4fda-9f71-c047bca35c56 tempest-FlavorsV261TestJSON-892084394 tempest-FlavorsV261TestJSON-892084394-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.222224 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aedab399-c013-4fda-9f71-c047bca35c56 tempest-FlavorsV261TestJSON-892084394 tempest-FlavorsV261TestJSON-892084394-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.070824 Oct 04 18:05:46.222844 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 594/1170] 10.222.0.18 () {60 vars in 1166 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:46.248279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f71d9d0-7674-41f3-95aa-0be8de5195db tempest-FlavorsV261TestJSON-1247244136 tempest-FlavorsV261TestJSON-1247244136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.279515 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f71d9d0-7674-41f3-95aa-0be8de5195db tempest-FlavorsV261TestJSON-1247244136 tempest-FlavorsV261TestJSON-1247244136-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/199975215" status: 202 len: 0 microversion: 2.61 time: 0.035512 Oct 04 18:05:46.280526 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 595/1171] 10.222.0.18 () {60 vars in 1199 bytes} [Tue Oct 4 18:05:46 2022] DELETE /compute/v2.1/flavors/199975215 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:46.296100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6a63d138-fbd0-493b-9b2b-c10b26513ab0 tempest-FlavorsV261TestJSON-1247244136 tempest-FlavorsV261TestJSON-1247244136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.334723 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6a63d138-fbd0-493b-9b2b-c10b26513ab0 tempest-FlavorsV261TestJSON-1247244136 tempest-FlavorsV261TestJSON-1247244136-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.047146 Oct 04 18:05:46.335747 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 596/1172] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:46.370802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80426add-ac42-4410-8442-606790637bef tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.373171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-80426add-ac42-4410-8442-606790637bef tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.387744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80426add-ac42-4410-8442-606790637bef tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.388246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80426add-ac42-4410-8442-606790637bef tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.391572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80426add-ac42-4410-8442-606790637bef tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.391850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80426add-ac42-4410-8442-606790637bef tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.392325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80426add-ac42-4410-8442-606790637bef tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.392773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80426add-ac42-4410-8442-606790637bef tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.455256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b75b533-17a8-4e4f-b42b-7d857ffda92e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.473663 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7b75b533-17a8-4e4f-b42b-7d857ffda92e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.345273 Oct 04 18:05:46.475095 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 577/1173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:46.520862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6e75077d-54af-4dfe-9917-eca3846d7f65 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d5b550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.581227 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6e75077d-54af-4dfe-9917-eca3846d7f65 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.062993 Oct 04 18:05:46.589227 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 578/1174] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:46.628231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-25725884-7a48-4f3a-b78f-3a5bebcd8540 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.629141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-25725884-7a48-4f3a-b78f-3a5bebcd8540 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.660068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25725884-7a48-4f3a-b78f-3a5bebcd8540 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.661150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25725884-7a48-4f3a-b78f-3a5bebcd8540 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.669035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25725884-7a48-4f3a-b78f-3a5bebcd8540 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.671497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25725884-7a48-4f3a-b78f-3a5bebcd8540 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.672940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25725884-7a48-4f3a-b78f-3a5bebcd8540 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.674667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25725884-7a48-4f3a-b78f-3a5bebcd8540 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.702140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:47.066846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-80426add-ac42-4410-8442-606790637bef tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.078526 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80426add-ac42-4410-8442-606790637bef tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1315 microversion: 2.1 time: 0.728593 Oct 04 18:05:47.079171 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 597/1175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:47.130404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-25725884-7a48-4f3a-b78f-3a5bebcd8540 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.141688 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-25725884-7a48-4f3a-b78f-3a5bebcd8540 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.517611 Oct 04 18:05:47.142063 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 579/1176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:47.508813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d6cff82-7057-46b6-a8d0-c36b314232bf tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:47.509402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3d6cff82-7057-46b6-a8d0-c36b314232bf tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:47.518601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:47.534419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d6cff82-7057-46b6-a8d0-c36b314232bf tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.535458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d6cff82-7057-46b6-a8d0-c36b314232bf tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.536090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d6cff82-7057-46b6-a8d0-c36b314232bf tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.537272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d6cff82-7057-46b6-a8d0-c36b314232bf tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.538178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d6cff82-7057-46b6-a8d0-c36b314232bf tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.538778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d6cff82-7057-46b6-a8d0-c36b314232bf tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.606163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-31450f33-27fa-4ca4-a865-97ca158c556c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d1cf70>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:47.691913 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-31450f33-27fa-4ca4-a865-97ca158c556c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.098576 Oct 04 18:05:47.692831 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 580/1177] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:47 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:47.822619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3d6cff82-7057-46b6-a8d0-c36b314232bf tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.833380 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3d6cff82-7057-46b6-a8d0-c36b314232bf tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.328467 Oct 04 18:05:47.834515 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 598/1178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:47 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.105951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-caac51e7-3ef1-404d-9079-f3bb85d77345 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.106867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-caac51e7-3ef1-404d-9079-f3bb85d77345 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.124665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caac51e7-3ef1-404d-9079-f3bb85d77345 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.125759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caac51e7-3ef1-404d-9079-f3bb85d77345 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.127162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caac51e7-3ef1-404d-9079-f3bb85d77345 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.128346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caac51e7-3ef1-404d-9079-f3bb85d77345 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.129176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caac51e7-3ef1-404d-9079-f3bb85d77345 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.166004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caac51e7-3ef1-404d-9079-f3bb85d77345 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.192234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3b5cc4b2-41ee-4799-a3f8-95f352c48c43 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.196602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3b5cc4b2-41ee-4799-a3f8-95f352c48c43 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.224988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b5cc4b2-41ee-4799-a3f8-95f352c48c43 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.227673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b5cc4b2-41ee-4799-a3f8-95f352c48c43 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.229338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b5cc4b2-41ee-4799-a3f8-95f352c48c43 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.231034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b5cc4b2-41ee-4799-a3f8-95f352c48c43 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.232449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b5cc4b2-41ee-4799-a3f8-95f352c48c43 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.233558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b5cc4b2-41ee-4799-a3f8-95f352c48c43 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.660585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-caac51e7-3ef1-404d-9079-f3bb85d77345 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:48.678347 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-caac51e7-3ef1-404d-9079-f3bb85d77345 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1315 microversion: 2.1 time: 0.578577 Oct 04 18:05:48.679252 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 581/1179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.701169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3b5cc4b2-41ee-4799-a3f8-95f352c48c43 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:48.716171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04ac8902-7adb-4874-bad4-89e0107ace13 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d0b5e0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.716768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3b5cc4b2-41ee-4799-a3f8-95f352c48c43 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.533542 Oct 04 18:05:48.736892 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 599/1180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.792827 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04ac8902-7adb-4874-bad4-89e0107ace13 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.082588 Oct 04 18:05:48.800896 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 582/1181] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.863802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f5d60e1-cfed-4d0b-8bf9-444cc5b9af38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.864934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7f5d60e1-cfed-4d0b-8bf9-444cc5b9af38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.873072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f5d60e1-cfed-4d0b-8bf9-444cc5b9af38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.874422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f5d60e1-cfed-4d0b-8bf9-444cc5b9af38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.875063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f5d60e1-cfed-4d0b-8bf9-444cc5b9af38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.876098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f5d60e1-cfed-4d0b-8bf9-444cc5b9af38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.879635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f5d60e1-cfed-4d0b-8bf9-444cc5b9af38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.880516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f5d60e1-cfed-4d0b-8bf9-444cc5b9af38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.089694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f5d60e1-cfed-4d0b-8bf9-444cc5b9af38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.098757 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f5d60e1-cfed-4d0b-8bf9-444cc5b9af38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.240918 Oct 04 18:05:49.099853 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 600/1182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:49.179768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.185635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.193482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Searching by: {'deleted': False, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:05:49.211773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.215828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.216324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.217068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.217572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.218008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.312277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:05:49.373489 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c37fc4e-16d5-4e78-8ad2-525107683b29 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198087 Oct 04 18:05:49.374377 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 583/1183] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:49.387597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.398205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.399300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Searching by: {'deleted': False, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:05:49.405346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.405831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.406262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.407297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.408016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.408715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.552551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:05:49.636380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.642174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.642659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.643293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.707250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-491fec88-a8ed-4326-95a6-3e8b02e1a1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.708238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-491fec88-a8ed-4326-95a6-3e8b02e1a1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.716575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-491fec88-a8ed-4326-95a6-3e8b02e1a1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.717353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-491fec88-a8ed-4326-95a6-3e8b02e1a1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.718389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-491fec88-a8ed-4326-95a6-3e8b02e1a1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.719885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-491fec88-a8ed-4326-95a6-3e8b02e1a1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.720963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-491fec88-a8ed-4326-95a6-3e8b02e1a1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.721994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-491fec88-a8ed-4326-95a6-3e8b02e1a1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.787517 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1a88f74-2705-4751-8950-71dd17ae5680 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.402657 Oct 04 18:05:49.789301 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 601/1184] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:49.796317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c01002f8-6f70-408b-a578-9539466a5f81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.798544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c01002f8-6f70-408b-a578-9539466a5f81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.816406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c01002f8-6f70-408b-a578-9539466a5f81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.817301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c01002f8-6f70-408b-a578-9539466a5f81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.817995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c01002f8-6f70-408b-a578-9539466a5f81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.818736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c01002f8-6f70-408b-a578-9539466a5f81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.819223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c01002f8-6f70-408b-a578-9539466a5f81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.819747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c01002f8-6f70-408b-a578-9539466a5f81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.988992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-491fec88-a8ed-4326-95a6-3e8b02e1a1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.000382 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-491fec88-a8ed-4326-95a6-3e8b02e1a1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1465 microversion: 2.1 time: 0.296905 Oct 04 18:05:50.001289 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 584/1185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1465 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.006108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e267b18e-09a7-4829-bf92-6e9e6948ea99 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1ece700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.049102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c01002f8-6f70-408b-a578-9539466a5f81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.058520 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e267b18e-09a7-4829-bf92-6e9e6948ea99 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.055923 Oct 04 18:05:50.059700 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 585/1186] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.067385 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c01002f8-6f70-408b-a578-9539466a5f81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.268984 Oct 04 18:05:50.067385 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 602/1187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.070947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ac21d93-deb5-416e-b55a-bb6dc82e2c9e tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.072645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-05ea4434-19f6-4a56-96bd-6fb6f0e0c36e tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.073424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-05ea4434-19f6-4a56-96bd-6fb6f0e0c36e tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.079851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05ea4434-19f6-4a56-96bd-6fb6f0e0c36e tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.080808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05ea4434-19f6-4a56-96bd-6fb6f0e0c36e tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.081408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05ea4434-19f6-4a56-96bd-6fb6f0e0c36e tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.082293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05ea4434-19f6-4a56-96bd-6fb6f0e0c36e tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.082910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05ea4434-19f6-4a56-96bd-6fb6f0e0c36e tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.083508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05ea4434-19f6-4a56-96bd-6fb6f0e0c36e tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.085458 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ac21d93-deb5-416e-b55a-bb6dc82e2c9e tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023733 Oct 04 18:05:50.086070 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 603/1188] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:50.123644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce1e2d7e-29cf-455b-a0c9-3c238efce247 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.124503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ce1e2d7e-29cf-455b-a0c9-3c238efce247 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.135647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1e2d7e-29cf-455b-a0c9-3c238efce247 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.136160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1e2d7e-29cf-455b-a0c9-3c238efce247 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.136609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1e2d7e-29cf-455b-a0c9-3c238efce247 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.137333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1e2d7e-29cf-455b-a0c9-3c238efce247 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.137796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1e2d7e-29cf-455b-a0c9-3c238efce247 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.139111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1e2d7e-29cf-455b-a0c9-3c238efce247 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.352676 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-05ea4434-19f6-4a56-96bd-6fb6f0e0c36e tempest-ServersOnMultiNodesTest-243547594 tempest-ServersOnMultiNodesTest-243547594-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1618 microversion: 2.1 time: 0.283253 Oct 04 18:05:50.356489 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 586/1189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1618 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.379962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ce1e2d7e-29cf-455b-a0c9-3c238efce247 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.388234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d599e9f8-cce1-406b-90d1-4808bdfc2ee7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.389032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d599e9f8-cce1-406b-90d1-4808bdfc2ee7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.396413 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ce1e2d7e-29cf-455b-a0c9-3c238efce247 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.276466 Oct 04 18:05:50.397168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d599e9f8-cce1-406b-90d1-4808bdfc2ee7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.397829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d599e9f8-cce1-406b-90d1-4808bdfc2ee7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.399061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d599e9f8-cce1-406b-90d1-4808bdfc2ee7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.399232 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 604/1190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.400101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d599e9f8-cce1-406b-90d1-4808bdfc2ee7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.400717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d599e9f8-cce1-406b-90d1-4808bdfc2ee7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.401305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d599e9f8-cce1-406b-90d1-4808bdfc2ee7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.440404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d599e9f8-cce1-406b-90d1-4808bdfc2ee7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:50.592110 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d599e9f8-cce1-406b-90d1-4808bdfc2ee7 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 204 len: 0 microversion: 2.1 time: 0.210803 Oct 04 18:05:50.597301 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 587/1191] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:50 2022] DELETE /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:50.602284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.602904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.614104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.614756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.615403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.616493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.616961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.617477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.745484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8c42f633-c841-4c36-8402-64a4273519eb tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.745999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c42f633-c841-4c36-8402-64a4273519eb tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.760002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c42f633-c841-4c36-8402-64a4273519eb tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.764944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c42f633-c841-4c36-8402-64a4273519eb tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.765639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c42f633-c841-4c36-8402-64a4273519eb tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.767107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c42f633-c841-4c36-8402-64a4273519eb tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.767754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c42f633-c841-4c36-8402-64a4273519eb tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.768196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c42f633-c841-4c36-8402-64a4273519eb tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.814613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c42f633-c841-4c36-8402-64a4273519eb tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:50.815724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.826884 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1471 microversion: 2.1 time: 0.229232 Oct 04 18:05:50.843924 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 605/1192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:50.850231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.852080 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a79d9bf-7c2a-4472-a523-5f7d6a068686 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006320 Oct 04 18:05:50.852797 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 606/1193] 10.222.0.18 () {56 vars in 886 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:05:50.949952 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8c42f633-c841-4c36-8402-64a4273519eb tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 204 len: 0 microversion: 2.1 time: 0.209170 Oct 04 18:05:50.954800 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 588/1194] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:50 2022] DELETE /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:50.960998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ada66b4-19f5-4f42-b1d9-222771772f61 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.961647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4ada66b4-19f5-4f42-b1d9-222771772f61 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.973788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ada66b4-19f5-4f42-b1d9-222771772f61 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.974294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ada66b4-19f5-4f42-b1d9-222771772f61 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.974741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ada66b4-19f5-4f42-b1d9-222771772f61 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.976817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ada66b4-19f5-4f42-b1d9-222771772f61 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.976817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ada66b4-19f5-4f42-b1d9-222771772f61 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.976817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ada66b4-19f5-4f42-b1d9-222771772f61 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.080747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca8d36b0-2b59-4ce9-9d93-94ee56181880 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1da40d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.174842 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca8d36b0-2b59-4ce9-9d93-94ee56181880 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1422 microversion: 2.1 time: 0.101922 Oct 04 18:05:51.175503 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 589/1195] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1422 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:51.180706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e825072-d0c1-4c3d-a0bd-3e02cd4d5786 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.181478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e825072-d0c1-4c3d-a0bd-3e02cd4d5786 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.199100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e825072-d0c1-4c3d-a0bd-3e02cd4d5786 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.199619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e825072-d0c1-4c3d-a0bd-3e02cd4d5786 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.200084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e825072-d0c1-4c3d-a0bd-3e02cd4d5786 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.200744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4ada66b4-19f5-4f42-b1d9-222771772f61 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.200906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e825072-d0c1-4c3d-a0bd-3e02cd4d5786 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.201288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e825072-d0c1-4c3d-a0bd-3e02cd4d5786 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.201727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e825072-d0c1-4c3d-a0bd-3e02cd4d5786 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.211958 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ada66b4-19f5-4f42-b1d9-222771772f61 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1606 microversion: 2.1 time: 0.255160 Oct 04 18:05:51.213008 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 607/1196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1606 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:51.222826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6dfb4229-6fd7-4f29-a3e4-b3c5c4d58d8c req-f62572e0-ee0c-453d-8e81-f62b275b2b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513fb23f-209f-4de1-add7-84c46117aace", "name": "network-vif-unplugged", "status": "completed", "tag": "ae27d040-17cf-482a-b391-3a571eec78cd"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:51.233772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6dfb4229-6fd7-4f29-a3e4-b3c5c4d58d8c req-f62572e0-ee0c-453d-8e81-f62b275b2b79 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.234576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6dfb4229-6fd7-4f29-a3e4-b3c5c4d58d8c req-f62572e0-ee0c-453d-8e81-f62b275b2b79 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.236279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6dfb4229-6fd7-4f29-a3e4-b3c5c4d58d8c req-f62572e0-ee0c-453d-8e81-f62b275b2b79 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.255688 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6dfb4229-6fd7-4f29-a3e4-b3c5c4d58d8c req-f62572e0-ee0c-453d-8e81-f62b275b2b79 service nova] Creating event network-vif-unplugged:ae27d040-17cf-482a-b391-3a571eec78cd for instance 513fb23f-209f-4de1-add7-84c46117aace on n-h1-850499-14 Oct 04 18:05:51.264759 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6dfb4229-6fd7-4f29-a3e4-b3c5c4d58d8c req-f62572e0-ee0c-453d-8e81-f62b275b2b79 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048313 Oct 04 18:05:51.265957 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 608/1197] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:51.426869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-242765fb-5dc6-4384-893e-8427451eb686 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.449688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-242765fb-5dc6-4384-893e-8427451eb686 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.462428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-242765fb-5dc6-4384-893e-8427451eb686 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.465450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-242765fb-5dc6-4384-893e-8427451eb686 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.466917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-242765fb-5dc6-4384-893e-8427451eb686 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.470359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-242765fb-5dc6-4384-893e-8427451eb686 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.472502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-242765fb-5dc6-4384-893e-8427451eb686 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.475259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7e825072-d0c1-4c3d-a0bd-3e02cd4d5786 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.477253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-242765fb-5dc6-4384-893e-8427451eb686 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.486231 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e825072-d0c1-4c3d-a0bd-3e02cd4d5786 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.309664 Oct 04 18:05:51.501480 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 590/1198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:51.648198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-242765fb-5dc6-4384-893e-8427451eb686 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.661629 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-242765fb-5dc6-4384-893e-8427451eb686 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.243870 Oct 04 18:05:51.662601 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 609/1199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:51.863748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e455c04f-2261-49b9-b794-4552f865b2dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.864524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e455c04f-2261-49b9-b794-4552f865b2dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.871130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e455c04f-2261-49b9-b794-4552f865b2dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.871837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e455c04f-2261-49b9-b794-4552f865b2dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.872274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e455c04f-2261-49b9-b794-4552f865b2dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.872968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e455c04f-2261-49b9-b794-4552f865b2dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.873420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e455c04f-2261-49b9-b794-4552f865b2dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.873840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e455c04f-2261-49b9-b794-4552f865b2dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.095678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e455c04f-2261-49b9-b794-4552f865b2dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:52.104485 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e455c04f-2261-49b9-b794-4552f865b2dd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1471 microversion: 2.1 time: 0.248353 Oct 04 18:05:52.105207 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 591/1200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:52.193640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4dbd474-ca3a-4f4c-9728-0b765b4f461f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1c9e3a0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.241599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-737a6ca8-bd0a-4a04-a90f-09b44b881055 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.243135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-737a6ca8-bd0a-4a04-a90f-09b44b881055 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:52.246210 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f4dbd474-ca3a-4f4c-9728-0b765b4f461f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1431 microversion: 2.1 time: 0.057265 Oct 04 18:05:52.255726 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 610/1201] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1431 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:52.261161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-737a6ca8-bd0a-4a04-a90f-09b44b881055 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.262543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-737a6ca8-bd0a-4a04-a90f-09b44b881055 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.263239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-737a6ca8-bd0a-4a04-a90f-09b44b881055 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.264731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-737a6ca8-bd0a-4a04-a90f-09b44b881055 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.265402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-737a6ca8-bd0a-4a04-a90f-09b44b881055 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.266289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-737a6ca8-bd0a-4a04-a90f-09b44b881055 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.267070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0e0a554b-4d39-4896-87af-3f6e3d21e654 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e4ae50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.326258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0e0a554b-4d39-4896-87af-3f6e3d21e654 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 200 len: 1431 microversion: 2.1 time: 0.067804 Oct 04 18:05:52.337636 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 611/1202] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 1431 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:52.349707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cfbda073-4b98-439c-b497-9a20fd6bf846 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.352384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cfbda073-4b98-439c-b497-9a20fd6bf846 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:52.363338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbda073-4b98-439c-b497-9a20fd6bf846 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.364356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbda073-4b98-439c-b497-9a20fd6bf846 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.365145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbda073-4b98-439c-b497-9a20fd6bf846 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.381946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbda073-4b98-439c-b497-9a20fd6bf846 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.382553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbda073-4b98-439c-b497-9a20fd6bf846 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.382862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbda073-4b98-439c-b497-9a20fd6bf846 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.731235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-737a6ca8-bd0a-4a04-a90f-09b44b881055 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:52.741578 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-737a6ca8-bd0a-4a04-a90f-09b44b881055 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1606 microversion: 2.1 time: 0.505235 Oct 04 18:05:52.744220 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 592/1203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1606 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:52.749420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f53192b9-6106-47da-b17a-7edece866c68 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.750008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f53192b9-6106-47da-b17a-7edece866c68 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:52.757187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f53192b9-6106-47da-b17a-7edece866c68 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.758498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f53192b9-6106-47da-b17a-7edece866c68 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.759130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f53192b9-6106-47da-b17a-7edece866c68 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.760009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f53192b9-6106-47da-b17a-7edece866c68 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.760675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f53192b9-6106-47da-b17a-7edece866c68 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.761102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f53192b9-6106-47da-b17a-7edece866c68 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.779248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cfbda073-4b98-439c-b497-9a20fd6bf846 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:52.788196 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cfbda073-4b98-439c-b497-9a20fd6bf846 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1466 microversion: 2.1 time: 0.447173 Oct 04 18:05:52.803542 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 612/1204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1466 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:52.811306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a3aa4a81-4346-4545-bceb-d82a20ae2c4b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.811306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a3aa4a81-4346-4545-bceb-d82a20ae2c4b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:52.817506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3aa4a81-4346-4545-bceb-d82a20ae2c4b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.818083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3aa4a81-4346-4545-bceb-d82a20ae2c4b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.818523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3aa4a81-4346-4545-bceb-d82a20ae2c4b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.819262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3aa4a81-4346-4545-bceb-d82a20ae2c4b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.819715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3aa4a81-4346-4545-bceb-d82a20ae2c4b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.820137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3aa4a81-4346-4545-bceb-d82a20ae2c4b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.184738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f53192b9-6106-47da-b17a-7edece866c68 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:53.200913 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f53192b9-6106-47da-b17a-7edece866c68 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.455199 Oct 04 18:05:53.202067 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 593/1205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:53.237472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bd352ea3-460a-45a3-a9c7-4f1b62d9d7bd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1c64700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.248321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3aa4a81-4346-4545-bceb-d82a20ae2c4b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:53.258571 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a3aa4a81-4346-4545-bceb-d82a20ae2c4b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.464967 Oct 04 18:05:53.259538 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 613/1206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:53.275843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.276468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:53.284338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.284927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.285445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.286295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.286909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.287369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.307470 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bd352ea3-460a-45a3-a9c7-4f1b62d9d7bd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/acd24e6c-2248-4327-9505-66fea04436b8" status: 200 len: 784 microversion: 2.1 time: 0.095471 Oct 04 18:05:53.308049 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 594/1207] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:53 2022] GET /compute/v2.1/images/acd24e6c-2248-4327-9505-66fea04436b8 => generated 784 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:53.322253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f1df6182-f4b5-43da-85ff-17c398a1e030 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.324603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.325106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.325706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.326170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lazy-loading 'fault' on Instance uuid e9348f06-99a4-45a6-be27-b5cb7cb3cd37 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:53.330541 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f1df6182-f4b5-43da-85ff-17c398a1e030 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012606 Oct 04 18:05:53.331139 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 595/1208] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:05:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:53.343365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-9371a150-0bd7-4d74-b2c0-cd95d8a02619 req-d8602cc4-cad3-403b-bce7-b7261fc9ca80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513fb23f-209f-4de1-add7-84c46117aace", "tag": "ae27d040-17cf-482a-b391-3a571eec78cd"}, {"server_uuid": "e9348f06-99a4-45a6-be27-b5cb7cb3cd37", "name": "network-vif-deleted", "tag": "4def4e77-0d73-494f-967d-c9a8e911085b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:53.355370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9371a150-0bd7-4d74-b2c0-cd95d8a02619 req-d8602cc4-cad3-403b-bce7-b7261fc9ca80 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.355860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9371a150-0bd7-4d74-b2c0-cd95d8a02619 req-d8602cc4-cad3-403b-bce7-b7261fc9ca80 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.356589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9371a150-0bd7-4d74-b2c0-cd95d8a02619 req-d8602cc4-cad3-403b-bce7-b7261fc9ca80 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.371265 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9371a150-0bd7-4d74-b2c0-cd95d8a02619 req-d8602cc4-cad3-403b-bce7-b7261fc9ca80 service nova] Creating event network-changed:ae27d040-17cf-482a-b391-3a571eec78cd for instance 513fb23f-209f-4de1-add7-84c46117aace on n-h1-850499-14 Oct 04 18:05:53.371776 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9371a150-0bd7-4d74-b2c0-cd95d8a02619 req-d8602cc4-cad3-403b-bce7-b7261fc9ca80 service nova] Creating event network-vif-deleted:4def4e77-0d73-494f-967d-c9a8e911085b for instance e9348f06-99a4-45a6-be27-b5cb7cb3cd37 on n-h1-850499-14 Oct 04 18:05:53.378718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-9371a150-0bd7-4d74-b2c0-cd95d8a02619 req-d8602cc4-cad3-403b-bce7-b7261fc9ca80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038898 Oct 04 18:05:53.379245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:53.379738 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 596/1209] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:53.383472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:53.386606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca518fdd-238c-48e1-a615-cdcf5e74ff7a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1ece310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.388895 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5cb39605-6f37-4083-adb8-6ebb75b7c9ff tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1305 microversion: 2.1 time: 0.128437 Oct 04 18:05:53.403073 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 614/1210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:53 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:53.768033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a7f6f78-0fb5-4dd3-9778-2334055e55f7 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.768802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a7f6f78-0fb5-4dd3-9778-2334055e55f7 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:53.782574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a7f6f78-0fb5-4dd3-9778-2334055e55f7 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.783933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a7f6f78-0fb5-4dd3-9778-2334055e55f7 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.784548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a7f6f78-0fb5-4dd3-9778-2334055e55f7 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.785426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a7f6f78-0fb5-4dd3-9778-2334055e55f7 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.786681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a7f6f78-0fb5-4dd3-9778-2334055e55f7 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.787650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a7f6f78-0fb5-4dd3-9778-2334055e55f7 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.158733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7a7f6f78-0fb5-4dd3-9778-2334055e55f7 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.169695 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a7f6f78-0fb5-4dd3-9778-2334055e55f7 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1606 microversion: 2.1 time: 0.406141 Oct 04 18:05:54.183628 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 615/1211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:53 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1606 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:54.225161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f740368-9bdb-4ad4-ba29-12440eee4715 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.226038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4f740368-9bdb-4ad4-ba29-12440eee4715 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.238114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f740368-9bdb-4ad4-ba29-12440eee4715 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.239201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f740368-9bdb-4ad4-ba29-12440eee4715 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.239845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f740368-9bdb-4ad4-ba29-12440eee4715 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.240745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f740368-9bdb-4ad4-ba29-12440eee4715 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.243405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f740368-9bdb-4ad4-ba29-12440eee4715 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.244629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f740368-9bdb-4ad4-ba29-12440eee4715 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.280617 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca518fdd-238c-48e1-a615-cdcf5e74ff7a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "DELETE /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 204 len: 0 microversion: 2.1 time: 0.897183 Oct 04 18:05:54.282686 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 597/1212] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:53 2022] DELETE /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 0 bytes in 903 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:54.296047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-32470232-397a-430f-ad28-fe25c8df9f73 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.298824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-32470232-397a-430f-ad28-fe25c8df9f73 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.346093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32470232-397a-430f-ad28-fe25c8df9f73 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.353137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32470232-397a-430f-ad28-fe25c8df9f73 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.354086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32470232-397a-430f-ad28-fe25c8df9f73 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.355437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32470232-397a-430f-ad28-fe25c8df9f73 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.356617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32470232-397a-430f-ad28-fe25c8df9f73 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.357494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32470232-397a-430f-ad28-fe25c8df9f73 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.518389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4f740368-9bdb-4ad4-ba29-12440eee4715 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.527236 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f740368-9bdb-4ad4-ba29-12440eee4715 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.306048 Oct 04 18:05:54.528093 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 616/1213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:54.532911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2e31f956-86d7-4adc-8596-973713417361 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e4a9d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.576183 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-2e31f956-86d7-4adc-8596-973713417361 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] HTTP exception thrown: Image not found. Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2e31f956-86d7-4adc-8596-973713417361 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Request method failure captured: Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 HTTP/1.1 Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHXZurKJ8CRpr-mwYCTtVegSMemxdZulC5hJgfklo7cBx9JMkhqFKp_j85dnRv48EkmfjmqDNvJEljQIdpfJtuiI_KS7nTACkLC6Kd23ixQFk9OH8uoHWrorOoXw1UvFTuU3tUlIc5L_03jD2QtkrgbiKxOwJs-VRql2JoJbJG_W76Y Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9347f6d02b614c0d85ece3ec91521bd4 Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesOneServerTestJSON-755622534 Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:54.613642 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9347f6d02b614c0d85ece3ec91521bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9347f6d02b614c0d85ece3ec91521bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9347f6d02b614c0d85ece3ec91521bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9347f6d02b614c0d85ece3ec91521bd4"}]}] Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesOneServerTestJSON-755622534 Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9347f6d02b614c0d85ece3ec91521bd4 Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-755622534 Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesOneServerTestJSON-755622534-project Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 424cdee7a8ef4100b600b8a59f8f7394 Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesOneServerTestJSON-755622534-project Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'cec55691-018d-4abe-9915-f24973817a53'} Oct 04 18:05:54.615357 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:05:54.616404 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cec55691-018d-4abe-9915-f24973817a53 Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:05:54.617751 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cec55691-018d-4abe-9915-f24973817a53 could not be found. Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:05:54.620668 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2e31f956-86d7-4adc-8596-973713417361 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:54.622744 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2e31f956-86d7-4adc-8596-973713417361 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 404 len: 62 microversion: 2.1 time: 0.086114 Oct 04 18:05:54.625761 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 617/1214] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:05:54.628325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-32470232-397a-430f-ad28-fe25c8df9f73 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.629407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.630242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.646746 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-32470232-397a-430f-ad28-fe25c8df9f73 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.358703 Oct 04 18:05:54.651702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.652760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.653551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.654469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.655579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.656305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.673045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 598/1215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:54.685869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f20502e0-56c6-45a2-ac13-22c1101a9b28 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2128565701"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:54.705970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f20502e0-56c6-45a2-ac13-22c1101a9b28 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.736532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20502e0-56c6-45a2-ac13-22c1101a9b28 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.737045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20502e0-56c6-45a2-ac13-22c1101a9b28 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.737493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20502e0-56c6-45a2-ac13-22c1101a9b28 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.738219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20502e0-56c6-45a2-ac13-22c1101a9b28 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.738810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20502e0-56c6-45a2-ac13-22c1101a9b28 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.747577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20502e0-56c6-45a2-ac13-22c1101a9b28 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.765429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.768955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.769977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.771285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lazy-loading 'fault' on Instance uuid e9348f06-99a4-45a6-be27-b5cb7cb3cd37 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:54.958725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.001889 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2d81c5ad-aa6a-4088-a7ce-a862b6c41727 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 200 len: 1305 microversion: 2.1 time: 0.380380 Oct 04 18:05:55.005425 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 618/1216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 1305 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:55.075272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:55.196277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5671f7c7-d7f6-411a-b6ce-894a8cd27371 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:55.197755 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f20502e0-56c6-45a2-ac13-22c1101a9b28 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "POST /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2/action" status: 202 len: 0 microversion: 2.1 time: 0.517177 Oct 04 18:05:55.197882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5671f7c7-d7f6-411a-b6ce-894a8cd27371 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:55.199765 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 599/1217] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:54 2022] POST /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:05:55.208668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5671f7c7-d7f6-411a-b6ce-894a8cd27371 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.209304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5671f7c7-d7f6-411a-b6ce-894a8cd27371 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.209740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5671f7c7-d7f6-411a-b6ce-894a8cd27371 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.212611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5671f7c7-d7f6-411a-b6ce-894a8cd27371 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.212732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1a70400-05e6-4bfb-947a-d5b3b4fbccbe tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d5bc10>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:55.213283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5671f7c7-d7f6-411a-b6ce-894a8cd27371 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.213283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5671f7c7-d7f6-411a-b6ce-894a8cd27371 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.308457 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1a70400-05e6-4bfb-947a-d5b3b4fbccbe tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.096300 Oct 04 18:05:55.310102 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 600/1218] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:55 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:55.321990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5671f7c7-d7f6-411a-b6ce-894a8cd27371 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.333707 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5671f7c7-d7f6-411a-b6ce-894a8cd27371 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1252 microversion: 2.1 time: 0.143308 Oct 04 18:05:55.341657 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 619/1219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:55 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1252 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:55.398464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-0ddbbb13-e101-4123-b881-17220edf28e0 req-ca644c41-1d1c-474b-88f3-7e516edae5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b911ede1-8b72-4521-a647-8ea9dd3232ed", "name": "network-vif-deleted", "tag": "52faaf09-6573-4cc6-8bc9-5bdc801746cc"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:55.416269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0ddbbb13-e101-4123-b881-17220edf28e0 req-ca644c41-1d1c-474b-88f3-7e516edae5e4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.416759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0ddbbb13-e101-4123-b881-17220edf28e0 req-ca644c41-1d1c-474b-88f3-7e516edae5e4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.417195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0ddbbb13-e101-4123-b881-17220edf28e0 req-ca644c41-1d1c-474b-88f3-7e516edae5e4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.439205 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-0ddbbb13-e101-4123-b881-17220edf28e0 req-ca644c41-1d1c-474b-88f3-7e516edae5e4 service nova] Creating event network-vif-deleted:52faaf09-6573-4cc6-8bc9-5bdc801746cc for instance b911ede1-8b72-4521-a647-8ea9dd3232ed on n-h2-850499-14 Oct 04 18:05:55.446235 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-0ddbbb13-e101-4123-b881-17220edf28e0 req-ca644c41-1d1c-474b-88f3-7e516edae5e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054436 Oct 04 18:05:55.447682 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 601/1220] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:55.555673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8712870-6ad1-4f7c-a0d9-064656edff3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:55.556456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f8712870-6ad1-4f7c-a0d9-064656edff3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:55.568342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8712870-6ad1-4f7c-a0d9-064656edff3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.569423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8712870-6ad1-4f7c-a0d9-064656edff3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.570102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8712870-6ad1-4f7c-a0d9-064656edff3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.571554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8712870-6ad1-4f7c-a0d9-064656edff3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.572541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8712870-6ad1-4f7c-a0d9-064656edff3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.577417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8712870-6ad1-4f7c-a0d9-064656edff3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.698537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57632d7f-1870-4596-8c24-87e801811809 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:55.699848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-57632d7f-1870-4596-8c24-87e801811809 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:55.719450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57632d7f-1870-4596-8c24-87e801811809 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.721011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57632d7f-1870-4596-8c24-87e801811809 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.721777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57632d7f-1870-4596-8c24-87e801811809 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.725472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57632d7f-1870-4596-8c24-87e801811809 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.726293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57632d7f-1870-4596-8c24-87e801811809 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.727928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57632d7f-1870-4596-8c24-87e801811809 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.073763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f8712870-6ad1-4f7c-a0d9-064656edff3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.079658 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8712870-6ad1-4f7c-a0d9-064656edff3b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1543 microversion: 2.1 time: 0.529632 Oct 04 18:05:56.080559 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 620/1221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:55 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1543 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:56.085142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.086514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e9348f06-99a4-45a6-be27-b5cb7cb3cd37] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.104531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.105116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.105571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.106302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.106765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.123867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.170525 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] HTTP exception thrown: Instance e9348f06-99a4-45a6-be27-b5cb7cb3cd37 could not be found. Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Request method failure captured: Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 HTTP/1.1 Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHVQz1NE3kt3KG8YI5JPGsVVgcaKtXMWfqZO652Lwd64gK7xXxW8N6IOJiWaDKDQte234JQs8WMYZ-8pWnAeG_wPrA92qwT23Kjj8M38B7IJrStpLdCdXdXdTYLJkLUyRJVdWRBn7Gi8Joyy3ehbo_nPv9n5KK9mydgSN-yLd-WOaiQ Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:05:56.172127 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}] Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: d5e7c7c7826b4660acf4a4276c3e829c Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance e9348f06-99a4-45a6-be27-b5cb7cb3cd37 could not be found. Oct 04 18:05:56.173730 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'e9348f06-99a4-45a6-be27-b5cb7cb3cd37'} Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9348f06-99a4-45a6-be27-b5cb7cb3cd37 could not be found. Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:56.175603 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9348f06-99a4-45a6-be27-b5cb7cb3cd37 could not be found. Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9348f06-99a4-45a6-be27-b5cb7cb3cd37 could not be found. Oct 04 18:05:56.176907 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:05:56.178149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Returning 404 to user: Instance e9348f06-99a4-45a6-be27-b5cb7cb3cd37 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:56.178149 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4824ea05-60b0-4a3d-b457-5c241895b1ba tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37" status: 404 len: 111 microversion: 2.1 time: 0.092041 Oct 04 18:05:56.185911 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 621/1222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/e9348f06-99a4-45a6-be27-b5cb7cb3cd37 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:56.190874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3711bba1-53eb-47e5-ad2b-59776f83ab23 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.207261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3711bba1-53eb-47e5-ad2b-59776f83ab23 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.216966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3711bba1-53eb-47e5-ad2b-59776f83ab23 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.217491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3711bba1-53eb-47e5-ad2b-59776f83ab23 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.217947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3711bba1-53eb-47e5-ad2b-59776f83ab23 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.218727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3711bba1-53eb-47e5-ad2b-59776f83ab23 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.219228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3711bba1-53eb-47e5-ad2b-59776f83ab23 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.219664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3711bba1-53eb-47e5-ad2b-59776f83ab23 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.288002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3711bba1-53eb-47e5-ad2b-59776f83ab23 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:56.304145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-57632d7f-1870-4596-8c24-87e801811809 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.321766 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-57632d7f-1870-4596-8c24-87e801811809 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.621213 Oct 04 18:05:56.330999 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 602/1223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:55 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:56.341814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eb0f62ae-a7e6-48a8-8d08-ff6057fa25e7 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1c64820>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.450242 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eb0f62ae-a7e6-48a8-8d08-ff6057fa25e7 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.123222 Oct 04 18:05:56.451128 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 603/1224] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:56.468639 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3711bba1-53eb-47e5-ad2b-59776f83ab23 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 204 len: 0 microversion: 2.1 time: 0.280410 Oct 04 18:05:56.469456 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 622/1225] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:56 2022] DELETE /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:56.476359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0af6e5b5-f0f2-437e-9319-ff3dbe2330ea tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.478134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0af6e5b5-f0f2-437e-9319-ff3dbe2330ea tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.479055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96d197e4-4e97-4da9-b309-d0fb885bb1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.480339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96d197e4-4e97-4da9-b309-d0fb885bb1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.487287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d197e4-4e97-4da9-b309-d0fb885bb1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.488108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d197e4-4e97-4da9-b309-d0fb885bb1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.488715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d197e4-4e97-4da9-b309-d0fb885bb1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.489983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d197e4-4e97-4da9-b309-d0fb885bb1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.490654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d197e4-4e97-4da9-b309-d0fb885bb1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.491311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96d197e4-4e97-4da9-b309-d0fb885bb1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.491458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af6e5b5-f0f2-437e-9319-ff3dbe2330ea tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.492499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af6e5b5-f0f2-437e-9319-ff3dbe2330ea tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.497973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af6e5b5-f0f2-437e-9319-ff3dbe2330ea tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.498746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af6e5b5-f0f2-437e-9319-ff3dbe2330ea tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.499412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af6e5b5-f0f2-437e-9319-ff3dbe2330ea tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.499871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af6e5b5-f0f2-437e-9319-ff3dbe2330ea tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.670973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0af6e5b5-f0f2-437e-9319-ff3dbe2330ea tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.687826 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0af6e5b5-f0f2-437e-9319-ff3dbe2330ea tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1252 microversion: 2.1 time: 0.225888 Oct 04 18:05:56.688714 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 604/1226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1252 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:56.721741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96d197e4-4e97-4da9-b309-d0fb885bb1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.736366 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96d197e4-4e97-4da9-b309-d0fb885bb1f1 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1473 microversion: 2.1 time: 0.257338 Oct 04 18:05:56.749371 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 623/1227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1473 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:56.754695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-75811612-bf43-4034-8d4a-c5e1b7289b60 req-2899b58b-c325-48e1-936f-58303db3c1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f193d-65a7-48df-96b4-ee57115149a2", "name": "network-vif-unplugged", "status": "completed", "tag": "f53b385d-ad62-40bc-9e0f-d89171784dac"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:56.779805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-75811612-bf43-4034-8d4a-c5e1b7289b60 req-2899b58b-c325-48e1-936f-58303db3c1b0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.780286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-75811612-bf43-4034-8d4a-c5e1b7289b60 req-2899b58b-c325-48e1-936f-58303db3c1b0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.780719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-75811612-bf43-4034-8d4a-c5e1b7289b60 req-2899b58b-c325-48e1-936f-58303db3c1b0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.798524 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-75811612-bf43-4034-8d4a-c5e1b7289b60 req-2899b58b-c325-48e1-936f-58303db3c1b0 service nova] Creating event network-vif-unplugged:f53b385d-ad62-40bc-9e0f-d89171784dac for instance 3b9f193d-65a7-48df-96b4-ee57115149a2 on n-h1-850499-14 Oct 04 18:05:56.812435 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-75811612-bf43-4034-8d4a-c5e1b7289b60 req-2899b58b-c325-48e1-936f-58303db3c1b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061449 Oct 04 18:05:56.817651 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 624/1228] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:56.911532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Calling method '.version_select at 0x7fd4d1d1aa60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.913725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.914475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.915148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.946834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.950136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.951000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.980637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.981512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.982077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.994707 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17027e80-b581-4442-a266-a8a5dc83ab75 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.304911 Oct 04 18:05:56.996832 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 605/1229] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:57.009506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Calling method '.version_select at 0x7fd4d1df5c10>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.011476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.011975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.012422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.053664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.057313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.058046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.087406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.088682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.092554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.114885 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-adcffbd6-60b1-4947-aaba-c741bc871cf7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1510 microversion: 2.1 time: 0.109866 Oct 04 18:05:57.115786 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 625/1230] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1510 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.125093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e0a06a60-1e8c-4c12-b01c-bd604d78e974 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.130690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e0a06a60-1e8c-4c12-b01c-bd604d78e974 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.133190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Calling method '.version_select at 0x7fd4d1e7ff70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.135284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.135947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.136580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.144142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0a06a60-1e8c-4c12-b01c-bd604d78e974 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.145935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0a06a60-1e8c-4c12-b01c-bd604d78e974 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.147395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0a06a60-1e8c-4c12-b01c-bd604d78e974 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.149000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0a06a60-1e8c-4c12-b01c-bd604d78e974 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.149723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0a06a60-1e8c-4c12-b01c-bd604d78e974 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.151103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0a06a60-1e8c-4c12-b01c-bd604d78e974 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.175338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.176232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.176843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.197801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.198571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.202741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.234418 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-787e0555-e74a-41ba-922a-5842ee11c94a tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.105668 Oct 04 18:05:57.235092 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 626/1231] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:57.247774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d51af66-c451-481b-97a7-fba2df90cf3e tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Calling method '.version_select at 0x7fd4d1e4e1f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.250159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d51af66-c451-481b-97a7-fba2df90cf3e tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.250905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d51af66-c451-481b-97a7-fba2df90cf3e tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.253499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d51af66-c451-481b-97a7-fba2df90cf3e tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.273113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d51af66-c451-481b-97a7-fba2df90cf3e tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.273822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d51af66-c451-481b-97a7-fba2df90cf3e tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.274492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d51af66-c451-481b-97a7-fba2df90cf3e tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.283311 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d51af66-c451-481b-97a7-fba2df90cf3e tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.039265 Oct 04 18:05:57.284125 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 627/1232] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:57.305945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-697138a7-f704-43a6-bd1a-4897c0b7f9d7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Calling method '.version_select at 0x7fd4d1bd9c10>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.307828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-697138a7-f704-43a6-bd1a-4897c0b7f9d7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.308393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-697138a7-f704-43a6-bd1a-4897c0b7f9d7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.308937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-697138a7-f704-43a6-bd1a-4897c0b7f9d7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.343741 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-697138a7-f704-43a6-bd1a-4897c0b7f9d7 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.042422 Oct 04 18:05:57.344618 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 628/1233] 10.222.0.18 () {58 vars in 1179 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:57.363592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de656ba4-c150-454f-a772-dc08b3884afe tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.370176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-de656ba4-c150-454f-a772-dc08b3884afe tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.388818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de656ba4-c150-454f-a772-dc08b3884afe tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.390705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de656ba4-c150-454f-a772-dc08b3884afe tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.392785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de656ba4-c150-454f-a772-dc08b3884afe tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.393954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de656ba4-c150-454f-a772-dc08b3884afe tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.394096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de656ba4-c150-454f-a772-dc08b3884afe tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.394627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de656ba4-c150-454f-a772-dc08b3884afe tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.445982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e0a06a60-1e8c-4c12-b01c-bd604d78e974 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.470010 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e0a06a60-1e8c-4c12-b01c-bd604d78e974 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1542 microversion: 2.1 time: 0.365689 Oct 04 18:05:57.470592 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 606/1234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1542 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.485562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Calling method '.version_select at 0x7fd4d1d5bdc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.487657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.488317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.488996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.511682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.512625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.513264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.534495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.535167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.535635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.549669 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99b9c9ab-cc23-41aa-95fb-801194d95ef8 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.071171 Oct 04 18:05:57.550509 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 607/1235] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:57.555568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-afcc858f-3752-4bd3-bab4-39da0cb991be tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1c64820>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.618540 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-afcc858f-3752-4bd3-bab4-39da0cb991be tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.066735 Oct 04 18:05:57.619170 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 608/1236] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.624970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a94865c8-0b7c-4849-856f-b6f6694fb6b9 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Calling method '.version_select at 0x7fd4d1d1a310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.626986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a94865c8-0b7c-4849-856f-b6f6694fb6b9 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.627655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a94865c8-0b7c-4849-856f-b6f6694fb6b9 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.628265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a94865c8-0b7c-4849-856f-b6f6694fb6b9 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.629155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de656ba4-c150-454f-a772-dc08b3884afe tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.640014 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de656ba4-c150-454f-a772-dc08b3884afe tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.293995 Oct 04 18:05:57.641595 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 629/1237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.658835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a94865c8-0b7c-4849-856f-b6f6694fb6b9 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.659817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a94865c8-0b7c-4849-856f-b6f6694fb6b9 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.660336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a94865c8-0b7c-4849-856f-b6f6694fb6b9 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.667464 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a94865c8-0b7c-4849-856f-b6f6694fb6b9 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.047212 Oct 04 18:05:57.668190 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 609/1238] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:57.683208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80c72243-ddb6-4b78-9f93-865885d7c650 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Calling method '.version_select at 0x7fd4d1bd9d30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.685432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80c72243-ddb6-4b78-9f93-865885d7c650 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.686155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80c72243-ddb6-4b78-9f93-865885d7c650 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.686596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80c72243-ddb6-4b78-9f93-865885d7c650 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.702216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80c72243-ddb6-4b78-9f93-865885d7c650 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.703077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80c72243-ddb6-4b78-9f93-865885d7c650 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.703687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80c72243-ddb6-4b78-9f93-865885d7c650 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.712291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f5ad823-1863-467a-b616-eabc8f5223ba tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.714033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9f5ad823-1863-467a-b616-eabc8f5223ba tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.722337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f5ad823-1863-467a-b616-eabc8f5223ba tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.723752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f5ad823-1863-467a-b616-eabc8f5223ba tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.724531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f5ad823-1863-467a-b616-eabc8f5223ba tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.725489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f5ad823-1863-467a-b616-eabc8f5223ba tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.727086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f5ad823-1863-467a-b616-eabc8f5223ba tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.727911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f5ad823-1863-467a-b616-eabc8f5223ba tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.737051 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80c72243-ddb6-4b78-9f93-865885d7c650 tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 762 microversion: 2.1 time: 0.057766 Oct 04 18:05:57.749267 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 630/1239] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/os-hypervisors/2 => generated 762 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:57.755907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Calling method '.version_select at 0x7fd4d1e311f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.758273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.758762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.760546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.774694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.775479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.776156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.789012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.789839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.790515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.826150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f5ad823-1863-467a-b616-eabc8f5223ba tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.847292 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-72ae2e2f-5eea-4e60-90b9-817dd2c810bf tempest-HypervisorAdminTestJSON-858179198 tempest-HypervisorAdminTestJSON-858179198-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.090390 Oct 04 18:05:57.848565 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 631/1240] 10.222.0.18 () {58 vars in 1173 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:57.863863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ee921a5-c65f-4862-96ed-03ac790e292d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.865065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ee921a5-c65f-4862-96ed-03ac790e292d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.865238 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9f5ad823-1863-467a-b616-eabc8f5223ba tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1252 microversion: 2.1 time: 0.159197 Oct 04 18:05:57.879165 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 610/1241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1252 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.884464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ee921a5-c65f-4862-96ed-03ac790e292d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.885222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ee921a5-c65f-4862-96ed-03ac790e292d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.885703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ee921a5-c65f-4862-96ed-03ac790e292d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.890739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ee921a5-c65f-4862-96ed-03ac790e292d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.892172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ee921a5-c65f-4862-96ed-03ac790e292d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.892897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ee921a5-c65f-4862-96ed-03ac790e292d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.992697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1170826-5af5-4927-92d9-55bca2e220bb tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cd03ab7-1ee5-41de-9696-49fb1f4894c1"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:57.995570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e1170826-5af5-4927-92d9-55bca2e220bb tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.008673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1170826-5af5-4927-92d9-55bca2e220bb tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.009553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1170826-5af5-4927-92d9-55bca2e220bb tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.010383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1170826-5af5-4927-92d9-55bca2e220bb tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.011411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1170826-5af5-4927-92d9-55bca2e220bb tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.012246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1170826-5af5-4927-92d9-55bca2e220bb tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.012907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1170826-5af5-4927-92d9-55bca2e220bb tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.083821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ee921a5-c65f-4862-96ed-03ac790e292d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.094121 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ee921a5-c65f-4862-96ed-03ac790e292d tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1473 microversion: 2.1 time: 0.243942 Oct 04 18:05:58.097764 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 632/1242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1473 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:58.493710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-483b8a3f-493f-4ba1-aded-aa3535c4424a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.494328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-483b8a3f-493f-4ba1-aded-aa3535c4424a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.503853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-483b8a3f-493f-4ba1-aded-aa3535c4424a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.504363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-483b8a3f-493f-4ba1-aded-aa3535c4424a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.504808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-483b8a3f-493f-4ba1-aded-aa3535c4424a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.505523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-483b8a3f-493f-4ba1-aded-aa3535c4424a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.505983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-483b8a3f-493f-4ba1-aded-aa3535c4424a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.506473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-483b8a3f-493f-4ba1-aded-aa3535c4424a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.512595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:58.841752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-483b8a3f-493f-4ba1-aded-aa3535c4424a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.854155 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-483b8a3f-493f-4ba1-aded-aa3535c4424a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1474 microversion: 2.1 time: 0.364660 Oct 04 18:05:58.854844 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 633/1243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:58.860026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c779170f-1b30-4daf-bba1-09424d825439 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1bc1280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.914555 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c779170f-1b30-4daf-bba1-09424d825439 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.057669 Oct 04 18:05:58.915389 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 634/1244] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:58.920506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bc383dea-a1c8-4eea-b909-7671806c253b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.921337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bc383dea-a1c8-4eea-b909-7671806c253b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.928491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc383dea-a1c8-4eea-b909-7671806c253b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.929355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc383dea-a1c8-4eea-b909-7671806c253b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.930480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc383dea-a1c8-4eea-b909-7671806c253b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.931547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc383dea-a1c8-4eea-b909-7671806c253b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.932253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc383dea-a1c8-4eea-b909-7671806c253b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.932882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc383dea-a1c8-4eea-b909-7671806c253b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.108004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bc383dea-a1c8-4eea-b909-7671806c253b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.120124 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bc383dea-a1c8-4eea-b909-7671806c253b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.203625 Oct 04 18:05:59.121103 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 635/1245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:59.126943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51b9c1a3-d0f5-45ad-bdfe-b2442e60d084 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.128230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-51b9c1a3-d0f5-45ad-bdfe-b2442e60d084 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.136431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51b9c1a3-d0f5-45ad-bdfe-b2442e60d084 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.137405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51b9c1a3-d0f5-45ad-bdfe-b2442e60d084 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.137918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51b9c1a3-d0f5-45ad-bdfe-b2442e60d084 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.139009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51b9c1a3-d0f5-45ad-bdfe-b2442e60d084 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.139626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51b9c1a3-d0f5-45ad-bdfe-b2442e60d084 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.140216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51b9c1a3-d0f5-45ad-bdfe-b2442e60d084 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.227840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-51b9c1a3-d0f5-45ad-bdfe-b2442e60d084 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.237976 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-51b9c1a3-d0f5-45ad-bdfe-b2442e60d084 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1252 microversion: 2.1 time: 0.115232 Oct 04 18:05:59.238942 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 636/1246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:59 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1252 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:59.244345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aef50c25-3ccf-4a29-b3f6-6dd96135df71 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.244954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aef50c25-3ccf-4a29-b3f6-6dd96135df71 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.251412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef50c25-3ccf-4a29-b3f6-6dd96135df71 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.252090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef50c25-3ccf-4a29-b3f6-6dd96135df71 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.253124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef50c25-3ccf-4a29-b3f6-6dd96135df71 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.253261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef50c25-3ccf-4a29-b3f6-6dd96135df71 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.253674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef50c25-3ccf-4a29-b3f6-6dd96135df71 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.254118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef50c25-3ccf-4a29-b3f6-6dd96135df71 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.261184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:59.413230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aef50c25-3ccf-4a29-b3f6-6dd96135df71 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.425036 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aef50c25-3ccf-4a29-b3f6-6dd96135df71 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1473 microversion: 2.1 time: 0.185089 Oct 04 18:05:59.435570 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 637/1247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:59 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1473 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:59.770395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-81f703e5-5b06-4b60-a32d-e064d155479d req-3714a796-f511-4e0a-893f-2e725a645105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4dafc5-240b-4d3e-8fb4-71121b9a9e8a", "name": "network-vif-deleted", "tag": "177c1fa2-47af-47d8-b025-616202d19293"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:59.788288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:59.790151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:59.800477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-81f703e5-5b06-4b60-a32d-e064d155479d req-3714a796-f511-4e0a-893f-2e725a645105 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.800477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-81f703e5-5b06-4b60-a32d-e064d155479d req-3714a796-f511-4e0a-893f-2e725a645105 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.800994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-81f703e5-5b06-4b60-a32d-e064d155479d req-3714a796-f511-4e0a-893f-2e725a645105 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.815746 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-81f703e5-5b06-4b60-a32d-e064d155479d req-3714a796-f511-4e0a-893f-2e725a645105 service nova] Creating event network-vif-deleted:177c1fa2-47af-47d8-b025-616202d19293 for instance de4dafc5-240b-4d3e-8fb4-71121b9a9e8a on n-h2-850499-14 Oct 04 18:05:59.832409 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-81f703e5-5b06-4b60-a32d-e064d155479d req-3714a796-f511-4e0a-893f-2e725a645105 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071529 Oct 04 18:05:59.833219 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 638/1248] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:59.888931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4df094a9-11e3-48a2-a867-7fd2963675ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.890144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4df094a9-11e3-48a2-a867-7fd2963675ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.913512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4df094a9-11e3-48a2-a867-7fd2963675ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.916672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4df094a9-11e3-48a2-a867-7fd2963675ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.917137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4df094a9-11e3-48a2-a867-7fd2963675ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.918240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4df094a9-11e3-48a2-a867-7fd2963675ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.919746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4df094a9-11e3-48a2-a867-7fd2963675ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.920641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4df094a9-11e3-48a2-a867-7fd2963675ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.146586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4df094a9-11e3-48a2-a867-7fd2963675ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.197429 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4df094a9-11e3-48a2-a867-7fd2963675ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1474 microversion: 2.1 time: 0.319218 Oct 04 18:06:00.198273 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 639/1249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:59 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1474 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:00.215595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d377427-5e9d-42d9-be8d-e1c5c547ade1 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1b414c0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.318399 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d377427-5e9d-42d9-be8d-e1c5c547ade1 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.109317 Oct 04 18:06:00.319844 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 640/1250] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:00.357205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1cd3db8-146e-42d3-9f50-657a1a618176 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.357962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a1cd3db8-146e-42d3-9f50-657a1a618176 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.376079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1cd3db8-146e-42d3-9f50-657a1a618176 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.376976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1cd3db8-146e-42d3-9f50-657a1a618176 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.377601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1cd3db8-146e-42d3-9f50-657a1a618176 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.378372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1cd3db8-146e-42d3-9f50-657a1a618176 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.379152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1cd3db8-146e-42d3-9f50-657a1a618176 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.379782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1cd3db8-146e-42d3-9f50-657a1a618176 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.401354 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1170826-5af5-4927-92d9-55bca2e220bb tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "POST /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.412736 Oct 04 18:06:00.408498 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 611/1251] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:05:57 2022] POST /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-volume_attachments => generated 194 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:00.417275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d30edd5d-a3ad-4418-890e-2025b448ad9b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.418899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d30edd5d-a3ad-4418-890e-2025b448ad9b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.428162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d30edd5d-a3ad-4418-890e-2025b448ad9b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.429251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d30edd5d-a3ad-4418-890e-2025b448ad9b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.430637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d30edd5d-a3ad-4418-890e-2025b448ad9b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.431696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d30edd5d-a3ad-4418-890e-2025b448ad9b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.432432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d30edd5d-a3ad-4418-890e-2025b448ad9b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.433112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d30edd5d-a3ad-4418-890e-2025b448ad9b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.629983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d30edd5d-a3ad-4418-890e-2025b448ad9b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.648351 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d30edd5d-a3ad-4418-890e-2025b448ad9b tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1252 microversion: 2.1 time: 0.235979 Oct 04 18:06:00.650359 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 612/1252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1252 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:00.664114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.674003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.694415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.697458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.699348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.700579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.702156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.706277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.775454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a1cd3db8-146e-42d3-9f50-657a1a618176 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.796214 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1cd3db8-146e-42d3-9f50-657a1a618176 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.474866 Oct 04 18:06:00.796837 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 641/1253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:00.826075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6626e597-0100-4048-b17b-45481930a5db req-5fbe4583-5b47-4bdc-b318-bc7268503e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70", "name": "network-vif-unplugged", "status": "completed", "tag": "c24ea2e8-e606-476d-b4d4-83e53aad9183"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:00.827874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.830368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.831691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.834047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lazy-loading 'fault' on Instance uuid de4dafc5-240b-4d3e-8fb4-71121b9a9e8a {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:00.849370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6626e597-0100-4048-b17b-45481930a5db req-5fbe4583-5b47-4bdc-b318-bc7268503e6b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.850081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6626e597-0100-4048-b17b-45481930a5db req-5fbe4583-5b47-4bdc-b318-bc7268503e6b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.851934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6626e597-0100-4048-b17b-45481930a5db req-5fbe4583-5b47-4bdc-b318-bc7268503e6b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.870684 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6626e597-0100-4048-b17b-45481930a5db req-5fbe4583-5b47-4bdc-b318-bc7268503e6b service nova] Creating event network-vif-unplugged:c24ea2e8-e606-476d-b4d4-83e53aad9183 for instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 on n-h1-850499-14 Oct 04 18:06:00.881422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-6626e597-0100-4048-b17b-45481930a5db req-5fbe4583-5b47-4bdc-b318-bc7268503e6b service nova] Instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:06:00.892930 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6626e597-0100-4048-b17b-45481930a5db req-5fbe4583-5b47-4bdc-b318-bc7268503e6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079602 Oct 04 18:06:00.909999 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 642/1254] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:00.939758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.959049 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-edc0a3ea-eac0-4d7a-aa41-90a79012ce61 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 200 len: 1307 microversion: 2.1 time: 0.305217 Oct 04 18:06:00.959665 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 613/1255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.225304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d073d939-e055-42b0-91cc-c7049086b1c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.226127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d073d939-e055-42b0-91cc-c7049086b1c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:01.246173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d073d939-e055-42b0-91cc-c7049086b1c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.248606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d073d939-e055-42b0-91cc-c7049086b1c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.250069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d073d939-e055-42b0-91cc-c7049086b1c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.253009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d073d939-e055-42b0-91cc-c7049086b1c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.254767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d073d939-e055-42b0-91cc-c7049086b1c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.256317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d073d939-e055-42b0-91cc-c7049086b1c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.336270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aa16a85d-d29f-4511-8870-0b52062edc6f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d1a820>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.425272 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aa16a85d-d29f-4511-8870-0b52062edc6f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.093797 Oct 04 18:06:01.428817 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 614/1256] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:01.529511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d073d939-e055-42b0-91cc-c7049086b1c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:01.539727 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d073d939-e055-42b0-91cc-c7049086b1c6 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1471 microversion: 2.1 time: 0.321673 Oct 04 18:06:01.542458 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 643/1257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1471 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.568151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:01.571764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:01.585490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.586686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.587483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.588368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.589562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.590112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.691564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.692402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:01.708682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.713408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.715819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.717536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.721015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.722223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.770037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.770545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.771032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.771832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.772230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.772655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.775429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.776185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.777100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.777988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lazy-loading 'fault' on Instance uuid b911ede1-8b72-4521-a647-8ea9dd3232ed {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:01.840475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1205c1bd748c6845643ae231bf19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec29258aab154d4aaf11ff64931a4fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:01.859335 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c36fbce6-a9ba-4bbf-9571-353c74a8c35f tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 200 len: 1257 microversion: 2.1 time: 0.182577 Oct 04 18:06:01.860468 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 644/1258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 1257 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.865977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b71767cf-2db4-49b6-9923-e5fb8df7b33c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.867596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b71767cf-2db4-49b6-9923-e5fb8df7b33c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:01.874590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:01.876317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b71767cf-2db4-49b6-9923-e5fb8df7b33c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.877179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b71767cf-2db4-49b6-9923-e5fb8df7b33c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.877854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b71767cf-2db4-49b6-9923-e5fb8df7b33c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.880698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b71767cf-2db4-49b6-9923-e5fb8df7b33c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.882483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b71767cf-2db4-49b6-9923-e5fb8df7b33c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.885416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b71767cf-2db4-49b6-9923-e5fb8df7b33c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.901996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'cores', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:01.908007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:01.909472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for user d7458740d4be4cedaa01bea94ba992d2 and project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'cores', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:02.129374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:02.165965 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9bbb3d89-f9ae-45f2-8d5d-0f7a2d013db8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70/action" status: 202 len: 0 microversion: 2.1 time: 0.602080 Oct 04 18:06:02.169193 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 615/1259] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:01 2022] POST /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:02.204129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.206046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: de4dafc5-240b-4d3e-8fb4-71121b9a9e8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.224944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.232826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.232826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.233267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.234724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.234724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.242391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b71767cf-2db4-49b6-9923-e5fb8df7b33c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.258283 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b71767cf-2db4-49b6-9923-e5fb8df7b33c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.395977 Oct 04 18:06:02.260334 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 645/1260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.266437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e378b32-8dae-497c-9603-c4732f6edfcc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.267489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e378b32-8dae-497c-9603-c4732f6edfcc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.284215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e378b32-8dae-497c-9603-c4732f6edfcc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.286215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e378b32-8dae-497c-9603-c4732f6edfcc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.286777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e378b32-8dae-497c-9603-c4732f6edfcc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.287878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e378b32-8dae-497c-9603-c4732f6edfcc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.290766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e378b32-8dae-497c-9603-c4732f6edfcc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.291291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e378b32-8dae-497c-9603-c4732f6edfcc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.545741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e378b32-8dae-497c-9603-c4732f6edfcc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.576654 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e378b32-8dae-497c-9603-c4732f6edfcc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1470 microversion: 2.1 time: 0.313638 Oct 04 18:06:02.579269 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 646/1261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1470 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.591633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d8f17914-6d69-46ef-be65-dbef7d6bf2fe tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e31e50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.660444 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] HTTP exception thrown: Instance de4dafc5-240b-4d3e-8fb4-71121b9a9e8a could not be found. Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Request method failure captured: Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a HTTP/1.1 Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVQz1NE3kt3KG8YI5JPGsVVgcaKtXMWfqZO652Lwd64gK7xXxW8N6IOJiWaDKDQte234JQs8WMYZ-8pWnAeG_wPrA92qwT23Kjj8M38B7IJrStpLdCdXdXdTYLJkLUyRJVdWRBn7Gi8Joyy3ehbo_nPv9n5KK9mydgSN-yLd-WOaiQ Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:06:02.664298 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}] Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d5e7c7c7826b4660acf4a4276c3e829c Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance de4dafc5-240b-4d3e-8fb4-71121b9a9e8a could not be found. Oct 04 18:06:02.665829 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'de4dafc5-240b-4d3e-8fb4-71121b9a9e8a'} Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4dafc5-240b-4d3e-8fb4-71121b9a9e8a could not be found. Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:02.666710 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4dafc5-240b-4d3e-8fb4-71121b9a9e8a could not be found. Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4dafc5-240b-4d3e-8fb4-71121b9a9e8a could not be found. Oct 04 18:06:02.668368 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:02.672512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Returning 404 to user: Instance de4dafc5-240b-4d3e-8fb4-71121b9a9e8a could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:02.676297 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f95f442f-1400-48d1-9d85-a7e450065204 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a" status: 404 len: 111 microversion: 2.1 time: 0.505177 Oct 04 18:06:02.680172 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 616/1262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/de4dafc5-240b-4d3e-8fb4-71121b9a9e8a => generated 111 bytes in 511 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:02.691771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-50823ebc-da40-448f-bcdb-7c9e8947c922 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.696024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-50823ebc-da40-448f-bcdb-7c9e8947c922 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.698534 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d8f17914-6d69-46ef-be65-dbef7d6bf2fe tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.117687 Oct 04 18:06:02.707809 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 647/1263] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.717881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50823ebc-da40-448f-bcdb-7c9e8947c922 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.720715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50823ebc-da40-448f-bcdb-7c9e8947c922 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.722697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50823ebc-da40-448f-bcdb-7c9e8947c922 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.723759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50823ebc-da40-448f-bcdb-7c9e8947c922 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.726558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50823ebc-da40-448f-bcdb-7c9e8947c922 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.730528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50823ebc-da40-448f-bcdb-7c9e8947c922 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.795948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-50823ebc-da40-448f-bcdb-7c9e8947c922 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:02.964262 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-50823ebc-da40-448f-bcdb-7c9e8947c922 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 204 len: 0 microversion: 2.1 time: 0.279035 Oct 04 18:06:02.965428 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 617/1264] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:02 2022] DELETE /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:02.979253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.980612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] [instance: b911ede1-8b72-4521-a647-8ea9dd3232ed] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.996721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.997462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.998893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.000042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.000888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.001560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.029667 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] HTTP exception thrown: Instance b911ede1-8b72-4521-a647-8ea9dd3232ed could not be found. Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Request method failure captured: Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed HTTP/1.1 Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVoAQ1XeXpSbS9oYisesa6a5vTfAOJACFpas7VP0wLlnH93HCGE6mjP1Qw4XXxig6Ez5jZeCfEl0nfa5ZMOe41APBuBoh7y1s_SJ2pdY5KE-Atcr3Qx5S5V6jKebMdx_FCk9jiXMeP5f72x7EuTCFWU9w45UkhFQ59Tcvi4pl9WQJ0 Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ec29258aab154d4aaf11ff64931a4fbe Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestBootFromVolume-1726971430 Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:06:03.033260 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ec29258aab154d4aaf11ff64931a4fbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ec29258aab154d4aaf11ff64931a4fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ec29258aab154d4aaf11ff64931a4fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ec29258aab154d4aaf11ff64931a4fbe"}]}] Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestBootFromVolume-1726971430 Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ec29258aab154d4aaf11ff64931a4fbe Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1726971430 Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestBootFromVolume-1726971430-project Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b6d1205c1bd748c6845643ae231bf19a Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestBootFromVolume-1726971430-project Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance b911ede1-8b72-4521-a647-8ea9dd3232ed could not be found. Oct 04 18:06:03.034683 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'b911ede1-8b72-4521-a647-8ea9dd3232ed'} Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b911ede1-8b72-4521-a647-8ea9dd3232ed could not be found. Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:03.035590 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b911ede1-8b72-4521-a647-8ea9dd3232ed could not be found. Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b911ede1-8b72-4521-a647-8ea9dd3232ed could not be found. Oct 04 18:06:03.036817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:03.041122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Returning 404 to user: Instance b911ede1-8b72-4521-a647-8ea9dd3232ed could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:03.042243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9a3cb1e-786e-47eb-8cb5-03ddcdb6f531 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed" status: 404 len: 111 microversion: 2.1 time: 0.074331 Oct 04 18:06:03.043378 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 618/1265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/b911ede1-8b72-4521-a647-8ea9dd3232ed => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:03.049244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-261f65ff-961b-481a-b0c3-3f4f54c9820e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.050275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-261f65ff-961b-481a-b0c3-3f4f54c9820e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:03.057260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-261f65ff-961b-481a-b0c3-3f4f54c9820e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.058296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-261f65ff-961b-481a-b0c3-3f4f54c9820e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.058845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-261f65ff-961b-481a-b0c3-3f4f54c9820e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.059894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-261f65ff-961b-481a-b0c3-3f4f54c9820e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.060600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-261f65ff-961b-481a-b0c3-3f4f54c9820e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.061625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-261f65ff-961b-481a-b0c3-3f4f54c9820e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.193650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Calling method '.version_select at 0x7fd4d1b00790>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.196453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.197203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.197880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.228763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.231420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.233141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.272835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-261f65ff-961b-481a-b0c3-3f4f54c9820e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:03.275095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.279370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.281728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.285459 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-261f65ff-961b-481a-b0c3-3f4f54c9820e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1471 microversion: 2.1 time: 0.240400 Oct 04 18:06:03.286411 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 619/1266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:03.292286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d175a398-d11d-4e97-b5ad-bf44877a8e85 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] Calling method '.version_select at 0x7fd4d1d0bb80>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.307615 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e8b0f5e6-f5be-4c5c-9d74-9e6c8734802f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.442829 Oct 04 18:06:03.311556 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 648/1267] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.324753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-20dff096-e381-4730-adc9-3276ebf33507 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.330273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-20dff096-e381-4730-adc9-3276ebf33507 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:03.337116 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d175a398-d11d-4e97-b5ad-bf44877a8e85 tempest-ServersTestBootFromVolume-1726971430 tempest-ServersTestBootFromVolume-1726971430-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867673379" status: 202 len: 0 microversion: 2.1 time: 0.049436 Oct 04 18:06:03.342581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20dff096-e381-4730-adc9-3276ebf33507 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.344054 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 620/1268] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867673379 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:03.344668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20dff096-e381-4730-adc9-3276ebf33507 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.345376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20dff096-e381-4730-adc9-3276ebf33507 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.348267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20dff096-e381-4730-adc9-3276ebf33507 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.348983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20dff096-e381-4730-adc9-3276ebf33507 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.353788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20dff096-e381-4730-adc9-3276ebf33507 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.369127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Calling method '.version_select at 0x7fd4d1d941f0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.371002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.383230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.387369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.436503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.437030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.441716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.485863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.486979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.486979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.495029 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0499502e-b154-4f88-aebe-4113c0477514 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/n-h1-850499-14/servers" status: 200 len: 671 microversion: 2.1 time: 0.149056 Oct 04 18:06:03.512380 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 621/1269] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/os-hypervisors/n-h1-850499-14/servers => generated 671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.524493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Calling method '.version_select at 0x7fd4d1dd0c10>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.527190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.527693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.528141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.546343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.546841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.547352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.580991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.581498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.581938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.603070 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-24805394-ce95-47c5-b6eb-3e23ff23252f tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.084288 Oct 04 18:06:03.606240 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 622/1270] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.618368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e20f631-f31e-4767-97eb-d0b80855a7ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.619003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e20f631-f31e-4767-97eb-d0b80855a7ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:03.634276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e20f631-f31e-4767-97eb-d0b80855a7ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.635165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e20f631-f31e-4767-97eb-d0b80855a7ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.635861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e20f631-f31e-4767-97eb-d0b80855a7ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.636813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e20f631-f31e-4767-97eb-d0b80855a7ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.637791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e20f631-f31e-4767-97eb-d0b80855a7ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.639106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e20f631-f31e-4767-97eb-d0b80855a7ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.681427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-20dff096-e381-4730-adc9-3276ebf33507 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:03.690534 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-20dff096-e381-4730-adc9-3276ebf33507 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.377381 Oct 04 18:06:03.703643 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 649/1271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:03.713251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-761b56da-ff02-45a5-ac58-19545cbc2747 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Calling method '.version_select at 0x7fd4d1b118b0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.716013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761b56da-ff02-45a5-ac58-19545cbc2747 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.718507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761b56da-ff02-45a5-ac58-19545cbc2747 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.719390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761b56da-ff02-45a5-ac58-19545cbc2747 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.737001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761b56da-ff02-45a5-ac58-19545cbc2747 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.737922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761b56da-ff02-45a5-ac58-19545cbc2747 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.738626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761b56da-ff02-45a5-ac58-19545cbc2747 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.746569 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-761b56da-ff02-45a5-ac58-19545cbc2747 tempest-HypervisorAdminUnderV252Test-1166812408 tempest-HypervisorAdminUnderV252Test-1166812408-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/n-h1-850499-14/search" status: 200 len: 105 microversion: 2.1 time: 0.041376 Oct 04 18:06:03.747990 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 650/1272] 10.222.0.18 () {58 vars in 1212 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/os-hypervisors/n-h1-850499-14/search => generated 105 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.781731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-71b79e0d-c6b7-407b-9663-40a6a08c50f9 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e31280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.860604 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-71b79e0d-c6b7-407b-9663-40a6a08c50f9 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.111217 Oct 04 18:06:03.870476 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 651/1273] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:04.286273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7e20f631-f31e-4767-97eb-d0b80855a7ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:04.298388 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e20f631-f31e-4767-97eb-d0b80855a7ff tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1470 microversion: 2.1 time: 0.685065 Oct 04 18:06:04.313297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bab896ed-61ba-4afa-a497-1f3f835119e5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:04.314846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bab896ed-61ba-4afa-a497-1f3f835119e5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:04.317436 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 623/1274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1470 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:04.326086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bab896ed-61ba-4afa-a497-1f3f835119e5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.326986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bab896ed-61ba-4afa-a497-1f3f835119e5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.327674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bab896ed-61ba-4afa-a497-1f3f835119e5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.328635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bab896ed-61ba-4afa-a497-1f3f835119e5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.331608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bab896ed-61ba-4afa-a497-1f3f835119e5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.332313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bab896ed-61ba-4afa-a497-1f3f835119e5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.592293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-16961b12-4213-436f-b961-b1b62473a23b req-bc37f400-6676-4a37-bf56-ca217a9e04af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f193d-65a7-48df-96b4-ee57115149a2", "name": "network-vif-plugged", "status": "completed", "tag": "f53b385d-ad62-40bc-9e0f-d89171784dac"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:04.613734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-16961b12-4213-436f-b961-b1b62473a23b req-bc37f400-6676-4a37-bf56-ca217a9e04af service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.616745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-16961b12-4213-436f-b961-b1b62473a23b req-bc37f400-6676-4a37-bf56-ca217a9e04af service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.617450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-16961b12-4213-436f-b961-b1b62473a23b req-bc37f400-6676-4a37-bf56-ca217a9e04af service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.667769 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-16961b12-4213-436f-b961-b1b62473a23b req-bc37f400-6676-4a37-bf56-ca217a9e04af service nova] Creating event network-vif-plugged:f53b385d-ad62-40bc-9e0f-d89171784dac for instance 3b9f193d-65a7-48df-96b4-ee57115149a2 on n-h1-850499-14 Oct 04 18:06:04.689976 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-16961b12-4213-436f-b961-b1b62473a23b req-bc37f400-6676-4a37-bf56-ca217a9e04af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101084 Oct 04 18:06:04.692033 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 624/1275] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:04.730172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf1785cf-a445-4029-b85f-845fd50ad4b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:04.744758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf1785cf-a445-4029-b85f-845fd50ad4b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:04.768546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1785cf-a445-4029-b85f-845fd50ad4b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.770526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1785cf-a445-4029-b85f-845fd50ad4b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.771861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1785cf-a445-4029-b85f-845fd50ad4b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.773585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1785cf-a445-4029-b85f-845fd50ad4b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.774738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1785cf-a445-4029-b85f-845fd50ad4b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.775871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1785cf-a445-4029-b85f-845fd50ad4b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.918220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bab896ed-61ba-4afa-a497-1f3f835119e5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:04.928187 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bab896ed-61ba-4afa-a497-1f3f835119e5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1471 microversion: 2.1 time: 0.618621 Oct 04 18:06:04.935301 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 652/1276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:04 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1471 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:04.956780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3b114902-34d1-48f8-a3ef-da7f35e446e5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1c9e430>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:05.107775 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3b114902-34d1-48f8-a3ef-da7f35e446e5 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.155491 Oct 04 18:06:05.109421 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 653/1277] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:04 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:05.329862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d70bf22-c5d1-4081-b831-79f1f1319044 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:05.331536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d70bf22-c5d1-4081-b831-79f1f1319044 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:05.352794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d70bf22-c5d1-4081-b831-79f1f1319044 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.353661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d70bf22-c5d1-4081-b831-79f1f1319044 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.366035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d70bf22-c5d1-4081-b831-79f1f1319044 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.379439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d70bf22-c5d1-4081-b831-79f1f1319044 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.380196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d70bf22-c5d1-4081-b831-79f1f1319044 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.381426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d70bf22-c5d1-4081-b831-79f1f1319044 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.469796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cf1785cf-a445-4029-b85f-845fd50ad4b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:05.491652 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf1785cf-a445-4029-b85f-845fd50ad4b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.772702 Oct 04 18:06:05.493142 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 625/1278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:04 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:05.961532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5a5b956-8f41-40eb-bde1-f872bb85c2b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:05.962165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a5a5b956-8f41-40eb-bde1-f872bb85c2b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:05.981899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5a5b956-8f41-40eb-bde1-f872bb85c2b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.982451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5a5b956-8f41-40eb-bde1-f872bb85c2b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.982920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5a5b956-8f41-40eb-bde1-f872bb85c2b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.983716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5a5b956-8f41-40eb-bde1-f872bb85c2b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.984186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5a5b956-8f41-40eb-bde1-f872bb85c2b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.984625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5a5b956-8f41-40eb-bde1-f872bb85c2b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.096332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d70bf22-c5d1-4081-b831-79f1f1319044 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:07.128967 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d70bf22-c5d1-4081-b831-79f1f1319044 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1470 microversion: 2.1 time: 1.797822 Oct 04 18:06:07.132186 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 654/1279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:05 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1470 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:07.144015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0f9420db-69fa-4982-aae5-041ab262e203 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e4a040>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:07.274275 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0f9420db-69fa-4982-aae5-041ab262e203 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.140783 Oct 04 18:06:07.275289 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 655/1280] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:07 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:07.299662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ca586c7-a4a2-446c-bed8-c07e27e8cc22 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:07.300947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ca586c7-a4a2-446c-bed8-c07e27e8cc22 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:07.303594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a5a5b956-8f41-40eb-bde1-f872bb85c2b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:07.319762 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a5a5b956-8f41-40eb-bde1-f872bb85c2b6 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1471 microversion: 2.1 time: 1.363277 Oct 04 18:06:07.320344 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 626/1281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:05 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1471 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:07.327274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca586c7-a4a2-446c-bed8-c07e27e8cc22 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.331702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca586c7-a4a2-446c-bed8-c07e27e8cc22 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.335894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7d756b01-26ba-4b87-bd8d-87022b18cab3 req-602d57d3-5c58-4f3d-ae34-8447959ff8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70", "name": "network-vif-plugged", "status": "completed", "tag": "c24ea2e8-e606-476d-b4d4-83e53aad9183"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:07.337087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca586c7-a4a2-446c-bed8-c07e27e8cc22 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.344247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca586c7-a4a2-446c-bed8-c07e27e8cc22 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.349321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca586c7-a4a2-446c-bed8-c07e27e8cc22 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.352046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca586c7-a4a2-446c-bed8-c07e27e8cc22 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.393929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7d756b01-26ba-4b87-bd8d-87022b18cab3 req-602d57d3-5c58-4f3d-ae34-8447959ff8e3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.394427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7d756b01-26ba-4b87-bd8d-87022b18cab3 req-602d57d3-5c58-4f3d-ae34-8447959ff8e3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.402247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7d756b01-26ba-4b87-bd8d-87022b18cab3 req-602d57d3-5c58-4f3d-ae34-8447959ff8e3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.471994 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7d756b01-26ba-4b87-bd8d-87022b18cab3 req-602d57d3-5c58-4f3d-ae34-8447959ff8e3 service nova] Creating event network-vif-plugged:c24ea2e8-e606-476d-b4d4-83e53aad9183 for instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 on n-h1-850499-14 Oct 04 18:06:07.520035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-7d756b01-26ba-4b87-bd8d-87022b18cab3 req-602d57d3-5c58-4f3d-ae34-8447959ff8e3 service nova] Instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:06:07.545893 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7d756b01-26ba-4b87-bd8d-87022b18cab3 req-602d57d3-5c58-4f3d-ae34-8447959ff8e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217998 Oct 04 18:06:07.549132 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 627/1282] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:07.574790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3ddbb4ff-053a-4d3c-bb97-0bfbae7dce47 req-5eeb550e-cfb0-417d-a0b2-17efa9e1ab5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae9ebd3-ad90-4235-a6c0-58bb69a748d4", "name": "network-vif-deleted", "tag": "9ed1f26f-430d-4158-be06-f80de6cb8a8e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:07.603892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3ddbb4ff-053a-4d3c-bb97-0bfbae7dce47 req-5eeb550e-cfb0-417d-a0b2-17efa9e1ab5e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.613554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3ddbb4ff-053a-4d3c-bb97-0bfbae7dce47 req-5eeb550e-cfb0-417d-a0b2-17efa9e1ab5e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.628552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3ddbb4ff-053a-4d3c-bb97-0bfbae7dce47 req-5eeb550e-cfb0-417d-a0b2-17efa9e1ab5e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.650735 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3ddbb4ff-053a-4d3c-bb97-0bfbae7dce47 req-5eeb550e-cfb0-417d-a0b2-17efa9e1ab5e service nova] Creating event network-vif-deleted:9ed1f26f-430d-4158-be06-f80de6cb8a8e for instance 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 on n-h2-850499-14 Oct 04 18:06:07.671512 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3ddbb4ff-053a-4d3c-bb97-0bfbae7dce47 req-5eeb550e-cfb0-417d-a0b2-17efa9e1ab5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120352 Oct 04 18:06:07.674295 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 628/1283] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:08.161942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-acc05c80-963c-405a-9f64-f8ac88761625 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.163014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-acc05c80-963c-405a-9f64-f8ac88761625 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:08.193025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acc05c80-963c-405a-9f64-f8ac88761625 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.194678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acc05c80-963c-405a-9f64-f8ac88761625 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.204740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acc05c80-963c-405a-9f64-f8ac88761625 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.207556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acc05c80-963c-405a-9f64-f8ac88761625 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.209343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acc05c80-963c-405a-9f64-f8ac88761625 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.213202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ca586c7-a4a2-446c-bed8-c07e27e8cc22 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.213815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acc05c80-963c-405a-9f64-f8ac88761625 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.216606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:08.228577 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ca586c7-a4a2-446c-bed8-c07e27e8cc22 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.949924 Oct 04 18:06:08.243777 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 656/1284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:07 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:08.290327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee8b1314-49a2-4114-a357-6d5764059872 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1b30d30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.401360 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee8b1314-49a2-4114-a357-6d5764059872 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.115476 Oct 04 18:06:08.402821 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 657/1285] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:08.427340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.428543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:08.468647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.469736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.470786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.474505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.475536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.476728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.540693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.551732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.552578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.556589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lazy-loading 'fault' on Instance uuid 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:08.651774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.660300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-516d32a1-4ed9-4bf9-bc80-d789be778bec tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 200 len: 1306 microversion: 2.1 time: 0.255960 Oct 04 18:06:08.664020 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 658/1286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 1306 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:08.749881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-acc05c80-963c-405a-9f64-f8ac88761625 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.758258 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-acc05c80-963c-405a-9f64-f8ac88761625 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1536 microversion: 2.1 time: 0.606377 Oct 04 18:06:08.758849 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 629/1287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1536 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:09.267446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b55a3a8-bf80-44bb-b7da-f29080abba27 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.268646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8b55a3a8-bf80-44bb-b7da-f29080abba27 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:09.285938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b55a3a8-bf80-44bb-b7da-f29080abba27 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.286706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b55a3a8-bf80-44bb-b7da-f29080abba27 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.287408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b55a3a8-bf80-44bb-b7da-f29080abba27 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.288870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b55a3a8-bf80-44bb-b7da-f29080abba27 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.289547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b55a3a8-bf80-44bb-b7da-f29080abba27 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.290187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b55a3a8-bf80-44bb-b7da-f29080abba27 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.420565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b26e3712-1963-42ee-a331-cb6dffc6b09c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d1adc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.560655 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b26e3712-1963-42ee-a331-cb6dffc6b09c tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.144016 Oct 04 18:06:09.566091 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 630/1288] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:09 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:09.643458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8b55a3a8-bf80-44bb-b7da-f29080abba27 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:09.657758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b55a3a8-bf80-44bb-b7da-f29080abba27 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.394399 Oct 04 18:06:09.658843 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 659/1289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:09 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:09.690339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.691290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:09.703665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.708785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.712795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.714170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.716998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.719751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.756755 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] HTTP exception thrown: Instance 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 could not be found. Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Request method failure captured: Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 HTTP/1.1 Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVQz1NE3kt3KG8YI5JPGsVVgcaKtXMWfqZO652Lwd64gK7xXxW8N6IOJiWaDKDQte234JQs8WMYZ-8pWnAeG_wPrA92qwT23Kjj8M38B7IJrStpLdCdXdXdTYLJkLUyRJVdWRBn7Gi8Joyy3ehbo_nPv9n5KK9mydgSN-yLd-WOaiQ Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:06:09.760444 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}] Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d5e7c7c7826b4660acf4a4276c3e829c Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 could not be found. Oct 04 18:06:09.762101 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '9ae9ebd3-ad90-4235-a6c0-58bb69a748d4'} Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 could not be found. Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:09.763715 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 could not be found. Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 could not be found. Oct 04 18:06:09.765741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:09.768855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Returning 404 to user: Instance 9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:09.769966 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2d80e6b2-b7ea-4214-9e79-5a84e5776091 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4" status: 404 len: 111 microversion: 2.1 time: 0.084163 Oct 04 18:06:09.774287 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 631/1290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:09 2022] GET /compute/v2.1/servers/9ae9ebd3-ad90-4235-a6c0-58bb69a748d4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:09.781902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6fb7591e-d9bc-4967-8806-85103a1d0479 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.782514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6fb7591e-d9bc-4967-8806-85103a1d0479 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: cd85fc2b-0943-4616-8b69-f8e5825e400a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:09.792521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb7591e-d9bc-4967-8806-85103a1d0479 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.794752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d075b59-df7b-4c9d-bf6a-bd538e1a8004 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.795477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb7591e-d9bc-4967-8806-85103a1d0479 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.796047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9d075b59-df7b-4c9d-bf6a-bd538e1a8004 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:09.796333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb7591e-d9bc-4967-8806-85103a1d0479 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.797311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb7591e-d9bc-4967-8806-85103a1d0479 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.800865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb7591e-d9bc-4967-8806-85103a1d0479 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.801565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fb7591e-d9bc-4967-8806-85103a1d0479 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.806105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d075b59-df7b-4c9d-bf6a-bd538e1a8004 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.807034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d075b59-df7b-4c9d-bf6a-bd538e1a8004 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.807940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d075b59-df7b-4c9d-bf6a-bd538e1a8004 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.808851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d075b59-df7b-4c9d-bf6a-bd538e1a8004 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.809648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d075b59-df7b-4c9d-bf6a-bd538e1a8004 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.810286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d075b59-df7b-4c9d-bf6a-bd538e1a8004 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.868128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6fb7591e-d9bc-4967-8806-85103a1d0479 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: cd85fc2b-0943-4616-8b69-f8e5825e400a] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:10.213377 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6fb7591e-d9bc-4967-8806-85103a1d0479 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a" status: 204 len: 0 microversion: 2.1 time: 0.437690 Oct 04 18:06:10.214012 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 660/1291] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:09 2022] DELETE /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:10.232720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac9ebd2b-5642-49a5-962f-a1573b916baf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:10.237594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac9ebd2b-5642-49a5-962f-a1573b916baf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:10.253879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac9ebd2b-5642-49a5-962f-a1573b916baf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.254376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac9ebd2b-5642-49a5-962f-a1573b916baf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.254815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac9ebd2b-5642-49a5-962f-a1573b916baf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.265437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac9ebd2b-5642-49a5-962f-a1573b916baf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.266829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac9ebd2b-5642-49a5-962f-a1573b916baf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.267316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac9ebd2b-5642-49a5-962f-a1573b916baf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.298616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9d075b59-df7b-4c9d-bf6a-bd538e1a8004 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:10.309704 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9d075b59-df7b-4c9d-bf6a-bd538e1a8004 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1536 microversion: 2.1 time: 0.525005 Oct 04 18:06:10.314392 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 632/1292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:09 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1536 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:10.365745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac9ebd2b-5642-49a5-962f-a1573b916baf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:10.564847 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac9ebd2b-5642-49a5-962f-a1573b916baf tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "DELETE /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 204 len: 0 microversion: 2.1 time: 0.342917 Oct 04 18:06:10.569230 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 661/1293] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:10 2022] DELETE /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:10.576442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3f28cda0-e9a4-4332-b7c7-43c98e7b6839 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:10.577073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3f28cda0-e9a4-4332-b7c7-43c98e7b6839 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: cd85fc2b-0943-4616-8b69-f8e5825e400a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:10.582011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c424b2bd-2ac1-426e-a38e-f98c846aa5d1 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1b41700>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:10.593719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f28cda0-e9a4-4332-b7c7-43c98e7b6839 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.594233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f28cda0-e9a4-4332-b7c7-43c98e7b6839 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.594683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f28cda0-e9a4-4332-b7c7-43c98e7b6839 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.595449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f28cda0-e9a4-4332-b7c7-43c98e7b6839 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.595916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f28cda0-e9a4-4332-b7c7-43c98e7b6839 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.596349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f28cda0-e9a4-4332-b7c7-43c98e7b6839 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.678560 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c424b2bd-2ac1-426e-a38e-f98c846aa5d1 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.102251 Oct 04 18:06:10.680168 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 662/1294] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:10 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:10.691684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5e6567c6-64c5-4f37-8721-b05663377fdf req-2d4619f7-69f5-43b5-bc1f-9074b06608ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70", "name": "network-vif-unplugged", "status": "completed", "tag": "c24ea2e8-e606-476d-b4d4-83e53aad9183"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:10.724576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5e6567c6-64c5-4f37-8721-b05663377fdf req-2d4619f7-69f5-43b5-bc1f-9074b06608ab service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.725422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5e6567c6-64c5-4f37-8721-b05663377fdf req-2d4619f7-69f5-43b5-bc1f-9074b06608ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.728501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5e6567c6-64c5-4f37-8721-b05663377fdf req-2d4619f7-69f5-43b5-bc1f-9074b06608ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.753809 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5e6567c6-64c5-4f37-8721-b05663377fdf req-2d4619f7-69f5-43b5-bc1f-9074b06608ab service nova] Creating event network-vif-unplugged:c24ea2e8-e606-476d-b4d4-83e53aad9183 for instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 on n-h1-850499-14 Oct 04 18:06:10.771345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-5e6567c6-64c5-4f37-8721-b05663377fdf req-2d4619f7-69f5-43b5-bc1f-9074b06608ab service nova] Instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:06:10.784389 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5e6567c6-64c5-4f37-8721-b05663377fdf req-2d4619f7-69f5-43b5-bc1f-9074b06608ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100744 Oct 04 18:06:10.787354 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 663/1295] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:10.798697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0cbb46f5-ff06-4193-b465-222033a51811 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:10.799461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0cbb46f5-ff06-4193-b465-222033a51811 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:10.815359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbb46f5-ff06-4193-b465-222033a51811 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.820354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbb46f5-ff06-4193-b465-222033a51811 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.822636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbb46f5-ff06-4193-b465-222033a51811 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.823815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbb46f5-ff06-4193-b465-222033a51811 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.838345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbb46f5-ff06-4193-b465-222033a51811 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.839066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbb46f5-ff06-4193-b465-222033a51811 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.023957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3f28cda0-e9a4-4332-b7c7-43c98e7b6839 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.032984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3f28cda0-e9a4-4332-b7c7-43c98e7b6839 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a" status: 200 len: 1473 microversion: 2.1 time: 0.462090 Oct 04 18:06:11.037463 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 633/1296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:10 2022] GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a => generated 1473 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:11.287092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0cbb46f5-ff06-4193-b465-222033a51811 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.312174 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0cbb46f5-ff06-4193-b465-222033a51811 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.520704 Oct 04 18:06:11.313568 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 664/1297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:10 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:11.336968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-141b6667-13b1-4cd9-a9f0-a23be4bbf14e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.337848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-141b6667-13b1-4cd9-a9f0-a23be4bbf14e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:11.343870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b1f83c5-904d-4467-bc4c-a53eafc22c9e tempest-InstanceUsageAuditLogNegativeTestJSON-126704691 tempest-InstanceUsageAuditLogNegativeTestJSON-126704691-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.348472 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-9b1f83c5-904d-4467-bc4c-a53eafc22c9e tempest-InstanceUsageAuditLogNegativeTestJSON-126704691 tempest-InstanceUsageAuditLogNegativeTestJSON-126704691-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 18:06:11.359444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-141b6667-13b1-4cd9-a9f0-a23be4bbf14e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.360223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-141b6667-13b1-4cd9-a9f0-a23be4bbf14e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.360854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-141b6667-13b1-4cd9-a9f0-a23be4bbf14e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.361749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-141b6667-13b1-4cd9-a9f0-a23be4bbf14e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.362388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-141b6667-13b1-4cd9-a9f0-a23be4bbf14e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.363533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-141b6667-13b1-4cd9-a9f0-a23be4bbf14e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b1f83c5-904d-4467-bc4c-a53eafc22c9e tempest-InstanceUsageAuditLogNegativeTestJSON-126704691 tempest-InstanceUsageAuditLogNegativeTestJSON-126704691-project-admin] Request method failure captured: Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYSx5j0NYNevOb1fxAaxXquFfQsmbl8WQpo_lpi3VnaYN8LdXBxltI2LmP0TKqDi-KgAP8eSNzYLW3slYl92wVDrZQUm-hbU-uSdX1Gk0lJwjcdrAFFoVeSpcG1UmWY1Jx8QY5iIEeA_vVBVjtYXqYvfGgY_JK2N3xpd-Uf4ckqyOA Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 709ab5b698f249609e226f2148d5b48c Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-126704691 Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:06:11.372611 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_709ab5b698f249609e226f2148d5b48c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/709ab5b698f249609e226f2148d5b48c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/709ab5b698f249609e226f2148d5b48c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/709ab5b698f249609e226f2148d5b48c"}]}] Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-126704691 Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 709ab5b698f249609e226f2148d5b48c Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-126704691 Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-126704691-project-admin Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1645df461170439b832cf4fa67edcd24 Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-126704691-project-admin Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:06:11.374349 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid timestamp for date invalid_time Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'invalid_time'} Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:11.375329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 18:06:11.376805 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.378558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b1f83c5-904d-4467-bc4c-a53eafc22c9e tempest-InstanceUsageAuditLogNegativeTestJSON-126704691 tempest-InstanceUsageAuditLogNegativeTestJSON-126704691-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:11.379621 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b1f83c5-904d-4467-bc4c-a53eafc22c9e tempest-InstanceUsageAuditLogNegativeTestJSON-126704691 tempest-InstanceUsageAuditLogNegativeTestJSON-126704691-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.253803 Oct 04 18:06:11.380344 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 634/1298] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:06:11.566397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbf2ce7c-a473-4c1e-bb66-b921823b461f tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.568488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bbf2ce7c-a473-4c1e-bb66-b921823b461f tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '20a05478341c4469a5e9dbc83c040d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2812fbbd66f4a7189b02fc3257a0829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbf2ce7c-a473-4c1e-bb66-b921823b461f tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project] Request method failure captured: Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYRePofy0KC64ws0br8kbtwk4NaS8GYfK5YtuElqORPF-OcKPWO9awVYBeSEFmo0K-rxqIwX7PE8yR6OTvLCucrNuxlO4zyvmbRyYw1qiUl5kVSO3MGVqGXGGtWa71EyVWqh9oYDQQ45xj-S9i6Ig2tMwmhNGV9-jB2JqpkY1VtjPk Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: a2812fbbd66f4a7189b02fc3257a0829 Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:06:11.571643 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:06:11.573181 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a2812fbbd66f4a7189b02fc3257a0829"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a2812fbbd66f4a7189b02fc3257a0829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2812fbbd66f4a7189b02fc3257a0829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2812fbbd66f4a7189b02fc3257a0829"}]}] Oct 04 18:06:11.573181 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 Oct 04 18:06:11.573181 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: a2812fbbd66f4a7189b02fc3257a0829 Oct 04 18:06:11.573181 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 Oct 04 18:06:11.573181 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project Oct 04 18:06:11.573181 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:11.573181 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:11.573181 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 20a05478341c4469a5e9dbc83c040d11 Oct 04 18:06:11.573181 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project Oct 04 18:06:11.573181 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: action_args: {} Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:06:11.573837 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:06:11.575177 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.577242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbf2ce7c-a473-4c1e-bb66-b921823b461f tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:11.580050 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bbf2ce7c-a473-4c1e-bb66-b921823b461f tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.193723 Oct 04 18:06:11.582816 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 635/1299] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 197 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:11.607496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1a0edfd-c88a-4b2c-be1f-005a82cdf386 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.609400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1a0edfd-c88a-4b2c-be1f-005a82cdf386 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '20a05478341c4469a5e9dbc83c040d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2812fbbd66f4a7189b02fc3257a0829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1a0edfd-c88a-4b2c-be1f-005a82cdf386 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project] Request method failure captured: Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018:06:11 HTTP/1.1 Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYRePofy0KC64ws0br8kbtwk4NaS8GYfK5YtuElqORPF-OcKPWO9awVYBeSEFmo0K-rxqIwX7PE8yR6OTvLCucrNuxlO4zyvmbRyYw1qiUl5kVSO3MGVqGXGGtWa71EyVWqh9oYDQQ45xj-S9i6Ig2tMwmhNGV9-jB2JqpkY1VtjPk Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: a2812fbbd66f4a7189b02fc3257a0829 Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:06:11.611155 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:06:11.612489 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a2812fbbd66f4a7189b02fc3257a0829"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a2812fbbd66f4a7189b02fc3257a0829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2812fbbd66f4a7189b02fc3257a0829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a2812fbbd66f4a7189b02fc3257a0829"}]}] Oct 04 18:06:11.612489 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 Oct 04 18:06:11.612489 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: a2812fbbd66f4a7189b02fc3257a0829 Oct 04 18:06:11.612489 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 Oct 04 18:06:11.612489 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project Oct 04 18:06:11.612489 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:11.612489 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:11.612489 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 20a05478341c4469a5e9dbc83c040d11 Oct 04 18:06:11.612489 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project Oct 04 18:06:11.612489 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '2022-10-04 18:06:11'} Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:06:11.613106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:06:11.614525 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:11.617539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1a0edfd-c88a-4b2c-be1f-005a82cdf386 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:11.617539 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1a0edfd-c88a-4b2c-be1f-005a82cdf386 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842 tempest-InstanceUsageAuditLogNegativeTestJSON-578438842-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 18:06:11" status: 403 len: 128 microversion: 2.1 time: 0.023047 Oct 04 18:06:11.617539 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 636/1300] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018%3A06%3A11 => generated 128 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:06:11.695080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0102e94d-a7d4-4c52-b23f-dbad8a083270 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e7e550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.709557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-141b6667-13b1-4cd9-a9f0-a23be4bbf14e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.718813 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-141b6667-13b1-4cd9-a9f0-a23be4bbf14e tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1536 microversion: 2.1 time: 0.387735 Oct 04 18:06:11.719454 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 665/1301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1536 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:11.856403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0102e94d-a7d4-4c52-b23f-dbad8a083270 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.159583 Oct 04 18:06:11.862618 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 637/1302] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:12.066454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-09fbb5f9-66a5-4b99-8738-89ab36218e7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.068817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-09fbb5f9-66a5-4b99-8738-89ab36218e7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: cd85fc2b-0943-4616-8b69-f8e5825e400a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.086627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09fbb5f9-66a5-4b99-8738-89ab36218e7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.087879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09fbb5f9-66a5-4b99-8738-89ab36218e7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.088528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09fbb5f9-66a5-4b99-8738-89ab36218e7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.091396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09fbb5f9-66a5-4b99-8738-89ab36218e7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.093205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09fbb5f9-66a5-4b99-8738-89ab36218e7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.094829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09fbb5f9-66a5-4b99-8738-89ab36218e7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.346648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a3dac795-a6e5-44e5-a45d-da9365dc2a42 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.348437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a3dac795-a6e5-44e5-a45d-da9365dc2a42 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.357463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:12.361257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3dac795-a6e5-44e5-a45d-da9365dc2a42 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.362579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3dac795-a6e5-44e5-a45d-da9365dc2a42 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.363818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3dac795-a6e5-44e5-a45d-da9365dc2a42 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.365059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3dac795-a6e5-44e5-a45d-da9365dc2a42 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.365753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3dac795-a6e5-44e5-a45d-da9365dc2a42 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.367033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3dac795-a6e5-44e5-a45d-da9365dc2a42 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.578080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-09fbb5f9-66a5-4b99-8738-89ab36218e7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.602840 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-09fbb5f9-66a5-4b99-8738-89ab36218e7a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a" status: 200 len: 1473 microversion: 2.1 time: 0.539161 Oct 04 18:06:12.608425 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 666/1303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a => generated 1473 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:12.744826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-137e26e0-cc6a-4231-96cd-1305f40508a5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.746357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-137e26e0-cc6a-4231-96cd-1305f40508a5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.754506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a3dac795-a6e5-44e5-a45d-da9365dc2a42 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.767006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-137e26e0-cc6a-4231-96cd-1305f40508a5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.770631 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a3dac795-a6e5-44e5-a45d-da9365dc2a42 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.429757 Oct 04 18:06:12.774019 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 638/1304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:12.774576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-137e26e0-cc6a-4231-96cd-1305f40508a5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.775189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-137e26e0-cc6a-4231-96cd-1305f40508a5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.776839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-137e26e0-cc6a-4231-96cd-1305f40508a5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.784463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-137e26e0-cc6a-4231-96cd-1305f40508a5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.785353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-137e26e0-cc6a-4231-96cd-1305f40508a5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.873568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-71ae281f-e049-4fcd-939d-032f3828a459 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1dd9d30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.964975 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-71ae281f-e049-4fcd-939d-032f3828a459 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.093443 Oct 04 18:06:12.966204 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 639/1305] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:13.123299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-137e26e0-cc6a-4231-96cd-1305f40508a5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.134404 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-137e26e0-cc6a-4231-96cd-1305f40508a5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1536 microversion: 2.1 time: 0.394282 Oct 04 18:06:13.135639 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 667/1306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1536 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:13.635022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b8bf2266-33e0-415f-a478-268ac4410669 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.636520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b8bf2266-33e0-415f-a478-268ac4410669 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: cd85fc2b-0943-4616-8b69-f8e5825e400a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:13.657307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8bf2266-33e0-415f-a478-268ac4410669 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.657823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8bf2266-33e0-415f-a478-268ac4410669 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.660769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8bf2266-33e0-415f-a478-268ac4410669 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.662530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8bf2266-33e0-415f-a478-268ac4410669 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.665284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8bf2266-33e0-415f-a478-268ac4410669 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.665952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8bf2266-33e0-415f-a478-268ac4410669 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.805300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-14230f15-177c-49bf-83f0-5ad0080dcef9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.805920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-14230f15-177c-49bf-83f0-5ad0080dcef9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:13.824643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14230f15-177c-49bf-83f0-5ad0080dcef9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.837942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14230f15-177c-49bf-83f0-5ad0080dcef9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.838732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14230f15-177c-49bf-83f0-5ad0080dcef9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.839705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14230f15-177c-49bf-83f0-5ad0080dcef9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.843900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14230f15-177c-49bf-83f0-5ad0080dcef9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.845373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14230f15-177c-49bf-83f0-5ad0080dcef9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.177942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-14230f15-177c-49bf-83f0-5ad0080dcef9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.196470 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-14230f15-177c-49bf-83f0-5ad0080dcef9 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.398499 Oct 04 18:06:14.201017 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 668/1307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:14.206261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-deb5cd44-912b-472a-b464-112b7128c107 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1b22940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:14.295957 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-deb5cd44-912b-472a-b464-112b7128c107 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.093474 Oct 04 18:06:14.298273 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 669/1308] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:14 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:14.310748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b8bf2266-33e0-415f-a478-268ac4410669 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.313019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-925e04fe-ebe7-4e89-875c-4982f5e37996 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:14.317435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-925e04fe-ebe7-4e89-875c-4982f5e37996 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:14.339874 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b8bf2266-33e0-415f-a478-268ac4410669 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a" status: 200 len: 1473 microversion: 2.1 time: 0.712526 Oct 04 18:06:14.347506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-925e04fe-ebe7-4e89-875c-4982f5e37996 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.349181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-925e04fe-ebe7-4e89-875c-4982f5e37996 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.350366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-925e04fe-ebe7-4e89-875c-4982f5e37996 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.351867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-925e04fe-ebe7-4e89-875c-4982f5e37996 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.352518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-925e04fe-ebe7-4e89-875c-4982f5e37996 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.355936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-925e04fe-ebe7-4e89-875c-4982f5e37996 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.361160 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 640/1309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a => generated 1473 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:14.923220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-925e04fe-ebe7-4e89-875c-4982f5e37996 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.944085 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-925e04fe-ebe7-4e89-875c-4982f5e37996 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1529 microversion: 2.1 time: 0.636668 Oct 04 18:06:14.947006 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 670/1310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:14 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1529 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:14.973931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a53a9db-a113-484a-9109-38353fd2e562 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:14.974705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3a53a9db-a113-484a-9109-38353fd2e562 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:14.998227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a53a9db-a113-484a-9109-38353fd2e562 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.999470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a53a9db-a113-484a-9109-38353fd2e562 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.001296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a53a9db-a113-484a-9109-38353fd2e562 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.004644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a53a9db-a113-484a-9109-38353fd2e562 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.006619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a53a9db-a113-484a-9109-38353fd2e562 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.008692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a53a9db-a113-484a-9109-38353fd2e562 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.015361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:15.231708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-95d1d07e-ea15-4466-b1bb-121ef8cf9e57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:15.232438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-95d1d07e-ea15-4466-b1bb-121ef8cf9e57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:15.255780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95d1d07e-ea15-4466-b1bb-121ef8cf9e57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.257715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95d1d07e-ea15-4466-b1bb-121ef8cf9e57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.258419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95d1d07e-ea15-4466-b1bb-121ef8cf9e57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.260441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95d1d07e-ea15-4466-b1bb-121ef8cf9e57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.262073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95d1d07e-ea15-4466-b1bb-121ef8cf9e57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.262714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95d1d07e-ea15-4466-b1bb-121ef8cf9e57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.614461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95d1d07e-ea15-4466-b1bb-121ef8cf9e57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:15.633105 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-95d1d07e-ea15-4466-b1bb-121ef8cf9e57 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.408038 Oct 04 18:06:15.647969 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 671/1311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:15 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:15.659316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-25b2a933-866c-4210-8471-15f12b116032 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1b41af0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:15.739710 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-25b2a933-866c-4210-8471-15f12b116032 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.090318 Oct 04 18:06:15.740715 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 672/1312] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:15 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:15.755531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-baf5dc14-e3f1-4f5c-ace5-cdb616f35449 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:15.756394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-baf5dc14-e3f1-4f5c-ace5-cdb616f35449 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: cd85fc2b-0943-4616-8b69-f8e5825e400a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:15.764904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-baf5dc14-e3f1-4f5c-ace5-cdb616f35449 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.765735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-baf5dc14-e3f1-4f5c-ace5-cdb616f35449 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.766437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-baf5dc14-e3f1-4f5c-ace5-cdb616f35449 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.767379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-baf5dc14-e3f1-4f5c-ace5-cdb616f35449 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.768265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-baf5dc14-e3f1-4f5c-ace5-cdb616f35449 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.769060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-baf5dc14-e3f1-4f5c-ace5-cdb616f35449 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.143913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3a53a9db-a113-484a-9109-38353fd2e562 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.172229 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a53a9db-a113-484a-9109-38353fd2e562 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1529 microversion: 2.1 time: 1.195458 Oct 04 18:06:16.176787 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 641/1313] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:14 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1529 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:16.197365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-baf5dc14-e3f1-4f5c-ace5-cdb616f35449 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.199947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-51a69a94-4819-4902-8cad-685bac085af3 req-30a4a212-8971-4c10-9893-e55f8d63832e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587dc93d-6601-457a-b25d-8b88eb79ab15", "name": "network-vif-deleted", "tag": "9cac6fd6-3881-4d94-b5ec-b76381ebf1d6"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:16.209471 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-baf5dc14-e3f1-4f5c-ace5-cdb616f35449 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a" status: 200 len: 1431 microversion: 2.1 time: 0.464688 Oct 04 18:06:16.212873 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 673/1314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:15 2022] GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a => generated 1431 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:16.224876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d34d4b89-5d06-4dc4-ad84-e08991f245fa req-f5428252-df71-4451-b01f-6618281a5c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70", "name": "network-vif-plugged", "status": "completed", "tag": "c24ea2e8-e606-476d-b4d4-83e53aad9183"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:16.248384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d34d4b89-5d06-4dc4-ad84-e08991f245fa req-f5428252-df71-4451-b01f-6618281a5c85 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.249313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d34d4b89-5d06-4dc4-ad84-e08991f245fa req-f5428252-df71-4451-b01f-6618281a5c85 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.251525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d34d4b89-5d06-4dc4-ad84-e08991f245fa req-f5428252-df71-4451-b01f-6618281a5c85 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.263714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51a69a94-4819-4902-8cad-685bac085af3 req-30a4a212-8971-4c10-9893-e55f8d63832e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.264346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51a69a94-4819-4902-8cad-685bac085af3 req-30a4a212-8971-4c10-9893-e55f8d63832e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.269480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51a69a94-4819-4902-8cad-685bac085af3 req-30a4a212-8971-4c10-9893-e55f8d63832e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.277095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:16.283930 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d34d4b89-5d06-4dc4-ad84-e08991f245fa req-f5428252-df71-4451-b01f-6618281a5c85 service nova] Creating event network-vif-plugged:c24ea2e8-e606-476d-b4d4-83e53aad9183 for instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 on n-h1-850499-14 Oct 04 18:06:16.298105 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d34d4b89-5d06-4dc4-ad84-e08991f245fa req-f5428252-df71-4451-b01f-6618281a5c85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081918 Oct 04 18:06:16.299363 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 674/1315] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:16.307656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-18a4bef6-edfb-4c21-b59d-471a906f071f tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.320131 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-51a69a94-4819-4902-8cad-685bac085af3 req-30a4a212-8971-4c10-9893-e55f8d63832e service nova] Creating event network-vif-deleted:9cac6fd6-3881-4d94-b5ec-b76381ebf1d6 for instance 587dc93d-6601-457a-b25d-8b88eb79ab15 on n-h2-850499-14 Oct 04 18:06:16.328266 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-18a4bef6-edfb-4c21-b59d-471a906f071f tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] HTTP exception thrown: Flavor e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9 could not be found. Oct 04 18:06:16.334539 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-51a69a94-4819-4902-8cad-685bac085af3 req-30a4a212-8971-4c10-9893-e55f8d63832e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154382 Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-18a4bef6-edfb-4c21-b59d-471a906f071f tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Request method failure captured: Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/flavors/e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9 HTTP/1.1 Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUhBAkZgU-FFvpICptv3XmJrWb8ajkvKo_9ItPBuUJxeK0pevHneK8APq4ucWV15mLyC74XWnzI2KBzpp5CStuNgYFuGVzloYlBedtfDdK1uY5wIYPOD3JWLcrrfbg5bkyzZulsNuAjgt4mQFLBdGbboFfkQYQvT9ACfjv6EHJl98U Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 601e148e2e0d4b25b3d2603006aa729d Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-MigrationsAdminTest-6322720 Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:06:16.336290 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_601e148e2e0d4b25b3d2603006aa729d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/601e148e2e0d4b25b3d2603006aa729d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/601e148e2e0d4b25b3d2603006aa729d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/601e148e2e0d4b25b3d2603006aa729d"}]}] Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-MigrationsAdminTest-6322720 Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 601e148e2e0d4b25b3d2603006aa729d Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-MigrationsAdminTest-6322720 Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-MigrationsAdminTest-6322720-project-admin Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e6e24f05339f436f8828a49f3d305a0d Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-MigrationsAdminTest-6322720-project-admin Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: exception: Flavor e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9 could not be found. Oct 04 18:06:16.337894 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9'} Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9 could not be found. Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.338804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9 could not be found. Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9 could not be found. Oct 04 18:06:16.340985 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.342383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-18a4bef6-edfb-4c21-b59d-471a906f071f tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Returning 404 to user: Flavor e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:16.342383 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-18a4bef6-edfb-4c21-b59d-471a906f071f tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9" status: 404 len: 109 microversion: 2.1 time: 0.037176 Oct 04 18:06:16.344483 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 642/1316] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:16.369674 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 675/1317] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:16 2022] DELETE /compute/v2.1/flavors/e9c092f6-3ae7-47ee-ae03-1ebe48d3cdf9 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:16.607681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1489213256", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:16.664264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de165279-960c-4a10-a190-a2db15661c9b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.665012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-de165279-960c-4a10-a190-a2db15661c9b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.683825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de165279-960c-4a10-a190-a2db15661c9b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.688405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de165279-960c-4a10-a190-a2db15661c9b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.691931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de165279-960c-4a10-a190-a2db15661c9b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.692727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de165279-960c-4a10-a190-a2db15661c9b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.698198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de165279-960c-4a10-a190-a2db15661c9b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.698557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de165279-960c-4a10-a190-a2db15661c9b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.778654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:17.839500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de165279-960c-4a10-a190-a2db15661c9b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.849612 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de165279-960c-4a10-a190-a2db15661c9b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 1.190183 Oct 04 18:06:17.850808 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 676/1318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:16 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:17.855688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05068497-ab01-46d5-947f-509c2a1c29c0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1acb820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.923882 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-05068497-ab01-46d5-947f-509c2a1c29c0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.071609 Oct 04 18:06:17.924474 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 677/1319] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:17.935791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.936813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: cd85fc2b-0943-4616-8b69-f8e5825e400a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.962641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.963185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.963637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.964352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.964809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.965318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.014930 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] HTTP exception thrown: Instance cd85fc2b-0943-4616-8b69-f8e5825e400a could not be found. Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Request method failure captured: Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a HTTP/1.1 Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHVQz1NE3kt3KG8YI5JPGsVVgcaKtXMWfqZO652Lwd64gK7xXxW8N6IOJiWaDKDQte234JQs8WMYZ-8pWnAeG_wPrA92qwT23Kjj8M38B7IJrStpLdCdXdXdTYLJkLUyRJVdWRBn7Gi8Joyy3ehbo_nPv9n5KK9mydgSN-yLd-WOaiQ Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:06:18.025544 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}] Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: d5e7c7c7826b4660acf4a4276c3e829c Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance cd85fc2b-0943-4616-8b69-f8e5825e400a could not be found. Oct 04 18:06:18.027008 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'cd85fc2b-0943-4616-8b69-f8e5825e400a'} Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd85fc2b-0943-4616-8b69-f8e5825e400a could not be found. Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:18.027804 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd85fc2b-0943-4616-8b69-f8e5825e400a could not be found. Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd85fc2b-0943-4616-8b69-f8e5825e400a could not be found. Oct 04 18:06:18.029095 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.030265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Returning 404 to user: Instance cd85fc2b-0943-4616-8b69-f8e5825e400a could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:18.030265 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-411d76e2-eeb9-4661-b8de-2a2dbabcf8a5 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a" status: 404 len: 111 microversion: 2.1 time: 0.104070 Oct 04 18:06:18.032331 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 678/1320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/servers/cd85fc2b-0943-4616-8b69-f8e5825e400a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:18.067936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.076109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: 587dc93d-6601-457a-b25d-8b88eb79ab15] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.096969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.099683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.100919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.109323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.109829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.110276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.160606 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] HTTP exception thrown: Instance 587dc93d-6601-457a-b25d-8b88eb79ab15 could not be found. Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Request method failure captured: Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 HTTP/1.1 Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHVQz1NE3kt3KG8YI5JPGsVVgcaKtXMWfqZO652Lwd64gK7xXxW8N6IOJiWaDKDQte234JQs8WMYZ-8pWnAeG_wPrA92qwT23Kjj8M38B7IJrStpLdCdXdXdTYLJkLUyRJVdWRBn7Gi8Joyy3ehbo_nPv9n5KK9mydgSN-yLd-WOaiQ Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:06:18.162158 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}] Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: d5e7c7c7826b4660acf4a4276c3e829c Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 587dc93d-6601-457a-b25d-8b88eb79ab15 could not be found. Oct 04 18:06:18.164401 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '587dc93d-6601-457a-b25d-8b88eb79ab15'} Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587dc93d-6601-457a-b25d-8b88eb79ab15 could not be found. Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:18.168233 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587dc93d-6601-457a-b25d-8b88eb79ab15 could not be found. Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587dc93d-6601-457a-b25d-8b88eb79ab15 could not be found. Oct 04 18:06:18.170050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.171454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Returning 404 to user: Instance 587dc93d-6601-457a-b25d-8b88eb79ab15 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:18.171454 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49884b13-dd48-4b29-80fc-28e10fc93a46 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15" status: 404 len: 111 microversion: 2.1 time: 0.119514 Oct 04 18:06:18.176149 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 679/1321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/servers/587dc93d-6601-457a-b25d-8b88eb79ab15 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:18.187995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-86ae4fdf-3794-4d03-b391-149a498ff9e8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.248085 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-86ae4fdf-3794-4d03-b391-149a498ff9e8 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/ac2be6be-9103-49c4-9b7e-c4eba285ae5c" status: 204 len: 0 microversion: 2.1 time: 0.071228 Oct 04 18:06:18.253005 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 680/1322] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:06:18 2022] DELETE /compute/v2.1/os-server-groups/ac2be6be-9103-49c4-9b7e-c4eba285ae5c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:18.260374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a17bee91-0f11-4a22-9cd2-c9cfcf0901fb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.261044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a17bee91-0f11-4a22-9cd2-c9cfcf0901fb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.269928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a17bee91-0f11-4a22-9cd2-c9cfcf0901fb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.271609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a17bee91-0f11-4a22-9cd2-c9cfcf0901fb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.272415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a17bee91-0f11-4a22-9cd2-c9cfcf0901fb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.273938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a17bee91-0f11-4a22-9cd2-c9cfcf0901fb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.274626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a17bee91-0f11-4a22-9cd2-c9cfcf0901fb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.275356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a17bee91-0f11-4a22-9cd2-c9cfcf0901fb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.300439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:18.300988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:18.301547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:18.302177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:18.302600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:18.335076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.336047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.341274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.343371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.345184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.347525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.401979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:18.410083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Getting quotas for user d7458740d4be4cedaa01bea94ba992d2 and project 31d6eb30af1d4b6fa2955cb3cdeae3ee. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:18.426037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:18.429448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:18.512740 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f8da0d17-5e62-41d7-a36f-8a951171d351 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.908269 Oct 04 18:06:18.515571 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 643/1323] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:18.734617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a17bee91-0f11-4a22-9cd2-c9cfcf0901fb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:18.778528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ff69e7d3-3115-49cc-911d-71e0e94dc6bd req-96b0c085-dc5d-44f7-87b4-1162e6b16f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd85fc2b-0943-4616-8b69-f8e5825e400a", "name": "network-vif-deleted", "tag": "fc1d34ff-022f-4682-b2ba-b4f782843867"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:18.799738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ff69e7d3-3115-49cc-911d-71e0e94dc6bd req-96b0c085-dc5d-44f7-87b4-1162e6b16f31 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.800518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ff69e7d3-3115-49cc-911d-71e0e94dc6bd req-96b0c085-dc5d-44f7-87b4-1162e6b16f31 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.801179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ff69e7d3-3115-49cc-911d-71e0e94dc6bd req-96b0c085-dc5d-44f7-87b4-1162e6b16f31 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.820269 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ff69e7d3-3115-49cc-911d-71e0e94dc6bd req-96b0c085-dc5d-44f7-87b4-1162e6b16f31 service nova] Creating event network-vif-deleted:fc1d34ff-022f-4682-b2ba-b4f782843867 for instance cd85fc2b-0943-4616-8b69-f8e5825e400a on n-h1-850499-14 Oct 04 18:06:18.828489 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ff69e7d3-3115-49cc-911d-71e0e94dc6bd req-96b0c085-dc5d-44f7-87b4-1162e6b16f31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311198 Oct 04 18:06:18.829805 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 644/1324] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:18.863398 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a17bee91-0f11-4a22-9cd2-c9cfcf0901fb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 204 len: 0 microversion: 2.1 time: 0.605737 Oct 04 18:06:18.869519 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 681/1325] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:18 2022] DELETE /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:18.872720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2013090d-9ca3-4941-8549-c88df91cb7a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.875458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2013090d-9ca3-4941-8549-c88df91cb7a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.884760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2076def-277c-472d-bc90-0cb4ec74339e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.887893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2076def-277c-472d-bc90-0cb4ec74339e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.902936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2076def-277c-472d-bc90-0cb4ec74339e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.905175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2076def-277c-472d-bc90-0cb4ec74339e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.906404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2076def-277c-472d-bc90-0cb4ec74339e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.908261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2076def-277c-472d-bc90-0cb4ec74339e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.909609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2076def-277c-472d-bc90-0cb4ec74339e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.912434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2076def-277c-472d-bc90-0cb4ec74339e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.999170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2076def-277c-472d-bc90-0cb4ec74339e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:19.054212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2013090d-9ca3-4941-8549-c88df91cb7a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.065017 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2013090d-9ca3-4941-8549-c88df91cb7a3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1213 microversion: 2.1 time: 0.232475 Oct 04 18:06:19.065809 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 645/1326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1213 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:19.077312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42fc857e-af70-4916-989b-c1a9fb7e53ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.078626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42fc857e-af70-4916-989b-c1a9fb7e53ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:19.103364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42fc857e-af70-4916-989b-c1a9fb7e53ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.104171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42fc857e-af70-4916-989b-c1a9fb7e53ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.106207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42fc857e-af70-4916-989b-c1a9fb7e53ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.108437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42fc857e-af70-4916-989b-c1a9fb7e53ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.108956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42fc857e-af70-4916-989b-c1a9fb7e53ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.109408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42fc857e-af70-4916-989b-c1a9fb7e53ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.242107 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2076def-277c-472d-bc90-0cb4ec74339e tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 204 len: 0 microversion: 2.1 time: 0.367909 Oct 04 18:06:19.242107 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 682/1327] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:18 2022] DELETE /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:19.251065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d94e105c-d836-4289-b264-f39c9f418b2e tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1b110d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.328664 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d94e105c-d836-4289-b264-f39c9f418b2e tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.083660 Oct 04 18:06:19.329717 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 683/1328] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:19 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:19.336978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0249c2c2-944a-4f2d-8d65-89a3bfc7f8d2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.338772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0249c2c2-944a-4f2d-8d65-89a3bfc7f8d2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:19.347225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0249c2c2-944a-4f2d-8d65-89a3bfc7f8d2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.347971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0249c2c2-944a-4f2d-8d65-89a3bfc7f8d2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.348668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0249c2c2-944a-4f2d-8d65-89a3bfc7f8d2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.349548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0249c2c2-944a-4f2d-8d65-89a3bfc7f8d2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.350256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0249c2c2-944a-4f2d-8d65-89a3bfc7f8d2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.352094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0249c2c2-944a-4f2d-8d65-89a3bfc7f8d2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.381003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-42fc857e-af70-4916-989b-c1a9fb7e53ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.391337 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42fc857e-af70-4916-989b-c1a9fb7e53ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.323515 Oct 04 18:06:19.408533 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 646/1329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:19 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:19.627739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0249c2c2-944a-4f2d-8d65-89a3bfc7f8d2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.638919 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0249c2c2-944a-4f2d-8d65-89a3bfc7f8d2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 200 len: 1474 microversion: 2.1 time: 0.308007 Oct 04 18:06:19.640120 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 684/1330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:19 2022] GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 1474 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:20.103142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90b37355-4862-4274-85be-7bf22615c00a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:20.104073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90b37355-4862-4274-85be-7bf22615c00a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:20.119116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b37355-4862-4274-85be-7bf22615c00a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.122331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b37355-4862-4274-85be-7bf22615c00a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.123084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b37355-4862-4274-85be-7bf22615c00a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.124053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b37355-4862-4274-85be-7bf22615c00a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.127186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b37355-4862-4274-85be-7bf22615c00a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.129089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b37355-4862-4274-85be-7bf22615c00a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.262779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90b37355-4862-4274-85be-7bf22615c00a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:20.274707 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90b37355-4862-4274-85be-7bf22615c00a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1217 microversion: 2.1 time: 0.189829 Oct 04 18:06:20.276024 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 647/1331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:20 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:20.345334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-83906ffc-ec0e-404b-8b4f-a329b0388341 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1b11ee0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:20.416471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e24bd9e8-27c4-467f-9bc7-c8d7fd9d99a4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:20.417096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e24bd9e8-27c4-467f-9bc7-c8d7fd9d99a4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:20.418915 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-83906ffc-ec0e-404b-8b4f-a329b0388341 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.077404 Oct 04 18:06:20.420097 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 685/1332] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:20 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:20.429951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e24bd9e8-27c4-467f-9bc7-c8d7fd9d99a4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.436687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e24bd9e8-27c4-467f-9bc7-c8d7fd9d99a4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.436687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e24bd9e8-27c4-467f-9bc7-c8d7fd9d99a4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.436687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e24bd9e8-27c4-467f-9bc7-c8d7fd9d99a4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.436687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e24bd9e8-27c4-467f-9bc7-c8d7fd9d99a4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.437132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e24bd9e8-27c4-467f-9bc7-c8d7fd9d99a4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.667068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ecd4c39-c17c-47bd-9a12-c1c96bcbaef3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:20.667980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ecd4c39-c17c-47bd-9a12-c1c96bcbaef3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:20.676777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecd4c39-c17c-47bd-9a12-c1c96bcbaef3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.677559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecd4c39-c17c-47bd-9a12-c1c96bcbaef3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.678161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecd4c39-c17c-47bd-9a12-c1c96bcbaef3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.678443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e24bd9e8-27c4-467f-9bc7-c8d7fd9d99a4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:20.679963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecd4c39-c17c-47bd-9a12-c1c96bcbaef3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.680752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecd4c39-c17c-47bd-9a12-c1c96bcbaef3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.681439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecd4c39-c17c-47bd-9a12-c1c96bcbaef3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.690571 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e24bd9e8-27c4-467f-9bc7-c8d7fd9d99a4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.274892 Oct 04 18:06:20.691967 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 648/1333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:20 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:20.967304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ecd4c39-c17c-47bd-9a12-c1c96bcbaef3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:20.987760 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ecd4c39-c17c-47bd-9a12-c1c96bcbaef3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 200 len: 1474 microversion: 2.1 time: 0.324401 Oct 04 18:06:20.990628 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 686/1334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:20 2022] GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 1474 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:21.299014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f2faf360-7e8e-4f62-81c3-a28b75301775 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:21.300414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f2faf360-7e8e-4f62-81c3-a28b75301775 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:21.309857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2faf360-7e8e-4f62-81c3-a28b75301775 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.310650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2faf360-7e8e-4f62-81c3-a28b75301775 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.311301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2faf360-7e8e-4f62-81c3-a28b75301775 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.312306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2faf360-7e8e-4f62-81c3-a28b75301775 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.313029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2faf360-7e8e-4f62-81c3-a28b75301775 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.313796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2faf360-7e8e-4f62-81c3-a28b75301775 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.435168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-449d12d8-3a10-47db-8944-03cc3544899e tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1b11550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:21.439896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f2faf360-7e8e-4f62-81c3-a28b75301775 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.460610 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f2faf360-7e8e-4f62-81c3-a28b75301775 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1217 microversion: 2.1 time: 0.165400 Oct 04 18:06:21.462085 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 649/1335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:21 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:21.519567 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-449d12d8-3a10-47db-8944-03cc3544899e tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.088174 Oct 04 18:06:21.528217 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 687/1336] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:21 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:21.718178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4809deb7-3572-48d3-bf79-40fee8111f9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:21.719085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4809deb7-3572-48d3-bf79-40fee8111f9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:21.726642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4809deb7-3572-48d3-bf79-40fee8111f9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.727463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4809deb7-3572-48d3-bf79-40fee8111f9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.728105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4809deb7-3572-48d3-bf79-40fee8111f9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.729026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4809deb7-3572-48d3-bf79-40fee8111f9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.729669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4809deb7-3572-48d3-bf79-40fee8111f9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.730295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4809deb7-3572-48d3-bf79-40fee8111f9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.017114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-953087b3-313b-4c77-ad04-1e7b926172bc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.017779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-953087b3-313b-4c77-ad04-1e7b926172bc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:22.033025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-953087b3-313b-4c77-ad04-1e7b926172bc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.034233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-953087b3-313b-4c77-ad04-1e7b926172bc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.035556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-953087b3-313b-4c77-ad04-1e7b926172bc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.040454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-953087b3-313b-4c77-ad04-1e7b926172bc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.041180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-953087b3-313b-4c77-ad04-1e7b926172bc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.044121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-953087b3-313b-4c77-ad04-1e7b926172bc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.160100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4809deb7-3572-48d3-bf79-40fee8111f9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.174119 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4809deb7-3572-48d3-bf79-40fee8111f9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.458073 Oct 04 18:06:22.178531 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 650/1337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:21 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:22.485292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee827420-7b4d-43a4-b663-dd72bf9b09d3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.485963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ee827420-7b4d-43a4-b663-dd72bf9b09d3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:22.502769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee827420-7b4d-43a4-b663-dd72bf9b09d3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.503873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee827420-7b4d-43a4-b663-dd72bf9b09d3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.504509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee827420-7b4d-43a4-b663-dd72bf9b09d3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.505406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee827420-7b4d-43a4-b663-dd72bf9b09d3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.506032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee827420-7b4d-43a4-b663-dd72bf9b09d3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.508408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee827420-7b4d-43a4-b663-dd72bf9b09d3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.580790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-953087b3-313b-4c77-ad04-1e7b926172bc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.591650 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-953087b3-313b-4c77-ad04-1e7b926172bc tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 200 len: 1474 microversion: 2.1 time: 0.578606 Oct 04 18:06:22.606991 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 688/1338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 1474 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:22.608610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a174d87d-a83b-436d-8278-471279c33394 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1b30040>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.685976 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a174d87d-a83b-436d-8278-471279c33394 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.087045 Oct 04 18:06:22.686515 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 689/1339] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:22.703626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee827420-7b4d-43a4-b663-dd72bf9b09d3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.717984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ee827420-7b4d-43a4-b663-dd72bf9b09d3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1265 microversion: 2.1 time: 0.236586 Oct 04 18:06:22.730993 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 651/1340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:23.205953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-40f430b8-18f7-4046-917c-50e558817459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:23.206995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-40f430b8-18f7-4046-917c-50e558817459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:23.220589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40f430b8-18f7-4046-917c-50e558817459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.221100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40f430b8-18f7-4046-917c-50e558817459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.224133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40f430b8-18f7-4046-917c-50e558817459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.227420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40f430b8-18f7-4046-917c-50e558817459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.228581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40f430b8-18f7-4046-917c-50e558817459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.230198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40f430b8-18f7-4046-917c-50e558817459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.622480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0cf0525f-0c43-449b-8582-d5103eaffa80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:23.623703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0cf0525f-0c43-449b-8582-d5103eaffa80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:23.635809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:23.642369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cf0525f-0c43-449b-8582-d5103eaffa80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.643439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cf0525f-0c43-449b-8582-d5103eaffa80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.644382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cf0525f-0c43-449b-8582-d5103eaffa80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.645426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cf0525f-0c43-449b-8582-d5103eaffa80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.652252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cf0525f-0c43-449b-8582-d5103eaffa80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.653577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cf0525f-0c43-449b-8582-d5103eaffa80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.013321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-40f430b8-18f7-4046-917c-50e558817459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:24.041773 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-40f430b8-18f7-4046-917c-50e558817459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1719 microversion: 2.1 time: 0.841526 Oct 04 18:06:24.042482 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 690/1341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:23 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1719 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:24.071438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-09279501-5af2-4005-a0dc-b824db721aa1 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1bd9670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.182982 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-09279501-5af2-4005-a0dc-b824db721aa1 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.115706 Oct 04 18:06:24.188552 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 691/1342] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:24 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:24.206234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-496f7013-5aae-4eb7-af94-1057cf6848bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.223010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-496f7013-5aae-4eb7-af94-1057cf6848bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:24.234735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:24.251173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-496f7013-5aae-4eb7-af94-1057cf6848bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.265547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-496f7013-5aae-4eb7-af94-1057cf6848bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.267952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-496f7013-5aae-4eb7-af94-1057cf6848bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.275400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-496f7013-5aae-4eb7-af94-1057cf6848bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.276297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-496f7013-5aae-4eb7-af94-1057cf6848bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.276953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-496f7013-5aae-4eb7-af94-1057cf6848bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.502477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-496f7013-5aae-4eb7-af94-1057cf6848bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:24.519377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0cf0525f-0c43-449b-8582-d5103eaffa80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:24.521539 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-496f7013-5aae-4eb7-af94-1057cf6848bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1271 microversion: 2.1 time: 0.329788 Oct 04 18:06:24.523480 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 692/1343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:24 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1271 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:24.531869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9aca11e8-6239-472a-9b02-ab99ae272864 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.534928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9aca11e8-6239-472a-9b02-ab99ae272864 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:24.543110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aca11e8-6239-472a-9b02-ab99ae272864 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.544796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aca11e8-6239-472a-9b02-ab99ae272864 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.545815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aca11e8-6239-472a-9b02-ab99ae272864 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.546020 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0cf0525f-0c43-449b-8582-d5103eaffa80 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 200 len: 1474 microversion: 2.1 time: 0.927366 Oct 04 18:06:24.547518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aca11e8-6239-472a-9b02-ab99ae272864 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.548742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aca11e8-6239-472a-9b02-ab99ae272864 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.549320 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 652/1344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:23 2022] GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 1474 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:24.550613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aca11e8-6239-472a-9b02-ab99ae272864 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.613098 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9aca11e8-6239-472a-9b02-ab99ae272864 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087730 Oct 04 18:06:24.620323 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 693/1345] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:24 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:24.632902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f14f7167-64f8-466a-ad0a-a2d178c3f481 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.633662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f14f7167-64f8-466a-ad0a-a2d178c3f481 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:24.649076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f14f7167-64f8-466a-ad0a-a2d178c3f481 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.651361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f14f7167-64f8-466a-ad0a-a2d178c3f481 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.659667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f14f7167-64f8-466a-ad0a-a2d178c3f481 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.660620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f14f7167-64f8-466a-ad0a-a2d178c3f481 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.661218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f14f7167-64f8-466a-ad0a-a2d178c3f481 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.661784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f14f7167-64f8-466a-ad0a-a2d178c3f481 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.918991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-f14f7167-64f8-466a-ad0a-a2d178c3f481 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lazy-loading 'services' on Instance uuid 2bc68e22-19de-42cd-aae6-efc5d6218e8c {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:25.077246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-15478c2a-9f82-400a-9cd4-2e8428fd8580 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.078517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-15478c2a-9f82-400a-9cd4-2e8428fd8580 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.097694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15478c2a-9f82-400a-9cd4-2e8428fd8580 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.102282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15478c2a-9f82-400a-9cd4-2e8428fd8580 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.110602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15478c2a-9f82-400a-9cd4-2e8428fd8580 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.113484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15478c2a-9f82-400a-9cd4-2e8428fd8580 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.116599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15478c2a-9f82-400a-9cd4-2e8428fd8580 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.119933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15478c2a-9f82-400a-9cd4-2e8428fd8580 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.227448 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f14f7167-64f8-466a-ad0a-a2d178c3f481 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-volume_attachments/2cd03ab7-1ee5-41de-9696-49fb1f4894c1" status: 202 len: 0 microversion: 2.1 time: 0.605191 Oct 04 18:06:25.228131 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 653/1346] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:06:24 2022] DELETE /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-volume_attachments/2cd03ab7-1ee5-41de-9696-49fb1f4894c1 => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:25.241379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-47c3ff5e-64da-4e7f-9872-983b89052684 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d94af0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.363906 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-47c3ff5e-64da-4e7f-9872-983b89052684 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.134250 Oct 04 18:06:25.375145 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 654/1347] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:25.547432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4eebbc18-1efe-4410-bcff-f1600f715350 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.548340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4eebbc18-1efe-4410-bcff-f1600f715350 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.552673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-15478c2a-9f82-400a-9cd4-2e8428fd8580 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.568508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4eebbc18-1efe-4410-bcff-f1600f715350 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.570079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4eebbc18-1efe-4410-bcff-f1600f715350 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.572157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4eebbc18-1efe-4410-bcff-f1600f715350 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.573109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4eebbc18-1efe-4410-bcff-f1600f715350 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.577186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4eebbc18-1efe-4410-bcff-f1600f715350 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.577186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4eebbc18-1efe-4410-bcff-f1600f715350 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.581255 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-15478c2a-9f82-400a-9cd4-2e8428fd8580 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1709 microversion: 2.1 time: 0.509002 Oct 04 18:06:25.583582 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 694/1348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1709 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:25.609443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9108786d-5039-4597-b070-1858c79fd43a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.610096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9108786d-5039-4597-b070-1858c79fd43a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.631658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9108786d-5039-4597-b070-1858c79fd43a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.632545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9108786d-5039-4597-b070-1858c79fd43a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.633327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9108786d-5039-4597-b070-1858c79fd43a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.634586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9108786d-5039-4597-b070-1858c79fd43a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.646141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9108786d-5039-4597-b070-1858c79fd43a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.651508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9108786d-5039-4597-b070-1858c79fd43a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.793183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4eebbc18-1efe-4410-bcff-f1600f715350 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.806077 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4eebbc18-1efe-4410-bcff-f1600f715350 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1271 microversion: 2.1 time: 0.262830 Oct 04 18:06:25.806824 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 655/1349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:25.812571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-41279d63-5adb-4e6a-8872-0ac437b4e161 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '.version_select at 0x7fd4d1f724c0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.828726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41279d63-5adb-4e6a-8872-0ac437b4e161 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.829441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41279d63-5adb-4e6a-8872-0ac437b4e161 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.830129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41279d63-5adb-4e6a-8872-0ac437b4e161 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.852142 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-41279d63-5adb-4e6a-8872-0ac437b4e161 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2368 microversion: 2.1 time: 0.043031 Oct 04 18:06:25.867080 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 656/1350] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/os-migrations => generated 2368 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:25.875923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4c309df-3e8a-412f-b122-431a95c79074 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.876713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f4c309df-3e8a-412f-b122-431a95c79074 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.901290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4c309df-3e8a-412f-b122-431a95c79074 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.901910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4c309df-3e8a-412f-b122-431a95c79074 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.902645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4c309df-3e8a-412f-b122-431a95c79074 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.903550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4c309df-3e8a-412f-b122-431a95c79074 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.904287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4c309df-3e8a-412f-b122-431a95c79074 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.905165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4c309df-3e8a-412f-b122-431a95c79074 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.287299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9108786d-5039-4597-b070-1858c79fd43a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.353652 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9108786d-5039-4597-b070-1858c79fd43a tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 200 len: 1474 microversion: 2.1 time: 0.758386 Oct 04 18:06:26.356191 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 695/1351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 1474 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:26.366927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-0be52ca9-2ef1-4a4b-a99b-270c7d6de962 req-6cec05e5-b55b-497b-85d2-08a2a6470f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0bc7d77-c5ab-428c-8714-c9ae8292a8b6", "name": "network-vif-deleted", "tag": "7e6bf0d1-c58d-4b4d-bbda-48efc495a4ce"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:26.433441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0be52ca9-2ef1-4a4b-a99b-270c7d6de962 req-6cec05e5-b55b-497b-85d2-08a2a6470f41 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.435274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0be52ca9-2ef1-4a4b-a99b-270c7d6de962 req-6cec05e5-b55b-497b-85d2-08a2a6470f41 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.440149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0be52ca9-2ef1-4a4b-a99b-270c7d6de962 req-6cec05e5-b55b-497b-85d2-08a2a6470f41 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.495045 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-0be52ca9-2ef1-4a4b-a99b-270c7d6de962 req-6cec05e5-b55b-497b-85d2-08a2a6470f41 service nova] Creating event network-vif-deleted:7e6bf0d1-c58d-4b4d-bbda-48efc495a4ce for instance e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 on n-h2-850499-14 Oct 04 18:06:26.512022 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-0be52ca9-2ef1-4a4b-a99b-270c7d6de962 req-6cec05e5-b55b-497b-85d2-08a2a6470f41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153639 Oct 04 18:06:26.514072 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 696/1352] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:26.526758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0a9621ee-a441-4e2f-abee-4883fcc66e1f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d2c670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.635566 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0a9621ee-a441-4e2f-abee-4883fcc66e1f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.119471 Oct 04 18:06:26.636786 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 697/1353] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:26.831312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e5d2fa26-8593-4ab5-9611-965848c85bb7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.832277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e5d2fa26-8593-4ab5-9611-965848c85bb7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:26.860842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa26-8593-4ab5-9611-965848c85bb7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.862798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa26-8593-4ab5-9611-965848c85bb7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.863399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa26-8593-4ab5-9611-965848c85bb7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.867172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa26-8593-4ab5-9611-965848c85bb7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.867824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa26-8593-4ab5-9611-965848c85bb7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.868401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5d2fa26-8593-4ab5-9611-965848c85bb7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.870497 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f4c309df-3e8a-412f-b122-431a95c79074 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1862 microversion: 2.1 time: 0.998146 Oct 04 18:06:26.906045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 657/1354] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1862 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:26.923696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-50f85802-82df-4b64-85c2-2c0284b87d76 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.925496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-50f85802-82df-4b64-85c2-2c0284b87d76 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:26.944139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f85802-82df-4b64-85c2-2c0284b87d76 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.947998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f85802-82df-4b64-85c2-2c0284b87d76 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.950127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f85802-82df-4b64-85c2-2c0284b87d76 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.951116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f85802-82df-4b64-85c2-2c0284b87d76 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.953939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f85802-82df-4b64-85c2-2c0284b87d76 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.954731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f85802-82df-4b64-85c2-2c0284b87d76 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.229006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e5d2fa26-8593-4ab5-9611-965848c85bb7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:27.241247 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e5d2fa26-8593-4ab5-9611-965848c85bb7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1271 microversion: 2.1 time: 0.414015 Oct 04 18:06:27.260060 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 698/1355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1271 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:27.386809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:27.387622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:27.408047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.414506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.417534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.418646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.419198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.419632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.494760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:27.555438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.556207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.557028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.557817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lazy-loading 'fault' on Instance uuid c31b2e2a-3ff2-4f05-b2c5-071a392b21ea {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:27.969144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:27.992765 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-127edc32-5be1-40a6-8202-8336da9b9fd3 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 200 len: 1309 microversion: 2.1 time: 0.607614 Oct 04 18:06:27.994058 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 699/1356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:27 2022] GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 1309 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:28.012686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-851fcdab-7ac7-407d-9eb3-33c1a8eddb96 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1e314c0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.034031 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-50f85802-82df-4b64-85c2-2c0284b87d76 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1862 microversion: 2.1 time: 1.121359 Oct 04 18:06:28.040414 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 658/1357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1862 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:28.157714 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-851fcdab-7ac7-407d-9eb3-33c1a8eddb96 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.162313 Oct 04 18:06:28.160921 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 700/1358] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:27 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:28.250752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d8276b6-869d-4883-b093-df3ef9f85de0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.251889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d8276b6-869d-4883-b093-df3ef9f85de0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:28.266140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9289d87e-9bb2-45c1-af26-980fa9eb11f9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.268507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9289d87e-9bb2-45c1-af26-980fa9eb11f9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:28.276114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d8276b6-869d-4883-b093-df3ef9f85de0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.280464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d8276b6-869d-4883-b093-df3ef9f85de0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.280968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d8276b6-869d-4883-b093-df3ef9f85de0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.293868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d8276b6-869d-4883-b093-df3ef9f85de0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.295057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d8276b6-869d-4883-b093-df3ef9f85de0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.298597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d8276b6-869d-4883-b093-df3ef9f85de0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.310637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9289d87e-9bb2-45c1-af26-980fa9eb11f9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.311448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9289d87e-9bb2-45c1-af26-980fa9eb11f9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.314355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9289d87e-9bb2-45c1-af26-980fa9eb11f9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.315967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9289d87e-9bb2-45c1-af26-980fa9eb11f9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.318891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9289d87e-9bb2-45c1-af26-980fa9eb11f9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.319656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9289d87e-9bb2-45c1-af26-980fa9eb11f9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.411892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:28.674440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-1d8276b6-869d-4883-b093-df3ef9f85de0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lazy-loading 'services' on Instance uuid 513fb23f-209f-4de1-add7-84c46117aace {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:28.889646 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d8276b6-869d-4883-b093-df3ef9f85de0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "DELETE /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments/11223bcb-93bf-4c6b-a025-dd2799779f10" status: 202 len: 0 microversion: 2.1 time: 0.644421 Oct 04 18:06:28.894256 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 659/1359] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:06:28 2022] DELETE /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments/11223bcb-93bf-4c6b-a025-dd2799779f10 => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:28.923781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8bf8725d-49ae-4ed4-846e-0efef047da4e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.932789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8bf8725d-49ae-4ed4-846e-0efef047da4e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:28.971245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bf8725d-49ae-4ed4-846e-0efef047da4e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.971804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bf8725d-49ae-4ed4-846e-0efef047da4e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.972254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bf8725d-49ae-4ed4-846e-0efef047da4e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.975789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bf8725d-49ae-4ed4-846e-0efef047da4e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.993129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bf8725d-49ae-4ed4-846e-0efef047da4e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.994174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bf8725d-49ae-4ed4-846e-0efef047da4e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.064597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:29.110811 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8bf8725d-49ae-4ed4-846e-0efef047da4e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195914 Oct 04 18:06:29.121851 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 660/1360] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:29.133576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.141445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: c31b2e2a-3ff2-4f05-b2c5-071a392b21ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:29.152613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.153308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.153857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.155356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.156726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.160458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.169005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:29.211415 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] HTTP exception thrown: Instance c31b2e2a-3ff2-4f05-b2c5-071a392b21ea could not be found. Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Request method failure captured: Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea HTTP/1.1 Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVQz1NE3kt3KG8YI5JPGsVVgcaKtXMWfqZO652Lwd64gK7xXxW8N6IOJiWaDKDQte234JQs8WMYZ-8pWnAeG_wPrA92qwT23Kjj8M38B7IJrStpLdCdXdXdTYLJkLUyRJVdWRBn7Gi8Joyy3ehbo_nPv9n5KK9mydgSN-yLd-WOaiQ Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:06:29.216973 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}] Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d5e7c7c7826b4660acf4a4276c3e829c Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance c31b2e2a-3ff2-4f05-b2c5-071a392b21ea could not be found. Oct 04 18:06:29.219433 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c31b2e2a-3ff2-4f05-b2c5-071a392b21ea'} Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c31b2e2a-3ff2-4f05-b2c5-071a392b21ea could not be found. Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:29.221159 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c31b2e2a-3ff2-4f05-b2c5-071a392b21ea could not be found. Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c31b2e2a-3ff2-4f05-b2c5-071a392b21ea could not be found. Oct 04 18:06:29.222667 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:29.230386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Returning 404 to user: Instance c31b2e2a-3ff2-4f05-b2c5-071a392b21ea could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:29.235815 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0186b0c0-7802-4908-b45b-5d54ed49a2bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea" status: 404 len: 111 microversion: 2.1 time: 0.109703 Oct 04 18:06:29.239169 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 661/1361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:29 2022] GET /compute/v2.1/servers/c31b2e2a-3ff2-4f05-b2c5-071a392b21ea => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:29.253827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3e321ff5-8de1-44b2-a5ee-4c0837d9537f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1dd9c10>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.361417 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3e321ff5-8de1-44b2-a5ee-4c0837d9537f tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1427 microversion: 2.1 time: 0.119673 Oct 04 18:06:29.370457 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 662/1362] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:29 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:29.393103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.397941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: e0bc7d77-c5ab-428c-8714-c9ae8292a8b6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:29.425135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.428312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.429030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.429978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.454670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.458255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.533141 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] HTTP exception thrown: Instance e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 could not be found. Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Request method failure captured: Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 HTTP/1.1 Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHVQz1NE3kt3KG8YI5JPGsVVgcaKtXMWfqZO652Lwd64gK7xXxW8N6IOJiWaDKDQte234JQs8WMYZ-8pWnAeG_wPrA92qwT23Kjj8M38B7IJrStpLdCdXdXdTYLJkLUyRJVdWRBn7Gi8Joyy3ehbo_nPv9n5KK9mydgSN-yLd-WOaiQ Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:06:29.536081 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}] Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d5e7c7c7826b4660acf4a4276c3e829c Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 could not be found. Oct 04 18:06:29.538445 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e0bc7d77-c5ab-428c-8714-c9ae8292a8b6'} Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 could not be found. Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:29.539414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 could not be found. Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 could not be found. Oct 04 18:06:29.540916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:29.542281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Returning 404 to user: Instance e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:29.542281 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-579f053e-2e04-4769-b0b7-a5f94d3d67b2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6" status: 404 len: 111 microversion: 2.1 time: 0.166722 Oct 04 18:06:29.550887 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 663/1363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:29 2022] GET /compute/v2.1/servers/e0bc7d77-c5ab-428c-8714-c9ae8292a8b6 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:29.558060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ceabb3d-e17c-4173-a61b-31d3313c2680 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.695964 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ceabb3d-e17c-4173-a61b-31d3313c2680 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/1ac34048-0a16-40a7-9526-17415b175fb8" status: 204 len: 0 microversion: 2.1 time: 0.143114 Oct 04 18:06:29.698945 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 664/1364] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:06:29 2022] DELETE /compute/v2.1/os-server-groups/1ac34048-0a16-40a7-9526-17415b175fb8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:29.709911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90e85688-37df-42d2-9dd8-f7060100e365 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.710534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90e85688-37df-42d2-9dd8-f7060100e365 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:29.728853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90e85688-37df-42d2-9dd8-f7060100e365 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.729384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90e85688-37df-42d2-9dd8-f7060100e365 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.729838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90e85688-37df-42d2-9dd8-f7060100e365 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.730582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90e85688-37df-42d2-9dd8-f7060100e365 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.732476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90e85688-37df-42d2-9dd8-f7060100e365 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.732922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90e85688-37df-42d2-9dd8-f7060100e365 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.817564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90e85688-37df-42d2-9dd8-f7060100e365 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:29.952891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9289d87e-9bb2-45c1-af26-980fa9eb11f9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:29.988510 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9289d87e-9bb2-45c1-af26-980fa9eb11f9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 1.726585 Oct 04 18:06:29.993765 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 701/1365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:30.093219 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90e85688-37df-42d2-9dd8-f7060100e365 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 204 len: 0 microversion: 2.1 time: 0.389804 Oct 04 18:06:30.096781 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 665/1366] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:29 2022] DELETE /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:06:30.102862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-712aa6f5-df0e-4f0e-8945-fbe306796e66 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.103545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-712aa6f5-df0e-4f0e-8945-fbe306796e66 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:30.118515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-712aa6f5-df0e-4f0e-8945-fbe306796e66 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.124587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-712aa6f5-df0e-4f0e-8945-fbe306796e66 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.127885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-497e93fb-2b6a-4d1e-bdc2-138532032d9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.129219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-712aa6f5-df0e-4f0e-8945-fbe306796e66 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.130784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-712aa6f5-df0e-4f0e-8945-fbe306796e66 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.131541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-497e93fb-2b6a-4d1e-bdc2-138532032d9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:30.134999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-712aa6f5-df0e-4f0e-8945-fbe306796e66 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.135884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-712aa6f5-df0e-4f0e-8945-fbe306796e66 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.155741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497e93fb-2b6a-4d1e-bdc2-138532032d9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.156329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497e93fb-2b6a-4d1e-bdc2-138532032d9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.156787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497e93fb-2b6a-4d1e-bdc2-138532032d9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.157552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497e93fb-2b6a-4d1e-bdc2-138532032d9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.158026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497e93fb-2b6a-4d1e-bdc2-138532032d9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.158467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497e93fb-2b6a-4d1e-bdc2-138532032d9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.254783 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-497e93fb-2b6a-4d1e-bdc2-138532032d9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129156 Oct 04 18:06:30.255516 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 666/1367] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:30.320769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2c970361-7228-4557-9131-41d0df0aabac req-6d7bd725-037a-4441-aa3a-070f2bf9b52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c31b2e2a-3ff2-4f05-b2c5-071a392b21ea", "name": "network-vif-deleted", "tag": "63e5138e-54a8-464b-a808-cf8ff8e32709"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:30.331728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2c970361-7228-4557-9131-41d0df0aabac req-6d7bd725-037a-4441-aa3a-070f2bf9b52a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.332495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2c970361-7228-4557-9131-41d0df0aabac req-6d7bd725-037a-4441-aa3a-070f2bf9b52a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.333134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2c970361-7228-4557-9131-41d0df0aabac req-6d7bd725-037a-4441-aa3a-070f2bf9b52a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.349306 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2c970361-7228-4557-9131-41d0df0aabac req-6d7bd725-037a-4441-aa3a-070f2bf9b52a service nova] Creating event network-vif-deleted:63e5138e-54a8-464b-a808-cf8ff8e32709 for instance c31b2e2a-3ff2-4f05-b2c5-071a392b21ea on n-h2-850499-14 Oct 04 18:06:30.366698 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2c970361-7228-4557-9131-41d0df0aabac req-6d7bd725-037a-4441-aa3a-070f2bf9b52a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054304 Oct 04 18:06:30.369403 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 667/1368] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:30.386150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8300ef5d-2c98-4c6a-85b4-65b1fc7faec8 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1d1ac10>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.482463 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8300ef5d-2c98-4c6a-85b4-65b1fc7faec8 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1436 microversion: 2.1 time: 0.108924 Oct 04 18:06:30.483410 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 668/1369] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1436 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:30.498455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b0dbba2-4ef2-4dce-ae57-6be1b8c35319 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1fcc280>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.575799 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b0dbba2-4ef2-4dce-ae57-6be1b8c35319 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 200 len: 1436 microversion: 2.1 time: 0.081504 Oct 04 18:06:30.577882 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 669/1370] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 1436 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:30.600237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-15b1670f-a6d6-4cf7-a28c-2fc7c7aa641a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.603476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15b1670f-a6d6-4cf7-a28c-2fc7c7aa641a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:30.618687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15b1670f-a6d6-4cf7-a28c-2fc7c7aa641a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.619630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15b1670f-a6d6-4cf7-a28c-2fc7c7aa641a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.620274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15b1670f-a6d6-4cf7-a28c-2fc7c7aa641a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.621183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15b1670f-a6d6-4cf7-a28c-2fc7c7aa641a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.624720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15b1670f-a6d6-4cf7-a28c-2fc7c7aa641a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.625396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15b1670f-a6d6-4cf7-a28c-2fc7c7aa641a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.716513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-712aa6f5-df0e-4f0e-8945-fbe306796e66 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.742842 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-712aa6f5-df0e-4f0e-8945-fbe306796e66 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1471 microversion: 2.1 time: 0.644528 Oct 04 18:06:30.743856 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 702/1371] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1471 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:31.028820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b75ce57b-cf62-4577-8851-bf2018e8b5fd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.031127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b75ce57b-cf62-4577-8851-bf2018e8b5fd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:31.047301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75ce57b-cf62-4577-8851-bf2018e8b5fd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.054514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75ce57b-cf62-4577-8851-bf2018e8b5fd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.061457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75ce57b-cf62-4577-8851-bf2018e8b5fd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.062393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75ce57b-cf62-4577-8851-bf2018e8b5fd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.062898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75ce57b-cf62-4577-8851-bf2018e8b5fd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.063381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75ce57b-cf62-4577-8851-bf2018e8b5fd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.086143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-15b1670f-a6d6-4cf7-a28c-2fc7c7aa641a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:31.108494 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-15b1670f-a6d6-4cf7-a28c-2fc7c7aa641a tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1466 microversion: 2.1 time: 0.517882 Oct 04 18:06:31.109164 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 670/1372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1466 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:31.150748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3cd16ed0-9295-472e-ba11-82a7e2e3f7e0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1dd08b0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.368809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b75ce57b-cf62-4577-8851-bf2018e8b5fd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:31.393525 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b75ce57b-cf62-4577-8851-bf2018e8b5fd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.357594 Oct 04 18:06:31.395560 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 703/1373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:31.402537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3729206d-70c9-4d73-852d-1a7e7dabe7d6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.411193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3729206d-70c9-4d73-852d-1a7e7dabe7d6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:31.454289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3729206d-70c9-4d73-852d-1a7e7dabe7d6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.456389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3729206d-70c9-4d73-852d-1a7e7dabe7d6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.458056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3729206d-70c9-4d73-852d-1a7e7dabe7d6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.461905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3729206d-70c9-4d73-852d-1a7e7dabe7d6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.462680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3729206d-70c9-4d73-852d-1a7e7dabe7d6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.466684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3729206d-70c9-4d73-852d-1a7e7dabe7d6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.539490 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3729206d-70c9-4d73-852d-1a7e7dabe7d6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142251 Oct 04 18:06:31.540744 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 704/1374] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:31.786414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-632e25f6-7a97-4286-b70b-c455e2812e2c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.787198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-632e25f6-7a97-4286-b70b-c455e2812e2c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:31.800296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632e25f6-7a97-4286-b70b-c455e2812e2c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.804814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632e25f6-7a97-4286-b70b-c455e2812e2c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.805297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632e25f6-7a97-4286-b70b-c455e2812e2c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.807642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632e25f6-7a97-4286-b70b-c455e2812e2c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.808937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632e25f6-7a97-4286-b70b-c455e2812e2c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.809404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632e25f6-7a97-4286-b70b-c455e2812e2c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.295974 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3cd16ed0-9295-472e-ba11-82a7e2e3f7e0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "DELETE /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b" status: 204 len: 0 microversion: 2.1 time: 1.151964 Oct 04 18:06:32.297265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-632e25f6-7a97-4286-b70b-c455e2812e2c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.299838 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 671/1375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:31 2022] DELETE /compute/v2.1/images/847e9e8e-9b5b-4f7d-a7df-5b411271ba0b => generated 0 bytes in 1154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:32.305943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39b6624a-62e2-422e-8841-c4382834c290 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '.version_select at 0x7fd4d1dd95e0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.308833 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-632e25f6-7a97-4286-b70b-c455e2812e2c tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1471 microversion: 2.1 time: 0.526839 Oct 04 18:06:32.330257 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 705/1376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1471 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:32.396460 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-39b6624a-62e2-422e-8841-c4382834c290 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] HTTP exception thrown: Image not found. Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39b6624a-62e2-422e-8841-c4382834c290 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Request method failure captured: Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 HTTP/1.1 Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHXZurKJ8CRpr-mwYCTtVegSMemxdZulC5hJgfklo7cBx9JMkhqFKp_j85dnRv48EkmfjmqDNvJEljQIdpfJtuiI_KS7nTACkLC6Kd23ixQFk9OH8uoHWrorOoXw1UvFTuU3tUlIc5L_03jD2QtkrgbiKxOwJs-VRql2JoJbJG_W76Y Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9347f6d02b614c0d85ece3ec91521bd4 Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesOneServerTestJSON-755622534 Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:06:32.400978 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9347f6d02b614c0d85ece3ec91521bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9347f6d02b614c0d85ece3ec91521bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9347f6d02b614c0d85ece3ec91521bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9347f6d02b614c0d85ece3ec91521bd4"}]}] Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesOneServerTestJSON-755622534 Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9347f6d02b614c0d85ece3ec91521bd4 Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-755622534 Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesOneServerTestJSON-755622534-project Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 424cdee7a8ef4100b600b8a59f8f7394 Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesOneServerTestJSON-755622534-project Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: exception: Image not found. Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'cec55691-018d-4abe-9915-f24973817a53'} Oct 04 18:06:32.402652 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cec55691-018d-4abe-9915-f24973817a53 to delete Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:32.403729 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cec55691-018d-4abe-9915-f24973817a53 could not be found. Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:32.405651 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:06:32.407958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:32.410641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39b6624a-62e2-422e-8841-c4382834c290 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Returning 404 to user: Image not found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:32.411824 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39b6624a-62e2-422e-8841-c4382834c290 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "DELETE /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53" status: 404 len: 62 microversion: 2.1 time: 0.110937 Oct 04 18:06:32.414771 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 672/1377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:32 2022] DELETE /compute/v2.1/images/cec55691-018d-4abe-9915-f24973817a53 => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:06:32.419744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ed77b95-c784-4eac-ac08-1981cee7a45f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.420730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8ed77b95-c784-4eac-ac08-1981cee7a45f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.432955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbbd6e23-843e-4edf-90c7-a395163e12ed tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.435154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bbbd6e23-843e-4edf-90c7-a395163e12ed tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.441736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed77b95-c784-4eac-ac08-1981cee7a45f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.445312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed77b95-c784-4eac-ac08-1981cee7a45f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.446730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed77b95-c784-4eac-ac08-1981cee7a45f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.451285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed77b95-c784-4eac-ac08-1981cee7a45f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.451665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbbd6e23-843e-4edf-90c7-a395163e12ed tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.452311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbbd6e23-843e-4edf-90c7-a395163e12ed tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.452428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed77b95-c784-4eac-ac08-1981cee7a45f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.452886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbbd6e23-843e-4edf-90c7-a395163e12ed tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.453005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ed77b95-c784-4eac-ac08-1981cee7a45f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.453740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbbd6e23-843e-4edf-90c7-a395163e12ed tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.454277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbbd6e23-843e-4edf-90c7-a395163e12ed tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.463919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbbd6e23-843e-4edf-90c7-a395163e12ed tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.511338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bbbd6e23-843e-4edf-90c7-a395163e12ed tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:32.699956 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bbbd6e23-843e-4edf-90c7-a395163e12ed tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 204 len: 0 microversion: 2.1 time: 0.280132 Oct 04 18:06:32.701181 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 673/1378] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:32 2022] DELETE /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:06:32.713454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc6740c1-a2a8-422f-9086-1de765b48e76 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.716573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc6740c1-a2a8-422f-9086-1de765b48e76 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.728380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6740c1-a2a8-422f-9086-1de765b48e76 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.729667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6740c1-a2a8-422f-9086-1de765b48e76 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.730760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6740c1-a2a8-422f-9086-1de765b48e76 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.731871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6740c1-a2a8-422f-9086-1de765b48e76 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.732670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6740c1-a2a8-422f-9086-1de765b48e76 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.733306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6740c1-a2a8-422f-9086-1de765b48e76 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.809052 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc6740c1-a2a8-422f-9086-1de765b48e76 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106348 Oct 04 18:06:32.814591 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 674/1379] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:32.832097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dedbaba2-97e7-4588-b8ba-5ac112ff6d52 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.833044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dedbaba2-97e7-4588-b8ba-5ac112ff6d52 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.840205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dedbaba2-97e7-4588-b8ba-5ac112ff6d52 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.841100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dedbaba2-97e7-4588-b8ba-5ac112ff6d52 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.841779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dedbaba2-97e7-4588-b8ba-5ac112ff6d52 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.842738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dedbaba2-97e7-4588-b8ba-5ac112ff6d52 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.843459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dedbaba2-97e7-4588-b8ba-5ac112ff6d52 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.844112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dedbaba2-97e7-4588-b8ba-5ac112ff6d52 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.901085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8ed77b95-c784-4eac-ac08-1981cee7a45f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.911213 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8ed77b95-c784-4eac-ac08-1981cee7a45f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.495819 Oct 04 18:06:32.916615 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 706/1380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:32.934781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b2d0bcc2-44cf-42b4-8541-2178928cb996 req-81017ecc-5812-4a67-a4e9-e98dd3bde818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b522e60-ef39-4497-8da3-023eac9859af", "tag": "f59d0713-eb06-474f-8c60-34c2e6eaf606"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:32.947279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b2d0bcc2-44cf-42b4-8541-2178928cb996 req-81017ecc-5812-4a67-a4e9-e98dd3bde818 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.948078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b2d0bcc2-44cf-42b4-8541-2178928cb996 req-81017ecc-5812-4a67-a4e9-e98dd3bde818 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.948683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b2d0bcc2-44cf-42b4-8541-2178928cb996 req-81017ecc-5812-4a67-a4e9-e98dd3bde818 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.990790 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b2d0bcc2-44cf-42b4-8541-2178928cb996 req-81017ecc-5812-4a67-a4e9-e98dd3bde818 service nova] Creating event network-changed:f59d0713-eb06-474f-8c60-34c2e6eaf606 for instance 4b522e60-ef39-4497-8da3-023eac9859af on n-h2-850499-14 Oct 04 18:06:32.997368 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b2d0bcc2-44cf-42b4-8541-2178928cb996 req-81017ecc-5812-4a67-a4e9-e98dd3bde818 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079315 Oct 04 18:06:32.998739 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 707/1381] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:33.319307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dedbaba2-97e7-4588-b8ba-5ac112ff6d52 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.330017 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dedbaba2-97e7-4588-b8ba-5ac112ff6d52 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1472 microversion: 2.1 time: 0.501719 Oct 04 18:06:33.336056 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 675/1382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1472 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:33.364267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b5ecceaf-da64-49ba-8553-c1c97d911bdb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.364993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b5ecceaf-da64-49ba-8553-c1c97d911bdb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.385228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5ecceaf-da64-49ba-8553-c1c97d911bdb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.386450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5ecceaf-da64-49ba-8553-c1c97d911bdb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.386925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5ecceaf-da64-49ba-8553-c1c97d911bdb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.388220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5ecceaf-da64-49ba-8553-c1c97d911bdb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.388739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5ecceaf-da64-49ba-8553-c1c97d911bdb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.389184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5ecceaf-da64-49ba-8553-c1c97d911bdb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.826494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb9e8212-b70d-4ba4-943e-964e13ff4e9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.828881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bb9e8212-b70d-4ba4-943e-964e13ff4e9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.851068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb9e8212-b70d-4ba4-943e-964e13ff4e9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.851583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb9e8212-b70d-4ba4-943e-964e13ff4e9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.852030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb9e8212-b70d-4ba4-943e-964e13ff4e9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.852760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb9e8212-b70d-4ba4-943e-964e13ff4e9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.853267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb9e8212-b70d-4ba4-943e-964e13ff4e9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.853642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb9e8212-b70d-4ba4-943e-964e13ff4e9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.913808 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb9e8212-b70d-4ba4-943e-964e13ff4e9a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091401 Oct 04 18:06:33.919041 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 676/1383] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:33.919251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b5ecceaf-da64-49ba-8553-c1c97d911bdb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.922803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-96b59cf2-8e98-4f28-bc05-ebe05bc5eaf0 req-24ae1cfd-8c36-4c97-b3a1-b2c6ff0211b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa79c4dc-6409-43e7-85da-46dde9db68bd", "name": "network-vif-deleted", "tag": "49406afb-3f01-47c9-934a-32a6e95c4e60"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:33.926621 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b5ecceaf-da64-49ba-8553-c1c97d911bdb tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1471 microversion: 2.1 time: 0.592951 Oct 04 18:06:33.930865 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 708/1384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1471 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:33.937300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d5afd48-4218-4272-ba26-8e03f6827ed8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.937922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4d5afd48-4218-4272-ba26-8e03f6827ed8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.959020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-96b59cf2-8e98-4f28-bc05-ebe05bc5eaf0 req-24ae1cfd-8c36-4c97-b3a1-b2c6ff0211b0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.959774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-96b59cf2-8e98-4f28-bc05-ebe05bc5eaf0 req-24ae1cfd-8c36-4c97-b3a1-b2c6ff0211b0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.960327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-96b59cf2-8e98-4f28-bc05-ebe05bc5eaf0 req-24ae1cfd-8c36-4c97-b3a1-b2c6ff0211b0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.960662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d5afd48-4218-4272-ba26-8e03f6827ed8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.961354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d5afd48-4218-4272-ba26-8e03f6827ed8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.961981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d5afd48-4218-4272-ba26-8e03f6827ed8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.963286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d5afd48-4218-4272-ba26-8e03f6827ed8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.964058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d5afd48-4218-4272-ba26-8e03f6827ed8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.964766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d5afd48-4218-4272-ba26-8e03f6827ed8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.977104 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-96b59cf2-8e98-4f28-bc05-ebe05bc5eaf0 req-24ae1cfd-8c36-4c97-b3a1-b2c6ff0211b0 service nova] Creating event network-vif-deleted:49406afb-3f01-47c9-934a-32a6e95c4e60 for instance aa79c4dc-6409-43e7-85da-46dde9db68bd on n-h1-850499-14 Oct 04 18:06:33.997245 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-96b59cf2-8e98-4f28-bc05-ebe05bc5eaf0 req-24ae1cfd-8c36-4c97-b3a1-b2c6ff0211b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067998 Oct 04 18:06:33.998931 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 677/1385] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:34.371000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ec04660a-d447-441d-af25-c8f64048f4d0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:34.372090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ec04660a-d447-441d-af25-c8f64048f4d0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:34.377666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4d5afd48-4218-4272-ba26-8e03f6827ed8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:34.394905 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4d5afd48-4218-4272-ba26-8e03f6827ed8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.461397 Oct 04 18:06:34.398803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec04660a-d447-441d-af25-c8f64048f4d0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.399201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec04660a-d447-441d-af25-c8f64048f4d0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.400236 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 709/1386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:34.406485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec04660a-d447-441d-af25-c8f64048f4d0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.411819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec04660a-d447-441d-af25-c8f64048f4d0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.412724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec04660a-d447-441d-af25-c8f64048f4d0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.413350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec04660a-d447-441d-af25-c8f64048f4d0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.764587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ec04660a-d447-441d-af25-c8f64048f4d0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:34.774780 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ec04660a-d447-441d-af25-c8f64048f4d0 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1472 microversion: 2.1 time: 0.409869 Oct 04 18:06:34.778861 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 678/1387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:34.929765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-44844f58-dc30-4b08-a4ac-0cc5e1c8d459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:34.933867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-44844f58-dc30-4b08-a4ac-0cc5e1c8d459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:34.961354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44844f58-dc30-4b08-a4ac-0cc5e1c8d459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.963235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44844f58-dc30-4b08-a4ac-0cc5e1c8d459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.965324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44844f58-dc30-4b08-a4ac-0cc5e1c8d459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.967742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44844f58-dc30-4b08-a4ac-0cc5e1c8d459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.968324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:34.968909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44844f58-dc30-4b08-a4ac-0cc5e1c8d459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.969924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:34.971674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44844f58-dc30-4b08-a4ac-0cc5e1c8d459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.018104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.019322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.019994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.021584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.022268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.024716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.126621 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-44844f58-dc30-4b08-a4ac-0cc5e1c8d459 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201730 Oct 04 18:06:35.132441 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 710/1388] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:35.158630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.160233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.162097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.164566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lazy-loading 'fault' on Instance uuid aa79c4dc-6409-43e7-85da-46dde9db68bd {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:35.509660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b9b33453-38ac-45c8-a8be-2e8ed1a12dcc req-d765cc3d-971d-4ee7-a3af-a10a8ab60e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f193d-65a7-48df-96b4-ee57115149a2", "name": "network-vif-unplugged", "status": "completed", "tag": "f53b385d-ad62-40bc-9e0f-d89171784dac"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:35.531737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b9b33453-38ac-45c8-a8be-2e8ed1a12dcc req-d765cc3d-971d-4ee7-a3af-a10a8ab60e6e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.532367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b9b33453-38ac-45c8-a8be-2e8ed1a12dcc req-d765cc3d-971d-4ee7-a3af-a10a8ab60e6e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.532907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b9b33453-38ac-45c8-a8be-2e8ed1a12dcc req-d765cc3d-971d-4ee7-a3af-a10a8ab60e6e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.547274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e7c7c7826b4660acf4a4276c3e829c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006ab9b759d4fd58f50c8c721bcaa6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:35.558249 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a8959fc-71cc-42bf-b5b9-d26055ff10c2 tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 200 len: 1306 microversion: 2.1 time: 0.601625 Oct 04 18:06:35.564895 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b9b33453-38ac-45c8-a8be-2e8ed1a12dcc req-d765cc3d-971d-4ee7-a3af-a10a8ab60e6e service nova] Creating event network-vif-unplugged:f53b385d-ad62-40bc-9e0f-d89171784dac for instance 3b9f193d-65a7-48df-96b4-ee57115149a2 on n-h1-850499-14 Oct 04 18:06:35.569096 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 679/1389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 1306 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:35.591108 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b9b33453-38ac-45c8-a8be-2e8ed1a12dcc req-d765cc3d-971d-4ee7-a3af-a10a8ab60e6e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.456535 Oct 04 18:06:35.594108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4f14f622-ef3e-4fbc-8050-7129db85ccea tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:35.595725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4f14f622-ef3e-4fbc-8050-7129db85ccea tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:35.602438 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 711/1390] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:35.622169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f14f622-ef3e-4fbc-8050-7129db85ccea tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.623103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f14f622-ef3e-4fbc-8050-7129db85ccea tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.623794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f14f622-ef3e-4fbc-8050-7129db85ccea tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.624721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f14f622-ef3e-4fbc-8050-7129db85ccea tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.625362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f14f622-ef3e-4fbc-8050-7129db85ccea tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.625963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f14f622-ef3e-4fbc-8050-7129db85ccea tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.809420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3e6d9399-351c-4dce-bb6a-c0bb53ebeccb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:35.819123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3e6d9399-351c-4dce-bb6a-c0bb53ebeccb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:35.832205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6d9399-351c-4dce-bb6a-c0bb53ebeccb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.841022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6d9399-351c-4dce-bb6a-c0bb53ebeccb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.842170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6d9399-351c-4dce-bb6a-c0bb53ebeccb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.846189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6d9399-351c-4dce-bb6a-c0bb53ebeccb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.846689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6d9399-351c-4dce-bb6a-c0bb53ebeccb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.847160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6d9399-351c-4dce-bb6a-c0bb53ebeccb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.392185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4f14f622-ef3e-4fbc-8050-7129db85ccea tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.413599 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4f14f622-ef3e-4fbc-8050-7129db85ccea tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.840689 Oct 04 18:06:36.430999 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 680/1391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:35 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:36.454920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21e69f8d-f7af-4023-81ea-7f5663cd76e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.459903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21e69f8d-f7af-4023-81ea-7f5663cd76e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.473060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e69f8d-f7af-4023-81ea-7f5663cd76e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.475497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e69f8d-f7af-4023-81ea-7f5663cd76e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.476245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e69f8d-f7af-4023-81ea-7f5663cd76e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.480944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e69f8d-f7af-4023-81ea-7f5663cd76e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.484392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e69f8d-f7af-4023-81ea-7f5663cd76e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.485441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e69f8d-f7af-4023-81ea-7f5663cd76e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.536288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3e6d9399-351c-4dce-bb6a-c0bb53ebeccb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.565061 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3e6d9399-351c-4dce-bb6a-c0bb53ebeccb tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1472 microversion: 2.1 time: 0.763689 Oct 04 18:06:36.582997 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 712/1392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:35 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1472 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:36.588842 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21e69f8d-f7af-4023-81ea-7f5663cd76e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166398 Oct 04 18:06:36.589641 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 681/1393] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:36.608233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.609039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] [instance: aa79c4dc-6409-43e7-85da-46dde9db68bd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.616745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.628889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.630473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.632319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.633888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.634699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.661804 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] HTTP exception thrown: Instance aa79c4dc-6409-43e7-85da-46dde9db68bd could not be found. Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Request method failure captured: Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd HTTP/1.1 Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHVQz1NE3kt3KG8YI5JPGsVVgcaKtXMWfqZO652Lwd64gK7xXxW8N6IOJiWaDKDQte234JQs8WMYZ-8pWnAeG_wPrA92qwT23Kjj8M38B7IJrStpLdCdXdXdTYLJkLUyRJVdWRBn7Gi8Joyy3ehbo_nPv9n5KK9mydgSN-yLd-WOaiQ Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:06:36.688436 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9006ab9b759d4fd58f50c8c721bcaa6c"}]}] Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9006ab9b759d4fd58f50c8c721bcaa6c Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1461576862 Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: d5e7c7c7826b4660acf4a4276c3e829c Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersOnMultiNodesTest-1461576862-project Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance aa79c4dc-6409-43e7-85da-46dde9db68bd could not be found. Oct 04 18:06:36.690044 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'aa79c4dc-6409-43e7-85da-46dde9db68bd'} Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa79c4dc-6409-43e7-85da-46dde9db68bd could not be found. Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:36.690927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa79c4dc-6409-43e7-85da-46dde9db68bd could not be found. Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa79c4dc-6409-43e7-85da-46dde9db68bd could not be found. Oct 04 18:06:36.692357 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:06:36.697262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] Returning 404 to user: Instance aa79c4dc-6409-43e7-85da-46dde9db68bd could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:36.699822 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a8de470-a484-40dd-a174-46e2cc3e40bd tempest-ServersOnMultiNodesTest-1461576862 tempest-ServersOnMultiNodesTest-1461576862-project] 10.222.0.18 "GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd" status: 404 len: 111 microversion: 2.1 time: 0.094127 Oct 04 18:06:36.713117 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 713/1394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/aa79c4dc-6409-43e7-85da-46dde9db68bd => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:06:37.046520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-cefa7a79-e5c1-4cbb-b3b8-007af0269c97 req-c3f2590f-e5e8-4fed-9f2b-62eb3078ff95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f193d-65a7-48df-96b4-ee57115149a2", "name": "network-vif-deleted", "tag": "f53b385d-ad62-40bc-9e0f-d89171784dac"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:37.075209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cefa7a79-e5c1-4cbb-b3b8-007af0269c97 req-c3f2590f-e5e8-4fed-9f2b-62eb3078ff95 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.089675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cefa7a79-e5c1-4cbb-b3b8-007af0269c97 req-c3f2590f-e5e8-4fed-9f2b-62eb3078ff95 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.090302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cefa7a79-e5c1-4cbb-b3b8-007af0269c97 req-c3f2590f-e5e8-4fed-9f2b-62eb3078ff95 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.143088 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-cefa7a79-e5c1-4cbb-b3b8-007af0269c97 req-c3f2590f-e5e8-4fed-9f2b-62eb3078ff95 service nova] Creating event network-vif-deleted:f53b385d-ad62-40bc-9e0f-d89171784dac for instance 3b9f193d-65a7-48df-96b4-ee57115149a2 on n-h1-850499-14 Oct 04 18:06:37.159233 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-cefa7a79-e5c1-4cbb-b3b8-007af0269c97 req-c3f2590f-e5e8-4fed-9f2b-62eb3078ff95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110238 Oct 04 18:06:37.160594 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 682/1395] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:37.458764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0187ddb5-809a-4974-ae29-740c079de55b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.459875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0187ddb5-809a-4974-ae29-740c079de55b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:37.495852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf806998-52ce-4a14-9b71-1bac970f2c13 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.497235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0187ddb5-809a-4974-ae29-740c079de55b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.498145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf806998-52ce-4a14-9b71-1bac970f2c13 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:37.498609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0187ddb5-809a-4974-ae29-740c079de55b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.499363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0187ddb5-809a-4974-ae29-740c079de55b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.501314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0187ddb5-809a-4974-ae29-740c079de55b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.502228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0187ddb5-809a-4974-ae29-740c079de55b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.502908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0187ddb5-809a-4974-ae29-740c079de55b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.510745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf806998-52ce-4a14-9b71-1bac970f2c13 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.511274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf806998-52ce-4a14-9b71-1bac970f2c13 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.511710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf806998-52ce-4a14-9b71-1bac970f2c13 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.512430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf806998-52ce-4a14-9b71-1bac970f2c13 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.512951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf806998-52ce-4a14-9b71-1bac970f2c13 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.513434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf806998-52ce-4a14-9b71-1bac970f2c13 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.555356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:37.615902 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf806998-52ce-4a14-9b71-1bac970f2c13 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124591 Oct 04 18:06:37.638980 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 683/1396] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-volume_attachments => generated 25 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:37.644068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.644692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:37.682156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.682811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.683181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.683962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.684430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.684843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.799713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.800485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.801095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.803701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lazy-loading 'fault' on Instance uuid 3b9f193d-65a7-48df-96b4-ee57115149a2 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:37.811162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0187ddb5-809a-4974-ae29-740c079de55b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:37.829351 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0187ddb5-809a-4974-ae29-740c079de55b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.384087 Oct 04 18:06:37.835593 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 714/1397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:37.842077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5e4ac605-8ccb-40dd-8d96-715430f4197b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.847961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5e4ac605-8ccb-40dd-8d96-715430f4197b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:37.886105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e4ac605-8ccb-40dd-8d96-715430f4197b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.892876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e4ac605-8ccb-40dd-8d96-715430f4197b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.893334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e4ac605-8ccb-40dd-8d96-715430f4197b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.894094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e4ac605-8ccb-40dd-8d96-715430f4197b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.894559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e4ac605-8ccb-40dd-8d96-715430f4197b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.895006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e4ac605-8ccb-40dd-8d96-715430f4197b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.938094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424cdee7a8ef4100b600b8a59f8f7394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347f6d02b614c0d85ece3ec91521bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:37.956314 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40a07a0b-c62d-4c13-9094-5127fd57b169 tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 200 len: 1306 microversion: 2.1 time: 0.316044 Oct 04 18:06:37.957200 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 684/1398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 1306 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:37.974803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1f54e50a-d62b-4a82-a965-144f9c6069e9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.984160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1f54e50a-d62b-4a82-a965-144f9c6069e9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.010644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f54e50a-d62b-4a82-a965-144f9c6069e9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.014258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f54e50a-d62b-4a82-a965-144f9c6069e9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.017755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f54e50a-d62b-4a82-a965-144f9c6069e9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.019675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f54e50a-d62b-4a82-a965-144f9c6069e9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.027552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f54e50a-d62b-4a82-a965-144f9c6069e9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.027872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f54e50a-d62b-4a82-a965-144f9c6069e9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.028009 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5e4ac605-8ccb-40dd-8d96-715430f4197b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190690 Oct 04 18:06:38.030622 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 715/1399] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:38.168834 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1f54e50a-d62b-4a82-a965-144f9c6069e9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.208660 Oct 04 18:06:38.169441 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 685/1400] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c/os-volume_attachments => generated 25 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:38.328794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7554561c-3f51-4e94-86f5-2035b3bae710 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.329364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7554561c-3f51-4e94-86f5-2035b3bae710 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.340836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7554561c-3f51-4e94-86f5-2035b3bae710 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.351594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7554561c-3f51-4e94-86f5-2035b3bae710 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.353911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7554561c-3f51-4e94-86f5-2035b3bae710 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.355199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7554561c-3f51-4e94-86f5-2035b3bae710 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.355860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7554561c-3f51-4e94-86f5-2035b3bae710 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.356470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7554561c-3f51-4e94-86f5-2035b3bae710 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.405815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7554561c-3f51-4e94-86f5-2035b3bae710 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:38.537014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:38.589331 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7554561c-3f51-4e94-86f5-2035b3bae710 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 204 len: 0 microversion: 2.1 time: 0.264886 Oct 04 18:06:38.600450 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 716/1401] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:38 2022] DELETE /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:38.619314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ad72125-9206-4a0a-a782-70bb6ad77ec9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.620530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ad72125-9206-4a0a-a782-70bb6ad77ec9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.637154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ad72125-9206-4a0a-a782-70bb6ad77ec9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.637925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ad72125-9206-4a0a-a782-70bb6ad77ec9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.645076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ad72125-9206-4a0a-a782-70bb6ad77ec9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.646690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ad72125-9206-4a0a-a782-70bb6ad77ec9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.647387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ad72125-9206-4a0a-a782-70bb6ad77ec9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.648000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ad72125-9206-4a0a-a782-70bb6ad77ec9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.862905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-890a8f60-e7eb-46bd-af27-3083aab32c87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.863651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-890a8f60-e7eb-46bd-af27-3083aab32c87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.879445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-890a8f60-e7eb-46bd-af27-3083aab32c87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.880232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-890a8f60-e7eb-46bd-af27-3083aab32c87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.881380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-890a8f60-e7eb-46bd-af27-3083aab32c87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.882275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-890a8f60-e7eb-46bd-af27-3083aab32c87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.882891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-890a8f60-e7eb-46bd-af27-3083aab32c87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.883576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-890a8f60-e7eb-46bd-af27-3083aab32c87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.133525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ad72125-9206-4a0a-a782-70bb6ad77ec9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.147990 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ad72125-9206-4a0a-a782-70bb6ad77ec9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1682 microversion: 2.1 time: 0.543080 Oct 04 18:06:39.151225 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 686/1402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1682 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:39.160568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.162188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] [instance: 3b9f193d-65a7-48df-96b4-ee57115149a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.180768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.181992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.181992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.182566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.183211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.183525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.217264 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] HTTP exception thrown: Instance 3b9f193d-65a7-48df-96b4-ee57115149a2 could not be found. Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Request method failure captured: Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 HTTP/1.1 Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHXZurKJ8CRpr-mwYCTtVegSMemxdZulC5hJgfklo7cBx9JMkhqFKp_j85dnRv48EkmfjmqDNvJEljQIdpfJtuiI_KS7nTACkLC6Kd23ixQFk9OH8uoHWrorOoXw1UvFTuU3tUlIc5L_03jD2QtkrgbiKxOwJs-VRql2JoJbJG_W76Y Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9347f6d02b614c0d85ece3ec91521bd4 Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesOneServerTestJSON-755622534 Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:06:39.219119 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9347f6d02b614c0d85ece3ec91521bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9347f6d02b614c0d85ece3ec91521bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9347f6d02b614c0d85ece3ec91521bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9347f6d02b614c0d85ece3ec91521bd4"}]}] Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesOneServerTestJSON-755622534 Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9347f6d02b614c0d85ece3ec91521bd4 Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-755622534 Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesOneServerTestJSON-755622534-project Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 424cdee7a8ef4100b600b8a59f8f7394 Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesOneServerTestJSON-755622534-project Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 3b9f193d-65a7-48df-96b4-ee57115149a2 could not be found. Oct 04 18:06:39.220501 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '3b9f193d-65a7-48df-96b4-ee57115149a2'} Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9f193d-65a7-48df-96b4-ee57115149a2 could not be found. Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:39.221289 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9f193d-65a7-48df-96b4-ee57115149a2 could not be found. Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9f193d-65a7-48df-96b4-ee57115149a2 could not be found. Oct 04 18:06:39.222537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:39.223788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] Returning 404 to user: Instance 3b9f193d-65a7-48df-96b4-ee57115149a2 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:39.230248 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f81d2aa0-3c4b-42c4-baca-c34310fcb6dd tempest-ImagesOneServerTestJSON-755622534 tempest-ImagesOneServerTestJSON-755622534-project] 10.222.0.18 "GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2" status: 404 len: 111 microversion: 2.1 time: 0.071421 Oct 04 18:06:39.230248 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 687/1403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/3b9f193d-65a7-48df-96b4-ee57115149a2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:39.242632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f7d20a25-5535-4c44-aada-137bb38925b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.250178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f7d20a25-5535-4c44-aada-137bb38925b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.270524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d20a25-5535-4c44-aada-137bb38925b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.279260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d20a25-5535-4c44-aada-137bb38925b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.289733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d20a25-5535-4c44-aada-137bb38925b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.290860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d20a25-5535-4c44-aada-137bb38925b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.295291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d20a25-5535-4c44-aada-137bb38925b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.296373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d20a25-5535-4c44-aada-137bb38925b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.375937 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f7d20a25-5535-4c44-aada-137bb38925b0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145680 Oct 04 18:06:39.382620 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 688/1404] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:39.613225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-890a8f60-e7eb-46bd-af27-3083aab32c87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.640272 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-890a8f60-e7eb-46bd-af27-3083aab32c87 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.780852 Oct 04 18:06:39.643992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 717/1405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:40.181109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5acc81b9-69ed-4f16-9023-5288fcb48e4f tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.181617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5acc81b9-69ed-4f16-9023-5288fcb48e4f tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:40.205961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5acc81b9-69ed-4f16-9023-5288fcb48e4f tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.207504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5acc81b9-69ed-4f16-9023-5288fcb48e4f tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.208216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5acc81b9-69ed-4f16-9023-5288fcb48e4f tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.216586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5acc81b9-69ed-4f16-9023-5288fcb48e4f tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.217901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5acc81b9-69ed-4f16-9023-5288fcb48e4f tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.218736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5acc81b9-69ed-4f16-9023-5288fcb48e4f tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.389550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac7a43e2-b186-4d37-82e4-54e94a5b194a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.392614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac7a43e2-b186-4d37-82e4-54e94a5b194a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:40.404315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac7a43e2-b186-4d37-82e4-54e94a5b194a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.415030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac7a43e2-b186-4d37-82e4-54e94a5b194a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.415868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac7a43e2-b186-4d37-82e4-54e94a5b194a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.416993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac7a43e2-b186-4d37-82e4-54e94a5b194a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.417751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac7a43e2-b186-4d37-82e4-54e94a5b194a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.418678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac7a43e2-b186-4d37-82e4-54e94a5b194a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.543811 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac7a43e2-b186-4d37-82e4-54e94a5b194a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157703 Oct 04 18:06:40.553264 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 718/1406] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:40.673896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2556437b-cdfa-447e-9403-c8d4f4421a67 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.674776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2556437b-cdfa-447e-9403-c8d4f4421a67 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:40.684028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2556437b-cdfa-447e-9403-c8d4f4421a67 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.684871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2556437b-cdfa-447e-9403-c8d4f4421a67 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.685403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2556437b-cdfa-447e-9403-c8d4f4421a67 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.686406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2556437b-cdfa-447e-9403-c8d4f4421a67 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.687356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2556437b-cdfa-447e-9403-c8d4f4421a67 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.688282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2556437b-cdfa-447e-9403-c8d4f4421a67 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.743907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5acc81b9-69ed-4f16-9023-5288fcb48e4f tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:40.772745 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5acc81b9-69ed-4f16-9023-5288fcb48e4f tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1682 microversion: 2.1 time: 0.596153 Oct 04 18:06:40.773993 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 689/1407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1682 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:41.060288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2556437b-cdfa-447e-9403-c8d4f4421a67 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:41.072490 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2556437b-cdfa-447e-9403-c8d4f4421a67 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.406354 Oct 04 18:06:41.073343 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 719/1408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:41.562396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42c2f3ff-f48c-4a53-aa6d-af840a889d46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:41.565259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42c2f3ff-f48c-4a53-aa6d-af840a889d46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:41.590396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2f3ff-f48c-4a53-aa6d-af840a889d46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.592386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2f3ff-f48c-4a53-aa6d-af840a889d46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.594492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2f3ff-f48c-4a53-aa6d-af840a889d46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.598090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2f3ff-f48c-4a53-aa6d-af840a889d46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.600924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2f3ff-f48c-4a53-aa6d-af840a889d46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.602334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2f3ff-f48c-4a53-aa6d-af840a889d46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.692087 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42c2f3ff-f48c-4a53-aa6d-af840a889d46 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137774 Oct 04 18:06:41.703329 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 690/1409] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:41 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:41.802302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0fe1c1f0-3e40-4cf0-ad34-7b042a91ccdc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:41.803082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0fe1c1f0-3e40-4cf0-ad34-7b042a91ccdc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:41.831356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fe1c1f0-3e40-4cf0-ad34-7b042a91ccdc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.832435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fe1c1f0-3e40-4cf0-ad34-7b042a91ccdc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.833249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fe1c1f0-3e40-4cf0-ad34-7b042a91ccdc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.834258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fe1c1f0-3e40-4cf0-ad34-7b042a91ccdc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.834880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fe1c1f0-3e40-4cf0-ad34-7b042a91ccdc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.835679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fe1c1f0-3e40-4cf0-ad34-7b042a91ccdc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.101649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cda7e409-2126-4706-9a9e-7020a3ef3b8d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:42.131016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cda7e409-2126-4706-9a9e-7020a3ef3b8d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:42.131016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cda7e409-2126-4706-9a9e-7020a3ef3b8d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.131016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cda7e409-2126-4706-9a9e-7020a3ef3b8d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.131016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cda7e409-2126-4706-9a9e-7020a3ef3b8d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.131689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cda7e409-2126-4706-9a9e-7020a3ef3b8d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.131689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cda7e409-2126-4706-9a9e-7020a3ef3b8d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.131689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cda7e409-2126-4706-9a9e-7020a3ef3b8d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.181649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cda7e409-2126-4706-9a9e-7020a3ef3b8d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:43.194921 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cda7e409-2126-4706-9a9e-7020a3ef3b8d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 1.098372 Oct 04 18:06:43.217459 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 691/1410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:42 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:43.224950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b7d433df-166b-4138-9a86-ff252ae8abde tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:43.227873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b7d433df-166b-4138-9a86-ff252ae8abde tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:43.236318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7d433df-166b-4138-9a86-ff252ae8abde tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.237545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7d433df-166b-4138-9a86-ff252ae8abde tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.237878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7d433df-166b-4138-9a86-ff252ae8abde tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.239017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7d433df-166b-4138-9a86-ff252ae8abde tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.240319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7d433df-166b-4138-9a86-ff252ae8abde tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.241199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7d433df-166b-4138-9a86-ff252ae8abde tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.257733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0fe1c1f0-3e40-4cf0-ad34-7b042a91ccdc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:43.275768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0fe1c1f0-3e40-4cf0-ad34-7b042a91ccdc tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1682 microversion: 2.1 time: 1.477981 Oct 04 18:06:43.283718 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 720/1411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:41 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1682 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:43.297641 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b7d433df-166b-4138-9a86-ff252ae8abde tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078528 Oct 04 18:06:43.307603 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 692/1412] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:43 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:43.732360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-8b64235b-cd92-4339-835a-23e82a5c1edd req-5636c281-550d-45c1-92ea-25cdb39af9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc68e22-19de-42cd-aae6-efc5d6218e8c", "name": "network-vif-deleted", "tag": "c2427d5a-9159-4150-8502-801eeb7afc45"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:43.751845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8b64235b-cd92-4339-835a-23e82a5c1edd req-5636c281-550d-45c1-92ea-25cdb39af9d3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.752712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8b64235b-cd92-4339-835a-23e82a5c1edd req-5636c281-550d-45c1-92ea-25cdb39af9d3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.753511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8b64235b-cd92-4339-835a-23e82a5c1edd req-5636c281-550d-45c1-92ea-25cdb39af9d3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.776220 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-8b64235b-cd92-4339-835a-23e82a5c1edd req-5636c281-550d-45c1-92ea-25cdb39af9d3 service nova] Creating event network-vif-deleted:c2427d5a-9159-4150-8502-801eeb7afc45 for instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c on n-h1-850499-14 Oct 04 18:06:43.784881 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-8b64235b-cd92-4339-835a-23e82a5c1edd req-5636c281-550d-45c1-92ea-25cdb39af9d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058149 Oct 04 18:06:43.791456 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 721/1413] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:44.225794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3f1207b1-760e-4d2d-a72d-594ae8bbf169 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.226969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3f1207b1-760e-4d2d-a72d-594ae8bbf169 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:44.239743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f1207b1-760e-4d2d-a72d-594ae8bbf169 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.243865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f1207b1-760e-4d2d-a72d-594ae8bbf169 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.247280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f1207b1-760e-4d2d-a72d-594ae8bbf169 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.248382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f1207b1-760e-4d2d-a72d-594ae8bbf169 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.250900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f1207b1-760e-4d2d-a72d-594ae8bbf169 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.254816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f1207b1-760e-4d2d-a72d-594ae8bbf169 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.310830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce4b5474-eabf-400c-a4be-32d2c52cff11 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.313581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ce4b5474-eabf-400c-a4be-32d2c52cff11 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:44.328692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce4b5474-eabf-400c-a4be-32d2c52cff11 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.340736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce4b5474-eabf-400c-a4be-32d2c52cff11 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.341495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce4b5474-eabf-400c-a4be-32d2c52cff11 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.342446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce4b5474-eabf-400c-a4be-32d2c52cff11 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.342912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce4b5474-eabf-400c-a4be-32d2c52cff11 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.352970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce4b5474-eabf-400c-a4be-32d2c52cff11 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.429814 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ce4b5474-eabf-400c-a4be-32d2c52cff11 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123387 Oct 04 18:06:44.474454 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 722/1414] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:44.481116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.482040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:44.497535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.498353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.499028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.500613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.501268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.504374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.589969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3f1207b1-760e-4d2d-a72d-594ae8bbf169 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:44.607990 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3f1207b1-760e-4d2d-a72d-594ae8bbf169 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.385967 Oct 04 18:06:44.623540 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 693/1415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:44.629951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.634388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.635274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.635985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lazy-loading 'fault' on Instance uuid 2bc68e22-19de-42cd-aae6-efc5d6218e8c {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:44.713612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d2223fbb374de8bf6792e8187e9c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa1267514574b10b88edc89c547c727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:44.733388 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-acebe0fa-b42f-47f6-b03e-afdef063a815 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 200 len: 1331 microversion: 2.1 time: 0.247933 Oct 04 18:06:44.734655 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 723/1416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 1331 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:45.045845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-961572193", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": "none"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:45.204802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:45.206694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:45.209604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:45.217058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:45.218200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:45.236609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.252435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.253288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.254350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.256911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.257958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.316383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Getting quotas for project 08a6c48bdde84fb49996b12ff2d70315. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:45.331498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Getting quotas for user 72f39a6a738045f592734b36a265febd and project 08a6c48bdde84fb49996b12ff2d70315. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:45.335718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:45.352195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:45.355907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:45.473581 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c0920f89-118d-48ab-842a-526a0c815e78 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.691414 Oct 04 18:06:45.477647 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 694/1417] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:06:45.492577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e8be4cf-3bcc-48df-b5c9-d4a88908e4e3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.510729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b3e3748c-422c-4a36-8820-ac7d6312c931 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.511138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e8be4cf-3bcc-48df-b5c9-d4a88908e4e3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.513466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b3e3748c-422c-4a36-8820-ac7d6312c931 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.541233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e8be4cf-3bcc-48df-b5c9-d4a88908e4e3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.546328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e8be4cf-3bcc-48df-b5c9-d4a88908e4e3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.551265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e8be4cf-3bcc-48df-b5c9-d4a88908e4e3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.552953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e8be4cf-3bcc-48df-b5c9-d4a88908e4e3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.556708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e8be4cf-3bcc-48df-b5c9-d4a88908e4e3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.558225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e8be4cf-3bcc-48df-b5c9-d4a88908e4e3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.662867 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e8be4cf-3bcc-48df-b5c9-d4a88908e4e3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179639 Oct 04 18:06:45.664299 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 724/1418] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:45.670431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0fef7608-7814-4b9b-8709-332dd86457f3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.671483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0fef7608-7814-4b9b-8709-332dd86457f3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.679248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fef7608-7814-4b9b-8709-332dd86457f3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.680336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fef7608-7814-4b9b-8709-332dd86457f3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.681111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fef7608-7814-4b9b-8709-332dd86457f3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.682238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fef7608-7814-4b9b-8709-332dd86457f3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.682948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fef7608-7814-4b9b-8709-332dd86457f3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.684289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fef7608-7814-4b9b-8709-332dd86457f3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.768233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3e3748c-422c-4a36-8820-ac7d6312c931 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:45.797934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3e3748c-422c-4a36-8820-ac7d6312c931 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:45.803337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3e3748c-422c-4a36-8820-ac7d6312c931 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:45.827859 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b3e3748c-422c-4a36-8820-ac7d6312c931 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1452 microversion: 2.91 time: 0.331336 Oct 04 18:06:45.830453 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 695/1419] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1452 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:45.844319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.846935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.873863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.877616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.878084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.878867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.879573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.880127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.957283 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] HTTP exception thrown: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Request method failure captured: Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c HTTP/1.1 Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHV1fiLqnwoEb9VHXYSwPU9ctJx-5Ydho2KIUBHTfKv_uW7ONMctrxRhYYhSrsMcnYisftwEuN7xvg8gKyxndybmHLChw2h9VfPpzkoYPjFlZVZduWJUA6--52t4MokVxCpYpGZOkTQ0hEa8vjyJyj2VboR1Jfk5dmHj6UZyAo7jOgI Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 1aa1267514574b10b88edc89c547c727 Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1163464557 Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:06:45.959513 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1aa1267514574b10b88edc89c547c727"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1aa1267514574b10b88edc89c547c727"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1aa1267514574b10b88edc89c547c727"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1aa1267514574b10b88edc89c547c727"}]}] Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1163464557 Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 1aa1267514574b10b88edc89c547c727 Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1163464557 Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachSCSIVolumeTestJSON-1163464557-project Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 72d2223fbb374de8bf6792e8187e9c08 Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1163464557-project Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:06:45.961286 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '2bc68e22-19de-42cd-aae6-efc5d6218e8c'} Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:45.962335 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:06:45.963780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:06:45.969408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Returning 404 to user: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:45.974405 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4fbd50bf-cba9-4dad-8fdb-a3c6eff572b6 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 404 len: 111 microversion: 2.1 time: 0.139063 Oct 04 18:06:45.976521 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 696/1420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:45.987788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1458015898", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "9c70f707-ae67-44fe-b78d-3b8c38ae1bf8"}, {"uuid": "d97c17b7-2dd7-4509-b26f-23b004afb301"}, {"uuid": "9c70f707-ae67-44fe-b78d-3b8c38ae1bf8"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:46.123883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] validate_networks() for [('9c70f707-ae67-44fe-b78d-3b8c38ae1bf8', None, None, None, None, None), ('d97c17b7-2dd7-4509-b26f-23b004afb301', None, None, None, None, None), ('9c70f707-ae67-44fe-b78d-3b8c38ae1bf8', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:46.133576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0fef7608-7814-4b9b-8709-332dd86457f3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.153100 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0fef7608-7814-4b9b-8709-332dd86457f3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.487388 Oct 04 18:06:46.172118 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 725/1421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:46.185789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-83f879ce-fd33-492b-bcd5-b40fd0842867 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '.version_select at 0x7fd4d1b41a60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:46.233984 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-83f879ce-fd33-492b-bcd5-b40fd0842867 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-101376571" status: 202 len: 0 microversion: 2.1 time: 0.056596 Oct 04 18:06:46.235268 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 726/1422] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 4 18:06:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-101376571 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:46.683312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d30d72e1-ab82-4196-a68e-d25994fef2f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:46.709277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d30d72e1-ab82-4196-a68e-d25994fef2f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:46.746395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d30d72e1-ab82-4196-a68e-d25994fef2f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.747547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d30d72e1-ab82-4196-a68e-d25994fef2f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.748014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d30d72e1-ab82-4196-a68e-d25994fef2f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.750039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d30d72e1-ab82-4196-a68e-d25994fef2f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.751988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d30d72e1-ab82-4196-a68e-d25994fef2f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.753644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d30d72e1-ab82-4196-a68e-d25994fef2f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.884681 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d30d72e1-ab82-4196-a68e-d25994fef2f3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212391 Oct 04 18:06:46.886090 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 727/1423] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:46 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:46.894887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:46.901017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:46.917162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.918059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.919126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.928377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.929736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.931737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.402664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.417589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.430929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.456702 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a01685a1-0504-4323-9fe8-72818639d4d6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1456 microversion: 2.91 time: 0.565741 Oct 04 18:06:47.457317 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 728/1424] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:46 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1456 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:47.480254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-850189ce-e074-4d00-9dfd-e9f837693177 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:47.481367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-850189ce-e074-4d00-9dfd-e9f837693177 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:47.504052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-850189ce-e074-4d00-9dfd-e9f837693177 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.505057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-850189ce-e074-4d00-9dfd-e9f837693177 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.506453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-850189ce-e074-4d00-9dfd-e9f837693177 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.513720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-850189ce-e074-4d00-9dfd-e9f837693177 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.514565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-850189ce-e074-4d00-9dfd-e9f837693177 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.515235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-850189ce-e074-4d00-9dfd-e9f837693177 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.337251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-850189ce-e074-4d00-9dfd-e9f837693177 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:48.380135 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-850189ce-e074-4d00-9dfd-e9f837693177 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.916658 Oct 04 18:06:48.384087 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 729/1425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:47 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:48.417256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-da2fc036-cced-4add-a9ad-838e0a38f258 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9b8e6f9-78a7-4056-b90b-5210ea8553bd"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:48.430920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-da2fc036-cced-4add-a9ad-838e0a38f258 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:48.461991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da2fc036-cced-4add-a9ad-838e0a38f258 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.463891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da2fc036-cced-4add-a9ad-838e0a38f258 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.466736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da2fc036-cced-4add-a9ad-838e0a38f258 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.467822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da2fc036-cced-4add-a9ad-838e0a38f258 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.469199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da2fc036-cced-4add-a9ad-838e0a38f258 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.471404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da2fc036-cced-4add-a9ad-838e0a38f258 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.232425 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-da2fc036-cced-4add-a9ad-838e0a38f258 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "POST /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840707 Oct 04 18:06:49.236769 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 730/1426] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:06:48 2022] POST /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:49.257780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-922558de-fb58-4480-be56-c94345238242 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.279155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-922558de-fb58-4480-be56-c94345238242 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:49.313413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922558de-fb58-4480-be56-c94345238242 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.313927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922558de-fb58-4480-be56-c94345238242 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.314373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922558de-fb58-4480-be56-c94345238242 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.328348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922558de-fb58-4480-be56-c94345238242 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.329089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922558de-fb58-4480-be56-c94345238242 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.329419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922558de-fb58-4480-be56-c94345238242 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.478202 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-922558de-fb58-4480-be56-c94345238242 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.239964 Oct 04 18:06:49.495131 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 731/1427] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace/os-volume_attachments => generated 25 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:49.514714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ba084774-0bd8-4248-a862-e226e68cbfc1 req-644c51c3-69e4-4aae-a274-3a64ff4cee0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b522e60-ef39-4497-8da3-023eac9859af", "name": "network-vif-plugged", "status": "completed", "tag": "f59d0713-eb06-474f-8c60-34c2e6eaf606"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:49.565176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ba084774-0bd8-4248-a862-e226e68cbfc1 req-644c51c3-69e4-4aae-a274-3a64ff4cee0f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.565380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ba084774-0bd8-4248-a862-e226e68cbfc1 req-644c51c3-69e4-4aae-a274-3a64ff4cee0f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.565818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ba084774-0bd8-4248-a862-e226e68cbfc1 req-644c51c3-69e4-4aae-a274-3a64ff4cee0f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.598554 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ba084774-0bd8-4248-a862-e226e68cbfc1 req-644c51c3-69e4-4aae-a274-3a64ff4cee0f service nova] Creating event network-vif-plugged:f59d0713-eb06-474f-8c60-34c2e6eaf606 for instance 4b522e60-ef39-4497-8da3-023eac9859af on n-h2-850499-14 Oct 04 18:06:49.645703 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ba084774-0bd8-4248-a862-e226e68cbfc1 req-644c51c3-69e4-4aae-a274-3a64ff4cee0f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147185 Oct 04 18:06:49.668905 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 732/1428] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:49.709599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.728033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:49.749688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.760803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.763047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.765131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.772121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.774139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.888649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:49.889540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:49.890181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:49.898648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:49.898648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:49.949481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.953927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.954556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.956865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.958208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.959788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.980596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.019490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.021629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.052828 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b0bfb97e-0599-42bb-a305-de5cb155917e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1510 microversion: 2.91 time: 0.381718 Oct 04 18:06:50.064175 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 733/1429] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1510 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:50.067356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Getting quotas for project 4839e26fbc244802b56f2b0289410041. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:50.092534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Getting quotas for user 29738c2533554939a890fad96acc1bef and project 4839e26fbc244802b56f2b0289410041. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:50.109370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3aea2454-f73e-4b1a-9997-3c4bbb2ab806 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.112054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3aea2454-f73e-4b1a-9997-3c4bbb2ab806 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.135154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aea2454-f73e-4b1a-9997-3c4bbb2ab806 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.139901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aea2454-f73e-4b1a-9997-3c4bbb2ab806 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.141926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:50.144331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aea2454-f73e-4b1a-9997-3c4bbb2ab806 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.147117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:50.148523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aea2454-f73e-4b1a-9997-3c4bbb2ab806 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.150947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aea2454-f73e-4b1a-9997-3c4bbb2ab806 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.157694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aea2454-f73e-4b1a-9997-3c4bbb2ab806 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.182817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:50.331931 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d4872cea-4054-4609-a9d4-2f0747035671 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.352733 Oct 04 18:06:50.337922 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 697/1430] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:50.350677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75df0704-6ea4-42ac-9efe-4e1c7519d748 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.351351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75df0704-6ea4-42ac-9efe-4e1c7519d748 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.631911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75df0704-6ea4-42ac-9efe-4e1c7519d748 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.697143 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75df0704-6ea4-42ac-9efe-4e1c7519d748 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1213 microversion: 2.1 time: 0.351959 Oct 04 18:06:50.704540 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 698/1431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1213 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:50.904123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3aea2454-f73e-4b1a-9997-3c4bbb2ab806 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.920073 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3aea2454-f73e-4b1a-9997-3c4bbb2ab806 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.853667 Oct 04 18:06:50.933082 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 734/1432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:51.104199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.104840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.121559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.124827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.127717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.128614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.129206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.129407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.355205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.377390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.390147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.409085 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-14b5b0db-3d96-4146-90fe-b0333cccdf70 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1510 microversion: 2.91 time: 0.318384 Oct 04 18:06:51.415348 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 699/1433] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1510 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:51.731689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9937b609-7212-4ce9-bc94-bf39d7759cb5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.732393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9937b609-7212-4ce9-bc94-bf39d7759cb5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.768809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:51.948262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f4aa2d0-07da-4b17-9634-4466cbc9a3d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.949058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0f4aa2d0-07da-4b17-9634-4466cbc9a3d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.975422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9937b609-7212-4ce9-bc94-bf39d7759cb5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.978856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4aa2d0-07da-4b17-9634-4466cbc9a3d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.983354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4aa2d0-07da-4b17-9634-4466cbc9a3d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.984020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4aa2d0-07da-4b17-9634-4466cbc9a3d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.986240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4aa2d0-07da-4b17-9634-4466cbc9a3d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.986945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4aa2d0-07da-4b17-9634-4466cbc9a3d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.987253 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9937b609-7212-4ce9-bc94-bf39d7759cb5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1213 microversion: 2.1 time: 0.259133 Oct 04 18:06:51.989057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4aa2d0-07da-4b17-9634-4466cbc9a3d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.990419 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 735/1434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1213 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:52.453651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.454858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.492085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.494433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.494912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.503028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.503538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.512221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.667714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0f4aa2d0-07da-4b17-9634-4466cbc9a3d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.678279 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0f4aa2d0-07da-4b17-9634-4466cbc9a3d8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1313 microversion: 2.1 time: 0.733859 Oct 04 18:06:52.685754 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 700/1435] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1313 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:52.846780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.859255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.863142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.882023 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed514342-8a44-4211-a018-3efc59eb9097 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1531 microversion: 2.91 time: 0.433270 Oct 04 18:06:52.896240 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 736/1436] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1531 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:53.013410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-39c67443-def7-4e86-9f55-4b98ac29f25c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.014498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-39c67443-def7-4e86-9f55-4b98ac29f25c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.033854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39c67443-def7-4e86-9f55-4b98ac29f25c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.034392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39c67443-def7-4e86-9f55-4b98ac29f25c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.034931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39c67443-def7-4e86-9f55-4b98ac29f25c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.035704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39c67443-def7-4e86-9f55-4b98ac29f25c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.036766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39c67443-def7-4e86-9f55-4b98ac29f25c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.037203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39c67443-def7-4e86-9f55-4b98ac29f25c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.086171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5c480ca9-46f6-4864-a811-efc2070405e5 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.087141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5c480ca9-46f6-4864-a811-efc2070405e5 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.112341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c480ca9-46f6-4864-a811-efc2070405e5 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.136250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c480ca9-46f6-4864-a811-efc2070405e5 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.137129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c480ca9-46f6-4864-a811-efc2070405e5 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.138092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c480ca9-46f6-4864-a811-efc2070405e5 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.138743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c480ca9-46f6-4864-a811-efc2070405e5 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.139366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c480ca9-46f6-4864-a811-efc2070405e5 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.212471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-39c67443-def7-4e86-9f55-4b98ac29f25c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:53.221898 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-39c67443-def7-4e86-9f55-4b98ac29f25c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1265 microversion: 2.1 time: 0.214157 Oct 04 18:06:53.240883 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 737/1437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:53.330388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-5c480ca9-46f6-4864-a811-efc2070405e5 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lazy-loading 'services' on Instance uuid 11187b54-8f68-40db-b316-f1cfba27eb35 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:53.378731 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5c480ca9-46f6-4864-a811-efc2070405e5 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1938 microversion: 2.91 time: 0.467095 Oct 04 18:06:53.397295 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 701/1438] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1938 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:53.424431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b39043ff-ba71-4bb1-aed0-f002f485fb74 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.429039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b39043ff-ba71-4bb1-aed0-f002f485fb74 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.478733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39043ff-ba71-4bb1-aed0-f002f485fb74 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.479290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39043ff-ba71-4bb1-aed0-f002f485fb74 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.479742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39043ff-ba71-4bb1-aed0-f002f485fb74 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.480486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39043ff-ba71-4bb1-aed0-f002f485fb74 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.480955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39043ff-ba71-4bb1-aed0-f002f485fb74 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.481394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39043ff-ba71-4bb1-aed0-f002f485fb74 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.708072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4331ba58-9a2b-4375-9250-4d80ab631b0b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.709869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4331ba58-9a2b-4375-9250-4d80ab631b0b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.723512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4331ba58-9a2b-4375-9250-4d80ab631b0b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.724363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4331ba58-9a2b-4375-9250-4d80ab631b0b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.725102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4331ba58-9a2b-4375-9250-4d80ab631b0b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.726130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4331ba58-9a2b-4375-9250-4d80ab631b0b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.727527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4331ba58-9a2b-4375-9250-4d80ab631b0b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.733147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4331ba58-9a2b-4375-9250-4d80ab631b0b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.813257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-b39043ff-ba71-4bb1-aed0-f002f485fb74 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lazy-loading 'services' on Instance uuid 11187b54-8f68-40db-b316-f1cfba27eb35 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:53.904347 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b39043ff-ba71-4bb1-aed0-f002f485fb74 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1938 microversion: 2.91 time: 0.489056 Oct 04 18:06:53.919357 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 738/1439] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1938 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:53.949819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d9a0822-d2f7-4806-9587-8695d27efb0d tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.973393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d9a0822-d2f7-4806-9587-8695d27efb0d tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.974497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d9a0822-d2f7-4806-9587-8695d27efb0d tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.975081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d9a0822-d2f7-4806-9587-8695d27efb0d tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.975935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d9a0822-d2f7-4806-9587-8695d27efb0d tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.976406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d9a0822-d2f7-4806-9587-8695d27efb0d tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.976835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d9a0822-d2f7-4806-9587-8695d27efb0d tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.068291 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d9a0822-d2f7-4806-9587-8695d27efb0d tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.122402 Oct 04 18:06:54.078401 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 739/1440] 10.222.0.18 () {60 vars in 1217 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:06:54.089128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-53dc5a56-9676-46d4-a4ad-a3ce23fb30ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:54.099853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-53dc5a56-9676-46d4-a4ad-a3ce23fb30ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.118246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53dc5a56-9676-46d4-a4ad-a3ce23fb30ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.118751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53dc5a56-9676-46d4-a4ad-a3ce23fb30ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.119226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53dc5a56-9676-46d4-a4ad-a3ce23fb30ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.119943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53dc5a56-9676-46d4-a4ad-a3ce23fb30ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.120406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53dc5a56-9676-46d4-a4ad-a3ce23fb30ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.120839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53dc5a56-9676-46d4-a4ad-a3ce23fb30ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.182098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-53dc5a56-9676-46d4-a4ad-a3ce23fb30ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lazy-loading 'flavor' on Instance uuid 11187b54-8f68-40db-b316-f1cfba27eb35 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:54.473267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4331ba58-9a2b-4375-9250-4d80ab631b0b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.487039 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4331ba58-9a2b-4375-9250-4d80ab631b0b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1462 microversion: 2.1 time: 0.785925 Oct 04 18:06:54.511199 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 702/1441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1462 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:54.522163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a5cdf64-d714-4607-952d-2b2d1bf622cb tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.526640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8a5cdf64-d714-4607-952d-2b2d1bf622cb tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.548609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a5cdf64-d714-4607-952d-2b2d1bf622cb tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.549447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a5cdf64-d714-4607-952d-2b2d1bf622cb tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.551464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a5cdf64-d714-4607-952d-2b2d1bf622cb tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.555504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a5cdf64-d714-4607-952d-2b2d1bf622cb tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.559909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a5cdf64-d714-4607-952d-2b2d1bf622cb tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.564874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a5cdf64-d714-4607-952d-2b2d1bf622cb tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.682501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-53dc5a56-9676-46d4-a4ad-a3ce23fb30ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "POST /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35/action" status: 202 len: 0 microversion: 2.91 time: 0.597449 Oct 04 18:06:54.686908 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 740/1442] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:06:54 2022] POST /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:54.695746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db1f117f-9dd6-4005-860e-498394c15b57 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.700030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-db1f117f-9dd6-4005-860e-498394c15b57 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.724262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1f117f-9dd6-4005-860e-498394c15b57 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.724262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1f117f-9dd6-4005-860e-498394c15b57 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.724989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1f117f-9dd6-4005-860e-498394c15b57 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.725139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1f117f-9dd6-4005-860e-498394c15b57 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.725764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1f117f-9dd6-4005-860e-498394c15b57 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.726372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1f117f-9dd6-4005-860e-498394c15b57 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.784425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a5cdf64-d714-4607-952d-2b2d1bf622cb tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.812428 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a5cdf64-d714-4607-952d-2b2d1bf622cb tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1271 microversion: 2.1 time: 0.299525 Oct 04 18:06:54.814466 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 703/1443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1271 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:54.830770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.832151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.851320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.853034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.854284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.856571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.857381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.858095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.872329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:55.227936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.242006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.248001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.279022 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8296875b-470f-41d7-bd12-c6b48d657d1a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.462575 Oct 04 18:06:55.300952 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 704/1444] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:55.530980 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-db1f117f-9dd6-4005-860e-498394c15b57 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1615 microversion: 2.1 time: 0.831892 Oct 04 18:06:55.530980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 741/1445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1615 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:55.557688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:55.558280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:55.576836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.577343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.584641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.591039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.591503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.591948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.843703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f19dc0fc-cdfa-43ea-b2ad-494b9a93a5ab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:55.844326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f19dc0fc-cdfa-43ea-b2ad-494b9a93a5ab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:55.863150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19dc0fc-cdfa-43ea-b2ad-494b9a93a5ab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.863901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19dc0fc-cdfa-43ea-b2ad-494b9a93a5ab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.865050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19dc0fc-cdfa-43ea-b2ad-494b9a93a5ab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.865819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19dc0fc-cdfa-43ea-b2ad-494b9a93a5ab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.866313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19dc0fc-cdfa-43ea-b2ad-494b9a93a5ab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.866724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19dc0fc-cdfa-43ea-b2ad-494b9a93a5ab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.955500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e6e24f05339f436f8828a49f3d305a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e148e2e0d4b25b3d2603006aa729d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.956321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] flavor_id is None. Assuming migration. {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:06:55.969525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:06:57.202245 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f82b29c-647b-4907-8f1c-a8a6630860b9 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af/action" status: 202 len: 0 microversion: 2.1 time: 1.645802 Oct 04 18:06:57.210098 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 705/1446] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:55 2022] POST /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af/action => generated 0 bytes in 1658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:57.246301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:57.247756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:57.257565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.258515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.259430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.260580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.262100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.262884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.663172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.690127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.696167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.741704 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce71faee-e5d5-4d0f-b7af-f6d61b5fdaa9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.513782 Oct 04 18:06:57.747932 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 706/1447] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:57 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:57.769309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5762ff64-cb05-49ba-9def-a6d0e226b718 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:57.781615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5762ff64-cb05-49ba-9def-a6d0e226b718 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:57.798382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5762ff64-cb05-49ba-9def-a6d0e226b718 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.807616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5762ff64-cb05-49ba-9def-a6d0e226b718 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.809359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5762ff64-cb05-49ba-9def-a6d0e226b718 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.812093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5762ff64-cb05-49ba-9def-a6d0e226b718 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.815500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5762ff64-cb05-49ba-9def-a6d0e226b718 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.819554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5762ff64-cb05-49ba-9def-a6d0e226b718 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.052378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f19dc0fc-cdfa-43ea-b2ad-494b9a93a5ab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:58.069094 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f19dc0fc-cdfa-43ea-b2ad-494b9a93a5ab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1313 microversion: 2.1 time: 2.229752 Oct 04 18:06:58.074032 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 742/1448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:55 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1313 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:58.433322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1554845264", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "c5519c6a-88b3-4e11-a279-e6dbd711c38c"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:58.586395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] validate_networks() for [('c5519c6a-88b3-4e11-a279-e6dbd711c38c', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:59.101629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5762ff64-cb05-49ba-9def-a6d0e226b718 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.111740 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5762ff64-cb05-49ba-9def-a6d0e226b718 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1471 microversion: 2.1 time: 1.362464 Oct 04 18:06:59.127548 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 707/1449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:57 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1471 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:59.143306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:59.144339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:59.170292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.171793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.174826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.177696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.182750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.185570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.486173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.515010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.523019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.538788 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-22e62a72-68f2-4cab-b8b2-0b3a7121359a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.409613 Oct 04 18:06:59.549175 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 708/1450] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:59 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:59.565779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8bd0553f-e89b-4add-adb2-024873f8a500 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:59.567597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8bd0553f-e89b-4add-adb2-024873f8a500 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:59.595679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bd0553f-e89b-4add-adb2-024873f8a500 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.596246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bd0553f-e89b-4add-adb2-024873f8a500 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.596713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bd0553f-e89b-4add-adb2-024873f8a500 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.597444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bd0553f-e89b-4add-adb2-024873f8a500 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.597922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bd0553f-e89b-4add-adb2-024873f8a500 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.598373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bd0553f-e89b-4add-adb2-024873f8a500 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.003744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:00.695312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=16 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:00.931493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8bd0553f-e89b-4add-adb2-024873f8a500 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:00.982696 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8bd0553f-e89b-4add-adb2-024873f8a500 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1313 microversion: 2.1 time: 1.432099 Oct 04 18:07:00.987693 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 709/1451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:59 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1313 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:01.010300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e804ebe2-87ad-44ac-a256-59be3c719252 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.026027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e804ebe2-87ad-44ac-a256-59be3c719252 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.060852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e804ebe2-87ad-44ac-a256-59be3c719252 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.069009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e804ebe2-87ad-44ac-a256-59be3c719252 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.074662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e804ebe2-87ad-44ac-a256-59be3c719252 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.077033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e804ebe2-87ad-44ac-a256-59be3c719252 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.084735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e804ebe2-87ad-44ac-a256-59be3c719252 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.086137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e804ebe2-87ad-44ac-a256-59be3c719252 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.619349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e804ebe2-87ad-44ac-a256-59be3c719252 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:01.629283 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e804ebe2-87ad-44ac-a256-59be3c719252 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1471 microversion: 2.1 time: 0.636598 Oct 04 18:07:01.641789 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 710/1452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:00 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1471 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:01.647202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.667951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.682591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.683532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.691918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.693152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.693883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.694559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.804541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:01.805603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:01.806535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:01.807391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:01.808141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:01.829334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.830136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.832168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.840923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.844735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.847985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.910455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Getting quotas for project 1a630efa59244fbf9426904b7bf00eee. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:01.947597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Getting quotas for user 9796f56e209540ee967eb5090a1d2dbe and project 1a630efa59244fbf9426904b7bf00eee. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:02.008556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:02.026303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:02.252655 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59c41537-bd1a-45da-ab6e-508fc651be2f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.985240 Oct 04 18:07:02.254536 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 743/1453] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:06:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3990 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:07:02.287878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5573eb58-5340-461b-94a0-c2c84f3b4495 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.299390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5573eb58-5340-461b-94a0-c2c84f3b4495 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.310602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.320357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.334468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.353870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5573eb58-5340-461b-94a0-c2c84f3b4495 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.353870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5573eb58-5340-461b-94a0-c2c84f3b4495 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.353870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5573eb58-5340-461b-94a0-c2c84f3b4495 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.380662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5573eb58-5340-461b-94a0-c2c84f3b4495 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.381841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5573eb58-5340-461b-94a0-c2c84f3b4495 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.391188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5573eb58-5340-461b-94a0-c2c84f3b4495 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.393688 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7b33f5fd-8b67-42a6-ae5e-baf04c5766ec tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.750108 Oct 04 18:07:02.395140 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 711/1454] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:02.408075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.408916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.427211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.453765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.454645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.468286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.469326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.470137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.508884 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] HTTP exception thrown: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Request method failure captured: Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c HTTP/1.1 Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHV1fiLqnwoEb9VHXYSwPU9ctJx-5Ydho2KIUBHTfKv_uW7ONMctrxRhYYhSrsMcnYisftwEuN7xvg8gKyxndybmHLChw2h9VfPpzkoYPjFlZVZduWJUA6--52t4MokVxCpYpGZOkTQ0hEa8vjyJyj2VboR1Jfk5dmHj6UZyAo7jOgI Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 1aa1267514574b10b88edc89c547c727 Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1163464557 Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:07:02.511083 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1aa1267514574b10b88edc89c547c727"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1aa1267514574b10b88edc89c547c727"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1aa1267514574b10b88edc89c547c727"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1aa1267514574b10b88edc89c547c727"}]}] Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1163464557 Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 1aa1267514574b10b88edc89c547c727 Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1163464557 Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachSCSIVolumeTestJSON-1163464557-project Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 72d2223fbb374de8bf6792e8187e9c08 Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1163464557-project Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:07:02.513217 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '2bc68e22-19de-42cd-aae6-efc5d6218e8c'} Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:02.514134 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:07:02.515549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.518550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Returning 404 to user: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:02.519725 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04c88277-de3a-4994-a6ee-a8080503b4d9 tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 404 len: 111 microversion: 2.1 time: 0.122612 Oct 04 18:07:02.521131 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 712/1455] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:02 2022] DELETE /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:02.527640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2df94337-022b-4ed3-a755-4f046fc8089c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.538325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2df94337-022b-4ed3-a755-4f046fc8089c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.925300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2df94337-022b-4ed3-a755-4f046fc8089c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.944947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2df94337-022b-4ed3-a755-4f046fc8089c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.946436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2df94337-022b-4ed3-a755-4f046fc8089c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.961559 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2df94337-022b-4ed3-a755-4f046fc8089c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1262 microversion: 2.25 time: 0.434371 Oct 04 18:07:02.968425 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 713/1456] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1262 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:02.973611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.990549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] [instance: 2bc68e22-19de-42cd-aae6-efc5d6218e8c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.022626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.026794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.029450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.030427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.032075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.037751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.139137 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] HTTP exception thrown: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Request method failure captured: Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c HTTP/1.1 Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHV1fiLqnwoEb9VHXYSwPU9ctJx-5Ydho2KIUBHTfKv_uW7ONMctrxRhYYhSrsMcnYisftwEuN7xvg8gKyxndybmHLChw2h9VfPpzkoYPjFlZVZduWJUA6--52t4MokVxCpYpGZOkTQ0hEa8vjyJyj2VboR1Jfk5dmHj6UZyAo7jOgI Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 1aa1267514574b10b88edc89c547c727 Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1163464557 Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:07:03.157527 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1aa1267514574b10b88edc89c547c727"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1aa1267514574b10b88edc89c547c727"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1aa1267514574b10b88edc89c547c727"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1aa1267514574b10b88edc89c547c727"}]}] Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1163464557 Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 1aa1267514574b10b88edc89c547c727 Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1163464557 Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachSCSIVolumeTestJSON-1163464557-project Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 72d2223fbb374de8bf6792e8187e9c08 Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1163464557-project Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:07:03.160359 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '2bc68e22-19de-42cd-aae6-efc5d6218e8c'} Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:03.161893 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. Oct 04 18:07:03.164262 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:03.171751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] Returning 404 to user: Instance 2bc68e22-19de-42cd-aae6-efc5d6218e8c could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:03.197385 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b09bde96-5ed2-4686-a6c4-df47cddf8f0a tempest-AttachSCSIVolumeTestJSON-1163464557 tempest-AttachSCSIVolumeTestJSON-1163464557-project] 10.222.0.18 "GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c" status: 404 len: 111 microversion: 2.1 time: 0.204436 Oct 04 18:07:03.203352 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 714/1457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/2bc68e22-19de-42cd-aae6-efc5d6218e8c => generated 111 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:03.231589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9a02cff-ef0e-455a-b496-83f2188818c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.234430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9a02cff-ef0e-455a-b496-83f2188818c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.268759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5573eb58-5340-461b-94a0-c2c84f3b4495 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:03.281366 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5573eb58-5340-461b-94a0-c2c84f3b4495 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1334 microversion: 2.1 time: 1.020324 Oct 04 18:07:03.284675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a02cff-ef0e-455a-b496-83f2188818c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.291591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a02cff-ef0e-455a-b496-83f2188818c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.292868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a02cff-ef0e-455a-b496-83f2188818c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.293498 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 744/1458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1334 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:03.296424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a02cff-ef0e-455a-b496-83f2188818c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.299184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a02cff-ef0e-455a-b496-83f2188818c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.302415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9a02cff-ef0e-455a-b496-83f2188818c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.450562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.451440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.466659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.473254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.476033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.477044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.482530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.483325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.614404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:04.643556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:04.652078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:04.675633 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-56dc6739-012b-4f99-9bff-ef28bb27c847 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 1.246396 Oct 04 18:07:04.678726 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 745/1459] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:03 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:04.693090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:04.701573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:04.720378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.721362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.722286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.725144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.729195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.730601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.076694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:05.101592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:05.111327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:05.113592 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac032f45-ff2a-4829-a090-045406637938 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1258 microversion: 2.25 time: 0.433203 Oct 04 18:07:05.123356 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 746/1460] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:04 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1258 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:05.128428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-efa773f9-ec2a-4825-897a-fa352527c0f5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:05.129050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-efa773f9-ec2a-4825-897a-fa352527c0f5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:05.155362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa773f9-ec2a-4825-897a-fa352527c0f5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.178309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa773f9-ec2a-4825-897a-fa352527c0f5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.178776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa773f9-ec2a-4825-897a-fa352527c0f5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.180837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa773f9-ec2a-4825-897a-fa352527c0f5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.181343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa773f9-ec2a-4825-897a-fa352527c0f5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.181794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa773f9-ec2a-4825-897a-fa352527c0f5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.842611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9a02cff-ef0e-455a-b496-83f2188818c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:05.863203 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9a02cff-ef0e-455a-b496-83f2188818c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1471 microversion: 2.1 time: 2.656229 Oct 04 18:07:05.865203 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 715/1461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:03 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1471 bytes in 2661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:06.027721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-073d049e-1b8a-46ae-b8fb-17740794c00b tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d1bf45e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1305143043", "description": "tempest-description-1953425028"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:06.280502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-efa773f9-ec2a-4825-897a-fa352527c0f5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.292820 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-efa773f9-ec2a-4825-897a-fa352527c0f5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1334 microversion: 2.1 time: 1.168181 Oct 04 18:07:06.295739 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 747/1462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:05 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1334 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:06.317421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.318584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.336990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.344197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.361276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.362290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.362709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.363286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.690746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.715327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.719527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.736631 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-532d7b31-fefd-452c-a743-5bb6f84ad820 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.438515 Oct 04 18:07:06.765538 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 748/1463] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:06 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:06.771648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.772911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.782066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.782783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.783446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.784411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.786031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.786844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.050204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.090255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.101428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.102878 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1e13c2ed-4e60-4bab-adcf-b3802c02055e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1314 microversion: 2.25 time: 0.336217 Oct 04 18:07:07.124197 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 749/1464] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:06 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:07.147978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7fe53b42-196c-48e9-944a-90ea5d44cbd1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.149168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7fe53b42-196c-48e9-944a-90ea5d44cbd1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.164380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe53b42-196c-48e9-944a-90ea5d44cbd1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.166144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe53b42-196c-48e9-944a-90ea5d44cbd1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.166879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe53b42-196c-48e9-944a-90ea5d44cbd1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.168005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe53b42-196c-48e9-944a-90ea5d44cbd1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.169053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe53b42-196c-48e9-944a-90ea5d44cbd1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.169916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe53b42-196c-48e9-944a-90ea5d44cbd1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.942823 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-073d049e-1b8a-46ae-b8fb-17740794c00b tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.075368 Oct 04 18:07:07.944063 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 716/1465] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:07:05 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:07.951419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6c1721dd-220d-446c-bcc1-a810cd7bfebc tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.955067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6c1721dd-220d-446c-bcc1-a810cd7bfebc tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.972899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1721dd-220d-446c-bcc1-a810cd7bfebc tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.977561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1721dd-220d-446c-bcc1-a810cd7bfebc tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.978342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1721dd-220d-446c-bcc1-a810cd7bfebc tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.979394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1721dd-220d-446c-bcc1-a810cd7bfebc tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.979988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1721dd-220d-446c-bcc1-a810cd7bfebc tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.980537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1721dd-220d-446c-bcc1-a810cd7bfebc tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.204831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7fe53b42-196c-48e9-944a-90ea5d44cbd1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.213625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:08.225116 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7fe53b42-196c-48e9-944a-90ea5d44cbd1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 1.097081 Oct 04 18:07:08.250472 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 750/1466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:08.261764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:08.273668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:08.287634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.288552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.289246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.290238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.290928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.291609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.409481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.441529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.443660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.453314 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d1b60324-4f1c-4628-a553-3d0cc3d96b40 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.200604 Oct 04 18:07:08.467590 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 751/1467] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:08 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:08.467590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-be2b6f2f-d59b-45b3-af0c-f3367defe7de tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d1b22dc0>, body: {"security_group_rule": {"parent_group_id": "e36da470-7416-45b0-9655-1dcf5ebaf5da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:08.756113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6c1721dd-220d-446c-bcc1-a810cd7bfebc tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.777377 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6c1721dd-220d-446c-bcc1-a810cd7bfebc tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.832032 Oct 04 18:07:08.778898 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 717/1468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:08.787159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:08.788119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:08.795930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.796786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.797862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.798849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.799524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.800258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.950947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.967858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.974358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.976828 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ae150062-0cfb-4c33-98b4-5429c447ca3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1320 microversion: 2.25 time: 0.196639 Oct 04 18:07:08.980113 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 718/1469] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:08 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1320 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:09.255093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d16dfd3-d82e-46c3-850d-04d0451ef28f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:09.256065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5d16dfd3-d82e-46c3-850d-04d0451ef28f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:09.271103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d16dfd3-d82e-46c3-850d-04d0451ef28f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.275972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d16dfd3-d82e-46c3-850d-04d0451ef28f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.276988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d16dfd3-d82e-46c3-850d-04d0451ef28f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.278234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d16dfd3-d82e-46c3-850d-04d0451ef28f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.278913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d16dfd3-d82e-46c3-850d-04d0451ef28f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.280773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d16dfd3-d82e-46c3-850d-04d0451ef28f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.549158 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-be2b6f2f-d59b-45b3-af0c-f3367defe7de tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.094128 Oct 04 18:07:09.550391 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 752/1470] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:07:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:09.556183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:09.557080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:09.577293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.578083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.578734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.579696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.580346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.580960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.753730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:09.769370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:09.775811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:09.787033 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7cd64dc6-7037-4c90-bc03-323d2e2afac3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.235308 Oct 04 18:07:09.790858 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 753/1471] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:09 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:09.807848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e306c311-5c73-465f-a413-d69aac6001c6 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d1b223a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1332508844", "description": "tempest-description-1485078334"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:10.759250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d16dfd3-d82e-46c3-850d-04d0451ef28f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:10.772890 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d16dfd3-d82e-46c3-850d-04d0451ef28f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 1.524043 Oct 04 18:07:10.774306 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 719/1472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:09 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:10.785520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df9c96c3-a9ff-4804-ad53-98328f251e16 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:10.787873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df9c96c3-a9ff-4804-ad53-98328f251e16 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:10.804869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df9c96c3-a9ff-4804-ad53-98328f251e16 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.805248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df9c96c3-a9ff-4804-ad53-98328f251e16 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.805876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df9c96c3-a9ff-4804-ad53-98328f251e16 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.807150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df9c96c3-a9ff-4804-ad53-98328f251e16 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.810303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df9c96c3-a9ff-4804-ad53-98328f251e16 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.811210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df9c96c3-a9ff-4804-ad53-98328f251e16 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.390551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df9c96c3-a9ff-4804-ad53-98328f251e16 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:11.405182 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e306c311-5c73-465f-a413-d69aac6001c6 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.609110 Oct 04 18:07:11.407892 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 754/1473] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:07:09 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:11.416772 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df9c96c3-a9ff-4804-ad53-98328f251e16 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.640879 Oct 04 18:07:11.417915 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 720/1474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:10 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:11.423462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:11.424329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:11.431501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:11.432329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:11.439526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.440500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.441117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.446346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.451045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.452213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.457323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.458310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.459175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.463471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.464397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.465066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.647815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:11.662629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:11.671071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:11.691306 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6949486a-3074-43dd-9024-926c6f2825a2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.271468 Oct 04 18:07:11.692671 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 721/1475] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:11 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:11.699150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-340d4261-c339-4977-8f74-3c9557ff48ed tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d1c5b940>, body: {"security_group_rule": {"parent_group_id": "d390b7f8-04fe-4cf1-bbc2-bb945b7e0f97", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:11.873443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:11.987800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:12.107641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.119257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.120903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.122114 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5e108006-4262-4814-8ace-0a6f1f009909 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1362 microversion: 2.25 time: 0.712748 Oct 04 18:07:12.127437 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 755/1476] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:11 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:12.137994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-dd79b6dd-2891-4b97-aaa2-79e5cfc0c8c6 req-f5d65d9b-d879-49dc-85d2-cb84adbe6db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d01d60f-4bfb-4c40-9a29-8734c5aba5ab", "tag": "d0b9b85c-0770-429a-a7d9-3683ed20319f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:12.164114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd79b6dd-2891-4b97-aaa2-79e5cfc0c8c6 req-f5d65d9b-d879-49dc-85d2-cb84adbe6db0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.164624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd79b6dd-2891-4b97-aaa2-79e5cfc0c8c6 req-f5d65d9b-d879-49dc-85d2-cb84adbe6db0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.165177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd79b6dd-2891-4b97-aaa2-79e5cfc0c8c6 req-f5d65d9b-d879-49dc-85d2-cb84adbe6db0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.203930 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-dd79b6dd-2891-4b97-aaa2-79e5cfc0c8c6 req-f5d65d9b-d879-49dc-85d2-cb84adbe6db0 service nova] Creating event network-changed:d0b9b85c-0770-429a-a7d9-3683ed20319f for instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab on n-h2-850499-14 Oct 04 18:07:12.217083 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-dd79b6dd-2891-4b97-aaa2-79e5cfc0c8c6 req-f5d65d9b-d879-49dc-85d2-cb84adbe6db0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083519 Oct 04 18:07:12.217928 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 756/1477] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:12.225408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a9ea7255-5f7e-49fb-9f75-3b8f23beae9f req-9248e5fb-d330-420a-91a0-62e1f25c6a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "tag": "b7c9f9d0-f676-4a60-87ba-cbc4fe8c9d7d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:12.237561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a9ea7255-5f7e-49fb-9f75-3b8f23beae9f req-9248e5fb-d330-420a-91a0-62e1f25c6a56 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.237561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a9ea7255-5f7e-49fb-9f75-3b8f23beae9f req-9248e5fb-d330-420a-91a0-62e1f25c6a56 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.238533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a9ea7255-5f7e-49fb-9f75-3b8f23beae9f req-9248e5fb-d330-420a-91a0-62e1f25c6a56 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.252445 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a9ea7255-5f7e-49fb-9f75-3b8f23beae9f req-9248e5fb-d330-420a-91a0-62e1f25c6a56 service nova] Creating event network-changed:b7c9f9d0-f676-4a60-87ba-cbc4fe8c9d7d for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:12.260158 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a9ea7255-5f7e-49fb-9f75-3b8f23beae9f req-9248e5fb-d330-420a-91a0-62e1f25c6a56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039937 Oct 04 18:07:12.261216 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 757/1478] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:12.266676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-274cff52-2666-4b52-8dda-0f44ecb61236 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.268801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-274cff52-2666-4b52-8dda-0f44ecb61236 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.276250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-274cff52-2666-4b52-8dda-0f44ecb61236 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.277165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-274cff52-2666-4b52-8dda-0f44ecb61236 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.277848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-274cff52-2666-4b52-8dda-0f44ecb61236 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.279456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-274cff52-2666-4b52-8dda-0f44ecb61236 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.280227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-274cff52-2666-4b52-8dda-0f44ecb61236 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.280775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-274cff52-2666-4b52-8dda-0f44ecb61236 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.759434 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-340d4261-c339-4977-8f74-3c9557ff48ed tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.065281 Oct 04 18:07:12.759936 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 722/1479] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:07:11 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:12.765151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-551999d7-22bd-4aa0-b6c2-c65fbf9cf617 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.766086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-551999d7-22bd-4aa0-b6c2-c65fbf9cf617 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.786785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-551999d7-22bd-4aa0-b6c2-c65fbf9cf617 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.787314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-551999d7-22bd-4aa0-b6c2-c65fbf9cf617 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.788089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-551999d7-22bd-4aa0-b6c2-c65fbf9cf617 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.789010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-551999d7-22bd-4aa0-b6c2-c65fbf9cf617 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.789664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-551999d7-22bd-4aa0-b6c2-c65fbf9cf617 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.790283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-551999d7-22bd-4aa0-b6c2-c65fbf9cf617 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.839268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:12.906042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-274cff52-2666-4b52-8dda-0f44ecb61236 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.916338 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-274cff52-2666-4b52-8dda-0f44ecb61236 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 0.653621 Oct 04 18:07:12.918520 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 758/1480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:12.925149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.926182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.932047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:12.939793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.940906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.941639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.943230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.943941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.944686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.090042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.150667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.162486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.180586 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-844706e8-79fa-4886-a2ea-4027a70b2e9d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.260180 Oct 04 18:07:13.182160 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 759/1481] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:13.189903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a79c7e3c-d53a-48fa-8893-ec71028cf509 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d1a78310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2110517630", "description": "tempest-description-385652877"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:13.349332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-551999d7-22bd-4aa0-b6c2-c65fbf9cf617 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.362195 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-551999d7-22bd-4aa0-b6c2-c65fbf9cf617 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.600753 Oct 04 18:07:13.362811 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 723/1482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:13.373319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.374499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:13.380646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:13.382842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.383580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.384233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.384965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.385508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.386176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.681277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.693796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.698880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.701745 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-606fcb69-c1fb-4fa8-8e5a-38363ee45bb0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1362 microversion: 2.25 time: 0.336537 Oct 04 18:07:13.702337 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 724/1483] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:13.946415 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a79c7e3c-d53a-48fa-8893-ec71028cf509 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.762975 Oct 04 18:07:13.947048 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 760/1484] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:07:13 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:13.948116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a13f62d6-d95b-4261-979e-fa442c84a0d1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.948763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a13f62d6-d95b-4261-979e-fa442c84a0d1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:13.962818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-92ebf326-bdb9-4e5d-bbab-a9454d27ac69 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d1b11dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1039842405", "description": "tempest-description-230942656"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:13.963650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a13f62d6-d95b-4261-979e-fa442c84a0d1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.964664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a13f62d6-d95b-4261-979e-fa442c84a0d1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.965862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a13f62d6-d95b-4261-979e-fa442c84a0d1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.967547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a13f62d6-d95b-4261-979e-fa442c84a0d1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.968310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a13f62d6-d95b-4261-979e-fa442c84a0d1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.969841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a13f62d6-d95b-4261-979e-fa442c84a0d1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.322505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a13f62d6-d95b-4261-979e-fa442c84a0d1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.339577 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a13f62d6-d95b-4261-979e-fa442c84a0d1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 0.396646 Oct 04 18:07:14.351954 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 725/1485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:14.357566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:14.358349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:14.368900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.374393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.375456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.384915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.384915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.384915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.568483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.587603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.599475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.603627 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-92ebf326-bdb9-4e5d-bbab-a9454d27ac69 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.646497 Oct 04 18:07:14.603865 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 761/1486] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:07:13 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:07:14.608583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29caab3e-d17a-4621-8eec-d5670791e25d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:14.609200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-29caab3e-d17a-4621-8eec-d5670791e25d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:14.622771 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34a2405a-9f1a-41af-907e-8e7b08bf7995 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.269087 Oct 04 18:07:14.626939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29caab3e-d17a-4621-8eec-d5670791e25d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.627824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29caab3e-d17a-4621-8eec-d5670791e25d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.628954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29caab3e-d17a-4621-8eec-d5670791e25d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.631909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29caab3e-d17a-4621-8eec-d5670791e25d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.639997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29caab3e-d17a-4621-8eec-d5670791e25d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.640871 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 726/1487] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:14 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:14.642620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29caab3e-d17a-4621-8eec-d5670791e25d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.660016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0b299392-66d6-4790-bb96-e45bf4f876b4 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d2350af0>, body: {"security_group_rule": {"parent_group_id": "2e35d0ad-0daf-4904-8cbc-10838a5aab56", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "016b5217-ce84-4aeb-8212-605fea1f6b67"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:15.180783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29caab3e-d17a-4621-8eec-d5670791e25d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.221355 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29caab3e-d17a-4621-8eec-d5670791e25d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.616345 Oct 04 18:07:15.222242 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 762/1488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:14 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:15.241288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:15.241959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:15.268251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.272228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.272953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.273739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.279134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.279705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.826576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.835911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.837367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.838538 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e2b31dd-5310-43b8-8f11-94347e0437e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1362 microversion: 2.25 time: 0.615323 Oct 04 18:07:15.839130 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 763/1489] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:15 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1362 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:15.851248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-47b89699-cf19-498d-89d3-630d872609bd req-b1071357-3533-4341-b586-3068308fb66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "tag": "b211cb3c-33b7-4842-a49e-47fd06e827a6"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:15.864271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-47b89699-cf19-498d-89d3-630d872609bd req-b1071357-3533-4341-b586-3068308fb66a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.865733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-47b89699-cf19-498d-89d3-630d872609bd req-b1071357-3533-4341-b586-3068308fb66a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.866274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-47b89699-cf19-498d-89d3-630d872609bd req-b1071357-3533-4341-b586-3068308fb66a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.899343 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-47b89699-cf19-498d-89d3-630d872609bd req-b1071357-3533-4341-b586-3068308fb66a service nova] Creating event network-changed:b211cb3c-33b7-4842-a49e-47fd06e827a6 for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:15.909332 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-47b89699-cf19-498d-89d3-630d872609bd req-b1071357-3533-4341-b586-3068308fb66a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062932 Oct 04 18:07:15.910249 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 764/1490] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:15.936009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e594b626-bf36-4cad-b360-bcdfd4686f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:15.936809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e594b626-bf36-4cad-b360-bcdfd4686f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:15.953155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e594b626-bf36-4cad-b360-bcdfd4686f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.953670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e594b626-bf36-4cad-b360-bcdfd4686f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.954122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e594b626-bf36-4cad-b360-bcdfd4686f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.962176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e594b626-bf36-4cad-b360-bcdfd4686f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.962870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e594b626-bf36-4cad-b360-bcdfd4686f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.963343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e594b626-bf36-4cad-b360-bcdfd4686f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.132369 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0b299392-66d6-4790-bb96-e45bf4f876b4 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.490157 Oct 04 18:07:16.133162 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 727/1491] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:07:14 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:16.139341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:16.140294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:16.148952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.152193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.153313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.154518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.155456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.156862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.281872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.291989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.295951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.309079 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fc2f1cf4-f88c-44bf-825f-dc345157aef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.174581 Oct 04 18:07:16.310907 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 728/1492] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:16 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:16.318517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6926211-9958-486d-acc3-cfd427f4b979 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d23505e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-743637379", "description": "tempest-description-886609023"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:16.324283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e594b626-bf36-4cad-b360-bcdfd4686f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.352791 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e594b626-bf36-4cad-b360-bcdfd4686f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 0.440122 Oct 04 18:07:16.354769 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 765/1493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:15 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:16.378907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b11a929e-a56f-4721-a577-ea96f7f8d017 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:16.383617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b11a929e-a56f-4721-a577-ea96f7f8d017 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:16.403795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b11a929e-a56f-4721-a577-ea96f7f8d017 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.405094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b11a929e-a56f-4721-a577-ea96f7f8d017 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.405744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b11a929e-a56f-4721-a577-ea96f7f8d017 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.406895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b11a929e-a56f-4721-a577-ea96f7f8d017 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.407688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b11a929e-a56f-4721-a577-ea96f7f8d017 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.408550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b11a929e-a56f-4721-a577-ea96f7f8d017 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.840946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6926211-9958-486d-acc3-cfd427f4b979 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.526493 Oct 04 18:07:16.854529 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 729/1494] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:07:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:16.868278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d843632b-5377-47a5-a8a2-8c57a8fb4870 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d210b9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1792594665", "description": "tempest-description-644746907"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:16.937179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b11a929e-a56f-4721-a577-ea96f7f8d017 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.948072 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b11a929e-a56f-4721-a577-ea96f7f8d017 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.590739 Oct 04 18:07:16.959770 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 766/1495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:16 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:16.964609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:16.965243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:16.976848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.977421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.977878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.978622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.979190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.979637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.339253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.365643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.377764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.382541 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d2204e15-4d0d-4add-b8de-2e5cf963d804 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1362 microversion: 2.25 time: 0.421534 Oct 04 18:07:17.386059 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 767/1496] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:16 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:17.466350 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d843632b-5377-47a5-a8a2-8c57a8fb4870 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.607817 Oct 04 18:07:17.467606 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 730/1497] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:07:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:17.487257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:17.488077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:17.511484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.512948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.516656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.519056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.521125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.522689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.620246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.649024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.650517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.660080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2d30ec68-4e35-40f4-8aef-c7aa4744e674"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:17.663562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:17.669858 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-de9ae5cb-e021-4c62-8f04-6adfcd547c4d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.187184 Oct 04 18:07:17.677153 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 731/1498] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:17 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:17.685106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-edd5731d-7ff3-410e-9666-f5444aa56852 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:17.702743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-edd5731d-7ff3-410e-9666-f5444aa56852 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:17.704957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.705790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.706516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.711849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.712603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.713226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.723328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd5731d-7ff3-410e-9666-f5444aa56852 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.725048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd5731d-7ff3-410e-9666-f5444aa56852 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.727825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd5731d-7ff3-410e-9666-f5444aa56852 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.728801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd5731d-7ff3-410e-9666-f5444aa56852 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.729384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd5731d-7ff3-410e-9666-f5444aa56852 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.730139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd5731d-7ff3-410e-9666-f5444aa56852 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.961959 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] HTTP exception thrown: Volume 2d30ec68-4e35-40f4-8aef-c7aa4744e674 could not be found. Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Request method failure captured: Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: request: PUT /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments/f9b8e6f9-78a7-4056-b90b-5210ea8553bd HTTP/1.1 Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 74 Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHWh2hpkdXIl2WizxfG3Eewh52pwO4DioJHEfuN8px3owCywV7VDDYMNZG0CdTXIBlIkdMQyW58n3cq-L9tQ-6coLkWmroV-kyroX6PSruIN2h207TBt52rIvI0Vao0DoTsEa7GnDKiPQZRmikZCukh-OB1coQh_jTRkbecTPK77CD4 Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: b830465e51154274b13b2dce61554099 Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesAdminNegativeTest-1759953198 Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:07:17.997094 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b830465e51154274b13b2dce61554099"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b830465e51154274b13b2dce61554099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b830465e51154274b13b2dce61554099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b830465e51154274b13b2dce61554099"}]}] Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesAdminNegativeTest-1759953198 Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: b830465e51154274b13b2dce61554099 Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1759953198 Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesAdminNegativeTest-1759953198-project-admin Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6c5b173c40364eda899d369de033e56f Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesAdminNegativeTest-1759953198-project-admin Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: {"volumeAttachment": {"volumeId": "2d30ec68-4e35-40f4-8aef-c7aa4744e674"}} Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:07:17.999192 n-d-850499-14 devstack@n-api.service[122332]: exception: Volume 2d30ec68-4e35-40f4-8aef-c7aa4744e674 could not be found. Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'server_id': '2505e8f7-6362-487e-9099-1dfe07254a31', 'id': 'f9b8e6f9-78a7-4056-b90b-5210ea8553bd', 'body': {'volumeAttachment': {'volumeId': '2d30ec68-4e35-40f4-8aef-c7aa4744e674'}}} Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:07:18.002146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d30ec68-4e35-40f4-8aef-c7aa4744e674 could not be found. (HTTP 404) (Request-ID: req-dc676722-8f61-4dab-9628-76c193e46f31) Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:07:18.005633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d30ec68-4e35-40f4-8aef-c7aa4744e674 could not be found. Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:18.012237 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 2d30ec68-4e35-40f4-8aef-c7aa4744e674 could not be found. Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d30ec68-4e35-40f4-8aef-c7aa4744e674 could not be found. Oct 04 18:07:18.018575 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:18.025349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Returning 400 to user: Volume 2d30ec68-4e35-40f4-8aef-c7aa4744e674 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:18.025349 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3d3194e3-bd1a-4862-bd05-98644a14982e tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments/f9b8e6f9-78a7-4056-b90b-5210ea8553bd" status: 400 len: 107 microversion: 2.1 time: 0.611040 Oct 04 18:07:18.025349 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 768/1499] 10.222.0.18 () {60 vars in 1433 bytes} [Tue Oct 4 18:07:17 2022] PUT /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments/f9b8e6f9-78a7-4056-b90b-5210ea8553bd => generated 107 bytes in 613 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:07:18.025349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ab194dc9-ce1f-4308-8e48-cd8a6349b8c3 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d1b22940>, body: {"security_group_rule": {"parent_group_id": "c24e713b-d5d3-4668-b23c-bee8a997680f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "74d9ffff-2c74-425d-9a51-8369ff5d8cc8"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:18.563453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-edd5731d-7ff3-410e-9666-f5444aa56852 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:18.585500 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-edd5731d-7ff3-410e-9666-f5444aa56852 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 0.907140 Oct 04 18:07:18.601066 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 732/1500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:17 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:18.612119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e6c79e20-45e1-477b-a35f-6133d87251c4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:18.618212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e6c79e20-45e1-477b-a35f-6133d87251c4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:18.637661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6c79e20-45e1-477b-a35f-6133d87251c4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.638462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6c79e20-45e1-477b-a35f-6133d87251c4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.639285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6c79e20-45e1-477b-a35f-6133d87251c4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.640408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6c79e20-45e1-477b-a35f-6133d87251c4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.641113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6c79e20-45e1-477b-a35f-6133d87251c4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.641783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6c79e20-45e1-477b-a35f-6133d87251c4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.134456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e6c79e20-45e1-477b-a35f-6133d87251c4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:19.171469 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e6c79e20-45e1-477b-a35f-6133d87251c4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.556812 Oct 04 18:07:19.172442 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 733/1501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:18 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:19.187494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8e909638-cc11-4ec6-9273-9386355510bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.188028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8e909638-cc11-4ec6-9273-9386355510bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:19.205526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e909638-cc11-4ec6-9273-9386355510bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.206049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e909638-cc11-4ec6-9273-9386355510bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.206502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e909638-cc11-4ec6-9273-9386355510bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.208096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e909638-cc11-4ec6-9273-9386355510bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.208577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e909638-cc11-4ec6-9273-9386355510bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.209075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e909638-cc11-4ec6-9273-9386355510bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.258093 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ab194dc9-ce1f-4308-8e48-cd8a6349b8c3 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.253699 Oct 04 18:07:19.258704 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 769/1502] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:07:17 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:19.269420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c4dc5cbe-3a14-4f48-ace4-9c4139711fe8 req-d8a3329a-2e92-432a-aaa1-7eae9799847a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "tag": "ac1d4707-1c27-40af-9ec7-bb0a88a70075"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:19.286085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c4dc5cbe-3a14-4f48-ace4-9c4139711fe8 req-d8a3329a-2e92-432a-aaa1-7eae9799847a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.296803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c4dc5cbe-3a14-4f48-ace4-9c4139711fe8 req-d8a3329a-2e92-432a-aaa1-7eae9799847a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.299620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c4dc5cbe-3a14-4f48-ace4-9c4139711fe8 req-d8a3329a-2e92-432a-aaa1-7eae9799847a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.333377 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c4dc5cbe-3a14-4f48-ace4-9c4139711fe8 req-d8a3329a-2e92-432a-aaa1-7eae9799847a service nova] Creating event network-changed:ac1d4707-1c27-40af-9ec7-bb0a88a70075 for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:19.353320 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c4dc5cbe-3a14-4f48-ace4-9c4139711fe8 req-d8a3329a-2e92-432a-aaa1-7eae9799847a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093022 Oct 04 18:07:19.354916 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 770/1503] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:19.366834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.376079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:19.389584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.390344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.390995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.391915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.392531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.393123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.431482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-8e909638-cc11-4ec6-9273-9386355510bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lazy-loading 'services' on Instance uuid 2505e8f7-6362-487e-9099-1dfe07254a31 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:19.597603 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8e909638-cc11-4ec6-9273-9386355510bb tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments/f9b8e6f9-78a7-4056-b90b-5210ea8553bd" status: 202 len: 0 microversion: 2.1 time: 0.423776 Oct 04 18:07:19.599072 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 734/1504] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:07:19 2022] DELETE /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments/f9b8e6f9-78a7-4056-b90b-5210ea8553bd => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:19.622947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.625111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:19.633951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.634931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.635723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.636751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.637428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.638075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.896627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:19.913009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:19.915782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:19.933515 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-297a6cde-5e06-46ce-8497-de95a9467edf tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.324738 Oct 04 18:07:19.947072 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 735/1505] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:19 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:19.947072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39fccad3-a2cb-4006-8dc0-81d1d510ce01 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d1c48280>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.033126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.049047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.057187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.058815 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4da158d6-ae75-4743-827d-e237ee0e9ce1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1362 microversion: 2.25 time: 0.697061 Oct 04 18:07:20.063794 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 771/1506] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:19 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1362 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:20.075529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a37dd277-0e86-4a34-a1b2-d976e5b9827e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.089224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a37dd277-0e86-4a34-a1b2-d976e5b9827e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:20.122530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37dd277-0e86-4a34-a1b2-d976e5b9827e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.127460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37dd277-0e86-4a34-a1b2-d976e5b9827e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.128467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37dd277-0e86-4a34-a1b2-d976e5b9827e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.131595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37dd277-0e86-4a34-a1b2-d976e5b9827e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.132403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37dd277-0e86-4a34-a1b2-d976e5b9827e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.133097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37dd277-0e86-4a34-a1b2-d976e5b9827e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.196979 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a37dd277-0e86-4a34-a1b2-d976e5b9827e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130432 Oct 04 18:07:20.197789 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 772/1507] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:20.204636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af4352b4-fa8a-4654-9ce5-e84269bb2cf5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.205426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-af4352b4-fa8a-4654-9ce5-e84269bb2cf5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:20.222598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4352b4-fa8a-4654-9ce5-e84269bb2cf5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.226107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4352b4-fa8a-4654-9ce5-e84269bb2cf5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.226896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4352b4-fa8a-4654-9ce5-e84269bb2cf5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.228564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4352b4-fa8a-4654-9ce5-e84269bb2cf5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.229533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4352b4-fa8a-4654-9ce5-e84269bb2cf5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.230281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4352b4-fa8a-4654-9ce5-e84269bb2cf5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.616046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-af4352b4-fa8a-4654-9ce5-e84269bb2cf5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.630312 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-af4352b4-fa8a-4654-9ce5-e84269bb2cf5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 0.431013 Oct 04 18:07:20.647783 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 773/1508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:20.654826 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39fccad3-a2cb-4006-8dc0-81d1d510ce01 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/74d9ffff-2c74-425d-9a51-8369ff5d8cc8" status: 202 len: 0 microversion: 2.1 time: 0.717618 Oct 04 18:07:20.658582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-085093f8-cd2c-4487-a777-8d2721055c51 req-ed783a10-0ec6-43f9-a155-50148a830f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01d60f-4bfb-4c40-9a29-8734c5aba5ab", "name": "network-vif-plugged", "status": "completed", "tag": "d0b9b85c-0770-429a-a7d9-3683ed20319f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:20.659936 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 736/1509] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:07:19 2022] DELETE /compute/v2.1/os-security-groups/74d9ffff-2c74-425d-9a51-8369ff5d8cc8 => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:20.665209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cc984a01-7fa5-4089-b8a8-74fd80f16014 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.665844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cc984a01-7fa5-4089-b8a8-74fd80f16014 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:20.679125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc984a01-7fa5-4089-b8a8-74fd80f16014 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.683496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc984a01-7fa5-4089-b8a8-74fd80f16014 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.683976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc984a01-7fa5-4089-b8a8-74fd80f16014 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.685211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-085093f8-cd2c-4487-a777-8d2721055c51 req-ed783a10-0ec6-43f9-a155-50148a830f0d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.685892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-085093f8-cd2c-4487-a777-8d2721055c51 req-ed783a10-0ec6-43f9-a155-50148a830f0d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.687087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc984a01-7fa5-4089-b8a8-74fd80f16014 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.687405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-085093f8-cd2c-4487-a777-8d2721055c51 req-ed783a10-0ec6-43f9-a155-50148a830f0d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.687628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc984a01-7fa5-4089-b8a8-74fd80f16014 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.688086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc984a01-7fa5-4089-b8a8-74fd80f16014 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.733002 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-085093f8-cd2c-4487-a777-8d2721055c51 req-ed783a10-0ec6-43f9-a155-50148a830f0d service nova] Creating event network-vif-plugged:d0b9b85c-0770-429a-a7d9-3683ed20319f for instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab on n-h2-850499-14 Oct 04 18:07:20.744201 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-085093f8-cd2c-4487-a777-8d2721055c51 req-ed783a10-0ec6-43f9-a155-50148a830f0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094390 Oct 04 18:07:20.749594 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 774/1510] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:20.767241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-edda0c5a-3af4-48e2-b6e7-d074b9375e72 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d1b22550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:21.007694 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-edda0c5a-3af4-48e2-b6e7-d074b9375e72 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/c24e713b-d5d3-4668-b23c-bee8a997680f" status: 200 len: 246 microversion: 2.1 time: 0.256474 Oct 04 18:07:21.008519 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 775/1511] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/os-security-groups/c24e713b-d5d3-4668-b23c-bee8a997680f => generated 246 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:21.014080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:21.015099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:21.029470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:21.035145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.039139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.042382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.044896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.054395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.054866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.176715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cc984a01-7fa5-4089-b8a8-74fd80f16014 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:21.186125 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cc984a01-7fa5-4089-b8a8-74fd80f16014 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.524754 Oct 04 18:07:21.186726 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 737/1512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:21.196580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b56c7195-ab9e-4ad5-8cac-468c313f7143 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d21a5d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1860203555", "description": "tempest-description-49122343"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:21.196984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:21.211842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:21.219175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:21.232134 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-87f9401d-4740-481a-8f71-f57263926ece tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.222303 Oct 04 18:07:21.232997 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 776/1513] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:21 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:21.268959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:21.272573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:21.290802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.293186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.294608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.295693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.296397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.297252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.405516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:21.732531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:21.748281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:21.753059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:21.757359 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74f4ceaf-f3a3-47ca-8ff5-79be3fd65f35 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1362 microversion: 2.25 time: 0.501952 Oct 04 18:07:21.758277 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 777/1514] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:21 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1362 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:21.794849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-13237244-741d-467d-9667-7695b02ac41a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:21.797655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-13237244-741d-467d-9667-7695b02ac41a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:21.822516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13237244-741d-467d-9667-7695b02ac41a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.823293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13237244-741d-467d-9667-7695b02ac41a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.823518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13237244-741d-467d-9667-7695b02ac41a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.828296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13237244-741d-467d-9667-7695b02ac41a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.828805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13237244-741d-467d-9667-7695b02ac41a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.829261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13237244-741d-467d-9667-7695b02ac41a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.898320 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-13237244-741d-467d-9667-7695b02ac41a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115892 Oct 04 18:07:21.898920 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 778/1515] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:07:21 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:21.912518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db0e9961-d60a-4b0d-be84-99e486ac4179 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:21.913936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-db0e9961-d60a-4b0d-be84-99e486ac4179 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:21.929570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db0e9961-d60a-4b0d-be84-99e486ac4179 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.931309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db0e9961-d60a-4b0d-be84-99e486ac4179 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.932534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db0e9961-d60a-4b0d-be84-99e486ac4179 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.934284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db0e9961-d60a-4b0d-be84-99e486ac4179 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.935020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db0e9961-d60a-4b0d-be84-99e486ac4179 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.935636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db0e9961-d60a-4b0d-be84-99e486ac4179 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.967113 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b56c7195-ab9e-4ad5-8cac-468c313f7143 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.779226 Oct 04 18:07:21.968316 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 738/1516] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:07:21 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:21.981997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0623a5dc-1a45-4ec5-a07d-3c04f6a749ed tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d1c5b3a0>, body: {"security_group_rule": {"parent_group_id": "e603c403-1108-439a-9092-aad14f726933", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:22.354510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-db0e9961-d60a-4b0d-be84-99e486ac4179 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:22.365745 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-db0e9961-d60a-4b0d-be84-99e486ac4179 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 0.458827 Oct 04 18:07:22.367260 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 779/1517] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:21 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:22.372948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f2cc91a-8445-411d-a043-1e74a2b56ac9 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:22.373645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f2cc91a-8445-411d-a043-1e74a2b56ac9 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:22.386792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f2cc91a-8445-411d-a043-1e74a2b56ac9 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.387803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f2cc91a-8445-411d-a043-1e74a2b56ac9 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.388464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f2cc91a-8445-411d-a043-1e74a2b56ac9 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.389610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f2cc91a-8445-411d-a043-1e74a2b56ac9 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.390165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f2cc91a-8445-411d-a043-1e74a2b56ac9 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.391350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f2cc91a-8445-411d-a043-1e74a2b56ac9 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.751407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1f2cc91a-8445-411d-a043-1e74a2b56ac9 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:22.779891 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f2cc91a-8445-411d-a043-1e74a2b56ac9 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.411211 Oct 04 18:07:22.803565 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 780/1518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:22 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:22.817589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:22.830144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:22.853852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.854362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.854815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.857669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.858146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.858585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.927114 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0623a5dc-1a45-4ec5-a07d-3c04f6a749ed tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.947962 Oct 04 18:07:22.928057 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 739/1519] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:07:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:07:22.933222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:22.934715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:22.949243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.949963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.950669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.951796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.952551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.953211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.035912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.053558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.059243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.070393 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-17cc347c-a20f-44f0-afe5-266a64614ef0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.266077 Oct 04 18:07:23.101000 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 781/1520] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:22 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:23.110772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-510cb28c-8c7d-4442-ac47-4e9f1a896592 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:23.113150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-510cb28c-8c7d-4442-ac47-4e9f1a896592 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:23.135771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-510cb28c-8c7d-4442-ac47-4e9f1a896592 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.136281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-510cb28c-8c7d-4442-ac47-4e9f1a896592 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.136725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-510cb28c-8c7d-4442-ac47-4e9f1a896592 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.141356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-510cb28c-8c7d-4442-ac47-4e9f1a896592 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.141799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-510cb28c-8c7d-4442-ac47-4e9f1a896592 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.142242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-510cb28c-8c7d-4442-ac47-4e9f1a896592 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.239580 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-510cb28c-8c7d-4442-ac47-4e9f1a896592 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134791 Oct 04 18:07:23.243132 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 782/1521] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:07:23 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:23.264783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0a1d069-f781-41f3-85d8-558ed4910591 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Action: 'create', calling method: .version_select at 0x7fd4d1b41b80>, body: {"security_group_rule": {"parent_group_id": "e603c403-1108-439a-9092-aad14f726933", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:23.336294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.362470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.366573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.369752 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2a12d681-8f8d-4419-889d-64969dc272b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1362 microversion: 2.25 time: 0.440305 Oct 04 18:07:23.372636 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 740/1522] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:22 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1362 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:23.398415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21d31a4d-fa2a-4085-a4c5-210748d9d986 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:23.399679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21d31a4d-fa2a-4085-a4c5-210748d9d986 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:23.411253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d31a4d-fa2a-4085-a4c5-210748d9d986 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.412957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d31a4d-fa2a-4085-a4c5-210748d9d986 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.413969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d31a4d-fa2a-4085-a4c5-210748d9d986 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.414911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d31a4d-fa2a-4085-a4c5-210748d9d986 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.415769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d31a4d-fa2a-4085-a4c5-210748d9d986 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.416493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d31a4d-fa2a-4085-a4c5-210748d9d986 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.790581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-21d31a4d-fa2a-4085-a4c5-210748d9d986 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.800191 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21d31a4d-fa2a-4085-a4c5-210748d9d986 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 0.414327 Oct 04 18:07:23.815269 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 741/1523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:23 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:23.815982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f7f209d-de73-45bb-9a1d-134a434fe302 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:23.819192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2f7f209d-de73-45bb-9a1d-134a434fe302 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:23.830903 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f0a1d069-f781-41f3-85d8-558ed4910591 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.583202 Oct 04 18:07:23.831631 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 783/1524] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 4 18:07:23 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:23.833846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7f209d-de73-45bb-9a1d-134a434fe302 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.834381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7f209d-de73-45bb-9a1d-134a434fe302 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.834996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7f209d-de73-45bb-9a1d-134a434fe302 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.838282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7f209d-de73-45bb-9a1d-134a434fe302 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.838865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7f209d-de73-45bb-9a1d-134a434fe302 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.839476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7f209d-de73-45bb-9a1d-134a434fe302 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.846909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-12d63443-93cf-47d4-9778-faac8686bfce tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d20d4160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.101898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2f7f209d-de73-45bb-9a1d-134a434fe302 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.113281 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2f7f209d-de73-45bb-9a1d-134a434fe302 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.302597 Oct 04 18:07:24.117753 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 742/1525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:23 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:24.129811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.130868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:24.148492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.149333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.151327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.154308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.155877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.156538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.172315 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-12d63443-93cf-47d4-9778-faac8686bfce tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/e603c403-1108-439a-9092-aad14f726933" status: 200 len: 663 microversion: 2.1 time: 0.331108 Oct 04 18:07:24.173273 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 784/1526] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:07:23 2022] GET /compute/v2.1/os-security-groups/e603c403-1108-439a-9092-aad14f726933 => generated 663 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:24.188172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac52a11b-8527-4206-ac8a-368fd71e4199 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d1a7b8b0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.282818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.293456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.295403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.301586 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4d68fd86-2f89-4600-a568-032591ac1b35 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.180929 Oct 04 18:07:24.302921 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 743/1527] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:24.309151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3362bae7-5b92-42d8-92e7-08ae0c3b78be tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.314386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3362bae7-5b92-42d8-92e7-08ae0c3b78be tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:24.324510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3362bae7-5b92-42d8-92e7-08ae0c3b78be tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.325372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3362bae7-5b92-42d8-92e7-08ae0c3b78be tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.326313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3362bae7-5b92-42d8-92e7-08ae0c3b78be tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.327878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3362bae7-5b92-42d8-92e7-08ae0c3b78be tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.328758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3362bae7-5b92-42d8-92e7-08ae0c3b78be tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.329445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3362bae7-5b92-42d8-92e7-08ae0c3b78be tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.391729 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3362bae7-5b92-42d8-92e7-08ae0c3b78be tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086518 Oct 04 18:07:24.399871 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 744/1528] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:24.410464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.411452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:24.419928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.420996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.421712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.422525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.423260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.424283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.474556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:24.560907 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac52a11b-8527-4206-ac8a-368fd71e4199 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/77a444f5-fc19-4ae3-846e-b0f23cc615b5" status: 202 len: 0 microversion: 2.1 time: 0.377459 Oct 04 18:07:24.562599 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 785/1529] 10.222.0.18 () {58 vars in 1287 bytes} [Tue Oct 4 18:07:24 2022] DELETE /compute/v2.1/os-security-group-rules/77a444f5-fc19-4ae3-846e-b0f23cc615b5 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:24.576627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd61ad47-4211-4ec5-816d-44563e584e4f tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d1a7b040>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.730748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.753768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.756475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.761498 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8c777d40-eccd-40ee-adea-48bb66ffbe27 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1557 microversion: 2.25 time: 0.358000 Oct 04 18:07:24.763307 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 745/1530] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1557 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:25.081290 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cd61ad47-4211-4ec5-816d-44563e584e4f tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/e603c403-1108-439a-9092-aad14f726933" status: 202 len: 0 microversion: 2.1 time: 0.511852 Oct 04 18:07:25.082658 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 786/1531] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:07:24 2022] DELETE /compute/v2.1/os-security-groups/e603c403-1108-439a-9092-aad14f726933 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:25.087803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fc1b9b05-aa9b-4ccc-8786-9163fd73bb35 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.088895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fc1b9b05-aa9b-4ccc-8786-9163fd73bb35 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:25.104290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1b9b05-aa9b-4ccc-8786-9163fd73bb35 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.106445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1b9b05-aa9b-4ccc-8786-9163fd73bb35 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.111072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1b9b05-aa9b-4ccc-8786-9163fd73bb35 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.112142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1b9b05-aa9b-4ccc-8786-9163fd73bb35 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.113035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1b9b05-aa9b-4ccc-8786-9163fd73bb35 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.113767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1b9b05-aa9b-4ccc-8786-9163fd73bb35 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.512116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fc1b9b05-aa9b-4ccc-8786-9163fd73bb35 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.525244 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fc1b9b05-aa9b-4ccc-8786-9163fd73bb35 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 0.441165 Oct 04 18:07:25.525938 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 787/1532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:25.548999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4cf22736-d764-4b9f-a632-ea052035eb0e tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d21c7a60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.557635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d8a65ebf-8a18-4977-aa66-a56f9270bcb9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.566108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d8a65ebf-8a18-4977-aa66-a56f9270bcb9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:25.582814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8a65ebf-8a18-4977-aa66-a56f9270bcb9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.583357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8a65ebf-8a18-4977-aa66-a56f9270bcb9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.583807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8a65ebf-8a18-4977-aa66-a56f9270bcb9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.584542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8a65ebf-8a18-4977-aa66-a56f9270bcb9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.585008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8a65ebf-8a18-4977-aa66-a56f9270bcb9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.587259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8a65ebf-8a18-4977-aa66-a56f9270bcb9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.589424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-4cf22736-d764-4b9f-a632-ea052035eb0e tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 74d9ffff-2c74-425d-9a51-8369ff5d8cc8 does not exist", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:07:25.590476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.security_group_api [None req-4cf22736-d764-4b9f-a632-ea052035eb0e tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Neutron security group 74d9ffff-2c74-425d-9a51-8369ff5d8cc8 not found {{(pid=122332) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:07:25.591522 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-4cf22736-d764-4b9f-a632-ea052035eb0e tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] HTTP exception thrown: Security group 74d9ffff-2c74-425d-9a51-8369ff5d8cc8 does not exist Oct 04 18:07:25.591522 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-2df62ba8-c1bf-460a-9971-f53f31f1b136'] Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4cf22736-d764-4b9f-a632-ea052035eb0e tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Request method failure captured: Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-security-groups/74d9ffff-2c74-425d-9a51-8369ff5d8cc8 HTTP/1.1 Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHZIP7ScH9Wml-BW7vpTZySPiV6cW6hSsG2b4mCqU0Ws0U5AhyL5VbtiTVumvDDfNphfzUJgMWRunA-CkTu_7zZfPhIST1tMXmA-36vyGsEAV0v_NEluxzCpqLtLSRurLZCqvGh0gGekFC41IrmVYsfURQ7r9andq0taV2-bFSgDBdI Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 574a72cf7746467fa0c18f74d20d7576 Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-207576944 Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:07:25.595965 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_574a72cf7746467fa0c18f74d20d7576"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/574a72cf7746467fa0c18f74d20d7576"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/574a72cf7746467fa0c18f74d20d7576"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/574a72cf7746467fa0c18f74d20d7576"}]}] Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupRulesTestJSON-207576944 Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 574a72cf7746467fa0c18f74d20d7576 Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-207576944 Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupRulesTestJSON-207576944-project Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 3a3e961a994c4a2aa7c16c84c9f60f23 Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupRulesTestJSON-207576944-project Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: exception: Security group 74d9ffff-2c74-425d-9a51-8369ff5d8cc8 does not exist Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-2df62ba8-c1bf-460a-9971-f53f31f1b136'] Oct 04 18:07:25.598159 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '74d9ffff-2c74-425d-9a51-8369ff5d8cc8'} Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:25.599191 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 74d9ffff-2c74-425d-9a51-8369ff5d8cc8 does not exist Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2df62ba8-c1bf-460a-9971-f53f31f1b136'] Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:07:25.600536 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 74d9ffff-2c74-425d-9a51-8369ff5d8cc8 does not exist Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2df62ba8-c1bf-460a-9971-f53f31f1b136'] Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 74d9ffff-2c74-425d-9a51-8369ff5d8cc8 does not exist Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2df62ba8-c1bf-460a-9971-f53f31f1b136'] Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:25.601806 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 74d9ffff-2c74-425d-9a51-8369ff5d8cc8 does not exist Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2df62ba8-c1bf-460a-9971-f53f31f1b136'] Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4cf22736-d764-4b9f-a632-ea052035eb0e tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Returning 404 to user: Security group 74d9ffff-2c74-425d-9a51-8369ff5d8cc8 does not exist Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-2df62ba8-c1bf-460a-9971-f53f31f1b136'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4cf22736-d764-4b9f-a632-ea052035eb0e tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/74d9ffff-2c74-425d-9a51-8369ff5d8cc8" status: 404 len: 194 microversion: 2.1 time: 0.071945 Oct 04 18:07:25.603362 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 788/1533] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:07:25 2022] DELETE /compute/v2.1/os-security-groups/74d9ffff-2c74-425d-9a51-8369ff5d8cc8 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:25.617081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce309bcb-40d4-4788-8a0c-0e9aa6922f40 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.617383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ce309bcb-40d4-4788-8a0c-0e9aa6922f40 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:25.632574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce309bcb-40d4-4788-8a0c-0e9aa6922f40 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.633081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce309bcb-40d4-4788-8a0c-0e9aa6922f40 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.634728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce309bcb-40d4-4788-8a0c-0e9aa6922f40 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.637264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce309bcb-40d4-4788-8a0c-0e9aa6922f40 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.639341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce309bcb-40d4-4788-8a0c-0e9aa6922f40 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.640087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce309bcb-40d4-4788-8a0c-0e9aa6922f40 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.841405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-d8a65ebf-8a18-4977-aa66-a56f9270bcb9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:25.858268 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d8a65ebf-8a18-4977-aa66-a56f9270bcb9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 2052 microversion: 2.25 time: 1.062509 Oct 04 18:07:25.871918 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 746/1534] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 2052 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:25.885579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.886194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:25.895143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.895942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.896570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.897620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.898274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.898879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.906082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ce309bcb-40d4-4788-8a0c-0e9aa6922f40 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.916314 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ce309bcb-40d4-4788-8a0c-0e9aa6922f40 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.310021 Oct 04 18:07:25.917334 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 789/1535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:25.926735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-13b8fb83-c091-4094-bda1-753c0508e2f4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.932943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-13b8fb83-c091-4094-bda1-753c0508e2f4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:25.958921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13b8fb83-c091-4094-bda1-753c0508e2f4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.960563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13b8fb83-c091-4094-bda1-753c0508e2f4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.961529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13b8fb83-c091-4094-bda1-753c0508e2f4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.963079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13b8fb83-c091-4094-bda1-753c0508e2f4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.964157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13b8fb83-c091-4094-bda1-753c0508e2f4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.965206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13b8fb83-c091-4094-bda1-753c0508e2f4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.003081 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-13b8fb83-c091-4094-bda1-753c0508e2f4 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083709 Oct 04 18:07:26.003639 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 790/1536] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:26.009773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a787c20-8440-46e9-99af-3b60e2ac9276 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d1bc1d30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:26.023197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:26.034342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:26.037036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:26.054410 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-207b3736-a85c-460c-8521-e8adcd1761df tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1558 microversion: 2.91 time: 0.181099 Oct 04 18:07:26.058651 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 747/1537] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:26.091064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be9537d1-2ff9-4b03-9e0e-d0e427a5e3d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:26.095507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be9537d1-2ff9-4b03-9e0e-d0e427a5e3d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:26.108651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9537d1-2ff9-4b03-9e0e-d0e427a5e3d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.110724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9537d1-2ff9-4b03-9e0e-d0e427a5e3d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.112170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9537d1-2ff9-4b03-9e0e-d0e427a5e3d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.114591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9537d1-2ff9-4b03-9e0e-d0e427a5e3d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.115732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9537d1-2ff9-4b03-9e0e-d0e427a5e3d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.116779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9537d1-2ff9-4b03-9e0e-d0e427a5e3d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.428551 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1a787c20-8440-46e9-99af-3b60e2ac9276 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c24e713b-d5d3-4668-b23c-bee8a997680f" status: 202 len: 0 microversion: 2.1 time: 0.422899 Oct 04 18:07:26.432576 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 791/1538] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:07:26 2022] DELETE /compute/v2.1/os-security-groups/c24e713b-d5d3-4668-b23c-bee8a997680f => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:26.447680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00a2ff3e-4349-44b3-9800-cb27c3f283f9 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d1b22790>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:26.454912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-be9537d1-2ff9-4b03-9e0e-d0e427a5e3d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:26.492996 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be9537d1-2ff9-4b03-9e0e-d0e427a5e3d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 2052 microversion: 2.25 time: 0.432791 Oct 04 18:07:26.494519 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 748/1539] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:26 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 2052 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:26.521225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c86c87f-cb8f-4814-8e83-86d0f35937fa tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:26.525157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c86c87f-cb8f-4814-8e83-86d0f35937fa tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.525664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c86c87f-cb8f-4814-8e83-86d0f35937fa tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.526115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c86c87f-cb8f-4814-8e83-86d0f35937fa tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.526878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c86c87f-cb8f-4814-8e83-86d0f35937fa tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.527483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c86c87f-cb8f-4814-8e83-86d0f35937fa tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.527934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c86c87f-cb8f-4814-8e83-86d0f35937fa tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.559229 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c86c87f-cb8f-4814-8e83-86d0f35937fa tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.042688 Oct 04 18:07:26.560958 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 749/1540] 10.222.0.18 () {60 vars in 1217 bytes} [Tue Oct 4 18:07:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:07:26.567166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12038170-d9e2-4e1c-96fd-a237b2066d40 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:26.568087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-12038170-d9e2-4e1c-96fd-a237b2066d40 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:26.576105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12038170-d9e2-4e1c-96fd-a237b2066d40 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.576801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12038170-d9e2-4e1c-96fd-a237b2066d40 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.577445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12038170-d9e2-4e1c-96fd-a237b2066d40 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.578352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12038170-d9e2-4e1c-96fd-a237b2066d40 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.578937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12038170-d9e2-4e1c-96fd-a237b2066d40 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.579406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12038170-d9e2-4e1c-96fd-a237b2066d40 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.927911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-12038170-d9e2-4e1c-96fd-a237b2066d40 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:26.953686 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12038170-d9e2-4e1c-96fd-a237b2066d40 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1476 microversion: 2.1 time: 0.391032 Oct 04 18:07:26.954595 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 750/1541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:26 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1476 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:26.966025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850499-14", "block_migration": "auto"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:26.969241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:26.984029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.985388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.985940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.986806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.987492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.988656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.029266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'flavor' on Instance uuid 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:27.046265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Going to try to live migrate instance to n-h1-850499-14 {{(pid=122331) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:07:27.077580 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00a2ff3e-4349-44b3-9800-cb27c3f283f9 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/016b5217-ce84-4aeb-8212-605fea1f6b67" status: 202 len: 0 microversion: 2.1 time: 0.641200 Oct 04 18:07:27.078881 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 792/1542] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:07:26 2022] DELETE /compute/v2.1/os-security-groups/016b5217-ce84-4aeb-8212-605fea1f6b67 => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:27.090471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3def7bcb-4292-4717-9766-a5d919c2b3a1 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:27.091672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3def7bcb-4292-4717-9766-a5d919c2b3a1 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:27.101546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3def7bcb-4292-4717-9766-a5d919c2b3a1 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.103349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3def7bcb-4292-4717-9766-a5d919c2b3a1 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.104811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3def7bcb-4292-4717-9766-a5d919c2b3a1 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.105944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3def7bcb-4292-4717-9766-a5d919c2b3a1 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.106792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3def7bcb-4292-4717-9766-a5d919c2b3a1 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.107515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3def7bcb-4292-4717-9766-a5d919c2b3a1 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.335974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3def7bcb-4292-4717-9766-a5d919c2b3a1 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.345036 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3def7bcb-4292-4717-9766-a5d919c2b3a1 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.264311 Oct 04 18:07:27.347029 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 793/1543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:27 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:27.352878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78f724a0-d1cc-4d93-b382-760c964def13 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:27.355642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78f724a0-d1cc-4d93-b382-760c964def13 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:27.363830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f724a0-d1cc-4d93-b382-760c964def13 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.364675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f724a0-d1cc-4d93-b382-760c964def13 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.365374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f724a0-d1cc-4d93-b382-760c964def13 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.366566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f724a0-d1cc-4d93-b382-760c964def13 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.368199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f724a0-d1cc-4d93-b382-760c964def13 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.369043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f724a0-d1cc-4d93-b382-760c964def13 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.407311 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78f724a0-d1cc-4d93-b382-760c964def13 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058424 Oct 04 18:07:27.413431 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 794/1544] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:07:27 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:27.419829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-352baff8-64c1-457f-a620-73cdde720083 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d1a7e5e0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:27.750769 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-352baff8-64c1-457f-a620-73cdde720083 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/2e35d0ad-0daf-4904-8cbc-10838a5aab56" status: 202 len: 0 microversion: 2.1 time: 0.335737 Oct 04 18:07:27.752762 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 795/1545] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:07:27 2022] DELETE /compute/v2.1/os-security-groups/2e35d0ad-0daf-4904-8cbc-10838a5aab56 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:27.768904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:27.773809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:27.803084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.805917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.807103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.809040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.812588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.813454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.969229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.981420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.983028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.991825 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b24ff9b-b153-4194-86f0-63cb78086ec8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.237147 Oct 04 18:07:27.999530 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 796/1546] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:27 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:28.033471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-00cb33b9-1f6d-41ee-95f9-0eb001340876 req-36870f75-b4fa-4416-90e0-75841d189488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "name": "network-vif-plugged", "status": "completed", "tag": "b7c9f9d0-f676-4a60-87ba-cbc4fe8c9d7d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:28.072059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-00cb33b9-1f6d-41ee-95f9-0eb001340876 req-36870f75-b4fa-4416-90e0-75841d189488 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.072861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-00cb33b9-1f6d-41ee-95f9-0eb001340876 req-36870f75-b4fa-4416-90e0-75841d189488 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.074975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-00cb33b9-1f6d-41ee-95f9-0eb001340876 req-36870f75-b4fa-4416-90e0-75841d189488 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.113874 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-00cb33b9-1f6d-41ee-95f9-0eb001340876 req-36870f75-b4fa-4416-90e0-75841d189488 service nova] Creating event network-vif-plugged:b7c9f9d0-f676-4a60-87ba-cbc4fe8c9d7d for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:28.130845 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-00cb33b9-1f6d-41ee-95f9-0eb001340876 req-36870f75-b4fa-4416-90e0-75841d189488 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124733 Oct 04 18:07:28.134486 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 797/1547] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:28.152042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e1980a7-c9e4-49e2-bfe4-64a6e61261b2 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d1b22af0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:29.486743 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e1980a7-c9e4-49e2-bfe4-64a6e61261b2 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d390b7f8-04fe-4cf1-bbc2-bb945b7e0f97" status: 202 len: 0 microversion: 2.1 time: 1.350086 Oct 04 18:07:29.491120 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 798/1548] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:07:28 2022] DELETE /compute/v2.1/os-security-groups/d390b7f8-04fe-4cf1-bbc2-bb945b7e0f97 => generated 0 bytes in 1356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:29.496556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-845584799", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a2884286-aa9a-463d-8f10-555c5aa8fb7e"}], "block_device_mapping_v2": [{"uuid": "84bb7424-499b-4220-8859-18aeadca44e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:29.598096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] validate_networks() for [('a2884286-aa9a-463d-8f10-555c5aa8fb7e', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:29.848398 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-da18e6dc-f254-437e-aaa1-f42ceb9d43ae tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab/action" status: 202 len: 0 microversion: 2.25 time: 2.891983 Oct 04 18:07:29.852957 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 751/1549] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:07:26 2022] POST /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab/action => generated 0 bytes in 2895 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:29.865543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-493147b6-def7-42ff-b8af-9ea9272f5641 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:29.868704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-493147b6-def7-42ff-b8af-9ea9272f5641 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:29.878477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-493147b6-def7-42ff-b8af-9ea9272f5641 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.879788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-493147b6-def7-42ff-b8af-9ea9272f5641 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.880254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-493147b6-def7-42ff-b8af-9ea9272f5641 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:29.881050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-493147b6-def7-42ff-b8af-9ea9272f5641 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.885316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-493147b6-def7-42ff-b8af-9ea9272f5641 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.886601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-493147b6-def7-42ff-b8af-9ea9272f5641 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.628602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-493147b6-def7-42ff-b8af-9ea9272f5641 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.654128 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-493147b6-def7-42ff-b8af-9ea9272f5641 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1475 microversion: 2.1 time: 0.790746 Oct 04 18:07:30.656465 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 752/1550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:29 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1475 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:30.685976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-81bdfea0-207d-43a2-abb0-22df682de596 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.687012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-81bdfea0-207d-43a2-abb0-22df682de596 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:30.709563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81bdfea0-207d-43a2-abb0-22df682de596 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.710470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81bdfea0-207d-43a2-abb0-22df682de596 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.715806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81bdfea0-207d-43a2-abb0-22df682de596 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.716980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81bdfea0-207d-43a2-abb0-22df682de596 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.717733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81bdfea0-207d-43a2-abb0-22df682de596 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.718560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81bdfea0-207d-43a2-abb0-22df682de596 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.375300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:31.376073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:31.376412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:31.377009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:31.377493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:31.402279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.403055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.403845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.404930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.405855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.406814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.456169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Getting quotas for project bc4df90b761348c082e7787ff4925299. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:31.468530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Getting quotas for user 327e7f9ab3d74ff4a4d1bb86d15ad8fc and project bc4df90b761348c082e7787ff4925299. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:31.590203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:31.592934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84bb7424-499b-4220-8859-18aeadca44e5',volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:31.664734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-81bdfea0-207d-43a2-abb0-22df682de596 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:31.689879 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-81bdfea0-207d-43a2-abb0-22df682de596 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 1.030990 Oct 04 18:07:31.692698 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 753/1551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:30 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:31.699370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5b5bc225-660f-413b-a11f-bfa3f9d775af tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:31.701989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5b5bc225-660f-413b-a11f-bfa3f9d775af tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:31.743535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b5bc225-660f-413b-a11f-bfa3f9d775af tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.744828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b5bc225-660f-413b-a11f-bfa3f9d775af tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.745514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b5bc225-660f-413b-a11f-bfa3f9d775af tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.746467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b5bc225-660f-413b-a11f-bfa3f9d775af tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.747325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b5bc225-660f-413b-a11f-bfa3f9d775af tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.748691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b5bc225-660f-413b-a11f-bfa3f9d775af tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.835827 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5b5bc225-660f-413b-a11f-bfa3f9d775af tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141008 Oct 04 18:07:31.838240 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 754/1552] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:07:31 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:07:31.867371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:31.872353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:31.905148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.906693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.908845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.911248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.914851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.916869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.976806 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9403b0b1-4353-42a0-b41d-40d9873b7c7d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.484454 Oct 04 18:07:31.988348 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 799/1553] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:32.016253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3bb54068-fa1d-45e3-b748-03d491fcd453 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] Calling method '.version_select at 0x7fd4d1a78550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:32.250235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.263943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.265394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.279580 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-db93fdb1-191d-444f-90d7-2f821c5992c5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.438875 Oct 04 18:07:32.280559 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 755/1554] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:31 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:32.293095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:32.294599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:32.309436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.309950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.310401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:32.311318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.311610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.312042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.025023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:33.045316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:33.047178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:33.048592 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e89eb953-a4ea-4d13-939b-67fba33816d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1567 microversion: 2.25 time: 0.766728 Oct 04 18:07:33.050389 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 756/1555] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:32 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1567 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:33.059528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-db40027e-d814-4578-8143-c8204f1a9e03 req-f32420cc-a38b-4f9a-9a52-b5514098df34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "name": "network-vif-plugged", "status": "completed", "tag": "ac1d4707-1c27-40af-9ec7-bb0a88a70075"}, {"server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "name": "network-vif-plugged", "status": "completed", "tag": "b211cb3c-33b7-4842-a49e-47fd06e827a6"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:33.082678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db40027e-d814-4578-8143-c8204f1a9e03 req-f32420cc-a38b-4f9a-9a52-b5514098df34 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.087769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db40027e-d814-4578-8143-c8204f1a9e03 req-f32420cc-a38b-4f9a-9a52-b5514098df34 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.088588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db40027e-d814-4578-8143-c8204f1a9e03 req-f32420cc-a38b-4f9a-9a52-b5514098df34 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.121797 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-db40027e-d814-4578-8143-c8204f1a9e03 req-f32420cc-a38b-4f9a-9a52-b5514098df34 service nova] Creating event network-vif-plugged:ac1d4707-1c27-40af-9ec7-bb0a88a70075 for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:33.122599 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-db40027e-d814-4578-8143-c8204f1a9e03 req-f32420cc-a38b-4f9a-9a52-b5514098df34 service nova] Creating event network-vif-plugged:b211cb3c-33b7-4842-a49e-47fd06e827a6 for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:33.130769 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-db40027e-d814-4578-8143-c8204f1a9e03 req-f32420cc-a38b-4f9a-9a52-b5514098df34 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074844 Oct 04 18:07:33.132054 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 757/1556] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:33.143395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-1ca15996-6089-426f-be0d-2436fa684153 req-30319556-bbf0-4d49-8650-0188e4b1343d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b522e60-ef39-4497-8da3-023eac9859af", "name": "network-vif-unplugged", "status": "completed", "tag": "f59d0713-eb06-474f-8c60-34c2e6eaf606"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:33.166419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1ca15996-6089-426f-be0d-2436fa684153 req-30319556-bbf0-4d49-8650-0188e4b1343d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.171752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1ca15996-6089-426f-be0d-2436fa684153 req-30319556-bbf0-4d49-8650-0188e4b1343d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.172465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1ca15996-6089-426f-be0d-2436fa684153 req-30319556-bbf0-4d49-8650-0188e4b1343d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.203614 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1ca15996-6089-426f-be0d-2436fa684153 req-30319556-bbf0-4d49-8650-0188e4b1343d service nova] Creating event network-vif-unplugged:f59d0713-eb06-474f-8c60-34c2e6eaf606 for instance 4b522e60-ef39-4497-8da3-023eac9859af on n-h1-850499-14 Oct 04 18:07:33.217436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-1ca15996-6089-426f-be0d-2436fa684153 req-30319556-bbf0-4d49-8650-0188e4b1343d service nova] Instance 4b522e60-ef39-4497-8da3-023eac9859af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:07:33.238845 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-1ca15996-6089-426f-be0d-2436fa684153 req-30319556-bbf0-4d49-8650-0188e4b1343d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105216 Oct 04 18:07:33.242558 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 758/1557] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:33.251800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57d489af-f72a-4e50-a65d-53e9876cbbc7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:33.257107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-57d489af-f72a-4e50-a65d-53e9876cbbc7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:33.274587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d489af-f72a-4e50-a65d-53e9876cbbc7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.275197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d489af-f72a-4e50-a65d-53e9876cbbc7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.275657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d489af-f72a-4e50-a65d-53e9876cbbc7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.276454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d489af-f72a-4e50-a65d-53e9876cbbc7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.276878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d489af-f72a-4e50-a65d-53e9876cbbc7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.277315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d489af-f72a-4e50-a65d-53e9876cbbc7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.085028 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3bb54068-fa1d-45e3-b748-03d491fcd453 tempest-SecurityGroupRulesTestJSON-207576944 tempest-SecurityGroupRulesTestJSON-207576944-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/e36da470-7416-45b0-9655-1dcf5ebaf5da" status: 202 len: 0 microversion: 2.1 time: 2.094261 Oct 04 18:07:34.086944 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 800/1558] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:07:31 2022] DELETE /compute/v2.1/os-security-groups/e36da470-7416-45b0-9655-1dcf5ebaf5da => generated 0 bytes in 2098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:34.104563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-164d4d09-587c-41ac-b852-9f88b7046f0d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:34.108994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-164d4d09-587c-41ac-b852-9f88b7046f0d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:34.128510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-164d4d09-587c-41ac-b852-9f88b7046f0d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.130193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-164d4d09-587c-41ac-b852-9f88b7046f0d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.132249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-164d4d09-587c-41ac-b852-9f88b7046f0d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.137538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-164d4d09-587c-41ac-b852-9f88b7046f0d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.138405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-164d4d09-587c-41ac-b852-9f88b7046f0d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.139063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-164d4d09-587c-41ac-b852-9f88b7046f0d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.206058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-57d489af-f72a-4e50-a65d-53e9876cbbc7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:34.221475 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-57d489af-f72a-4e50-a65d-53e9876cbbc7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1475 microversion: 2.1 time: 0.976785 Oct 04 18:07:34.228377 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 759/1559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:33 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1475 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:34.252881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1951945665", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "7b189823-babe-4aab-95c8-7413e2c1cca2"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:34.345698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-164d4d09-587c-41ac-b852-9f88b7046f0d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:34.357312 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-164d4d09-587c-41ac-b852-9f88b7046f0d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1150 microversion: 2.1 time: 0.268821 Oct 04 18:07:34.360907 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 801/1560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:34 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1150 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:34.374000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] validate_networks() for [('7b189823-babe-4aab-95c8-7413e2c1cca2', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:34.384145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-dd2f916a-2460-497a-8755-7f234b23200c req-196a2040-1055-4ce2-9519-ac3aea1dac0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01d60f-4bfb-4c40-9a29-8734c5aba5ab", "name": "network-vif-unplugged", "status": "completed", "tag": "d0b9b85c-0770-429a-a7d9-3683ed20319f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:34.400009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd2f916a-2460-497a-8755-7f234b23200c req-196a2040-1055-4ce2-9519-ac3aea1dac0a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.400876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd2f916a-2460-497a-8755-7f234b23200c req-196a2040-1055-4ce2-9519-ac3aea1dac0a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.401516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd2f916a-2460-497a-8755-7f234b23200c req-196a2040-1055-4ce2-9519-ac3aea1dac0a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.416750 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-dd2f916a-2460-497a-8755-7f234b23200c req-196a2040-1055-4ce2-9519-ac3aea1dac0a service nova] Creating event network-vif-unplugged:d0b9b85c-0770-429a-a7d9-3683ed20319f for instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab on n-h2-850499-14 Oct 04 18:07:34.423956 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-dd2f916a-2460-497a-8755-7f234b23200c req-196a2040-1055-4ce2-9519-ac3aea1dac0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060523 Oct 04 18:07:34.426171 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 802/1561] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:34.432323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-69a0c6db-543e-47c4-9aa0-e20335a2fbc0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:34.433333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-69a0c6db-543e-47c4-9aa0-e20335a2fbc0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:34.440511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69a0c6db-543e-47c4-9aa0-e20335a2fbc0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.441412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69a0c6db-543e-47c4-9aa0-e20335a2fbc0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.442224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69a0c6db-543e-47c4-9aa0-e20335a2fbc0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.443154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69a0c6db-543e-47c4-9aa0-e20335a2fbc0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.443796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69a0c6db-543e-47c4-9aa0-e20335a2fbc0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.444403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69a0c6db-543e-47c4-9aa0-e20335a2fbc0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.814809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-69a0c6db-543e-47c4-9aa0-e20335a2fbc0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:34.832235 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-69a0c6db-543e-47c4-9aa0-e20335a2fbc0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1355 microversion: 2.1 time: 0.403794 Oct 04 18:07:34.833191 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 803/1562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:34 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1355 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:34.846373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:34.848256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:34.860291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.861151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.864073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.865129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.865940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.866660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.018404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.036548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.038028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.057314 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-68f4c085-70f2-41ae-9036-e282e39337d2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.222840 Oct 04 18:07:35.058467 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 804/1563] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:34 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:35.063422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.064369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:35.084762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.085266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.086343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.087322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.087958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.088564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.773404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.783804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:35.809907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.812399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.821300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-41acecba-fb8f-4a3b-b997-5500f9038107 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1567 microversion: 2.25 time: 0.755472 Oct 04 18:07:35.849218 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 805/1564] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:35 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1567 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:35.872927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e0d7d328-e08d-49a3-8d0c-a20438df3255 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.873564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e0d7d328-e08d-49a3-8d0c-a20438df3255 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:35.903454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0d7d328-e08d-49a3-8d0c-a20438df3255 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.903966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0d7d328-e08d-49a3-8d0c-a20438df3255 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.904457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0d7d328-e08d-49a3-8d0c-a20438df3255 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.905193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0d7d328-e08d-49a3-8d0c-a20438df3255 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.905669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0d7d328-e08d-49a3-8d0c-a20438df3255 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.906107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0d7d328-e08d-49a3-8d0c-a20438df3255 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.032678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:36.033547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:36.033547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:36.033840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:36.034248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:36.066018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.067327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.067966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.068888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.069533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.070133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.184335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Getting quotas for project ae47a898442347e294b846831590285f. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:36.200702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Getting quotas for user 46c8316f57dd4741af0df67f141f2205 and project ae47a898442347e294b846831590285f. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:36.244640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:36.262181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e0d7d328-e08d-49a3-8d0c-a20438df3255 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.270870 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e0d7d328-e08d-49a3-8d0c-a20438df3255 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1475 microversion: 2.1 time: 0.420412 Oct 04 18:07:36.282978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:36.283369 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 806/1565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:35 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1475 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:36.290804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-552b5346-b965-44de-8f29-a3f9e90fc710 req-724d7971-8f92-4ca3-b90a-13a557c4c16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b522e60-ef39-4497-8da3-023eac9859af", "tag": "f59d0713-eb06-474f-8c60-34c2e6eaf606"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:36.326999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-552b5346-b965-44de-8f29-a3f9e90fc710 req-724d7971-8f92-4ca3-b90a-13a557c4c16b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.327512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-552b5346-b965-44de-8f29-a3f9e90fc710 req-724d7971-8f92-4ca3-b90a-13a557c4c16b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.327950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-552b5346-b965-44de-8f29-a3f9e90fc710 req-724d7971-8f92-4ca3-b90a-13a557c4c16b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.371656 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-552b5346-b965-44de-8f29-a3f9e90fc710 req-724d7971-8f92-4ca3-b90a-13a557c4c16b service nova] Creating event network-changed:f59d0713-eb06-474f-8c60-34c2e6eaf606 for instance 4b522e60-ef39-4497-8da3-023eac9859af on n-h1-850499-14 Oct 04 18:07:36.391631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-552b5346-b965-44de-8f29-a3f9e90fc710 req-724d7971-8f92-4ca3-b90a-13a557c4c16b service nova] Instance 4b522e60-ef39-4497-8da3-023eac9859af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:07:36.398903 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8daf12d6-9798-46c3-b039-9eb771179119 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.168244 Oct 04 18:07:36.401505 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 760/1566] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:36.429692 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-552b5346-b965-44de-8f29-a3f9e90fc710 req-724d7971-8f92-4ca3-b90a-13a557c4c16b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144962 Oct 04 18:07:36.430780 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 807/1567] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:36.438682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ada5f77-bb3e-4b03-ab50-f64fd1b4fdff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.439462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ada5f77-bb3e-4b03-ab50-f64fd1b4fdff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:36.450829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada5f77-bb3e-4b03-ab50-f64fd1b4fdff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.451293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada5f77-bb3e-4b03-ab50-f64fd1b4fdff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.451745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada5f77-bb3e-4b03-ab50-f64fd1b4fdff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.452468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada5f77-bb3e-4b03-ab50-f64fd1b4fdff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.452932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada5f77-bb3e-4b03-ab50-f64fd1b4fdff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.453366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada5f77-bb3e-4b03-ab50-f64fd1b4fdff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.469843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8b5eb654-de54-4224-a322-48a83fde1b38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.470524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8b5eb654-de54-4224-a322-48a83fde1b38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:36.490303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b5eb654-de54-4224-a322-48a83fde1b38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.490850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b5eb654-de54-4224-a322-48a83fde1b38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.491362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b5eb654-de54-4224-a322-48a83fde1b38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.493546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b5eb654-de54-4224-a322-48a83fde1b38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.494042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b5eb654-de54-4224-a322-48a83fde1b38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.494490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b5eb654-de54-4224-a322-48a83fde1b38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.705122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8b5eb654-de54-4224-a322-48a83fde1b38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.717872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:36.737500 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8b5eb654-de54-4224-a322-48a83fde1b38 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1168 microversion: 2.1 time: 0.326591 Oct 04 18:07:36.740191 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 761/1568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1168 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:36.760030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.760700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:36.777717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.780974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.782400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.785818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.787183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.790929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.908600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ada5f77-bb3e-4b03-ab50-f64fd1b4fdff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.923894 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ada5f77-bb3e-4b03-ab50-f64fd1b4fdff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1804 microversion: 2.1 time: 0.492273 Oct 04 18:07:36.929537 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 808/1569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1804 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:36.947478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5f422bb7-50a4-47ed-af3b-c84824a2c588 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.949963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5f422bb7-50a4-47ed-af3b-c84824a2c588 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.013119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:37.027736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:37.031843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:37.049036 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0e737ef8-d58b-49e4-9192-f725510db23d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.306345 Oct 04 18:07:37.051342 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 762/1570] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:37.082894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.083711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.095068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:37.100102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.101291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.101761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.102589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.103100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.103546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.114828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f422bb7-50a4-47ed-af3b-c84824a2c588 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:37.124147 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5f422bb7-50a4-47ed-af3b-c84824a2c588 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1218 microversion: 2.1 time: 0.193182 Oct 04 18:07:37.124758 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 809/1571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1218 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:37.143049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6b40b5f3-df25-4e66-8d58-60808147a52d req-5a1ed45c-d444-4b3a-86f9-a59bf71c588b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d01d60f-4bfb-4c40-9a29-8734c5aba5ab", "tag": "d0b9b85c-0770-429a-a7d9-3683ed20319f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:37.189091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6b40b5f3-df25-4e66-8d58-60808147a52d req-5a1ed45c-d444-4b3a-86f9-a59bf71c588b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.196274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6b40b5f3-df25-4e66-8d58-60808147a52d req-5a1ed45c-d444-4b3a-86f9-a59bf71c588b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.203719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6b40b5f3-df25-4e66-8d58-60808147a52d req-5a1ed45c-d444-4b3a-86f9-a59bf71c588b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.249010 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6b40b5f3-df25-4e66-8d58-60808147a52d req-5a1ed45c-d444-4b3a-86f9-a59bf71c588b service nova] Creating event network-changed:d0b9b85c-0770-429a-a7d9-3683ed20319f for instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab on n-h2-850499-14 Oct 04 18:07:37.274770 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6b40b5f3-df25-4e66-8d58-60808147a52d req-5a1ed45c-d444-4b3a-86f9-a59bf71c588b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143702 Oct 04 18:07:37.279401 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 810/1572] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:37.298064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9dc378a4-df89-49d6-ba57-d3281cf95952 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.300085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9dc378a4-df89-49d6-ba57-d3281cf95952 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.335041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc378a4-df89-49d6-ba57-d3281cf95952 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.338289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc378a4-df89-49d6-ba57-d3281cf95952 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.338905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc378a4-df89-49d6-ba57-d3281cf95952 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.340929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc378a4-df89-49d6-ba57-d3281cf95952 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.346039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc378a4-df89-49d6-ba57-d3281cf95952 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.346689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc378a4-df89-49d6-ba57-d3281cf95952 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.450872 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9dc378a4-df89-49d6-ba57-d3281cf95952 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8/ips" status: 200 len: 217 microversion: 2.1 time: 0.145334 Oct 04 18:07:37.455278 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 811/1573] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:07:37 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8/ips => generated 217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:37.473950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97a96efc-5a9c-423e-9f8c-60404cff4979 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.475391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-97a96efc-5a9c-423e-9f8c-60404cff4979 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.496337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97a96efc-5a9c-423e-9f8c-60404cff4979 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.500957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97a96efc-5a9c-423e-9f8c-60404cff4979 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.501829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97a96efc-5a9c-423e-9f8c-60404cff4979 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.503430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97a96efc-5a9c-423e-9f8c-60404cff4979 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.506800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97a96efc-5a9c-423e-9f8c-60404cff4979 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.509252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97a96efc-5a9c-423e-9f8c-60404cff4979 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.537036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:37.555166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:37.557023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:37.560327 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0aa8ce2d-ff17-45ff-bd1e-381b752c6320 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1567 microversion: 2.25 time: 0.494731 Oct 04 18:07:37.574984 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 763/1574] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:37 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1567 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:37.587511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd052971-3315-4ebd-a3bd-02264505473f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.587511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd052971-3315-4ebd-a3bd-02264505473f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.594636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd052971-3315-4ebd-a3bd-02264505473f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.595463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd052971-3315-4ebd-a3bd-02264505473f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.598632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd052971-3315-4ebd-a3bd-02264505473f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.600305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd052971-3315-4ebd-a3bd-02264505473f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.602608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd052971-3315-4ebd-a3bd-02264505473f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.604049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd052971-3315-4ebd-a3bd-02264505473f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.693547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd052971-3315-4ebd-a3bd-02264505473f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:37.933814 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd052971-3315-4ebd-a3bd-02264505473f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 204 len: 0 microversion: 2.1 time: 0.368715 Oct 04 18:07:37.934420 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 764/1575] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:37 2022] DELETE /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:37.944863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-97a96efc-5a9c-423e-9f8c-60404cff4979 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:37.959229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4a41276b-698e-46ae-a874-b313bb3dc40e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.959881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4a41276b-698e-46ae-a874-b313bb3dc40e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.972370 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-97a96efc-5a9c-423e-9f8c-60404cff4979 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1473 microversion: 2.1 time: 0.514397 Oct 04 18:07:37.979222 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 812/1576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:37 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1473 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:37.985389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b529d6d-ed33-4510-be2a-e3517799c151 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.986425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8b529d6d-ed33-4510-be2a-e3517799c151 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.990440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a41276b-698e-46ae-a874-b313bb3dc40e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.990948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a41276b-698e-46ae-a874-b313bb3dc40e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.991424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a41276b-698e-46ae-a874-b313bb3dc40e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.992177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a41276b-698e-46ae-a874-b313bb3dc40e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.992644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a41276b-698e-46ae-a874-b313bb3dc40e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.993134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a41276b-698e-46ae-a874-b313bb3dc40e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.022721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b529d6d-ed33-4510-be2a-e3517799c151 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.026381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b529d6d-ed33-4510-be2a-e3517799c151 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.028539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b529d6d-ed33-4510-be2a-e3517799c151 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.032256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b529d6d-ed33-4510-be2a-e3517799c151 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.039120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b529d6d-ed33-4510-be2a-e3517799c151 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.039782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b529d6d-ed33-4510-be2a-e3517799c151 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.162865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4a41276b-698e-46ae-a874-b313bb3dc40e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.209762 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4a41276b-698e-46ae-a874-b313bb3dc40e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1168 microversion: 2.1 time: 0.266303 Oct 04 18:07:38.216181 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 765/1577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:37 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1168 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:38.248831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.259846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:38.299238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.307108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.314623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.322447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.326649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.331429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.606854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.647980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.650272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.655232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8b529d6d-ed33-4510-be2a-e3517799c151 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.677768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b529d6d-ed33-4510-be2a-e3517799c151 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1810 microversion: 2.1 time: 0.696749 Oct 04 18:07:38.678821 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 813/1578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:37 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1810 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:38.684517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-044d7878-d99f-423d-944c-718542ba81a2 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.685419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-044d7878-d99f-423d-944c-718542ba81a2 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:38.692693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044d7878-d99f-423d-944c-718542ba81a2 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.693510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044d7878-d99f-423d-944c-718542ba81a2 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.693763 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d2660d0-a134-4363-9f57-01d68580145a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.475050 Oct 04 18:07:38.701372 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 766/1579] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:38 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:38.703613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044d7878-d99f-423d-944c-718542ba81a2 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.704710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044d7878-d99f-423d-944c-718542ba81a2 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.705601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044d7878-d99f-423d-944c-718542ba81a2 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.706259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044d7878-d99f-423d-944c-718542ba81a2 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.708932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.709586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:38.732665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.733183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.740708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.741679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.742171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.742675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.856128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-044d7878-d99f-423d-944c-718542ba81a2 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.878212 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-044d7878-d99f-423d-944c-718542ba81a2 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1270 microversion: 2.1 time: 0.198010 Oct 04 18:07:38.880056 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 814/1580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:38 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:39.010545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3cd4bddb-419d-4e55-99ab-cea3e6a08e4d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.011787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3cd4bddb-419d-4e55-99ab-cea3e6a08e4d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.040345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cd4bddb-419d-4e55-99ab-cea3e6a08e4d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.040856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cd4bddb-419d-4e55-99ab-cea3e6a08e4d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.041306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cd4bddb-419d-4e55-99ab-cea3e6a08e4d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.042279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cd4bddb-419d-4e55-99ab-cea3e6a08e4d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.042760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cd4bddb-419d-4e55-99ab-cea3e6a08e4d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.043240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cd4bddb-419d-4e55-99ab-cea3e6a08e4d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.182732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.200597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.205052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.212160 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc6d5056-2706-464e-bfa9-e9899e4deb6b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1567 microversion: 2.25 time: 0.505466 Oct 04 18:07:39.234101 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 767/1581] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:38 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1567 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:39.247866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2923dcc-d265-4f3a-8110-aa147d0c0f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.248830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a2923dcc-d265-4f3a-8110-aa147d0c0f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.270206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2923dcc-d265-4f3a-8110-aa147d0c0f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.270741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2923dcc-d265-4f3a-8110-aa147d0c0f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.271315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2923dcc-d265-4f3a-8110-aa147d0c0f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.272059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2923dcc-d265-4f3a-8110-aa147d0c0f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.272505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2923dcc-d265-4f3a-8110-aa147d0c0f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.273146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2923dcc-d265-4f3a-8110-aa147d0c0f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.364833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3cd4bddb-419d-4e55-99ab-cea3e6a08e4d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.386489 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3cd4bddb-419d-4e55-99ab-cea3e6a08e4d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1473 microversion: 2.1 time: 0.379426 Oct 04 18:07:39.413920 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 815/1582] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1473 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:39.480426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a2923dcc-d265-4f3a-8110-aa147d0c0f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.493093 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a2923dcc-d265-4f3a-8110-aa147d0c0f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1168 microversion: 2.1 time: 0.257782 Oct 04 18:07:39.500149 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 768/1583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1168 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:39.709644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78294262-a01a-458f-af5b-80c87dc4a99c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.710905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78294262-a01a-458f-af5b-80c87dc4a99c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.723018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.723680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.728181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78294262-a01a-458f-af5b-80c87dc4a99c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.730554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78294262-a01a-458f-af5b-80c87dc4a99c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.731150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78294262-a01a-458f-af5b-80c87dc4a99c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.731933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78294262-a01a-458f-af5b-80c87dc4a99c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.732451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78294262-a01a-458f-af5b-80c87dc4a99c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.737711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.738862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78294262-a01a-458f-af5b-80c87dc4a99c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.739298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.739941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.741036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.741666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.745212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.107833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.132747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.146143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.169445 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b843ba82-dbef-4195-8bc7-9929aac10276 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.450436 Oct 04 18:07:40.200523 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 769/1584] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:40.223404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6fe505e6-7277-4c62-a292-531d57efe5e1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.224335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6fe505e6-7277-4c62-a292-531d57efe5e1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:40.244358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe505e6-7277-4c62-a292-531d57efe5e1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.245143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe505e6-7277-4c62-a292-531d57efe5e1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.246522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe505e6-7277-4c62-a292-531d57efe5e1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.247574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe505e6-7277-4c62-a292-531d57efe5e1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.249723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe505e6-7277-4c62-a292-531d57efe5e1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.251322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe505e6-7277-4c62-a292-531d57efe5e1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.328878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78294262-a01a-458f-af5b-80c87dc4a99c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.358889 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78294262-a01a-458f-af5b-80c87dc4a99c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1810 microversion: 2.1 time: 0.651368 Oct 04 18:07:40.362157 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 816/1585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1810 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:40.391357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.398708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:40.427788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.445554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.446307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.447164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.447664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.448138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.527748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6fe505e6-7277-4c62-a292-531d57efe5e1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.548707 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6fe505e6-7277-4c62-a292-531d57efe5e1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1288 microversion: 2.1 time: 0.339351 Oct 04 18:07:40.554613 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 770/1586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1288 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:40.589056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f811bece-e428-40cb-bd7b-5789bc8e90a7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.601669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f811bece-e428-40cb-bd7b-5789bc8e90a7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:40.637687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f811bece-e428-40cb-bd7b-5789bc8e90a7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.641203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f811bece-e428-40cb-bd7b-5789bc8e90a7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.642543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f811bece-e428-40cb-bd7b-5789bc8e90a7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.650402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f811bece-e428-40cb-bd7b-5789bc8e90a7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.651056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f811bece-e428-40cb-bd7b-5789bc8e90a7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.655107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f811bece-e428-40cb-bd7b-5789bc8e90a7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.085368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.098669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.104117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.105565 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-91ac7435-4831-4ffd-baa4-1ea1e8465720 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1567 microversion: 2.25 time: 0.736252 Oct 04 18:07:41.110756 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 817/1587] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1567 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:41.122583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-40965876-4e80-4b71-9e75-b3ffdf4cd54b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.131423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-40965876-4e80-4b71-9e75-b3ffdf4cd54b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.154187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40965876-4e80-4b71-9e75-b3ffdf4cd54b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.155334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40965876-4e80-4b71-9e75-b3ffdf4cd54b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.155813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40965876-4e80-4b71-9e75-b3ffdf4cd54b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.161341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40965876-4e80-4b71-9e75-b3ffdf4cd54b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.164094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40965876-4e80-4b71-9e75-b3ffdf4cd54b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.166300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40965876-4e80-4b71-9e75-b3ffdf4cd54b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.245281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f811bece-e428-40cb-bd7b-5789bc8e90a7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.256076 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f811bece-e428-40cb-bd7b-5789bc8e90a7 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1470 microversion: 2.1 time: 0.700015 Oct 04 18:07:41.267400 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 771/1588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1470 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.272506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.273135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.300925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.301471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.301930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.302691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.303224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.303739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.439004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:41.486577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-40965876-4e80-4b71-9e75-b3ffdf4cd54b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.489841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.500996 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-40965876-4e80-4b71-9e75-b3ffdf4cd54b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1168 microversion: 2.1 time: 0.381996 Oct 04 18:07:41.504188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.507413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.515741 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 818/1589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1168 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.524776 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27b24e21-b1d8-4b3b-87dd-6ba9d1f72696 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.255214 Oct 04 18:07:41.529477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b665cf9-e090-48c6-a8ec-ac0b77942cc8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:41.532841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1b665cf9-e090-48c6-a8ec-ac0b77942cc8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.540331 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 772/1590] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:41.548697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b665cf9-e090-48c6-a8ec-ac0b77942cc8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.552327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b665cf9-e090-48c6-a8ec-ac0b77942cc8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.558171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b665cf9-e090-48c6-a8ec-ac0b77942cc8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.560835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b171f1dc-6b41-4230-a25f-51e07a0faa72 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.561509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b171f1dc-6b41-4230-a25f-51e07a0faa72 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.562206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b665cf9-e090-48c6-a8ec-ac0b77942cc8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.562899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b665cf9-e090-48c6-a8ec-ac0b77942cc8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.563668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b665cf9-e090-48c6-a8ec-ac0b77942cc8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.569874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b171f1dc-6b41-4230-a25f-51e07a0faa72 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.570384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b171f1dc-6b41-4230-a25f-51e07a0faa72 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.570835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b171f1dc-6b41-4230-a25f-51e07a0faa72 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.572714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b171f1dc-6b41-4230-a25f-51e07a0faa72 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.574219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b171f1dc-6b41-4230-a25f-51e07a0faa72 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.574669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b171f1dc-6b41-4230-a25f-51e07a0faa72 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.865330 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b665cf9-e090-48c6-a8ec-ac0b77942cc8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "POST /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af/action" status: 202 len: 0 microversion: 2.1 time: 0.347767 Oct 04 18:07:41.871769 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 819/1591] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:41 2022] POST /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:41.881762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1220324e-ed92-4ea5-8d3f-ff90136baf19 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.883712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1220324e-ed92-4ea5-8d3f-ff90136baf19 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.893899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1220324e-ed92-4ea5-8d3f-ff90136baf19 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.896092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1220324e-ed92-4ea5-8d3f-ff90136baf19 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.896869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1220324e-ed92-4ea5-8d3f-ff90136baf19 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.898030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1220324e-ed92-4ea5-8d3f-ff90136baf19 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.898739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1220324e-ed92-4ea5-8d3f-ff90136baf19 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.899492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1220324e-ed92-4ea5-8d3f-ff90136baf19 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.950186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b171f1dc-6b41-4230-a25f-51e07a0faa72 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.961826 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b171f1dc-6b41-4230-a25f-51e07a0faa72 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1810 microversion: 2.1 time: 0.419935 Oct 04 18:07:41.962752 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 773/1592] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1810 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.967438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5c6aa97-0527-4ce5-ada4-c025a976a16d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.974773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a5c6aa97-0527-4ce5-ada4-c025a976a16d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.988087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5c6aa97-0527-4ce5-ada4-c025a976a16d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.990360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5c6aa97-0527-4ce5-ada4-c025a976a16d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.991082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5c6aa97-0527-4ce5-ada4-c025a976a16d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.994932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5c6aa97-0527-4ce5-ada4-c025a976a16d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.008262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5c6aa97-0527-4ce5-ada4-c025a976a16d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.009000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5c6aa97-0527-4ce5-ada4-c025a976a16d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.046211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1220324e-ed92-4ea5-8d3f-ff90136baf19 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.054845 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1220324e-ed92-4ea5-8d3f-ff90136baf19 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1276 microversion: 2.1 time: 0.180785 Oct 04 18:07:42.071434 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 820/1593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:42.137298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:42.138393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:42.152584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.157712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.160111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.163648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.171019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.171705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.538426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a5c6aa97-0527-4ce5-ada4-c025a976a16d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.567505 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a5c6aa97-0527-4ce5-ada4-c025a976a16d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1469 microversion: 2.1 time: 0.603188 Oct 04 18:07:42.575155 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 774/1594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1469 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:42.580529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99e1d7da-e660-4555-9c7e-ad42111dfb86 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:42.581226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99e1d7da-e660-4555-9c7e-ad42111dfb86 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:42.608983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99e1d7da-e660-4555-9c7e-ad42111dfb86 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.609502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99e1d7da-e660-4555-9c7e-ad42111dfb86 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.609955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99e1d7da-e660-4555-9c7e-ad42111dfb86 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.610702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99e1d7da-e660-4555-9c7e-ad42111dfb86 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.611226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99e1d7da-e660-4555-9c7e-ad42111dfb86 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.611666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99e1d7da-e660-4555-9c7e-ad42111dfb86 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.793220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-99e1d7da-e660-4555-9c7e-ad42111dfb86 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.809985 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99e1d7da-e660-4555-9c7e-ad42111dfb86 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1168 microversion: 2.1 time: 0.233638 Oct 04 18:07:42.811342 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 775/1595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1168 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:42.834366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:42.836377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:42.849521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.860054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.860720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.861185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.862076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.863721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.864216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.864660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.872075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.873376 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2f4a5abb-1870-4301-beb3-5f7bea22c6fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1567 microversion: 2.25 time: 0.741528 Oct 04 18:07:42.883058 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 821/1596] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1567 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:07:42.999953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2349063c-1068-489b-9117-9d5602c94029 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.000702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2349063c-1068-489b-9117-9d5602c94029 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:43.007651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.015443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:43.018985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.020975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.024868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:43.029547 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-11404daa-4281-4bdf-b239-1aba3b7122ad tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.216842 Oct 04 18:07:43.030075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2349063c-1068-489b-9117-9d5602c94029 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.030743 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 776/1597] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:43.031849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2349063c-1068-489b-9117-9d5602c94029 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.032954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2349063c-1068-489b-9117-9d5602c94029 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.034354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2349063c-1068-489b-9117-9d5602c94029 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.036141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2349063c-1068-489b-9117-9d5602c94029 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.036594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2349063c-1068-489b-9117-9d5602c94029 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.089574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fb1f9847-e66d-42c4-8992-9548a85aeb9e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.090494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb1f9847-e66d-42c4-8992-9548a85aeb9e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:43.099581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1f9847-e66d-42c4-8992-9548a85aeb9e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.108845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1f9847-e66d-42c4-8992-9548a85aeb9e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.113361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1f9847-e66d-42c4-8992-9548a85aeb9e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.114419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1f9847-e66d-42c4-8992-9548a85aeb9e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.115677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1f9847-e66d-42c4-8992-9548a85aeb9e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.127825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1f9847-e66d-42c4-8992-9548a85aeb9e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.500047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fb1f9847-e66d-42c4-8992-9548a85aeb9e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.509456 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fb1f9847-e66d-42c4-8992-9548a85aeb9e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1276 microversion: 2.1 time: 0.424285 Oct 04 18:07:43.514406 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 777/1598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:43 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1276 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:43.606098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-708c3742-b853-4fe0-b29a-bf9a3716be90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.608186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-708c3742-b853-4fe0-b29a-bf9a3716be90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:43.633291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-708c3742-b853-4fe0-b29a-bf9a3716be90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.634523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-708c3742-b853-4fe0-b29a-bf9a3716be90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.640104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-708c3742-b853-4fe0-b29a-bf9a3716be90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.641801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-708c3742-b853-4fe0-b29a-bf9a3716be90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.642907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-708c3742-b853-4fe0-b29a-bf9a3716be90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.644039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-708c3742-b853-4fe0-b29a-bf9a3716be90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.728725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2349063c-1068-489b-9117-9d5602c94029 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.738108 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2349063c-1068-489b-9117-9d5602c94029 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1810 microversion: 2.1 time: 0.745068 Oct 04 18:07:43.752036 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 822/1599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1810 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:43.837234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7306ab31-4b97-4715-9593-72e15b2ad6b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.837983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7306ab31-4b97-4715-9593-72e15b2ad6b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:43.852505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7306ab31-4b97-4715-9593-72e15b2ad6b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.861542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7306ab31-4b97-4715-9593-72e15b2ad6b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.861542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7306ab31-4b97-4715-9593-72e15b2ad6b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.861542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7306ab31-4b97-4715-9593-72e15b2ad6b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.861542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7306ab31-4b97-4715-9593-72e15b2ad6b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.866213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7306ab31-4b97-4715-9593-72e15b2ad6b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.869709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:45.384239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7306ab31-4b97-4715-9593-72e15b2ad6b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.394920 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7306ab31-4b97-4715-9593-72e15b2ad6b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1210 microversion: 2.1 time: 1.562580 Oct 04 18:07:45.415399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-708c3742-b853-4fe0-b29a-bf9a3716be90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.425005 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 823/1600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:43 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1210 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:45.431663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e3a8efb1-96fb-4b68-8efd-88e11336b835 req-1c6ed889-676d-4521-80ee-dd5aafe06fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b522e60-ef39-4497-8da3-023eac9859af", "name": "network-vif-plugged", "status": "completed", "tag": "f59d0713-eb06-474f-8c60-34c2e6eaf606"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:45.433097 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-708c3742-b853-4fe0-b29a-bf9a3716be90 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1469 microversion: 2.1 time: 1.833603 Oct 04 18:07:45.435845 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 778/1601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:43 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1469 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:45.459005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.460039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.480592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e3a8efb1-96fb-4b68-8efd-88e11336b835 req-1c6ed889-676d-4521-80ee-dd5aafe06fca service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.483289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.486076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e3a8efb1-96fb-4b68-8efd-88e11336b835 req-1c6ed889-676d-4521-80ee-dd5aafe06fca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.495359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.496810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e3a8efb1-96fb-4b68-8efd-88e11336b835 req-1c6ed889-676d-4521-80ee-dd5aafe06fca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.497925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.501460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.503581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.504551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.538079 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e3a8efb1-96fb-4b68-8efd-88e11336b835 req-1c6ed889-676d-4521-80ee-dd5aafe06fca service nova] Creating event network-vif-plugged:f59d0713-eb06-474f-8c60-34c2e6eaf606 for instance 4b522e60-ef39-4497-8da3-023eac9859af on n-h1-850499-14 Oct 04 18:07:45.551123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-e3a8efb1-96fb-4b68-8efd-88e11336b835 req-1c6ed889-676d-4521-80ee-dd5aafe06fca service nova] Instance 4b522e60-ef39-4497-8da3-023eac9859af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:07:45.579437 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e3a8efb1-96fb-4b68-8efd-88e11336b835 req-1c6ed889-676d-4521-80ee-dd5aafe06fca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148196 Oct 04 18:07:45.582084 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 824/1602] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:45.595242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.596775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.613200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.617007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.618475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.620063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.621035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.622259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.882184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.893970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.918191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.942824 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-82b9fe54-97aa-44db-9a74-cf5e0953168b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.357375 Oct 04 18:07:45.965677 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 825/1603] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:45.976372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-305ab687-2d98-4571-bef2-6f956fccf2d9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.977020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-305ab687-2d98-4571-bef2-6f956fccf2d9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.994301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-305ab687-2d98-4571-bef2-6f956fccf2d9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.994705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-305ab687-2d98-4571-bef2-6f956fccf2d9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.995348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-305ab687-2d98-4571-bef2-6f956fccf2d9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.996083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-305ab687-2d98-4571-bef2-6f956fccf2d9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.996552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-305ab687-2d98-4571-bef2-6f956fccf2d9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.996987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-305ab687-2d98-4571-bef2-6f956fccf2d9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.038151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:46.059757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:46.071247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:46.079693 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0864c25c-2ccc-4484-bc0f-002e4f0dc7fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1567 microversion: 2.25 time: 0.637091 Oct 04 18:07:46.098680 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 779/1604] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1567 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:46.121126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-26dc33d1-ae1c-49ab-98ef-c9a7cea62ba6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:46.121881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-26dc33d1-ae1c-49ab-98ef-c9a7cea62ba6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:46.132089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:46.155583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dc33d1-ae1c-49ab-98ef-c9a7cea62ba6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.156089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dc33d1-ae1c-49ab-98ef-c9a7cea62ba6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.156532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dc33d1-ae1c-49ab-98ef-c9a7cea62ba6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.166881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dc33d1-ae1c-49ab-98ef-c9a7cea62ba6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.167444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dc33d1-ae1c-49ab-98ef-c9a7cea62ba6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.167892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dc33d1-ae1c-49ab-98ef-c9a7cea62ba6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.223474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:46.259420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-305ab687-2d98-4571-bef2-6f956fccf2d9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:46.290710 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-305ab687-2d98-4571-bef2-6f956fccf2d9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1276 microversion: 2.1 time: 0.324050 Oct 04 18:07:46.297084 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 826/1605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1276 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:46.417739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f3348ff4-da40-4749-b49f-3a603231dcd7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:46.418654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f3348ff4-da40-4749-b49f-3a603231dcd7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:46.432108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3348ff4-da40-4749-b49f-3a603231dcd7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.432623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3348ff4-da40-4749-b49f-3a603231dcd7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.433075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3348ff4-da40-4749-b49f-3a603231dcd7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.433814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3348ff4-da40-4749-b49f-3a603231dcd7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.434277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3348ff4-da40-4749-b49f-3a603231dcd7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.434713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3348ff4-da40-4749-b49f-3a603231dcd7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.086091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-26dc33d1-ae1c-49ab-98ef-c9a7cea62ba6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.098895 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-26dc33d1-ae1c-49ab-98ef-c9a7cea62ba6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1789 microversion: 2.1 time: 0.998528 Oct 04 18:07:47.100220 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 780/1606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:46 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1789 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:47.109926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fac341cf-0351-4275-a566-fc2988ec7c01 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.110907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fac341cf-0351-4275-a566-fc2988ec7c01 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:47.118838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fac341cf-0351-4275-a566-fc2988ec7c01 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.119756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fac341cf-0351-4275-a566-fc2988ec7c01 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.120521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fac341cf-0351-4275-a566-fc2988ec7c01 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.121516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fac341cf-0351-4275-a566-fc2988ec7c01 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.122765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:47.123126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fac341cf-0351-4275-a566-fc2988ec7c01 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.124301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fac341cf-0351-4275-a566-fc2988ec7c01 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.426234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f3348ff4-da40-4749-b49f-3a603231dcd7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.448307 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f3348ff4-da40-4749-b49f-3a603231dcd7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1210 microversion: 2.1 time: 1.034254 Oct 04 18:07:47.449719 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 827/1607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:46 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1210 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:47.458766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-82deb569-2a43-468b-82f7-45744e1deb3a req-a68af3ad-a921-4b1c-8795-c82c41280957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "name": "network-vif-deleted", "tag": "b211cb3c-33b7-4842-a49e-47fd06e827a6"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:47.493959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-82deb569-2a43-468b-82f7-45744e1deb3a req-a68af3ad-a921-4b1c-8795-c82c41280957 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.494724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-82deb569-2a43-468b-82f7-45744e1deb3a req-a68af3ad-a921-4b1c-8795-c82c41280957 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.495437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-82deb569-2a43-468b-82f7-45744e1deb3a req-a68af3ad-a921-4b1c-8795-c82c41280957 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.529289 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-82deb569-2a43-468b-82f7-45744e1deb3a req-a68af3ad-a921-4b1c-8795-c82c41280957 service nova] Creating event network-vif-deleted:b211cb3c-33b7-4842-a49e-47fd06e827a6 for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:47.539971 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-82deb569-2a43-468b-82f7-45744e1deb3a req-a68af3ad-a921-4b1c-8795-c82c41280957 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088650 Oct 04 18:07:47.541367 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 828/1608] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:47.550505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.556128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:47.572482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.580600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.583507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.584841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.585698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.586511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.844600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fac341cf-0351-4275-a566-fc2988ec7c01 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.861924 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fac341cf-0351-4275-a566-fc2988ec7c01 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1469 microversion: 2.1 time: 0.760164 Oct 04 18:07:47.863224 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 781/1609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1469 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:47.873094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.887893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:47.896511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.897339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.898035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.903333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.904224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.905268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.964294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.980870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.982527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.998335 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b450d7fd-a6e6-43b8-9717-f48bce94598e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.452454 Oct 04 18:07:47.999470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 829/1610] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:48.016886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e076fda7-94f6-43c8-aff4-d0c126e32001 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.017948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e076fda7-94f6-43c8-aff4-d0c126e32001 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.025221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e076fda7-94f6-43c8-aff4-d0c126e32001 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.026020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e076fda7-94f6-43c8-aff4-d0c126e32001 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.026660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e076fda7-94f6-43c8-aff4-d0c126e32001 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.027631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e076fda7-94f6-43c8-aff4-d0c126e32001 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.028089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e076fda7-94f6-43c8-aff4-d0c126e32001 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.028514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e076fda7-94f6-43c8-aff4-d0c126e32001 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.169137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e076fda7-94f6-43c8-aff4-d0c126e32001 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:48.180172 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e076fda7-94f6-43c8-aff4-d0c126e32001 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1276 microversion: 2.1 time: 0.178940 Oct 04 18:07:48.182026 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 830/1611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:48.187561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-8d3bc8d4-0b40-4df6-a4d3-d01e882dc84c req-55136db4-7e90-427a-98ea-607cb832e094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "name": "network-vif-unplugged", "status": "completed", "tag": "b7c9f9d0-f676-4a60-87ba-cbc4fe8c9d7d"}, {"server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "name": "network-vif-unplugged", "status": "completed", "tag": "ac1d4707-1c27-40af-9ec7-bb0a88a70075"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:48.202381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8d3bc8d4-0b40-4df6-a4d3-d01e882dc84c req-55136db4-7e90-427a-98ea-607cb832e094 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.203208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8d3bc8d4-0b40-4df6-a4d3-d01e882dc84c req-55136db4-7e90-427a-98ea-607cb832e094 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.203824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8d3bc8d4-0b40-4df6-a4d3-d01e882dc84c req-55136db4-7e90-427a-98ea-607cb832e094 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.217542 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-8d3bc8d4-0b40-4df6-a4d3-d01e882dc84c req-55136db4-7e90-427a-98ea-607cb832e094 service nova] Creating event network-vif-unplugged:b7c9f9d0-f676-4a60-87ba-cbc4fe8c9d7d for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:48.218406 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-8d3bc8d4-0b40-4df6-a4d3-d01e882dc84c req-55136db4-7e90-427a-98ea-607cb832e094 service nova] Creating event network-vif-unplugged:ac1d4707-1c27-40af-9ec7-bb0a88a70075 for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:48.227526 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-8d3bc8d4-0b40-4df6-a4d3-d01e882dc84c req-55136db4-7e90-427a-98ea-607cb832e094 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.043757 Oct 04 18:07:48.228722 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 831/1612] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:48.235829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e5ea5089-741f-41d5-9141-ffaf8b64883f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.236895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e5ea5089-741f-41d5-9141-ffaf8b64883f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.244657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ea5089-741f-41d5-9141-ffaf8b64883f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.245506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ea5089-741f-41d5-9141-ffaf8b64883f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.246130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ea5089-741f-41d5-9141-ffaf8b64883f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.247102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ea5089-741f-41d5-9141-ffaf8b64883f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.247754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ea5089-741f-41d5-9141-ffaf8b64883f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.248395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ea5089-741f-41d5-9141-ffaf8b64883f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.503795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:48.516071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:48.528656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:48.529928 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8105a64f-320a-4cbb-ab93-f1f2d88f88d2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1567 microversion: 2.25 time: 0.660857 Oct 04 18:07:48.530851 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 782/1613] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1567 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:48.535614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f8019998-b318-4ae4-a86c-3a9ebf5b353b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.536233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f8019998-b318-4ae4-a86c-3a9ebf5b353b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.562638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8019998-b318-4ae4-a86c-3a9ebf5b353b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.563176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8019998-b318-4ae4-a86c-3a9ebf5b353b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.563585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8019998-b318-4ae4-a86c-3a9ebf5b353b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.564248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8019998-b318-4ae4-a86c-3a9ebf5b353b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.564710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8019998-b318-4ae4-a86c-3a9ebf5b353b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.565141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8019998-b318-4ae4-a86c-3a9ebf5b353b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.490493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e5ea5089-741f-41d5-9141-ffaf8b64883f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:49.543977 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e5ea5089-741f-41d5-9141-ffaf8b64883f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1631 microversion: 2.1 time: 1.306878 Oct 04 18:07:49.544972 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 832/1614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1631 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:49.568996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e0f9b648-86fd-414a-94ad-c32e93bf53e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.569636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e0f9b648-86fd-414a-94ad-c32e93bf53e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.576147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f8019998-b318-4ae4-a86c-3a9ebf5b353b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:49.585583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0f9b648-86fd-414a-94ad-c32e93bf53e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.589468 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f8019998-b318-4ae4-a86c-3a9ebf5b353b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 1.057511 Oct 04 18:07:49.589686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0f9b648-86fd-414a-94ad-c32e93bf53e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.590231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0f9b648-86fd-414a-94ad-c32e93bf53e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.593273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0f9b648-86fd-414a-94ad-c32e93bf53e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.596014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0f9b648-86fd-414a-94ad-c32e93bf53e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.599750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0f9b648-86fd-414a-94ad-c32e93bf53e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.603447 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 783/1615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:49.620961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.621591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.634878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.641010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.644244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.650068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.651123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.654052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.028991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:50.060281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:50.080774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:50.135635 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-38d1d22d-7733-493b-99e3-299d59004630 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.530809 Oct 04 18:07:50.139841 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 784/1616] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:50.205333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d7506bc-06ea-4638-8ad6-4709b8ea8064 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:50.207933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d7506bc-06ea-4638-8ad6-4709b8ea8064 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:50.230833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d7506bc-06ea-4638-8ad6-4709b8ea8064 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.232057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e0f9b648-86fd-414a-94ad-c32e93bf53e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:50.235837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d7506bc-06ea-4638-8ad6-4709b8ea8064 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.242305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d7506bc-06ea-4638-8ad6-4709b8ea8064 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.243253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d7506bc-06ea-4638-8ad6-4709b8ea8064 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.244235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d7506bc-06ea-4638-8ad6-4709b8ea8064 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.245288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d7506bc-06ea-4638-8ad6-4709b8ea8064 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.249917 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e0f9b648-86fd-414a-94ad-c32e93bf53e5 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1469 microversion: 2.1 time: 0.703574 Oct 04 18:07:50.254438 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 833/1617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1469 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:50.283871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:50.285649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:50.299555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.303034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.304188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.306545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.308275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.308915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.983007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.027760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.029799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.032432 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b929f2df-839c-419e-b748-b72a2c6140e3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1567 microversion: 2.25 time: 0.776305 Oct 04 18:07:51.036215 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 834/1618] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:50 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1567 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:51.050676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-775c58b4-bbc2-4c59-a758-c3394974f389 req-12d9722a-32f4-48d7-8f8e-4d3b525beffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc93dc3-d2ac-4450-92fd-63bbedaf9b92", "tag": "041c1840-6713-484f-9db9-ed4df1bc61a0"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:51.085925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-775c58b4-bbc2-4c59-a758-c3394974f389 req-12d9722a-32f4-48d7-8f8e-4d3b525beffc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.087551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-775c58b4-bbc2-4c59-a758-c3394974f389 req-12d9722a-32f4-48d7-8f8e-4d3b525beffc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.090797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-775c58b4-bbc2-4c59-a758-c3394974f389 req-12d9722a-32f4-48d7-8f8e-4d3b525beffc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.131564 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-775c58b4-bbc2-4c59-a758-c3394974f389 req-12d9722a-32f4-48d7-8f8e-4d3b525beffc service nova] Creating event network-changed:041c1840-6713-484f-9db9-ed4df1bc61a0 for instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 on n-h1-850499-14 Oct 04 18:07:51.142465 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-775c58b4-bbc2-4c59-a758-c3394974f389 req-12d9722a-32f4-48d7-8f8e-4d3b525beffc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104400 Oct 04 18:07:51.147075 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 835/1619] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:51.163327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c3927111-b7f2-4bbe-b87d-dbc7736028f7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:51.171096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c3927111-b7f2-4bbe-b87d-dbc7736028f7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:51.183652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3927111-b7f2-4bbe-b87d-dbc7736028f7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.188390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3927111-b7f2-4bbe-b87d-dbc7736028f7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.189232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3927111-b7f2-4bbe-b87d-dbc7736028f7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.190198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3927111-b7f2-4bbe-b87d-dbc7736028f7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.194916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3927111-b7f2-4bbe-b87d-dbc7736028f7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.195771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3927111-b7f2-4bbe-b87d-dbc7736028f7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.681037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d7506bc-06ea-4638-8ad6-4709b8ea8064 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.712839 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d7506bc-06ea-4638-8ad6-4709b8ea8064 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1318 microversion: 2.1 time: 1.560956 Oct 04 18:07:51.728748 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 785/1620] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:50 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1318 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:51.736977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4faa5a2-c707-497a-9b68-4dce90c5194d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:51.738512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f4faa5a2-c707-497a-9b68-4dce90c5194d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:51.745854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4faa5a2-c707-497a-9b68-4dce90c5194d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.746725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4faa5a2-c707-497a-9b68-4dce90c5194d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.747393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4faa5a2-c707-497a-9b68-4dce90c5194d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.748378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4faa5a2-c707-497a-9b68-4dce90c5194d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.749009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4faa5a2-c707-497a-9b68-4dce90c5194d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.749816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4faa5a2-c707-497a-9b68-4dce90c5194d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.049398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f4faa5a2-c707-497a-9b68-4dce90c5194d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.070253 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f4faa5a2-c707-497a-9b68-4dce90c5194d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 0.339409 Oct 04 18:07:52.071545 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 786/1621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:51 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:52.089577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c3927111-b7f2-4bbe-b87d-dbc7736028f7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.090180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:52.090180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:52.099121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.099545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.099998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.100729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.101212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.102357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.134585 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c3927111-b7f2-4bbe-b87d-dbc7736028f7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 200 len: 1610 microversion: 2.1 time: 0.982964 Oct 04 18:07:52.152484 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 836/1622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:51 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 1610 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:52.166710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96c8b135-3dca-4b37-9b57-1908a216c03d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:52.167408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96c8b135-3dca-4b37-9b57-1908a216c03d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:52.181370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c8b135-3dca-4b37-9b57-1908a216c03d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.182019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c8b135-3dca-4b37-9b57-1908a216c03d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.182420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c8b135-3dca-4b37-9b57-1908a216c03d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.183188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c8b135-3dca-4b37-9b57-1908a216c03d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.187647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c8b135-3dca-4b37-9b57-1908a216c03d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.191675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c8b135-3dca-4b37-9b57-1908a216c03d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.282104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.296345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.299407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.312830 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17cb48ac-70f5-4c8b-9d18-908f455873d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.240170 Oct 04 18:07:52.313799 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 787/1623] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:52 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:52.474377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-315870170", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "09d3e330-5b4f-4c00-bc76-a5da1584aaf5"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:52.579309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] validate_networks() for [('09d3e330-5b4f-4c00-bc76-a5da1584aaf5', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:52.742432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96c8b135-3dca-4b37-9b57-1908a216c03d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.753236 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96c8b135-3dca-4b37-9b57-1908a216c03d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1469 microversion: 2.1 time: 0.599009 Oct 04 18:07:52.761231 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 837/1624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:52 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1469 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:52.766557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:52.771830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:52.784173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.789828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.793756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.796240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.796969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.802541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:53.555900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:53.582205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:53.583893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:53.585306 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a4e07241-e430-4473-9e2a-0279aaf03305 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1557 microversion: 2.25 time: 0.822802 Oct 04 18:07:53.612005 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 838/1625] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:52 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1557 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:53.642871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d94aaf8e-d6e6-4e13-ab29-ef08a982575e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:53.645833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d94aaf8e-d6e6-4e13-ab29-ef08a982575e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:53.678060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d94aaf8e-d6e6-4e13-ab29-ef08a982575e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:53.682010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d94aaf8e-d6e6-4e13-ab29-ef08a982575e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:53.683253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d94aaf8e-d6e6-4e13-ab29-ef08a982575e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:53.687437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d94aaf8e-d6e6-4e13-ab29-ef08a982575e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:53.694151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d94aaf8e-d6e6-4e13-ab29-ef08a982575e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:53.697537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d94aaf8e-d6e6-4e13-ab29-ef08a982575e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.547068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d94aaf8e-d6e6-4e13-ab29-ef08a982575e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.564181 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d94aaf8e-d6e6-4e13-ab29-ef08a982575e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1318 microversion: 2.1 time: 0.939763 Oct 04 18:07:54.583171 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 839/1626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:53 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1318 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:54.609714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99e9fc94-9e34-470a-b361-122af9b49550 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:54.611027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-99e9fc94-9e34-470a-b361-122af9b49550 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:54.638994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e9fc94-9e34-470a-b361-122af9b49550 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.641313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e9fc94-9e34-470a-b361-122af9b49550 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.648963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e9fc94-9e34-470a-b361-122af9b49550 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.650008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e9fc94-9e34-470a-b361-122af9b49550 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.651284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e9fc94-9e34-470a-b361-122af9b49550 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.653006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e9fc94-9e34-470a-b361-122af9b49550 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.976628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:54.977742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:54.978526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:54.979162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:54.979760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:55.011368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.012139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.027122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.032107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.036235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.037607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.146485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Getting quotas for project 67c1cf4579c5406fb461ec00e486b491. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:55.163032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Getting quotas for user 2f402a68c6734b9488ab4a04e8b630a6 and project 67c1cf4579c5406fb461ec00e486b491. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:55.237837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:55.247299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:55.367825 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1094b1a4-17c4-467c-a844-36ed7164b809 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.052693 Oct 04 18:07:55.377850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 788/1627] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:55.389031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.389655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:55.401905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.402405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.402854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.403606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.417918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.422218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.474939 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] HTTP exception thrown: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Request method failure captured: Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 HTTP/1.1 Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYug7p1cF12x0psu1bKgbc58bKhE_ihtRs56f_9Ez7TrOojI1b3S0PDL04HkWJSvPNmTfCvL-0RLsp5YzuuFj6ELNYh4NOyhQWWhIwCPn5KEr1ovnpl0i_jnxQgvJkCkYUol_6LCKoxRnxXokOU8ziRLGEXt6dMMRu4y64eg6Hq66A Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:07:55.481204 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4839e26fbc244802b56f2b0289410041"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4839e26fbc244802b56f2b0289410041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}] Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestMultiNic-1386020474 Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 29738c2533554939a890fad96acc1bef Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:07:55.483246 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'a58c5045-ad93-49bc-8150-b4f31c3128f8'} Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:55.484318 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:07:55.486053 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:07:55.492937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Returning 404 to user: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:55.496038 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-af39812d-e755-4f2d-9d11-78c6e3c2aa54 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 404 len: 111 microversion: 2.1 time: 0.116970 Oct 04 18:07:55.507917 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 789/1628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:55.513469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-20ebf8ac-200c-4895-adbf-ea686fce0790 req-b9107d16-85f3-4202-8532-94d794a83a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "name": "network-vif-deleted", "tag": "ac1d4707-1c27-40af-9ec7-bb0a88a70075"}, {"server_uuid": "4b522e60-ef39-4497-8da3-023eac9859af", "name": "network-vif-unplugged", "status": "completed", "tag": "f59d0713-eb06-474f-8c60-34c2e6eaf606"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:55.580254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-20ebf8ac-200c-4895-adbf-ea686fce0790 req-b9107d16-85f3-4202-8532-94d794a83a08 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.586804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-20ebf8ac-200c-4895-adbf-ea686fce0790 req-b9107d16-85f3-4202-8532-94d794a83a08 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.591350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-20ebf8ac-200c-4895-adbf-ea686fce0790 req-b9107d16-85f3-4202-8532-94d794a83a08 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.657353 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-20ebf8ac-200c-4895-adbf-ea686fce0790 req-b9107d16-85f3-4202-8532-94d794a83a08 service nova] Creating event network-vif-deleted:ac1d4707-1c27-40af-9ec7-bb0a88a70075 for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:55.663254 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-20ebf8ac-200c-4895-adbf-ea686fce0790 req-b9107d16-85f3-4202-8532-94d794a83a08 service nova] Creating event network-vif-unplugged:f59d0713-eb06-474f-8c60-34c2e6eaf606 for instance 4b522e60-ef39-4497-8da3-023eac9859af on n-h2-850499-14 Oct 04 18:07:55.692567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-20ebf8ac-200c-4895-adbf-ea686fce0790 req-b9107d16-85f3-4202-8532-94d794a83a08 service nova] Instance 4b522e60-ef39-4497-8da3-023eac9859af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:07:55.697246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-99e9fc94-9e34-470a-b361-122af9b49550 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.706631 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-99e9fc94-9e34-470a-b361-122af9b49550 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 1.122157 Oct 04 18:07:55.709518 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 840/1629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:54 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:55.726103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.733997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:55.762387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.765031 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-20ebf8ac-200c-4895-adbf-ea686fce0790 req-b9107d16-85f3-4202-8532-94d794a83a08 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.252727 Oct 04 18:07:55.765203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.765590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.766662 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 790/1630] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:55.773506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.774270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.774692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.803117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f70f2a15-d7b0-448c-98ca-da2313d195c8 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '.version_select at 0x7fd4d1c5bee0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.811750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f70f2a15-d7b0-448c-98ca-da2313d195c8 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.816100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f70f2a15-d7b0-448c-98ca-da2313d195c8 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.828149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f70f2a15-d7b0-448c-98ca-da2313d195c8 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.860169 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f70f2a15-d7b0-448c-98ca-da2313d195c8 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 3660 microversion: 2.25 time: 0.089678 Oct 04 18:07:55.864223 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 791/1631] 10.222.0.18 () {60 vars in 1184 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/os-migrations => generated 3660 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:55.887423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ed12ef7-b07a-4970-9190-31cef7baaf77 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.889553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ed12ef7-b07a-4970-9190-31cef7baaf77 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:55.900150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed12ef7-b07a-4970-9190-31cef7baaf77 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.901048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed12ef7-b07a-4970-9190-31cef7baaf77 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.901782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed12ef7-b07a-4970-9190-31cef7baaf77 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.902969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed12ef7-b07a-4970-9190-31cef7baaf77 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.903711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed12ef7-b07a-4970-9190-31cef7baaf77 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.904437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed12ef7-b07a-4970-9190-31cef7baaf77 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.094376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:56.106703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:56.115774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:56.136285 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e6a3b06-d8af-4dae-a38a-42a9f7f7ae17 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.425640 Oct 04 18:07:56.156214 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 841/1632] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:56.173974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a27a394-02e7-407d-8872-56c474e7bc08 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:56.175497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a27a394-02e7-407d-8872-56c474e7bc08 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:56.424609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a27a394-02e7-407d-8872-56c474e7bc08 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:56.437983 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a27a394-02e7-407d-8872-56c474e7bc08 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1207 microversion: 2.1 time: 0.278540 Oct 04 18:07:56.439300 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 842/1633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:56 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1207 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:56.450740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-adbbb2d5-85bd-4385-86f6-f23ef87a228f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:56.453265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-adbbb2d5-85bd-4385-86f6-f23ef87a228f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:56.469328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adbbb2d5-85bd-4385-86f6-f23ef87a228f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.472875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adbbb2d5-85bd-4385-86f6-f23ef87a228f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.473947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adbbb2d5-85bd-4385-86f6-f23ef87a228f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.474919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adbbb2d5-85bd-4385-86f6-f23ef87a228f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.476593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adbbb2d5-85bd-4385-86f6-f23ef87a228f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.477483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adbbb2d5-85bd-4385-86f6-f23ef87a228f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.488050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ed12ef7-b07a-4970-9190-31cef7baaf77 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:56.500048 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ed12ef7-b07a-4970-9190-31cef7baaf77 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1469 microversion: 2.1 time: 0.633835 Oct 04 18:07:56.514169 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 792/1634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1469 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:56.525214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-321e7001-b0b8-4a57-9eb4-f0ff9deedd63 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:56.526883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-321e7001-b0b8-4a57-9eb4-f0ff9deedd63 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:56.530398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:56.534878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-321e7001-b0b8-4a57-9eb4-f0ff9deedd63 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.535554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-321e7001-b0b8-4a57-9eb4-f0ff9deedd63 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.536665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-321e7001-b0b8-4a57-9eb4-f0ff9deedd63 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.537538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-321e7001-b0b8-4a57-9eb4-f0ff9deedd63 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.538126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-321e7001-b0b8-4a57-9eb4-f0ff9deedd63 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.538710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-321e7001-b0b8-4a57-9eb4-f0ff9deedd63 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.775021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-adbbb2d5-85bd-4385-86f6-f23ef87a228f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:56.786135 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-adbbb2d5-85bd-4385-86f6-f23ef87a228f tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1318 microversion: 2.1 time: 0.345238 Oct 04 18:07:56.797604 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 843/1635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:56 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:56.810842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a16b850-7cfb-4d12-ba35-e925f709d9f1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:56.811976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a16b850-7cfb-4d12-ba35-e925f709d9f1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:56.823304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a16b850-7cfb-4d12-ba35-e925f709d9f1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.824094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a16b850-7cfb-4d12-ba35-e925f709d9f1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.824829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a16b850-7cfb-4d12-ba35-e925f709d9f1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.825954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a16b850-7cfb-4d12-ba35-e925f709d9f1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.826808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a16b850-7cfb-4d12-ba35-e925f709d9f1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.828222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a16b850-7cfb-4d12-ba35-e925f709d9f1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.839388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-321e7001-b0b8-4a57-9eb4-f0ff9deedd63 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:56.872850 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-321e7001-b0b8-4a57-9eb4-f0ff9deedd63 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 2052 microversion: 2.25 time: 0.352526 Oct 04 18:07:56.887167 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 793/1636] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:56 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 2052 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:57.054352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-208617309", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "c5519c6a-88b3-4e11-a279-e6dbd711c38c"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:57.147098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] validate_networks() for [('c5519c6a-88b3-4e11-a279-e6dbd711c38c', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:57.309790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7a16b850-7cfb-4d12-ba35-e925f709d9f1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.325613 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a16b850-7cfb-4d12-ba35-e925f709d9f1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 0.535730 Oct 04 18:07:57.326496 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 844/1637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:56 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:57.337753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:57.344073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:57.370267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.371232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.371983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.373304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.373985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.374650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.524376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.535427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.537469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.545516 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-91680c76-bfda-46fb-87f5-a58b6f8b04b6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1535 microversion: 2.91 time: 0.216914 Oct 04 18:07:57.576901 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 845/1638] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:57 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1535 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:57.582685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-110e077c-1ea1-4d21-afa8-52b49b799ca2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:57.583621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-110e077c-1ea1-4d21-afa8-52b49b799ca2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:57.591393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-110e077c-1ea1-4d21-afa8-52b49b799ca2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.592151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-110e077c-1ea1-4d21-afa8-52b49b799ca2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.592766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-110e077c-1ea1-4d21-afa8-52b49b799ca2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.593972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-110e077c-1ea1-4d21-afa8-52b49b799ca2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.594782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-110e077c-1ea1-4d21-afa8-52b49b799ca2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.595502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-110e077c-1ea1-4d21-afa8-52b49b799ca2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.742329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-110e077c-1ea1-4d21-afa8-52b49b799ca2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.754136 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-110e077c-1ea1-4d21-afa8-52b49b799ca2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1259 microversion: 2.1 time: 0.175916 Oct 04 18:07:57.770079 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 846/1639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:57 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:57.776969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3fbf8d0f-31d1-48ee-820f-5ac7e0637f04 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:57.778682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3fbf8d0f-31d1-48ee-820f-5ac7e0637f04 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:57.786943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fbf8d0f-31d1-48ee-820f-5ac7e0637f04 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.787958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fbf8d0f-31d1-48ee-820f-5ac7e0637f04 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.789110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fbf8d0f-31d1-48ee-820f-5ac7e0637f04 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.790310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fbf8d0f-31d1-48ee-820f-5ac7e0637f04 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.790801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fbf8d0f-31d1-48ee-820f-5ac7e0637f04 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.791287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fbf8d0f-31d1-48ee-820f-5ac7e0637f04 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.033952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3fbf8d0f-31d1-48ee-820f-5ac7e0637f04 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.047101 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3fbf8d0f-31d1-48ee-820f-5ac7e0637f04 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1469 microversion: 2.1 time: 0.275208 Oct 04 18:07:58.048646 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 847/1640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:57 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:58.060820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-41b1ed8b-26e5-45cc-8922-f3b9900e89c1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:58.062419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-41b1ed8b-26e5-45cc-8922-f3b9900e89c1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:58.089310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41b1ed8b-26e5-45cc-8922-f3b9900e89c1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.092008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:58.092932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:58.093273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41b1ed8b-26e5-45cc-8922-f3b9900e89c1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.093792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41b1ed8b-26e5-45cc-8922-f3b9900e89c1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.093918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:58.094586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41b1ed8b-26e5-45cc-8922-f3b9900e89c1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.094713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:58.095171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:58.095318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41b1ed8b-26e5-45cc-8922-f3b9900e89c1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.098456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41b1ed8b-26e5-45cc-8922-f3b9900e89c1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.107276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.107746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.109090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.110275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.111222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.111866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.148680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Getting quotas for project 1a630efa59244fbf9426904b7bf00eee. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:58.154480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Getting quotas for user 9796f56e209540ee967eb5090a1d2dbe and project 1a630efa59244fbf9426904b7bf00eee. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:58.157748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:58.174061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:58.178341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:58.255766 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b7fc1e44-c68f-4ea5-893b-6ec8522c3f71 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.206233 Oct 04 18:07:58.257972 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 794/1641] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:07:58.278005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ac1e4dbd-3b43-4b70-b64d-638fed86d82a req-cd125177-36ab-4236-8724-a9f8f5bfb274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2acda7d-dc95-44ac-8ac8-62522ca02bd3", "tag": "6cbd39c4-148c-498e-8e9f-3e4c7e392850"}, {"server_uuid": "a58c5045-ad93-49bc-8150-b4f31c3128f8", "name": "network-vif-deleted", "tag": "b7c9f9d0-f676-4a60-87ba-cbc4fe8c9d7d"}, {"name": "network-changed", "server_uuid": "4b522e60-ef39-4497-8da3-023eac9859af", "tag": "f59d0713-eb06-474f-8c60-34c2e6eaf606"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:58.291052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-41b1ed8b-26e5-45cc-8922-f3b9900e89c1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.307234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ac1e4dbd-3b43-4b70-b64d-638fed86d82a req-cd125177-36ab-4236-8724-a9f8f5bfb274 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.308006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ac1e4dbd-3b43-4b70-b64d-638fed86d82a req-cd125177-36ab-4236-8724-a9f8f5bfb274 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.308520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ac1e4dbd-3b43-4b70-b64d-638fed86d82a req-cd125177-36ab-4236-8724-a9f8f5bfb274 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.319483 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-41b1ed8b-26e5-45cc-8922-f3b9900e89c1 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1318 microversion: 2.1 time: 0.267142 Oct 04 18:07:58.323164 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 848/1642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:58 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:58.330850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ba7cde8-b850-488a-b2da-c8ec7c4088ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:58.331679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ba7cde8-b850-488a-b2da-c8ec7c4088ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:58.339285 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ac1e4dbd-3b43-4b70-b64d-638fed86d82a req-cd125177-36ab-4236-8724-a9f8f5bfb274 service nova] Creating event network-changed:6cbd39c4-148c-498e-8e9f-3e4c7e392850 for instance e2acda7d-dc95-44ac-8ac8-62522ca02bd3 on n-h2-850499-14 Oct 04 18:07:58.339970 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ac1e4dbd-3b43-4b70-b64d-638fed86d82a req-cd125177-36ab-4236-8724-a9f8f5bfb274 service nova] Creating event network-vif-deleted:b7c9f9d0-f676-4a60-87ba-cbc4fe8c9d7d for instance a58c5045-ad93-49bc-8150-b4f31c3128f8 on n-h1-850499-14 Oct 04 18:07:58.340468 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ac1e4dbd-3b43-4b70-b64d-638fed86d82a req-cd125177-36ab-4236-8724-a9f8f5bfb274 service nova] Creating event network-changed:f59d0713-eb06-474f-8c60-34c2e6eaf606 for instance 4b522e60-ef39-4497-8da3-023eac9859af on n-h2-850499-14 Oct 04 18:07:58.364809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-ac1e4dbd-3b43-4b70-b64d-638fed86d82a req-cd125177-36ab-4236-8724-a9f8f5bfb274 service nova] Instance 4b522e60-ef39-4497-8da3-023eac9859af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:07:58.381820 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ac1e4dbd-3b43-4b70-b64d-638fed86d82a req-cd125177-36ab-4236-8724-a9f8f5bfb274 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.120541 Oct 04 18:07:58.383129 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 795/1643] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:58.391758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a932506-edc4-46ba-a0ab-7a98feaf5090 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:58.392515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a932506-edc4-46ba-a0ab-7a98feaf5090 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:58.415848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a932506-edc4-46ba-a0ab-7a98feaf5090 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.419860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a932506-edc4-46ba-a0ab-7a98feaf5090 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.420382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a932506-edc4-46ba-a0ab-7a98feaf5090 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.421141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a932506-edc4-46ba-a0ab-7a98feaf5090 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.421610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a932506-edc4-46ba-a0ab-7a98feaf5090 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.422048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a932506-edc4-46ba-a0ab-7a98feaf5090 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.436386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ba7cde8-b850-488a-b2da-c8ec7c4088ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.450203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ba7cde8-b850-488a-b2da-c8ec7c4088ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.452004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ba7cde8-b850-488a-b2da-c8ec7c4088ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.453497 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ba7cde8-b850-488a-b2da-c8ec7c4088ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1261 microversion: 2.25 time: 0.128432 Oct 04 18:07:58.454331 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 849/1644] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:58 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1261 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:58.484925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:58.584084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:58.584904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:58.591825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.592123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.592836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.593640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.594369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.595095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.713257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.729922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.732735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.751586 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-45b70147-5d1b-410e-9485-2a975857c7b3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1535 microversion: 2.91 time: 0.173012 Oct 04 18:07:58.770996 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 850/1645] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:58 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1535 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:58.786319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3da95c04-edae-4c06-b53c-ea710744c88b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:58.790399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3da95c04-edae-4c06-b53c-ea710744c88b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:58.809392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da95c04-edae-4c06-b53c-ea710744c88b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.830137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da95c04-edae-4c06-b53c-ea710744c88b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.831546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da95c04-edae-4c06-b53c-ea710744c88b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.833027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da95c04-edae-4c06-b53c-ea710744c88b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.834250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da95c04-edae-4c06-b53c-ea710744c88b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.835083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da95c04-edae-4c06-b53c-ea710744c88b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.841737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a932506-edc4-46ba-a0ab-7a98feaf5090 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.857635 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a932506-edc4-46ba-a0ab-7a98feaf5090 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 0.469325 Oct 04 18:07:58.863054 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 796/1646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:58 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:58.927357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3da95c04-edae-4c06-b53c-ea710744c88b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.936517 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3da95c04-edae-4c06-b53c-ea710744c88b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1267 microversion: 2.1 time: 0.156078 Oct 04 18:07:58.940860 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 851/1647] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:58 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:59.077069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bf4f3197-88db-4b8a-b3b8-6ef8d236cb8a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:59.077973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bf4f3197-88db-4b8a-b3b8-6ef8d236cb8a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:59.089508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf4f3197-88db-4b8a-b3b8-6ef8d236cb8a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.094133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf4f3197-88db-4b8a-b3b8-6ef8d236cb8a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.095380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf4f3197-88db-4b8a-b3b8-6ef8d236cb8a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.098081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf4f3197-88db-4b8a-b3b8-6ef8d236cb8a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.099193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf4f3197-88db-4b8a-b3b8-6ef8d236cb8a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.099860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf4f3197-88db-4b8a-b3b8-6ef8d236cb8a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.350611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-471042f7-bce9-4786-9f74-30d25d41a6ca tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:59.351404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-471042f7-bce9-4786-9f74-30d25d41a6ca tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:59.364766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-471042f7-bce9-4786-9f74-30d25d41a6ca tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.365412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-471042f7-bce9-4786-9f74-30d25d41a6ca tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.365964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-471042f7-bce9-4786-9f74-30d25d41a6ca tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.367069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-471042f7-bce9-4786-9f74-30d25d41a6ca tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.368853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-471042f7-bce9-4786-9f74-30d25d41a6ca tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.370491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-471042f7-bce9-4786-9f74-30d25d41a6ca tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.761876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bf4f3197-88db-4b8a-b3b8-6ef8d236cb8a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.776810 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bf4f3197-88db-4b8a-b3b8-6ef8d236cb8a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1469 microversion: 2.1 time: 0.705610 Oct 04 18:07:59.810689 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 797/1648] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:59 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1469 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:59.825040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:59.825963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:59.851077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.851863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.853019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.862025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-471042f7-bce9-4786-9f74-30d25d41a6ca tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.907184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.908059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.908705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.910217 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-471042f7-bce9-4786-9f74-30d25d41a6ca tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1318 microversion: 2.1 time: 0.564173 Oct 04 18:07:59.924820 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 852/1649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:59 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:59.939032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:59.942475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:59.956047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.956935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.957825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.959399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.960105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.960858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.029573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.040564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.046522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.058332 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-69d1f3d3-89c1-40be-89bf-e69959a3260c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1313 microversion: 2.25 time: 0.245581 Oct 04 18:08:00.059611 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 798/1650] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:59 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:00.065176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04b99022-fa07-49af-bc4d-7d793dc1595d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:00.065866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-04b99022-fa07-49af-bc4d-7d793dc1595d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:00.084522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b99022-fa07-49af-bc4d-7d793dc1595d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.085469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b99022-fa07-49af-bc4d-7d793dc1595d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.086210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b99022-fa07-49af-bc4d-7d793dc1595d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.087786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b99022-fa07-49af-bc4d-7d793dc1595d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.088631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b99022-fa07-49af-bc4d-7d793dc1595d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.089222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b99022-fa07-49af-bc4d-7d793dc1595d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.189571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.202159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.211071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.229262 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eade6869-f2a7-4c2a-8355-7456ba1c75ff tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1535 microversion: 2.91 time: 0.301971 Oct 04 18:08:00.230263 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 853/1651] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:59 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1535 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:00.241701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-778b2339-4038-4774-b467-f015804efd15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:00.242348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-778b2339-4038-4774-b467-f015804efd15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:00.265989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-778b2339-4038-4774-b467-f015804efd15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.266901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-778b2339-4038-4774-b467-f015804efd15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.269834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-778b2339-4038-4774-b467-f015804efd15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.272356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-778b2339-4038-4774-b467-f015804efd15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.273868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-778b2339-4038-4774-b467-f015804efd15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.274337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-778b2339-4038-4774-b467-f015804efd15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.827064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-778b2339-4038-4774-b467-f015804efd15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.855524 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-778b2339-4038-4774-b467-f015804efd15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1277 microversion: 2.1 time: 0.614234 Oct 04 18:08:00.855524 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 854/1652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:00 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1277 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:00.857678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-38ebd50b-0088-42b1-8203-f15806684269 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:00.858405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-38ebd50b-0088-42b1-8203-f15806684269 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:00.879805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38ebd50b-0088-42b1-8203-f15806684269 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.910396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38ebd50b-0088-42b1-8203-f15806684269 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.913024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38ebd50b-0088-42b1-8203-f15806684269 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.914041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38ebd50b-0088-42b1-8203-f15806684269 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.914767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38ebd50b-0088-42b1-8203-f15806684269 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.916470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38ebd50b-0088-42b1-8203-f15806684269 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.937009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-04b99022-fa07-49af-bc4d-7d793dc1595d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.973692 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04b99022-fa07-49af-bc4d-7d793dc1595d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 0.912455 Oct 04 18:08:00.992871 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 799/1653] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:00 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:01.003349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab54283a-097f-4266-9dca-179f1087c825 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:01.004252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ab54283a-097f-4266-9dca-179f1087c825 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:01.022391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab54283a-097f-4266-9dca-179f1087c825 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.023397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab54283a-097f-4266-9dca-179f1087c825 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.024092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab54283a-097f-4266-9dca-179f1087c825 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.025070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab54283a-097f-4266-9dca-179f1087c825 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.025759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab54283a-097f-4266-9dca-179f1087c825 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.026416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab54283a-097f-4266-9dca-179f1087c825 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.399412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-38ebd50b-0088-42b1-8203-f15806684269 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.426338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ab54283a-097f-4266-9dca-179f1087c825 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.428686 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-38ebd50b-0088-42b1-8203-f15806684269 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1469 microversion: 2.1 time: 0.580079 Oct 04 18:08:01.445340 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ab54283a-097f-4266-9dca-179f1087c825 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1318 microversion: 2.1 time: 0.451037 Oct 04 18:08:01.455381 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 855/1654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:00 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1469 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:01.461862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:01.462760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:01.470785 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 800/1655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:00 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:01.477543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.478252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.478727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.481410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.481987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.482713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.505765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:01.514400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:01.522493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.523033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.523484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.524816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.525297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.525735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.605358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.622012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.624459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.628543 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-be2025f4-b38b-408c-83ac-de24217b3646 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1321 microversion: 2.25 time: 0.169447 Oct 04 18:08:01.632602 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 856/1656] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:01 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:01.756664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.770851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.776522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.793461 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6b6b73e2-b3fb-4da5-ae62-475974b2a645 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1538 microversion: 2.91 time: 0.320290 Oct 04 18:08:01.795149 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 801/1657] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:01 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1538 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:01.824737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe98df5e-e59a-4df2-964f-a1c3fc9876b7 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-850499-14"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:01.829539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fe98df5e-e59a-4df2-964f-a1c3fc9876b7 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:01.839378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe98df5e-e59a-4df2-964f-a1c3fc9876b7 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.840041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe98df5e-e59a-4df2-964f-a1c3fc9876b7 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.840607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe98df5e-e59a-4df2-964f-a1c3fc9876b7 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.841403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe98df5e-e59a-4df2-964f-a1c3fc9876b7 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.841956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe98df5e-e59a-4df2-964f-a1c3fc9876b7 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.842457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe98df5e-e59a-4df2-964f-a1c3fc9876b7 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.874595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d24f37f4-c1e9-4623-977f-0bc8581d9320 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:01.875600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d24f37f4-c1e9-4623-977f-0bc8581d9320 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:01.887936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d24f37f4-c1e9-4623-977f-0bc8581d9320 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.888762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d24f37f4-c1e9-4623-977f-0bc8581d9320 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.889453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d24f37f4-c1e9-4623-977f-0bc8581d9320 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.890445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d24f37f4-c1e9-4623-977f-0bc8581d9320 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.892529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d24f37f4-c1e9-4623-977f-0bc8581d9320 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.895902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d24f37f4-c1e9-4623-977f-0bc8581d9320 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.947955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fe98df5e-e59a-4df2-964f-a1c3fc9876b7 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-850499-14". {{(pid=122332) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:08:02.036646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d24f37f4-c1e9-4623-977f-0bc8581d9320 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:02.051995 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d24f37f4-c1e9-4623-977f-0bc8581d9320 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1265 microversion: 2.1 time: 0.183013 Oct 04 18:08:02.052965 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 802/1658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:01 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:02.057762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42c2104b-97d7-41c1-a831-cd3af10d96c0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:02.058385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42c2104b-97d7-41c1-a831-cd3af10d96c0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:02.074024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2104b-97d7-41c1-a831-cd3af10d96c0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.074532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2104b-97d7-41c1-a831-cd3af10d96c0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.075003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2104b-97d7-41c1-a831-cd3af10d96c0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.075730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2104b-97d7-41c1-a831-cd3af10d96c0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.076192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2104b-97d7-41c1-a831-cd3af10d96c0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.076628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42c2104b-97d7-41c1-a831-cd3af10d96c0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.083392 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fe98df5e-e59a-4df2-964f-a1c3fc9876b7 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35/action" status: 202 len: 0 microversion: 2.91 time: 0.263962 Oct 04 18:08:02.084538 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 857/1659] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:08:01 2022] POST /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:02.092614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:02.093776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:02.111968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.114141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.115200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.133708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.134228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.136719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.528316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:02.544365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:02.546713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:02.555373 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8878b748-fe80-4cde-9300-4669485be501 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1486 microversion: 2.91 time: 0.466541 Oct 04 18:08:02.556870 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 858/1660] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:02 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1486 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:02.565434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a78e7d75-f7a3-40eb-9c59-872688dcbbc0 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:02.566315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a78e7d75-f7a3-40eb-9c59-872688dcbbc0 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:02.574844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a78e7d75-f7a3-40eb-9c59-872688dcbbc0 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.576023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a78e7d75-f7a3-40eb-9c59-872688dcbbc0 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.576738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a78e7d75-f7a3-40eb-9c59-872688dcbbc0 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.579366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a78e7d75-f7a3-40eb-9c59-872688dcbbc0 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.580902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a78e7d75-f7a3-40eb-9c59-872688dcbbc0 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.582342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a78e7d75-f7a3-40eb-9c59-872688dcbbc0 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.635193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:03.126536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-42c2104b-97d7-41c1-a831-cd3af10d96c0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.136888 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42c2104b-97d7-41c1-a831-cd3af10d96c0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 1.082725 Oct 04 18:08:03.144085 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 803/1661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:02 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:03.158822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a378c8d-68e0-4e3c-8fba-c98844095616 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.161621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8a378c8d-68e0-4e3c-8fba-c98844095616 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:03.181670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a378c8d-68e0-4e3c-8fba-c98844095616 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.183725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a378c8d-68e0-4e3c-8fba-c98844095616 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.184274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a378c8d-68e0-4e3c-8fba-c98844095616 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.185067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a378c8d-68e0-4e3c-8fba-c98844095616 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.185558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a378c8d-68e0-4e3c-8fba-c98844095616 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.185995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a378c8d-68e0-4e3c-8fba-c98844095616 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.412817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a78e7d75-f7a3-40eb-9c59-872688dcbbc0 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.423933 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a78e7d75-f7a3-40eb-9c59-872688dcbbc0 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1318 microversion: 2.1 time: 0.864777 Oct 04 18:08:03.425533 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 859/1662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:02 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1318 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:03.431522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.436720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:03.455055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.455607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.456143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.456912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.457390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.457823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.576015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.587783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.589683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.591079 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b4729321-a9e1-40b2-80cb-5fb14bd92308 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1321 microversion: 2.25 time: 0.163376 Oct 04 18:08:03.592230 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 860/1663] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:03 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:03.598177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96940d47-a22d-4074-a310-d7b2842220f0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.599215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96940d47-a22d-4074-a310-d7b2842220f0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:03.602453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:03.607843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96940d47-a22d-4074-a310-d7b2842220f0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.608782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96940d47-a22d-4074-a310-d7b2842220f0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.609806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96940d47-a22d-4074-a310-d7b2842220f0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.614189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96940d47-a22d-4074-a310-d7b2842220f0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.614826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96940d47-a22d-4074-a310-d7b2842220f0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.627825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96940d47-a22d-4074-a310-d7b2842220f0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.809485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a378c8d-68e0-4e3c-8fba-c98844095616 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.827203 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a378c8d-68e0-4e3c-8fba-c98844095616 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1469 microversion: 2.1 time: 0.676972 Oct 04 18:08:03.828403 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 804/1664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:03 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1469 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:03.834823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.835521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:03.860445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.860953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.861393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.862631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.863134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.863564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.085072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:04.094773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:04.097357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96940d47-a22d-4074-a310-d7b2842220f0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:04.097810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:04.104745 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-38833c63-7649-48cb-99d7-69102b42adb2 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1488 microversion: 2.91 time: 0.274761 Oct 04 18:08:04.126855 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96940d47-a22d-4074-a310-d7b2842220f0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1307 microversion: 2.1 time: 0.533146 Oct 04 18:08:04.127430 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 805/1665] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:03 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1488 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:04.140297 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 861/1666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:03 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1307 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:04.172011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-71c1cf31-99cc-4a83-8752-306979e10adb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:04.172641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-71c1cf31-99cc-4a83-8752-306979e10adb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:04.182504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71c1cf31-99cc-4a83-8752-306979e10adb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.183761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71c1cf31-99cc-4a83-8752-306979e10adb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.184383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71c1cf31-99cc-4a83-8752-306979e10adb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.185592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71c1cf31-99cc-4a83-8752-306979e10adb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.186549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71c1cf31-99cc-4a83-8752-306979e10adb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.187297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71c1cf31-99cc-4a83-8752-306979e10adb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.307979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-41e74a17-f89e-4dc3-a187-632156c498be req-09caa089-a430-4dc0-a160-7b9f8bcb72e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2acda7d-dc95-44ac-8ac8-62522ca02bd3", "name": "network-vif-plugged", "status": "completed", "tag": "6cbd39c4-148c-498e-8e9f-3e4c7e392850"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:04.328990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-41e74a17-f89e-4dc3-a187-632156c498be req-09caa089-a430-4dc0-a160-7b9f8bcb72e3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.329368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-41e74a17-f89e-4dc3-a187-632156c498be req-09caa089-a430-4dc0-a160-7b9f8bcb72e3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.331729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-41e74a17-f89e-4dc3-a187-632156c498be req-09caa089-a430-4dc0-a160-7b9f8bcb72e3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.371599 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-41e74a17-f89e-4dc3-a187-632156c498be req-09caa089-a430-4dc0-a160-7b9f8bcb72e3 service nova] Creating event network-vif-plugged:6cbd39c4-148c-498e-8e9f-3e4c7e392850 for instance e2acda7d-dc95-44ac-8ac8-62522ca02bd3 on n-h2-850499-14 Oct 04 18:08:04.384686 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-41e74a17-f89e-4dc3-a187-632156c498be req-09caa089-a430-4dc0-a160-7b9f8bcb72e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077550 Oct 04 18:08:04.386574 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 862/1667] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:08:04.434349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e9b77ea2-34aa-4de2-a338-6ef8ceb81247 req-f72961d9-1026-449f-84f3-31394e77959a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d", "tag": "4fd0d5d2-3dd8-4446-b5b1-1caafbeb86b3"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:04.516425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e9b77ea2-34aa-4de2-a338-6ef8ceb81247 req-f72961d9-1026-449f-84f3-31394e77959a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.518937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e9b77ea2-34aa-4de2-a338-6ef8ceb81247 req-f72961d9-1026-449f-84f3-31394e77959a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.520603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e9b77ea2-34aa-4de2-a338-6ef8ceb81247 req-f72961d9-1026-449f-84f3-31394e77959a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.564636 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e9b77ea2-34aa-4de2-a338-6ef8ceb81247 req-f72961d9-1026-449f-84f3-31394e77959a service nova] Creating event network-changed:4fd0d5d2-3dd8-4446-b5b1-1caafbeb86b3 for instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d on n-h1-850499-14 Oct 04 18:08:04.573089 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e9b77ea2-34aa-4de2-a338-6ef8ceb81247 req-f72961d9-1026-449f-84f3-31394e77959a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142628 Oct 04 18:08:04.574099 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 863/1668] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:04.581441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3eb3a537-14dc-4ff3-b5ac-b70e6714242a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:04.582513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3eb3a537-14dc-4ff3-b5ac-b70e6714242a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:04.604145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb3a537-14dc-4ff3-b5ac-b70e6714242a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.604985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb3a537-14dc-4ff3-b5ac-b70e6714242a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.605606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb3a537-14dc-4ff3-b5ac-b70e6714242a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.606515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb3a537-14dc-4ff3-b5ac-b70e6714242a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.607181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb3a537-14dc-4ff3-b5ac-b70e6714242a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.607779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb3a537-14dc-4ff3-b5ac-b70e6714242a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.795583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-71c1cf31-99cc-4a83-8752-306979e10adb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:04.826932 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-71c1cf31-99cc-4a83-8752-306979e10adb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 0.646246 Oct 04 18:08:04.827721 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 806/1669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:04 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:04.840453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:04.841093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:04.865594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.866105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.866558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.867338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.867810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.868245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.461692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.483262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.484748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.485902 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d6815463-accf-4fd3-905c-0f2a80b6ac92 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1319 microversion: 2.25 time: 0.657173 Oct 04 18:08:05.486484 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 807/1670] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:04 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1319 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:05.536778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5e4c29cf-65da-4987-82d1-4f512258e6c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:05.543776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5e4c29cf-65da-4987-82d1-4f512258e6c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:05.570761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e4c29cf-65da-4987-82d1-4f512258e6c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.574022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e4c29cf-65da-4987-82d1-4f512258e6c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.577037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e4c29cf-65da-4987-82d1-4f512258e6c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.583418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e4c29cf-65da-4987-82d1-4f512258e6c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.585423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e4c29cf-65da-4987-82d1-4f512258e6c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.589939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e4c29cf-65da-4987-82d1-4f512258e6c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.662837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3eb3a537-14dc-4ff3-b5ac-b70e6714242a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.675086 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3eb3a537-14dc-4ff3-b5ac-b70e6714242a tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1318 microversion: 2.1 time: 1.098788 Oct 04 18:08:05.694700 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 864/1671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:04 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1318 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:05.712275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:05.714406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:05.728749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.729267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.729706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.730816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.732653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.733415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:06.009568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:06.039331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:06.043954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:06.062623 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d0571ec-8982-41cf-95c1-c376c5d901da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.363326 Oct 04 18:08:06.067868 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 865/1672] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:05 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:06.082323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d337456c-f9c7-42c5-93dc-c60cb2c0edcf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:06.100631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d337456c-f9c7-42c5-93dc-c60cb2c0edcf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:06.126595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d337456c-f9c7-42c5-93dc-c60cb2c0edcf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:06.128332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d337456c-f9c7-42c5-93dc-c60cb2c0edcf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:06.133215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d337456c-f9c7-42c5-93dc-c60cb2c0edcf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:06.138542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d337456c-f9c7-42c5-93dc-c60cb2c0edcf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:06.155156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d337456c-f9c7-42c5-93dc-c60cb2c0edcf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:06.156406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d337456c-f9c7-42c5-93dc-c60cb2c0edcf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:06.354773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5e4c29cf-65da-4987-82d1-4f512258e6c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:06.376492 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5e4c29cf-65da-4987-82d1-4f512258e6c9 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1462 microversion: 2.1 time: 0.855300 Oct 04 18:08:06.402330 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 808/1673] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:05 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1462 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:06.417054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93454fd6-2f8b-46dc-aee5-7f1254b64158 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:06.417743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-93454fd6-2f8b-46dc-aee5-7f1254b64158 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:06.444165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93454fd6-2f8b-46dc-aee5-7f1254b64158 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:06.445699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93454fd6-2f8b-46dc-aee5-7f1254b64158 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:06.446160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93454fd6-2f8b-46dc-aee5-7f1254b64158 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:06.461755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93454fd6-2f8b-46dc-aee5-7f1254b64158 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:06.469587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93454fd6-2f8b-46dc-aee5-7f1254b64158 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:06.470076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93454fd6-2f8b-46dc-aee5-7f1254b64158 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.277142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93454fd6-2f8b-46dc-aee5-7f1254b64158 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:07.293844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d337456c-f9c7-42c5-93dc-c60cb2c0edcf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:07.297702 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-93454fd6-2f8b-46dc-aee5-7f1254b64158 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 0.894869 Oct 04 18:08:07.298586 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 809/1674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:06 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:07.305001 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d337456c-f9c7-42c5-93dc-c60cb2c0edcf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1307 microversion: 2.1 time: 1.232807 Oct 04 18:08:07.307031 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 866/1675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:06 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1307 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:07.324617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:07.325645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:07.339510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.340510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.347266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.348195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.348930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.349611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.556509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5e233287-81ea-4014-aa87-18de55628914 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:07.557186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5e233287-81ea-4014-aa87-18de55628914 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:07.573184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e233287-81ea-4014-aa87-18de55628914 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.573695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e233287-81ea-4014-aa87-18de55628914 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.574139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e233287-81ea-4014-aa87-18de55628914 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.574863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e233287-81ea-4014-aa87-18de55628914 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.576417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e233287-81ea-4014-aa87-18de55628914 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.579870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e233287-81ea-4014-aa87-18de55628914 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:08.135399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:08.166493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=12 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:08.443304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:08.725560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:08.741676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:08.749220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:08.753140 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e7dc0ae7-f0e8-4222-848f-6ad5dbf0f3c8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1361 microversion: 2.25 time: 1.442866 Oct 04 18:08:08.756407 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 867/1676] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:07 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1361 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:08.771837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a55d84d-8722-4c0e-bb36-def8ff3d0715 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:08.772774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3a55d84d-8722-4c0e-bb36-def8ff3d0715 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:08.789404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a55d84d-8722-4c0e-bb36-def8ff3d0715 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:08.790686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a55d84d-8722-4c0e-bb36-def8ff3d0715 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:08.792315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a55d84d-8722-4c0e-bb36-def8ff3d0715 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:08.797998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a55d84d-8722-4c0e-bb36-def8ff3d0715 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:08.800644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a55d84d-8722-4c0e-bb36-def8ff3d0715 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:08.803535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a55d84d-8722-4c0e-bb36-def8ff3d0715 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.070040 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5e233287-81ea-4014-aa87-18de55628914 tempest-MigrationsAdminTest-6322720 tempest-MigrationsAdminTest-6322720-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1615 microversion: 2.1 time: 1.767755 Oct 04 18:08:09.071509 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 810/1677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:07 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1615 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:09.121527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:09.123005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:09.133739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.134707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.135947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.136973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.137808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.139232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.488272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:09.504825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:09.513845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:09.534617 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-37125ae6-9762-4cef-a4c1-0204e7c4bfb9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.421008 Oct 04 18:08:09.535720 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 811/1678] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:09 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:09.565841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-21724d9a-c31c-46c9-bdf2-ac419d96e08e req-5804f21b-a781-49c2-bfea-a48c7aa40b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc93dc3-d2ac-4450-92fd-63bbedaf9b92", "name": "network-vif-plugged", "status": "completed", "tag": "041c1840-6713-484f-9db9-ed4df1bc61a0"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:09.592323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-21724d9a-c31c-46c9-bdf2-ac419d96e08e req-5804f21b-a781-49c2-bfea-a48c7aa40b62 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.600250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-21724d9a-c31c-46c9-bdf2-ac419d96e08e req-5804f21b-a781-49c2-bfea-a48c7aa40b62 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.603523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-21724d9a-c31c-46c9-bdf2-ac419d96e08e req-5804f21b-a781-49c2-bfea-a48c7aa40b62 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.643115 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-21724d9a-c31c-46c9-bdf2-ac419d96e08e req-5804f21b-a781-49c2-bfea-a48c7aa40b62 service nova] Creating event network-vif-plugged:041c1840-6713-484f-9db9-ed4df1bc61a0 for instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 on n-h1-850499-14 Oct 04 18:08:09.650742 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-21724d9a-c31c-46c9-bdf2-ac419d96e08e req-5804f21b-a781-49c2-bfea-a48c7aa40b62 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112556 Oct 04 18:08:09.651813 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 812/1679] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:09.672412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b705a0a1-2c55-4f25-8fb1-dd983846f06b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:09.673646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b705a0a1-2c55-4f25-8fb1-dd983846f06b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:09.682133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b705a0a1-2c55-4f25-8fb1-dd983846f06b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.682944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b705a0a1-2c55-4f25-8fb1-dd983846f06b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.683614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b705a0a1-2c55-4f25-8fb1-dd983846f06b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.684556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b705a0a1-2c55-4f25-8fb1-dd983846f06b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.685205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b705a0a1-2c55-4f25-8fb1-dd983846f06b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.685853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b705a0a1-2c55-4f25-8fb1-dd983846f06b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.891033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3a55d84d-8722-4c0e-bb36-def8ff3d0715 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:09.908166 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3a55d84d-8722-4c0e-bb36-def8ff3d0715 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1507 microversion: 2.1 time: 1.150109 Oct 04 18:08:09.908825 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 868/1680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:08 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1507 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:09.913867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ec5b4520-150c-49b9-b64a-2ee610fbef82 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:09.919182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ec5b4520-150c-49b9-b64a-2ee610fbef82 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:09.929113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec5b4520-150c-49b9-b64a-2ee610fbef82 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.929889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec5b4520-150c-49b9-b64a-2ee610fbef82 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.930547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec5b4520-150c-49b9-b64a-2ee610fbef82 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.931484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec5b4520-150c-49b9-b64a-2ee610fbef82 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.932668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec5b4520-150c-49b9-b64a-2ee610fbef82 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.933672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec5b4520-150c-49b9-b64a-2ee610fbef82 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.102346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b705a0a1-2c55-4f25-8fb1-dd983846f06b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:10.106626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:10.114640 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b705a0a1-2c55-4f25-8fb1-dd983846f06b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 0.461566 Oct 04 18:08:10.115281 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 813/1681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:09 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:10.126462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39e6c93c-0725-4f32-b97a-6745150c98bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:10.144531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39e6c93c-0725-4f32-b97a-6745150c98bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:10.155906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e6c93c-0725-4f32-b97a-6745150c98bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:10.157511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e6c93c-0725-4f32-b97a-6745150c98bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:10.158744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e6c93c-0725-4f32-b97a-6745150c98bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.160155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e6c93c-0725-4f32-b97a-6745150c98bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:10.161384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e6c93c-0725-4f32-b97a-6745150c98bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:10.162508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e6c93c-0725-4f32-b97a-6745150c98bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.201154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39e6c93c-0725-4f32-b97a-6745150c98bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:10.235949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ec5b4520-150c-49b9-b64a-2ee610fbef82 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:10.247339 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ec5b4520-150c-49b9-b64a-2ee610fbef82 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1307 microversion: 2.1 time: 0.337114 Oct 04 18:08:10.267898 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 869/1682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:09 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1307 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:10.278317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a88f9252-3f32-4217-9e85-c025fd16c673 req-73b393e7-be0d-4a5b-8c05-dcfe9c239d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d488d1-77e8-4d0e-9f33-0b675d54dc67", "tag": "151409ae-2c91-4671-9adf-e22cfaac01aa"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:10.306340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a88f9252-3f32-4217-9e85-c025fd16c673 req-73b393e7-be0d-4a5b-8c05-dcfe9c239d6b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:10.307332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a88f9252-3f32-4217-9e85-c025fd16c673 req-73b393e7-be0d-4a5b-8c05-dcfe9c239d6b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:10.309203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a88f9252-3f32-4217-9e85-c025fd16c673 req-73b393e7-be0d-4a5b-8c05-dcfe9c239d6b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.343076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a88f9252-3f32-4217-9e85-c025fd16c673 req-73b393e7-be0d-4a5b-8c05-dcfe9c239d6b service nova] Creating event network-changed:151409ae-2c91-4671-9adf-e22cfaac01aa for instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 on n-h2-850499-14 Oct 04 18:08:10.369742 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a88f9252-3f32-4217-9e85-c025fd16c673 req-73b393e7-be0d-4a5b-8c05-dcfe9c239d6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089126 Oct 04 18:08:10.375073 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 870/1683] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:10.380148 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39e6c93c-0725-4f32-b97a-6745150c98bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 204 len: 0 microversion: 2.1 time: 0.257206 Oct 04 18:08:10.380901 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 814/1684] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:10 2022] DELETE /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:10.386589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:10.387110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2052955270", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "6fd5579e-ca5d-48f8-ac4e-96d5813bfdbe"}, {"uuid": "a89e3399-6d93-494e-b6a5-87b3be0164db"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:10.395657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:10.422325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:10.424956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:10.427181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.428412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:10.433608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:10.434878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.528531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] validate_networks() for [('6fd5579e-ca5d-48f8-ac4e-96d5813bfdbe', None, None, None, None, None), ('a89e3399-6d93-494e-b6a5-87b3be0164db', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:08:11.021186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:11.042003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:11.046751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:11.049828 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-94224112-e30f-4254-a382-235df9e440f2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1361 microversion: 2.25 time: 0.673238 Oct 04 18:08:11.056594 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 871/1685] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:10 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1361 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:11.104722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-206e5f81-cd3e-406e-a687-7fa68ce025bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:11.108010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-206e5f81-cd3e-406e-a687-7fa68ce025bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:11.126845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-206e5f81-cd3e-406e-a687-7fa68ce025bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:11.133412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-206e5f81-cd3e-406e-a687-7fa68ce025bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:11.134296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-206e5f81-cd3e-406e-a687-7fa68ce025bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:11.136469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-206e5f81-cd3e-406e-a687-7fa68ce025bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:11.140943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-206e5f81-cd3e-406e-a687-7fa68ce025bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:11.150102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-206e5f81-cd3e-406e-a687-7fa68ce025bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:12.689338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-206e5f81-cd3e-406e-a687-7fa68ce025bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:12.713531 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-206e5f81-cd3e-406e-a687-7fa68ce025bd tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1468 microversion: 2.1 time: 1.652567 Oct 04 18:08:12.714504 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 872/1686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:11 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1468 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:12.727373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:12.728338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:12.761287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:12.761808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:12.762260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:12.763019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:12.770857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:12.773917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:13.058405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:13.078302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:13.085515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:13.102766 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-808e2c35-7655-4740-82ab-26927e125b92 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.383136 Oct 04 18:08:13.106213 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 873/1687] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:12 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:13.117531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-61944640-85de-4b4b-9a7d-68dc176a2bfb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:13.120833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-61944640-85de-4b4b-9a7d-68dc176a2bfb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:13.146356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61944640-85de-4b4b-9a7d-68dc176a2bfb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:13.152601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61944640-85de-4b4b-9a7d-68dc176a2bfb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:13.157900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61944640-85de-4b4b-9a7d-68dc176a2bfb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:13.163738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61944640-85de-4b4b-9a7d-68dc176a2bfb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:13.169475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61944640-85de-4b4b-9a7d-68dc176a2bfb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:13.171723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61944640-85de-4b4b-9a7d-68dc176a2bfb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:13.535469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61944640-85de-4b4b-9a7d-68dc176a2bfb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:13.546793 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-61944640-85de-4b4b-9a7d-68dc176a2bfb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1198 microversion: 2.1 time: 0.438064 Oct 04 18:08:13.550296 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 874/1688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:13 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1198 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:13.563437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-35640b8c-2d67-4afe-8150-29730be7b0f4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:13.564427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-35640b8c-2d67-4afe-8150-29730be7b0f4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:13.576778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35640b8c-2d67-4afe-8150-29730be7b0f4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:13.581163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35640b8c-2d67-4afe-8150-29730be7b0f4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:13.588041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35640b8c-2d67-4afe-8150-29730be7b0f4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:13.589512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35640b8c-2d67-4afe-8150-29730be7b0f4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:13.590330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35640b8c-2d67-4afe-8150-29730be7b0f4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:13.591560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35640b8c-2d67-4afe-8150-29730be7b0f4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:13.860682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:08:13.861534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:08:13.862461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:08:13.863198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:08:13.864581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:08:13.887180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:13.888139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:13.888836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:13.889855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:13.890657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:13.891499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:13.928092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Getting quotas for project 4839e26fbc244802b56f2b0289410041. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:13.934147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Getting quotas for user 29738c2533554939a890fad96acc1bef and project 4839e26fbc244802b56f2b0289410041. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:13.957168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-35640b8c-2d67-4afe-8150-29730be7b0f4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:13.961018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:08:13.965215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:08:14.006194 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-35640b8c-2d67-4afe-8150-29730be7b0f4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1307 microversion: 2.1 time: 0.452888 Oct 04 18:08:14.021378 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 875/1689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:13 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1307 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:14.052384 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ecaf134-458b-4e9f-9b90-95d9e580bda2 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.670089 Oct 04 18:08:14.056216 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 815/1690] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:08:14.066940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-dd94def9-cd31-425a-b9fa-6ba1aea6aa6a req-cce4df9d-acb2-4a41-b4a7-4e877d9e7c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b522e60-ef39-4497-8da3-023eac9859af", "name": "network-vif-plugged", "status": "completed", "tag": "f59d0713-eb06-474f-8c60-34c2e6eaf606"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:14.072952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:14.073798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:14.081179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd94def9-cd31-425a-b9fa-6ba1aea6aa6a req-cce4df9d-acb2-4a41-b4a7-4e877d9e7c09 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.081680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd94def9-cd31-425a-b9fa-6ba1aea6aa6a req-cce4df9d-acb2-4a41-b4a7-4e877d9e7c09 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.082121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd94def9-cd31-425a-b9fa-6ba1aea6aa6a req-cce4df9d-acb2-4a41-b4a7-4e877d9e7c09 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:14.083543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.085386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.086425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:14.092196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.093421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.094471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:14.117721 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-dd94def9-cd31-425a-b9fa-6ba1aea6aa6a req-cce4df9d-acb2-4a41-b4a7-4e877d9e7c09 service nova] Creating event network-vif-plugged:f59d0713-eb06-474f-8c60-34c2e6eaf606 for instance 4b522e60-ef39-4497-8da3-023eac9859af on n-h2-850499-14 Oct 04 18:08:14.131577 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-dd94def9-cd31-425a-b9fa-6ba1aea6aa6a req-cce4df9d-acb2-4a41-b4a7-4e877d9e7c09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087980 Oct 04 18:08:14.132528 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 876/1691] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:14.146925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "515ff1f1-024f-43aa-b653-c6dda2fd1b6c"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:14.159200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:14.175460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.180814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.195641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:14.198771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.203601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.204226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:14.311267 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] HTTP exception thrown: Volume a49e8a79-0781-40c6-9890-218f4bc5f095 could not be found. Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Request method failure captured: Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: request: PUT /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3/os-volume_attachments/a49e8a79-0781-40c6-9890-218f4bc5f095 HTTP/1.1 Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 74 Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHWh2hpkdXIl2WizxfG3Eewh52pwO4DioJHEfuN8px3owCywV7VDDYMNZG0CdTXIBlIkdMQyW58n3cq-L9tQ-6coLkWmroV-kyroX6PSruIN2h207TBt52rIvI0Vao0DoTsEa7GnDKiPQZRmikZCukh-OB1coQh_jTRkbecTPK77CD4 Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: b830465e51154274b13b2dce61554099 Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesAdminNegativeTest-1759953198 Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:08:14.315896 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b830465e51154274b13b2dce61554099"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b830465e51154274b13b2dce61554099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b830465e51154274b13b2dce61554099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b830465e51154274b13b2dce61554099"}]}] Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesAdminNegativeTest-1759953198 Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: b830465e51154274b13b2dce61554099 Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1759953198 Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesAdminNegativeTest-1759953198-project-admin Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6c5b173c40364eda899d369de033e56f Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesAdminNegativeTest-1759953198-project-admin Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: {"volumeAttachment": {"volumeId": "515ff1f1-024f-43aa-b653-c6dda2fd1b6c"}} Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:08:14.317679 n-d-850499-14 devstack@n-api.service[122332]: exception: Volume a49e8a79-0781-40c6-9890-218f4bc5f095 could not be found. Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'server_id': 'e2acda7d-dc95-44ac-8ac8-62522ca02bd3', 'id': 'a49e8a79-0781-40c6-9890-218f4bc5f095', 'body': {'volumeAttachment': {'volumeId': '515ff1f1-024f-43aa-b653-c6dda2fd1b6c'}}} Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:08:14.318785 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a49e8a79-0781-40c6-9890-218f4bc5f095 could not be found. (HTTP 404) (Request-ID: req-5436cece-8e5f-4b36-a716-f69757ddf2ca) Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:08:14.320204 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a49e8a79-0781-40c6-9890-218f4bc5f095 could not be found. Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:14.321747 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a49e8a79-0781-40c6-9890-218f4bc5f095 could not be found. Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a49e8a79-0781-40c6-9890-218f4bc5f095 could not be found. Oct 04 18:08:14.323510 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:14.325149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] Returning 404 to user: Volume a49e8a79-0781-40c6-9890-218f4bc5f095 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:14.325149 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b7e51b73-8e38-4e3c-a382-2ba5472ed63a tempest-VolumesAdminNegativeTest-1759953198 tempest-VolumesAdminNegativeTest-1759953198-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3/os-volume_attachments/a49e8a79-0781-40c6-9890-218f4bc5f095" status: 404 len: 109 microversion: 2.1 time: 0.184226 Oct 04 18:08:14.331629 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 877/1692] 10.222.0.18 () {60 vars in 1433 bytes} [Tue Oct 4 18:08:14 2022] PUT /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3/os-volume_attachments/a49e8a79-0781-40c6-9890-218f4bc5f095 => generated 109 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:14.494515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:14.495090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-521760164", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "3460d6d9-0801-4482-b14b-54fef623a1ce"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:14.505743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:14.509556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:14.512309 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b0e40363-6efd-460d-928a-d3162a556a1b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1361 microversion: 2.25 time: 0.454430 Oct 04 18:08:14.514045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 816/1693] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:14 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1361 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:14.547793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-30b7e312-2dcf-472e-8889-48d03fdc3908 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:14.550638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-30b7e312-2dcf-472e-8889-48d03fdc3908 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:14.579015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b7e312-2dcf-472e-8889-48d03fdc3908 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.579015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b7e312-2dcf-472e-8889-48d03fdc3908 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.579015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b7e312-2dcf-472e-8889-48d03fdc3908 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:14.581261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b7e312-2dcf-472e-8889-48d03fdc3908 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.582378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b7e312-2dcf-472e-8889-48d03fdc3908 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.583589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b7e312-2dcf-472e-8889-48d03fdc3908 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:14.611119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] validate_networks() for [('3460d6d9-0801-4482-b14b-54fef623a1ce', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:08:15.051404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-30b7e312-2dcf-472e-8889-48d03fdc3908 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:15.067858 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-30b7e312-2dcf-472e-8889-48d03fdc3908 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1468 microversion: 2.1 time: 0.551725 Oct 04 18:08:15.071916 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 817/1694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:14 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1468 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:15.098471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5822a26b-7236-4212-ae6e-6ac3c4026a5f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:15.101682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5822a26b-7236-4212-ae6e-6ac3c4026a5f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:15.119718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5822a26b-7236-4212-ae6e-6ac3c4026a5f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:15.120683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5822a26b-7236-4212-ae6e-6ac3c4026a5f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:15.121307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5822a26b-7236-4212-ae6e-6ac3c4026a5f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:15.122262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5822a26b-7236-4212-ae6e-6ac3c4026a5f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:15.123205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5822a26b-7236-4212-ae6e-6ac3c4026a5f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:15.126437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5822a26b-7236-4212-ae6e-6ac3c4026a5f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:15.328316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5822a26b-7236-4212-ae6e-6ac3c4026a5f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:15.338353 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5822a26b-7236-4212-ae6e-6ac3c4026a5f tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1217 microversion: 2.1 time: 0.262159 Oct 04 18:08:15.354242 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 818/1695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:15 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:15.366619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:15.384710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:15.403463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:15.416474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:15.417458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:15.418910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:15.419636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:15.420349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:15.901616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:15.931798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:15.936324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:15.968304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc61d9c8-975a-4402-b471-2a47c0ddfc82 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.612236 Oct 04 18:08:15.969807 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 819/1696] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:15 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:16.016275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-10c21197-e878-4873-b048-f92d58b802b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:16.017260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-10c21197-e878-4873-b048-f92d58b802b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:16.024544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10c21197-e878-4873-b048-f92d58b802b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.025484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10c21197-e878-4873-b048-f92d58b802b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.026396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10c21197-e878-4873-b048-f92d58b802b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.027554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10c21197-e878-4873-b048-f92d58b802b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.028189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10c21197-e878-4873-b048-f92d58b802b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.028823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10c21197-e878-4873-b048-f92d58b802b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.462119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:08:16.462693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:08:16.463020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:08:16.463647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:08:16.464231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:08:16.492790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.496819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.498758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.501956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.505106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.507560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.577337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:16.592847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for user ba39a7cdf309477195a07acb5cdf24f4 and project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:16.634350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:08:16.646264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:08:16.717165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-10c21197-e878-4873-b048-f92d58b802b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:16.734710 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-10c21197-e878-4873-b048-f92d58b802b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1381 microversion: 2.1 time: 0.743226 Oct 04 18:08:16.739149 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 820/1697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:15 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1381 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:16.747074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2720955a-c16c-4ce1-908a-916a98f96916 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:16.753508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2720955a-c16c-4ce1-908a-916a98f96916 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:16.772956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2720955a-c16c-4ce1-908a-916a98f96916 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.774245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2720955a-c16c-4ce1-908a-916a98f96916 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.777426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2720955a-c16c-4ce1-908a-916a98f96916 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.778568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2720955a-c16c-4ce1-908a-916a98f96916 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.782545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2720955a-c16c-4ce1-908a-916a98f96916 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.783324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2720955a-c16c-4ce1-908a-916a98f96916 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.838135 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f0e087bc-a974-41cc-a0b4-9dfd8efdb5a6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.504927 Oct 04 18:08:16.838804 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 878/1698] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:08:16.853907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:16.854541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:16.926634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.933453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.934989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.937211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.938605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.940072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.444219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2720955a-c16c-4ce1-908a-916a98f96916 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.458798 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2720955a-c16c-4ce1-908a-916a98f96916 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1307 microversion: 2.1 time: 0.716441 Oct 04 18:08:17.459527 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 821/1699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:16 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1307 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:17.468755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2901d26-7642-4693-b43c-2f1398e567c1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:17.471410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a2901d26-7642-4693-b43c-2f1398e567c1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:17.474466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.483940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:17.499111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2901d26-7642-4693-b43c-2f1398e567c1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.499872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2901d26-7642-4693-b43c-2f1398e567c1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.500511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2901d26-7642-4693-b43c-2f1398e567c1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.501676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2901d26-7642-4693-b43c-2f1398e567c1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.502356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2901d26-7642-4693-b43c-2f1398e567c1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.503017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2901d26-7642-4693-b43c-2f1398e567c1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.503301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.514313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.517944 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1359a7aa-799e-45f4-99b1-5c65337f5f00 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1361 microversion: 2.25 time: 0.667888 Oct 04 18:08:17.543900 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 879/1700] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:16 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1361 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:17.563036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ab1b2ccf-0246-4c8e-8596-a8c1eb1aca7a tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:17.563962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ab1b2ccf-0246-4c8e-8596-a8c1eb1aca7a tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:17.581151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab1b2ccf-0246-4c8e-8596-a8c1eb1aca7a tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.589947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab1b2ccf-0246-4c8e-8596-a8c1eb1aca7a tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.591853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab1b2ccf-0246-4c8e-8596-a8c1eb1aca7a tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.597476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab1b2ccf-0246-4c8e-8596-a8c1eb1aca7a tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.598524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab1b2ccf-0246-4c8e-8596-a8c1eb1aca7a tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.600130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab1b2ccf-0246-4c8e-8596-a8c1eb1aca7a tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.954857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ab1b2ccf-0246-4c8e-8596-a8c1eb1aca7a tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.972456 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ab1b2ccf-0246-4c8e-8596-a8c1eb1aca7a tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1265 microversion: 2.1 time: 0.418597 Oct 04 18:08:17.973144 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 880/1701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:17 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1265 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:18.187141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a2901d26-7642-4693-b43c-2f1398e567c1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:18.227387 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a2901d26-7642-4693-b43c-2f1398e567c1 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1468 microversion: 2.1 time: 0.762756 Oct 04 18:08:18.231122 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 822/1702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:17 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1468 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:18.262854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a930f0bd-b3a2-440b-9ac9-8f050de37bb9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:18.271634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a930f0bd-b3a2-440b-9ac9-8f050de37bb9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:18.317324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a930f0bd-b3a2-440b-9ac9-8f050de37bb9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.317829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a930f0bd-b3a2-440b-9ac9-8f050de37bb9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.318269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a930f0bd-b3a2-440b-9ac9-8f050de37bb9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.319015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a930f0bd-b3a2-440b-9ac9-8f050de37bb9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.319482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a930f0bd-b3a2-440b-9ac9-8f050de37bb9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.319914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a930f0bd-b3a2-440b-9ac9-8f050de37bb9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.611615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a930f0bd-b3a2-440b-9ac9-8f050de37bb9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:18.624940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e670d8e8-4246-4c08-8c92-fd45b53972ab tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:18.625694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e670d8e8-4246-4c08-8c92-fd45b53972ab tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:18.632052 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a930f0bd-b3a2-440b-9ac9-8f050de37bb9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1218 microversion: 2.1 time: 0.396728 Oct 04 18:08:18.641337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e670d8e8-4246-4c08-8c92-fd45b53972ab tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.643892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e670d8e8-4246-4c08-8c92-fd45b53972ab tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.648331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e670d8e8-4246-4c08-8c92-fd45b53972ab tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.651473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e670d8e8-4246-4c08-8c92-fd45b53972ab tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.652045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 823/1703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:18 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1218 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:18.654715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e670d8e8-4246-4c08-8c92-fd45b53972ab tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.656264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e670d8e8-4246-4c08-8c92-fd45b53972ab tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.671720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:18.676285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:18.701485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.706325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.708631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.712149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.712992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.715339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.961162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:18.973681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:18.975192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:18.996361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-075e9f49-0b3c-40b9-a09f-9d28b2f5d40b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.340334 Oct 04 18:08:19.017589 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 824/1704] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:18 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:19.053485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7172d3ca-9f8b-4e65-8c7b-81846fcf41f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:19.054078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7172d3ca-9f8b-4e65-8c7b-81846fcf41f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:19.069606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7172d3ca-9f8b-4e65-8c7b-81846fcf41f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.070125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7172d3ca-9f8b-4e65-8c7b-81846fcf41f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.070696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7172d3ca-9f8b-4e65-8c7b-81846fcf41f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:19.079027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7172d3ca-9f8b-4e65-8c7b-81846fcf41f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.079317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7172d3ca-9f8b-4e65-8c7b-81846fcf41f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.079929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7172d3ca-9f8b-4e65-8c7b-81846fcf41f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.109297 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e670d8e8-4246-4c08-8c92-fd45b53972ab tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1534 microversion: 2.1 time: 2.126546 Oct 04 18:08:20.122984 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 881/1705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:17 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1534 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:20.125532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:20.129114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:20.151493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.153085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.159568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.162089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.162618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.165052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7172d3ca-9f8b-4e65-8c7b-81846fcf41f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:20.165636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.201286 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7172d3ca-9f8b-4e65-8c7b-81846fcf41f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1307 microversion: 2.1 time: 1.181294 Oct 04 18:08:20.201925 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 825/1706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:19 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1307 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:20.234544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-aded9ce1-e305-4e39-80da-f321c13554a9 req-e33eb1b3-feb9-46fe-a06a-2d77dadc405b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b522e60-ef39-4497-8da3-023eac9859af", "name": "network-vif-deleted", "tag": "f59d0713-eb06-474f-8c60-34c2e6eaf606"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:20.292608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:20.301826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-aded9ce1-e305-4e39-80da-f321c13554a9 req-e33eb1b3-feb9-46fe-a06a-2d77dadc405b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.305916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-aded9ce1-e305-4e39-80da-f321c13554a9 req-e33eb1b3-feb9-46fe-a06a-2d77dadc405b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.307917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-aded9ce1-e305-4e39-80da-f321c13554a9 req-e33eb1b3-feb9-46fe-a06a-2d77dadc405b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.356447 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-aded9ce1-e305-4e39-80da-f321c13554a9 req-e33eb1b3-feb9-46fe-a06a-2d77dadc405b service nova] Creating event network-vif-deleted:f59d0713-eb06-474f-8c60-34c2e6eaf606 for instance 4b522e60-ef39-4497-8da3-023eac9859af on n-h2-850499-14 Oct 04 18:08:20.375364 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-aded9ce1-e305-4e39-80da-f321c13554a9 req-e33eb1b3-feb9-46fe-a06a-2d77dadc405b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169099 Oct 04 18:08:20.376273 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 826/1707] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:20.399584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73ad1a9f-8e3b-4a07-a5c0-32e7c0720bad tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:20.401025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73ad1a9f-8e3b-4a07-a5c0-32e7c0720bad tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:20.426181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73ad1a9f-8e3b-4a07-a5c0-32e7c0720bad tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.426703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73ad1a9f-8e3b-4a07-a5c0-32e7c0720bad tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.427189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73ad1a9f-8e3b-4a07-a5c0-32e7c0720bad tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.431600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73ad1a9f-8e3b-4a07-a5c0-32e7c0720bad tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.434005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73ad1a9f-8e3b-4a07-a5c0-32e7c0720bad tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.435617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73ad1a9f-8e3b-4a07-a5c0-32e7c0720bad tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.832205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-73ad1a9f-8e3b-4a07-a5c0-32e7c0720bad tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:20.858560 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-73ad1a9f-8e3b-4a07-a5c0-32e7c0720bad tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1271 microversion: 2.1 time: 0.478757 Oct 04 18:08:20.859190 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 827/1708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:20 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1271 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:20.903576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:20.904797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:20.931624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.933367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.936014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.940694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.941707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.942498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.069002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.069552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.070891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.071427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lazy-loading 'fault' on Instance uuid 4b522e60-ef39-4497-8da3-023eac9859af {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:21.106906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.117753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.125908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.130007 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2525ba45-b72f-45d8-abea-f613f8a56d94 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1361 microversion: 2.25 time: 1.015391 Oct 04 18:08:21.137693 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 882/1709] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:20 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1361 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:21.143739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84046428-8823-4af4-8074-d05166a7f6b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:21.146699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-84046428-8823-4af4-8074-d05166a7f6b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:21.165724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84046428-8823-4af4-8074-d05166a7f6b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.168515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84046428-8823-4af4-8074-d05166a7f6b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.172949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84046428-8823-4af4-8074-d05166a7f6b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.174773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84046428-8823-4af4-8074-d05166a7f6b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.175488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84046428-8823-4af4-8074-d05166a7f6b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.176604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84046428-8823-4af4-8074-d05166a7f6b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.256733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.271916 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f130c1b-f6ea-40d8-b3cd-c5bc2df7e25d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 200 len: 1303 microversion: 2.1 time: 0.399568 Oct 04 18:08:21.303666 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 828/1710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:20 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 1303 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:21.308436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-824fa825-fedc-4ec8-8caa-e11da5d2b4e1 req-eee5ac5b-09c1-4c78-a2ec-3e42a29392b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d", "name": "network-vif-plugged", "status": "completed", "tag": "4fd0d5d2-3dd8-4446-b5b1-1caafbeb86b3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:21.342656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-824fa825-fedc-4ec8-8caa-e11da5d2b4e1 req-eee5ac5b-09c1-4c78-a2ec-3e42a29392b9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.343520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-824fa825-fedc-4ec8-8caa-e11da5d2b4e1 req-eee5ac5b-09c1-4c78-a2ec-3e42a29392b9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.344159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-824fa825-fedc-4ec8-8caa-e11da5d2b4e1 req-eee5ac5b-09c1-4c78-a2ec-3e42a29392b9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.386459 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-824fa825-fedc-4ec8-8caa-e11da5d2b4e1 req-eee5ac5b-09c1-4c78-a2ec-3e42a29392b9 service nova] Creating event network-vif-plugged:4fd0d5d2-3dd8-4446-b5b1-1caafbeb86b3 for instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d on n-h1-850499-14 Oct 04 18:08:21.400175 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-824fa825-fedc-4ec8-8caa-e11da5d2b4e1 req-eee5ac5b-09c1-4c78-a2ec-3e42a29392b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094803 Oct 04 18:08:21.401786 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 829/1711] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:21.419141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:21.420136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:21.461695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.470592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.470757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.475652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.476565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.477229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.553356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:21.628931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-84046428-8823-4af4-8074-d05166a7f6b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.645645 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84046428-8823-4af4-8074-d05166a7f6b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1272 microversion: 2.1 time: 0.506548 Oct 04 18:08:21.646242 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 883/1712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:21 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1272 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:21.672038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f9a1b85d-8c91-4d75-a422-b5f4358a66f5 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:21.680422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f9a1b85d-8c91-4d75-a422-b5f4358a66f5 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:21.703517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9a1b85d-8c91-4d75-a422-b5f4358a66f5 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.705057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9a1b85d-8c91-4d75-a422-b5f4358a66f5 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.710013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9a1b85d-8c91-4d75-a422-b5f4358a66f5 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.713580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9a1b85d-8c91-4d75-a422-b5f4358a66f5 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.714943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9a1b85d-8c91-4d75-a422-b5f4358a66f5 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.720107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9a1b85d-8c91-4d75-a422-b5f4358a66f5 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.920887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.946403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.957716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.971832 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6033d58f-9a25-4c94-9c60-4120cb500fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.569214 Oct 04 18:08:21.977020 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 830/1713] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:21 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:21.988145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c54bdff7-297e-4a6f-a201-60a9180db606 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:21.997404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c54bdff7-297e-4a6f-a201-60a9180db606 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:22.027597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c54bdff7-297e-4a6f-a201-60a9180db606 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.028442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c54bdff7-297e-4a6f-a201-60a9180db606 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.029139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c54bdff7-297e-4a6f-a201-60a9180db606 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.030140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c54bdff7-297e-4a6f-a201-60a9180db606 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.030616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c54bdff7-297e-4a6f-a201-60a9180db606 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.031116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c54bdff7-297e-4a6f-a201-60a9180db606 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.522084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c54bdff7-297e-4a6f-a201-60a9180db606 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:22.536291 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c54bdff7-297e-4a6f-a201-60a9180db606 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1307 microversion: 2.1 time: 0.557627 Oct 04 18:08:22.543023 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 831/1714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:21 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1307 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:22.543023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-43239f34-438c-49b8-af35-6b81761e4a6e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:22.543023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-43239f34-438c-49b8-af35-6b81761e4a6e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:22.551486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43239f34-438c-49b8-af35-6b81761e4a6e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.555893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43239f34-438c-49b8-af35-6b81761e4a6e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.560382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43239f34-438c-49b8-af35-6b81761e4a6e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.564278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43239f34-438c-49b8-af35-6b81761e4a6e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.564278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43239f34-438c-49b8-af35-6b81761e4a6e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.564278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43239f34-438c-49b8-af35-6b81761e4a6e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.583411 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f9a1b85d-8c91-4d75-a422-b5f4358a66f5 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1534 microversion: 2.1 time: 0.920370 Oct 04 18:08:22.584104 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 884/1715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:21 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1534 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:22.599735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b6057978-93a9-4244-8173-0de31824e753 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:22.600385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b6057978-93a9-4244-8173-0de31824e753 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:22.612717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6057978-93a9-4244-8173-0de31824e753 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.613213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6057978-93a9-4244-8173-0de31824e753 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.624039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-43239f34-438c-49b8-af35-6b81761e4a6e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:22.629118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6057978-93a9-4244-8173-0de31824e753 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.629907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6057978-93a9-4244-8173-0de31824e753 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.630381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6057978-93a9-4244-8173-0de31824e753 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.630819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6057978-93a9-4244-8173-0de31824e753 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.762147 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-43239f34-438c-49b8-af35-6b81761e4a6e tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 204 len: 0 microversion: 2.1 time: 0.223341 Oct 04 18:08:22.766486 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 832/1716] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:22 2022] DELETE /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:22.776117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:22.789219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:22.806862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.808173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.809357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.811030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.813397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.814218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.100527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6057978-93a9-4244-8173-0de31824e753 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.111430 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b6057978-93a9-4244-8173-0de31824e753 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1313 microversion: 2.1 time: 0.526177 Oct 04 18:08:23.114236 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 885/1717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:22 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:23.119416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.120471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 4b522e60-ef39-4497-8da3-023eac9859af] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.124072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.131514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.132291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.134223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.134924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.135878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.136542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.138740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.142623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.144237 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-417df766-3d3c-4765-a7eb-2b541fb40ed1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1361 microversion: 2.25 time: 0.376005 Oct 04 18:08:23.145039 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 833/1718] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:22 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:23.153842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d2c6244b-5dd4-4e20-8eb2-9fdafef6c0dd tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.158295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2c6244b-5dd4-4e20-8eb2-9fdafef6c0dd tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.162372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2c6244b-5dd4-4e20-8eb2-9fdafef6c0dd tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.162372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2c6244b-5dd4-4e20-8eb2-9fdafef6c0dd tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.162372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2c6244b-5dd4-4e20-8eb2-9fdafef6c0dd tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.162372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2c6244b-5dd4-4e20-8eb2-9fdafef6c0dd tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.162794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2c6244b-5dd4-4e20-8eb2-9fdafef6c0dd tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.176986 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] HTTP exception thrown: Instance 4b522e60-ef39-4497-8da3-023eac9859af could not be found. Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Request method failure captured: Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af HTTP/1.1 Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUf8dchgSXE9vgOCKScrTppBi--u612-BByNU9fbbDIdV6mYCvbC8pDs4Upd_xlWfPhtoT_d3CHoi8ga5ibSNJQ6MdCunmto3snMRshHd_F9d04JtgGK3fb8M_ApoEmEDf6jTP42CLTIGxaTqU6WxHAlmQIra5mzvHZ6lae0XEI6R4 Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 31d6eb30af1d4b6fa2955cb3cdeae3ee Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:08:23.178547 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}] Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 31d6eb30af1d4b6fa2955cb3cdeae3ee Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-MigrationsAdminTest-1880636506-project Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: d7458740d4be4cedaa01bea94ba992d2 Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-MigrationsAdminTest-1880636506-project Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4b522e60-ef39-4497-8da3-023eac9859af could not be found. Oct 04 18:08:23.180401 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4b522e60-ef39-4497-8da3-023eac9859af'} Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b522e60-ef39-4497-8da3-023eac9859af could not be found. Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:23.185092 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b522e60-ef39-4497-8da3-023eac9859af could not be found. Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b522e60-ef39-4497-8da3-023eac9859af could not be found. Oct 04 18:08:23.188224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:23.198179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Returning 404 to user: Instance 4b522e60-ef39-4497-8da3-023eac9859af could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:23.198179 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-da26e487-9054-4b94-86c2-0a4a89a5ba4b tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af" status: 404 len: 111 microversion: 2.1 time: 0.064452 Oct 04 18:08:23.198179 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 886/1719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/servers/4b522e60-ef39-4497-8da3-023eac9859af => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:23.201643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2e874231-7572-447b-a1f0-2001ae762adc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.202516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2e874231-7572-447b-a1f0-2001ae762adc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.217745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e874231-7572-447b-a1f0-2001ae762adc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.218224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e874231-7572-447b-a1f0-2001ae762adc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.218669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e874231-7572-447b-a1f0-2001ae762adc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.219432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e874231-7572-447b-a1f0-2001ae762adc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.219895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e874231-7572-447b-a1f0-2001ae762adc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.220328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e874231-7572-447b-a1f0-2001ae762adc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.233966 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d2c6244b-5dd4-4e20-8eb2-9fdafef6c0dd tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.087701 Oct 04 18:08:23.243029 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 834/1720] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:23.243029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e44e0788-53a7-4ccb-bf0d-d16ff3aa82f9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.243029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e44e0788-53a7-4ccb-bf0d-d16ff3aa82f9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.254390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e44e0788-53a7-4ccb-bf0d-d16ff3aa82f9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.255034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e44e0788-53a7-4ccb-bf0d-d16ff3aa82f9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.256243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e44e0788-53a7-4ccb-bf0d-d16ff3aa82f9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.257064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e44e0788-53a7-4ccb-bf0d-d16ff3aa82f9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.258052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e44e0788-53a7-4ccb-bf0d-d16ff3aa82f9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.258202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e44e0788-53a7-4ccb-bf0d-d16ff3aa82f9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.592081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2e874231-7572-447b-a1f0-2001ae762adc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.601397 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2e874231-7572-447b-a1f0-2001ae762adc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.403841 Oct 04 18:08:23.601989 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 887/1721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:23.605319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e44e0788-53a7-4ccb-bf0d-d16ff3aa82f9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.615456 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e44e0788-53a7-4ccb-bf0d-d16ff3aa82f9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1513 microversion: 2.1 time: 0.379528 Oct 04 18:08:23.617948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.618648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.622571 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 835/1722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1513 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:23.630460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.631097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.631616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.632444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.632899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.633332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.634884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d84173c-44b2-4b5d-8edd-63e7cadfb7a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.639785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d84173c-44b2-4b5d-8edd-63e7cadfb7a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.649890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d84173c-44b2-4b5d-8edd-63e7cadfb7a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.650749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d84173c-44b2-4b5d-8edd-63e7cadfb7a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.651386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d84173c-44b2-4b5d-8edd-63e7cadfb7a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.652198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d84173c-44b2-4b5d-8edd-63e7cadfb7a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.652795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d84173c-44b2-4b5d-8edd-63e7cadfb7a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.653317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d84173c-44b2-4b5d-8edd-63e7cadfb7a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.681429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d84173c-44b2-4b5d-8edd-63e7cadfb7a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:23.741107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.753141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.755934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.764658 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-61d448d1-ed61-4c03-88f5-756a123b595a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.161191 Oct 04 18:08:23.776377 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 888/1723] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:23.781843 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3d84173c-44b2-4b5d-8edd-63e7cadfb7a2 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 204 len: 0 microversion: 2.1 time: 0.153884 Oct 04 18:08:23.784042 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 836/1724] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:23 2022] DELETE /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:23.790942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f69f90d-5cd0-4879-a477-837808b4cd8a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.792341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0f69f90d-5cd0-4879-a477-837808b4cd8a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.794619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850499-14", "block_migration": false, "disk_over_commit": false}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:23.798734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.801540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f69f90d-5cd0-4879-a477-837808b4cd8a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.802275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f69f90d-5cd0-4879-a477-837808b4cd8a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.803472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f69f90d-5cd0-4879-a477-837808b4cd8a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.804622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f69f90d-5cd0-4879-a477-837808b4cd8a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.805374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f69f90d-5cd0-4879-a477-837808b4cd8a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.806930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.807201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f69f90d-5cd0-4879-a477-837808b4cd8a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.807983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.808765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.811046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.811872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.812482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.847113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lazy-loading 'flavor' on Instance uuid fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:23.861789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Going to try to live migrate instance to n-h2-850499-14 {{(pid=122332) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:08:23.952350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:24.062657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0f69f90d-5cd0-4879-a477-837808b4cd8a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.071870 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0f69f90d-5cd0-4879-a477-837808b4cd8a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1307 microversion: 2.1 time: 0.286395 Oct 04 18:08:24.072620 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 837/1725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1307 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:24.077444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2adb412-f64c-48b7-8a56-c77d5731a99d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.078058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a2adb412-f64c-48b7-8a56-c77d5731a99d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:24.094389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2adb412-f64c-48b7-8a56-c77d5731a99d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.094887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2adb412-f64c-48b7-8a56-c77d5731a99d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.095357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2adb412-f64c-48b7-8a56-c77d5731a99d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.096190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2adb412-f64c-48b7-8a56-c77d5731a99d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.096658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2adb412-f64c-48b7-8a56-c77d5731a99d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.097417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2adb412-f64c-48b7-8a56-c77d5731a99d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.364720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a2adb412-f64c-48b7-8a56-c77d5731a99d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.378798 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a2adb412-f64c-48b7-8a56-c77d5731a99d tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1535 microversion: 2.1 time: 0.305153 Oct 04 18:08:24.394574 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 838/1726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1535 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:24.399949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ebe418c5-5c5c-4afa-8ead-03d0036402f4 req-1d28eb6e-85c7-494f-9240-451087767e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d488d1-77e8-4d0e-9f33-0b675d54dc67", "name": "network-vif-plugged", "status": "completed", "tag": "151409ae-2c91-4671-9adf-e22cfaac01aa"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:24.412546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ebe418c5-5c5c-4afa-8ead-03d0036402f4 req-1d28eb6e-85c7-494f-9240-451087767e27 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.413099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ebe418c5-5c5c-4afa-8ead-03d0036402f4 req-1d28eb6e-85c7-494f-9240-451087767e27 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.413526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ebe418c5-5c5c-4afa-8ead-03d0036402f4 req-1d28eb6e-85c7-494f-9240-451087767e27 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.430874 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ebe418c5-5c5c-4afa-8ead-03d0036402f4 req-1d28eb6e-85c7-494f-9240-451087767e27 service nova] Creating event network-vif-plugged:151409ae-2c91-4671-9adf-e22cfaac01aa for instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 on n-h2-850499-14 Oct 04 18:08:24.435764 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ebe418c5-5c5c-4afa-8ead-03d0036402f4 req-1d28eb6e-85c7-494f-9240-451087767e27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039252 Oct 04 18:08:24.436768 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 839/1727] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:24.443319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-718fbc3f-a117-4c12-93b9-f6b110896b41 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.444260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-718fbc3f-a117-4c12-93b9-f6b110896b41 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:24.451919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-718fbc3f-a117-4c12-93b9-f6b110896b41 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.452637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-718fbc3f-a117-4c12-93b9-f6b110896b41 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.453238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-718fbc3f-a117-4c12-93b9-f6b110896b41 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.454717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-718fbc3f-a117-4c12-93b9-f6b110896b41 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.456819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-718fbc3f-a117-4c12-93b9-f6b110896b41 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.457313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-718fbc3f-a117-4c12-93b9-f6b110896b41 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.657565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-718fbc3f-a117-4c12-93b9-f6b110896b41 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.666873 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-718fbc3f-a117-4c12-93b9-f6b110896b41 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.228494 Oct 04 18:08:24.667482 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 840/1728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:24.672841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.673453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:24.680312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.680799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.681236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.681933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.682388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.682811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.822221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.831447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.832895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.834058 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a973d0b-b87c-41dd-b857-4582abdea8cf tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1361 microversion: 2.25 time: 0.165462 Oct 04 18:08:24.834622 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 841/1729] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:24.840701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-edfb9010-81d1-4ba6-9739-0e283ae115f5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.842472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-edfb9010-81d1-4ba6-9739-0e283ae115f5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:24.850638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfb9010-81d1-4ba6-9739-0e283ae115f5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.851430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfb9010-81d1-4ba6-9739-0e283ae115f5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.852036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfb9010-81d1-4ba6-9739-0e283ae115f5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.852914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfb9010-81d1-4ba6-9739-0e283ae115f5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.853381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfb9010-81d1-4ba6-9739-0e283ae115f5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.853808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfb9010-81d1-4ba6-9739-0e283ae115f5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.112504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-edfb9010-81d1-4ba6-9739-0e283ae115f5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.121066 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-edfb9010-81d1-4ba6-9739-0e283ae115f5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.285355 Oct 04 18:08:25.131845 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 842/1730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:25.138005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6b9b24ff-d378-4639-847c-9f6ddbff7dae tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:25.138744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6b9b24ff-d378-4639-847c-9f6ddbff7dae tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:25.145181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b9b24ff-d378-4639-847c-9f6ddbff7dae tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.145686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b9b24ff-d378-4639-847c-9f6ddbff7dae tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.146121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b9b24ff-d378-4639-847c-9f6ddbff7dae tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.146829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b9b24ff-d378-4639-847c-9f6ddbff7dae tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.147328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b9b24ff-d378-4639-847c-9f6ddbff7dae tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.147748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b9b24ff-d378-4639-847c-9f6ddbff7dae tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.381805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6b9b24ff-d378-4639-847c-9f6ddbff7dae tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.390040 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6b9b24ff-d378-4639-847c-9f6ddbff7dae tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1513 microversion: 2.1 time: 0.256047 Oct 04 18:08:25.390811 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 843/1731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:25 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:25.397930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:25.399502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:25.410807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.411822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.412696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.414022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.414933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.415815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.505879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.515950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.517651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.523618 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-691ccb5b-8501-425b-b5cf-7e0582e5806e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.129984 Oct 04 18:08:25.524203 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 844/1732] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:25 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:25.528687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a36f650-b49c-4003-8d2e-7e70d35b2675 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:25.529463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8a36f650-b49c-4003-8d2e-7e70d35b2675 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:25.535542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a36f650-b49c-4003-8d2e-7e70d35b2675 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.536041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a36f650-b49c-4003-8d2e-7e70d35b2675 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.536483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a36f650-b49c-4003-8d2e-7e70d35b2675 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.537177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a36f650-b49c-4003-8d2e-7e70d35b2675 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.537634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a36f650-b49c-4003-8d2e-7e70d35b2675 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.538062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a36f650-b49c-4003-8d2e-7e70d35b2675 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.555795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:26.072275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a36f650-b49c-4003-8d2e-7e70d35b2675 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.082100 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a36f650-b49c-4003-8d2e-7e70d35b2675 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1487 microversion: 2.1 time: 0.556572 Oct 04 18:08:26.083106 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 845/1733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:25 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1487 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:26.088980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f499f8ea-5e1f-4ec9-8c98-716ca88d45a8 req-c9bc8419-71e0-432e-b949-27ddb004ff97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af0d606d-f41f-40fa-80d3-32974fc534a5", "tag": "669b81d6-31f9-4ffe-93ee-6a4c042ad41c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:26.099810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f499f8ea-5e1f-4ec9-8c98-716ca88d45a8 req-c9bc8419-71e0-432e-b949-27ddb004ff97 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.100568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f499f8ea-5e1f-4ec9-8c98-716ca88d45a8 req-c9bc8419-71e0-432e-b949-27ddb004ff97 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.100999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f499f8ea-5e1f-4ec9-8c98-716ca88d45a8 req-c9bc8419-71e0-432e-b949-27ddb004ff97 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.112680 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f499f8ea-5e1f-4ec9-8c98-716ca88d45a8 req-c9bc8419-71e0-432e-b949-27ddb004ff97 service nova] Creating event network-changed:669b81d6-31f9-4ffe-93ee-6a4c042ad41c for instance af0d606d-f41f-40fa-80d3-32974fc534a5 on n-h2-850499-14 Oct 04 18:08:26.117560 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f499f8ea-5e1f-4ec9-8c98-716ca88d45a8 req-c9bc8419-71e0-432e-b949-27ddb004ff97 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033189 Oct 04 18:08:26.118170 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 846/1734] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:26.123162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-48d8e806-49d2-4b95-96fd-7e5ecd2a721f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:26.123864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-48d8e806-49d2-4b95-96fd-7e5ecd2a721f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:26.130104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48d8e806-49d2-4b95-96fd-7e5ecd2a721f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.130596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48d8e806-49d2-4b95-96fd-7e5ecd2a721f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.131063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48d8e806-49d2-4b95-96fd-7e5ecd2a721f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.131771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48d8e806-49d2-4b95-96fd-7e5ecd2a721f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.132221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48d8e806-49d2-4b95-96fd-7e5ecd2a721f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.132641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48d8e806-49d2-4b95-96fd-7e5ecd2a721f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.363949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-48d8e806-49d2-4b95-96fd-7e5ecd2a721f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.379379 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-48d8e806-49d2-4b95-96fd-7e5ecd2a721f tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1535 microversion: 2.1 time: 0.259346 Oct 04 18:08:26.380732 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 847/1735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1535 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:26.388957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-37e0cb1e-8e98-4473-814c-5016a695b6b5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:26.390030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-37e0cb1e-8e98-4473-814c-5016a695b6b5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:26.406118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37e0cb1e-8e98-4473-814c-5016a695b6b5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.407387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37e0cb1e-8e98-4473-814c-5016a695b6b5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.408156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37e0cb1e-8e98-4473-814c-5016a695b6b5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.409979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37e0cb1e-8e98-4473-814c-5016a695b6b5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.411363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37e0cb1e-8e98-4473-814c-5016a695b6b5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.412102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37e0cb1e-8e98-4473-814c-5016a695b6b5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.527758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:26.576853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-37e0cb1e-8e98-4473-814c-5016a695b6b5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.585002 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-37e0cb1e-8e98-4473-814c-5016a695b6b5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.202718 Oct 04 18:08:26.585480 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 848/1736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:26.597239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:26.598452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:26.605639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.606153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.606574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.607314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.608030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.608483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.621520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:26.825095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.842744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.853326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.855725 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1897e0b2-969d-4b8b-a122-ae0a1ea00bbb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1361 microversion: 2.25 time: 0.263718 Oct 04 18:08:26.858102 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 849/1737] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:26.863149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c6745e4a-e032-4bff-8195-efb8fd539a3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:26.863884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c6745e4a-e032-4bff-8195-efb8fd539a3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:26.873580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6745e4a-e032-4bff-8195-efb8fd539a3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.874516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6745e4a-e032-4bff-8195-efb8fd539a3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.875205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6745e4a-e032-4bff-8195-efb8fd539a3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.877021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6745e4a-e032-4bff-8195-efb8fd539a3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.878785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6745e4a-e032-4bff-8195-efb8fd539a3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.879541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6745e4a-e032-4bff-8195-efb8fd539a3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.987059 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c6745e4a-e032-4bff-8195-efb8fd539a3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d/action" status: 202 len: 0 microversion: 2.1 time: 0.127285 Oct 04 18:08:26.988255 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 850/1738] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:26 2022] POST /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:27.000950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d9d3aa96-2439-4373-a0b1-3af4b32a6b60 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.001782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d9d3aa96-2439-4373-a0b1-3af4b32a6b60 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.010628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9d3aa96-2439-4373-a0b1-3af4b32a6b60 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.011604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9d3aa96-2439-4373-a0b1-3af4b32a6b60 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.012240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9d3aa96-2439-4373-a0b1-3af4b32a6b60 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.013067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9d3aa96-2439-4373-a0b1-3af4b32a6b60 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.013530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9d3aa96-2439-4373-a0b1-3af4b32a6b60 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.014150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9d3aa96-2439-4373-a0b1-3af4b32a6b60 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.267114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d9d3aa96-2439-4373-a0b1-3af4b32a6b60 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.285419 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d9d3aa96-2439-4373-a0b1-3af4b32a6b60 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.294458 Oct 04 18:08:27.306632 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 851/1739] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:27.469392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b58d5b9e-1ea4-4045-ae3b-a20f185bc654 req-f2720acf-97b8-483b-a34f-358737ba839d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff727bae-d934-4636-869c-de1bb44b402a", "tag": "452af399-99d6-4771-8795-b48622fc34d3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:27.488279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b58d5b9e-1ea4-4045-ae3b-a20f185bc654 req-f2720acf-97b8-483b-a34f-358737ba839d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.489147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b58d5b9e-1ea4-4045-ae3b-a20f185bc654 req-f2720acf-97b8-483b-a34f-358737ba839d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.490487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b58d5b9e-1ea4-4045-ae3b-a20f185bc654 req-f2720acf-97b8-483b-a34f-358737ba839d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.509209 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b58d5b9e-1ea4-4045-ae3b-a20f185bc654 req-f2720acf-97b8-483b-a34f-358737ba839d service nova] Creating event network-changed:452af399-99d6-4771-8795-b48622fc34d3 for instance ff727bae-d934-4636-869c-de1bb44b402a on n-h1-850499-14 Oct 04 18:08:27.519112 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b58d5b9e-1ea4-4045-ae3b-a20f185bc654 req-f2720acf-97b8-483b-a34f-358737ba839d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204895 Oct 04 18:08:27.519974 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 852/1740] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:27.525989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.526990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.536071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.536585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.537228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.538128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.539419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.539869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.579797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.580781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.581503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.582468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lazy-loading 'fault' on Instance uuid e2acda7d-dc95-44ac-8ac8-62522ca02bd3 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:27.642290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.659905 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-927fe098-4930-408e-b113-61b2ced369e5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1308 microversion: 2.1 time: 0.138570 Oct 04 18:08:27.672877 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 853/1741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:27 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1308 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:27.678761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.679551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.685972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.686586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.687173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.688032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.688793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.689429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.783091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.793437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.795566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.802470 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d95ad884-a50e-4ecd-8508-78e24fa5ab66 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.128297 Oct 04 18:08:27.803191 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 854/1742] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:27 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:27.824593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6afa8cb1-a7f3-4bf7-9b56-2fbd83ad6d15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.825453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6afa8cb1-a7f3-4bf7-9b56-2fbd83ad6d15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.832827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afa8cb1-a7f3-4bf7-9b56-2fbd83ad6d15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.833412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afa8cb1-a7f3-4bf7-9b56-2fbd83ad6d15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.834131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afa8cb1-a7f3-4bf7-9b56-2fbd83ad6d15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.834916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afa8cb1-a7f3-4bf7-9b56-2fbd83ad6d15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.835623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afa8cb1-a7f3-4bf7-9b56-2fbd83ad6d15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.836112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afa8cb1-a7f3-4bf7-9b56-2fbd83ad6d15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.052018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6afa8cb1-a7f3-4bf7-9b56-2fbd83ad6d15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.062676 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6afa8cb1-a7f3-4bf7-9b56-2fbd83ad6d15 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 200 len: 1472 microversion: 2.1 time: 0.258077 Oct 04 18:08:28.079915 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 855/1743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:27 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:28.079915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6aefecff-ee98-4c8d-8dc1-8abf1b4bf9ec tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.079915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6aefecff-ee98-4c8d-8dc1-8abf1b4bf9ec tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.079915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aefecff-ee98-4c8d-8dc1-8abf1b4bf9ec tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.079915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aefecff-ee98-4c8d-8dc1-8abf1b4bf9ec tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.081066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aefecff-ee98-4c8d-8dc1-8abf1b4bf9ec tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.081066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aefecff-ee98-4c8d-8dc1-8abf1b4bf9ec tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.081066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aefecff-ee98-4c8d-8dc1-8abf1b4bf9ec tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.081066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aefecff-ee98-4c8d-8dc1-8abf1b4bf9ec tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.262662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6aefecff-ee98-4c8d-8dc1-8abf1b4bf9ec tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.272287 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6aefecff-ee98-4c8d-8dc1-8abf1b4bf9ec tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1535 microversion: 2.1 time: 0.207816 Oct 04 18:08:28.273222 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 856/1744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1535 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:28.278660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3563ce0d-47f1-4596-b4a6-078d9c5a9b65 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.279306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3563ce0d-47f1-4596-b4a6-078d9c5a9b65 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.286232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3563ce0d-47f1-4596-b4a6-078d9c5a9b65 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.286794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3563ce0d-47f1-4596-b4a6-078d9c5a9b65 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.287337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3563ce0d-47f1-4596-b4a6-078d9c5a9b65 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.288318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3563ce0d-47f1-4596-b4a6-078d9c5a9b65 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.288783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3563ce0d-47f1-4596-b4a6-078d9c5a9b65 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.289216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3563ce0d-47f1-4596-b4a6-078d9c5a9b65 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.510599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3563ce0d-47f1-4596-b4a6-078d9c5a9b65 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.524301 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3563ce0d-47f1-4596-b4a6-078d9c5a9b65 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.249903 Oct 04 18:08:28.525399 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 857/1745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:28.537927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.538555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.556037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.556742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.557278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.558027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.558495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.558928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.773364 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2e0536e0-fcfb-482c-9f10-27312fd8e690 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92/action" status: 202 len: 0 microversion: 2.1 time: 4.988610 Oct 04 18:08:28.778230 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 889/1746] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:23 2022] POST /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92/action => generated 0 bytes in 4997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:28.781007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-344c8af6-9811-4e9d-bd8c-52f2fe98149e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-434518733"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:28.784698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.787634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-344c8af6-9811-4e9d-bd8c-52f2fe98149e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.794644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c8af6-9811-4e9d-bd8c-52f2fe98149e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.794938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.795165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c8af6-9811-4e9d-bd8c-52f2fe98149e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.795627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c8af6-9811-4e9d-bd8c-52f2fe98149e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.796311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c8af6-9811-4e9d-bd8c-52f2fe98149e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.796557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.796767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c8af6-9811-4e9d-bd8c-52f2fe98149e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.797194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c8af6-9811-4e9d-bd8c-52f2fe98149e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.797737 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-77115f89-42ab-4640-a931-45400dbe29ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1557 microversion: 2.25 time: 0.271129 Oct 04 18:08:28.798320 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 858/1747] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1557 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:28.804882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3c17fa92-c271-4fdb-abfc-332170b62702 req-dfa13e97-8606-46ad-8725-e7e853c5d1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2acda7d-dc95-44ac-8ac8-62522ca02bd3", "name": "network-vif-deleted", "tag": "6cbd39c4-148c-498e-8e9f-3e4c7e392850"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:28.816194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3c17fa92-c271-4fdb-abfc-332170b62702 req-dfa13e97-8606-46ad-8725-e7e853c5d1ab service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.816932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3c17fa92-c271-4fdb-abfc-332170b62702 req-dfa13e97-8606-46ad-8725-e7e853c5d1ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.817574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3c17fa92-c271-4fdb-abfc-332170b62702 req-dfa13e97-8606-46ad-8725-e7e853c5d1ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.833412 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3c17fa92-c271-4fdb-abfc-332170b62702 req-dfa13e97-8606-46ad-8725-e7e853c5d1ab service nova] Creating event network-vif-deleted:6cbd39c4-148c-498e-8e9f-3e4c7e392850 for instance e2acda7d-dc95-44ac-8ac8-62522ca02bd3 on n-h2-850499-14 Oct 04 18:08:28.838440 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3c17fa92-c271-4fdb-abfc-332170b62702 req-dfa13e97-8606-46ad-8725-e7e853c5d1ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037484 Oct 04 18:08:28.838866 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 859/1748] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:28.847175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5db7eabd-a15a-4ebb-b8c4-4978c3aa3903 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.848078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5db7eabd-a15a-4ebb-b8c4-4978c3aa3903 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.872093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5db7eabd-a15a-4ebb-b8c4-4978c3aa3903 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.873209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5db7eabd-a15a-4ebb-b8c4-4978c3aa3903 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.874014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5db7eabd-a15a-4ebb-b8c4-4978c3aa3903 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.875124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5db7eabd-a15a-4ebb-b8c4-4978c3aa3903 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.875717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5db7eabd-a15a-4ebb-b8c4-4978c3aa3903 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.876264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5db7eabd-a15a-4ebb-b8c4-4978c3aa3903 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.091428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5db7eabd-a15a-4ebb-b8c4-4978c3aa3903 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.126499 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-344c8af6-9811-4e9d-bd8c-52f2fe98149e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d/action" status: 202 len: 0 microversion: 2.1 time: 0.350738 Oct 04 18:08:29.128654 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 890/1749] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:28 2022] POST /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:08:29.136913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.138021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.145651 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5db7eabd-a15a-4ebb-b8c4-4978c3aa3903 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.303976 Oct 04 18:08:29.147675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.148438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.149171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.150273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.151128 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 860/1750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:29.151687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.153745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.161863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-664fc834-da78-4574-996c-8e3c70e99c4a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.161863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-664fc834-da78-4574-996c-8e3c70e99c4a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.174888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-664fc834-da78-4574-996c-8e3c70e99c4a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.175745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-664fc834-da78-4574-996c-8e3c70e99c4a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.176748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-664fc834-da78-4574-996c-8e3c70e99c4a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.177853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-664fc834-da78-4574-996c-8e3c70e99c4a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.178891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-664fc834-da78-4574-996c-8e3c70e99c4a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.179643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-664fc834-da78-4574-996c-8e3c70e99c4a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.201788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.202560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.203195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.203824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lazy-loading 'fault' on Instance uuid e2acda7d-dc95-44ac-8ac8-62522ca02bd3 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:29.261521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.276829 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-11befbd9-7da1-4acb-a927-0daea46f4b71 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1308 microversion: 2.1 time: 0.143437 Oct 04 18:08:29.278800 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 891/1751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1308 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:29.285758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9c78c59-1292-4b11-9e2f-01ce4e2f2915 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.287877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9c78c59-1292-4b11-9e2f-01ce4e2f2915 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.297994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9c78c59-1292-4b11-9e2f-01ce4e2f2915 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.298854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9c78c59-1292-4b11-9e2f-01ce4e2f2915 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.299733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9c78c59-1292-4b11-9e2f-01ce4e2f2915 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.300693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9c78c59-1292-4b11-9e2f-01ce4e2f2915 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.301341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9c78c59-1292-4b11-9e2f-01ce4e2f2915 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.302276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9c78c59-1292-4b11-9e2f-01ce4e2f2915 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.520497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-664fc834-da78-4574-996c-8e3c70e99c4a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.530444 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-664fc834-da78-4574-996c-8e3c70e99c4a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.377631 Oct 04 18:08:29.531144 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 861/1752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:29.536951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.537808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.545650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.546458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.546926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.547804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.548422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.549329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.565399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-a9c78c59-1292-4b11-9e2f-01ce4e2f2915 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid f8d488d1-77e8-4d0e-9f33-0b675d54dc67 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:29.575246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:29.585210 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9c78c59-1292-4b11-9e2f-01ce4e2f2915 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 2051 microversion: 2.25 time: 0.304521 Oct 04 18:08:29.586377 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 892/1753] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 2051 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:29.591966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b053721-a0a5-4b32-995e-df11d52c187d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1cd94c0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.649497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.657587 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b053721-a0a5-4b32-995e-df11d52c187d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.069825 Oct 04 18:08:29.658354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.658607 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 893/1754] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:29.660156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.665537 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6bc0f649-91e2-4302-b26b-606c9b6f57cb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1531 microversion: 2.91 time: 0.133177 Oct 04 18:08:29.671120 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 862/1755] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1531 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:29.671294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.671294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.671687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8fdfa5f7-7b11-4ab1-bca3-cd545f8bcd5b req-557f7060-6ed7-471b-affa-71a88d1f6477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff727bae-d934-4636-869c-de1bb44b402a", "tag": "71b27edc-f099-4014-8ce8-dd6fbaece7d0"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:29.678147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:29.682275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8fdfa5f7-7b11-4ab1-bca3-cd545f8bcd5b req-557f7060-6ed7-471b-affa-71a88d1f6477 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.682844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8fdfa5f7-7b11-4ab1-bca3-cd545f8bcd5b req-557f7060-6ed7-471b-affa-71a88d1f6477 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.683437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8fdfa5f7-7b11-4ab1-bca3-cd545f8bcd5b req-557f7060-6ed7-471b-affa-71a88d1f6477 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.689820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.691556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.692451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.693331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.694865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.695386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.697329 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8fdfa5f7-7b11-4ab1-bca3-cd545f8bcd5b req-557f7060-6ed7-471b-affa-71a88d1f6477 service nova] Creating event network-changed:71b27edc-f099-4014-8ce8-dd6fbaece7d0 for instance ff727bae-d934-4636-869c-de1bb44b402a on n-h1-850499-14 Oct 04 18:08:29.699356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:29.702506 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8fdfa5f7-7b11-4ab1-bca3-cd545f8bcd5b req-557f7060-6ed7-471b-affa-71a88d1f6477 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034746 Oct 04 18:08:29.703122 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 863/1756] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:29.708749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-004e2af4-516f-41b5-a178-85c2f8b6d944 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.709455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-004e2af4-516f-41b5-a178-85c2f8b6d944 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.715849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-004e2af4-516f-41b5-a178-85c2f8b6d944 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.716366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-004e2af4-516f-41b5-a178-85c2f8b6d944 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.716776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-004e2af4-516f-41b5-a178-85c2f8b6d944 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.717481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-004e2af4-516f-41b5-a178-85c2f8b6d944 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.717937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-004e2af4-516f-41b5-a178-85c2f8b6d944 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.718358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-004e2af4-516f-41b5-a178-85c2f8b6d944 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.743215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.743747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.744227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.744856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lazy-loading 'fault' on Instance uuid f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:29.829369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.838103 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fcaa2fd0-3bc2-4d29-8381-e2db5dbe0f79 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 200 len: 1369 microversion: 2.1 time: 0.173808 Oct 04 18:08:29.838694 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 894/1757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 1369 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:29.843465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-26116120-14ec-4177-8d9b-bdc2c6f6f1b1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.844343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-26116120-14ec-4177-8d9b-bdc2c6f6f1b1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.852460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26116120-14ec-4177-8d9b-bdc2c6f6f1b1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.853113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26116120-14ec-4177-8d9b-bdc2c6f6f1b1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.853595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26116120-14ec-4177-8d9b-bdc2c6f6f1b1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.854277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26116120-14ec-4177-8d9b-bdc2c6f6f1b1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.854765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26116120-14ec-4177-8d9b-bdc2c6f6f1b1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.855324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26116120-14ec-4177-8d9b-bdc2c6f6f1b1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.956704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-004e2af4-516f-41b5-a178-85c2f8b6d944 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.965945 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-004e2af4-516f-41b5-a178-85c2f8b6d944 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.261348 Oct 04 18:08:29.966860 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 864/1758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:29.972305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-23d7b762-caa1-4ea5-b9e1-859549c15d15 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.972924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-23d7b762-caa1-4ea5-b9e1-859549c15d15 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.980223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d7b762-caa1-4ea5-b9e1-859549c15d15 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.980765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d7b762-caa1-4ea5-b9e1-859549c15d15 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.981312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d7b762-caa1-4ea5-b9e1-859549c15d15 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.982143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d7b762-caa1-4ea5-b9e1-859549c15d15 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.982711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d7b762-caa1-4ea5-b9e1-859549c15d15 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.983301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d7b762-caa1-4ea5-b9e1-859549c15d15 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.019508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-26116120-14ec-4177-8d9b-bdc2c6f6f1b1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid f8d488d1-77e8-4d0e-9f33-0b675d54dc67 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:30.033112 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-26116120-14ec-4177-8d9b-bdc2c6f6f1b1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 2051 microversion: 2.25 time: 0.193313 Oct 04 18:08:30.033740 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 895/1759] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 2051 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:30.061143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16ef76af-ee64-49f1-a491-b8718caa819f tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.066109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-23d7b762-caa1-4ea5-b9e1-859549c15d15 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lazy-loading 'services' on Instance uuid 11187b54-8f68-40db-b316-f1cfba27eb35 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:30.068358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ef76af-ee64-49f1-a491-b8718caa819f tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.069582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ef76af-ee64-49f1-a491-b8718caa819f tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.070754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ef76af-ee64-49f1-a491-b8718caa819f tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.071818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ef76af-ee64-49f1-a491-b8718caa819f tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.074195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ef76af-ee64-49f1-a491-b8718caa819f tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.074713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ef76af-ee64-49f1-a491-b8718caa819f tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.097252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-23d7b762-caa1-4ea5-b9e1-859549c15d15 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1938 microversion: 2.91 time: 0.128209 Oct 04 18:08:30.098789 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 865/1760] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1938 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:30.110271 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-16ef76af-ee64-49f1-a491-b8718caa819f tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.054602 Oct 04 18:08:30.112144 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 896/1761] 10.222.0.18 () {60 vars in 1217 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:08:30.125251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d4908ff0-c1bd-4816-a6e0-d63143a68ede tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:30.125947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d4908ff0-c1bd-4816-a6e0-d63143a68ede tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.130209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f2740e23-47a3-4076-97bf-2ddddf0e1822 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:30.131223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f2740e23-47a3-4076-97bf-2ddddf0e1822 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.135220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4908ff0-c1bd-4816-a6e0-d63143a68ede tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.135732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4908ff0-c1bd-4816-a6e0-d63143a68ede tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.136276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4908ff0-c1bd-4816-a6e0-d63143a68ede tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.137627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4908ff0-c1bd-4816-a6e0-d63143a68ede tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.138142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4908ff0-c1bd-4816-a6e0-d63143a68ede tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.138793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4908ff0-c1bd-4816-a6e0-d63143a68ede tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.138991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2740e23-47a3-4076-97bf-2ddddf0e1822 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.140197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2740e23-47a3-4076-97bf-2ddddf0e1822 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.141004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2740e23-47a3-4076-97bf-2ddddf0e1822 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.142300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2740e23-47a3-4076-97bf-2ddddf0e1822 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.143638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2740e23-47a3-4076-97bf-2ddddf0e1822 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.144620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2740e23-47a3-4076-97bf-2ddddf0e1822 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.179667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f2740e23-47a3-4076-97bf-2ddddf0e1822 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lazy-loading 'flavor' on Instance uuid 11187b54-8f68-40db-b316-f1cfba27eb35 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:30.232121 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d4908ff0-c1bd-4816-a6e0-d63143a68ede tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67/action" status: 202 len: 0 microversion: 2.25 time: 0.111383 Oct 04 18:08:30.232881 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 866/1762] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:08:30 2022] POST /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:08:30.244119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9440543f-7f9e-479c-a49b-44e561cb0dde tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.245677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9440543f-7f9e-479c-a49b-44e561cb0dde tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.255889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9440543f-7f9e-479c-a49b-44e561cb0dde tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.256430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9440543f-7f9e-479c-a49b-44e561cb0dde tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.256944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9440543f-7f9e-479c-a49b-44e561cb0dde tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.257705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9440543f-7f9e-479c-a49b-44e561cb0dde tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.258256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9440543f-7f9e-479c-a49b-44e561cb0dde tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.258684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9440543f-7f9e-479c-a49b-44e561cb0dde tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.411847 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f2740e23-47a3-4076-97bf-2ddddf0e1822 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "POST /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35/action" status: 202 len: 0 microversion: 2.91 time: 0.286267 Oct 04 18:08:30.412487 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 897/1763] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:08:30 2022] POST /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:08:30.418051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e7fe9451-c518-47ac-b498-668f495d5b7c tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.418753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e7fe9451-c518-47ac-b498-668f495d5b7c tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.421093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:30.427142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7fe9451-c518-47ac-b498-668f495d5b7c tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.427639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7fe9451-c518-47ac-b498-668f495d5b7c tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.428273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7fe9451-c518-47ac-b498-668f495d5b7c tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.429000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7fe9451-c518-47ac-b498-668f495d5b7c tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.429452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7fe9451-c518-47ac-b498-668f495d5b7c tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.429917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7fe9451-c518-47ac-b498-668f495d5b7c tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.444663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9440543f-7f9e-479c-a49b-44e561cb0dde tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.451538 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9440543f-7f9e-479c-a49b-44e561cb0dde tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.213813 Oct 04 18:08:30.457681 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 867/1764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:30.461643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.462327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.472099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.473015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.473506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.474289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.474928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.475430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.531173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.531892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.532217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.532866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lazy-loading 'fault' on Instance uuid e2acda7d-dc95-44ac-8ac8-62522ca02bd3 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:30.591437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.600297 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-495304e9-8722-40d3-98bf-ece7371900ce tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 200 len: 1308 microversion: 2.1 time: 0.146047 Oct 04 18:08:30.601492 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 868/1765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 1308 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:30.607955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.608657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.614383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-e7fe9451-c518-47ac-b498-668f495d5b7c tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid f8d488d1-77e8-4d0e-9f33-0b675d54dc67 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:30.616180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.616718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.617350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.618353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.618920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.619421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.630057 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e7fe9451-c518-47ac-b498-668f495d5b7c tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 2056 microversion: 2.25 time: 0.216147 Oct 04 18:08:30.630890 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 898/1766] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 2056 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:30.656164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ed9290f-a5a1-4145-8de1-91abbb8a3d1c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.656888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ed9290f-a5a1-4145-8de1-91abbb8a3d1c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.663351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ed9290f-a5a1-4145-8de1-91abbb8a3d1c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.663911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ed9290f-a5a1-4145-8de1-91abbb8a3d1c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.664367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ed9290f-a5a1-4145-8de1-91abbb8a3d1c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.665197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ed9290f-a5a1-4145-8de1-91abbb8a3d1c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.665657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ed9290f-a5a1-4145-8de1-91abbb8a3d1c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.666082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ed9290f-a5a1-4145-8de1-91abbb8a3d1c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.694600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.703559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.705999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.711958 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f0b97738-c068-4a00-9346-d7671803c686 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.109192 Oct 04 18:08:30.712628 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 869/1767] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:30.721021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-388d4bb5-4019-4b2a-932c-4ca4e2263ca4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1934a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.769304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-388d4bb5-4019-4b2a-932c-4ca4e2263ca4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.054828 Oct 04 18:08:30.769889 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 870/1768] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:30.811772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ed9290f-a5a1-4145-8de1-91abbb8a3d1c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.820156 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ed9290f-a5a1-4145-8de1-91abbb8a3d1c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.172137 Oct 04 18:08:30.820713 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 899/1769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:30.853639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-0cc36585-78ff-4a5b-b7de-b7fad162cd53 req-a820d7a4-b1c5-4028-9323-15ab3603abe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70", "name": "network-vif-deleted", "tag": "c24ea2e8-e606-476d-b4d4-83e53aad9183"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:30.861850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.862455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.864293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0cc36585-78ff-4a5b-b7de-b7fad162cd53 req-a820d7a4-b1c5-4028-9323-15ab3603abe1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.864787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0cc36585-78ff-4a5b-b7de-b7fad162cd53 req-a820d7a4-b1c5-4028-9323-15ab3603abe1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.865133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0cc36585-78ff-4a5b-b7de-b7fad162cd53 req-a820d7a4-b1c5-4028-9323-15ab3603abe1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.869312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.869804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.870251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.870986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.871454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.871883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.879016 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-0cc36585-78ff-4a5b-b7de-b7fad162cd53 req-a820d7a4-b1c5-4028-9323-15ab3603abe1 service nova] Creating event network-vif-deleted:c24ea2e8-e606-476d-b4d4-83e53aad9183 for instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 on n-h1-850499-14 Oct 04 18:08:30.885549 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-0cc36585-78ff-4a5b-b7de-b7fad162cd53 req-a820d7a4-b1c5-4028-9323-15ab3603abe1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035589 Oct 04 18:08:30.886460 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 871/1770] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:30.887131 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] HTTP exception thrown: Instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 could not be found. Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Request method failure captured: Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 HTTP/1.1 Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUf8dchgSXE9vgOCKScrTppBi--u612-BByNU9fbbDIdV6mYCvbC8pDs4Upd_xlWfPhtoT_d3CHoi8ga5ibSNJQ6MdCunmto3snMRshHd_F9d04JtgGK3fb8M_ApoEmEDf6jTP42CLTIGxaTqU6WxHAlmQIra5mzvHZ6lae0XEI6R4 Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 31d6eb30af1d4b6fa2955cb3cdeae3ee Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:08:30.888812 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}] Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 31d6eb30af1d4b6fa2955cb3cdeae3ee Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-MigrationsAdminTest-1880636506-project Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: d7458740d4be4cedaa01bea94ba992d2 Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-MigrationsAdminTest-1880636506-project Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 could not be found. Oct 04 18:08:30.890577 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70'} Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 could not be found. Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:30.892457 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 could not be found. Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 could not be found. Oct 04 18:08:30.894337 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:30.896115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Returning 404 to user: Instance f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:30.896115 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3af54792-fa81-444b-b9aa-5ebb8ba6db52 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70" status: 404 len: 111 microversion: 2.1 time: 0.032671 Oct 04 18:08:30.896115 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 900/1771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/servers/f2fc6cc4-d14f-4e18-b596-6ce1e2b10d70 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:08:30.899159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-22a593b4-e1b3-4cba-a4b1-9e6942d556dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '.version_select at 0x7fd4d1a33ca0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.925496 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-22a593b4-e1b3-4cba-a4b1-9e6942d556dc tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-430049581" status: 202 len: 0 microversion: 2.1 time: 0.030263 Oct 04 18:08:30.926497 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 872/1772] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 4 18:08:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-430049581 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:30.990035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-719e8c50-26de-4662-bb44-98eaba3c15e4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.990878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-719e8c50-26de-4662-bb44-98eaba3c15e4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.998411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-719e8c50-26de-4662-bb44-98eaba3c15e4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.999224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-719e8c50-26de-4662-bb44-98eaba3c15e4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.999671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-719e8c50-26de-4662-bb44-98eaba3c15e4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.000523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-719e8c50-26de-4662-bb44-98eaba3c15e4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.001143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-719e8c50-26de-4662-bb44-98eaba3c15e4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.001761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-719e8c50-26de-4662-bb44-98eaba3c15e4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.287670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-719e8c50-26de-4662-bb44-98eaba3c15e4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.297855 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-719e8c50-26de-4662-bb44-98eaba3c15e4 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.312641 Oct 04 18:08:31.299022 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 901/1773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:31.479189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d2fcc5f2-0287-48e2-a6ed-ac9a10f68c2e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.480702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d2fcc5f2-0287-48e2-a6ed-ac9a10f68c2e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.489033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2fcc5f2-0287-48e2-a6ed-ac9a10f68c2e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.489917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2fcc5f2-0287-48e2-a6ed-ac9a10f68c2e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.490545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2fcc5f2-0287-48e2-a6ed-ac9a10f68c2e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.491740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2fcc5f2-0287-48e2-a6ed-ac9a10f68c2e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.492408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2fcc5f2-0287-48e2-a6ed-ac9a10f68c2e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.493167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2fcc5f2-0287-48e2-a6ed-ac9a10f68c2e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.634324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.635523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: e2acda7d-dc95-44ac-8ac8-62522ca02bd3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.646003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.648315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.649161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.651881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.652945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.653814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.683203 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] HTTP exception thrown: Instance e2acda7d-dc95-44ac-8ac8-62522ca02bd3 could not be found. Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Request method failure captured: Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 HTTP/1.1 Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHWNqVOFMP0NeWXJsbEnF1JhAfTSK0AwPdpgB-Ig5t19dDXbrA5r_3Y7Sx0s8euhHWimqejsSGwg8YFEaU2SCaFMeZ3Z16WQ-_CFnaZyDhBFeA0ASGq4X21z9Zhrf2D1W3vHJZcaTRNpxEklRxHeeximYnoycEdrtYTGeWwuhvZDYI4 Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ae47a898442347e294b846831590285f Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesAdminNegativeTest-131952708 Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:08:31.686774 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae47a898442347e294b846831590285f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae47a898442347e294b846831590285f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae47a898442347e294b846831590285f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae47a898442347e294b846831590285f"}]}] Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesAdminNegativeTest-131952708 Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ae47a898442347e294b846831590285f Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-131952708 Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesAdminNegativeTest-131952708-project Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 46c8316f57dd4741af0df67f141f2205 Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesAdminNegativeTest-131952708-project Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance e2acda7d-dc95-44ac-8ac8-62522ca02bd3 could not be found. Oct 04 18:08:31.688852 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'e2acda7d-dc95-44ac-8ac8-62522ca02bd3'} Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2acda7d-dc95-44ac-8ac8-62522ca02bd3 could not be found. Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:31.691689 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2acda7d-dc95-44ac-8ac8-62522ca02bd3 could not be found. Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2acda7d-dc95-44ac-8ac8-62522ca02bd3 could not be found. Oct 04 18:08:31.693740 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:31.698294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Returning 404 to user: Instance e2acda7d-dc95-44ac-8ac8-62522ca02bd3 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:31.699979 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d8af0693-8370-42f2-9f4e-6c9bbb95b974 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3" status: 404 len: 111 microversion: 2.1 time: 0.076222 Oct 04 18:08:31.701168 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 902/1774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:31 2022] GET /compute/v2.1/servers/e2acda7d-dc95-44ac-8ac8-62522ca02bd3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:31.711261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-66ef5aa6-43b5-4223-8a0e-eebccde6ccee tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.712645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-66ef5aa6-43b5-4223-8a0e-eebccde6ccee tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.721611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66ef5aa6-43b5-4223-8a0e-eebccde6ccee tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.722445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66ef5aa6-43b5-4223-8a0e-eebccde6ccee tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.723124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66ef5aa6-43b5-4223-8a0e-eebccde6ccee tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.724149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66ef5aa6-43b5-4223-8a0e-eebccde6ccee tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.724806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66ef5aa6-43b5-4223-8a0e-eebccde6ccee tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.725454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66ef5aa6-43b5-4223-8a0e-eebccde6ccee tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.804695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d2fcc5f2-0287-48e2-a6ed-ac9a10f68c2e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.854160 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d2fcc5f2-0287-48e2-a6ed-ac9a10f68c2e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.362716 Oct 04 18:08:31.856803 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 873/1775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:31 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:31.872618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.873695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.896068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.906303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.907585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.910363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.913732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.914421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.051101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-66ef5aa6-43b5-4223-8a0e-eebccde6ccee tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid f8d488d1-77e8-4d0e-9f33-0b675d54dc67 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:32.082088 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-66ef5aa6-43b5-4223-8a0e-eebccde6ccee tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 2036 microversion: 2.25 time: 0.379138 Oct 04 18:08:32.094979 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 903/1776] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:31 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 2036 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:32.094979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-057076aa-b57f-4394-8e0d-f2ec72f39f9b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d621f670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.095299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.103806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.107392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.114171 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d395e6c4-88ae-4d68-b1a0-5938af3e93f6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.255968 Oct 04 18:08:32.127902 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 874/1777] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:31 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:32.139064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c8fd8f47-26ac-439c-8990-e3ecc621856e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.140400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c8fd8f47-26ac-439c-8990-e3ecc621856e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.154506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fd8f47-26ac-439c-8990-e3ecc621856e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.155510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fd8f47-26ac-439c-8990-e3ecc621856e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.156410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fd8f47-26ac-439c-8990-e3ecc621856e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.157570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fd8f47-26ac-439c-8990-e3ecc621856e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.159121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fd8f47-26ac-439c-8990-e3ecc621856e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.161732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fd8f47-26ac-439c-8990-e3ecc621856e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.176142 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-057076aa-b57f-4394-8e0d-f2ec72f39f9b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.089754 Oct 04 18:08:32.188177 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 904/1778] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:32.195093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-47a8797a-b44b-424b-866c-a17c63ea2100 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.195967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-47a8797a-b44b-424b-866c-a17c63ea2100 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.202500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a8797a-b44b-424b-866c-a17c63ea2100 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.203396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a8797a-b44b-424b-866c-a17c63ea2100 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.204119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a8797a-b44b-424b-866c-a17c63ea2100 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.205072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a8797a-b44b-424b-866c-a17c63ea2100 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.205822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a8797a-b44b-424b-866c-a17c63ea2100 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.206480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a8797a-b44b-424b-866c-a17c63ea2100 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.257592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-47a8797a-b44b-424b-866c-a17c63ea2100 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:32.374075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c8fd8f47-26ac-439c-8990-e3ecc621856e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.387991 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c8fd8f47-26ac-439c-8990-e3ecc621856e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.257707 Oct 04 18:08:32.389889 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 875/1779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:32.396275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850499-14", "block_migration": "auto"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:32.401031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.408973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.411265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.411961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.413022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.414045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.414727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.448462 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-47a8797a-b44b-424b-866c-a17c63ea2100 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 204 len: 0 microversion: 2.1 time: 0.257637 Oct 04 18:08:32.454638 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 905/1780] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:32 2022] DELETE /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:32.463150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9269de12-78ec-4ea2-b379-293ce2147a84 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.466437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9269de12-78ec-4ea2-b379-293ce2147a84 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.473503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9269de12-78ec-4ea2-b379-293ce2147a84 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.474398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9269de12-78ec-4ea2-b379-293ce2147a84 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.475154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9269de12-78ec-4ea2-b379-293ce2147a84 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.477201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9269de12-78ec-4ea2-b379-293ce2147a84 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.477936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9269de12-78ec-4ea2-b379-293ce2147a84 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.478648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9269de12-78ec-4ea2-b379-293ce2147a84 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.495860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'flavor' on Instance uuid f8d488d1-77e8-4d0e-9f33-0b675d54dc67 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:32.542055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Going to try to live migrate instance to n-h1-850499-14 {{(pid=122331) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:08:32.715722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9269de12-78ec-4ea2-b379-293ce2147a84 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.728621 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9269de12-78ec-4ea2-b379-293ce2147a84 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.275085 Oct 04 18:08:32.735673 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 906/1781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:32.761425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4a59aa5-c956-4e65-b6e8-0cfc3162bd6a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.763791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4a59aa5-c956-4e65-b6e8-0cfc3162bd6a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.774683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a59aa5-c956-4e65-b6e8-0cfc3162bd6a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.775711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a59aa5-c956-4e65-b6e8-0cfc3162bd6a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.776340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a59aa5-c956-4e65-b6e8-0cfc3162bd6a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.778174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a59aa5-c956-4e65-b6e8-0cfc3162bd6a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.779536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a59aa5-c956-4e65-b6e8-0cfc3162bd6a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.780173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a59aa5-c956-4e65-b6e8-0cfc3162bd6a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.968710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d4a59aa5-c956-4e65-b6e8-0cfc3162bd6a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.979414 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d4a59aa5-c956-4e65-b6e8-0cfc3162bd6a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1468 microversion: 2.1 time: 0.241447 Oct 04 18:08:32.980397 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 907/1782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:32.988728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d524b218-6ba9-4da2-9334-776c0eb28839 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.989444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d524b218-6ba9-4da2-9334-776c0eb28839 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.997710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d524b218-6ba9-4da2-9334-776c0eb28839 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.998639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d524b218-6ba9-4da2-9334-776c0eb28839 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.999245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d524b218-6ba9-4da2-9334-776c0eb28839 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.000286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d524b218-6ba9-4da2-9334-776c0eb28839 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.000969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d524b218-6ba9-4da2-9334-776c0eb28839 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.001612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d524b218-6ba9-4da2-9334-776c0eb28839 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.190235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d524b218-6ba9-4da2-9334-776c0eb28839 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.192654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:33.197018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:33.211718 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d524b218-6ba9-4da2-9334-776c0eb28839 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.229573 Oct 04 18:08:33.222989 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 908/1783] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:33.222989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:33.222989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:33.229086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.229086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.229454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.230241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.230744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.231234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.312024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.321963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.323476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.329264 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10e7ae04-5c84-465c-badb-c2da54c5cf41 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.115677 Oct 04 18:08:33.335065 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 909/1784] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:33 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:33.335065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-438fa168-e920-4cd8-a30e-1c1c39a8b382 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d6283e50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:33.381598 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-438fa168-e920-4cd8-a30e-1c1c39a8b382 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.050169 Oct 04 18:08:33.382186 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 910/1785] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:33 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:33.413785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5af0d61d-0429-47d3-9aaa-407218876f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:33.414418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5af0d61d-0429-47d3-9aaa-407218876f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:33.420944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5af0d61d-0429-47d3-9aaa-407218876f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.421444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5af0d61d-0429-47d3-9aaa-407218876f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.421892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5af0d61d-0429-47d3-9aaa-407218876f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.422610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5af0d61d-0429-47d3-9aaa-407218876f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.423102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5af0d61d-0429-47d3-9aaa-407218876f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.423537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5af0d61d-0429-47d3-9aaa-407218876f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.572085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5af0d61d-0429-47d3-9aaa-407218876f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.581247 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5af0d61d-0429-47d3-9aaa-407218876f7e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.171542 Oct 04 18:08:33.582357 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 911/1786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:33 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:33.756615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e2de7b29-ba08-4f46-943e-0e5f8fb3617c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:33.757395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e2de7b29-ba08-4f46-943e-0e5f8fb3617c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:33.764375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2de7b29-ba08-4f46-943e-0e5f8fb3617c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.765534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2de7b29-ba08-4f46-943e-0e5f8fb3617c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.765982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2de7b29-ba08-4f46-943e-0e5f8fb3617c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.767080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2de7b29-ba08-4f46-943e-0e5f8fb3617c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.767550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2de7b29-ba08-4f46-943e-0e5f8fb3617c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.768375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2de7b29-ba08-4f46-943e-0e5f8fb3617c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.930810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e2de7b29-ba08-4f46-943e-0e5f8fb3617c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.938691 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e2de7b29-ba08-4f46-943e-0e5f8fb3617c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.186872 Oct 04 18:08:33.951506 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 912/1787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:33 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:33.960918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b7dce001-bebc-4458-b174-46da0bfe0229 req-51c56ebf-3af6-47d3-947f-6fa722ee4856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d", "name": "network-vif-plugged", "status": "completed", "tag": "4fd0d5d2-3dd8-4446-b5b1-1caafbeb86b3"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:33.974324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b7dce001-bebc-4458-b174-46da0bfe0229 req-51c56ebf-3af6-47d3-947f-6fa722ee4856 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.975162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b7dce001-bebc-4458-b174-46da0bfe0229 req-51c56ebf-3af6-47d3-947f-6fa722ee4856 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.975895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b7dce001-bebc-4458-b174-46da0bfe0229 req-51c56ebf-3af6-47d3-947f-6fa722ee4856 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.990186 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b7dce001-bebc-4458-b174-46da0bfe0229 req-51c56ebf-3af6-47d3-947f-6fa722ee4856 service nova] Creating event network-vif-plugged:4fd0d5d2-3dd8-4446-b5b1-1caafbeb86b3 for instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d on n-h1-850499-14 Oct 04 18:08:33.996348 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b7dce001-bebc-4458-b174-46da0bfe0229 req-51c56ebf-3af6-47d3-947f-6fa722ee4856 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043146 Oct 04 18:08:33.997578 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 913/1788] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:34.018653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85d5276f-95a3-4122-8305-f17ef4792127 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.023738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-85d5276f-95a3-4122-8305-f17ef4792127 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:34.037142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85d5276f-95a3-4122-8305-f17ef4792127 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.041198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85d5276f-95a3-4122-8305-f17ef4792127 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.042026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85d5276f-95a3-4122-8305-f17ef4792127 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.043044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85d5276f-95a3-4122-8305-f17ef4792127 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.045062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85d5276f-95a3-4122-8305-f17ef4792127 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.046869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85d5276f-95a3-4122-8305-f17ef4792127 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.387107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-85d5276f-95a3-4122-8305-f17ef4792127 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.399923 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-85d5276f-95a3-4122-8305-f17ef4792127 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1468 microversion: 2.1 time: 0.389255 Oct 04 18:08:34.410992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 914/1789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1468 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:34.427020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-634e1707-d04c-4f19-a065-04f9f10096fd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.428812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-634e1707-d04c-4f19-a065-04f9f10096fd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:34.445609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634e1707-d04c-4f19-a065-04f9f10096fd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.446132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634e1707-d04c-4f19-a065-04f9f10096fd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.446583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634e1707-d04c-4f19-a065-04f9f10096fd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.447840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634e1707-d04c-4f19-a065-04f9f10096fd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.455594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634e1707-d04c-4f19-a065-04f9f10096fd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.456821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634e1707-d04c-4f19-a065-04f9f10096fd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.753052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-634e1707-d04c-4f19-a065-04f9f10096fd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.764512 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-634e1707-d04c-4f19-a065-04f9f10096fd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.361952 Oct 04 18:08:34.768209 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 915/1790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:34.776581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.777452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:34.784366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.785161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.786027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.787192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.787963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.788633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.880367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.896492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.922899 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12ebdb47-004d-4fdd-8134-cbfbbd40926a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67/action" status: 202 len: 0 microversion: 2.25 time: 2.530589 Oct 04 18:08:34.929770 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 876/1791] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:08:32 2022] POST /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67/action => generated 0 bytes in 2539 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:34.930086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.939301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a3cca527-ccd9-4174-8835-b591b2edb9b7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d195b280>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.954095 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-86c72abd-e91b-410f-a893-3f20dc12571a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.183188 Oct 04 18:08:34.965427 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 916/1792] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:34.979214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c7904599-9192-4968-9052-0ebcafe3af17 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.981944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c7904599-9192-4968-9052-0ebcafe3af17 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:35.005361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7904599-9192-4968-9052-0ebcafe3af17 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.007795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7904599-9192-4968-9052-0ebcafe3af17 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.008859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7904599-9192-4968-9052-0ebcafe3af17 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.010318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7904599-9192-4968-9052-0ebcafe3af17 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.011085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7904599-9192-4968-9052-0ebcafe3af17 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.011788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7904599-9192-4968-9052-0ebcafe3af17 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.069613 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a3cca527-ccd9-4174-8835-b591b2edb9b7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.138077 Oct 04 18:08:35.070679 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 877/1793] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:35.083604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.087357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:35.107771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.110087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.110935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.114784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.115650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.117201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.614432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7904599-9192-4968-9052-0ebcafe3af17 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.628045 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c7904599-9192-4968-9052-0ebcafe3af17 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.659779 Oct 04 18:08:35.630830 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 917/1794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:35.649938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-57089f62-6e3b-4a6a-bcf7-991a9750bad3 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.653821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57089f62-6e3b-4a6a-bcf7-991a9750bad3 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:35.679168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57089f62-6e3b-4a6a-bcf7-991a9750bad3 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.682186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57089f62-6e3b-4a6a-bcf7-991a9750bad3 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.684309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57089f62-6e3b-4a6a-bcf7-991a9750bad3 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.690494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57089f62-6e3b-4a6a-bcf7-991a9750bad3 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.691793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57089f62-6e3b-4a6a-bcf7-991a9750bad3 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.692236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57089f62-6e3b-4a6a-bcf7-991a9750bad3 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.765498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.781898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.790639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.796792 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-78be1919-092e-4ebd-8159-240582283c52 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.718724 Oct 04 18:08:35.797459 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 878/1795] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:35.840562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d9e652a-9f5e-4ded-8e49-c00572168420 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.841775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0d9e652a-9f5e-4ded-8e49-c00572168420 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:35.879471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9e652a-9f5e-4ded-8e49-c00572168420 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.882147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9e652a-9f5e-4ded-8e49-c00572168420 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.884687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9e652a-9f5e-4ded-8e49-c00572168420 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.886696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9e652a-9f5e-4ded-8e49-c00572168420 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.890307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9e652a-9f5e-4ded-8e49-c00572168420 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.890776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9e652a-9f5e-4ded-8e49-c00572168420 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.223066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0d9e652a-9f5e-4ded-8e49-c00572168420 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.228793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:36.258289 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0d9e652a-9f5e-4ded-8e49-c00572168420 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1297 microversion: 2.1 time: 0.435936 Oct 04 18:08:36.259009 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 879/1796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1297 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:36.290717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9c55718e-26b7-4daa-ab5d-dbc91830dd55 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.296463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9c55718e-26b7-4daa-ab5d-dbc91830dd55 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:36.297767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-57089f62-6e3b-4a6a-bcf7-991a9750bad3 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.311163 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-57089f62-6e3b-4a6a-bcf7-991a9750bad3 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.676976 Oct 04 18:08:36.327270 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 918/1797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:36.341124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c55718e-26b7-4daa-ab5d-dbc91830dd55 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.342930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-71d0ff3c-ca17-49db-9a2d-315aa00bfed4 req-7e1ebdd4-d153-411a-be03-a8a2048b8424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51903294-696f-4e13-adb2-d63862de1a52", "name": "network-vif-deleted", "tag": "ade6ab7a-2609-411b-8d9e-c2fe5c446530"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:36.345101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c55718e-26b7-4daa-ab5d-dbc91830dd55 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.346438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c55718e-26b7-4daa-ab5d-dbc91830dd55 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.356492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c55718e-26b7-4daa-ab5d-dbc91830dd55 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.357326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c55718e-26b7-4daa-ab5d-dbc91830dd55 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.362636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c55718e-26b7-4daa-ab5d-dbc91830dd55 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.389954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-71d0ff3c-ca17-49db-9a2d-315aa00bfed4 req-7e1ebdd4-d153-411a-be03-a8a2048b8424 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.390361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-71d0ff3c-ca17-49db-9a2d-315aa00bfed4 req-7e1ebdd4-d153-411a-be03-a8a2048b8424 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.390809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-71d0ff3c-ca17-49db-9a2d-315aa00bfed4 req-7e1ebdd4-d153-411a-be03-a8a2048b8424 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.459051 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-71d0ff3c-ca17-49db-9a2d-315aa00bfed4 req-7e1ebdd4-d153-411a-be03-a8a2048b8424 service nova] Creating event network-vif-deleted:ade6ab7a-2609-411b-8d9e-c2fe5c446530 for instance 51903294-696f-4e13-adb2-d63862de1a52 on n-h2-850499-14 Oct 04 18:08:36.468273 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-71d0ff3c-ca17-49db-9a2d-315aa00bfed4 req-7e1ebdd4-d153-411a-be03-a8a2048b8424 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138994 Oct 04 18:08:36.469905 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 919/1798] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:36.485768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.487142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:36.495242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.496052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.496510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.497319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.497797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.498227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.744648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.756017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.757466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.793471 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-12d7e7f1-14e2-4ba6-a483-21d069d6bf6b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.317043 Oct 04 18:08:36.796721 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 920/1799] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:36.817539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a3cf3e46-f0d0-4041-a7d6-0e3cf0593a16 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61f6940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.864968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9c55718e-26b7-4daa-ab5d-dbc91830dd55 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.879512 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9c55718e-26b7-4daa-ab5d-dbc91830dd55 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.608628 Oct 04 18:08:36.886933 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 880/1800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:36.901894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-84a5f126-76da-4311-8347-321104da9a65 req-af4cd6e2-bd9f-435b-93da-9c43fccff263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0d606d-f41f-40fa-80d3-32974fc534a5", "name": "network-vif-plugged", "status": "completed", "tag": "669b81d6-31f9-4ffe-93ee-6a4c042ad41c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:36.930330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-84a5f126-76da-4311-8347-321104da9a65 req-af4cd6e2-bd9f-435b-93da-9c43fccff263 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.931223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-84a5f126-76da-4311-8347-321104da9a65 req-af4cd6e2-bd9f-435b-93da-9c43fccff263 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.933267 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a3cf3e46-f0d0-4041-a7d6-0e3cf0593a16 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.135401 Oct 04 18:08:36.939222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-84a5f126-76da-4311-8347-321104da9a65 req-af4cd6e2-bd9f-435b-93da-9c43fccff263 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.949349 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 921/1801] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:36.956690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ced2385-4de5-4f2e-b37c-582c3aeab043 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.960928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ced2385-4de5-4f2e-b37c-582c3aeab043 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:36.969073 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-84a5f126-76da-4311-8347-321104da9a65 req-af4cd6e2-bd9f-435b-93da-9c43fccff263 service nova] Creating event network-vif-plugged:669b81d6-31f9-4ffe-93ee-6a4c042ad41c for instance af0d606d-f41f-40fa-80d3-32974fc534a5 on n-h2-850499-14 Oct 04 18:08:36.970157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ced2385-4de5-4f2e-b37c-582c3aeab043 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.981929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ced2385-4de5-4f2e-b37c-582c3aeab043 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.984294 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-84a5f126-76da-4311-8347-321104da9a65 req-af4cd6e2-bd9f-435b-93da-9c43fccff263 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093997 Oct 04 18:08:36.985357 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 881/1802] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:36.991909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ced2385-4de5-4f2e-b37c-582c3aeab043 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.993150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ced2385-4de5-4f2e-b37c-582c3aeab043 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.995786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ced2385-4de5-4f2e-b37c-582c3aeab043 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.996041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ced2385-4de5-4f2e-b37c-582c3aeab043 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.997408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.998160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:37.011700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.013186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.013985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.015419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.017081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.017766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.322893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ced2385-4de5-4f2e-b37c-582c3aeab043 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.336576 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ced2385-4de5-4f2e-b37c-582c3aeab043 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.383335 Oct 04 18:08:37.339265 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 922/1803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:37.359146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.360155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:37.376881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.383914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.384734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.385675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.386340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.389737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.411202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.427265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.430263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.431759 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e34840b1-8d2d-4fba-a711-936fa7772e7c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.444070 Oct 04 18:08:37.432904 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 882/1804] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:37.438935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-201363e7-60c7-4d52-ae61-2e1cd939b168 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.439900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-201363e7-60c7-4d52-ae61-2e1cd939b168 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:37.459568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201363e7-60c7-4d52-ae61-2e1cd939b168 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.472776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201363e7-60c7-4d52-ae61-2e1cd939b168 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.473944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201363e7-60c7-4d52-ae61-2e1cd939b168 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.476589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201363e7-60c7-4d52-ae61-2e1cd939b168 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.478126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201363e7-60c7-4d52-ae61-2e1cd939b168 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.478777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201363e7-60c7-4d52-ae61-2e1cd939b168 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.498460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.499293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.499912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.500550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lazy-loading 'fault' on Instance uuid 51903294-696f-4e13-adb2-d63862de1a52 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:37.569812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.586667 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a69c5226-bf3d-4677-80cb-98c42f407012 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 200 len: 1302 microversion: 2.1 time: 0.246075 Oct 04 18:08:37.600679 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 923/1805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 1302 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:37.625758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59ea5272-7958-44c4-86fd-e5afe847ca6d tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.631123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59ea5272-7958-44c4-86fd-e5afe847ca6d tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:37.651455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ea5272-7958-44c4-86fd-e5afe847ca6d tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.653130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ea5272-7958-44c4-86fd-e5afe847ca6d tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.654731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ea5272-7958-44c4-86fd-e5afe847ca6d tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.656436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ea5272-7958-44c4-86fd-e5afe847ca6d tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.659608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ea5272-7958-44c4-86fd-e5afe847ca6d tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.660411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ea5272-7958-44c4-86fd-e5afe847ca6d tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.749975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59ea5272-7958-44c4-86fd-e5afe847ca6d tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:37.816762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-201363e7-60c7-4d52-ae61-2e1cd939b168 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.826681 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-201363e7-60c7-4d52-ae61-2e1cd939b168 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.392449 Oct 04 18:08:37.837211 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 883/1806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:37.851774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.855046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:37.867672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.871072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.871687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.872624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.873216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.878653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.042123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.057211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.058819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.072248 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59ea5272-7958-44c4-86fd-e5afe847ca6d tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 204 len: 0 microversion: 2.1 time: 0.467917 Oct 04 18:08:38.077600 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 924/1807] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:37 2022] DELETE /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:38.082047 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-061f2e42-edc9-4f96-adff-d6201b061880 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.243471 Oct 04 18:08:38.086787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df8c2816-bfd2-4b47-8ffc-3334dc32d92e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.088404 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 884/1808] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:38.102841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-605df04a-7f30-4f00-8389-5e1b1f439360 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1a08a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.104060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-df8c2816-bfd2-4b47-8ffc-3334dc32d92e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:38.110621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df8c2816-bfd2-4b47-8ffc-3334dc32d92e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.112046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df8c2816-bfd2-4b47-8ffc-3334dc32d92e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.112734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df8c2816-bfd2-4b47-8ffc-3334dc32d92e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.113722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df8c2816-bfd2-4b47-8ffc-3334dc32d92e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.117231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df8c2816-bfd2-4b47-8ffc-3334dc32d92e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.117844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df8c2816-bfd2-4b47-8ffc-3334dc32d92e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.193782 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-605df04a-7f30-4f00-8389-5e1b1f439360 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.104250 Oct 04 18:08:38.194371 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 885/1809] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:38.222446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4bdb8f7c-6352-4e11-8caf-30f75410a967 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.227434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4bdb8f7c-6352-4e11-8caf-30f75410a967 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:38.243363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bdb8f7c-6352-4e11-8caf-30f75410a967 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.245592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bdb8f7c-6352-4e11-8caf-30f75410a967 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.246632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bdb8f7c-6352-4e11-8caf-30f75410a967 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.249132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bdb8f7c-6352-4e11-8caf-30f75410a967 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.249860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bdb8f7c-6352-4e11-8caf-30f75410a967 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.253692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bdb8f7c-6352-4e11-8caf-30f75410a967 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.663662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-df8c2816-bfd2-4b47-8ffc-3334dc32d92e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.676044 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-df8c2816-bfd2-4b47-8ffc-3334dc32d92e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.597039 Oct 04 18:08:38.677908 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 925/1810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:38.695145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6f1329ec-dcb3-40f8-9008-ed32eddd0271 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.696217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6f1329ec-dcb3-40f8-9008-ed32eddd0271 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:38.712508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f1329ec-dcb3-40f8-9008-ed32eddd0271 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.716002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f1329ec-dcb3-40f8-9008-ed32eddd0271 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.716734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f1329ec-dcb3-40f8-9008-ed32eddd0271 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.717799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f1329ec-dcb3-40f8-9008-ed32eddd0271 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.722256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f1329ec-dcb3-40f8-9008-ed32eddd0271 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.723234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f1329ec-dcb3-40f8-9008-ed32eddd0271 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.724114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4bdb8f7c-6352-4e11-8caf-30f75410a967 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.737426 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4bdb8f7c-6352-4e11-8caf-30f75410a967 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1681 microversion: 2.1 time: 0.518283 Oct 04 18:08:38.745560 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 886/1811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1681 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:38.751165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.751165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:38.765084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.765539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.765999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.770027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.770589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.774148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.101371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6f1329ec-dcb3-40f8-9008-ed32eddd0271 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.105743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:39.140375 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6f1329ec-dcb3-40f8-9008-ed32eddd0271 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.456364 Oct 04 18:08:39.143179 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 926/1812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:39.161746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5a15e489-12e3-4db7-933a-d572619c9ec9 req-5b10150d-2991-4452-9d3b-4bd6f67c8cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d488d1-77e8-4d0e-9f33-0b675d54dc67", "name": "network-vif-unplugged", "status": "completed", "tag": "151409ae-2c91-4671-9adf-e22cfaac01aa"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:39.191004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a15e489-12e3-4db7-933a-d572619c9ec9 req-5b10150d-2991-4452-9d3b-4bd6f67c8cd5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.192131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a15e489-12e3-4db7-933a-d572619c9ec9 req-5b10150d-2991-4452-9d3b-4bd6f67c8cd5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.193082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a15e489-12e3-4db7-933a-d572619c9ec9 req-5b10150d-2991-4452-9d3b-4bd6f67c8cd5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.219023 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5a15e489-12e3-4db7-933a-d572619c9ec9 req-5b10150d-2991-4452-9d3b-4bd6f67c8cd5 service nova] Creating event network-vif-unplugged:151409ae-2c91-4671-9adf-e22cfaac01aa for instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 on n-h2-850499-14 Oct 04 18:08:39.231368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.233156 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5a15e489-12e3-4db7-933a-d572619c9ec9 req-5b10150d-2991-4452-9d3b-4bd6f67c8cd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087294 Oct 04 18:08:39.240784 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 927/1813] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:39.249640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.251483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.253260 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-86acb129-c56c-4d7e-bfea-6011e09db835 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.514249 Oct 04 18:08:39.262171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.263303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 51903294-696f-4e13-adb2-d63862de1a52] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.271947 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 887/1814] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:39.279201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.283905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.284717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.285784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.290797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.291641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.297175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75f26351-e476-419e-bb9c-0e3fe4816fab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.297893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75f26351-e476-419e-bb9c-0e3fe4816fab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.323017 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] HTTP exception thrown: Instance 51903294-696f-4e13-adb2-d63862de1a52 could not be found. Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Request method failure captured: Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 HTTP/1.1 Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUf8dchgSXE9vgOCKScrTppBi--u612-BByNU9fbbDIdV6mYCvbC8pDs4Upd_xlWfPhtoT_d3CHoi8ga5ibSNJQ6MdCunmto3snMRshHd_F9d04JtgGK3fb8M_ApoEmEDf6jTP42CLTIGxaTqU6WxHAlmQIra5mzvHZ6lae0XEI6R4 Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 31d6eb30af1d4b6fa2955cb3cdeae3ee Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:08:39.325339 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}] Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 31d6eb30af1d4b6fa2955cb3cdeae3ee Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-MigrationsAdminTest-1880636506-project Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: d7458740d4be4cedaa01bea94ba992d2 Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-MigrationsAdminTest-1880636506-project Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 51903294-696f-4e13-adb2-d63862de1a52 could not be found. Oct 04 18:08:39.326934 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '51903294-696f-4e13-adb2-d63862de1a52'} Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51903294-696f-4e13-adb2-d63862de1a52 could not be found. Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:39.328016 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51903294-696f-4e13-adb2-d63862de1a52 could not be found. Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51903294-696f-4e13-adb2-d63862de1a52 could not be found. Oct 04 18:08:39.329807 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:39.332684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f26351-e476-419e-bb9c-0e3fe4816fab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.333069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f26351-e476-419e-bb9c-0e3fe4816fab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.333550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f26351-e476-419e-bb9c-0e3fe4816fab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.334619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f26351-e476-419e-bb9c-0e3fe4816fab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.334811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f26351-e476-419e-bb9c-0e3fe4816fab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.335248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f26351-e476-419e-bb9c-0e3fe4816fab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.335379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Returning 404 to user: Instance 51903294-696f-4e13-adb2-d63862de1a52 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:39.336498 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-03fa1b14-721c-43ad-a2e2-713d183f56eb tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52" status: 404 len: 111 microversion: 2.1 time: 0.090975 Oct 04 18:08:39.337604 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 928/1815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/servers/51903294-696f-4e13-adb2-d63862de1a52 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:39.347501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e876583f-31c3-4c47-a758-cfab603185a8 req-3b650dc1-9d72-422c-be38-673952b77b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff727bae-d934-4636-869c-de1bb44b402a", "name": "network-vif-plugged", "status": "completed", "tag": "452af399-99d6-4771-8795-b48622fc34d3"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:39.360406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e876583f-31c3-4c47-a758-cfab603185a8 req-3b650dc1-9d72-422c-be38-673952b77b83 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.361320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e876583f-31c3-4c47-a758-cfab603185a8 req-3b650dc1-9d72-422c-be38-673952b77b83 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.362199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e876583f-31c3-4c47-a758-cfab603185a8 req-3b650dc1-9d72-422c-be38-673952b77b83 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.384777 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e876583f-31c3-4c47-a758-cfab603185a8 req-3b650dc1-9d72-422c-be38-673952b77b83 service nova] Creating event network-vif-plugged:452af399-99d6-4771-8795-b48622fc34d3 for instance ff727bae-d934-4636-869c-de1bb44b402a on n-h1-850499-14 Oct 04 18:08:39.399717 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e876583f-31c3-4c47-a758-cfab603185a8 req-3b650dc1-9d72-422c-be38-673952b77b83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060077 Oct 04 18:08:39.400907 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 929/1816] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:39.406575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.407589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.423104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.424421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.425383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.426277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.426935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.427824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.594344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.630808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.636885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.649223 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-300cc0c1-6261-4c01-8c24-12b59d608e0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.246761 Oct 04 18:08:39.650675 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 930/1817] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:39.656803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d8eba212-ea15-469b-ae76-e93e0b8e7415 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61f2820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.734600 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d8eba212-ea15-469b-ae76-e93e0b8e7415 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.081787 Oct 04 18:08:39.735303 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 931/1818] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:39.751011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-545a549d-b512-44eb-a962-7de8e835d053 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.758715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-545a549d-b512-44eb-a962-7de8e835d053 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.775835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-545a549d-b512-44eb-a962-7de8e835d053 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.776387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-545a549d-b512-44eb-a962-7de8e835d053 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.776850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-545a549d-b512-44eb-a962-7de8e835d053 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.777611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-545a549d-b512-44eb-a962-7de8e835d053 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.781473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-545a549d-b512-44eb-a962-7de8e835d053 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.782381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-545a549d-b512-44eb-a962-7de8e835d053 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.802817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75f26351-e476-419e-bb9c-0e3fe4816fab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.819576 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75f26351-e476-419e-bb9c-0e3fe4816fab tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.546145 Oct 04 18:08:39.836460 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 888/1819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:39.847232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a67f56f-bd47-4e5e-86df-aea8fb8d2ab7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.848514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a67f56f-bd47-4e5e-86df-aea8fb8d2ab7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.854611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-545a549d-b512-44eb-a962-7de8e835d053 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:39.878547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a67f56f-bd47-4e5e-86df-aea8fb8d2ab7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.879477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a67f56f-bd47-4e5e-86df-aea8fb8d2ab7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.881306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a67f56f-bd47-4e5e-86df-aea8fb8d2ab7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.883276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a67f56f-bd47-4e5e-86df-aea8fb8d2ab7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.884473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a67f56f-bd47-4e5e-86df-aea8fb8d2ab7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.885671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a67f56f-bd47-4e5e-86df-aea8fb8d2ab7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.031210 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-545a549d-b512-44eb-a962-7de8e835d053 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 204 len: 0 microversion: 2.1 time: 0.294565 Oct 04 18:08:40.036343 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 932/1820] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:39 2022] DELETE /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:40.044272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02aec8e7-b232-406b-bc29-45123e8581b9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.045018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-02aec8e7-b232-406b-bc29-45123e8581b9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.054452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02aec8e7-b232-406b-bc29-45123e8581b9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.054871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02aec8e7-b232-406b-bc29-45123e8581b9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.055349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02aec8e7-b232-406b-bc29-45123e8581b9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.056086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02aec8e7-b232-406b-bc29-45123e8581b9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.056596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02aec8e7-b232-406b-bc29-45123e8581b9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.057036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02aec8e7-b232-406b-bc29-45123e8581b9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.081279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:40.233710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a67f56f-bd47-4e5e-86df-aea8fb8d2ab7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.246405 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a67f56f-bd47-4e5e-86df-aea8fb8d2ab7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1314 microversion: 2.1 time: 0.408532 Oct 04 18:08:40.247047 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 889/1821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:40.278600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-35202eb9-c142-40f6-b13f-cf4ed0f3eb81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.283929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-35202eb9-c142-40f6-b13f-cf4ed0f3eb81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.309469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35202eb9-c142-40f6-b13f-cf4ed0f3eb81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.310548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35202eb9-c142-40f6-b13f-cf4ed0f3eb81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.313205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35202eb9-c142-40f6-b13f-cf4ed0f3eb81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.314700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35202eb9-c142-40f6-b13f-cf4ed0f3eb81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.315528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35202eb9-c142-40f6-b13f-cf4ed0f3eb81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.316236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35202eb9-c142-40f6-b13f-cf4ed0f3eb81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.413976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-02aec8e7-b232-406b-bc29-45123e8581b9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.427641 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-02aec8e7-b232-406b-bc29-45123e8581b9 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1681 microversion: 2.1 time: 0.388350 Oct 04 18:08:40.428795 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 933/1822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:40 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1681 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:40.435756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-303b4ff0-8da4-4e8b-addc-3b09581c37dc tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.436433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-303b4ff0-8da4-4e8b-addc-3b09581c37dc tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.456391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303b4ff0-8da4-4e8b-addc-3b09581c37dc tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.458272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303b4ff0-8da4-4e8b-addc-3b09581c37dc tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.459874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303b4ff0-8da4-4e8b-addc-3b09581c37dc tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.463017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303b4ff0-8da4-4e8b-addc-3b09581c37dc tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.463549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303b4ff0-8da4-4e8b-addc-3b09581c37dc tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.466565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303b4ff0-8da4-4e8b-addc-3b09581c37dc tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.648807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-35202eb9-c142-40f6-b13f-cf4ed0f3eb81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.660359 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-35202eb9-c142-40f6-b13f-cf4ed0f3eb81 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1467 microversion: 2.1 time: 0.391088 Oct 04 18:08:40.661432 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 890/1823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:40 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1467 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:40.667140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.667769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.680708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.681276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.681732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.682462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.682932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.683769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.702874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-303b4ff0-8da4-4e8b-addc-3b09581c37dc tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.711718 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-303b4ff0-8da4-4e8b-addc-3b09581c37dc tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.281649 Oct 04 18:08:40.712497 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 934/1824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:40 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:40.727001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.729102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.738982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.739604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.740134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.740978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.741515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.742023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.841906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.860799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.863797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.881352 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-07286bd9-db4d-498b-9625-b13ffc846fc8 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.167936 Oct 04 18:08:40.882279 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 935/1825] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:40 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:40.902983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ee90eb8-0692-41ae-8ff0-a9e0ced3d993 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61f2ee0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.946009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.954628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.956199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.957401 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be20d568-affd-4a0a-aeda-c6c18e3093e6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.294998 Oct 04 18:08:40.957973 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 891/1826] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:40 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:40.974364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-569de97d-b7a5-4114-907f-7fff7a79c0a8 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.976233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-569de97d-b7a5-4114-907f-7fff7a79c0a8 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.987055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569de97d-b7a5-4114-907f-7fff7a79c0a8 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.987795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569de97d-b7a5-4114-907f-7fff7a79c0a8 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.988357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569de97d-b7a5-4114-907f-7fff7a79c0a8 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.989310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569de97d-b7a5-4114-907f-7fff7a79c0a8 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.989900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569de97d-b7a5-4114-907f-7fff7a79c0a8 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.990442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569de97d-b7a5-4114-907f-7fff7a79c0a8 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.997741 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6ee90eb8-0692-41ae-8ff0-a9e0ced3d993 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.114243 Oct 04 18:08:40.998564 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 936/1827] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:40 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:41.225526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-569de97d-b7a5-4114-907f-7fff7a79c0a8 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.242110 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-569de97d-b7a5-4114-907f-7fff7a79c0a8 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.279530 Oct 04 18:08:41.242767 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 892/1828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:40 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:41.257172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-27172d53-8ed2-4213-b7a8-ba13cfb35b27 req-a8443706-72bf-4e88-8287-fea3c89a3728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d488d1-77e8-4d0e-9f33-0b675d54dc67", "tag": "151409ae-2c91-4671-9adf-e22cfaac01aa"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:41.277472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36e471cc-6555-4881-bbc5-0b94c7b58279 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.278098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-36e471cc-6555-4881-bbc5-0b94c7b58279 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.289700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36e471cc-6555-4881-bbc5-0b94c7b58279 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.290284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36e471cc-6555-4881-bbc5-0b94c7b58279 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.290735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36e471cc-6555-4881-bbc5-0b94c7b58279 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.291373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-27172d53-8ed2-4213-b7a8-ba13cfb35b27 req-a8443706-72bf-4e88-8287-fea3c89a3728 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.291508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36e471cc-6555-4881-bbc5-0b94c7b58279 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.291925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-27172d53-8ed2-4213-b7a8-ba13cfb35b27 req-a8443706-72bf-4e88-8287-fea3c89a3728 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.292070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36e471cc-6555-4881-bbc5-0b94c7b58279 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.292372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-27172d53-8ed2-4213-b7a8-ba13cfb35b27 req-a8443706-72bf-4e88-8287-fea3c89a3728 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.292695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36e471cc-6555-4881-bbc5-0b94c7b58279 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.310814 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-27172d53-8ed2-4213-b7a8-ba13cfb35b27 req-a8443706-72bf-4e88-8287-fea3c89a3728 service nova] Creating event network-changed:151409ae-2c91-4671-9adf-e22cfaac01aa for instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 on n-h2-850499-14 Oct 04 18:08:41.321125 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-27172d53-8ed2-4213-b7a8-ba13cfb35b27 req-a8443706-72bf-4e88-8287-fea3c89a3728 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067776 Oct 04 18:08:41.322036 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 937/1829] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:41.438146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-2106adc2-f3cf-456f-9681-9c206def7d12 req-9e2288d0-e657-4802-b4e1-80957063b6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff727bae-d934-4636-869c-de1bb44b402a", "name": "network-vif-plugged", "status": "completed", "tag": "71b27edc-f099-4014-8ce8-dd6fbaece7d0"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:41.448805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:41.492296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2106adc2-f3cf-456f-9681-9c206def7d12 req-9e2288d0-e657-4802-b4e1-80957063b6ef service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.492810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2106adc2-f3cf-456f-9681-9c206def7d12 req-9e2288d0-e657-4802-b4e1-80957063b6ef service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.493239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2106adc2-f3cf-456f-9681-9c206def7d12 req-9e2288d0-e657-4802-b4e1-80957063b6ef service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.499211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-36e471cc-6555-4881-bbc5-0b94c7b58279 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.506989 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-2106adc2-f3cf-456f-9681-9c206def7d12 req-9e2288d0-e657-4802-b4e1-80957063b6ef service nova] Creating event network-vif-plugged:71b27edc-f099-4014-8ce8-dd6fbaece7d0 for instance ff727bae-d934-4636-869c-de1bb44b402a on n-h1-850499-14 Oct 04 18:08:41.515379 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-2106adc2-f3cf-456f-9681-9c206def7d12 req-9e2288d0-e657-4802-b4e1-80957063b6ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081540 Oct 04 18:08:41.518359 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 938/1830] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:41.519364 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-36e471cc-6555-4881-bbc5-0b94c7b58279 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1500 microversion: 2.1 time: 0.247844 Oct 04 18:08:41.521797 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 893/1831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1500 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:41.532823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1064117-1739-4184-9fe3-3dfd19b1e5bf tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.534235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1064117-1739-4184-9fe3-3dfd19b1e5bf tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.546234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1064117-1739-4184-9fe3-3dfd19b1e5bf tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.546735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1064117-1739-4184-9fe3-3dfd19b1e5bf tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.547285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1064117-1739-4184-9fe3-3dfd19b1e5bf tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.548100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1064117-1739-4184-9fe3-3dfd19b1e5bf tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.548653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1064117-1739-4184-9fe3-3dfd19b1e5bf tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.549322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1064117-1739-4184-9fe3-3dfd19b1e5bf tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.551511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c180c6b5-aab3-459f-9556-1fec2ffe22b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.552318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c180c6b5-aab3-459f-9556-1fec2ffe22b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.563872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c180c6b5-aab3-459f-9556-1fec2ffe22b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.564997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c180c6b5-aab3-459f-9556-1fec2ffe22b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.565510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c180c6b5-aab3-459f-9556-1fec2ffe22b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.566364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c180c6b5-aab3-459f-9556-1fec2ffe22b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.566896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c180c6b5-aab3-459f-9556-1fec2ffe22b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.567408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c180c6b5-aab3-459f-9556-1fec2ffe22b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.617335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c180c6b5-aab3-459f-9556-1fec2ffe22b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:41.769002 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c180c6b5-aab3-459f-9556-1fec2ffe22b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 204 len: 0 microversion: 2.1 time: 0.224990 Oct 04 18:08:41.770387 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 894/1832] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:41 2022] DELETE /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:41.781882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf1037c4-c30c-4ff9-97df-7f393756b8b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.784378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf1037c4-c30c-4ff9-97df-7f393756b8b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.797029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1037c4-c30c-4ff9-97df-7f393756b8b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.798101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1037c4-c30c-4ff9-97df-7f393756b8b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.799927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1037c4-c30c-4ff9-97df-7f393756b8b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.801714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1037c4-c30c-4ff9-97df-7f393756b8b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.803145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1037c4-c30c-4ff9-97df-7f393756b8b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.804329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf1037c4-c30c-4ff9-97df-7f393756b8b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.819223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1064117-1739-4184-9fe3-3dfd19b1e5bf tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.830912 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1064117-1739-4184-9fe3-3dfd19b1e5bf tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1681 microversion: 2.1 time: 0.309597 Oct 04 18:08:41.847035 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 939/1833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1681 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:41.851632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a303b7e7-238c-4a10-89ef-9c56dc07ac93 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.855653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a303b7e7-238c-4a10-89ef-9c56dc07ac93 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.868907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a303b7e7-238c-4a10-89ef-9c56dc07ac93 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.869416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a303b7e7-238c-4a10-89ef-9c56dc07ac93 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.869865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a303b7e7-238c-4a10-89ef-9c56dc07ac93 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.870597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a303b7e7-238c-4a10-89ef-9c56dc07ac93 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.879504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a303b7e7-238c-4a10-89ef-9c56dc07ac93 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.882602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a303b7e7-238c-4a10-89ef-9c56dc07ac93 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.155248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cf1037c4-c30c-4ff9-97df-7f393756b8b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.174406 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf1037c4-c30c-4ff9-97df-7f393756b8b3 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1467 microversion: 2.1 time: 0.402238 Oct 04 18:08:42.175292 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 895/1834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1467 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:42.186359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-049c85a9-451b-4ec3-bd7e-6da4a3de6907 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:42.187961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-049c85a9-451b-4ec3-bd7e-6da4a3de6907 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:42.197714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-049c85a9-451b-4ec3-bd7e-6da4a3de6907 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.198386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-049c85a9-451b-4ec3-bd7e-6da4a3de6907 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.198934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-049c85a9-451b-4ec3-bd7e-6da4a3de6907 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.199886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-049c85a9-451b-4ec3-bd7e-6da4a3de6907 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.200462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-049c85a9-451b-4ec3-bd7e-6da4a3de6907 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.201009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-049c85a9-451b-4ec3-bd7e-6da4a3de6907 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.213663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a303b7e7-238c-4a10-89ef-9c56dc07ac93 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.225519 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a303b7e7-238c-4a10-89ef-9c56dc07ac93 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.386972 Oct 04 18:08:42.228381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:42.240289 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 940/1835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:42.250001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:42.252314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:42.291195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.292288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.293046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.294325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.296338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.296827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.410940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.426625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.428447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.454981 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1e68a8f5-7dcc-4acc-88dc-a2e7284a8837 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.212403 Oct 04 18:08:42.468286 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 941/1836] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:42 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:42.483268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:42.483815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:42.493149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.494562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.494562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.496323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.496323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.496323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.530019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-049c85a9-451b-4ec3-bd7e-6da4a3de6907 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.540696 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-049c85a9-451b-4ec3-bd7e-6da4a3de6907 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1506 microversion: 2.1 time: 0.364228 Oct 04 18:08:42.554979 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 896/1837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:42 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:42.554979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a4a3582-2d19-4faa-82da-ca4af5052a88 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d197c820>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:42.607346 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a4a3582-2d19-4faa-82da-ca4af5052a88 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.064515 Oct 04 18:08:42.618720 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 897/1838] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:42 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:42.624098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c8169208-1a14-4c2c-a3cd-c9cb0b662253 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:42.624901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c8169208-1a14-4c2c-a3cd-c9cb0b662253 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:42.631765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8169208-1a14-4c2c-a3cd-c9cb0b662253 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.632399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8169208-1a14-4c2c-a3cd-c9cb0b662253 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.632941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8169208-1a14-4c2c-a3cd-c9cb0b662253 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.633884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8169208-1a14-4c2c-a3cd-c9cb0b662253 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.634452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8169208-1a14-4c2c-a3cd-c9cb0b662253 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.635008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8169208-1a14-4c2c-a3cd-c9cb0b662253 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.742589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.763021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.764677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.768203 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1f3cf2a-2900-4351-bf05-e2829a40dc66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.298271 Oct 04 18:08:42.784205 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 942/1839] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:42 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:42.852120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c8169208-1a14-4c2c-a3cd-c9cb0b662253 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.857640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8c552728-21d5-4071-97d8-bb2212b93e48 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:42.858719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8c552728-21d5-4071-97d8-bb2212b93e48 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:42.865908 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c8169208-1a14-4c2c-a3cd-c9cb0b662253 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1334 microversion: 2.1 time: 0.245931 Oct 04 18:08:42.866812 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 898/1840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:42 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1334 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:42.874359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c552728-21d5-4071-97d8-bb2212b93e48 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.875607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c552728-21d5-4071-97d8-bb2212b93e48 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.881101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c552728-21d5-4071-97d8-bb2212b93e48 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.882143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c552728-21d5-4071-97d8-bb2212b93e48 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.882729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c552728-21d5-4071-97d8-bb2212b93e48 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.883295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c552728-21d5-4071-97d8-bb2212b93e48 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.101875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8c552728-21d5-4071-97d8-bb2212b93e48 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.111310 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8c552728-21d5-4071-97d8-bb2212b93e48 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1681 microversion: 2.1 time: 0.257409 Oct 04 18:08:43.124089 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 943/1841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:42 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1681 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:43.199239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-156cce69-0bc5-48b4-bdc0-422563d052b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.201521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-156cce69-0bc5-48b4-bdc0-422563d052b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:43.210443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-156cce69-0bc5-48b4-bdc0-422563d052b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.211094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-156cce69-0bc5-48b4-bdc0-422563d052b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.211745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-156cce69-0bc5-48b4-bdc0-422563d052b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.217637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-156cce69-0bc5-48b4-bdc0-422563d052b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.218300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-156cce69-0bc5-48b4-bdc0-422563d052b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.218755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-156cce69-0bc5-48b4-bdc0-422563d052b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.258744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4cf4cf36-2200-493b-8b21-3f260ba307d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.261813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4cf4cf36-2200-493b-8b21-3f260ba307d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:43.270861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf4cf36-2200-493b-8b21-3f260ba307d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.271895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf4cf36-2200-493b-8b21-3f260ba307d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.273513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf4cf36-2200-493b-8b21-3f260ba307d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.274653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf4cf36-2200-493b-8b21-3f260ba307d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.275732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf4cf36-2200-493b-8b21-3f260ba307d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.276609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf4cf36-2200-493b-8b21-3f260ba307d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.575390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-156cce69-0bc5-48b4-bdc0-422563d052b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.589126 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-156cce69-0bc5-48b4-bdc0-422563d052b8 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1467 microversion: 2.1 time: 0.395029 Oct 04 18:08:43.605249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4cf4cf36-2200-493b-8b21-3f260ba307d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.606780 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 899/1842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1467 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:43.612044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.612924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:43.617990 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4cf4cf36-2200-493b-8b21-3f260ba307d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.370588 Oct 04 18:08:43.620448 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 944/1843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:43.623994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e071e5d8-b0d7-4652-87ac-03a5bbffc5c6 req-03575ca7-1ecc-4b84-a7e4-eed2f3624371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2505e8f7-6362-487e-9099-1dfe07254a31", "name": "network-vif-unplugged", "status": "completed", "tag": "c85dbcc1-f6de-40b4-b2fa-919f947c77f4"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:43.628036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.635376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e071e5d8-b0d7-4652-87ac-03a5bbffc5c6 req-03575ca7-1ecc-4b84-a7e4-eed2f3624371 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.635883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e071e5d8-b0d7-4652-87ac-03a5bbffc5c6 req-03575ca7-1ecc-4b84-a7e4-eed2f3624371 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.636332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e071e5d8-b0d7-4652-87ac-03a5bbffc5c6 req-03575ca7-1ecc-4b84-a7e4-eed2f3624371 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.641998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.646164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.647206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.650369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.652813 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e071e5d8-b0d7-4652-87ac-03a5bbffc5c6 req-03575ca7-1ecc-4b84-a7e4-eed2f3624371 service nova] Creating event network-vif-unplugged:c85dbcc1-f6de-40b4-b2fa-919f947c77f4 for instance 2505e8f7-6362-487e-9099-1dfe07254a31 on n-h2-850499-14 Oct 04 18:08:43.654010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.659073 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e071e5d8-b0d7-4652-87ac-03a5bbffc5c6 req-03575ca7-1ecc-4b84-a7e4-eed2f3624371 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038879 Oct 04 18:08:43.660015 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 945/1844] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:43.665238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6585ceed-67e7-4d64-b490-1f7b109cee57 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.665954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6585ceed-67e7-4d64-b490-1f7b109cee57 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:43.672934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6585ceed-67e7-4d64-b490-1f7b109cee57 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.673438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6585ceed-67e7-4d64-b490-1f7b109cee57 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.673918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6585ceed-67e7-4d64-b490-1f7b109cee57 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.674651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6585ceed-67e7-4d64-b490-1f7b109cee57 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.675281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6585ceed-67e7-4d64-b490-1f7b109cee57 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.675644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6585ceed-67e7-4d64-b490-1f7b109cee57 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.832750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.870305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.876048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.897220 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4bea653a-a513-4b76-8285-b7f06327a138 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.288793 Oct 04 18:08:43.903391 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 900/1845] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:43.908992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-11d27470-2dd7-4ebd-a9d9-3e2de041423e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1a0a430>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.986878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6585ceed-67e7-4d64-b490-1f7b109cee57 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.989469 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-11d27470-2dd7-4ebd-a9d9-3e2de041423e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.084744 Oct 04 18:08:43.990585 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 901/1846] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:43.996576 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6585ceed-67e7-4d64-b490-1f7b109cee57 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1506 microversion: 2.1 time: 0.335332 Oct 04 18:08:43.997194 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 946/1847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:44.001836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.002743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.018340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b0ea57ae-eccc-4e6f-85c7-84c315e7332b tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.019564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b0ea57ae-eccc-4e6f-85c7-84c315e7332b tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.021074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.021779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.022407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.023342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.023974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.024587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.026027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ea57ae-eccc-4e6f-85c7-84c315e7332b tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.026590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ea57ae-eccc-4e6f-85c7-84c315e7332b tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.027110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ea57ae-eccc-4e6f-85c7-84c315e7332b tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.027864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ea57ae-eccc-4e6f-85c7-84c315e7332b tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.028484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ea57ae-eccc-4e6f-85c7-84c315e7332b tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.031734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ea57ae-eccc-4e6f-85c7-84c315e7332b tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.333174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b0ea57ae-eccc-4e6f-85c7-84c315e7332b tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.336473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:44.344274 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b0ea57ae-eccc-4e6f-85c7-84c315e7332b tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1670 microversion: 2.1 time: 0.345612 Oct 04 18:08:44.354998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.364591 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 947/1848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1670 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:44.368289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.370251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.371599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-56c232e8-6666-4303-8550-464a9f174646 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.372547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-56c232e8-6666-4303-8550-464a9f174646 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.373853 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-771ff8e8-ba29-41eb-b14a-100c8872abf3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.375885 Oct 04 18:08:44.374475 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 902/1849] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:44.381898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c232e8-6666-4303-8550-464a9f174646 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.382826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c232e8-6666-4303-8550-464a9f174646 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.383562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c232e8-6666-4303-8550-464a9f174646 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.384548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c232e8-6666-4303-8550-464a9f174646 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.384951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c082e6cb-38e9-494b-aee1-6383cf374d7d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.385505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c232e8-6666-4303-8550-464a9f174646 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.385661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c082e6cb-38e9-494b-aee1-6383cf374d7d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.386370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c232e8-6666-4303-8550-464a9f174646 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.398633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c082e6cb-38e9-494b-aee1-6383cf374d7d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.399807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c082e6cb-38e9-494b-aee1-6383cf374d7d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.400261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c082e6cb-38e9-494b-aee1-6383cf374d7d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.401516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c082e6cb-38e9-494b-aee1-6383cf374d7d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.401989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c082e6cb-38e9-494b-aee1-6383cf374d7d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.402933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c082e6cb-38e9-494b-aee1-6383cf374d7d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.443069 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c082e6cb-38e9-494b-aee1-6383cf374d7d tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a/ips" status: 200 len: 180 microversion: 2.1 time: 0.067304 Oct 04 18:08:44.449894 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 903/1850] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a/ips => generated 180 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:44.458448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4330a07-da88-4131-9183-e654a090eb8c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.463603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4330a07-da88-4131-9183-e654a090eb8c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.484715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4330a07-da88-4131-9183-e654a090eb8c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.485231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4330a07-da88-4131-9183-e654a090eb8c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.485679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4330a07-da88-4131-9183-e654a090eb8c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.486927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4330a07-da88-4131-9183-e654a090eb8c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.486927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4330a07-da88-4131-9183-e654a090eb8c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.487524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4330a07-da88-4131-9183-e654a090eb8c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.536891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4330a07-da88-4131-9183-e654a090eb8c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:44.604393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-56c232e8-6666-4303-8550-464a9f174646 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.613748 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-56c232e8-6666-4303-8550-464a9f174646 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1681 microversion: 2.1 time: 0.247571 Oct 04 18:08:44.627869 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 948/1851] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:44.639811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9775ab38-faee-42cd-8b94-83a0d7ec8f1c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.640991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9775ab38-faee-42cd-8b94-83a0d7ec8f1c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.654182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:44.658668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9775ab38-faee-42cd-8b94-83a0d7ec8f1c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.659361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9775ab38-faee-42cd-8b94-83a0d7ec8f1c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.662468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9775ab38-faee-42cd-8b94-83a0d7ec8f1c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.663477 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c4330a07-da88-4131-9183-e654a090eb8c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 204 len: 0 microversion: 2.1 time: 0.208418 Oct 04 18:08:44.664540 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 904/1852] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:44 2022] DELETE /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:44.664955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9775ab38-faee-42cd-8b94-83a0d7ec8f1c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.665869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9775ab38-faee-42cd-8b94-83a0d7ec8f1c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.665869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9775ab38-faee-42cd-8b94-83a0d7ec8f1c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.676987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d37ccca-9cfb-4060-af7e-8b5f32137ee0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.678883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4d37ccca-9cfb-4060-af7e-8b5f32137ee0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.691200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d37ccca-9cfb-4060-af7e-8b5f32137ee0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.692093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d37ccca-9cfb-4060-af7e-8b5f32137ee0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.693440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d37ccca-9cfb-4060-af7e-8b5f32137ee0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.694938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d37ccca-9cfb-4060-af7e-8b5f32137ee0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.696108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d37ccca-9cfb-4060-af7e-8b5f32137ee0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.696880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d37ccca-9cfb-4060-af7e-8b5f32137ee0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.941903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4d37ccca-9cfb-4060-af7e-8b5f32137ee0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.953563 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4d37ccca-9cfb-4060-af7e-8b5f32137ee0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.285023 Oct 04 18:08:44.958888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9775ab38-faee-42cd-8b94-83a0d7ec8f1c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.963219 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 905/1853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:44.967513 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9775ab38-faee-42cd-8b94-83a0d7ec8f1c tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1467 microversion: 2.1 time: 0.337648 Oct 04 18:08:44.969172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f768909d-1e90-4906-8d69-5784c1c6b605 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.969906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f768909d-1e90-4906-8d69-5784c1c6b605 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.976582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f768909d-1e90-4906-8d69-5784c1c6b605 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.977229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f768909d-1e90-4906-8d69-5784c1c6b605 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.977783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f768909d-1e90-4906-8d69-5784c1c6b605 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.978620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f768909d-1e90-4906-8d69-5784c1c6b605 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.979261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f768909d-1e90-4906-8d69-5784c1c6b605 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.979798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f768909d-1e90-4906-8d69-5784c1c6b605 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.979929 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 949/1854] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1467 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:44.997510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.998052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:45.005144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.005660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.006631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.006826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.007333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.007763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.117016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.131786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.133730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.140278 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-454fd6f6-8546-4e88-b48c-ca50306ae7ef tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.151649 Oct 04 18:08:45.154992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 950/1855] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:45.154992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e3fb4657-400c-4383-ad75-c4a37fb41560 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d620dd30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.204749 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e3fb4657-400c-4383-ad75-c4a37fb41560 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.062371 Oct 04 18:08:45.213170 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 951/1856] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:45.213170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ba8525d-77f5-4d10-955e-38e733b0a340 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.213170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ba8525d-77f5-4d10-955e-38e733b0a340 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:45.221511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ba8525d-77f5-4d10-955e-38e733b0a340 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.222298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ba8525d-77f5-4d10-955e-38e733b0a340 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.223405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ba8525d-77f5-4d10-955e-38e733b0a340 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.224237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ba8525d-77f5-4d10-955e-38e733b0a340 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.224778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ba8525d-77f5-4d10-955e-38e733b0a340 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.225291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ba8525d-77f5-4d10-955e-38e733b0a340 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.238092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f768909d-1e90-4906-8d69-5784c1c6b605 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.253286 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f768909d-1e90-4906-8d69-5784c1c6b605 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1676 microversion: 2.1 time: 0.288741 Oct 04 18:08:45.254052 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 906/1857] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1676 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:45.412528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.422555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:45.445743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ba8525d-77f5-4d10-955e-38e733b0a340 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.457651 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ba8525d-77f5-4d10-955e-38e733b0a340 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1506 microversion: 2.1 time: 0.250782 Oct 04 18:08:45.458745 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 952/1858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:45.467135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.467647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.468087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.468806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.469270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.469761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.638328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e2a6e25a-1ba4-4067-aa23-beb742a218a5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.638905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e2a6e25a-1ba4-4067-aa23-beb742a218a5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:45.646905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a6e25a-1ba4-4067-aa23-beb742a218a5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.647586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a6e25a-1ba4-4067-aa23-beb742a218a5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.648046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a6e25a-1ba4-4067-aa23-beb742a218a5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.649200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a6e25a-1ba4-4067-aa23-beb742a218a5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.649722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a6e25a-1ba4-4067-aa23-beb742a218a5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.650159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a6e25a-1ba4-4067-aa23-beb742a218a5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.690288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.714309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.716771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.720371 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8d5abb2b-f41d-4d3c-9352-6abf67b82abb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.318470 Oct 04 18:08:45.723424 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 907/1859] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:45.855908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2d23e518-68de-41a4-b66c-040ded2aea8e req-386513a5-d228-44d4-be5e-0c4f1976cd21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4b0323-60bc-47aa-8c5e-142573d6c375", "name": "network-vif-deleted", "tag": "c0d7f40e-b90b-492b-bffc-13171692063a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:45.888082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2d23e518-68de-41a4-b66c-040ded2aea8e req-386513a5-d228-44d4-be5e-0c4f1976cd21 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.893088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2d23e518-68de-41a4-b66c-040ded2aea8e req-386513a5-d228-44d4-be5e-0c4f1976cd21 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.893623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2d23e518-68de-41a4-b66c-040ded2aea8e req-386513a5-d228-44d4-be5e-0c4f1976cd21 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.932889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e2a6e25a-1ba4-4067-aa23-beb742a218a5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.944416 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2d23e518-68de-41a4-b66c-040ded2aea8e req-386513a5-d228-44d4-be5e-0c4f1976cd21 service nova] Creating event network-vif-deleted:c0d7f40e-b90b-492b-bffc-13171692063a for instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 on n-h2-850499-14 Oct 04 18:08:45.950628 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2d23e518-68de-41a4-b66c-040ded2aea8e req-386513a5-d228-44d4-be5e-0c4f1976cd21 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099209 Oct 04 18:08:45.951800 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 908/1860] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:45.956740 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e2a6e25a-1ba4-4067-aa23-beb742a218a5 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1681 microversion: 2.1 time: 0.322668 Oct 04 18:08:45.957333 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 953/1861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1681 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:45.986301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a051f5b5-c8d8-4aa0-bbc1-8908dbcab16a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.987049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a051f5b5-c8d8-4aa0-bbc1-8908dbcab16a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:45.994465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.998448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.007254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a051f5b5-c8d8-4aa0-bbc1-8908dbcab16a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.007759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a051f5b5-c8d8-4aa0-bbc1-8908dbcab16a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.011750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a051f5b5-c8d8-4aa0-bbc1-8908dbcab16a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.014791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a051f5b5-c8d8-4aa0-bbc1-8908dbcab16a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.018177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a051f5b5-c8d8-4aa0-bbc1-8908dbcab16a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.018761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a051f5b5-c8d8-4aa0-bbc1-8908dbcab16a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.020263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.020786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.021229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.025379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.027294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.029328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.149973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.150726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.151474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.152137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lazy-loading 'fault' on Instance uuid 5a4b0323-60bc-47aa-8c5e-142573d6c375 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:46.809115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7458740d4be4cedaa01bea94ba992d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6eb30af1d4b6fa2955cb3cdeae3ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:46.825396 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-afa2e461-2e13-4e04-8d3a-a647da427e4a tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 200 len: 1303 microversion: 2.1 time: 0.835472 Oct 04 18:08:46.840084 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 954/1862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 1303 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:46.845109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.846564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.856500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.861589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.861589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.862523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.862867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.872834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.060704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.093550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.102164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.118226 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-476bf925-f8a4-4c69-81a2-cc92aa4e60c0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.276988 Oct 04 18:08:47.118829 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 955/1863] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:47.123505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d7e61e66-3434-4b47-86db-05b82b2254c0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61aed30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.185303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a051f5b5-c8d8-4aa0-bbc1-8908dbcab16a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.204121 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a051f5b5-c8d8-4aa0-bbc1-8908dbcab16a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 1.222441 Oct 04 18:08:47.207418 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 909/1864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:47.222378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b7952120-7ebd-4ecf-b65a-bfbc09d2461c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.223156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b7952120-7ebd-4ecf-b65a-bfbc09d2461c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:47.236603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7952120-7ebd-4ecf-b65a-bfbc09d2461c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.238024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7952120-7ebd-4ecf-b65a-bfbc09d2461c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.238726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7952120-7ebd-4ecf-b65a-bfbc09d2461c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.239915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7952120-7ebd-4ecf-b65a-bfbc09d2461c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.240804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7952120-7ebd-4ecf-b65a-bfbc09d2461c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.243636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7952120-7ebd-4ecf-b65a-bfbc09d2461c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.279969 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d7e61e66-3434-4b47-86db-05b82b2254c0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.159762 Oct 04 18:08:47.281631 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 956/1865] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:47.297002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.299348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:47.312546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.313450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.314288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.315564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.316423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.317212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.384258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.385203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.385924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.386666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'fault' on Instance uuid af0d606d-f41f-40fa-80d3-32974fc534a5 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:47.453948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.469017 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f2bd1393-97a6-4879-883a-7eaf9bbb813e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 200 len: 1304 microversion: 2.1 time: 0.186088 Oct 04 18:08:47.489928 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 957/1866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 1304 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:47.489928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.489928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:47.495673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.496386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.496940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.498072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.498757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.499309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.901760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.924381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.926414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.935154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b7952120-7ebd-4ecf-b65a-bfbc09d2461c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.940375 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ff237ac-40b2-46b1-82e9-c0ffaff784bc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.461147 Oct 04 18:08:47.948641 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 958/1867] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:47.956612 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b7952120-7ebd-4ecf-b65a-bfbc09d2461c tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1676 microversion: 2.1 time: 0.739140 Oct 04 18:08:47.960791 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 910/1868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1676 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:47.972313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.987881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:47.991630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.001048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] [instance: 5a4b0323-60bc-47aa-8c5e-142573d6c375] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.024606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.029982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.031361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.031489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.031886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.032650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.033192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.033633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.034252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.035893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.039179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.040068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.124962 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] HTTP exception thrown: Instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 could not be found. Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Request method failure captured: Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 HTTP/1.1 Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUf8dchgSXE9vgOCKScrTppBi--u612-BByNU9fbbDIdV6mYCvbC8pDs4Upd_xlWfPhtoT_d3CHoi8ga5ibSNJQ6MdCunmto3snMRshHd_F9d04JtgGK3fb8M_ApoEmEDf6jTP42CLTIGxaTqU6WxHAlmQIra5mzvHZ6lae0XEI6R4 Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 31d6eb30af1d4b6fa2955cb3cdeae3ee Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:08:48.129970 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31d6eb30af1d4b6fa2955cb3cdeae3ee"}]}] Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 31d6eb30af1d4b6fa2955cb3cdeae3ee Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-MigrationsAdminTest-1880636506 Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-MigrationsAdminTest-1880636506-project Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d7458740d4be4cedaa01bea94ba992d2 Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-MigrationsAdminTest-1880636506-project Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 could not be found. Oct 04 18:08:48.132579 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '5a4b0323-60bc-47aa-8c5e-142573d6c375'} Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 could not be found. Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:48.133542 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 could not be found. Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 could not be found. Oct 04 18:08:48.137597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.144170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] Returning 404 to user: Instance 5a4b0323-60bc-47aa-8c5e-142573d6c375 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:48.150273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.151963 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3c43b729-17ed-45cc-bee9-d9beab9c1444 tempest-MigrationsAdminTest-1880636506 tempest-MigrationsAdminTest-1880636506-project] 10.222.0.18 "GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375" status: 404 len: 111 microversion: 2.1 time: 0.177710 Oct 04 18:08:48.152881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.153350 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 911/1869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/servers/5a4b0323-60bc-47aa-8c5e-142573d6c375 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:48.153890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.155365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lazy-loading 'fault' on Instance uuid 2505e8f7-6362-487e-9099-1dfe07254a31 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:48.172602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.177656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.194092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.198416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.206490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.208383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.211284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.212319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.239227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c8316f57dd4741af0df67f141f2205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae47a898442347e294b846831590285f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.247540 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5b019396-a671-45a4-a90f-ecef1f2c4e74 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 200 len: 1332 microversion: 2.1 time: 0.297578 Oct 04 18:08:48.250824 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 959/1870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 1332 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:48.259155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7a8c278c-0e3a-42d9-a819-d90ce7b2b7c8 req-bd021ec7-b8bd-42d6-b043-cb04a87d00a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af0d606d-f41f-40fa-80d3-32974fc534a5", "name": "network-vif-deleted", "tag": "669b81d6-31f9-4ffe-93ee-6a4c042ad41c"}, {"server_uuid": "2505e8f7-6362-487e-9099-1dfe07254a31", "name": "network-vif-deleted", "tag": "c85dbcc1-f6de-40b4-b2fa-919f947c77f4"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:48.302791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7a8c278c-0e3a-42d9-a819-d90ce7b2b7c8 req-bd021ec7-b8bd-42d6-b043-cb04a87d00a1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.303324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7a8c278c-0e3a-42d9-a819-d90ce7b2b7c8 req-bd021ec7-b8bd-42d6-b043-cb04a87d00a1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.306068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7a8c278c-0e3a-42d9-a819-d90ce7b2b7c8 req-bd021ec7-b8bd-42d6-b043-cb04a87d00a1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.344016 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7a8c278c-0e3a-42d9-a819-d90ce7b2b7c8 req-bd021ec7-b8bd-42d6-b043-cb04a87d00a1 service nova] Creating event network-vif-deleted:669b81d6-31f9-4ffe-93ee-6a4c042ad41c for instance af0d606d-f41f-40fa-80d3-32974fc534a5 on n-h2-850499-14 Oct 04 18:08:48.345218 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7a8c278c-0e3a-42d9-a819-d90ce7b2b7c8 req-bd021ec7-b8bd-42d6-b043-cb04a87d00a1 service nova] Creating event network-vif-deleted:c85dbcc1-f6de-40b4-b2fa-919f947c77f4 for instance 2505e8f7-6362-487e-9099-1dfe07254a31 on n-h2-850499-14 Oct 04 18:08:48.360526 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7a8c278c-0e3a-42d9-a819-d90ce7b2b7c8 req-bd021ec7-b8bd-42d6-b043-cb04a87d00a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105263 Oct 04 18:08:48.361553 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 960/1871] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:48.363313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.367915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0fcb8739-4395-4380-b5f4-6dc4644076b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.369117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0fcb8739-4395-4380-b5f4-6dc4644076b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.380088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fcb8739-4395-4380-b5f4-6dc4644076b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.380944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fcb8739-4395-4380-b5f4-6dc4644076b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.381411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fcb8739-4395-4380-b5f4-6dc4644076b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.382178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fcb8739-4395-4380-b5f4-6dc4644076b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.382718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fcb8739-4395-4380-b5f4-6dc4644076b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.383594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fcb8739-4395-4380-b5f4-6dc4644076b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.407145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.410070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.428959 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6cf9d841-3aa9-4f17-a7ad-cbbf30c51b31 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.273887 Oct 04 18:08:48.485777 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 912/1872] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:48.503563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94338e6c-de80-4d8c-851a-21efd30f4fe2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1914f70>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.603008 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-94338e6c-de80-4d8c-851a-21efd30f4fe2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.112273 Oct 04 18:08:48.603866 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 913/1873] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:48.613095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.622019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.637044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.645701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.659111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.660524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.661240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.662177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.717486 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 HTTP/1.1 Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:08:48.721343 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:08:48.723013 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'af0d606d-f41f-40fa-80d3-32974fc534a5'} Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:48.723932 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:08:48.727744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:08:48.744164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:48.745689 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c7ae4a34-0074-4712-9604-6f3eb2d9e809 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 404 len: 111 microversion: 2.1 time: 0.139949 Oct 04 18:08:48.749050 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 914/1874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:48.835157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0fcb8739-4395-4380-b5f4-6dc4644076b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.848514 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0fcb8739-4395-4380-b5f4-6dc4644076b3 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.482524 Oct 04 18:08:48.851062 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 961/1875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:48.975162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.976055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.986712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49477988-0b81-4b01-8463-037bb04f3bc6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.987391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-49477988-0b81-4b01-8463-037bb04f3bc6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.994258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.996853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49477988-0b81-4b01-8463-037bb04f3bc6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.997369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49477988-0b81-4b01-8463-037bb04f3bc6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.002351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49477988-0b81-4b01-8463-037bb04f3bc6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.002615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.003283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49477988-0b81-4b01-8463-037bb04f3bc6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.003421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.003979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49477988-0b81-4b01-8463-037bb04f3bc6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.004487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49477988-0b81-4b01-8463-037bb04f3bc6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.005900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.008335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.010190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.413341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:49.428144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:49.430212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:49.436626 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1571a3a8-4c5e-427b-a126-a4612a55649d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.466306 Oct 04 18:08:49.438005 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 915/1876] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:49.446712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-49477988-0b81-4b01-8463-037bb04f3bc6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:49.476028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1217159157", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "3460d6d9-0801-4482-b14b-54fef623a1ce"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:49.483496 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49477988-0b81-4b01-8463-037bb04f3bc6 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1655 microversion: 2.1 time: 0.493671 Oct 04 18:08:49.488921 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 962/1877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1655 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:49.500666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:49.501296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] [instance: 2505e8f7-6362-487e-9099-1dfe07254a31] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:49.519536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.520106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.520560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.523440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.526378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.527736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.553700 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] HTTP exception thrown: Instance 2505e8f7-6362-487e-9099-1dfe07254a31 could not be found. Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Request method failure captured: Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 HTTP/1.1 Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHWNqVOFMP0NeWXJsbEnF1JhAfTSK0AwPdpgB-Ig5t19dDXbrA5r_3Y7Sx0s8euhHWimqejsSGwg8YFEaU2SCaFMeZ3Z16WQ-_CFnaZyDhBFeA0ASGq4X21z9Zhrf2D1W3vHJZcaTRNpxEklRxHeeximYnoycEdrtYTGeWwuhvZDYI4 Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ae47a898442347e294b846831590285f Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesAdminNegativeTest-131952708 Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:08:49.555466 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae47a898442347e294b846831590285f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae47a898442347e294b846831590285f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae47a898442347e294b846831590285f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae47a898442347e294b846831590285f"}]}] Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesAdminNegativeTest-131952708 Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ae47a898442347e294b846831590285f Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-131952708 Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesAdminNegativeTest-131952708-project Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 46c8316f57dd4741af0df67f141f2205 Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesAdminNegativeTest-131952708-project Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 2505e8f7-6362-487e-9099-1dfe07254a31 could not be found. Oct 04 18:08:49.557071 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '2505e8f7-6362-487e-9099-1dfe07254a31'} Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2505e8f7-6362-487e-9099-1dfe07254a31 could not be found. Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:49.558044 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2505e8f7-6362-487e-9099-1dfe07254a31 could not be found. Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2505e8f7-6362-487e-9099-1dfe07254a31 could not be found. Oct 04 18:08:49.561620 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:49.562941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Returning 404 to user: Instance 2505e8f7-6362-487e-9099-1dfe07254a31 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:49.562941 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ef3b01b8-ae63-4bff-a604-793f63f749fa tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31" status: 404 len: 111 microversion: 2.1 time: 0.066912 Oct 04 18:08:49.562941 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 963/1878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:49 2022] GET /compute/v2.1/servers/2505e8f7-6362-487e-9099-1dfe07254a31 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:49.565674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:49.566303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:49.572623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.573124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.573568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.574838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.575349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.575778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.603475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] validate_networks() for [('3460d6d9-0801-4482-b14b-54fef623a1ce', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:08:49.765473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:49.784803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:49.786344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:49.804555 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-978c3599-28af-4697-a42a-245ecf0133f4 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.242638 Oct 04 18:08:49.819016 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 964/1879] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:49 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:49.819016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-046a6581-88b7-4bd1-8f27-c8c4345bf2f7 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] Calling method '.version_select at 0x7fd4d620d670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:49.860756 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-046a6581-88b7-4bd1-8f27-c8c4345bf2f7 tempest-VolumesAdminNegativeTest-131952708 tempest-VolumesAdminNegativeTest-131952708-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387470139" status: 202 len: 0 microversion: 2.1 time: 0.051844 Oct 04 18:08:49.865656 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 965/1880] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387470139 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:49.871509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c451e91c-d09a-4984-8550-2960c65862d7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61cadc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:49.925401 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c451e91c-d09a-4984-8550-2960c65862d7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.058322 Oct 04 18:08:49.938455 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 966/1881] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:49 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:49.945850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6de41481-7821-441b-a60a-ee07a29f8b10 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:49.946726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6de41481-7821-441b-a60a-ee07a29f8b10 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:49.954909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6de41481-7821-441b-a60a-ee07a29f8b10 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.955724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6de41481-7821-441b-a60a-ee07a29f8b10 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.956341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6de41481-7821-441b-a60a-ee07a29f8b10 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.957244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6de41481-7821-441b-a60a-ee07a29f8b10 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.958024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6de41481-7821-441b-a60a-ee07a29f8b10 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.958646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6de41481-7821-441b-a60a-ee07a29f8b10 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.314557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6de41481-7821-441b-a60a-ee07a29f8b10 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.347083 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6de41481-7821-441b-a60a-ee07a29f8b10 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.404083 Oct 04 18:08:50.363046 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 967/1882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:49 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:50.468342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:50.469804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:50.491771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.492733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.495789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.497856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.501202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.502563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.628759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:08:50.629277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:08:50.630140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:08:50.630776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:08:50.631305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:08:50.651299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.661528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.662105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.663053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.663620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.664124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.712989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:50.721579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for user ba39a7cdf309477195a07acb5cdf24f4 and project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:50.738549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:08:50.741882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:08:50.823486 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8c8c73d5-622a-47be-b2b0-35054c0d44cb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380652 Oct 04 18:08:50.824636 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 916/1883] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:08:50.837935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee62a826-822c-45d0-b104-84914c01c412 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:50.839183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ee62a826-822c-45d0-b104-84914c01c412 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:50.847893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee62a826-822c-45d0-b104-84914c01c412 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.848486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee62a826-822c-45d0-b104-84914c01c412 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.849541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee62a826-822c-45d0-b104-84914c01c412 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.851553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee62a826-822c-45d0-b104-84914c01c412 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.852244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee62a826-822c-45d0-b104-84914c01c412 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.852701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee62a826-822c-45d0-b104-84914c01c412 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.897695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.900968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:50.918425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.920308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:50.925208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.927575 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-48f3a7de-aecc-4765-b997-f5aec7594394 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.463151 Oct 04 18:08:50.931327 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 968/1884] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:50 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:50.941401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:50.942475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:50.958938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.962618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.964485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.966738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.972497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.974849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.230478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee62a826-822c-45d0-b104-84914c01c412 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:51.250824 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ee62a826-822c-45d0-b104-84914c01c412 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1613 microversion: 2.1 time: 0.424773 Oct 04 18:08:51.263635 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 917/1885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:50 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1613 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:51.293148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-889bc53f-c3d1-4a25-92dc-b5f8ba88da1f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.302051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-889bc53f-c3d1-4a25-92dc-b5f8ba88da1f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:51.393777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:51.411705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:51.416509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:51.433838 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3317c3e3-f066-4587-82a9-de040d9cb7b0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.500793 Oct 04 18:08:51.438692 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 969/1886] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:50 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:51.457729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6503e053-8915-4ebd-8a7f-c43a45ba02d7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61a0160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.559032 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6503e053-8915-4ebd-8a7f-c43a45ba02d7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.118081 Oct 04 18:08:51.563494 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 970/1887] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:51 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:51.575156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1896be7b-1048-41dc-8dc0-74b7be092e09 req-407e7b63-4415-46d4-a16e-5989d33420ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff727bae-d934-4636-869c-de1bb44b402a", "name": "network-vif-deleted", "tag": "71b27edc-f099-4014-8ce8-dd6fbaece7d0"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:51.606605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-889bc53f-c3d1-4a25-92dc-b5f8ba88da1f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:51.621518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1896be7b-1048-41dc-8dc0-74b7be092e09 req-407e7b63-4415-46d4-a16e-5989d33420ac service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.622651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1896be7b-1048-41dc-8dc0-74b7be092e09 req-407e7b63-4415-46d4-a16e-5989d33420ac service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.623173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1896be7b-1048-41dc-8dc0-74b7be092e09 req-407e7b63-4415-46d4-a16e-5989d33420ac service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.627161 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-889bc53f-c3d1-4a25-92dc-b5f8ba88da1f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1215 microversion: 2.1 time: 0.359577 Oct 04 18:08:51.639342 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 918/1888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:51 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1215 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:51.640921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b0ff775b-91ed-4c8c-87bd-76008c85bae2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.641744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b0ff775b-91ed-4c8c-87bd-76008c85bae2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:51.661370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0ff775b-91ed-4c8c-87bd-76008c85bae2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.663433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0ff775b-91ed-4c8c-87bd-76008c85bae2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.665201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0ff775b-91ed-4c8c-87bd-76008c85bae2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.666619 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1896be7b-1048-41dc-8dc0-74b7be092e09 req-407e7b63-4415-46d4-a16e-5989d33420ac service nova] Creating event network-vif-deleted:71b27edc-f099-4014-8ce8-dd6fbaece7d0 for instance ff727bae-d934-4636-869c-de1bb44b402a on n-h1-850499-14 Oct 04 18:08:51.669575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0ff775b-91ed-4c8c-87bd-76008c85bae2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.674365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0ff775b-91ed-4c8c-87bd-76008c85bae2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.679508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0ff775b-91ed-4c8c-87bd-76008c85bae2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.700299 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1896be7b-1048-41dc-8dc0-74b7be092e09 req-407e7b63-4415-46d4-a16e-5989d33420ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133568 Oct 04 18:08:51.704541 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 971/1889] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:51.962227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.966381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:51.982859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.984040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.987417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.992434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.993439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.997326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.703974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0ff775b-91ed-4c8c-87bd-76008c85bae2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.721007 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b0ff775b-91ed-4c8c-87bd-76008c85bae2 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 1.090070 Oct 04 18:08:52.721975 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 919/1890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:51 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:52.734507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:52.735814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:52.750014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.750677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.751173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.752577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.756318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.756780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.839213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.839778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.840232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.840696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lazy-loading 'fault' on Instance uuid ff727bae-d934-4636-869c-de1bb44b402a {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:52.972656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.987302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.989246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.996599 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-370d016c-d352-4132-b5cb-9e59cce72105 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 1.040556 Oct 04 18:08:52.997870 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 972/1891] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:51 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:53.004420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:53.013254 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-79181528-4378-4cb0-b554-d76ed9aee883 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1303 microversion: 2.1 time: 0.290059 Oct 04 18:08:53.013829 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 920/1892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:52 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1303 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:53.014727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.015705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.023063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.024034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.024856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.025869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.037523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.038282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.043349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8c90917-8b27-44c2-b640-35299ef2b09c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d191cb80>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.174033 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e8c90917-8b27-44c2-b640-35299ef2b09c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.151661 Oct 04 18:08:53.177335 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 921/1893] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:53.193019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fc0826fd-481d-423c-a8ab-1437d2168520 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.195202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fc0826fd-481d-423c-a8ab-1437d2168520 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.207400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:53.215958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc0826fd-481d-423c-a8ab-1437d2168520 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.217307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc0826fd-481d-423c-a8ab-1437d2168520 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.218541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc0826fd-481d-423c-a8ab-1437d2168520 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.222602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc0826fd-481d-423c-a8ab-1437d2168520 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.224236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc0826fd-481d-423c-a8ab-1437d2168520 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.226975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:53.227645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc0826fd-481d-423c-a8ab-1437d2168520 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.235229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:53.253566 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ce85ba8-4af9-4979-befb-9c164d7520bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.254300 Oct 04 18:08:53.254979 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 973/1894] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:52 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:53.271926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5995eb2e-b53e-4694-a06e-195fff059607 req-6f8f61df-f620-465b-9c7d-1de08d8d2de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc93dc3-d2ac-4450-92fd-63bbedaf9b92", "name": "network-vif-unplugged", "status": "completed", "tag": "041c1840-6713-484f-9db9-ed4df1bc61a0"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:53.305986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5995eb2e-b53e-4694-a06e-195fff059607 req-6f8f61df-f620-465b-9c7d-1de08d8d2de9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.308903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5995eb2e-b53e-4694-a06e-195fff059607 req-6f8f61df-f620-465b-9c7d-1de08d8d2de9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.310488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5995eb2e-b53e-4694-a06e-195fff059607 req-6f8f61df-f620-465b-9c7d-1de08d8d2de9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.353891 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5995eb2e-b53e-4694-a06e-195fff059607 req-6f8f61df-f620-465b-9c7d-1de08d8d2de9 service nova] Creating event network-vif-unplugged:041c1840-6713-484f-9db9-ed4df1bc61a0 for instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 on n-h1-850499-14 Oct 04 18:08:53.372553 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5995eb2e-b53e-4694-a06e-195fff059607 req-6f8f61df-f620-465b-9c7d-1de08d8d2de9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114042 Oct 04 18:08:53.377127 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 974/1895] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:53.513562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fc0826fd-481d-423c-a8ab-1437d2168520 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:53.523954 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fc0826fd-481d-423c-a8ab-1437d2168520 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1267 microversion: 2.1 time: 0.342034 Oct 04 18:08:53.539013 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 922/1896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:53.748469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db1ff0ee-eb66-4265-9bc1-0fd6669fed2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.750125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-db1ff0ee-eb66-4265-9bc1-0fd6669fed2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.765017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1ff0ee-eb66-4265-9bc1-0fd6669fed2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.765869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1ff0ee-eb66-4265-9bc1-0fd6669fed2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.766541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1ff0ee-eb66-4265-9bc1-0fd6669fed2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.768468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1ff0ee-eb66-4265-9bc1-0fd6669fed2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.769186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1ff0ee-eb66-4265-9bc1-0fd6669fed2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.769532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d0e32ac3-d1f2-4b42-8ec0-b15095a685e9 req-cfd02ea3-59be-4ee3-aa8b-ec25dc1ca912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff727bae-d934-4636-869c-de1bb44b402a", "name": "network-vif-deleted", "tag": "452af399-99d6-4771-8795-b48622fc34d3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:53.770340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db1ff0ee-eb66-4265-9bc1-0fd6669fed2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.810081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d0e32ac3-d1f2-4b42-8ec0-b15095a685e9 req-cfd02ea3-59be-4ee3-aa8b-ec25dc1ca912 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.810602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d0e32ac3-d1f2-4b42-8ec0-b15095a685e9 req-cfd02ea3-59be-4ee3-aa8b-ec25dc1ca912 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.811080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d0e32ac3-d1f2-4b42-8ec0-b15095a685e9 req-cfd02ea3-59be-4ee3-aa8b-ec25dc1ca912 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.849047 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d0e32ac3-d1f2-4b42-8ec0-b15095a685e9 req-cfd02ea3-59be-4ee3-aa8b-ec25dc1ca912 service nova] Creating event network-vif-deleted:452af399-99d6-4771-8795-b48622fc34d3 for instance ff727bae-d934-4636-869c-de1bb44b402a on n-h1-850499-14 Oct 04 18:08:53.877265 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d0e32ac3-d1f2-4b42-8ec0-b15095a685e9 req-cfd02ea3-59be-4ee3-aa8b-ec25dc1ca912 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121138 Oct 04 18:08:53.878584 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 923/1897] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:54.034389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:54.035218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:54.050139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.050591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.051071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.051795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.061469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.062096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.502122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-db1ff0ee-eb66-4265-9bc1-0fd6669fed2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.551372 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-db1ff0ee-eb66-4265-9bc1-0fd6669fed2b tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.808549 Oct 04 18:08:54.641223 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 975/1898] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:54.691058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:54.695751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:54.748061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.752713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.759180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.764525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.770876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.776003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.928794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.952118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.953747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.956823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.960600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lazy-loading 'fault' on Instance uuid ff727bae-d934-4636-869c-de1bb44b402a {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:54.965641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.979890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.985565 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-55dbd6e3-7588-4f44-9f32-027ecebbd1ba tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1567 microversion: 2.25 time: 0.964174 Oct 04 18:08:54.991582 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 924/1899] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:54 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1567 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:55.008451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ffe6380-d61b-4fb0-9bb9-2eade87eebc9 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1956940>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:55.069309 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ffe6380-d61b-4fb0-9bb9-2eade87eebc9 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.075266 Oct 04 18:08:55.079156 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 925/1900] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:54 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:55.084656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:55.085555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:55.093791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.094591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.095775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.096717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.097950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.099604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.120917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29738c2533554939a890fad96acc1bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4839e26fbc244802b56f2b0289410041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.136144 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4cf2a39b-7e40-4cb4-8996-04fb1a3571c5 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 200 len: 1303 microversion: 2.1 time: 0.491459 Oct 04 18:08:55.159151 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 976/1901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:54 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 1303 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:55.170458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3b831b2b-d8e0-4f1c-b80d-4af6569ba0cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:55.172889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3b831b2b-d8e0-4f1c-b80d-4af6569ba0cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:55.182116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b831b2b-d8e0-4f1c-b80d-4af6569ba0cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.183100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b831b2b-d8e0-4f1c-b80d-4af6569ba0cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.186119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b831b2b-d8e0-4f1c-b80d-4af6569ba0cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.187775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b831b2b-d8e0-4f1c-b80d-4af6569ba0cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.188676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b831b2b-d8e0-4f1c-b80d-4af6569ba0cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.190103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b831b2b-d8e0-4f1c-b80d-4af6569ba0cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.262460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.288678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.301001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.304688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3b831b2b-d8e0-4f1c-b80d-4af6569ba0cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.307521 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c4e4d212-1517-47ea-8f54-2da5f2708990 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.226842 Oct 04 18:08:55.325134 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3b831b2b-d8e0-4f1c-b80d-4af6569ba0cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1273 microversion: 2.1 time: 0.152940 Oct 04 18:08:55.325134 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 977/1902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:55 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:55.336245 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 926/1903] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:55 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:55.401932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-4f96bfc1-393f-4098-acc3-0a9cb16f4227 req-a9729ab3-0227-485b-8fe8-9f6f84c90d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc93dc3-d2ac-4450-92fd-63bbedaf9b92", "tag": "041c1840-6713-484f-9db9-ed4df1bc61a0"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:55.423090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4f96bfc1-393f-4098-acc3-0a9cb16f4227 req-a9729ab3-0227-485b-8fe8-9f6f84c90d62 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.424118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4f96bfc1-393f-4098-acc3-0a9cb16f4227 req-a9729ab3-0227-485b-8fe8-9f6f84c90d62 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.424553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4f96bfc1-393f-4098-acc3-0a9cb16f4227 req-a9729ab3-0227-485b-8fe8-9f6f84c90d62 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.456512 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-4f96bfc1-393f-4098-acc3-0a9cb16f4227 req-a9729ab3-0227-485b-8fe8-9f6f84c90d62 service nova] Creating event network-changed:041c1840-6713-484f-9db9-ed4df1bc61a0 for instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 on n-h1-850499-14 Oct 04 18:08:55.483530 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-4f96bfc1-393f-4098-acc3-0a9cb16f4227 req-a9729ab3-0227-485b-8fe8-9f6f84c90d62 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085899 Oct 04 18:08:55.488865 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 978/1904] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:55.625617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-daf348e6-aa8f-44c0-a56f-a33b97b9b25a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:55.635516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-daf348e6-aa8f-44c0-a56f-a33b97b9b25a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:55.644664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daf348e6-aa8f-44c0-a56f-a33b97b9b25a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.646109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daf348e6-aa8f-44c0-a56f-a33b97b9b25a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.646973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daf348e6-aa8f-44c0-a56f-a33b97b9b25a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.647962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daf348e6-aa8f-44c0-a56f-a33b97b9b25a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.648652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daf348e6-aa8f-44c0-a56f-a33b97b9b25a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.649308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daf348e6-aa8f-44c0-a56f-a33b97b9b25a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.925192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-daf348e6-aa8f-44c0-a56f-a33b97b9b25a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.934975 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-daf348e6-aa8f-44c0-a56f-a33b97b9b25a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.313665 Oct 04 18:08:55.949370 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 927/1905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:55 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:55.958159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ebff177d-b578-4a03-8b81-230190c8b7ed tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d61ce4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:56.020310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:56.021135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:56.030179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.031610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.033442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.034461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.035281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.038179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.062163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebff177d-b578-4a03-8b81-230190c8b7ed tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.063484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebff177d-b578-4a03-8b81-230190c8b7ed tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.064122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebff177d-b578-4a03-8b81-230190c8b7ed tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.065000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebff177d-b578-4a03-8b81-230190c8b7ed tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.065578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebff177d-b578-4a03-8b81-230190c8b7ed tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.067202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebff177d-b578-4a03-8b81-230190c8b7ed tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.097125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:56.155210 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ebff177d-b578-4a03-8b81-230190c8b7ed tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/36b91e89820c42bea49140e60415747f" status: 200 len: 240 microversion: 2.36 time: 0.457960 Oct 04 18:08:56.165423 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 979/1906] 10.222.0.18 () {62 vars in 1303 bytes} [Tue Oct 4 18:08:55 2022] PUT /compute/v2.1/os-quota-sets/36b91e89820c42bea49140e60415747f => generated 240 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:08:56.172836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a43bc41f-e7f8-4e79-bb21-d6079cd875b1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61a0280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:56.246561 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a43bc41f-e7f8-4e79-bb21-d6079cd875b1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1411 microversion: 2.1 time: 0.079449 Oct 04 18:08:56.247575 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 980/1907] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:56 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:56.256260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:56.260734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:56.283220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.283900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.285996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.290346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.291278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.291884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.332568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:56.350999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:56.352682 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] HTTP exception thrown: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:08:56.353259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:56.354476 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-acdab162-7809-4421-9cb6-c2ed35e1b2f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1542 microversion: 2.25 time: 0.339805 Oct 04 18:08:56.355086 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 928/1908] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:56 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1542 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:56.382483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a8b7f0fa-89ce-42c6-ba81-8d27b06bec15 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Calling method '.version_select at 0x7fd4d191a040>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Request method failure captured: Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a HTTP/1.1 Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHYug7p1cF12x0psu1bKgbc58bKhE_ihtRs56f_9Ez7TrOojI1b3S0PDL04HkWJSvPNmTfCvL-0RLsp5YzuuFj6ELNYh4NOyhQWWhIwCPn5KEr1ovnpl0i_jnxQgvJkCkYUol_6LCKoxRnxXokOU8ziRLGEXt6dMMRu4y64eg6Hq66A Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:08:56.386483 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4839e26fbc244802b56f2b0289410041"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4839e26fbc244802b56f2b0289410041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}] Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersTestMultiNic-1386020474 Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 29738c2533554939a890fad96acc1bef Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:08:56.388304 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ff727bae-d934-4636-869c-de1bb44b402a'} Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:56.389392 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:08:56.391028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.392477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Returning 404 to user: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:56.392477 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0df3505a-ddd7-4cef-a7df-6277fa89ebff tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 404 len: 111 microversion: 2.1 time: 0.140842 Oct 04 18:08:56.398559 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 981/1909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:56 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:56.424341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d7e2bc08-4430-41c1-b9b5-0200fd5f98cc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:56.425005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d7e2bc08-4430-41c1-b9b5-0200fd5f98cc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:56.450454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7e2bc08-4430-41c1-b9b5-0200fd5f98cc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.451620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7e2bc08-4430-41c1-b9b5-0200fd5f98cc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.453211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7e2bc08-4430-41c1-b9b5-0200fd5f98cc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.454128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7e2bc08-4430-41c1-b9b5-0200fd5f98cc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.460969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7e2bc08-4430-41c1-b9b5-0200fd5f98cc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.461677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7e2bc08-4430-41c1-b9b5-0200fd5f98cc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.583918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b7f0fa-89ce-42c6-ba81-8d27b06bec15 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.584647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b7f0fa-89ce-42c6-ba81-8d27b06bec15 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.585378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b7f0fa-89ce-42c6-ba81-8d27b06bec15 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.586378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b7f0fa-89ce-42c6-ba81-8d27b06bec15 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.587044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b7f0fa-89ce-42c6-ba81-8d27b06bec15 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.588193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b7f0fa-89ce-42c6-ba81-8d27b06bec15 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.622558 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a8b7f0fa-89ce-42c6-ba81-8d27b06bec15 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/36b91e89820c42bea49140e60415747f/detail" status: 200 len: 672 microversion: 2.36 time: 0.251217 Oct 04 18:08:56.624691 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 929/1910] 10.222.0.18 () {60 vars in 1304 bytes} [Tue Oct 4 18:08:56 2022] GET /compute/v2.1/os-quota-sets/36b91e89820c42bea49140e60415747f/detail => generated 672 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:08:56.651558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:56.654042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:56.664551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.665350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.666294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.667487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.668127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.668727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.961546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:56.983552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:56.991868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.001627 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-32700cde-d7a9-478e-82a2-6feac52ff255 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.373506 Oct 04 18:08:57.002379 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 930/1911] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:56 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:57.015169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-43621258-98d0-43c4-a64e-968f4af30f90 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '.version_select at 0x7fd4d191a670>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.033971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43621258-98d0-43c4-a64e-968f4af30f90 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.040472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43621258-98d0-43c4-a64e-968f4af30f90 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.041497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43621258-98d0-43c4-a64e-968f4af30f90 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.069022 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-43621258-98d0-43c4-a64e-968f4af30f90 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 3051 microversion: 2.25 time: 0.064234 Oct 04 18:08:57.070427 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 931/1912] 10.222.0.18 () {60 vars in 1184 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/os-migrations => generated 3051 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:57.086798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8ad82a66-df59-44c4-b670-27622dd7393d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.089379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8ad82a66-df59-44c4-b670-27622dd7393d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.095933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad82a66-df59-44c4-b670-27622dd7393d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.096812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad82a66-df59-44c4-b670-27622dd7393d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.097516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad82a66-df59-44c4-b670-27622dd7393d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.098599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad82a66-df59-44c4-b670-27622dd7393d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.099367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad82a66-df59-44c4-b670-27622dd7393d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.100041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ad82a66-df59-44c4-b670-27622dd7393d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.178118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d7e2bc08-4430-41c1-b9b5-0200fd5f98cc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.198684 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d7e2bc08-4430-41c1-b9b5-0200fd5f98cc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1315 microversion: 2.1 time: 0.785440 Oct 04 18:08:57.199824 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 982/1913] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:56 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:57.205292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d61cf0d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:57.318772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.321286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.322243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.324294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.325548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.327468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.384768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.389076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8ad82a66-df59-44c4-b670-27622dd7393d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.393620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.398639 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8ad82a66-df59-44c4-b670-27622dd7393d tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.326965 Oct 04 18:08:57.399491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.400479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.401222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.415766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.415877 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 932/1914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:57.422168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d998d7df-8483-40aa-9c45-3be56ed467de tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.423834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d998d7df-8483-40aa-9c45-3be56ed467de tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.434352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d998d7df-8483-40aa-9c45-3be56ed467de tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.436494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d998d7df-8483-40aa-9c45-3be56ed467de tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.437454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d998d7df-8483-40aa-9c45-3be56ed467de tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.439487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d998d7df-8483-40aa-9c45-3be56ed467de tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.441042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d998d7df-8483-40aa-9c45-3be56ed467de tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.442940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d998d7df-8483-40aa-9c45-3be56ed467de tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.571431 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80ede159-e2b0-4a4f-8794-c54f985e57c7 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/36b91e89820c42bea49140e60415747f?user_id=57c1fc2009c74a8f805c01f1ed243515" status: 200 len: 240 microversion: 2.36 time: 0.369381 Oct 04 18:08:57.584906 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 983/1915] 10.222.0.18 () {62 vars in 1384 bytes} [Tue Oct 4 18:08:57 2022] PUT /compute/v2.1/os-quota-sets/36b91e89820c42bea49140e60415747f?user_id=57c1fc2009c74a8f805c01f1ed243515 => generated 240 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:08:57.592716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a627116-275a-4d86-94ea-c2b400ae017a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d6150dc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.654735 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a627116-275a-4d86-94ea-c2b400ae017a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1420 microversion: 2.1 time: 0.067827 Oct 04 18:08:57.655846 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 984/1916] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:57.670504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ad8df11c-a9a9-4afc-bfdd-7093c6ffec08 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] Calling method '.version_select at 0x7fd4d6150af0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.811929 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ad8df11c-a9a9-4afc-bfdd-7093c6ffec08 tempest-QuotasAdminTestV236-591033455 tempest-QuotasAdminTestV236-591033455-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/36b91e89820c42bea49140e60415747f?user_id=57c1fc2009c74a8f805c01f1ed243515" status: 200 len: 282 microversion: 2.36 time: 0.145397 Oct 04 18:08:57.812935 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 985/1917] 10.222.0.18 () {60 vars in 1364 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/os-quota-sets/36b91e89820c42bea49140e60415747f?user_id=57c1fc2009c74a8f805c01f1ed243515 => generated 282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:08:57.824508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-742ad52b-768f-44d2-924f-931d1457e58f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d620d820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.932186 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-742ad52b-768f-44d2-924f-931d1457e58f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 200 len: 1420 microversion: 2.1 time: 0.111449 Oct 04 18:08:57.933157 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 986/1918] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:57.950915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-883ae691-c53c-49e0-8342-e67842b3d8d3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61cfdc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:58.067533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-d998d7df-8483-40aa-9c45-3be56ed467de tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid f8d488d1-77e8-4d0e-9f33-0b675d54dc67 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:58.116164 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d998d7df-8483-40aa-9c45-3be56ed467de tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 2036 microversion: 2.25 time: 0.704847 Oct 04 18:08:58.120992 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 933/1919] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 2036 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:58.136601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:58.137537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:58.152931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:58.155187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:58.155889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.160113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:58.162137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:58.163365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.478968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:58.490878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:58.495631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:58.509384 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-af2e1baf-da01-43ba-8a08-323bf998dfd5 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.386553 Oct 04 18:08:58.510390 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 934/1920] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:58 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:58.526782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ca2a4fd-eb93-4924-9f91-1fcac7ed92c4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Action: 'create', calling method: .version_select at 0x7fd4d1968dc0>, body: {"keypair": {"name": "tempest-keypair-1094405831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN04ypFFZ18NlawjIpKpx9N64XGn/udarzMt79hrPGTRAtejcNYxObntrtAMXILxvuDtcKyZWGPzQWXObJeQtkg76zrxqg0NQUIe2/yMzVATYnC0SAqRShViUFu4cIMnNA=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:58.570424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3ca2a4fd-eb93-4924-9f91-1fcac7ed92c4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Getting quotas for project 1a630efa59244fbf9426904b7bf00eee. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:58.584664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3ca2a4fd-eb93-4924-9f91-1fcac7ed92c4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Getting quotas for user 9796f56e209540ee967eb5090a1d2dbe and project 1a630efa59244fbf9426904b7bf00eee. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:58.632550 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ca2a4fd-eb93-4924-9f91-1fcac7ed92c4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.117377 Oct 04 18:08:58.633572 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 935/1921] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 4 18:08:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:08:58.652261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6921b88d-c69f-4be8-b4d1-765bc251911e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:58.653224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6921b88d-c69f-4be8-b4d1-765bc251911e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:58.683657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6921b88d-c69f-4be8-b4d1-765bc251911e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:58.684805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6921b88d-c69f-4be8-b4d1-765bc251911e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:58.688102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6921b88d-c69f-4be8-b4d1-765bc251911e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.689497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6921b88d-c69f-4be8-b4d1-765bc251911e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:58.690037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6921b88d-c69f-4be8-b4d1-765bc251911e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:58.690675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6921b88d-c69f-4be8-b4d1-765bc251911e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.350510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6921b88d-c69f-4be8-b4d1-765bc251911e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:59.362614 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6921b88d-c69f-4be8-b4d1-765bc251911e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1315 microversion: 2.1 time: 0.726880 Oct 04 18:08:59.367689 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 936/1922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:58 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:59.372909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f82697e6-231f-4954-904b-0653a3538ac0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:59.378788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f82697e6-231f-4954-904b-0653a3538ac0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:59.393517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82697e6-231f-4954-904b-0653a3538ac0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.394341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82697e6-231f-4954-904b-0653a3538ac0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.396986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82697e6-231f-4954-904b-0653a3538ac0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.398038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82697e6-231f-4954-904b-0653a3538ac0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.399595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82697e6-231f-4954-904b-0653a3538ac0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.401986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82697e6-231f-4954-904b-0653a3538ac0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.566660 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-883ae691-c53c-49e0-8342-e67842b3d8d3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 204 len: 0 microversion: 2.1 time: 1.622445 Oct 04 18:08:59.567699 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 987/1923] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:57 2022] DELETE /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 0 bytes in 1624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:59.575303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:59.576165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:59.588758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.590749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.593728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.595027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.597346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.599045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.879691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:59.894459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:59.896340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:59.912100 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a920d27e-2833-43a5-98c7-71d11e4e993d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.341924 Oct 04 18:08:59.913892 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 988/1924] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:59 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:59.925739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2e6ccd3f-d17a-4aea-b06a-beae3014cb21 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:59.926994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2e6ccd3f-d17a-4aea-b06a-beae3014cb21 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:59.944042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e6ccd3f-d17a-4aea-b06a-beae3014cb21 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.945482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e6ccd3f-d17a-4aea-b06a-beae3014cb21 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.946212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e6ccd3f-d17a-4aea-b06a-beae3014cb21 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.948605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e6ccd3f-d17a-4aea-b06a-beae3014cb21 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.950352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e6ccd3f-d17a-4aea-b06a-beae3014cb21 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.951822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e6ccd3f-d17a-4aea-b06a-beae3014cb21 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.047865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2e6ccd3f-d17a-4aea-b06a-beae3014cb21 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:00.268354 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2e6ccd3f-d17a-4aea-b06a-beae3014cb21 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 204 len: 0 microversion: 2.1 time: 0.351746 Oct 04 18:09:00.269826 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 989/1925] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:59 2022] DELETE /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:00.396550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d701bf9-1fa1-4340-a3d5-be6d83a24a29 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:00.397800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d701bf9-1fa1-4340-a3d5-be6d83a24a29 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:00.410510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d701bf9-1fa1-4340-a3d5-be6d83a24a29 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.411633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d701bf9-1fa1-4340-a3d5-be6d83a24a29 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.412388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d701bf9-1fa1-4340-a3d5-be6d83a24a29 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.413414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d701bf9-1fa1-4340-a3d5-be6d83a24a29 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.414120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d701bf9-1fa1-4340-a3d5-be6d83a24a29 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.414934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d701bf9-1fa1-4340-a3d5-be6d83a24a29 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.484387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f82697e6-231f-4954-904b-0653a3538ac0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:00.496565 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f82697e6-231f-4954-904b-0653a3538ac0 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 1.124708 Oct 04 18:09:00.499282 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 937/1926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:59 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:00.515822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7c7a4bba-3413-4200-be3b-d7e8cebf1195 req-6055721e-346b-4034-9e33-ee0b46d17341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a466a26b-a6a8-473e-a42b-e1d1c71c2c35", "tag": "feb69b4e-25f6-4f92-bd6c-b253d86b7e8e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:00.526335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:00.542495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7c7a4bba-3413-4200-be3b-d7e8cebf1195 req-6055721e-346b-4034-9e33-ee0b46d17341 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.542805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7c7a4bba-3413-4200-be3b-d7e8cebf1195 req-6055721e-346b-4034-9e33-ee0b46d17341 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.544520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7c7a4bba-3413-4200-be3b-d7e8cebf1195 req-6055721e-346b-4034-9e33-ee0b46d17341 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.573019 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7c7a4bba-3413-4200-be3b-d7e8cebf1195 req-6055721e-346b-4034-9e33-ee0b46d17341 service nova] Creating event network-changed:feb69b4e-25f6-4f92-bd6c-b253d86b7e8e for instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 on n-h2-850499-14 Oct 04 18:09:00.587100 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7c7a4bba-3413-4200-be3b-d7e8cebf1195 req-6055721e-346b-4034-9e33-ee0b46d17341 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086463 Oct 04 18:09:00.588014 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 938/1927] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:00.593721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1870130946", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "09d3e330-5b4f-4c00-bc76-a5da1584aaf5"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:00.699593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] validate_networks() for [('09d3e330-5b4f-4c00-bc76-a5da1584aaf5', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:01.085310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d701bf9-1fa1-4340-a3d5-be6d83a24a29 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:01.104828 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d701bf9-1fa1-4340-a3d5-be6d83a24a29 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1315 microversion: 2.1 time: 0.714248 Oct 04 18:09:01.125367 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 990/1928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:00 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:01.156238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:01.159593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:01.180541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.181187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.181533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.184197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.184817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.185284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.379608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:01.397049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:01.401621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:01.417320 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d031f24-8f40-4d2c-b834-3a5be5e985bc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.289338 Oct 04 18:09:01.418798 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 991/1929] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:01 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:01.522244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9e0f34d-8ea3-4eb1-9a75-efd371def1e4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:01.523353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9e0f34d-8ea3-4eb1-9a75-efd371def1e4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:01.531076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9e0f34d-8ea3-4eb1-9a75-efd371def1e4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.531835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9e0f34d-8ea3-4eb1-9a75-efd371def1e4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.533766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9e0f34d-8ea3-4eb1-9a75-efd371def1e4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.534710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9e0f34d-8ea3-4eb1-9a75-efd371def1e4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.535607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9e0f34d-8ea3-4eb1-9a75-efd371def1e4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.536225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9e0f34d-8ea3-4eb1-9a75-efd371def1e4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.989170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9e0f34d-8ea3-4eb1-9a75-efd371def1e4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:01.995110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:02.039112 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9e0f34d-8ea3-4eb1-9a75-efd371def1e4 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.517917 Oct 04 18:09:02.044553 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 992/1930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:01 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:02.084537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:02.085177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:02.085524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:02.085947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:02.086371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:02.104718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.105253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.105557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.106383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.106852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.107340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.138969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3eea8ae0-19c5-448a-9618-c66957f8846d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:02.140412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3eea8ae0-19c5-448a-9618-c66957f8846d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:02.156141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eea8ae0-19c5-448a-9618-c66957f8846d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.159655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eea8ae0-19c5-448a-9618-c66957f8846d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.160435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eea8ae0-19c5-448a-9618-c66957f8846d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.163964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eea8ae0-19c5-448a-9618-c66957f8846d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.164758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eea8ae0-19c5-448a-9618-c66957f8846d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.165427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eea8ae0-19c5-448a-9618-c66957f8846d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.176656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Getting quotas for project 67c1cf4579c5406fb461ec00e486b491. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:02.201289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Getting quotas for user 2f402a68c6734b9488ab4a04e8b630a6 and project 67c1cf4579c5406fb461ec00e486b491. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:02.269873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:02.281512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:02.398567 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ee9f951-77cc-4997-8fe9-f9a8af7422af tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.808872 Oct 04 18:09:02.408684 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 939/1931] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:09:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:09:02.416101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c98a9d1b-b757-4481-a0c8-80b34181687a req-ea2d5a89-3e30-406e-9453-5e14bda5834f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d", "name": "network-vif-unplugged", "status": "completed", "tag": "4fd0d5d2-3dd8-4446-b5b1-1caafbeb86b3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:02.445258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c98a9d1b-b757-4481-a0c8-80b34181687a req-ea2d5a89-3e30-406e-9453-5e14bda5834f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.451249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c98a9d1b-b757-4481-a0c8-80b34181687a req-ea2d5a89-3e30-406e-9453-5e14bda5834f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.456482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c98a9d1b-b757-4481-a0c8-80b34181687a req-ea2d5a89-3e30-406e-9453-5e14bda5834f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.499247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c98a9d1b-b757-4481-a0c8-80b34181687a req-ea2d5a89-3e30-406e-9453-5e14bda5834f service nova] Creating event network-vif-unplugged:4fd0d5d2-3dd8-4446-b5b1-1caafbeb86b3 for instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d on n-h1-850499-14 Oct 04 18:09:02.530026 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c98a9d1b-b757-4481-a0c8-80b34181687a req-ea2d5a89-3e30-406e-9453-5e14bda5834f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119791 Oct 04 18:09:02.536955 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 940/1932] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:02.543284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bec43713-d195-44e7-9551-055a078bbe28 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:02.544142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bec43713-d195-44e7-9551-055a078bbe28 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:02.631638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bec43713-d195-44e7-9551-055a078bbe28 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:02.668405 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bec43713-d195-44e7-9551-055a078bbe28 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1208 microversion: 2.1 time: 0.129926 Oct 04 18:09:02.672046 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 941/1933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:02 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1208 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:02.698813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:02.709478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:02.732800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.739607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.740168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.745906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.747950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.749327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.801022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:02.858388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3eea8ae0-19c5-448a-9618-c66957f8846d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:02.877640 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3eea8ae0-19c5-448a-9618-c66957f8846d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1315 microversion: 2.1 time: 0.747021 Oct 04 18:09:02.880395 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 993/1934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:02 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1315 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:02.932531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:02.947754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:02.955138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:02.971563 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b7f087c1-86c9-4536-8711-3a5be7ab95b1 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1558 microversion: 2.91 time: 0.289765 Oct 04 18:09:02.973604 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 942/1935] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:02 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1558 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:03.072172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60aae541-d063-4f4c-866b-48a42ed26d66 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.072640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-60aae541-d063-4f4c-866b-48a42ed26d66 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:03.085957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aae541-d063-4f4c-866b-48a42ed26d66 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.086391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aae541-d063-4f4c-866b-48a42ed26d66 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.086842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aae541-d063-4f4c-866b-48a42ed26d66 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.087599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aae541-d063-4f4c-866b-48a42ed26d66 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.088062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aae541-d063-4f4c-866b-48a42ed26d66 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.093036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aae541-d063-4f4c-866b-48a42ed26d66 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.416213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.416900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:03.441642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.442458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.443148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.444060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.444878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.445486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.471614 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] HTTP exception thrown: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Request method failure captured: Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a HTTP/1.1 Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYug7p1cF12x0psu1bKgbc58bKhE_ihtRs56f_9Ez7TrOojI1b3S0PDL04HkWJSvPNmTfCvL-0RLsp5YzuuFj6ELNYh4NOyhQWWhIwCPn5KEr1ovnpl0i_jnxQgvJkCkYUol_6LCKoxRnxXokOU8ziRLGEXt6dMMRu4y64eg6Hq66A Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:09:03.473805 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4839e26fbc244802b56f2b0289410041"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4839e26fbc244802b56f2b0289410041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}] Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 29738c2533554939a890fad96acc1bef Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:09:03.475670 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'ff727bae-d934-4636-869c-de1bb44b402a'} Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:03.476709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:09:03.478403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.480885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Returning 404 to user: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:03.481944 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-58f5ff36-84d8-4e1a-93a1-bbd0d4458ff7 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 404 len: 111 microversion: 2.1 time: 0.070358 Oct 04 18:09:03.482697 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 943/1936] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:03 2022] DELETE /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:09:03.493287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.494325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: ff727bae-d934-4636-869c-de1bb44b402a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:03.503371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.503916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.504365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.505108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.505565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.506002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.524293 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] HTTP exception thrown: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Request method failure captured: Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a HTTP/1.1 Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYug7p1cF12x0psu1bKgbc58bKhE_ihtRs56f_9Ez7TrOojI1b3S0PDL04HkWJSvPNmTfCvL-0RLsp5YzuuFj6ELNYh4NOyhQWWhIwCPn5KEr1ovnpl0i_jnxQgvJkCkYUol_6LCKoxRnxXokOU8ziRLGEXt6dMMRu4y64eg6Hq66A Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:09:03.526349 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4839e26fbc244802b56f2b0289410041"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4839e26fbc244802b56f2b0289410041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}] Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 29738c2533554939a890fad96acc1bef Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:09:03.528281 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'ff727bae-d934-4636-869c-de1bb44b402a'} Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:03.529282 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. Oct 04 18:09:03.531329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.536123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Returning 404 to user: Instance ff727bae-d934-4636-869c-de1bb44b402a could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:03.537318 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a9f68f70-a659-4fcc-8fe9-c7952bb19b58 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a" status: 404 len: 111 microversion: 2.1 time: 0.049975 Oct 04 18:09:03.538482 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 944/1937] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:03 2022] GET /compute/v2.1/servers/ff727bae-d934-4636-869c-de1bb44b402a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:09:03.547895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.548970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:03.556201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.558041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.558539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.559333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.559810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.560239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.577231 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] HTTP exception thrown: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Request method failure captured: Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 HTTP/1.1 Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYug7p1cF12x0psu1bKgbc58bKhE_ihtRs56f_9Ez7TrOojI1b3S0PDL04HkWJSvPNmTfCvL-0RLsp5YzuuFj6ELNYh4NOyhQWWhIwCPn5KEr1ovnpl0i_jnxQgvJkCkYUol_6LCKoxRnxXokOU8ziRLGEXt6dMMRu4y64eg6Hq66A Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:09:03.580181 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4839e26fbc244802b56f2b0289410041"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4839e26fbc244802b56f2b0289410041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}] Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 29738c2533554939a890fad96acc1bef Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:09:03.582045 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'a58c5045-ad93-49bc-8150-b4f31c3128f8'} Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:03.583122 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:09:03.584827 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.588006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Returning 404 to user: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:03.589160 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-18a6a379-76ad-44a3-861d-4dd9ee3a50c0 tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 404 len: 111 microversion: 2.1 time: 0.046743 Oct 04 18:09:03.590642 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 945/1938] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:03 2022] DELETE /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:03.602450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.603819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] [instance: a58c5045-ad93-49bc-8150-b4f31c3128f8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:03.613114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-60aae541-d063-4f4c-866b-48a42ed26d66 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:03.615743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.616250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.616696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.617416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.625041 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-60aae541-d063-4f4c-866b-48a42ed26d66 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.557195 Oct 04 18:09:03.625268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.625690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.639823 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 994/1939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:03 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:03.660783 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] HTTP exception thrown: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Request method failure captured: Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 HTTP/1.1 Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYug7p1cF12x0psu1bKgbc58bKhE_ihtRs56f_9Ez7TrOojI1b3S0PDL04HkWJSvPNmTfCvL-0RLsp5YzuuFj6ELNYh4NOyhQWWhIwCPn5KEr1ovnpl0i_jnxQgvJkCkYUol_6LCKoxRnxXokOU8ziRLGEXt6dMMRu4y64eg6Hq66A Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:09:03.664674 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4839e26fbc244802b56f2b0289410041"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4839e26fbc244802b56f2b0289410041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4839e26fbc244802b56f2b0289410041"}]}] Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 4839e26fbc244802b56f2b0289410041 Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestMultiNic-1386020474 Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 29738c2533554939a890fad96acc1bef Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestMultiNic-1386020474-project Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:09:03.666592 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'a58c5045-ad93-49bc-8150-b4f31c3128f8'} Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:03.667633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. Oct 04 18:09:03.669556 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:03.671135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] Returning 404 to user: Instance a58c5045-ad93-49bc-8150-b4f31c3128f8 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:03.671135 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ecf18fb6-e1a6-487d-a369-47ebee12f0db tempest-ServersTestMultiNic-1386020474 tempest-ServersTestMultiNic-1386020474-project] 10.222.0.18 "GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8" status: 404 len: 111 microversion: 2.1 time: 0.068516 Oct 04 18:09:03.673058 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 946/1940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:03 2022] GET /compute/v2.1/servers/a58c5045-ad93-49bc-8150-b4f31c3128f8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:03.698474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b2e7f50-cc25-427b-b727-42a7ef83decb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.699209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b2e7f50-cc25-427b-b727-42a7ef83decb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:03.707493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2e7f50-cc25-427b-b727-42a7ef83decb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.707999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2e7f50-cc25-427b-b727-42a7ef83decb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.708447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2e7f50-cc25-427b-b727-42a7ef83decb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.709175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2e7f50-cc25-427b-b727-42a7ef83decb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.709872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2e7f50-cc25-427b-b727-42a7ef83decb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.710318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2e7f50-cc25-427b-b727-42a7ef83decb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.890389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7b2e7f50-cc25-427b-b727-42a7ef83decb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:03.921536 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b2e7f50-cc25-427b-b727-42a7ef83decb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1260 microversion: 2.1 time: 0.226700 Oct 04 18:09:03.923971 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 995/1941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:03 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:03.947002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f06b390a-b59a-42c5-88c2-7183542d71b1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.948565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f06b390a-b59a-42c5-88c2-7183542d71b1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:03.959568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06b390a-b59a-42c5-88c2-7183542d71b1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.960292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06b390a-b59a-42c5-88c2-7183542d71b1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.961042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06b390a-b59a-42c5-88c2-7183542d71b1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.962270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06b390a-b59a-42c5-88c2-7183542d71b1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.963204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06b390a-b59a-42c5-88c2-7183542d71b1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.963757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06b390a-b59a-42c5-88c2-7183542d71b1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.008705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:04.009607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:04.016091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.016926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.017639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.018609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.019185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.019724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.216919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:04.225683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:04.227184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:04.235384 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d346a57-35af-4227-917b-ecac955649ce tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1558 microversion: 2.91 time: 0.230716 Oct 04 18:09:04.236786 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 996/1942] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:04 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1558 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:09:04.400025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f06b390a-b59a-42c5-88c2-7183542d71b1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:04.408576 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f06b390a-b59a-42c5-88c2-7183542d71b1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1315 microversion: 2.1 time: 0.507149 Oct 04 18:09:04.410999 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 947/1943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:03 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:04.651898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-562cc5c8-b51c-45a4-b396-27e70c4fc7a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:04.653148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-562cc5c8-b51c-45a4-b396-27e70c4fc7a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:04.666782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-562cc5c8-b51c-45a4-b396-27e70c4fc7a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.669007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-562cc5c8-b51c-45a4-b396-27e70c4fc7a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.671007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-562cc5c8-b51c-45a4-b396-27e70c4fc7a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.673028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-562cc5c8-b51c-45a4-b396-27e70c4fc7a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.674370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-562cc5c8-b51c-45a4-b396-27e70c4fc7a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.676155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-562cc5c8-b51c-45a4-b396-27e70c4fc7a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.964159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27ad757c-b89d-4252-bcaf-d39ad9e27821 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:04.966644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27ad757c-b89d-4252-bcaf-d39ad9e27821 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:04.984172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ad757c-b89d-4252-bcaf-d39ad9e27821 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.988516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ad757c-b89d-4252-bcaf-d39ad9e27821 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.990806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ad757c-b89d-4252-bcaf-d39ad9e27821 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.991765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ad757c-b89d-4252-bcaf-d39ad9e27821 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.995203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ad757c-b89d-4252-bcaf-d39ad9e27821 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.998805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ad757c-b89d-4252-bcaf-d39ad9e27821 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.392820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27ad757c-b89d-4252-bcaf-d39ad9e27821 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:05.402436 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27ad757c-b89d-4252-bcaf-d39ad9e27821 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1266 microversion: 2.1 time: 0.442776 Oct 04 18:09:05.417722 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 948/1944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:04 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1266 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:05.429194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-956da434-0a1f-4e6d-bd8b-a50adf2f27fd req-7f0b183f-f826-44ea-abac-ac5af9f1b194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d", "name": "network-vif-deleted", "tag": "4fd0d5d2-3dd8-4446-b5b1-1caafbeb86b3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:05.468444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-956da434-0a1f-4e6d-bd8b-a50adf2f27fd req-7f0b183f-f826-44ea-abac-ac5af9f1b194 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.469150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-956da434-0a1f-4e6d-bd8b-a50adf2f27fd req-7f0b183f-f826-44ea-abac-ac5af9f1b194 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.469607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-956da434-0a1f-4e6d-bd8b-a50adf2f27fd req-7f0b183f-f826-44ea-abac-ac5af9f1b194 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.487800 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-956da434-0a1f-4e6d-bd8b-a50adf2f27fd req-7f0b183f-f826-44ea-abac-ac5af9f1b194 service nova] Creating event network-vif-deleted:4fd0d5d2-3dd8-4446-b5b1-1caafbeb86b3 for instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d on n-h1-850499-14 Oct 04 18:09:05.517469 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-956da434-0a1f-4e6d-bd8b-a50adf2f27fd req-7f0b183f-f826-44ea-abac-ac5af9f1b194 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092761 Oct 04 18:09:05.520811 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 949/1945] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:05.539713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:05.542654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:05.558807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.561500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.561964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.562702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.565579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.566252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.779044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:05.792335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:05.807570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:05.823472 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c838fcc5-4737-4acf-8f57-46078e8277da tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.299808 Oct 04 18:09:05.824065 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 950/1946] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:05 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:05.840344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a8693a2a-e350-4580-9b1a-0f3593ae0f49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:05.841297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a8693a2a-e350-4580-9b1a-0f3593ae0f49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:05.854007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8693a2a-e350-4580-9b1a-0f3593ae0f49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.854525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8693a2a-e350-4580-9b1a-0f3593ae0f49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.855011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8693a2a-e350-4580-9b1a-0f3593ae0f49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.855726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8693a2a-e350-4580-9b1a-0f3593ae0f49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.856389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8693a2a-e350-4580-9b1a-0f3593ae0f49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.856997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8693a2a-e350-4580-9b1a-0f3593ae0f49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.963153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-562cc5c8-b51c-45a4-b396-27e70c4fc7a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:05.976101 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-562cc5c8-b51c-45a4-b396-27e70c4fc7a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 1.328856 Oct 04 18:09:05.990991 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 997/1947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:04 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:06.424945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-425334872", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "c5519c6a-88b3-4e11-a279-e6dbd711c38c"}], "security_groups": [{"name": "tempest-securitygroup--1232631741"}], "key_name": "tempest-keypair-1094405831", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:06.504102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a8693a2a-e350-4580-9b1a-0f3593ae0f49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:06.513667 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a8693a2a-e350-4580-9b1a-0f3593ae0f49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1315 microversion: 2.1 time: 0.687695 Oct 04 18:09:06.515645 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 951/1948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:05 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:06.521722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8cd74c5c-d707-4e5c-b773-d6adbf768cb1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:06.535939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8cd74c5c-d707-4e5c-b773-d6adbf768cb1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:06.542192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cd74c5c-d707-4e5c-b773-d6adbf768cb1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.542693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cd74c5c-d707-4e5c-b773-d6adbf768cb1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.543170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cd74c5c-d707-4e5c-b773-d6adbf768cb1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.544098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cd74c5c-d707-4e5c-b773-d6adbf768cb1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.545002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cd74c5c-d707-4e5c-b773-d6adbf768cb1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.545436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cd74c5c-d707-4e5c-b773-d6adbf768cb1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.714081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8cd74c5c-d707-4e5c-b773-d6adbf768cb1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:06.726404 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8cd74c5c-d707-4e5c-b773-d6adbf768cb1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1266 microversion: 2.1 time: 0.208193 Oct 04 18:09:06.727308 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 952/1949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:06 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:06.856875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:06.857488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:06.865433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.866591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.867520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.868688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.869343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.870013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.063302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.079395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.080595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] validate_networks() for [('c5519c6a-88b3-4e11-a279-e6dbd711c38c', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:07.085772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.101098 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-26cc4fa1-422c-4e68-935d-d8ac484e77ea tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.247947 Oct 04 18:09:07.119482 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 953/1950] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:06 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:07.124892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc1db4e7-4140-4170-8404-0b1520c82273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:07.131278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dc1db4e7-4140-4170-8404-0b1520c82273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:07.139202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1db4e7-4140-4170-8404-0b1520c82273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.139698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1db4e7-4140-4170-8404-0b1520c82273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.140167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1db4e7-4140-4170-8404-0b1520c82273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.141074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1db4e7-4140-4170-8404-0b1520c82273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.141536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1db4e7-4140-4170-8404-0b1520c82273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.142179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1db4e7-4140-4170-8404-0b1520c82273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.444549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=7 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:07.800054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc1db4e7-4140-4170-8404-0b1520c82273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.804549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=24 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:07.843104 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dc1db4e7-4140-4170-8404-0b1520c82273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1391 microversion: 2.1 time: 0.722349 Oct 04 18:09:07.858699 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 954/1951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:07 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1391 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:08.163604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2a5d0030-1668-4f9f-b3ec-03336436446d tempest-SecurityGroupsTestAdminJSON-1753548296 tempest-SecurityGroupsTestAdminJSON-1753548296-project] Action: 'create', calling method: .version_select at 0x7fd4d1934ca0>, body: {"security_group": {"name": "tempest-securitygroup-1984790939", "description": "tempest-description-524103224"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:09.540810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:09.541277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:09.541982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:09.542398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:09.542812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:09.573329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.574108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.574793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.575776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.576403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.577005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.601474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Getting quotas for project 1a630efa59244fbf9426904b7bf00eee. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:09.632918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Getting quotas for user 9796f56e209540ee967eb5090a1d2dbe and project 1a630efa59244fbf9426904b7bf00eee. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:09.677110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:09.680367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:09.755157 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d4aecc2e-3cf4-43c6-9bf4-4bd1a4b97aae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 3.333954 Oct 04 18:09:09.756430 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 998/1952] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:09:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 3336 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:09:09.764009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6291c9b6-3ae9-4b44-86af-74239b43601b req-973ce53a-26d4-4d65-afed-8b0cd906b3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a466a26b-a6a8-473e-a42b-e1d1c71c2c35", "name": "network-vif-plugged", "status": "completed", "tag": "feb69b4e-25f6-4f92-bd6c-b253d86b7e8e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:09.822237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6291c9b6-3ae9-4b44-86af-74239b43601b req-973ce53a-26d4-4d65-afed-8b0cd906b3c4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.827889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6291c9b6-3ae9-4b44-86af-74239b43601b req-973ce53a-26d4-4d65-afed-8b0cd906b3c4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.831622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6291c9b6-3ae9-4b44-86af-74239b43601b req-973ce53a-26d4-4d65-afed-8b0cd906b3c4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.868713 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6291c9b6-3ae9-4b44-86af-74239b43601b req-973ce53a-26d4-4d65-afed-8b0cd906b3c4 service nova] Creating event network-vif-plugged:feb69b4e-25f6-4f92-bd6c-b253d86b7e8e for instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 on n-h2-850499-14 Oct 04 18:09:09.886238 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6291c9b6-3ae9-4b44-86af-74239b43601b req-973ce53a-26d4-4d65-afed-8b0cd906b3c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128243 Oct 04 18:09:09.887777 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 999/1953] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:09.894503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-761dd2f8-9dcf-49f8-bf7d-2b750286349c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:09.895517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-761dd2f8-9dcf-49f8-bf7d-2b750286349c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:09.903091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761dd2f8-9dcf-49f8-bf7d-2b750286349c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.903782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761dd2f8-9dcf-49f8-bf7d-2b750286349c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.904402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761dd2f8-9dcf-49f8-bf7d-2b750286349c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.905341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761dd2f8-9dcf-49f8-bf7d-2b750286349c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.905994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761dd2f8-9dcf-49f8-bf7d-2b750286349c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.906600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761dd2f8-9dcf-49f8-bf7d-2b750286349c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.644806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-761dd2f8-9dcf-49f8-bf7d-2b750286349c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:10.647595 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2a5d0030-1668-4f9f-b3ec-03336436446d tempest-SecurityGroupsTestAdminJSON-1753548296 tempest-SecurityGroupsTestAdminJSON-1753548296-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.793767 Oct 04 18:09:10.648814 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 955/1954] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:07 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:10.656033 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-761dd2f8-9dcf-49f8-bf7d-2b750286349c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1315 microversion: 2.1 time: 0.766801 Oct 04 18:09:10.658832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c78bc134-b48d-45cc-a47f-ea57bc1650ea tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.659518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c78bc134-b48d-45cc-a47f-ea57bc1650ea tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:10.667245 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1000/1955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:09 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:10.672795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.673483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:10.689870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.690384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.690834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.691664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.692136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.692574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.697544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c78bc134-b48d-45cc-a47f-ea57bc1650ea tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.698099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c78bc134-b48d-45cc-a47f-ea57bc1650ea tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.700012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c78bc134-b48d-45cc-a47f-ea57bc1650ea tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.700802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c78bc134-b48d-45cc-a47f-ea57bc1650ea tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.701281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c78bc134-b48d-45cc-a47f-ea57bc1650ea tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.703937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c78bc134-b48d-45cc-a47f-ea57bc1650ea tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.437317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:11.464636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:11.466483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:11.479549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:11.485014 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ba7b8a8-79f1-457c-855e-75e7d19e2352 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.816605 Oct 04 18:09:11.505923 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1001/1956] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:11.518382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa4fae94-cda2-4fc0-b67c-58bac6f507d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.519364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aa4fae94-cda2-4fc0-b67c-58bac6f507d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:11.527286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa4fae94-cda2-4fc0-b67c-58bac6f507d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.528045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa4fae94-cda2-4fc0-b67c-58bac6f507d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.537663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa4fae94-cda2-4fc0-b67c-58bac6f507d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.539353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa4fae94-cda2-4fc0-b67c-58bac6f507d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.540023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa4fae94-cda2-4fc0-b67c-58bac6f507d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.540791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa4fae94-cda2-4fc0-b67c-58bac6f507d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.850636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c78bc134-b48d-45cc-a47f-ea57bc1650ea tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:11.869849 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c78bc134-b48d-45cc-a47f-ea57bc1650ea tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1308 microversion: 2.1 time: 1.219687 Oct 04 18:09:11.870657 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 956/1957] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1308 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:11.884160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.885241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:11.893767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.894269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.894709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.895465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.895917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.896560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.120428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:12.140227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:12.141709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:12.148927 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e90d5b99-1ff0-41b7-954c-efae1c649128 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1337 microversion: 2.25 time: 0.262723 Oct 04 18:09:12.163136 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 957/1958] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1337 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:12.171033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aa4fae94-cda2-4fc0-b67c-58bac6f507d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:12.175165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:12.182714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5c56e2a0-5c50-47d1-870a-9a78a9c5f516 tempest-SecurityGroupsTestAdminJSON-1753548296 tempest-SecurityGroupsTestAdminJSON-1753548296-project] Action: 'create', calling method: .version_select at 0x7fd4d191c4c0>, body: {"security_group": {"name": "tempest-securitygroup-766878364", "description": "tempest-description-1783117883"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:12.190447 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa4fae94-cda2-4fc0-b67c-58bac6f507d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1381 microversion: 2.1 time: 0.679842 Oct 04 18:09:12.191429 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1002/1959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1381 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:12.207389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a422edc-797b-42e6-850a-ded19eb6ce3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:12.214002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1a422edc-797b-42e6-850a-ded19eb6ce3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:12.230797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a422edc-797b-42e6-850a-ded19eb6ce3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:12.232939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a422edc-797b-42e6-850a-ded19eb6ce3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:12.234168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a422edc-797b-42e6-850a-ded19eb6ce3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.237068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a422edc-797b-42e6-850a-ded19eb6ce3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:12.238195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a422edc-797b-42e6-850a-ded19eb6ce3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:12.239547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a422edc-797b-42e6-850a-ded19eb6ce3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.646447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=22 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:12.802985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1a422edc-797b-42e6-850a-ded19eb6ce3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:12.816392 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1a422edc-797b-42e6-850a-ded19eb6ce3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1315 microversion: 2.1 time: 0.620467 Oct 04 18:09:12.831561 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1003/1960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:12 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:12.849454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16c5028c-fbec-4419-b061-cf661aca2511 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '.version_select at 0x7fd4d61cfb80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:12.857370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16c5028c-fbec-4419-b061-cf661aca2511 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:12.862918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16c5028c-fbec-4419-b061-cf661aca2511 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:12.863800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16c5028c-fbec-4419-b061-cf661aca2511 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.890353 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-16c5028c-fbec-4419-b061-cf661aca2511 tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2345 microversion: 2.1 time: 0.057220 Oct 04 18:09:12.894345 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1004/1961] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:09:12 2022] GET /compute/v2.1/os-migrations => generated 2345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:12.917933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:12.918578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:12.932044 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5c56e2a0-5c50-47d1-870a-9a78a9c5f516 tempest-SecurityGroupsTestAdminJSON-1753548296 tempest-SecurityGroupsTestAdminJSON-1753548296-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.765923 Oct 04 18:09:12.932900 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 958/1962] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:12 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:12.940100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cddd753b-a6cb-41b3-bf6d-70ce328032da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:12.940748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:12.941862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:12.942535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.945473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cddd753b-a6cb-41b3-bf6d-70ce328032da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:12.945900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:12.946593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:12.948491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.975560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cddd753b-a6cb-41b3-bf6d-70ce328032da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:12.982036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cddd753b-a6cb-41b3-bf6d-70ce328032da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:12.985871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cddd753b-a6cb-41b3-bf6d-70ce328032da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.987086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cddd753b-a6cb-41b3-bf6d-70ce328032da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:12.989736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cddd753b-a6cb-41b3-bf6d-70ce328032da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:13.009713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cddd753b-a6cb-41b3-bf6d-70ce328032da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:13.237639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:13.268664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:13.277924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:13.300403 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9e65b320-b1f9-4a06-8019-5225cacd22fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.391521 Oct 04 18:09:13.333893 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1005/1963] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:12 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:13.363696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e801075-8333-477c-91df-8c76c3168b0b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:13.365660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e801075-8333-477c-91df-8c76c3168b0b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:13.387114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e801075-8333-477c-91df-8c76c3168b0b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:13.391152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e801075-8333-477c-91df-8c76c3168b0b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:13.394282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e801075-8333-477c-91df-8c76c3168b0b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:13.396004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e801075-8333-477c-91df-8c76c3168b0b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:13.396507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e801075-8333-477c-91df-8c76c3168b0b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:13.399938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e801075-8333-477c-91df-8c76c3168b0b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:13.790220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cddd753b-a6cb-41b3-bf6d-70ce328032da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:13.802051 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cddd753b-a6cb-41b3-bf6d-70ce328032da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1308 microversion: 2.1 time: 0.867313 Oct 04 18:09:13.803576 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 959/1964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:12 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1308 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:13.909217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e371bd05-2cea-43d6-9891-2aa16887c72d tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Action: 'create', calling method: .version_select at 0x7fd4d19a1670>, body: {"security_group": {"name": "tempest-securitygroup-1520432492", "description": "tempest-description-2046969655"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:14.468210 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e801075-8333-477c-91df-8c76c3168b0b tempest-LiveMigrationTest-1050394770 tempest-LiveMigrationTest-1050394770-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1534 microversion: 2.1 time: 1.130513 Oct 04 18:09:14.473687 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1006/1965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:13 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1534 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:14.493260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:14.494600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:14.513466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:14.519501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:14.520319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:14.521627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:14.522458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:14.523224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:14.756390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:14.795348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:14.800036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:14.805685 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d568c41b-4f4f-4ee9-b378-74aece4d71ab tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1343 microversion: 2.25 time: 0.328839 Oct 04 18:09:14.825699 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1007/1966] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:14 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1343 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:14.837702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1fa55cb5-acfa-4032-b146-2f0560fae02d req-d995e821-9165-4c1b-b1c9-f10f732648fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95bfba3c-5b12-4b4a-800c-c3a37b9da5e2", "tag": "d87be326-0818-410e-ad20-1bc0d3600186"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:14.886931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1fa55cb5-acfa-4032-b146-2f0560fae02d req-d995e821-9165-4c1b-b1c9-f10f732648fd service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:14.887754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1fa55cb5-acfa-4032-b146-2f0560fae02d req-d995e821-9165-4c1b-b1c9-f10f732648fd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:14.888487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1fa55cb5-acfa-4032-b146-2f0560fae02d req-d995e821-9165-4c1b-b1c9-f10f732648fd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:14.937152 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1fa55cb5-acfa-4032-b146-2f0560fae02d req-d995e821-9165-4c1b-b1c9-f10f732648fd service nova] Creating event network-changed:d87be326-0818-410e-ad20-1bc0d3600186 for instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 on n-h1-850499-14 Oct 04 18:09:14.957887 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1fa55cb5-acfa-4032-b146-2f0560fae02d req-d995e821-9165-4c1b-b1c9-f10f732648fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130184 Oct 04 18:09:14.961724 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1008/1967] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:14.979906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f84d1f4-905c-4da3-afe8-5960a93541f2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:14.989634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7f84d1f4-905c-4da3-afe8-5960a93541f2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:15.008716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f84d1f4-905c-4da3-afe8-5960a93541f2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.010938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f84d1f4-905c-4da3-afe8-5960a93541f2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.012654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f84d1f4-905c-4da3-afe8-5960a93541f2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.014404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f84d1f4-905c-4da3-afe8-5960a93541f2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.016130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f84d1f4-905c-4da3-afe8-5960a93541f2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.017696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f84d1f4-905c-4da3-afe8-5960a93541f2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.565181 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e371bd05-2cea-43d6-9891-2aa16887c72d tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.760201 Oct 04 18:09:15.574871 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 960/1968] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:13 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:15.580643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:15.581258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:15.601526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.602037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.602486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.603300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.603766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.607945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.788472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:15.805773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:15.810588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:15.828564 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a21a0b9b-3c09-4992-945b-f916a0f8c781 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.251858 Oct 04 18:09:15.831398 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 961/1969] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:15 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:15.837480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-02e2ad8c-427a-458d-999e-6fed84c13669 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:15.838835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-02e2ad8c-427a-458d-999e-6fed84c13669 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:15.846679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02e2ad8c-427a-458d-999e-6fed84c13669 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.848580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02e2ad8c-427a-458d-999e-6fed84c13669 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.849228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02e2ad8c-427a-458d-999e-6fed84c13669 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.850315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02e2ad8c-427a-458d-999e-6fed84c13669 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.851287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02e2ad8c-427a-458d-999e-6fed84c13669 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.851975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02e2ad8c-427a-458d-999e-6fed84c13669 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.892320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-02e2ad8c-427a-458d-999e-6fed84c13669 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:15.928989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f84d1f4-905c-4da3-afe8-5960a93541f2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:15.938493 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f84d1f4-905c-4da3-afe8-5960a93541f2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1502 microversion: 2.1 time: 0.974030 Oct 04 18:09:15.943691 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1009/1970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:14 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1502 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:15.968048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f9bb6a07-3733-4706-b315-b43caeb4dbcd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:15.971580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f9bb6a07-3733-4706-b315-b43caeb4dbcd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:15.982547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bb6a07-3733-4706-b315-b43caeb4dbcd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.988714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bb6a07-3733-4706-b315-b43caeb4dbcd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.989381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bb6a07-3733-4706-b315-b43caeb4dbcd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.990311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bb6a07-3733-4706-b315-b43caeb4dbcd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.994381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bb6a07-3733-4706-b315-b43caeb4dbcd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.995204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bb6a07-3733-4706-b315-b43caeb4dbcd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.026064 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-02e2ad8c-427a-458d-999e-6fed84c13669 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 204 len: 0 microversion: 2.1 time: 0.192450 Oct 04 18:09:16.027855 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 962/1971] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:15 2022] DELETE /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:16.040286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b64342a7-4f9c-48d0-839d-d7c0b35c0602 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Action: 'create', calling method: .version_select at 0x7fd4d1a08a60>, body: {"security_group": {"name": "tempest-securitygroup-2019789019", "description": "tempest-description-1770832273"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:16.561522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f9bb6a07-3733-4706-b315-b43caeb4dbcd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:16.581390 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f9bb6a07-3733-4706-b315-b43caeb4dbcd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1308 microversion: 2.1 time: 0.628010 Oct 04 18:09:16.595274 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1010/1972] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:15 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1308 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:16.605435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:16.606280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:16.612858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.613644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.614261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.615192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.615803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.616395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.701397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:16.715052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:16.720959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:16.722131 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb5e7dbd-a064-46d7-bd73-a78d16f01cd2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1343 microversion: 2.25 time: 0.125485 Oct 04 18:09:16.747359 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1011/1973] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:16 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1343 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:16.752794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4662daeb-bbac-442e-9544-d5a17b125a48 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:16.769820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4662daeb-bbac-442e-9544-d5a17b125a48 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:16.784289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4662daeb-bbac-442e-9544-d5a17b125a48 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.784790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4662daeb-bbac-442e-9544-d5a17b125a48 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.785234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4662daeb-bbac-442e-9544-d5a17b125a48 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.785949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4662daeb-bbac-442e-9544-d5a17b125a48 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.786407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4662daeb-bbac-442e-9544-d5a17b125a48 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.786831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4662daeb-bbac-442e-9544-d5a17b125a48 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.880331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:17.437006 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b64342a7-4f9c-48d0-839d-d7c0b35c0602 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.406244 Oct 04 18:09:17.438126 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 963/1974] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:16 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:17.459881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:17.461267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:17.502920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.524216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.526315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.530821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.534144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.536262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.003985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:18.047374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:18.055764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:18.058719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:18.077840 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-10e1af39-ddb7-4cbe-a03c-8e1aa498f763 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.637638 Oct 04 18:09:18.079081 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 964/1975] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:17 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:18.087130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Calling method '.version_select at 0x7fd4d1a229d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:18.285736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4662daeb-bbac-442e-9544-d5a17b125a48 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:18.295061 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4662daeb-bbac-442e-9544-d5a17b125a48 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1387 microversion: 2.1 time: 1.546201 Oct 04 18:09:18.295662 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1012/1976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:16 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1387 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:18.305826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c16668eb-23d1-4d1b-94f0-5fbd117b47ba tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:18.306356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c16668eb-23d1-4d1b-94f0-5fbd117b47ba tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:18.327010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16668eb-23d1-4d1b-94f0-5fbd117b47ba tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.327506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16668eb-23d1-4d1b-94f0-5fbd117b47ba tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.327955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16668eb-23d1-4d1b-94f0-5fbd117b47ba tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.328679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16668eb-23d1-4d1b-94f0-5fbd117b47ba tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.329171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16668eb-23d1-4d1b-94f0-5fbd117b47ba tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.329631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16668eb-23d1-4d1b-94f0-5fbd117b47ba tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.570293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c16668eb-23d1-4d1b-94f0-5fbd117b47ba tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:19.587662 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c16668eb-23d1-4d1b-94f0-5fbd117b47ba tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1308 microversion: 2.1 time: 1.283558 Oct 04 18:09:19.588630 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1013/1977] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:18 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1308 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:19.591433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:19.609104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:19.610156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:19.633015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.633540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.633996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.634743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.635277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.635713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.701213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:20.861430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:20.891083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:20.895670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:20.898480 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-03d86b22-b09a-4aca-b148-307c8933f331 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1411 microversion: 2.25 time: 1.307375 Oct 04 18:09:20.917802 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1014/1978] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:19 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1411 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:20.945351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-f7e67ea4-f6c7-41e2-b2b4-c21639b7ca6f req-419d0cc8-b74d-46dd-98d3-43dc8c0c14ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc93dc3-d2ac-4450-92fd-63bbedaf9b92", "name": "network-vif-deleted", "tag": "041c1840-6713-484f-9db9-ed4df1bc61a0"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:20.959286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f7e67ea4-f6c7-41e2-b2b4-c21639b7ca6f req-419d0cc8-b74d-46dd-98d3-43dc8c0c14ce service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.960012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f7e67ea4-f6c7-41e2-b2b4-c21639b7ca6f req-419d0cc8-b74d-46dd-98d3-43dc8c0c14ce service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.960634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f7e67ea4-f6c7-41e2-b2b4-c21639b7ca6f req-419d0cc8-b74d-46dd-98d3-43dc8c0c14ce service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.978929 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-f7e67ea4-f6c7-41e2-b2b4-c21639b7ca6f req-419d0cc8-b74d-46dd-98d3-43dc8c0c14ce service nova] Creating event network-vif-deleted:041c1840-6713-484f-9db9-ed4df1bc61a0 for instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 on n-h2-850499-14 Oct 04 18:09:20.984474 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-f7e67ea4-f6c7-41e2-b2b4-c21639b7ca6f req-419d0cc8-b74d-46dd-98d3-43dc8c0c14ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064650 Oct 04 18:09:20.993164 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1015/1979] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:21.000067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fd1396d3-bf0a-4098-bba6-e45efcc23446 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c18e747-c8dd-42bf-97f0-21c41fcf539e"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:21.003342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fd1396d3-bf0a-4098-bba6-e45efcc23446 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:21.012448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd1396d3-bf0a-4098-bba6-e45efcc23446 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.013112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd1396d3-bf0a-4098-bba6-e45efcc23446 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.013686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd1396d3-bf0a-4098-bba6-e45efcc23446 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.014527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd1396d3-bf0a-4098-bba6-e45efcc23446 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.015307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd1396d3-bf0a-4098-bba6-e45efcc23446 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.015923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd1396d3-bf0a-4098-bba6-e45efcc23446 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.640082 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fd1396d3-bf0a-4098-bba6-e45efcc23446 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.642817 Oct 04 18:09:21.642633 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1016/1980] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:09:20 2022] POST /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35/os-volume_attachments => generated 194 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:21.689173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.691607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:21.721726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.722249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.722703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.728171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.734500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.738098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.048009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:22.067127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:22.083422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:22.108029 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c6fbca65-e47d-4836-910d-e8e018800fbd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.461868 Oct 04 18:09:22.123012 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1017/1981] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:21 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:22.134602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9a3ff71-2287-4a05-aea3-828ca5642230 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:22.134602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9a3ff71-2287-4a05-aea3-828ca5642230 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:22.145836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a3ff71-2287-4a05-aea3-828ca5642230 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.149255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a3ff71-2287-4a05-aea3-828ca5642230 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.150224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a3ff71-2287-4a05-aea3-828ca5642230 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.152807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a3ff71-2287-4a05-aea3-828ca5642230 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.154978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a3ff71-2287-4a05-aea3-828ca5642230 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.155838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a3ff71-2287-4a05-aea3-828ca5642230 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.306405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9a3ff71-2287-4a05-aea3-828ca5642230 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:22.343982 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9a3ff71-2287-4a05-aea3-828ca5642230 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1183 microversion: 2.1 time: 0.215948 Oct 04 18:09:22.343982 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1018/1982] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:22 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:22.355376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a89bd38-b40d-429f-b535-c9b48033ab97 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:22.358901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a89bd38-b40d-429f-b535-c9b48033ab97 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:22.380103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a89bd38-b40d-429f-b535-c9b48033ab97 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.380829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a89bd38-b40d-429f-b535-c9b48033ab97 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.382068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a89bd38-b40d-429f-b535-c9b48033ab97 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.384268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a89bd38-b40d-429f-b535-c9b48033ab97 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.386797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a89bd38-b40d-429f-b535-c9b48033ab97 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.388311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a89bd38-b40d-429f-b535-c9b48033ab97 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.227329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a89bd38-b40d-429f-b535-c9b48033ab97 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:23.245741 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a89bd38-b40d-429f-b535-c9b48033ab97 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1308 microversion: 2.1 time: 0.898694 Oct 04 18:09:23.246947 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1019/1983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:22 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1308 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:23.252433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:23.259907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:23.271755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.272547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.273185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.274148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.275325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.275981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.058023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.080329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.081993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.093116 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-791b22ea-cdc6-4aeb-97f7-55398c8f567a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1411 microversion: 2.25 time: 0.844672 Oct 04 18:09:24.113585 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1020/1984] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:23 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1411 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:24.125041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9a0bfb71-bfe7-402f-8e4f-00feb51cceb3 req-8e3f4ca9-edce-4977-8ea2-10ef2e81e218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bfba3c-5b12-4b4a-800c-c3a37b9da5e2", "name": "network-vif-plugged", "status": "completed", "tag": "d87be326-0818-410e-ad20-1bc0d3600186"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:24.169537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9a0bfb71-bfe7-402f-8e4f-00feb51cceb3 req-8e3f4ca9-edce-4977-8ea2-10ef2e81e218 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.176029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9a0bfb71-bfe7-402f-8e4f-00feb51cceb3 req-8e3f4ca9-edce-4977-8ea2-10ef2e81e218 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.176029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9a0bfb71-bfe7-402f-8e4f-00feb51cceb3 req-8e3f4ca9-edce-4977-8ea2-10ef2e81e218 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.216763 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9a0bfb71-bfe7-402f-8e4f-00feb51cceb3 req-8e3f4ca9-edce-4977-8ea2-10ef2e81e218 service nova] Creating event network-vif-plugged:d87be326-0818-410e-ad20-1bc0d3600186 for instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 on n-h1-850499-14 Oct 04 18:09:24.229373 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9a0bfb71-bfe7-402f-8e4f-00feb51cceb3 req-8e3f4ca9-edce-4977-8ea2-10ef2e81e218 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114544 Oct 04 18:09:24.232474 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1021/1985] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:24.240545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-25f19913-14d2-4491-b6f8-6d96f071201f req-1b3d224d-84de-4652-91ae-a6c7b21e8fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "381cd7a0-7761-4e5b-8b7a-345f828634ea", "tag": "9a53d5b7-c91a-4800-8ef7-ceb69419fc49"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:24.274618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-25f19913-14d2-4491-b6f8-6d96f071201f req-1b3d224d-84de-4652-91ae-a6c7b21e8fad service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.275507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-25f19913-14d2-4491-b6f8-6d96f071201f req-1b3d224d-84de-4652-91ae-a6c7b21e8fad service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.277027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-25f19913-14d2-4491-b6f8-6d96f071201f req-1b3d224d-84de-4652-91ae-a6c7b21e8fad service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.309435 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-25f19913-14d2-4491-b6f8-6d96f071201f req-1b3d224d-84de-4652-91ae-a6c7b21e8fad service nova] Creating event network-changed:9a53d5b7-c91a-4800-8ef7-ceb69419fc49 for instance 381cd7a0-7761-4e5b-8b7a-345f828634ea on n-h2-850499-14 Oct 04 18:09:24.317058 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-25f19913-14d2-4491-b6f8-6d96f071201f req-1b3d224d-84de-4652-91ae-a6c7b21e8fad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084033 Oct 04 18:09:24.318326 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1022/1986] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:24.324880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:24.327883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:24.341977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.342688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.346620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.348126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.348941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.349574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.638535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.657691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.663765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.684896 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-04ceee00-2e10-4834-90ba-decb63dcac5d tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.364116 Oct 04 18:09:24.685944 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1023/1987] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:24 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:24.699289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9d178e44-9b33-4a39-a09d-b5797ea109e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:24.700340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9d178e44-9b33-4a39-a09d-b5797ea109e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:24.708304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d178e44-9b33-4a39-a09d-b5797ea109e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.709230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d178e44-9b33-4a39-a09d-b5797ea109e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.710104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d178e44-9b33-4a39-a09d-b5797ea109e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.711130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d178e44-9b33-4a39-a09d-b5797ea109e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.711834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d178e44-9b33-4a39-a09d-b5797ea109e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.712543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d178e44-9b33-4a39-a09d-b5797ea109e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.846112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9d178e44-9b33-4a39-a09d-b5797ea109e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.861985 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9d178e44-9b33-4a39-a09d-b5797ea109e8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1183 microversion: 2.1 time: 0.167489 Oct 04 18:09:24.879278 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1024/1988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:24 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:24.910069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e78331f8-a4e5-43aa-b7f5-3cb8cbb18ea8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:24.910069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e78331f8-a4e5-43aa-b7f5-3cb8cbb18ea8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:24.920664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e78331f8-a4e5-43aa-b7f5-3cb8cbb18ea8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.925533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e78331f8-a4e5-43aa-b7f5-3cb8cbb18ea8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.926099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e78331f8-a4e5-43aa-b7f5-3cb8cbb18ea8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.926927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e78331f8-a4e5-43aa-b7f5-3cb8cbb18ea8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.929851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e78331f8-a4e5-43aa-b7f5-3cb8cbb18ea8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.931418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e78331f8-a4e5-43aa-b7f5-3cb8cbb18ea8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.190098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9792a30d-418a-495d-8890-75a2d7d9bb37 does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:09:25.192289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Neutron security group 9792a30d-418a-495d-8890-75a2d7d9bb37 not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:09:25.192885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.security_groups [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Security Group ID 9792a30d-418a-495d-8890-75a2d7d9bb37 does not exist {{(pid=122331) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 04 18:09:25.247124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e78331f8-a4e5-43aa-b7f5-3cb8cbb18ea8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:25.258171 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e78331f8-a4e5-43aa-b7f5-3cb8cbb18ea8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1308 microversion: 2.1 time: 0.374089 Oct 04 18:09:25.263763 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1025/1989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:24 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:25.279625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:25.280632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:25.291835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9792a30d-418a-495d-8890-75a2d7d9bb37 does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:09:25.292774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Neutron security group 9792a30d-418a-495d-8890-75a2d7d9bb37 not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:09:25.293480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.security_groups [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Security Group ID 9792a30d-418a-495d-8890-75a2d7d9bb37 does not exist {{(pid=122331) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 04 18:09:25.294683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.295675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.297087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.298703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.299588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.300187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.332920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b6e8ac55-ef9d-4a37-b562-400ec02a975d does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:09:25.334498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Neutron security group b6e8ac55-ef9d-4a37-b562-400ec02a975d not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:09:25.335875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.security_groups [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Security Group ID b6e8ac55-ef9d-4a37-b562-400ec02a975d does not exist {{(pid=122331) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 04 18:09:25.395360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b6e8ac55-ef9d-4a37-b562-400ec02a975d does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:09:25.396398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Neutron security group b6e8ac55-ef9d-4a37-b562-400ec02a975d not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:09:25.397098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.security_groups [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Security Group ID b6e8ac55-ef9d-4a37-b562-400ec02a975d does not exist {{(pid=122331) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 04 18:09:25.587131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:25.596335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:25.609032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:25.610352 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ac91fce-1531-4d32-97fd-be07a13122b8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1411 microversion: 2.25 time: 0.345139 Oct 04 18:09:25.622991 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1026/1990] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:25 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1411 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:26.030884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d6f2534-79bf-4c50-b998-23e0df37a15d tempest-FlavorsV2NegativeTest-91768444 tempest-FlavorsV2NegativeTest-91768444-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:26.051084 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d6f2534-79bf-4c50-b998-23e0df37a15d tempest-FlavorsV2NegativeTest-91768444 tempest-FlavorsV2NegativeTest-91768444-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.434460 Oct 04 18:09:26.055009 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1027/1991] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:09:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:26.064726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:26.065626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:26.092886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.093893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.094668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.096144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.096642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.097087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.166296 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-91023618-2d1b-4fa4-a1a0-ab3237772833 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9960 microversion: 2.1 time: 8.085221 Oct 04 18:09:26.167615 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 965/1992] 10.222.0.18 () {58 vars in 1191 bytes} [Tue Oct 4 18:09:18 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9960 bytes in 8087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:26.179019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac9314a6-0139-430a-8087-b19e7a881585 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:26.182902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ac9314a6-0139-430a-8087-b19e7a881585 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:26.211769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac9314a6-0139-430a-8087-b19e7a881585 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.212524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac9314a6-0139-430a-8087-b19e7a881585 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.212893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac9314a6-0139-430a-8087-b19e7a881585 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.213649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac9314a6-0139-430a-8087-b19e7a881585 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.214113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac9314a6-0139-430a-8087-b19e7a881585 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.217261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac9314a6-0139-430a-8087-b19e7a881585 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.264882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:26.286655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:26.304344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:26.329765 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-61ab9232-724b-4d9c-a2f8-ad352ae5ae2b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1553 microversion: 2.91 time: 0.265934 Oct 04 18:09:26.330837 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1028/1993] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:26 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1553 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:26.347215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1991531a-8395-413e-a489-0362b39dd097 tempest-SecurityGroupsTestAdminJSON-1753548296 tempest-SecurityGroupsTestAdminJSON-1753548296-project] Calling method '.version_select at 0x7fd4d6122160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:26.383682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ac9314a6-0139-430a-8087-b19e7a881585 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:26.411777 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ac9314a6-0139-430a-8087-b19e7a881585 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1183 microversion: 2.1 time: 0.242730 Oct 04 18:09:26.412373 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 966/1994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:26 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:26.442491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a4b735ad-0ea5-4349-ae2e-ea546c70abd2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:26.444564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a4b735ad-0ea5-4349-ae2e-ea546c70abd2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:26.484489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b735ad-0ea5-4349-ae2e-ea546c70abd2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.491558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b735ad-0ea5-4349-ae2e-ea546c70abd2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.494311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b735ad-0ea5-4349-ae2e-ea546c70abd2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.497588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b735ad-0ea5-4349-ae2e-ea546c70abd2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.505085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b735ad-0ea5-4349-ae2e-ea546c70abd2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.505784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b735ad-0ea5-4349-ae2e-ea546c70abd2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.077260 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1991531a-8395-413e-a489-0362b39dd097 tempest-SecurityGroupsTestAdminJSON-1753548296 tempest-SecurityGroupsTestAdminJSON-1753548296-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.744971 Oct 04 18:09:27.078673 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1029/1995] 10.222.0.18 () {58 vars in 1191 bytes} [Tue Oct 4 18:09:26 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:27.084341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:27.085329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:27.109159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.112520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.115796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.118234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.122682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.122940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.209988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a4b735ad-0ea5-4349-ae2e-ea546c70abd2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:27.219325 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a4b735ad-0ea5-4349-ae2e-ea546c70abd2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1487 microversion: 2.1 time: 0.800729 Oct 04 18:09:27.228523 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 967/1996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:26 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1487 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:27.247362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9320fad6-5819-4200-a6b8-c71e39e4ddf4 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Calling method '.version_select at 0x7fd4d1934ca0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:27.758712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:27.768008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:27.769488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:27.770689 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bee90da0-6bdc-44ac-8d19-ff57287c45fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1411 microversion: 2.25 time: 0.690156 Oct 04 18:09:27.784566 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1030/1997] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:27 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1411 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:27.815562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e696b26-8ebb-465f-85f2-1fe0516f8edc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:27.827125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e696b26-8ebb-465f-85f2-1fe0516f8edc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.838202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e696b26-8ebb-465f-85f2-1fe0516f8edc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.839437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e696b26-8ebb-465f-85f2-1fe0516f8edc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.008139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:28.019127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e696b26-8ebb-465f-85f2-1fe0516f8edc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Going to try to stop instance {{(pid=122332) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:09:28.180496 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e696b26-8ebb-465f-85f2-1fe0516f8edc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2/action" status: 202 len: 0 microversion: 2.1 time: 0.379254 Oct 04 18:09:28.181609 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1031/1998] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:27 2022] POST /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:28.187283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:28.198782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:28.226098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.234499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.239928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.247862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.248503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.248890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.475435 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9320fad6-5819-4200-a6b8-c71e39e4ddf4 tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/3da4c7c5-6946-4da2-bccf-13ed32c94c68" status: 202 len: 0 microversion: 2.1 time: 1.245410 Oct 04 18:09:28.477239 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 968/1999] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:27 2022] DELETE /compute/v2.1/os-security-groups/3da4c7c5-6946-4da2-bccf-13ed32c94c68 => generated 0 bytes in 1248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:28.482611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1156fbe0-856a-43e8-b5d9-2fe726e75226 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:28.484133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1156fbe0-856a-43e8-b5d9-2fe726e75226 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:28.513043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1156fbe0-856a-43e8-b5d9-2fe726e75226 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.518660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1156fbe0-856a-43e8-b5d9-2fe726e75226 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.519899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1156fbe0-856a-43e8-b5d9-2fe726e75226 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.526385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1156fbe0-856a-43e8-b5d9-2fe726e75226 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.528409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1156fbe0-856a-43e8-b5d9-2fe726e75226 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.533016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1156fbe0-856a-43e8-b5d9-2fe726e75226 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.580145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:28.596025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:28.598091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:28.608707 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f7dcaf14-0cfc-429b-b2c2-7863d7b6cb8e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1535 microversion: 2.91 time: 0.425589 Oct 04 18:09:28.610082 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1032/2000] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:28 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1535 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:28.615250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4496e753-e8d2-4ad6-b2f2-30f66b6ff0cc tempest-FlavorsV2NegativeTest-91768444 tempest-FlavorsV2NegativeTest-91768444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-140847909", "imageRef": "cfe785f9-f694-4a2c-9915-ef01956813ba", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:28.710878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-4496e753-e8d2-4ad6-b2f2-30f66b6ff0cc tempest-FlavorsV2NegativeTest-91768444 tempest-FlavorsV2NegativeTest-91768444-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:28.887549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1156fbe0-856a-43e8-b5d9-2fe726e75226 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:28.903201 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1156fbe0-856a-43e8-b5d9-2fe726e75226 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 200 len: 1183 microversion: 2.1 time: 0.422484 Oct 04 18:09:28.904781 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 969/2001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:28 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 1183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:28.922389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45a07e80-bdc2-4fea-88a8-2646c7220102 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:28.925209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45a07e80-bdc2-4fea-88a8-2646c7220102 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:28.941273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45a07e80-bdc2-4fea-88a8-2646c7220102 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.942109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45a07e80-bdc2-4fea-88a8-2646c7220102 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.942911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45a07e80-bdc2-4fea-88a8-2646c7220102 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.944881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45a07e80-bdc2-4fea-88a8-2646c7220102 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.945575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45a07e80-bdc2-4fea-88a8-2646c7220102 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.946209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45a07e80-bdc2-4fea-88a8-2646c7220102 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:29.913755 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-4496e753-e8d2-4ad6-b2f2-30f66b6ff0cc tempest-FlavorsV2NegativeTest-91768444 tempest-FlavorsV2NegativeTest-91768444-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4496e753-e8d2-4ad6-b2f2-30f66b6ff0cc tempest-FlavorsV2NegativeTest-91768444 tempest-FlavorsV2NegativeTest-91768444-project] Request method failure captured: Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 142 Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHbV6VQ0Nf-xyLViVws9kCmsX54bKdU00b2WW-iNdixuTe251Vvq1UixCvSs6DfhQoGda3-hexL6fhV_wFAyokVqu5XiaeJIF8mvP9UBmiXNJbIINHIWS5_5X79FHaWOTcHsPyqBI5zVkL-aANua7-mAxM5parKxwFx7i7rZXML4sg8 Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: c51ea657e9fc42868e1ec3749457f6b7 Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FlavorsV2NegativeTest-91768444 Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:09:29.917097 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c51ea657e9fc42868e1ec3749457f6b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c51ea657e9fc42868e1ec3749457f6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c51ea657e9fc42868e1ec3749457f6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c51ea657e9fc42868e1ec3749457f6b7"}]}] Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FlavorsV2NegativeTest-91768444 Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: c51ea657e9fc42868e1ec3749457f6b7 Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-91768444 Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FlavorsV2NegativeTest-91768444-project Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 164b96a4ec094ad0858a899800b39e47 Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FlavorsV2NegativeTest-91768444-project Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-140847909", "imageRef": "cfe785f9-f694-4a2c-9915-ef01956813ba", "flavorRef": "452"}} Oct 04 18:09:29.918860 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: exception: Flavor's memory is too small for requested image. Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-140847909', 'imageRef': 'cfe785f9-f694-4a2c-9915-ef01956813ba', 'flavorRef': '452'}}} Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:29.920126 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:09:29.921726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:29.924821 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:29.924821 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:29.924821 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:29.924821 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:29.924821 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 18:09:29.924821 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:09:29.924821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4496e753-e8d2-4ad6-b2f2-30f66b6ff0cc tempest-FlavorsV2NegativeTest-91768444 tempest-FlavorsV2NegativeTest-91768444-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:29.924821 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4496e753-e8d2-4ad6-b2f2-30f66b6ff0cc tempest-FlavorsV2NegativeTest-91768444 tempest-FlavorsV2NegativeTest-91768444-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.307356 Oct 04 18:09:29.924821 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1033/2002] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:09:28 2022] POST /compute/v2.1/servers => generated 93 bytes in 1309 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:09:29.935180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9137b53d-0fc4-4288-b3f3-44d013b785ad tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] Calling method '.version_select at 0x7fd4d61a05e0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:30.053831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-45a07e80-bdc2-4fea-88a8-2646c7220102 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.072303 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45a07e80-bdc2-4fea-88a8-2646c7220102 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 1.157615 Oct 04 18:09:30.074815 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 970/2003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:28 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:30.080555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:30.081176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:30.103462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.103980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.105099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.107758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.108479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.109111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.492226 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9137b53d-0fc4-4288-b3f3-44d013b785ad tempest-SecurityGroupsTestAdminJSON-172089012 tempest-SecurityGroupsTestAdminJSON-172089012-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/66f1ca1a-196c-487c-9936-4ff46192125f" status: 202 len: 0 microversion: 2.1 time: 0.570910 Oct 04 18:09:30.495312 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1034/2004] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:29 2022] DELETE /compute/v2.1/os-security-groups/66f1ca1a-196c-487c-9936-4ff46192125f => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:30.505852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:30.507720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:30.523275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.524352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.525068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.526100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.526898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.528211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.666130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.701562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.711126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.718879 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fed09d4f-bbc8-4678-9bae-c4169b701034 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1411 microversion: 2.25 time: 0.642236 Oct 04 18:09:30.723886 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 971/2005] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:30 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1411 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:30.738698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:30.760200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: fcc93dc3-d2ac-4450-92fd-63bbedaf9b92] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:30.762163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:30.804709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.814939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.816641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.817784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.818329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.818802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.820012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.820482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.820917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.850506 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb025adf-c226-43d5-9f16-dcf9f6401ef9 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1535 microversion: 2.91 time: 0.353671 Oct 04 18:09:30.858670 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1035/2006] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:30 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1535 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:30.866684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ec40a8ed-fe1c-4b16-be0d-0da76dc3f02a tempest-SecurityGroupsTestAdminJSON-1753548296 tempest-SecurityGroupsTestAdminJSON-1753548296-project] Calling method '.version_select at 0x7fd4d618bf70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:30.885026 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] HTTP exception thrown: Instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 could not be found. Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Request method failure captured: Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 HTTP/1.1 Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUJ3cjVSHexwIjEk6YYRPM4aeRk4n8Lb6xHENjLa6WH5tv19z26xN69bIxWjL3jQ5J-QxDshiZYPjbS01dCEcaGXiK89y_AtmcDXI028ikyjUCQnTgHvzfHJkS-p3hVAmhW6ehdckHNCSsHxqAMIC-7rytTPsIapW9yFGAI_qMueB4 Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: bc4df90b761348c082e7787ff4925299 Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-LiveMigrationTest-373582620 Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:09:30.886777 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc4df90b761348c082e7787ff4925299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc4df90b761348c082e7787ff4925299"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc4df90b761348c082e7787ff4925299"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc4df90b761348c082e7787ff4925299"}]}] Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-LiveMigrationTest-373582620 Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: bc4df90b761348c082e7787ff4925299 Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-LiveMigrationTest-373582620 Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-LiveMigrationTest-373582620-project Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 327e7f9ab3d74ff4a4d1bb86d15ad8fc Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-LiveMigrationTest-373582620-project Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 could not be found. Oct 04 18:09:30.888425 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'fcc93dc3-d2ac-4450-92fd-63bbedaf9b92'} Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 could not be found. Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:30.889348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 could not be found. Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 could not be found. Oct 04 18:09:30.890818 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:09:30.892270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Returning 404 to user: Instance fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:30.892270 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-62c72d92-adbf-473c-ad42-0d350b6efe31 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92" status: 404 len: 111 microversion: 2.1 time: 0.155258 Oct 04 18:09:30.892270 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 972/2007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:30 2022] GET /compute/v2.1/servers/fcc93dc3-d2ac-4450-92fd-63bbedaf9b92 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:31.102944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7419b4c5-3348-44c5-91d6-9464c3984233 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:31.103643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7419b4c5-3348-44c5-91d6-9464c3984233 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:31.121988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7419b4c5-3348-44c5-91d6-9464c3984233 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.123171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7419b4c5-3348-44c5-91d6-9464c3984233 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.123906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7419b4c5-3348-44c5-91d6-9464c3984233 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.124859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7419b4c5-3348-44c5-91d6-9464c3984233 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.125540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7419b4c5-3348-44c5-91d6-9464c3984233 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.126938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7419b4c5-3348-44c5-91d6-9464c3984233 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.555001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7419b4c5-3348-44c5-91d6-9464c3984233 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:31.573016 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7419b4c5-3348-44c5-91d6-9464c3984233 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.474929 Oct 04 18:09:31.573937 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 973/2008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:31 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:31.609049 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ec40a8ed-fe1c-4b16-be0d-0da76dc3f02a tempest-SecurityGroupsTestAdminJSON-1753548296 tempest-SecurityGroupsTestAdminJSON-1753548296-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d4eae56b-c9e7-4129-8ca6-a8cccd814007" status: 202 len: 0 microversion: 2.1 time: 0.748884 Oct 04 18:09:31.616294 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1036/2009] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:30 2022] DELETE /compute/v2.1/os-security-groups/d4eae56b-c9e7-4129-8ca6-a8cccd814007 => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:31.619631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6dee87a7-65bc-46b3-91a9-520a6d0092f4 tempest-SecurityGroupsTestAdminJSON-1753548296 tempest-SecurityGroupsTestAdminJSON-1753548296-project] Calling method '.version_select at 0x7fd4d19145e0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:31.957668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-536167500", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "f7c46616-3f5a-44e8-8d50-cd7f745c0ee2"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:32.038450 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6dee87a7-65bc-46b3-91a9-520a6d0092f4 tempest-SecurityGroupsTestAdminJSON-1753548296 tempest-SecurityGroupsTestAdminJSON-1753548296-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/7fad8197-a84f-41ea-85e1-1a6478f262d6" status: 202 len: 0 microversion: 2.1 time: 0.422647 Oct 04 18:09:32.039076 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 974/2010] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:31 2022] DELETE /compute/v2.1/os-security-groups/7fad8197-a84f-41ea-85e1-1a6478f262d6 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:32.049795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:32.050628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:32.077348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:32.078162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:32.081446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:32.101622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:32.103325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:32.106336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:32.109601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] validate_networks() for [('f7c46616-3f5a-44e8-8d50-cd7f745c0ee2', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:32.679674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:32.706662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:32.708641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:32.709325 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-275c0fea-86b8-49ec-8f23-2bc3c816e10d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1411 microversion: 2.25 time: 0.664942 Oct 04 18:09:32.709886 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 975/2011] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:32 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1411 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:32.736125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:32.736756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:32.752171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:32.752878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:32.753511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:32.754461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:32.755118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:32.755727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.073179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:33.082169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:33.098450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:33.123133 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2af7bfc6-9337-499a-be06-ca46dca3d5cd tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1478 microversion: 2.91 time: 0.395430 Oct 04 18:09:33.124980 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 976/2012] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:32 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1478 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:33.139084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-24a72063-0acf-45f3-88eb-43dfdc924629 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:33.139772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-24a72063-0acf-45f3-88eb-43dfdc924629 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:33.159414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24a72063-0acf-45f3-88eb-43dfdc924629 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.160513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24a72063-0acf-45f3-88eb-43dfdc924629 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.160972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24a72063-0acf-45f3-88eb-43dfdc924629 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.161729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24a72063-0acf-45f3-88eb-43dfdc924629 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.164367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24a72063-0acf-45f3-88eb-43dfdc924629 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.164842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24a72063-0acf-45f3-88eb-43dfdc924629 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.301747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:33.302193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:33.302539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:33.303612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:33.303891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:33.315945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.316928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.321111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.322797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.323613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.324993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.398848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Getting quotas for project 4bdc06e452984bf18267e832440ddcd9. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:33.406589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Getting quotas for user bf48879013734f8ca1ce5862895b8bcf and project 4bdc06e452984bf18267e832440ddcd9. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:33.425715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Going to run 3 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:33.429547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:33.494180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:33.511139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-24a72063-0acf-45f3-88eb-43dfdc924629 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:33.522411 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-24a72063-0acf-45f3-88eb-43dfdc924629 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.395189 Oct 04 18:09:33.524608 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 977/2013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:33 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:33.529530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-657f29d0-d023-4d89-bc8c-61fba8d43079 req-947b3402-2258-4da2-8d22-eaa01a0de609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381cd7a0-7761-4e5b-8b7a-345f828634ea", "name": "network-vif-plugged", "status": "completed", "tag": "9a53d5b7-c91a-4800-8ef7-ceb69419fc49"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:33.540018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-657f29d0-d023-4d89-bc8c-61fba8d43079 req-947b3402-2258-4da2-8d22-eaa01a0de609 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.541199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-657f29d0-d023-4d89-bc8c-61fba8d43079 req-947b3402-2258-4da2-8d22-eaa01a0de609 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.542105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-657f29d0-d023-4d89-bc8c-61fba8d43079 req-947b3402-2258-4da2-8d22-eaa01a0de609 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.551622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=858d86de-5fe8-43e9-9409-364826f1c48c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:33.561357 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-657f29d0-d023-4d89-bc8c-61fba8d43079 req-947b3402-2258-4da2-8d22-eaa01a0de609 service nova] Creating event network-vif-plugged:9a53d5b7-c91a-4800-8ef7-ceb69419fc49 for instance 381cd7a0-7761-4e5b-8b7a-345f828634ea on n-h2-850499-14 Oct 04 18:09:33.568961 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-657f29d0-d023-4d89-bc8c-61fba8d43079 req-947b3402-2258-4da2-8d22-eaa01a0de609 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041598 Oct 04 18:09:33.570407 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 978/2014] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:33.578607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4540a63c-a406-4b0d-bca7-3634731711a2 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:33.584887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4540a63c-a406-4b0d-bca7-3634731711a2 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:33.592517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4540a63c-a406-4b0d-bca7-3634731711a2 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.593338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4540a63c-a406-4b0d-bca7-3634731711a2 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.594024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4540a63c-a406-4b0d-bca7-3634731711a2 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.595616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4540a63c-a406-4b0d-bca7-3634731711a2 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.596332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4540a63c-a406-4b0d-bca7-3634731711a2 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.597840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4540a63c-a406-4b0d-bca7-3634731711a2 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.686603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4540a63c-a406-4b0d-bca7-3634731711a2 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-850499-14". {{(pid=122331) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:09:33.695121 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed022882-badb-4d5d-9ccb-5185fc473067 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.013690 Oct 04 18:09:33.696582 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1037/2015] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:09:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:09:33.713626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e92763a5-82e7-4232-be45-811f254bf230 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:33.727090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e92763a5-82e7-4232-be45-811f254bf230 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:33.730739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e92763a5-82e7-4232-be45-811f254bf230 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Searching by: {'deleted': False, 'project_id': '4bdc06e452984bf18267e832440ddcd9'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:09:33.734834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:33.774908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e92763a5-82e7-4232-be45-811f254bf230 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.775942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e92763a5-82e7-4232-be45-811f254bf230 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.776670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e92763a5-82e7-4232-be45-811f254bf230 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.777730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e92763a5-82e7-4232-be45-811f254bf230 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.778522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e92763a5-82e7-4232-be45-811f254bf230 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.779230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e92763a5-82e7-4232-be45-811f254bf230 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.812598 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e92763a5-82e7-4232-be45-811f254bf230 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.106502 Oct 04 18:09:33.814066 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1038/2016] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:09:33 2022] GET /compute/v2.1/servers => generated 1015 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:33.820908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:33.821914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:33.839811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.842607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.843453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.844229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:33.844780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:33.845225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:33.896467 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4540a63c-a406-4b0d-bca7-3634731711a2 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35/action" status: 202 len: 0 microversion: 2.91 time: 0.323647 Oct 04 18:09:33.903876 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 979/2017] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:09:33 2022] POST /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:33.914731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-229c024a-6c8e-4269-abc4-cc36b5a340bc tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:33.916374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-229c024a-6c8e-4269-abc4-cc36b5a340bc tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:34.118573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-229c024a-6c8e-4269-abc4-cc36b5a340bc tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.127723 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-229c024a-6c8e-4269-abc4-cc36b5a340bc tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1222 microversion: 2.1 time: 0.222314 Oct 04 18:09:34.144295 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 980/2018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:33 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1222 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:34.153147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:34.154823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:34.217545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.220730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.221735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.222867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.223712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.225065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.342973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.358641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.367479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.368788 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8dc97f2e-324f-47c6-8a94-ed0e23cc53b5 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1411 microversion: 2.25 time: 0.552200 Oct 04 18:09:34.369379 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1039/2019] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:33 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1411 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:34.447855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.505655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.520433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.538640 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-291ff58d-3bca-4ba7-a6f4-90362a870e19 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1486 microversion: 2.91 time: 0.388226 Oct 04 18:09:34.540200 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 981/2020] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:34 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1486 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:34.556455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b2a0b56e-0e60-45a9-bc51-015bbd9de164 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:34.558850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b2a0b56e-0e60-45a9-bc51-015bbd9de164 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:34.581197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2a0b56e-0e60-45a9-bc51-015bbd9de164 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.586613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2a0b56e-0e60-45a9-bc51-015bbd9de164 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.587268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2a0b56e-0e60-45a9-bc51-015bbd9de164 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.593919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2a0b56e-0e60-45a9-bc51-015bbd9de164 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.611816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2a0b56e-0e60-45a9-bc51-015bbd9de164 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.615818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2a0b56e-0e60-45a9-bc51-015bbd9de164 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.920255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b2a0b56e-0e60-45a9-bc51-015bbd9de164 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.931293 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b2a0b56e-0e60-45a9-bc51-015bbd9de164 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.386715 Oct 04 18:09:34.942553 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1040/2021] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:34 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:35.156394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be5af08c-5dcf-4ae9-861b-43d54593eb18 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:35.158419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be5af08c-5dcf-4ae9-861b-43d54593eb18 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:35.314814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be5af08c-5dcf-4ae9-861b-43d54593eb18 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:35.353057 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be5af08c-5dcf-4ae9-861b-43d54593eb18 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1222 microversion: 2.1 time: 0.187487 Oct 04 18:09:35.353057 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 982/2022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:35 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:35.394454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:35.395198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:35.411780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.418985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.420635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:35.428216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.443893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.444561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:35.581718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:35.582645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:35.598066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.598583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.599189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:35.599920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.600381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.600809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:35.853690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:35.875334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:35.897361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:35.929789 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0945fc53-e383-4092-9bd2-b96b1dd9bb3b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1488 microversion: 2.91 time: 0.343931 Oct 04 18:09:35.930389 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 983/2023] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:35 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1488 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:09:35.972253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7805c98f-c0d5-4acd-8bbe-355f0f49a468 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:35.972889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7805c98f-c0d5-4acd-8bbe-355f0f49a468 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:35.995886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7805c98f-c0d5-4acd-8bbe-355f0f49a468 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.996758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7805c98f-c0d5-4acd-8bbe-355f0f49a468 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.997238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7805c98f-c0d5-4acd-8bbe-355f0f49a468 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:36.014306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7805c98f-c0d5-4acd-8bbe-355f0f49a468 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:36.023411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7805c98f-c0d5-4acd-8bbe-355f0f49a468 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:36.025036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7805c98f-c0d5-4acd-8bbe-355f0f49a468 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:36.668394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:36.698757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:36.708007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:36.714352 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dcba529f-f06f-441f-8c8f-138232a8bdd1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1411 microversion: 2.25 time: 1.319571 Oct 04 18:09:36.718584 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1041/2024] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:35 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1411 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:36.737878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4994b159-0fe3-48ed-aab4-e03b2e76b467 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:36.760121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4994b159-0fe3-48ed-aab4-e03b2e76b467 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:36.816609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4994b159-0fe3-48ed-aab4-e03b2e76b467 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:36.821104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4994b159-0fe3-48ed-aab4-e03b2e76b467 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:36.821977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4994b159-0fe3-48ed-aab4-e03b2e76b467 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:36.837110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4994b159-0fe3-48ed-aab4-e03b2e76b467 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:36.838360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4994b159-0fe3-48ed-aab4-e03b2e76b467 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:36.847324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4994b159-0fe3-48ed-aab4-e03b2e76b467 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:36.933599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7805c98f-c0d5-4acd-8bbe-355f0f49a468 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:36.961565 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7805c98f-c0d5-4acd-8bbe-355f0f49a468 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.981119 Oct 04 18:09:36.964649 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 984/2025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:35 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:36.989314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:36.991356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:37.016132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.019860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.020410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.025604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.026109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.026554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.167491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4994b159-0fe3-48ed-aab4-e03b2e76b467 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:37.180034 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4994b159-0fe3-48ed-aab4-e03b2e76b467 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1226 microversion: 2.1 time: 0.458852 Oct 04 18:09:37.186170 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1042/2026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:36 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1226 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:37.299407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:37.318241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:37.320142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:37.335657 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b344f68-3da9-479a-9f02-954133b36fbb tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.362568 Oct 04 18:09:37.336333 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 985/2027] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:36 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:37.748168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:37.748772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:37.781445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.784107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.786090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.798909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.799561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.800012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.002272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c37ae3b8-d940-4f46-bc22-1219ccae2646 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:38.003368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c37ae3b8-d940-4f46-bc22-1219ccae2646 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:38.027927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37ae3b8-d940-4f46-bc22-1219ccae2646 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:38.028437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37ae3b8-d940-4f46-bc22-1219ccae2646 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:38.028875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37ae3b8-d940-4f46-bc22-1219ccae2646 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.052226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37ae3b8-d940-4f46-bc22-1219ccae2646 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:38.053185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37ae3b8-d940-4f46-bc22-1219ccae2646 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:38.053185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37ae3b8-d940-4f46-bc22-1219ccae2646 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.146828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:39.133333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.145162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.162440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.164554 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dcf60b28-4492-490c-aab4-f091a32eb604 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1607 microversion: 2.25 time: 1.423375 Oct 04 18:09:39.167089 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1043/2028] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:37 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1607 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:39.187918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cf3756da-3ae8-46ae-be30-7aa0f32b9f99 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:39.189521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cf3756da-3ae8-46ae-be30-7aa0f32b9f99 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:39.217909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf3756da-3ae8-46ae-be30-7aa0f32b9f99 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.223205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf3756da-3ae8-46ae-be30-7aa0f32b9f99 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.224650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf3756da-3ae8-46ae-be30-7aa0f32b9f99 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.250582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf3756da-3ae8-46ae-be30-7aa0f32b9f99 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.254373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf3756da-3ae8-46ae-be30-7aa0f32b9f99 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.254927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf3756da-3ae8-46ae-be30-7aa0f32b9f99 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.878073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cf3756da-3ae8-46ae-be30-7aa0f32b9f99 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.900402 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cf3756da-3ae8-46ae-be30-7aa0f32b9f99 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1274 microversion: 2.1 time: 0.727713 Oct 04 18:09:39.904193 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1044/2029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:39 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1274 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:39.919797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:39.929141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:39.951172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.956235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.957286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.958246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.958892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.963357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.037126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c37ae3b8-d940-4f46-bc22-1219ccae2646 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.076898 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c37ae3b8-d940-4f46-bc22-1219ccae2646 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 2.082931 Oct 04 18:09:40.081996 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 986/2030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:37 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:40.247162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.263244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.265069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.288725 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-99f08c72-f598-4126-a840-47d1ee6f5b65 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.377881 Oct 04 18:09:40.290096 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1045/2031] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:39 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:40.317722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-15806cff-f7a2-423e-a118-7692032327d9 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:40.321503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-15806cff-f7a2-423e-a118-7692032327d9 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:40.354857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15806cff-f7a2-423e-a118-7692032327d9 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.358778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15806cff-f7a2-423e-a118-7692032327d9 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.359651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15806cff-f7a2-423e-a118-7692032327d9 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.363865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15806cff-f7a2-423e-a118-7692032327d9 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.365610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15806cff-f7a2-423e-a118-7692032327d9 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.368287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15806cff-f7a2-423e-a118-7692032327d9 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.589214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-501970733", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:40.608571 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-15806cff-f7a2-423e-a118-7692032327d9 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.315462 Oct 04 18:09:40.609756 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1046/2032] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 4 18:09:40 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-interface => generated 285 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:09:40.697999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:40.932254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9199ce2d-eb23-4754-ae3a-84c89131d15c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:40.934045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9199ce2d-eb23-4754-ae3a-84c89131d15c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:40.982182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9199ce2d-eb23-4754-ae3a-84c89131d15c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.983111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9199ce2d-eb23-4754-ae3a-84c89131d15c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.990883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9199ce2d-eb23-4754-ae3a-84c89131d15c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.993129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9199ce2d-eb23-4754-ae3a-84c89131d15c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.999574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9199ce2d-eb23-4754-ae3a-84c89131d15c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.002795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9199ce2d-eb23-4754-ae3a-84c89131d15c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.694361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9199ce2d-eb23-4754-ae3a-84c89131d15c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:41.717972 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9199ce2d-eb23-4754-ae3a-84c89131d15c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1280 microversion: 2.1 time: 0.791367 Oct 04 18:09:41.735809 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1047/2033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:40 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1280 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:41.747059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78e303d1-f90a-4296-b7d1-ef314e95607b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:41.747059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78e303d1-f90a-4296-b7d1-ef314e95607b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:41.772353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78e303d1-f90a-4296-b7d1-ef314e95607b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.772903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78e303d1-f90a-4296-b7d1-ef314e95607b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.781803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78e303d1-f90a-4296-b7d1-ef314e95607b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.782728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78e303d1-f90a-4296-b7d1-ef314e95607b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.783253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78e303d1-f90a-4296-b7d1-ef314e95607b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.783696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78e303d1-f90a-4296-b7d1-ef314e95607b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.107005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78e303d1-f90a-4296-b7d1-ef314e95607b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:43.121811 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78e303d1-f90a-4296-b7d1-ef314e95607b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 1.388213 Oct 04 18:09:43.122508 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1048/2034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:41 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:43.134130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:43.138106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:43.153348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.156407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.157679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.160474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.163518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.164219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.416721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:43.606581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:43.607150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:43.607517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:43.608274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:43.608884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:43.640480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.640741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.644796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.645986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.646651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.647303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.697308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:43.700917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Getting quotas for project 23ca16963de94a4889dd27ddf6f87415. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:43.714382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:43.715554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Getting quotas for user 34e1743c012844919c05429542d30f7b and project 23ca16963de94a4889dd27ddf6f87415. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:43.717242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:43.743625 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5f8e9b32-1fc6-4c40-b43b-f17c527899be tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.616847 Oct 04 18:09:43.744782 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1049/2035] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:43 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:43.763021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5186e87f-6526-4ebd-8244-d3d777ddb5b1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:43.764760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5186e87f-6526-4ebd-8244-d3d777ddb5b1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:43.774497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:43.776906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5186e87f-6526-4ebd-8244-d3d777ddb5b1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.777811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5186e87f-6526-4ebd-8244-d3d777ddb5b1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.779361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5186e87f-6526-4ebd-8244-d3d777ddb5b1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.783945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5186e87f-6526-4ebd-8244-d3d777ddb5b1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.784685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5186e87f-6526-4ebd-8244-d3d777ddb5b1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.785202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5186e87f-6526-4ebd-8244-d3d777ddb5b1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.792591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:43.824186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:43.860688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5186e87f-6526-4ebd-8244-d3d777ddb5b1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:43.990342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:44.002173 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-82fd4179-0b8c-451b-9700-803e53bf9e14 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.907528 Oct 04 18:09:44.006667 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 987/2036] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:09:44.053786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a871582c-68a0-4fb3-a9e4-a9a48033dd73 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:44.077665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a871582c-68a0-4fb3-a9e4-a9a48033dd73 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:44.136266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a871582c-68a0-4fb3-a9e4-a9a48033dd73 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.139024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a871582c-68a0-4fb3-a9e4-a9a48033dd73 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.139024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a871582c-68a0-4fb3-a9e4-a9a48033dd73 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.149472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a871582c-68a0-4fb3-a9e4-a9a48033dd73 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.151457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a871582c-68a0-4fb3-a9e4-a9a48033dd73 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.153052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a871582c-68a0-4fb3-a9e4-a9a48033dd73 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.164224 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5186e87f-6526-4ebd-8244-d3d777ddb5b1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "DELETE /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 204 len: 0 microversion: 2.1 time: 0.403308 Oct 04 18:09:44.166099 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1050/2037] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:43 2022] DELETE /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:44.199519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-94a4b52c-bf5f-4644-925c-74e74e1dbbbb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:44.203420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-94a4b52c-bf5f-4644-925c-74e74e1dbbbb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:44.506127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-94a4b52c-bf5f-4644-925c-74e74e1dbbbb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:44.515680 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-94a4b52c-bf5f-4644-925c-74e74e1dbbbb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1222 microversion: 2.1 time: 0.343627 Oct 04 18:09:44.540642 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1051/2038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:44 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1222 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:44.551689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5a0a5b3e-064e-4a93-a523-a7e8ccd96b7b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:44.552699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5a0a5b3e-064e-4a93-a523-a7e8ccd96b7b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:44.557239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a871582c-68a0-4fb3-a9e4-a9a48033dd73 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:44.568162 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a871582c-68a0-4fb3-a9e4-a9a48033dd73 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1280 microversion: 2.1 time: 0.560035 Oct 04 18:09:44.575975 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 988/2039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:44 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1280 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:44.584144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aebf3034-0f5c-465f-a054-e37cf05c3dcb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:44.604274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aebf3034-0f5c-465f-a054-e37cf05c3dcb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:44.604639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0a5b3e-064e-4a93-a523-a7e8ccd96b7b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.605481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0a5b3e-064e-4a93-a523-a7e8ccd96b7b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.607487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0a5b3e-064e-4a93-a523-a7e8ccd96b7b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.611780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0a5b3e-064e-4a93-a523-a7e8ccd96b7b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.612597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0a5b3e-064e-4a93-a523-a7e8ccd96b7b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.613293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0a5b3e-064e-4a93-a523-a7e8ccd96b7b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.632401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebf3034-0f5c-465f-a054-e37cf05c3dcb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.641139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebf3034-0f5c-465f-a054-e37cf05c3dcb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.642025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebf3034-0f5c-465f-a054-e37cf05c3dcb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.643183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebf3034-0f5c-465f-a054-e37cf05c3dcb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.651340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebf3034-0f5c-465f-a054-e37cf05c3dcb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.652202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebf3034-0f5c-465f-a054-e37cf05c3dcb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.489244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5a0a5b3e-064e-4a93-a523-a7e8ccd96b7b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:45.498797 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5a0a5b3e-064e-4a93-a523-a7e8ccd96b7b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.956943 Oct 04 18:09:45.505588 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1052/2040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:44 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:45.527010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:45.534439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:45.550052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.550726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.551374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.552223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.552800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.558509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.609167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aebf3034-0f5c-465f-a054-e37cf05c3dcb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.619847 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aebf3034-0f5c-465f-a054-e37cf05c3dcb tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1669 microversion: 2.1 time: 2.039662 Oct 04 18:09:46.646022 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 989/2041] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:44 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1669 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:46.665944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-141fca12-d022-4cfe-8be2-4f656bea7eaf tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:46.675348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-141fca12-d022-4cfe-8be2-4f656bea7eaf tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:46.692983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-141fca12-d022-4cfe-8be2-4f656bea7eaf tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.693753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-141fca12-d022-4cfe-8be2-4f656bea7eaf tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.694442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.695108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-141fca12-d022-4cfe-8be2-4f656bea7eaf tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.697733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-141fca12-d022-4cfe-8be2-4f656bea7eaf tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.698421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-141fca12-d022-4cfe-8be2-4f656bea7eaf tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.699960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-141fca12-d022-4cfe-8be2-4f656bea7eaf tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.728403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.740511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.772734 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-936ef919-1966-4091-840d-24f5a8eed1fc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 1.254890 Oct 04 18:09:46.775797 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1053/2042] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:45 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:46.802543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bd879fc6-61d3-40d8-a4af-671dfc9eb98a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:46.804509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bd879fc6-61d3-40d8-a4af-671dfc9eb98a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:46.846327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd879fc6-61d3-40d8-a4af-671dfc9eb98a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.849419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd879fc6-61d3-40d8-a4af-671dfc9eb98a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.850220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd879fc6-61d3-40d8-a4af-671dfc9eb98a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.853583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd879fc6-61d3-40d8-a4af-671dfc9eb98a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.854527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd879fc6-61d3-40d8-a4af-671dfc9eb98a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.855650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd879fc6-61d3-40d8-a4af-671dfc9eb98a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.872571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-141fca12-d022-4cfe-8be2-4f656bea7eaf tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.890436 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-141fca12-d022-4cfe-8be2-4f656bea7eaf tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1274 microversion: 2.1 time: 0.239532 Oct 04 18:09:46.915619 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 990/2043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:46 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:46.933719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f7d7634-3b2b-4a06-a305-cb70a916476e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:46.939860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f7d7634-3b2b-4a06-a305-cb70a916476e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:46.955266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7d7634-3b2b-4a06-a305-cb70a916476e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.956822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7d7634-3b2b-4a06-a305-cb70a916476e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.957850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7d7634-3b2b-4a06-a305-cb70a916476e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.966940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7d7634-3b2b-4a06-a305-cb70a916476e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.967921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7d7634-3b2b-4a06-a305-cb70a916476e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.968929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f7d7634-3b2b-4a06-a305-cb70a916476e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.732857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f7d7634-3b2b-4a06-a305-cb70a916476e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:47.752779 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f7d7634-3b2b-4a06-a305-cb70a916476e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.829451 Oct 04 18:09:47.756386 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 991/2044] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:46 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:47.787956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99636690-6652-4aaa-a3f1-fb56a4b31e89 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:47.788763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99636690-6652-4aaa-a3f1-fb56a4b31e89 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:47.819197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99636690-6652-4aaa-a3f1-fb56a4b31e89 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.820060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99636690-6652-4aaa-a3f1-fb56a4b31e89 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.820530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99636690-6652-4aaa-a3f1-fb56a4b31e89 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.821305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99636690-6652-4aaa-a3f1-fb56a4b31e89 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.821775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99636690-6652-4aaa-a3f1-fb56a4b31e89 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.822207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99636690-6652-4aaa-a3f1-fb56a4b31e89 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.965814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99636690-6652-4aaa-a3f1-fb56a4b31e89 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:48.235607 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99636690-6652-4aaa-a3f1-fb56a4b31e89 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 204 len: 0 microversion: 2.1 time: 0.470401 Oct 04 18:09:48.241586 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 992/2045] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:47 2022] DELETE /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:48.251213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bd879fc6-61d3-40d8-a4af-671dfc9eb98a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.256475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ca2adb9-01be-4674-8cc9-0f7ea9fdce30 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:48.259126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9ca2adb9-01be-4674-8cc9-0f7ea9fdce30 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:48.277305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca2adb9-01be-4674-8cc9-0f7ea9fdce30 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.277881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca2adb9-01be-4674-8cc9-0f7ea9fdce30 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.278401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca2adb9-01be-4674-8cc9-0f7ea9fdce30 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.279250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca2adb9-01be-4674-8cc9-0f7ea9fdce30 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.283043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca2adb9-01be-4674-8cc9-0f7ea9fdce30 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.286101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca2adb9-01be-4674-8cc9-0f7ea9fdce30 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.312107 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bd879fc6-61d3-40d8-a4af-671dfc9eb98a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1322 microversion: 2.1 time: 1.530122 Oct 04 18:09:48.332611 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1054/2046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:46 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1322 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:48.342283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:48.364137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:48.384590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.393485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.394246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.395988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.396813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.396918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.615381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.624900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.626456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.649644 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6dbe85d7-7eb0-4eda-a3f1-de6ac4ba0e5a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.313226 Oct 04 18:09:48.650317 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1055/2047] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:48 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:48.658187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5e3988f9-44ab-4d3f-a9ec-a31aa25f45aa tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:48.661640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5e3988f9-44ab-4d3f-a9ec-a31aa25f45aa tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:48.676539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e3988f9-44ab-4d3f-a9ec-a31aa25f45aa tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.677981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e3988f9-44ab-4d3f-a9ec-a31aa25f45aa tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.678645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e3988f9-44ab-4d3f-a9ec-a31aa25f45aa tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.681944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e3988f9-44ab-4d3f-a9ec-a31aa25f45aa tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.682644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e3988f9-44ab-4d3f-a9ec-a31aa25f45aa tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.683360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e3988f9-44ab-4d3f-a9ec-a31aa25f45aa tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.825834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ca2adb9-01be-4674-8cc9-0f7ea9fdce30 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.835374 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ca2adb9-01be-4674-8cc9-0f7ea9fdce30 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1669 microversion: 2.1 time: 0.591924 Oct 04 18:09:48.851984 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 993/2048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:48 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1669 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:48.858245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b37729fc-3763-4ad9-b421-b278a1ddbcbe req-0161917a-4fad-4df1-8a1b-a5014bdd8552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "381cd7a0-7761-4e5b-8b7a-345f828634ea", "tag": "9a53d5b7-c91a-4800-8ef7-ceb69419fc49"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:48.869786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b37729fc-3763-4ad9-b421-b278a1ddbcbe req-0161917a-4fad-4df1-8a1b-a5014bdd8552 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.870647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b37729fc-3763-4ad9-b421-b278a1ddbcbe req-0161917a-4fad-4df1-8a1b-a5014bdd8552 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.871356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b37729fc-3763-4ad9-b421-b278a1ddbcbe req-0161917a-4fad-4df1-8a1b-a5014bdd8552 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.883110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5e3988f9-44ab-4d3f-a9ec-a31aa25f45aa tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.885748 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b37729fc-3763-4ad9-b421-b278a1ddbcbe req-0161917a-4fad-4df1-8a1b-a5014bdd8552 service nova] Creating event network-changed:9a53d5b7-c91a-4800-8ef7-ceb69419fc49 for instance 381cd7a0-7761-4e5b-8b7a-345f828634ea on n-h2-850499-14 Oct 04 18:09:48.891725 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5e3988f9-44ab-4d3f-a9ec-a31aa25f45aa tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1280 microversion: 2.1 time: 0.239909 Oct 04 18:09:48.896474 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1056/2049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:48 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1280 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:48.903984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b63f64ab-8c2d-4727-9683-5f17fc64e78c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:48.908710 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b37729fc-3763-4ad9-b421-b278a1ddbcbe req-0161917a-4fad-4df1-8a1b-a5014bdd8552 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054976 Oct 04 18:09:48.909986 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 994/2050] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:48.911120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b63f64ab-8c2d-4727-9683-5f17fc64e78c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:48.916420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd5e889e-f8e6-415e-91a7-636440a38a72 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:48.917486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd5e889e-f8e6-415e-91a7-636440a38a72 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:48.921804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b63f64ab-8c2d-4727-9683-5f17fc64e78c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.922259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b63f64ab-8c2d-4727-9683-5f17fc64e78c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.922774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b63f64ab-8c2d-4727-9683-5f17fc64e78c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.923534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b63f64ab-8c2d-4727-9683-5f17fc64e78c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.924007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b63f64ab-8c2d-4727-9683-5f17fc64e78c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.924441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b63f64ab-8c2d-4727-9683-5f17fc64e78c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.928529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd5e889e-f8e6-415e-91a7-636440a38a72 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.929375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd5e889e-f8e6-415e-91a7-636440a38a72 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.930052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd5e889e-f8e6-415e-91a7-636440a38a72 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.931093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd5e889e-f8e6-415e-91a7-636440a38a72 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.931797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd5e889e-f8e6-415e-91a7-636440a38a72 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.932460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd5e889e-f8e6-415e-91a7-636440a38a72 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.492393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fd5e889e-f8e6-415e-91a7-636440a38a72 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.502137 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd5e889e-f8e6-415e-91a7-636440a38a72 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.590668 Oct 04 18:09:49.522985 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 995/2051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:48 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:49.522985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-613d7495-64f2-4166-a11e-aa7f2c5ae83c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:49.522985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-613d7495-64f2-4166-a11e-aa7f2c5ae83c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:49.529567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b63f64ab-8c2d-4727-9683-5f17fc64e78c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.543082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-613d7495-64f2-4166-a11e-aa7f2c5ae83c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.543647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-613d7495-64f2-4166-a11e-aa7f2c5ae83c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.544422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-613d7495-64f2-4166-a11e-aa7f2c5ae83c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.545548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-613d7495-64f2-4166-a11e-aa7f2c5ae83c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.546122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-613d7495-64f2-4166-a11e-aa7f2c5ae83c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.546831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-613d7495-64f2-4166-a11e-aa7f2c5ae83c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.552720 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b63f64ab-8c2d-4727-9683-5f17fc64e78c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1554 microversion: 2.1 time: 0.654797 Oct 04 18:09:49.553329 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1057/2052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:48 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1554 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:49.687548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:49.689312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:49.702892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.703483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.704659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.705764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.706439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.709105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.958066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.980793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.983346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.990680 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e7d7fb1c-2bc0-4a2f-887c-a979affcd333 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.312628 Oct 04 18:09:49.992139 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1058/2053] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:49 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:09:49.999260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00ef9541-c5ee-4e8f-9fdb-9d28e7381273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:50.000129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00ef9541-c5ee-4e8f-9fdb-9d28e7381273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:50.008083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ef9541-c5ee-4e8f-9fdb-9d28e7381273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.011647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ef9541-c5ee-4e8f-9fdb-9d28e7381273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.013305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ef9541-c5ee-4e8f-9fdb-9d28e7381273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.015445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ef9541-c5ee-4e8f-9fdb-9d28e7381273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.017844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ef9541-c5ee-4e8f-9fdb-9d28e7381273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.018414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ef9541-c5ee-4e8f-9fdb-9d28e7381273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.419574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-613d7495-64f2-4166-a11e-aa7f2c5ae83c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:50.449000 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-613d7495-64f2-4166-a11e-aa7f2c5ae83c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1322 microversion: 2.1 time: 0.935849 Oct 04 18:09:50.450393 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 996/2054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:49 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1322 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:50.457194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-015a4183-cc9b-4c87-91db-644101a9d45c tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:50.461006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-015a4183-cc9b-4c87-91db-644101a9d45c tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:50.469013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00ef9541-c5ee-4e8f-9fdb-9d28e7381273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:50.475785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-015a4183-cc9b-4c87-91db-644101a9d45c tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.477143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-015a4183-cc9b-4c87-91db-644101a9d45c tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.478792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-015a4183-cc9b-4c87-91db-644101a9d45c tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.479696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-015a4183-cc9b-4c87-91db-644101a9d45c tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.481223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-015a4183-cc9b-4c87-91db-644101a9d45c tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.482777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-015a4183-cc9b-4c87-91db-644101a9d45c tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.483289 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00ef9541-c5ee-4e8f-9fdb-9d28e7381273 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1601 microversion: 2.1 time: 0.488261 Oct 04 18:09:50.499841 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1059/2055] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:49 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1601 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:50.519341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-99eb432a-230e-4250-9749-e681e2fbec96 req-59853f0c-74ea-4aae-9acc-08ac7ee45c35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d94795-de6c-4946-ae72-68ae4c497228", "tag": "4f5bf8c3-59a9-4ef9-9478-c38d330d2eb0"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:50.540615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-99eb432a-230e-4250-9749-e681e2fbec96 req-59853f0c-74ea-4aae-9acc-08ac7ee45c35 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.542078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-99eb432a-230e-4250-9749-e681e2fbec96 req-59853f0c-74ea-4aae-9acc-08ac7ee45c35 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.543083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-99eb432a-230e-4250-9749-e681e2fbec96 req-59853f0c-74ea-4aae-9acc-08ac7ee45c35 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.575071 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-99eb432a-230e-4250-9749-e681e2fbec96 req-59853f0c-74ea-4aae-9acc-08ac7ee45c35 service nova] Creating event network-changed:4f5bf8c3-59a9-4ef9-9478-c38d330d2eb0 for instance f6d94795-de6c-4946-ae72-68ae4c497228 on n-h1-850499-14 Oct 04 18:09:50.592934 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-99eb432a-230e-4250-9749-e681e2fbec96 req-59853f0c-74ea-4aae-9acc-08ac7ee45c35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081585 Oct 04 18:09:50.595081 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1060/2056] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:50.607665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-30a6bf23-be76-425a-9378-ae7480baf378 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:50.608917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-30a6bf23-be76-425a-9378-ae7480baf378 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:50.634115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30a6bf23-be76-425a-9378-ae7480baf378 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.634651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30a6bf23-be76-425a-9378-ae7480baf378 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.635522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30a6bf23-be76-425a-9378-ae7480baf378 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.636347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30a6bf23-be76-425a-9378-ae7480baf378 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.636821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30a6bf23-be76-425a-9378-ae7480baf378 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.637271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30a6bf23-be76-425a-9378-ae7480baf378 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.737054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-015a4183-cc9b-4c87-91db-644101a9d45c tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:50.763181 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-015a4183-cc9b-4c87-91db-644101a9d45c tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1280 microversion: 2.1 time: 0.311036 Oct 04 18:09:50.765687 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 997/2057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:50 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1280 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:50.774559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-61c4c3cc-9119-434d-9b01-2b25a1dd6222 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:50.775931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-61c4c3cc-9119-434d-9b01-2b25a1dd6222 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:50.816959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c4c3cc-9119-434d-9b01-2b25a1dd6222 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.817853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c4c3cc-9119-434d-9b01-2b25a1dd6222 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.818542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c4c3cc-9119-434d-9b01-2b25a1dd6222 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.819754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c4c3cc-9119-434d-9b01-2b25a1dd6222 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.820446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c4c3cc-9119-434d-9b01-2b25a1dd6222 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.833899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c4c3cc-9119-434d-9b01-2b25a1dd6222 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.187282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-30a6bf23-be76-425a-9378-ae7480baf378 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.200534 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-30a6bf23-be76-425a-9378-ae7480baf378 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.603694 Oct 04 18:09:51.202613 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1061/2058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:50 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:51.211723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-863444da-0b41-4f0c-8066-9ebc55256d9f req-3ca2453e-233a-47db-af8c-790730b98cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513fb23f-209f-4de1-add7-84c46117aace", "name": "network-vif-deleted", "tag": "ae27d040-17cf-482a-b391-3a571eec78cd"}, {"name": "network-changed", "server_uuid": "ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc", "tag": "37f5965c-e639-4376-a067-f8aeab3bea4d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:51.237479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-863444da-0b41-4f0c-8066-9ebc55256d9f req-3ca2453e-233a-47db-af8c-790730b98cc8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.240085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-863444da-0b41-4f0c-8066-9ebc55256d9f req-3ca2453e-233a-47db-af8c-790730b98cc8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.241202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-863444da-0b41-4f0c-8066-9ebc55256d9f req-3ca2453e-233a-47db-af8c-790730b98cc8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.281760 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-863444da-0b41-4f0c-8066-9ebc55256d9f req-3ca2453e-233a-47db-af8c-790730b98cc8 service nova] Creating event network-vif-deleted:ae27d040-17cf-482a-b391-3a571eec78cd for instance 513fb23f-209f-4de1-add7-84c46117aace on n-h2-850499-14 Oct 04 18:09:51.283601 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-863444da-0b41-4f0c-8066-9ebc55256d9f req-3ca2453e-233a-47db-af8c-790730b98cc8 service nova] Creating event network-changed:37f5965c-e639-4376-a067-f8aeab3bea4d for instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc on n-h1-850499-14 Oct 04 18:09:51.302501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-863444da-0b41-4f0c-8066-9ebc55256d9f req-3ca2453e-233a-47db-af8c-790730b98cc8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.094381 Oct 04 18:09:51.307638 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1062/2059] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:51.317679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:51.328149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:51.343012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.343848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.344588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.348342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.349116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.349749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.526346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61c4c3cc-9119-434d-9b01-2b25a1dd6222 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.536813 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-61c4c3cc-9119-434d-9b01-2b25a1dd6222 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1554 microversion: 2.1 time: 0.766987 Oct 04 18:09:51.542898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.552391 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 998/2060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:50 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1554 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:51.564332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e2b25d43-a06e-4801-a9ea-33aa2f6dd429 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:51.564577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.567430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e2b25d43-a06e-4801-a9ea-33aa2f6dd429 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:51.582691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b25d43-a06e-4801-a9ea-33aa2f6dd429 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.585913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b25d43-a06e-4801-a9ea-33aa2f6dd429 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.586727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b25d43-a06e-4801-a9ea-33aa2f6dd429 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.587297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.588049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b25d43-a06e-4801-a9ea-33aa2f6dd429 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.589953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b25d43-a06e-4801-a9ea-33aa2f6dd429 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.590596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2b25d43-a06e-4801-a9ea-33aa2f6dd429 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.605911 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2f7ea5e8-79fa-434a-8db5-4495114b3c50 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.296118 Oct 04 18:09:51.607159 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1063/2061] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:51 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:51.613211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-48446e8a-a0fc-4003-bf41-5056bdca4c3e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:51.637169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-48446e8a-a0fc-4003-bf41-5056bdca4c3e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:51.659238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48446e8a-a0fc-4003-bf41-5056bdca4c3e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.660311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48446e8a-a0fc-4003-bf41-5056bdca4c3e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.660966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48446e8a-a0fc-4003-bf41-5056bdca4c3e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.662410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48446e8a-a0fc-4003-bf41-5056bdca4c3e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.667685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48446e8a-a0fc-4003-bf41-5056bdca4c3e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.669016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48446e8a-a0fc-4003-bf41-5056bdca4c3e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.949679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-48446e8a-a0fc-4003-bf41-5056bdca4c3e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.975853 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-48446e8a-a0fc-4003-bf41-5056bdca4c3e tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1601 microversion: 2.1 time: 0.367292 Oct 04 18:09:51.981039 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1064/2062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:51 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1601 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:51.994785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e755c8fc-9d00-443b-98c8-f9dc98c2a1a2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:51.995457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e755c8fc-9d00-443b-98c8-f9dc98c2a1a2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:52.027261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e755c8fc-9d00-443b-98c8-f9dc98c2a1a2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.027777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e755c8fc-9d00-443b-98c8-f9dc98c2a1a2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.028234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e755c8fc-9d00-443b-98c8-f9dc98c2a1a2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.028970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e755c8fc-9d00-443b-98c8-f9dc98c2a1a2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.029446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e755c8fc-9d00-443b-98c8-f9dc98c2a1a2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.029889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e755c8fc-9d00-443b-98c8-f9dc98c2a1a2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.291935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e2b25d43-a06e-4801-a9ea-33aa2f6dd429 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.308099 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e2b25d43-a06e-4801-a9ea-33aa2f6dd429 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1322 microversion: 2.1 time: 0.754317 Oct 04 18:09:52.311392 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 999/2063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:51 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1322 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:52.320529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ab0fde8-62f4-43d8-944e-87fa49bb43bd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:52.330824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3ab0fde8-62f4-43d8-944e-87fa49bb43bd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:52.357860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab0fde8-62f4-43d8-944e-87fa49bb43bd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.359116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab0fde8-62f4-43d8-944e-87fa49bb43bd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.360497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab0fde8-62f4-43d8-944e-87fa49bb43bd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.361931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab0fde8-62f4-43d8-944e-87fa49bb43bd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.364220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab0fde8-62f4-43d8-944e-87fa49bb43bd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.367485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab0fde8-62f4-43d8-944e-87fa49bb43bd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.510637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e755c8fc-9d00-443b-98c8-f9dc98c2a1a2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.529777 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e755c8fc-9d00-443b-98c8-f9dc98c2a1a2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1322 microversion: 2.1 time: 0.547494 Oct 04 18:09:52.531125 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1065/2064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:51 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:52.567734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-be7226ea-fed1-4804-8682-3cba2812ab07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:52.569385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-be7226ea-fed1-4804-8682-3cba2812ab07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:52.580426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be7226ea-fed1-4804-8682-3cba2812ab07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.581672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be7226ea-fed1-4804-8682-3cba2812ab07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.582324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be7226ea-fed1-4804-8682-3cba2812ab07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.583298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be7226ea-fed1-4804-8682-3cba2812ab07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.583947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be7226ea-fed1-4804-8682-3cba2812ab07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.584562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be7226ea-fed1-4804-8682-3cba2812ab07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.713828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3ab0fde8-62f4-43d8-944e-87fa49bb43bd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.726850 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ab0fde8-62f4-43d8-944e-87fa49bb43bd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.414288 Oct 04 18:09:52.728102 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1000/2065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:52 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:52.733565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:52.734193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:52.755201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.755718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.756180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.756919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.760790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.761448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.838125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be7226ea-fed1-4804-8682-3cba2812ab07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.853138 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-be7226ea-fed1-4804-8682-3cba2812ab07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1554 microversion: 2.1 time: 0.287686 Oct 04 18:09:52.879319 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1066/2066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:52 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1554 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:52.993210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.003251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-41e3eaf2-f11c-4a47-b725-5ee47e5384ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:53.003886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-41e3eaf2-f11c-4a47-b725-5ee47e5384ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.006064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.008716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.012547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e3eaf2-f11c-4a47-b725-5ee47e5384ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.013327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e3eaf2-f11c-4a47-b725-5ee47e5384ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.013976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e3eaf2-f11c-4a47-b725-5ee47e5384ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.015736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e3eaf2-f11c-4a47-b725-5ee47e5384ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.017011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e3eaf2-f11c-4a47-b725-5ee47e5384ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.017658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e3eaf2-f11c-4a47-b725-5ee47e5384ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.029292 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-93c16c0d-2905-4848-8934-ab5553f2dadc tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.299771 Oct 04 18:09:53.030079 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1001/2067] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:52 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:53.132186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-41e3eaf2-f11c-4a47-b725-5ee47e5384ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.140708 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-41e3eaf2-f11c-4a47-b725-5ee47e5384ef tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1601 microversion: 2.1 time: 0.141515 Oct 04 18:09:53.142540 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1067/2068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:52 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1601 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:53.339091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-11f7191c-c605-41bb-a853-c9a26a898f49 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:53.340381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-11f7191c-c605-41bb-a853-c9a26a898f49 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.351500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11f7191c-c605-41bb-a853-c9a26a898f49 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.353540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11f7191c-c605-41bb-a853-c9a26a898f49 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.354004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11f7191c-c605-41bb-a853-c9a26a898f49 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.354772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11f7191c-c605-41bb-a853-c9a26a898f49 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.357496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11f7191c-c605-41bb-a853-c9a26a898f49 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.358975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11f7191c-c605-41bb-a853-c9a26a898f49 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.563597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-68426625-0859-48c5-aabf-23d3c6985819 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:53.564673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-68426625-0859-48c5-aabf-23d3c6985819 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.589989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68426625-0859-48c5-aabf-23d3c6985819 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.591394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68426625-0859-48c5-aabf-23d3c6985819 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.592051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68426625-0859-48c5-aabf-23d3c6985819 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.593033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68426625-0859-48c5-aabf-23d3c6985819 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.593685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68426625-0859-48c5-aabf-23d3c6985819 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.594850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68426625-0859-48c5-aabf-23d3c6985819 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.673523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:53.709949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-11f7191c-c605-41bb-a853-c9a26a898f49 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.714077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:53.723889 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-11f7191c-c605-41bb-a853-c9a26a898f49 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1322 microversion: 2.1 time: 0.388650 Oct 04 18:09:53.745451 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1002/2069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:53 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:53.758724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-782d2d5b-0f20-4652-8c50-a9ab39a1abe7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:53.759702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-782d2d5b-0f20-4652-8c50-a9ab39a1abe7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.766632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:53.768983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-782d2d5b-0f20-4652-8c50-a9ab39a1abe7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.769872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-782d2d5b-0f20-4652-8c50-a9ab39a1abe7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.771984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-782d2d5b-0f20-4652-8c50-a9ab39a1abe7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.773085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-782d2d5b-0f20-4652-8c50-a9ab39a1abe7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.773780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-782d2d5b-0f20-4652-8c50-a9ab39a1abe7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.774383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-782d2d5b-0f20-4652-8c50-a9ab39a1abe7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.894115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-68426625-0859-48c5-aabf-23d3c6985819 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.903712 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-68426625-0859-48c5-aabf-23d3c6985819 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1322 microversion: 2.1 time: 0.344772 Oct 04 18:09:53.913724 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1068/2070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:53 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:53.924980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-21a22f73-d6ab-4355-9785-6d780e7315b3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:53.925782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-21a22f73-d6ab-4355-9785-6d780e7315b3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.932582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a22f73-d6ab-4355-9785-6d780e7315b3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.933247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a22f73-d6ab-4355-9785-6d780e7315b3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.933814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a22f73-d6ab-4355-9785-6d780e7315b3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.934832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a22f73-d6ab-4355-9785-6d780e7315b3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.935570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a22f73-d6ab-4355-9785-6d780e7315b3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.936303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a22f73-d6ab-4355-9785-6d780e7315b3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.951532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:54.132241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-782d2d5b-0f20-4652-8c50-a9ab39a1abe7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.161361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-782d2d5b-0f20-4652-8c50-a9ab39a1abe7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.406349 Oct 04 18:09:54.167358 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1003/2071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:53 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:54.181075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.182030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:54.216736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:54.218361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.218873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.219424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.220170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.220632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.221186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.233535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-21a22f73-d6ab-4355-9785-6d780e7315b3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.267416 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-21a22f73-d6ab-4355-9785-6d780e7315b3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1554 microversion: 2.1 time: 0.331993 Oct 04 18:09:54.270578 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1069/2072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:53 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1554 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:54.295673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-86478d2a-0935-4b91-8ea9-7d72a7b0917a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.305834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-86478d2a-0935-4b91-8ea9-7d72a7b0917a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:54.328015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86478d2a-0935-4b91-8ea9-7d72a7b0917a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.330105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86478d2a-0935-4b91-8ea9-7d72a7b0917a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.331363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86478d2a-0935-4b91-8ea9-7d72a7b0917a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.333485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86478d2a-0935-4b91-8ea9-7d72a7b0917a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.335756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86478d2a-0935-4b91-8ea9-7d72a7b0917a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.337849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86478d2a-0935-4b91-8ea9-7d72a7b0917a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.368252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.379496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.380896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.399365 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-61ac6636-2c8d-4c6b-9332-1b7746e08725 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.230568 Oct 04 18:09:54.400338 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1004/2073] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:54.443455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86478d2a-0935-4b91-8ea9-7d72a7b0917a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.456807 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-86478d2a-0935-4b91-8ea9-7d72a7b0917a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1601 microversion: 2.1 time: 0.184589 Oct 04 18:09:54.460456 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1070/2074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1601 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:54.758111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93f71658-3ac0-43c7-ad04-7272d989396c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.760716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-93f71658-3ac0-43c7-ad04-7272d989396c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:54.775201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93f71658-3ac0-43c7-ad04-7272d989396c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.775861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93f71658-3ac0-43c7-ad04-7272d989396c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.776417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93f71658-3ac0-43c7-ad04-7272d989396c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.777620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93f71658-3ac0-43c7-ad04-7272d989396c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.782121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93f71658-3ac0-43c7-ad04-7272d989396c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.783007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93f71658-3ac0-43c7-ad04-7272d989396c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.840830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-28d2e598-ddaf-4e69-81c9-43150c4f0a75 req-a8a6ffb0-7099-4dfb-8bf1-b9dd12e0e524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a466a26b-a6a8-473e-a42b-e1d1c71c2c35", "name": "network-vif-unplugged", "status": "completed", "tag": "feb69b4e-25f6-4f92-bd6c-b253d86b7e8e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:54.853880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:54.878837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-28d2e598-ddaf-4e69-81c9-43150c4f0a75 req-a8a6ffb0-7099-4dfb-8bf1-b9dd12e0e524 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.882736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-28d2e598-ddaf-4e69-81c9-43150c4f0a75 req-a8a6ffb0-7099-4dfb-8bf1-b9dd12e0e524 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.884505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-28d2e598-ddaf-4e69-81c9-43150c4f0a75 req-a8a6ffb0-7099-4dfb-8bf1-b9dd12e0e524 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.950714 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-28d2e598-ddaf-4e69-81c9-43150c4f0a75 req-a8a6ffb0-7099-4dfb-8bf1-b9dd12e0e524 service nova] Creating event network-vif-unplugged:feb69b4e-25f6-4f92-bd6c-b253d86b7e8e for instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 on n-h2-850499-14 Oct 04 18:09:54.964680 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-28d2e598-ddaf-4e69-81c9-43150c4f0a75 req-a8a6ffb0-7099-4dfb-8bf1-b9dd12e0e524 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129185 Oct 04 18:09:54.970292 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1071/2075] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:54.986172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-584129b8-1d0c-48b8-b59b-49c3989b7bc7 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.987470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-584129b8-1d0c-48b8-b59b-49c3989b7bc7 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:55.007794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-584129b8-1d0c-48b8-b59b-49c3989b7bc7 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.008840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-584129b8-1d0c-48b8-b59b-49c3989b7bc7 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.009924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-584129b8-1d0c-48b8-b59b-49c3989b7bc7 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.012200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-584129b8-1d0c-48b8-b59b-49c3989b7bc7 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.014262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-584129b8-1d0c-48b8-b59b-49c3989b7bc7 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.015309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-584129b8-1d0c-48b8-b59b-49c3989b7bc7 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.271743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93f71658-3ac0-43c7-ad04-7272d989396c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:55.286672 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-93f71658-3ac0-43c7-ad04-7272d989396c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1322 microversion: 2.1 time: 0.537270 Oct 04 18:09:55.289620 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1005/2076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:55.330609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c29bfcef-b9b5-4be7-8afe-0834fcbad482 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:55.339315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c29bfcef-b9b5-4be7-8afe-0834fcbad482 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:55.371250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c29bfcef-b9b5-4be7-8afe-0834fcbad482 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.374993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c29bfcef-b9b5-4be7-8afe-0834fcbad482 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.384655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c29bfcef-b9b5-4be7-8afe-0834fcbad482 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.385621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c29bfcef-b9b5-4be7-8afe-0834fcbad482 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.386133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c29bfcef-b9b5-4be7-8afe-0834fcbad482 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.386589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c29bfcef-b9b5-4be7-8afe-0834fcbad482 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.428516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-584129b8-1d0c-48b8-b59b-49c3989b7bc7 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:55.462749 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-584129b8-1d0c-48b8-b59b-49c3989b7bc7 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1322 microversion: 2.1 time: 0.490646 Oct 04 18:09:55.463969 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1072/2077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:55.476380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b3124204-aab3-4dc9-a1b0-b7b092aee9bb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:55.478598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b3124204-aab3-4dc9-a1b0-b7b092aee9bb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:55.488128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3124204-aab3-4dc9-a1b0-b7b092aee9bb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.489030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3124204-aab3-4dc9-a1b0-b7b092aee9bb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.489725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3124204-aab3-4dc9-a1b0-b7b092aee9bb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.490715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3124204-aab3-4dc9-a1b0-b7b092aee9bb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.491511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3124204-aab3-4dc9-a1b0-b7b092aee9bb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.492197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3124204-aab3-4dc9-a1b0-b7b092aee9bb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.538889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c29bfcef-b9b5-4be7-8afe-0834fcbad482 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.549663 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c29bfcef-b9b5-4be7-8afe-0834fcbad482 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 1.253847 Oct 04 18:09:56.579344 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1006/2078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:55 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:56.584673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:56.585316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:56.625325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.626545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.627171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.634229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.635034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.635695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.661361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b3124204-aab3-4dc9-a1b0-b7b092aee9bb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.677343 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b3124204-aab3-4dc9-a1b0-b7b092aee9bb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1554 microversion: 2.1 time: 1.211364 Oct 04 18:09:56.680627 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1073/2079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:55 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1554 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:56.700131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-404728e7-d7ef-4c98-b2cb-334d327bd5dd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:56.700908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-404728e7-d7ef-4c98-b2cb-334d327bd5dd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:56.729964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-404728e7-d7ef-4c98-b2cb-334d327bd5dd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.731537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-404728e7-d7ef-4c98-b2cb-334d327bd5dd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.734517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-404728e7-d7ef-4c98-b2cb-334d327bd5dd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.739296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-404728e7-d7ef-4c98-b2cb-334d327bd5dd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.740342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-404728e7-d7ef-4c98-b2cb-334d327bd5dd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.741255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-404728e7-d7ef-4c98-b2cb-334d327bd5dd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.817662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.839827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.840370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-404728e7-d7ef-4c98-b2cb-334d327bd5dd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.843531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.856465 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-404728e7-d7ef-4c98-b2cb-334d327bd5dd tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1319 microversion: 2.1 time: 0.174318 Oct 04 18:09:56.857804 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c37eda25-e340-4244-a484-b3349829ca38 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.275453 Oct 04 18:09:56.874116 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1007/2080] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:56 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:56.884148 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1074/2081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:56 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:56.892681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d02b80a-0c54-48f7-83cf-7a07b8713089 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:56.893828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d02b80a-0c54-48f7-83cf-7a07b8713089 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:56.903159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d02b80a-0c54-48f7-83cf-7a07b8713089 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.903991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d02b80a-0c54-48f7-83cf-7a07b8713089 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.904741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d02b80a-0c54-48f7-83cf-7a07b8713089 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.907038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d02b80a-0c54-48f7-83cf-7a07b8713089 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.907774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d02b80a-0c54-48f7-83cf-7a07b8713089 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.908448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d02b80a-0c54-48f7-83cf-7a07b8713089 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.985342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1067816544", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "61d1d0bf-30e4-4740-8b71-20dd29f08efb"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:57.086639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] validate_networks() for [('61d1d0bf-30e4-4740-8b71-20dd29f08efb', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:57.687544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d02b80a-0c54-48f7-83cf-7a07b8713089 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:57.715855 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d02b80a-0c54-48f7-83cf-7a07b8713089 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1322 microversion: 2.1 time: 0.839696 Oct 04 18:09:57.721598 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1008/2082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:56 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1322 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:57.738296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8e3ebb34-2ef3-4fb1-9697-9f59637f1f45 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:57.739659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8e3ebb34-2ef3-4fb1-9697-9f59637f1f45 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:57.752852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e3ebb34-2ef3-4fb1-9697-9f59637f1f45 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.753785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e3ebb34-2ef3-4fb1-9697-9f59637f1f45 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.754507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e3ebb34-2ef3-4fb1-9697-9f59637f1f45 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.755721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e3ebb34-2ef3-4fb1-9697-9f59637f1f45 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.756473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e3ebb34-2ef3-4fb1-9697-9f59637f1f45 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.757553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e3ebb34-2ef3-4fb1-9697-9f59637f1f45 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.026074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:58.026655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:58.027470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:58.028202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:58.028746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:58.052341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.055443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.056895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.058936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.063879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.064502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.084684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8e3ebb34-2ef3-4fb1-9697-9f59637f1f45 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.086865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Getting quotas for project 197a6854a6a949b88eae7d185688d461. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:58.092497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:58.093429 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8e3ebb34-2ef3-4fb1-9697-9f59637f1f45 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1322 microversion: 2.1 time: 0.367212 Oct 04 18:09:58.093961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Getting quotas for user aa469d1847b5434eaa545db65834a323 and project 197a6854a6a949b88eae7d185688d461. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:58.095349 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1009/2083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:57 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:58.100293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-6b0586a6-11b5-476f-9938-ec25996d6184 req-8562b576-be47-4870-b4a6-3b9b123e8021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3352785-cdd3-4a48-bd8f-6c0cfacff173", "tag": "75b96692-98cb-4fe0-8702-0069060c372a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:58.113628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6b0586a6-11b5-476f-9938-ec25996d6184 req-8562b576-be47-4870-b4a6-3b9b123e8021 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.114941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6b0586a6-11b5-476f-9938-ec25996d6184 req-8562b576-be47-4870-b4a6-3b9b123e8021 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.116002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6b0586a6-11b5-476f-9938-ec25996d6184 req-8562b576-be47-4870-b4a6-3b9b123e8021 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.127378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:58.129775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:58.130739 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-6b0586a6-11b5-476f-9938-ec25996d6184 req-8562b576-be47-4870-b4a6-3b9b123e8021 service nova] Creating event network-changed:75b96692-98cb-4fe0-8702-0069060c372a for instance d3352785-cdd3-4a48-bd8f-6c0cfacff173 on n-h1-850499-14 Oct 04 18:09:58.136164 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-6b0586a6-11b5-476f-9938-ec25996d6184 req-8562b576-be47-4870-b4a6-3b9b123e8021 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039334 Oct 04 18:09:58.137610 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1010/2084] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:58.145651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-6d37815d-a2c1-495d-84a1-bded6797306c req-8976de24-44bf-4193-a3e8-9fbb8053e0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d94795-de6c-4946-ae72-68ae4c497228", "name": "network-vif-plugged", "status": "completed", "tag": "4f5bf8c3-59a9-4ef9-9478-c38d330d2eb0"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:58.157390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6d37815d-a2c1-495d-84a1-bded6797306c req-8976de24-44bf-4193-a3e8-9fbb8053e0f9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.158266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6d37815d-a2c1-495d-84a1-bded6797306c req-8976de24-44bf-4193-a3e8-9fbb8053e0f9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.159020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6d37815d-a2c1-495d-84a1-bded6797306c req-8976de24-44bf-4193-a3e8-9fbb8053e0f9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.171773 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-6d37815d-a2c1-495d-84a1-bded6797306c req-8976de24-44bf-4193-a3e8-9fbb8053e0f9 service nova] Creating event network-vif-plugged:4f5bf8c3-59a9-4ef9-9478-c38d330d2eb0 for instance f6d94795-de6c-4946-ae72-68ae4c497228 on n-h1-850499-14 Oct 04 18:09:58.178199 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-6d37815d-a2c1-495d-84a1-bded6797306c req-8976de24-44bf-4193-a3e8-9fbb8053e0f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036445 Oct 04 18:09:58.179634 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1011/2085] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:58.188052 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2ed7cdc-d9a7-4d9f-b41f-f5ec78dc2465 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.309003 Oct 04 18:09:58.189009 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1075/2086] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:09:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:09:58.194632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-08ef6d94-9e83-434e-808a-bf8439e5949e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.195722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-08ef6d94-9e83-434e-808a-bf8439e5949e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.197945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-68dc0d7b-dac3-4f62-8885-08801637ded5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.198628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-68dc0d7b-dac3-4f62-8885-08801637ded5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.203091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ef6d94-9e83-434e-808a-bf8439e5949e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.204378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ef6d94-9e83-434e-808a-bf8439e5949e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.204824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ef6d94-9e83-434e-808a-bf8439e5949e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.205542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ef6d94-9e83-434e-808a-bf8439e5949e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.206002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ef6d94-9e83-434e-808a-bf8439e5949e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.206628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ef6d94-9e83-434e-808a-bf8439e5949e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.212592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dc0d7b-dac3-4f62-8885-08801637ded5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.213101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dc0d7b-dac3-4f62-8885-08801637ded5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.213553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dc0d7b-dac3-4f62-8885-08801637ded5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.214272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dc0d7b-dac3-4f62-8885-08801637ded5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.214737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dc0d7b-dac3-4f62-8885-08801637ded5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.215206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dc0d7b-dac3-4f62-8885-08801637ded5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.454706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-68dc0d7b-dac3-4f62-8885-08801637ded5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.467902 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-68dc0d7b-dac3-4f62-8885-08801637ded5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1497 microversion: 2.1 time: 0.286256 Oct 04 18:09:58.479002 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1012/2087] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1497 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:58.479002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8cc7cb3e-8640-42b8-bfaf-9feb584ce4a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.479513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8cc7cb3e-8640-42b8-bfaf-9feb584ce4a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.485777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08ef6d94-9e83-434e-808a-bf8439e5949e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.486215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc7cb3e-8640-42b8-bfaf-9feb584ce4a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.486805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc7cb3e-8640-42b8-bfaf-9feb584ce4a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.487179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc7cb3e-8640-42b8-bfaf-9feb584ce4a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.487945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc7cb3e-8640-42b8-bfaf-9feb584ce4a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.488378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc7cb3e-8640-42b8-bfaf-9feb584ce4a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.488799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc7cb3e-8640-42b8-bfaf-9feb584ce4a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.501531 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-08ef6d94-9e83-434e-808a-bf8439e5949e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1554 microversion: 2.1 time: 0.311043 Oct 04 18:09:58.515878 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1076/2088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1554 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:58.524789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.525875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.538428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.539061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.539573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.543163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.544493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.545009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.575133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8cc7cb3e-8640-42b8-bfaf-9feb584ce4a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.585578 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8cc7cb3e-8640-42b8-bfaf-9feb584ce4a7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1319 microversion: 2.1 time: 0.113159 Oct 04 18:09:58.586711 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1013/2089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1319 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:58.591710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f94bc63c-2643-4333-9a7d-3f6b48ab7c0a tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.592734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f94bc63c-2643-4333-9a7d-3f6b48ab7c0a tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.636269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.650848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.653701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.662493 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0856fff7-74a7-4d29-b797-b4664ac0f95a tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.144580 Oct 04 18:09:58.675492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f94bc63c-2643-4333-9a7d-3f6b48ab7c0a tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.677001 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1077/2090] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:58.684745 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f94bc63c-2643-4333-9a7d-3f6b48ab7c0a tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1224 microversion: 2.1 time: 0.096647 Oct 04 18:09:58.686877 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1014/2091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:58.746121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-058d5f32-035a-4b46-9e26-5ce269e2030f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.747021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-058d5f32-035a-4b46-9e26-5ce269e2030f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.754716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-058d5f32-035a-4b46-9e26-5ce269e2030f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.755325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-058d5f32-035a-4b46-9e26-5ce269e2030f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.756013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-058d5f32-035a-4b46-9e26-5ce269e2030f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.756993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-058d5f32-035a-4b46-9e26-5ce269e2030f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.757690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-058d5f32-035a-4b46-9e26-5ce269e2030f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.758360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-058d5f32-035a-4b46-9e26-5ce269e2030f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.910321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-058d5f32-035a-4b46-9e26-5ce269e2030f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.918643 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-058d5f32-035a-4b46-9e26-5ce269e2030f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1322 microversion: 2.1 time: 0.176344 Oct 04 18:09:58.919301 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1078/2092] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:59.118084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b33e064d-4ac1-42ca-be24-995983064510 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:59.118720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b33e064d-4ac1-42ca-be24-995983064510 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:59.148783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b33e064d-4ac1-42ca-be24-995983064510 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.149304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b33e064d-4ac1-42ca-be24-995983064510 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.149760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b33e064d-4ac1-42ca-be24-995983064510 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.150499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b33e064d-4ac1-42ca-be24-995983064510 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.155008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b33e064d-4ac1-42ca-be24-995983064510 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.155008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b33e064d-4ac1-42ca-be24-995983064510 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.480773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b33e064d-4ac1-42ca-be24-995983064510 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:59.491644 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b33e064d-4ac1-42ca-be24-995983064510 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1322 microversion: 2.1 time: 0.377596 Oct 04 18:09:59.507178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b087a9a8-2b34-4ac2-833d-af546a358610 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:59.507178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b087a9a8-2b34-4ac2-833d-af546a358610 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:59.507178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b087a9a8-2b34-4ac2-833d-af546a358610 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.507178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b087a9a8-2b34-4ac2-833d-af546a358610 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.507940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b087a9a8-2b34-4ac2-833d-af546a358610 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.507940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b087a9a8-2b34-4ac2-833d-af546a358610 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.507940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b087a9a8-2b34-4ac2-833d-af546a358610 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.507940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b087a9a8-2b34-4ac2-833d-af546a358610 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.516246 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1015/2093] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:59 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:59.530516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-72f39162-7710-444a-9df5-3ff0d436697f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:59.540850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-72f39162-7710-444a-9df5-3ff0d436697f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:59.548390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72f39162-7710-444a-9df5-3ff0d436697f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.548990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72f39162-7710-444a-9df5-3ff0d436697f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.549490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72f39162-7710-444a-9df5-3ff0d436697f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.550368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72f39162-7710-444a-9df5-3ff0d436697f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.550916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72f39162-7710-444a-9df5-3ff0d436697f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.551449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72f39162-7710-444a-9df5-3ff0d436697f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.862417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b087a9a8-2b34-4ac2-833d-af546a358610 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:59.871934 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b087a9a8-2b34-4ac2-833d-af546a358610 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 200 len: 1474 microversion: 2.1 time: 0.382425 Oct 04 18:09:59.876262 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1079/2094] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:59 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 1474 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:59.888913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-72f39162-7710-444a-9df5-3ff0d436697f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:59.900741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:59.901954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:59.904315 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-72f39162-7710-444a-9df5-3ff0d436697f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1554 microversion: 2.1 time: 0.377732 Oct 04 18:09:59.914582 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1016/2095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:59 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1554 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:59.930083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:59.930362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.930477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:59.930585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.930585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.932445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.932445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.932445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.942073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.944800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.947579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.950391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.951308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.951431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.028077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.029550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.030236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.030919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lazy-loading 'fault' on Instance uuid 513fb23f-209f-4de1-add7-84c46117aace {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:00.132624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.136049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.143090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.144579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.154943 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-08ee2e3e-17a3-43c8-ade4-9d77d0e10447 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1324 microversion: 2.1 time: 0.277340 Oct 04 18:10:00.156973 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fbded87c-a7ce-48ee-9e17-abcdcbe935ed tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.250436 Oct 04 18:10:00.158526 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1080/2096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:59 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:00.170157 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1017/2097] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:59 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:00.183568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd6a39c8-1f88-4f47-bfc4-7871340583e2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:00.184211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cd6a39c8-1f88-4f47-bfc4-7871340583e2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:00.191472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd6a39c8-1f88-4f47-bfc4-7871340583e2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.192298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd6a39c8-1f88-4f47-bfc4-7871340583e2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.193031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd6a39c8-1f88-4f47-bfc4-7871340583e2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.194462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd6a39c8-1f88-4f47-bfc4-7871340583e2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.195412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd6a39c8-1f88-4f47-bfc4-7871340583e2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.196128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd6a39c8-1f88-4f47-bfc4-7871340583e2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.196620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-78739aa7-d995-4ede-9e93-a19df450e649 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-755938605"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:00.204441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-78739aa7-d995-4ede-9e93-a19df450e649 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:00.211924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78739aa7-d995-4ede-9e93-a19df450e649 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.212430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78739aa7-d995-4ede-9e93-a19df450e649 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.212949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78739aa7-d995-4ede-9e93-a19df450e649 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.213742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78739aa7-d995-4ede-9e93-a19df450e649 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.214197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78739aa7-d995-4ede-9e93-a19df450e649 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.214621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78739aa7-d995-4ede-9e93-a19df450e649 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.330073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cd6a39c8-1f88-4f47-bfc4-7871340583e2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.339730 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cd6a39c8-1f88-4f47-bfc4-7871340583e2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1220 microversion: 2.1 time: 0.168908 Oct 04 18:10:00.341110 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1081/2098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:00 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:00.346320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e07a278d-7a68-40a0-a00f-932d5ef9b13c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:00.347080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e07a278d-7a68-40a0-a00f-932d5ef9b13c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:00.355825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e07a278d-7a68-40a0-a00f-932d5ef9b13c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.356423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e07a278d-7a68-40a0-a00f-932d5ef9b13c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.356946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e07a278d-7a68-40a0-a00f-932d5ef9b13c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.357740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e07a278d-7a68-40a0-a00f-932d5ef9b13c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.358287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e07a278d-7a68-40a0-a00f-932d5ef9b13c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.358733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e07a278d-7a68-40a0-a00f-932d5ef9b13c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.556791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e07a278d-7a68-40a0-a00f-932d5ef9b13c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.561607 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-78739aa7-d995-4ede-9e93-a19df450e649 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2/action" status: 202 len: 0 microversion: 2.1 time: 0.390902 Oct 04 18:10:00.569140 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1018/2099] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:00 2022] POST /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:10:00.575927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-29906051-8a1c-480f-8c45-b2db0f312b42 req-59075b1d-97b8-47f2-803e-947ce5b274b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858d86de-5fe8-43e9-9409-364826f1c48c", "tag": "e872f74e-c019-41cc-bb6f-c40a21a59d12"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:00.600436 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e07a278d-7a68-40a0-a00f-932d5ef9b13c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1322 microversion: 2.1 time: 0.251289 Oct 04 18:10:00.600609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-29906051-8a1c-480f-8c45-b2db0f312b42 req-59075b1d-97b8-47f2-803e-947ce5b274b1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.600609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-29906051-8a1c-480f-8c45-b2db0f312b42 req-59075b1d-97b8-47f2-803e-947ce5b274b1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.600609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-29906051-8a1c-480f-8c45-b2db0f312b42 req-59075b1d-97b8-47f2-803e-947ce5b274b1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.615341 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1082/2100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:00 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:00.618310 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-29906051-8a1c-480f-8c45-b2db0f312b42 req-59075b1d-97b8-47f2-803e-947ce5b274b1 service nova] Creating event network-changed:e872f74e-c019-41cc-bb6f-c40a21a59d12 for instance 858d86de-5fe8-43e9-9409-364826f1c48c on n-h2-850499-14 Oct 04 18:10:00.621290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ecb65d1b-0355-4b52-8182-f1799dbc1b3d req-a3a4210d-b814-4fd7-9282-a9760606915f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc", "name": "network-vif-plugged", "status": "completed", "tag": "37f5965c-e639-4376-a067-f8aeab3bea4d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:00.624138 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-29906051-8a1c-480f-8c45-b2db0f312b42 req-59075b1d-97b8-47f2-803e-947ce5b274b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058042 Oct 04 18:10:00.625181 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1019/2101] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:00.631131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4fbb76f6-aeab-4d0b-99be-ca2a0add4fed tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:00.631943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4fbb76f6-aeab-4d0b-99be-ca2a0add4fed tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:00.632292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ecb65d1b-0355-4b52-8182-f1799dbc1b3d req-a3a4210d-b814-4fd7-9282-a9760606915f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.632787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ecb65d1b-0355-4b52-8182-f1799dbc1b3d req-a3a4210d-b814-4fd7-9282-a9760606915f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.633233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ecb65d1b-0355-4b52-8182-f1799dbc1b3d req-a3a4210d-b814-4fd7-9282-a9760606915f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.639143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbb76f6-aeab-4d0b-99be-ca2a0add4fed tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.639913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbb76f6-aeab-4d0b-99be-ca2a0add4fed tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.640441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbb76f6-aeab-4d0b-99be-ca2a0add4fed tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.641897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbb76f6-aeab-4d0b-99be-ca2a0add4fed tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.642432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbb76f6-aeab-4d0b-99be-ca2a0add4fed tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.642936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4fbb76f6-aeab-4d0b-99be-ca2a0add4fed tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.646767 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ecb65d1b-0355-4b52-8182-f1799dbc1b3d req-a3a4210d-b814-4fd7-9282-a9760606915f service nova] Creating event network-vif-plugged:37f5965c-e639-4376-a067-f8aeab3bea4d for instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc on n-h1-850499-14 Oct 04 18:10:00.652248 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ecb65d1b-0355-4b52-8182-f1799dbc1b3d req-a3a4210d-b814-4fd7-9282-a9760606915f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035557 Oct 04 18:10:00.652872 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1083/2102] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:00.662330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ef528e2-7e15-4ae0-9bcb-ddbf9f0f79e1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d6095dc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:00.724104 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ef528e2-7e15-4ae0-9bcb-ddbf9f0f79e1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.062548 Oct 04 18:10:00.724968 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1084/2103] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:00 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:00.824179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4fbb76f6-aeab-4d0b-99be-ca2a0add4fed tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.833026 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4fbb76f6-aeab-4d0b-99be-ca2a0add4fed tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1322 microversion: 2.1 time: 0.206450 Oct 04 18:10:00.833621 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1020/2104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:00 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:00.934664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-46b7a304-0fb7-4bcd-862f-5afd7d790047 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:00.936492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-46b7a304-0fb7-4bcd-862f-5afd7d790047 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:00.949033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b7a304-0fb7-4bcd-862f-5afd7d790047 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.950034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b7a304-0fb7-4bcd-862f-5afd7d790047 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.950793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b7a304-0fb7-4bcd-862f-5afd7d790047 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.951974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b7a304-0fb7-4bcd-862f-5afd7d790047 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.953174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b7a304-0fb7-4bcd-862f-5afd7d790047 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.953948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46b7a304-0fb7-4bcd-862f-5afd7d790047 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.182431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.183777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:01.191786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.192594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.193217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.194151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.194807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.195678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.203516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:01.223251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-46b7a304-0fb7-4bcd-862f-5afd7d790047 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.235405 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-46b7a304-0fb7-4bcd-862f-5afd7d790047 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1554 microversion: 2.1 time: 0.306720 Oct 04 18:10:01.246990 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1085/2105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:00 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1554 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:01.247838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.253358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:01.269976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.270556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.271455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.272339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.272997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.274600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.290035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.291965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.292961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.293940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lazy-loading 'fault' on Instance uuid 513fb23f-209f-4de1-add7-84c46117aace {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:01.368407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.385117 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2312e975-ccb8-4495-869b-88402fdc2787 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1324 microversion: 2.1 time: 0.206740 Oct 04 18:10:01.400513 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1021/2106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1324 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:01.413547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2202b3ad-5a98-4dfb-9530-878bdd72f0f9 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.414172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2202b3ad-5a98-4dfb-9530-878bdd72f0f9 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:01.423901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2202b3ad-5a98-4dfb-9530-878bdd72f0f9 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.424671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2202b3ad-5a98-4dfb-9530-878bdd72f0f9 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.425310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2202b3ad-5a98-4dfb-9530-878bdd72f0f9 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.426229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2202b3ad-5a98-4dfb-9530-878bdd72f0f9 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.427724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2202b3ad-5a98-4dfb-9530-878bdd72f0f9 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.428338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2202b3ad-5a98-4dfb-9530-878bdd72f0f9 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.444569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.454115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.455647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.461365 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-40ac6bdd-afdc-49f6-9c43-9a2a29e76baa tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.221558 Oct 04 18:10:01.462181 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1086/2107] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:01.526873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2202b3ad-5a98-4dfb-9530-878bdd72f0f9 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.538873 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2202b3ad-5a98-4dfb-9530-878bdd72f0f9 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1220 microversion: 2.1 time: 0.136765 Oct 04 18:10:01.539847 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1022/2108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:01.620614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f6181e5b-a8d9-431a-8184-44fa4d3953dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.621256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f6181e5b-a8d9-431a-8184-44fa4d3953dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:01.628674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6181e5b-a8d9-431a-8184-44fa4d3953dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.629168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6181e5b-a8d9-431a-8184-44fa4d3953dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.629611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6181e5b-a8d9-431a-8184-44fa4d3953dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.630320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6181e5b-a8d9-431a-8184-44fa4d3953dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.630777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6181e5b-a8d9-431a-8184-44fa4d3953dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.631235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6181e5b-a8d9-431a-8184-44fa4d3953dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.741032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba0a5505-40b2-408b-abb9-b685e5867652 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1c5b9d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.775444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f6181e5b-a8d9-431a-8184-44fa4d3953dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.784411 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f6181e5b-a8d9-431a-8184-44fa4d3953dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1515 microversion: 2.1 time: 0.167741 Oct 04 18:10:01.785129 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1087/2109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:01.790070 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba0a5505-40b2-408b-abb9-b685e5867652 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.051218 Oct 04 18:10:01.790070 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1023/2110] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:01.807404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e27778f1-1a5f-4b44-a1a8-c58c7fb490dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.808027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e27778f1-1a5f-4b44-a1a8-c58c7fb490dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:01.814753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27778f1-1a5f-4b44-a1a8-c58c7fb490dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.815280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27778f1-1a5f-4b44-a1a8-c58c7fb490dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.815725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27778f1-1a5f-4b44-a1a8-c58c7fb490dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.816440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27778f1-1a5f-4b44-a1a8-c58c7fb490dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.816906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27778f1-1a5f-4b44-a1a8-c58c7fb490dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.817334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27778f1-1a5f-4b44-a1a8-c58c7fb490dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.836741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:01.856368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c9037be-8a7b-4e3f-9100-aa9679ab6bb2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.856895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4c9037be-8a7b-4e3f-9100-aa9679ab6bb2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:01.863395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c9037be-8a7b-4e3f-9100-aa9679ab6bb2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.863893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c9037be-8a7b-4e3f-9100-aa9679ab6bb2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.864341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c9037be-8a7b-4e3f-9100-aa9679ab6bb2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.865059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c9037be-8a7b-4e3f-9100-aa9679ab6bb2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.865516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c9037be-8a7b-4e3f-9100-aa9679ab6bb2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.865976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c9037be-8a7b-4e3f-9100-aa9679ab6bb2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.010750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e27778f1-1a5f-4b44-a1a8-c58c7fb490dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.023451 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e27778f1-1a5f-4b44-a1a8-c58c7fb490dd tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1322 microversion: 2.1 time: 0.219601 Oct 04 18:10:02.024272 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1088/2111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:02.036726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4c9037be-8a7b-4e3f-9100-aa9679ab6bb2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.044970 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c9037be-8a7b-4e3f-9100-aa9679ab6bb2 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1322 microversion: 2.1 time: 0.192525 Oct 04 18:10:02.050083 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1024/2112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:02.275582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aed70dfc-3bfd-42d4-b23a-84883e449144 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:02.276208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aed70dfc-3bfd-42d4-b23a-84883e449144 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:02.283207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aed70dfc-3bfd-42d4-b23a-84883e449144 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.283706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aed70dfc-3bfd-42d4-b23a-84883e449144 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.284152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aed70dfc-3bfd-42d4-b23a-84883e449144 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.284859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aed70dfc-3bfd-42d4-b23a-84883e449144 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.285324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aed70dfc-3bfd-42d4-b23a-84883e449144 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.285751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aed70dfc-3bfd-42d4-b23a-84883e449144 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.352230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aed70dfc-3bfd-42d4-b23a-84883e449144 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.366334 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aed70dfc-3bfd-42d4-b23a-84883e449144 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1512 microversion: 2.1 time: 0.094596 Oct 04 18:10:02.366912 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1089/2113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:02 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1512 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:02.413224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:02.413836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:02.421407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.421894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.422886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.423633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.424086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.424510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.457500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.457983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.458422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.458868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lazy-loading 'fault' on Instance uuid 513fb23f-209f-4de1-add7-84c46117aace {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:02.490511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:02.491254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:02.497616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.498110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.498648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.499275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.499732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.500154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.504313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.514124 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a20c58bf-a836-40e1-866b-8c7e7fe1a5d8 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1324 microversion: 2.1 time: 0.104711 Oct 04 18:10:02.514917 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1025/2114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:02 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1324 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:02.565908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5685d30d-c24f-46b0-afab-47d833889be8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:02.566805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5685d30d-c24f-46b0-afab-47d833889be8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:02.571825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.573161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5685d30d-c24f-46b0-afab-47d833889be8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.573660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5685d30d-c24f-46b0-afab-47d833889be8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.574113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5685d30d-c24f-46b0-afab-47d833889be8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.574839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5685d30d-c24f-46b0-afab-47d833889be8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.575321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5685d30d-c24f-46b0-afab-47d833889be8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.575759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5685d30d-c24f-46b0-afab-47d833889be8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.581250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.582753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.588117 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3abcfe68-7a57-4e1e-a8d9-cc1af87dcdb0 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.101637 Oct 04 18:10:02.588751 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1090/2115] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:02 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:02.639318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5685d30d-c24f-46b0-afab-47d833889be8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.647667 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5685d30d-c24f-46b0-afab-47d833889be8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1220 microversion: 2.1 time: 0.089170 Oct 04 18:10:02.648244 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1026/2116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:02 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:02.805988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e01a1a92-1906-46d3-a604-66d33f16a180 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d6079310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:02.876777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4d5c2475-0424-4f7c-b1fd-18958d9ad0b3 req-54dc24ab-a459-4746-bfe0-6f421fab3dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a466a26b-a6a8-473e-a42b-e1d1c71c2c35", "name": "network-vif-deleted", "tag": "feb69b4e-25f6-4f92-bd6c-b253d86b7e8e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:02.884037 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e01a1a92-1906-46d3-a604-66d33f16a180 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.081983 Oct 04 18:10:02.884365 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1091/2117] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:02 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:02.913080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4d5c2475-0424-4f7c-b1fd-18958d9ad0b3 req-54dc24ab-a459-4746-bfe0-6f421fab3dd8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.914349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4d5c2475-0424-4f7c-b1fd-18958d9ad0b3 req-54dc24ab-a459-4746-bfe0-6f421fab3dd8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.918886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4d5c2475-0424-4f7c-b1fd-18958d9ad0b3 req-54dc24ab-a459-4746-bfe0-6f421fab3dd8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.954279 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4d5c2475-0424-4f7c-b1fd-18958d9ad0b3 req-54dc24ab-a459-4746-bfe0-6f421fab3dd8 service nova] Creating event network-vif-deleted:feb69b4e-25f6-4f92-bd6c-b253d86b7e8e for instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 on n-h2-850499-14 Oct 04 18:10:02.980144 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4d5c2475-0424-4f7c-b1fd-18958d9ad0b3 req-54dc24ab-a459-4746-bfe0-6f421fab3dd8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097204 Oct 04 18:10:02.983736 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1027/2118] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:03.058072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9cc31870-771f-4efd-86d3-8f5d4f37e49e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.058899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9cc31870-771f-4efd-86d3-8f5d4f37e49e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.069777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aee22b39-3ca7-434b-9de3-f2876dacfdb0 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.070503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aee22b39-3ca7-434b-9de3-f2876dacfdb0 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.076505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cc31870-771f-4efd-86d3-8f5d4f37e49e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.077539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cc31870-771f-4efd-86d3-8f5d4f37e49e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.078275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cc31870-771f-4efd-86d3-8f5d4f37e49e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.079714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cc31870-771f-4efd-86d3-8f5d4f37e49e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.084108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cc31870-771f-4efd-86d3-8f5d4f37e49e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.085749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cc31870-771f-4efd-86d3-8f5d4f37e49e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.094892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aee22b39-3ca7-434b-9de3-f2876dacfdb0 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.095444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aee22b39-3ca7-434b-9de3-f2876dacfdb0 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.095905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aee22b39-3ca7-434b-9de3-f2876dacfdb0 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.096655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aee22b39-3ca7-434b-9de3-f2876dacfdb0 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.097138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aee22b39-3ca7-434b-9de3-f2876dacfdb0 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.097554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aee22b39-3ca7-434b-9de3-f2876dacfdb0 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.378674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aee22b39-3ca7-434b-9de3-f2876dacfdb0 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.380074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9cc31870-771f-4efd-86d3-8f5d4f37e49e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.407880 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aee22b39-3ca7-434b-9de3-f2876dacfdb0 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1322 microversion: 2.1 time: 0.341342 Oct 04 18:10:03.411542 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1028/2119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:03.420165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8c7fedcb-d9f2-43d6-8012-4c8d29d2565d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.421764 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9cc31870-771f-4efd-86d3-8f5d4f37e49e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1322 microversion: 2.1 time: 0.360457 Oct 04 18:10:03.423004 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1092/2120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:03.424032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c7fedcb-d9f2-43d6-8012-4c8d29d2565d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.432903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c7fedcb-d9f2-43d6-8012-4c8d29d2565d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.433726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c7fedcb-d9f2-43d6-8012-4c8d29d2565d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.434347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c7fedcb-d9f2-43d6-8012-4c8d29d2565d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.435269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c7fedcb-d9f2-43d6-8012-4c8d29d2565d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.435899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c7fedcb-d9f2-43d6-8012-4c8d29d2565d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.436498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c7fedcb-d9f2-43d6-8012-4c8d29d2565d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.537688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.538306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.550572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.551108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.551557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.558072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.558732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.559215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.670440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.671979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8c7fedcb-d9f2-43d6-8012-4c8d29d2565d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.677765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.680641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.681565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lazy-loading 'fault' on Instance uuid 513fb23f-209f-4de1-add7-84c46117aace {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:03.692765 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8c7fedcb-d9f2-43d6-8012-4c8d29d2565d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1346 microversion: 2.1 time: 0.275312 Oct 04 18:10:03.694989 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1029/2121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1346 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:03.702532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.703708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.713181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.714143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.714825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.717082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.717761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.718366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.798426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.808066 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-31cf9732-9419-47c3-b34c-5bb720e1135f tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 200 len: 1324 microversion: 2.1 time: 0.274060 Oct 04 18:10:03.808745 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1093/2122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:03.816223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed4f7d38-66fe-4559-9416-e308eb7a3da5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.823802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed4f7d38-66fe-4559-9416-e308eb7a3da5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.849351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed4f7d38-66fe-4559-9416-e308eb7a3da5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.849936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed4f7d38-66fe-4559-9416-e308eb7a3da5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.850592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed4f7d38-66fe-4559-9416-e308eb7a3da5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.851556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed4f7d38-66fe-4559-9416-e308eb7a3da5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.852223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed4f7d38-66fe-4559-9416-e308eb7a3da5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.852737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed4f7d38-66fe-4559-9416-e308eb7a3da5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.863719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.876407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.878368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.885886 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ee4b5961-33aa-43d0-bb26-b8cd7c5e2bc6 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.188718 Oct 04 18:10:03.887765 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1030/2123] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:03.897638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5e9107ca-c8ab-4081-9903-f4296cecaf36 req-cc2f79e9-2e1e-480a-a108-11054be881d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3352785-cdd3-4a48-bd8f-6c0cfacff173", "name": "network-vif-plugged", "status": "completed", "tag": "75b96692-98cb-4fe0-8702-0069060c372a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:03.914643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5e9107ca-c8ab-4081-9903-f4296cecaf36 req-cc2f79e9-2e1e-480a-a108-11054be881d0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.915812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5e9107ca-c8ab-4081-9903-f4296cecaf36 req-cc2f79e9-2e1e-480a-a108-11054be881d0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.916531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5e9107ca-c8ab-4081-9903-f4296cecaf36 req-cc2f79e9-2e1e-480a-a108-11054be881d0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.933900 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5e9107ca-c8ab-4081-9903-f4296cecaf36 req-cc2f79e9-2e1e-480a-a108-11054be881d0 service nova] Creating event network-vif-plugged:75b96692-98cb-4fe0-8702-0069060c372a for instance d3352785-cdd3-4a48-bd8f-6c0cfacff173 on n-h1-850499-14 Oct 04 18:10:03.944277 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5e9107ca-c8ab-4081-9903-f4296cecaf36 req-cc2f79e9-2e1e-480a-a108-11054be881d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050483 Oct 04 18:10:03.945295 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1031/2124] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:03.952412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6afda4bc-cfdf-4b5b-b54c-4d5ebf2ef7d6 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1c644c0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.952537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ed4f7d38-66fe-4559-9416-e308eb7a3da5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.963131 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed4f7d38-66fe-4559-9416-e308eb7a3da5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1276 microversion: 2.1 time: 0.153118 Oct 04 18:10:03.973654 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1094/2125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:04.046018 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6afda4bc-cfdf-4b5b-b54c-4d5ebf2ef7d6 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.098487 Oct 04 18:10:04.048808 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1032/2126] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:04.434118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ffabc25-578b-402c-8e4e-52f2ecce9fd8 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.435292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ffabc25-578b-402c-8e4e-52f2ecce9fd8 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:04.442458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ffabc25-578b-402c-8e4e-52f2ecce9fd8 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.443239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ffabc25-578b-402c-8e4e-52f2ecce9fd8 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.443861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ffabc25-578b-402c-8e4e-52f2ecce9fd8 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.444908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ffabc25-578b-402c-8e4e-52f2ecce9fd8 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.445592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ffabc25-578b-402c-8e4e-52f2ecce9fd8 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.446995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ffabc25-578b-402c-8e4e-52f2ecce9fd8 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.453332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e5ad38e8-4f1e-4a08-a682-1bd823e95862 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.455541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e5ad38e8-4f1e-4a08-a682-1bd823e95862 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:04.464944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5ad38e8-4f1e-4a08-a682-1bd823e95862 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.466138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5ad38e8-4f1e-4a08-a682-1bd823e95862 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.466588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5ad38e8-4f1e-4a08-a682-1bd823e95862 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.468835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5ad38e8-4f1e-4a08-a682-1bd823e95862 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.469806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5ad38e8-4f1e-4a08-a682-1bd823e95862 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.470271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5ad38e8-4f1e-4a08-a682-1bd823e95862 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.697988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5ad38e8-4f1e-4a08-a682-1bd823e95862 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:04.702161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ffabc25-578b-402c-8e4e-52f2ecce9fd8 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:04.751964 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ffabc25-578b-402c-8e4e-52f2ecce9fd8 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1322 microversion: 2.1 time: 0.320769 Oct 04 18:10:04.764679 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1095/2127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:04 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:04.765054 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e5ad38e8-4f1e-4a08-a682-1bd823e95862 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1322 microversion: 2.1 time: 0.311253 Oct 04 18:10:04.768850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1033/2128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:04 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:04.769059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8f9469ce-79db-4800-a4e2-adc15b87cee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.769290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8f9469ce-79db-4800-a4e2-adc15b87cee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:04.776948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f9469ce-79db-4800-a4e2-adc15b87cee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.778255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f9469ce-79db-4800-a4e2-adc15b87cee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.779360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f9469ce-79db-4800-a4e2-adc15b87cee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.781026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f9469ce-79db-4800-a4e2-adc15b87cee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.781768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f9469ce-79db-4800-a4e2-adc15b87cee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.782205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f9469ce-79db-4800-a4e2-adc15b87cee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.850169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.851305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 513fb23f-209f-4de1-add7-84c46117aace] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:04.861694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8f9469ce-79db-4800-a4e2-adc15b87cee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:04.867940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.868616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.869373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.870370 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8f9469ce-79db-4800-a4e2-adc15b87cee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1346 microversion: 2.1 time: 0.107459 Oct 04 18:10:04.870575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.870998 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1096/2129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:04 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:04.871333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.871893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.902126 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] HTTP exception thrown: Instance 513fb23f-209f-4de1-add7-84c46117aace could not be found. Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Request method failure captured: Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace HTTP/1.1 Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHUJ3cjVSHexwIjEk6YYRPM4aeRk4n8Lb6xHENjLa6WH5tv19z26xN69bIxWjL3jQ5J-QxDshiZYPjbS01dCEcaGXiK89y_AtmcDXI028ikyjUCQnTgHvzfHJkS-p3hVAmhW6ehdckHNCSsHxqAMIC-7rytTPsIapW9yFGAI_qMueB4 Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: bc4df90b761348c082e7787ff4925299 Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-LiveMigrationTest-373582620 Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:04.905321 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc4df90b761348c082e7787ff4925299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc4df90b761348c082e7787ff4925299"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc4df90b761348c082e7787ff4925299"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc4df90b761348c082e7787ff4925299"}]}] Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-LiveMigrationTest-373582620 Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: bc4df90b761348c082e7787ff4925299 Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-LiveMigrationTest-373582620 Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-LiveMigrationTest-373582620-project Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 327e7f9ab3d74ff4a4d1bb86d15ad8fc Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-LiveMigrationTest-373582620-project Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 513fb23f-209f-4de1-add7-84c46117aace could not be found. Oct 04 18:10:04.908083 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '513fb23f-209f-4de1-add7-84c46117aace'} Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513fb23f-209f-4de1-add7-84c46117aace could not be found. Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:04.909176 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513fb23f-209f-4de1-add7-84c46117aace could not be found. Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513fb23f-209f-4de1-add7-84c46117aace could not be found. Oct 04 18:10:04.910886 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:04.912618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Returning 404 to user: Instance 513fb23f-209f-4de1-add7-84c46117aace could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:04.912618 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a97f3e1-b896-4c63-9047-1a3de1759d94 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace" status: 404 len: 111 microversion: 2.1 time: 0.064507 Oct 04 18:10:04.914727 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1034/2130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:04 2022] GET /compute/v2.1/servers/513fb23f-209f-4de1-add7-84c46117aace => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:04.919240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.919679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:04.929210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ae424f8d-b54f-4356-8034-2fcc90ae6c08 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '.version_select at 0x7fd4d1c64790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.929732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.930338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.930887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.931871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.932452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.933003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.972971 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ae424f8d-b54f-4356-8034-2fcc90ae6c08 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033798269" status: 202 len: 0 microversion: 2.1 time: 0.051148 Oct 04 18:10:04.974221 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1035/2131] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:10:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033798269 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:10:04.989908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f77652a-1ced-4c83-a9a6-41876df69a62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.990572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9f77652a-1ced-4c83-a9a6-41876df69a62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:05.009364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f77652a-1ced-4c83-a9a6-41876df69a62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.009927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f77652a-1ced-4c83-a9a6-41876df69a62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.010373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f77652a-1ced-4c83-a9a6-41876df69a62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.013776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f77652a-1ced-4c83-a9a6-41876df69a62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.014334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f77652a-1ced-4c83-a9a6-41876df69a62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.014787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f77652a-1ced-4c83-a9a6-41876df69a62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.035990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.049442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.051658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.058921 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ffeb6d95-e278-4490-8b96-b38ff029e34c tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.144987 Oct 04 18:10:05.060385 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1097/2132] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:04 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:05.067213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c81666ea-f35c-4d94-9279-2e1b79f982a5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d6086700>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.124535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f77652a-1ced-4c83-a9a6-41876df69a62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.140832 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9f77652a-1ced-4c83-a9a6-41876df69a62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1276 microversion: 2.1 time: 0.157438 Oct 04 18:10:05.142635 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1036/2133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:04 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:05.205340 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c81666ea-f35c-4d94-9279-2e1b79f982a5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.143449 Oct 04 18:10:05.207035 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1098/2134] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:05.791291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c7c4c7d-d4a6-4512-8d62-ace50d4cdb0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.794907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1c7c4c7d-d4a6-4512-8d62-ace50d4cdb0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:05.796833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b8099c9-606b-41f6-a4e9-cc749be5659b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.802031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b8099c9-606b-41f6-a4e9-cc749be5659b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:05.817291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c7c4c7d-d4a6-4512-8d62-ace50d4cdb0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.818484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c7c4c7d-d4a6-4512-8d62-ace50d4cdb0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.819452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c7c4c7d-d4a6-4512-8d62-ace50d4cdb0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.820924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c7c4c7d-d4a6-4512-8d62-ace50d4cdb0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.822370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c7c4c7d-d4a6-4512-8d62-ace50d4cdb0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.823825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c7c4c7d-d4a6-4512-8d62-ace50d4cdb0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.826194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b8099c9-606b-41f6-a4e9-cc749be5659b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.827143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b8099c9-606b-41f6-a4e9-cc749be5659b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.834796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b8099c9-606b-41f6-a4e9-cc749be5659b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.838081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b8099c9-606b-41f6-a4e9-cc749be5659b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.838848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b8099c9-606b-41f6-a4e9-cc749be5659b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.839741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b8099c9-606b-41f6-a4e9-cc749be5659b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.261266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1c7c4c7d-d4a6-4512-8d62-ace50d4cdb0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.270938 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c7c4c7d-d4a6-4512-8d62-ace50d4cdb0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1322 microversion: 2.1 time: 0.496660 Oct 04 18:10:06.289601 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1037/2135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1322 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:06.302196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bde6423a-49a1-42a0-89d6-0a14e8f1cc04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.303638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bde6423a-49a1-42a0-89d6-0a14e8f1cc04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.316699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bde6423a-49a1-42a0-89d6-0a14e8f1cc04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.321567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bde6423a-49a1-42a0-89d6-0a14e8f1cc04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.322324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bde6423a-49a1-42a0-89d6-0a14e8f1cc04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.323823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bde6423a-49a1-42a0-89d6-0a14e8f1cc04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.324471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bde6423a-49a1-42a0-89d6-0a14e8f1cc04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.332677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bde6423a-49a1-42a0-89d6-0a14e8f1cc04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.349092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7b8099c9-606b-41f6-a4e9-cc749be5659b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.360798 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b8099c9-606b-41f6-a4e9-cc749be5659b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1322 microversion: 2.1 time: 0.573602 Oct 04 18:10:06.362324 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1099/2136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:06.374931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-085bb890-ac24-445b-b72e-3e4c093fbadb req-0bb79388-5154-43e2-b2e0-ae4de9480cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bfba3c-5b12-4b4a-800c-c3a37b9da5e2", "name": "network-vif-plugged", "status": "completed", "tag": "d87be326-0818-410e-ad20-1bc0d3600186"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:06.402204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-085bb890-ac24-445b-b72e-3e4c093fbadb req-0bb79388-5154-43e2-b2e0-ae4de9480cc7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.403144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-085bb890-ac24-445b-b72e-3e4c093fbadb req-0bb79388-5154-43e2-b2e0-ae4de9480cc7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.403985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-085bb890-ac24-445b-b72e-3e4c093fbadb req-0bb79388-5154-43e2-b2e0-ae4de9480cc7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.418630 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-085bb890-ac24-445b-b72e-3e4c093fbadb req-0bb79388-5154-43e2-b2e0-ae4de9480cc7 service nova] Creating event network-vif-plugged:d87be326-0818-410e-ad20-1bc0d3600186 for instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 on n-h1-850499-14 Oct 04 18:10:06.430334 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-085bb890-ac24-445b-b72e-3e4c093fbadb req-0bb79388-5154-43e2-b2e0-ae4de9480cc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064260 Oct 04 18:10:06.435159 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1100/2137] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:06.447806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.454744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.469921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bde6423a-49a1-42a0-89d6-0a14e8f1cc04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.480230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.480736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.481189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.481920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.482541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.484197 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bde6423a-49a1-42a0-89d6-0a14e8f1cc04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1346 microversion: 2.1 time: 0.193383 Oct 04 18:10:06.499083 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1038/2138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1346 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:06.499432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.499661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d4856c4b-4efc-4a13-8ea8-f129452fb8bc tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.499661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d4856c4b-4efc-4a13-8ea8-f129452fb8bc tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.499661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4856c4b-4efc-4a13-8ea8-f129452fb8bc tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.499661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4856c4b-4efc-4a13-8ea8-f129452fb8bc tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.500374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4856c4b-4efc-4a13-8ea8-f129452fb8bc tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.500374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4856c4b-4efc-4a13-8ea8-f129452fb8bc tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.500374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4856c4b-4efc-4a13-8ea8-f129452fb8bc tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.500906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4856c4b-4efc-4a13-8ea8-f129452fb8bc tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.586606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d4856c4b-4efc-4a13-8ea8-f129452fb8bc tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.607937 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d4856c4b-4efc-4a13-8ea8-f129452fb8bc tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1276 microversion: 2.1 time: 0.120742 Oct 04 18:10:06.610243 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1039/2139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:06.620401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ab99689-11c3-4ac0-ba7a-cdd772d033cf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1ececa0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.623983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.643910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.645676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.651871 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-930b1f78-9621-495c-9212-56c15faa7de7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.212286 Oct 04 18:10:06.663446 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1101/2140] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:06.681443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e7f82c3d-dcbb-4236-9105-3823b8795357 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.682256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e7f82c3d-dcbb-4236-9105-3823b8795357 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.690752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7f82c3d-dcbb-4236-9105-3823b8795357 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.691483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7f82c3d-dcbb-4236-9105-3823b8795357 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.692121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7f82c3d-dcbb-4236-9105-3823b8795357 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.693038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7f82c3d-dcbb-4236-9105-3823b8795357 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.693709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7f82c3d-dcbb-4236-9105-3823b8795357 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.694326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7f82c3d-dcbb-4236-9105-3823b8795357 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.717285 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ab99689-11c3-4ac0-ba7a-cdd772d033cf tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.105068 Oct 04 18:10:06.730266 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1040/2141] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:06.747649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e7f82c3d-dcbb-4236-9105-3823b8795357 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:06.868478 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e7f82c3d-dcbb-4236-9105-3823b8795357 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "DELETE /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 204 len: 0 microversion: 2.1 time: 0.203351 Oct 04 18:10:06.869323 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1102/2142] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:06 2022] DELETE /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:06.878669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40940718-5c3f-4c06-84a9-5154c0805997 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.879585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-40940718-5c3f-4c06-84a9-5154c0805997 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.887472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40940718-5c3f-4c06-84a9-5154c0805997 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.887980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40940718-5c3f-4c06-84a9-5154c0805997 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.888430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40940718-5c3f-4c06-84a9-5154c0805997 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.889152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40940718-5c3f-4c06-84a9-5154c0805997 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.889623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40940718-5c3f-4c06-84a9-5154c0805997 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.890082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40940718-5c3f-4c06-84a9-5154c0805997 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.070735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-40940718-5c3f-4c06-84a9-5154c0805997 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.080779 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40940718-5c3f-4c06-84a9-5154c0805997 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1485 microversion: 2.1 time: 0.207316 Oct 04 18:10:07.095104 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1041/2143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1485 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:07.303864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9aa5f0fc-98b8-4009-9063-f2eaf3e86f0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:07.304891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9aa5f0fc-98b8-4009-9063-f2eaf3e86f0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:07.312192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa5f0fc-98b8-4009-9063-f2eaf3e86f0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.313985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa5f0fc-98b8-4009-9063-f2eaf3e86f0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.314967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa5f0fc-98b8-4009-9063-f2eaf3e86f0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.316856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa5f0fc-98b8-4009-9063-f2eaf3e86f0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.317905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa5f0fc-98b8-4009-9063-f2eaf3e86f0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.318878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa5f0fc-98b8-4009-9063-f2eaf3e86f0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.389002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8fd4c46b-3dbf-4871-82ec-33e8fe1edf9a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:07.392153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8fd4c46b-3dbf-4871-82ec-33e8fe1edf9a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:07.409446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fd4c46b-3dbf-4871-82ec-33e8fe1edf9a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.412901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fd4c46b-3dbf-4871-82ec-33e8fe1edf9a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.415687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fd4c46b-3dbf-4871-82ec-33e8fe1edf9a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.418875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fd4c46b-3dbf-4871-82ec-33e8fe1edf9a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.419581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fd4c46b-3dbf-4871-82ec-33e8fe1edf9a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.422430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fd4c46b-3dbf-4871-82ec-33e8fe1edf9a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.620129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9aa5f0fc-98b8-4009-9063-f2eaf3e86f0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.638592 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9aa5f0fc-98b8-4009-9063-f2eaf3e86f0d tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1472 microversion: 2.1 time: 0.340508 Oct 04 18:10:07.649376 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1103/2144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:07 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:07.664100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29e26aee-5a16-4a8c-a6be-c6fafb930ae9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:07.664729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-29e26aee-5a16-4a8c-a6be-c6fafb930ae9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:07.695767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29e26aee-5a16-4a8c-a6be-c6fafb930ae9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.696434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29e26aee-5a16-4a8c-a6be-c6fafb930ae9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.697545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29e26aee-5a16-4a8c-a6be-c6fafb930ae9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.697821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29e26aee-5a16-4a8c-a6be-c6fafb930ae9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.708841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29e26aee-5a16-4a8c-a6be-c6fafb930ae9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.722587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29e26aee-5a16-4a8c-a6be-c6fafb930ae9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.748697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8fd4c46b-3dbf-4871-82ec-33e8fe1edf9a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.758663 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8fd4c46b-3dbf-4871-82ec-33e8fe1edf9a tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1322 microversion: 2.1 time: 0.374127 Oct 04 18:10:07.773777 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1042/2145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:07 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:07.789472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-64b2babf-5d82-4a3d-a3e0-593bf2809b8b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:07.790142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-64b2babf-5d82-4a3d-a3e0-593bf2809b8b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:07.799455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64b2babf-5d82-4a3d-a3e0-593bf2809b8b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.799967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64b2babf-5d82-4a3d-a3e0-593bf2809b8b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.800502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64b2babf-5d82-4a3d-a3e0-593bf2809b8b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.801104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64b2babf-5d82-4a3d-a3e0-593bf2809b8b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.801566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64b2babf-5d82-4a3d-a3e0-593bf2809b8b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.802054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64b2babf-5d82-4a3d-a3e0-593bf2809b8b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.807896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:07.898646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-64b2babf-5d82-4a3d-a3e0-593bf2809b8b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.915257 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-64b2babf-5d82-4a3d-a3e0-593bf2809b8b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1276 microversion: 2.1 time: 0.139955 Oct 04 18:10:07.915893 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1043/2146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:07 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:07.929966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:07.939965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:07.954624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.956395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.958698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.960918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.972189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.972942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.010589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29e26aee-5a16-4a8c-a6be-c6fafb930ae9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.027872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.044126 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29e26aee-5a16-4a8c-a6be-c6fafb930ae9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1346 microversion: 2.1 time: 0.393216 Oct 04 18:10:08.045391 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1104/2147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:07 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1346 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Request method failure captured: Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173/diagnostics HTTP/1.1 Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHbg7VEzsAOurHOBWyIdkync-MNj2PwkutqmZ_vZM6WKHQwvo_7cT93wLEY0KrDBm9jOKNFYJsIgaiEySlHFc2JxULeFNoAw5mL6Ngv2AYYT73r5x0tXjvNCr1L1xsbH2-21D6-4hLkJMjiH028xam_BLOBxegUaqv-5rOO4zsIKKyo Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 23ca16963de94a4889dd27ddf6f87415 Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-337839008 Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:08.050553 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_23ca16963de94a4889dd27ddf6f87415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/23ca16963de94a4889dd27ddf6f87415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23ca16963de94a4889dd27ddf6f87415"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23ca16963de94a4889dd27ddf6f87415"}]}] Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-337839008 Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 23ca16963de94a4889dd27ddf6f87415 Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-337839008 Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerDiagnosticsNegativeTest-337839008-project Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 34e1743c012844919c05429542d30f7b Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-337839008-project Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:08.052614 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'server_id': 'd3352785-cdd3-4a48-bd8f-6c0cfacff173'} Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:10:08.053597 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:10:08.056361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:08.059657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:08.060779 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a995f2ef-a617-434e-9fde-92611f6f8064 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.143509 Oct 04 18:10:08.066721 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1044/2148] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:10:07 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173/diagnostics => generated 117 bytes in 150 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:08.077354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ca11199-bc86-4b37-b1d3-7f4f7b8b4450 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1c644c0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.079954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.082189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:08.093440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:08.101100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.101953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.102621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.103611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.104277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.104915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.137110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:08.231687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.238704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:08.243871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.245607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.254173 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1945a385-eb31-4238-958d-b04c8532f37e tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1544 microversion: 2.91 time: 0.206941 Oct 04 18:10:08.276546 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1105/2149] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1544 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:08.282069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-58c03526-6187-4621-b712-845bc0afb4fb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.282666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-58c03526-6187-4621-b712-845bc0afb4fb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:08.290565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58c03526-6187-4621-b712-845bc0afb4fb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.291949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58c03526-6187-4621-b712-845bc0afb4fb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.293548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58c03526-6187-4621-b712-845bc0afb4fb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.294815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58c03526-6187-4621-b712-845bc0afb4fb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.295340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58c03526-6187-4621-b712-845bc0afb4fb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.296052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58c03526-6187-4621-b712-845bc0afb4fb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.333647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-58c03526-6187-4621-b712-845bc0afb4fb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:08.514746 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-58c03526-6187-4621-b712-845bc0afb4fb tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 204 len: 0 microversion: 2.1 time: 0.235418 Oct 04 18:10:08.517181 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1106/2150] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:08 2022] DELETE /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:08.533166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1730eb9-61f8-4a2b-b172-4a39409cdd6a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.535651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1730eb9-61f8-4a2b-b172-4a39409cdd6a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:08.554072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1730eb9-61f8-4a2b-b172-4a39409cdd6a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.555972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1730eb9-61f8-4a2b-b172-4a39409cdd6a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.558938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1730eb9-61f8-4a2b-b172-4a39409cdd6a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.559817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1730eb9-61f8-4a2b-b172-4a39409cdd6a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.561035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1730eb9-61f8-4a2b-b172-4a39409cdd6a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.561640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1730eb9-61f8-4a2b-b172-4a39409cdd6a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.681071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:08.982612 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ca11199-bc86-4b37-b1d3-7f4f7b8b4450 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.911044 Oct 04 18:10:08.983470 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1045/2151] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:08.989596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01499e4b-76fe-4df4-b169-714787649a25 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.991451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01499e4b-76fe-4df4-b169-714787649a25 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:09.013172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01499e4b-76fe-4df4-b169-714787649a25 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.014290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01499e4b-76fe-4df4-b169-714787649a25 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.015037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01499e4b-76fe-4df4-b169-714787649a25 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.016166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01499e4b-76fe-4df4-b169-714787649a25 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.016888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01499e4b-76fe-4df4-b169-714787649a25 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.017723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01499e4b-76fe-4df4-b169-714787649a25 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.376443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1730eb9-61f8-4a2b-b172-4a39409cdd6a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.385802 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1730eb9-61f8-4a2b-b172-4a39409cdd6a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1485 microversion: 2.1 time: 0.866579 Oct 04 18:10:09.386401 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1107/2152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1485 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:09.406910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-918d1930-5842-4a4a-b2e3-06f93a174d14 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:09.416543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-918d1930-5842-4a4a-b2e3-06f93a174d14 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:09.447388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-918d1930-5842-4a4a-b2e3-06f93a174d14 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.455481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-918d1930-5842-4a4a-b2e3-06f93a174d14 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.459192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-918d1930-5842-4a4a-b2e3-06f93a174d14 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.464520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-918d1930-5842-4a4a-b2e3-06f93a174d14 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.468215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-918d1930-5842-4a4a-b2e3-06f93a174d14 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.472649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-918d1930-5842-4a4a-b2e3-06f93a174d14 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.692913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01499e4b-76fe-4df4-b169-714787649a25 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.720577 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01499e4b-76fe-4df4-b169-714787649a25 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1478 microversion: 2.1 time: 0.735500 Oct 04 18:10:09.721335 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1046/2153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1478 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:09.726314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12e1ecb8-2f07-4d84-87b6-8875391dae1c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:09.727244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-12e1ecb8-2f07-4d84-87b6-8875391dae1c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:09.742724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1ecb8-2f07-4d84-87b6-8875391dae1c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.745031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1ecb8-2f07-4d84-87b6-8875391dae1c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.754252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1ecb8-2f07-4d84-87b6-8875391dae1c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.755039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1ecb8-2f07-4d84-87b6-8875391dae1c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.755517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1ecb8-2f07-4d84-87b6-8875391dae1c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.755948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12e1ecb8-2f07-4d84-87b6-8875391dae1c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.348032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-12e1ecb8-2f07-4d84-87b6-8875391dae1c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.373790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-918d1930-5842-4a4a-b2e3-06f93a174d14 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.381382 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12e1ecb8-2f07-4d84-87b6-8875391dae1c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1282 microversion: 2.1 time: 0.658713 Oct 04 18:10:10.387706 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-918d1930-5842-4a4a-b2e3-06f93a174d14 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1322 microversion: 2.1 time: 0.993019 Oct 04 18:10:10.388179 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1047/2154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:09 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1282 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:10.389883 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1108/2155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:09 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1322 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:10.395602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:10.396675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:10.404026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:10.405044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:10.405239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.406156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.406925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.408467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.409251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.409940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.455947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.456732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.469837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.477507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.479148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.486207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.553773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.555933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.572687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.573486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'fault' on Instance uuid a466a26b-a6a8-473e-a42b-e1d1c71c2c35 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:10.701341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.726159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.731948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.754913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:10.756954 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49501d72-17b8-4e2f-af2e-e43c763478d3 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1531 microversion: 2.91 time: 0.365691 Oct 04 18:10:10.758915 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1109/2156] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:10 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1531 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:10.767362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-8ff8e703-7931-4b9c-9502-196a64c74c45 req-0102ca2b-4b9c-4c16-9c37-97fd7dc9deed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b090a0-2ada-4af7-be73-c21ed69a3720", "name": "network-vif-deleted", "tag": "55fe455b-5dcd-4805-b03b-0514147b4e32"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:10.785468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8ff8e703-7931-4b9c-9502-196a64c74c45 req-0102ca2b-4b9c-4c16-9c37-97fd7dc9deed service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.786665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8ff8e703-7931-4b9c-9502-196a64c74c45 req-0102ca2b-4b9c-4c16-9c37-97fd7dc9deed service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.787774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8ff8e703-7931-4b9c-9502-196a64c74c45 req-0102ca2b-4b9c-4c16-9c37-97fd7dc9deed service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.809580 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-8ff8e703-7931-4b9c-9502-196a64c74c45 req-0102ca2b-4b9c-4c16-9c37-97fd7dc9deed service nova] Creating event network-vif-deleted:55fe455b-5dcd-4805-b03b-0514147b4e32 for instance 27b090a0-2ada-4af7-be73-c21ed69a3720 on n-h1-850499-14 Oct 04 18:10:10.815654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.819988 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-8ff8e703-7931-4b9c-9502-196a64c74c45 req-0102ca2b-4b9c-4c16-9c37-97fd7dc9deed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059455 Oct 04 18:10:10.821093 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1110/2157] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:10.829722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b590b95-5db4-43a8-90f1-708105e3e277 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1555ca0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:10.834145 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-46a9ce99-7ec2-4c4f-b218-302ebbd2241d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1351 microversion: 2.1 time: 0.444991 Oct 04 18:10:10.840576 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1048/2158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:10 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1351 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:10.848100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:10.849205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:10.856018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:10.860588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.862111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.862858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.864017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.864664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.865833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.923744 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b590b95-5db4-43a8-90f1-708105e3e277 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.101007 Oct 04 18:10:10.928239 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1111/2159] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:10 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:10.947316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a71dfead-11f8-4303-90a0-c7f21770bd7e tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:10.948508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a71dfead-11f8-4303-90a0-c7f21770bd7e tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:10.969273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.971663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.972392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.972855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71dfead-11f8-4303-90a0-c7f21770bd7e tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.973609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lazy-loading 'fault' on Instance uuid 27b090a0-2ada-4af7-be73-c21ed69a3720 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:10.974413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71dfead-11f8-4303-90a0-c7f21770bd7e tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.976000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71dfead-11f8-4303-90a0-c7f21770bd7e tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.978599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71dfead-11f8-4303-90a0-c7f21770bd7e tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.982284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71dfead-11f8-4303-90a0-c7f21770bd7e tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.985035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71dfead-11f8-4303-90a0-c7f21770bd7e tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.179111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.199283 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-13d47cea-65e7-43dd-ae97-9cd435bc83b7 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 200 len: 1300 microversion: 2.1 time: 0.356661 Oct 04 18:10:11.203787 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1049/2160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:10 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 1300 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:11.256206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00f4fce4-1a32-454e-a7d6-82ddbd768361 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:11.257397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00f4fce4-1a32-454e-a7d6-82ddbd768361 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:11.288024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f4fce4-1a32-454e-a7d6-82ddbd768361 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.296509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f4fce4-1a32-454e-a7d6-82ddbd768361 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.298180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f4fce4-1a32-454e-a7d6-82ddbd768361 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.299823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f4fce4-1a32-454e-a7d6-82ddbd768361 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.303777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f4fce4-1a32-454e-a7d6-82ddbd768361 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.307749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00f4fce4-1a32-454e-a7d6-82ddbd768361 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.358277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a71dfead-11f8-4303-90a0-c7f21770bd7e tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.393397 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a71dfead-11f8-4303-90a0-c7f21770bd7e tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1478 microversion: 2.1 time: 0.459895 Oct 04 18:10:11.411522 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1112/2161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:10 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1478 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:11.460717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33040774-1efa-4dc6-a8f0-e32145966a85 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:11.485896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33040774-1efa-4dc6-a8f0-e32145966a85 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:11.530287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33040774-1efa-4dc6-a8f0-e32145966a85 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.533388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33040774-1efa-4dc6-a8f0-e32145966a85 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.533858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33040774-1efa-4dc6-a8f0-e32145966a85 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.539992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33040774-1efa-4dc6-a8f0-e32145966a85 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.540507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33040774-1efa-4dc6-a8f0-e32145966a85 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.540961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33040774-1efa-4dc6-a8f0-e32145966a85 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.577132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-00f4fce4-1a32-454e-a7d6-82ddbd768361 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] Lazy-loading 'services' on Instance uuid 11187b54-8f68-40db-b316-f1cfba27eb35 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:11.612274 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-00f4fce4-1a32-454e-a7d6-82ddbd768361 tempest-UnshelveToHostMultiNodesTest-1898526955 tempest-UnshelveToHostMultiNodesTest-1898526955-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1938 microversion: 2.91 time: 0.383283 Oct 04 18:10:11.623273 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1050/2162] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:11 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1938 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:11.638359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-60373049-6869-46cd-802e-15cce9174917 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:11.638359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-60373049-6869-46cd-802e-15cce9174917 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:11.639856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60373049-6869-46cd-802e-15cce9174917 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.640722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60373049-6869-46cd-802e-15cce9174917 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.641844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60373049-6869-46cd-802e-15cce9174917 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.642778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60373049-6869-46cd-802e-15cce9174917 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.643410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60373049-6869-46cd-802e-15cce9174917 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.644010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60373049-6869-46cd-802e-15cce9174917 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.081416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-60373049-6869-46cd-802e-15cce9174917 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.097343 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-60373049-6869-46cd-802e-15cce9174917 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.478549 Oct 04 18:10:12.121479 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1051/2163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:11 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:12.139216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-536ef3d6-fb14-4593-8dd2-b9d5261a2788 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.139713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-536ef3d6-fb14-4593-8dd2-b9d5261a2788 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.146996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-536ef3d6-fb14-4593-8dd2-b9d5261a2788 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.149188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-536ef3d6-fb14-4593-8dd2-b9d5261a2788 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.149652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-536ef3d6-fb14-4593-8dd2-b9d5261a2788 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.150513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-536ef3d6-fb14-4593-8dd2-b9d5261a2788 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.151207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-536ef3d6-fb14-4593-8dd2-b9d5261a2788 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.151564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-536ef3d6-fb14-4593-8dd2-b9d5261a2788 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.168642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-33040774-1efa-4dc6-a8f0-e32145966a85 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.197425 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33040774-1efa-4dc6-a8f0-e32145966a85 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1322 microversion: 2.1 time: 0.754404 Oct 04 18:10:12.198576 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1113/2164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:11 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1322 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:12.205198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.208912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.225462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.226496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.227882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.229230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.232127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.232835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.287378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-536ef3d6-fb14-4593-8dd2-b9d5261a2788 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:12.315613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.319585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.320364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.322365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'fault' on Instance uuid a466a26b-a6a8-473e-a42b-e1d1c71c2c35 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:12.457416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.471828 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-30eb07fc-cbe3-4ffc-9369-2d0201e54e2a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 200 len: 1305 microversion: 2.1 time: 0.270632 Oct 04 18:10:12.473170 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1114/2165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 1305 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:12.491081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9482d160-2800-4338-a306-7ad70c041865 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d6086ee0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.573520 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9482d160-2800-4338-a306-7ad70c041865 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.098871 Oct 04 18:10:12.574554 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1115/2166] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:12.580918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.581985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: 27b090a0-2ada-4af7-be73-c21ed69a3720] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.595148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.596483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.597524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.599289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.600613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.601676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.613188 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-536ef3d6-fb14-4593-8dd2-b9d5261a2788 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "DELETE /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 204 len: 0 microversion: 2.91 time: 0.480995 Oct 04 18:10:12.614013 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1052/2167] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:10:12 2022] DELETE /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:10:12.627476 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] HTTP exception thrown: Instance 27b090a0-2ada-4af7-be73-c21ed69a3720 could not be found. Oct 04 18:10:12.629783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Request method failure captured: Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 HTTP/1.1 Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUJ3cjVSHexwIjEk6YYRPM4aeRk4n8Lb6xHENjLa6WH5tv19z26xN69bIxWjL3jQ5J-QxDshiZYPjbS01dCEcaGXiK89y_AtmcDXI028ikyjUCQnTgHvzfHJkS-p3hVAmhW6ehdckHNCSsHxqAMIC-7rytTPsIapW9yFGAI_qMueB4 Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bc4df90b761348c082e7787ff4925299 Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-LiveMigrationTest-373582620 Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:10:12.629919 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc4df90b761348c082e7787ff4925299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc4df90b761348c082e7787ff4925299"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc4df90b761348c082e7787ff4925299"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc4df90b761348c082e7787ff4925299"}]}] Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-LiveMigrationTest-373582620 Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bc4df90b761348c082e7787ff4925299 Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-LiveMigrationTest-373582620 Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-LiveMigrationTest-373582620-project Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 327e7f9ab3d74ff4a4d1bb86d15ad8fc Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-LiveMigrationTest-373582620-project Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 27b090a0-2ada-4af7-be73-c21ed69a3720 could not be found. Oct 04 18:10:12.630909 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '27b090a0-2ada-4af7-be73-c21ed69a3720'} Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b090a0-2ada-4af7-be73-c21ed69a3720 could not be found. Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:12.631492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b090a0-2ada-4af7-be73-c21ed69a3720 could not be found. Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b090a0-2ada-4af7-be73-c21ed69a3720 could not be found. Oct 04 18:10:12.632349 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:12.633146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.642361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.642867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.643355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.644081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.644535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.644964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.649441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Returning 404 to user: Instance 27b090a0-2ada-4af7-be73-c21ed69a3720 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:12.650648 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-27de3424-4735-4d06-9909-ee8f774a6350 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720" status: 404 len: 111 microversion: 2.1 time: 0.074402 Oct 04 18:10:12.651471 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1116/2168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/27b090a0-2ada-4af7-be73-c21ed69a3720 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:12.661229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.663429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.675909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.677343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.678092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.681864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.685064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.686806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.759810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.760948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.761615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.762441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lazy-loading 'fault' on Instance uuid d3352785-cdd3-4a48-bd8f-6c0cfacff173 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:12.861612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.873160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.878235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.893748 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2399936d-ce05-4dcd-a09b-729b8f820694 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.239572 Oct 04 18:10:12.895400 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1117/2169] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:12.905286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67d4e560-85a5-4cac-a4b6-01680e336693 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.906823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67d4e560-85a5-4cac-a4b6-01680e336693 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.913838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e1743c012844919c05429542d30f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ca16963de94a4889dd27ddf6f87415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.927631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d4e560-85a5-4cac-a4b6-01680e336693 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.928871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d4e560-85a5-4cac-a4b6-01680e336693 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.930093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d4e560-85a5-4cac-a4b6-01680e336693 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.932338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d4e560-85a5-4cac-a4b6-01680e336693 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.934014 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c969d0b4-05a8-41c4-87d1-ecfe324dbb87 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 200 len: 1312 microversion: 2.1 time: 0.317600 Oct 04 18:10:12.939567 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1053/2170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:12.940042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d4e560-85a5-4cac-a4b6-01680e336693 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.942383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d4e560-85a5-4cac-a4b6-01680e336693 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.961120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f5b4dcbc-a0ae-4f99-b943-97b02cebd598 req-c92a1563-b2b9-40ab-b9b5-3e4cf6ad2479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3352785-cdd3-4a48-bd8f-6c0cfacff173", "name": "network-vif-deleted", "tag": "75b96692-98cb-4fe0-8702-0069060c372a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:12.994264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f5b4dcbc-a0ae-4f99-b943-97b02cebd598 req-c92a1563-b2b9-40ab-b9b5-3e4cf6ad2479 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.994754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f5b4dcbc-a0ae-4f99-b943-97b02cebd598 req-c92a1563-b2b9-40ab-b9b5-3e4cf6ad2479 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.001018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f5b4dcbc-a0ae-4f99-b943-97b02cebd598 req-c92a1563-b2b9-40ab-b9b5-3e4cf6ad2479 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.036175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67d4e560-85a5-4cac-a4b6-01680e336693 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:13.038645 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f5b4dcbc-a0ae-4f99-b943-97b02cebd598 req-c92a1563-b2b9-40ab-b9b5-3e4cf6ad2479 service nova] Creating event network-vif-deleted:75b96692-98cb-4fe0-8702-0069060c372a for instance d3352785-cdd3-4a48-bd8f-6c0cfacff173 on n-h1-850499-14 Oct 04 18:10:13.052840 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f5b4dcbc-a0ae-4f99-b943-97b02cebd598 req-c92a1563-b2b9-40ab-b9b5-3e4cf6ad2479 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094884 Oct 04 18:10:13.057008 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1054/2171] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:13.134972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-758d2cdc-dd0e-4dc0-86a9-7ff4e593e01e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.137223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-758d2cdc-dd0e-4dc0-86a9-7ff4e593e01e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.150672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-758d2cdc-dd0e-4dc0-86a9-7ff4e593e01e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.151468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-758d2cdc-dd0e-4dc0-86a9-7ff4e593e01e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.152742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-758d2cdc-dd0e-4dc0-86a9-7ff4e593e01e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.154256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-758d2cdc-dd0e-4dc0-86a9-7ff4e593e01e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.154973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-758d2cdc-dd0e-4dc0-86a9-7ff4e593e01e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.155901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-758d2cdc-dd0e-4dc0-86a9-7ff4e593e01e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.173258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67d4e560-85a5-4cac-a4b6-01680e336693 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 204 len: 0 microversion: 2.1 time: 0.275403 Oct 04 18:10:13.174689 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1118/2172] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:12 2022] DELETE /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:13.201453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f57256f3-e842-4ddf-8cef-d74a8f20c7d1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.206219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f57256f3-e842-4ddf-8cef-d74a8f20c7d1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.224338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f57256f3-e842-4ddf-8cef-d74a8f20c7d1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.229532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f57256f3-e842-4ddf-8cef-d74a8f20c7d1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.231341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f57256f3-e842-4ddf-8cef-d74a8f20c7d1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.234003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f57256f3-e842-4ddf-8cef-d74a8f20c7d1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.235971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f57256f3-e842-4ddf-8cef-d74a8f20c7d1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.236561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f57256f3-e842-4ddf-8cef-d74a8f20c7d1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.625697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-758d2cdc-dd0e-4dc0-86a9-7ff4e593e01e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.635387 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-758d2cdc-dd0e-4dc0-86a9-7ff4e593e01e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.507021 Oct 04 18:10:13.636757 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1055/2173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:13.642811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d5b6e30-95c3-4d2a-a3a7-59908ea2d661 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.643752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d5b6e30-95c3-4d2a-a3a7-59908ea2d661 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.657302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5b6e30-95c3-4d2a-a3a7-59908ea2d661 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.658177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5b6e30-95c3-4d2a-a3a7-59908ea2d661 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.658982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5b6e30-95c3-4d2a-a3a7-59908ea2d661 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.660159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5b6e30-95c3-4d2a-a3a7-59908ea2d661 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.661032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5b6e30-95c3-4d2a-a3a7-59908ea2d661 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.661677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5b6e30-95c3-4d2a-a3a7-59908ea2d661 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.674573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f57256f3-e842-4ddf-8cef-d74a8f20c7d1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.687566 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f57256f3-e842-4ddf-8cef-d74a8f20c7d1 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1501 microversion: 2.1 time: 0.507493 Oct 04 18:10:13.688227 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1119/2174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1501 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:13.705997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.707660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.714359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.714872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.715450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.716173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.716640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.717081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.741647 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 HTTP/1.1 Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:10:13.744554 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:10:13.745648 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'a466a26b-a6a8-473e-a42b-e1d1c71c2c35'} Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:13.746220 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:10:13.747185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.747997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:13.747997 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac245c60-ba5d-4d88-a05f-6028f9ece954 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 404 len: 111 microversion: 2.1 time: 0.051930 Oct 04 18:10:13.747997 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1120/2175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:13.758554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-3e25baa3-cbfe-4220-99f3-3d97a6144aeb req-da6c361c-c3e5-4f35-882f-847267ad67d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858d86de-5fe8-43e9-9409-364826f1c48c", "name": "network-vif-plugged", "status": "completed", "tag": "e872f74e-c019-41cc-bb6f-c40a21a59d12"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:13.769791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3e25baa3-cbfe-4220-99f3-3d97a6144aeb req-da6c361c-c3e5-4f35-882f-847267ad67d7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.770650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3e25baa3-cbfe-4220-99f3-3d97a6144aeb req-da6c361c-c3e5-4f35-882f-847267ad67d7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.771455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3e25baa3-cbfe-4220-99f3-3d97a6144aeb req-da6c361c-c3e5-4f35-882f-847267ad67d7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.787398 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-3e25baa3-cbfe-4220-99f3-3d97a6144aeb req-da6c361c-c3e5-4f35-882f-847267ad67d7 service nova] Creating event network-vif-plugged:e872f74e-c019-41cc-bb6f-c40a21a59d12 for instance 858d86de-5fe8-43e9-9409-364826f1c48c on n-h2-850499-14 Oct 04 18:10:13.795242 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-3e25baa3-cbfe-4220-99f3-3d97a6144aeb req-da6c361c-c3e5-4f35-882f-847267ad67d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046249 Oct 04 18:10:13.803212 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1121/2176] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:13.818754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a443643c-964d-4dc0-b3a2-31de9a319469 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d610a160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.886431 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a443643c-964d-4dc0-b3a2-31de9a319469 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.081028 Oct 04 18:10:13.887198 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1122/2177] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:13.929082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.929833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.937340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.937916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.938370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.939127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.939676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.940309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.988291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7d5b6e30-95c3-4d2a-a3a7-59908ea2d661 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.999571 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d5b6e30-95c3-4d2a-a3a7-59908ea2d661 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1322 microversion: 2.1 time: 0.361527 Oct 04 18:10:14.011261 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1056/2178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:14.011261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.011261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.025536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.026116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.026662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.027497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.028061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.028550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.054604 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35/os-volume_attachments HTTP/1.1 Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:14.057047 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:10:14.059020 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'server_id': 'a466a26b-a6a8-473e-a42b-e1d1c71c2c35'} Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:14.060010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:10:14.061477 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.063758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:14.063758 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17a510cf-5759-4259-addd-3e5bf864ed0b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057086 Oct 04 18:10:14.064002 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1057/2179] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:10:14 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:14.069151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.069964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] [instance: d3352785-cdd3-4a48-bd8f-6c0cfacff173] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.076883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.077570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.078091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.079090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.079639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.080147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.097916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:14.099080 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] HTTP exception thrown: Instance d3352785-cdd3-4a48-bd8f-6c0cfacff173 could not be found. Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Request method failure captured: Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 HTTP/1.1 Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHbg7VEzsAOurHOBWyIdkync-MNj2PwkutqmZ_vZM6WKHQwvo_7cT93wLEY0KrDBm9jOKNFYJsIgaiEySlHFc2JxULeFNoAw5mL6Ngv2AYYT73r5x0tXjvNCr1L1xsbH2-21D6-4hLkJMjiH028xam_BLOBxegUaqv-5rOO4zsIKKyo Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 23ca16963de94a4889dd27ddf6f87415 Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-337839008 Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:14.100826 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_23ca16963de94a4889dd27ddf6f87415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/23ca16963de94a4889dd27ddf6f87415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23ca16963de94a4889dd27ddf6f87415"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/23ca16963de94a4889dd27ddf6f87415"}]}] Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-337839008 Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 23ca16963de94a4889dd27ddf6f87415 Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-337839008 Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerDiagnosticsNegativeTest-337839008-project Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 34e1743c012844919c05429542d30f7b Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-337839008-project Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance d3352785-cdd3-4a48-bd8f-6c0cfacff173 could not be found. Oct 04 18:10:14.101892 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'd3352785-cdd3-4a48-bd8f-6c0cfacff173'} Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3352785-cdd3-4a48-bd8f-6c0cfacff173 could not be found. Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:14.102467 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3352785-cdd3-4a48-bd8f-6c0cfacff173 could not be found. Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3352785-cdd3-4a48-bd8f-6c0cfacff173 could not be found. Oct 04 18:10:14.103417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.104311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] Returning 404 to user: Instance d3352785-cdd3-4a48-bd8f-6c0cfacff173 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:14.104311 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d216de66-bc20-467c-bd47-bb2ee7506251 tempest-ServerDiagnosticsNegativeTest-337839008 tempest-ServerDiagnosticsNegativeTest-337839008-project] 10.222.0.18 "GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173" status: 404 len: 111 microversion: 2.1 time: 0.037001 Oct 04 18:10:14.104311 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1058/2180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:14 2022] GET /compute/v2.1/servers/d3352785-cdd3-4a48-bd8f-6c0cfacff173 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:14.109289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-374f62d8-9bda-4854-830c-412f6cb660be req-5a668af6-0bbf-436d-b094-6a6bf8387816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f64a66b-6e31-45ef-a711-60c9e8f0ec3a", "tag": "6edb64f1-120e-4ab2-81b6-c49027ad6cca"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:14.120372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-374f62d8-9bda-4854-830c-412f6cb660be req-5a668af6-0bbf-436d-b094-6a6bf8387816 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.120941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-374f62d8-9bda-4854-830c-412f6cb660be req-5a668af6-0bbf-436d-b094-6a6bf8387816 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.121574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-374f62d8-9bda-4854-830c-412f6cb660be req-5a668af6-0bbf-436d-b094-6a6bf8387816 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.123278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:14.127520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:14.136098 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-374f62d8-9bda-4854-830c-412f6cb660be req-5a668af6-0bbf-436d-b094-6a6bf8387816 service nova] Creating event network-changed:6edb64f1-120e-4ab2-81b6-c49027ad6cca for instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a on n-h2-850499-14 Oct 04 18:10:14.141636 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-374f62d8-9bda-4854-830c-412f6cb660be req-5a668af6-0bbf-436d-b094-6a6bf8387816 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037147 Oct 04 18:10:14.142698 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1059/2181] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:14.150329 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a2198a5-2582-4a89-b84c-f37229b3fa0b tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.225424 Oct 04 18:10:14.163576 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1123/2182] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:14.360574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-847674413", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "3460d6d9-0801-4482-b14b-54fef623a1ce"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:14.432037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] validate_networks() for [('3460d6d9-0801-4482-b14b-54fef623a1ce', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:14.669496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ab442eba-6f0d-4210-ab13-8a83823290c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.670130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ab442eba-6f0d-4210-ab13-8a83823290c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.682558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab442eba-6f0d-4210-ab13-8a83823290c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.683637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab442eba-6f0d-4210-ab13-8a83823290c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.683637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab442eba-6f0d-4210-ab13-8a83823290c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.684254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab442eba-6f0d-4210-ab13-8a83823290c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.684728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab442eba-6f0d-4210-ab13-8a83823290c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.685167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ab442eba-6f0d-4210-ab13-8a83823290c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.737153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:14.997965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ab442eba-6f0d-4210-ab13-8a83823290c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:15.014908 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ab442eba-6f0d-4210-ab13-8a83823290c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.351785 Oct 04 18:10:15.033350 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1124/2183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:14 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:15.049057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04a78b37-d177-481d-bb87-570aec01a291 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.049907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-04a78b37-d177-481d-bb87-570aec01a291 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:15.064324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04a78b37-d177-481d-bb87-570aec01a291 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.065079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04a78b37-d177-481d-bb87-570aec01a291 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.065737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04a78b37-d177-481d-bb87-570aec01a291 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.066677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04a78b37-d177-481d-bb87-570aec01a291 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.067387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04a78b37-d177-481d-bb87-570aec01a291 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.068018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04a78b37-d177-481d-bb87-570aec01a291 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.154624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:15.154624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:15.155478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:15.155478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:15.156874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:15.179974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.188569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.190748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.193180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.197766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.197766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.257091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:15.264462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for user ba39a7cdf309477195a07acb5cdf24f4 and project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:15.316987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:15.325620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 53c91dad-00c1-4391-8481-63cc11613100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:15.476731 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ad95b213-f080-40b2-89f0-e0e7cce977ab tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118977 Oct 04 18:10:15.487298 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1060/2184] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:15.487298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-edc8aa0b-2806-40fe-a28d-32ce1db4fba7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d24fcdc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.550525 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-edc8aa0b-2806-40fe-a28d-32ce1db4fba7 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.071667 Oct 04 18:10:15.551734 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1061/2185] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:15.560311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1decb82c-c937-4af8-80b9-0dc47dbd8a36 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.561828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1decb82c-c937-4af8-80b9-0dc47dbd8a36 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:15.575358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1decb82c-c937-4af8-80b9-0dc47dbd8a36 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.576454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1decb82c-c937-4af8-80b9-0dc47dbd8a36 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.577393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1decb82c-c937-4af8-80b9-0dc47dbd8a36 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.578604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1decb82c-c937-4af8-80b9-0dc47dbd8a36 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.579340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1decb82c-c937-4af8-80b9-0dc47dbd8a36 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.579946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1decb82c-c937-4af8-80b9-0dc47dbd8a36 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.623243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:15.650173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-04a78b37-d177-481d-bb87-570aec01a291 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:15.674602 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-04a78b37-d177-481d-bb87-570aec01a291 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1501 microversion: 2.1 time: 0.628489 Oct 04 18:10:15.676697 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1125/2186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1501 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:15.697552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.699492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:15.717595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.720973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.721866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.725607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.727521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.732239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.984780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.012233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.016069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.026826 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-65261ef6-a03b-408a-a0ea-d1a1b18c5879 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1537 microversion: 2.91 time: 0.346545 Oct 04 18:10:16.027695 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1126/2187] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1537 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:16.040725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51debbf2-8985-42a0-b73c-c4185dd1a2bc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.041754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-51debbf2-8985-42a0-b73c-c4185dd1a2bc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 53c91dad-00c1-4391-8481-63cc11613100] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:16.202005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-51debbf2-8985-42a0-b73c-c4185dd1a2bc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.222105 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-51debbf2-8985-42a0-b73c-c4185dd1a2bc tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100" status: 200 len: 1214 microversion: 2.1 time: 0.190700 Oct 04 18:10:16.240576 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1127/2188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:16 2022] GET /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100 => generated 1214 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:16.257578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d264917e-20d9-488d-a625-f6814bcd8656 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.258482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d264917e-20d9-488d-a625-f6814bcd8656 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:16.267183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d264917e-20d9-488d-a625-f6814bcd8656 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.267974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d264917e-20d9-488d-a625-f6814bcd8656 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.268609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d264917e-20d9-488d-a625-f6814bcd8656 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.269514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d264917e-20d9-488d-a625-f6814bcd8656 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.270547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d264917e-20d9-488d-a625-f6814bcd8656 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.271232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d264917e-20d9-488d-a625-f6814bcd8656 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.302538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1decb82c-c937-4af8-80b9-0dc47dbd8a36 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.316033 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1decb82c-c937-4af8-80b9-0dc47dbd8a36 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1322 microversion: 2.1 time: 0.760771 Oct 04 18:10:16.316827 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1062/2189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1322 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:16.326395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.328552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 53c91dad-00c1-4391-8481-63cc11613100] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:16.394939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 53c91dad-00c1-4391-8481-63cc11613100] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:16.411522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.412288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.413114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.466568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'flavor' on Instance uuid 53c91dad-00c1-4391-8481-63cc11613100 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:16.527838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'system_metadata' on Instance uuid 53c91dad-00c1-4391-8481-63cc11613100 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:16.583488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d264917e-20d9-488d-a625-f6814bcd8656 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.591893 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d264917e-20d9-488d-a625-f6814bcd8656 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.349417 Oct 04 18:10:16.605071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'metadata' on Instance uuid 53c91dad-00c1-4391-8481-63cc11613100 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:16.609247 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1128/2190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:16 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:16.614652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6958cea4-b96c-4207-9180-4a73a2616868 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d14f6550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.673501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6958cea4-b96c-4207-9180-4a73a2616868 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.062294 Oct 04 18:10:16.674739 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1129/2191] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:16 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:16.681098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7c6c676f-8786-4451-9c12-02f25af649c5 req-96ba53ce-0358-4355-9c85-3a00daf6d25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0d4381-3fce-4a7d-918e-755cd5123531", "name": "network-vif-deleted", "tag": "17b6dffb-7626-47e5-838a-8ecf72593ec8"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:16.707704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7c6c676f-8786-4451-9c12-02f25af649c5 req-96ba53ce-0358-4355-9c85-3a00daf6d25f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.708452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7c6c676f-8786-4451-9c12-02f25af649c5 req-96ba53ce-0358-4355-9c85-3a00daf6d25f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.710417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7c6c676f-8786-4451-9c12-02f25af649c5 req-96ba53ce-0358-4355-9c85-3a00daf6d25f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.001742 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.scheduler.client.report [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Deleted allocations for instance 53c91dad-00c1-4391-8481-63cc11613100 Oct 04 18:10:17.067408 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-80246b62-7630-4639-b8cb-e4c5b7a62d40 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100" status: 204 len: 0 microversion: 2.1 time: 0.744770 Oct 04 18:10:17.073795 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1063/2192] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:16 2022] DELETE /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:17.090425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.092050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.117518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.119685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.122408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.125315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.127763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.130040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.224788 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7c6c676f-8786-4451-9c12-02f25af649c5 req-96ba53ce-0358-4355-9c85-3a00daf6d25f service nova] Creating event network-vif-deleted:17b6dffb-7626-47e5-838a-8ecf72593ec8 for instance ea0d4381-3fce-4a7d-918e-755cd5123531 on n-h2-850499-14 Oct 04 18:10:17.241785 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7c6c676f-8786-4451-9c12-02f25af649c5 req-96ba53ce-0358-4355-9c85-3a00daf6d25f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.565382 Oct 04 18:10:17.242973 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1130/2193] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:17.249083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.250788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.253514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.254094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.254211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lazy-loading 'fault' on Instance uuid ea0d4381-3fce-4a7d-918e-755cd5123531 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:17.255251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.274142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.274634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.275283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.277084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.277750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.278338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.343371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.355223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.358316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.360545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lazy-loading 'fault' on Instance uuid 11187b54-8f68-40db-b316-f1cfba27eb35 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:17.448180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.472852 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-198cd8c6-232b-42bf-afd9-f897e769a3a6 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1301 microversion: 2.1 time: 0.382067 Oct 04 18:10:17.479211 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1064/2194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1301 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:17.518914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.518914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 53c91dad-00c1-4391-8481-63cc11613100] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.538445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.540263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.540788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.547420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.563712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.564370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.608145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.613655 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100 HTTP/1.1 Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:17.615664 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:10:17.616887 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '53c91dad-00c1-4391-8481-63cc11613100'} Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:17.617487 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:10:17.618411 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:17.619924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:17.620902 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7772856a-3c2e-4d56-a3a8-b82780ccce25 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100" status: 404 len: 111 microversion: 2.1 time: 0.140599 Oct 04 18:10:17.621712 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1065/2195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:17.630098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-23d2e4d0-b46c-4321-9c4e-8a4cda591453 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.630991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-23d2e4d0-b46c-4321-9c4e-8a4cda591453 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.638064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d2e4d0-b46c-4321-9c4e-8a4cda591453 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.638792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d2e4d0-b46c-4321-9c4e-8a4cda591453 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.639581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d2e4d0-b46c-4321-9c4e-8a4cda591453 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.649605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.650420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d2e4d0-b46c-4321-9c4e-8a4cda591453 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.659385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72f39a6a738045f592734b36a265febd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a6c48bdde84fb49996b12ff2d70315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.659385 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d5819b5-e7e1-4f4f-970a-1b8d8c31bee7 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 200 len: 1542 microversion: 2.91 time: 0.414512 Oct 04 18:10:17.659807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d2e4d0-b46c-4321-9c4e-8a4cda591453 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.668138 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1131/2196] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 1542 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:17.668437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23d2e4d0-b46c-4321-9c4e-8a4cda591453 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.670406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bd85c2ea-6ec5-44bb-bbdf-f72e72b08e3e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.672219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bd85c2ea-6ec5-44bb-bbdf-f72e72b08e3e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.681391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd85c2ea-6ec5-44bb-bbdf-f72e72b08e3e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.682855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd85c2ea-6ec5-44bb-bbdf-f72e72b08e3e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.683580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd85c2ea-6ec5-44bb-bbdf-f72e72b08e3e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.684800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd85c2ea-6ec5-44bb-bbdf-f72e72b08e3e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.686206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd85c2ea-6ec5-44bb-bbdf-f72e72b08e3e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.687281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd85c2ea-6ec5-44bb-bbdf-f72e72b08e3e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.011778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bd85c2ea-6ec5-44bb-bbdf-f72e72b08e3e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.025719 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bd85c2ea-6ec5-44bb-bbdf-f72e72b08e3e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.361372 Oct 04 18:10:18.031920 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1132/2197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:18.052073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2cdd05b-2faf-41af-a78e-f5d0a08b3428 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1555160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.140033 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2cdd05b-2faf-41af-a78e-f5d0a08b3428 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.105658 Oct 04 18:10:18.144281 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1133/2198] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:18.158208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1887246441", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "3460d6d9-0801-4482-b14b-54fef623a1ce"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:18.195262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23d2e4d0-b46c-4321-9c4e-8a4cda591453 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.205786 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-23d2e4d0-b46c-4321-9c4e-8a4cda591453 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1515 microversion: 2.1 time: 0.581163 Oct 04 18:10:18.219372 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1066/2199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1515 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:18.249407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c0814f51-d76b-4201-9fb2-aa9d33b38b54 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.250581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c0814f51-d76b-4201-9fb2-aa9d33b38b54 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:18.303333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0814f51-d76b-4201-9fb2-aa9d33b38b54 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.304112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0814f51-d76b-4201-9fb2-aa9d33b38b54 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.304791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0814f51-d76b-4201-9fb2-aa9d33b38b54 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.306101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0814f51-d76b-4201-9fb2-aa9d33b38b54 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.306676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0814f51-d76b-4201-9fb2-aa9d33b38b54 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.307436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0814f51-d76b-4201-9fb2-aa9d33b38b54 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.317266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] validate_networks() for [('3460d6d9-0801-4482-b14b-54fef623a1ce', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:18.823694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c0814f51-d76b-4201-9fb2-aa9d33b38b54 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.832457 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c0814f51-d76b-4201-9fb2-aa9d33b38b54 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc" status: 200 len: 1515 microversion: 2.1 time: 0.601535 Oct 04 18:10:18.836599 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1067/2200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc => generated 1515 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:18.841745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.842475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:18.863175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.864050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.864721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.866617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.867419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.868068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.920392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.923585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.924195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.926087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lazy-loading 'fault' on Instance uuid ea0d4381-3fce-4a7d-918e-755cd5123531 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:19.033398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.051705 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-74b4f008-1d5a-464a-8d1a-eff79ebbcb28 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1301 microversion: 2.1 time: 0.212859 Oct 04 18:10:19.052953 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1068/2201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1301 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:19.062340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.063560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] [instance: 11187b54-8f68-40db-b316-f1cfba27eb35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.075659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.076784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.077435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.078421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.078978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.079551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.090641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:19.092025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:19.093049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:19.094345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:19.095775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:19.110825 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] HTTP exception thrown: Instance 11187b54-8f68-40db-b316-f1cfba27eb35 could not be found. Oct 04 18:10:19.112752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Request method failure captured: Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 HTTP/1.1 Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYz4SLzCUrOsMH3ndiEsohamSRbzfgOeKD5DlfOwD54UrdFhpCwEf33eZzkmTlcur8rZY0CiOJJ1dXzBYm4OiII7JTq67jhy-N-0TydIOIvtV2kJJTHxQy6sYIazjnJf_pwbPGwpCyJnri-OVGvWHveeefVXqIE7RDiptv0-2snqjU Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 08a6c48bdde84fb49996b12ff2d70315 Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-624071692 Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:19.112999 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_08a6c48bdde84fb49996b12ff2d70315"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/08a6c48bdde84fb49996b12ff2d70315"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08a6c48bdde84fb49996b12ff2d70315"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08a6c48bdde84fb49996b12ff2d70315"}]}] Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-624071692 Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 08a6c48bdde84fb49996b12ff2d70315 Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-624071692 Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-UnshelveToHostMultiNodesTest-624071692-project Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 72f39a6a738045f592734b36a265febd Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-624071692-project Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 11187b54-8f68-40db-b316-f1cfba27eb35 could not be found. Oct 04 18:10:19.114096 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '11187b54-8f68-40db-b316-f1cfba27eb35'} Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11187b54-8f68-40db-b316-f1cfba27eb35 could not be found. Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:19.114811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11187b54-8f68-40db-b316-f1cfba27eb35 could not be found. Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11187b54-8f68-40db-b316-f1cfba27eb35 could not be found. Oct 04 18:10:19.115797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:19.116637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] Returning 404 to user: Instance 11187b54-8f68-40db-b316-f1cfba27eb35 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:19.116637 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c3907e26-fd37-4ad2-8672-7e3066ff1321 tempest-UnshelveToHostMultiNodesTest-624071692 tempest-UnshelveToHostMultiNodesTest-624071692-project] 10.222.0.18 "GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35" status: 404 len: 111 microversion: 2.91 time: 0.059739 Oct 04 18:10:19.116637 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1069/2202] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:19 2022] GET /compute/v2.1/servers/11187b54-8f68-40db-b316-f1cfba27eb35 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:19.118175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.118875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.120504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.121390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.122029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.134932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ecec98c-301c-4af7-948b-707c9dde7557 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.135736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ecec98c-301c-4af7-948b-707c9dde7557 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.159784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:19.166543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for user ba39a7cdf309477195a07acb5cdf24f4 and project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:19.169420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ecec98c-301c-4af7-948b-707c9dde7557 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.171538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ecec98c-301c-4af7-948b-707c9dde7557 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.172268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ecec98c-301c-4af7-948b-707c9dde7557 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.173487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ecec98c-301c-4af7-948b-707c9dde7557 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.174300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ecec98c-301c-4af7-948b-707c9dde7557 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.179907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ecec98c-301c-4af7-948b-707c9dde7557 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.181535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:19.184251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:19.261390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ecec98c-301c-4af7-948b-707c9dde7557 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:19.318559 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3887b100-fcd5-4b99-8159-23a07cb1e511 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170807 Oct 04 18:10:19.319931 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1134/2203] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:19.328051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1396cbbb-446c-49b2-afb0-6c6ef5772cfd tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.330110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1396cbbb-446c-49b2-afb0-6c6ef5772cfd tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.339037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1396cbbb-446c-49b2-afb0-6c6ef5772cfd tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.342437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1396cbbb-446c-49b2-afb0-6c6ef5772cfd tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.344080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1396cbbb-446c-49b2-afb0-6c6ef5772cfd tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.346656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1396cbbb-446c-49b2-afb0-6c6ef5772cfd tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.348129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1396cbbb-446c-49b2-afb0-6c6ef5772cfd tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.349248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1396cbbb-446c-49b2-afb0-6c6ef5772cfd tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.432802 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ecec98c-301c-4af7-948b-707c9dde7557 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc" status: 204 len: 0 microversion: 2.1 time: 0.311912 Oct 04 18:10:19.433749 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1070/2204] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:19 2022] DELETE /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:19.461360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f24e1467-04cf-47b6-944f-088967856618 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1da4550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.573785 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f24e1467-04cf-47b6-944f-088967856618 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.138042 Oct 04 18:10:19.574379 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1071/2205] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:19 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:19.588547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d40f9770-650c-4140-a323-c630f311c59f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.606004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d40f9770-650c-4140-a323-c630f311c59f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.799135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d40f9770-650c-4140-a323-c630f311c59f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.804533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1396cbbb-446c-49b2-afb0-6c6ef5772cfd tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.808996 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d40f9770-650c-4140-a323-c630f311c59f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1215 microversion: 2.1 time: 0.222427 Oct 04 18:10:19.816971 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1396cbbb-446c-49b2-afb0-6c6ef5772cfd tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.495508 Oct 04 18:10:19.827079 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1072/2206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:19 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:19.829854 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1135/2207] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:19 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:19.851047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-146e5e5d-de59-43d9-a645-d6e1261b88d6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.852935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-146e5e5d-de59-43d9-a645-d6e1261b88d6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.868493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-146e5e5d-de59-43d9-a645-d6e1261b88d6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.872286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-146e5e5d-de59-43d9-a645-d6e1261b88d6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.873550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-146e5e5d-de59-43d9-a645-d6e1261b88d6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.878723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-146e5e5d-de59-43d9-a645-d6e1261b88d6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.879556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-146e5e5d-de59-43d9-a645-d6e1261b88d6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.882203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-146e5e5d-de59-43d9-a645-d6e1261b88d6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.085021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:20.088521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:20.110003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.111692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.112367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.113425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.114092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.115225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.170292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.171481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.173173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.173817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-146e5e5d-de59-43d9-a645-d6e1261b88d6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:20.174082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lazy-loading 'fault' on Instance uuid ea0d4381-3fce-4a7d-918e-755cd5123531 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:20.189201 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-146e5e5d-de59-43d9-a645-d6e1261b88d6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc" status: 200 len: 1521 microversion: 2.1 time: 0.364982 Oct 04 18:10:20.190232 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1073/2208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:19 2022] GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:20.287858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:20.308295 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2af0b1b7-d5c7-4236-836b-c058c6bd2044 tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1301 microversion: 2.1 time: 0.228798 Oct 04 18:10:20.312301 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1136/2209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:20 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1301 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:20.552394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-330474845", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:20.590935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-68b15fd5-136b-449a-877a-573f9b4e422f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d611db80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:20.684727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:20.735217 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-68b15fd5-136b-449a-877a-573f9b4e422f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.148334 Oct 04 18:10:20.736210 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1137/2210] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:20 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:20.846805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2aa6dce4-76f2-4387-91fd-fb0a3e909d08 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:20.862867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2aa6dce4-76f2-4387-91fd-fb0a3e909d08 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:20.877393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aa6dce4-76f2-4387-91fd-fb0a3e909d08 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.878677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aa6dce4-76f2-4387-91fd-fb0a3e909d08 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.879362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aa6dce4-76f2-4387-91fd-fb0a3e909d08 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.880564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aa6dce4-76f2-4387-91fd-fb0a3e909d08 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.881447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aa6dce4-76f2-4387-91fd-fb0a3e909d08 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.882764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aa6dce4-76f2-4387-91fd-fb0a3e909d08 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.013373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:21.014593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:21.015453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:21.017718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:21.019148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:21.031600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.032661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.033354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.034447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.035127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.035838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.055475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2aa6dce4-76f2-4387-91fd-fb0a3e909d08 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:21.055802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:21.071845 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2aa6dce4-76f2-4387-91fd-fb0a3e909d08 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1219 microversion: 2.1 time: 0.232981 Oct 04 18:10:21.082977 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1138/2211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:20 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1219 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:21.082977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9d3786f-085b-437f-90dc-ad6e53a04635 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:21.082977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9d3786f-085b-437f-90dc-ad6e53a04635 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:21.085932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3786f-085b-437f-90dc-ad6e53a04635 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.086430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3786f-085b-437f-90dc-ad6e53a04635 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.086890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3786f-085b-437f-90dc-ad6e53a04635 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.087023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Getting quotas for project b1b14394d8ea452eb046b7ce147a4ec7. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:21.091133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3786f-085b-437f-90dc-ad6e53a04635 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.091133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3786f-085b-437f-90dc-ad6e53a04635 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.091133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3786f-085b-437f-90dc-ad6e53a04635 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.096589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Getting quotas for user 0b824cdb1fd346729b59aece4c49a927 and project b1b14394d8ea452eb046b7ce147a4ec7. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:21.117502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:21.121026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:21.198395 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ce00a5a-49b0-4d7a-be1b-4ac5c6b766ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846263 Oct 04 18:10:21.200066 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1074/2212] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:21.247091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39475361-9d56-4c26-ac80-b0a82c95e1a5 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:21.265229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39475361-9d56-4c26-ac80-b0a82c95e1a5 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:21.271807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39475361-9d56-4c26-ac80-b0a82c95e1a5 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.276014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39475361-9d56-4c26-ac80-b0a82c95e1a5 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.277238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39475361-9d56-4c26-ac80-b0a82c95e1a5 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.278452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39475361-9d56-4c26-ac80-b0a82c95e1a5 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.280677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39475361-9d56-4c26-ac80-b0a82c95e1a5 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.283124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39475361-9d56-4c26-ac80-b0a82c95e1a5 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.397513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9d3786f-085b-437f-90dc-ad6e53a04635 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:21.406845 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9d3786f-085b-437f-90dc-ad6e53a04635 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.332292 Oct 04 18:10:21.415082 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1139/2213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:21 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:21.468240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:21.469713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:21.479465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.480340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.487430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.488644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.489365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.490041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.640117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.641482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.646659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.655118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lazy-loading 'fault' on Instance uuid ea0d4381-3fce-4a7d-918e-755cd5123531 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:21.673974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-39475361-9d56-4c26-ac80-b0a82c95e1a5 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:21.696289 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39475361-9d56-4c26-ac80-b0a82c95e1a5 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc" status: 200 len: 1521 microversion: 2.1 time: 0.468000 Oct 04 18:10:21.703105 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1075/2214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:21 2022] GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:21.709299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-518559945", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:21.779002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327e7f9ab3d74ff4a4d1bb86d15ad8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc4df90b761348c082e7787ff4925299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:21.795613 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b277d298-498b-467c-bd41-cecaa7cd5f1a tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 200 len: 1301 microversion: 2.1 time: 0.365065 Oct 04 18:10:21.796636 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1140/2215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:21 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 1301 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:21.813506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03cc74c9-5452-4a5d-9a5d-18e1c91ee511 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61275e0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:21.830889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:21.930860 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-03cc74c9-5452-4a5d-9a5d-18e1c91ee511 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1411 microversion: 2.1 time: 0.132191 Oct 04 18:10:21.932827 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1141/2216] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:21 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1411 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:22.099115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0b346213-6c42-4ddb-9cf2-05453c0cfee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.099755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0b346213-6c42-4ddb-9cf2-05453c0cfee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:22.121485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b346213-6c42-4ddb-9cf2-05453c0cfee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.122015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b346213-6c42-4ddb-9cf2-05453c0cfee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.122483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b346213-6c42-4ddb-9cf2-05453c0cfee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.130297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b346213-6c42-4ddb-9cf2-05453c0cfee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.133625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b346213-6c42-4ddb-9cf2-05453c0cfee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.134532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b346213-6c42-4ddb-9cf2-05453c0cfee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.259261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:22.259841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:22.260273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:22.260723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:22.261195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:22.289297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.291237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.293251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.294573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.297735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.298751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.330906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0b346213-6c42-4ddb-9cf2-05453c0cfee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:22.346031 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0b346213-6c42-4ddb-9cf2-05453c0cfee4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1267 microversion: 2.1 time: 0.247541 Oct 04 18:10:22.347110 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1142/2217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:22.358149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Getting quotas for project b1b14394d8ea452eb046b7ce147a4ec7. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:22.370312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Getting quotas for user 0b824cdb1fd346729b59aece4c49a927 and project b1b14394d8ea452eb046b7ce147a4ec7. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:22.406381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:22.410105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:22.443868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-18f76768-023e-41ee-a9f8-3a48283dd3e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.445131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-18f76768-023e-41ee-a9f8-3a48283dd3e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:22.462376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18f76768-023e-41ee-a9f8-3a48283dd3e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.466623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18f76768-023e-41ee-a9f8-3a48283dd3e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.467451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18f76768-023e-41ee-a9f8-3a48283dd3e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.469989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18f76768-023e-41ee-a9f8-3a48283dd3e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.473771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18f76768-023e-41ee-a9f8-3a48283dd3e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.474236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18f76768-023e-41ee-a9f8-3a48283dd3e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.560748 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-23e42226-8691-4dff-a695-bd76828da4c9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855349 Oct 04 18:10:22.569235 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1076/2218] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:22.575609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-802a9ff0-5e1f-46d0-b5e7-a3396f4cf558 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.577145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-802a9ff0-5e1f-46d0-b5e7-a3396f4cf558 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:22.688865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-802a9ff0-5e1f-46d0-b5e7-a3396f4cf558 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:22.696930 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-802a9ff0-5e1f-46d0-b5e7-a3396f4cf558 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1213 microversion: 2.1 time: 0.125576 Oct 04 18:10:22.701314 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1077/2219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:22.733200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d1d15be-39f5-4424-bcf4-8b568c358f70 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.734940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9d1d15be-39f5-4424-bcf4-8b568c358f70 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:22.747774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d1d15be-39f5-4424-bcf4-8b568c358f70 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.748447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d1d15be-39f5-4424-bcf4-8b568c358f70 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.749002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d1d15be-39f5-4424-bcf4-8b568c358f70 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.749871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d1d15be-39f5-4424-bcf4-8b568c358f70 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.751558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d1d15be-39f5-4424-bcf4-8b568c358f70 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.752223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d1d15be-39f5-4424-bcf4-8b568c358f70 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.941460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-18f76768-023e-41ee-a9f8-3a48283dd3e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:22.959691 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-18f76768-023e-41ee-a9f8-3a48283dd3e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.520737 Oct 04 18:10:22.977218 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1143/2220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:23.019371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:23.019995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] [instance: ea0d4381-3fce-4a7d-918e-755cd5123531] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:23.045223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.045854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.046607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.047483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.047960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.048381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.107706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9d1d15be-39f5-4424-bcf4-8b568c358f70 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:23.111275 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] HTTP exception thrown: Instance ea0d4381-3fce-4a7d-918e-755cd5123531 could not be found. Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Request method failure captured: Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 HTTP/1.1 Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHUJ3cjVSHexwIjEk6YYRPM4aeRk4n8Lb6xHENjLa6WH5tv19z26xN69bIxWjL3jQ5J-QxDshiZYPjbS01dCEcaGXiK89y_AtmcDXI028ikyjUCQnTgHvzfHJkS-p3hVAmhW6ehdckHNCSsHxqAMIC-7rytTPsIapW9yFGAI_qMueB4 Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bc4df90b761348c082e7787ff4925299 Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-LiveMigrationTest-373582620 Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:10:23.121497 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc4df90b761348c082e7787ff4925299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc4df90b761348c082e7787ff4925299"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc4df90b761348c082e7787ff4925299"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc4df90b761348c082e7787ff4925299"}]}] Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-LiveMigrationTest-373582620 Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bc4df90b761348c082e7787ff4925299 Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-LiveMigrationTest-373582620 Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-LiveMigrationTest-373582620-project Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 327e7f9ab3d74ff4a4d1bb86d15ad8fc Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-LiveMigrationTest-373582620-project Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ea0d4381-3fce-4a7d-918e-755cd5123531 could not be found. Oct 04 18:10:23.123810 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ea0d4381-3fce-4a7d-918e-755cd5123531'} Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0d4381-3fce-4a7d-918e-755cd5123531 could not be found. Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:23.125121 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0d4381-3fce-4a7d-918e-755cd5123531 could not be found. Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0d4381-3fce-4a7d-918e-755cd5123531 could not be found. Oct 04 18:10:23.127119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:23.141896 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9d1d15be-39f5-4424-bcf4-8b568c358f70 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc" status: 200 len: 1521 microversion: 2.1 time: 0.415915 Oct 04 18:10:23.143264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] Returning 404 to user: Instance ea0d4381-3fce-4a7d-918e-755cd5123531 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:23.152831 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3595688c-be59-4e59-8529-07d577bfc77c tempest-LiveMigrationTest-373582620 tempest-LiveMigrationTest-373582620-project] 10.222.0.18 "GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531" status: 404 len: 111 microversion: 2.1 time: 0.155729 Oct 04 18:10:23.156415 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1078/2221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:23.161378 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1144/2222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/servers/ea0d4381-3fce-4a7d-918e-755cd5123531 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:23.181812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b683f4ed-6e4f-4301-b140-1386923d4ce9 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d238eaf0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:23.184339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-45046a47-212a-4856-beb2-a17f0a93fd72 req-9e886d43-e04b-40f9-84cd-9451d96277fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc", "name": "network-vif-deleted", "tag": "37f5965c-e639-4376-a067-f8aeab3bea4d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:23.227841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-45046a47-212a-4856-beb2-a17f0a93fd72 req-9e886d43-e04b-40f9-84cd-9451d96277fa service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.235055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-45046a47-212a-4856-beb2-a17f0a93fd72 req-9e886d43-e04b-40f9-84cd-9451d96277fa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.235971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-45046a47-212a-4856-beb2-a17f0a93fd72 req-9e886d43-e04b-40f9-84cd-9451d96277fa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.287074 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-45046a47-212a-4856-beb2-a17f0a93fd72 req-9e886d43-e04b-40f9-84cd-9451d96277fa service nova] Creating event network-vif-deleted:37f5965c-e639-4376-a067-f8aeab3bea4d for instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc on n-h1-850499-14 Oct 04 18:10:23.302448 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-45046a47-212a-4856-beb2-a17f0a93fd72 req-9e886d43-e04b-40f9-84cd-9451d96277fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137652 Oct 04 18:10:23.307277 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1145/2223] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:23.337611 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b683f4ed-6e4f-4301-b140-1386923d4ce9 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1420 microversion: 2.1 time: 0.171196 Oct 04 18:10:23.339173 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1079/2224] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:23 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:23.361745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b6bc6572-7941-4818-98d9-6c3fe7a7ffd5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d6122550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:23.372141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d2b95e8-e9c1-4ad3-a1e9-97ae48e05859 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:23.372916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d2b95e8-e9c1-4ad3-a1e9-97ae48e05859 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:23.410336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2b95e8-e9c1-4ad3-a1e9-97ae48e05859 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.410863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2b95e8-e9c1-4ad3-a1e9-97ae48e05859 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.414043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2b95e8-e9c1-4ad3-a1e9-97ae48e05859 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.416935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2b95e8-e9c1-4ad3-a1e9-97ae48e05859 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.417449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2b95e8-e9c1-4ad3-a1e9-97ae48e05859 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.423448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2b95e8-e9c1-4ad3-a1e9-97ae48e05859 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.434768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:23.473016 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b6bc6572-7941-4818-98d9-6c3fe7a7ffd5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 200 len: 1420 microversion: 2.1 time: 0.115663 Oct 04 18:10:23.494122 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1146/2225] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:10:23 2022] GET /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:23.505148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aaad8ef5-f4c4-4157-b1c3-549878023728 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d618bb80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:23.637664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d2b95e8-e9c1-4ad3-a1e9-97ae48e05859 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:23.655025 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d2b95e8-e9c1-4ad3-a1e9-97ae48e05859 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1275 microversion: 2.1 time: 0.285633 Oct 04 18:10:23.657138 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1080/2226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:23 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:23.725088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-862652d8-7b01-405a-b503-0b8647054758 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:23.725966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-862652d8-7b01-405a-b503-0b8647054758 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:23.852762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-862652d8-7b01-405a-b503-0b8647054758 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:23.861569 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-862652d8-7b01-405a-b503-0b8647054758 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1213 microversion: 2.1 time: 0.140719 Oct 04 18:10:23.862175 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1081/2227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:23 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1213 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:24.006172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ad97b2c5-aa09-4441-8aae-154d93ad99e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.007221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ad97b2c5-aa09-4441-8aae-154d93ad99e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:24.026318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad97b2c5-aa09-4441-8aae-154d93ad99e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.027656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad97b2c5-aa09-4441-8aae-154d93ad99e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.029315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad97b2c5-aa09-4441-8aae-154d93ad99e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.030435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad97b2c5-aa09-4441-8aae-154d93ad99e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.030921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad97b2c5-aa09-4441-8aae-154d93ad99e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.037120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad97b2c5-aa09-4441-8aae-154d93ad99e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.381151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ad97b2c5-aa09-4441-8aae-154d93ad99e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:24.391716 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ad97b2c5-aa09-4441-8aae-154d93ad99e1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.391670 Oct 04 18:10:24.393906 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1082/2228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:23 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:24.406871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.409114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:24.420293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.421321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.422073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.423427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.424149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.424965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.482822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.483639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.484433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.485237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lazy-loading 'fault' on Instance uuid ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:24.616076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:24.628574 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3f6e8110-e2d2-4509-80b7-5e946cf5b14c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc" status: 200 len: 1312 microversion: 2.1 time: 0.232772 Oct 04 18:10:24.629353 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1083/2229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:24 2022] GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc => generated 1312 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:24.683077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-64d1d2e7-2a34-41dd-9273-ef70afa17df1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.684462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-64d1d2e7-2a34-41dd-9273-ef70afa17df1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:24.702670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d1d2e7-2a34-41dd-9273-ef70afa17df1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.707235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d1d2e7-2a34-41dd-9273-ef70afa17df1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.708107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d1d2e7-2a34-41dd-9273-ef70afa17df1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.710410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d1d2e7-2a34-41dd-9273-ef70afa17df1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.716134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d1d2e7-2a34-41dd-9273-ef70afa17df1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.716687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d1d2e7-2a34-41dd-9273-ef70afa17df1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.851569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-64d1d2e7-2a34-41dd-9273-ef70afa17df1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:24.865641 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-64d1d2e7-2a34-41dd-9273-ef70afa17df1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1273 microversion: 2.1 time: 0.187281 Oct 04 18:10:24.868567 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1084/2230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:24 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:24.873725 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aaad8ef5-f4c4-4157-b1c3-549878023728 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 204 len: 0 microversion: 2.1 time: 1.378325 Oct 04 18:10:24.875736 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1147/2231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:23 2022] DELETE /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 0 bytes in 1381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:24.892851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b255779-dae4-483b-bcbc-365b51c1fa56 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.895313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b255779-dae4-483b-bcbc-365b51c1fa56 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:24.899823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7000a161-b28b-447a-8d53-19eb7ef9a18e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.900460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7000a161-b28b-447a-8d53-19eb7ef9a18e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:24.908259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b255779-dae4-483b-bcbc-365b51c1fa56 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.908992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b255779-dae4-483b-bcbc-365b51c1fa56 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.909674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b255779-dae4-483b-bcbc-365b51c1fa56 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.910622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b255779-dae4-483b-bcbc-365b51c1fa56 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.911420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b255779-dae4-483b-bcbc-365b51c1fa56 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.912088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b255779-dae4-483b-bcbc-365b51c1fa56 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.918490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7000a161-b28b-447a-8d53-19eb7ef9a18e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.919016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7000a161-b28b-447a-8d53-19eb7ef9a18e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.919457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7000a161-b28b-447a-8d53-19eb7ef9a18e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.923690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7000a161-b28b-447a-8d53-19eb7ef9a18e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.925688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7000a161-b28b-447a-8d53-19eb7ef9a18e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.927980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7000a161-b28b-447a-8d53-19eb7ef9a18e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.958416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b255779-dae4-483b-bcbc-365b51c1fa56 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:25.003930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:25.048112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:25.067631 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b255779-dae4-483b-bcbc-365b51c1fa56 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 204 len: 0 microversion: 2.1 time: 0.182539 Oct 04 18:10:25.084264 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1148/2232] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:24 2022] DELETE /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:25.217612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1067163713", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "09d3e330-5b4f-4c00-bc76-a5da1584aaf5"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:25.314600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] validate_networks() for [('09d3e330-5b4f-4c00-bc76-a5da1584aaf5', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:25.498591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7000a161-b28b-447a-8d53-19eb7ef9a18e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:25.510899 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7000a161-b28b-447a-8d53-19eb7ef9a18e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1265 microversion: 2.1 time: 0.626202 Oct 04 18:10:25.526996 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1085/2233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:24 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1265 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:25.535602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7b59e9d1-b86e-418d-a687-2ad7f366b320 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:25.536432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7b59e9d1-b86e-418d-a687-2ad7f366b320 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:25.546019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b59e9d1-b86e-418d-a687-2ad7f366b320 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:25.548524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b59e9d1-b86e-418d-a687-2ad7f366b320 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:25.549473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b59e9d1-b86e-418d-a687-2ad7f366b320 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:25.551049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b59e9d1-b86e-418d-a687-2ad7f366b320 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:25.552264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b59e9d1-b86e-418d-a687-2ad7f366b320 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:25.553354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b59e9d1-b86e-418d-a687-2ad7f366b320 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:25.971853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b59e9d1-b86e-418d-a687-2ad7f366b320 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:25.986714 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7b59e9d1-b86e-418d-a687-2ad7f366b320 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.461885 Oct 04 18:10:25.987499 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1086/2234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:25 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:25.999898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8dbfcfa8-9757-4b6a-b1a8-20797d15ab26 req-4b9697d8-94d3-4581-8538-aae6c5c14b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bfba3c-5b12-4b4a-800c-c3a37b9da5e2", "name": "network-vif-unplugged", "status": "completed", "tag": "d87be326-0818-410e-ad20-1bc0d3600186"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:26.006840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8dbfcfa8-9757-4b6a-b1a8-20797d15ab26 req-4b9697d8-94d3-4581-8538-aae6c5c14b11 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.007603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8dbfcfa8-9757-4b6a-b1a8-20797d15ab26 req-4b9697d8-94d3-4581-8538-aae6c5c14b11 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.008280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8dbfcfa8-9757-4b6a-b1a8-20797d15ab26 req-4b9697d8-94d3-4581-8538-aae6c5c14b11 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.027730 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8dbfcfa8-9757-4b6a-b1a8-20797d15ab26 req-4b9697d8-94d3-4581-8538-aae6c5c14b11 service nova] Creating event network-vif-unplugged:d87be326-0818-410e-ad20-1bc0d3600186 for instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 on n-h1-850499-14 Oct 04 18:10:26.035626 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8dbfcfa8-9757-4b6a-b1a8-20797d15ab26 req-4b9697d8-94d3-4581-8538-aae6c5c14b11 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046728 Oct 04 18:10:26.042543 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1087/2235] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:26.049193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.050264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:26.063228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.064085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.065019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.065995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.066682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.068079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.090734 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] HTTP exception thrown: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Request method failure captured: Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc HTTP/1.1 Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHbbWX5KhDyYM_40LNILvuTuuaZJWcvDJ-W-1pGfnreKrB026rhm2m3CV2EFLyjb5QkPRt9RpPGK8ecl4pGw1VkfTHCCBwtvhU-2h5cgtV1k6y0Uqd3z01Pdp0A82J4NV-DnSkczdyvCn7lwoj-dG7yo6w-eBzQlHK3OIbj19y7FnBQ Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:26.096337 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}] Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: bf48879013734f8ca1ce5862895b8bcf Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:26.103536 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc'} Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:26.104294 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:26.105784 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.106948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Returning 404 to user: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:26.106948 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3d225315-c01a-44f3-b9b0-5530e5c4ce77 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc" status: 404 len: 111 microversion: 2.1 time: 0.049977 Oct 04 18:10:26.106948 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1088/2236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:26.106948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c065be4-b98c-4c8a-8f04-9db34805e091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.106948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3c065be4-b98c-4c8a-8f04-9db34805e091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:26.110997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c065be4-b98c-4c8a-8f04-9db34805e091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.111368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c065be4-b98c-4c8a-8f04-9db34805e091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.111808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c065be4-b98c-4c8a-8f04-9db34805e091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.112541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c065be4-b98c-4c8a-8f04-9db34805e091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.113867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c065be4-b98c-4c8a-8f04-9db34805e091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.113867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c065be4-b98c-4c8a-8f04-9db34805e091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.536603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3c065be4-b98c-4c8a-8f04-9db34805e091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.551480 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3c065be4-b98c-4c8a-8f04-9db34805e091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.454078 Oct 04 18:10:26.568409 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1089/2237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:26.574507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-565f6892-5495-4e92-a10a-159af5c17a09 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.587084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-565f6892-5495-4e92-a10a-159af5c17a09 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.592670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:26.593235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:26.594408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:26.595672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:26.595672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:26.595817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-565f6892-5495-4e92-a10a-159af5c17a09 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '4bdc06e452984bf18267e832440ddcd9'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:26.606828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-565f6892-5495-4e92-a10a-159af5c17a09 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.609023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-565f6892-5495-4e92-a10a-159af5c17a09 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.610664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-565f6892-5495-4e92-a10a-159af5c17a09 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.612661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-565f6892-5495-4e92-a10a-159af5c17a09 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.613207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-565f6892-5495-4e92-a10a-159af5c17a09 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.614169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.614686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-565f6892-5495-4e92-a10a-159af5c17a09 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.617295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.618052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.619004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.619569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.619940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.648294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Getting quotas for project 67c1cf4579c5406fb461ec00e486b491. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:26.655601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Getting quotas for user 2f402a68c6734b9488ab4a04e8b630a6 and project 67c1cf4579c5406fb461ec00e486b491. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:26.669762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:26.672687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:26.727076 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-565f6892-5495-4e92-a10a-159af5c17a09 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.164318 Oct 04 18:10:26.737530 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1090/2238] 10.222.0.18 () {58 vars in 1230 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:26.749537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-277d5652-1a2f-4379-a857-43e073402940 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.752051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-277d5652-1a2f-4379-a857-43e073402940 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:26.758534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-277d5652-1a2f-4379-a857-43e073402940 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.759450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-277d5652-1a2f-4379-a857-43e073402940 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.760085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-277d5652-1a2f-4379-a857-43e073402940 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.761082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-277d5652-1a2f-4379-a857-43e073402940 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.762733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-277d5652-1a2f-4379-a857-43e073402940 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.764051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-277d5652-1a2f-4379-a857-43e073402940 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.790663 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7239e70a-572d-4178-ad16-01b6ac93c83d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.585057 Oct 04 18:10:26.791980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1149/2239] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:26.797636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ac58232-2544-4e5f-bf15-9527de168ebe tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ac58232-2544-4e5f-bf15-9527de168ebe tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Request method failure captured: Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHbbWX5KhDyYM_40LNILvuTuuaZJWcvDJ-W-1pGfnreKrB026rhm2m3CV2EFLyjb5QkPRt9RpPGK8ecl4pGw1VkfTHCCBwtvhU-2h5cgtV1k6y0Uqd3z01Pdp0A82J4NV-DnSkczdyvCn7lwoj-dG7yo6w-eBzQlHK3OIbj19y7FnBQ Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:10:26.802654 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}] Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: bf48879013734f8ca1ce5862895b8bcf Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:10:26.804201 n-d-850499-14 devstack@n-api.service[122332]: action_args: {} Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:26.804856 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:26.805951 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:26.807768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:26.807768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:26.807768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:10:26.807768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:26.809294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ac58232-2544-4e5f-bf15-9527de168ebe tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:26.810933 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ac58232-2544-4e5f-bf15-9527de168ebe tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.017589 Oct 04 18:10:26.812076 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1150/2240] 10.222.0.18 () {58 vars in 1182 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:26.834370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bfd67d34-dd80-428a-9198-1fb5d9e72945 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.836296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bfd67d34-dd80-428a-9198-1fb5d9e72945 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:26.907548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-277d5652-1a2f-4379-a857-43e073402940 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.924218 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-277d5652-1a2f-4379-a857-43e073402940 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1265 microversion: 2.1 time: 0.185091 Oct 04 18:10:26.928623 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1091/2241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:26.939098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.958772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.962150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Searching by: {'deleted': False, 'project_id': '4bdc06e452984bf18267e832440ddcd9'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:26.970199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.971134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.971754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.973628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.974440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.975623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.987092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bfd67d34-dd80-428a-9198-1fb5d9e72945 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.995048 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bfd67d34-dd80-428a-9198-1fb5d9e72945 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1208 microversion: 2.1 time: 0.181153 Oct 04 18:10:26.997564 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1151/2242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1208 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:27.016772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:27.025277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6613208e-ef8a-4dad-a4e5-c19748ba7879 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.026047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6613208e-ef8a-4dad-a4e5-c19748ba7879 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:27.054365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6613208e-ef8a-4dad-a4e5-c19748ba7879 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.055401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6613208e-ef8a-4dad-a4e5-c19748ba7879 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.057771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6613208e-ef8a-4dad-a4e5-c19748ba7879 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.060391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6613208e-ef8a-4dad-a4e5-c19748ba7879 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.062050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6613208e-ef8a-4dad-a4e5-c19748ba7879 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.063505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6613208e-ef8a-4dad-a4e5-c19748ba7879 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.064207 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3bb9b118-fadc-4937-9d50-24ab32dd119e tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.134398 Oct 04 18:10:27.065173 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1092/2243] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers => generated 681 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:27.081267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.094984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:27.095588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.servers [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Removing options 'limit' from query {{(pid=122331) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:10:27.096942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Searching by: {'deleted': False, 'project_id': '4bdc06e452984bf18267e832440ddcd9'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:27.109059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.111009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.112763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.113723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.115398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.116355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.173721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:27.240221 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0488941d-791c-404a-82e8-5dda46cf382c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.165099 Oct 04 18:10:27.254409 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1093/2244] 10.222.0.18 () {58 vars in 1144 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:27.260981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d47b766b-d1eb-4083-94ef-11b20f9b5601 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d47b766b-d1eb-4083-94ef-11b20f9b5601 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Request method failure captured: Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHbbWX5KhDyYM_40LNILvuTuuaZJWcvDJ-W-1pGfnreKrB026rhm2m3CV2EFLyjb5QkPRt9RpPGK8ecl4pGw1VkfTHCCBwtvhU-2h5cgtV1k6y0Uqd3z01Pdp0A82J4NV-DnSkczdyvCn7lwoj-dG7yo6w-eBzQlHK3OIbj19y7FnBQ Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:27.264841 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}] Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: bf48879013734f8ca1ce5862895b8bcf Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:10:27.266550 n-d-850499-14 devstack@n-api.service[122331]: action_args: {} Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi '-1' Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:27.267329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.268686 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:27.269697 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:27.269697 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:27.269697 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:27.269697 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:27.269697 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:10:27.269697 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.269697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d47b766b-d1eb-4083-94ef-11b20f9b5601 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:27.269697 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d47b766b-d1eb-4083-94ef-11b20f9b5601 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.011288 Oct 04 18:10:27.269697 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1094/2245] 10.222.0.18 () {58 vars in 1142 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:10:27.285673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4b09abf-e5b2-455e-86a0-9a58de1f68cc tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4b09abf-e5b2-455e-86a0-9a58de1f68cc tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Request method failure captured: Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHbbWX5KhDyYM_40LNILvuTuuaZJWcvDJ-W-1pGfnreKrB026rhm2m3CV2EFLyjb5QkPRt9RpPGK8ecl4pGw1VkfTHCCBwtvhU-2h5cgtV1k6y0Uqd3z01Pdp0A82J4NV-DnSkczdyvCn7lwoj-dG7yo6w-eBzQlHK3OIbj19y7FnBQ Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:27.290213 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}] Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: bf48879013734f8ca1ce5862895b8bcf Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:10:27.291451 n-d-850499-14 devstack@n-api.service[122331]: action_args: {} Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:27.292042 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.293161 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:27.294329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:27.294329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:27.294329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:27.294329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:27.294329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:10:27.294329 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.296589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4b09abf-e5b2-455e-86a0-9a58de1f68cc tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:27.298035 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f4b09abf-e5b2-455e-86a0-9a58de1f68cc tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016315 Oct 04 18:10:27.299259 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1095/2246] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:27.314490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be49c3b2-cdc9-42bf-a759-9f2a9dcf982c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.332139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be49c3b2-cdc9-42bf-a759-9f2a9dcf982c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:27.332817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be49c3b2-cdc9-42bf-a759-9f2a9dcf982c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '4bdc06e452984bf18267e832440ddcd9'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:27.344824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.servers [None req-be49c3b2-cdc9-42bf-a759-9f2a9dcf982c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Flavor 'non_existing_flavor' could not be found {{(pid=122331) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 18:10:27.345892 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be49c3b2-cdc9-42bf-a759-9f2a9dcf982c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.038962 Oct 04 18:10:27.346486 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1096/2247] 10.222.0.18 () {58 vars in 1178 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:27.364355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-72cc8625-9f7d-414e-a22d-1e0f04c725e6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.369934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-72cc8625-9f7d-414e-a22d-1e0f04c725e6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:27.370718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-72cc8625-9f7d-414e-a22d-1e0f04c725e6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '4bdc06e452984bf18267e832440ddcd9'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:27.394278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72cc8625-9f7d-414e-a22d-1e0f04c725e6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.395027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72cc8625-9f7d-414e-a22d-1e0f04c725e6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.395611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72cc8625-9f7d-414e-a22d-1e0f04c725e6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.396615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72cc8625-9f7d-414e-a22d-1e0f04c725e6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.397756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72cc8625-9f7d-414e-a22d-1e0f04c725e6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.398342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72cc8625-9f7d-414e-a22d-1e0f04c725e6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.467389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6613208e-ef8a-4dad-a4e5-c19748ba7879 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:27.475494 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6613208e-ef8a-4dad-a4e5-c19748ba7879 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.454461 Oct 04 18:10:27.479177 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1152/2248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:27.581905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5e900d07-bac0-4106-828b-0a44e79067a0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.583170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5e900d07-bac0-4106-828b-0a44e79067a0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:27.594315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e900d07-bac0-4106-828b-0a44e79067a0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.599560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e900d07-bac0-4106-828b-0a44e79067a0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.600652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e900d07-bac0-4106-828b-0a44e79067a0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.601606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e900d07-bac0-4106-828b-0a44e79067a0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.602258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e900d07-bac0-4106-828b-0a44e79067a0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.607647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e900d07-bac0-4106-828b-0a44e79067a0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.680167 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-72cc8625-9f7d-414e-a22d-1e0f04c725e6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.323717 Oct 04 18:10:27.680793 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1097/2249] 10.222.0.18 () {58 vars in 1174 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:10:27.719492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f3a27237-85d8-4289-afb9-94af260b4a3b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.747195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f3a27237-85d8-4289-afb9-94af260b4a3b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:27.754774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f3a27237-85d8-4289-afb9-94af260b4a3b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '4bdc06e452984bf18267e832440ddcd9'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:27.768880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a27237-85d8-4289-afb9-94af260b4a3b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.769395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a27237-85d8-4289-afb9-94af260b4a3b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.769845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a27237-85d8-4289-afb9-94af260b4a3b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.775183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a27237-85d8-4289-afb9-94af260b4a3b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.776390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a27237-85d8-4289-afb9-94af260b4a3b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.776887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a27237-85d8-4289-afb9-94af260b4a3b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.957690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5e900d07-bac0-4106-828b-0a44e79067a0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:27.972694 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f3a27237-85d8-4289-afb9-94af260b4a3b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.267276 Oct 04 18:10:27.976128 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5e900d07-bac0-4106-828b-0a44e79067a0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.399096 Oct 04 18:10:27.976771 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1098/2250] 10.222.0.18 () {58 vars in 1184 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:27.979236 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1153/2251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:27.997867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d3c832b6-36f3-4d85-a473-bf17815820de tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.000870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.005823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.006872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Searching by: {'deleted': False, 'project_id': '4bdc06e452984bf18267e832440ddcd9'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:28.008206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d3c832b6-36f3-4d85-a473-bf17815820de tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.014760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3c832b6-36f3-4d85-a473-bf17815820de tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.015759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3c832b6-36f3-4d85-a473-bf17815820de tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.016491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3c832b6-36f3-4d85-a473-bf17815820de tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.020120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3c832b6-36f3-4d85-a473-bf17815820de tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.024175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3c832b6-36f3-4d85-a473-bf17815820de tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.024919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3c832b6-36f3-4d85-a473-bf17815820de tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.034677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.040498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.043520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.044469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.045048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.047181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.103250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:28.144837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.152500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.153079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.153606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.202304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d3c832b6-36f3-4d85-a473-bf17815820de tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.213720 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d3c832b6-36f3-4d85-a473-bf17815820de tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1271 microversion: 2.1 time: 0.235467 Oct 04 18:10:28.214388 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1099/2252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:28.238717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c47cc0a0-a65e-4d44-b25c-74a46900978e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.243862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c47cc0a0-a65e-4d44-b25c-74a46900978e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.254113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47cc0a0-a65e-4d44-b25c-74a46900978e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.261068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47cc0a0-a65e-4d44-b25c-74a46900978e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.261769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47cc0a0-a65e-4d44-b25c-74a46900978e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.262712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47cc0a0-a65e-4d44-b25c-74a46900978e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.263380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47cc0a0-a65e-4d44-b25c-74a46900978e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.263958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47cc0a0-a65e-4d44-b25c-74a46900978e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.382354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c47cc0a0-a65e-4d44-b25c-74a46900978e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.394979 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c47cc0a0-a65e-4d44-b25c-74a46900978e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1260 microversion: 2.1 time: 0.160111 Oct 04 18:10:28.396857 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1100/2253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:28.405560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-63ef9fbf-3e39-49a6-8239-7985046dcb33 req-d89f8810-6c05-46b7-99b8-c0f7a4bde43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f64a66b-6e31-45ef-a711-60c9e8f0ec3a", "name": "network-vif-plugged", "status": "completed", "tag": "6edb64f1-120e-4ab2-81b6-c49027ad6cca"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:28.428876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-63ef9fbf-3e39-49a6-8239-7985046dcb33 req-d89f8810-6c05-46b7-99b8-c0f7a4bde43c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.444223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-63ef9fbf-3e39-49a6-8239-7985046dcb33 req-d89f8810-6c05-46b7-99b8-c0f7a4bde43c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.445252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-63ef9fbf-3e39-49a6-8239-7985046dcb33 req-d89f8810-6c05-46b7-99b8-c0f7a4bde43c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.483567 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-63ef9fbf-3e39-49a6-8239-7985046dcb33 req-d89f8810-6c05-46b7-99b8-c0f7a4bde43c service nova] Creating event network-vif-plugged:6edb64f1-120e-4ab2-81b6-c49027ad6cca for instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a on n-h2-850499-14 Oct 04 18:10:28.490151 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-63ef9fbf-3e39-49a6-8239-7985046dcb33 req-d89f8810-6c05-46b7-99b8-c0f7a4bde43c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090286 Oct 04 18:10:28.490870 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1101/2254] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:28.519213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fc09101b-fff6-4af2-9ea2-6d52109f4677 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.520186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fc09101b-fff6-4af2-9ea2-6d52109f4677 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.531508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc09101b-fff6-4af2-9ea2-6d52109f4677 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.533411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc09101b-fff6-4af2-9ea2-6d52109f4677 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.534977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc09101b-fff6-4af2-9ea2-6d52109f4677 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.537844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc09101b-fff6-4af2-9ea2-6d52109f4677 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.538725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc09101b-fff6-4af2-9ea2-6d52109f4677 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.540532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc09101b-fff6-4af2-9ea2-6d52109f4677 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.665591 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3147cde5-88fb-4655-808b-3af42c99137c tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.669759 Oct 04 18:10:28.667880 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1154/2255] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:28.717793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f310c2ff-6301-4ddb-af81-7c3ce19ad9c4 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.757748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f310c2ff-6301-4ddb-af81-7c3ce19ad9c4 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.763369 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f310c2ff-6301-4ddb-af81-7c3ce19ad9c4 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.053448 Oct 04 18:10:28.779577 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1155/2256] 10.222.0.18 () {58 vars in 1178 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:28.794486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.805295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.806994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Searching by: {'deleted': False, 'project_id': '4bdc06e452984bf18267e832440ddcd9'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:28.816862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.818242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.819626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.821231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.822345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.823368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.891774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:28.958135 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6faa5463-49bf-4d92-b672-eb1d9dab839d tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.175354 Oct 04 18:10:28.967423 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1156/2257] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers => generated 681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:28.974268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.975098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.982302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.983215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.983823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.984783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.985410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.986710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.004140 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] HTTP exception thrown: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Request method failure captured: Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc HTTP/1.1 Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHbbWX5KhDyYM_40LNILvuTuuaZJWcvDJ-W-1pGfnreKrB026rhm2m3CV2EFLyjb5QkPRt9RpPGK8ecl4pGw1VkfTHCCBwtvhU-2h5cgtV1k6y0Uqd3z01Pdp0A82J4NV-DnSkczdyvCn7lwoj-dG7yo6w-eBzQlHK3OIbj19y7FnBQ Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:10:29.008035 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}] Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: bf48879013734f8ca1ce5862895b8bcf Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:29.009406 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc'} Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:29.010160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:29.011426 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.012669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fc09101b-fff6-4af2-9ea2-6d52109f4677 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.014254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Returning 404 to user: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:29.015339 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-04cb7e9e-53eb-4739-934c-45bb6ab47749 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc" status: 404 len: 111 microversion: 2.1 time: 0.046552 Oct 04 18:10:29.020072 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fc09101b-fff6-4af2-9ea2-6d52109f4677 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.514014 Oct 04 18:10:29.020468 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1157/2258] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:28 2022] DELETE /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:29.026827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5c48ec3b-521d-496f-b749-d5d92cba261b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.027788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5c48ec3b-521d-496f-b749-d5d92cba261b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.037984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c48ec3b-521d-496f-b749-d5d92cba261b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.039410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c48ec3b-521d-496f-b749-d5d92cba261b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.040032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c48ec3b-521d-496f-b749-d5d92cba261b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.041248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c48ec3b-521d-496f-b749-d5d92cba261b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.041866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c48ec3b-521d-496f-b749-d5d92cba261b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.042442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c48ec3b-521d-496f-b749-d5d92cba261b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.045401 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1102/2259] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:29.061983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b5a702ee-1ad9-4296-b172-a6990e2b8966 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.063426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b5a702ee-1ad9-4296-b172-a6990e2b8966 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.078144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a702ee-1ad9-4296-b172-a6990e2b8966 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.078832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a702ee-1ad9-4296-b172-a6990e2b8966 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.079384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a702ee-1ad9-4296-b172-a6990e2b8966 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.080239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a702ee-1ad9-4296-b172-a6990e2b8966 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.080868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a702ee-1ad9-4296-b172-a6990e2b8966 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.081402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a702ee-1ad9-4296-b172-a6990e2b8966 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.115919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b5a702ee-1ad9-4296-b172-a6990e2b8966 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:29.136424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:29.292636 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b5a702ee-1ad9-4296-b172-a6990e2b8966 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "DELETE /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 204 len: 0 microversion: 2.1 time: 0.244776 Oct 04 18:10:29.293494 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1103/2260] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:29 2022] DELETE /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:29.299881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d5fbcd9b-a88b-4491-a5e8-be5f8f675422 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.300624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d5fbcd9b-a88b-4491-a5e8-be5f8f675422 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.311392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5c48ec3b-521d-496f-b749-d5d92cba261b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.314794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5fbcd9b-a88b-4491-a5e8-be5f8f675422 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.315331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5fbcd9b-a88b-4491-a5e8-be5f8f675422 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.315778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5fbcd9b-a88b-4491-a5e8-be5f8f675422 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.316501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5fbcd9b-a88b-4491-a5e8-be5f8f675422 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.316962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5fbcd9b-a88b-4491-a5e8-be5f8f675422 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.317392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5fbcd9b-a88b-4491-a5e8-be5f8f675422 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.334023 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5c48ec3b-521d-496f-b749-d5d92cba261b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.311237 Oct 04 18:10:29.335499 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1158/2261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:29.362037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-38b133a2-da09-4a1b-9b46-110b061aea64 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.362037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-38b133a2-da09-4a1b-9b46-110b061aea64 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.373738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38b133a2-da09-4a1b-9b46-110b061aea64 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.375433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38b133a2-da09-4a1b-9b46-110b061aea64 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.376127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38b133a2-da09-4a1b-9b46-110b061aea64 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.377210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38b133a2-da09-4a1b-9b46-110b061aea64 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.378538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38b133a2-da09-4a1b-9b46-110b061aea64 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.379429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38b133a2-da09-4a1b-9b46-110b061aea64 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.424649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-38b133a2-da09-4a1b-9b46-110b061aea64 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:29.580402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d5fbcd9b-a88b-4491-a5e8-be5f8f675422 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.594450 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d5fbcd9b-a88b-4491-a5e8-be5f8f675422 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1271 microversion: 2.1 time: 0.299950 Oct 04 18:10:29.613712 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1104/2262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1271 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:29.618701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d13fd0b8-82f6-477f-83cb-b4ba5b72de85 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.619378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d13fd0b8-82f6-477f-83cb-b4ba5b72de85 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.626194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d13fd0b8-82f6-477f-83cb-b4ba5b72de85 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.626767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d13fd0b8-82f6-477f-83cb-b4ba5b72de85 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.627274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d13fd0b8-82f6-477f-83cb-b4ba5b72de85 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.628001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d13fd0b8-82f6-477f-83cb-b4ba5b72de85 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.628468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d13fd0b8-82f6-477f-83cb-b4ba5b72de85 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.629346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d13fd0b8-82f6-477f-83cb-b4ba5b72de85 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.632286 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-38b133a2-da09-4a1b-9b46-110b061aea64 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 204 len: 0 microversion: 2.1 time: 0.295145 Oct 04 18:10:29.633944 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1159/2263] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:29 2022] DELETE /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:29.667209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.669873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.698550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.699093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.699552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.700283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.700750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.701181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.724014 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] HTTP exception thrown: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Request method failure captured: Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc HTTP/1.1 Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHbbWX5KhDyYM_40LNILvuTuuaZJWcvDJ-W-1pGfnreKrB026rhm2m3CV2EFLyjb5QkPRt9RpPGK8ecl4pGw1VkfTHCCBwtvhU-2h5cgtV1k6y0Uqd3z01Pdp0A82J4NV-DnSkczdyvCn7lwoj-dG7yo6w-eBzQlHK3OIbj19y7FnBQ Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:10:29.725762 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}] Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: bf48879013734f8ca1ce5862895b8bcf Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:29.726904 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc'} Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:29.727561 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. Oct 04 18:10:29.728533 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:29.731881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Returning 404 to user: Instance ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:29.731881 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ee0b35e-48b8-40ec-ac4c-494b2ad309be tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc" status: 404 len: 111 microversion: 2.1 time: 0.077832 Oct 04 18:10:29.731881 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1160/2264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers/ba0dae56-b2ef-4b5d-b4a5-b5243f2d94dc => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:29.740657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-598f973a-8c09-41f0-839b-9d3473b38143 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.741534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-598f973a-8c09-41f0-839b-9d3473b38143 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.772794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-598f973a-8c09-41f0-839b-9d3473b38143 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.773957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-598f973a-8c09-41f0-839b-9d3473b38143 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.783158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-598f973a-8c09-41f0-839b-9d3473b38143 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.785511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-598f973a-8c09-41f0-839b-9d3473b38143 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.786029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-598f973a-8c09-41f0-839b-9d3473b38143 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.788196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-598f973a-8c09-41f0-839b-9d3473b38143 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.792266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d13fd0b8-82f6-477f-83cb-b4ba5b72de85 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.808935 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d13fd0b8-82f6-477f-83cb-b4ba5b72de85 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1266 microversion: 2.1 time: 0.187831 Oct 04 18:10:29.809805 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1105/2265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:29.978095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-0545d610-335a-45b7-89c7-fb3d7103b02f req-a6b2a933-935a-47d6-b73c-afebc8cebc28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3c972a-93d9-42f4-a3ee-840fc973de13", "tag": "ae2cd46e-ccab-4178-9cbb-0bd456cdcfd5"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:29.995309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0545d610-335a-45b7-89c7-fb3d7103b02f req-a6b2a933-935a-47d6-b73c-afebc8cebc28 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.997842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0545d610-335a-45b7-89c7-fb3d7103b02f req-a6b2a933-935a-47d6-b73c-afebc8cebc28 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.998920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0545d610-335a-45b7-89c7-fb3d7103b02f req-a6b2a933-935a-47d6-b73c-afebc8cebc28 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.026020 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-0545d610-335a-45b7-89c7-fb3d7103b02f req-a6b2a933-935a-47d6-b73c-afebc8cebc28 service nova] Creating event network-changed:ae2cd46e-ccab-4178-9cbb-0bd456cdcfd5 for instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 on n-h2-850499-14 Oct 04 18:10:30.038272 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-0545d610-335a-45b7-89c7-fb3d7103b02f req-a6b2a933-935a-47d6-b73c-afebc8cebc28 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062741 Oct 04 18:10:30.041616 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1106/2266] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:30.060630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d1a7949-d579-403f-aaa7-7746e194020e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.062985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d1a7949-d579-403f-aaa7-7746e194020e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:30.077163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1a7949-d579-403f-aaa7-7746e194020e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.078735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1a7949-d579-403f-aaa7-7746e194020e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.079452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1a7949-d579-403f-aaa7-7746e194020e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.080438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1a7949-d579-403f-aaa7-7746e194020e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.081138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1a7949-d579-403f-aaa7-7746e194020e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.081790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1a7949-d579-403f-aaa7-7746e194020e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.218370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-598f973a-8c09-41f0-839b-9d3473b38143 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:30.233873 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-598f973a-8c09-41f0-839b-9d3473b38143 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1521 microversion: 2.1 time: 0.497184 Oct 04 18:10:30.252571 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1161/2267] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:30.365806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b4173cbd-ff97-4c38-a821-5786b89e4cbe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.366784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4173cbd-ff97-4c38-a821-5786b89e4cbe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:30.379763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4173cbd-ff97-4c38-a821-5786b89e4cbe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.380275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4173cbd-ff97-4c38-a821-5786b89e4cbe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.380723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4173cbd-ff97-4c38-a821-5786b89e4cbe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.381497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4173cbd-ff97-4c38-a821-5786b89e4cbe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.382045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4173cbd-ff97-4c38-a821-5786b89e4cbe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.382549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4173cbd-ff97-4c38-a821-5786b89e4cbe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.768027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7d1a7949-d579-403f-aaa7-7746e194020e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:30.780452 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d1a7949-d579-403f-aaa7-7746e194020e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.729672 Oct 04 18:10:30.784133 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1107/2268] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:30 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:30.794843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3aa27aa3-524a-4610-8814-742f6cfba1a2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.795692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3aa27aa3-524a-4610-8814-742f6cfba1a2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:30.825050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa27aa3-524a-4610-8814-742f6cfba1a2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.826350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa27aa3-524a-4610-8814-742f6cfba1a2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.827563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa27aa3-524a-4610-8814-742f6cfba1a2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.829834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa27aa3-524a-4610-8814-742f6cfba1a2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.831157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa27aa3-524a-4610-8814-742f6cfba1a2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.833129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa27aa3-524a-4610-8814-742f6cfba1a2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.966486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b4173cbd-ff97-4c38-a821-5786b89e4cbe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:30.999437 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b4173cbd-ff97-4c38-a821-5786b89e4cbe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.635738 Oct 04 18:10:31.001354 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1162/2269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:30 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:31.023295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7d90dbcc-3695-426d-a2aa-ccb1077be004 req-07241c14-7799-4ff9-93f9-1a641a76a8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a", "tag": "1075430b-4731-47b1-aeb1-6c78e21fd987"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:31.064513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7d90dbcc-3695-426d-a2aa-ccb1077be004 req-07241c14-7799-4ff9-93f9-1a641a76a8de service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.077692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7d90dbcc-3695-426d-a2aa-ccb1077be004 req-07241c14-7799-4ff9-93f9-1a641a76a8de service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.083179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7d90dbcc-3695-426d-a2aa-ccb1077be004 req-07241c14-7799-4ff9-93f9-1a641a76a8de service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.123044 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7d90dbcc-3695-426d-a2aa-ccb1077be004 req-07241c14-7799-4ff9-93f9-1a641a76a8de service nova] Creating event network-changed:1075430b-4731-47b1-aeb1-6c78e21fd987 for instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a on n-h2-850499-14 Oct 04 18:10:31.133803 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7d90dbcc-3695-426d-a2aa-ccb1077be004 req-07241c14-7799-4ff9-93f9-1a641a76a8de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127996 Oct 04 18:10:31.139344 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1163/2270] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:31.158252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9559a58c-2184-441f-a76d-82a97386ba74 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.164698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9559a58c-2184-441f-a76d-82a97386ba74 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:31.177123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9559a58c-2184-441f-a76d-82a97386ba74 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.178940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9559a58c-2184-441f-a76d-82a97386ba74 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.179767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9559a58c-2184-441f-a76d-82a97386ba74 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.180898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9559a58c-2184-441f-a76d-82a97386ba74 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.182328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9559a58c-2184-441f-a76d-82a97386ba74 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.196948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9559a58c-2184-441f-a76d-82a97386ba74 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.326383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3aa27aa3-524a-4610-8814-742f6cfba1a2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.388939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9559a58c-2184-441f-a76d-82a97386ba74 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.389605 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3aa27aa3-524a-4610-8814-742f6cfba1a2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1313 microversion: 2.1 time: 0.598277 Oct 04 18:10:31.406625 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9559a58c-2184-441f-a76d-82a97386ba74 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1266 microversion: 2.1 time: 0.265214 Oct 04 18:10:31.409960 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1108/2271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:30 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:31.420717 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1164/2272] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:31 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:31.446806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-44109a41-dff5-489d-8453-26d8bfb83ee6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.448023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-44109a41-dff5-489d-8453-26d8bfb83ee6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:31.455038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:31.458938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44109a41-dff5-489d-8453-26d8bfb83ee6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.460372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44109a41-dff5-489d-8453-26d8bfb83ee6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.460972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44109a41-dff5-489d-8453-26d8bfb83ee6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.461846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44109a41-dff5-489d-8453-26d8bfb83ee6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.463192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44109a41-dff5-489d-8453-26d8bfb83ee6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.463984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44109a41-dff5-489d-8453-26d8bfb83ee6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.816168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3b23c586-8466-4f05-bc99-f0d8f5a14d88 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.817352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3b23c586-8466-4f05-bc99-f0d8f5a14d88 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:31.827285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b23c586-8466-4f05-bc99-f0d8f5a14d88 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.827943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b23c586-8466-4f05-bc99-f0d8f5a14d88 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.828772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b23c586-8466-4f05-bc99-f0d8f5a14d88 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.831472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b23c586-8466-4f05-bc99-f0d8f5a14d88 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.832154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b23c586-8466-4f05-bc99-f0d8f5a14d88 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.834877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b23c586-8466-4f05-bc99-f0d8f5a14d88 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.431824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-44109a41-dff5-489d-8453-26d8bfb83ee6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.443803 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-44109a41-dff5-489d-8453-26d8bfb83ee6 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1521 microversion: 2.1 time: 1.018542 Oct 04 18:10:32.445653 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1109/2273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:31 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1521 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:32.451194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6e632ad7-51b5-4def-8feb-8d192c7e2576 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.452307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6e632ad7-51b5-4def-8feb-8d192c7e2576 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.464307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e632ad7-51b5-4def-8feb-8d192c7e2576 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.464990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e632ad7-51b5-4def-8feb-8d192c7e2576 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.465539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e632ad7-51b5-4def-8feb-8d192c7e2576 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.466361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e632ad7-51b5-4def-8feb-8d192c7e2576 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.466923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e632ad7-51b5-4def-8feb-8d192c7e2576 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.467485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e632ad7-51b5-4def-8feb-8d192c7e2576 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.583875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3b23c586-8466-4f05-bc99-f0d8f5a14d88 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.596164 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3b23c586-8466-4f05-bc99-f0d8f5a14d88 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1324 microversion: 2.1 time: 0.787578 Oct 04 18:10:32.611486 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1165/2274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:31 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1324 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:32.617814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-4615fc88-c31d-4bc2-8d42-0d60160759fb req-e52593af-a7d1-4695-8528-c962b3368c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bfba3c-5b12-4b4a-800c-c3a37b9da5e2", "name": "network-vif-deleted", "tag": "d87be326-0818-410e-ad20-1bc0d3600186"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:32.629722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4615fc88-c31d-4bc2-8d42-0d60160759fb req-e52593af-a7d1-4695-8528-c962b3368c49 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.630201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4615fc88-c31d-4bc2-8d42-0d60160759fb req-e52593af-a7d1-4695-8528-c962b3368c49 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.630803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4615fc88-c31d-4bc2-8d42-0d60160759fb req-e52593af-a7d1-4695-8528-c962b3368c49 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.643376 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-4615fc88-c31d-4bc2-8d42-0d60160759fb req-e52593af-a7d1-4695-8528-c962b3368c49 service nova] Creating event network-vif-deleted:d87be326-0818-410e-ad20-1bc0d3600186 for instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 on n-h1-850499-14 Oct 04 18:10:32.648258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-4615fc88-c31d-4bc2-8d42-0d60160759fb req-e52593af-a7d1-4695-8528-c962b3368c49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035527 Oct 04 18:10:32.648866 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1166/2275] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:32.654066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5e554e1c-7e7d-49b0-9ebc-ccf4c11aa7b8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.654771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5e554e1c-7e7d-49b0-9ebc-ccf4c11aa7b8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.661476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e554e1c-7e7d-49b0-9ebc-ccf4c11aa7b8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.661845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e554e1c-7e7d-49b0-9ebc-ccf4c11aa7b8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.662391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e554e1c-7e7d-49b0-9ebc-ccf4c11aa7b8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.663179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e554e1c-7e7d-49b0-9ebc-ccf4c11aa7b8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.663797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e554e1c-7e7d-49b0-9ebc-ccf4c11aa7b8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.664364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e554e1c-7e7d-49b0-9ebc-ccf4c11aa7b8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.779554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6e632ad7-51b5-4def-8feb-8d192c7e2576 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.792220 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6e632ad7-51b5-4def-8feb-8d192c7e2576 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.344829 Oct 04 18:10:32.794464 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1110/2276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:32.802812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ad5f82bd-b4f3-4dec-b09e-8bcda8245942 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.803893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ad5f82bd-b4f3-4dec-b09e-8bcda8245942 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.812119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad5f82bd-b4f3-4dec-b09e-8bcda8245942 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.813401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad5f82bd-b4f3-4dec-b09e-8bcda8245942 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.813995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad5f82bd-b4f3-4dec-b09e-8bcda8245942 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.814894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad5f82bd-b4f3-4dec-b09e-8bcda8245942 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.815531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad5f82bd-b4f3-4dec-b09e-8bcda8245942 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.816106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad5f82bd-b4f3-4dec-b09e-8bcda8245942 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.996608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ad5f82bd-b4f3-4dec-b09e-8bcda8245942 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:33.013103 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ad5f82bd-b4f3-4dec-b09e-8bcda8245942 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1266 microversion: 2.1 time: 0.214544 Oct 04 18:10:33.013705 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1111/2277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:33.091402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5e554e1c-7e7d-49b0-9ebc-ccf4c11aa7b8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:33.107590 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5e554e1c-7e7d-49b0-9ebc-ccf4c11aa7b8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1313 microversion: 2.1 time: 0.457258 Oct 04 18:10:33.125542 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1167/2278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:33.474299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5729626a-ea63-4f79-b361-c8122aa1dc3f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.481799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5729626a-ea63-4f79-b361-c8122aa1dc3f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.496600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5729626a-ea63-4f79-b361-c8122aa1dc3f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.503288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c2ede75a-8b3c-4109-ab44-86f9068b8b3c req-fd611edb-e968-40db-b8ac-ed43ed7db814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378afc34-2555-49c8-b008-303c8f22eded", "tag": "279e0ebb-0c3d-4ebe-8b58-abe1859c6f23"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:33.510814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5729626a-ea63-4f79-b361-c8122aa1dc3f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.511524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5729626a-ea63-4f79-b361-c8122aa1dc3f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.513538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5729626a-ea63-4f79-b361-c8122aa1dc3f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.516281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5729626a-ea63-4f79-b361-c8122aa1dc3f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.517352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5729626a-ea63-4f79-b361-c8122aa1dc3f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.527848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c2ede75a-8b3c-4109-ab44-86f9068b8b3c req-fd611edb-e968-40db-b8ac-ed43ed7db814 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.530474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c2ede75a-8b3c-4109-ab44-86f9068b8b3c req-fd611edb-e968-40db-b8ac-ed43ed7db814 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.531664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c2ede75a-8b3c-4109-ab44-86f9068b8b3c req-fd611edb-e968-40db-b8ac-ed43ed7db814 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.570220 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c2ede75a-8b3c-4109-ab44-86f9068b8b3c req-fd611edb-e968-40db-b8ac-ed43ed7db814 service nova] Creating event network-changed:279e0ebb-0c3d-4ebe-8b58-abe1859c6f23 for instance 378afc34-2555-49c8-b008-303c8f22eded on n-h1-850499-14 Oct 04 18:10:33.595584 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c2ede75a-8b3c-4109-ab44-86f9068b8b3c req-fd611edb-e968-40db-b8ac-ed43ed7db814 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096166 Oct 04 18:10:33.599334 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1168/2279] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:33.625048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99bc0a93-01b2-4b27-a43e-1fbd3209ccec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.626880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-99bc0a93-01b2-4b27-a43e-1fbd3209ccec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.635480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99bc0a93-01b2-4b27-a43e-1fbd3209ccec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.636478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99bc0a93-01b2-4b27-a43e-1fbd3209ccec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.637300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99bc0a93-01b2-4b27-a43e-1fbd3209ccec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.638623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99bc0a93-01b2-4b27-a43e-1fbd3209ccec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.639549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99bc0a93-01b2-4b27-a43e-1fbd3209ccec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.640600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99bc0a93-01b2-4b27-a43e-1fbd3209ccec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.649624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:33.693054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5729626a-ea63-4f79-b361-c8122aa1dc3f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:33.711782 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5729626a-ea63-4f79-b361-c8122aa1dc3f tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1479 microversion: 2.1 time: 0.247450 Oct 04 18:10:33.713089 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1112/2280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1479 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:33.729794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b422bc07-b818-40d0-856d-d8be866f54f0 req-c9f4264e-900b-41c9-9768-e70a93ba07cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d94795-de6c-4946-ae72-68ae4c497228", "name": "network-vif-unplugged", "status": "completed", "tag": "4f5bf8c3-59a9-4ef9-9478-c38d330d2eb0"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:33.750756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b422bc07-b818-40d0-856d-d8be866f54f0 req-c9f4264e-900b-41c9-9768-e70a93ba07cd service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.751295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b422bc07-b818-40d0-856d-d8be866f54f0 req-c9f4264e-900b-41c9-9768-e70a93ba07cd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.751735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b422bc07-b818-40d0-856d-d8be866f54f0 req-c9f4264e-900b-41c9-9768-e70a93ba07cd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.780610 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b422bc07-b818-40d0-856d-d8be866f54f0 req-c9f4264e-900b-41c9-9768-e70a93ba07cd service nova] Creating event network-vif-unplugged:4f5bf8c3-59a9-4ef9-9478-c38d330d2eb0 for instance f6d94795-de6c-4946-ae72-68ae4c497228 on n-h1-850499-14 Oct 04 18:10:33.805476 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b422bc07-b818-40d0-856d-d8be866f54f0 req-c9f4264e-900b-41c9-9768-e70a93ba07cd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088627 Oct 04 18:10:33.807445 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1113/2281] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:33.819341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d265d1ba-7b5a-4452-abc5-1b50a15f4a5e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.820554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d265d1ba-7b5a-4452-abc5-1b50a15f4a5e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.836950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d265d1ba-7b5a-4452-abc5-1b50a15f4a5e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.837688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d265d1ba-7b5a-4452-abc5-1b50a15f4a5e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.838732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d265d1ba-7b5a-4452-abc5-1b50a15f4a5e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.839732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d265d1ba-7b5a-4452-abc5-1b50a15f4a5e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.840591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d265d1ba-7b5a-4452-abc5-1b50a15f4a5e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.841210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d265d1ba-7b5a-4452-abc5-1b50a15f4a5e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.871914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=24 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:34.140836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-99bc0a93-01b2-4b27-a43e-1fbd3209ccec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.150768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-99bc0a93-01b2-4b27-a43e-1fbd3209ccec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1519 microversion: 2.1 time: 0.530848 Oct 04 18:10:34.151915 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1169/2282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1519 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:34.157090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d06c52a7-a976-45ef-b96f-e3e4fe324b98 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:34.157966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d06c52a7-a976-45ef-b96f-e3e4fe324b98 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:34.165715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d06c52a7-a976-45ef-b96f-e3e4fe324b98 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.166553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d06c52a7-a976-45ef-b96f-e3e4fe324b98 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.167234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d06c52a7-a976-45ef-b96f-e3e4fe324b98 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.168196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d06c52a7-a976-45ef-b96f-e3e4fe324b98 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.169596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d06c52a7-a976-45ef-b96f-e3e4fe324b98 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.170416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d06c52a7-a976-45ef-b96f-e3e4fe324b98 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.261839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d265d1ba-7b5a-4452-abc5-1b50a15f4a5e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.273487 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d265d1ba-7b5a-4452-abc5-1b50a15f4a5e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.458742 Oct 04 18:10:34.274354 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1114/2283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:34.279811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ed96afe-1d34-4c90-a845-905d757dc775 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:34.280720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6ed96afe-1d34-4c90-a845-905d757dc775 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:34.291187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed96afe-1d34-4c90-a845-905d757dc775 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.296551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed96afe-1d34-4c90-a845-905d757dc775 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.297996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed96afe-1d34-4c90-a845-905d757dc775 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.303544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d06c52a7-a976-45ef-b96f-e3e4fe324b98 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.313343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed96afe-1d34-4c90-a845-905d757dc775 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.314059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed96afe-1d34-4c90-a845-905d757dc775 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.315390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed96afe-1d34-4c90-a845-905d757dc775 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.323757 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d06c52a7-a976-45ef-b96f-e3e4fe324b98 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1266 microversion: 2.1 time: 0.170182 Oct 04 18:10:34.337098 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1170/2284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:34 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:34.356697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b5f9939-732e-4bdc-8d78-494cbab770e5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Action: 'create', calling method: .version_select at 0x7fd4d611d160>, body: {"pool": null} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:34.861210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ed96afe-1d34-4c90-a845-905d757dc775 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.879091 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ed96afe-1d34-4c90-a845-905d757dc775 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1313 microversion: 2.1 time: 0.601727 Oct 04 18:10:34.880219 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1115/2285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:34 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:34.885936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:34.886791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:34.904179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.905046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.905679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.906886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.907850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.908448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.966521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.967045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.967491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.967948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lazy-loading 'fault' on Instance uuid 858d86de-5fe8-43e9-9409-364826f1c48c {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:35.093430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:35.103752 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d5e1ad0-8323-40d5-bc57-4c336c0e8308 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 200 len: 1312 microversion: 2.1 time: 0.222101 Oct 04 18:10:35.104718 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1116/2286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:34 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:35.196436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ca0c116f-fe87-44c3-905b-779126265980 req-e33ad824-4a05-4f3b-8902-6e716de81bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d94795-de6c-4946-ae72-68ae4c497228", "name": "network-vif-deleted", "tag": "4f5bf8c3-59a9-4ef9-9478-c38d330d2eb0"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:35.215069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ca0c116f-fe87-44c3-905b-779126265980 req-e33ad824-4a05-4f3b-8902-6e716de81bc8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.215608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ca0c116f-fe87-44c3-905b-779126265980 req-e33ad824-4a05-4f3b-8902-6e716de81bc8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.216231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ca0c116f-fe87-44c3-905b-779126265980 req-e33ad824-4a05-4f3b-8902-6e716de81bc8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.245299 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ca0c116f-fe87-44c3-905b-779126265980 req-e33ad824-4a05-4f3b-8902-6e716de81bc8 service nova] Creating event network-vif-deleted:4f5bf8c3-59a9-4ef9-9478-c38d330d2eb0 for instance f6d94795-de6c-4946-ae72-68ae4c497228 on n-h1-850499-14 Oct 04 18:10:35.251656 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ca0c116f-fe87-44c3-905b-779126265980 req-e33ad824-4a05-4f3b-8902-6e716de81bc8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062524 Oct 04 18:10:35.252961 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1117/2287] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:35.304864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b7c26ab6-d104-443c-9f2a-cf9c84526070 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:35.305924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b7c26ab6-d104-443c-9f2a-cf9c84526070 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:35.319258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7c26ab6-d104-443c-9f2a-cf9c84526070 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.319900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7c26ab6-d104-443c-9f2a-cf9c84526070 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.320438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7c26ab6-d104-443c-9f2a-cf9c84526070 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.321329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7c26ab6-d104-443c-9f2a-cf9c84526070 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.321903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7c26ab6-d104-443c-9f2a-cf9c84526070 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.322802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7c26ab6-d104-443c-9f2a-cf9c84526070 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.589520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b7c26ab6-d104-443c-9f2a-cf9c84526070 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:35.597963 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b7c26ab6-d104-443c-9f2a-cf9c84526070 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.301907 Oct 04 18:10:35.611354 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1118/2288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:35 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:35.613610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8a0bd29-a902-4db5-a1fd-cc0127ebe49d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:35.614245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e8a0bd29-a902-4db5-a1fd-cc0127ebe49d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:35.626889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8a0bd29-a902-4db5-a1fd-cc0127ebe49d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.627319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8a0bd29-a902-4db5-a1fd-cc0127ebe49d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.627769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8a0bd29-a902-4db5-a1fd-cc0127ebe49d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.628533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8a0bd29-a902-4db5-a1fd-cc0127ebe49d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.628963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8a0bd29-a902-4db5-a1fd-cc0127ebe49d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.629400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8a0bd29-a902-4db5-a1fd-cc0127ebe49d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.923995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8a0bd29-a902-4db5-a1fd-cc0127ebe49d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:35.936028 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e8a0bd29-a902-4db5-a1fd-cc0127ebe49d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1308 microversion: 2.1 time: 0.333182 Oct 04 18:10:35.936835 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1119/2289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:35 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:35.949099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c43b0caa-32c8-4a3b-9c18-731cd7be6fec req-c8407df5-7906-482e-ae32-23fb4edf9b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858d86de-5fe8-43e9-9409-364826f1c48c", "name": "network-vif-deleted", "tag": "e872f74e-c019-41cc-bb6f-c40a21a59d12"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:35.961061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c43b0caa-32c8-4a3b-9c18-731cd7be6fec req-c8407df5-7906-482e-ae32-23fb4edf9b25 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.961478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c43b0caa-32c8-4a3b-9c18-731cd7be6fec req-c8407df5-7906-482e-ae32-23fb4edf9b25 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.963658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c43b0caa-32c8-4a3b-9c18-731cd7be6fec req-c8407df5-7906-482e-ae32-23fb4edf9b25 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.996136 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c43b0caa-32c8-4a3b-9c18-731cd7be6fec req-c8407df5-7906-482e-ae32-23fb4edf9b25 service nova] Creating event network-vif-deleted:e872f74e-c019-41cc-bb6f-c40a21a59d12 for instance 858d86de-5fe8-43e9-9409-364826f1c48c on n-h2-850499-14 Oct 04 18:10:36.007049 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c43b0caa-32c8-4a3b-9c18-731cd7be6fec req-c8407df5-7906-482e-ae32-23fb4edf9b25 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068717 Oct 04 18:10:36.008788 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1120/2290] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:36.050713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d2f9e05-bf4a-4272-b4cd-a98a45441623 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.058017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0d2f9e05-bf4a-4272-b4cd-a98a45441623 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:36.079210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d2f9e05-bf4a-4272-b4cd-a98a45441623 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.080574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d2f9e05-bf4a-4272-b4cd-a98a45441623 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.081472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d2f9e05-bf4a-4272-b4cd-a98a45441623 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.084665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d2f9e05-bf4a-4272-b4cd-a98a45441623 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.088464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d2f9e05-bf4a-4272-b4cd-a98a45441623 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.089377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d2f9e05-bf4a-4272-b4cd-a98a45441623 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.099042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:36.458247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0d2f9e05-bf4a-4272-b4cd-a98a45441623 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:36.467558 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0d2f9e05-bf4a-4272-b4cd-a98a45441623 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1313 microversion: 2.1 time: 0.455820 Oct 04 18:10:36.469397 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1121/2291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:36.474471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.475463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: 858d86de-5fe8-43e9-9409-364826f1c48c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:36.482539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.483597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.484311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.485750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.486422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.487188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.503123 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] HTTP exception thrown: Instance 858d86de-5fe8-43e9-9409-364826f1c48c could not be found. Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Request method failure captured: Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c HTTP/1.1 Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHbbWX5KhDyYM_40LNILvuTuuaZJWcvDJ-W-1pGfnreKrB026rhm2m3CV2EFLyjb5QkPRt9RpPGK8ecl4pGw1VkfTHCCBwtvhU-2h5cgtV1k6y0Uqd3z01Pdp0A82J4NV-DnSkczdyvCn7lwoj-dG7yo6w-eBzQlHK3OIbj19y7FnBQ Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:36.505431 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}] Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: bf48879013734f8ca1ce5862895b8bcf Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 858d86de-5fe8-43e9-9409-364826f1c48c could not be found. Oct 04 18:10:36.507363 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '858d86de-5fe8-43e9-9409-364826f1c48c'} Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 858d86de-5fe8-43e9-9409-364826f1c48c could not be found. Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:36.508447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 858d86de-5fe8-43e9-9409-364826f1c48c could not be found. Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 858d86de-5fe8-43e9-9409-364826f1c48c could not be found. Oct 04 18:10:36.510269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:36.514606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Returning 404 to user: Instance 858d86de-5fe8-43e9-9409-364826f1c48c could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:36.516210 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c1e48455-94ff-42f8-9a1b-ebad125a779b tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c" status: 404 len: 111 microversion: 2.1 time: 0.045386 Oct 04 18:10:36.517333 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1122/2292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/858d86de-5fe8-43e9-9409-364826f1c48c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:36.529715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.530766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:36.539083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.539971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.540638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.541561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.542216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.542851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.586192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.587170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.588015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.589246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lazy-loading 'fault' on Instance uuid f6d94795-de6c-4946-ae72-68ae4c497228 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:36.682877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf48879013734f8ca1ce5862895b8bcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdc06e452984bf18267e832440ddcd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:36.695174 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f17d8a7c-0aa3-41f9-9924-2ed9938b9819 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 200 len: 1312 microversion: 2.1 time: 0.171333 Oct 04 18:10:36.696978 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1123/2293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:36.703087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5b1f96df-4e58-4e95-80dd-78a4ffc85a51 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.704346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5b1f96df-4e58-4e95-80dd-78a4ffc85a51 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:36.715861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b1f96df-4e58-4e95-80dd-78a4ffc85a51 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.718892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b1f96df-4e58-4e95-80dd-78a4ffc85a51 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.719733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b1f96df-4e58-4e95-80dd-78a4ffc85a51 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.720740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b1f96df-4e58-4e95-80dd-78a4ffc85a51 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.721461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b1f96df-4e58-4e95-80dd-78a4ffc85a51 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.722401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b1f96df-4e58-4e95-80dd-78a4ffc85a51 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.066739 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b5f9939-732e-4bdc-8d78-494cbab770e5 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.723832 Oct 04 18:10:37.067420 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1171/2294] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:10:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:37.068962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b1f96df-4e58-4e95-80dd-78a4ffc85a51 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:37.077553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-62c0d3af-3220-4d6f-a676-9e74049a4b91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:37.078606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-62c0d3af-3220-4d6f-a676-9e74049a4b91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:37.079011 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5b1f96df-4e58-4e95-80dd-78a4ffc85a51 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.380558 Oct 04 18:10:37.087044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c0d3af-3220-4d6f-a676-9e74049a4b91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.087909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c0d3af-3220-4d6f-a676-9e74049a4b91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.088580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c0d3af-3220-4d6f-a676-9e74049a4b91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.090391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c0d3af-3220-4d6f-a676-9e74049a4b91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.091136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c0d3af-3220-4d6f-a676-9e74049a4b91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.091832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c0d3af-3220-4d6f-a676-9e74049a4b91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.092161 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1124/2295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:37.209938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-926707836", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "61d1d0bf-30e4-4740-8b71-20dd29f08efb"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:37.279970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-62c0d3af-3220-4d6f-a676-9e74049a4b91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:37.280734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] validate_networks() for [('61d1d0bf-30e4-4740-8b71-20dd29f08efb', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:37.298388 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-62c0d3af-3220-4d6f-a676-9e74049a4b91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1308 microversion: 2.1 time: 0.229655 Oct 04 18:10:37.299814 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1172/2296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:37 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:37.491458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8067813-8dcc-4e17-b361-632773977dea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:37.492405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f8067813-8dcc-4e17-b361-632773977dea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:37.499276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8067813-8dcc-4e17-b361-632773977dea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.500729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8067813-8dcc-4e17-b361-632773977dea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.501382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8067813-8dcc-4e17-b361-632773977dea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.502315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8067813-8dcc-4e17-b361-632773977dea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.503034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8067813-8dcc-4e17-b361-632773977dea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.503672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8067813-8dcc-4e17-b361-632773977dea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.857167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f8067813-8dcc-4e17-b361-632773977dea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:37.870642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=16 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:37.885602 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8067813-8dcc-4e17-b361-632773977dea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1313 microversion: 2.1 time: 0.382520 Oct 04 18:10:37.902112 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1173/2297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:37 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:37.915291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:37.916843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] [instance: f6d94795-de6c-4946-ae72-68ae4c497228] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:37.930301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.931274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.933174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.934774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.936246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.937092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.961757 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] HTTP exception thrown: Instance f6d94795-de6c-4946-ae72-68ae4c497228 could not be found. Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Request method failure captured: Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 HTTP/1.1 Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHbbWX5KhDyYM_40LNILvuTuuaZJWcvDJ-W-1pGfnreKrB026rhm2m3CV2EFLyjb5QkPRt9RpPGK8ecl4pGw1VkfTHCCBwtvhU-2h5cgtV1k6y0Uqd3z01Pdp0A82J4NV-DnSkczdyvCn7lwoj-dG7yo6w-eBzQlHK3OIbj19y7FnBQ Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:10:37.966071 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4bdc06e452984bf18267e832440ddcd9"}]}] Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 4bdc06e452984bf18267e832440ddcd9 Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-822683703 Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: bf48879013734f8ca1ce5862895b8bcf Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ListServersNegativeTestJSON-822683703-project Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance f6d94795-de6c-4946-ae72-68ae4c497228 could not be found. Oct 04 18:10:37.967266 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'f6d94795-de6c-4946-ae72-68ae4c497228'} Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d94795-de6c-4946-ae72-68ae4c497228 could not be found. Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:37.967893 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d94795-de6c-4946-ae72-68ae4c497228 could not be found. Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d94795-de6c-4946-ae72-68ae4c497228 could not be found. Oct 04 18:10:37.968897 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:10:37.971071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] Returning 404 to user: Instance f6d94795-de6c-4946-ae72-68ae4c497228 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:37.972219 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7c060f2f-e507-4616-80d9-1d9399496689 tempest-ListServersNegativeTestJSON-822683703 tempest-ListServersNegativeTestJSON-822683703-project] 10.222.0.18 "GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228" status: 404 len: 111 microversion: 2.1 time: 0.068966 Oct 04 18:10:37.973853 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1174/2298] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:37 2022] GET /compute/v2.1/servers/f6d94795-de6c-4946-ae72-68ae4c497228 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:38.111583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-928f0b5e-05b1-4269-987a-a1b003915e8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:38.113142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-928f0b5e-05b1-4269-987a-a1b003915e8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.127761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928f0b5e-05b1-4269-987a-a1b003915e8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.129476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928f0b5e-05b1-4269-987a-a1b003915e8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.130172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928f0b5e-05b1-4269-987a-a1b003915e8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.131285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928f0b5e-05b1-4269-987a-a1b003915e8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.132122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928f0b5e-05b1-4269-987a-a1b003915e8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.133741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928f0b5e-05b1-4269-987a-a1b003915e8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.143715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=18 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:38.381202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:38.381780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:38.382090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:38.382499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:38.382909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:38.399149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.400103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.401665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.402673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.403796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.404461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.428347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Getting quotas for project 197a6854a6a949b88eae7d185688d461. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:38.438522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Getting quotas for user aa469d1847b5434eaa545db65834a323 and project 197a6854a6a949b88eae7d185688d461. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:38.459110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:38.462593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:38.505429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-928f0b5e-05b1-4269-987a-a1b003915e8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.528327 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-928f0b5e-05b1-4269-987a-a1b003915e8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.423227 Oct 04 18:10:38.530274 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1175/2299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:38 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:38.537677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-caa6177d-60dd-4e91-952e-828d0a2ae8c4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:38.539285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-caa6177d-60dd-4e91-952e-828d0a2ae8c4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.547295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caa6177d-60dd-4e91-952e-828d0a2ae8c4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.548186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caa6177d-60dd-4e91-952e-828d0a2ae8c4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.548883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caa6177d-60dd-4e91-952e-828d0a2ae8c4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.549880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caa6177d-60dd-4e91-952e-828d0a2ae8c4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.550660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caa6177d-60dd-4e91-952e-828d0a2ae8c4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.551363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caa6177d-60dd-4e91-952e-828d0a2ae8c4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.557206 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e259cb5f-faae-4c0e-bfab-3c1cdefa6f33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351494 Oct 04 18:10:38.558818 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1125/2300] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:10:38.572903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f74c6ad6-c11a-4baa-9e3e-726259106b4a tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:38.574317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f74c6ad6-c11a-4baa-9e3e-726259106b4a tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.705276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f74c6ad6-c11a-4baa-9e3e-726259106b4a tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.725296 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f74c6ad6-c11a-4baa-9e3e-726259106b4a tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1223 microversion: 2.1 time: 0.158873 Oct 04 18:10:38.728076 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1126/2301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:38 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1223 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:38.847356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:38.868606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-caa6177d-60dd-4e91-952e-828d0a2ae8c4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.878035 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-caa6177d-60dd-4e91-952e-828d0a2ae8c4 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1308 microversion: 2.1 time: 0.345335 Oct 04 18:10:38.892511 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1176/2302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:38 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1308 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:38.915483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-996d88be-22a7-465f-ab0d-3120f1fb3bfb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:38.917713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-996d88be-22a7-465f-ab0d-3120f1fb3bfb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.938902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996d88be-22a7-465f-ab0d-3120f1fb3bfb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.940375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996d88be-22a7-465f-ab0d-3120f1fb3bfb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.941517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996d88be-22a7-465f-ab0d-3120f1fb3bfb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.943497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996d88be-22a7-465f-ab0d-3120f1fb3bfb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.944471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996d88be-22a7-465f-ab0d-3120f1fb3bfb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.945433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996d88be-22a7-465f-ab0d-3120f1fb3bfb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.238756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-996d88be-22a7-465f-ab0d-3120f1fb3bfb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:39.259785 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-996d88be-22a7-465f-ab0d-3120f1fb3bfb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1313 microversion: 2.1 time: 0.347793 Oct 04 18:10:39.261982 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1127/2303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:38 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:39.555920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7fc2a067-6b33-488e-b24a-913e8caeabfb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:39.556701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7fc2a067-6b33-488e-b24a-913e8caeabfb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:39.570714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fc2a067-6b33-488e-b24a-913e8caeabfb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.571746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fc2a067-6b33-488e-b24a-913e8caeabfb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.572159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fc2a067-6b33-488e-b24a-913e8caeabfb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.573145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fc2a067-6b33-488e-b24a-913e8caeabfb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.573863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fc2a067-6b33-488e-b24a-913e8caeabfb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.574526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fc2a067-6b33-488e-b24a-913e8caeabfb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.741192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-841a4a07-1ecc-4f9a-88df-bde9d4a2a0e8 req-16a8a8b2-a6d4-405b-8b6a-025463aa8252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785194b8-dcad-4490-9f2a-e62dcf5afe79", "tag": "a1297b31-1254-4f09-b9cc-b8acb3985f3d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:39.767099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-841a4a07-1ecc-4f9a-88df-bde9d4a2a0e8 req-16a8a8b2-a6d4-405b-8b6a-025463aa8252 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.767832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-841a4a07-1ecc-4f9a-88df-bde9d4a2a0e8 req-16a8a8b2-a6d4-405b-8b6a-025463aa8252 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.768413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-841a4a07-1ecc-4f9a-88df-bde9d4a2a0e8 req-16a8a8b2-a6d4-405b-8b6a-025463aa8252 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.788464 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-841a4a07-1ecc-4f9a-88df-bde9d4a2a0e8 req-16a8a8b2-a6d4-405b-8b6a-025463aa8252 service nova] Creating event network-changed:a1297b31-1254-4f09-b9cc-b8acb3985f3d for instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 on n-h1-850499-14 Oct 04 18:10:39.802187 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-841a4a07-1ecc-4f9a-88df-bde9d4a2a0e8 req-16a8a8b2-a6d4-405b-8b6a-025463aa8252 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064566 Oct 04 18:10:39.803059 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1128/2304] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:39.808328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9bb643fa-6c26-4907-8c7b-977958203e42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:39.818830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9bb643fa-6c26-4907-8c7b-977958203e42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:39.829553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bb643fa-6c26-4907-8c7b-977958203e42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.830356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bb643fa-6c26-4907-8c7b-977958203e42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.831191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bb643fa-6c26-4907-8c7b-977958203e42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.832145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bb643fa-6c26-4907-8c7b-977958203e42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.833177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bb643fa-6c26-4907-8c7b-977958203e42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.833814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bb643fa-6c26-4907-8c7b-977958203e42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.986158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7fc2a067-6b33-488e-b24a-913e8caeabfb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:39.996141 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7fc2a067-6b33-488e-b24a-913e8caeabfb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.444207 Oct 04 18:10:39.997203 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1177/2305] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:39 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:40.008025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f822c9ef-08f7-4d2c-8ec1-507da44bb02f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.009119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9bb643fa-6c26-4907-8c7b-977958203e42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.009947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f822c9ef-08f7-4d2c-8ec1-507da44bb02f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:40.022164 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9bb643fa-6c26-4907-8c7b-977958203e42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1275 microversion: 2.1 time: 0.217570 Oct 04 18:10:40.022370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f822c9ef-08f7-4d2c-8ec1-507da44bb02f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.022703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f822c9ef-08f7-4d2c-8ec1-507da44bb02f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.023190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f822c9ef-08f7-4d2c-8ec1-507da44bb02f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.023902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f822c9ef-08f7-4d2c-8ec1-507da44bb02f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.024351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f822c9ef-08f7-4d2c-8ec1-507da44bb02f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.029584 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1129/2306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:39 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:40.035786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f822c9ef-08f7-4d2c-8ec1-507da44bb02f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.081242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5685ce19-a23e-4c66-be3d-42e01934dd44 req-60741e50-3496-4afb-8922-d18d594d1d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378afc34-2555-49c8-b008-303c8f22eded", "name": "network-vif-plugged", "status": "completed", "tag": "279e0ebb-0c3d-4ebe-8b58-abe1859c6f23"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:40.102343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5685ce19-a23e-4c66-be3d-42e01934dd44 req-60741e50-3496-4afb-8922-d18d594d1d7f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.112014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5685ce19-a23e-4c66-be3d-42e01934dd44 req-60741e50-3496-4afb-8922-d18d594d1d7f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.112529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5685ce19-a23e-4c66-be3d-42e01934dd44 req-60741e50-3496-4afb-8922-d18d594d1d7f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.134164 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5685ce19-a23e-4c66-be3d-42e01934dd44 req-60741e50-3496-4afb-8922-d18d594d1d7f service nova] Creating event network-vif-plugged:279e0ebb-0c3d-4ebe-8b58-abe1859c6f23 for instance 378afc34-2555-49c8-b008-303c8f22eded on n-h1-850499-14 Oct 04 18:10:40.147125 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5685ce19-a23e-4c66-be3d-42e01934dd44 req-60741e50-3496-4afb-8922-d18d594d1d7f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069581 Oct 04 18:10:40.147961 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1130/2307] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:40.285547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b2420344-96d6-493c-a9ee-d8ed9200c6f2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.286467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b2420344-96d6-493c-a9ee-d8ed9200c6f2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:40.303761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2420344-96d6-493c-a9ee-d8ed9200c6f2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.313671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2420344-96d6-493c-a9ee-d8ed9200c6f2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.331247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f822c9ef-08f7-4d2c-8ec1-507da44bb02f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.342492 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f822c9ef-08f7-4d2c-8ec1-507da44bb02f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1308 microversion: 2.1 time: 0.344041 Oct 04 18:10:40.348465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2420344-96d6-493c-a9ee-d8ed9200c6f2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.350198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2420344-96d6-493c-a9ee-d8ed9200c6f2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.357399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2420344-96d6-493c-a9ee-d8ed9200c6f2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.358172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2420344-96d6-493c-a9ee-d8ed9200c6f2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.360690 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1178/2308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:39 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:40.840936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b2420344-96d6-493c-a9ee-d8ed9200c6f2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.856288 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b2420344-96d6-493c-a9ee-d8ed9200c6f2 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1313 microversion: 2.1 time: 0.576392 Oct 04 18:10:40.865199 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1131/2309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:41.019579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1545ecd4-9ee1-44be-ade3-84c4df895d04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.020673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1545ecd4-9ee1-44be-ade3-84c4df895d04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.033719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1545ecd4-9ee1-44be-ade3-84c4df895d04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.035359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1545ecd4-9ee1-44be-ade3-84c4df895d04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.037418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1545ecd4-9ee1-44be-ade3-84c4df895d04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.038323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1545ecd4-9ee1-44be-ade3-84c4df895d04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.041351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1545ecd4-9ee1-44be-ade3-84c4df895d04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.042417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1545ecd4-9ee1-44be-ade3-84c4df895d04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.057248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e3540569-17ed-4942-a5de-f0cc038da3d3 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.058275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e3540569-17ed-4942-a5de-f0cc038da3d3 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.074126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3540569-17ed-4942-a5de-f0cc038da3d3 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.075043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3540569-17ed-4942-a5de-f0cc038da3d3 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.075661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3540569-17ed-4942-a5de-f0cc038da3d3 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.076738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3540569-17ed-4942-a5de-f0cc038da3d3 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.077555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3540569-17ed-4942-a5de-f0cc038da3d3 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.078812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3540569-17ed-4942-a5de-f0cc038da3d3 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.254190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e3540569-17ed-4942-a5de-f0cc038da3d3 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.263515 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e3540569-17ed-4942-a5de-f0cc038da3d3 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1281 microversion: 2.1 time: 0.215477 Oct 04 18:10:41.285142 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1132/2310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:41.388504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12bcc355-fe04-4f7b-9a15-abb1c320069b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.389492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-12bcc355-fe04-4f7b-9a15-abb1c320069b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.424347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12bcc355-fe04-4f7b-9a15-abb1c320069b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.427756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12bcc355-fe04-4f7b-9a15-abb1c320069b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.428106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12bcc355-fe04-4f7b-9a15-abb1c320069b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.428856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12bcc355-fe04-4f7b-9a15-abb1c320069b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.429323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12bcc355-fe04-4f7b-9a15-abb1c320069b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.429788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12bcc355-fe04-4f7b-9a15-abb1c320069b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.448200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1545ecd4-9ee1-44be-ade3-84c4df895d04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.457214 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1545ecd4-9ee1-44be-ade3-84c4df895d04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.441497 Oct 04 18:10:41.458467 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1179/2311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:41.708032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-12bcc355-fe04-4f7b-9a15-abb1c320069b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.720526 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12bcc355-fe04-4f7b-9a15-abb1c320069b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1308 microversion: 2.1 time: 0.357175 Oct 04 18:10:41.722161 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1133/2312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:41.879840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-acfc6218-b20c-4279-a56f-73b882832325 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.880517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-acfc6218-b20c-4279-a56f-73b882832325 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.887770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acfc6218-b20c-4279-a56f-73b882832325 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.888273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acfc6218-b20c-4279-a56f-73b882832325 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.891138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acfc6218-b20c-4279-a56f-73b882832325 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.891929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acfc6218-b20c-4279-a56f-73b882832325 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.892552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acfc6218-b20c-4279-a56f-73b882832325 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.893145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acfc6218-b20c-4279-a56f-73b882832325 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.128769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-acfc6218-b20c-4279-a56f-73b882832325 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:42.137935 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-acfc6218-b20c-4279-a56f-73b882832325 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1313 microversion: 2.1 time: 0.262717 Oct 04 18:10:42.138906 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1180/2313] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:42.291904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-289bf081-2379-40a8-982c-1b02411e400d tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.292819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-289bf081-2379-40a8-982c-1b02411e400d tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.306423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-289bf081-2379-40a8-982c-1b02411e400d tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.306621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-289bf081-2379-40a8-982c-1b02411e400d tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.307046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-289bf081-2379-40a8-982c-1b02411e400d tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.307934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-289bf081-2379-40a8-982c-1b02411e400d tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.308409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-289bf081-2379-40a8-982c-1b02411e400d tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.308821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-289bf081-2379-40a8-982c-1b02411e400d tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.485541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-08b2937b-24b5-4f3b-9caa-c32db24eba07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.486385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-08b2937b-24b5-4f3b-9caa-c32db24eba07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.506055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08b2937b-24b5-4f3b-9caa-c32db24eba07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.506616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08b2937b-24b5-4f3b-9caa-c32db24eba07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.507104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08b2937b-24b5-4f3b-9caa-c32db24eba07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.507866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08b2937b-24b5-4f3b-9caa-c32db24eba07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.508336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08b2937b-24b5-4f3b-9caa-c32db24eba07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.508774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08b2937b-24b5-4f3b-9caa-c32db24eba07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.634504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-289bf081-2379-40a8-982c-1b02411e400d tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:42.643919 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-289bf081-2379-40a8-982c-1b02411e400d tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1323 microversion: 2.1 time: 0.355814 Oct 04 18:10:42.651580 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1134/2314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:42 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:42.790592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08b2937b-24b5-4f3b-9caa-c32db24eba07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:42.803315 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-08b2937b-24b5-4f3b-9caa-c32db24eba07 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.322974 Oct 04 18:10:42.807925 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1181/2315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:42 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:42.839558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5d113535-ed9b-4020-9356-33b6ae107305 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.846144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5d113535-ed9b-4020-9356-33b6ae107305 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.851615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-de52b0eb-2916-4c52-b622-6cf42357ddae tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Action: 'create', calling method: .version_select at 0x7fd4d1d94b80>, body: {"pool": null} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:42.864127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d113535-ed9b-4020-9356-33b6ae107305 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.864698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d113535-ed9b-4020-9356-33b6ae107305 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.867235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d113535-ed9b-4020-9356-33b6ae107305 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.869016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d113535-ed9b-4020-9356-33b6ae107305 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.869016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d113535-ed9b-4020-9356-33b6ae107305 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.872855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d113535-ed9b-4020-9356-33b6ae107305 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:43.659599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5d113535-ed9b-4020-9356-33b6ae107305 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:43.675612 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5d113535-ed9b-4020-9356-33b6ae107305 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1308 microversion: 2.1 time: 0.866244 Oct 04 18:10:43.676576 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1182/2316] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:42 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1308 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:43.692379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49dadc37-b090-488c-b33a-fac16b2ba93c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:43.693465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-49dadc37-b090-488c-b33a-fac16b2ba93c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:43.707133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49dadc37-b090-488c-b33a-fac16b2ba93c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:43.711541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49dadc37-b090-488c-b33a-fac16b2ba93c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:43.712233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49dadc37-b090-488c-b33a-fac16b2ba93c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:43.713163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49dadc37-b090-488c-b33a-fac16b2ba93c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:43.715626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49dadc37-b090-488c-b33a-fac16b2ba93c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:43.716265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49dadc37-b090-488c-b33a-fac16b2ba93c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:44.622109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-49dadc37-b090-488c-b33a-fac16b2ba93c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:44.637181 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49dadc37-b090-488c-b33a-fac16b2ba93c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1463 microversion: 2.1 time: 0.955106 Oct 04 18:10:44.640373 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1183/2317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:43 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1463 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:44.656497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-617fce0d-54ee-419a-8e56-55b68d63dae7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:44.659388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-617fce0d-54ee-419a-8e56-55b68d63dae7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:44.670427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-617fce0d-54ee-419a-8e56-55b68d63dae7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:44.672214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-617fce0d-54ee-419a-8e56-55b68d63dae7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:44.673156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-617fce0d-54ee-419a-8e56-55b68d63dae7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:44.674191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-617fce0d-54ee-419a-8e56-55b68d63dae7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:44.674676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-617fce0d-54ee-419a-8e56-55b68d63dae7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:44.675268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-617fce0d-54ee-419a-8e56-55b68d63dae7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.530292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-617fce0d-54ee-419a-8e56-55b68d63dae7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:45.542160 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-617fce0d-54ee-419a-8e56-55b68d63dae7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1323 microversion: 2.1 time: 0.898814 Oct 04 18:10:45.558294 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1184/2318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:44 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1323 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:45.564787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7656bfa5-1ec3-4f78-8f66-95dd2fa8a5db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:45.565742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7656bfa5-1ec3-4f78-8f66-95dd2fa8a5db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:45.583099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7656bfa5-1ec3-4f78-8f66-95dd2fa8a5db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:45.584171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7656bfa5-1ec3-4f78-8f66-95dd2fa8a5db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:45.584973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7656bfa5-1ec3-4f78-8f66-95dd2fa8a5db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.586055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7656bfa5-1ec3-4f78-8f66-95dd2fa8a5db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:45.587683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7656bfa5-1ec3-4f78-8f66-95dd2fa8a5db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:45.588347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7656bfa5-1ec3-4f78-8f66-95dd2fa8a5db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.206447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7656bfa5-1ec3-4f78-8f66-95dd2fa8a5db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:46.215818 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7656bfa5-1ec3-4f78-8f66-95dd2fa8a5db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.655983 Oct 04 18:10:46.216972 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1185/2319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:45 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:46.226613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-cc54fe0a-727f-46a2-b959-2d91aff6ce61 req-78313754-4ad2-4f8b-8651-5dd566a7b7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8ca046-dc23-46f1-85e5-ba07d44234c6", "tag": "219231f1-3c0d-49e8-8810-cf7c3110a792"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:46.240754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cc54fe0a-727f-46a2-b959-2d91aff6ce61 req-78313754-4ad2-4f8b-8651-5dd566a7b7ff service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.241426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cc54fe0a-727f-46a2-b959-2d91aff6ce61 req-78313754-4ad2-4f8b-8651-5dd566a7b7ff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.242028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cc54fe0a-727f-46a2-b959-2d91aff6ce61 req-78313754-4ad2-4f8b-8651-5dd566a7b7ff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.259109 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-cc54fe0a-727f-46a2-b959-2d91aff6ce61 req-78313754-4ad2-4f8b-8651-5dd566a7b7ff service nova] Creating event network-changed:219231f1-3c0d-49e8-8810-cf7c3110a792 for instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 on n-h1-850499-14 Oct 04 18:10:46.268977 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-cc54fe0a-727f-46a2-b959-2d91aff6ce61 req-78313754-4ad2-4f8b-8651-5dd566a7b7ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050498 Oct 04 18:10:46.270212 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1186/2320] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:46.290892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e3f6ae1a-12cd-466c-b21c-b5cb03ab8d92 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:46.291745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e3f6ae1a-12cd-466c-b21c-b5cb03ab8d92 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:46.322849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:46.325241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3f6ae1a-12cd-466c-b21c-b5cb03ab8d92 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.325760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3f6ae1a-12cd-466c-b21c-b5cb03ab8d92 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.326221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3f6ae1a-12cd-466c-b21c-b5cb03ab8d92 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.326977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3f6ae1a-12cd-466c-b21c-b5cb03ab8d92 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.327448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3f6ae1a-12cd-466c-b21c-b5cb03ab8d92 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.327918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3f6ae1a-12cd-466c-b21c-b5cb03ab8d92 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.637382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e3f6ae1a-12cd-466c-b21c-b5cb03ab8d92 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:46.648514 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e3f6ae1a-12cd-466c-b21c-b5cb03ab8d92 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1313 microversion: 2.1 time: 0.376563 Oct 04 18:10:46.669008 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1187/2321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:46 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:46.676045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0e09ec89-4c3e-4d2a-b11b-8572bd7bae10 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:46.681001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0e09ec89-4c3e-4d2a-b11b-8572bd7bae10 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:46.699660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e09ec89-4c3e-4d2a-b11b-8572bd7bae10 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.700131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e09ec89-4c3e-4d2a-b11b-8572bd7bae10 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.703875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e09ec89-4c3e-4d2a-b11b-8572bd7bae10 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.707241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e09ec89-4c3e-4d2a-b11b-8572bd7bae10 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.708089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e09ec89-4c3e-4d2a-b11b-8572bd7bae10 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.708715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e09ec89-4c3e-4d2a-b11b-8572bd7bae10 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.724624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:47.345285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0e09ec89-4c3e-4d2a-b11b-8572bd7bae10 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:47.361045 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0e09ec89-4c3e-4d2a-b11b-8572bd7bae10 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1308 microversion: 2.1 time: 0.691588 Oct 04 18:10:47.368608 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1188/2322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:46 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1308 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:47.385422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e6c7c494-2c13-42b4-ad7b-8c34c2b16a9c req-bdfa5be0-ed0e-450b-a0a0-2632cae1c364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a", "name": "network-vif-plugged", "status": "completed", "tag": "1075430b-4731-47b1-aeb1-6c78e21fd987"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:47.386785 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-de52b0eb-2916-4c52-b622-6cf42357ddae tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.733820 Oct 04 18:10:47.387431 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1135/2323] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:10:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:47.399820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e6c7c494-2c13-42b4-ad7b-8c34c2b16a9c req-bdfa5be0-ed0e-450b-a0a0-2632cae1c364 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.400320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e6c7c494-2c13-42b4-ad7b-8c34c2b16a9c req-bdfa5be0-ed0e-450b-a0a0-2632cae1c364 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.400539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6638f6b6-bd17-4706-81a8-cef7e944f9ec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:47.400759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e6c7c494-2c13-42b4-ad7b-8c34c2b16a9c req-bdfa5be0-ed0e-450b-a0a0-2632cae1c364 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.401168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6638f6b6-bd17-4706-81a8-cef7e944f9ec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:47.408745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6638f6b6-bd17-4706-81a8-cef7e944f9ec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.409490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6638f6b6-bd17-4706-81a8-cef7e944f9ec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.410102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6638f6b6-bd17-4706-81a8-cef7e944f9ec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.411011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6638f6b6-bd17-4706-81a8-cef7e944f9ec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.411623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6638f6b6-bd17-4706-81a8-cef7e944f9ec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.412208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6638f6b6-bd17-4706-81a8-cef7e944f9ec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.418538 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e6c7c494-2c13-42b4-ad7b-8c34c2b16a9c req-bdfa5be0-ed0e-450b-a0a0-2632cae1c364 service nova] Creating event network-vif-plugged:1075430b-4731-47b1-aeb1-6c78e21fd987 for instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a on n-h2-850499-14 Oct 04 18:10:47.427137 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e6c7c494-2c13-42b4-ad7b-8c34c2b16a9c req-bdfa5be0-ed0e-450b-a0a0-2632cae1c364 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056536 Oct 04 18:10:47.428259 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1189/2324] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:47.440932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9273d5e2-ed3e-409c-a693-4ebbf6b9177e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:47.441968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9273d5e2-ed3e-409c-a693-4ebbf6b9177e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:47.453511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9273d5e2-ed3e-409c-a693-4ebbf6b9177e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.454251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9273d5e2-ed3e-409c-a693-4ebbf6b9177e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.454926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9273d5e2-ed3e-409c-a693-4ebbf6b9177e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.455804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9273d5e2-ed3e-409c-a693-4ebbf6b9177e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.456407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9273d5e2-ed3e-409c-a693-4ebbf6b9177e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.457422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9273d5e2-ed3e-409c-a693-4ebbf6b9177e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.910940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6638f6b6-bd17-4706-81a8-cef7e944f9ec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:47.919452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9273d5e2-ed3e-409c-a693-4ebbf6b9177e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:47.933521 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9273d5e2-ed3e-409c-a693-4ebbf6b9177e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.502432 Oct 04 18:10:47.935913 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1190/2325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:47 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:47.944208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6bdac9e8-c9b1-4dde-a255-b38f8ae7c7e0 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Action: 'create', calling method: .version_select at 0x7fd4d61279d0>, body: {"pool": null} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:47.959378 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6638f6b6-bd17-4706-81a8-cef7e944f9ec tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1323 microversion: 2.1 time: 0.561373 Oct 04 18:10:47.961804 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1136/2326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:47 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1323 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:47.973658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ad8c1b2a-9552-4fe2-9503-f288e2b7e8f0 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:47.974664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ad8c1b2a-9552-4fe2-9503-f288e2b7e8f0 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:47.982400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8c1b2a-9552-4fe2-9503-f288e2b7e8f0 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.983335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8c1b2a-9552-4fe2-9503-f288e2b7e8f0 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.984075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8c1b2a-9552-4fe2-9503-f288e2b7e8f0 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.985532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8c1b2a-9552-4fe2-9503-f288e2b7e8f0 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.986187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8c1b2a-9552-4fe2-9503-f288e2b7e8f0 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.986772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8c1b2a-9552-4fe2-9503-f288e2b7e8f0 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.387974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ad8c1b2a-9552-4fe2-9503-f288e2b7e8f0 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:48.400794 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ad8c1b2a-9552-4fe2-9503-f288e2b7e8f0 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1313 microversion: 2.1 time: 0.436290 Oct 04 18:10:48.402026 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1137/2327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:47 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:48.432758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-41b05b48-bb15-4e7c-8dbc-24fad4ced0b2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:48.435724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-41b05b48-bb15-4e7c-8dbc-24fad4ced0b2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:48.447700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:48.450754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41b05b48-bb15-4e7c-8dbc-24fad4ced0b2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.452077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41b05b48-bb15-4e7c-8dbc-24fad4ced0b2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.453523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41b05b48-bb15-4e7c-8dbc-24fad4ced0b2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.454725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41b05b48-bb15-4e7c-8dbc-24fad4ced0b2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.456486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41b05b48-bb15-4e7c-8dbc-24fad4ced0b2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.457172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41b05b48-bb15-4e7c-8dbc-24fad4ced0b2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.712831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:48.882450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-41b05b48-bb15-4e7c-8dbc-24fad4ced0b2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:48.896393 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-41b05b48-bb15-4e7c-8dbc-24fad4ced0b2 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1308 microversion: 2.1 time: 0.492766 Oct 04 18:10:48.896993 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1138/2328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:48 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1308 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:48.963596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1ebf2a3-87ff-4225-b2e4-0ccddabc2b8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:48.964515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e1ebf2a3-87ff-4225-b2e4-0ccddabc2b8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:48.974496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1ebf2a3-87ff-4225-b2e4-0ccddabc2b8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.980866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1ebf2a3-87ff-4225-b2e4-0ccddabc2b8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.981489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1ebf2a3-87ff-4225-b2e4-0ccddabc2b8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.982416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1ebf2a3-87ff-4225-b2e4-0ccddabc2b8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.982909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1ebf2a3-87ff-4225-b2e4-0ccddabc2b8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.983410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1ebf2a3-87ff-4225-b2e4-0ccddabc2b8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.252846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1ebf2a3-87ff-4225-b2e4-0ccddabc2b8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:49.265322 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1ebf2a3-87ff-4225-b2e4-0ccddabc2b8a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.305281 Oct 04 18:10:49.266764 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1139/2329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:48 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:49.285783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-382b258b-abff-40f9-ab26-21256c260f3b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:49.286765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-382b258b-abff-40f9-ab26-21256c260f3b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:49.299694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-382b258b-abff-40f9-ab26-21256c260f3b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.301155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-382b258b-abff-40f9-ab26-21256c260f3b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.303778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-382b258b-abff-40f9-ab26-21256c260f3b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.305800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-382b258b-abff-40f9-ab26-21256c260f3b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.307365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-382b258b-abff-40f9-ab26-21256c260f3b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.308298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-382b258b-abff-40f9-ab26-21256c260f3b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.581854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-382b258b-abff-40f9-ab26-21256c260f3b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:49.594767 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-382b258b-abff-40f9-ab26-21256c260f3b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1323 microversion: 2.1 time: 0.321292 Oct 04 18:10:49.597142 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1140/2330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:49 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1323 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:49.607681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7b5be450-7579-4442-ad3c-9bc0ba7a517e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:49.612558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7b5be450-7579-4442-ad3c-9bc0ba7a517e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:49.630037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b5be450-7579-4442-ad3c-9bc0ba7a517e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.630805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b5be450-7579-4442-ad3c-9bc0ba7a517e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.632811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b5be450-7579-4442-ad3c-9bc0ba7a517e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.634322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b5be450-7579-4442-ad3c-9bc0ba7a517e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.635610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b5be450-7579-4442-ad3c-9bc0ba7a517e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.637933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b5be450-7579-4442-ad3c-9bc0ba7a517e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.959225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b5be450-7579-4442-ad3c-9bc0ba7a517e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:49.972207 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7b5be450-7579-4442-ad3c-9bc0ba7a517e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1313 microversion: 2.1 time: 0.372495 Oct 04 18:10:49.973564 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1141/2331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:49 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:49.979840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-78c2cafe-928f-4739-860a-fcad561b6252 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:49.980855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-78c2cafe-928f-4739-860a-fcad561b6252 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:49.989438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78c2cafe-928f-4739-860a-fcad561b6252 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.990159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78c2cafe-928f-4739-860a-fcad561b6252 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.990861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78c2cafe-928f-4739-860a-fcad561b6252 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.991969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78c2cafe-928f-4739-860a-fcad561b6252 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.992846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78c2cafe-928f-4739-860a-fcad561b6252 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.993594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78c2cafe-928f-4739-860a-fcad561b6252 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.024722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:50.303548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-78c2cafe-928f-4739-860a-fcad561b6252 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:50.312766 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-78c2cafe-928f-4739-860a-fcad561b6252 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1308 microversion: 2.1 time: 0.337748 Oct 04 18:10:50.313713 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1142/2332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:49 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1308 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:50.318923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3bf784dc-50ce-4992-986e-e446d3b785e7 req-f8141f67-3a1c-4f53-ad9f-732a4bae4c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785194b8-dcad-4490-9f2a-e62dcf5afe79", "name": "network-vif-plugged", "status": "completed", "tag": "a1297b31-1254-4f09-b9cc-b8acb3985f3d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:50.331943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3bf784dc-50ce-4992-986e-e446d3b785e7 req-f8141f67-3a1c-4f53-ad9f-732a4bae4c23 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.333198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3bf784dc-50ce-4992-986e-e446d3b785e7 req-f8141f67-3a1c-4f53-ad9f-732a4bae4c23 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.333917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3bf784dc-50ce-4992-986e-e446d3b785e7 req-f8141f67-3a1c-4f53-ad9f-732a4bae4c23 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.358868 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3bf784dc-50ce-4992-986e-e446d3b785e7 req-f8141f67-3a1c-4f53-ad9f-732a4bae4c23 service nova] Creating event network-vif-plugged:a1297b31-1254-4f09-b9cc-b8acb3985f3d for instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 on n-h1-850499-14 Oct 04 18:10:50.366254 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3bf784dc-50ce-4992-986e-e446d3b785e7 req-f8141f67-3a1c-4f53-ad9f-732a4bae4c23 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050834 Oct 04 18:10:50.375714 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1143/2333] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:50.633869 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6bdac9e8-c9b1-4dde-a255-b38f8ae7c7e0 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.693265 Oct 04 18:10:50.634669 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1191/2334] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:10:47 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:50.639723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac0e4b5c-6140-42a9-9451-c32cf8ef8e7c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:50.640485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac0e4b5c-6140-42a9-9451-c32cf8ef8e7c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:50.658472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac0e4b5c-6140-42a9-9451-c32cf8ef8e7c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.659089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac0e4b5c-6140-42a9-9451-c32cf8ef8e7c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.659549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac0e4b5c-6140-42a9-9451-c32cf8ef8e7c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.660284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac0e4b5c-6140-42a9-9451-c32cf8ef8e7c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.660881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac0e4b5c-6140-42a9-9451-c32cf8ef8e7c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.662329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac0e4b5c-6140-42a9-9451-c32cf8ef8e7c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.669528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4626b5db-80ed-4621-a04a-955f02fea2a9 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-933700699", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:50.674028 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4626b5db-80ed-4621-a04a-955f02fea2a9 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] HTTP exception thrown: min_count must be <= max_count Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4626b5db-80ed-4621-a04a-955f02fea2a9 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Request method failure captured: Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 183 Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHcp-ykrFDCt9yCYNXzoD0six7EOuVGQgNYsTza8ENw5oTuKuu6NptylCPWEvQe2HJOM5mEza3TdfCjRPattlrm6hEWMjbxWfEJAp5DRT811Yb8tYlnPviYEHHRTZnTA-BK1zVEil5lsRwOnlKHoCUBemsR7ILuL9vGa-GyOsnDquF0 Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: bc7f774afc9348de9d55fbe2b46bd7b2 Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:50.675582 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc7f774afc9348de9d55fbe2b46bd7b2"}]}] Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: bc7f774afc9348de9d55fbe2b46bd7b2 Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-MultipleCreateNegativeTestJSON-853084942-project Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d3975b8c9d2747c2b01d5533b299deae Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-853084942-project Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:10:50.676753 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-933700699", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: exception: min_count must be <= max_count Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-933700699', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:10:50.677466 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4626b5db-80ed-4621-a04a-955f02fea2a9 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Returning 400 to user: min_count must be <= max_count {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:50.679090 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4626b5db-80ed-4621-a04a-955f02fea2a9 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.299853 Oct 04 18:10:50.682930 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1144/2335] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:50 2022] POST /compute/v2.1/servers => generated 74 bytes in 306 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:10:50.690550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eff26a04-b5a9-411d-b764-96c794f203c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:50.692048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eff26a04-b5a9-411d-b764-96c794f203c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:50.702105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff26a04-b5a9-411d-b764-96c794f203c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.703164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff26a04-b5a9-411d-b764-96c794f203c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.703618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff26a04-b5a9-411d-b764-96c794f203c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.704334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff26a04-b5a9-411d-b764-96c794f203c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.704796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff26a04-b5a9-411d-b764-96c794f203c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.705219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eff26a04-b5a9-411d-b764-96c794f203c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.879266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ac0e4b5c-6140-42a9-9451-c32cf8ef8e7c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:50.887101 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac0e4b5c-6140-42a9-9451-c32cf8ef8e7c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.251321 Oct 04 18:10:50.887902 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1192/2336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:50 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:50.892777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8005c5bf-43e8-4c88-98d5-d99b198b7ae9 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Action: 'create', calling method: .version_select at 0x7fd4d61f6040>, body: {"pool": null} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:50.948561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eff26a04-b5a9-411d-b764-96c794f203c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:50.959522 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eff26a04-b5a9-411d-b764-96c794f203c8 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1323 microversion: 2.1 time: 0.274982 Oct 04 18:10:50.960478 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1145/2337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:50 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:50.965253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1def6642-c1b0-4665-be6e-93d9d3866a70 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-824419896", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "max_count": 0}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1def6642-c1b0-4665-be6e-93d9d3866a70 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Request method failure captured: Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 167 Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHcp-ykrFDCt9yCYNXzoD0six7EOuVGQgNYsTza8ENw5oTuKuu6NptylCPWEvQe2HJOM5mEza3TdfCjRPattlrm6hEWMjbxWfEJAp5DRT811Yb8tYlnPviYEHHRTZnTA-BK1zVEil5lsRwOnlKHoCUBemsR7ILuL9vGa-GyOsnDquF0 Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: bc7f774afc9348de9d55fbe2b46bd7b2 Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:50.969891 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc7f774afc9348de9d55fbe2b46bd7b2"}]}] Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: bc7f774afc9348de9d55fbe2b46bd7b2 Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-MultipleCreateNegativeTestJSON-853084942-project Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d3975b8c9d2747c2b01d5533b299deae Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-853084942-project Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:10:50.971304 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-824419896", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "max_count": 0}} Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-824419896', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'max_count': 0}}} Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 0 Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.972082 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.973598 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:50.974877 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:50.974877 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:50.974877 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:50.974877 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:50.974877 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:50.974877 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:50.974877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1def6642-c1b0-4665-be6e-93d9d3866a70 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:50.975839 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1def6642-c1b0-4665-be6e-93d9d3866a70 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013391 Oct 04 18:10:50.976656 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1146/2338] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:50 2022] POST /compute/v2.1/servers => generated 130 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:51.008381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5b786032-5e89-4d18-aea1-e592201fdc43 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:51.009394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5b786032-5e89-4d18-aea1-e592201fdc43 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:51.021002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b786032-5e89-4d18-aea1-e592201fdc43 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.021824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b786032-5e89-4d18-aea1-e592201fdc43 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.022512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b786032-5e89-4d18-aea1-e592201fdc43 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.023500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b786032-5e89-4d18-aea1-e592201fdc43 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.024189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b786032-5e89-4d18-aea1-e592201fdc43 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.024903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b786032-5e89-4d18-aea1-e592201fdc43 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.493208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b786032-5e89-4d18-aea1-e592201fdc43 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:51.510690 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5b786032-5e89-4d18-aea1-e592201fdc43 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1462 microversion: 2.1 time: 0.508547 Oct 04 18:10:51.511773 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1147/2339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:50 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1462 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:51.523580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca7e70b5-29bc-43da-a0dd-5cdcfcc36082 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-232789645", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "max_count": 2.5}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca7e70b5-29bc-43da-a0dd-5cdcfcc36082 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Request method failure captured: Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 169 Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHcp-ykrFDCt9yCYNXzoD0six7EOuVGQgNYsTza8ENw5oTuKuu6NptylCPWEvQe2HJOM5mEza3TdfCjRPattlrm6hEWMjbxWfEJAp5DRT811Yb8tYlnPviYEHHRTZnTA-BK1zVEil5lsRwOnlKHoCUBemsR7ILuL9vGa-GyOsnDquF0 Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: bc7f774afc9348de9d55fbe2b46bd7b2 Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:51.533173 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc7f774afc9348de9d55fbe2b46bd7b2"}]}] Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: bc7f774afc9348de9d55fbe2b46bd7b2 Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-MultipleCreateNegativeTestJSON-853084942-project Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d3975b8c9d2747c2b01d5533b299deae Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-853084942-project Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:10:51.536116 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-232789645", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "max_count": 2.5}} Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-232789645', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.537356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.539914 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:51.542502 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:51.542502 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:51.542502 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:51.542502 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:51.542502 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:51.542502 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:51.542502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca7e70b5-29bc-43da-a0dd-5cdcfcc36082 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:51.542502 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca7e70b5-29bc-43da-a0dd-5cdcfcc36082 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020903 Oct 04 18:10:51.546199 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1148/2340] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:51 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:51.552582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-110a73d9-7e54-447b-8856-d591441ca61c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:51.553715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-110a73d9-7e54-447b-8856-d591441ca61c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:51.562868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-110a73d9-7e54-447b-8856-d591441ca61c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.563596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-110a73d9-7e54-447b-8856-d591441ca61c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.564369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-110a73d9-7e54-447b-8856-d591441ca61c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.565530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-110a73d9-7e54-447b-8856-d591441ca61c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.566398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-110a73d9-7e54-447b-8856-d591441ca61c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.567092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-110a73d9-7e54-447b-8856-d591441ca61c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.895627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-110a73d9-7e54-447b-8856-d591441ca61c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:51.903422 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-110a73d9-7e54-447b-8856-d591441ca61c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1308 microversion: 2.1 time: 0.355873 Oct 04 18:10:51.903982 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1149/2341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:51 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:52.037089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-64d582a9-2009-4af4-91a1-d6f73f760c7c tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.040653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d582a9-2009-4af4-91a1-d6f73f760c7c tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.041140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d582a9-2009-4af4-91a1-d6f73f760c7c tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.041576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d582a9-2009-4af4-91a1-d6f73f760c7c tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.042307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d582a9-2009-4af4-91a1-d6f73f760c7c tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.042762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d582a9-2009-4af4-91a1-d6f73f760c7c tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.043208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64d582a9-2009-4af4-91a1-d6f73f760c7c tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.068246 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-64d582a9-2009-4af4-91a1-d6f73f760c7c tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.163117 Oct 04 18:10:52.068925 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1150/2342] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:10:51 2022] GET /compute/v2.1/os-services => generated 949 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:52.073550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1754079657", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:52.129829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:52.479490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:52.479906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:52.480381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:52.480783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:52.481198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:52.483353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:52.492324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.492806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.493242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.494024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.494526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.494998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.512866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Getting quotas for project b1b14394d8ea452eb046b7ce147a4ec7. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:52.519287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Getting quotas for user 0b824cdb1fd346729b59aece4c49a927 and project b1b14394d8ea452eb046b7ce147a4ec7. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:52.532392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:52.534754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:52.579929 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4be9a643-8da9-46dd-a06b-70f64d66483d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509788 Oct 04 18:10:52.580425 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1151/2343] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:52.585048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eac2487d-c6e3-4245-b2f3-33d8286409c9 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1567692390", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 0}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eac2487d-c6e3-4245-b2f3-33d8286409c9 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Request method failure captured: Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 168 Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHcp-ykrFDCt9yCYNXzoD0six7EOuVGQgNYsTza8ENw5oTuKuu6NptylCPWEvQe2HJOM5mEza3TdfCjRPattlrm6hEWMjbxWfEJAp5DRT811Yb8tYlnPviYEHHRTZnTA-BK1zVEil5lsRwOnlKHoCUBemsR7ILuL9vGa-GyOsnDquF0 Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: bc7f774afc9348de9d55fbe2b46bd7b2 Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:52.589145 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc7f774afc9348de9d55fbe2b46bd7b2"}]}] Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: bc7f774afc9348de9d55fbe2b46bd7b2 Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-MultipleCreateNegativeTestJSON-853084942-project Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d3975b8c9d2747c2b01d5533b299deae Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-853084942-project Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:10:52.590564 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1567692390", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 0}} Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1567692390', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'min_count': 0}}} Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 0 Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.591301 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.592684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:52.594299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:52.594299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:52.594299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:52.594299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:52.594299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:52.594299 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:52.595449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eac2487d-c6e3-4245-b2f3-33d8286409c9 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:52.596310 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eac2487d-c6e3-4245-b2f3-33d8286409c9 tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.014930 Oct 04 18:10:52.597085 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1152/2344] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:52 2022] POST /compute/v2.1/servers => generated 130 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:52.603510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d2cc6bb7-c15b-4d50-bd7e-9541080877da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.604161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d2cc6bb7-c15b-4d50-bd7e-9541080877da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:52.610931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2cc6bb7-c15b-4d50-bd7e-9541080877da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.611563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2cc6bb7-c15b-4d50-bd7e-9541080877da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.612015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2cc6bb7-c15b-4d50-bd7e-9541080877da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.613224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2cc6bb7-c15b-4d50-bd7e-9541080877da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.613364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2cc6bb7-c15b-4d50-bd7e-9541080877da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.613842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2cc6bb7-c15b-4d50-bd7e-9541080877da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.861739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d2cc6bb7-c15b-4d50-bd7e-9541080877da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:52.871163 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d2cc6bb7-c15b-4d50-bd7e-9541080877da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.272941 Oct 04 18:10:52.883667 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1153/2345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:52 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:52.893941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ed5ed15-4af1-46c3-84b6-26c0d28572ae tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.894421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7ed5ed15-4af1-46c3-84b6-26c0d28572ae tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:52.900838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed5ed15-4af1-46c3-84b6-26c0d28572ae tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.902229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed5ed15-4af1-46c3-84b6-26c0d28572ae tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.902733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed5ed15-4af1-46c3-84b6-26c0d28572ae tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.903724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed5ed15-4af1-46c3-84b6-26c0d28572ae tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.904367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed5ed15-4af1-46c3-84b6-26c0d28572ae tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.905020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed5ed15-4af1-46c3-84b6-26c0d28572ae tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.095804 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8005c5bf-43e8-4c88-98d5-d99b198b7ae9 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.206435 Oct 04 18:10:53.097759 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1193/2346] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:10:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:53.105619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-36304e2c-a632-4558-abb9-d2ad54ef2add tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:53.113798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36304e2c-a632-4558-abb9-d2ad54ef2add tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.114853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36304e2c-a632-4558-abb9-d2ad54ef2add tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.115630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36304e2c-a632-4558-abb9-d2ad54ef2add tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.116909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36304e2c-a632-4558-abb9-d2ad54ef2add tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.117660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36304e2c-a632-4558-abb9-d2ad54ef2add tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.118329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36304e2c-a632-4558-abb9-d2ad54ef2add tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.120904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7ed5ed15-4af1-46c3-84b6-26c0d28572ae tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:53.134014 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ed5ed15-4af1-46c3-84b6-26c0d28572ae tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1323 microversion: 2.1 time: 0.248780 Oct 04 18:10:53.135055 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1154/2347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:52 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:53.141376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f22f41bf-284b-448f-93a3-7daed23fdf06 req-5d3c191f-22a6-4c6c-846f-c6bf04f52cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3c972a-93d9-42f4-a3ee-840fc973de13", "name": "network-vif-plugged", "status": "completed", "tag": "ae2cd46e-ccab-4178-9cbb-0bd456cdcfd5"}, {"server_uuid": "ad8ca046-dc23-46f1-85e5-ba07d44234c6", "name": "network-vif-plugged", "status": "completed", "tag": "219231f1-3c0d-49e8-8810-cf7c3110a792"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:53.156215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f22f41bf-284b-448f-93a3-7daed23fdf06 req-5d3c191f-22a6-4c6c-846f-c6bf04f52cec service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.157066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f22f41bf-284b-448f-93a3-7daed23fdf06 req-5d3c191f-22a6-4c6c-846f-c6bf04f52cec service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.157603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f22f41bf-284b-448f-93a3-7daed23fdf06 req-5d3c191f-22a6-4c6c-846f-c6bf04f52cec service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.162850 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-36304e2c-a632-4558-abb9-d2ad54ef2add tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.064373 Oct 04 18:10:53.172572 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1194/2348] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 4 18:10:53 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:53.172572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e68f6487-c955-4582-94c1-230df8eecfab tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:53.172572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e68f6487-c955-4582-94c1-230df8eecfab tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:53.175205 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f22f41bf-284b-448f-93a3-7daed23fdf06 req-5d3c191f-22a6-4c6c-846f-c6bf04f52cec service nova] Creating event network-vif-plugged:ae2cd46e-ccab-4178-9cbb-0bd456cdcfd5 for instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 on n-h2-850499-14 Oct 04 18:10:53.175821 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f22f41bf-284b-448f-93a3-7daed23fdf06 req-5d3c191f-22a6-4c6c-846f-c6bf04f52cec service nova] Creating event network-vif-plugged:219231f1-3c0d-49e8-8810-cf7c3110a792 for instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 on n-h1-850499-14 Oct 04 18:10:53.179073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e68f6487-c955-4582-94c1-230df8eecfab tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.179748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e68f6487-c955-4582-94c1-230df8eecfab tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.180419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e68f6487-c955-4582-94c1-230df8eecfab tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.181386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e68f6487-c955-4582-94c1-230df8eecfab tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.181842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e68f6487-c955-4582-94c1-230df8eecfab tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.182438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e68f6487-c955-4582-94c1-230df8eecfab tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.184844 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f22f41bf-284b-448f-93a3-7daed23fdf06 req-5d3c191f-22a6-4c6c-846f-c6bf04f52cec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048230 Oct 04 18:10:53.185547 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1155/2349] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:53.192383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-644c7642-9210-4b26-a358-07c08db3585a tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1740178522", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 2.5}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-644c7642-9210-4b26-a358-07c08db3585a tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Request method failure captured: Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 170 Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHcp-ykrFDCt9yCYNXzoD0six7EOuVGQgNYsTza8ENw5oTuKuu6NptylCPWEvQe2HJOM5mEza3TdfCjRPattlrm6hEWMjbxWfEJAp5DRT811Yb8tYlnPviYEHHRTZnTA-BK1zVEil5lsRwOnlKHoCUBemsR7ILuL9vGa-GyOsnDquF0 Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: bc7f774afc9348de9d55fbe2b46bd7b2 Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:53.197531 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc7f774afc9348de9d55fbe2b46bd7b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc7f774afc9348de9d55fbe2b46bd7b2"}]}] Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: bc7f774afc9348de9d55fbe2b46bd7b2 Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-853084942 Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-MultipleCreateNegativeTestJSON-853084942-project Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d3975b8c9d2747c2b01d5533b299deae Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-853084942-project Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:10:53.199808 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1740178522", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 2.5}} Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1740178522', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:53.200405 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:53.201573 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:53.202566 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:53.202566 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:53.202566 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:53.202566 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:53.202566 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:53.202566 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:53.202566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-644c7642-9210-4b26-a358-07c08db3585a tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:53.202566 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-644c7642-9210-4b26-a358-07c08db3585a tempest-MultipleCreateNegativeTestJSON-853084942 tempest-MultipleCreateNegativeTestJSON-853084942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012135 Oct 04 18:10:53.202566 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1156/2350] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:53 2022] POST /compute/v2.1/servers => generated 139 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:53.220224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd87e659-ad2f-4a8b-b74f-813be374703d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:53.220983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cd87e659-ad2f-4a8b-b74f-813be374703d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:53.230579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd87e659-ad2f-4a8b-b74f-813be374703d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.231020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd87e659-ad2f-4a8b-b74f-813be374703d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.231472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd87e659-ad2f-4a8b-b74f-813be374703d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.232178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd87e659-ad2f-4a8b-b74f-813be374703d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.232639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd87e659-ad2f-4a8b-b74f-813be374703d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.233068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd87e659-ad2f-4a8b-b74f-813be374703d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.261965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e68f6487-c955-4582-94c1-230df8eecfab tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:53.274289 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e68f6487-c955-4582-94c1-230df8eecfab tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1218 microversion: 2.1 time: 0.108723 Oct 04 18:10:53.275012 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1195/2351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:53 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:53.279925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-30d3c382-09ce-425c-b71c-047cb642dc9a tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Action: 'create', calling method: .version_select at 0x7fd4d621f4c0>, body: {"pool": null} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:53.672728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd87e659-ad2f-4a8b-b74f-813be374703d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:53.682340 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd87e659-ad2f-4a8b-b74f-813be374703d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1488 microversion: 2.1 time: 0.481284 Oct 04 18:10:53.683148 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1157/2352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:53 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1488 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:53.688669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b424b4fa-31b2-4f3e-8405-6ac13b5a40aa tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:53.692332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b424b4fa-31b2-4f3e-8405-6ac13b5a40aa tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.693070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b424b4fa-31b2-4f3e-8405-6ac13b5a40aa tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.693981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b424b4fa-31b2-4f3e-8405-6ac13b5a40aa tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.695640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b424b4fa-31b2-4f3e-8405-6ac13b5a40aa tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.696314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b424b4fa-31b2-4f3e-8405-6ac13b5a40aa tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.697280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b424b4fa-31b2-4f3e-8405-6ac13b5a40aa tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.725266 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b424b4fa-31b2-4f3e-8405-6ac13b5a40aa tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.040886 Oct 04 18:10:53.726496 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1158/2353] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:10:53 2022] GET /compute/v2.1/os-services => generated 949 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:53.736819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da90266b-9059-4b03-91f4-3d3aa213627e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:53.737187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-da90266b-9059-4b03-91f4-3d3aa213627e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:53.744659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da90266b-9059-4b03-91f4-3d3aa213627e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.745201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da90266b-9059-4b03-91f4-3d3aa213627e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.745741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da90266b-9059-4b03-91f4-3d3aa213627e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.746551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da90266b-9059-4b03-91f4-3d3aa213627e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.747140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da90266b-9059-4b03-91f4-3d3aa213627e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.747732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da90266b-9059-4b03-91f4-3d3aa213627e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.782434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-da90266b-9059-4b03-91f4-3d3aa213627e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lazy-loading 'flavor' on Instance uuid 785194b8-dcad-4490-9f2a-e62dcf5afe79 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:53.862330 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-da90266b-9059-4b03-91f4-3d3aa213627e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79/action" status: 202 len: 0 microversion: 2.1 time: 0.134188 Oct 04 18:10:53.863622 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1159/2354] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:53 2022] POST /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:10:53.869319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e19b4281-d596-4353-b4c4-d08b9278a5ac tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:53.873564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e19b4281-d596-4353-b4c4-d08b9278a5ac tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.874080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e19b4281-d596-4353-b4c4-d08b9278a5ac tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.874743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e19b4281-d596-4353-b4c4-d08b9278a5ac tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.876008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e19b4281-d596-4353-b4c4-d08b9278a5ac tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.876469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e19b4281-d596-4353-b4c4-d08b9278a5ac tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.876907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e19b4281-d596-4353-b4c4-d08b9278a5ac tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.907545 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e19b4281-d596-4353-b4c4-d08b9278a5ac tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=n-d-850499-14&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.042171 Oct 04 18:10:53.908755 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1160/2355] 10.222.0.18 () {58 vars in 1196 bytes} [Tue Oct 4 18:10:53 2022] GET /compute/v2.1/os-services?host=n-d-850499-14&binary=xxx => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:53.908755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e958e707-8e0b-4b48-9d99-2cbcd62ed6c3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:53.908755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e958e707-8e0b-4b48-9d99-2cbcd62ed6c3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:53.924150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e958e707-8e0b-4b48-9d99-2cbcd62ed6c3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.924669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e958e707-8e0b-4b48-9d99-2cbcd62ed6c3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.925290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e958e707-8e0b-4b48-9d99-2cbcd62ed6c3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.926008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e958e707-8e0b-4b48-9d99-2cbcd62ed6c3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.926469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e958e707-8e0b-4b48-9d99-2cbcd62ed6c3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.927024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e958e707-8e0b-4b48-9d99-2cbcd62ed6c3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.142468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e958e707-8e0b-4b48-9d99-2cbcd62ed6c3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:54.150696 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e958e707-8e0b-4b48-9d99-2cbcd62ed6c3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1496 microversion: 2.1 time: 0.240871 Oct 04 18:10:54.175224 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1161/2356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:53 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1496 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:54.182280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f2ada809-fd4d-4d29-9084-65ee6c2fdb78 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:54.182863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f2ada809-fd4d-4d29-9084-65ee6c2fdb78 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:54.193938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2ada809-fd4d-4d29-9084-65ee6c2fdb78 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.194723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2ada809-fd4d-4d29-9084-65ee6c2fdb78 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.195395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2ada809-fd4d-4d29-9084-65ee6c2fdb78 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.196480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2ada809-fd4d-4d29-9084-65ee6c2fdb78 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.197102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2ada809-fd4d-4d29-9084-65ee6c2fdb78 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.197692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2ada809-fd4d-4d29-9084-65ee6c2fdb78 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.425374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f2ada809-fd4d-4d29-9084-65ee6c2fdb78 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:54.450495 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f2ada809-fd4d-4d29-9084-65ee6c2fdb78 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1315 microversion: 2.1 time: 0.264232 Oct 04 18:10:54.455029 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1162/2357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:54 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:54.459830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-357c2e63-9bd5-4908-9d39-b80da43fd8db tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:54.464271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357c2e63-9bd5-4908-9d39-b80da43fd8db tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.464773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357c2e63-9bd5-4908-9d39-b80da43fd8db tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.465221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357c2e63-9bd5-4908-9d39-b80da43fd8db tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.466391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357c2e63-9bd5-4908-9d39-b80da43fd8db tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.468881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357c2e63-9bd5-4908-9d39-b80da43fd8db tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.469350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357c2e63-9bd5-4908-9d39-b80da43fd8db tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.495616 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-357c2e63-9bd5-4908-9d39-b80da43fd8db tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.042080 Oct 04 18:10:54.496412 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1163/2358] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:10:54 2022] GET /compute/v2.1/os-services => generated 949 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:54.502069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2faae388-b659-480a-b0d7-e0d58aa96fef tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:54.503035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2faae388-b659-480a-b0d7-e0d58aa96fef tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:54.512320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2faae388-b659-480a-b0d7-e0d58aa96fef tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.513000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2faae388-b659-480a-b0d7-e0d58aa96fef tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.513461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2faae388-b659-480a-b0d7-e0d58aa96fef tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.514304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2faae388-b659-480a-b0d7-e0d58aa96fef tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.514705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2faae388-b659-480a-b0d7-e0d58aa96fef tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.515421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2faae388-b659-480a-b0d7-e0d58aa96fef tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.709819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2faae388-b659-480a-b0d7-e0d58aa96fef tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:54.726825 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2faae388-b659-480a-b0d7-e0d58aa96fef tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1323 microversion: 2.1 time: 0.221378 Oct 04 18:10:54.727579 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1164/2359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:54 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:54.732342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e969d9b3-b1b5-477e-951b-7f082b78a4a6 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:54.733021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e969d9b3-b1b5-477e-951b-7f082b78a4a6 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:54.748675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e969d9b3-b1b5-477e-951b-7f082b78a4a6 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.751429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e969d9b3-b1b5-477e-951b-7f082b78a4a6 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.751887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e969d9b3-b1b5-477e-951b-7f082b78a4a6 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.752638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e969d9b3-b1b5-477e-951b-7f082b78a4a6 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.753116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e969d9b3-b1b5-477e-951b-7f082b78a4a6 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.753553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e969d9b3-b1b5-477e-951b-7f082b78a4a6 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.850811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e969d9b3-b1b5-477e-951b-7f082b78a4a6 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:54.864460 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e969d9b3-b1b5-477e-951b-7f082b78a4a6 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1266 microversion: 2.1 time: 0.135803 Oct 04 18:10:54.865472 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1165/2360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:54 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:54.870769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-60967190-90a7-446c-899d-9fdd47f0c7f9 tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:54.874550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60967190-90a7-446c-899d-9fdd47f0c7f9 tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.875108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60967190-90a7-446c-899d-9fdd47f0c7f9 tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.875726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60967190-90a7-446c-899d-9fdd47f0c7f9 tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.876633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60967190-90a7-446c-899d-9fdd47f0c7f9 tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.877246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60967190-90a7-446c-899d-9fdd47f0c7f9 tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.877929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60967190-90a7-446c-899d-9fdd47f0c7f9 tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.922792 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-60967190-90a7-446c-899d-9fdd47f0c7f9 tempest-ServicesAdminNegativeTestJSON-1885938022 tempest-ServicesAdminNegativeTestJSON-1885938022-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.056177 Oct 04 18:10:54.923469 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1166/2361] 10.222.0.18 () {58 vars in 1198 bytes} [Tue Oct 4 18:10:54 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:55.067364 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-30d3c382-09ce-425c-b71c-047cb642dc9a tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.790849 Oct 04 18:10:55.068160 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1196/2362] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:10:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:55.124081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c305edc-dbf2-4961-a2bf-a4dfc5d8aee9 tempest-ServicesAdminNegativeTestJSON-1061510609 tempest-ServicesAdminNegativeTestJSON-1061510609-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:55.128013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0c305edc-dbf2-4961-a2bf-a4dfc5d8aee9 tempest-ServicesAdminNegativeTestJSON-1061510609 tempest-ServicesAdminNegativeTestJSON-1061510609-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '86cf7e4aa82c4367908afbc13d0aab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e50900bad5407bbfdf6f023bd06150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:55.128968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2031695251", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": "none"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c305edc-dbf2-4961-a2bf-a4dfc5d8aee9 tempest-ServicesAdminNegativeTestJSON-1061510609 tempest-ServicesAdminNegativeTestJSON-1061510609-project] Request method failure captured: Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHcqq3xSNqggrBlK3W3egIGV_j4xBDFO_NNVxj6150w9s1ToaW5pYfpwL1UFpD9iWfpKPg6q0D1_jnTGR06Z6j2hlGHhZ8xynlL-mGe3h11plyCI0-f1rCjQCSd5YwPY_Fz6Ho396VWdyXP20jRbVAtpguyzTm0_bPO54RK2lUvxL9c Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 01e50900bad5407bbfdf6f023bd06150 Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1061510609 Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:10:55.129705 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_01e50900bad5407bbfdf6f023bd06150"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/01e50900bad5407bbfdf6f023bd06150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01e50900bad5407bbfdf6f023bd06150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01e50900bad5407bbfdf6f023bd06150"}]}] Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1061510609 Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 01e50900bad5407bbfdf6f023bd06150 Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1061510609 Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServicesAdminNegativeTestJSON-1061510609-project Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 86cf7e4aa82c4367908afbc13d0aab72 Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1061510609-project Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:10:55.131056 n-d-850499-14 devstack@n-api.service[122331]: action_args: {} Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:10:55.131813 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:10:55.133321 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:10:55.134591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c305edc-dbf2-4961-a2bf-a4dfc5d8aee9 tempest-ServicesAdminNegativeTestJSON-1061510609 tempest-ServicesAdminNegativeTestJSON-1061510609-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:55.134591 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0c305edc-dbf2-4961-a2bf-a4dfc5d8aee9 tempest-ServicesAdminNegativeTestJSON-1061510609 tempest-ServicesAdminNegativeTestJSON-1061510609-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.199308 Oct 04 18:10:55.134591 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1167/2363] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:10:54 2022] GET /compute/v2.1/os-services => generated 112 bytes in 200 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:55.138480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-934aca36-6ab0-48d5-a348-2d6de01df6a6 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Calling method '.version_select at 0x7fd4d1e7edc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:55.211559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:55.211995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:55.212748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:55.213166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:55.213698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:55.224109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.224634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.225075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.225813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.226322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.227168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.251617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Getting quotas for project 293a03b41512449c81f69cffccf59856. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:55.257251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Getting quotas for user 220932b3ec1047a9b77665d684a6db45 and project 293a03b41512449c81f69cffccf59856. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:55.272102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:55.274883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] [instance: 56e5b194-1c46-466b-982f-1e0d0ea5f47b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:55.346027 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a927308c-9002-48ac-a636-78c499b710f3 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.276348 Oct 04 18:10:55.346788 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1197/2364] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 278 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:10:55.373302 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-934aca36-6ab0-48d5-a348-2d6de01df6a6 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/070703a6-f131-4301-9500-5c2528adf70a" status: 200 len: 142 microversion: 2.1 time: 0.240537 Oct 04 18:10:55.374002 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1168/2365] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:10:55 2022] GET /compute/v2.1/os-floating-ips/070703a6-f131-4301-9500-5c2528adf70a => generated 142 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:55.382843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-96dfdff8-be21-40cc-a781-5853ff8e5f3f tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:55.383953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-96dfdff8-be21-40cc-a781-5853ff8e5f3f tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] [instance: 56e5b194-1c46-466b-982f-1e0d0ea5f47b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:55.385753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a803c8a-6fe1-4f90-817f-86c558f5c342 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:55.386860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a803c8a-6fe1-4f90-817f-86c558f5c342 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:55.400315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a803c8a-6fe1-4f90-817f-86c558f5c342 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.400819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a803c8a-6fe1-4f90-817f-86c558f5c342 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.401269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a803c8a-6fe1-4f90-817f-86c558f5c342 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.401973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a803c8a-6fe1-4f90-817f-86c558f5c342 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.407496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a803c8a-6fe1-4f90-817f-86c558f5c342 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.408217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a803c8a-6fe1-4f90-817f-86c558f5c342 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.548812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-96dfdff8-be21-40cc-a781-5853ff8e5f3f tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:55.563758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-96dfdff8-be21-40cc-a781-5853ff8e5f3f tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:55.569350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-96dfdff8-be21-40cc-a781-5853ff8e5f3f tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:55.570657 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-96dfdff8-be21-40cc-a781-5853ff8e5f3f tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] 10.222.0.18 "GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b" status: 200 len: 1281 microversion: 2.47 time: 0.195565 Oct 04 18:10:55.571446 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1169/2366] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:55 2022] GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b => generated 1281 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:55.597997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34c3767f-ecf8-453f-9438-e2b132ac95a5 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Calling method '.version_select at 0x7fd4d1d948b0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:55.859324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a803c8a-6fe1-4f90-817f-86c558f5c342 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:55.889316 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a803c8a-6fe1-4f90-817f-86c558f5c342 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1496 microversion: 2.1 time: 0.535101 Oct 04 18:10:55.892707 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1198/2367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:55 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1496 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:55.904382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1806a7c-2dfe-4206-8751-87070bf29b59 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:55.905289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b1806a7c-2dfe-4206-8751-87070bf29b59 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:55.918509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1806a7c-2dfe-4206-8751-87070bf29b59 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.919033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1806a7c-2dfe-4206-8751-87070bf29b59 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.923528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1806a7c-2dfe-4206-8751-87070bf29b59 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.924328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1806a7c-2dfe-4206-8751-87070bf29b59 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.924807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1806a7c-2dfe-4206-8751-87070bf29b59 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.925538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1806a7c-2dfe-4206-8751-87070bf29b59 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:56.305954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b1806a7c-2dfe-4206-8751-87070bf29b59 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:56.316216 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b1806a7c-2dfe-4206-8751-87070bf29b59 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1501 microversion: 2.1 time: 0.422146 Oct 04 18:10:56.339149 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1199/2368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:55 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1501 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:56.348572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-878c4b35-1134-4372-8ff9-90881992da96 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:56.349415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-878c4b35-1134-4372-8ff9-90881992da96 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:56.356802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-878c4b35-1134-4372-8ff9-90881992da96 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:56.357217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-878c4b35-1134-4372-8ff9-90881992da96 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:56.358648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-878c4b35-1134-4372-8ff9-90881992da96 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:56.359661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-878c4b35-1134-4372-8ff9-90881992da96 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:56.360316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-878c4b35-1134-4372-8ff9-90881992da96 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:56.361141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-878c4b35-1134-4372-8ff9-90881992da96 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:56.683841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-878c4b35-1134-4372-8ff9-90881992da96 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:56.698554 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-878c4b35-1134-4372-8ff9-90881992da96 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 200 len: 1518 microversion: 2.1 time: 0.357833 Oct 04 18:10:56.699944 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1200/2369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:56 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 1518 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:56.705401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00d5ff04-d603-4a62-a723-258f50299400 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:56.706094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00d5ff04-d603-4a62-a723-258f50299400 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:56.725660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00d5ff04-d603-4a62-a723-258f50299400 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:56.726418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00d5ff04-d603-4a62-a723-258f50299400 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:56.727438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00d5ff04-d603-4a62-a723-258f50299400 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:56.728324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00d5ff04-d603-4a62-a723-258f50299400 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:56.729434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00d5ff04-d603-4a62-a723-258f50299400 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:56.730100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00d5ff04-d603-4a62-a723-258f50299400 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:56.923148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00d5ff04-d603-4a62-a723-258f50299400 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:56.935964 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00d5ff04-d603-4a62-a723-258f50299400 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1272 microversion: 2.1 time: 0.234618 Oct 04 18:10:56.937430 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1201/2370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:56 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:56.944526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e401ec39-9f24-4aaa-b977-264e78b49d71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:56.945366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e401ec39-9f24-4aaa-b977-264e78b49d71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:56.955339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e401ec39-9f24-4aaa-b977-264e78b49d71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:56.956302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e401ec39-9f24-4aaa-b977-264e78b49d71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:56.957684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e401ec39-9f24-4aaa-b977-264e78b49d71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:56.958889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e401ec39-9f24-4aaa-b977-264e78b49d71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:56.959680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e401ec39-9f24-4aaa-b977-264e78b49d71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:56.960943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e401ec39-9f24-4aaa-b977-264e78b49d71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:56.978110 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34c3767f-ecf8-453f-9438-e2b132ac95a5 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/070703a6-f131-4301-9500-5c2528adf70a" status: 202 len: 0 microversion: 2.1 time: 1.405051 Oct 04 18:10:56.980919 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1170/2371] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:10:55 2022] DELETE /compute/v2.1/os-floating-ips/070703a6-f131-4301-9500-5c2528adf70a => generated 0 bytes in 1408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:10:57.011683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:57.015092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] [instance: 56e5b194-1c46-466b-982f-1e0d0ea5f47b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:57.044334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.047563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.051478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.055886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.057090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.058216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.104210 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e401ec39-9f24-4aaa-b977-264e78b49d71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13/action" status: 202 len: 0 microversion: 2.1 time: 0.164362 Oct 04 18:10:57.105182 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1202/2372] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:56 2022] POST /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:10:57.121365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.161"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:57.129404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:57.141235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.145127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.147135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.150507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.151618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.152851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.240187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "refresh_cache-5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:10:57.240599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquired lock "refresh_cache-5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:10:57.330682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:57.708917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:57.740038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:57.744155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:57.747128 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45b69b77-a38f-4b58-84a5-15bc6d3e843b tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] 10.222.0.18 "GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b" status: 200 len: 1341 microversion: 2.47 time: 0.763371 Oct 04 18:10:57.764377 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1171/2373] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:56 2022] GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b => generated 1341 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:57.801003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6fd6ccfa-3d66-4c03-8d16-3ad47d6abe64 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:57.802869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6fd6ccfa-3d66-4c03-8d16-3ad47d6abe64 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:57.819130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fd6ccfa-3d66-4c03-8d16-3ad47d6abe64 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.820468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fd6ccfa-3d66-4c03-8d16-3ad47d6abe64 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.821548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fd6ccfa-3d66-4c03-8d16-3ad47d6abe64 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.823208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fd6ccfa-3d66-4c03-8d16-3ad47d6abe64 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.824359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fd6ccfa-3d66-4c03-8d16-3ad47d6abe64 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.826565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fd6ccfa-3d66-4c03-8d16-3ad47d6abe64 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:58.448520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6fd6ccfa-3d66-4c03-8d16-3ad47d6abe64 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:58.459305 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6fd6ccfa-3d66-4c03-8d16-3ad47d6abe64 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 200 len: 1479 microversion: 2.1 time: 0.692278 Oct 04 18:10:58.461271 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1172/2374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:57 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 1479 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:58.466269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ef9f2ad-afda-4754-8853-42cf6aedc548 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Calling method '.version_select at 0x7fd4d61db160>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:58.864723 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ef9f2ad-afda-4754-8853-42cf6aedc548 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.402060 Oct 04 18:10:58.865307 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1173/2375] 10.222.0.18 () {58 vars in 1164 bytes} [Tue Oct 4 18:10:58 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:58.872692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd0b5176-2fd0-4510-aa12-adf5cb0baa4e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:58.873716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd0b5176-2fd0-4510-aa12-adf5cb0baa4e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:58.880986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b5176-2fd0-4510-aa12-adf5cb0baa4e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:58.881722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b5176-2fd0-4510-aa12-adf5cb0baa4e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:58.882333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b5176-2fd0-4510-aa12-adf5cb0baa4e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:58.883239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b5176-2fd0-4510-aa12-adf5cb0baa4e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:58.883708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b5176-2fd0-4510-aa12-adf5cb0baa4e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:58.884142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b5176-2fd0-4510-aa12-adf5cb0baa4e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.240960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fd0b5176-2fd0-4510-aa12-adf5cb0baa4e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:59.253813 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd0b5176-2fd0-4510-aa12-adf5cb0baa4e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1486 microversion: 2.1 time: 0.387193 Oct 04 18:10:59.254589 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1174/2376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:58 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1486 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:59.259731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3eaf6e1a-7445-4888-803a-2fb131fc9855 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:59.260537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3eaf6e1a-7445-4888-803a-2fb131fc9855 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:59.269166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eaf6e1a-7445-4888-803a-2fb131fc9855 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.270275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eaf6e1a-7445-4888-803a-2fb131fc9855 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.270275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eaf6e1a-7445-4888-803a-2fb131fc9855 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.271234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eaf6e1a-7445-4888-803a-2fb131fc9855 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.271881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eaf6e1a-7445-4888-803a-2fb131fc9855 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.272523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eaf6e1a-7445-4888-803a-2fb131fc9855 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.586946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3eaf6e1a-7445-4888-803a-2fb131fc9855 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:59.595127 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3eaf6e1a-7445-4888-803a-2fb131fc9855 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1314 microversion: 2.1 time: 0.339648 Oct 04 18:10:59.595821 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1175/2377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:59 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:59.600391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ae187089-63b2-4f19-b01d-3ffd88df8d4a req-c173d775-e4e8-46c3-868e-3611ae8b0b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0121e319-5427-4e22-a36e-27be74f9d945", "tag": "ce19af49-3750-4aa6-b309-5929000fd198"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:59.610571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ae187089-63b2-4f19-b01d-3ffd88df8d4a req-c173d775-e4e8-46c3-868e-3611ae8b0b4c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.611092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ae187089-63b2-4f19-b01d-3ffd88df8d4a req-c173d775-e4e8-46c3-868e-3611ae8b0b4c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.611529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ae187089-63b2-4f19-b01d-3ffd88df8d4a req-c173d775-e4e8-46c3-868e-3611ae8b0b4c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.623202 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ae187089-63b2-4f19-b01d-3ffd88df8d4a req-c173d775-e4e8-46c3-868e-3611ae8b0b4c service nova] Creating event network-changed:ce19af49-3750-4aa6-b309-5929000fd198 for instance 0121e319-5427-4e22-a36e-27be74f9d945 on n-h2-850499-14 Oct 04 18:10:59.628642 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ae187089-63b2-4f19-b01d-3ffd88df8d4a req-c173d775-e4e8-46c3-868e-3611ae8b0b4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031642 Oct 04 18:10:59.629239 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1176/2378] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:59.637699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-432bafcd-ffab-4895-b4c1-25f05f848879 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1040777346"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:59.640257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-432bafcd-ffab-4895-b4c1-25f05f848879 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:59.647829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-432bafcd-ffab-4895-b4c1-25f05f848879 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.648456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-432bafcd-ffab-4895-b4c1-25f05f848879 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.648968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-432bafcd-ffab-4895-b4c1-25f05f848879 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.650109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-432bafcd-ffab-4895-b4c1-25f05f848879 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.650738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-432bafcd-ffab-4895-b4c1-25f05f848879 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.651337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-432bafcd-ffab-4895-b4c1-25f05f848879 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.866796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Building network info cache for instance {{(pid=122332) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:10:59.891080 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-432bafcd-ffab-4895-b4c1-25f05f848879 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79/action" status: 202 len: 0 microversion: 2.1 time: 0.257233 Oct 04 18:10:59.891750 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1177/2379] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:59 2022] POST /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:10:59.897105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:59.898048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] [instance: 56e5b194-1c46-466b-982f-1e0d0ea5f47b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:59.904798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.905539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.906014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.906718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.907201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.907628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:00.028596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:00.050220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:00.052132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:00.053547 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b200349f-017c-402b-ae41-28fbfb529746 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] 10.222.0.18 "GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b" status: 200 len: 1339 microversion: 2.47 time: 0.160484 Oct 04 18:11:00.054164 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1178/2380] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:59 2022] GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b => generated 1339 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:00.078488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-599c79ee-aab7-402c-bffa-17e464acc3c7 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Calling method '.version_select at 0x7fd4d61c6670>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:00.875963 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-599c79ee-aab7-402c-bffa-17e464acc3c7 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.806886 Oct 04 18:11:00.885830 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1179/2381] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:11:00 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:00.891446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dd9864f0-81cc-4cd8-ae89-c521c4a9dd9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:00.891970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dd9864f0-81cc-4cd8-ae89-c521c4a9dd9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:00.902095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd9864f0-81cc-4cd8-ae89-c521c4a9dd9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:00.902767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd9864f0-81cc-4cd8-ae89-c521c4a9dd9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:00.903322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd9864f0-81cc-4cd8-ae89-c521c4a9dd9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:00.904322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd9864f0-81cc-4cd8-ae89-c521c4a9dd9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:00.904869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd9864f0-81cc-4cd8-ae89-c521c4a9dd9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:00.905390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd9864f0-81cc-4cd8-ae89-c521c4a9dd9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:00.933993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dd9864f0-81cc-4cd8-ae89-c521c4a9dd9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:01.026183 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dd9864f0-81cc-4cd8-ae89-c521c4a9dd9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 204 len: 0 microversion: 2.1 time: 0.138898 Oct 04 18:11:01.027292 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1180/2382] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:00 2022] DELETE /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:01.155057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1bbe8d37-2cce-44db-88ae-0261a5e0edb4 tempest-AZV2TestJSON-647754291 tempest-AZV2TestJSON-647754291-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.157170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1bbe8d37-2cce-44db-88ae-0261a5e0edb4 tempest-AZV2TestJSON-647754291 tempest-AZV2TestJSON-647754291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.157695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1bbe8d37-2cce-44db-88ae-0261a5e0edb4 tempest-AZV2TestJSON-647754291 tempest-AZV2TestJSON-647754291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.158163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1bbe8d37-2cce-44db-88ae-0261a5e0edb4 tempest-AZV2TestJSON-647754291 tempest-AZV2TestJSON-647754291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.158903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1bbe8d37-2cce-44db-88ae-0261a5e0edb4 tempest-AZV2TestJSON-647754291 tempest-AZV2TestJSON-647754291-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.159395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1bbe8d37-2cce-44db-88ae-0261a5e0edb4 tempest-AZV2TestJSON-647754291 tempest-AZV2TestJSON-647754291-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.159834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1bbe8d37-2cce-44db-88ae-0261a5e0edb4 tempest-AZV2TestJSON-647754291 tempest-AZV2TestJSON-647754291-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.164079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Updating instance_info_cache with network_info: [{"id": "6edb64f1-120e-4ab2-81b6-c49027ad6cca", "address": "fa:16:3e:00:2e:e0", "network": {"id": "61d1d0bf-30e4-4740-8b71-20dd29f08efb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-462894479-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "197a6854a6a949b88eae7d185688d461", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6edb64f1-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122332) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:11:01.177161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Releasing lock "refresh_cache-5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:11:01.178211 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4d386681-7961-47e8-b65d-6df3782f7d33 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "POST /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a/action" status: 202 len: 0 microversion: 2.1 time: 4.071230 Oct 04 18:11:01.178943 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1203/2383] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:57 2022] POST /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a/action => generated 0 bytes in 4073 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:11:01.185287 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1bbe8d37-2cce-44db-88ae-0261a5e0edb4 tempest-AZV2TestJSON-647754291 tempest-AZV2TestJSON-647754291-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.156285 Oct 04 18:11:01.185874 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1181/2384] 10.222.0.18 () {58 vars in 1164 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:11:01.186067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-0c7f5cb2-0ed2-482d-8d81-ee6c022fff5a req-3051cc41-945d-4bf9-b4d9-056a592c09ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f64a66b-6e31-45ef-a711-60c9e8f0ec3a", "tag": "6edb64f1-120e-4ab2-81b6-c49027ad6cca"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:01.191930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1da5668f-9001-402d-b920-9d83d273536f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61c6430>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.196565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0c7f5cb2-0ed2-482d-8d81-ee6c022fff5a req-3051cc41-945d-4bf9-b4d9-056a592c09ca service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.197123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0c7f5cb2-0ed2-482d-8d81-ee6c022fff5a req-3051cc41-945d-4bf9-b4d9-056a592c09ca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.197626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0c7f5cb2-0ed2-482d-8d81-ee6c022fff5a req-3051cc41-945d-4bf9-b4d9-056a592c09ca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.209981 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-0c7f5cb2-0ed2-482d-8d81-ee6c022fff5a req-3051cc41-945d-4bf9-b4d9-056a592c09ca service nova] Creating event network-changed:6edb64f1-120e-4ab2-81b6-c49027ad6cca for instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a on n-h2-850499-14 Oct 04 18:11:01.215196 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-0c7f5cb2-0ed2-482d-8d81-ee6c022fff5a req-3051cc41-945d-4bf9-b4d9-056a592c09ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034791 Oct 04 18:11:01.216023 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1204/2385] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:01.221979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5e478dd4-08e8-4fea-9bcc-7de841e0531f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.222682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5e478dd4-08e8-4fea-9bcc-7de841e0531f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:01.229114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e478dd4-08e8-4fea-9bcc-7de841e0531f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.229614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e478dd4-08e8-4fea-9bcc-7de841e0531f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.230117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e478dd4-08e8-4fea-9bcc-7de841e0531f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.230828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e478dd4-08e8-4fea-9bcc-7de841e0531f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.231311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e478dd4-08e8-4fea-9bcc-7de841e0531f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.231735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e478dd4-08e8-4fea-9bcc-7de841e0531f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.252464 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1da5668f-9001-402d-b920-9d83d273536f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1438 microversion: 2.1 time: 0.065531 Oct 04 18:11:01.253331 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1182/2386] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:01.257845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-19551bc9-895c-4cf4-973e-1ee9a632e91a tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Calling method '.version_select at 0x7fd4d18b8ca0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.617550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5e478dd4-08e8-4fea-9bcc-7de841e0531f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:01.628483 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5e478dd4-08e8-4fea-9bcc-7de841e0531f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1314 microversion: 2.1 time: 0.410904 Oct 04 18:11:01.629326 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1205/2387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:01.639772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a53a390-eec2-4b54-ab52-09b9b4e47f75 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.641279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4a53a390-eec2-4b54-ab52-09b9b4e47f75 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:01.649218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a53a390-eec2-4b54-ab52-09b9b4e47f75 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.650002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a53a390-eec2-4b54-ab52-09b9b4e47f75 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.650762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a53a390-eec2-4b54-ab52-09b9b4e47f75 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.651642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a53a390-eec2-4b54-ab52-09b9b4e47f75 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.652031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a53a390-eec2-4b54-ab52-09b9b4e47f75 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.652458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a53a390-eec2-4b54-ab52-09b9b4e47f75 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.954178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4a53a390-eec2-4b54-ab52-09b9b4e47f75 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:01.962662 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4a53a390-eec2-4b54-ab52-09b9b4e47f75 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1492 microversion: 2.1 time: 0.328626 Oct 04 18:11:01.963578 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1206/2388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1492 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:01.968970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.969726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] [instance: 56e5b194-1c46-466b-982f-1e0d0ea5f47b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:01.976814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.977469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.977913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.978829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.979853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.980431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:02.106069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:02.121062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:02.121062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:02.121062 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d54b7bf-353f-4d22-8443-5f460405f1ea tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] 10.222.0.18 "GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b" status: 200 len: 1360 microversion: 2.47 time: 0.153204 Oct 04 18:11:02.127531 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1207/2389] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:02.144286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.161"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:02.146814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:02.153250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:02.153661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:02.154098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:02.154905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:02.155399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:02.156110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:02.184341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "refresh_cache-ad8ca046-dc23-46f1-85e5-ba07d44234c6" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:11:02.184977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquired lock "refresh_cache-ad8ca046-dc23-46f1-85e5-ba07d44234c6" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:11:02.377642 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-19551bc9-895c-4cf4-973e-1ee9a632e91a tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/3366c305-0b00-4f77-8883-d63c42b5eb49" status: 202 len: 0 microversion: 2.1 time: 1.123302 Oct 04 18:11:02.378582 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1183/2390] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:11:01 2022] DELETE /compute/v2.1/os-floating-ips/3366c305-0b00-4f77-8883-d63c42b5eb49 => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:11:02.393257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be572fba-6c68-4d29-8a31-1bccbd02c2b8 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-991015962"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:02.396609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be572fba-6c68-4d29-8a31-1bccbd02c2b8 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] [instance: 56e5b194-1c46-466b-982f-1e0d0ea5f47b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:02.405651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be572fba-6c68-4d29-8a31-1bccbd02c2b8 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:02.407427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be572fba-6c68-4d29-8a31-1bccbd02c2b8 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:02.408054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be572fba-6c68-4d29-8a31-1bccbd02c2b8 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:02.409038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be572fba-6c68-4d29-8a31-1bccbd02c2b8 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:02.409492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be572fba-6c68-4d29-8a31-1bccbd02c2b8 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:02.410088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be572fba-6c68-4d29-8a31-1bccbd02c2b8 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:02.631683 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be572fba-6c68-4d29-8a31-1bccbd02c2b8 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] 10.222.0.18 "POST /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b/action" status: 202 len: 52 microversion: 2.47 time: 0.247868 Oct 04 18:11:02.631683 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1184/2391] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:11:02 2022] POST /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b/action => generated 52 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:11:02.634784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b3814a00-e683-4768-96d8-4b9cabf17475 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d2193a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:02.690446 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b3814a00-e683-4768-96d8-4b9cabf17475 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1438 microversion: 2.1 time: 0.059849 Oct 04 18:11:02.691610 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1185/2392] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:02 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1438 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:02.696451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6c212f5a-a90f-40d5-930d-28b19bcb33bc tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Calling method '.version_select at 0x7fd4d61dbd30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:04.879788 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6c212f5a-a90f-40d5-930d-28b19bcb33bc tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/f05c013c-2404-4bbc-b300-249bcef46c27" status: 202 len: 0 microversion: 2.1 time: 2.186457 Oct 04 18:11:04.881076 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1186/2393] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:11:02 2022] DELETE /compute/v2.1/os-floating-ips/f05c013c-2404-4bbc-b300-249bcef46c27 => generated 0 bytes in 2189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:11:04.900694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-920c6364-39a1-47e9-b125-2b6a195ef449 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:04.908756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-920c6364-39a1-47e9-b125-2b6a195ef449 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] [instance: 56e5b194-1c46-466b-982f-1e0d0ea5f47b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:04.943556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-920c6364-39a1-47e9-b125-2b6a195ef449 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.944824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-920c6364-39a1-47e9-b125-2b6a195ef449 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.945880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-920c6364-39a1-47e9-b125-2b6a195ef449 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:04.947968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-920c6364-39a1-47e9-b125-2b6a195ef449 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.949207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-920c6364-39a1-47e9-b125-2b6a195ef449 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.950388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-920c6364-39a1-47e9-b125-2b6a195ef449 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:05.038947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-920c6364-39a1-47e9-b125-2b6a195ef449 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] [instance: 56e5b194-1c46-466b-982f-1e0d0ea5f47b] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:05.235711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:05.264748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:05.294006 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-920c6364-39a1-47e9-b125-2b6a195ef449 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] 10.222.0.18 "DELETE /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b" status: 204 len: 0 microversion: 2.47 time: 0.410860 Oct 04 18:11:05.294905 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1187/2394] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:11:04 2022] DELETE /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:11:05.316277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9699671c-293c-481b-92e2-5673e4c92f9b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:05.318723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9699671c-293c-481b-92e2-5673e4c92f9b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:05.326140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9699671c-293c-481b-92e2-5673e4c92f9b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:05.327079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9699671c-293c-481b-92e2-5673e4c92f9b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:05.328422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9699671c-293c-481b-92e2-5673e4c92f9b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:05.329576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9699671c-293c-481b-92e2-5673e4c92f9b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:05.330201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9699671c-293c-481b-92e2-5673e4c92f9b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:05.330789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9699671c-293c-481b-92e2-5673e4c92f9b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:05.557586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:06.295302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9699671c-293c-481b-92e2-5673e4c92f9b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:06.311429 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9699671c-293c-481b-92e2-5673e4c92f9b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1314 microversion: 2.1 time: 1.014430 Oct 04 18:11:06.312778 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1188/2395] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:05 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1314 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:06.339187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3713c6d8-8d8c-46e7-9a8b-0f7d99541d95 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:06.340119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3713c6d8-8d8c-46e7-9a8b-0f7d99541d95 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:06.358319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3713c6d8-8d8c-46e7-9a8b-0f7d99541d95 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:06.359104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3713c6d8-8d8c-46e7-9a8b-0f7d99541d95 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:06.368463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3713c6d8-8d8c-46e7-9a8b-0f7d99541d95 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:06.369304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3713c6d8-8d8c-46e7-9a8b-0f7d99541d95 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:06.369852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3713c6d8-8d8c-46e7-9a8b-0f7d99541d95 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:06.370354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3713c6d8-8d8c-46e7-9a8b-0f7d99541d95 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:06.415002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:06.804477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3713c6d8-8d8c-46e7-9a8b-0f7d99541d95 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:06.812786 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3713c6d8-8d8c-46e7-9a8b-0f7d99541d95 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 200 len: 1492 microversion: 2.1 time: 0.484117 Oct 04 18:11:06.818422 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1189/2396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:06 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 1492 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:06.830053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca05f26d-cd22-40e4-9104-983d117b1949 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d611a160>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:06.901250 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca05f26d-cd22-40e4-9104-983d117b1949 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1438 microversion: 2.1 time: 0.081321 Oct 04 18:11:06.901850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1190/2397] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:06 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1438 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:06.906845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5b18b39-9d6d-469b-98b8-15f8dc006c87 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] Calling method '.version_select at 0x7fd4d611c160>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:07.158390 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.network.neutron [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] re-assign floating IP 172.25.4.161 from instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a Oct 04 18:11:07.162383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:07.275705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Building network info cache for instance {{(pid=122332) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:11:09.531773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Updating instance_info_cache with network_info: [{"id": "6edb64f1-120e-4ab2-81b6-c49027ad6cca", "address": "fa:16:3e:00:2e:e0", "network": {"id": "61d1d0bf-30e4-4740-8b71-20dd29f08efb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-462894479-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "197a6854a6a949b88eae7d185688d461", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6edb64f1-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122332) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:11:09.541224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Building network info cache for instance {{(pid=122332) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:11:10.138688 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a5b18b39-9d6d-469b-98b8-15f8dc006c87 tempest-FloatingIPDetailsTestJSON-755423367 tempest-FloatingIPDetailsTestJSON-755423367-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/428b07a1-be88-4a7e-913a-4dc65e96bd28" status: 202 len: 0 microversion: 2.1 time: 3.235488 Oct 04 18:11:10.145303 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1191/2398] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:11:06 2022] DELETE /compute/v2.1/os-floating-ips/428b07a1-be88-4a7e-913a-4dc65e96bd28 => generated 0 bytes in 3243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:11:10.170289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:10.174255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] [instance: 56e5b194-1c46-466b-982f-1e0d0ea5f47b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:10.194198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:10.195225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:10.195877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:10.197146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:10.197863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:10.198572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:10.389670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:10.393366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:10.394108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:10.395791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lazy-loading 'fault' on Instance uuid 56e5b194-1c46-466b-982f-1e0d0ea5f47b {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:11.166373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=14 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:11.321468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:11.335233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:11.336778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220932b3ec1047a9b77665d684a6db45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293a03b41512449c81f69cffccf59856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:11.344297 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8189ca6b-d407-4194-8363-5b8a55fd0568 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] 10.222.0.18 "GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b" status: 200 len: 1371 microversion: 2.47 time: 1.193094 Oct 04 18:11:11.348008 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1192/2399] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:10 2022] GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b => generated 1371 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:11.372462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c43c6a49-868e-44bf-b723-6bb26c191834 req-36d2d830-7315-4077-a44e-9cb38989c3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785194b8-dcad-4490-9f2a-e62dcf5afe79", "name": "network-vif-plugged", "status": "completed", "tag": "a1297b31-1254-4f09-b9cc-b8acb3985f3d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:11.393607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c43c6a49-868e-44bf-b723-6bb26c191834 req-36d2d830-7315-4077-a44e-9cb38989c3ef service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:11.394102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c43c6a49-868e-44bf-b723-6bb26c191834 req-36d2d830-7315-4077-a44e-9cb38989c3ef service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:11.394543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c43c6a49-868e-44bf-b723-6bb26c191834 req-36d2d830-7315-4077-a44e-9cb38989c3ef service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:11.471629 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c43c6a49-868e-44bf-b723-6bb26c191834 req-36d2d830-7315-4077-a44e-9cb38989c3ef service nova] Creating event network-vif-plugged:a1297b31-1254-4f09-b9cc-b8acb3985f3d for instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 on n-h1-850499-14 Oct 04 18:11:11.493984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c43c6a49-868e-44bf-b723-6bb26c191834 req-36d2d830-7315-4077-a44e-9cb38989c3ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139323 Oct 04 18:11:11.494678 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1193/2400] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:11.521867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-af1ae602-e55b-4835-9bf5-3104bbd56d8d req-1492878d-9f99-4958-9896-927c49d68f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f64a66b-6e31-45ef-a711-60c9e8f0ec3a", "tag": "6edb64f1-120e-4ab2-81b6-c49027ad6cca"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:11.572587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af1ae602-e55b-4835-9bf5-3104bbd56d8d req-1492878d-9f99-4958-9896-927c49d68f56 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:11.577452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af1ae602-e55b-4835-9bf5-3104bbd56d8d req-1492878d-9f99-4958-9896-927c49d68f56 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:11.581761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af1ae602-e55b-4835-9bf5-3104bbd56d8d req-1492878d-9f99-4958-9896-927c49d68f56 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:11.644832 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-af1ae602-e55b-4835-9bf5-3104bbd56d8d req-1492878d-9f99-4958-9896-927c49d68f56 service nova] Creating event network-changed:6edb64f1-120e-4ab2-81b6-c49027ad6cca for instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a on n-h2-850499-14 Oct 04 18:11:11.716106 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-af1ae602-e55b-4835-9bf5-3104bbd56d8d req-1492878d-9f99-4958-9896-927c49d68f56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210081 Oct 04 18:11:11.723708 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1194/2401] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:11.759603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-553e3e1a-87ac-4c37-b898-96465823941a tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:11.761976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-553e3e1a-87ac-4c37-b898-96465823941a tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:11.784560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:11.788556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553e3e1a-87ac-4c37-b898-96465823941a tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:11.809339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553e3e1a-87ac-4c37-b898-96465823941a tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:11.828582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553e3e1a-87ac-4c37-b898-96465823941a tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:11.840821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553e3e1a-87ac-4c37-b898-96465823941a tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:11.842929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553e3e1a-87ac-4c37-b898-96465823941a tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:11.844048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553e3e1a-87ac-4c37-b898-96465823941a tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:12.150986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:12.855847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-553e3e1a-87ac-4c37-b898-96465823941a tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:12.885077 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-553e3e1a-87ac-4c37-b898-96465823941a tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1314 microversion: 2.1 time: 1.159597 Oct 04 18:11:12.886025 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1195/2402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:11 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1314 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:12.895710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:12.899862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:12.925481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:12.926003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:12.926458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:12.927225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:12.927692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:12.928122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:12.982665 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 HTTP/1.1 Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:11:12.984973 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:11:12.987480 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '9e3c972a-93d9-42f4-a3ee-840fc973de13'} Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:12.988359 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:11:12.990708 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:11:12.992904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:12.992904 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b4f165eb-d869-49cb-80c4-255a43535f79 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 404 len: 111 microversion: 2.1 time: 0.099447 Oct 04 18:11:12.997701 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1196/2403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:12 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:11:13.017551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6219a99-f1af-423e-a1c9-17506fa3ed91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1d0bc10>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:13.158302 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6219a99-f1af-423e-a1c9-17506fa3ed91 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1438 microversion: 2.1 time: 0.159261 Oct 04 18:11:13.158816 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1197/2404] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:12 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1438 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:13.198823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:13.199815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] [instance: 56e5b194-1c46-466b-982f-1e0d0ea5f47b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:13.230811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.231802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.237989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.239752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.240408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.243590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.288116 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] HTTP exception thrown: Instance 56e5b194-1c46-466b-982f-1e0d0ea5f47b could not be found. Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Request method failure captured: Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b HTTP/1.1 Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHcu7iJu6_2jMTBb2FxduM142Yi5HUrfxhwY3KG39jSIGTGNj3uY5wc_tT3SUB35umV_nkZ6usuzbqi57w_I3HP6PHx0xn_TOYXC3s-8NoksDfDKHSt7BAAHSKPhjPcKyv9EkUmBSqWtF6SIXZY0fQ4b-ldzxxEgn3Xfhd8HsgENtqA Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 293a03b41512449c81f69cffccf59856 Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersAaction247Test-1021236652 Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:11:13.290341 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_293a03b41512449c81f69cffccf59856"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/293a03b41512449c81f69cffccf59856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/293a03b41512449c81f69cffccf59856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/293a03b41512449c81f69cffccf59856"}]}] Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersAaction247Test-1021236652 Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 293a03b41512449c81f69cffccf59856 Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersAaction247Test-1021236652 Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersAaction247Test-1021236652-project Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 220932b3ec1047a9b77665d684a6db45 Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersAaction247Test-1021236652-project Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 56e5b194-1c46-466b-982f-1e0d0ea5f47b could not be found. Oct 04 18:11:13.291816 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '56e5b194-1c46-466b-982f-1e0d0ea5f47b'} Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e5b194-1c46-466b-982f-1e0d0ea5f47b could not be found. Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:13.292923 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e5b194-1c46-466b-982f-1e0d0ea5f47b could not be found. Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e5b194-1c46-466b-982f-1e0d0ea5f47b could not be found. Oct 04 18:11:13.294228 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.297753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] Returning 404 to user: Instance 56e5b194-1c46-466b-982f-1e0d0ea5f47b could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:13.300892 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8cfc8d91-4e5f-4b11-9316-4e25768c1e83 tempest-ServersAaction247Test-1021236652 tempest-ServersAaction247Test-1021236652-project] 10.222.0.18 "GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b" status: 404 len: 111 microversion: 2.47 time: 0.134465 Oct 04 18:11:13.302237 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1198/2405] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:13 2022] GET /compute/v2.1/servers/56e5b194-1c46-466b-982f-1e0d0ea5f47b => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:11:13.309103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-148949478", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "3460d6d9-0801-4482-b14b-54fef623a1ce"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:13.400967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] validate_networks() for [('3460d6d9-0801-4482-b14b-54fef623a1ce', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:13.604613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Updating instance_info_cache with network_info: [{"id": "219231f1-3c0d-49e8-8810-cf7c3110a792", "address": "fa:16:3e:38:32:22", "network": {"id": "61d1d0bf-30e4-4740-8b71-20dd29f08efb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-462894479-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "197a6854a6a949b88eae7d185688d461", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap219231f1-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122332) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:11:13.622686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Releasing lock "refresh_cache-ad8ca046-dc23-46f1-85e5-ba07d44234c6" {{(pid=122332) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:11:13.624165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5421a978-2b76-4b3b-bbad-0eb4a030dd7b tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "POST /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6/action" status: 202 len: 0 microversion: 2.1 time: 11.495499 Oct 04 18:11:13.626570 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1208/2406] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:02 2022] POST /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6/action => generated 0 bytes in 11498 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:11:13.638373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c8652aad-fb19-4b7d-b388-e436c6c9c7d0 req-d2832685-a0e6-4f9c-8aa3-52a65e4e06e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0121e319-5427-4e22-a36e-27be74f9d945", "name": "network-vif-plugged", "status": "completed", "tag": "ce19af49-3750-4aa6-b309-5929000fd198"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:13.662486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c8652aad-fb19-4b7d-b388-e436c6c9c7d0 req-d2832685-a0e6-4f9c-8aa3-52a65e4e06e4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.665264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c8652aad-fb19-4b7d-b388-e436c6c9c7d0 req-d2832685-a0e6-4f9c-8aa3-52a65e4e06e4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.665905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c8652aad-fb19-4b7d-b388-e436c6c9c7d0 req-d2832685-a0e6-4f9c-8aa3-52a65e4e06e4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.705291 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c8652aad-fb19-4b7d-b388-e436c6c9c7d0 req-d2832685-a0e6-4f9c-8aa3-52a65e4e06e4 service nova] Creating event network-vif-plugged:ce19af49-3750-4aa6-b309-5929000fd198 for instance 0121e319-5427-4e22-a36e-27be74f9d945 on n-h2-850499-14 Oct 04 18:11:13.712763 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c8652aad-fb19-4b7d-b388-e436c6c9c7d0 req-d2832685-a0e6-4f9c-8aa3-52a65e4e06e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083855 Oct 04 18:11:13.719891 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1209/2407] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:13.738812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.161"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:14.808265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:14.829511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:14.835965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:14.837157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:14.838079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:14.838696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:14.839314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.592006 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] HTTP exception thrown: Floating IP 172.25.4.161 is not associated with instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a. Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Request method failure captured: Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a/action HTTP/1.1 Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 49 Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHb0Xn7O2H6qtWWRuyDzvAKvx9j2BBsecM5YL-vT2VmKZgbleT4kF7Ybj2sDjOzQJGPTuyRCbCXf1HQe2ikt4bGDdzRj8xKxKM6YZ6BGpvaxzlSzP0Vk08g4E5getivDlICenHvt6A90eSrFgvNIap_Isrrybp6zLxTiYvCyzqakN6o Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 197a6854a6a949b88eae7d185688d461 Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:11:15.593877 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_197a6854a6a949b88eae7d185688d461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/197a6854a6a949b88eae7d185688d461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/197a6854a6a949b88eae7d185688d461"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/197a6854a6a949b88eae7d185688d461"}]}] Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 197a6854a6a949b88eae7d185688d461 Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FloatingIPsAssociationTestJSON-1004452683-project Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: aa469d1847b5434eaa545db65834a323 Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1004452683-project Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: {"removeFloatingIp": {"address": "172.25.4.161"}} Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:11:15.595160 n-d-850499-14 devstack@n-api.service[122332]: exception: Floating IP 172.25.4.161 is not associated with instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a. Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '5f64a66b-6e31-45ef-a711-60c9e8f0ec3a', 'body': {'removeFloatingIp': {'address': '172.25.4.161'}}} Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.161 is not associated with instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a. Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:15.595902 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:15.597007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:15.597007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:15.597007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:15.597007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:15.597007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.161 is not associated with instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a. Oct 04 18:11:15.597007 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:15.598411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Returning 409 to user: Floating IP 172.25.4.161 is not associated with instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:15.599799 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0f5fe162-d233-48c0-83e0-026cda95c4f4 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "POST /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a/action" status: 409 len: 146 microversion: 2.1 time: 1.875778 Oct 04 18:11:15.600567 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1210/2408] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:13 2022] POST /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a/action => generated 146 bytes in 1879 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:11:15.615624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-2e89a8f3-0d3e-4d1c-8818-a4c9edbde98c req-6836401d-6281-40b0-8307-75384a6eac9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8ca046-dc23-46f1-85e5-ba07d44234c6", "tag": "219231f1-3c0d-49e8-8810-cf7c3110a792"}, {"server_uuid": "9e3c972a-93d9-42f4-a3ee-840fc973de13", "name": "network-vif-deleted", "tag": "ae2cd46e-ccab-4178-9cbb-0bd456cdcfd5"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:15.649888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2e89a8f3-0d3e-4d1c-8818-a4c9edbde98c req-6836401d-6281-40b0-8307-75384a6eac9b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.650806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2e89a8f3-0d3e-4d1c-8818-a4c9edbde98c req-6836401d-6281-40b0-8307-75384a6eac9b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.655726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2e89a8f3-0d3e-4d1c-8818-a4c9edbde98c req-6836401d-6281-40b0-8307-75384a6eac9b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.683650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:15.684418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:15.685184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:15.686129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:15.687166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:15.712310 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-2e89a8f3-0d3e-4d1c-8818-a4c9edbde98c req-6836401d-6281-40b0-8307-75384a6eac9b service nova] Creating event network-changed:219231f1-3c0d-49e8-8810-cf7c3110a792 for instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 on n-h1-850499-14 Oct 04 18:11:15.720077 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-2e89a8f3-0d3e-4d1c-8818-a4c9edbde98c req-6836401d-6281-40b0-8307-75384a6eac9b service nova] Creating event network-vif-deleted:ae2cd46e-ccab-4178-9cbb-0bd456cdcfd5 for instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 on n-h2-850499-14 Oct 04 18:11:15.725484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.727213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.727213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.727785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.728632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.729296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.767138 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-2e89a8f3-0d3e-4d1c-8818-a4c9edbde98c req-6836401d-6281-40b0-8307-75384a6eac9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.162748 Oct 04 18:11:15.769024 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1211/2409] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:15.773255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:15.781418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for user ba39a7cdf309477195a07acb5cdf24f4 and project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:15.782658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22b641fb-8ffe-475f-8fba-3924b87f90ef tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:15.786230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-22b641fb-8ffe-475f-8fba-3924b87f90ef tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:15.802480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22b641fb-8ffe-475f-8fba-3924b87f90ef tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.803040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22b641fb-8ffe-475f-8fba-3924b87f90ef tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.805117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22b641fb-8ffe-475f-8fba-3924b87f90ef tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.807717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22b641fb-8ffe-475f-8fba-3924b87f90ef tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.808375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22b641fb-8ffe-475f-8fba-3924b87f90ef tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.808934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22b641fb-8ffe-475f-8fba-3924b87f90ef tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.826564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:15.830119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:15.937925 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c891e845-df46-4490-a00a-a8a633fecd61 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.634123 Oct 04 18:11:15.939159 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1199/2410] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:15.944428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4dae0524-eb41-4771-819c-82f1cfb5019f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1c40040>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:16.071260 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4dae0524-eb41-4771-819c-82f1cfb5019f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1438 microversion: 2.1 time: 0.129190 Oct 04 18:11:16.074297 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1200/2411] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:15 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1438 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:16.094533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.161"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:17.552005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-22b641fb-8ffe-475f-8fba-3924b87f90ef tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:17.566325 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22b641fb-8ffe-475f-8fba-3924b87f90ef tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1314 microversion: 2.1 time: 1.795918 Oct 04 18:11:17.567432 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1212/2412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:15 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1314 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:17.577409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-98f6275b-8ebb-4dcf-b5e7-31b622bf7f59 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:17.578108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-98f6275b-8ebb-4dcf-b5e7-31b622bf7f59 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:17.582535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:17.589658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.590081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.590541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:17.594311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.595320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.595790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:17.601645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98f6275b-8ebb-4dcf-b5e7-31b622bf7f59 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.604642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98f6275b-8ebb-4dcf-b5e7-31b622bf7f59 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.605143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98f6275b-8ebb-4dcf-b5e7-31b622bf7f59 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:17.609815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98f6275b-8ebb-4dcf-b5e7-31b622bf7f59 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.610325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98f6275b-8ebb-4dcf-b5e7-31b622bf7f59 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.610774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98f6275b-8ebb-4dcf-b5e7-31b622bf7f59 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.511803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-98f6275b-8ebb-4dcf-b5e7-31b622bf7f59 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid 381cd7a0-7761-4e5b-8b7a-345f828634ea {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:18.602821 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-98f6275b-8ebb-4dcf-b5e7-31b622bf7f59 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 2345 microversion: 2.25 time: 1.033561 Oct 04 18:11:18.622737 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1213/2413] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:17 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 2345 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:18.645189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea5cb264-1c3c-4ce6-9bf4-ebaf8bb97f50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:18.646645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ea5cb264-1c3c-4ce6-9bf4-ebaf8bb97f50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:18.668930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5cb264-1c3c-4ce6-9bf4-ebaf8bb97f50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.672172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5cb264-1c3c-4ce6-9bf4-ebaf8bb97f50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.676198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5cb264-1c3c-4ce6-9bf4-ebaf8bb97f50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.677239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5cb264-1c3c-4ce6-9bf4-ebaf8bb97f50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.678593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5cb264-1c3c-4ce6-9bf4-ebaf8bb97f50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.679275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea5cb264-1c3c-4ce6-9bf4-ebaf8bb97f50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:19.566809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "refresh_cache-ad8ca046-dc23-46f1-85e5-ba07d44234c6" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:11:19.567356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquired lock "refresh_cache-ad8ca046-dc23-46f1-85e5-ba07d44234c6" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:11:19.599229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ea5cb264-1c3c-4ce6-9bf4-ebaf8bb97f50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:19.612300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ea5cb264-1c3c-4ce6-9bf4-ebaf8bb97f50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1266 microversion: 2.1 time: 0.987318 Oct 04 18:11:19.614071 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1214/2414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:18 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1266 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:19.620735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f0d4138-0924-4cc3-9194-4c5b77789d46 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d6294670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:19.786619 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f0d4138-0924-4cc3-9194-4c5b77789d46 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1438 microversion: 2.1 time: 0.169466 Oct 04 18:11:19.789400 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1215/2415] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:19 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1438 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:19.808759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-640779fc-50fc-4adb-b7d5-559a7b6ab0fa tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:19.813888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-640779fc-50fc-4adb-b7d5-559a7b6ab0fa tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:19.830205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-640779fc-50fc-4adb-b7d5-559a7b6ab0fa tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:19.831064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-640779fc-50fc-4adb-b7d5-559a7b6ab0fa tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:19.833846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-640779fc-50fc-4adb-b7d5-559a7b6ab0fa tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:19.838284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-640779fc-50fc-4adb-b7d5-559a7b6ab0fa tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:19.839274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-640779fc-50fc-4adb-b7d5-559a7b6ab0fa tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:19.840011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-640779fc-50fc-4adb-b7d5-559a7b6ab0fa tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.136846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-640779fc-50fc-4adb-b7d5-559a7b6ab0fa tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:21.194640 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-640779fc-50fc-4adb-b7d5-559a7b6ab0fa tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1464 microversion: 2.1 time: 1.402836 Oct 04 18:11:21.205560 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1216/2416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:19 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1464 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:21.221270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e60a6597-e00c-41d1-8140-401c0c8e0f1a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:21.256774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e60a6597-e00c-41d1-8140-401c0c8e0f1a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.257364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e60a6597-e00c-41d1-8140-401c0c8e0f1a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.261901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e60a6597-e00c-41d1-8140-401c0c8e0f1a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.266881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e60a6597-e00c-41d1-8140-401c0c8e0f1a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.275852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e60a6597-e00c-41d1-8140-401c0c8e0f1a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.276442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e60a6597-e00c-41d1-8140-401c0c8e0f1a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.412759 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e60a6597-e00c-41d1-8140-401c0c8e0f1a tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.199389 Oct 04 18:11:21.421179 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1217/2417] 10.222.0.18 () {60 vars in 1217 bytes} [Tue Oct 4 18:11:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:11:21.440391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b15066fe-ccb8-4ca7-bb52-21638ce81662 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:21.443801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b15066fe-ccb8-4ca7-bb52-21638ce81662 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:21.460791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b15066fe-ccb8-4ca7-bb52-21638ce81662 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.471964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b15066fe-ccb8-4ca7-bb52-21638ce81662 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.478909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b15066fe-ccb8-4ca7-bb52-21638ce81662 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.479987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b15066fe-ccb8-4ca7-bb52-21638ce81662 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.480792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b15066fe-ccb8-4ca7-bb52-21638ce81662 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.481516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b15066fe-ccb8-4ca7-bb52-21638ce81662 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.913140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b15066fe-ccb8-4ca7-bb52-21638ce81662 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:21.924766 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b15066fe-ccb8-4ca7-bb52-21638ce81662 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1272 microversion: 2.1 time: 0.502303 Oct 04 18:11:21.943464 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1218/2418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:21 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1272 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:21.961172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a641d619-66bc-4bc4-9130-5908972b71b0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1b22940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:22.058740 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a641d619-66bc-4bc4-9130-5908972b71b0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1438 microversion: 2.1 time: 0.113562 Oct 04 18:11:22.059371 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1219/2419] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:21 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:22.497888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6cdcc49d-6f46-4183-a8af-5c800eb74629 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:22.503790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6cdcc49d-6f46-4183-a8af-5c800eb74629 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Searching by: {'deleted': False, 'project_id': '181465b730bb4f68949a1ebdb9f93b15'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:11:22.543549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cdcc49d-6f46-4183-a8af-5c800eb74629 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:22.544050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cdcc49d-6f46-4183-a8af-5c800eb74629 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:22.544495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cdcc49d-6f46-4183-a8af-5c800eb74629 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:22.545246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cdcc49d-6f46-4183-a8af-5c800eb74629 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:22.545713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cdcc49d-6f46-4183-a8af-5c800eb74629 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:22.546155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cdcc49d-6f46-4183-a8af-5c800eb74629 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:22.654177 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6cdcc49d-6f46-4183-a8af-5c800eb74629 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.592067 Oct 04 18:11:22.657118 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1220/2420] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:11:22 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:11:22.681921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:22.695721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Searching by: {'deleted': False} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:11:22.704713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:22.705213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:22.705660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:22.706680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:22.707172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:22.707612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:23.008750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:11:23.290857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:23.293062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:23.294739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.353597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Building network info cache for instance {{(pid=122331) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:11:25.746019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:25.805630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:27.241811 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-615ab1f3-6ddd-46a6-b048-a65f0406e280 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16462 microversion: 2.1 time: 4.564080 Oct 04 18:11:27.242827 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1221/2421] 10.222.0.18 () {58 vars in 1171 bytes} [Tue Oct 4 18:11:22 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16462 bytes in 4566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:11:27.247698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f140477-e6fc-408a-bf1b-cc598cfe3964 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:27.248324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7f140477-e6fc-408a-bf1b-cc598cfe3964 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:27.265063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f140477-e6fc-408a-bf1b-cc598cfe3964 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.265590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f140477-e6fc-408a-bf1b-cc598cfe3964 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.266088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f140477-e6fc-408a-bf1b-cc598cfe3964 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.266826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f140477-e6fc-408a-bf1b-cc598cfe3964 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.267503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f140477-e6fc-408a-bf1b-cc598cfe3964 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.270527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f140477-e6fc-408a-bf1b-cc598cfe3964 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.586815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:28.284177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f140477-e6fc-408a-bf1b-cc598cfe3964 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:28.300001 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f140477-e6fc-408a-bf1b-cc598cfe3964 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1314 microversion: 2.1 time: 1.055964 Oct 04 18:11:28.311173 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1222/2422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:27 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1314 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:28.334692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c376c57c-6b1e-4635-9eef-18f1c0926a14 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1a7bd30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:28.429459 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c376c57c-6b1e-4635-9eef-18f1c0926a14 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1438 microversion: 2.1 time: 0.113826 Oct 04 18:11:28.430126 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1223/2423] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:28 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1438 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:28.494072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6c96bb9c-67cd-49d1-b87a-832a90b0aa81 req-98b764f4-fdb4-4542-808d-506075f0e318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8ca046-dc23-46f1-85e5-ba07d44234c6", "tag": "219231f1-3c0d-49e8-8810-cf7c3110a792"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:28.547051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6c96bb9c-67cd-49d1-b87a-832a90b0aa81 req-98b764f4-fdb4-4542-808d-506075f0e318 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:28.547528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6c96bb9c-67cd-49d1-b87a-832a90b0aa81 req-98b764f4-fdb4-4542-808d-506075f0e318 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:28.548238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6c96bb9c-67cd-49d1-b87a-832a90b0aa81 req-98b764f4-fdb4-4542-808d-506075f0e318 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:28.601517 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6c96bb9c-67cd-49d1-b87a-832a90b0aa81 req-98b764f4-fdb4-4542-808d-506075f0e318 service nova] Creating event network-changed:219231f1-3c0d-49e8-8810-cf7c3110a792 for instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 on n-h1-850499-14 Oct 04 18:11:28.618965 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6c96bb9c-67cd-49d1-b87a-832a90b0aa81 req-98b764f4-fdb4-4542-808d-506075f0e318 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146216 Oct 04 18:11:28.621325 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1224/2424] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:28.636693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-35b05054-34e6-41b0-bf15-1e6a658074d4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7b0b18c-6d3f-4847-9131-b51e2cb1f8ba", "device": "/dev/xvdb"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:28.642709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-35b05054-34e6-41b0-bf15-1e6a658074d4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:28.667218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35b05054-34e6-41b0-bf15-1e6a658074d4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:28.669033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35b05054-34e6-41b0-bf15-1e6a658074d4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:28.672193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35b05054-34e6-41b0-bf15-1e6a658074d4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:28.673485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35b05054-34e6-41b0-bf15-1e6a658074d4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:28.674698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35b05054-34e6-41b0-bf15-1e6a658074d4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:28.675372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35b05054-34e6-41b0-bf15-1e6a658074d4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:28.908428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Updating instance_info_cache with network_info: [{"id": "219231f1-3c0d-49e8-8810-cf7c3110a792", "address": "fa:16:3e:38:32:22", "network": {"id": "61d1d0bf-30e4-4740-8b71-20dd29f08efb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-462894479-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "197a6854a6a949b88eae7d185688d461", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap219231f1-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122331) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:11:28.930414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Releasing lock "refresh_cache-ad8ca046-dc23-46f1-85e5-ba07d44234c6" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:11:28.934232 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fa39db63-1903-44bb-a5e6-23be3aa11482 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "POST /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6/action" status: 202 len: 0 microversion: 2.1 time: 12.857611 Oct 04 18:11:28.955731 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1201/2425] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:16 2022] POST /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6/action => generated 0 bytes in 12880 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:11:28.979114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-68d93a5b-f02c-47d5-a0da-8a64d6d65056 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:28.986245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-68d93a5b-f02c-47d5-a0da-8a64d6d65056 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Searching by: {'deleted': False, 'project_id': '181465b730bb4f68949a1ebdb9f93b15'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:11:29.013421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d93a5b-f02c-47d5-a0da-8a64d6d65056 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.014683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d93a5b-f02c-47d5-a0da-8a64d6d65056 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.015423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d93a5b-f02c-47d5-a0da-8a64d6d65056 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.016386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d93a5b-f02c-47d5-a0da-8a64d6d65056 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.017059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d93a5b-f02c-47d5-a0da-8a64d6d65056 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.017713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d93a5b-f02c-47d5-a0da-8a64d6d65056 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.473476 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-35b05054-34e6-41b0-bf15-1e6a658074d4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "POST /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.842878 Oct 04 18:11:29.475344 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1225/2426] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Oct 4 18:11:28 2022] POST /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments => generated 194 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:11:29.521761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-13e14c27-5326-484a-9b24-aff2af820d31 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:29.524297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-13e14c27-5326-484a-9b24-aff2af820d31 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:29.550903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13e14c27-5326-484a-9b24-aff2af820d31 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.551458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13e14c27-5326-484a-9b24-aff2af820d31 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.551911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13e14c27-5326-484a-9b24-aff2af820d31 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.552649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13e14c27-5326-484a-9b24-aff2af820d31 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.553116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13e14c27-5326-484a-9b24-aff2af820d31 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.553556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13e14c27-5326-484a-9b24-aff2af820d31 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.593607 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-68d93a5b-f02c-47d5-a0da-8a64d6d65056 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?tenant_id=b1b14394d8ea452eb046b7ce147a4ec7" status: 200 len: 15 microversion: 2.1 time: 0.635818 Oct 04 18:11:29.594174 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1202/2427] 10.222.0.18 () {58 vars in 1231 bytes} [Tue Oct 4 18:11:28 2022] GET /compute/v2.1/servers/detail?tenant_id=b1b14394d8ea452eb046b7ce147a4ec7 => generated 15 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:11:29.618985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-154854ed-4614-4c75-9719-019c38a474ee tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:29.619687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-154854ed-4614-4c75-9719-019c38a474ee tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:29.649993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-154854ed-4614-4c75-9719-019c38a474ee tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.650640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-154854ed-4614-4c75-9719-019c38a474ee tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.661645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-154854ed-4614-4c75-9719-019c38a474ee tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.662754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-154854ed-4614-4c75-9719-019c38a474ee tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.672205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-154854ed-4614-4c75-9719-019c38a474ee tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.673043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-154854ed-4614-4c75-9719-019c38a474ee tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.679869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-13e14c27-5326-484a-9b24-aff2af820d31 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:29.821602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:30.012970 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-13e14c27-5326-484a-9b24-aff2af820d31 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 204 len: 0 microversion: 2.1 time: 0.535445 Oct 04 18:11:30.013140 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1226/2428] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:29 2022] DELETE /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:30.025863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac7d7f69-d2d4-4d8a-b795-76dd10b3459b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d6257f70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:30.190557 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac7d7f69-d2d4-4d8a-b795-76dd10b3459b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1438 microversion: 2.1 time: 0.175263 Oct 04 18:11:30.191208 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1227/2429] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:30 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1438 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:30.226453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:30.265587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Searching by: {'tenant_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'deleted': False} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:11:30.291861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:30.292355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:30.292819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:30.293554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:30.294024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:30.294455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:30.414860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:11:30.633651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:30.634284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:30.635357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:30.904813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-154854ed-4614-4c75-9719-019c38a474ee tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:30.917946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-154854ed-4614-4c75-9719-019c38a474ee tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1314 microversion: 2.1 time: 1.322689 Oct 04 18:11:30.918539 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1203/2430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:29 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1314 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:30.944262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.161"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:30.980985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:31.006034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.009922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.013731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.020628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.021487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.023020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.092643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "refresh_cache-5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:11:31.096138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquired lock "refresh_cache-5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:11:31.725388 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-970face8-275b-4b31-9d88-351006283e0a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b1b14394d8ea452eb046b7ce147a4ec7" status: 200 len: 4831 microversion: 2.1 time: 1.533090 Oct 04 18:11:31.739628 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1228/2431] 10.222.0.18 () {58 vars in 1257 bytes} [Tue Oct 4 18:11:30 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b1b14394d8ea452eb046b7ce147a4ec7 => generated 4831 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:31.739628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70ff83ef-7f07-4c48-ba2e-52cdc86196eb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1e4e310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:31.834308 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70ff83ef-7f07-4c48-ba2e-52cdc86196eb tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1438 microversion: 2.1 time: 0.106694 Oct 04 18:11:31.834900 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1229/2432] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:31 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:31.850172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e76d30ae-9f5a-4d93-98e1-33927f8e7d39 req-351f5135-5be4-49cf-86fd-fb8681079562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5d14a05-8a0f-4911-af5e-e84c9e8076cf", "tag": "2a0c754b-d2bd-4a81-95a3-d6413110c4cd"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:31.873426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e76d30ae-9f5a-4d93-98e1-33927f8e7d39 req-351f5135-5be4-49cf-86fd-fb8681079562 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.876297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e76d30ae-9f5a-4d93-98e1-33927f8e7d39 req-351f5135-5be4-49cf-86fd-fb8681079562 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.877097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e76d30ae-9f5a-4d93-98e1-33927f8e7d39 req-351f5135-5be4-49cf-86fd-fb8681079562 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.891629 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e76d30ae-9f5a-4d93-98e1-33927f8e7d39 req-351f5135-5be4-49cf-86fd-fb8681079562 service nova] Creating event network-changed:2a0c754b-d2bd-4a81-95a3-d6413110c4cd for instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf on n-h2-850499-14 Oct 04 18:11:31.902851 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e76d30ae-9f5a-4d93-98e1-33927f8e7d39 req-351f5135-5be4-49cf-86fd-fb8681079562 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064809 Oct 04 18:11:31.910155 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1230/2433] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:31.916065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e91a6667-2fd4-4aa1-bb81-8ebb54865827 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:31.954282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e91a6667-2fd4-4aa1-bb81-8ebb54865827 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Searching by: {'tenant_id': '181465b730bb4f68949a1ebdb9f93b15', 'deleted': False} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:11:31.962659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91a6667-2fd4-4aa1-bb81-8ebb54865827 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.965100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91a6667-2fd4-4aa1-bb81-8ebb54865827 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.966482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91a6667-2fd4-4aa1-bb81-8ebb54865827 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.971652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91a6667-2fd4-4aa1-bb81-8ebb54865827 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.972446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91a6667-2fd4-4aa1-bb81-8ebb54865827 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.973104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91a6667-2fd4-4aa1-bb81-8ebb54865827 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.066334 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e91a6667-2fd4-4aa1-bb81-8ebb54865827 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=181465b730bb4f68949a1ebdb9f93b15" status: 200 len: 15 microversion: 2.1 time: 0.154184 Oct 04 18:11:32.081559 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1231/2434] 10.222.0.18 () {58 vars in 1257 bytes} [Tue Oct 4 18:11:31 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=181465b730bb4f68949a1ebdb9f93b15 => generated 15 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:11:32.082054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5114496-5955-4788-b42a-ef161da2de87 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:32.091489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5114496-5955-4788-b42a-ef161da2de87 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:32.107373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5114496-5955-4788-b42a-ef161da2de87 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.108159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5114496-5955-4788-b42a-ef161da2de87 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.109288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5114496-5955-4788-b42a-ef161da2de87 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.110188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5114496-5955-4788-b42a-ef161da2de87 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.111722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5114496-5955-4788-b42a-ef161da2de87 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.113789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5114496-5955-4788-b42a-ef161da2de87 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.535083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5114496-5955-4788-b42a-ef161da2de87 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.554518 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5114496-5955-4788-b42a-ef161da2de87 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1314 microversion: 2.1 time: 4.480217 Oct 04 18:11:36.590134 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1232/2435] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:32 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1314 bytes in 4517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:36.606748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e7b4253e-b001-406b-81f8-63a554489d5e tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:36.613795 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e7b4253e-b001-406b-81f8-63a554489d5e tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.021368 Oct 04 18:11:36.615388 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1233/2436] 10.222.0.18 () {58 vars in 1189 bytes} [Tue Oct 4 18:11:36 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:11:36.620303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-298b5fb7-6c08-47fb-b974-96426c9884aa tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61a01f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:36.776768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-298b5fb7-6c08-47fb-b974-96426c9884aa tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1447 microversion: 2.1 time: 0.159113 Oct 04 18:11:36.777327 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1234/2437] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:36 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:37.079412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-8ebade61-116e-4724-87bd-b70b166cecc1 req-a05a1e8d-5432-425f-9c14-b96fd1d65218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8ca046-dc23-46f1-85e5-ba07d44234c6", "name": "network-vif-deleted", "tag": "219231f1-3c0d-49e8-8810-cf7c3110a792"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:37.113438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8ebade61-116e-4724-87bd-b70b166cecc1 req-a05a1e8d-5432-425f-9c14-b96fd1d65218 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.114506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8ebade61-116e-4724-87bd-b70b166cecc1 req-a05a1e8d-5432-425f-9c14-b96fd1d65218 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.115346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8ebade61-116e-4724-87bd-b70b166cecc1 req-a05a1e8d-5432-425f-9c14-b96fd1d65218 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.146926 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-8ebade61-116e-4724-87bd-b70b166cecc1 req-a05a1e8d-5432-425f-9c14-b96fd1d65218 service nova] Creating event network-vif-deleted:219231f1-3c0d-49e8-8810-cf7c3110a792 for instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 on n-h1-850499-14 Oct 04 18:11:37.172152 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-8ebade61-116e-4724-87bd-b70b166cecc1 req-a05a1e8d-5432-425f-9c14-b96fd1d65218 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.390124 Oct 04 18:11:37.172828 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1235/2438] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:37.200252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51fc3575-477e-4dd4-b99e-079114004ed8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:37.221593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-51fc3575-477e-4dd4-b99e-079114004ed8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:37.236740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51fc3575-477e-4dd4-b99e-079114004ed8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.244150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51fc3575-477e-4dd4-b99e-079114004ed8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.244884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51fc3575-477e-4dd4-b99e-079114004ed8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.246181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51fc3575-477e-4dd4-b99e-079114004ed8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.250085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51fc3575-477e-4dd4-b99e-079114004ed8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.251907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51fc3575-477e-4dd4-b99e-079114004ed8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.527071 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-51fc3575-477e-4dd4-b99e-079114004ed8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action" status: 202 len: 0 microversion: 2.1 time: 0.345137 Oct 04 18:11:37.529691 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1236/2439] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:37 2022] POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:11:37.549239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2e7bbe23-47d5-4377-9a3a-c334bef1b678 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d629d1f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:37.663077 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2e7bbe23-47d5-4377-9a3a-c334bef1b678 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 200 len: 1447 microversion: 2.1 time: 0.129448 Oct 04 18:11:37.673476 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1237/2440] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:11:37 2022] GET /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:38.140872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-570765977", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "7a0d5b52-c2d3-407c-bd24-90b4e7140780"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:38.297127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] validate_networks() for [('7a0d5b52-c2d3-407c-bd24-90b4e7140780', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:39.295551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:40.497659 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:11:40.498157 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 18:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Oct 04 18:11:40.539186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Building network info cache for instance {{(pid=122331) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:11:40.547619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=48,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:40.579518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:40.713333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:40.713757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:40.714265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:40.714706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:40.715351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:40.746410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.747099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.747576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.748421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.750099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.750884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.812669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Getting quotas for project 945b6308c9b642468ffe22b5825e22b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:40.829184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Getting quotas for user e2b7db5805f34e58b086bffb82ff79b4 and project 945b6308c9b642468ffe22b5825e22b5. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:40.858872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:40.875315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:41.006164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:41.021083 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0e009a24-e9d6-42b6-8c78-c93eb684ed36 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.346390 Oct 04 18:11:41.023857 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1238/2441] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:41.034732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:41.048923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:41.056420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:11:41.074723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.075302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.090018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.092725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.093678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.095852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.331465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:11:41.509529 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-573d4f51-1fad-4356-ac9f-5efcadfac6b4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.484277 Oct 04 18:11:41.523939 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1239/2442] 10.222.0.18 () {58 vars in 1150 bytes} [Tue Oct 4 18:11:41 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:41.548458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f822e1b-2123-4f96-9a22-93c20745b959 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:41.549544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4f822e1b-2123-4f96-9a22-93c20745b959 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:41.576091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f822e1b-2123-4f96-9a22-93c20745b959 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.579360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f822e1b-2123-4f96-9a22-93c20745b959 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.580323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f822e1b-2123-4f96-9a22-93c20745b959 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.581097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f822e1b-2123-4f96-9a22-93c20745b959 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.582731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f822e1b-2123-4f96-9a22-93c20745b959 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.585888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f822e1b-2123-4f96-9a22-93c20745b959 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.731864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4f822e1b-2123-4f96-9a22-93c20745b959 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:42.746475 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f822e1b-2123-4f96-9a22-93c20745b959 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1314 microversion: 2.1 time: 1.219425 Oct 04 18:11:42.767214 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1240/2443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:41 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1314 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:42.774323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-36609700-45cc-4892-84dc-4164f50c66b6 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1b30a60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:43.022126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Updating instance_info_cache with network_info: [{"id": "6edb64f1-120e-4ab2-81b6-c49027ad6cca", "address": "fa:16:3e:00:2e:e0", "network": {"id": "61d1d0bf-30e4-4740-8b71-20dd29f08efb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-462894479-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "197a6854a6a949b88eae7d185688d461", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6edb64f1-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122331) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:11:43.043712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Releasing lock "refresh_cache-5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:11:43.047391 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-676a8be4-e038-4552-8af5-1eb027dffd57 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "POST /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a/action" status: 202 len: 0 microversion: 2.1 time: 12.114894 Oct 04 18:11:43.052833 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1204/2444] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:30 2022] POST /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a/action => generated 0 bytes in 12120 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:11:43.490837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-49891d6f-341b-48f1-85da-c7e04c774a50 req-c537d57a-5891-48ab-9fe6-5d1e0e8a9a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785194b8-dcad-4490-9f2a-e62dcf5afe79", "name": "network-vif-unplugged", "status": "completed", "tag": "a1297b31-1254-4f09-b9cc-b8acb3985f3d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:43.526848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-49891d6f-341b-48f1-85da-c7e04c774a50 req-c537d57a-5891-48ab-9fe6-5d1e0e8a9a48 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.534052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-49891d6f-341b-48f1-85da-c7e04c774a50 req-c537d57a-5891-48ab-9fe6-5d1e0e8a9a48 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.540693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-49891d6f-341b-48f1-85da-c7e04c774a50 req-c537d57a-5891-48ab-9fe6-5d1e0e8a9a48 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.576185 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-49891d6f-341b-48f1-85da-c7e04c774a50 req-c537d57a-5891-48ab-9fe6-5d1e0e8a9a48 service nova] Creating event network-vif-unplugged:a1297b31-1254-4f09-b9cc-b8acb3985f3d for instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 on n-h1-850499-14 Oct 04 18:11:43.591673 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-49891d6f-341b-48f1-85da-c7e04c774a50 req-c537d57a-5891-48ab-9fe6-5d1e0e8a9a48 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.535982 Oct 04 18:11:43.600677 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1205/2445] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:43.622543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-677d75d8-88fb-4a2a-b1f4-4a244d405535 req-434b6a4d-8869-465f-a719-51e59bacb689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f64a66b-6e31-45ef-a711-60c9e8f0ec3a", "tag": "6edb64f1-120e-4ab2-81b6-c49027ad6cca"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:43.655469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-677d75d8-88fb-4a2a-b1f4-4a244d405535 req-434b6a4d-8869-465f-a719-51e59bacb689 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.656557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-677d75d8-88fb-4a2a-b1f4-4a244d405535 req-434b6a4d-8869-465f-a719-51e59bacb689 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.657223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-677d75d8-88fb-4a2a-b1f4-4a244d405535 req-434b6a4d-8869-465f-a719-51e59bacb689 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.680947 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-677d75d8-88fb-4a2a-b1f4-4a244d405535 req-434b6a4d-8869-465f-a719-51e59bacb689 service nova] Creating event network-changed:6edb64f1-120e-4ab2-81b6-c49027ad6cca for instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a on n-h2-850499-14 Oct 04 18:11:43.688195 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-677d75d8-88fb-4a2a-b1f4-4a244d405535 req-434b6a4d-8869-465f-a719-51e59bacb689 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082011 Oct 04 18:11:43.689126 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1206/2446] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:43.697523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-15e5ef44-1273-4ea2-9c6b-2be2cd72c0e0 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:43.698588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15e5ef44-1273-4ea2-9c6b-2be2cd72c0e0 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:43.709403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e5ef44-1273-4ea2-9c6b-2be2cd72c0e0 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.711578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e5ef44-1273-4ea2-9c6b-2be2cd72c0e0 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.713339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e5ef44-1273-4ea2-9c6b-2be2cd72c0e0 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.714375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e5ef44-1273-4ea2-9c6b-2be2cd72c0e0 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.715114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e5ef44-1273-4ea2-9c6b-2be2cd72c0e0 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.715726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15e5ef44-1273-4ea2-9c6b-2be2cd72c0e0 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.250184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-15e5ef44-1273-4ea2-9c6b-2be2cd72c0e0 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:44.291902 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-15e5ef44-1273-4ea2-9c6b-2be2cd72c0e0 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1268 microversion: 2.1 time: 0.584118 Oct 04 18:11:44.293309 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1207/2447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:43 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1268 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:44.301838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5037e5e2-962b-432b-b1ca-b1861605e20b tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:44.337724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5037e5e2-962b-432b-b1ca-b1861605e20b tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:44.354223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5037e5e2-962b-432b-b1ca-b1861605e20b tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.356068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5037e5e2-962b-432b-b1ca-b1861605e20b tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.364286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5037e5e2-962b-432b-b1ca-b1861605e20b tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.366440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5037e5e2-962b-432b-b1ca-b1861605e20b tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.368587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5037e5e2-962b-432b-b1ca-b1861605e20b tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.373986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5037e5e2-962b-432b-b1ca-b1861605e20b tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.428683 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-36609700-45cc-4892-84dc-4164f50c66b6 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 204 len: 0 microversion: 2.1 time: 1.659178 Oct 04 18:11:44.429296 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1241/2448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:42 2022] DELETE /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 0 bytes in 1664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:44.447082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67687e61-b045-446e-a9cc-4087d2edf0f2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '.version_select at 0x7fd4d1e4a280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:44.607606 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5037e5e2-962b-432b-b1ca-b1861605e20b tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action" status: 202 len: 0 microversion: 2.1 time: 0.311889 Oct 04 18:11:44.608494 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1208/2449] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:44 2022] POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:11:44.617582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f2273db-7b3f-4273-8235-bf33fd5c3a63 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:44.619021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f2273db-7b3f-4273-8235-bf33fd5c3a63 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:44.632248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2273db-7b3f-4273-8235-bf33fd5c3a63 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.633655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2273db-7b3f-4273-8235-bf33fd5c3a63 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.634660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2273db-7b3f-4273-8235-bf33fd5c3a63 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.635819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2273db-7b3f-4273-8235-bf33fd5c3a63 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.636497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2273db-7b3f-4273-8235-bf33fd5c3a63 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.637136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2273db-7b3f-4273-8235-bf33fd5c3a63 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.273101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f2273db-7b3f-4273-8235-bf33fd5c3a63 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.294074 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f2273db-7b3f-4273-8235-bf33fd5c3a63 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1314 microversion: 2.1 time: 0.681270 Oct 04 18:11:45.294714 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1209/2450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:44 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:45.330070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7036b677-8905-4b94-ab14-426fd14ba07c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:45.334892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7036b677-8905-4b94-ab14-426fd14ba07c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:45.349760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7036b677-8905-4b94-ab14-426fd14ba07c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.353697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7036b677-8905-4b94-ab14-426fd14ba07c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.354730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7036b677-8905-4b94-ab14-426fd14ba07c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.360072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7036b677-8905-4b94-ab14-426fd14ba07c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.363511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7036b677-8905-4b94-ab14-426fd14ba07c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.369770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7036b677-8905-4b94-ab14-426fd14ba07c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.407379 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67687e61-b045-446e-a9cc-4087d2edf0f2 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/c3de872c-c99a-4da5-bbfc-21b22b857d55" status: 200 len: 184 microversion: 2.1 time: 0.976278 Oct 04 18:11:45.410507 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1242/2451] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:11:44 2022] GET /compute/v2.1/os-floating-ips/c3de872c-c99a-4da5-bbfc-21b22b857d55 => generated 184 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:45.421747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d0ce91e-5b3e-47bb-8bbb-1083e32258f8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:45.422595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d0ce91e-5b3e-47bb-8bbb-1083e32258f8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:45.436270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7036b677-8905-4b94-ab14-426fd14ba07c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:45.444133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:45.445766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d0ce91e-5b3e-47bb-8bbb-1083e32258f8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.446275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d0ce91e-5b3e-47bb-8bbb-1083e32258f8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.446722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d0ce91e-5b3e-47bb-8bbb-1083e32258f8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.447557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d0ce91e-5b3e-47bb-8bbb-1083e32258f8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.448020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d0ce91e-5b3e-47bb-8bbb-1083e32258f8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.448453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d0ce91e-5b3e-47bb-8bbb-1083e32258f8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.614680 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7036b677-8905-4b94-ab14-426fd14ba07c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 204 len: 0 microversion: 2.1 time: 0.296448 Oct 04 18:11:45.616275 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1210/2452] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:45 2022] DELETE /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:45.625333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-37a04822-cadd-4a78-84dc-73237a20e40d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:45.626312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-37a04822-cadd-4a78-84dc-73237a20e40d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:45.642808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37a04822-cadd-4a78-84dc-73237a20e40d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.644881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37a04822-cadd-4a78-84dc-73237a20e40d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.645786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37a04822-cadd-4a78-84dc-73237a20e40d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.646835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37a04822-cadd-4a78-84dc-73237a20e40d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.648194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37a04822-cadd-4a78-84dc-73237a20e40d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.648930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37a04822-cadd-4a78-84dc-73237a20e40d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.808281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-37a04822-cadd-4a78-84dc-73237a20e40d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.819591 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-37a04822-cadd-4a78-84dc-73237a20e40d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1274 microversion: 2.1 time: 0.201018 Oct 04 18:11:45.823302 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1211/2453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:45 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:45.833189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.161"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:45.906215 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d0ce91e-5b3e-47bb-8bbb-1083e32258f8 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1615 microversion: 2.1 time: 0.493876 Oct 04 18:11:45.920336 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1243/2454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:45 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1615 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:45.935058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-587043789", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "09d3e330-5b4f-4c00-bc76-a5da1584aaf5"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:46.039820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] validate_networks() for [('09d3e330-5b4f-4c00-bc76-a5da1584aaf5', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:46.684430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.695738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.696522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.701823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.703045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.703668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.704154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.217322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "refresh_cache-5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:11:47.217737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquired lock "refresh_cache-5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:11:47.928987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:47.930186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:47.930868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:47.931511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:47.932168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:47.951228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.952924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.953821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.955778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.956758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.957742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.974800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=15 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:48.004935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Getting quotas for project 67c1cf4579c5406fb461ec00e486b491. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:48.013238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Getting quotas for user 2f402a68c6734b9488ab4a04e8b630a6 and project 67c1cf4579c5406fb461ec00e486b491. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:48.039355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:48.045042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:48.128782 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4a988183-4317-41cd-863e-60cd8378a79c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.205865 Oct 04 18:11:48.130084 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1244/2455] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:48.140527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2fc0497a-a1f5-4c91-9804-14508b14f09a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:48.142154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2fc0497a-a1f5-4c91-9804-14508b14f09a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:48.152021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fc0497a-a1f5-4c91-9804-14508b14f09a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.153012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fc0497a-a1f5-4c91-9804-14508b14f09a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.153751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fc0497a-a1f5-4c91-9804-14508b14f09a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.154735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fc0497a-a1f5-4c91-9804-14508b14f09a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.155413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fc0497a-a1f5-4c91-9804-14508b14f09a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.160226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fc0497a-a1f5-4c91-9804-14508b14f09a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.836446 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2fc0497a-a1f5-4c91-9804-14508b14f09a tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1615 microversion: 2.1 time: 0.703045 Oct 04 18:11:48.843319 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1245/2456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:48 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1615 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:48.862330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c344424-2070-4623-bde0-0d834fa40f04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:48.870630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c344424-2070-4623-bde0-0d834fa40f04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:48.888863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c344424-2070-4623-bde0-0d834fa40f04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.895213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c344424-2070-4623-bde0-0d834fa40f04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.895792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c344424-2070-4623-bde0-0d834fa40f04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.896568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c344424-2070-4623-bde0-0d834fa40f04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.897047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c344424-2070-4623-bde0-0d834fa40f04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.897529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c344424-2070-4623-bde0-0d834fa40f04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.294177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c344424-2070-4623-bde0-0d834fa40f04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:49.309287 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c344424-2070-4623-bde0-0d834fa40f04 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1314 microversion: 2.1 time: 0.461536 Oct 04 18:11:49.309898 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1246/2457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:48 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:49.324781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b167062c-da92-49c7-a797-7a1255df8bf6 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:49.326139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b167062c-da92-49c7-a797-7a1255df8bf6 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:49.339828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b167062c-da92-49c7-a797-7a1255df8bf6 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.342584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b167062c-da92-49c7-a797-7a1255df8bf6 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.345322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b167062c-da92-49c7-a797-7a1255df8bf6 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.346532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b167062c-da92-49c7-a797-7a1255df8bf6 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.348539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b167062c-da92-49c7-a797-7a1255df8bf6 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.351178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b167062c-da92-49c7-a797-7a1255df8bf6 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.397396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b167062c-da92-49c7-a797-7a1255df8bf6 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:50.440709 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b167062c-da92-49c7-a797-7a1255df8bf6 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1316 microversion: 2.1 time: 1.126776 Oct 04 18:11:50.443428 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1247/2458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:49 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1316 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:50.456357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7606fa12-cb81-47ef-b7e7-aecb19247ae0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:50.459594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7606fa12-cb81-47ef-b7e7-aecb19247ae0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:50.478011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7606fa12-cb81-47ef-b7e7-aecb19247ae0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.481275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7606fa12-cb81-47ef-b7e7-aecb19247ae0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.482105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7606fa12-cb81-47ef-b7e7-aecb19247ae0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.483131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7606fa12-cb81-47ef-b7e7-aecb19247ae0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.485130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7606fa12-cb81-47ef-b7e7-aecb19247ae0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.487345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7606fa12-cb81-47ef-b7e7-aecb19247ae0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.512830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Building network info cache for instance {{(pid=122331) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:11:50.722409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7606fa12-cb81-47ef-b7e7-aecb19247ae0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:50.737316 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7606fa12-cb81-47ef-b7e7-aecb19247ae0 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1267 microversion: 2.1 time: 0.284923 Oct 04 18:11:50.738487 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1248/2459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:50 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:50.780191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-0cc92d60-0c45-4fe7-b368-f12cf4657f65 req-5d90450b-c3c7-4629-88b7-3298237acb08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d14a05-8a0f-4911-af5e-e84c9e8076cf", "name": "network-vif-plugged", "status": "completed", "tag": "2a0c754b-d2bd-4a81-95a3-d6413110c4cd"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:50.829503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0cc92d60-0c45-4fe7-b368-f12cf4657f65 req-5d90450b-c3c7-4629-88b7-3298237acb08 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.829985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0cc92d60-0c45-4fe7-b368-f12cf4657f65 req-5d90450b-c3c7-4629-88b7-3298237acb08 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.830423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0cc92d60-0c45-4fe7-b368-f12cf4657f65 req-5d90450b-c3c7-4629-88b7-3298237acb08 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.874872 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-0cc92d60-0c45-4fe7-b368-f12cf4657f65 req-5d90450b-c3c7-4629-88b7-3298237acb08 service nova] Creating event network-vif-plugged:2a0c754b-d2bd-4a81-95a3-d6413110c4cd for instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf on n-h2-850499-14 Oct 04 18:11:50.908275 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-0cc92d60-0c45-4fe7-b368-f12cf4657f65 req-5d90450b-c3c7-4629-88b7-3298237acb08 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168235 Oct 04 18:11:50.912630 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1249/2460] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:50.931005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9fd2d888-143c-4c4f-ba01-6f456a3e53c6 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:50.962169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9fd2d888-143c-4c4f-ba01-6f456a3e53c6 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Searching by: {'host': 'n-h2-850499-14', 'deleted': False} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:11:50.968323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fd2d888-143c-4c4f-ba01-6f456a3e53c6 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.969047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fd2d888-143c-4c4f-ba01-6f456a3e53c6 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.969670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fd2d888-143c-4c4f-ba01-6f456a3e53c6 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.970618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fd2d888-143c-4c4f-ba01-6f456a3e53c6 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.971304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fd2d888-143c-4c4f-ba01-6f456a3e53c6 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.972202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fd2d888-143c-4c4f-ba01-6f456a3e53c6 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.278469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-9fd2d888-143c-4c4f-ba01-6f456a3e53c6 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:11:51.469407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:51.482408 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9fd2d888-143c-4c4f-ba01-6f456a3e53c6 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=n-h2-850499-14&all_tenants=1" status: 200 len: 1661 microversion: 2.1 time: 0.567853 Oct 04 18:11:51.492563 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1250/2461] 10.222.0.18 () {58 vars in 1192 bytes} [Tue Oct 4 18:11:50 2022] GET /compute/v2.1/servers?host=n-h2-850499-14&all_tenants=1 => generated 1661 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:51.517742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5dabe6cc-3c78-4ddd-8695-ba5de3b8a7cc req-c40346ec-7777-4726-b5f6-656c57daecf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785194b8-dcad-4490-9f2a-e62dcf5afe79", "name": "network-vif-deleted", "tag": "a1297b31-1254-4f09-b9cc-b8acb3985f3d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:51.551225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5dabe6cc-3c78-4ddd-8695-ba5de3b8a7cc req-c40346ec-7777-4726-b5f6-656c57daecf6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.551725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5dabe6cc-3c78-4ddd-8695-ba5de3b8a7cc req-c40346ec-7777-4726-b5f6-656c57daecf6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.553592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5dabe6cc-3c78-4ddd-8695-ba5de3b8a7cc req-c40346ec-7777-4726-b5f6-656c57daecf6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.591614 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5dabe6cc-3c78-4ddd-8695-ba5de3b8a7cc req-c40346ec-7777-4726-b5f6-656c57daecf6 service nova] Creating event network-vif-deleted:a1297b31-1254-4f09-b9cc-b8acb3985f3d for instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 on n-h1-850499-14 Oct 04 18:11:51.605399 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5dabe6cc-3c78-4ddd-8695-ba5de3b8a7cc req-c40346ec-7777-4726-b5f6-656c57daecf6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107277 Oct 04 18:11:51.609253 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1251/2462] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:51.637031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4edc531b-bed6-4d3f-a433-10dbed441546 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:51.642032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4edc531b-bed6-4d3f-a433-10dbed441546 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:51.661925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4edc531b-bed6-4d3f-a433-10dbed441546 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.664486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4edc531b-bed6-4d3f-a433-10dbed441546 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.665721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4edc531b-bed6-4d3f-a433-10dbed441546 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.687380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4edc531b-bed6-4d3f-a433-10dbed441546 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.694238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4edc531b-bed6-4d3f-a433-10dbed441546 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.696508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4edc531b-bed6-4d3f-a433-10dbed441546 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.215715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4edc531b-bed6-4d3f-a433-10dbed441546 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:52.259874 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4edc531b-bed6-4d3f-a433-10dbed441546 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1314 microversion: 2.1 time: 0.646700 Oct 04 18:11:52.260746 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1252/2463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:51 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:52.275693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-2b205a63-7acc-4566-bf8b-02c5d9dc268b req-7455f10b-40fd-4a1e-a138-5ec21e2994ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f64a66b-6e31-45ef-a711-60c9e8f0ec3a", "tag": "6edb64f1-120e-4ab2-81b6-c49027ad6cca"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:52.295802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2b205a63-7acc-4566-bf8b-02c5d9dc268b req-7455f10b-40fd-4a1e-a138-5ec21e2994ba service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.296599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2b205a63-7acc-4566-bf8b-02c5d9dc268b req-7455f10b-40fd-4a1e-a138-5ec21e2994ba service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.297194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2b205a63-7acc-4566-bf8b-02c5d9dc268b req-7455f10b-40fd-4a1e-a138-5ec21e2994ba service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.312923 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-2b205a63-7acc-4566-bf8b-02c5d9dc268b req-7455f10b-40fd-4a1e-a138-5ec21e2994ba service nova] Creating event network-changed:6edb64f1-120e-4ab2-81b6-c49027ad6cca for instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a on n-h2-850499-14 Oct 04 18:11:52.320450 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-2b205a63-7acc-4566-bf8b-02c5d9dc268b req-7455f10b-40fd-4a1e-a138-5ec21e2994ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057865 Oct 04 18:11:52.322067 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1253/2464] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:52.329103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fefc1b6a-ff36-435b-b3d0-190eec0ad527 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:52.330340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fefc1b6a-ff36-435b-b3d0-190eec0ad527 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:52.343584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fefc1b6a-ff36-435b-b3d0-190eec0ad527 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.345745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fefc1b6a-ff36-435b-b3d0-190eec0ad527 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.346389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fefc1b6a-ff36-435b-b3d0-190eec0ad527 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.347331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fefc1b6a-ff36-435b-b3d0-190eec0ad527 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.348577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fefc1b6a-ff36-435b-b3d0-190eec0ad527 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.349175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fefc1b6a-ff36-435b-b3d0-190eec0ad527 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.041897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Updating instance_info_cache with network_info: [{"id": "6edb64f1-120e-4ab2-81b6-c49027ad6cca", "address": "fa:16:3e:00:2e:e0", "network": {"id": "61d1d0bf-30e4-4740-8b71-20dd29f08efb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-462894479-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "197a6854a6a949b88eae7d185688d461", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6edb64f1-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122331) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:11:53.063509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Releasing lock "refresh_cache-5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:11:53.064378 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6a0abda3-9023-457c-81ce-65de89d51586 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "POST /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a/action" status: 202 len: 0 microversion: 2.1 time: 7.239758 Oct 04 18:11:53.065207 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1212/2465] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:45 2022] POST /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a/action => generated 0 bytes in 7241 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:11:53.068055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-fefc1b6a-ff36-435b-b3d0-190eec0ad527 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid 381cd7a0-7761-4e5b-8b7a-345f828634ea {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:53.080040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f91bfc93-9df6-432b-89a4-dce122ab4564 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:53.080683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f91bfc93-9df6-432b-89a4-dce122ab4564 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:53.097708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f91bfc93-9df6-432b-89a4-dce122ab4564 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.099131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f91bfc93-9df6-432b-89a4-dce122ab4564 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.101728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f91bfc93-9df6-432b-89a4-dce122ab4564 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.102706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f91bfc93-9df6-432b-89a4-dce122ab4564 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.103379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f91bfc93-9df6-432b-89a4-dce122ab4564 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.107298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f91bfc93-9df6-432b-89a4-dce122ab4564 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.132424 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fefc1b6a-ff36-435b-b3d0-190eec0ad527 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 2423 microversion: 2.25 time: 0.785187 Oct 04 18:11:53.133141 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1254/2466] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:52 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 2423 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:53.151565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c52abd95-7e3a-4798-958a-94804a8727e2 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:53.180642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c52abd95-7e3a-4798-958a-94804a8727e2 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:11:53.206104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c52abd95-7e3a-4798-958a-94804a8727e2 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.206546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c52abd95-7e3a-4798-958a-94804a8727e2 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.207026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c52abd95-7e3a-4798-958a-94804a8727e2 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.207779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c52abd95-7e3a-4798-958a-94804a8727e2 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.208247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c52abd95-7e3a-4798-958a-94804a8727e2 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.220607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c52abd95-7e3a-4798-958a-94804a8727e2 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.289485 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c52abd95-7e3a-4798-958a-94804a8727e2 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.155207 Oct 04 18:11:53.303070 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1255/2467] 10.222.0.18 () {58 vars in 1196 bytes} [Tue Oct 4 18:11:53 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:11:53.322040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-018bb5d3-86cc-4871-83dc-d1fb119eaced tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:53.323789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-018bb5d3-86cc-4871-83dc-d1fb119eaced tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:53.341405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-018bb5d3-86cc-4871-83dc-d1fb119eaced tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.342390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-018bb5d3-86cc-4871-83dc-d1fb119eaced tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.343193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-018bb5d3-86cc-4871-83dc-d1fb119eaced tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.344166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-018bb5d3-86cc-4871-83dc-d1fb119eaced tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.344867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-018bb5d3-86cc-4871-83dc-d1fb119eaced tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.345519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-018bb5d3-86cc-4871-83dc-d1fb119eaced tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.981018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f91bfc93-9df6-432b-89a4-dce122ab4564 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.988557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-018bb5d3-86cc-4871-83dc-d1fb119eaced tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.997620 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-018bb5d3-86cc-4871-83dc-d1fb119eaced tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1307 microversion: 2.1 time: 0.692975 Oct 04 18:11:54.000581 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1256/2468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:53 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1307 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:54.003160 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f91bfc93-9df6-432b-89a4-dce122ab4564 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1316 microversion: 2.1 time: 0.923893 Oct 04 18:11:54.018094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:54.019589 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1213/2469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:53 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1316 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:54.027034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.032531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850499-14", "block_migration": "auto"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:54.039447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.044652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.048182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.049786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.050157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.050565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.050715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.051462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.051596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.052259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.052895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.053573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.056143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.076474 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] HTTP exception thrown: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Request method failure captured: Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 HTTP/1.1 Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHb0Xn7O2H6qtWWRuyDzvAKvx9j2BBsecM5YL-vT2VmKZgbleT4kF7Ybj2sDjOzQJGPTuyRCbCXf1HQe2ikt4bGDdzRj8xKxKM6YZ6BGpvaxzlSzP0Vk08g4E5getivDlICenHvt6A90eSrFgvNIap_Isrrybp6zLxTiYvCyzqakN6o Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 197a6854a6a949b88eae7d185688d461 Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:11:54.079790 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_197a6854a6a949b88eae7d185688d461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/197a6854a6a949b88eae7d185688d461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/197a6854a6a949b88eae7d185688d461"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/197a6854a6a949b88eae7d185688d461"}]}] Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 197a6854a6a949b88eae7d185688d461 Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FloatingIPsAssociationTestJSON-1004452683-project Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: aa469d1847b5434eaa545db65834a323 Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1004452683-project Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. Oct 04 18:11:54.081480 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ad8ca046-dc23-46f1-85e5-ba07d44234c6'} Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:54.082320 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. Oct 04 18:11:54.083775 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:54.086301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Returning 404 to user: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:54.087459 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-45ac8d15-6818-4859-840d-5708fcf544d1 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 404 len: 111 microversion: 2.1 time: 0.083987 Oct 04 18:11:54.088771 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1257/2470] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:54 2022] DELETE /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:11:54.093968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ebecebc5-bc82-4cfa-8f0f-aa41dc9bd150 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:54.094879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ebecebc5-bc82-4cfa-8f0f-aa41dc9bd150 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.102092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebecebc5-bc82-4cfa-8f0f-aa41dc9bd150 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.102679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebecebc5-bc82-4cfa-8f0f-aa41dc9bd150 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.103302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebecebc5-bc82-4cfa-8f0f-aa41dc9bd150 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.104290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebecebc5-bc82-4cfa-8f0f-aa41dc9bd150 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.104951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebecebc5-bc82-4cfa-8f0f-aa41dc9bd150 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.105575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebecebc5-bc82-4cfa-8f0f-aa41dc9bd150 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.111253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'flavor' on Instance uuid 381cd7a0-7761-4e5b-8b7a-345f828634ea {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:54.129066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Going to try to live migrate instance to n-h1-850499-14 {{(pid=122331) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:11:54.430654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ebecebc5-bc82-4cfa-8f0f-aa41dc9bd150 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.458421 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ebecebc5-bc82-4cfa-8f0f-aa41dc9bd150 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1501 microversion: 2.1 time: 0.368291 Oct 04 18:11:54.482414 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1258/2471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:54 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1501 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:54.491618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-450104af-9d21-4e11-b489-1e094ea6b20f tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:54.494010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-450104af-9d21-4e11-b489-1e094ea6b20f tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.503092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-450104af-9d21-4e11-b489-1e094ea6b20f tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.504434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-450104af-9d21-4e11-b489-1e094ea6b20f tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.505235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-450104af-9d21-4e11-b489-1e094ea6b20f tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.506184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-450104af-9d21-4e11-b489-1e094ea6b20f tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.507563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-450104af-9d21-4e11-b489-1e094ea6b20f tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.508084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-450104af-9d21-4e11-b489-1e094ea6b20f tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.686807 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-450104af-9d21-4e11-b489-1e094ea6b20f tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action" status: 202 len: 0 microversion: 2.1 time: 0.202688 Oct 04 18:11:54.691174 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1259/2472] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:54 2022] POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:11:54.700796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:54.701435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: ad8ca046-dc23-46f1-85e5-ba07d44234c6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.717608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.718456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.719496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.721516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.724023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.725226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.757886 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] HTTP exception thrown: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Request method failure captured: Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 HTTP/1.1 Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHb0Xn7O2H6qtWWRuyDzvAKvx9j2BBsecM5YL-vT2VmKZgbleT4kF7Ybj2sDjOzQJGPTuyRCbCXf1HQe2ikt4bGDdzRj8xKxKM6YZ6BGpvaxzlSzP0Vk08g4E5getivDlICenHvt6A90eSrFgvNIap_Isrrybp6zLxTiYvCyzqakN6o Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 197a6854a6a949b88eae7d185688d461 Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:11:54.764600 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_197a6854a6a949b88eae7d185688d461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/197a6854a6a949b88eae7d185688d461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/197a6854a6a949b88eae7d185688d461"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/197a6854a6a949b88eae7d185688d461"}]}] Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 197a6854a6a949b88eae7d185688d461 Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FloatingIPsAssociationTestJSON-1004452683-project Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: aa469d1847b5434eaa545db65834a323 Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1004452683-project Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. Oct 04 18:11:54.766425 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ad8ca046-dc23-46f1-85e5-ba07d44234c6'} Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:54.767281 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. Oct 04 18:11:54.768505 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:11:54.770501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Returning 404 to user: Instance ad8ca046-dc23-46f1-85e5-ba07d44234c6 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:54.771783 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c14d0af-7e6b-4363-b27b-bba6f53d885e tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6" status: 404 len: 111 microversion: 2.1 time: 0.077371 Oct 04 18:11:54.772908 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1260/2473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:54 2022] GET /compute/v2.1/servers/ad8ca046-dc23-46f1-85e5-ba07d44234c6 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:11:54.778137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ff82263-6c49-4fd5-86c6-8d31021d3ab4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:54.778924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4ff82263-6c49-4fd5-86c6-8d31021d3ab4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.786608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ff82263-6c49-4fd5-86c6-8d31021d3ab4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.787437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ff82263-6c49-4fd5-86c6-8d31021d3ab4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.788085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ff82263-6c49-4fd5-86c6-8d31021d3ab4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.788993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ff82263-6c49-4fd5-86c6-8d31021d3ab4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.790119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ff82263-6c49-4fd5-86c6-8d31021d3ab4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.790712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ff82263-6c49-4fd5-86c6-8d31021d3ab4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.824684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-4ff82263-6c49-4fd5-86c6-8d31021d3ab4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'flavor' on Instance uuid b5d14a05-8a0f-4911-af5e-e84c9e8076cf {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:55.131288 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ff82263-6c49-4fd5-86c6-8d31021d3ab4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf/action" status: 202 len: 0 microversion: 2.1 time: 0.355405 Oct 04 18:11:55.133370 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1261/2474] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:54 2022] POST /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:11:55.146107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c48c37dc-0c1a-45b3-bb9e-228ed080cd24 req-631a7711-2307-4eb1-963e-f93e3e3c0dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7", "tag": "dd7953c5-2924-4e62-b2a5-ee3d29567612"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:55.187658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c48c37dc-0c1a-45b3-bb9e-228ed080cd24 req-631a7711-2307-4eb1-963e-f93e3e3c0dc5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.188848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c48c37dc-0c1a-45b3-bb9e-228ed080cd24 req-631a7711-2307-4eb1-963e-f93e3e3c0dc5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.189577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c48c37dc-0c1a-45b3-bb9e-228ed080cd24 req-631a7711-2307-4eb1-963e-f93e3e3c0dc5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.226123 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c48c37dc-0c1a-45b3-bb9e-228ed080cd24 req-631a7711-2307-4eb1-963e-f93e3e3c0dc5 service nova] Creating event network-changed:dd7953c5-2924-4e62-b2a5-ee3d29567612 for instance 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 on n-h1-850499-14 Oct 04 18:11:55.238745 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c48c37dc-0c1a-45b3-bb9e-228ed080cd24 req-631a7711-2307-4eb1-963e-f93e3e3c0dc5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102099 Oct 04 18:11:55.239782 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1262/2475] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:55.372479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-319821006", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "90fa0345-6116-4bb1-a4ac-8968ad10f40c"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:55.505826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] validate_networks() for [('90fa0345-6116-4bb1-a4ac-8968ad10f40c', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:56.355546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:56.356104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:56.357275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:56.357696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:56.358179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:56.406049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.420762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.422104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.425630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.445787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.447674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.528940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Getting quotas for project 7ada5850074c4165815bcddf248aa35b. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:56.539882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Getting quotas for user 89286c3fcbc6461dab027b06df6cfaed and project 7ada5850074c4165815bcddf248aa35b. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:56.557815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:56.560562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:56.658187 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-068492ca-c73c-40e8-88e6-0d44ce9d395c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.412529 Oct 04 18:11:56.659470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1263/2476] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:56.673527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:56.678629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:56.703583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.705715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.706877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.708894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.710016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.711188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.727245 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9fc6bbfb-ae84-48f2-a6ea-c8fb39a14af9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/action" status: 202 len: 0 microversion: 2.25 time: 2.705539 Oct 04 18:11:56.728225 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1214/2477] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:11:54 2022] POST /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/action => generated 0 bytes in 2708 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:56.735016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-803b453e-d2b0-46ca-ac20-a2bea06ac383 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '.version_select at 0x7fd4d1f52a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:56.838500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:56.839470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:56.840201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:56.840836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:56.841493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:57.003942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:57.015511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.018452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.019357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.020272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.021349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.021884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.079324 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a5af8bc-45e8-4983-89ee-619409ab3466 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action" status: 202 len: 1066 microversion: 2.1 time: 0.418423 Oct 04 18:11:57.080510 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1264/2478] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:56 2022] POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action => generated 1066 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:11:57.088126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5a182333-2108-4f19-a0f0-4c2e14f23357 req-511368b1-e4ff-4846-8902-45a333cbaead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f181126-dac5-443e-be03-5027f1a63479", "tag": "e9bdd62f-fcc9-4109-8f33-80a3d42a1b46"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:57.107072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a182333-2108-4f19-a0f0-4c2e14f23357 req-511368b1-e4ff-4846-8902-45a333cbaead service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.108283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a182333-2108-4f19-a0f0-4c2e14f23357 req-511368b1-e4ff-4846-8902-45a333cbaead service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.110029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a182333-2108-4f19-a0f0-4c2e14f23357 req-511368b1-e4ff-4846-8902-45a333cbaead service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.124475 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5a182333-2108-4f19-a0f0-4c2e14f23357 req-511368b1-e4ff-4846-8902-45a333cbaead service nova] Creating event network-changed:e9bdd62f-fcc9-4109-8f33-80a3d42a1b46 for instance 0f181126-dac5-443e-be03-5027f1a63479 on n-h1-850499-14 Oct 04 18:11:57.130352 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5a182333-2108-4f19-a0f0-4c2e14f23357 req-511368b1-e4ff-4846-8902-45a333cbaead service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048383 Oct 04 18:11:57.131154 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1265/2479] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:57.146991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ccdaa4a3-b30f-454b-bf5f-b7d8614d2c0a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:57.151156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ccdaa4a3-b30f-454b-bf5f-b7d8614d2c0a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:57.164987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccdaa4a3-b30f-454b-bf5f-b7d8614d2c0a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.166329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccdaa4a3-b30f-454b-bf5f-b7d8614d2c0a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.166992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccdaa4a3-b30f-454b-bf5f-b7d8614d2c0a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.167863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccdaa4a3-b30f-454b-bf5f-b7d8614d2c0a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.168435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccdaa4a3-b30f-454b-bf5f-b7d8614d2c0a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.168987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccdaa4a3-b30f-454b-bf5f-b7d8614d2c0a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.033084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ccdaa4a3-b30f-454b-bf5f-b7d8614d2c0a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:58.049338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:58.057888 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ccdaa4a3-b30f-454b-bf5f-b7d8614d2c0a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1307 microversion: 2.1 time: 0.925162 Oct 04 18:11:58.063897 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1266/2480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:57 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1307 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:58.081935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5bc427ee-eb2d-4a84-aebf-9a02822af880 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:58.085034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5bc427ee-eb2d-4a84-aebf-9a02822af880 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:58.111660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bc427ee-eb2d-4a84-aebf-9a02822af880 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.112486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bc427ee-eb2d-4a84-aebf-9a02822af880 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.113047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bc427ee-eb2d-4a84-aebf-9a02822af880 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.116994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bc427ee-eb2d-4a84-aebf-9a02822af880 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.117884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bc427ee-eb2d-4a84-aebf-9a02822af880 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.118440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bc427ee-eb2d-4a84-aebf-9a02822af880 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.000165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5bc427ee-eb2d-4a84-aebf-9a02822af880 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.014522 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5bc427ee-eb2d-4a84-aebf-9a02822af880 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1316 microversion: 2.1 time: 0.948331 Oct 04 18:11:59.016860 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1267/2481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:58 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1316 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:59.030114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-90374916-52ff-4f47-afa6-c547eff87aef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:59.033435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-90374916-52ff-4f47-afa6-c547eff87aef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:59.049100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90374916-52ff-4f47-afa6-c547eff87aef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.052930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90374916-52ff-4f47-afa6-c547eff87aef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.055208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90374916-52ff-4f47-afa6-c547eff87aef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.057003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90374916-52ff-4f47-afa6-c547eff87aef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.058002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90374916-52ff-4f47-afa6-c547eff87aef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.060389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90374916-52ff-4f47-afa6-c547eff87aef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.699077 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-803b453e-d2b0-46ca-ac20-a2bea06ac383 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/c3de872c-c99a-4da5-bbfc-21b22b857d55" status: 202 len: 0 microversion: 2.1 time: 2.968512 Oct 04 18:11:59.707387 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1215/2482] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:11:56 2022] DELETE /compute/v2.1/os-floating-ips/c3de872c-c99a-4da5-bbfc-21b22b857d55 => generated 0 bytes in 2978 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:11:59.727848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3cf9a063-5f43-4ec8-9bdc-71303524098a tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:59.728818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3cf9a063-5f43-4ec8-9bdc-71303524098a tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:59.737351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cf9a063-5f43-4ec8-9bdc-71303524098a tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.738112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cf9a063-5f43-4ec8-9bdc-71303524098a tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.738776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cf9a063-5f43-4ec8-9bdc-71303524098a tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.741208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cf9a063-5f43-4ec8-9bdc-71303524098a tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.742392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cf9a063-5f43-4ec8-9bdc-71303524098a tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.742529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cf9a063-5f43-4ec8-9bdc-71303524098a tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.899370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3cf9a063-5f43-4ec8-9bdc-71303524098a tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.903360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=7,nova_cell1:RELEASE=2,nova_cell1:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:59.908446 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3cf9a063-5f43-4ec8-9bdc-71303524098a tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1273 microversion: 2.1 time: 0.198992 Oct 04 18:11:59.919877 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1216/2483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:59 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:00.065243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90374916-52ff-4f47-afa6-c547eff87aef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.076670 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-90374916-52ff-4f47-afa6-c547eff87aef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 1.058549 Oct 04 18:12:00.076886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.078065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.078801 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1268/2484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:59 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:00.090299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ad47ea01-cd4a-4ff0-9c01-cdf1d2140c21 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.090516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.090883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.091361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.092168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.092635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.092980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ad47ea01-cd4a-4ff0-9c01-cdf1d2140c21 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.093124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.103931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad47ea01-cd4a-4ff0-9c01-cdf1d2140c21 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.105026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad47ea01-cd4a-4ff0-9c01-cdf1d2140c21 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.107892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad47ea01-cd4a-4ff0-9c01-cdf1d2140c21 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.109413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad47ea01-cd4a-4ff0-9c01-cdf1d2140c21 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.110091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad47ea01-cd4a-4ff0-9c01-cdf1d2140c21 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.110774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad47ea01-cd4a-4ff0-9c01-cdf1d2140c21 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.406998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ad47ea01-cd4a-4ff0-9c01-cdf1d2140c21 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.426778 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ad47ea01-cd4a-4ff0-9c01-cdf1d2140c21 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1470 microversion: 2.1 time: 0.342221 Oct 04 18:12:00.429546 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1269/2485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:00 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1470 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:00.442093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8e3e389a-375e-40cd-a451-3bf9a9c62b2f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.448689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8e3e389a-375e-40cd-a451-3bf9a9c62b2f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.476132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e3e389a-375e-40cd-a451-3bf9a9c62b2f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.477429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e3e389a-375e-40cd-a451-3bf9a9c62b2f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.478213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e3e389a-375e-40cd-a451-3bf9a9c62b2f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.481370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e3e389a-375e-40cd-a451-3bf9a9c62b2f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.482086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e3e389a-375e-40cd-a451-3bf9a9c62b2f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.482871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e3e389a-375e-40cd-a451-3bf9a9c62b2f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.500642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.516607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.519456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.522613 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ec7c2373-4389-449c-a06c-be23143086ee tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.607605 Oct 04 18:12:00.526290 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1217/2486] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:59 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:00.543957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01b845ca-0b24-4bc9-87bc-7dda495cdf3c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.544461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01b845ca-0b24-4bc9-87bc-7dda495cdf3c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.569571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01b845ca-0b24-4bc9-87bc-7dda495cdf3c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.570386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01b845ca-0b24-4bc9-87bc-7dda495cdf3c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.571256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01b845ca-0b24-4bc9-87bc-7dda495cdf3c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.572209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01b845ca-0b24-4bc9-87bc-7dda495cdf3c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.572870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01b845ca-0b24-4bc9-87bc-7dda495cdf3c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.573515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01b845ca-0b24-4bc9-87bc-7dda495cdf3c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.601345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01b845ca-0b24-4bc9-87bc-7dda495cdf3c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:12:00.754231 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01b845ca-0b24-4bc9-87bc-7dda495cdf3c tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 204 len: 0 microversion: 2.1 time: 0.226394 Oct 04 18:12:00.756028 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1218/2487] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:00 2022] DELETE /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:00.762935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f829fed7-a444-40f6-ad81-ad872270b4a8 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.771857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f829fed7-a444-40f6-ad81-ad872270b4a8 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.791800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f829fed7-a444-40f6-ad81-ad872270b4a8 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.792584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f829fed7-a444-40f6-ad81-ad872270b4a8 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.793259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f829fed7-a444-40f6-ad81-ad872270b4a8 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.794540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f829fed7-a444-40f6-ad81-ad872270b4a8 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.795261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f829fed7-a444-40f6-ad81-ad872270b4a8 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.795911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f829fed7-a444-40f6-ad81-ad872270b4a8 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.836709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8e3e389a-375e-40cd-a451-3bf9a9c62b2f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.844703 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8e3e389a-375e-40cd-a451-3bf9a9c62b2f tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1307 microversion: 2.1 time: 0.413657 Oct 04 18:12:00.859040 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1270/2488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:00 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1307 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:00.864411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-81efb5a9-67bb-483c-afe3-d3d9ca4a8c62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.865269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-81efb5a9-67bb-483c-afe3-d3d9ca4a8c62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.872930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81efb5a9-67bb-483c-afe3-d3d9ca4a8c62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.873441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81efb5a9-67bb-483c-afe3-d3d9ca4a8c62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.873901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81efb5a9-67bb-483c-afe3-d3d9ca4a8c62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.874751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81efb5a9-67bb-483c-afe3-d3d9ca4a8c62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.875220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81efb5a9-67bb-483c-afe3-d3d9ca4a8c62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.875650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81efb5a9-67bb-483c-afe3-d3d9ca4a8c62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.210718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f829fed7-a444-40f6-ad81-ad872270b4a8 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.221013 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f829fed7-a444-40f6-ad81-ad872270b4a8 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1316 microversion: 2.1 time: 0.463390 Oct 04 18:12:01.236940 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1219/2489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:00 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:01.244057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8298e5ea-28f0-4bc4-8471-370fe50254e6 req-5d021c57-e22f-4e5c-bf13-7502bcce4a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7", "name": "network-vif-plugged", "status": "completed", "tag": "dd7953c5-2924-4e62-b2a5-ee3d29567612"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:01.245924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-81efb5a9-67bb-483c-afe3-d3d9ca4a8c62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.261726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8298e5ea-28f0-4bc4-8471-370fe50254e6 req-5d021c57-e22f-4e5c-bf13-7502bcce4a77 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.262587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8298e5ea-28f0-4bc4-8471-370fe50254e6 req-5d021c57-e22f-4e5c-bf13-7502bcce4a77 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.263265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8298e5ea-28f0-4bc4-8471-370fe50254e6 req-5d021c57-e22f-4e5c-bf13-7502bcce4a77 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.263998 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-81efb5a9-67bb-483c-afe3-d3d9ca4a8c62 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1525 microversion: 2.1 time: 0.400375 Oct 04 18:12:01.267595 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1271/2490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:00 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1525 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:01.276645 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8298e5ea-28f0-4bc4-8471-370fe50254e6 req-5d021c57-e22f-4e5c-bf13-7502bcce4a77 service nova] Creating event network-vif-plugged:dd7953c5-2924-4e62-b2a5-ee3d29567612 for instance 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 on n-h1-850499-14 Oct 04 18:12:01.283863 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8298e5ea-28f0-4bc4-8471-370fe50254e6 req-5d021c57-e22f-4e5c-bf13-7502bcce4a77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044748 Oct 04 18:12:01.284962 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1220/2491] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:01.288398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-26d3873f-ed76-44cd-8f3c-8a6b1f587738 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.290358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d48da55e-3e80-4c93-b314-ecbf600b94b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.292467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d48da55e-3e80-4c93-b314-ecbf600b94b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.293160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-26d3873f-ed76-44cd-8f3c-8a6b1f587738 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.301164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d48da55e-3e80-4c93-b314-ecbf600b94b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.301964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d48da55e-3e80-4c93-b314-ecbf600b94b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.302662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d48da55e-3e80-4c93-b314-ecbf600b94b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.303657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d48da55e-3e80-4c93-b314-ecbf600b94b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.304323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d48da55e-3e80-4c93-b314-ecbf600b94b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.305238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d48da55e-3e80-4c93-b314-ecbf600b94b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.319131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26d3873f-ed76-44cd-8f3c-8a6b1f587738 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.320240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26d3873f-ed76-44cd-8f3c-8a6b1f587738 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.321022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26d3873f-ed76-44cd-8f3c-8a6b1f587738 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.322053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26d3873f-ed76-44cd-8f3c-8a6b1f587738 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.322858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26d3873f-ed76-44cd-8f3c-8a6b1f587738 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.323572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26d3873f-ed76-44cd-8f3c-8a6b1f587738 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.830028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-26d3873f-ed76-44cd-8f3c-8a6b1f587738 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.846478 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-26d3873f-ed76-44cd-8f3c-8a6b1f587738 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.575371 Oct 04 18:12:01.859066 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1272/2492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:01.866789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e15612ae-e09b-4ea7-a4b3-81674106a569 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.866789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e15612ae-e09b-4ea7-a4b3-81674106a569 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.885107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e15612ae-e09b-4ea7-a4b3-81674106a569 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.888699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e15612ae-e09b-4ea7-a4b3-81674106a569 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.889308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e15612ae-e09b-4ea7-a4b3-81674106a569 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.890221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e15612ae-e09b-4ea7-a4b3-81674106a569 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.893563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e15612ae-e09b-4ea7-a4b3-81674106a569 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.894112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e15612ae-e09b-4ea7-a4b3-81674106a569 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.000117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d48da55e-3e80-4c93-b314-ecbf600b94b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.014477 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d48da55e-3e80-4c93-b314-ecbf600b94b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.727880 Oct 04 18:12:02.015614 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1221/2493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:02.029080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:02.029487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:02.045501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.046825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.047897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.049722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.050713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.051434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.210570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e15612ae-e09b-4ea7-a4b3-81674106a569 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.226137 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e15612ae-e09b-4ea7-a4b3-81674106a569 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1470 microversion: 2.1 time: 0.374431 Oct 04 18:12:02.227074 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1273/2494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1470 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:02.232949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-da22e548-c60a-41b8-b34c-da09bd0ad430 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:02.234442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-da22e548-c60a-41b8-b34c-da09bd0ad430 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:02.245646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da22e548-c60a-41b8-b34c-da09bd0ad430 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.246672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da22e548-c60a-41b8-b34c-da09bd0ad430 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.248548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da22e548-c60a-41b8-b34c-da09bd0ad430 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.249955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da22e548-c60a-41b8-b34c-da09bd0ad430 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.251457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da22e548-c60a-41b8-b34c-da09bd0ad430 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.252111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da22e548-c60a-41b8-b34c-da09bd0ad430 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.255929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.271699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.273576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.275184 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9f4fedf1-cf21-41f6-b97f-fd9019d31b29 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.251238 Oct 04 18:12:02.276097 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1222/2495] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:02 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:02.289006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1e4417d-dd2b-4cf3-b62f-fd94d002509e tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:02.290578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e1e4417d-dd2b-4cf3-b62f-fd94d002509e tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:02.307142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e4417d-dd2b-4cf3-b62f-fd94d002509e tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.308021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e4417d-dd2b-4cf3-b62f-fd94d002509e tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.309050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e4417d-dd2b-4cf3-b62f-fd94d002509e tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.312003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e4417d-dd2b-4cf3-b62f-fd94d002509e tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.312705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e4417d-dd2b-4cf3-b62f-fd94d002509e tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.315181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e4417d-dd2b-4cf3-b62f-fd94d002509e tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.496539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1e4417d-dd2b-4cf3-b62f-fd94d002509e tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.505345 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1e4417d-dd2b-4cf3-b62f-fd94d002509e tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1316 microversion: 2.1 time: 0.226771 Oct 04 18:12:02.506661 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1223/2496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:02 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:02.514609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d5e5278b-7fdb-4091-ba4b-b5da322e6e3f tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:02.515644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d5e5278b-7fdb-4091-ba4b-b5da322e6e3f tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:02.533810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5e5278b-7fdb-4091-ba4b-b5da322e6e3f tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.534416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5e5278b-7fdb-4091-ba4b-b5da322e6e3f tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.534990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5e5278b-7fdb-4091-ba4b-b5da322e6e3f tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.535800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5e5278b-7fdb-4091-ba4b-b5da322e6e3f tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.538241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5e5278b-7fdb-4091-ba4b-b5da322e6e3f tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.538806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5e5278b-7fdb-4091-ba4b-b5da322e6e3f tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.669712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-da22e548-c60a-41b8-b34c-da09bd0ad430 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.684171 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-da22e548-c60a-41b8-b34c-da09bd0ad430 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1307 microversion: 2.1 time: 0.455516 Oct 04 18:12:02.700464 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1274/2497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:02 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1307 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:02.871838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1c5331f-b810-4310-b10a-de70db365e82 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:02.872479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1c5331f-b810-4310-b10a-de70db365e82 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:02.881021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1c5331f-b810-4310-b10a-de70db365e82 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.881592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1c5331f-b810-4310-b10a-de70db365e82 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.881986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1c5331f-b810-4310-b10a-de70db365e82 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.882735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1c5331f-b810-4310-b10a-de70db365e82 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.883257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1c5331f-b810-4310-b10a-de70db365e82 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.883698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1c5331f-b810-4310-b10a-de70db365e82 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.011886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d5e5278b-7fdb-4091-ba4b-b5da322e6e3f tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.033635 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d5e5278b-7fdb-4091-ba4b-b5da322e6e3f tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1525 microversion: 2.1 time: 0.525167 Oct 04 18:12:03.037558 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1224/2498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:02 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1525 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:03.059325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-edda701c-25b5-4a9d-a0e5-d6cdbc81195a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.064097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-edda701c-25b5-4a9d-a0e5-d6cdbc81195a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.076604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edda701c-25b5-4a9d-a0e5-d6cdbc81195a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.078278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edda701c-25b5-4a9d-a0e5-d6cdbc81195a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.078893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edda701c-25b5-4a9d-a0e5-d6cdbc81195a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.079826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edda701c-25b5-4a9d-a0e5-d6cdbc81195a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.080432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edda701c-25b5-4a9d-a0e5-d6cdbc81195a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.081029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edda701c-25b5-4a9d-a0e5-d6cdbc81195a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.301224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e1c5331f-b810-4310-b10a-de70db365e82 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.314901 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1c5331f-b810-4310-b10a-de70db365e82 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.446943 Oct 04 18:12:03.317474 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1275/2499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:02 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:03.322603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b2137e6-c35e-4999-84ef-9429bfe3a6e7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.323483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b2137e6-c35e-4999-84ef-9429bfe3a6e7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.338215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2137e6-c35e-4999-84ef-9429bfe3a6e7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.340368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2137e6-c35e-4999-84ef-9429bfe3a6e7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.341643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2137e6-c35e-4999-84ef-9429bfe3a6e7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.344412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2137e6-c35e-4999-84ef-9429bfe3a6e7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.345062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2137e6-c35e-4999-84ef-9429bfe3a6e7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.345637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b2137e6-c35e-4999-84ef-9429bfe3a6e7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.354205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-edda701c-25b5-4a9d-a0e5-d6cdbc81195a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.369007 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-edda701c-25b5-4a9d-a0e5-d6cdbc81195a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.325629 Oct 04 18:12:03.371449 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1225/2500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:03.392905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.393634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.400069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.400853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.401518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.402585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.403265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.403885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.895153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7b2137e6-c35e-4999-84ef-9429bfe3a6e7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.905404 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b2137e6-c35e-4999-84ef-9429bfe3a6e7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1470 microversion: 2.1 time: 0.586624 Oct 04 18:12:03.907045 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1276/2501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1470 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:03.912857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d6b8f469-e101-47e7-9ab7-cc4b5e20a754 req-df4e9664-26a8-4b39-ab2b-a77960a976ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f181126-dac5-443e-be03-5027f1a63479", "name": "network-vif-plugged", "status": "completed", "tag": "e9bdd62f-fcc9-4109-8f33-80a3d42a1b46"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:03.925657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:03.928501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d6b8f469-e101-47e7-9ab7-cc4b5e20a754 req-df4e9664-26a8-4b39-ab2b-a77960a976ba service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.929059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d6b8f469-e101-47e7-9ab7-cc4b5e20a754 req-df4e9664-26a8-4b39-ab2b-a77960a976ba service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.929560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d6b8f469-e101-47e7-9ab7-cc4b5e20a754 req-df4e9664-26a8-4b39-ab2b-a77960a976ba service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.946838 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d6b8f469-e101-47e7-9ab7-cc4b5e20a754 req-df4e9664-26a8-4b39-ab2b-a77960a976ba service nova] Creating event network-vif-plugged:e9bdd62f-fcc9-4109-8f33-80a3d42a1b46 for instance 0f181126-dac5-443e-be03-5027f1a63479 on n-h1-850499-14 Oct 04 18:12:03.953098 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d6b8f469-e101-47e7-9ab7-cc4b5e20a754 req-df4e9664-26a8-4b39-ab2b-a77960a976ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043644 Oct 04 18:12:03.953991 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1277/2502] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:03.959939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-27fdb1a2-ff5d-44d6-9b64-24b0c1a2ee96 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.960733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-27fdb1a2-ff5d-44d6-9b64-24b0c1a2ee96 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.968059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27fdb1a2-ff5d-44d6-9b64-24b0c1a2ee96 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.968660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27fdb1a2-ff5d-44d6-9b64-24b0c1a2ee96 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.969171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27fdb1a2-ff5d-44d6-9b64-24b0c1a2ee96 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.969955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27fdb1a2-ff5d-44d6-9b64-24b0c1a2ee96 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.971361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27fdb1a2-ff5d-44d6-9b64-24b0c1a2ee96 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.971968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27fdb1a2-ff5d-44d6-9b64-24b0c1a2ee96 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.997018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.012848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.017559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.020658 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7bb50ffc-0448-4e19-a046-566d49486c0a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.647196 Oct 04 18:12:04.023632 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1226/2503] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:04.039770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2276d6a4-97ac-4505-83ea-2f0401589a2d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.039770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2276d6a4-97ac-4505-83ea-2f0401589a2d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.039770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2276d6a4-97ac-4505-83ea-2f0401589a2d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.039770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2276d6a4-97ac-4505-83ea-2f0401589a2d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.040084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2276d6a4-97ac-4505-83ea-2f0401589a2d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.040084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2276d6a4-97ac-4505-83ea-2f0401589a2d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.040342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2276d6a4-97ac-4505-83ea-2f0401589a2d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.040951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2276d6a4-97ac-4505-83ea-2f0401589a2d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.522372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2276d6a4-97ac-4505-83ea-2f0401589a2d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.540288 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2276d6a4-97ac-4505-83ea-2f0401589a2d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1307 microversion: 2.1 time: 0.515511 Oct 04 18:12:04.541232 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1227/2504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1307 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:04.553228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4817edac-9806-47a5-a1c5-d31c383e1e8c req-e04ef845-6f2b-4d81-bff3-003387ac016a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f64a66b-6e31-45ef-a711-60c9e8f0ec3a", "name": "network-vif-deleted", "tag": "6edb64f1-120e-4ab2-81b6-c49027ad6cca"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:04.593123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4817edac-9806-47a5-a1c5-d31c383e1e8c req-e04ef845-6f2b-4d81-bff3-003387ac016a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.594062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4817edac-9806-47a5-a1c5-d31c383e1e8c req-e04ef845-6f2b-4d81-bff3-003387ac016a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.594902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4817edac-9806-47a5-a1c5-d31c383e1e8c req-e04ef845-6f2b-4d81-bff3-003387ac016a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.609941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-27fdb1a2-ff5d-44d6-9b64-24b0c1a2ee96 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.627398 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-27fdb1a2-ff5d-44d6-9b64-24b0c1a2ee96 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1503 microversion: 2.1 time: 0.671546 Oct 04 18:12:04.639461 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4817edac-9806-47a5-a1c5-d31c383e1e8c req-e04ef845-6f2b-4d81-bff3-003387ac016a service nova] Creating event network-vif-deleted:6edb64f1-120e-4ab2-81b6-c49027ad6cca for instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a on n-h2-850499-14 Oct 04 18:12:04.642204 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1278/2505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1503 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:04.651304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4817edac-9806-47a5-a1c5-d31c383e1e8c req-e04ef845-6f2b-4d81-bff3-003387ac016a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108325 Oct 04 18:12:04.655192 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1228/2506] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:04.661517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b470227a-8719-47b8-ac4e-bbf147cca7cc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.662260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b470227a-8719-47b8-ac4e-bbf147cca7cc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.668150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.668851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.671831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b470227a-8719-47b8-ac4e-bbf147cca7cc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.672704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b470227a-8719-47b8-ac4e-bbf147cca7cc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.673194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b470227a-8719-47b8-ac4e-bbf147cca7cc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.674289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b470227a-8719-47b8-ac4e-bbf147cca7cc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.674812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b470227a-8719-47b8-ac4e-bbf147cca7cc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.675279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b470227a-8719-47b8-ac4e-bbf147cca7cc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.683441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.683959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.684418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.687376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.687903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.688345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.736667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.737425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.738113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.738753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lazy-loading 'fault' on Instance uuid 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:04.809910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa469d1847b5434eaa545db65834a323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197a6854a6a949b88eae7d185688d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.849061 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0f9e29e6-1fff-4e0e-9a73-90e4873de2b7 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 200 len: 1314 microversion: 2.1 time: 0.205000 Oct 04 18:12:04.853093 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1279/2507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:04.859346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ae12a6f-cb62-4b24-9606-3b84cd0673c3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.859967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8ae12a6f-cb62-4b24-9606-3b84cd0673c3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.866639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ae12a6f-cb62-4b24-9606-3b84cd0673c3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.867140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ae12a6f-cb62-4b24-9606-3b84cd0673c3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.867584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ae12a6f-cb62-4b24-9606-3b84cd0673c3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.868422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ae12a6f-cb62-4b24-9606-3b84cd0673c3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.869797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ae12a6f-cb62-4b24-9606-3b84cd0673c3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.870257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ae12a6f-cb62-4b24-9606-3b84cd0673c3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.938616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b470227a-8719-47b8-ac4e-bbf147cca7cc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.947732 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b470227a-8719-47b8-ac4e-bbf147cca7cc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.290904 Oct 04 18:12:04.963652 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1229/2508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:04.971095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-615d806e-1194-41db-a5e9-869c98fed155 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.971887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-615d806e-1194-41db-a5e9-869c98fed155 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.979069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-615d806e-1194-41db-a5e9-869c98fed155 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.979896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-615d806e-1194-41db-a5e9-869c98fed155 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.980508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-615d806e-1194-41db-a5e9-869c98fed155 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.981461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-615d806e-1194-41db-a5e9-869c98fed155 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.982264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-615d806e-1194-41db-a5e9-869c98fed155 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.982914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-615d806e-1194-41db-a5e9-869c98fed155 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.013566 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-615d806e-1194-41db-a5e9-869c98fed155 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7/ips" status: 200 len: 107 microversion: 2.1 time: 0.048298 Oct 04 18:12:05.015576 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1230/2509] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7/ips => generated 107 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:05.034158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fbb9fbec-7225-429a-a4d4-1e616736306a req-a7dfd378-d834-4ca0-96a7-e4160ef262d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f3ca20-9d90-425f-9377-096532e41db4", "tag": "6548269f-7daa-41dd-a98b-109dc9ef6c4e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:05.046474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fbb9fbec-7225-429a-a4d4-1e616736306a req-a7dfd378-d834-4ca0-96a7-e4160ef262d8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.047629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fbb9fbec-7225-429a-a4d4-1e616736306a req-a7dfd378-d834-4ca0-96a7-e4160ef262d8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.048266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fbb9fbec-7225-429a-a4d4-1e616736306a req-a7dfd378-d834-4ca0-96a7-e4160ef262d8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.062704 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fbb9fbec-7225-429a-a4d4-1e616736306a req-a7dfd378-d834-4ca0-96a7-e4160ef262d8 service nova] Creating event network-changed:6548269f-7daa-41dd-a98b-109dc9ef6c4e for instance 32f3ca20-9d90-425f-9377-096532e41db4 on n-h2-850499-14 Oct 04 18:12:05.071085 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fbb9fbec-7225-429a-a4d4-1e616736306a req-a7dfd378-d834-4ca0-96a7-e4160ef262d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053990 Oct 04 18:12:05.087717 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1231/2510] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:05.097165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac2218e1-ba23-420c-a800-f4eb944caf01 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.103302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ac2218e1-ba23-420c-a800-f4eb944caf01 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.120701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2218e1-ba23-420c-a800-f4eb944caf01 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.121450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2218e1-ba23-420c-a800-f4eb944caf01 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.122284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2218e1-ba23-420c-a800-f4eb944caf01 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.125957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2218e1-ba23-420c-a800-f4eb944caf01 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.126789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2218e1-ba23-420c-a800-f4eb944caf01 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.127447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2218e1-ba23-420c-a800-f4eb944caf01 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.198809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8ae12a6f-cb62-4b24-9606-3b84cd0673c3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:05.211076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8ae12a6f-cb62-4b24-9606-3b84cd0673c3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.356644 Oct 04 18:12:05.227252 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1280/2511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:05.240744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.241414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.251590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.252156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.252714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.253458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.253933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.254369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.529788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ac2218e1-ba23-420c-a800-f4eb944caf01 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:05.539978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:05.544244 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ac2218e1-ba23-420c-a800-f4eb944caf01 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1470 microversion: 2.1 time: 0.454080 Oct 04 18:12:05.545151 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1232/2512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1470 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:05.552461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e2c99136-4be2-445c-ae90-5e3c9b35c680 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.554088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e2c99136-4be2-445c-ae90-5e3c9b35c680 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.561549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2c99136-4be2-445c-ae90-5e3c9b35c680 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.563920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2c99136-4be2-445c-ae90-5e3c9b35c680 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.564839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2c99136-4be2-445c-ae90-5e3c9b35c680 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.565627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:05.566296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2c99136-4be2-445c-ae90-5e3c9b35c680 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.567031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2c99136-4be2-445c-ae90-5e3c9b35c680 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.567144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:05.567796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2c99136-4be2-445c-ae90-5e3c9b35c680 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.568364 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ed48635-c271-45e7-a474-4c20773275c2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.345473 Oct 04 18:12:05.571477 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1281/2513] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:05.582887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a7fc7c9-4397-4d6f-8b4f-f6ebb0fb35dd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.583831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a7fc7c9-4397-4d6f-8b4f-f6ebb0fb35dd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.599741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7fc7c9-4397-4d6f-8b4f-f6ebb0fb35dd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.600571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7fc7c9-4397-4d6f-8b4f-f6ebb0fb35dd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.602317 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e2c99136-4be2-445c-ae90-5e3c9b35c680 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7/ips" status: 200 len: 107 microversion: 2.1 time: 0.055581 Oct 04 18:12:05.603755 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1233/2514] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7/ips => generated 107 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:05.610398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7fc7c9-4397-4d6f-8b4f-f6ebb0fb35dd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.611144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7fc7c9-4397-4d6f-8b4f-f6ebb0fb35dd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.611636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7fc7c9-4397-4d6f-8b4f-f6ebb0fb35dd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.612080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7fc7c9-4397-4d6f-8b4f-f6ebb0fb35dd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.618645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5b404b1a-bcc8-43c2-a32e-b63759ecd761 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.619581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5b404b1a-bcc8-43c2-a32e-b63759ecd761 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.630607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b404b1a-bcc8-43c2-a32e-b63759ecd761 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.631543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b404b1a-bcc8-43c2-a32e-b63759ecd761 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.632211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b404b1a-bcc8-43c2-a32e-b63759ecd761 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.633335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b404b1a-bcc8-43c2-a32e-b63759ecd761 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.634530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b404b1a-bcc8-43c2-a32e-b63759ecd761 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.635365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b404b1a-bcc8-43c2-a32e-b63759ecd761 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.668624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:05.680797 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5b404b1a-bcc8-43c2-a32e-b63759ecd761 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7/ips/tempest-ServerAddressesTestJSON-70718399-network" status: 200 len: 92 microversion: 2.1 time: 0.070045 Oct 04 18:12:05.682166 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1234/2515] 10.222.0.18 () {58 vars in 1395 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7/ips/tempest-ServerAddressesTestJSON-70718399-network => generated 92 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:12:05.695842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-09d5b554-3398-44ce-9ac6-08a7d949a683 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.696771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-09d5b554-3398-44ce-9ac6-08a7d949a683 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.705726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d5b554-3398-44ce-9ac6-08a7d949a683 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.706818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d5b554-3398-44ce-9ac6-08a7d949a683 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.707540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d5b554-3398-44ce-9ac6-08a7d949a683 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.708549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d5b554-3398-44ce-9ac6-08a7d949a683 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.709433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d5b554-3398-44ce-9ac6-08a7d949a683 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.710126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d5b554-3398-44ce-9ac6-08a7d949a683 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.767012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-09d5b554-3398-44ce-9ac6-08a7d949a683 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:12:05.897608 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-09d5b554-3398-44ce-9ac6-08a7d949a683 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 204 len: 0 microversion: 2.1 time: 0.206076 Oct 04 18:12:05.901242 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1235/2516] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:05 2022] DELETE /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:12:05.904989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.905836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] [instance: 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.912730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.913442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.914402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.914849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.915367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.915808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.934185 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] HTTP exception thrown: Instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a could not be found. Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Request method failure captured: Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a HTTP/1.1 Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHb0Xn7O2H6qtWWRuyDzvAKvx9j2BBsecM5YL-vT2VmKZgbleT4kF7Ybj2sDjOzQJGPTuyRCbCXf1HQe2ikt4bGDdzRj8xKxKM6YZ6BGpvaxzlSzP0Vk08g4E5getivDlICenHvt6A90eSrFgvNIap_Isrrybp6zLxTiYvCyzqakN6o Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 197a6854a6a949b88eae7d185688d461 Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:05.935926 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_197a6854a6a949b88eae7d185688d461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/197a6854a6a949b88eae7d185688d461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/197a6854a6a949b88eae7d185688d461"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/197a6854a6a949b88eae7d185688d461"}]}] Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 197a6854a6a949b88eae7d185688d461 Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1004452683 Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FloatingIPsAssociationTestJSON-1004452683-project Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: aa469d1847b5434eaa545db65834a323 Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1004452683-project Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a could not be found. Oct 04 18:12:05.937394 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '5f64a66b-6e31-45ef-a711-60c9e8f0ec3a'} Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a could not be found. Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:05.938198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a could not be found. Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a could not be found. Oct 04 18:12:05.939521 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:05.940750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] Returning 404 to user: Instance 5f64a66b-6e31-45ef-a711-60c9e8f0ec3a could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:05.940750 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4d03e9f9-c0db-45c2-afe8-3f5017058c42 tempest-FloatingIPsAssociationTestJSON-1004452683 tempest-FloatingIPsAssociationTestJSON-1004452683-project] 10.222.0.18 "GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a" status: 404 len: 111 microversion: 2.1 time: 0.037716 Oct 04 18:12:05.940886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a7fc7c9-4397-4d6f-8b4f-f6ebb0fb35dd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:05.942683 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1236/2517] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/5f64a66b-6e31-45ef-a711-60c9e8f0ec3a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:05.947901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b4dae7cf-98b0-465b-809c-eb7215d5cf63 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.948567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b4dae7cf-98b0-465b-809c-eb7215d5cf63 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.949170 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a7fc7c9-4397-4d6f-8b4f-f6ebb0fb35dd tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1307 microversion: 2.1 time: 0.376365 Oct 04 18:12:05.949788 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1282/2518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1307 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:05.966767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4dae7cf-98b0-465b-809c-eb7215d5cf63 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.967324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4dae7cf-98b0-465b-809c-eb7215d5cf63 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.967789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4dae7cf-98b0-465b-809c-eb7215d5cf63 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.969252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4dae7cf-98b0-465b-809c-eb7215d5cf63 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.969740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4dae7cf-98b0-465b-809c-eb7215d5cf63 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.970186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4dae7cf-98b0-465b-809c-eb7215d5cf63 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.981214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c41b9be2-2594-4c44-86fa-f4910a4911ff tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.982053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c41b9be2-2594-4c44-86fa-f4910a4911ff tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.990520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41b9be2-2594-4c44-86fa-f4910a4911ff tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.991058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41b9be2-2594-4c44-86fa-f4910a4911ff tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.991514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41b9be2-2594-4c44-86fa-f4910a4911ff tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.998043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41b9be2-2594-4c44-86fa-f4910a4911ff tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.998813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41b9be2-2594-4c44-86fa-f4910a4911ff tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.999401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41b9be2-2594-4c44-86fa-f4910a4911ff tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.215596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b4dae7cf-98b0-465b-809c-eb7215d5cf63 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.219674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c41b9be2-2594-4c44-86fa-f4910a4911ff tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.223758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:06.231110 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c41b9be2-2594-4c44-86fa-f4910a4911ff tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.255634 Oct 04 18:12:06.237447 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1283/2519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:06.237731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b208b7d6-fba6-4acd-b459-2f35047f8a23 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:06.238616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b208b7d6-fba6-4acd-b459-2f35047f8a23 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:06.240623 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b4dae7cf-98b0-465b-809c-eb7215d5cf63 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1509 microversion: 2.1 time: 0.295390 Oct 04 18:12:06.243384 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1237/2520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1509 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:06.246697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b208b7d6-fba6-4acd-b459-2f35047f8a23 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.247476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b208b7d6-fba6-4acd-b459-2f35047f8a23 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.248072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b208b7d6-fba6-4acd-b459-2f35047f8a23 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.250039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b208b7d6-fba6-4acd-b459-2f35047f8a23 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.250911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b208b7d6-fba6-4acd-b459-2f35047f8a23 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.251636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b208b7d6-fba6-4acd-b459-2f35047f8a23 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.417924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b208b7d6-fba6-4acd-b459-2f35047f8a23 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.426489 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b208b7d6-fba6-4acd-b459-2f35047f8a23 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.192958 Oct 04 18:12:06.427407 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1284/2521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:06 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:06.574945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-30b29033-9a51-4684-8075-375fb9a7fc0c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:06.575744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-30b29033-9a51-4684-8075-375fb9a7fc0c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:06.582497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b29033-9a51-4684-8075-375fb9a7fc0c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.583025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b29033-9a51-4684-8075-375fb9a7fc0c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.583477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b29033-9a51-4684-8075-375fb9a7fc0c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.584195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b29033-9a51-4684-8075-375fb9a7fc0c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.584658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b29033-9a51-4684-8075-375fb9a7fc0c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.585093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30b29033-9a51-4684-8075-375fb9a7fc0c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.599948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:06.601098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:06.604341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=7 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:06.605789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=18 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:06.612045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.612758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.613137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.614108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.614578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.615041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.804026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-30b29033-9a51-4684-8075-375fb9a7fc0c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.812446 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-30b29033-9a51-4684-8075-375fb9a7fc0c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1470 microversion: 2.1 time: 0.241458 Oct 04 18:12:06.815873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.824940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.826405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.828175 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dd9f45f8-1c41-41de-bf02-dc48036b26cc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.232455 Oct 04 18:12:06.828323 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1238/2522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:06 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:06.829046 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1285/2523] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:06 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:06.983975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a69e0236-a93f-4190-ad04-31c2d485314d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:06.986212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a69e0236-a93f-4190-ad04-31c2d485314d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:06.999187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a69e0236-a93f-4190-ad04-31c2d485314d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.000247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a69e0236-a93f-4190-ad04-31c2d485314d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.001104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a69e0236-a93f-4190-ad04-31c2d485314d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.002069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a69e0236-a93f-4190-ad04-31c2d485314d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.002765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a69e0236-a93f-4190-ad04-31c2d485314d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.004030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a69e0236-a93f-4190-ad04-31c2d485314d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.221768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a69e0236-a93f-4190-ad04-31c2d485314d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:07.232234 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a69e0236-a93f-4190-ad04-31c2d485314d tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1487 microversion: 2.1 time: 0.257498 Oct 04 18:12:07.232918 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1239/2524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:06 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1487 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:07.255284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-77f2ed0c-ca8a-406f-99bf-8dcfce0c095d tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:07.256136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b8dff9c0-3482-4ffc-b149-02e4cccaf1bc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-170593540"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:07.256414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-77f2ed0c-ca8a-406f-99bf-8dcfce0c095d tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.260451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b8dff9c0-3482-4ffc-b149-02e4cccaf1bc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.272501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8dff9c0-3482-4ffc-b149-02e4cccaf1bc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.273017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8dff9c0-3482-4ffc-b149-02e4cccaf1bc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.273467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8dff9c0-3482-4ffc-b149-02e4cccaf1bc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.274192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8dff9c0-3482-4ffc-b149-02e4cccaf1bc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.274703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f2ed0c-ca8a-406f-99bf-8dcfce0c095d tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.275252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f2ed0c-ca8a-406f-99bf-8dcfce0c095d tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.275696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f2ed0c-ca8a-406f-99bf-8dcfce0c095d tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.277203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f2ed0c-ca8a-406f-99bf-8dcfce0c095d tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.278074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8dff9c0-3482-4ffc-b149-02e4cccaf1bc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.279040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f2ed0c-ca8a-406f-99bf-8dcfce0c095d tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.279592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8dff9c0-3482-4ffc-b149-02e4cccaf1bc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.280245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f2ed0c-ca8a-406f-99bf-8dcfce0c095d tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.562609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-77f2ed0c-ca8a-406f-99bf-8dcfce0c095d tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:07.578130 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-77f2ed0c-ca8a-406f-99bf-8dcfce0c095d tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.326607 Oct 04 18:12:07.580258 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1286/2525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:07 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:07.585743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0726006c-8cf1-4494-bba7-7a4df4a4a611 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:07.586768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0726006c-8cf1-4494-bba7-7a4df4a4a611 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.593469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0726006c-8cf1-4494-bba7-7a4df4a4a611 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.594299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0726006c-8cf1-4494-bba7-7a4df4a4a611 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.595054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0726006c-8cf1-4494-bba7-7a4df4a4a611 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.596232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0726006c-8cf1-4494-bba7-7a4df4a4a611 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.596704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0726006c-8cf1-4494-bba7-7a4df4a4a611 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.597395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0726006c-8cf1-4494-bba7-7a4df4a4a611 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.622642 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b8dff9c0-3482-4ffc-b149-02e4cccaf1bc tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "POST /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479/action" status: 202 len: 0 microversion: 2.1 time: 0.370965 Oct 04 18:12:07.643752 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1240/2526] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:12:07 2022] POST /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:12:07.652188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-82b49d71-40f3-4271-9a9c-9bb8c3d37e3e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:07.653157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-82b49d71-40f3-4271-9a9c-9bb8c3d37e3e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.670614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b49d71-40f3-4271-9a9c-9bb8c3d37e3e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.674495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b49d71-40f3-4271-9a9c-9bb8c3d37e3e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.675225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b49d71-40f3-4271-9a9c-9bb8c3d37e3e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.676127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b49d71-40f3-4271-9a9c-9bb8c3d37e3e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.683078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b49d71-40f3-4271-9a9c-9bb8c3d37e3e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.683457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b49d71-40f3-4271-9a9c-9bb8c3d37e3e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.258738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-82b49d71-40f3-4271-9a9c-9bb8c3d37e3e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.263913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0726006c-8cf1-4494-bba7-7a4df4a4a611 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.275911 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-82b49d71-40f3-4271-9a9c-9bb8c3d37e3e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.629243 Oct 04 18:12:08.279176 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1241/2527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:07 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:08.297414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-58f7bc5e-f6c6-473a-9002-3e6d8269d40c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d61c63a0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:08.309199 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0726006c-8cf1-4494-bba7-7a4df4a4a611 tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1509 microversion: 2.1 time: 0.727382 Oct 04 18:12:08.312676 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1287/2528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:07 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1509 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:08.333713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ec80f330-d160-4202-aa7b-65e7717e2c77 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:08.334572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ec80f330-d160-4202-aa7b-65e7717e2c77 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:08.397982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec80f330-d160-4202-aa7b-65e7717e2c77 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.399141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec80f330-d160-4202-aa7b-65e7717e2c77 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.399141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec80f330-d160-4202-aa7b-65e7717e2c77 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.399716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec80f330-d160-4202-aa7b-65e7717e2c77 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.400788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec80f330-d160-4202-aa7b-65e7717e2c77 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.402369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec80f330-d160-4202-aa7b-65e7717e2c77 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.416327 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-58f7bc5e-f6c6-473a-9002-3e6d8269d40c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83" status: 200 len: 1411 microversion: 2.1 time: 0.134702 Oct 04 18:12:08.417220 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1242/2529] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:12:08 2022] GET /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 => generated 1411 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:08.441637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:08.443637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:08.457217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.458025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.458653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.459655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.461984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.462822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.847427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ec80f330-d160-4202-aa7b-65e7717e2c77 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.859312 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ec80f330-d160-4202-aa7b-65e7717e2c77 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1470 microversion: 2.1 time: 0.544025 Oct 04 18:12:08.875015 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1288/2530] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:08 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1470 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:08.876391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.880799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e455e8d8-910f-4547-823e-4a11199b824c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d1aaedc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:08.890793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.892375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.893539 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ad3789c3-c297-4c8e-8c13-1a9829c5e09e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.475178 Oct 04 18:12:08.894374 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1243/2531] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:08 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:08.915752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5fcd6169-e9ca-44cf-99db-9c20961249cf req-d9dd744a-a45f-4eeb-8c16-9c63690af158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7", "name": "network-vif-deleted", "tag": "dd7953c5-2924-4e62-b2a5-ee3d29567612"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:08.930855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5fcd6169-e9ca-44cf-99db-9c20961249cf req-d9dd744a-a45f-4eeb-8c16-9c63690af158 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.931387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5fcd6169-e9ca-44cf-99db-9c20961249cf req-d9dd744a-a45f-4eeb-8c16-9c63690af158 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.935280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5fcd6169-e9ca-44cf-99db-9c20961249cf req-d9dd744a-a45f-4eeb-8c16-9c63690af158 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.935680 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e455e8d8-910f-4547-823e-4a11199b824c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83" status: 200 len: 1411 microversion: 2.1 time: 0.059261 Oct 04 18:12:08.946298 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1289/2532] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:12:08 2022] GET /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 => generated 1411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:08.947576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70f55a90-f762-4ee2-96f3-44e2e09e2aa6 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:08.948228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-70f55a90-f762-4ee2-96f3-44e2e09e2aa6 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:08.951118 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5fcd6169-e9ca-44cf-99db-9c20961249cf req-d9dd744a-a45f-4eeb-8c16-9c63690af158 service nova] Creating event network-vif-deleted:dd7953c5-2924-4e62-b2a5-ee3d29567612 for instance 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 on n-h1-850499-14 Oct 04 18:12:08.957160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70f55a90-f762-4ee2-96f3-44e2e09e2aa6 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.957826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70f55a90-f762-4ee2-96f3-44e2e09e2aa6 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.958256 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5fcd6169-e9ca-44cf-99db-9c20961249cf req-d9dd744a-a45f-4eeb-8c16-9c63690af158 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055148 Oct 04 18:12:08.958794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70f55a90-f762-4ee2-96f3-44e2e09e2aa6 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.959320 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1244/2533] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:08.960244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70f55a90-f762-4ee2-96f3-44e2e09e2aa6 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.961190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70f55a90-f762-4ee2-96f3-44e2e09e2aa6 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.962116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70f55a90-f762-4ee2-96f3-44e2e09e2aa6 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.965786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-66972df9-9d2b-47fe-93e4-38320c842f8b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d6056d30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.122353 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-66972df9-9d2b-47fe-93e4-38320c842f8b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83" status: 204 len: 0 microversion: 2.1 time: 0.161392 Oct 04 18:12:09.123797 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1245/2534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:08 2022] DELETE /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:09.132478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94e9b959-384a-47a3-959f-9865717c5a7e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d12fa160>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.161166 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-94e9b959-384a-47a3-959f-9865717c5a7e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Image not found. Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94e9b959-384a-47a3-959f-9865717c5a7e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 HTTP/1.1 Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:09.164636 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: exception: Image not found. Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'ca446f1a-e6c4-41d7-89e2-0acddcf0ff83'} Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:09.166181 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 Oct 04 18:12:09.167191 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:12:09.169501 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 could not be found. Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:09.170778 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:12:09.172549 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:09.175079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94e9b959-384a-47a3-959f-9865717c5a7e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Image not found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:09.176226 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-94e9b959-384a-47a3-959f-9865717c5a7e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83" status: 404 len: 62 microversion: 2.1 time: 0.048217 Oct 04 18:12:09.181074 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1246/2535] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:12:09 2022] GET /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:12:09.187644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b9638c53-46fe-4c44-9bce-544f24ac34d8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.188325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b9638c53-46fe-4c44-9bce-544f24ac34d8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:09.197099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70f55a90-f762-4ee2-96f3-44e2e09e2aa6 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.199709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9638c53-46fe-4c44-9bce-544f24ac34d8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.200229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9638c53-46fe-4c44-9bce-544f24ac34d8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.201367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9638c53-46fe-4c44-9bce-544f24ac34d8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.202178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9638c53-46fe-4c44-9bce-544f24ac34d8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.202646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9638c53-46fe-4c44-9bce-544f24ac34d8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.203153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9638c53-46fe-4c44-9bce-544f24ac34d8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.206500 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70f55a90-f762-4ee2-96f3-44e2e09e2aa6 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.267323 Oct 04 18:12:09.207833 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1290/2536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:08 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:09.301473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d1ebb459-a6d9-4cf8-b635-8062f06e4792 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.302238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d1ebb459-a6d9-4cf8-b635-8062f06e4792 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:09.309334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1ebb459-a6d9-4cf8-b635-8062f06e4792 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.310181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1ebb459-a6d9-4cf8-b635-8062f06e4792 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.310634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1ebb459-a6d9-4cf8-b635-8062f06e4792 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.312141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1ebb459-a6d9-4cf8-b635-8062f06e4792 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.312610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1ebb459-a6d9-4cf8-b635-8062f06e4792 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.313046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1ebb459-a6d9-4cf8-b635-8062f06e4792 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.435008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b9638c53-46fe-4c44-9bce-544f24ac34d8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.446237 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b9638c53-46fe-4c44-9bce-544f24ac34d8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1505 microversion: 2.1 time: 0.262519 Oct 04 18:12:09.447439 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1247/2537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:09 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:09.454688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.455556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:09.462266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:09.471814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.472492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.473117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.474924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.475888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.476796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.530211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.531496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.532122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.532888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lazy-loading 'fault' on Instance uuid 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:09.709950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b7db5805f34e58b086bffb82ff79b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945b6308c9b642468ffe22b5825e22b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.721479 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be981700-04f6-48b5-9d77-0f34dbabc19b tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 200 len: 1306 microversion: 2.1 time: 0.272683 Oct 04 18:12:09.736835 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1248/2538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:09 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 1306 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:09.761863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d1ebb459-a6d9-4cf8-b635-8062f06e4792 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.771187 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d1ebb459-a6d9-4cf8-b635-8062f06e4792 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.474277 Oct 04 18:12:09.772457 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1291/2539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:09 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:09.881792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-edd9c39d-5237-45c7-a13f-8233731810a8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.882294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-edd9c39d-5237-45c7-a13f-8233731810a8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:09.891003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd9c39d-5237-45c7-a13f-8233731810a8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.891580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd9c39d-5237-45c7-a13f-8233731810a8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.895562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd9c39d-5237-45c7-a13f-8233731810a8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.896430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd9c39d-5237-45c7-a13f-8233731810a8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.896920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd9c39d-5237-45c7-a13f-8233731810a8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.897361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edd9c39d-5237-45c7-a13f-8233731810a8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.930776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.931458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:09.941040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.942032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.942829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.943774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.944512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.945653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.338026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.341398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-edd9c39d-5237-45c7-a13f-8233731810a8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.354007 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-edd9c39d-5237-45c7-a13f-8233731810a8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1470 microversion: 2.1 time: 0.476195 Oct 04 18:12:10.354922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.356922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.358906 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-687886db-db07-4e10-b866-4c5741a495dc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.443043 Oct 04 18:12:10.360408 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1292/2540] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:09 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:10.366366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c7d54cb1-95ee-46b0-bf20-666da0c03175 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:10.367293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c7d54cb1-95ee-46b0-bf20-666da0c03175 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:10.368606 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1249/2541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:09 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1470 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:10.374408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7d54cb1-95ee-46b0-bf20-666da0c03175 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.375057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7d54cb1-95ee-46b0-bf20-666da0c03175 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.375719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7d54cb1-95ee-46b0-bf20-666da0c03175 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.376658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7d54cb1-95ee-46b0-bf20-666da0c03175 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.377332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7d54cb1-95ee-46b0-bf20-666da0c03175 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.377971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7d54cb1-95ee-46b0-bf20-666da0c03175 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.475675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a63b76ab-6924-43e7-b273-67ed96116fd3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:10.476300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a63b76ab-6924-43e7-b273-67ed96116fd3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:10.485877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a63b76ab-6924-43e7-b273-67ed96116fd3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.486565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a63b76ab-6924-43e7-b273-67ed96116fd3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.487390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a63b76ab-6924-43e7-b273-67ed96116fd3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.489225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a63b76ab-6924-43e7-b273-67ed96116fd3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.489839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a63b76ab-6924-43e7-b273-67ed96116fd3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.490394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a63b76ab-6924-43e7-b273-67ed96116fd3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.683538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7d54cb1-95ee-46b0-bf20-666da0c03175 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.695917 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c7d54cb1-95ee-46b0-bf20-666da0c03175 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.333965 Oct 04 18:12:10.698386 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1293/2542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:10 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:10.764111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:10.764908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] [instance: 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:10.775873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.777133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.777689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.778825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.781627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.781802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.791675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a63b76ab-6924-43e7-b273-67ed96116fd3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.802360 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a63b76ab-6924-43e7-b273-67ed96116fd3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1505 microversion: 2.1 time: 0.330874 Oct 04 18:12:10.802966 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1250/2543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:10 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:10.818122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b1f08269-cb96-48ea-a46a-7131c9172565 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:10.823677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b1f08269-cb96-48ea-a46a-7131c9172565 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] HTTP exception thrown: Instance 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 could not be found. Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Request method failure captured: Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 HTTP/1.1 Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHdYXFTrHiCeQ6HivdfPvh2VepcWNGhv_Qe9pS8dtrNHYkUHXtDmMfXUD7Mrf6gQ7hCeY6mrSaWHEIcA-9VRL3rRpKFCVs81AeHaeABEpji9BQ5nxPaC9k8RTt6S_ZRdJR6jEcwcVyK7gxN_s7PQB05Y6icsHV22kTPUBu_2b5wuEmk Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 945b6308c9b642468ffe22b5825e22b5 Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerAddressesTestJSON-1583124660 Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:10.823853 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_945b6308c9b642468ffe22b5825e22b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/945b6308c9b642468ffe22b5825e22b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/945b6308c9b642468ffe22b5825e22b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/945b6308c9b642468ffe22b5825e22b5"}]}] Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerAddressesTestJSON-1583124660 Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 945b6308c9b642468ffe22b5825e22b5 Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1583124660 Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerAddressesTestJSON-1583124660-project Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e2b7db5805f34e58b086bffb82ff79b4 Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerAddressesTestJSON-1583124660-project Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 could not be found. Oct 04 18:12:10.825380 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7'} Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 could not be found. Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:10.826205 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 could not be found. Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 could not be found. Oct 04 18:12:10.828534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:10.830822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] Returning 404 to user: Instance 7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:10.830822 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-249746f6-c6d9-4e34-9e2a-52f54cd1b86d tempest-ServerAddressesTestJSON-1583124660 tempest-ServerAddressesTestJSON-1583124660-project] 10.222.0.18 "GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7" status: 404 len: 111 microversion: 2.1 time: 0.067990 Oct 04 18:12:10.831127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1f08269-cb96-48ea-a46a-7131c9172565 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.831127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1f08269-cb96-48ea-a46a-7131c9172565 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.831127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1f08269-cb96-48ea-a46a-7131c9172565 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.831127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1f08269-cb96-48ea-a46a-7131c9172565 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.831621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1f08269-cb96-48ea-a46a-7131c9172565 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.831621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1f08269-cb96-48ea-a46a-7131c9172565 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.831773 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1294/2544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:10 2022] GET /compute/v2.1/servers/7d0541f4-7cdb-4f00-a75f-ab66bd72fbc7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:11.384960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10ce958e-4ce8-49db-a6b1-3c175c38a9ca tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:11.385649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10ce958e-4ce8-49db-a6b1-3c175c38a9ca tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:11.394104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ce958e-4ce8-49db-a6b1-3c175c38a9ca tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.394759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ce958e-4ce8-49db-a6b1-3c175c38a9ca tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.395441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ce958e-4ce8-49db-a6b1-3c175c38a9ca tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.396279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ce958e-4ce8-49db-a6b1-3c175c38a9ca tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.396850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ce958e-4ce8-49db-a6b1-3c175c38a9ca tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.397548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ce958e-4ce8-49db-a6b1-3c175c38a9ca tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.570987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1f08269-cb96-48ea-a46a-7131c9172565 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.590876 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b1f08269-cb96-48ea-a46a-7131c9172565 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.786374 Oct 04 18:12:11.592340 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1251/2545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:10 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:11.608798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:11.609757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:11.626180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.626693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.627390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.628280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.628903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.629677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.664453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:11.773754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-10ce958e-4ce8-49db-a6b1-3c175c38a9ca tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.783190 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10ce958e-4ce8-49db-a6b1-3c175c38a9ca tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1470 microversion: 2.1 time: 0.406481 Oct 04 18:12:11.784227 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1295/2546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:11 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:11.790581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9e496e0-bf1f-4ef9-9830-5271705c5b7f tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:11.791415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9e496e0-bf1f-4ef9-9830-5271705c5b7f tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:11.799298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9e496e0-bf1f-4ef9-9830-5271705c5b7f tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.799944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9e496e0-bf1f-4ef9-9830-5271705c5b7f tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.800489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9e496e0-bf1f-4ef9-9830-5271705c5b7f tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.801357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9e496e0-bf1f-4ef9-9830-5271705c5b7f tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.801915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9e496e0-bf1f-4ef9-9830-5271705c5b7f tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.802624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9e496e0-bf1f-4ef9-9830-5271705c5b7f tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.953089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.961922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.963751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.965143 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1e1e45ca-c609-431a-a437-3611bbd2518c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.368060 Oct 04 18:12:11.966003 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1252/2547] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:11 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:11.970637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-09a7ddd6-64e3-4295-bb00-e0de35afdd35 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:11.971682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-09a7ddd6-64e3-4295-bb00-e0de35afdd35 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:11.978479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09a7ddd6-64e3-4295-bb00-e0de35afdd35 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.979650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09a7ddd6-64e3-4295-bb00-e0de35afdd35 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.979823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09a7ddd6-64e3-4295-bb00-e0de35afdd35 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.980664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09a7ddd6-64e3-4295-bb00-e0de35afdd35 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.981234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09a7ddd6-64e3-4295-bb00-e0de35afdd35 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.981913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09a7ddd6-64e3-4295-bb00-e0de35afdd35 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.141096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9e496e0-bf1f-4ef9-9830-5271705c5b7f tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:12.154436 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9e496e0-bf1f-4ef9-9830-5271705c5b7f tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.368258 Oct 04 18:12:12.172328 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1296/2548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:11 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:12.293468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-09a7ddd6-64e3-4295-bb00-e0de35afdd35 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:12.301897 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-09a7ddd6-64e3-4295-bb00-e0de35afdd35 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1487 microversion: 2.1 time: 0.334813 Oct 04 18:12:12.304459 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1253/2549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:11 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1487 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:12.333491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9671ee29-1622-43bb-a315-2e3faf57712a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:12.334346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9671ee29-1622-43bb-a315-2e3faf57712a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:12.343823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9671ee29-1622-43bb-a315-2e3faf57712a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.344659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9671ee29-1622-43bb-a315-2e3faf57712a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.345477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9671ee29-1622-43bb-a315-2e3faf57712a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.346422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9671ee29-1622-43bb-a315-2e3faf57712a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.347688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9671ee29-1622-43bb-a315-2e3faf57712a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.348433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9671ee29-1622-43bb-a315-2e3faf57712a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.419470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9671ee29-1622-43bb-a315-2e3faf57712a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:12:12.620572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-576535f1-05a2-4469-9e80-3ea834d88bbf tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:12.622809 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9671ee29-1622-43bb-a315-2e3faf57712a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 204 len: 0 microversion: 2.1 time: 0.295097 Oct 04 18:12:12.624812 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1297/2550] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:12 2022] DELETE /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:12.637046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-576535f1-05a2-4469-9e80-3ea834d88bbf tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:12.641221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ae9b46b-79d5-4b1d-8964-14e5327d72d5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d137cdc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:12.668275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-576535f1-05a2-4469-9e80-3ea834d88bbf tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.668787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-576535f1-05a2-4469-9e80-3ea834d88bbf tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.669263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-576535f1-05a2-4469-9e80-3ea834d88bbf tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.670003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-576535f1-05a2-4469-9e80-3ea834d88bbf tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.672074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-576535f1-05a2-4469-9e80-3ea834d88bbf tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.672519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-576535f1-05a2-4469-9e80-3ea834d88bbf tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.705492 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-2ae9b46b-79d5-4b1d-8964-14e5327d72d5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Image not found. Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ae9b46b-79d5-4b1d-8964-14e5327d72d5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 HTTP/1.1 Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:12.708050 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ca446f1a-e6c4-41d7-89e2-0acddcf0ff83'} Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:12.709266 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 to delete Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:12.710023 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 could not be found. Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:12.711150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:12:12.712216 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:12.723640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ae9b46b-79d5-4b1d-8964-14e5327d72d5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:12.724743 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ae9b46b-79d5-4b1d-8964-14e5327d72d5 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83" status: 404 len: 62 microversion: 2.1 time: 0.094244 Oct 04 18:12:12.725756 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1298/2551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:12 2022] DELETE /compute/v2.1/images/ca446f1a-e6c4-41d7-89e2-0acddcf0ff83 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:12:12.748949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:12.750840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:12.769659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.773594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.775700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.776715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.778820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.779546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.828804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:12:12.929167 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.compute.api [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Instance is already in deleting state, ignoring this request Oct 04 18:12:12.940827 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-56c684dc-53b7-4877-8f58-ad994177844e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 204 len: 0 microversion: 2.1 time: 0.206182 Oct 04 18:12:12.944394 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1299/2552] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:12 2022] DELETE /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:12:12.961570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ede0744-31ab-4e09-ab41-dc2e2e7300a4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:12.962632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ede0744-31ab-4e09-ab41-dc2e2e7300a4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:12.984424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ede0744-31ab-4e09-ab41-dc2e2e7300a4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.986853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ede0744-31ab-4e09-ab41-dc2e2e7300a4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.987748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ede0744-31ab-4e09-ab41-dc2e2e7300a4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.989739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ede0744-31ab-4e09-ab41-dc2e2e7300a4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.990233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ede0744-31ab-4e09-ab41-dc2e2e7300a4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.993710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ede0744-31ab-4e09-ab41-dc2e2e7300a4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.010049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-576535f1-05a2-4469-9e80-3ea834d88bbf tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.013443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:13.023126 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-576535f1-05a2-4469-9e80-3ea834d88bbf tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.403630 Oct 04 18:12:13.025878 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1254/2553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:12 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:13.056235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b107c2c5-b2c0-47a4-ac02-e0d008f0f25e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:13.058615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b107c2c5-b2c0-47a4-ac02-e0d008f0f25e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:13.078574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107c2c5-b2c0-47a4-ac02-e0d008f0f25e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.081034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107c2c5-b2c0-47a4-ac02-e0d008f0f25e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.085132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107c2c5-b2c0-47a4-ac02-e0d008f0f25e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.086598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107c2c5-b2c0-47a4-ac02-e0d008f0f25e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.087904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107c2c5-b2c0-47a4-ac02-e0d008f0f25e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.090008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107c2c5-b2c0-47a4-ac02-e0d008f0f25e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.658824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ede0744-31ab-4e09-ab41-dc2e2e7300a4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.675022 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ede0744-31ab-4e09-ab41-dc2e2e7300a4 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1470 microversion: 2.1 time: 0.728154 Oct 04 18:12:13.693460 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1300/2554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:12 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1470 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:13.698389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:13.699440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:13.712342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b107c2c5-b2c0-47a4-ac02-e0d008f0f25e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.716225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.716225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.716225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.716225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.716668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.716668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.724769 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b107c2c5-b2c0-47a4-ac02-e0d008f0f25e tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1493 microversion: 2.1 time: 0.697402 Oct 04 18:12:13.729887 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1255/2555] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:13 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1493 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:13.742079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5193f6c0-cde7-49dd-86ad-8aec7ae73f21 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:13.745319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5193f6c0-cde7-49dd-86ad-8aec7ae73f21 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:13.759821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5193f6c0-cde7-49dd-86ad-8aec7ae73f21 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.762356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5193f6c0-cde7-49dd-86ad-8aec7ae73f21 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.764456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5193f6c0-cde7-49dd-86ad-8aec7ae73f21 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.765474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5193f6c0-cde7-49dd-86ad-8aec7ae73f21 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.766102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5193f6c0-cde7-49dd-86ad-8aec7ae73f21 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.766893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5193f6c0-cde7-49dd-86ad-8aec7ae73f21 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.048473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.068711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.073629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.078336 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-09707f56-3e79-4c08-a8f4-3131926d8bda tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.383368 Oct 04 18:12:14.081897 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1301/2556] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:13 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:14.100656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5193f6c0-cde7-49dd-86ad-8aec7ae73f21 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.101529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b5861cab-e385-4cc2-b69e-50657931d1bc req-3807a591-ad6c-4241-93e5-f42bc32a8e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f3ca20-9d90-425f-9377-096532e41db4", "name": "network-vif-plugged", "status": "completed", "tag": "6548269f-7daa-41dd-a98b-109dc9ef6c4e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:14.114142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b5861cab-e385-4cc2-b69e-50657931d1bc req-3807a591-ad6c-4241-93e5-f42bc32a8e66 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.114929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b5861cab-e385-4cc2-b69e-50657931d1bc req-3807a591-ad6c-4241-93e5-f42bc32a8e66 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.115782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b5861cab-e385-4cc2-b69e-50657931d1bc req-3807a591-ad6c-4241-93e5-f42bc32a8e66 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.127076 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5193f6c0-cde7-49dd-86ad-8aec7ae73f21 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.394507 Oct 04 18:12:14.148767 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1256/2557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:13 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:14.148966 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b5861cab-e385-4cc2-b69e-50657931d1bc req-3807a591-ad6c-4241-93e5-f42bc32a8e66 service nova] Creating event network-vif-plugged:6548269f-7daa-41dd-a98b-109dc9ef6c4e for instance 32f3ca20-9d90-425f-9377-096532e41db4 on n-h2-850499-14 Oct 04 18:12:14.152928 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b5861cab-e385-4cc2-b69e-50657931d1bc req-3807a591-ad6c-4241-93e5-f42bc32a8e66 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069543 Oct 04 18:12:14.153584 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1302/2558] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:14.156106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c33d1242-07bc-4cd2-85f6-8dd6245ed20c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:14.157003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c33d1242-07bc-4cd2-85f6-8dd6245ed20c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:14.164437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c33d1242-07bc-4cd2-85f6-8dd6245ed20c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.165722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c33d1242-07bc-4cd2-85f6-8dd6245ed20c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.166467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c33d1242-07bc-4cd2-85f6-8dd6245ed20c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.167416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c33d1242-07bc-4cd2-85f6-8dd6245ed20c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.168067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c33d1242-07bc-4cd2-85f6-8dd6245ed20c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.168698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c33d1242-07bc-4cd2-85f6-8dd6245ed20c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.455420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c33d1242-07bc-4cd2-85f6-8dd6245ed20c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.464202 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c33d1242-07bc-4cd2-85f6-8dd6245ed20c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.321343 Oct 04 18:12:14.464798 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1257/2559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:14 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:14.699661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c2a60ca-8538-4e8d-89aa-081b902ecc70 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:14.700525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c2a60ca-8538-4e8d-89aa-081b902ecc70 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:14.711526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2a60ca-8538-4e8d-89aa-081b902ecc70 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.712353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2a60ca-8538-4e8d-89aa-081b902ecc70 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.713042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2a60ca-8538-4e8d-89aa-081b902ecc70 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.713841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2a60ca-8538-4e8d-89aa-081b902ecc70 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.714593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2a60ca-8538-4e8d-89aa-081b902ecc70 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.716163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2a60ca-8538-4e8d-89aa-081b902ecc70 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.768511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f3e7ac68-8c2c-499c-9ad1-9b7861dadd3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:14.769152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f3e7ac68-8c2c-499c-9ad1-9b7861dadd3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:14.782321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3e7ac68-8c2c-499c-9ad1-9b7861dadd3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.791473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3e7ac68-8c2c-499c-9ad1-9b7861dadd3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.792169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3e7ac68-8c2c-499c-9ad1-9b7861dadd3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.793100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3e7ac68-8c2c-499c-9ad1-9b7861dadd3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.794364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3e7ac68-8c2c-499c-9ad1-9b7861dadd3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.794988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3e7ac68-8c2c-499c-9ad1-9b7861dadd3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.391723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f3e7ac68-8c2c-499c-9ad1-9b7861dadd3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.400628 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f3e7ac68-8c2c-499c-9ad1-9b7861dadd3a tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1493 microversion: 2.1 time: 0.645743 Oct 04 18:12:15.408081 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1258/2560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:14 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1493 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:15.419584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:15.420213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:15.442907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.443557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.444200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.445224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.445846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.446769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.516395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3c2a60ca-8538-4e8d-89aa-081b902ecc70 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.525504 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c2a60ca-8538-4e8d-89aa-081b902ecc70 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1470 microversion: 2.1 time: 0.830738 Oct 04 18:12:15.536168 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1303/2561] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:14 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1470 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:15.551744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-544ff265-7827-4fe8-845d-8d4e8133b466 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:15.552597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-544ff265-7827-4fe8-845d-8d4e8133b466 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:15.566820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-544ff265-7827-4fe8-845d-8d4e8133b466 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.569382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-544ff265-7827-4fe8-845d-8d4e8133b466 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.574863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-544ff265-7827-4fe8-845d-8d4e8133b466 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.576041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-544ff265-7827-4fe8-845d-8d4e8133b466 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.585562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-544ff265-7827-4fe8-845d-8d4e8133b466 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.586400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-544ff265-7827-4fe8-845d-8d4e8133b466 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.543459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-544ff265-7827-4fe8-845d-8d4e8133b466 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.554145 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-544ff265-7827-4fe8-845d-8d4e8133b466 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 1.016469 Oct 04 18:12:16.557519 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1304/2562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:15 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:16.578244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9d2ddc55-88a0-4c38-be0e-aceeda6a7822 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:16.579653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9d2ddc55-88a0-4c38-be0e-aceeda6a7822 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:16.598661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.609488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d2ddc55-88a0-4c38-be0e-aceeda6a7822 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.610066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d2ddc55-88a0-4c38-be0e-aceeda6a7822 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.611211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d2ddc55-88a0-4c38-be0e-aceeda6a7822 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.615775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d2ddc55-88a0-4c38-be0e-aceeda6a7822 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.616339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d2ddc55-88a0-4c38-be0e-aceeda6a7822 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.617014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d2ddc55-88a0-4c38-be0e-aceeda6a7822 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.617448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.624400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.630825 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1fe83645-ce73-488f-97c8-f860d23848fc tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 1.218572 Oct 04 18:12:16.632297 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1259/2563] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:15 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:16.648410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ac998b5-913a-4659-8523-7809ae185a00 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:16.649254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7ac998b5-913a-4659-8523-7809ae185a00 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:16.664449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac998b5-913a-4659-8523-7809ae185a00 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.668456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac998b5-913a-4659-8523-7809ae185a00 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.669403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac998b5-913a-4659-8523-7809ae185a00 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.673302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac998b5-913a-4659-8523-7809ae185a00 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.674795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac998b5-913a-4659-8523-7809ae185a00 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.677530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac998b5-913a-4659-8523-7809ae185a00 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.942932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7ac998b5-913a-4659-8523-7809ae185a00 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f402a68c6734b9488ab4a04e8b630a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67c1cf4579c5406fb461ec00e486b491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.971428 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ac998b5-913a-4659-8523-7809ae185a00 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 200 len: 1451 microversion: 2.1 time: 0.337580 Oct 04 18:12:16.972995 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1260/2564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:16 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 1451 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:16.980114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5fdb450c-4e08-4964-854b-3d05d3d61d62 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:16.981072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5fdb450c-4e08-4964-854b-3d05d3d61d62 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:16.989509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fdb450c-4e08-4964-854b-3d05d3d61d62 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.990369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fdb450c-4e08-4964-854b-3d05d3d61d62 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.991072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fdb450c-4e08-4964-854b-3d05d3d61d62 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.992594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fdb450c-4e08-4964-854b-3d05d3d61d62 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.993749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fdb450c-4e08-4964-854b-3d05d3d61d62 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.994385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fdb450c-4e08-4964-854b-3d05d3d61d62 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.467484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9d2ddc55-88a0-4c38-be0e-aceeda6a7822 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.477830 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9d2ddc55-88a0-4c38-be0e-aceeda6a7822 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.909969 Oct 04 18:12:17.479250 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1305/2565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:16 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:17.485509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7293beb1-be92-4697-9818-815a8cec4be8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Action: 'create', calling method: .version_select at 0x7fd4d13dd3a0>, body: {"keypair": {"name": "tempest-keypair-1842530237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLxaQFFS5zUcqoaCRqkdDWj8l8CKb4KtCzzf7qKhq4dawWWJvOQpxBL0re6n8MSKfvzRHFOK0WwGaaDsBrq1MA38/QHUGHyQmH5r1zcXF+CFxEV78pNVvj3b/RTmeTBBQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:17.505151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-7293beb1-be92-4697-9818-815a8cec4be8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Getting quotas for project 122253078dc44e1fb2f880d0ebecac02. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:17.510740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-7293beb1-be92-4697-9818-815a8cec4be8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Getting quotas for user 4dbb0f91947e404d931fcc6fe7cfb9db and project 122253078dc44e1fb2f880d0ebecac02. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:17.551418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5fdb450c-4e08-4964-854b-3d05d3d61d62 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.566732 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7293beb1-be92-4697-9818-815a8cec4be8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.085942 Oct 04 18:12:17.568110 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5fdb450c-4e08-4964-854b-3d05d3d61d62 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1476 microversion: 2.1 time: 0.590377 Oct 04 18:12:17.570073 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1261/2566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:16 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1476 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:17.584278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-9def2d03-d35f-4767-a18c-0da6c45fb8e7 req-3c4363d4-a5f2-45a0-8a8c-f7a7a2d12f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f181126-dac5-443e-be03-5027f1a63479", "name": "network-vif-deleted", "tag": "e9bdd62f-fcc9-4109-8f33-80a3d42a1b46"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:17.587460 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1306/2567] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 4 18:12:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:12:17.603987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e238d590-79b0-404e-ac89-b36f152e842c req-95c20546-3f11-43eb-a68a-8ddf87264dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381cd7a0-7761-4e5b-8b7a-345f828634ea", "name": "network-vif-unplugged", "status": "completed", "tag": "9a53d5b7-c91a-4800-8ef7-ceb69419fc49"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:17.614607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9def2d03-d35f-4767-a18c-0da6c45fb8e7 req-3c4363d4-a5f2-45a0-8a8c-f7a7a2d12f51 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.615189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9def2d03-d35f-4767-a18c-0da6c45fb8e7 req-3c4363d4-a5f2-45a0-8a8c-f7a7a2d12f51 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.615540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9def2d03-d35f-4767-a18c-0da6c45fb8e7 req-3c4363d4-a5f2-45a0-8a8c-f7a7a2d12f51 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.622001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e238d590-79b0-404e-ac89-b36f152e842c req-95c20546-3f11-43eb-a68a-8ddf87264dd4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.622860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e238d590-79b0-404e-ac89-b36f152e842c req-95c20546-3f11-43eb-a68a-8ddf87264dd4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.623738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e238d590-79b0-404e-ac89-b36f152e842c req-95c20546-3f11-43eb-a68a-8ddf87264dd4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.645716 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e238d590-79b0-404e-ac89-b36f152e842c req-95c20546-3f11-43eb-a68a-8ddf87264dd4 service nova] Creating event network-vif-unplugged:9a53d5b7-c91a-4800-8ef7-ceb69419fc49 for instance 381cd7a0-7761-4e5b-8b7a-345f828634ea on n-h2-850499-14 Oct 04 18:12:17.650823 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9def2d03-d35f-4767-a18c-0da6c45fb8e7 req-3c4363d4-a5f2-45a0-8a8c-f7a7a2d12f51 service nova] Creating event network-vif-deleted:e9bdd62f-fcc9-4109-8f33-80a3d42a1b46 for instance 0f181126-dac5-443e-be03-5027f1a63479 on n-h1-850499-14 Oct 04 18:12:17.653335 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e238d590-79b0-404e-ac89-b36f152e842c req-95c20546-3f11-43eb-a68a-8ddf87264dd4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060091 Oct 04 18:12:17.655663 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1307/2568] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:17.662699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a368be62-510b-44e4-a115-da6c6f3cca75 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:17.664605 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-9def2d03-d35f-4767-a18c-0da6c45fb8e7 req-3c4363d4-a5f2-45a0-8a8c-f7a7a2d12f51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093095 Oct 04 18:12:17.666176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a368be62-510b-44e4-a115-da6c6f3cca75 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:17.675708 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1262/2569] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:17.678945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a368be62-510b-44e4-a115-da6c6f3cca75 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.679895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a368be62-510b-44e4-a115-da6c6f3cca75 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.680563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a368be62-510b-44e4-a115-da6c6f3cca75 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.681558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a368be62-510b-44e4-a115-da6c6f3cca75 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.682290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a368be62-510b-44e4-a115-da6c6f3cca75 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.683000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a368be62-510b-44e4-a115-da6c6f3cca75 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.686227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:17.687605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:17.715716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.716555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.717098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.718059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.718681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.719152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.514490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a368be62-510b-44e4-a115-da6c6f3cca75 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.529022 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a368be62-510b-44e4-a115-da6c6f3cca75 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.870720 Oct 04 18:12:18.546097 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1308/2570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:17 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:18.584145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:18.589125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0f181126-dac5-443e-be03-5027f1a63479] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:18.611129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.617017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.620645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.621882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.624741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.626609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.663655 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Instance 0f181126-dac5-443e-be03-5027f1a63479 could not be found. Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 HTTP/1.1 Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:18.666725 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 0f181126-dac5-443e-be03-5027f1a63479 could not be found. Oct 04 18:12:18.668245 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '0f181126-dac5-443e-be03-5027f1a63479'} Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f181126-dac5-443e-be03-5027f1a63479 could not be found. Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:18.669027 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f181126-dac5-443e-be03-5027f1a63479 could not be found. Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f181126-dac5-443e-be03-5027f1a63479 could not be found. Oct 04 18:12:18.670166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:18.677949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.691535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Instance 0f181126-dac5-443e-be03-5027f1a63479 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:18.695776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b7915bcd-b737-411e-b8b1-c44ca5765966 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479" status: 404 len: 111 microversion: 2.1 time: 0.144246 Oct 04 18:12:18.703216 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1309/2571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:18 2022] GET /compute/v2.1/servers/0f181126-dac5-443e-be03-5027f1a63479 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:18.711846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.717618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d863bc82-0632-435a-a691-156000c9c4da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:18.718213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.718714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d863bc82-0632-435a-a691-156000c9c4da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:18.719780 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-41c5afa9-a45c-4eef-9a8f-3b4a849da300 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 1.042655 Oct 04 18:12:18.720838 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1263/2572] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:17 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:18.735502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2524eddf-63d2-463a-ba62-e139a087771f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:18.736259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2524eddf-63d2-463a-ba62-e139a087771f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:18.736489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d863bc82-0632-435a-a691-156000c9c4da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.742614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d863bc82-0632-435a-a691-156000c9c4da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.743525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d863bc82-0632-435a-a691-156000c9c4da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.744604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d863bc82-0632-435a-a691-156000c9c4da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.745317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d863bc82-0632-435a-a691-156000c9c4da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.745930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d863bc82-0632-435a-a691-156000c9c4da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.746050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2524eddf-63d2-463a-ba62-e139a087771f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.751800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2524eddf-63d2-463a-ba62-e139a087771f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.752405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2524eddf-63d2-463a-ba62-e139a087771f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.753265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2524eddf-63d2-463a-ba62-e139a087771f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.753843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2524eddf-63d2-463a-ba62-e139a087771f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.754380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2524eddf-63d2-463a-ba62-e139a087771f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.627079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d863bc82-0632-435a-a691-156000c9c4da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:19.647943 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d863bc82-0632-435a-a691-156000c9c4da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.943298 Oct 04 18:12:19.648542 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1310/2573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:18 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:19.655236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2524eddf-63d2-463a-ba62-e139a087771f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:19.663349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e55fe25a-3403-4dea-b749-f89f35bb27d3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d13924c0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:19.664418 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2524eddf-63d2-463a-ba62-e139a087771f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1476 microversion: 2.1 time: 0.942316 Oct 04 18:12:19.665850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1264/2574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:18 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1476 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:19.670544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c9eea24d-8398-467f-8ea8-a1a76f16fd95 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:19.672570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c9eea24d-8398-467f-8ea8-a1a76f16fd95 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:19.700218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9eea24d-8398-467f-8ea8-a1a76f16fd95 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.702386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9eea24d-8398-467f-8ea8-a1a76f16fd95 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.703032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9eea24d-8398-467f-8ea8-a1a76f16fd95 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.703838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9eea24d-8398-467f-8ea8-a1a76f16fd95 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.706073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9eea24d-8398-467f-8ea8-a1a76f16fd95 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.707424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9eea24d-8398-467f-8ea8-a1a76f16fd95 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.717302 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-e55fe25a-3403-4dea-b749-f89f35bb27d3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Image not found. Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e55fe25a-3403-4dea-b749-f89f35bb27d3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 HTTP/1.1 Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:19.719641 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1'} Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:19.721120 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 to delete Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.722231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 could not be found. Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:19.723559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e55fe25a-3403-4dea-b749-f89f35bb27d3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e55fe25a-3403-4dea-b749-f89f35bb27d3 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1" status: 404 len: 62 microversion: 2.1 time: 0.063909 Oct 04 18:12:19.725072 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1311/2575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:19 2022] DELETE /compute/v2.1/images/3ce14187-8dac-4e44-b74a-c3fd9a6dd8d1 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:12:19.730721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:19.731257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:19.747192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.747987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.748468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.749909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.750686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.751343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.767492 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 HTTP/1.1 Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:19.769070 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. Oct 04 18:12:19.770463 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '785194b8-dcad-4490-9f2a-e62dcf5afe79'} Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:19.771249 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. Oct 04 18:12:19.772528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:19.774646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:19.775574 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-17164834-dcaa-4d9e-80d2-157d5c957c8c tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 404 len: 111 microversion: 2.1 time: 0.048646 Oct 04 18:12:19.776508 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1312/2576] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:19 2022] DELETE /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:19.781839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:19.782686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:19.789000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.789740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.790353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.791264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.791873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.792476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.178768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.188930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c9eea24d-8398-467f-8ea8-a1a76f16fd95 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.208157 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c9eea24d-8398-467f-8ea8-a1a76f16fd95 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.540676 Oct 04 18:12:20.209567 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1265/2577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:19 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:20.214614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.215795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.216204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.216954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 785194b8-dcad-4490-9f2a-e62dcf5afe79] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:20.217423 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3d5050df-52f2-41f8-b2bf-7269de9a1832 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.439733 Oct 04 18:12:20.218881 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1313/2578] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:19 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:20.231691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-bb4cd730-dc8a-4718-9e70-b112799f4db1 req-785203de-cd4c-47df-84d3-f9d005bf4430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "381cd7a0-7761-4e5b-8b7a-345f828634ea", "tag": "9a53d5b7-c91a-4800-8ef7-ceb69419fc49"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:20.248389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.249771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.251209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.253890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.254589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.255202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bb4cd730-dc8a-4718-9e70-b112799f4db1 req-785203de-cd4c-47df-84d3-f9d005bf4430 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.255436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.255833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bb4cd730-dc8a-4718-9e70-b112799f4db1 req-785203de-cd4c-47df-84d3-f9d005bf4430 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.256343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bb4cd730-dc8a-4718-9e70-b112799f4db1 req-785203de-cd4c-47df-84d3-f9d005bf4430 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.277900 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 HTTP/1.1 Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:20.282637 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. Oct 04 18:12:20.284013 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '785194b8-dcad-4490-9f2a-e62dcf5afe79'} Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:20.284693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. Oct 04 18:12:20.285892 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.289096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Instance 785194b8-dcad-4490-9f2a-e62dcf5afe79 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:20.291429 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-201e4a5c-a431-4b95-9b31-ce0f5f6f7e25 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79" status: 404 len: 111 microversion: 2.1 time: 0.080424 Oct 04 18:12:20.291582 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-bb4cd730-dc8a-4718-9e70-b112799f4db1 req-785203de-cd4c-47df-84d3-f9d005bf4430 service nova] Creating event network-changed:9a53d5b7-c91a-4800-8ef7-ceb69419fc49 for instance 381cd7a0-7761-4e5b-8b7a-345f828634ea on n-h2-850499-14 Oct 04 18:12:20.293472 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1266/2579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:20 2022] GET /compute/v2.1/servers/785194b8-dcad-4490-9f2a-e62dcf5afe79 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:20.308408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-309df691-3d8f-454b-b1e4-4915acb933f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d18b8ee0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.309744 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-bb4cd730-dc8a-4718-9e70-b112799f4db1 req-785203de-cd4c-47df-84d3-f9d005bf4430 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089244 Oct 04 18:12:20.314665 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1314/2580] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:20.347663 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-309df691-3d8f-454b-b1e4-4915acb933f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Image not found. Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-309df691-3d8f-454b-b1e4-4915acb933f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e HTTP/1.1 Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:20.350047 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: exception: Image not found. Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'f677628d-355a-4e82-97af-bd9d6bc3d76e'} Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:20.351364 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f677628d-355a-4e82-97af-bd9d6bc3d76e to delete Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.352139 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f677628d-355a-4e82-97af-bd9d6bc3d76e could not be found. Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:20.353277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-309df691-3d8f-454b-b1e4-4915acb933f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Image not found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-309df691-3d8f-454b-b1e4-4915acb933f1 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e" status: 404 len: 62 microversion: 2.1 time: 0.052522 Oct 04 18:12:20.354354 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1267/2581] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:20 2022] DELETE /compute/v2.1/images/f677628d-355a-4e82-97af-bd9d6bc3d76e => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:12:20.367187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.369661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:20.379334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.380137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.380992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.381931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.382592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.383267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.406099 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 HTTP/1.1 Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:20.408832 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. Oct 04 18:12:20.410268 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '95bfba3c-5b12-4b4a-800c-c3a37b9da5e2'} Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:20.410914 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. Oct 04 18:12:20.412017 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.415196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:20.416350 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-28cbaeaf-2186-46ad-96dc-ef9e15b13832 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 404 len: 111 microversion: 2.1 time: 0.056657 Oct 04 18:12:20.417464 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1315/2582] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:20 2022] DELETE /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:20.426007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.426766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:20.456473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.457369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.458035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.459007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.459690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.460337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.488191 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 HTTP/1.1 Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:20.490392 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. Oct 04 18:12:20.491673 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '95bfba3c-5b12-4b4a-800c-c3a37b9da5e2'} Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:20.492330 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. Oct 04 18:12:20.493404 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.496037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Instance 95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:20.497155 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f7d3a03f-fcde-49c7-a199-89ffbae0b7da tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2" status: 404 len: 111 microversion: 2.1 time: 0.075243 Oct 04 18:12:20.502024 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1268/2583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:20 2022] GET /compute/v2.1/servers/95bfba3c-5b12-4b4a-800c-c3a37b9da5e2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:20.509933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b19054de-5828-48e0-8158-c1253175dbd8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '.version_select at 0x7fd4d13d0b80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.545044 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-b19054de-5828-48e0-8158-c1253175dbd8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Image not found. Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b19054de-5828-48e0-8158-c1253175dbd8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c HTTP/1.1 Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:20.548556 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '832056e9-09c6-4215-85d4-69fb7aada29c'} Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:20.550266 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 832056e9-09c6-4215-85d4-69fb7aada29c to delete Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.551246 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 832056e9-09c6-4215-85d4-69fb7aada29c could not be found. Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:20.552490 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:12:20.553813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.557731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b19054de-5828-48e0-8158-c1253175dbd8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:20.558885 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b19054de-5828-48e0-8158-c1253175dbd8 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c" status: 404 len: 62 microversion: 2.1 time: 0.056022 Oct 04 18:12:20.568271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.569078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:20.575379 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1316/2584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:20 2022] DELETE /compute/v2.1/images/832056e9-09c6-4215-85d4-69fb7aada29c => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:12:20.578562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.579492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.580799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.582132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.583184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.584511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.605490 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d HTTP/1.1 Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:20.607890 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. Oct 04 18:12:20.609627 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d'} Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:20.610281 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. Oct 04 18:12:20.611407 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.614774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:20.616413 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-98faf2a3-2414-48eb-9221-74158521969b tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 404 len: 111 microversion: 2.1 time: 0.052447 Oct 04 18:12:20.627163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.627785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] [instance: 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:20.631392 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1269/2585] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:20 2022] DELETE /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:20.636942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.637447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.637896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.638612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.639101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.639530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.658707 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] HTTP exception thrown: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Request method failure captured: Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d HTTP/1.1 Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHZ3_W72sMUKiCOFNnPc6dSx8KJvddXbTx5hEiM0Wcq8c7_V14cnVQSDU0ATe_JbGkzdVFg0qMrjpBHkr0DydkjVIcMca698HIl9hYjVbm4qLb_htgw2xBfUPjSCWfwV3B3k_D4HORwt14pZXLEK0I5WhVLh3GrKlOpXHLTQJAwiSec Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:20.661263 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/67c1cf4579c5406fb461ec00e486b491"}]}] Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 67c1cf4579c5406fb461ec00e486b491 Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesTestJSON-199193138 Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 2f402a68c6734b9488ab4a04e8b630a6 Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesTestJSON-199193138-project Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. Oct 04 18:12:20.662496 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d'} Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:20.663264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. Oct 04 18:12:20.664380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:20.668197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] Returning 404 to user: Instance 0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:20.668197 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fb80c2b7-770f-4e56-b1d3-4ffdd7bbd970 tempest-ImagesTestJSON-199193138 tempest-ImagesTestJSON-199193138-project] 10.222.0.18 "GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d" status: 404 len: 111 microversion: 2.1 time: 0.041223 Oct 04 18:12:20.668197 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1317/2586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:20 2022] GET /compute/v2.1/servers/0bbd7fc0-d639-4752-a8dc-1b26cbd7c58d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:20.672961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d3d1254-0b92-4f7a-a2a0-abb35091dec6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.673597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8d3d1254-0b92-4f7a-a2a0-abb35091dec6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:20.680311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d3d1254-0b92-4f7a-a2a0-abb35091dec6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.680816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d3d1254-0b92-4f7a-a2a0-abb35091dec6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.681390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d3d1254-0b92-4f7a-a2a0-abb35091dec6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.682446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d3d1254-0b92-4f7a-a2a0-abb35091dec6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.683238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d3d1254-0b92-4f7a-a2a0-abb35091dec6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.684195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d3d1254-0b92-4f7a-a2a0-abb35091dec6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.693378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5084f95c-9dad-45ef-b341-aa2a30b14a3e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.694776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5084f95c-9dad-45ef-b341-aa2a30b14a3e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:20.709829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5084f95c-9dad-45ef-b341-aa2a30b14a3e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.721320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5084f95c-9dad-45ef-b341-aa2a30b14a3e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.722163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5084f95c-9dad-45ef-b341-aa2a30b14a3e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.723601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5084f95c-9dad-45ef-b341-aa2a30b14a3e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.724562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5084f95c-9dad-45ef-b341-aa2a30b14a3e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.725215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5084f95c-9dad-45ef-b341-aa2a30b14a3e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.112704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d3d1254-0b92-4f7a-a2a0-abb35091dec6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.119837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5084f95c-9dad-45ef-b341-aa2a30b14a3e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.124825 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8d3d1254-0b92-4f7a-a2a0-abb35091dec6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.455738 Oct 04 18:12:21.146992 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5084f95c-9dad-45ef-b341-aa2a30b14a3e tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1476 microversion: 2.1 time: 0.458326 Oct 04 18:12:21.148947 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1318/2588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:20 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1476 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:21.150786 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1270/2588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:20 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:21.262706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:21.263375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:21.264099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16671876-4494-422b-85dd-53dd4c3e41a1 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:21.264908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-16671876-4494-422b-85dd-53dd4c3e41a1 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:21.280873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.285299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.287960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16671876-4494-422b-85dd-53dd4c3e41a1 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.288492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16671876-4494-422b-85dd-53dd4c3e41a1 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.288771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.290698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.291245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.295093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16671876-4494-422b-85dd-53dd4c3e41a1 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.296580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.299627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16671876-4494-422b-85dd-53dd4c3e41a1 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.300172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16671876-4494-422b-85dd-53dd4c3e41a1 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.300634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16671876-4494-422b-85dd-53dd4c3e41a1 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.659542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.670230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.678457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.685092 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-87327bd2-57fb-4a48-9cdc-500fa6639df4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.432451 Oct 04 18:12:21.686170 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1271/2589] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:21 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:21.712072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-16671876-4494-422b-85dd-53dd4c3e41a1 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.725379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-02fdbd99-7996-4e15-9ca1-6d408c3daa72 req-0d6925d2-68a7-4f3b-ae9d-8229ec146b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a", "name": "network-vif-unplugged", "status": "completed", "tag": "1075430b-4731-47b1-aeb1-6c78e21fd987"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:21.741632 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-16671876-4494-422b-85dd-53dd4c3e41a1 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1315 microversion: 2.1 time: 0.511708 Oct 04 18:12:21.742895 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1319/2590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:21 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:21.743557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-02fdbd99-7996-4e15-9ca1-6d408c3daa72 req-0d6925d2-68a7-4f3b-ae9d-8229ec146b60 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.744050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-02fdbd99-7996-4e15-9ca1-6d408c3daa72 req-0d6925d2-68a7-4f3b-ae9d-8229ec146b60 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.745002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-02fdbd99-7996-4e15-9ca1-6d408c3daa72 req-0d6925d2-68a7-4f3b-ae9d-8229ec146b60 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.769701 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-02fdbd99-7996-4e15-9ca1-6d408c3daa72 req-0d6925d2-68a7-4f3b-ae9d-8229ec146b60 service nova] Creating event network-vif-unplugged:1075430b-4731-47b1-aeb1-6c78e21fd987 for instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a on n-h2-850499-14 Oct 04 18:12:21.775438 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-02fdbd99-7996-4e15-9ca1-6d408c3daa72 req-0d6925d2-68a7-4f3b-ae9d-8229ec146b60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060410 Oct 04 18:12:21.776526 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1272/2591] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:22.176695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5da7999c-1032-4623-8df4-cee84c0843cb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:22.180429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5da7999c-1032-4623-8df4-cee84c0843cb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:22.183154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-886d6746-5804-49c1-8444-3b27fbd51de9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:22.184019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-886d6746-5804-49c1-8444-3b27fbd51de9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:22.190696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da7999c-1032-4623-8df4-cee84c0843cb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.191770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da7999c-1032-4623-8df4-cee84c0843cb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.192381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da7999c-1032-4623-8df4-cee84c0843cb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.193416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da7999c-1032-4623-8df4-cee84c0843cb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.194165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da7999c-1032-4623-8df4-cee84c0843cb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.194785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da7999c-1032-4623-8df4-cee84c0843cb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.202904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-886d6746-5804-49c1-8444-3b27fbd51de9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.207283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-886d6746-5804-49c1-8444-3b27fbd51de9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.207834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-886d6746-5804-49c1-8444-3b27fbd51de9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.208670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-886d6746-5804-49c1-8444-3b27fbd51de9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.212748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-886d6746-5804-49c1-8444-3b27fbd51de9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.213321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-886d6746-5804-49c1-8444-3b27fbd51de9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.223591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:23.254683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5da7999c-1032-4623-8df4-cee84c0843cb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.268549 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5da7999c-1032-4623-8df4-cee84c0843cb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1476 microversion: 2.1 time: 1.100643 Oct 04 18:12:23.284712 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1273/2592] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:22 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1476 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:23.291943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-398419778", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dacd0e20-5ee4-4bd6-a993-fa8e20b5cbfc"}, {"port": "9f2aeed6-f4dd-4127-b639-9ee9eb77b3f7", "tag": "port-1"}, {"port": "eef312c0-5fd8-44b6-960d-307ccd82a1df", "tag": "port-2"}, {"uuid": "7850c830-2185-402b-ada4-74556a7635c0", "tag": "net-1"}, {"uuid": "7850c830-2185-402b-ada4-74556a7635c0"}, {"uuid": "5f0cc8c7-6054-4903-9768-d36f866a2ccd", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5f0cc8c7-6054-4903-9768-d36f866a2ccd", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5d81c772-493b-4e0b-8fec-1155b78b6d56", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "30034e8b-cb07-4e9a-894b-106678991fba", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "01f81a08-b19a-460a-9c62-f3668ac09c87", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1254785172"}], "key_name": "tempest-keypair-1842530237", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:23.330989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-886d6746-5804-49c1-8444-3b27fbd51de9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.347119 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-886d6746-5804-49c1-8444-3b27fbd51de9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 1.191738 Oct 04 18:12:23.348350 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1320/2593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:22 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:23.353469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:23.354422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:23.368552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.369876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.370557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.372211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.373012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.373678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.698085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] validate_networks() for [('dacd0e20-5ee4-4bd6-a993-fa8e20b5cbfc', None, None, None, None, None), (None, None, '9f2aeed6-f4dd-4127-b639-9ee9eb77b3f7', None, None, None), (None, None, 'eef312c0-5fd8-44b6-960d-307ccd82a1df', None, None, None), ('7850c830-2185-402b-ada4-74556a7635c0', None, None, None, None, None), ('7850c830-2185-402b-ada4-74556a7635c0', None, None, None, None, None), ('5f0cc8c7-6054-4903-9768-d36f866a2ccd', '10.2.2.100', None, None, None, None), ('5f0cc8c7-6054-4903-9768-d36f866a2ccd', '10.2.2.200', None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:12:23.879099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.892351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.894287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.895919 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fcf75609-4685-4f1a-88f4-82a5aceb6ca6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.546274 Oct 04 18:12:23.897575 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1321/2594] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:23 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:23.903826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1062e49-f6d4-4ec9-85ab-572d776787ba tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:23.904688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1062e49-f6d4-4ec9-85ab-572d776787ba tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:23.912544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:23.914788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1062e49-f6d4-4ec9-85ab-572d776787ba tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.915565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1062e49-f6d4-4ec9-85ab-572d776787ba tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.916225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1062e49-f6d4-4ec9-85ab-572d776787ba tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.917579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1062e49-f6d4-4ec9-85ab-572d776787ba tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.918329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1062e49-f6d4-4ec9-85ab-572d776787ba tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.919826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1062e49-f6d4-4ec9-85ab-572d776787ba tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.333081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e1062e49-f6d4-4ec9-85ab-572d776787ba tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:24.349729 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1062e49-f6d4-4ec9-85ab-572d776787ba tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1504 microversion: 2.1 time: 0.449852 Oct 04 18:12:24.356154 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1322/2595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:23 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1504 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:24.364271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a2f0a04-5afb-4389-badf-009209682420 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:24.364902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a2f0a04-5afb-4389-badf-009209682420 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:24.382176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2f0a04-5afb-4389-badf-009209682420 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:24.382755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2f0a04-5afb-4389-badf-009209682420 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:24.383238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2f0a04-5afb-4389-badf-009209682420 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.390945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2f0a04-5afb-4389-badf-009209682420 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:24.391554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2f0a04-5afb-4389-badf-009209682420 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:24.392070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2f0a04-5afb-4389-badf-009209682420 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.879704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a2f0a04-5afb-4389-badf-009209682420 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:24.893117 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a2f0a04-5afb-4389-badf-009209682420 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1476 microversion: 2.1 time: 0.535696 Oct 04 18:12:24.914066 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1323/2596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:24 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1476 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:24.924169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ee0d5d7-cbf1-47e5-a163-5c1879be7e80 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:24.925068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ee0d5d7-cbf1-47e5-a163-5c1879be7e80 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:24.942807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee0d5d7-cbf1-47e5-a163-5c1879be7e80 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:24.943347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee0d5d7-cbf1-47e5-a163-5c1879be7e80 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:24.943797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee0d5d7-cbf1-47e5-a163-5c1879be7e80 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.944892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee0d5d7-cbf1-47e5-a163-5c1879be7e80 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:24.945364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee0d5d7-cbf1-47e5-a163-5c1879be7e80 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:24.945807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee0d5d7-cbf1-47e5-a163-5c1879be7e80 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.003751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:25.693669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ee0d5d7-cbf1-47e5-a163-5c1879be7e80 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.703157 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ee0d5d7-cbf1-47e5-a163-5c1879be7e80 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.787801 Oct 04 18:12:25.706742 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1324/2597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:24 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:25.711930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-832b8f60-0f34-4136-ab4e-ba70094e4a1c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:25.712706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-832b8f60-0f34-4136-ab4e-ba70094e4a1c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:25.719760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-832b8f60-0f34-4136-ab4e-ba70094e4a1c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.720732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-832b8f60-0f34-4136-ab4e-ba70094e4a1c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.721407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-832b8f60-0f34-4136-ab4e-ba70094e4a1c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.727389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-832b8f60-0f34-4136-ab4e-ba70094e4a1c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.728478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-832b8f60-0f34-4136-ab4e-ba70094e4a1c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.729445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-832b8f60-0f34-4136-ab4e-ba70094e4a1c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.764256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-832b8f60-0f34-4136-ab4e-ba70094e4a1c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:12:25.917507 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-832b8f60-0f34-4136-ab4e-ba70094e4a1c tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "DELETE /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 204 len: 0 microversion: 2.1 time: 0.209016 Oct 04 18:12:25.920043 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1325/2598] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:25 2022] DELETE /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:25.933381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:25.935082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:25.947750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.949354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.950655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.951724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.953030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.953844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.534203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:26.544041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:26.545913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:26.547372 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8bce4707-5f07-4a34-8137-3368b1a8c777 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.625511 Oct 04 18:12:26.563978 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1326/2599] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:25 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:26.563978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f68bce05-b27e-427a-893e-47ebed54d5bd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:26.564566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f68bce05-b27e-427a-893e-47ebed54d5bd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:26.572247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f68bce05-b27e-427a-893e-47ebed54d5bd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.573077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f68bce05-b27e-427a-893e-47ebed54d5bd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.573743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f68bce05-b27e-427a-893e-47ebed54d5bd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.574679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f68bce05-b27e-427a-893e-47ebed54d5bd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.575526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f68bce05-b27e-427a-893e-47ebed54d5bd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.576177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f68bce05-b27e-427a-893e-47ebed54d5bd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:27.395820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f68bce05-b27e-427a-893e-47ebed54d5bd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:27.407951 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f68bce05-b27e-427a-893e-47ebed54d5bd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1476 microversion: 2.1 time: 0.858382 Oct 04 18:12:27.408828 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1327/2600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:26 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1476 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:27.415165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-236295d8-460c-44ae-88c5-7cfea2b49aab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:27.422120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-236295d8-460c-44ae-88c5-7cfea2b49aab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:27.458736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236295d8-460c-44ae-88c5-7cfea2b49aab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:27.462075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236295d8-460c-44ae-88c5-7cfea2b49aab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:27.463648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236295d8-460c-44ae-88c5-7cfea2b49aab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:27.464422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236295d8-460c-44ae-88c5-7cfea2b49aab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:27.466607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236295d8-460c-44ae-88c5-7cfea2b49aab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:27.467084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236295d8-460c-44ae-88c5-7cfea2b49aab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:27.528257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:27.912597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-236295d8-460c-44ae-88c5-7cfea2b49aab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:27.921315 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-236295d8-460c-44ae-88c5-7cfea2b49aab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1510 microversion: 2.1 time: 0.511062 Oct 04 18:12:27.943365 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1328/2601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:27 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1510 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:27.950749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9d91d8be-54b4-4033-9e9a-326724537c8d req-3f39fe2c-4977-4a71-aa5f-e46e5de96d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a", "name": "network-vif-plugged", "status": "completed", "tag": "1075430b-4731-47b1-aeb1-6c78e21fd987"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:27.975725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9d91d8be-54b4-4033-9e9a-326724537c8d req-3f39fe2c-4977-4a71-aa5f-e46e5de96d78 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:27.976764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9d91d8be-54b4-4033-9e9a-326724537c8d req-3f39fe2c-4977-4a71-aa5f-e46e5de96d78 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:27.977558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9d91d8be-54b4-4033-9e9a-326724537c8d req-3f39fe2c-4977-4a71-aa5f-e46e5de96d78 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:27.995716 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9d91d8be-54b4-4033-9e9a-326724537c8d req-3f39fe2c-4977-4a71-aa5f-e46e5de96d78 service nova] Creating event network-vif-plugged:1075430b-4731-47b1-aeb1-6c78e21fd987 for instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a on n-h2-850499-14 Oct 04 18:12:28.003585 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9d91d8be-54b4-4033-9e9a-326724537c8d req-3f39fe2c-4977-4a71-aa5f-e46e5de96d78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058238 Oct 04 18:12:28.004694 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1329/2602] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:28.016072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e48a93d1-bf97-46dc-bba8-8564764c3163 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:28.016706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e48a93d1-bf97-46dc-bba8-8564764c3163 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:28.039848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48a93d1-bf97-46dc-bba8-8564764c3163 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.040555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48a93d1-bf97-46dc-bba8-8564764c3163 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.041338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48a93d1-bf97-46dc-bba8-8564764c3163 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.042287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48a93d1-bf97-46dc-bba8-8564764c3163 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.043635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48a93d1-bf97-46dc-bba8-8564764c3163 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.044237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e48a93d1-bf97-46dc-bba8-8564764c3163 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.408198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e48a93d1-bf97-46dc-bba8-8564764c3163 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.423992 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e48a93d1-bf97-46dc-bba8-8564764c3163 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.417745 Oct 04 18:12:28.425438 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1330/2603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:28 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:28.430648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:28.433462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:28.447636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.448355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.448985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.451604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.453439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.454053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.967847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.984174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.985841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.997264 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-72674319-02ac-47ca-b8c5-dcff033c8e9d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.570449 Oct 04 18:12:28.997977 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1331/2604] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:28 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:29.003794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8afd0079-f64f-4b66-b40b-065bb4f1bad1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:29.004654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8afd0079-f64f-4b66-b40b-065bb4f1bad1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:29.018103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8afd0079-f64f-4b66-b40b-065bb4f1bad1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.019027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8afd0079-f64f-4b66-b40b-065bb4f1bad1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.019697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8afd0079-f64f-4b66-b40b-065bb4f1bad1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:29.021422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8afd0079-f64f-4b66-b40b-065bb4f1bad1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.022195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8afd0079-f64f-4b66-b40b-065bb4f1bad1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.022937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8afd0079-f64f-4b66-b40b-065bb4f1bad1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:29.462618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8afd0079-f64f-4b66-b40b-065bb4f1bad1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:29.482104 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8afd0079-f64f-4b66-b40b-065bb4f1bad1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1476 microversion: 2.1 time: 0.482491 Oct 04 18:12:29.483930 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1332/2605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:28 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1476 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:29.743305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a173919-484d-4b8f-83d6-4ff33f292b0b tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Action: 'create', calling method: .version_select at 0x7fd4d1b11ca0>, body: {"pool": null} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:30.753921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:30.754523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:30.755251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:30.755834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:30.756839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:30.776747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:30.777588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:30.781861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:30.784031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:30.785225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:30.786005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:30.848521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Getting quotas for project 122253078dc44e1fb2f880d0ebecac02. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:30.860780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Getting quotas for user 4dbb0f91947e404d931fcc6fe7cfb9db and project 122253078dc44e1fb2f880d0ebecac02. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:31.159500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:31.162488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5d81c772-493b-4e0b-8fec-1155b78b6d56',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='30034e8b-cb07-4e9a-894b-106678991fba',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01f81a08-b19a-460a-9c62-f3668ac09c87',volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:31.916293 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b8fdc1d6-e356-461a-92b2-dae822a2e620 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.629725 Oct 04 18:12:31.919436 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1274/2606] 10.222.0.18 () {62 vars in 1189 bytes} [Tue Oct 4 18:12:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 8634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:12:31.941614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:31.942435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:31.965370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:31.967413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:31.968440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:31.969205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:31.978770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:31.982221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:32.118108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:32.126241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:32.130838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:32.132992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lazy-loading 'fault' on Instance uuid 32f3ca20-9d90-425f-9377-096532e41db4 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:32.820730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89286c3fcbc6461dab027b06df6cfaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ada5850074c4165815bcddf248aa35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:32.833509 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-09710344-4d4c-49ef-99ab-2095a4c6d389 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 200 len: 1305 microversion: 2.1 time: 0.912895 Oct 04 18:12:32.835045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1275/2607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:31 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 1305 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:32.844538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9ceee1b-c1c1-48fe-960b-b6aa0a59d207 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:32.845298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9ceee1b-c1c1-48fe-960b-b6aa0a59d207 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:32.860983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9ceee1b-c1c1-48fe-960b-b6aa0a59d207 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:32.861801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9ceee1b-c1c1-48fe-960b-b6aa0a59d207 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:32.862411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9ceee1b-c1c1-48fe-960b-b6aa0a59d207 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:32.863524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9ceee1b-c1c1-48fe-960b-b6aa0a59d207 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:32.867863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9ceee1b-c1c1-48fe-960b-b6aa0a59d207 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:32.868548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9ceee1b-c1c1-48fe-960b-b6aa0a59d207 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:33.371177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9ceee1b-c1c1-48fe-960b-b6aa0a59d207 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:33.382811 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9ceee1b-c1c1-48fe-960b-b6aa0a59d207 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.546968 Oct 04 18:12:33.402531 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1276/2608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:32 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:33.419978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:33.423833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:33.440951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:33.441548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:33.441910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:33.444843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:33.445292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:33.445727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:33.854819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:33.870858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:33.875153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:33.878938 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b8869542-9361-4880-b467-33c16696df82 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 0.474992 Oct 04 18:12:33.880149 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1277/2609] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:33 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:33.896668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f1f76f4a-2459-424e-9739-d2a5b2c0c4f0 req-4d6aca3e-7d2d-4dc4-99ea-4399bcf3025d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f3ca20-9d90-425f-9377-096532e41db4", "name": "network-vif-deleted", "tag": "6548269f-7daa-41dd-a98b-109dc9ef6c4e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:33.927771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f1f76f4a-2459-424e-9739-d2a5b2c0c4f0 req-4d6aca3e-7d2d-4dc4-99ea-4399bcf3025d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:33.931594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f1f76f4a-2459-424e-9739-d2a5b2c0c4f0 req-4d6aca3e-7d2d-4dc4-99ea-4399bcf3025d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:33.936401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f1f76f4a-2459-424e-9739-d2a5b2c0c4f0 req-4d6aca3e-7d2d-4dc4-99ea-4399bcf3025d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:33.968564 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f1f76f4a-2459-424e-9739-d2a5b2c0c4f0 req-4d6aca3e-7d2d-4dc4-99ea-4399bcf3025d service nova] Creating event network-vif-deleted:6548269f-7daa-41dd-a98b-109dc9ef6c4e for instance 32f3ca20-9d90-425f-9377-096532e41db4 on n-h2-850499-14 Oct 04 18:12:34.000061 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f1f76f4a-2459-424e-9739-d2a5b2c0c4f0 req-4d6aca3e-7d2d-4dc4-99ea-4399bcf3025d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116668 Oct 04 18:12:34.001359 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1278/2610] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:34.017493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c07003ba-b57b-4ac5-9688-55733e852840 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:34.018902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c07003ba-b57b-4ac5-9688-55733e852840 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:34.034653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07003ba-b57b-4ac5-9688-55733e852840 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.035541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07003ba-b57b-4ac5-9688-55733e852840 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.036273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07003ba-b57b-4ac5-9688-55733e852840 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.037294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07003ba-b57b-4ac5-9688-55733e852840 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.038033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07003ba-b57b-4ac5-9688-55733e852840 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.038715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c07003ba-b57b-4ac5-9688-55733e852840 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.999628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c07003ba-b57b-4ac5-9688-55733e852840 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:35.027675 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c07003ba-b57b-4ac5-9688-55733e852840 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1462 microversion: 2.1 time: 1.014469 Oct 04 18:12:35.028292 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1279/2611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:34 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1462 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:35.042545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.043201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:35.059701 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a173919-484d-4b8f-83d6-4ff33f292b0b tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.574115 Oct 04 18:12:35.068224 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1333/2612] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:12:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:35.068224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.068224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:35.068758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.068758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.069851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.073016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.073641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.074105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.094010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.095915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.097075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.099452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.100725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.103183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.137980 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] HTTP exception thrown: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Request method failure captured: Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 HTTP/1.1 Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHdq3kjdqAPbRPbVI29aP6Ql0o_WXQPMM9xG2DjjzveVUrgpztB7kpQGTxFAkmaRFUTMHPoKnttzk2zN4wTHTh2kLYYljUApMfSzb6DMrpbaR06StsKDDLytOPGq4M5I95ODY_ExI803S1EYM9LZ8do6l-_FEkuHZTl4bIhFvprP0cg Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:35.140235 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7ada5850074c4165815bcddf248aa35b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}] Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 89286c3fcbc6461dab027b06df6cfaed Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:35.141468 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '32f3ca20-9d90-425f-9377-096532e41db4'} Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:35.142196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:35.143491 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:35.144498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Returning 404 to user: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:35.144498 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa089097-b0c4-404b-97f8-2a93440dbcfc tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 404 len: 111 microversion: 2.1 time: 0.081532 Oct 04 18:12:35.150757 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1334/2613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:35 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:35.157746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bae21c74-df65-4766-9fee-b0e4a8e692e2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.163606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bae21c74-df65-4766-9fee-b0e4a8e692e2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:35.184146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bae21c74-df65-4766-9fee-b0e4a8e692e2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.185157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bae21c74-df65-4766-9fee-b0e4a8e692e2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.185827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bae21c74-df65-4766-9fee-b0e4a8e692e2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.186863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bae21c74-df65-4766-9fee-b0e4a8e692e2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.187573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bae21c74-df65-4766-9fee-b0e4a8e692e2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.188227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bae21c74-df65-4766-9fee-b0e4a8e692e2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.347665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:35.362557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:35.364313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:35.365696 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12826967-e4a8-4d69-9ebb-8b2c4f44e94e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1575 microversion: 2.32 time: 0.331147 Oct 04 18:12:35.366518 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1280/2614] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:35 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1575 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:35.371639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.372593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:35.379498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.380872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.381544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.382517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.383236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.383884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.752516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bae21c74-df65-4766-9fee-b0e4a8e692e2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:35.765273 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bae21c74-df65-4766-9fee-b0e4a8e692e2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.611904 Oct 04 18:12:35.766486 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1335/2615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:35 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:35.777781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4a09dba-52ef-4a23-8943-2ec0516864fd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.781472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4a09dba-52ef-4a23-8943-2ec0516864fd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:35.802547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a09dba-52ef-4a23-8943-2ec0516864fd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.803270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a09dba-52ef-4a23-8943-2ec0516864fd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.806781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a09dba-52ef-4a23-8943-2ec0516864fd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.808847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a09dba-52ef-4a23-8943-2ec0516864fd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.811205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a09dba-52ef-4a23-8943-2ec0516864fd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.812332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4a09dba-52ef-4a23-8943-2ec0516864fd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.405991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.426559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.428423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.445385 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd137497-2245-4a5d-ba0e-80772965b69a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1813 microversion: 2.25 time: 1.077427 Oct 04 18:12:36.446110 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1281/2616] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:35 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1813 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:36.457463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c47e42ac-d169-4224-84e7-f4ad809923ae tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Calling method '.version_select at 0x7fd4d12fa430>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:36.500099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d4a09dba-52ef-4a23-8943-2ec0516864fd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.509741 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d4a09dba-52ef-4a23-8943-2ec0516864fd tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1462 microversion: 2.1 time: 0.740885 Oct 04 18:12:36.519028 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1336/2617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:35 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1462 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:36.521836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1316532908", "metadata": {"image_type": "test"}}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:36.538109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:36.552692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.555589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.556397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.557395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.560804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.562115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.594803 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] HTTP exception thrown: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Request method failure captured: Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4/action HTTP/1.1 Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 112 Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHdq3kjdqAPbRPbVI29aP6Ql0o_WXQPMM9xG2DjjzveVUrgpztB7kpQGTxFAkmaRFUTMHPoKnttzk2zN4wTHTh2kLYYljUApMfSzb6DMrpbaR06StsKDDLytOPGq4M5I95ODY_ExI803S1EYM9LZ8do6l-_FEkuHZTl4bIhFvprP0cg Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:36.601476 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7ada5850074c4165815bcddf248aa35b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}] Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 89286c3fcbc6461dab027b06df6cfaed Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1316532908", "metadata": {"image_type": "test"}}} Oct 04 18:12:36.602909 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '32f3ca20-9d90-425f-9377-096532e41db4', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1316532908', 'metadata': {'image_type': 'test'}}}} Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:36.603932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:36.605026 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:36.607122 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:36.607122 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:36.607122 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:36.607122 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:36.607122 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:36.615006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Returning 404 to user: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:36.616176 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7457f8fc-dd3f-4663-8940-a65cdc31a47e tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "POST /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4/action" status: 404 len: 111 microversion: 2.1 time: 0.101914 Oct 04 18:12:36.617319 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1337/2618] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 4 18:12:36 2022] POST /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4/action => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:36.709528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1899906488", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:36.780567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] validate_networks() for [('69b13a93-21c6-4fd2-9113-725fac9d7bbf', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:12:37.552923 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c47e42ac-d169-4224-84e7-f4ad809923ae tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/ff5fea6f-a40f-4a7e-b1e7-d9902ef81aef" status: 200 len: 142 microversion: 2.1 time: 1.104825 Oct 04 18:12:37.554222 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1282/2619] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:12:36 2022] GET /compute/v2.1/os-floating-ips/ff5fea6f-a40f-4a7e-b1e7-d9902ef81aef => generated 142 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:37.569954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:37.576581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:37.598879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:37.601879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:37.606694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:37.611951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:37.615174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:37.617191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.050851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:38.076557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:38.078987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:38.080881 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-57b8b897-6f70-4e0c-a925-c4ff1f37fcce tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1661 microversion: 2.32 time: 0.525528 Oct 04 18:12:38.082222 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1283/2620] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:37 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1661 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:38.088209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:38.093017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:38.100817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.101695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.102518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.103808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.104732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.105437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.281586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:38.282214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:38.282800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:38.283343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:38.283861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:38.408638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:38.428997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.429519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.429972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.430718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.443318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.443789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.508922 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1fc79531-aafa-4fd9-99ac-ee0c61424390 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action" status: 202 len: 1066 microversion: 2.1 time: 0.425003 Oct 04 18:12:38.512020 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1284/2621] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:12:38 2022] POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action => generated 1066 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:12:38.522218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d8987c5-c677-4a69-a02a-08d018d766e3 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1661319978", "metadata": {"image_type": "test"}}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:38.534593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d8987c5-c677-4a69-a02a-08d018d766e3 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Failed to fetch instance by id tempest-invalid-456179424 {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:12:38.534593 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-7d8987c5-c677-4a69-a02a-08d018d766e3 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] HTTP exception thrown: Instance tempest-invalid-456179424 could not be found. Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d8987c5-c677-4a69-a02a-08d018d766e3 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Request method failure captured: Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/tempest-invalid-456179424/action HTTP/1.1 Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 112 Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHdq3kjdqAPbRPbVI29aP6Ql0o_WXQPMM9xG2DjjzveVUrgpztB7kpQGTxFAkmaRFUTMHPoKnttzk2zN4wTHTh2kLYYljUApMfSzb6DMrpbaR06StsKDDLytOPGq4M5I95ODY_ExI803S1EYM9LZ8do6l-_FEkuHZTl4bIhFvprP0cg Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:38.536341 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7ada5850074c4165815bcddf248aa35b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}] Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 89286c3fcbc6461dab027b06df6cfaed Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1661319978", "metadata": {"image_type": "test"}}} Oct 04 18:12:38.537847 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance tempest-invalid-456179424 could not be found. Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'tempest-invalid-456179424', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1661319978', 'metadata': {'image_type': 'test'}}}} Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-456179424 could not be found. Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:38.545048 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-456179424 could not be found. Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-456179424 could not be found. Oct 04 18:12:38.546267 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:38.547439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d8987c5-c677-4a69-a02a-08d018d766e3 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Returning 404 to user: Instance tempest-invalid-456179424 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:38.547439 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d8987c5-c677-4a69-a02a-08d018d766e3 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "POST /compute/v2.1/servers/tempest-invalid-456179424/action" status: 404 len: 100 microversion: 2.1 time: 0.025116 Oct 04 18:12:38.547439 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1285/2622] 10.222.0.18 () {60 vars in 1246 bytes} [Tue Oct 4 18:12:38 2022] POST /compute/v2.1/servers/tempest-invalid-456179424/action => generated 100 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:38.548091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-19d942de-df45-494a-adf9-ea592ea4a4ff tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:38.548629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-19d942de-df45-494a-adf9-ea592ea4a4ff tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:38.571423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19d942de-df45-494a-adf9-ea592ea4a4ff tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.572374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19d942de-df45-494a-adf9-ea592ea4a4ff tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.572566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19d942de-df45-494a-adf9-ea592ea4a4ff tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.574827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19d942de-df45-494a-adf9-ea592ea4a4ff tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.576346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19d942de-df45-494a-adf9-ea592ea4a4ff tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.578264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19d942de-df45-494a-adf9-ea592ea4a4ff tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.764796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:38.765317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:38.765895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:38.766982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:38.767638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:38.788898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.789877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.790552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.791561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.792326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.793020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.845950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Getting quotas for project 81f7c69bc5f14725b40bcc5cccece335. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:38.855118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Getting quotas for user e4680d09618342e0bf77aca08de5c6eb and project 81f7c69bc5f14725b40bcc5cccece335. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:38.886537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:38.901318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:39.032225 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ff5149ae-7896-4d17-ab7c-4d67e5d03145 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.413213 Oct 04 18:12:39.049409 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1338/2623] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:12:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:12:39.077261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:39.077959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:39.092711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-19d942de-df45-494a-adf9-ea592ea4a4ff tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:39.103810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:39.106118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:39.107714 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-19d942de-df45-494a-adf9-ea592ea4a4ff tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1507 microversion: 2.1 time: 0.564235 Oct 04 18:12:39.108734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:39.109581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:39.110413 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1286/2624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:38 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1507 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:39.113403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:39.118006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:39.127072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bde10114-9126-4796-9340-14a4204262d5 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Calling method '.version_select at 0x7fd4d1c48b80>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:39.730596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:39.744178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:39.748959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:39.753582 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3961972f-9d3c-4471-8425-fd23d2a12154 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1803 microversion: 2.25 time: 0.699631 Oct 04 18:12:39.755397 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1339/2625] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:39 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1803 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:39.764979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-784c6463-fe36-4a13-8394-df0cd5e6cf34 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:39.769874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-784c6463-fe36-4a13-8394-df0cd5e6cf34 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:39.779859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-784c6463-fe36-4a13-8394-df0cd5e6cf34 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:39.782690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-784c6463-fe36-4a13-8394-df0cd5e6cf34 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:39.786020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-784c6463-fe36-4a13-8394-df0cd5e6cf34 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:39.786982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-784c6463-fe36-4a13-8394-df0cd5e6cf34 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:39.789330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-784c6463-fe36-4a13-8394-df0cd5e6cf34 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:39.789860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-784c6463-fe36-4a13-8394-df0cd5e6cf34 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:39.871516 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bde10114-9126-4796-9340-14a4204262d5 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.758511 Oct 04 18:12:39.872407 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1287/2626] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:12:39 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:39.877795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aeba36b8-a61e-4946-a4cc-47c62c2df202 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2042122332"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:39.882625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aeba36b8-a61e-4946-a4cc-47c62c2df202 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:12:39.886032 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-aeba36b8-a61e-4946-a4cc-47c62c2df202 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aeba36b8-a61e-4946-a4cc-47c62c2df202 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Request method failure captured: Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 57 Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHdq3kjdqAPbRPbVI29aP6Ql0o_WXQPMM9xG2DjjzveVUrgpztB7kpQGTxFAkmaRFUTMHPoKnttzk2zN4wTHTh2kLYYljUApMfSzb6DMrpbaR06StsKDDLytOPGq4M5I95ODY_ExI803S1EYM9LZ8do6l-_FEkuHZTl4bIhFvprP0cg Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:39.889063 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7ada5850074c4165815bcddf248aa35b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}] Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 89286c3fcbc6461dab027b06df6cfaed Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: {"createImage": {"name": "tempest-test-snap-2042122332"}} Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:12:39.890912 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2042122332'}}} Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:12:39.891689 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:12:39.892806 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:39.896246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aeba36b8-a61e-4946-a4cc-47c62c2df202 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:39.899273 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aeba36b8-a61e-4946-a4cc-47c62c2df202 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.025573 Oct 04 18:12:39.900817 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1288/2627] 10.222.0.18 () {60 vars in 1275 bytes} [Tue Oct 4 18:12:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:39.915205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b959db38-1d1c-490e-ac0e-ccb3d15e3a7e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:39.916992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b959db38-1d1c-490e-ac0e-ccb3d15e3a7e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:39.931679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:40.139437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b959db38-1d1c-490e-ac0e-ccb3d15e3a7e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.164288 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b959db38-1d1c-490e-ac0e-ccb3d15e3a7e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1223 microversion: 2.1 time: 0.256304 Oct 04 18:12:40.165137 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1289/2628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:39 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1223 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:40.194388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:40.205905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:40.235864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.236761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.237405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.240382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.249607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.260392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.556037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-784c6463-fe36-4a13-8394-df0cd5e6cf34 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.568098 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-784c6463-fe36-4a13-8394-df0cd5e6cf34 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1471 microversion: 2.1 time: 0.811357 Oct 04 18:12:40.586474 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1340/2629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:39 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1471 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:40.617637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d02258a7-e077-4c1a-ae68-eaf3e17637ba tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '.version_select at 0x7fd4d1e4e670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:40.633131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d02258a7-e077-4c1a-ae68-eaf3e17637ba tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.633815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d02258a7-e077-4c1a-ae68-eaf3e17637ba tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.634382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d02258a7-e077-4c1a-ae68-eaf3e17637ba tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.647924 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d02258a7-e077-4c1a-ae68-eaf3e17637ba tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1536 microversion: 2.25 time: 0.059659 Oct 04 18:12:40.653620 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1341/2630] 10.222.0.18 () {60 vars in 1184 bytes} [Tue Oct 4 18:12:40 2022] GET /compute/v2.1/os-migrations => generated 1536 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:40.660190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5476a3a6-c26f-4500-8c25-b5f6a17cee45 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Calling method '.version_select at 0x7fd4d137cb80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:40.820098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:41.214045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.259027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.264207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.271423 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5259a891-875c-4085-911c-7fdaf25603e3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1755 microversion: 2.32 time: 1.084973 Oct 04 18:12:41.276433 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1290/2631] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:40 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1755 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:41.297579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1fad10f4-9fef-42bf-899e-8b9e20e8ac02 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1064976168"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:41.307803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1fad10f4-9fef-42bf-899e-8b9e20e8ac02 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:12:41.312330 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-1fad10f4-9fef-42bf-899e-8b9e20e8ac02 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1fad10f4-9fef-42bf-899e-8b9e20e8ac02 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Request method failure captured: Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 57 Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHdq3kjdqAPbRPbVI29aP6Ql0o_WXQPMM9xG2DjjzveVUrgpztB7kpQGTxFAkmaRFUTMHPoKnttzk2zN4wTHTh2kLYYljUApMfSzb6DMrpbaR06StsKDDLytOPGq4M5I95ODY_ExI803S1EYM9LZ8do6l-_FEkuHZTl4bIhFvprP0cg Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:41.314345 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7ada5850074c4165815bcddf248aa35b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}] Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 89286c3fcbc6461dab027b06df6cfaed Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: {"createImage": {"name": "tempest-test-snap-1064976168"}} Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:12:41.315643 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1064976168'}}} Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:12:41.316395 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:12:41.317459 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:41.320552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1fad10f4-9fef-42bf-899e-8b9e20e8ac02 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:41.320552 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1fad10f4-9fef-42bf-899e-8b9e20e8ac02 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.037167 Oct 04 18:12:41.320552 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1291/2632] 10.222.0.18 () {60 vars in 1281 bytes} [Tue Oct 4 18:12:41 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:41.337200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-89a2e482-83b1-48fb-8eae-ea04e7f21759 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:41.337828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-89a2e482-83b1-48fb-8eae-ea04e7f21759 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:41.372551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89a2e482-83b1-48fb-8eae-ea04e7f21759 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.373069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89a2e482-83b1-48fb-8eae-ea04e7f21759 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.373521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89a2e482-83b1-48fb-8eae-ea04e7f21759 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.382021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89a2e482-83b1-48fb-8eae-ea04e7f21759 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.382577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89a2e482-83b1-48fb-8eae-ea04e7f21759 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.383060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89a2e482-83b1-48fb-8eae-ea04e7f21759 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.004774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-89a2e482-83b1-48fb-8eae-ea04e7f21759 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:42.019669 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-89a2e482-83b1-48fb-8eae-ea04e7f21759 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1528 microversion: 2.1 time: 0.702252 Oct 04 18:12:42.020920 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1292/2633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:41 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1528 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:42.025823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-52439a09-5c60-464d-a8a2-19312715426d tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:42.031536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-52439a09-5c60-464d-a8a2-19312715426d tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:42.042025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52439a09-5c60-464d-a8a2-19312715426d tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.047120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52439a09-5c60-464d-a8a2-19312715426d tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.047874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52439a09-5c60-464d-a8a2-19312715426d tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.048823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52439a09-5c60-464d-a8a2-19312715426d tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.049472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52439a09-5c60-464d-a8a2-19312715426d tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.050355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52439a09-5c60-464d-a8a2-19312715426d tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.262306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-52439a09-5c60-464d-a8a2-19312715426d tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid 381cd7a0-7761-4e5b-8b7a-345f828634ea {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:43.304074 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-52439a09-5c60-464d-a8a2-19312715426d tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 2423 microversion: 2.25 time: 1.281542 Oct 04 18:12:43.308091 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1293/2634] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:42 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 2423 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:43.325091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fbbdd130-af27-4082-9554-346c8b325838 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:43.325638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fbbdd130-af27-4082-9554-346c8b325838 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:43.345651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbbdd130-af27-4082-9554-346c8b325838 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.346159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbbdd130-af27-4082-9554-346c8b325838 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.346617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbbdd130-af27-4082-9554-346c8b325838 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.350022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbbdd130-af27-4082-9554-346c8b325838 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.350531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbbdd130-af27-4082-9554-346c8b325838 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.354450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbbdd130-af27-4082-9554-346c8b325838 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.539583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fbbdd130-af27-4082-9554-346c8b325838 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:43.544155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:43.557065 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fbbdd130-af27-4082-9554-346c8b325838 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1281 microversion: 2.1 time: 0.247727 Oct 04 18:12:43.563364 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1294/2635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:43 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1281 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:43.578810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:43.579610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:43.602143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.607637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.608825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.609740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.610368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.610972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.646377 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] HTTP exception thrown: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Request method failure captured: Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 HTTP/1.1 Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHdq3kjdqAPbRPbVI29aP6Ql0o_WXQPMM9xG2DjjzveVUrgpztB7kpQGTxFAkmaRFUTMHPoKnttzk2zN4wTHTh2kLYYljUApMfSzb6DMrpbaR06StsKDDLytOPGq4M5I95ODY_ExI803S1EYM9LZ8do6l-_FEkuHZTl4bIhFvprP0cg Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:43.652468 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7ada5850074c4165815bcddf248aa35b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}] Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 89286c3fcbc6461dab027b06df6cfaed Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:43.653984 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '32f3ca20-9d90-425f-9377-096532e41db4'} Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:43.654684 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:43.655931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:43.657090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Returning 404 to user: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:43.657090 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d38a6772-bbe9-426b-a78f-d928d4738eab tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "DELETE /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 404 len: 111 microversion: 2.1 time: 0.092009 Oct 04 18:12:43.657313 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1295/2636] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:43 2022] DELETE /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:43.671641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b0203237-9c33-448f-9f0b-33fca2c64d69 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:43.672719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b0203237-9c33-448f-9f0b-33fca2c64d69 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:43.695069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0203237-9c33-448f-9f0b-33fca2c64d69 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.696055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0203237-9c33-448f-9f0b-33fca2c64d69 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.696656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0203237-9c33-448f-9f0b-33fca2c64d69 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.697556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0203237-9c33-448f-9f0b-33fca2c64d69 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.703111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0203237-9c33-448f-9f0b-33fca2c64d69 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.704071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0203237-9c33-448f-9f0b-33fca2c64d69 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.002353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0203237-9c33-448f-9f0b-33fca2c64d69 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.015486 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b0203237-9c33-448f-9f0b-33fca2c64d69 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1471 microversion: 2.1 time: 0.355325 Oct 04 18:12:44.016594 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1296/2637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:43 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1471 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:44.032473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:44.033719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:44.048774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.049524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.050434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.051386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.052018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.052610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.451587 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5476a3a6-c26f-4500-8c25-b5f6a17cee45 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/ff5fea6f-a40f-4a7e-b1e7-d9902ef81aef" status: 202 len: 0 microversion: 2.1 time: 3.795057 Oct 04 18:12:44.453156 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1342/2638] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:12:40 2022] DELETE /compute/v2.1/os-floating-ips/ff5fea6f-a40f-4a7e-b1e7-d9902ef81aef => generated 0 bytes in 3799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:12:44.455802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.466571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.468424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79c29c69-e95d-4db6-9059-6487d0f976da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:44.471693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-79c29c69-e95d-4db6-9059-6487d0f976da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:44.473564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.476404 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c7ab713-5cd8-4f66-9df2-8da195bf04fb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1849 microversion: 2.32 time: 0.448376 Oct 04 18:12:44.479163 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1297/2639] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:44 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1849 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:44.483079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79c29c69-e95d-4db6-9059-6487d0f976da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.484769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79c29c69-e95d-4db6-9059-6487d0f976da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.486507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5a17fc2b-e952-4c64-95e4-34f3a58976bf tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:44.491275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79c29c69-e95d-4db6-9059-6487d0f976da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.492315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79c29c69-e95d-4db6-9059-6487d0f976da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.493017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79c29c69-e95d-4db6-9059-6487d0f976da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.493701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79c29c69-e95d-4db6-9059-6487d0f976da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.495717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5a17fc2b-e952-4c64-95e4-34f3a58976bf tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:44.502710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a17fc2b-e952-4c64-95e4-34f3a58976bf tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.505392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a17fc2b-e952-4c64-95e4-34f3a58976bf tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.506058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a17fc2b-e952-4c64-95e4-34f3a58976bf tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.508862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a17fc2b-e952-4c64-95e4-34f3a58976bf tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.509537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a17fc2b-e952-4c64-95e4-34f3a58976bf tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.510194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a17fc2b-e952-4c64-95e4-34f3a58976bf tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.833853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-79c29c69-e95d-4db6-9059-6487d0f976da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.842990 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-79c29c69-e95d-4db6-9059-6487d0f976da tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1528 microversion: 2.1 time: 0.388040 Oct 04 18:12:44.843900 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1343/2640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:44 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1528 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:44.849035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:44.849890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] [instance: 32f3ca20-9d90-425f-9377-096532e41db4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:44.861219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.862036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.862787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.864147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.865875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.866519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.888896 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] HTTP exception thrown: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Request method failure captured: Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 HTTP/1.1 Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHdq3kjdqAPbRPbVI29aP6Ql0o_WXQPMM9xG2DjjzveVUrgpztB7kpQGTxFAkmaRFUTMHPoKnttzk2zN4wTHTh2kLYYljUApMfSzb6DMrpbaR06StsKDDLytOPGq4M5I95ODY_ExI803S1EYM9LZ8do6l-_FEkuHZTl4bIhFvprP0cg Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:44.890706 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7ada5850074c4165815bcddf248aa35b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ada5850074c4165815bcddf248aa35b"}]}] Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 7ada5850074c4165815bcddf248aa35b Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1998310619 Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 89286c3fcbc6461dab027b06df6cfaed Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesNegativeTestJSON-1998310619-project Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:44.892146 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '32f3ca20-9d90-425f-9377-096532e41db4'} Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:44.892977 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. Oct 04 18:12:44.894187 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:44.897038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] Returning 404 to user: Instance 32f3ca20-9d90-425f-9377-096532e41db4 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:44.898142 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fa8a1356-ab11-437d-8235-35f52fae5c71 tempest-ImagesNegativeTestJSON-1998310619 tempest-ImagesNegativeTestJSON-1998310619-project] 10.222.0.18 "GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4" status: 404 len: 111 microversion: 2.1 time: 0.052805 Oct 04 18:12:44.902566 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1344/2641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:44 2022] GET /compute/v2.1/servers/32f3ca20-9d90-425f-9377-096532e41db4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:44.909448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-305ebe1e-5020-483e-b57e-4198c22ba401 req-ffdfeaba-7e0d-4113-afc9-f7d3e570c529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d14a05-8a0f-4911-af5e-e84c9e8076cf", "name": "network-vif-plugged", "status": "completed", "tag": "2a0c754b-d2bd-4a81-95a3-d6413110c4cd"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:44.925047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-305ebe1e-5020-483e-b57e-4198c22ba401 req-ffdfeaba-7e0d-4113-afc9-f7d3e570c529 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.926022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-305ebe1e-5020-483e-b57e-4198c22ba401 req-ffdfeaba-7e0d-4113-afc9-f7d3e570c529 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.926672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-305ebe1e-5020-483e-b57e-4198c22ba401 req-ffdfeaba-7e0d-4113-afc9-f7d3e570c529 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.955936 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-305ebe1e-5020-483e-b57e-4198c22ba401 req-ffdfeaba-7e0d-4113-afc9-f7d3e570c529 service nova] Creating event network-vif-plugged:2a0c754b-d2bd-4a81-95a3-d6413110c4cd for instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf on n-h2-850499-14 Oct 04 18:12:44.961497 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-305ebe1e-5020-483e-b57e-4198c22ba401 req-ffdfeaba-7e0d-4113-afc9-f7d3e570c529 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056966 Oct 04 18:12:44.962396 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1345/2642] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:44.968986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9caa7498-0ec0-42c6-9885-4198f5b62837 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Action: 'create', calling method: .version_select at 0x7fd4d15484c0>, body: {"pool": null} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:45.057099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-5a17fc2b-e952-4c64-95e4-34f3a58976bf tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid 381cd7a0-7761-4e5b-8b7a-345f828634ea {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:45.090685 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5a17fc2b-e952-4c64-95e4-34f3a58976bf tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 2423 microversion: 2.25 time: 0.608160 Oct 04 18:12:45.106573 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1298/2643] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:44 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 2423 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:45.114682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-a320f554-4ec9-4485-8d9f-cd90f0e1f073 req-5af01ca6-41e1-4314-97d0-31c240374fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "tag": "3a292832-0947-4c83-ad7e-41e6a929165c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:45.151082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a320f554-4ec9-4485-8d9f-cd90f0e1f073 req-5af01ca6-41e1-4314-97d0-31c240374fbe service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.151992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a320f554-4ec9-4485-8d9f-cd90f0e1f073 req-5af01ca6-41e1-4314-97d0-31c240374fbe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.152572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a320f554-4ec9-4485-8d9f-cd90f0e1f073 req-5af01ca6-41e1-4314-97d0-31c240374fbe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.181056 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-a320f554-4ec9-4485-8d9f-cd90f0e1f073 req-5af01ca6-41e1-4314-97d0-31c240374fbe service nova] Creating event network-changed:3a292832-0947-4c83-ad7e-41e6a929165c for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:12:45.206540 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-a320f554-4ec9-4485-8d9f-cd90f0e1f073 req-5af01ca6-41e1-4314-97d0-31c240374fbe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093314 Oct 04 18:12:45.207343 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1299/2644] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:45.215495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4e1ee520-19f6-4b5a-9d06-c915c51e2a0a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:45.219993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4e1ee520-19f6-4b5a-9d06-c915c51e2a0a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:45.243722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e1ee520-19f6-4b5a-9d06-c915c51e2a0a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.245818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e1ee520-19f6-4b5a-9d06-c915c51e2a0a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.247505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e1ee520-19f6-4b5a-9d06-c915c51e2a0a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.251828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e1ee520-19f6-4b5a-9d06-c915c51e2a0a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.252652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e1ee520-19f6-4b5a-9d06-c915c51e2a0a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.253367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e1ee520-19f6-4b5a-9d06-c915c51e2a0a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.964827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4e1ee520-19f6-4b5a-9d06-c915c51e2a0a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:45.976269 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4e1ee520-19f6-4b5a-9d06-c915c51e2a0a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1323 microversion: 2.1 time: 0.767344 Oct 04 18:12:45.976860 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1300/2645] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:45 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1323 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:45.986703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9c252fe4-af79-40b5-9964-03bd7b974c40 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:45.992326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9c252fe4-af79-40b5-9964-03bd7b974c40 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:46.009246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c252fe4-af79-40b5-9964-03bd7b974c40 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.010105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c252fe4-af79-40b5-9964-03bd7b974c40 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.010574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c252fe4-af79-40b5-9964-03bd7b974c40 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.012584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c252fe4-af79-40b5-9964-03bd7b974c40 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.013070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c252fe4-af79-40b5-9964-03bd7b974c40 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.013517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c252fe4-af79-40b5-9964-03bd7b974c40 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.508139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9c252fe4-af79-40b5-9964-03bd7b974c40 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:47.524267 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9c252fe4-af79-40b5-9964-03bd7b974c40 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1471 microversion: 2.1 time: 1.546312 Oct 04 18:12:47.541579 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1301/2646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:45 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1471 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:47.549204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17b99c71-2163-4388-9eb7-deae8bd85a6f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:47.550049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17b99c71-2163-4388-9eb7-deae8bd85a6f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:47.558677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b99c71-2163-4388-9eb7-deae8bd85a6f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.559457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b99c71-2163-4388-9eb7-deae8bd85a6f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.560314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b99c71-2163-4388-9eb7-deae8bd85a6f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.562270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b99c71-2163-4388-9eb7-deae8bd85a6f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.562936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b99c71-2163-4388-9eb7-deae8bd85a6f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.563551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b99c71-2163-4388-9eb7-deae8bd85a6f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.729721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-17b99c71-2163-4388-9eb7-deae8bd85a6f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lazy-loading 'services' on Instance uuid 381cd7a0-7761-4e5b-8b7a-345f828634ea {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:47.928325 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17b99c71-2163-4388-9eb7-deae8bd85a6f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "DELETE /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments/d7b0b18c-6d3f-4847-9131-b51e2cb1f8ba" status: 202 len: 0 microversion: 2.25 time: 0.385096 Oct 04 18:12:47.929946 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1302/2647] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Oct 4 18:12:47 2022] DELETE /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments/d7b0b18c-6d3f-4847-9131-b51e2cb1f8ba => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:47.960374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:47.962481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:47.979592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.980600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.981331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.983914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.987549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.994725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.678596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:48.694546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:48.698084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:48.702483 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b765238a-6586-4b28-a122-c89879efcaf1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1891 microversion: 2.32 time: 0.770060 Oct 04 18:12:48.705394 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1303/2648] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:47 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1891 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:48.716174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d57f4c4-1771-4764-ac96-8204e3f50b3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:48.718919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d57f4c4-1771-4764-ac96-8204e3f50b3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:48.732776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d57f4c4-1771-4764-ac96-8204e3f50b3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.738841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d57f4c4-1771-4764-ac96-8204e3f50b3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.739480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d57f4c4-1771-4764-ac96-8204e3f50b3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.740335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d57f4c4-1771-4764-ac96-8204e3f50b3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.740900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d57f4c4-1771-4764-ac96-8204e3f50b3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.741443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d57f4c4-1771-4764-ac96-8204e3f50b3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.814143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:48.875439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:49.180328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d57f4c4-1771-4764-ac96-8204e3f50b3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.189531 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d57f4c4-1771-4764-ac96-8204e3f50b3c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1523 microversion: 2.1 time: 0.480779 Oct 04 18:12:49.190128 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1304/2649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:48 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1523 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:49.202191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d4ec9379-70df-47d9-901e-650a976fd85b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:49.210033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d4ec9379-70df-47d9-901e-650a976fd85b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:49.226521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4ec9379-70df-47d9-901e-650a976fd85b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.227790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4ec9379-70df-47d9-901e-650a976fd85b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.228255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4ec9379-70df-47d9-901e-650a976fd85b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.233691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4ec9379-70df-47d9-901e-650a976fd85b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.234254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4ec9379-70df-47d9-901e-650a976fd85b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.234712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4ec9379-70df-47d9-901e-650a976fd85b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.616844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d4ec9379-70df-47d9-901e-650a976fd85b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.628182 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d4ec9379-70df-47d9-901e-650a976fd85b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1323 microversion: 2.1 time: 0.434584 Oct 04 18:12:49.628768 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1305/2650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:49 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1323 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:49.643922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-99e16593-541a-44ce-94c8-b8d460783de5 req-e505954b-4431-4fe6-932e-136a0aa495eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "tag": "9f2aeed6-f4dd-4127-b639-9ee9eb77b3f7"}, {"name": "network-changed", "server_uuid": "b8dcc660-4ee0-4c03-994c-bd8c00eea140", "tag": "0657bd03-e275-4cc6-8a1c-2040ba2533e3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:49.667446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-99e16593-541a-44ce-94c8-b8d460783de5 req-e505954b-4431-4fe6-932e-136a0aa495eb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.668309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-99e16593-541a-44ce-94c8-b8d460783de5 req-e505954b-4431-4fe6-932e-136a0aa495eb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.668942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-99e16593-541a-44ce-94c8-b8d460783de5 req-e505954b-4431-4fe6-932e-136a0aa495eb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.691648 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-99e16593-541a-44ce-94c8-b8d460783de5 req-e505954b-4431-4fe6-932e-136a0aa495eb service nova] Creating event network-changed:9f2aeed6-f4dd-4127-b639-9ee9eb77b3f7 for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:12:49.692324 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-99e16593-541a-44ce-94c8-b8d460783de5 req-e505954b-4431-4fe6-932e-136a0aa495eb service nova] Creating event network-changed:0657bd03-e275-4cc6-8a1c-2040ba2533e3 for instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 on n-h2-850499-14 Oct 04 18:12:49.703251 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-99e16593-541a-44ce-94c8-b8d460783de5 req-e505954b-4431-4fe6-932e-136a0aa495eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072492 Oct 04 18:12:49.705159 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1306/2651] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:49.834143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-642255755", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "47ff216e-5ac6-47ef-8951-1d8968800e41"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:49.982829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] validate_networks() for [('47ff216e-5ac6-47ef-8951-1d8968800e41', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:12:50.146210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:50.971174 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9caa7498-0ec0-42c6-9885-4198f5b62837 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.007257 Oct 04 18:12:50.979218 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1346/2652] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:12:44 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:50.984853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8512f170-5a29-470e-a157-f73fd1ee24d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.002096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8512f170-5a29-470e-a157-f73fd1ee24d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:51.022344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8512f170-5a29-470e-a157-f73fd1ee24d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.022858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8512f170-5a29-470e-a157-f73fd1ee24d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.023339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8512f170-5a29-470e-a157-f73fd1ee24d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.024068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8512f170-5a29-470e-a157-f73fd1ee24d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.024528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8512f170-5a29-470e-a157-f73fd1ee24d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.046521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8512f170-5a29-470e-a157-f73fd1ee24d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.164910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:51.228655 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8512f170-5a29-470e-a157-f73fd1ee24d7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.248132 Oct 04 18:12:51.235426 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1347/2653] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:12:50 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments => generated 197 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:12:51.255264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-40bf4816-3b23-4957-b109-d4022418624f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.255910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-40bf4816-3b23-4957-b109-d4022418624f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:51.294235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40bf4816-3b23-4957-b109-d4022418624f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.294786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40bf4816-3b23-4957-b109-d4022418624f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.295317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40bf4816-3b23-4957-b109-d4022418624f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.296095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40bf4816-3b23-4957-b109-d4022418624f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.297603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40bf4816-3b23-4957-b109-d4022418624f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.297603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40bf4816-3b23-4957-b109-d4022418624f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.859655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:51.860286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:51.860978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:51.861748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:51.863953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:51.896923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.897453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.900056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.901531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.903333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.908128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.945287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-40bf4816-3b23-4957-b109-d4022418624f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.959948 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-40bf4816-3b23-4957-b109-d4022418624f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1471 microversion: 2.1 time: 0.718021 Oct 04 18:12:51.977396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Getting quotas for project ba126ac644f740df852efc20cec70e25. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:51.981513 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1348/2654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1471 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:51.989074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.991850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:52.004257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Getting quotas for user facf0eae1c5d4dff8e957c3ab073c7dd and project ba126ac644f740df852efc20cec70e25. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:52.008509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.009210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.009836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.017751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.018497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.019131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.041377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:52.048663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:52.205148 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-41fbbbf1-2b2b-4940-8e80-4d4ecbe3fc00 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.497566 Oct 04 18:12:52.207288 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1307/2655] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:12:52.217065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e0d11e6c-84c6-4f82-9a28-d98ba906137f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:52.221590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e0d11e6c-84c6-4f82-9a28-d98ba906137f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:52.230730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d11e6c-84c6-4f82-9a28-d98ba906137f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.232318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d11e6c-84c6-4f82-9a28-d98ba906137f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.239996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d11e6c-84c6-4f82-9a28-d98ba906137f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.241282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d11e6c-84c6-4f82-9a28-d98ba906137f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.242524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d11e6c-84c6-4f82-9a28-d98ba906137f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.243997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d11e6c-84c6-4f82-9a28-d98ba906137f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.705855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.722492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.733245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.741583 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5be154d5-ad7c-4c2c-a658-a5020cea39ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1891 microversion: 2.32 time: 0.758312 Oct 04 18:12:52.747749 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1349/2656] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1891 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:52.764606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-674321c3-89dd-4fb1-85d3-ba9c81f8e2ff tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:52.772756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-674321c3-89dd-4fb1-85d3-ba9c81f8e2ff tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:52.779645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e0d11e6c-84c6-4f82-9a28-d98ba906137f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.793369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-674321c3-89dd-4fb1-85d3-ba9c81f8e2ff tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.793884 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e0d11e6c-84c6-4f82-9a28-d98ba906137f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1523 microversion: 2.1 time: 0.583086 Oct 04 18:12:52.795464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-674321c3-89dd-4fb1-85d3-ba9c81f8e2ff tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.796582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-674321c3-89dd-4fb1-85d3-ba9c81f8e2ff tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.796761 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1308/2657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:52 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1523 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:52.799802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-674321c3-89dd-4fb1-85d3-ba9c81f8e2ff tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.800697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-674321c3-89dd-4fb1-85d3-ba9c81f8e2ff tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.803517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-674321c3-89dd-4fb1-85d3-ba9c81f8e2ff tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.805621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8d5709f-5658-4063-88cc-f9b6662124a5 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Calling method '.version_select at 0x7fd4d6056dc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:54.373298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-674321c3-89dd-4fb1-85d3-ba9c81f8e2ff tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.385836 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-674321c3-89dd-4fb1-85d3-ba9c81f8e2ff tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1323 microversion: 2.1 time: 1.636741 Oct 04 18:12:54.387495 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1350/2658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:52 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1323 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:54.402934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-580cf0bd-eed5-44c8-9d15-aeb676343e4a req-8632e484-8c02-4f61-b845-563a260e2b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "tag": "eef312c0-5fd8-44b6-960d-307ccd82a1df"}, {"name": "network-changed", "server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "tag": "e1a15415-f9e0-4b1e-84c8-c5eeef520105"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:54.421711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:54.430735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-580cf0bd-eed5-44c8-9d15-aeb676343e4a req-8632e484-8c02-4f61-b845-563a260e2b68 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:54.437551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-580cf0bd-eed5-44c8-9d15-aeb676343e4a req-8632e484-8c02-4f61-b845-563a260e2b68 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:54.438230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-580cf0bd-eed5-44c8-9d15-aeb676343e4a req-8632e484-8c02-4f61-b845-563a260e2b68 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:54.460983 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-580cf0bd-eed5-44c8-9d15-aeb676343e4a req-8632e484-8c02-4f61-b845-563a260e2b68 service nova] Creating event network-changed:eef312c0-5fd8-44b6-960d-307ccd82a1df for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:12:54.461768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-580cf0bd-eed5-44c8-9d15-aeb676343e4a req-8632e484-8c02-4f61-b845-563a260e2b68 service nova] Creating event network-changed:e1a15415-f9e0-4b1e-84c8-c5eeef520105 for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:12:54.472449 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-580cf0bd-eed5-44c8-9d15-aeb676343e4a req-8632e484-8c02-4f61-b845-563a260e2b68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081410 Oct 04 18:12:54.474275 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1351/2659] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:54.479523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e4ba660b-2fc7-4740-bc47-cb9099054d94 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:54.480647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e4ba660b-2fc7-4740-bc47-cb9099054d94 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:54.491517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4ba660b-2fc7-4740-bc47-cb9099054d94 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:54.493004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4ba660b-2fc7-4740-bc47-cb9099054d94 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:54.494284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4ba660b-2fc7-4740-bc47-cb9099054d94 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:54.495301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4ba660b-2fc7-4740-bc47-cb9099054d94 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:54.495954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4ba660b-2fc7-4740-bc47-cb9099054d94 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:54.497150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4ba660b-2fc7-4740-bc47-cb9099054d94 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:54.865456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e4ba660b-2fc7-4740-bc47-cb9099054d94 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.896984 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e4ba660b-2fc7-4740-bc47-cb9099054d94 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1276 microversion: 2.1 time: 0.418479 Oct 04 18:12:54.911731 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1352/2660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:54 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1276 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:54.920144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c0b8a08-c316-4eed-a295-2663fb04f0bd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:54.928646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c0b8a08-c316-4eed-a295-2663fb04f0bd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:54.950508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c0b8a08-c316-4eed-a295-2663fb04f0bd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:54.951311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c0b8a08-c316-4eed-a295-2663fb04f0bd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:54.952011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c0b8a08-c316-4eed-a295-2663fb04f0bd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:54.953440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c0b8a08-c316-4eed-a295-2663fb04f0bd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:54.954756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c0b8a08-c316-4eed-a295-2663fb04f0bd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:54.955400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c0b8a08-c316-4eed-a295-2663fb04f0bd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:54.994346 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c0b8a08-c316-4eed-a295-2663fb04f0bd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.087861 Oct 04 18:12:54.995312 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1353/2661] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:12:54 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:12:55.001063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bebc7dd9-61bb-4c9d-a4c7-98f769e63463 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:55.007872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bebc7dd9-61bb-4c9d-a4c7-98f769e63463 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:55.016145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bebc7dd9-61bb-4c9d-a4c7-98f769e63463 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.016624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bebc7dd9-61bb-4c9d-a4c7-98f769e63463 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.017601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bebc7dd9-61bb-4c9d-a4c7-98f769e63463 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.018403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bebc7dd9-61bb-4c9d-a4c7-98f769e63463 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.018889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bebc7dd9-61bb-4c9d-a4c7-98f769e63463 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.019363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bebc7dd9-61bb-4c9d-a4c7-98f769e63463 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.697803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bebc7dd9-61bb-4c9d-a4c7-98f769e63463 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:55.716597 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bebc7dd9-61bb-4c9d-a4c7-98f769e63463 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1471 microversion: 2.1 time: 0.719973 Oct 04 18:12:55.716987 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1354/2662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:54 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1471 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:55.722299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:55.723172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:55.736281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.736996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.737616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.738519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.740029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.740654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.541874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.573109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.581218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.582561 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d716290e-35c5-494f-b79c-8af7e32d44d4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1891 microversion: 2.32 time: 0.863890 Oct 04 18:12:56.585312 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1355/2663] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:55 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1891 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:56.595561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b0284f6-bcb1-4990-8929-a108a237fedb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:56.600057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6b0284f6-bcb1-4990-8929-a108a237fedb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:56.616179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b0284f6-bcb1-4990-8929-a108a237fedb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.617111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b0284f6-bcb1-4990-8929-a108a237fedb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.621701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b0284f6-bcb1-4990-8929-a108a237fedb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.622659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b0284f6-bcb1-4990-8929-a108a237fedb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.623438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b0284f6-bcb1-4990-8929-a108a237fedb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.624098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b0284f6-bcb1-4990-8929-a108a237fedb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.059438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6b0284f6-bcb1-4990-8929-a108a237fedb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.070080 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6b0284f6-bcb1-4990-8929-a108a237fedb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1523 microversion: 2.1 time: 0.483397 Oct 04 18:12:57.075785 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1356/2664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:56 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:57.086506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a00901fb-2236-4d8a-a9ae-2fa1f81fed70 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.087456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a00901fb-2236-4d8a-a9ae-2fa1f81fed70 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.110887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a00901fb-2236-4d8a-a9ae-2fa1f81fed70 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.111973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a00901fb-2236-4d8a-a9ae-2fa1f81fed70 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.112870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a00901fb-2236-4d8a-a9ae-2fa1f81fed70 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.114153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a00901fb-2236-4d8a-a9ae-2fa1f81fed70 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.114694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a00901fb-2236-4d8a-a9ae-2fa1f81fed70 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.115429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a00901fb-2236-4d8a-a9ae-2fa1f81fed70 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.259725 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e8d5709f-5658-4063-88cc-f9b6662124a5 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/9c1c91a7-969c-4f4a-bb3a-52e46608907a" status: 202 len: 0 microversion: 2.1 time: 4.461653 Oct 04 18:12:57.260323 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1309/2665] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:12:52 2022] DELETE /compute/v2.1/os-floating-ips/9c1c91a7-969c-4f4a-bb3a-52e46608907a => generated 0 bytes in 4463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:12:57.265779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-76a773fc-bae5-4672-a673-452d6f147937 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.266607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-76a773fc-bae5-4672-a673-452d6f147937 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.283289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76a773fc-bae5-4672-a673-452d6f147937 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.283805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76a773fc-bae5-4672-a673-452d6f147937 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.284261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76a773fc-bae5-4672-a673-452d6f147937 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.294596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76a773fc-bae5-4672-a673-452d6f147937 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.299213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76a773fc-bae5-4672-a673-452d6f147937 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.301225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76a773fc-bae5-4672-a673-452d6f147937 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.363936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a00901fb-2236-4d8a-a9ae-2fa1f81fed70 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.382480 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a00901fb-2236-4d8a-a9ae-2fa1f81fed70 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1323 microversion: 2.1 time: 0.303695 Oct 04 18:12:57.394799 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1357/2666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1323 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:57.413495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-18c3a62b-49ed-4d8a-8673-3a872405078a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.419319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-18c3a62b-49ed-4d8a-8673-3a872405078a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.458377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-76a773fc-bae5-4672-a673-452d6f147937 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.459796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18c3a62b-49ed-4d8a-8673-3a872405078a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.462352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18c3a62b-49ed-4d8a-8673-3a872405078a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.463009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18c3a62b-49ed-4d8a-8673-3a872405078a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.465313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18c3a62b-49ed-4d8a-8673-3a872405078a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.467326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18c3a62b-49ed-4d8a-8673-3a872405078a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.468509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18c3a62b-49ed-4d8a-8673-3a872405078a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.471120 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-76a773fc-bae5-4672-a673-452d6f147937 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1282 microversion: 2.1 time: 0.206229 Oct 04 18:12:57.474272 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1310/2667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:57.480135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4b441a68-0036-4a5c-a475-da753b54e035 req-44811806-0505-4047-a1c7-1bf62eda9958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8dcc660-4ee0-4c03-994c-bd8c00eea140", "name": "network-vif-plugged", "status": "completed", "tag": "0657bd03-e275-4cc6-8a1c-2040ba2533e3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:57.506687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4b441a68-0036-4a5c-a475-da753b54e035 req-44811806-0505-4047-a1c7-1bf62eda9958 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.507614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4b441a68-0036-4a5c-a475-da753b54e035 req-44811806-0505-4047-a1c7-1bf62eda9958 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.508223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4b441a68-0036-4a5c-a475-da753b54e035 req-44811806-0505-4047-a1c7-1bf62eda9958 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.535548 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4b441a68-0036-4a5c-a475-da753b54e035 req-44811806-0505-4047-a1c7-1bf62eda9958 service nova] Creating event network-vif-plugged:0657bd03-e275-4cc6-8a1c-2040ba2533e3 for instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 on n-h2-850499-14 Oct 04 18:12:57.548219 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4b441a68-0036-4a5c-a475-da753b54e035 req-44811806-0505-4047-a1c7-1bf62eda9958 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072221 Oct 04 18:12:57.549076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-18c3a62b-49ed-4d8a-8673-3a872405078a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.149889 Oct 04 18:12:57.552195 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1311/2668] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:57.553468 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1358/2669] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:12:57.564789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c90014ea-a6ed-4c6d-811c-0e2b95786e8c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.566898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c90014ea-a6ed-4c6d-811c-0e2b95786e8c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.569359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8c099c94-6f78-4706-8232-de335c05b37e req-7da4366f-3218-4f81-824e-f35423dff6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "tag": "0363d8a0-489b-4b4b-bfe2-73f68c149109"}, {"name": "network-changed", "server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "tag": "37070eae-6e3f-46e7-9485-0df9262ac25b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:57.580938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c90014ea-a6ed-4c6d-811c-0e2b95786e8c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.582754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c90014ea-a6ed-4c6d-811c-0e2b95786e8c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.588725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c90014ea-a6ed-4c6d-811c-0e2b95786e8c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.590594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c90014ea-a6ed-4c6d-811c-0e2b95786e8c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.592003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c90014ea-a6ed-4c6d-811c-0e2b95786e8c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.593249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c90014ea-a6ed-4c6d-811c-0e2b95786e8c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.596693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8c099c94-6f78-4706-8232-de335c05b37e req-7da4366f-3218-4f81-824e-f35423dff6fe service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.599296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8c099c94-6f78-4706-8232-de335c05b37e req-7da4366f-3218-4f81-824e-f35423dff6fe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.600032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8c099c94-6f78-4706-8232-de335c05b37e req-7da4366f-3218-4f81-824e-f35423dff6fe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.637059 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8c099c94-6f78-4706-8232-de335c05b37e req-7da4366f-3218-4f81-824e-f35423dff6fe service nova] Creating event network-changed:0363d8a0-489b-4b4b-bfe2-73f68c149109 for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:12:57.638838 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8c099c94-6f78-4706-8232-de335c05b37e req-7da4366f-3218-4f81-824e-f35423dff6fe service nova] Creating event network-changed:37070eae-6e3f-46e7-9485-0df9262ac25b for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:12:57.650629 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8c099c94-6f78-4706-8232-de335c05b37e req-7da4366f-3218-4f81-824e-f35423dff6fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.087233 Oct 04 18:12:57.651336 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1312/2670] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:57.664513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5ec5f94-f0b0-43d2-b925-ff9302c10b32 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Calling method '.version_select at 0x7fd4d6056670>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.829376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-a5ec5f94-f0b0-43d2-b925-ff9302c10b32 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9c1c91a7-969c-4f4a-bb3a-52e46608907a could not be found", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:12:57.830552 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-a5ec5f94-f0b0-43d2-b925-ff9302c10b32 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] HTTP exception thrown: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5ec5f94-f0b0-43d2-b925-ff9302c10b32 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Request method failure captured: Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-floating-ips/9c1c91a7-969c-4f4a-bb3a-52e46608907a HTTP/1.1 Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHeMwN_99xY0ggR-SgxQ_Zm0PaKhU4KuLpejMipdtbDS9I2iJET-LTcT_C6yvsSPaEKHCUW80oLOXHW8hR6a2JbjHM4kfStulAVleVTXbtOBgdFtDAMPYuLxcY6HR_DI9lAxYG-TI5Y5Fh-bAPdyHQAtlT-bV9YBpOJU2inKDcp9b-g Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6967479522d6451e88ab8d78cc37e44b Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-FloatingIPsTestJSON-795085728 Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:12:57.833066 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6967479522d6451e88ab8d78cc37e44b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6967479522d6451e88ab8d78cc37e44b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6967479522d6451e88ab8d78cc37e44b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6967479522d6451e88ab8d78cc37e44b"}]}] Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-FloatingIPsTestJSON-795085728 Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6967479522d6451e88ab8d78cc37e44b Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-FloatingIPsTestJSON-795085728 Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-FloatingIPsTestJSON-795085728-project Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 05e5c8edc51842eebf3cfe5b0984072d Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-FloatingIPsTestJSON-795085728-project Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: exception: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '9c1c91a7-969c-4f4a-bb3a-52e46608907a'} Oct 04 18:12:57.835125 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:12:57.836401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9c1c91a7-969c-4f4a-bb3a-52e46608907a could not be found Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d59e85ca-28d3-4840-a368-c8751f944d0a'] Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a. Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:57.838264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:57.840529 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:57.841948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a Oct 04 18:12:57.841948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:12:57.843466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5ec5f94-f0b0-43d2-b925-ff9302c10b32 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Returning 404 to user: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:57.844313 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a5ec5f94-f0b0-43d2-b925-ff9302c10b32 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/9c1c91a7-969c-4f4a-bb3a-52e46608907a" status: 404 len: 111 microversion: 2.1 time: 0.191324 Oct 04 18:12:57.845366 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1313/2671] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/os-floating-ips/9c1c91a7-969c-4f4a-bb3a-52e46608907a => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:57.852713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.886413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.914869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.915710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.916753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.919047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.920321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.921947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.631043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c90014ea-a6ed-4c6d-811c-0e2b95786e8c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.643660 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c90014ea-a6ed-4c6d-811c-0e2b95786e8c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1471 microversion: 2.1 time: 1.088862 Oct 04 18:12:58.651745 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1359/2672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1471 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:58.657790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-37acca77-86e4-4d48-8f02-7aa279a3e9a4 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Calling method '.version_select at 0x7fd4d1b11160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.752124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-37acca77-86e4-4d48-8f02-7aa279a3e9a4 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9c1c91a7-969c-4f4a-bb3a-52e46608907a could not be found", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:12:58.753077 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-37acca77-86e4-4d48-8f02-7aa279a3e9a4 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] HTTP exception thrown: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-37acca77-86e4-4d48-8f02-7aa279a3e9a4 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Request method failure captured: Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-floating-ips/9c1c91a7-969c-4f4a-bb3a-52e46608907a HTTP/1.1 Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHeMwN_99xY0ggR-SgxQ_Zm0PaKhU4KuLpejMipdtbDS9I2iJET-LTcT_C6yvsSPaEKHCUW80oLOXHW8hR6a2JbjHM4kfStulAVleVTXbtOBgdFtDAMPYuLxcY6HR_DI9lAxYG-TI5Y5Fh-bAPdyHQAtlT-bV9YBpOJU2inKDcp9b-g Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6967479522d6451e88ab8d78cc37e44b Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FloatingIPsTestJSON-795085728 Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:12:58.755367 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6967479522d6451e88ab8d78cc37e44b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6967479522d6451e88ab8d78cc37e44b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6967479522d6451e88ab8d78cc37e44b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6967479522d6451e88ab8d78cc37e44b"}]}] Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FloatingIPsTestJSON-795085728 Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6967479522d6451e88ab8d78cc37e44b Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FloatingIPsTestJSON-795085728 Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FloatingIPsTestJSON-795085728-project Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 05e5c8edc51842eebf3cfe5b0984072d Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FloatingIPsTestJSON-795085728-project Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: exception: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '9c1c91a7-969c-4f4a-bb3a-52e46608907a'} Oct 04 18:12:58.756769 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:12:58.757512 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9c1c91a7-969c-4f4a-bb3a-52e46608907a could not be found Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cf51b46-ee88-4dea-83ce-d16bf0d70bff'] Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a. Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:58.758564 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:58.759709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:58.760824 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a Oct 04 18:12:58.760824 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:12:58.763130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-37acca77-86e4-4d48-8f02-7aa279a3e9a4 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] Returning 404 to user: Floating IP not found for ID 9c1c91a7-969c-4f4a-bb3a-52e46608907a {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:58.765066 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-37acca77-86e4-4d48-8f02-7aa279a3e9a4 tempest-FloatingIPsTestJSON-795085728 tempest-FloatingIPsTestJSON-795085728-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/9c1c91a7-969c-4f4a-bb3a-52e46608907a" status: 404 len: 111 microversion: 2.1 time: 0.111062 Oct 04 18:12:58.766258 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1360/2673] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:12:58 2022] DELETE /compute/v2.1/os-floating-ips/9c1c91a7-969c-4f4a-bb3a-52e46608907a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:58.771188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-820af904-9991-45b1-b9d1-d6cbe9814b22 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.776305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-820af904-9991-45b1-b9d1-d6cbe9814b22 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.795856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-820af904-9991-45b1-b9d1-d6cbe9814b22 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.796706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-820af904-9991-45b1-b9d1-d6cbe9814b22 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.797362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-820af904-9991-45b1-b9d1-d6cbe9814b22 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.798296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-820af904-9991-45b1-b9d1-d6cbe9814b22 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.803637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-820af904-9991-45b1-b9d1-d6cbe9814b22 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.804475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-820af904-9991-45b1-b9d1-d6cbe9814b22 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.886119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.896917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.903467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.909181 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d3ac0f9e-bbd6-4fb3-a74a-6627848dd3dd tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1891 microversion: 2.32 time: 1.062527 Oct 04 18:12:58.910515 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1314/2674] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1891 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:58.923833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-181f26a6-0797-4f94-bdb4-0b6f22f9a4d0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.924838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-181f26a6-0797-4f94-bdb4-0b6f22f9a4d0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.937866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-181f26a6-0797-4f94-bdb4-0b6f22f9a4d0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.943324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-181f26a6-0797-4f94-bdb4-0b6f22f9a4d0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.944034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-181f26a6-0797-4f94-bdb4-0b6f22f9a4d0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.945007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-181f26a6-0797-4f94-bdb4-0b6f22f9a4d0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.947712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-181f26a6-0797-4f94-bdb4-0b6f22f9a4d0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.948725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-181f26a6-0797-4f94-bdb4-0b6f22f9a4d0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.034064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-820af904-9991-45b1-b9d1-d6cbe9814b22 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:01.042211 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-820af904-9991-45b1-b9d1-d6cbe9814b22 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1523 microversion: 2.1 time: 2.274562 Oct 04 18:13:01.049388 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1361/2675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:58 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1523 bytes in 2282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:01.059342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a2861dd-2876-41f7-8faa-ac29a54487ef tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.061134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a2861dd-2876-41f7-8faa-ac29a54487ef tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.079383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2861dd-2876-41f7-8faa-ac29a54487ef tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.081939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2861dd-2876-41f7-8faa-ac29a54487ef tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.082744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2861dd-2876-41f7-8faa-ac29a54487ef tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.091841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2861dd-2876-41f7-8faa-ac29a54487ef tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.092844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2861dd-2876-41f7-8faa-ac29a54487ef tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.093491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a2861dd-2876-41f7-8faa-ac29a54487ef tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.100947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-181f26a6-0797-4f94-bdb4-0b6f22f9a4d0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:01.120549 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-181f26a6-0797-4f94-bdb4-0b6f22f9a4d0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1323 microversion: 2.1 time: 2.197542 Oct 04 18:13:01.126237 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1315/2676] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:58 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1323 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:01.133999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-31cca6b2-e4d4-4249-83e1-1aa8baee01b2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.141912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-31cca6b2-e4d4-4249-83e1-1aa8baee01b2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.170456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31cca6b2-e4d4-4249-83e1-1aa8baee01b2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.171033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31cca6b2-e4d4-4249-83e1-1aa8baee01b2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.173302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31cca6b2-e4d4-4249-83e1-1aa8baee01b2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.178140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31cca6b2-e4d4-4249-83e1-1aa8baee01b2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.179286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31cca6b2-e4d4-4249-83e1-1aa8baee01b2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.180604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31cca6b2-e4d4-4249-83e1-1aa8baee01b2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.215023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:01.237575 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-31cca6b2-e4d4-4249-83e1-1aa8baee01b2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.107368 Oct 04 18:13:01.249415 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1316/2677] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:01.255593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39ad5a72-0122-4ded-a87a-d40878d2adc9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.257065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39ad5a72-0122-4ded-a87a-d40878d2adc9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.265674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39ad5a72-0122-4ded-a87a-d40878d2adc9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.266697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39ad5a72-0122-4ded-a87a-d40878d2adc9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.268137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39ad5a72-0122-4ded-a87a-d40878d2adc9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.269368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39ad5a72-0122-4ded-a87a-d40878d2adc9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.270068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39ad5a72-0122-4ded-a87a-d40878d2adc9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.270831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39ad5a72-0122-4ded-a87a-d40878d2adc9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.492634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a2861dd-2876-41f7-8faa-ac29a54487ef tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:01.502688 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a2861dd-2876-41f7-8faa-ac29a54487ef tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1324 microversion: 2.1 time: 0.451794 Oct 04 18:13:01.506051 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1362/2678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:01.519427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a1f16065-6314-4b59-bc2d-5cb427a39fd7 req-04abe868-25b0-47bd-80b1-a15c49fe5f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "tag": "45b63755-90e1-40b1-b12e-372ba302bb3c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:01.543153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1f16065-6314-4b59-bc2d-5cb427a39fd7 req-04abe868-25b0-47bd-80b1-a15c49fe5f41 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.543661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1f16065-6314-4b59-bc2d-5cb427a39fd7 req-04abe868-25b0-47bd-80b1-a15c49fe5f41 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.544110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1f16065-6314-4b59-bc2d-5cb427a39fd7 req-04abe868-25b0-47bd-80b1-a15c49fe5f41 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.586135 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a1f16065-6314-4b59-bc2d-5cb427a39fd7 req-04abe868-25b0-47bd-80b1-a15c49fe5f41 service nova] Creating event network-changed:45b63755-90e1-40b1-b12e-372ba302bb3c for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:13:01.595420 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a1f16065-6314-4b59-bc2d-5cb427a39fd7 req-04abe868-25b0-47bd-80b1-a15c49fe5f41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086233 Oct 04 18:13:01.596514 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1363/2679] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:01.616114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.619559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.637775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.638335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.640277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.643360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.644349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.646300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.951800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:02.027052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:03.365103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:03.404195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:03.404195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:03.411965 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-704e1cdf-34f0-49b4-9e95-3fd3b5d76c52 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1891 microversion: 2.32 time: 1.807588 Oct 04 18:13:03.425485 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1364/2680] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1891 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:03.446445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22cde993-7e05-488c-bce7-214f6bca29e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:03.447186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-22cde993-7e05-488c-bce7-214f6bca29e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:03.459177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22cde993-7e05-488c-bce7-214f6bca29e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.459177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22cde993-7e05-488c-bce7-214f6bca29e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.459177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22cde993-7e05-488c-bce7-214f6bca29e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.459698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22cde993-7e05-488c-bce7-214f6bca29e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.459924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22cde993-7e05-488c-bce7-214f6bca29e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.460370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22cde993-7e05-488c-bce7-214f6bca29e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.525964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-39ad5a72-0122-4ded-a87a-d40878d2adc9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:03.535026 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39ad5a72-0122-4ded-a87a-d40878d2adc9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1471 microversion: 2.1 time: 2.284094 Oct 04 18:13:03.538671 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1317/2681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1471 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:03.545164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6dd79d2a-d944-4ae4-884e-8af190773483 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:03.546372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6dd79d2a-d944-4ae4-884e-8af190773483 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:03.576160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd79d2a-d944-4ae4-884e-8af190773483 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.576705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd79d2a-d944-4ae4-884e-8af190773483 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.577690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd79d2a-d944-4ae4-884e-8af190773483 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.578862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd79d2a-d944-4ae4-884e-8af190773483 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.580922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd79d2a-d944-4ae4-884e-8af190773483 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.581381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6dd79d2a-d944-4ae4-884e-8af190773483 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.419732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-22cde993-7e05-488c-bce7-214f6bca29e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:04.433744 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22cde993-7e05-488c-bce7-214f6bca29e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1523 microversion: 2.1 time: 1.008063 Oct 04 18:13:04.446233 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1365/2682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:03 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1523 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:04.462683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-63f21e58-dce7-4bc5-9468-80cebdf9c0fe tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:04.463982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-63f21e58-dce7-4bc5-9468-80cebdf9c0fe tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:04.502442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63f21e58-dce7-4bc5-9468-80cebdf9c0fe tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.503923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63f21e58-dce7-4bc5-9468-80cebdf9c0fe tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.504556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63f21e58-dce7-4bc5-9468-80cebdf9c0fe tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.505489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63f21e58-dce7-4bc5-9468-80cebdf9c0fe tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.512745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63f21e58-dce7-4bc5-9468-80cebdf9c0fe tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.513426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63f21e58-dce7-4bc5-9468-80cebdf9c0fe tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.518646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:04.569659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6dd79d2a-d944-4ae4-884e-8af190773483 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:04.583134 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6dd79d2a-d944-4ae4-884e-8af190773483 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1518 microversion: 2.1 time: 1.038833 Oct 04 18:13:04.595178 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1318/2683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:03 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1518 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:04.603949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-6a7aea4a-3e47-4a21-be32-f02e9f48b925 req-f1b5793c-928d-4015-9904-89891421da8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230fae08-91ae-495a-b756-394b097c7379", "tag": "889d0be0-ee97-4ae8-8c58-7808bbff16c1"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:04.644951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6a7aea4a-3e47-4a21-be32-f02e9f48b925 req-f1b5793c-928d-4015-9904-89891421da8b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.645448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6a7aea4a-3e47-4a21-be32-f02e9f48b925 req-f1b5793c-928d-4015-9904-89891421da8b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.645893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6a7aea4a-3e47-4a21-be32-f02e9f48b925 req-f1b5793c-928d-4015-9904-89891421da8b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.671007 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-6a7aea4a-3e47-4a21-be32-f02e9f48b925 req-f1b5793c-928d-4015-9904-89891421da8b service nova] Creating event network-changed:889d0be0-ee97-4ae8-8c58-7808bbff16c1 for instance 230fae08-91ae-495a-b756-394b097c7379 on n-h1-850499-14 Oct 04 18:13:04.684925 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-6a7aea4a-3e47-4a21-be32-f02e9f48b925 req-f1b5793c-928d-4015-9904-89891421da8b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096274 Oct 04 18:13:04.685922 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1319/2684] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:04.692084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:04.692802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:04.706789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.707338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.707788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.708523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.709001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.709433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.482112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.494093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.502115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.503831 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ae22f32a-ac7e-4e42-b204-7e3451a7838e tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1891 microversion: 2.32 time: 0.816165 Oct 04 18:13:05.508140 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1320/2685] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:04 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1891 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:05.518460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d5be2c1-330a-4a05-8cce-c111605d953c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:05.519519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d5be2c1-330a-4a05-8cce-c111605d953c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:05.534046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d5be2c1-330a-4a05-8cce-c111605d953c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.534927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d5be2c1-330a-4a05-8cce-c111605d953c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.535632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d5be2c1-330a-4a05-8cce-c111605d953c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.536571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d5be2c1-330a-4a05-8cce-c111605d953c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.537250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d5be2c1-330a-4a05-8cce-c111605d953c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.537915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d5be2c1-330a-4a05-8cce-c111605d953c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.783423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d5be2c1-330a-4a05-8cce-c111605d953c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:06.791082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-63f21e58-dce7-4bc5-9468-80cebdf9c0fe tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:06.796574 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d5be2c1-330a-4a05-8cce-c111605d953c tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1471 microversion: 2.1 time: 1.286380 Oct 04 18:13:06.815189 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-63f21e58-dce7-4bc5-9468-80cebdf9c0fe tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1324 microversion: 2.1 time: 2.358105 Oct 04 18:13:06.816597 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1366/2687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:04 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1324 bytes in 2369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:06.818878 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1321/2687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:05 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1471 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:06.822066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4d42e3f-5642-486c-8aa5-9766e5c1f26b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:06.827257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2266c045-8ce9-4cf8-bbd9-c9902488c8b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:06.828195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2266c045-8ce9-4cf8-bbd9-c9902488c8b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:06.831119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f4d42e3f-5642-486c-8aa5-9766e5c1f26b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:06.838390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2266c045-8ce9-4cf8-bbd9-c9902488c8b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.840228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2266c045-8ce9-4cf8-bbd9-c9902488c8b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.841587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2266c045-8ce9-4cf8-bbd9-c9902488c8b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.843163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2266c045-8ce9-4cf8-bbd9-c9902488c8b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.843868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2266c045-8ce9-4cf8-bbd9-c9902488c8b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.844607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2266c045-8ce9-4cf8-bbd9-c9902488c8b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.853713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4d42e3f-5642-486c-8aa5-9766e5c1f26b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.854142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4d42e3f-5642-486c-8aa5-9766e5c1f26b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.854593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4d42e3f-5642-486c-8aa5-9766e5c1f26b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.855357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4d42e3f-5642-486c-8aa5-9766e5c1f26b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.855830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4d42e3f-5642-486c-8aa5-9766e5c1f26b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.856269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4d42e3f-5642-486c-8aa5-9766e5c1f26b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.951336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f4d42e3f-5642-486c-8aa5-9766e5c1f26b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lazy-loading 'flavor' on Instance uuid b8dcc660-4ee0-4c03-994c-bd8c00eea140 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:07.177814 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f4d42e3f-5642-486c-8aa5-9766e5c1f26b tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "POST /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140/action" status: 200 len: 32 microversion: 2.1 time: 0.359718 Oct 04 18:13:07.183326 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1367/2688] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:06 2022] POST /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140/action => generated 32 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:07.212927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:07.214617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:07.233657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.235588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.237410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.242450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.243206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.243787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.408562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.431241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.439120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.444111 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78ec1768-28d3-4f7b-bc1f-dfc9d1322054 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1891 microversion: 2.32 time: 1.257666 Oct 04 18:13:08.447813 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1368/2689] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:07 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1891 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:08.463263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2676e254-eccf-4123-892e-0dfd8e71a578 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:08.464031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2676e254-eccf-4123-892e-0dfd8e71a578 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:08.485370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2676e254-eccf-4123-892e-0dfd8e71a578 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.489533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2676e254-eccf-4123-892e-0dfd8e71a578 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.490003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2266c045-8ce9-4cf8-bbd9-c9902488c8b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.490476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2676e254-eccf-4123-892e-0dfd8e71a578 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.490768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2676e254-eccf-4123-892e-0dfd8e71a578 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.491991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2676e254-eccf-4123-892e-0dfd8e71a578 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.493116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2676e254-eccf-4123-892e-0dfd8e71a578 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.498785 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2266c045-8ce9-4cf8-bbd9-c9902488c8b6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1523 microversion: 2.1 time: 1.678296 Oct 04 18:13:08.513930 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1322/2690] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:06 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1523 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:08.520292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e33f217f-3eee-4b2f-a64b-c0f2adde8d18 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:08.537281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e33f217f-3eee-4b2f-a64b-c0f2adde8d18 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:08.569694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33f217f-3eee-4b2f-a64b-c0f2adde8d18 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.570522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33f217f-3eee-4b2f-a64b-c0f2adde8d18 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.571282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33f217f-3eee-4b2f-a64b-c0f2adde8d18 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.572305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33f217f-3eee-4b2f-a64b-c0f2adde8d18 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.577019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33f217f-3eee-4b2f-a64b-c0f2adde8d18 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.577785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33f217f-3eee-4b2f-a64b-c0f2adde8d18 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.797151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2676e254-eccf-4123-892e-0dfd8e71a578 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.818762 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2676e254-eccf-4123-892e-0dfd8e71a578 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.355824 Oct 04 18:13:08.822645 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1369/2691] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:08 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:08.827741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70cb28b6-74ec-4e87-9f20-df408550b512 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:08.836075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-70cb28b6-74ec-4e87-9f20-df408550b512 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:08.856542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70cb28b6-74ec-4e87-9f20-df408550b512 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.857334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70cb28b6-74ec-4e87-9f20-df408550b512 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.859535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70cb28b6-74ec-4e87-9f20-df408550b512 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.862438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70cb28b6-74ec-4e87-9f20-df408550b512 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.863781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70cb28b6-74ec-4e87-9f20-df408550b512 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.864420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70cb28b6-74ec-4e87-9f20-df408550b512 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.594295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70cb28b6-74ec-4e87-9f20-df408550b512 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.605297 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70cb28b6-74ec-4e87-9f20-df408550b512 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1324 microversion: 2.1 time: 0.781266 Oct 04 18:13:09.631786 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1370/2692] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:08 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1324 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:09.637460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-bdd4d8eb-1b48-4c17-99c8-b0ac378c4b0a req-7f14a99a-fdbd-4ece-b6c2-a9612bae2ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230fae08-91ae-495a-b756-394b097c7379", "name": "network-vif-plugged", "status": "completed", "tag": "889d0be0-ee97-4ae8-8c58-7808bbff16c1"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:09.680158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bdd4d8eb-1b48-4c17-99c8-b0ac378c4b0a req-7f14a99a-fdbd-4ece-b6c2-a9612bae2ffa service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.682790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bdd4d8eb-1b48-4c17-99c8-b0ac378c4b0a req-7f14a99a-fdbd-4ece-b6c2-a9612bae2ffa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.683691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bdd4d8eb-1b48-4c17-99c8-b0ac378c4b0a req-7f14a99a-fdbd-4ece-b6c2-a9612bae2ffa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.731255 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-bdd4d8eb-1b48-4c17-99c8-b0ac378c4b0a req-7f14a99a-fdbd-4ece-b6c2-a9612bae2ffa service nova] Creating event network-vif-plugged:889d0be0-ee97-4ae8-8c58-7808bbff16c1 for instance 230fae08-91ae-495a-b756-394b097c7379 on n-h1-850499-14 Oct 04 18:13:09.745890 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-bdd4d8eb-1b48-4c17-99c8-b0ac378c4b0a req-7f14a99a-fdbd-4ece-b6c2-a9612bae2ffa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112352 Oct 04 18:13:09.746763 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1371/2693] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:09.758088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:09.772304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:09.789809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.801231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.802137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.803390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.807968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.808786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.865385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e33f217f-3eee-4b2f-a64b-c0f2adde8d18 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.879441 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e33f217f-3eee-4b2f-a64b-c0f2adde8d18 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1471 microversion: 2.1 time: 1.363084 Oct 04 18:13:09.887816 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1323/2694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:08 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1471 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:09.928787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36223463-77b1-40eb-a573-830991d880e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:09.932758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-36223463-77b1-40eb-a573-830991d880e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:09.969369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36223463-77b1-40eb-a573-830991d880e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.970229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36223463-77b1-40eb-a573-830991d880e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.992512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36223463-77b1-40eb-a573-830991d880e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.996955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36223463-77b1-40eb-a573-830991d880e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.000639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36223463-77b1-40eb-a573-830991d880e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.001709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36223463-77b1-40eb-a573-830991d880e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.917660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.927065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-36223463-77b1-40eb-a573-830991d880e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.935851 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-36223463-77b1-40eb-a573-830991d880e8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1523 microversion: 2.1 time: 1.036483 Oct 04 18:13:10.946521 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1324/2695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:09 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1523 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:10.973886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-870c4d91-5870-40d1-b3f4-fe741dac4f1d tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:10.974528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-870c4d91-5870-40d1-b3f4-fe741dac4f1d tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:10.975424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.984622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.988367 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a3122957-00d5-4eeb-b13a-f217ecf1fd76 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1891 microversion: 2.32 time: 1.240041 Oct 04 18:13:11.006983 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1372/2696] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:09 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1891 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:11.007535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:11.007535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-870c4d91-5870-40d1-b3f4-fe741dac4f1d tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.007535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-870c4d91-5870-40d1-b3f4-fe741dac4f1d tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.007773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-870c4d91-5870-40d1-b3f4-fe741dac4f1d tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.008353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-870c4d91-5870-40d1-b3f4-fe741dac4f1d tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.008818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-870c4d91-5870-40d1-b3f4-fe741dac4f1d tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.009257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-870c4d91-5870-40d1-b3f4-fe741dac4f1d tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.038043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10df9372-2ab8-4fe2-98d1-b784c1d34fb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:11.039659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10df9372-2ab8-4fe2-98d1-b784c1d34fb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:11.062883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10df9372-2ab8-4fe2-98d1-b784c1d34fb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.064373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10df9372-2ab8-4fe2-98d1-b784c1d34fb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.064958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10df9372-2ab8-4fe2-98d1-b784c1d34fb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.067191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10df9372-2ab8-4fe2-98d1-b784c1d34fb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.068110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10df9372-2ab8-4fe2-98d1-b784c1d34fb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.069790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10df9372-2ab8-4fe2-98d1-b784c1d34fb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.078287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-10df9372-2ab8-4fe2-98d1-b784c1d34fb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:12.088575 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10df9372-2ab8-4fe2-98d1-b784c1d34fb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1324 microversion: 2.1 time: 1.090194 Oct 04 18:13:12.109910 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1373/2697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:10 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1324 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:12.126722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f28a0c2-9b3c-48e4-afe9-66867f435127 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:12.130871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3f28a0c2-9b3c-48e4-afe9-66867f435127 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:12.148208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f28a0c2-9b3c-48e4-afe9-66867f435127 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.148975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f28a0c2-9b3c-48e4-afe9-66867f435127 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.154472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f28a0c2-9b3c-48e4-afe9-66867f435127 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.156295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f28a0c2-9b3c-48e4-afe9-66867f435127 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.156946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f28a0c2-9b3c-48e4-afe9-66867f435127 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.157564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f28a0c2-9b3c-48e4-afe9-66867f435127 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.304162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-870c4d91-5870-40d1-b3f4-fe741dac4f1d tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:12.316599 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-870c4d91-5870-40d1-b3f4-fe741dac4f1d tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 1.366297 Oct 04 18:13:12.319206 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1325/2698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:10 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:12.330873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-792eaca9-bad1-444a-b730-1054e75d87b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:12.338273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-792eaca9-bad1-444a-b730-1054e75d87b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:12.356470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792eaca9-bad1-444a-b730-1054e75d87b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.359251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792eaca9-bad1-444a-b730-1054e75d87b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.359904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792eaca9-bad1-444a-b730-1054e75d87b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.370290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792eaca9-bad1-444a-b730-1054e75d87b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.371183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792eaca9-bad1-444a-b730-1054e75d87b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.371898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792eaca9-bad1-444a-b730-1054e75d87b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.211566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-792eaca9-bad1-444a-b730-1054e75d87b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.260556 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-792eaca9-bad1-444a-b730-1054e75d87b8 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1523 microversion: 2.1 time: 1.937666 Oct 04 18:13:14.261171 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1326/2699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:12 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1523 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:14.280625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:14.281659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:14.294372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.294889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.297709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.298648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.299464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.300374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.369949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3f28a0c2-9b3c-48e4-afe9-66867f435127 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.416757 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f28a0c2-9b3c-48e4-afe9-66867f435127 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1471 microversion: 2.1 time: 2.305457 Oct 04 18:13:14.435379 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1374/2700] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:12 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1471 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:14.443859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e27b1b4f-fb78-464d-b6fe-7796b5b48cb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:14.462423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e27b1b4f-fb78-464d-b6fe-7796b5b48cb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:14.470895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27b1b4f-fb78-464d-b6fe-7796b5b48cb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.471889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27b1b4f-fb78-464d-b6fe-7796b5b48cb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.472498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27b1b4f-fb78-464d-b6fe-7796b5b48cb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.473984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27b1b4f-fb78-464d-b6fe-7796b5b48cb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.474613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27b1b4f-fb78-464d-b6fe-7796b5b48cb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.475226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e27b1b4f-fb78-464d-b6fe-7796b5b48cb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.034316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e27b1b4f-fb78-464d-b6fe-7796b5b48cb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.052408 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e27b1b4f-fb78-464d-b6fe-7796b5b48cb9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1521 microversion: 2.1 time: 0.611970 Oct 04 18:13:15.071236 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1375/2701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:14 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:15.078062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.084262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4b8932d7-e6f8-43f6-b869-0fcf047fbcbf tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:15.091435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.091602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4b8932d7-e6f8-43f6-b869-0fcf047fbcbf tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:15.107388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.110411 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1b126e23-55fb-4a35-8611-2f0f42ab6ac1 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1891 microversion: 2.32 time: 0.848173 Oct 04 18:13:15.117173 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1327/2702] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:14 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1891 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:15.131409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b8932d7-e6f8-43f6-b869-0fcf047fbcbf tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.137216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b8932d7-e6f8-43f6-b869-0fcf047fbcbf tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.140376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b8932d7-e6f8-43f6-b869-0fcf047fbcbf tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.145619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b8932d7-e6f8-43f6-b869-0fcf047fbcbf tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.150999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b8932d7-e6f8-43f6-b869-0fcf047fbcbf tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.151583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b8932d7-e6f8-43f6-b869-0fcf047fbcbf tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.570410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c09a7ae6-40bd-4005-a93e-7b7bd487b5d7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: .version_select at 0x7fd4d1325a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1808519862", "description": "tempest-description-2119723689"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:15.704471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4b8932d7-e6f8-43f6-b869-0fcf047fbcbf tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.731307 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4b8932d7-e6f8-43f6-b869-0fcf047fbcbf tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.670878 Oct 04 18:13:15.734178 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1376/2703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:15 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:15.741685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c492d98-8b81-4654-abcf-e0fd58b29911 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:15.742574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c492d98-8b81-4654-abcf-e0fd58b29911 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:15.764092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c492d98-8b81-4654-abcf-e0fd58b29911 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.768894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c492d98-8b81-4654-abcf-e0fd58b29911 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.769898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c492d98-8b81-4654-abcf-e0fd58b29911 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.772672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c492d98-8b81-4654-abcf-e0fd58b29911 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.782141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c492d98-8b81-4654-abcf-e0fd58b29911 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.783294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c492d98-8b81-4654-abcf-e0fd58b29911 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.281311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c492d98-8b81-4654-abcf-e0fd58b29911 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:16.297487 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c492d98-8b81-4654-abcf-e0fd58b29911 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1521 microversion: 2.1 time: 0.561406 Oct 04 18:13:16.298304 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1377/2704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:15 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:16.497919 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c09a7ae6-40bd-4005-a93e-7b7bd487b5d7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.376078 Oct 04 18:13:16.500499 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1328/2705] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:13:15 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:16.505441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7479fa15-4c8a-4205-8b22-5fadeda15dbe tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:16.506299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7479fa15-4c8a-4205-8b22-5fadeda15dbe tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:16.523465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7479fa15-4c8a-4205-8b22-5fadeda15dbe tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.524375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7479fa15-4c8a-4205-8b22-5fadeda15dbe tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.525510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7479fa15-4c8a-4205-8b22-5fadeda15dbe tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.528538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7479fa15-4c8a-4205-8b22-5fadeda15dbe tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.532032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7479fa15-4c8a-4205-8b22-5fadeda15dbe tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.533667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7479fa15-4c8a-4205-8b22-5fadeda15dbe tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.603079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2f115c4d-97ae-4c86-9bf4-a91e71c07c50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:16.603793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2f115c4d-97ae-4c86-9bf4-a91e71c07c50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:16.618707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f115c4d-97ae-4c86-9bf4-a91e71c07c50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.619878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f115c4d-97ae-4c86-9bf4-a91e71c07c50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.621296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f115c4d-97ae-4c86-9bf4-a91e71c07c50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.632608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f115c4d-97ae-4c86-9bf4-a91e71c07c50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.633749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f115c4d-97ae-4c86-9bf4-a91e71c07c50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.634826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f115c4d-97ae-4c86-9bf4-a91e71c07c50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.064654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7479fa15-4c8a-4205-8b22-5fadeda15dbe tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.084354 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7479fa15-4c8a-4205-8b22-5fadeda15dbe tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1477 microversion: 2.1 time: 0.582538 Oct 04 18:13:17.090314 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1329/2706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:16 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1477 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:17.116081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:17.119274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:17.138219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.141731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.142546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.143828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.147191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.148115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.205351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f115c4d-97ae-4c86-9bf4-a91e71c07c50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.214728 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2f115c4d-97ae-4c86-9bf4-a91e71c07c50 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1523 microversion: 2.1 time: 0.915343 Oct 04 18:13:17.216418 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1378/2707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:16 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1523 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:17.225417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-151fadfa-e717-418d-b4a2-c0c041900cd9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-759805888", "metadata": {"": ""}}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-151fadfa-e717-418d-b4a2-c0c041900cd9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action HTTP/1.1 Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 106 Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:13:17.230806 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-759805888", "metadata": {"": ""}}} Oct 04 18:13:17.232171 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '230fae08-91ae-495a-b756-394b097c7379', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-759805888', 'metadata': {'': ''}}}} Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:17.232957 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:17.234592 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:17.235958 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:17.235958 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:17.235958 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:13:17.235958 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:13:17.235958 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:13:17.235958 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:17.237482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-151fadfa-e717-418d-b4a2-c0c041900cd9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:17.240424 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-151fadfa-e717-418d-b4a2-c0c041900cd9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action" status: 400 len: 170 microversion: 2.1 time: 0.021730 Oct 04 18:13:17.245116 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1379/2708] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 4 18:13:17 2022] POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action => generated 170 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:13:17.252411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-43e4afb4-3d69-4b24-a22b-edf63e24dddc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: .version_select at 0x7fd4d13a83a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1913055646", "description": "tempest-description-568689225"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:17.601108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.611150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.612891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.614273 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f5fa551-1770-433a-b68d-5d2524f9243a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.522662 Oct 04 18:13:17.615201 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1330/2709] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:17 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:17.630948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4cbfed92-24ef-450d-9451-8fc2a7dc8959 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:17.632664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4cbfed92-24ef-450d-9451-8fc2a7dc8959 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:17.650528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4cbfed92-24ef-450d-9451-8fc2a7dc8959 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.652151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4cbfed92-24ef-450d-9451-8fc2a7dc8959 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.653434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4cbfed92-24ef-450d-9451-8fc2a7dc8959 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.654294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4cbfed92-24ef-450d-9451-8fc2a7dc8959 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.655606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4cbfed92-24ef-450d-9451-8fc2a7dc8959 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.656857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4cbfed92-24ef-450d-9451-8fc2a7dc8959 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.009679 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-43e4afb4-3d69-4b24-a22b-edf63e24dddc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.762350 Oct 04 18:13:18.012309 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1380/2710] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:13:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:18.020390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7853b0b6-d320-4b92-9747-b3b5e5fd94c1 req-ff463eb3-9653-4f23-a225-d5c16ef4ec6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a", "name": "network-vif-unplugged", "status": "completed", "tag": "1075430b-4731-47b1-aeb1-6c78e21fd987"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:18.036623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7853b0b6-d320-4b92-9747-b3b5e5fd94c1 req-ff463eb3-9653-4f23-a225-d5c16ef4ec6f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.038578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7853b0b6-d320-4b92-9747-b3b5e5fd94c1 req-ff463eb3-9653-4f23-a225-d5c16ef4ec6f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.039287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7853b0b6-d320-4b92-9747-b3b5e5fd94c1 req-ff463eb3-9653-4f23-a225-d5c16ef4ec6f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.060248 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7853b0b6-d320-4b92-9747-b3b5e5fd94c1 req-ff463eb3-9653-4f23-a225-d5c16ef4ec6f service nova] Creating event network-vif-unplugged:1075430b-4731-47b1-aeb1-6c78e21fd987 for instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a on n-h2-850499-14 Oct 04 18:13:18.075157 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7853b0b6-d320-4b92-9747-b3b5e5fd94c1 req-ff463eb3-9653-4f23-a225-d5c16ef4ec6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060470 Oct 04 18:13:18.076890 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1381/2711] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:18.089753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7198babb-115a-46ba-872c-7054fc08e09f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:18.091160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7198babb-115a-46ba-872c-7054fc08e09f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:18.118892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4cbfed92-24ef-450d-9451-8fc2a7dc8959 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:18.125078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7198babb-115a-46ba-872c-7054fc08e09f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.129588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7198babb-115a-46ba-872c-7054fc08e09f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.131235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7198babb-115a-46ba-872c-7054fc08e09f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.134445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7198babb-115a-46ba-872c-7054fc08e09f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.135994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7198babb-115a-46ba-872c-7054fc08e09f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.136927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7198babb-115a-46ba-872c-7054fc08e09f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.137894 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4cbfed92-24ef-450d-9451-8fc2a7dc8959 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.519559 Oct 04 18:13:18.139236 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1331/2712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:17 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:18.165399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1718875674", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "1b953c37-9a80-4e64-aa78-4705930962f1"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:18.271490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] validate_networks() for [('1b953c37-9a80-4e64-aa78-4705930962f1', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:13:18.538481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7198babb-115a-46ba-872c-7054fc08e09f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:18.548833 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7198babb-115a-46ba-872c-7054fc08e09f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1521 microversion: 2.1 time: 0.470322 Oct 04 18:13:18.554619 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1382/2713] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:18 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:18.562546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-072f6184-8eea-42c7-8c1f-974f6a6cf545 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:18.567322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-072f6184-8eea-42c7-8c1f-974f6a6cf545 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:18.578587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-072f6184-8eea-42c7-8c1f-974f6a6cf545 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.579692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-072f6184-8eea-42c7-8c1f-974f6a6cf545 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.580330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-072f6184-8eea-42c7-8c1f-974f6a6cf545 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.582019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-072f6184-8eea-42c7-8c1f-974f6a6cf545 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.582877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-072f6184-8eea-42c7-8c1f-974f6a6cf545 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.583501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-072f6184-8eea-42c7-8c1f-974f6a6cf545 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.487316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-072f6184-8eea-42c7-8c1f-974f6a6cf545 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.496604 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-072f6184-8eea-42c7-8c1f-974f6a6cf545 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1477 microversion: 2.1 time: 0.940628 Oct 04 18:13:19.512141 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1383/2714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:18 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1477 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:19.534449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-349df4df-d2ab-4cc3-9e89-fd8cc4e359f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:19.535439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-349df4df-d2ab-4cc3-9e89-fd8cc4e359f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:19.555740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349df4df-d2ab-4cc3-9e89-fd8cc4e359f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.557039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349df4df-d2ab-4cc3-9e89-fd8cc4e359f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.558382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349df4df-d2ab-4cc3-9e89-fd8cc4e359f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.560283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349df4df-d2ab-4cc3-9e89-fd8cc4e359f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.560924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349df4df-d2ab-4cc3-9e89-fd8cc4e359f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.562347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349df4df-d2ab-4cc3-9e89-fd8cc4e359f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.571982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:19.979717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:19.980233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:19.980960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:19.981628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:19.982116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:19.989006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-349df4df-d2ab-4cc3-9e89-fd8cc4e359f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.999171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.000244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.000906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.002007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.002317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-349df4df-d2ab-4cc3-9e89-fd8cc4e359f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1505 microversion: 2.1 time: 0.487308 Oct 04 18:13:20.003866 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1384/2715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:19 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:20.004006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.004450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.009556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-972843a7-bc43-4d14-b03a-df5f71e8e5a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.010178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-972843a7-bc43-4d14-b03a-df5f71e8e5a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.018474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-972843a7-bc43-4d14-b03a-df5f71e8e5a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.019089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-972843a7-bc43-4d14-b03a-df5f71e8e5a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.019810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-972843a7-bc43-4d14-b03a-df5f71e8e5a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.022001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-972843a7-bc43-4d14-b03a-df5f71e8e5a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.022480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-972843a7-bc43-4d14-b03a-df5f71e8e5a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.024063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-972843a7-bc43-4d14-b03a-df5f71e8e5a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.049634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Getting quotas for project 83335cd1899d4703b1bfc4a5571f69fd. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:20.058227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Getting quotas for user 3301f186f61e4badb072f9cf536a5887 and project 83335cd1899d4703b1bfc4a5571f69fd. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:20.084841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:13:20.087196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:13:20.164498 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6523a3c3-f4c0-4884-a89f-7f2220a769b8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.023685 Oct 04 18:13:20.167715 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1332/2716] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:13:20.180196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.180931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.197584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.198305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.199015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.200004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.203504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.204130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.559018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-972843a7-bc43-4d14-b03a-df5f71e8e5a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.576116 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-972843a7-bc43-4d14-b03a-df5f71e8e5a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1521 microversion: 2.1 time: 0.568559 Oct 04 18:13:20.578052 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1385/2717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1521 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:20.594397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-007f0435-bfdc-48d1-85d5-79b89027e3ed tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.594397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-007f0435-bfdc-48d1-85d5-79b89027e3ed tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.607564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-007f0435-bfdc-48d1-85d5-79b89027e3ed tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.608075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-007f0435-bfdc-48d1-85d5-79b89027e3ed tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.609038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-007f0435-bfdc-48d1-85d5-79b89027e3ed tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.609751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-007f0435-bfdc-48d1-85d5-79b89027e3ed tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.610205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-007f0435-bfdc-48d1-85d5-79b89027e3ed tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.610627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-007f0435-bfdc-48d1-85d5-79b89027e3ed tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.765260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.784977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.786707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.790520 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e068799e-0813-4e55-b7be-c5508a9e6ebb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.621591 Oct 04 18:13:20.793596 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1333/2718] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:20.804897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fdc3bfc8-09b0-4a20-a889-7b29d1144772 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.807350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fdc3bfc8-09b0-4a20-a889-7b29d1144772 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.926308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fdc3bfc8-09b0-4a20-a889-7b29d1144772 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.929996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-007f0435-bfdc-48d1-85d5-79b89027e3ed tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.940724 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-007f0435-bfdc-48d1-85d5-79b89027e3ed tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.361591 Oct 04 18:13:20.942105 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1386/2719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:20.947195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa8d1b77-144c-4530-b4f5-fa6f01af93a3 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.948030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aa8d1b77-144c-4530-b4f5-fa6f01af93a3 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.951072 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fdc3bfc8-09b0-4a20-a889-7b29d1144772 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1216 microversion: 2.1 time: 0.155499 Oct 04 18:13:20.955541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa8d1b77-144c-4530-b4f5-fa6f01af93a3 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.956410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa8d1b77-144c-4530-b4f5-fa6f01af93a3 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.957419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa8d1b77-144c-4530-b4f5-fa6f01af93a3 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.958314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa8d1b77-144c-4530-b4f5-fa6f01af93a3 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.958916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa8d1b77-144c-4530-b4f5-fa6f01af93a3 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.959515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa8d1b77-144c-4530-b4f5-fa6f01af93a3 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.979990 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1334/2720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1216 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:21.003621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6063112e-03c1-4baf-bfff-e6a6ef80640b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-966545148", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6063112e-03c1-4baf-bfff-e6a6ef80640b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action HTTP/1.1 Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 618 Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:13:21.012811 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:13:21.014241 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:13:21.014241 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:21.014241 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:13:21.014241 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:21.014241 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:13:21.014241 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:13:21.014241 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:13:21.014241 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:13:21.014241 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:13:21.014241 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:13:21.014871 n-d-850499-14 devstack@n-api.service[122331]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-966545148", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 18:13:21.014871 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:13:21.014871 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '230fae08-91ae-495a-b756-394b097c7379', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-966545148', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 18:13:21.015147 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:21.015790 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:21.016849 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:21.017564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:21.017564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:21.017564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:13:21.017564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:13:21.017564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:13:21.017564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:21.052025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6063112e-03c1-4baf-bfff-e6a6ef80640b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:21.052585 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6063112e-03c1-4baf-bfff-e6a6ef80640b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action" status: 400 len: 938 microversion: 2.1 time: 0.071381 Oct 04 18:13:21.053195 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1335/2721] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 4 18:13:20 2022] POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action => generated 938 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:13:21.064278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba62acb9-8d14-49ee-a516-95daa11c2a45 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:21.066501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba62acb9-8d14-49ee-a516-95daa11c2a45 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.074045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba62acb9-8d14-49ee-a516-95daa11c2a45 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.075520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba62acb9-8d14-49ee-a516-95daa11c2a45 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.076283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba62acb9-8d14-49ee-a516-95daa11c2a45 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.078663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba62acb9-8d14-49ee-a516-95daa11c2a45 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.079609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba62acb9-8d14-49ee-a516-95daa11c2a45 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.080509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba62acb9-8d14-49ee-a516-95daa11c2a45 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.306371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aa8d1b77-144c-4530-b4f5-fa6f01af93a3 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.315845 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa8d1b77-144c-4530-b4f5-fa6f01af93a3 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1477 microversion: 2.1 time: 0.372510 Oct 04 18:13:21.320670 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1387/2722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1477 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:21.350692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ab4274c-dc0a-46d5-9b7a-274532853a7d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:21.353170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8ab4274c-dc0a-46d5-9b7a-274532853a7d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.377600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ab4274c-dc0a-46d5-9b7a-274532853a7d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.383229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ab4274c-dc0a-46d5-9b7a-274532853a7d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.384504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ab4274c-dc0a-46d5-9b7a-274532853a7d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.386052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ab4274c-dc0a-46d5-9b7a-274532853a7d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.391722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ab4274c-dc0a-46d5-9b7a-274532853a7d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.395228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ab4274c-dc0a-46d5-9b7a-274532853a7d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.582447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ba62acb9-8d14-49ee-a516-95daa11c2a45 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.595170 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba62acb9-8d14-49ee-a516-95daa11c2a45 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1505 microversion: 2.1 time: 0.534155 Oct 04 18:13:21.598913 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1336/2723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:21 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:21.608771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-611865ba-7631-49b9-8e9e-ee6b6d9ddcce req-9639d947-d0e2-4302-8a1d-10736edc1f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a", "name": "network-vif-plugged", "status": "completed", "tag": "1075430b-4731-47b1-aeb1-6c78e21fd987"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:21.638036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-611865ba-7631-49b9-8e9e-ee6b6d9ddcce req-9639d947-d0e2-4302-8a1d-10736edc1f3a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.638534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-611865ba-7631-49b9-8e9e-ee6b6d9ddcce req-9639d947-d0e2-4302-8a1d-10736edc1f3a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.639008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-611865ba-7631-49b9-8e9e-ee6b6d9ddcce req-9639d947-d0e2-4302-8a1d-10736edc1f3a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.670836 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-611865ba-7631-49b9-8e9e-ee6b6d9ddcce req-9639d947-d0e2-4302-8a1d-10736edc1f3a service nova] Creating event network-vif-plugged:1075430b-4731-47b1-aeb1-6c78e21fd987 for instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a on n-h2-850499-14 Oct 04 18:13:21.688973 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-611865ba-7631-49b9-8e9e-ee6b6d9ddcce req-9639d947-d0e2-4302-8a1d-10736edc1f3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082539 Oct 04 18:13:21.689694 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1337/2724] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:21.729209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8ab4274c-dc0a-46d5-9b7a-274532853a7d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.740401 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8ab4274c-dc0a-46d5-9b7a-274532853a7d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1521 microversion: 2.1 time: 0.418112 Oct 04 18:13:21.751554 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1388/2725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:21 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:21.765832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fb029d85-087c-4a04-96c4-4ca6c3e28630 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:21.766723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb029d85-087c-4a04-96c4-4ca6c3e28630 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.784311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb029d85-087c-4a04-96c4-4ca6c3e28630 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.785382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb029d85-087c-4a04-96c4-4ca6c3e28630 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.786210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb029d85-087c-4a04-96c4-4ca6c3e28630 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.787488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb029d85-087c-4a04-96c4-4ca6c3e28630 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.788592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb029d85-087c-4a04-96c4-4ca6c3e28630 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.789222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb029d85-087c-4a04-96c4-4ca6c3e28630 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.796439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:21.824517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:21.825169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.832542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.833109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.835067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.837545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.839035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.839662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.080118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fb029d85-087c-4a04-96c4-4ca6c3e28630 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.092657 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fb029d85-087c-4a04-96c4-4ca6c3e28630 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1521 microversion: 2.1 time: 0.331024 Oct 04 18:13:22.094118 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1338/2726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:21 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:22.101295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d98eeedd-0543-4458-a91a-4f22030e65fc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.102321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d98eeedd-0543-4458-a91a-4f22030e65fc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.111139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98eeedd-0543-4458-a91a-4f22030e65fc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.112029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98eeedd-0543-4458-a91a-4f22030e65fc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.112676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98eeedd-0543-4458-a91a-4f22030e65fc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.114036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98eeedd-0543-4458-a91a-4f22030e65fc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.115151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98eeedd-0543-4458-a91a-4f22030e65fc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.116072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98eeedd-0543-4458-a91a-4f22030e65fc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.124611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.134769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.136237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.137403 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7eed3154-ce53-4759-aa56-1ca93bda8aaf tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.317201 Oct 04 18:13:22.138340 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1389/2727] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:21 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:22.143259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52898a4c-bc8a-43c7-a256-297bc0bdc509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.143866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-52898a4c-bc8a-43c7-a256-297bc0bdc509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.149876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52898a4c-bc8a-43c7-a256-297bc0bdc509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.150363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52898a4c-bc8a-43c7-a256-297bc0bdc509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.150805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52898a4c-bc8a-43c7-a256-297bc0bdc509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.151528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52898a4c-bc8a-43c7-a256-297bc0bdc509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.151988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52898a4c-bc8a-43c7-a256-297bc0bdc509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.152414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52898a4c-bc8a-43c7-a256-297bc0bdc509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.197616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d98eeedd-0543-4458-a91a-4f22030e65fc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.208227 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d98eeedd-0543-4458-a91a-4f22030e65fc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1268 microversion: 2.1 time: 0.111920 Oct 04 18:13:22.218935 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1339/2728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1268 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:22.234775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b2bfde99-112b-400a-aee1-6f17f32c4992 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b2bfde99-112b-400a-aee1-6f17f32c4992 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action HTTP/1.1 Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 285 Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:13:22.240555 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:13:22.242157 n-d-850499-14 devstack@n-api.service[122331]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:13:22.243080 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:13:22.243080 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:13:22.243080 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '230fae08-91ae-495a-b756-394b097c7379', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:13:22.243080 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:22.243080 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:22.243080 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:13:22.243080 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:13:22.243080 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:13:22.243080 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:13:22.243080 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:13:22.243836 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:13:22.245240 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:13:22.246108 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:13:22.246108 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:22.247006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b2bfde99-112b-400a-aee1-6f17f32c4992 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:22.248037 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b2bfde99-112b-400a-aee1-6f17f32c4992 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action" status: 400 len: 619 microversion: 2.1 time: 0.027679 Oct 04 18:13:22.248835 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1340/2729] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 4 18:13:22 2022] POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:13:22.257984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-494d0bf6-765e-4c0d-931f-c174d144d64f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.258624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-494d0bf6-765e-4c0d-931f-c174d144d64f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.278461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-494d0bf6-765e-4c0d-931f-c174d144d64f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.281438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-494d0bf6-765e-4c0d-931f-c174d144d64f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.281910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-494d0bf6-765e-4c0d-931f-c174d144d64f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.282664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-494d0bf6-765e-4c0d-931f-c174d144d64f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.283486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-494d0bf6-765e-4c0d-931f-c174d144d64f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.283939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-494d0bf6-765e-4c0d-931f-c174d144d64f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.332706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-52898a4c-bc8a-43c7-a256-297bc0bdc509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.343631 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-52898a4c-bc8a-43c7-a256-297bc0bdc509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.204043 Oct 04 18:13:22.344445 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1390/2730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:22.349484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-036abb3c-719b-4d6a-a96a-3c56f57883dd tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Calling method '.version_select at 0x7fd4d13604c0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.398697 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-036abb3c-719b-4d6a-a96a-3c56f57883dd tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95" status: 200 len: 636 microversion: 2.1 time: 0.052863 Oct 04 18:13:22.399769 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1391/2731] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95 => generated 636 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:22.413990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f391b4ae-2cf6-45bf-a64c-d7a7d83ac852 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.414708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f391b4ae-2cf6-45bf-a64c-d7a7d83ac852 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.423606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391b4ae-2cf6-45bf-a64c-d7a7d83ac852 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.424414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391b4ae-2cf6-45bf-a64c-d7a7d83ac852 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.424920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391b4ae-2cf6-45bf-a64c-d7a7d83ac852 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.425844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391b4ae-2cf6-45bf-a64c-d7a7d83ac852 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.426755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391b4ae-2cf6-45bf-a64c-d7a7d83ac852 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.427283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391b4ae-2cf6-45bf-a64c-d7a7d83ac852 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.452645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-494d0bf6-765e-4c0d-931f-c174d144d64f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.461276 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-494d0bf6-765e-4c0d-931f-c174d144d64f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1521 microversion: 2.1 time: 0.208189 Oct 04 18:13:22.462069 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1341/2732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:22.486412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c7d2c99-c2b2-49c0-aa5c-95344c019669 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Action: 'update_all', calling method: .version_select at 0x7fd4d611a8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:22.541482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-4c7d2c99-c2b2-49c0-aa5c-95344c019669 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:22.546649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-4c7d2c99-c2b2-49c0-aa5c-95344c019669 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for user a78f1f2a95b74b34b040147ec95c81a5 and project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:22.580180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f391b4ae-2cf6-45bf-a64c-d7a7d83ac852 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.593866 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f391b4ae-2cf6-45bf-a64c-d7a7d83ac852 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1462 microversion: 2.1 time: 0.190004 Oct 04 18:13:22.594656 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1392/2733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1462 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:22.599280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d7c815f-bcc9-468a-ab10-d4ac9ecbbd87 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.600172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d7c815f-bcc9-468a-ab10-d4ac9ecbbd87 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.606312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d7c815f-bcc9-468a-ab10-d4ac9ecbbd87 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.606803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d7c815f-bcc9-468a-ab10-d4ac9ecbbd87 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.607271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d7c815f-bcc9-468a-ab10-d4ac9ecbbd87 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.608037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d7c815f-bcc9-468a-ab10-d4ac9ecbbd87 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.608741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d7c815f-bcc9-468a-ab10-d4ac9ecbbd87 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.609256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d7c815f-bcc9-468a-ab10-d4ac9ecbbd87 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.758552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d7c815f-bcc9-468a-ab10-d4ac9ecbbd87 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.767839 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d7c815f-bcc9-468a-ab10-d4ac9ecbbd87 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1521 microversion: 2.1 time: 0.172099 Oct 04 18:13:22.768570 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1393/2734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:22.775267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a68d75d-40cb-4422-a6c0-13a03e56de64 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.776321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a68d75d-40cb-4422-a6c0-13a03e56de64 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.783023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a68d75d-40cb-4422-a6c0-13a03e56de64 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.783689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a68d75d-40cb-4422-a6c0-13a03e56de64 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.784441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a68d75d-40cb-4422-a6c0-13a03e56de64 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.785177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a68d75d-40cb-4422-a6c0-13a03e56de64 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.785697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a68d75d-40cb-4422-a6c0-13a03e56de64 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.786162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a68d75d-40cb-4422-a6c0-13a03e56de64 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.893987 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c7d2c99-c2b2-49c0-aa5c-95344c019669 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 61 microversion: 2.1 time: 0.417401 Oct 04 18:13:22.895308 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1342/2735] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:13:22 2022] PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 61 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:22.901469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6cfd40d6-fe51-4c83-bb36-f5551c8dae97 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:22.905171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6cfd40d6-fe51-4c83-bb36-f5551c8dae97 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.914478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cfd40d6-fe51-4c83-bb36-f5551c8dae97 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.915113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cfd40d6-fe51-4c83-bb36-f5551c8dae97 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.915635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cfd40d6-fe51-4c83-bb36-f5551c8dae97 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.916435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cfd40d6-fe51-4c83-bb36-f5551c8dae97 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.916969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cfd40d6-fe51-4c83-bb36-f5551c8dae97 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.917529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6cfd40d6-fe51-4c83-bb36-f5551c8dae97 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.937473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9a68d75d-40cb-4422-a6c0-13a03e56de64 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.945927 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a68d75d-40cb-4422-a6c0-13a03e56de64 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1505 microversion: 2.1 time: 0.175758 Oct 04 18:13:22.946817 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1394/2736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:22.955971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5340cc65-12f0-4a32-9d4c-a1283bda960b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2038503322"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:22.959896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5340cc65-12f0-4a32-9d4c-a1283bda960b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.966734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5340cc65-12f0-4a32-9d4c-a1283bda960b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.967267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5340cc65-12f0-4a32-9d4c-a1283bda960b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.968936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5340cc65-12f0-4a32-9d4c-a1283bda960b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.969670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5340cc65-12f0-4a32-9d4c-a1283bda960b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.970135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5340cc65-12f0-4a32-9d4c-a1283bda960b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.970564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5340cc65-12f0-4a32-9d4c-a1283bda960b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.016036 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6cfd40d6-fe51-4c83-bb36-f5551c8dae97 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action" status: 202 len: 0 microversion: 2.1 time: 0.117733 Oct 04 18:13:23.016869 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1343/2737] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:22 2022] POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:23.023381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-03804d79-f201-4559-9f0a-f44d71b6bf42 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Calling method '.version_select at 0x7fd4d611af70>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.240159 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5340cc65-12f0-4a32-9d4c-a1283bda960b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action" status: 202 len: 0 microversion: 2.1 time: 0.292005 Oct 04 18:13:23.243218 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1395/2738] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:22 2022] POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:13:23.252781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.255375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.264378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.265007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.265515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.266584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.267134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.267564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.305753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.306333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.306772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.307260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lazy-loading 'fault' on Instance uuid c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:23.400302 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-03804d79-f201-4559-9f0a-f44d71b6bf42 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "DELETE /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.382268 Oct 04 18:13:23.401466 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1344/2739] 10.222.0.18 () {58 vars in 1296 bytes} [Tue Oct 4 18:13:23 2022] DELETE /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata/os_version => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:23.406460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.407030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.413478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.414182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.414823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.415746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.416375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.416958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.435643 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f9de4a69-3ff1-4d9c-9431-4ca4a272cb96 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1598 microversion: 2.1 time: 0.189315 Oct 04 18:13:23.438432 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1396/2740] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1598 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:23.443343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f077eb1-6236-4143-bca3-3a61b2fc9fdc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.443967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f077eb1-6236-4143-bca3-3a61b2fc9fdc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.450830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f077eb1-6236-4143-bca3-3a61b2fc9fdc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.451613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f077eb1-6236-4143-bca3-3a61b2fc9fdc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.453078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f077eb1-6236-4143-bca3-3a61b2fc9fdc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.453879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f077eb1-6236-4143-bca3-3a61b2fc9fdc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.454421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f077eb1-6236-4143-bca3-3a61b2fc9fdc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.454929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f077eb1-6236-4143-bca3-3a61b2fc9fdc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.539652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1f077eb1-6236-4143-bca3-3a61b2fc9fdc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.549485 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f077eb1-6236-4143-bca3-3a61b2fc9fdc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1268 microversion: 2.1 time: 0.109680 Oct 04 18:13:23.562746 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1397/2741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1268 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:23.562746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1767233667"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:23.562746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.566131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.566788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.569971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.569971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.569971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.569971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.602518 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Cannot 'createImage' instance 230fae08-91ae-495a-b756-394b097c7379 while it is in task_state image_snapshot Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action HTTP/1.1 Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 85 Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:13:23.604367 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1767233667"}} Oct 04 18:13:23.605911 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'createImage' instance 230fae08-91ae-495a-b756-394b097c7379 while it is in task_state image_snapshot Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '230fae08-91ae-495a-b756-394b097c7379', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1767233667'}}} Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 230fae08-91ae-495a-b756-394b097c7379 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:23.606861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 230fae08-91ae-495a-b756-394b097c7379 while it is in task_state image_snapshot Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 230fae08-91ae-495a-b756-394b097c7379 while it is in task_state image_snapshot Oct 04 18:13:23.609799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:23.611715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 409 to user: Cannot 'createImage' instance 230fae08-91ae-495a-b756-394b097c7379 while it is in task_state image_snapshot {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:23.611715 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f0df82c9-e2cb-47e3-832b-f2dae72d6513 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action" status: 409 len: 159 microversion: 2.1 time: 0.058721 Oct 04 18:13:23.618098 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1398/2742] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:23 2022] POST /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379/action => generated 159 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:13:23.620145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4816eed8-39f7-4115-bc2d-e9b8ca3eee46 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.620762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4816eed8-39f7-4115-bc2d-e9b8ca3eee46 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.627257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4816eed8-39f7-4115-bc2d-e9b8ca3eee46 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.627744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4816eed8-39f7-4115-bc2d-e9b8ca3eee46 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.628178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4816eed8-39f7-4115-bc2d-e9b8ca3eee46 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.628958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4816eed8-39f7-4115-bc2d-e9b8ca3eee46 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.629418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4816eed8-39f7-4115-bc2d-e9b8ca3eee46 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.629840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4816eed8-39f7-4115-bc2d-e9b8ca3eee46 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.655367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.665391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.666990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.668389 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-29dbfbdd-859b-43b0-bc63-06692c0339c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.265703 Oct 04 18:13:23.669150 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1345/2743] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:23.674770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-81443e04-6ad4-47ce-b679-2d886e0784e3 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Calling method '.version_select at 0x7fd4d615d4c0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.727361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-81443e04-6ad4-47ce-b679-2d886e0784e3 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 37 microversion: 2.1 time: 0.056915 Oct 04 18:13:23.727967 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1346/2744] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 37 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:23.735480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f0b2158-a8fd-47a7-837a-819e11eaf718 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:23.738024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f0b2158-a8fd-47a7-837a-819e11eaf718 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.744982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0b2158-a8fd-47a7-837a-819e11eaf718 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.745694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0b2158-a8fd-47a7-837a-819e11eaf718 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.746316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0b2158-a8fd-47a7-837a-819e11eaf718 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.747083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0b2158-a8fd-47a7-837a-819e11eaf718 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.747551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0b2158-a8fd-47a7-837a-819e11eaf718 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.747995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0b2158-a8fd-47a7-837a-819e11eaf718 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.784876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4816eed8-39f7-4115-bc2d-e9b8ca3eee46 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.792930 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4816eed8-39f7-4115-bc2d-e9b8ca3eee46 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.176750 Oct 04 18:13:23.793740 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1399/2745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:23.798466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e80ef68a-10dd-4c13-9f95-f275a603e12f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '.version_select at 0x7fd4d13330d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.835470 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f0b2158-a8fd-47a7-837a-819e11eaf718 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action" status: 202 len: 0 microversion: 2.1 time: 0.105896 Oct 04 18:13:23.836427 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1347/2746] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:23 2022] POST /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:23.845013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-26a4e4ac-7eba-4b86-a54c-653b77b8c343 req-eb052e09-ceeb-46bb-82e5-c4345e8f0e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d14a05-8a0f-4911-af5e-e84c9e8076cf", "name": "network-vif-unplugged", "status": "completed", "tag": "2a0c754b-d2bd-4a81-95a3-d6413110c4cd"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:23.857369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-26a4e4ac-7eba-4b86-a54c-653b77b8c343 req-eb052e09-ceeb-46bb-82e5-c4345e8f0e24 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.857942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-26a4e4ac-7eba-4b86-a54c-653b77b8c343 req-eb052e09-ceeb-46bb-82e5-c4345e8f0e24 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.858489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-26a4e4ac-7eba-4b86-a54c-653b77b8c343 req-eb052e09-ceeb-46bb-82e5-c4345e8f0e24 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.875473 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-26a4e4ac-7eba-4b86-a54c-653b77b8c343 req-eb052e09-ceeb-46bb-82e5-c4345e8f0e24 service nova] Creating event network-vif-unplugged:2a0c754b-d2bd-4a81-95a3-d6413110c4cd for instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf on n-h2-850499-14 Oct 04 18:13:23.882747 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-26a4e4ac-7eba-4b86-a54c-653b77b8c343 req-eb052e09-ceeb-46bb-82e5-c4345e8f0e24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044753 Oct 04 18:13:23.883989 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1348/2747] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:23.890763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7906c103-0dda-4aa6-bab4-8a8103b317ce tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Action: 'update_all', calling method: .version_select at 0x7fd4d615ddc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:23.932965 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e80ef68a-10dd-4c13-9f95-f275a603e12f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "DELETE /compute/v2.1/images/9cb0204a-ee40-4585-88b5-b5de5b0c9264" status: 204 len: 0 microversion: 2.1 time: 0.137962 Oct 04 18:13:23.933667 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1400/2748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:23 2022] DELETE /compute/v2.1/images/9cb0204a-ee40-4585-88b5-b5de5b0c9264 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:23.939936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bd61de91-f8d7-458f-a2d2-7f437ed28772 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.940555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bd61de91-f8d7-458f-a2d2-7f437ed28772 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.947474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd61de91-f8d7-458f-a2d2-7f437ed28772 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.948215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd61de91-f8d7-458f-a2d2-7f437ed28772 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.948982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd61de91-f8d7-458f-a2d2-7f437ed28772 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.950033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd61de91-f8d7-458f-a2d2-7f437ed28772 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.950690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd61de91-f8d7-458f-a2d2-7f437ed28772 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.951368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd61de91-f8d7-458f-a2d2-7f437ed28772 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.954815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7906c103-0dda-4aa6-bab4-8a8103b317ce tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:23.956364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:23.961855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7906c103-0dda-4aa6-bab4-8a8103b317ce tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for user a78f1f2a95b74b34b040147ec95c81a5 and project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:24.116111 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bd61de91-f8d7-458f-a2d2-7f437ed28772 tempest-ServersAdminTestJSON-1075194312 tempest-ServersAdminTestJSON-1075194312-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1615 microversion: 2.1 time: 0.181521 Oct 04 18:13:24.117463 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1401/2749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1615 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:24.138816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eaa046a3-d14e-408c-b456-b0f778639484 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.139763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eaa046a3-d14e-408c-b456-b0f778639484 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.146640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaa046a3-d14e-408c-b456-b0f778639484 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.147414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaa046a3-d14e-408c-b456-b0f778639484 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.147862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaa046a3-d14e-408c-b456-b0f778639484 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.148616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaa046a3-d14e-408c-b456-b0f778639484 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.149238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaa046a3-d14e-408c-b456-b0f778639484 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.149858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaa046a3-d14e-408c-b456-b0f778639484 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.259301 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7906c103-0dda-4aa6-bab4-8a8103b317ce tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 61 microversion: 2.1 time: 0.373464 Oct 04 18:13:24.260218 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1349/2750] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:13:23 2022] PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 61 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:24.269043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00e9b15c-a7ca-4409-9ca5-475285fcdcc6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.269797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00e9b15c-a7ca-4409-9ca5-475285fcdcc6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.287243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00e9b15c-a7ca-4409-9ca5-475285fcdcc6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.288079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00e9b15c-a7ca-4409-9ca5-475285fcdcc6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.288685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00e9b15c-a7ca-4409-9ca5-475285fcdcc6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.289542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00e9b15c-a7ca-4409-9ca5-475285fcdcc6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.290102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00e9b15c-a7ca-4409-9ca5-475285fcdcc6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.291204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00e9b15c-a7ca-4409-9ca5-475285fcdcc6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.318123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eaa046a3-d14e-408c-b456-b0f778639484 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:24.328773 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eaa046a3-d14e-408c-b456-b0f778639484 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1533 microversion: 2.1 time: 0.210009 Oct 04 18:13:24.329615 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1402/2751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1533 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:24.336777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8961ca21-4707-4007-9732-b69181a6d90b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.337498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8961ca21-4707-4007-9732-b69181a6d90b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.346884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8961ca21-4707-4007-9732-b69181a6d90b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.347907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8961ca21-4707-4007-9732-b69181a6d90b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.348721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8961ca21-4707-4007-9732-b69181a6d90b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.350129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8961ca21-4707-4007-9732-b69181a6d90b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.351190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8961ca21-4707-4007-9732-b69181a6d90b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.352162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8961ca21-4707-4007-9732-b69181a6d90b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.387923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8961ca21-4707-4007-9732-b69181a6d90b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:24.464476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:24.476272 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8961ca21-4707-4007-9732-b69181a6d90b tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 204 len: 0 microversion: 2.1 time: 0.144746 Oct 04 18:13:24.476938 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1403/2752] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:24 2022] DELETE /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:24.477306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-00e9b15c-a7ca-4409-9ca5-475285fcdcc6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:24.482351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00cd7ef7-3d5b-4d0c-a1d8-b12eee97406b tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Calling method '.version_select at 0x7fd4d1333940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.485889 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-00e9b15c-a7ca-4409-9ca5-475285fcdcc6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1505 microversion: 2.1 time: 0.224621 Oct 04 18:13:24.486462 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1350/2753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:24.505954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3943e804-d0c4-4610-8da3-4b9151082e15 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.507675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3943e804-d0c4-4610-8da3-4b9151082e15 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.513808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3943e804-d0c4-4610-8da3-4b9151082e15 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.514307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3943e804-d0c4-4610-8da3-4b9151082e15 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.515331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3943e804-d0c4-4610-8da3-4b9151082e15 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.516209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3943e804-d0c4-4610-8da3-4b9151082e15 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.516831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3943e804-d0c4-4610-8da3-4b9151082e15 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.517443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3943e804-d0c4-4610-8da3-4b9151082e15 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.524142 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00cd7ef7-3d5b-4d0c-a1d8-b12eee97406b tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.046160 Oct 04 18:13:24.524893 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1404/2754] 10.222.0.18 () {58 vars in 1290 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata/os_distro => generated 33 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:24.535084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ba53ead5-1f04-4b28-aa02-12ad59743997 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Action: 'update_all', calling method: .version_select at 0x7fd4d136bdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:24.591877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ba53ead5-1f04-4b28-aa02-12ad59743997 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:24.597192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ba53ead5-1f04-4b28-aa02-12ad59743997 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for user a78f1f2a95b74b34b040147ec95c81a5 and project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:24.680747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3943e804-d0c4-4610-8da3-4b9151082e15 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:24.692442 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3943e804-d0c4-4610-8da3-4b9151082e15 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1470 microversion: 2.1 time: 0.191244 Oct 04 18:13:24.692442 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1351/2755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:24.697093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-855cad5b-8289-4c5b-9437-932486c7c39b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.697716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-855cad5b-8289-4c5b-9437-932486c7c39b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.704149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-855cad5b-8289-4c5b-9437-932486c7c39b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.704646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-855cad5b-8289-4c5b-9437-932486c7c39b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.705095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-855cad5b-8289-4c5b-9437-932486c7c39b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.705799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-855cad5b-8289-4c5b-9437-932486c7c39b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.706265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-855cad5b-8289-4c5b-9437-932486c7c39b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.706704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-855cad5b-8289-4c5b-9437-932486c7c39b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.790830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-855cad5b-8289-4c5b-9437-932486c7c39b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:24.799174 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-855cad5b-8289-4c5b-9437-932486c7c39b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1268 microversion: 2.1 time: 0.105728 Oct 04 18:13:24.799749 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1352/2756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1268 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:24.804719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.805328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.813076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.813793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.814398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.818626 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ba53ead5-1f04-4b28-aa02-12ad59743997 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 61 microversion: 2.1 time: 0.287241 Oct 04 18:13:24.819855 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1405/2757] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:13:24 2022] PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 61 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:13:24.825361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-353879be-3938-4f4a-bb8e-9a1896d77f5e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.826247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-353879be-3938-4f4a-bb8e-9a1896d77f5e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.827517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.828331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.828962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.832660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-353879be-3938-4f4a-bb8e-9a1896d77f5e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.833358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-353879be-3938-4f4a-bb8e-9a1896d77f5e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.833956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-353879be-3938-4f4a-bb8e-9a1896d77f5e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.834859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-353879be-3938-4f4a-bb8e-9a1896d77f5e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.837272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-353879be-3938-4f4a-bb8e-9a1896d77f5e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.837709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-353879be-3938-4f4a-bb8e-9a1896d77f5e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.105343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-353879be-3938-4f4a-bb8e-9a1896d77f5e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.109994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.113560 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-353879be-3938-4f4a-bb8e-9a1896d77f5e tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.292331 Oct 04 18:13:25.114355 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1406/2758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:25.118706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-483e9e99-9fb3-46ad-b799-f45a8196d243 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Calling method '.version_select at 0x7fd4d13ed1f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.132330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.134236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.135595 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a484889a-23ed-406c-bebf-6a2860ea8039 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.334813 Oct 04 18:13:25.136202 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1353/2759] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:25.166816 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-483e9e99-9fb3-46ad-b799-f45a8196d243 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 61 microversion: 2.1 time: 0.051622 Oct 04 18:13:25.167667 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1407/2760] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 61 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:25.180184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc0bb180-43a8-4c1d-9cb0-c110b7b03d77 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Action: 'update_all', calling method: .version_select at 0x7fd4d611af70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:25.231743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-bc0bb180-43a8-4c1d-9cb0-c110b7b03d77 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:25.236394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-bc0bb180-43a8-4c1d-9cb0-c110b7b03d77 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for user a78f1f2a95b74b34b040147ec95c81a5 and project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:25.356907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a72843f-3dce-442e-ad15-99f4b2bbbde8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.357536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a72843f-3dce-442e-ad15-99f4b2bbbde8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:25.366812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a72843f-3dce-442e-ad15-99f4b2bbbde8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.369578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a72843f-3dce-442e-ad15-99f4b2bbbde8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.370328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a72843f-3dce-442e-ad15-99f4b2bbbde8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.371666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a72843f-3dce-442e-ad15-99f4b2bbbde8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.373008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a72843f-3dce-442e-ad15-99f4b2bbbde8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.376874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a72843f-3dce-442e-ad15-99f4b2bbbde8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.421158 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc0bb180-43a8-4c1d-9cb0-c110b7b03d77 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 61 microversion: 2.1 time: 0.246024 Oct 04 18:13:25.423084 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1354/2761] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:13:25 2022] PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 61 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:25.447392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7680ad9e-69d9-4dde-ae44-022beea72b0e tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Action: 'update_all', calling method: .version_select at 0x7fd4d615daf0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:25.504652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7680ad9e-69d9-4dde-ae44-022beea72b0e tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:25.510782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7680ad9e-69d9-4dde-ae44-022beea72b0e tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for user a78f1f2a95b74b34b040147ec95c81a5 and project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:25.544823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7a72843f-3dce-442e-ad15-99f4b2bbbde8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.554437 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a72843f-3dce-442e-ad15-99f4b2bbbde8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1539 microversion: 2.1 time: 0.201023 Oct 04 18:13:25.555110 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1408/2762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1539 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:25.576575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6db1307a-d481-42da-b485-f42b8be413cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.577816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6db1307a-d481-42da-b485-f42b8be413cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:25.584910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6db1307a-d481-42da-b485-f42b8be413cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.585492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6db1307a-d481-42da-b485-f42b8be413cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.585947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6db1307a-d481-42da-b485-f42b8be413cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.586667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6db1307a-d481-42da-b485-f42b8be413cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.587161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6db1307a-d481-42da-b485-f42b8be413cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.587656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6db1307a-d481-42da-b485-f42b8be413cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.746714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6db1307a-d481-42da-b485-f42b8be413cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.756729 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6db1307a-d481-42da-b485-f42b8be413cd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1508 microversion: 2.1 time: 0.185587 Oct 04 18:13:25.758330 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1409/2763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:25.767534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dee3ed2b-2527-4b19-a285-970a1e6a5e71 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.777802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dee3ed2b-2527-4b19-a285-970a1e6a5e71 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:25.798509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dee3ed2b-2527-4b19-a285-970a1e6a5e71 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.799158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dee3ed2b-2527-4b19-a285-970a1e6a5e71 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.799612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dee3ed2b-2527-4b19-a285-970a1e6a5e71 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.800586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dee3ed2b-2527-4b19-a285-970a1e6a5e71 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.801230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dee3ed2b-2527-4b19-a285-970a1e6a5e71 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.802075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dee3ed2b-2527-4b19-a285-970a1e6a5e71 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.880646 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7680ad9e-69d9-4dde-ae44-022beea72b0e tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 64 microversion: 2.1 time: 0.451790 Oct 04 18:13:25.887105 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1355/2764] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:13:25 2022] PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 64 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:13:25.893859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.895401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:25.904638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.905670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.906376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.907523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.908114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.908660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.940966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:25.955439 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.compute.api [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Working on deleting snapshot 274a9952-d2f3-43c6-aec6-7fe2677acaab from shelved instance... Oct 04 18:13:25.981990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dee3ed2b-2527-4b19-a285-970a1e6a5e71 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.994184 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dee3ed2b-2527-4b19-a285-970a1e6a5e71 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1470 microversion: 2.1 time: 0.231633 Oct 04 18:13:25.994918 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1410/2765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:26.003887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c8aeea7b-1dee-4171-a73d-c46306f5b109 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.004823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c8aeea7b-1dee-4171-a73d-c46306f5b109 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.014866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8aeea7b-1dee-4171-a73d-c46306f5b109 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.015554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8aeea7b-1dee-4171-a73d-c46306f5b109 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.016152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8aeea7b-1dee-4171-a73d-c46306f5b109 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.017027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8aeea7b-1dee-4171-a73d-c46306f5b109 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.017699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8aeea7b-1dee-4171-a73d-c46306f5b109 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.018319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8aeea7b-1dee-4171-a73d-c46306f5b109 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.095083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c8aeea7b-1dee-4171-a73d-c46306f5b109 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:26.102948 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c8aeea7b-1dee-4171-a73d-c46306f5b109 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1276 microversion: 2.1 time: 0.107148 Oct 04 18:13:26.103936 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1411/2766] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:26.108330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4b9f174-96cb-47de-8252-6f3f5379a6af tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Calling method '.version_select at 0x7fd4d13564c0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.156376 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f4b9f174-96cb-47de-8252-6f3f5379a6af tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 64 microversion: 2.1 time: 0.050726 Oct 04 18:13:26.161944 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1412/2767] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 64 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:26.161944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7795de32-6cdb-4349-bb3f-65b57990b6b2 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.162442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7795de32-6cdb-4349-bb3f-65b57990b6b2 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.168734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7795de32-6cdb-4349-bb3f-65b57990b6b2 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.169175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7795de32-6cdb-4349-bb3f-65b57990b6b2 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.169612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7795de32-6cdb-4349-bb3f-65b57990b6b2 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.170312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7795de32-6cdb-4349-bb3f-65b57990b6b2 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.171073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7795de32-6cdb-4349-bb3f-65b57990b6b2 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.171588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7795de32-6cdb-4349-bb3f-65b57990b6b2 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.335689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7795de32-6cdb-4349-bb3f-65b57990b6b2 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:26.344527 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7795de32-6cdb-4349-bb3f-65b57990b6b2 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.186376 Oct 04 18:13:26.345531 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1413/2768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:26.350254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.350870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.357002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.357515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.357941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.359287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.360550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.361166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.587168 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27ee149a-1576-45f0-8397-de31fc315f84 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 204 len: 0 microversion: 2.1 time: 0.696012 Oct 04 18:13:26.588598 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1356/2769] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:25 2022] DELETE /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:26.595772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ccc5a6b8-91a8-4178-98c0-670bb3fcd9d0 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Action: 'update_all', calling method: .version_select at 0x7fd4d1325160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:26.645242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:26.658710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:26.660874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:26.662323 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2d3d160a-6e15-41f5-bba3-720e494bf595 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.315723 Oct 04 18:13:26.663071 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1414/2770] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:26.680172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:26.691787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c0705367-c58e-4cbd-9318-81958b4738cf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.698316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c0705367-c58e-4cbd-9318-81958b4738cf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.699166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ccc5a6b8-91a8-4178-98c0-670bb3fcd9d0 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:26.707696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ccc5a6b8-91a8-4178-98c0-670bb3fcd9d0 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for user a78f1f2a95b74b34b040147ec95c81a5 and project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:26.708765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0705367-c58e-4cbd-9318-81958b4738cf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.710097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0705367-c58e-4cbd-9318-81958b4738cf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.710614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0705367-c58e-4cbd-9318-81958b4738cf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.711551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0705367-c58e-4cbd-9318-81958b4738cf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.712206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0705367-c58e-4cbd-9318-81958b4738cf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.712869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0705367-c58e-4cbd-9318-81958b4738cf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.881462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c0705367-c58e-4cbd-9318-81958b4738cf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:26.890419 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c0705367-c58e-4cbd-9318-81958b4738cf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1534 microversion: 2.1 time: 0.225892 Oct 04 18:13:26.895319 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1415/2771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1534 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:26.910839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d6fefca-b2c8-49e5-883f-36f1e90123a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.912284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d6fefca-b2c8-49e5-883f-36f1e90123a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.918774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d6fefca-b2c8-49e5-883f-36f1e90123a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.919597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d6fefca-b2c8-49e5-883f-36f1e90123a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.920237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d6fefca-b2c8-49e5-883f-36f1e90123a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.921232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d6fefca-b2c8-49e5-883f-36f1e90123a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.922030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d6fefca-b2c8-49e5-883f-36f1e90123a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.922733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d6fefca-b2c8-49e5-883f-36f1e90123a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.069553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d6fefca-b2c8-49e5-883f-36f1e90123a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.077641 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d6fefca-b2c8-49e5-883f-36f1e90123a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1514 microversion: 2.1 time: 0.181052 Oct 04 18:13:27.078221 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1416/2772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:27.094989 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ccc5a6b8-91a8-4178-98c0-670bb3fcd9d0 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 61 microversion: 2.1 time: 0.504894 Oct 04 18:13:27.095837 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1357/2773] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:13:26 2022] PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 61 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:27.098152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0b7ae00a-5490-4883-ac13-285786e68094 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:27.098776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0b7ae00a-5490-4883-ac13-285786e68094 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:27.104952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7ae00a-5490-4883-ac13-285786e68094 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.105448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7ae00a-5490-4883-ac13-285786e68094 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.105888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7ae00a-5490-4883-ac13-285786e68094 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.106593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7ae00a-5490-4883-ac13-285786e68094 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.107075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7ae00a-5490-4883-ac13-285786e68094 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.107515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7ae00a-5490-4883-ac13-285786e68094 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.107926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8059a5f8-9e35-413f-a28f-b420ea717a27 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Action: 'update', calling method: .version_select at 0x7fd4d615d9d0>, body: {"meta": {"os_version": "alt"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:27.173726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-8059a5f8-9e35-413f-a28f-b420ea717a27 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:27.178882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-8059a5f8-9e35-413f-a28f-b420ea717a27 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for user a78f1f2a95b74b34b040147ec95c81a5 and project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:27.259472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0b7ae00a-5490-4883-ac13-285786e68094 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.269107 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0b7ae00a-5490-4883-ac13-285786e68094 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1470 microversion: 2.1 time: 0.176861 Oct 04 18:13:27.275076 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1417/2774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:27 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:27.277229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0c6fa875-ae38-41fe-b828-79cbb179da82 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:27.277893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0c6fa875-ae38-41fe-b828-79cbb179da82 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:27.285978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c6fa875-ae38-41fe-b828-79cbb179da82 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.286656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c6fa875-ae38-41fe-b828-79cbb179da82 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.287642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c6fa875-ae38-41fe-b828-79cbb179da82 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.288368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c6fa875-ae38-41fe-b828-79cbb179da82 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.290999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c6fa875-ae38-41fe-b828-79cbb179da82 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.291483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c6fa875-ae38-41fe-b828-79cbb179da82 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.384850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0c6fa875-ae38-41fe-b828-79cbb179da82 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.400369 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0c6fa875-ae38-41fe-b828-79cbb179da82 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1274 microversion: 2.1 time: 0.129500 Oct 04 18:13:27.407000 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1418/2775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:27 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:27.407000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0c982c97-7a3e-4b12-8fbe-039785329b2c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:27.407235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0c982c97-7a3e-4b12-8fbe-039785329b2c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:27.425731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c982c97-7a3e-4b12-8fbe-039785329b2c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.426240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c982c97-7a3e-4b12-8fbe-039785329b2c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.426947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c982c97-7a3e-4b12-8fbe-039785329b2c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.427680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c982c97-7a3e-4b12-8fbe-039785329b2c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.428138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c982c97-7a3e-4b12-8fbe-039785329b2c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.428575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c982c97-7a3e-4b12-8fbe-039785329b2c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.639683 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8059a5f8-9e35-413f-a28f-b420ea717a27 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.537939 Oct 04 18:13:27.652749 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1358/2776] 10.222.0.18 () {60 vars in 1313 bytes} [Tue Oct 4 18:13:27 2022] PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata/os_version => generated 31 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:27.664798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b5ffb761-877c-4486-b1f9-1f7c4c601971 req-9c210928-b2bc-45a0-8b4c-da2e9aa8f0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230fae08-91ae-495a-b756-394b097c7379", "name": "network-vif-plugged", "status": "completed", "tag": "889d0be0-ee97-4ae8-8c58-7808bbff16c1"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:27.691945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0c982c97-7a3e-4b12-8fbe-039785329b2c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.705165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0c982c97-7a3e-4b12-8fbe-039785329b2c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.302148 Oct 04 18:13:27.708271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b5ffb761-877c-4486-b1f9-1f7c4c601971 req-9c210928-b2bc-45a0-8b4c-da2e9aa8f0e6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.708770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b5ffb761-877c-4486-b1f9-1f7c4c601971 req-9c210928-b2bc-45a0-8b4c-da2e9aa8f0e6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.709215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b5ffb761-877c-4486-b1f9-1f7c4c601971 req-9c210928-b2bc-45a0-8b4c-da2e9aa8f0e6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.720070 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1419/2777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:27 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:27.723077 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b5ffb761-877c-4486-b1f9-1f7c4c601971 req-9c210928-b2bc-45a0-8b4c-da2e9aa8f0e6 service nova] Creating event network-vif-plugged:889d0be0-ee97-4ae8-8c58-7808bbff16c1 for instance 230fae08-91ae-495a-b756-394b097c7379 on n-h1-850499-14 Oct 04 18:13:27.728727 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b5ffb761-877c-4486-b1f9-1f7c4c601971 req-9c210928-b2bc-45a0-8b4c-da2e9aa8f0e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078174 Oct 04 18:13:27.729757 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1359/2778] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:27.730529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-56fa8e4e-cebf-49a0-8bad-05c8bc321f45 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Calling method '.version_select at 0x7fd4d136b670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:27.735096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:27.735871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:27.742646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.743305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.743864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.744845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.745533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.746823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.773309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:27.781588 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-56fa8e4e-cebf-49a0-8bad-05c8bc321f45 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 58 microversion: 2.1 time: 0.058965 Oct 04 18:13:27.782743 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1420/2779] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:13:27 2022] GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 58 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:27.793842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-571e2bb7-07dd-43c1-88b8-3357a9f544d3 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Action: 'update_all', calling method: .version_select at 0x7fd4d1356310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:27.881952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-571e2bb7-07dd-43c1-88b8-3357a9f544d3 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:27.893631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-571e2bb7-07dd-43c1-88b8-3357a9f544d3 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for user a78f1f2a95b74b34b040147ec95c81a5 and project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:28.081011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.093976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.100035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.102326 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-969381a4-13ef-4e18-a333-6843de3b1c4b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.371460 Oct 04 18:13:28.104783 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1360/2780] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:27 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:28.120968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-70d03e38-ebf9-4535-823b-2d06785f3c60 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.121874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-70d03e38-ebf9-4535-823b-2d06785f3c60 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.133959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d03e38-ebf9-4535-823b-2d06785f3c60 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.137105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d03e38-ebf9-4535-823b-2d06785f3c60 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.137573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d03e38-ebf9-4535-823b-2d06785f3c60 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.138338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d03e38-ebf9-4535-823b-2d06785f3c60 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.138822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d03e38-ebf9-4535-823b-2d06785f3c60 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.139298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d03e38-ebf9-4535-823b-2d06785f3c60 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.289289 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-571e2bb7-07dd-43c1-88b8-3357a9f544d3 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 61 microversion: 2.1 time: 0.499939 Oct 04 18:13:28.294427 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1421/2781] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:13:27 2022] PUT /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 61 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:28.296183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b16ae85c-9cfc-47a3-bc29-0693edfd1bc3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.298350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b16ae85c-9cfc-47a3-bc29-0693edfd1bc3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.311865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b16ae85c-9cfc-47a3-bc29-0693edfd1bc3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.312445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b16ae85c-9cfc-47a3-bc29-0693edfd1bc3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.312908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b16ae85c-9cfc-47a3-bc29-0693edfd1bc3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.313625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b16ae85c-9cfc-47a3-bc29-0693edfd1bc3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.314151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b16ae85c-9cfc-47a3-bc29-0693edfd1bc3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.314578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b16ae85c-9cfc-47a3-bc29-0693edfd1bc3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.319665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:28.604598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-70d03e38-ebf9-4535-823b-2d06785f3c60 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.619668 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-70d03e38-ebf9-4535-823b-2d06785f3c60 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1521 microversion: 2.1 time: 0.510193 Oct 04 18:13:28.620526 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1361/2782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:28.625882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3132ab8a-924d-40db-aff2-ab7bbd08dc5f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.634802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3132ab8a-924d-40db-aff2-ab7bbd08dc5f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.651176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3132ab8a-924d-40db-aff2-ab7bbd08dc5f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.652675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3132ab8a-924d-40db-aff2-ab7bbd08dc5f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.653304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3132ab8a-924d-40db-aff2-ab7bbd08dc5f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.654329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3132ab8a-924d-40db-aff2-ab7bbd08dc5f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.654801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3132ab8a-924d-40db-aff2-ab7bbd08dc5f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.655790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3132ab8a-924d-40db-aff2-ab7bbd08dc5f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.696453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b16ae85c-9cfc-47a3-bc29-0693edfd1bc3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.705661 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b16ae85c-9cfc-47a3-bc29-0693edfd1bc3 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1454 microversion: 2.1 time: 0.414290 Oct 04 18:13:28.706606 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1422/2783] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1454 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:28.728989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59ab2f80-2c1b-42fd-b4de-daed218a309d tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Action: 'create', calling method: .version_select at 0x7fd4d1b11c10>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:28.788616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-59ab2f80-2c1b-42fd-b4de-daed218a309d tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:28.794319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-59ab2f80-2c1b-42fd-b4de-daed218a309d tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Getting quotas for user a78f1f2a95b74b34b040147ec95c81a5 and project 6d867ea784604a17b755821d57040ab2. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:28.960133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3132ab8a-924d-40db-aff2-ab7bbd08dc5f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.968522 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3132ab8a-924d-40db-aff2-ab7bbd08dc5f tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 200 len: 1470 microversion: 2.1 time: 0.346796 Oct 04 18:13:28.969360 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1362/2784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 1470 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:28.974507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0cff5e8f-018e-4f65-ab08-6582871c0010 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.975447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0cff5e8f-018e-4f65-ab08-6582871c0010 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.982263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cff5e8f-018e-4f65-ab08-6582871c0010 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.983710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cff5e8f-018e-4f65-ab08-6582871c0010 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.984979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cff5e8f-018e-4f65-ab08-6582871c0010 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.986138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cff5e8f-018e-4f65-ab08-6582871c0010 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.986870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cff5e8f-018e-4f65-ab08-6582871c0010 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.987558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cff5e8f-018e-4f65-ab08-6582871c0010 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.305788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0cff5e8f-018e-4f65-ab08-6582871c0010 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:29.332152 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0cff5e8f-018e-4f65-ab08-6582871c0010 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1316 microversion: 2.1 time: 0.360106 Oct 04 18:13:29.333986 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1363/2785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:29.341112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b586d97b-5cdd-4601-b5b6-6de810dc1183 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:29.343077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b586d97b-5cdd-4601-b5b6-6de810dc1183 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:29.355409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b586d97b-5cdd-4601-b5b6-6de810dc1183 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.357668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b586d97b-5cdd-4601-b5b6-6de810dc1183 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.358661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b586d97b-5cdd-4601-b5b6-6de810dc1183 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.359832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b586d97b-5cdd-4601-b5b6-6de810dc1183 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.361129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b586d97b-5cdd-4601-b5b6-6de810dc1183 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.361895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b586d97b-5cdd-4601-b5b6-6de810dc1183 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.480605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b586d97b-5cdd-4601-b5b6-6de810dc1183 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:29.584111 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59ab2f80-2c1b-42fd-b4de-daed218a309d tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "POST /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 85 microversion: 2.1 time: 0.862725 Oct 04 18:13:29.585615 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1423/2786] 10.222.0.18 () {60 vars in 1281 bytes} [Tue Oct 4 18:13:28 2022] POST /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 85 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:29.601783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a6b3d5f-a67c-402f-a231-b6b565cdacb8 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:29.615689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a6b3d5f-a67c-402f-a231-b6b565cdacb8 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:29.664351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a6b3d5f-a67c-402f-a231-b6b565cdacb8 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.675969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a6b3d5f-a67c-402f-a231-b6b565cdacb8 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.681887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a6b3d5f-a67c-402f-a231-b6b565cdacb8 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.695741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a6b3d5f-a67c-402f-a231-b6b565cdacb8 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.698466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a6b3d5f-a67c-402f-a231-b6b565cdacb8 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.701590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a6b3d5f-a67c-402f-a231-b6b565cdacb8 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.815740 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b586d97b-5cdd-4601-b5b6-6de810dc1183 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "DELETE /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 204 len: 0 microversion: 2.1 time: 0.479101 Oct 04 18:13:29.822410 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1364/2787] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:29 2022] DELETE /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:30.017607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:30.028026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9a6b3d5f-a67c-402f-a231-b6b565cdacb8 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.045323 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a6b3d5f-a67c-402f-a231-b6b565cdacb8 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.457860 Oct 04 18:13:30.046341 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1424/2788] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:29 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:30.050703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.051488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.058539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.059393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.059591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.060280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.060744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.061697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.110699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-6ebced92-b6ff-4bf5-9c0b-4a7abbf8581a req-5251990c-9ea0-47f6-b656-34af47b29fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0121e319-5427-4e22-a36e-27be74f9d945", "name": "network-vif-deleted", "tag": "ce19af49-3750-4aa6-b309-5929000fd198"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:30.141962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6ebced92-b6ff-4bf5-9c0b-4a7abbf8581a req-5251990c-9ea0-47f6-b656-34af47b29fc6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.144419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6ebced92-b6ff-4bf5-9c0b-4a7abbf8581a req-5251990c-9ea0-47f6-b656-34af47b29fc6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.145213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6ebced92-b6ff-4bf5-9c0b-4a7abbf8581a req-5251990c-9ea0-47f6-b656-34af47b29fc6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.167137 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-6ebced92-b6ff-4bf5-9c0b-4a7abbf8581a req-5251990c-9ea0-47f6-b656-34af47b29fc6 service nova] Creating event network-vif-deleted:ce19af49-3750-4aa6-b309-5929000fd198 for instance 0121e319-5427-4e22-a36e-27be74f9d945 on n-h2-850499-14 Oct 04 18:13:30.176298 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-6ebced92-b6ff-4bf5-9c0b-4a7abbf8581a req-5251990c-9ea0-47f6-b656-34af47b29fc6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.349333 Oct 04 18:13:30.179475 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1365/2789] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:30.191420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f7ae59dd-0f81-40d7-b8ad-ca076f5053e2 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] Calling method '.version_select at 0x7fd4d1834790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.272789 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f7ae59dd-0f81-40d7-b8ad-ca076f5053e2 tempest-ImagesMetadataTestJSON-1892921435 tempest-ImagesMetadataTestJSON-1892921435-project] 10.222.0.18 "GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata" status: 200 len: 85 microversion: 2.1 time: 0.091913 Oct 04 18:13:30.278576 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1366/2790] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/images/0dc5e59f-a5ad-4fcc-a946-ddbe781f5b95/metadata => generated 85 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:13:30.281428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.283074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.299558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.300353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.300974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.302733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.303262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.303705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.364892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.365951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.366438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.366903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'fault' on Instance uuid b5d14a05-8a0f-4911-af5e-e84c9e8076cf {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:30.446533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.455173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.460944 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-650d938a-9314-4cb0-b541-f1563852c0b2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 200 len: 1244 microversion: 2.1 time: 0.184282 Oct 04 18:13:30.462015 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1367/2791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 1244 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:30.481444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.481755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-136115a6-edcd-49d8-bbf3-509693f69c8d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.482400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-136115a6-edcd-49d8-bbf3-509693f69c8d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.486576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.489052 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-be60b41a-a856-4264-8587-1e9950d873f8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.441820 Oct 04 18:13:30.490541 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1425/2792] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:30.498874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-136115a6-edcd-49d8-bbf3-509693f69c8d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.509694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-136115a6-edcd-49d8-bbf3-509693f69c8d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.510377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-136115a6-edcd-49d8-bbf3-509693f69c8d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.510723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-2bfbbe09-0c88-4f32-8d7f-d35301a061a7 req-17a9cfa3-dc6a-4cbc-96e6-fb81d4b5a823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d14a05-8a0f-4911-af5e-e84c9e8076cf", "name": "network-vif-deleted", "tag": "2a0c754b-d2bd-4a81-95a3-d6413110c4cd"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:30.511755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-136115a6-edcd-49d8-bbf3-509693f69c8d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.512912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-136115a6-edcd-49d8-bbf3-509693f69c8d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.513519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-136115a6-edcd-49d8-bbf3-509693f69c8d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.534747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2bfbbe09-0c88-4f32-8d7f-d35301a061a7 req-17a9cfa3-dc6a-4cbc-96e6-fb81d4b5a823 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.537086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2bfbbe09-0c88-4f32-8d7f-d35301a061a7 req-17a9cfa3-dc6a-4cbc-96e6-fb81d4b5a823 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.537755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2bfbbe09-0c88-4f32-8d7f-d35301a061a7 req-17a9cfa3-dc6a-4cbc-96e6-fb81d4b5a823 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.563380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.compute.server_external_events [req-2bfbbe09-0c88-4f32-8d7f-d35301a061a7 req-17a9cfa3-dc6a-4cbc-96e6-fb81d4b5a823 service nova] Unable to find a host for instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf. Dropping event network-vif-deleted {{(pid=122332) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:13:30.567717 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-2bfbbe09-0c88-4f32-8d7f-d35301a061a7 req-17a9cfa3-dc6a-4cbc-96e6-fb81d4b5a823 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.072722 Oct 04 18:13:30.568472 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1426/2793] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:13:30.573413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-bb3809ba-08b1-4571-9365-0348c736484e req-874c9d87-63fc-43f3-b5d2-9535864e1da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230fae08-91ae-495a-b756-394b097c7379", "name": "network-vif-unplugged", "status": "completed", "tag": "889d0be0-ee97-4ae8-8c58-7808bbff16c1"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:30.593752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bb3809ba-08b1-4571-9365-0348c736484e req-874c9d87-63fc-43f3-b5d2-9535864e1da2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.595058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bb3809ba-08b1-4571-9365-0348c736484e req-874c9d87-63fc-43f3-b5d2-9535864e1da2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.595803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bb3809ba-08b1-4571-9365-0348c736484e req-874c9d87-63fc-43f3-b5d2-9535864e1da2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.628771 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-bb3809ba-08b1-4571-9365-0348c736484e req-874c9d87-63fc-43f3-b5d2-9535864e1da2 service nova] Creating event network-vif-unplugged:889d0be0-ee97-4ae8-8c58-7808bbff16c1 for instance 230fae08-91ae-495a-b756-394b097c7379 on n-h1-850499-14 Oct 04 18:13:30.636975 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-bb3809ba-08b1-4571-9365-0348c736484e req-874c9d87-63fc-43f3-b5d2-9535864e1da2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066745 Oct 04 18:13:30.639191 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1427/2794] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:30.645684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.646697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 0121e319-5427-4e22-a36e-27be74f9d945] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.655997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.656554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.657242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.662784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.675845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.676912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.727581 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] HTTP exception thrown: Instance 0121e319-5427-4e22-a36e-27be74f9d945 could not be found. Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Request method failure captured: Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 HTTP/1.1 Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHcKYsG9HQPNzJ7sEol8ReflDLOeRvaTVuFKWokFiyqzITLblycjGqJ-zKGJuyQuJam4_Nh1NUfnLc6evjxQhw7mKDM7J7Wkq1mToK8CazKg2XzbzctZM9-4TyP0Fwrt9oRrGGfSwedJVv-r_iPr3s_5Ufm9w2WhBVkqInBxRWjblno Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: b1b14394d8ea452eb046b7ce147a4ec7 Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersAdminTestJSON-1413840815 Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:13:30.729386 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1b14394d8ea452eb046b7ce147a4ec7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1b14394d8ea452eb046b7ce147a4ec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1b14394d8ea452eb046b7ce147a4ec7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1b14394d8ea452eb046b7ce147a4ec7"}]}] Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersAdminTestJSON-1413840815 Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: b1b14394d8ea452eb046b7ce147a4ec7 Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersAdminTestJSON-1413840815 Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersAdminTestJSON-1413840815-project Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0b824cdb1fd346729b59aece4c49a927 Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersAdminTestJSON-1413840815-project Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 0121e319-5427-4e22-a36e-27be74f9d945 could not be found. Oct 04 18:13:30.730659 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '0121e319-5427-4e22-a36e-27be74f9d945'} Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0121e319-5427-4e22-a36e-27be74f9d945 could not be found. Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:30.731458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0121e319-5427-4e22-a36e-27be74f9d945 could not be found. Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0121e319-5427-4e22-a36e-27be74f9d945 could not be found. Oct 04 18:13:30.732607 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:30.736148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Returning 404 to user: Instance 0121e319-5427-4e22-a36e-27be74f9d945 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:30.736148 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4326a47f-c7a1-4bc8-a55c-d50aae92ed13 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945" status: 404 len: 111 microversion: 2.1 time: 0.090200 Oct 04 18:13:30.736148 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1428/2795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/0121e319-5427-4e22-a36e-27be74f9d945 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:30.737183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ae1718de-450a-4a71-9d1d-7ad89391d613 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.737871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ae1718de-450a-4a71-9d1d-7ad89391d613 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.744458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae1718de-450a-4a71-9d1d-7ad89391d613 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.745114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae1718de-450a-4a71-9d1d-7ad89391d613 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.745565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae1718de-450a-4a71-9d1d-7ad89391d613 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.746268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae1718de-450a-4a71-9d1d-7ad89391d613 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.746905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae1718de-450a-4a71-9d1d-7ad89391d613 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.747511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae1718de-450a-4a71-9d1d-7ad89391d613 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.805232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-136115a6-edcd-49d8-bbf3-509693f69c8d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.814583 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-136115a6-edcd-49d8-bbf3-509693f69c8d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1527 microversion: 2.1 time: 0.351504 Oct 04 18:13:30.815531 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1368/2796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1527 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:30.820611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45d4dfa3-d3bb-4128-9fb0-df9f67082214 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.821751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45d4dfa3-d3bb-4128-9fb0-df9f67082214 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.827937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45d4dfa3-d3bb-4128-9fb0-df9f67082214 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.828664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45d4dfa3-d3bb-4128-9fb0-df9f67082214 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.829488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45d4dfa3-d3bb-4128-9fb0-df9f67082214 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.830395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45d4dfa3-d3bb-4128-9fb0-df9f67082214 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.831077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45d4dfa3-d3bb-4128-9fb0-df9f67082214 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.831730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45d4dfa3-d3bb-4128-9fb0-df9f67082214 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.864098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45d4dfa3-d3bb-4128-9fb0-df9f67082214 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:30.985361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ae1718de-450a-4a71-9d1d-7ad89391d613 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.995885 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ae1718de-450a-4a71-9d1d-7ad89391d613 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1316 microversion: 2.1 time: 0.263052 Oct 04 18:13:31.002760 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45d4dfa3-d3bb-4128-9fb0-df9f67082214 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "DELETE /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 204 len: 0 microversion: 2.1 time: 0.185657 Oct 04 18:13:31.006410 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1369/2797] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:30 2022] DELETE /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:31.007488 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1429/2798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:31.026845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b41a323e-cc6d-409d-8808-1b69edc35eb1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.027642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b41a323e-cc6d-409d-8808-1b69edc35eb1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.035973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b41a323e-cc6d-409d-8808-1b69edc35eb1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.036653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b41a323e-cc6d-409d-8808-1b69edc35eb1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.037108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b41a323e-cc6d-409d-8808-1b69edc35eb1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.037825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b41a323e-cc6d-409d-8808-1b69edc35eb1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.038283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b41a323e-cc6d-409d-8808-1b69edc35eb1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.038752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b41a323e-cc6d-409d-8808-1b69edc35eb1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.071709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b84f380-0a09-4d5c-a997-a9b59ad785c0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.072750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b84f380-0a09-4d5c-a997-a9b59ad785c0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.095318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b84f380-0a09-4d5c-a997-a9b59ad785c0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.096139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b84f380-0a09-4d5c-a997-a9b59ad785c0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.096593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b84f380-0a09-4d5c-a997-a9b59ad785c0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.097340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b84f380-0a09-4d5c-a997-a9b59ad785c0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.098315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b84f380-0a09-4d5c-a997-a9b59ad785c0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.098712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b84f380-0a09-4d5c-a997-a9b59ad785c0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.268103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b41a323e-cc6d-409d-8808-1b69edc35eb1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.277712 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b41a323e-cc6d-409d-8808-1b69edc35eb1 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1469 microversion: 2.1 time: 0.261571 Oct 04 18:13:31.295683 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1370/2799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1469 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:31.307864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7b84f380-0a09-4d5c-a997-a9b59ad785c0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.317041 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b84f380-0a09-4d5c-a997-a9b59ad785c0 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.249372 Oct 04 18:13:31.317805 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1430/2800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:31.484693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.485313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.491472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.491974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.492411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.493116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.493578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.494197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.508440 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf HTTP/1.1 Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:13:31.510100 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:13:31.511629 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'b5d14a05-8a0f-4911-af5e-e84c9e8076cf'} Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:31.512649 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:13:31.514030 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:31.515226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:31.515226 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-73762a7a-d32b-4198-824e-215eaf349940 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 404 len: 111 microversion: 2.1 time: 0.030885 Oct 04 18:13:31.515226 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1371/2801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:31.531985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.532881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.539679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.540408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.541214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.542285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.542766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.543402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.637890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1364825582", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "3460d6d9-0801-4482-b14b-54fef623a1ce"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:31.699201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] validate_networks() for [('3460d6d9-0801-4482-b14b-54fef623a1ce', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:13:31.848169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.858530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.860108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.861281 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-af73cb0b-e2a9-42b5-90f1-608b20066f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.347535 Oct 04 18:13:31.862204 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1431/2802] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:31.867805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f626a006-644e-4521-b213-95bc3e61d3dc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.868426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f626a006-644e-4521-b213-95bc3e61d3dc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.875071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f626a006-644e-4521-b213-95bc3e61d3dc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.875503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f626a006-644e-4521-b213-95bc3e61d3dc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.876024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f626a006-644e-4521-b213-95bc3e61d3dc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.876743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f626a006-644e-4521-b213-95bc3e61d3dc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.877209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f626a006-644e-4521-b213-95bc3e61d3dc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.877644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f626a006-644e-4521-b213-95bc3e61d3dc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.122823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f626a006-644e-4521-b213-95bc3e61d3dc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:32.131794 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f626a006-644e-4521-b213-95bc3e61d3dc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1527 microversion: 2.1 time: 0.268033 Oct 04 18:13:32.132762 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1432/2803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1527 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:32.156935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-576110609", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "c5519c6a-88b3-4e11-a279-e6dbd711c38c"}], "block_device_mapping_v2": [{"uuid": "72bba11f-fabf-450a-9442-63425b2b4291", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:32.234814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] validate_networks() for [('c5519c6a-88b3-4e11-a279-e6dbd711c38c', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:13:32.237753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:32.239152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:32.240164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:32.240919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:32.241409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:32.251612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.252095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.252535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.253291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.253945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.254826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.277936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:32.283424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for user ba39a7cdf309477195a07acb5cdf24f4 and project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:32.298038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:13:32.300495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:13:32.359315 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-18e58008-0399-4861-bdb2-21c6b776c1c2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725165 Oct 04 18:13:32.360259 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1372/2804] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:13:32.373328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57a30119-b57e-4ba1-bc9f-5d178115b174 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:32.373328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-57a30119-b57e-4ba1-bc9f-5d178115b174 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:32.381012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57a30119-b57e-4ba1-bc9f-5d178115b174 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.381651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57a30119-b57e-4ba1-bc9f-5d178115b174 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.382236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57a30119-b57e-4ba1-bc9f-5d178115b174 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.383059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57a30119-b57e-4ba1-bc9f-5d178115b174 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.384115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57a30119-b57e-4ba1-bc9f-5d178115b174 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.384115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57a30119-b57e-4ba1-bc9f-5d178115b174 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.620730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-57a30119-b57e-4ba1-bc9f-5d178115b174 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:32.629257 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-57a30119-b57e-4ba1-bc9f-5d178115b174 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1316 microversion: 2.1 time: 0.267737 Oct 04 18:13:32.629852 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1373/2805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:32 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:32.634510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bdb9c816-01be-47a8-8ed9-5fc81b1da141 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:32.635264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bdb9c816-01be-47a8-8ed9-5fc81b1da141 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:32.641748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdb9c816-01be-47a8-8ed9-5fc81b1da141 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.642593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdb9c816-01be-47a8-8ed9-5fc81b1da141 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.643483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdb9c816-01be-47a8-8ed9-5fc81b1da141 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.644356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdb9c816-01be-47a8-8ed9-5fc81b1da141 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.644951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdb9c816-01be-47a8-8ed9-5fc81b1da141 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.645886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdb9c816-01be-47a8-8ed9-5fc81b1da141 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.117921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:33.118394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:33.119100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:33.119547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:33.119972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:33.129036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.129534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.129977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.130714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.131227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.131662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.143496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bdb9c816-01be-47a8-8ed9-5fc81b1da141 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.148693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Getting quotas for project 1a630efa59244fbf9426904b7bf00eee. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:33.153431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Getting quotas for user 9796f56e209540ee967eb5090a1d2dbe and project 1a630efa59244fbf9426904b7bf00eee. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:33.155860 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bdb9c816-01be-47a8-8ed9-5fc81b1da141 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1469 microversion: 2.1 time: 0.524436 Oct 04 18:13:33.156667 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1374/2806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:32 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1469 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:33.177868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ca21687-af60-4bac-83e2-a432ffe5a509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.178324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7ca21687-af60-4bac-83e2-a432ffe5a509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.184685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ca21687-af60-4bac-83e2-a432ffe5a509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.185194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ca21687-af60-4bac-83e2-a432ffe5a509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.185623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ca21687-af60-4bac-83e2-a432ffe5a509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.186396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ca21687-af60-4bac-83e2-a432ffe5a509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.186993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ca21687-af60-4bac-83e2-a432ffe5a509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.187514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ca21687-af60-4bac-83e2-a432ffe5a509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.214671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:13:33.216834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72bba11f-fabf-450a-9442-63425b2b4291',volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:13:33.326232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7ca21687-af60-4bac-83e2-a432ffe5a509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.334761 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ca21687-af60-4bac-83e2-a432ffe5a509 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.164071 Oct 04 18:13:33.335378 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1375/2807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:33.339964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c0d5dc92-a6bd-4f4b-b618-6d30cd4913ef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.340589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c0d5dc92-a6bd-4f4b-b618-6d30cd4913ef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.347494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0d5dc92-a6bd-4f4b-b618-6d30cd4913ef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.347992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0d5dc92-a6bd-4f4b-b618-6d30cd4913ef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.348572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0d5dc92-a6bd-4f4b-b618-6d30cd4913ef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.349215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0d5dc92-a6bd-4f4b-b618-6d30cd4913ef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.349730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0d5dc92-a6bd-4f4b-b618-6d30cd4913ef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.350172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0d5dc92-a6bd-4f4b-b618-6d30cd4913ef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.369288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:33.371924 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-73781de9-8f6d-4f67-bd2f-e29e6ef81eb3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.223785 Oct 04 18:13:33.372750 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1433/2808] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:13:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:13:33.428906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c0d5dc92-a6bd-4f4b-b618-6d30cd4913ef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.437525 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c0d5dc92-a6bd-4f4b-b618-6d30cd4913ef tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1219 microversion: 2.1 time: 0.101113 Oct 04 18:13:33.438098 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1376/2809] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:33.443158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-15e99d36-d356-4d0a-ac6e-cbef7a55c193 req-57891a41-c8b6-4d98-b7bb-bd4cff7510be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d683c0-cb6a-46db-a6a3-d956d333aeb6", "tag": "72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:33.458098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-15e99d36-d356-4d0a-ac6e-cbef7a55c193 req-57891a41-c8b6-4d98-b7bb-bd4cff7510be service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.458581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-15e99d36-d356-4d0a-ac6e-cbef7a55c193 req-57891a41-c8b6-4d98-b7bb-bd4cff7510be service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.459233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-15e99d36-d356-4d0a-ac6e-cbef7a55c193 req-57891a41-c8b6-4d98-b7bb-bd4cff7510be service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.472932 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-15e99d36-d356-4d0a-ac6e-cbef7a55c193 req-57891a41-c8b6-4d98-b7bb-bd4cff7510be service nova] Creating event network-changed:72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c for instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 on n-h2-850499-14 Oct 04 18:13:33.477985 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-15e99d36-d356-4d0a-ac6e-cbef7a55c193 req-57891a41-c8b6-4d98-b7bb-bd4cff7510be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038594 Oct 04 18:13:33.478589 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1377/2810] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:33.484663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.485360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.491727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.492101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.492543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.493243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.493699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.494255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.520923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0a5cbc54-94b5-48da-86ef-aa3bd94e5dcc tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Calling method '.version_select at 0x7fd4d12bc820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.546406 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-0a5cbc54-94b5-48da-86ef-aa3bd94e5dcc tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] HTTP exception thrown: Image not found. Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0a5cbc54-94b5-48da-86ef-aa3bd94e5dcc tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Request method failure captured: Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/9901bea6-2c49-49e9-99bb-1c0e1e930618/metadata/os_distro HTTP/1.1 Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHfMPiynOPEVxeKr7f8BtEktmh8E5PL-2PLyS4Xoz4I-Obuyvie-KqMamDV06btMDnAM8S_cIs9YG2X7cqH6B-X3-UqAoyzvnPaWCZpxxTGALUyiFI3ZosR9_MB4OBVLHmtz_-4fm0bK7vTQo3LEWl3lZ3CdlNmKXNXWYCAtPZk6aPs Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:13:33.553645 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}] Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ce83c1f88e94422a907f59883e020766 Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'image_id': '9901bea6-2c49-49e9-99bb-1c0e1e930618', 'id': 'os_distro'} Oct 04 18:13:33.555329 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:33.561984 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9901bea6-2c49-49e9-99bb-1c0e1e930618 Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:33.563802 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9901bea6-2c49-49e9-99bb-1c0e1e930618 could not be found. Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:13:33.565640 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.567423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0a5cbc54-94b5-48da-86ef-aa3bd94e5dcc tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:33.569108 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0a5cbc54-94b5-48da-86ef-aa3bd94e5dcc tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] 10.222.0.18 "DELETE /compute/v2.1/images/9901bea6-2c49-49e9-99bb-1c0e1e930618/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.181642 Oct 04 18:13:33.569108 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1434/2811] 10.222.0.18 () {58 vars in 1293 bytes} [Tue Oct 4 18:13:33 2022] DELETE /compute/v2.1/images/9901bea6-2c49-49e9-99bb-1c0e1e930618/metadata/os_distro => generated 62 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:13:33.569108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-800a69de-d63b-4a90-88bb-620db456ef99 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.569108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-800a69de-d63b-4a90-88bb-620db456ef99 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.569614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-800a69de-d63b-4a90-88bb-620db456ef99 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.570333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-800a69de-d63b-4a90-88bb-620db456ef99 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.570333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-800a69de-d63b-4a90-88bb-620db456ef99 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.571934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-800a69de-d63b-4a90-88bb-620db456ef99 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.571934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-800a69de-d63b-4a90-88bb-620db456ef99 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.572172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-800a69de-d63b-4a90-88bb-620db456ef99 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.760302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.773175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.775266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.775625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-800a69de-d63b-4a90-88bb-620db456ef99 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.776966 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-18d5bc43-898a-4d60-9c8e-1e242edf1f74 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.297161 Oct 04 18:13:33.793067 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-800a69de-d63b-4a90-88bb-620db456ef99 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1527 microversion: 2.1 time: 0.235604 Oct 04 18:13:33.795470 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1378/2812] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:33.796999 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1435/2813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1527 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:33.808780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-33b1596e-4f5f-4b38-8c81-611e2ba91f88 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.809983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-33b1596e-4f5f-4b38-8c81-611e2ba91f88 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.810121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe17e777-9be1-4f86-bfd1-e0f962265b53 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Calling method '.version_select at 0x7fd4d12d1dc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.833754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-fe17e777-9be1-4f86-bfd1-e0f962265b53 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] HTTP exception thrown: Image not found. Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe17e777-9be1-4f86-bfd1-e0f962265b53 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Request method failure captured: Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/images/1584bb8f-50d8-4877-9055-52228ae865df/metadata/os_version HTTP/1.1 Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHfMPiynOPEVxeKr7f8BtEktmh8E5PL-2PLyS4Xoz4I-Obuyvie-KqMamDV06btMDnAM8S_cIs9YG2X7cqH6B-X3-UqAoyzvnPaWCZpxxTGALUyiFI3ZosR9_MB4OBVLHmtz_-4fm0bK7vTQo3LEWl3lZ3CdlNmKXNXWYCAtPZk6aPs Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:13:33.835896 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}] Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ce83c1f88e94422a907f59883e020766 Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'image_id': '1584bb8f-50d8-4877-9055-52228ae865df', 'id': 'os_version'} Oct 04 18:13:33.837416 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:33.838358 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1584bb8f-50d8-4877-9055-52228ae865df Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:33.839743 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1584bb8f-50d8-4877-9055-52228ae865df could not be found. Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:13:33.841129 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.844853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe17e777-9be1-4f86-bfd1-e0f962265b53 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:33.846237 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fe17e777-9be1-4f86-bfd1-e0f962265b53 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] 10.222.0.18 "GET /compute/v2.1/images/1584bb8f-50d8-4877-9055-52228ae865df/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.045102 Oct 04 18:13:33.846237 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1436/2814] 10.222.0.18 () {58 vars in 1293 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/images/1584bb8f-50d8-4877-9055-52228ae865df/metadata/os_version => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:13:33.850654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-728a2a0e-d596-42c1-837d-07c9bfd919a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.851302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-728a2a0e-d596-42c1-837d-07c9bfd919a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.862694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728a2a0e-d596-42c1-837d-07c9bfd919a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.863223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728a2a0e-d596-42c1-837d-07c9bfd919a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.863669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728a2a0e-d596-42c1-837d-07c9bfd919a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.864380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728a2a0e-d596-42c1-837d-07c9bfd919a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.864841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728a2a0e-d596-42c1-837d-07c9bfd919a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.865270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728a2a0e-d596-42c1-837d-07c9bfd919a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.897868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-33b1596e-4f5f-4b38-8c81-611e2ba91f88 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.906158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-33b1596e-4f5f-4b38-8c81-611e2ba91f88 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.908030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-33b1596e-4f5f-4b38-8c81-611e2ba91f88 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.909162 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-33b1596e-4f5f-4b38-8c81-611e2ba91f88 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1103 microversion: 2.25 time: 0.112236 Oct 04 18:13:33.909726 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1379/2815] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1103 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:33.915513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ec71dd5-e9b5-4632-9bd7-bd549c25f960 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Calling method '.version_select at 0x7fd4d1834700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.939317 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-6ec71dd5-e9b5-4632-9bd7-bd549c25f960 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] HTTP exception thrown: Image not found. Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ec71dd5-e9b5-4632-9bd7-bd549c25f960 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Request method failure captured: Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/images/f3f31651-44dc-49e0-87e7-13b4d2d9f0c6/metadata HTTP/1.1 Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHfMPiynOPEVxeKr7f8BtEktmh8E5PL-2PLyS4Xoz4I-Obuyvie-KqMamDV06btMDnAM8S_cIs9YG2X7cqH6B-X3-UqAoyzvnPaWCZpxxTGALUyiFI3ZosR9_MB4OBVLHmtz_-4fm0bK7vTQo3LEWl3lZ3CdlNmKXNXWYCAtPZk6aPs Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:13:33.941713 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}] Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ce83c1f88e94422a907f59883e020766 Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: exception: Image not found. Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'image_id': 'f3f31651-44dc-49e0-87e7-13b4d2d9f0c6'} Oct 04 18:13:33.943047 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:33.943952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f3f31651-44dc-49e0-87e7-13b4d2d9f0c6 Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:33.945278 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f3f31651-44dc-49e0-87e7-13b4d2d9f0c6 could not be found. Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:13:33.946563 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:13:33.947954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:33.951249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ec71dd5-e9b5-4632-9bd7-bd549c25f960 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Returning 404 to user: Image not found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:33.952796 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ec71dd5-e9b5-4632-9bd7-bd549c25f960 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] 10.222.0.18 "GET /compute/v2.1/images/f3f31651-44dc-49e0-87e7-13b4d2d9f0c6/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041269 Oct 04 18:13:33.957652 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1380/2816] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/images/f3f31651-44dc-49e0-87e7-13b4d2d9f0c6/metadata => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:13:33.965458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a957f9f9-6eec-46d0-af91-0ae284c970b3 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Action: 'update_all', calling method: .version_select at 0x7fd4d1834700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:34.004431 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-a957f9f9-6eec-46d0-af91-0ae284c970b3 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] HTTP exception thrown: Image not found. Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a957f9f9-6eec-46d0-af91-0ae284c970b3 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Request method failure captured: Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/images/894e529d-6604-416a-8221-ada20876ab67/metadata HTTP/1.1 Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 57 Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHfMPiynOPEVxeKr7f8BtEktmh8E5PL-2PLyS4Xoz4I-Obuyvie-KqMamDV06btMDnAM8S_cIs9YG2X7cqH6B-X3-UqAoyzvnPaWCZpxxTGALUyiFI3ZosR9_MB4OBVLHmtz_-4fm0bK7vTQo3LEWl3lZ3CdlNmKXNXWYCAtPZk6aPs Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:13:34.007456 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}] Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ce83c1f88e94422a907f59883e020766 Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:13:34.008774 n-d-850499-14 devstack@n-api.service[122331]: exception: Image not found. Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'image_id': '894e529d-6604-416a-8221-ada20876ab67', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:34.009538 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 894e529d-6604-416a-8221-ada20876ab67 Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:34.010615 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 894e529d-6604-416a-8221-ada20876ab67 could not be found. Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:34.011796 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:13:34.012869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.014079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a957f9f9-6eec-46d0-af91-0ae284c970b3 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Returning 404 to user: Image not found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:34.019128 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a957f9f9-6eec-46d0-af91-0ae284c970b3 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] 10.222.0.18 "PUT /compute/v2.1/images/894e529d-6604-416a-8221-ada20876ab67/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049262 Oct 04 18:13:34.019724 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1381/2817] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:13:33 2022] PUT /compute/v2.1/images/894e529d-6604-416a-8221-ada20876ab67/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:13:34.040199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2fef8bba-891d-4ea1-acff-75aa3c823a7a tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Action: 'update', calling method: .version_select at 0x7fd4d6179700>, body: {"meta": {"os_distro": "alt"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:34.097061 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-2fef8bba-891d-4ea1-acff-75aa3c823a7a tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] HTTP exception thrown: Image not found. Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2fef8bba-891d-4ea1-acff-75aa3c823a7a tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Request method failure captured: Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/images/a9689b1a-a275-45b4-8853-33f719e81bb1/metadata/os_distro HTTP/1.1 Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 30 Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHfMPiynOPEVxeKr7f8BtEktmh8E5PL-2PLyS4Xoz4I-Obuyvie-KqMamDV06btMDnAM8S_cIs9YG2X7cqH6B-X3-UqAoyzvnPaWCZpxxTGALUyiFI3ZosR9_MB4OBVLHmtz_-4fm0bK7vTQo3LEWl3lZ3CdlNmKXNXWYCAtPZk6aPs Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:13:34.105241 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}] Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ce83c1f88e94422a907f59883e020766 Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: {"meta": {"os_distro": "alt"}} Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: exception: Image not found. Oct 04 18:13:34.106704 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'image_id': 'a9689b1a-a275-45b4-8853-33f719e81bb1', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:34.107744 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a9689b1a-a275-45b4-8853-33f719e81bb1 Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:34.109878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9689b1a-a275-45b4-8853-33f719e81bb1 could not be found. Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:34.112693 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:13:34.116269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.119780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2fef8bba-891d-4ea1-acff-75aa3c823a7a tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Returning 404 to user: Image not found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:34.119780 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2fef8bba-891d-4ea1-acff-75aa3c823a7a tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] 10.222.0.18 "PUT /compute/v2.1/images/a9689b1a-a275-45b4-8853-33f719e81bb1/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.083468 Oct 04 18:13:34.119780 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1382/2818] 10.222.0.18 () {60 vars in 1310 bytes} [Tue Oct 4 18:13:34 2022] PUT /compute/v2.1/images/a9689b1a-a275-45b4-8853-33f719e81bb1/metadata/os_distro => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:13:34.121615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4dadfddb-713c-4ebd-9ad0-2a5f76398474 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Action: 'create', calling method: .version_select at 0x7fd4d13251f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:34.161798 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4dadfddb-713c-4ebd-9ad0-2a5f76398474 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] HTTP exception thrown: Image not found. Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4dadfddb-713c-4ebd-9ad0-2a5f76398474 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Request method failure captured: Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/images/a332c61c-c134-4b6f-a44f-9454c02ebfad/metadata HTTP/1.1 Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 57 Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHfMPiynOPEVxeKr7f8BtEktmh8E5PL-2PLyS4Xoz4I-Obuyvie-KqMamDV06btMDnAM8S_cIs9YG2X7cqH6B-X3-UqAoyzvnPaWCZpxxTGALUyiFI3ZosR9_MB4OBVLHmtz_-4fm0bK7vTQo3LEWl3lZ3CdlNmKXNXWYCAtPZk6aPs Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:13:34.166524 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219d3741bf4a47cb948ca1affc32f403"}]}] Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 219d3741bf4a47cb948ca1affc32f403 Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279 Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ce83c1f88e94422a907f59883e020766 Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1741037279-project Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: exception: Image not found. Oct 04 18:13:34.168359 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'image_id': 'a332c61c-c134-4b6f-a44f-9454c02ebfad', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:34.169338 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a332c61c-c134-4b6f-a44f-9454c02ebfad Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:34.170980 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a332c61c-c134-4b6f-a44f-9454c02ebfad could not be found. Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:34.174947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:13:34.176445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:34.178426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4dadfddb-713c-4ebd-9ad0-2a5f76398474 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] Returning 404 to user: Image not found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:34.178426 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4dadfddb-713c-4ebd-9ad0-2a5f76398474 tempest-ImagesMetadataNegativeTestJSON-1741037279 tempest-ImagesMetadataNegativeTestJSON-1741037279-project] 10.222.0.18 "POST /compute/v2.1/images/a332c61c-c134-4b6f-a44f-9454c02ebfad/metadata" status: 404 len: 62 microversion: 2.1 time: 0.058674 Oct 04 18:13:34.179175 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1383/2819] 10.222.0.18 () {60 vars in 1281 bytes} [Tue Oct 4 18:13:34 2022] POST /compute/v2.1/images/a332c61c-c134-4b6f-a44f-9454c02ebfad/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:13:34.185451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-728a2a0e-d596-42c1-837d-07c9bfd919a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.188483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b658d7fe-705f-4b28-a065-69499f537dae tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.189110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b658d7fe-705f-4b28-a065-69499f537dae tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.197429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b658d7fe-705f-4b28-a065-69499f537dae tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.197936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b658d7fe-705f-4b28-a065-69499f537dae tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.198380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b658d7fe-705f-4b28-a065-69499f537dae tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.199138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b658d7fe-705f-4b28-a065-69499f537dae tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.199605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b658d7fe-705f-4b28-a065-69499f537dae tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.200039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b658d7fe-705f-4b28-a065-69499f537dae tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.210165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-728a2a0e-d596-42c1-837d-07c9bfd919a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1316 microversion: 2.1 time: 0.363737 Oct 04 18:13:34.211006 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1437/2820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:34.358378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-88ccb61e-b048-4e49-b9cd-a040eec0967f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.359141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-88ccb61e-b048-4e49-b9cd-a040eec0967f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.375496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88ccb61e-b048-4e49-b9cd-a040eec0967f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.376195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88ccb61e-b048-4e49-b9cd-a040eec0967f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.376802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88ccb61e-b048-4e49-b9cd-a040eec0967f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.377731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88ccb61e-b048-4e49-b9cd-a040eec0967f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.378190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88ccb61e-b048-4e49-b9cd-a040eec0967f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.378638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88ccb61e-b048-4e49-b9cd-a040eec0967f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.489770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b658d7fe-705f-4b28-a065-69499f537dae tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.505175 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b658d7fe-705f-4b28-a065-69499f537dae tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1469 microversion: 2.1 time: 0.324912 Oct 04 18:13:34.505759 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1384/2821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:34.523745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-18099baa-e5e2-40f8-a9ff-f9d15bde5df7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.525108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-18099baa-e5e2-40f8-a9ff-f9d15bde5df7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.543956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18099baa-e5e2-40f8-a9ff-f9d15bde5df7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.545039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18099baa-e5e2-40f8-a9ff-f9d15bde5df7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.545039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18099baa-e5e2-40f8-a9ff-f9d15bde5df7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.546160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18099baa-e5e2-40f8-a9ff-f9d15bde5df7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.546782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18099baa-e5e2-40f8-a9ff-f9d15bde5df7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.547087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18099baa-e5e2-40f8-a9ff-f9d15bde5df7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.662862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-18099baa-e5e2-40f8-a9ff-f9d15bde5df7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.675319 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-18099baa-e5e2-40f8-a9ff-f9d15bde5df7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1267 microversion: 2.1 time: 0.167775 Oct 04 18:13:34.676683 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1385/2822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:34.727444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-88ccb61e-b048-4e49-b9cd-a040eec0967f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.739440 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-88ccb61e-b048-4e49-b9cd-a040eec0967f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.384415 Oct 04 18:13:34.740059 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1438/2823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:34.815765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.822152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7c07aaa7-e934-4bc0-8030-d09cb864fa7e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.823109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7c07aaa7-e934-4bc0-8030-d09cb864fa7e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.831184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c07aaa7-e934-4bc0-8030-d09cb864fa7e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.831906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c07aaa7-e934-4bc0-8030-d09cb864fa7e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.832391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.832775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c07aaa7-e934-4bc0-8030-d09cb864fa7e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.833688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c07aaa7-e934-4bc0-8030-d09cb864fa7e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.834333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c07aaa7-e934-4bc0-8030-d09cb864fa7e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.835268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c07aaa7-e934-4bc0-8030-d09cb864fa7e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.853259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.853778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.854381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.855633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.856111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.856601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.995328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7c07aaa7-e934-4bc0-8030-d09cb864fa7e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.021392 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7c07aaa7-e934-4bc0-8030-d09cb864fa7e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1485 microversion: 2.1 time: 0.203282 Oct 04 18:13:35.022091 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1439/2824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1485 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:35.035933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.036084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.057446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.060553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.062148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.066437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.067035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.069725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.247169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.275386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.279509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.281950 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-62d40014-0571-444d-bc7a-232bae7a4eff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1232 microversion: 2.25 time: 0.255638 Oct 04 18:13:35.283600 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1440/2825] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1232 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:35.291612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a38532e5-3d56-4c5b-9ff6-cb88c3b7df46 req-82afe8f5-68ca-40a3-a8c4-d4a99eb64323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230fae08-91ae-495a-b756-394b097c7379", "name": "network-vif-deleted", "tag": "889d0be0-ee97-4ae8-8c58-7808bbff16c1"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:35.338741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a38532e5-3d56-4c5b-9ff6-cb88c3b7df46 req-82afe8f5-68ca-40a3-a8c4-d4a99eb64323 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.339317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a38532e5-3d56-4c5b-9ff6-cb88c3b7df46 req-82afe8f5-68ca-40a3-a8c4-d4a99eb64323 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.341278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a38532e5-3d56-4c5b-9ff6-cb88c3b7df46 req-82afe8f5-68ca-40a3-a8c4-d4a99eb64323 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.380036 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a38532e5-3d56-4c5b-9ff6-cb88c3b7df46 req-82afe8f5-68ca-40a3-a8c4-d4a99eb64323 service nova] Creating event network-vif-deleted:889d0be0-ee97-4ae8-8c58-7808bbff16c1 for instance 230fae08-91ae-495a-b756-394b097c7379 on n-h1-850499-14 Oct 04 18:13:35.396789 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a38532e5-3d56-4c5b-9ff6-cb88c3b7df46 req-82afe8f5-68ca-40a3-a8c4-d4a99eb64323 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111331 Oct 04 18:13:35.401470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1441/2826] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:35.407109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4b573896-3568-44b4-874b-171e34f51bbd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.407899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4b573896-3568-44b4-874b-171e34f51bbd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.425161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:35.426819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b573896-3568-44b4-874b-171e34f51bbd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.427609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b573896-3568-44b4-874b-171e34f51bbd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.428086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b573896-3568-44b4-874b-171e34f51bbd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.428865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b573896-3568-44b4-874b-171e34f51bbd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.429330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b573896-3568-44b4-874b-171e34f51bbd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.429768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b573896-3568-44b4-874b-171e34f51bbd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.571353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.585332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.593759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.595331 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c7eaaa81-8213-4475-a8b5-a23afcc310ed tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.787387 Oct 04 18:13:35.620314 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1386/2827] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:35.626766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-994d6fa9-d787-4f0c-a51e-639abf1d4a7f req-8882b902-a712-41cf-9e86-b160165c8514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378afc34-2555-49c8-b008-303c8f22eded", "name": "network-vif-deleted", "tag": "279e0ebb-0c3d-4ebe-8b58-abe1859c6f23"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:35.648538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-994d6fa9-d787-4f0c-a51e-639abf1d4a7f req-8882b902-a712-41cf-9e86-b160165c8514 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.649251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-994d6fa9-d787-4f0c-a51e-639abf1d4a7f req-8882b902-a712-41cf-9e86-b160165c8514 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.649863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-994d6fa9-d787-4f0c-a51e-639abf1d4a7f req-8882b902-a712-41cf-9e86-b160165c8514 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.663821 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-994d6fa9-d787-4f0c-a51e-639abf1d4a7f req-8882b902-a712-41cf-9e86-b160165c8514 service nova] Creating event network-vif-deleted:279e0ebb-0c3d-4ebe-8b58-abe1859c6f23 for instance 378afc34-2555-49c8-b008-303c8f22eded on n-h1-850499-14 Oct 04 18:13:35.669705 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-994d6fa9-d787-4f0c-a51e-639abf1d4a7f req-8882b902-a712-41cf-9e86-b160165c8514 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047979 Oct 04 18:13:35.671904 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1387/2828] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:35.680691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9654bb1f-e997-48ac-a259-b07b4700b345 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.681689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9654bb1f-e997-48ac-a259-b07b4700b345 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.690005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9654bb1f-e997-48ac-a259-b07b4700b345 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.690748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9654bb1f-e997-48ac-a259-b07b4700b345 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.691410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9654bb1f-e997-48ac-a259-b07b4700b345 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.694834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9654bb1f-e997-48ac-a259-b07b4700b345 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.695791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9654bb1f-e997-48ac-a259-b07b4700b345 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.696666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9654bb1f-e997-48ac-a259-b07b4700b345 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.831295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4b573896-3568-44b4-874b-171e34f51bbd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.833585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9654bb1f-e997-48ac-a259-b07b4700b345 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.842133 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9654bb1f-e997-48ac-a259-b07b4700b345 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1298 microversion: 2.1 time: 0.167317 Oct 04 18:13:35.843099 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1388/2829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1298 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:35.851420 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4b573896-3568-44b4-874b-171e34f51bbd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1316 microversion: 2.1 time: 0.443134 Oct 04 18:13:35.858662 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1442/2830] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:35.863400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dd4bff69-d797-40e7-b0bc-074b8d8612e1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.864866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dd4bff69-d797-40e7-b0bc-074b8d8612e1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.867430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6736eac2-0275-41a2-a6a1-9eb35af4941a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.868300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6736eac2-0275-41a2-a6a1-9eb35af4941a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.874729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd4bff69-d797-40e7-b0bc-074b8d8612e1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.875504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd4bff69-d797-40e7-b0bc-074b8d8612e1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.876512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd4bff69-d797-40e7-b0bc-074b8d8612e1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.877127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6736eac2-0275-41a2-a6a1-9eb35af4941a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.877731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd4bff69-d797-40e7-b0bc-074b8d8612e1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.877970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6736eac2-0275-41a2-a6a1-9eb35af4941a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.878205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd4bff69-d797-40e7-b0bc-074b8d8612e1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.878648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd4bff69-d797-40e7-b0bc-074b8d8612e1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.878896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6736eac2-0275-41a2-a6a1-9eb35af4941a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.879904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6736eac2-0275-41a2-a6a1-9eb35af4941a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.880395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6736eac2-0275-41a2-a6a1-9eb35af4941a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.880987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6736eac2-0275-41a2-a6a1-9eb35af4941a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.982548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dd4bff69-d797-40e7-b0bc-074b8d8612e1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.995783 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dd4bff69-d797-40e7-b0bc-074b8d8612e1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1273 microversion: 2.1 time: 0.140957 Oct 04 18:13:35.996763 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1389/2831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:36.048725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:36.049357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:36.056380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.060744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.061746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.062972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.063465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.063907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.083959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6736eac2-0275-41a2-a6a1-9eb35af4941a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.091874 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6736eac2-0275-41a2-a6a1-9eb35af4941a tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.231695 Oct 04 18:13:36.095805 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1443/2832] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:36.111507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:36.115422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.115983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.116455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.116905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lazy-loading 'fault' on Instance uuid 230fae08-91ae-495a-b756-394b097c7379 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:36.176240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.184373 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b1fe111e-7b62-4efc-9ca8-fe24b5394508 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1314 microversion: 2.1 time: 0.139481 Oct 04 18:13:36.190782 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1390/2833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:36 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:36.314773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:36.316152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:36.327568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.328198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.328933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.331865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.332357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.332931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.413253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.422501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.424020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.425152 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-95dfc4b9-0f47-4107-b3d6-2b2875fb3b08 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1232 microversion: 2.25 time: 0.114422 Oct 04 18:13:36.425716 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1444/2834] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:36 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1232 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:36.646228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:36.653682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:36.663557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.664064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.664518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.665248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.665725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.666159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.867854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:36.868828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:36.879034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.879981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.881195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.882173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.883346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.883855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.890455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:36.930162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.933749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.934417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.935168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lazy-loading 'fault' on Instance uuid 378afc34-2555-49c8-b008-303c8f22eded {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:37.007009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.019324 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4500841c-3501-45c9-8178-b2a6e71406ea tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1303 microversion: 2.1 time: 0.157708 Oct 04 18:13:37.019933 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1445/2835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:36 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:37.025545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d7530110-315c-4dbf-8bc4-77c3eb11f7ea tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:37.026385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d7530110-315c-4dbf-8bc4-77c3eb11f7ea tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:37.032672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7530110-315c-4dbf-8bc4-77c3eb11f7ea tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.033436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7530110-315c-4dbf-8bc4-77c3eb11f7ea tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.034049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7530110-315c-4dbf-8bc4-77c3eb11f7ea tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.034927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7530110-315c-4dbf-8bc4-77c3eb11f7ea tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.035578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7530110-315c-4dbf-8bc4-77c3eb11f7ea tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.036018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7530110-315c-4dbf-8bc4-77c3eb11f7ea tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.063106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.073501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.075058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.076252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-44da87f2-5b3e-459d-a727-dc5bb38c0326 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.452415 Oct 04 18:13:37.076844 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1391/2836] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:36 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:37.082109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c6aa18b0-6a9f-455b-bc35-5f26b708ec9a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:37.082723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c6aa18b0-6a9f-455b-bc35-5f26b708ec9a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:37.089514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6aa18b0-6a9f-455b-bc35-5f26b708ec9a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.091496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6aa18b0-6a9f-455b-bc35-5f26b708ec9a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.092180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6aa18b0-6a9f-455b-bc35-5f26b708ec9a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.093599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6aa18b0-6a9f-455b-bc35-5f26b708ec9a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.094275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6aa18b0-6a9f-455b-bc35-5f26b708ec9a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.094783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6aa18b0-6a9f-455b-bc35-5f26b708ec9a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.189789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c6aa18b0-6a9f-455b-bc35-5f26b708ec9a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.198188 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c6aa18b0-6a9f-455b-bc35-5f26b708ec9a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1273 microversion: 2.1 time: 0.120298 Oct 04 18:13:37.199271 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1392/2837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:37 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:37.203989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a8e0c868-fa85-4e56-aa77-b19961f13c35 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:37.204610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a8e0c868-fa85-4e56-aa77-b19961f13c35 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:37.210602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8e0c868-fa85-4e56-aa77-b19961f13c35 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.211140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8e0c868-fa85-4e56-aa77-b19961f13c35 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.211593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8e0c868-fa85-4e56-aa77-b19961f13c35 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.212305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8e0c868-fa85-4e56-aa77-b19961f13c35 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.212775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8e0c868-fa85-4e56-aa77-b19961f13c35 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.213265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8e0c868-fa85-4e56-aa77-b19961f13c35 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.298135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d7530110-315c-4dbf-8bc4-77c3eb11f7ea tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.307260 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d7530110-315c-4dbf-8bc4-77c3eb11f7ea tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1316 microversion: 2.1 time: 0.286177 Oct 04 18:13:37.307848 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1446/2838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:37 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:37.319132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:37.319132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:37.319132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.319835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.319835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.320392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.320979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.321914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.359045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.359864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.360475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.360921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lazy-loading 'fault' on Instance uuid 230fae08-91ae-495a-b756-394b097c7379 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:37.474340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.486966 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67f9c003-e53f-4da1-bb9d-6e2dca800333 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 200 len: 1314 microversion: 2.1 time: 0.178031 Oct 04 18:13:37.488007 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1447/2839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:37 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:37.494346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:37.495083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:37.502486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.503113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.504053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.505051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.505714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.506222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.530175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a8e0c868-fa85-4e56-aa77-b19961f13c35 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.542994 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a8e0c868-fa85-4e56-aa77-b19961f13c35 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.342522 Oct 04 18:13:37.543897 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1393/2840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:37 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:37.629223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.649655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.651416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.654804 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b2cba29f-934e-4398-970b-0aa098fda201 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1240 microversion: 2.25 time: 0.165426 Oct 04 18:13:37.655595 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1448/2841] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:37 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1240 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:38.041688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:38.042946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:38.058370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.059021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.059483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.061317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.061799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.064625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.103287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:38.104326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:38.113980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.114476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.114921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.115690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.116155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.116587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.197191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.200367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.201023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.201542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lazy-loading 'fault' on Instance uuid 378afc34-2555-49c8-b008-303c8f22eded {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:38.513575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.533307 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90b6396f-942d-41a1-9866-abb4f1dbafcb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 200 len: 1303 microversion: 2.1 time: 0.495072 Oct 04 18:13:38.534157 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1394/2842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:38 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 1303 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:38.553641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd6a10bb-629b-483b-84ab-bcb2856dad3b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:38.555009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd6a10bb-629b-483b-84ab-bcb2856dad3b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:38.561814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd6a10bb-629b-483b-84ab-bcb2856dad3b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.562537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd6a10bb-629b-483b-84ab-bcb2856dad3b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.563247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd6a10bb-629b-483b-84ab-bcb2856dad3b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.564356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd6a10bb-629b-483b-84ab-bcb2856dad3b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.564914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd6a10bb-629b-483b-84ab-bcb2856dad3b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.565502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd6a10bb-629b-483b-84ab-bcb2856dad3b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.017986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.030999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.037544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.041960 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-47231ef4-9d42-4fca-b520-57c104c4234a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.941586 Oct 04 18:13:39.043605 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1449/2843] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:38 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:39.049995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3eb95c4a-220b-4fc6-9ddb-99252a07e8a2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.050795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3eb95c4a-220b-4fc6-9ddb-99252a07e8a2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.061922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb95c4a-220b-4fc6-9ddb-99252a07e8a2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.062903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb95c4a-220b-4fc6-9ddb-99252a07e8a2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.063520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb95c4a-220b-4fc6-9ddb-99252a07e8a2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.064526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb95c4a-220b-4fc6-9ddb-99252a07e8a2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.065608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb95c4a-220b-4fc6-9ddb-99252a07e8a2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.066408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3eb95c4a-220b-4fc6-9ddb-99252a07e8a2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.115322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fd6a10bb-629b-483b-84ab-bcb2856dad3b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.124498 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd6a10bb-629b-483b-84ab-bcb2856dad3b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1315 microversion: 2.1 time: 0.586632 Oct 04 18:13:39.127541 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1395/2844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:38 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:39.140291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.142252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.161343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.162590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.163232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.164127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.164752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.165470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.203339 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 HTTP/1.1 Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:13:39.208563 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:13:39.210133 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '230fae08-91ae-495a-b756-394b097c7379'} Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:39.211106 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:13:39.212533 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:39.215709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 404 to user: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:39.216943 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c2cea6df-e50a-412b-a0dc-b70f3cfba0a8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 404 len: 111 microversion: 2.1 time: 0.087074 Oct 04 18:13:39.222414 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1396/2845] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:39.227589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef9e6a80-9b9d-47b4-9e8f-fc26888fec50 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.232619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef9e6a80-9b9d-47b4-9e8f-fc26888fec50 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.246239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef9e6a80-9b9d-47b4-9e8f-fc26888fec50 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.248316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef9e6a80-9b9d-47b4-9e8f-fc26888fec50 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.251910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef9e6a80-9b9d-47b4-9e8f-fc26888fec50 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.252856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef9e6a80-9b9d-47b4-9e8f-fc26888fec50 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.253485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef9e6a80-9b9d-47b4-9e8f-fc26888fec50 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.255019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef9e6a80-9b9d-47b4-9e8f-fc26888fec50 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.522353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3eb95c4a-220b-4fc6-9ddb-99252a07e8a2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.525017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef9e6a80-9b9d-47b4-9e8f-fc26888fec50 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.537659 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef9e6a80-9b9d-47b4-9e8f-fc26888fec50 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.313926 Oct 04 18:13:39.539085 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3eb95c4a-220b-4fc6-9ddb-99252a07e8a2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1316 microversion: 2.1 time: 0.494126 Oct 04 18:13:39.540120 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1450/2846] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:39.546021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.546855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.551562 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1397/2847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:39.554053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.554727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.556222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.557528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.559451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.560065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.563854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-22a4489e-f295-4ff0-a462-7ff709db4897 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1c20700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.613696 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-22a4489e-f295-4ff0-a462-7ff709db4897 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/bfdcb138-50e4-4cf8-9b58-6604494b64ee" status: 200 len: 662 microversion: 2.1 time: 0.060719 Oct 04 18:13:39.614747 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1398/2848] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/images/bfdcb138-50e4-4cf8-9b58-6604494b64ee => generated 662 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:39.619645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-bba81132-a3fb-4c8a-8a98-332f2e47d186 req-8883b3ec-7646-45b0-a804-347bb4ea5a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d683c0-cb6a-46db-a6a3-d956d333aeb6", "name": "network-vif-plugged", "status": "completed", "tag": "72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:39.631625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bba81132-a3fb-4c8a-8a98-332f2e47d186 req-8883b3ec-7646-45b0-a804-347bb4ea5a02 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.632415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bba81132-a3fb-4c8a-8a98-332f2e47d186 req-8883b3ec-7646-45b0-a804-347bb4ea5a02 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.633033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bba81132-a3fb-4c8a-8a98-332f2e47d186 req-8883b3ec-7646-45b0-a804-347bb4ea5a02 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.645770 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-bba81132-a3fb-4c8a-8a98-332f2e47d186 req-8883b3ec-7646-45b0-a804-347bb4ea5a02 service nova] Creating event network-vif-plugged:72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c for instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 on n-h2-850499-14 Oct 04 18:13:39.662255 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-bba81132-a3fb-4c8a-8a98-332f2e47d186 req-8883b3ec-7646-45b0-a804-347bb4ea5a02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046005 Oct 04 18:13:39.664100 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1399/2849] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:39.672909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c8ef3ada-d762-4cd1-a23e-48a66859eb74 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Action: 'create', calling method: .version_select at 0x7fd4d1292310>, body: {"keypair": {"name": "tempest-keypair-1459062888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqD0gxLuphXOZxJAeWpK/nM00Bcjq//TbF3PytFv82jMdZKLeoxtg5/tzoU/Fm+nt7OukMeUBMhuMRO//+WESSXSrOq6OfFuxsjBWdgoM1xe59A6sxvBZ/H8viQui4l/w=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:39.692369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-c8ef3ada-d762-4cd1-a23e-48a66859eb74 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Getting quotas for project ba126ac644f740df852efc20cec70e25. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:39.698390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-c8ef3ada-d762-4cd1-a23e-48a66859eb74 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Getting quotas for user facf0eae1c5d4dff8e957c3ab073c7dd and project ba126ac644f740df852efc20cec70e25. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:39.749847 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c8ef3ada-d762-4cd1-a23e-48a66859eb74 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080426 Oct 04 18:13:39.750881 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1400/2850] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:13:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:39.760958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.764952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: 378afc34-2555-49c8-b008-303c8f22eded] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.782247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.783193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.783879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.785029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.788958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.789835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.816815 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] HTTP exception thrown: Instance 378afc34-2555-49c8-b008-303c8f22eded could not be found. Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Request method failure captured: Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded HTTP/1.1 Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHcKYsG9HQPNzJ7sEol8ReflDLOeRvaTVuFKWokFiyqzITLblycjGqJ-zKGJuyQuJam4_Nh1NUfnLc6evjxQhw7mKDM7J7Wkq1mToK8CazKg2XzbzctZM9-4TyP0Fwrt9oRrGGfSwedJVv-r_iPr3s_5Ufm9w2WhBVkqInBxRWjblno Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: b1b14394d8ea452eb046b7ce147a4ec7 Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersAdminTestJSON-1413840815 Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:13:39.818729 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1b14394d8ea452eb046b7ce147a4ec7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1b14394d8ea452eb046b7ce147a4ec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1b14394d8ea452eb046b7ce147a4ec7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1b14394d8ea452eb046b7ce147a4ec7"}]}] Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersAdminTestJSON-1413840815 Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: b1b14394d8ea452eb046b7ce147a4ec7 Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersAdminTestJSON-1413840815 Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersAdminTestJSON-1413840815-project Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0b824cdb1fd346729b59aece4c49a927 Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersAdminTestJSON-1413840815-project Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 378afc34-2555-49c8-b008-303c8f22eded could not be found. Oct 04 18:13:39.820047 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '378afc34-2555-49c8-b008-303c8f22eded'} Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 378afc34-2555-49c8-b008-303c8f22eded could not be found. Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:39.820760 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 378afc34-2555-49c8-b008-303c8f22eded could not be found. Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 378afc34-2555-49c8-b008-303c8f22eded could not be found. Oct 04 18:13:39.821908 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:39.822999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Returning 404 to user: Instance 378afc34-2555-49c8-b008-303c8f22eded could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:39.822999 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3eb35e9f-9fd4-42ea-a733-9ae7eab48eb8 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded" status: 404 len: 111 microversion: 2.1 time: 0.068717 Oct 04 18:13:39.822999 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1401/2851] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/378afc34-2555-49c8-b008-303c8f22eded => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:39.827269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c14a963-e7c8-4142-8107-a21bb8d9f536 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1f10820>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.888207 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c14a963-e7c8-4142-8107-a21bb8d9f536 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/bfdcb138-50e4-4cf8-9b58-6604494b64ee" status: 200 len: 662 microversion: 2.1 time: 0.065021 Oct 04 18:13:39.889537 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1402/2852] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/images/bfdcb138-50e4-4cf8-9b58-6604494b64ee => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:39.908435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0caa9707-d2c3-4ed6-9b7d-8622bab254bb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.909906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0caa9707-d2c3-4ed6-9b7d-8622bab254bb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.927255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0caa9707-d2c3-4ed6-9b7d-8622bab254bb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.929335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0caa9707-d2c3-4ed6-9b7d-8622bab254bb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.931124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0caa9707-d2c3-4ed6-9b7d-8622bab254bb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.932001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0caa9707-d2c3-4ed6-9b7d-8622bab254bb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.932643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0caa9707-d2c3-4ed6-9b7d-8622bab254bb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.933230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0caa9707-d2c3-4ed6-9b7d-8622bab254bb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.987424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0caa9707-d2c3-4ed6-9b7d-8622bab254bb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:39.992661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:40.082650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.093117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.104882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.106630 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1eb70479-750f-4dd2-82f7-a038cef52f37 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1292 microversion: 2.25 time: 0.565299 Oct 04 18:13:40.108113 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1451/2853] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1292 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:40.113172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:40.121972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:40.131349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.135637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.136525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.137688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.138369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.140169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.154155 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0caa9707-d2c3-4ed6-9b7d-8622bab254bb tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 204 len: 0 microversion: 2.1 time: 0.255677 Oct 04 18:13:40.156149 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1403/2854] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:39 2022] DELETE /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:40.162866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ee59cbc-cf4a-47b2-95a1-2da89b9d8066 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:40.163939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3ee59cbc-cf4a-47b2-95a1-2da89b9d8066 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:40.174143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee59cbc-cf4a-47b2-95a1-2da89b9d8066 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.175779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee59cbc-cf4a-47b2-95a1-2da89b9d8066 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.176406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee59cbc-cf4a-47b2-95a1-2da89b9d8066 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.178156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee59cbc-cf4a-47b2-95a1-2da89b9d8066 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.178793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee59cbc-cf4a-47b2-95a1-2da89b9d8066 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.179451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ee59cbc-cf4a-47b2-95a1-2da89b9d8066 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.633404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.649932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.653126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.655946 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1e15e80a-3374-425a-b5e0-4e2cfa9e7f84 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.545142 Oct 04 18:13:40.657297 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1452/2855] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:40 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:40.662600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-50a61bde-0805-4d35-8bf3-f8b453014e5d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:40.663507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-50a61bde-0805-4d35-8bf3-f8b453014e5d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:40.671870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a61bde-0805-4d35-8bf3-f8b453014e5d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.672679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a61bde-0805-4d35-8bf3-f8b453014e5d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.673327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a61bde-0805-4d35-8bf3-f8b453014e5d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.674241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a61bde-0805-4d35-8bf3-f8b453014e5d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.675710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a61bde-0805-4d35-8bf3-f8b453014e5d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.676729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a61bde-0805-4d35-8bf3-f8b453014e5d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.783975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3ee59cbc-cf4a-47b2-95a1-2da89b9d8066 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.796659 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ee59cbc-cf4a-47b2-95a1-2da89b9d8066 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1315 microversion: 2.1 time: 0.638952 Oct 04 18:13:40.797185 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1404/2856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:40 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:40.803035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-acd097ec-0695-4057-8793-48bb5343aebc req-b6a71cd8-4b60-436b-93fd-d4994b1d6946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36c7b27-9927-4f6d-874d-dbf86b9ef895", "tag": "b431abe6-8cb4-48b7-b889-3c3dbf59f6d0"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:40.812766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-acd097ec-0695-4057-8793-48bb5343aebc req-b6a71cd8-4b60-436b-93fd-d4994b1d6946 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.813248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-acd097ec-0695-4057-8793-48bb5343aebc req-b6a71cd8-4b60-436b-93fd-d4994b1d6946 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.813683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-acd097ec-0695-4057-8793-48bb5343aebc req-b6a71cd8-4b60-436b-93fd-d4994b1d6946 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.824937 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-acd097ec-0695-4057-8793-48bb5343aebc req-b6a71cd8-4b60-436b-93fd-d4994b1d6946 service nova] Creating event network-changed:b431abe6-8cb4-48b7-b889-3c3dbf59f6d0 for instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 on n-h1-850499-14 Oct 04 18:13:40.831022 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-acd097ec-0695-4057-8793-48bb5343aebc req-b6a71cd8-4b60-436b-93fd-d4994b1d6946 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032323 Oct 04 18:13:40.831686 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1405/2857] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:40.836736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da01b2d6-e71e-4ce3-ae3d-b0530925b396 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:40.837617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-da01b2d6-e71e-4ce3-ae3d-b0530925b396 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:40.845439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da01b2d6-e71e-4ce3-ae3d-b0530925b396 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.846114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da01b2d6-e71e-4ce3-ae3d-b0530925b396 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.846719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da01b2d6-e71e-4ce3-ae3d-b0530925b396 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.847827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da01b2d6-e71e-4ce3-ae3d-b0530925b396 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.848943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da01b2d6-e71e-4ce3-ae3d-b0530925b396 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.849526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da01b2d6-e71e-4ce3-ae3d-b0530925b396 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.093681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-50a61bde-0805-4d35-8bf3-f8b453014e5d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.102884 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-50a61bde-0805-4d35-8bf3-f8b453014e5d tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1468 microversion: 2.1 time: 0.444273 Oct 04 18:13:41.106375 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1453/2858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:40 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1468 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:41.121745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0aa343db-586f-49e4-9b11-e3101c4c0f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.124185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0aa343db-586f-49e4-9b11-e3101c4c0f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:41.142864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa343db-586f-49e4-9b11-e3101c4c0f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.144086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa343db-586f-49e4-9b11-e3101c4c0f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.146148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa343db-586f-49e4-9b11-e3101c4c0f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.148267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa343db-586f-49e4-9b11-e3101c4c0f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.148902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa343db-586f-49e4-9b11-e3101c4c0f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.149495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa343db-586f-49e4-9b11-e3101c4c0f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.396498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-da01b2d6-e71e-4ce3-ae3d-b0530925b396 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.412026 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-da01b2d6-e71e-4ce3-ae3d-b0530925b396 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.578919 Oct 04 18:13:41.412636 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1406/2859] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:40 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:41.425116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7b88b0b0-94c7-49aa-abe0-4a8135958270 req-964a9552-643d-47cd-82b3-ac3de2fed930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40", "tag": "41d51df9-d9f3-4fb7-ade7-3b2c4ff0fdc4"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:41.473347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7b88b0b0-94c7-49aa-abe0-4a8135958270 req-964a9552-643d-47cd-82b3-ac3de2fed930 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.474312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7b88b0b0-94c7-49aa-abe0-4a8135958270 req-964a9552-643d-47cd-82b3-ac3de2fed930 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.474918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7b88b0b0-94c7-49aa-abe0-4a8135958270 req-964a9552-643d-47cd-82b3-ac3de2fed930 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.491187 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7b88b0b0-94c7-49aa-abe0-4a8135958270 req-964a9552-643d-47cd-82b3-ac3de2fed930 service nova] Creating event network-changed:41d51df9-d9f3-4fb7-ade7-3b2c4ff0fdc4 for instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 on n-h1-850499-14 Oct 04 18:13:41.498682 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7b88b0b0-94c7-49aa-abe0-4a8135958270 req-964a9552-643d-47cd-82b3-ac3de2fed930 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081132 Oct 04 18:13:41.500328 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1407/2860] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:41.507054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.507942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:41.515231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.515948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.516596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.517488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.518110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.518712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.559610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0aa343db-586f-49e4-9b11-e3101c4c0f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.569076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0aa343db-586f-49e4-9b11-e3101c4c0f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1316 microversion: 2.1 time: 0.460890 Oct 04 18:13:41.570260 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1454/2861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:41.575240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2884d987-bc72-4532-984d-3d53ab72c48a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12bd4c0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.633137 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2884d987-bc72-4532-984d-3d53ab72c48a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/fe3a3ebb-2f08-4789-8fde-8601ffa861cb" status: 200 len: 661 microversion: 2.1 time: 0.061496 Oct 04 18:13:41.633980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1455/2862] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/images/fe3a3ebb-2f08-4789-8fde-8601ffa861cb => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:41.649415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1e568b4-b246-4cec-ada0-6695f899ffb7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d13b2af0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.699463 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1e568b4-b246-4cec-ada0-6695f899ffb7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/fe3a3ebb-2f08-4789-8fde-8601ffa861cb" status: 200 len: 661 microversion: 2.1 time: 0.053950 Oct 04 18:13:41.700619 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1456/2863] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/images/fe3a3ebb-2f08-4789-8fde-8601ffa861cb => generated 661 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:41.715356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.719697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:41.732871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.736827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.737369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.738348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.744674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.745450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.188357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.198417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.203988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.214162 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cfc7a184-c3e9-47eb-8ad8-24d46d40c9f0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.511168 Oct 04 18:13:42.214988 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1457/2864] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:42.220386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-57d5d3e3-1fab-433f-a13f-e567b45f1d44 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:42.231111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57d5d3e3-1fab-433f-a13f-e567b45f1d44 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:42.244327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57d5d3e3-1fab-433f-a13f-e567b45f1d44 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.245215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57d5d3e3-1fab-433f-a13f-e567b45f1d44 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.250923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57d5d3e3-1fab-433f-a13f-e567b45f1d44 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.252329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57d5d3e3-1fab-433f-a13f-e567b45f1d44 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.253008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57d5d3e3-1fab-433f-a13f-e567b45f1d44 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.253663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57d5d3e3-1fab-433f-a13f-e567b45f1d44 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.265708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:42.458161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-57d5d3e3-1fab-433f-a13f-e567b45f1d44 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.469380 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-57d5d3e3-1fab-433f-a13f-e567b45f1d44 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1315 microversion: 2.1 time: 0.253096 Oct 04 18:13:42.470152 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1458/2865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:42 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:42.478563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a1dc8ca-5c02-458b-8a75-99b3b788c4f9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:42.479956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a1dc8ca-5c02-458b-8a75-99b3b788c4f9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:42.488837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a1dc8ca-5c02-458b-8a75-99b3b788c4f9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.490218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a1dc8ca-5c02-458b-8a75-99b3b788c4f9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.491403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a1dc8ca-5c02-458b-8a75-99b3b788c4f9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.492444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.493641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a1dc8ca-5c02-458b-8a75-99b3b788c4f9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.494286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a1dc8ca-5c02-458b-8a75-99b3b788c4f9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.494834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a1dc8ca-5c02-458b-8a75-99b3b788c4f9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.507639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.509823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.513448 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5a2d1fc9-175e-4cb8-9470-01a58ba1c64e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1292 microversion: 2.25 time: 1.011650 Oct 04 18:13:42.515106 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1408/2866] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1292 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:42.520114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5cb7754f-e3ca-49a1-a42d-b7e404253b49 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:42.521004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5cb7754f-e3ca-49a1-a42d-b7e404253b49 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:42.546638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cb7754f-e3ca-49a1-a42d-b7e404253b49 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.547279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cb7754f-e3ca-49a1-a42d-b7e404253b49 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.547750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cb7754f-e3ca-49a1-a42d-b7e404253b49 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.551437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cb7754f-e3ca-49a1-a42d-b7e404253b49 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.551941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cb7754f-e3ca-49a1-a42d-b7e404253b49 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.555325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5cb7754f-e3ca-49a1-a42d-b7e404253b49 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.831718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9a1dc8ca-5c02-458b-8a75-99b3b788c4f9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.845414 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a1dc8ca-5c02-458b-8a75-99b3b788c4f9 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1468 microversion: 2.1 time: 0.372860 Oct 04 18:13:42.846036 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1459/2867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:42 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1468 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:42.853118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-34cc7e77-2151-412c-97c8-6a69a03378fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:42.854104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-34cc7e77-2151-412c-97c8-6a69a03378fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:42.870040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34cc7e77-2151-412c-97c8-6a69a03378fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.875451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34cc7e77-2151-412c-97c8-6a69a03378fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.876128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34cc7e77-2151-412c-97c8-6a69a03378fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.877060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34cc7e77-2151-412c-97c8-6a69a03378fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.877700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5cb7754f-e3ca-49a1-a42d-b7e404253b49 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.877900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34cc7e77-2151-412c-97c8-6a69a03378fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.878546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34cc7e77-2151-412c-97c8-6a69a03378fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.890051 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5cb7754f-e3ca-49a1-a42d-b7e404253b49 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1524 microversion: 2.1 time: 0.373675 Oct 04 18:13:42.895170 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1409/2868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:42 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1524 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:43.041214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-34cc7e77-2151-412c-97c8-6a69a03378fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.059196 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-34cc7e77-2151-412c-97c8-6a69a03378fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1316 microversion: 2.1 time: 0.212039 Oct 04 18:13:43.060741 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1460/2869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:42 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:43.154497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45436085-d712-4bfb-88fa-875be7835f6d tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d18b8f70>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:43.201532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1028314813", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:43.206889 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45436085-d712-4bfb-88fa-875be7835f6d tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/546c2568-c2a9-4f17-9fa9-23f12c79f848" status: 200 len: 662 microversion: 2.1 time: 0.058613 Oct 04 18:13:43.207562 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1410/2870] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:13:43 2022] GET /compute/v2.1/images/546c2568-c2a9-4f17-9fa9-23f12c79f848 => generated 662 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:43.210305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:43.212240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=18 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:43.222409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4a3fc5b-ecb3-47a2-8365-c143313d59d4 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1325430>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:43.265311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] validate_networks() for [('47ff216e-5ac6-47ef-8951-1d8968800e41', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:13:43.273340 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e4a3fc5b-ecb3-47a2-8365-c143313d59d4 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/546c2568-c2a9-4f17-9fa9-23f12c79f848" status: 200 len: 662 microversion: 2.1 time: 0.054895 Oct 04 18:13:43.277370 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1411/2871] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:13:43 2022] GET /compute/v2.1/images/546c2568-c2a9-4f17-9fa9-23f12c79f848 => generated 662 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:43.281757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:43.282389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:43.301178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.302010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.303009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.303947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.304561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.305007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.574991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.585451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.587316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.588983 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f016b3ad-abf5-4d06-8aaa-e148481460e4 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.313992 Oct 04 18:13:43.589698 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1412/2872] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:43 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:43.606938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1676549446", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:43.662945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:13:43.916986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:43.917781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:43.918512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:43.919182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:43.921338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:43.936884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.938377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.939118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.940797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.941639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.942628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.965206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Getting quotas for project ba126ac644f740df852efc20cec70e25. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:43.971067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Getting quotas for user facf0eae1c5d4dff8e957c3ab073c7dd and project ba126ac644f740df852efc20cec70e25. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:43.980120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:43.981841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:43.982714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:43.984042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:43.985483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:43.989903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:13:43.992659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:13:43.999839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=45 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:44.005656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.011888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.012847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.014003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.017055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.017768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.043746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Getting quotas for project f00e986d888b46509f396884fe32853c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:44.051264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Getting quotas for user 70ef1c6abe074ce9af7b6baaef4721b9 and project f00e986d888b46509f396884fe32853c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:44.067926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:13:44.071364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:13:44.073565 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-159aefb8-1491-4b24-861d-45e893863281 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.876285 Oct 04 18:13:44.074268 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1461/2873] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:13:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:13:44.086389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-adfe6485-6c55-4d3a-8687-5ce4070c6589 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:44.087052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-adfe6485-6c55-4d3a-8687-5ce4070c6589 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:44.097653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adfe6485-6c55-4d3a-8687-5ce4070c6589 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.098497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adfe6485-6c55-4d3a-8687-5ce4070c6589 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.099276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adfe6485-6c55-4d3a-8687-5ce4070c6589 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.100813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adfe6485-6c55-4d3a-8687-5ce4070c6589 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.104039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adfe6485-6c55-4d3a-8687-5ce4070c6589 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.104689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adfe6485-6c55-4d3a-8687-5ce4070c6589 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.183014 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f6d126a-d1b4-4dc8-bba4-b8cdebf19fc8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581330 Oct 04 18:13:44.209942 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1413/2874] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:13:44.224431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:44.227425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:44.239067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.239942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.240670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.241711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.242375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.243029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.587377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-adfe6485-6c55-4d3a-8687-5ce4070c6589 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.600704 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-adfe6485-6c55-4d3a-8687-5ce4070c6589 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1315 microversion: 2.1 time: 0.525303 Oct 04 18:13:44.609808 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1462/2875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:44 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:44.622976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-72544e64-0a8d-4c8b-9b13-a0a24f418106 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:44.635953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-72544e64-0a8d-4c8b-9b13-a0a24f418106 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:44.643348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72544e64-0a8d-4c8b-9b13-a0a24f418106 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.644218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72544e64-0a8d-4c8b-9b13-a0a24f418106 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.644892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72544e64-0a8d-4c8b-9b13-a0a24f418106 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.645837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72544e64-0a8d-4c8b-9b13-a0a24f418106 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.651377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72544e64-0a8d-4c8b-9b13-a0a24f418106 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.652213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72544e64-0a8d-4c8b-9b13-a0a24f418106 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.726853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.748425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.753450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.757646 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e349e7eb-187a-45d5-b221-cf788c7834f0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1292 microversion: 2.25 time: 0.545125 Oct 04 18:13:44.758443 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1414/2876] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:44 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1292 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:44.769151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a44e58e5-9d84-47bd-831b-825cdb7a7712 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:44.769778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a44e58e5-9d84-47bd-831b-825cdb7a7712 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:44.789336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a44e58e5-9d84-47bd-831b-825cdb7a7712 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.789823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a44e58e5-9d84-47bd-831b-825cdb7a7712 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.790337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a44e58e5-9d84-47bd-831b-825cdb7a7712 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.807189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a44e58e5-9d84-47bd-831b-825cdb7a7712 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.808473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a44e58e5-9d84-47bd-831b-825cdb7a7712 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.811167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a44e58e5-9d84-47bd-831b-825cdb7a7712 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.292079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a44e58e5-9d84-47bd-831b-825cdb7a7712 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:45.301091 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a44e58e5-9d84-47bd-831b-825cdb7a7712 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1504 microversion: 2.1 time: 0.539305 Oct 04 18:13:45.304081 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1415/2877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:44 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1504 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:45.312722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d0f74f36-f23b-4b8d-bf69-f00104145ecc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.313670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d0f74f36-f23b-4b8d-bf69-f00104145ecc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.315400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-72544e64-0a8d-4c8b-9b13-a0a24f418106 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:45.319299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:45.331148 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-72544e64-0a8d-4c8b-9b13-a0a24f418106 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1468 microversion: 2.1 time: 0.719769 Oct 04 18:13:45.332061 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1463/2878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:44 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1468 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:45.344514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a20417fa-f786-461c-a560-ae4b0f6a3d4c tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.350038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a20417fa-f786-461c-a560-ae4b0f6a3d4c tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.359328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0f74f36-f23b-4b8d-bf69-f00104145ecc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.361302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0f74f36-f23b-4b8d-bf69-f00104145ecc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.361767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0f74f36-f23b-4b8d-bf69-f00104145ecc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.363960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0f74f36-f23b-4b8d-bf69-f00104145ecc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.364667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0f74f36-f23b-4b8d-bf69-f00104145ecc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.366265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0f74f36-f23b-4b8d-bf69-f00104145ecc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.374724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20417fa-f786-461c-a560-ae4b0f6a3d4c tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.375665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20417fa-f786-461c-a560-ae4b0f6a3d4c tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.377129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20417fa-f786-461c-a560-ae4b0f6a3d4c tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.378817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20417fa-f786-461c-a560-ae4b0f6a3d4c tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.380292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20417fa-f786-461c-a560-ae4b0f6a3d4c tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.383321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20417fa-f786-461c-a560-ae4b0f6a3d4c tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.500151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a20417fa-f786-461c-a560-ae4b0f6a3d4c tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:45.512246 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a20417fa-f786-461c-a560-ae4b0f6a3d4c tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1229 microversion: 2.1 time: 0.178917 Oct 04 18:13:45.531989 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1464/2879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1229 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:45.538279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1251723572", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:45.621994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:13:45.674410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d0f74f36-f23b-4b8d-bf69-f00104145ecc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:45.687264 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d0f74f36-f23b-4b8d-bf69-f00104145ecc tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1504 microversion: 2.1 time: 0.381765 Oct 04 18:13:45.688310 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1416/2880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:45.695251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.696359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.714260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.717300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.718532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.720994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.721809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.725035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.051525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.068290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.069029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:46.069566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:46.069807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.070245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:46.070931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:46.071078 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-14dc94fb-7bef-4447-a876-72da1449c8b0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.381253 Oct 04 18:13:46.071613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:46.079163 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1417/2881] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:46.079544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-61553db4-8951-43de-b60b-befb50df0c68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Action: 'create', calling method: .version_select at 0x7fd4d18343a0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1287719872", "description": "tempest-description-1846729788"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:46.088501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.089279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.089975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.091109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.091761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.092670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.115647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Getting quotas for project f00e986d888b46509f396884fe32853c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:46.120787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Getting quotas for user 70ef1c6abe074ce9af7b6baaef4721b9 and project f00e986d888b46509f396884fe32853c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:46.134393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:13:46.136723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:13:46.183699 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-85a1b480-4cdc-489f-90dd-76cb1a83503b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650084 Oct 04 18:13:46.184425 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1465/2882] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:13:46.189859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5a772de2-6d74-4d44-8af6-0b340df93ba2 req-3ea679e3-6d59-4889-b6c9-3ecc837fae8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a", "name": "network-vif-deleted", "tag": "1075430b-4731-47b1-aeb1-6c78e21fd987"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:46.201757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a772de2-6d74-4d44-8af6-0b340df93ba2 req-3ea679e3-6d59-4889-b6c9-3ecc837fae8f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.202279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a772de2-6d74-4d44-8af6-0b340df93ba2 req-3ea679e3-6d59-4889-b6c9-3ecc837fae8f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.202728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a772de2-6d74-4d44-8af6-0b340df93ba2 req-3ea679e3-6d59-4889-b6c9-3ecc837fae8f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.215647 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5a772de2-6d74-4d44-8af6-0b340df93ba2 req-3ea679e3-6d59-4889-b6c9-3ecc837fae8f service nova] Creating event network-vif-deleted:1075430b-4731-47b1-aeb1-6c78e21fd987 for instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a on n-h2-850499-14 Oct 04 18:13:46.221002 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5a772de2-6d74-4d44-8af6-0b340df93ba2 req-3ea679e3-6d59-4889-b6c9-3ecc837fae8f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035042 Oct 04 18:13:46.221917 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1466/2883] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:46.227900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-16f7c599-bb9b-4c73-871b-4b2fec7723e5 req-da2a81a6-360c-42b5-a8c1-5176f7fda642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-plugged", "status": "completed", "tag": "e1a15415-f9e0-4b1e-84c8-c5eeef520105"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:46.238619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-16f7c599-bb9b-4c73-871b-4b2fec7723e5 req-da2a81a6-360c-42b5-a8c1-5176f7fda642 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.239389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-16f7c599-bb9b-4c73-871b-4b2fec7723e5 req-da2a81a6-360c-42b5-a8c1-5176f7fda642 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.239835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-16f7c599-bb9b-4c73-871b-4b2fec7723e5 req-da2a81a6-360c-42b5-a8c1-5176f7fda642 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.251892 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-16f7c599-bb9b-4c73-871b-4b2fec7723e5 req-da2a81a6-360c-42b5-a8c1-5176f7fda642 service nova] Creating event network-vif-plugged:e1a15415-f9e0-4b1e-84c8-c5eeef520105 for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:13:46.257725 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-16f7c599-bb9b-4c73-871b-4b2fec7723e5 req-da2a81a6-360c-42b5-a8c1-5176f7fda642 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034415 Oct 04 18:13:46.261383 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1467/2884] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:46.267342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-466292be-dc89-48de-8449-50a322079884 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:46.268064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-466292be-dc89-48de-8449-50a322079884 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:46.272279 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-61553db4-8951-43de-b60b-befb50df0c68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.197929 Oct 04 18:13:46.274796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-466292be-dc89-48de-8449-50a322079884 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.275977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-466292be-dc89-48de-8449-50a322079884 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.276618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-466292be-dc89-48de-8449-50a322079884 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.277522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-466292be-dc89-48de-8449-50a322079884 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.277991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-466292be-dc89-48de-8449-50a322079884 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.278427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-466292be-dc89-48de-8449-50a322079884 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.284489 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1418/2885] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:13:46 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:46.290591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ec407cf-dd37-46c1-a9c6-55ee33e08701 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1808519862"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:46.291332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7ec407cf-dd37-46c1-a9c6-55ee33e08701 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:46.298507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ec407cf-dd37-46c1-a9c6-55ee33e08701 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.299118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ec407cf-dd37-46c1-a9c6-55ee33e08701 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.299658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ec407cf-dd37-46c1-a9c6-55ee33e08701 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.300577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ec407cf-dd37-46c1-a9c6-55ee33e08701 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.301227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ec407cf-dd37-46c1-a9c6-55ee33e08701 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.301774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ec407cf-dd37-46c1-a9c6-55ee33e08701 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.482154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-466292be-dc89-48de-8449-50a322079884 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.496110 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-466292be-dc89-48de-8449-50a322079884 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1315 microversion: 2.1 time: 0.233222 Oct 04 18:13:46.499339 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1468/2886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:46 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:46.508344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:46.509159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:46.520789 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.network.security_group_api [None req-7ec407cf-dd37-46c1-a9c6-55ee33e08701 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Adding security group b6491d8b-f1e4-4c74-9083-d50ac2d5c0b8 to port 72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c Oct 04 18:13:46.539376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.539985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.540770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.541974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.544966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.546125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.877271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.886790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.888263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.889969 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-260f51ee-a6b7-4b91-9e8c-e244988dd4a8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1280 microversion: 2.25 time: 0.388096 Oct 04 18:13:46.890535 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1469/2887] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:46 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1280 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:46.895175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-628f4cdd-0c7a-4f54-b0fd-3b6f16c26adf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:46.896006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-628f4cdd-0c7a-4f54-b0fd-3b6f16c26adf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:46.902884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-628f4cdd-0c7a-4f54-b0fd-3b6f16c26adf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.903593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-628f4cdd-0c7a-4f54-b0fd-3b6f16c26adf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.904218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-628f4cdd-0c7a-4f54-b0fd-3b6f16c26adf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.905153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-628f4cdd-0c7a-4f54-b0fd-3b6f16c26adf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.905771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-628f4cdd-0c7a-4f54-b0fd-3b6f16c26adf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.906359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-628f4cdd-0c7a-4f54-b0fd-3b6f16c26adf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.014895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-628f4cdd-0c7a-4f54-b0fd-3b6f16c26adf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.023146 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-628f4cdd-0c7a-4f54-b0fd-3b6f16c26adf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1214 microversion: 2.1 time: 0.131350 Oct 04 18:13:47.023721 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1470/2888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:46 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:47.028724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1112f94-23ff-4409-a44a-d8c41ee32aca tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1287719872"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:47.029539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1112f94-23ff-4409-a44a-d8c41ee32aca tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:47.046978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1112f94-23ff-4409-a44a-d8c41ee32aca tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.056364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1112f94-23ff-4409-a44a-d8c41ee32aca tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.057067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1112f94-23ff-4409-a44a-d8c41ee32aca tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.057926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1112f94-23ff-4409-a44a-d8c41ee32aca tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.058501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1112f94-23ff-4409-a44a-d8c41ee32aca tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.060125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1112f94-23ff-4409-a44a-d8c41ee32aca tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.242138 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ec407cf-dd37-46c1-a9c6-55ee33e08701 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6/action" status: 202 len: 0 microversion: 2.1 time: 0.956366 Oct 04 18:13:47.245730 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1419/2889] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:46 2022] POST /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6/action => generated 0 bytes in 958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:47.249374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:47.250026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:47.256171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.256660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.257107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.257797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.258252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.258873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.298146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.298891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.299424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.300139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lazy-loading 'fault' on Instance uuid c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:47.413214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b824cdb1fd346729b59aece4c49a927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b14394d8ea452eb046b7ce147a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.424584 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.network.security_group_api [None req-e1112f94-23ff-4409-a44a-d8c41ee32aca tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Adding security group ad9c063b-8ae0-4c81-ab53-40fc8746f234 to port 0657bd03-e275-4cc6-8a1c-2040ba2533e3 Oct 04 18:13:47.425586 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d6828f30-f4d0-479c-922a-cdd5406a4408 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 200 len: 1303 microversion: 2.1 time: 0.179516 Oct 04 18:13:47.426756 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1420/2890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:47 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:47.433657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c36e3db-9ab9-4928-9f39-1e835ea36747 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:47.434612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0c36e3db-9ab9-4928-9f39-1e835ea36747 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:47.446553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c36e3db-9ab9-4928-9f39-1e835ea36747 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.448268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c36e3db-9ab9-4928-9f39-1e835ea36747 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.449265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c36e3db-9ab9-4928-9f39-1e835ea36747 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.450172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c36e3db-9ab9-4928-9f39-1e835ea36747 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.451010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c36e3db-9ab9-4928-9f39-1e835ea36747 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.452789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c36e3db-9ab9-4928-9f39-1e835ea36747 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.561024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0c36e3db-9ab9-4928-9f39-1e835ea36747 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.580457 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0c36e3db-9ab9-4928-9f39-1e835ea36747 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1283 microversion: 2.1 time: 0.151977 Oct 04 18:13:47.581428 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1421/2891] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:47 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:47.586730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:47.587385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:47.594339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.595751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.596864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.598161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.598893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.599505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.329334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.340205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.342022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.343903 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-86cbbc30-c5e1-436b-a884-f59beee8c5c2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.761227 Oct 04 18:13:48.344548 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1422/2892] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:47 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:48.349868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4c8aadf-d1e0-4d0c-a82c-ef6204e4928e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1913055646"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:48.350742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e4c8aadf-d1e0-4d0c-a82c-ef6204e4928e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:48.359629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4c8aadf-d1e0-4d0c-a82c-ef6204e4928e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.360462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4c8aadf-d1e0-4d0c-a82c-ef6204e4928e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.361121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4c8aadf-d1e0-4d0c-a82c-ef6204e4928e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.362127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4c8aadf-d1e0-4d0c-a82c-ef6204e4928e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.362830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4c8aadf-d1e0-4d0c-a82c-ef6204e4928e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.363476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4c8aadf-d1e0-4d0c-a82c-ef6204e4928e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.562599 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1112f94-23ff-4409-a44a-d8c41ee32aca tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "POST /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140/action" status: 202 len: 0 microversion: 2.1 time: 1.537591 Oct 04 18:13:48.564037 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1471/2893] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:47 2022] POST /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140/action => generated 0 bytes in 1540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:48.580722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ca2039d-b55c-46b7-8cdd-e4280cbe847a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:48.581903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ca2039d-b55c-46b7-8cdd-e4280cbe847a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:48.591275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca2039d-b55c-46b7-8cdd-e4280cbe847a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.593127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca2039d-b55c-46b7-8cdd-e4280cbe847a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.593755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca2039d-b55c-46b7-8cdd-e4280cbe847a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.595529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca2039d-b55c-46b7-8cdd-e4280cbe847a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.596182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca2039d-b55c-46b7-8cdd-e4280cbe847a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.596783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca2039d-b55c-46b7-8cdd-e4280cbe847a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.720763 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.network.security_group_api [None req-e4c8aadf-d1e0-4d0c-a82c-ef6204e4928e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Adding security group dacdbdf7-ccfe-4d41-bea5-e1eaf9d49b6b to port 72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c Oct 04 18:13:49.163420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ca2039d-b55c-46b7-8cdd-e4280cbe847a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:49.175958 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ca2039d-b55c-46b7-8cdd-e4280cbe847a tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1315 microversion: 2.1 time: 0.601013 Oct 04 18:13:49.176631 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1472/2894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:48 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:49.189217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:49.189855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:49.211045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.211769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.212004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.212723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.213189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.213621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.640546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:49.650710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:49.653245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:49.669142 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-81629fa7-9d03-4fb8-82b7-36f87b24e9fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1280 microversion: 2.25 time: 0.490537 Oct 04 18:13:49.671283 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1473/2895] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:49 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1280 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:49.676606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-278b90ee-51a0-4f26-acbe-ea33f3c3bd53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:49.677794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-278b90ee-51a0-4f26-acbe-ea33f3c3bd53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:49.685137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278b90ee-51a0-4f26-acbe-ea33f3c3bd53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.686704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278b90ee-51a0-4f26-acbe-ea33f3c3bd53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.687419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278b90ee-51a0-4f26-acbe-ea33f3c3bd53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.688665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278b90ee-51a0-4f26-acbe-ea33f3c3bd53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.689697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278b90ee-51a0-4f26-acbe-ea33f3c3bd53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.690364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278b90ee-51a0-4f26-acbe-ea33f3c3bd53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.831695 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e4c8aadf-d1e0-4d0c-a82c-ef6204e4928e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6/action" status: 202 len: 0 microversion: 2.1 time: 1.483727 Oct 04 18:13:49.840534 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1423/2896] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:48 2022] POST /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6/action => generated 0 bytes in 1495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:49.855865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5a401f49-9815-4a5b-ba6d-4638a3cbffa5 req-cdf234c9-ee9b-4466-958a-b1b61e982fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d683c0-cb6a-46db-a6a3-d956d333aeb6", "tag": "72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:49.899504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5a401f49-9815-4a5b-ba6d-4638a3cbffa5 req-cdf234c9-ee9b-4466-958a-b1b61e982fd6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.900772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5a401f49-9815-4a5b-ba6d-4638a3cbffa5 req-cdf234c9-ee9b-4466-958a-b1b61e982fd6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.906105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5a401f49-9815-4a5b-ba6d-4638a3cbffa5 req-cdf234c9-ee9b-4466-958a-b1b61e982fd6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.951572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:49.957711 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5a401f49-9815-4a5b-ba6d-4638a3cbffa5 req-cdf234c9-ee9b-4466-958a-b1b61e982fd6 service nova] Creating event network-changed:72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c for instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 on n-h2-850499-14 Oct 04 18:13:49.968776 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5a401f49-9815-4a5b-ba6d-4638a3cbffa5 req-cdf234c9-ee9b-4466-958a-b1b61e982fd6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123477 Oct 04 18:13:49.969952 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1424/2897] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:49.975713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-24253217-4c05-4c15-83be-1a3c4cd72936 req-e69b8c27-a3cc-4112-bbb5-a066018d4398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-plugged", "status": "completed", "tag": "45b63755-90e1-40b1-b12e-372ba302bb3c"}, {"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-plugged", "status": "completed", "tag": "3a292832-0947-4c83-ad7e-41e6a929165c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:49.992749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24253217-4c05-4c15-83be-1a3c4cd72936 req-e69b8c27-a3cc-4112-bbb5-a066018d4398 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.993683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24253217-4c05-4c15-83be-1a3c4cd72936 req-e69b8c27-a3cc-4112-bbb5-a066018d4398 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.995147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24253217-4c05-4c15-83be-1a3c4cd72936 req-e69b8c27-a3cc-4112-bbb5-a066018d4398 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.033730 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-24253217-4c05-4c15-83be-1a3c4cd72936 req-e69b8c27-a3cc-4112-bbb5-a066018d4398 service nova] Creating event network-vif-plugged:45b63755-90e1-40b1-b12e-372ba302bb3c for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:13:50.035243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-24253217-4c05-4c15-83be-1a3c4cd72936 req-e69b8c27-a3cc-4112-bbb5-a066018d4398 service nova] Creating event network-vif-plugged:3a292832-0947-4c83-ad7e-41e6a929165c for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:13:50.043954 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-24253217-4c05-4c15-83be-1a3c4cd72936 req-e69b8c27-a3cc-4112-bbb5-a066018d4398 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072399 Oct 04 18:13:50.048659 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1425/2898] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:50.056330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.057972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] [instance: c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.067256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.068603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.069228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.070223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.071025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.071851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.100721 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] HTTP exception thrown: Instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a could not be found. Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Request method failure captured: Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a HTTP/1.1 Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHcKYsG9HQPNzJ7sEol8ReflDLOeRvaTVuFKWokFiyqzITLblycjGqJ-zKGJuyQuJam4_Nh1NUfnLc6evjxQhw7mKDM7J7Wkq1mToK8CazKg2XzbzctZM9-4TyP0Fwrt9oRrGGfSwedJVv-r_iPr3s_5Ufm9w2WhBVkqInBxRWjblno Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: b1b14394d8ea452eb046b7ce147a4ec7 Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersAdminTestJSON-1413840815 Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:13:50.104118 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1b14394d8ea452eb046b7ce147a4ec7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1b14394d8ea452eb046b7ce147a4ec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1b14394d8ea452eb046b7ce147a4ec7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1b14394d8ea452eb046b7ce147a4ec7"}]}] Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersAdminTestJSON-1413840815 Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: b1b14394d8ea452eb046b7ce147a4ec7 Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersAdminTestJSON-1413840815 Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersAdminTestJSON-1413840815-project Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0b824cdb1fd346729b59aece4c49a927 Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersAdminTestJSON-1413840815-project Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a could not be found. Oct 04 18:13:50.106053 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a'} Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a could not be found. Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:50.107074 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a could not be found. Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a could not be found. Oct 04 18:13:50.108659 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:13:50.111666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] Returning 404 to user: Instance c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:50.113513 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3d05b879-f44a-4e1d-ad99-cb392a0960b7 tempest-ServersAdminTestJSON-1413840815 tempest-ServersAdminTestJSON-1413840815-project] 10.222.0.18 "GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a" status: 404 len: 111 microversion: 2.1 time: 0.063279 Oct 04 18:13:50.117956 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1426/2899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:50 2022] GET /compute/v2.1/servers/c9cdc2a4-3afe-41c7-b96d-d02fa3d35a8a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:50.139224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-89fe4b9f-06b3-4950-9cc6-ba7f799ce393 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1287719872"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:50.140114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-89fe4b9f-06b3-4950-9cc6-ba7f799ce393 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.150695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89fe4b9f-06b3-4950-9cc6-ba7f799ce393 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.152027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89fe4b9f-06b3-4950-9cc6-ba7f799ce393 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.153384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89fe4b9f-06b3-4950-9cc6-ba7f799ce393 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.155576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89fe4b9f-06b3-4950-9cc6-ba7f799ce393 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.156489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89fe4b9f-06b3-4950-9cc6-ba7f799ce393 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.157187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89fe4b9f-06b3-4950-9cc6-ba7f799ce393 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.179501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-278b90ee-51a0-4f26-acbe-ea33f3c3bd53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.193987 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-278b90ee-51a0-4f26-acbe-ea33f3c3bd53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1318 microversion: 2.1 time: 0.521250 Oct 04 18:13:50.203765 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1474/2900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:49 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:50.211748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a4167072-8f5a-40e9-88e8-ea97d0123135 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.212548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a4167072-8f5a-40e9-88e8-ea97d0123135 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.224962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4167072-8f5a-40e9-88e8-ea97d0123135 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.225477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4167072-8f5a-40e9-88e8-ea97d0123135 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.227695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4167072-8f5a-40e9-88e8-ea97d0123135 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.228505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4167072-8f5a-40e9-88e8-ea97d0123135 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.230150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4167072-8f5a-40e9-88e8-ea97d0123135 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.230603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4167072-8f5a-40e9-88e8-ea97d0123135 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.614890 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.network.security_group_api [None req-89fe4b9f-06b3-4950-9cc6-ba7f799ce393 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Removing security group ad9c063b-8ae0-4c81-ab53-40fc8746f234 from port 0657bd03-e275-4cc6-8a1c-2040ba2533e3 Oct 04 18:13:50.752726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a4167072-8f5a-40e9-88e8-ea97d0123135 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.765005 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a4167072-8f5a-40e9-88e8-ea97d0123135 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1325 microversion: 2.1 time: 0.566732 Oct 04 18:13:50.769161 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1475/2901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:50 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1325 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:50.780494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.782305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.792391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.793447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.794089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.797544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.799533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.801209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.366692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.387804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.396168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.399932 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-389b65c4-adf0-4596-a139-603876255470 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.626086 Oct 04 18:13:51.401544 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1476/2902] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:50 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:51.410342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a69bf21-5716-4f86-b5f9-03ad492f1627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:51.410848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1a69bf21-5716-4f86-b5f9-03ad492f1627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:51.442048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a69bf21-5716-4f86-b5f9-03ad492f1627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.443101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a69bf21-5716-4f86-b5f9-03ad492f1627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.443916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a69bf21-5716-4f86-b5f9-03ad492f1627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.445656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a69bf21-5716-4f86-b5f9-03ad492f1627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.446380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a69bf21-5716-4f86-b5f9-03ad492f1627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.447353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a69bf21-5716-4f86-b5f9-03ad492f1627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.598621 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-89fe4b9f-06b3-4950-9cc6-ba7f799ce393 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "POST /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140/action" status: 202 len: 0 microversion: 2.1 time: 1.464312 Oct 04 18:13:51.601060 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1427/2903] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:50 2022] POST /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140/action => generated 0 bytes in 1468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:51.608813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f05441df-4eab-440c-b567-37a522216fe2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:51.609602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f05441df-4eab-440c-b567-37a522216fe2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:51.627253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:51.632230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05441df-4eab-440c-b567-37a522216fe2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.633506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05441df-4eab-440c-b567-37a522216fe2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.634348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05441df-4eab-440c-b567-37a522216fe2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.636259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05441df-4eab-440c-b567-37a522216fe2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.639798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05441df-4eab-440c-b567-37a522216fe2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.640568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05441df-4eab-440c-b567-37a522216fe2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.976012 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1a69bf21-5716-4f86-b5f9-03ad492f1627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.572945 Oct 04 18:13:51.977154 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1477/2904] 10.222.0.18 () {58 vars in 1293 bytes} [Tue Oct 4 18:13:51 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6/os-security-groups => generated 1158 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:51.985087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:51.986908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:51.991786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:52.005233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.005770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.006209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.007265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.008348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.008733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.061541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f05441df-4eab-440c-b567-37a522216fe2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:52.075724 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f05441df-4eab-440c-b567-37a522216fe2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1315 microversion: 2.1 time: 0.472764 Oct 04 18:13:52.097236 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1428/2905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:51 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:52.105666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1be295f6-977b-4e81-aae9-23ad4bce802a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:52.108345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1be295f6-977b-4e81-aae9-23ad4bce802a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:52.117477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be295f6-977b-4e81-aae9-23ad4bce802a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.118387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be295f6-977b-4e81-aae9-23ad4bce802a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.119038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be295f6-977b-4e81-aae9-23ad4bce802a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.122444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be295f6-977b-4e81-aae9-23ad4bce802a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.123219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be295f6-977b-4e81-aae9-23ad4bce802a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.124482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be295f6-977b-4e81-aae9-23ad4bce802a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.494303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1be295f6-977b-4e81-aae9-23ad4bce802a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:52.506318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:52.520773 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1be295f6-977b-4e81-aae9-23ad4bce802a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1318 microversion: 2.1 time: 0.421740 Oct 04 18:13:52.535732 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1429/2906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:52 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:52.539105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:52.551065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:52.555631 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-efd79675-c41b-4f11-8821-816e66720917 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1280 microversion: 2.25 time: 0.576344 Oct 04 18:13:52.558057 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1478/2907] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:51 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1280 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:52.559321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d27cddb2-fa39-4249-be3e-501ca529a38f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Action: 'create', calling method: .version_select at 0x7fd4d238eaf0>, body: {"pool": null} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:52.564676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5c9c9ba6-8f69-4dfa-ae26-b550b6f9636b req-dca3fb90-b48d-41fa-9884-1f2ca16665ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da89d46d-4ae1-466f-9889-e1d528e843e5", "tag": "4705f29d-c67d-4649-af0a-38b1ead030b6"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:52.579195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5c9c9ba6-8f69-4dfa-ae26-b550b6f9636b req-dca3fb90-b48d-41fa-9884-1f2ca16665ca service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.580211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5c9c9ba6-8f69-4dfa-ae26-b550b6f9636b req-dca3fb90-b48d-41fa-9884-1f2ca16665ca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.581029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5c9c9ba6-8f69-4dfa-ae26-b550b6f9636b req-dca3fb90-b48d-41fa-9884-1f2ca16665ca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.599995 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5c9c9ba6-8f69-4dfa-ae26-b550b6f9636b req-dca3fb90-b48d-41fa-9884-1f2ca16665ca service nova] Creating event network-changed:4705f29d-c67d-4649-af0a-38b1ead030b6 for instance da89d46d-4ae1-466f-9889-e1d528e843e5 on n-h2-850499-14 Oct 04 18:13:52.609634 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5c9c9ba6-8f69-4dfa-ae26-b550b6f9636b req-dca3fb90-b48d-41fa-9884-1f2ca16665ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049033 Oct 04 18:13:52.612121 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1479/2908] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:52.620123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4866dac5-0fa3-4b5d-9d49-1578db63925d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:52.621098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4866dac5-0fa3-4b5d-9d49-1578db63925d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:52.630764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4866dac5-0fa3-4b5d-9d49-1578db63925d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.631294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4866dac5-0fa3-4b5d-9d49-1578db63925d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.632083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4866dac5-0fa3-4b5d-9d49-1578db63925d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.633042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4866dac5-0fa3-4b5d-9d49-1578db63925d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.633508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4866dac5-0fa3-4b5d-9d49-1578db63925d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.634000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4866dac5-0fa3-4b5d-9d49-1578db63925d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.226106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4866dac5-0fa3-4b5d-9d49-1578db63925d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:53.234733 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4866dac5-0fa3-4b5d-9d49-1578db63925d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1325 microversion: 2.1 time: 0.620917 Oct 04 18:13:53.248052 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1480/2909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:52 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1325 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:53.248052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e6201e91-6251-4222-b568-c3776f3115fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: .version_select at 0x7fd4d12efdc0>, body: {"security_group": {"name": " tempest-securitygroup -1341159913 ", "description": "tempest-description-2122454243"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:53.585164 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e6201e91-6251-4222-b568-c3776f3115fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.348655 Oct 04 18:13:53.586324 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1481/2910] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:13:53 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:53.591394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1fe0ac3c-e45f-4640-a519-3567f946bcc8 req-07bf084a-2f80-404a-94d2-8cc582c231ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8dcc660-4ee0-4c03-994c-bd8c00eea140", "tag": "0657bd03-e275-4cc6-8a1c-2040ba2533e3"}, {"name": "network-changed", "server_uuid": "52d683c0-cb6a-46db-a6a3-d956d333aeb6", "tag": "72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c"}, {"name": "network-changed", "server_uuid": "8473402c-8305-4b12-80a3-a58369427df7", "tag": "7b4de8e5-02fc-4739-8a0c-a94e47cb8c83"}, {"name": "network-changed", "server_uuid": "b8dcc660-4ee0-4c03-994c-bd8c00eea140", "tag": "0657bd03-e275-4cc6-8a1c-2040ba2533e3"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:53.604982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1fe0ac3c-e45f-4640-a519-3567f946bcc8 req-07bf084a-2f80-404a-94d2-8cc582c231ee service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.605530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1fe0ac3c-e45f-4640-a519-3567f946bcc8 req-07bf084a-2f80-404a-94d2-8cc582c231ee service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.605975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1fe0ac3c-e45f-4640-a519-3567f946bcc8 req-07bf084a-2f80-404a-94d2-8cc582c231ee service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.620696 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1fe0ac3c-e45f-4640-a519-3567f946bcc8 req-07bf084a-2f80-404a-94d2-8cc582c231ee service nova] Creating event network-changed:0657bd03-e275-4cc6-8a1c-2040ba2533e3 for instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 on n-h2-850499-14 Oct 04 18:13:53.621209 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1fe0ac3c-e45f-4640-a519-3567f946bcc8 req-07bf084a-2f80-404a-94d2-8cc582c231ee service nova] Creating event network-changed:72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c for instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 on n-h2-850499-14 Oct 04 18:13:53.621715 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1fe0ac3c-e45f-4640-a519-3567f946bcc8 req-07bf084a-2f80-404a-94d2-8cc582c231ee service nova] Creating event network-changed:7b4de8e5-02fc-4739-8a0c-a94e47cb8c83 for instance 8473402c-8305-4b12-80a3-a58369427df7 on n-h2-850499-14 Oct 04 18:13:53.622212 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1fe0ac3c-e45f-4640-a519-3567f946bcc8 req-07bf084a-2f80-404a-94d2-8cc582c231ee service nova] Creating event network-changed:0657bd03-e275-4cc6-8a1c-2040ba2533e3 for instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 on n-h2-850499-14 Oct 04 18:13:53.636008 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1fe0ac3c-e45f-4640-a519-3567f946bcc8 req-07bf084a-2f80-404a-94d2-8cc582c231ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.048262 Oct 04 18:13:53.636837 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1482/2911] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:53.642844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-42cefc1c-5825-4d9e-8fe7-413d636a9446 req-c98f17eb-c0d4-4a80-87d6-be0d236e460b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-plugged", "status": "completed", "tag": "0363d8a0-489b-4b4b-bfe2-73f68c149109"}, {"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-plugged", "status": "completed", "tag": "9f2aeed6-f4dd-4127-b639-9ee9eb77b3f7"}, {"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-plugged", "status": "completed", "tag": "eef312c0-5fd8-44b6-960d-307ccd82a1df"}, {"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-plugged", "status": "completed", "tag": "37070eae-6e3f-46e7-9485-0df9262ac25b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:53.653623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-42cefc1c-5825-4d9e-8fe7-413d636a9446 req-c98f17eb-c0d4-4a80-87d6-be0d236e460b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.653986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-42cefc1c-5825-4d9e-8fe7-413d636a9446 req-c98f17eb-c0d4-4a80-87d6-be0d236e460b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.654425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-42cefc1c-5825-4d9e-8fe7-413d636a9446 req-c98f17eb-c0d4-4a80-87d6-be0d236e460b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.667005 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-42cefc1c-5825-4d9e-8fe7-413d636a9446 req-c98f17eb-c0d4-4a80-87d6-be0d236e460b service nova] Creating event network-vif-plugged:0363d8a0-489b-4b4b-bfe2-73f68c149109 for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:13:53.667512 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-42cefc1c-5825-4d9e-8fe7-413d636a9446 req-c98f17eb-c0d4-4a80-87d6-be0d236e460b service nova] Creating event network-vif-plugged:9f2aeed6-f4dd-4127-b639-9ee9eb77b3f7 for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:13:53.668014 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-42cefc1c-5825-4d9e-8fe7-413d636a9446 req-c98f17eb-c0d4-4a80-87d6-be0d236e460b service nova] Creating event network-vif-plugged:eef312c0-5fd8-44b6-960d-307ccd82a1df for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:13:53.668511 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-42cefc1c-5825-4d9e-8fe7-413d636a9446 req-c98f17eb-c0d4-4a80-87d6-be0d236e460b service nova] Creating event network-vif-plugged:37070eae-6e3f-46e7-9485-0df9262ac25b for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:13:53.674647 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-42cefc1c-5825-4d9e-8fe7-413d636a9446 req-c98f17eb-c0d4-4a80-87d6-be0d236e460b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.036429 Oct 04 18:13:53.675577 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1483/2912] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:53.680817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:53.681714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:53.687878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.688339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.688784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.689495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.690088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.690372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.993754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.004174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.005728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.006925 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-556ef405-b6a0-4d6b-8ed3-899a27bbe10b tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.330372 Oct 04 18:13:54.007507 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1484/2913] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:53 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:54.012877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-24198209-a121-4f0d-b20c-e081d1419a85 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.014009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-24198209-a121-4f0d-b20c-e081d1419a85 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.020167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24198209-a121-4f0d-b20c-e081d1419a85 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.020905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24198209-a121-4f0d-b20c-e081d1419a85 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.021528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24198209-a121-4f0d-b20c-e081d1419a85 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.022406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24198209-a121-4f0d-b20c-e081d1419a85 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.023059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24198209-a121-4f0d-b20c-e081d1419a85 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.023648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24198209-a121-4f0d-b20c-e081d1419a85 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.033097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:54.062184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=5 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:54.248724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-24198209-a121-4f0d-b20c-e081d1419a85 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.258966 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-24198209-a121-4f0d-b20c-e081d1419a85 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1315 microversion: 2.1 time: 0.249799 Oct 04 18:13:54.259814 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1485/2914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:54.271233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-525ee33d-264a-446e-b20a-eb7cf32f0001 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.271856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-525ee33d-264a-446e-b20a-eb7cf32f0001 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.278631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525ee33d-264a-446e-b20a-eb7cf32f0001 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.279173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525ee33d-264a-446e-b20a-eb7cf32f0001 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.279620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525ee33d-264a-446e-b20a-eb7cf32f0001 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.280356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525ee33d-264a-446e-b20a-eb7cf32f0001 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.281050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525ee33d-264a-446e-b20a-eb7cf32f0001 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.281489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525ee33d-264a-446e-b20a-eb7cf32f0001 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.285809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:54.527201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-525ee33d-264a-446e-b20a-eb7cf32f0001 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.535908 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-525ee33d-264a-446e-b20a-eb7cf32f0001 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1318 microversion: 2.1 time: 0.274885 Oct 04 18:13:54.536569 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1486/2915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:54.541045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.541767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.548101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.548853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.549399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.550199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.550762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.551335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.579652 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d27cddb2-fa39-4249-be3e-501ca529a38f tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.042521 Oct 04 18:13:54.580368 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1430/2916] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:13:52 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:54.584808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-92b8da72-407f-4355-8add-d46636c65209 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d18b88b0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.680468 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-92b8da72-407f-4355-8add-d46636c65209 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/c6a0ffe3-559d-44fd-838f-347ab785438d" status: 200 len: 224 microversion: 2.1 time: 0.098970 Oct 04 18:13:54.681058 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1431/2917] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/os-security-groups/c6a0ffe3-559d-44fd-838f-347ab785438d => generated 224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:54.732088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.741678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.743287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.744298 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-30adf2ec-9b06-492c-841c-be8c70e6f987 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1280 microversion: 2.25 time: 0.206809 Oct 04 18:13:54.744994 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1487/2918] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1280 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:54.749637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00a27b13-08a7-43f2-81ff-471587c91f04 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.750257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00a27b13-08a7-43f2-81ff-471587c91f04 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.756141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a27b13-08a7-43f2-81ff-471587c91f04 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.756817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a27b13-08a7-43f2-81ff-471587c91f04 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.757473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a27b13-08a7-43f2-81ff-471587c91f04 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.758337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a27b13-08a7-43f2-81ff-471587c91f04 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.759006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a27b13-08a7-43f2-81ff-471587c91f04 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.759598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a27b13-08a7-43f2-81ff-471587c91f04 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.811930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f2fb3af-98e9-465b-90c5-fddb25c66988 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Action: 'create', calling method: .version_select at 0x7fd4d13255e0>, body: {"keypair": {"name": "tempest-keypair-654544332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiGlCE65tq7PBhiXooR4Ha4AjBFrbXkQG4Gt0zPv8JlTo2f/ykHa5iOqJiHIykF4iKTcXG6IHVMdPgsPf0mVAZF/Nb2zJTskad8xAEpwWLWZ0MxA8cqlajrnX1ltZcU3g=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:54.829564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6f2fb3af-98e9-465b-90c5-fddb25c66988 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:54.834061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6f2fb3af-98e9-465b-90c5-fddb25c66988 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for user 711b1f472d0b4677b52c0b487e16c68b and project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:54.859302 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f2fb3af-98e9-465b-90c5-fddb25c66988 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.174172 Oct 04 18:13:54.866069 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1432/2919] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 4 18:13:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:13:54.870247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.9"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:54.872941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.879515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.880002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.880434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.881133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.881587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.882011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.894075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00a27b13-08a7-43f2-81ff-471587c91f04 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.903413 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00a27b13-08a7-43f2-81ff-471587c91f04 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1325 microversion: 2.1 time: 0.157364 Oct 04 18:13:54.903991 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1488/2920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1325 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:54.909496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "refresh_cache-b8dcc660-4ee0-4c03-994c-bd8c00eea140" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:13:54.909900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquired lock "refresh_cache-b8dcc660-4ee0-4c03-994c-bd8c00eea140" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:13:54.919110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-48fec344-d5d6-4752-8734-9bbf15be29a8 req-6c77f89b-16c7-4af3-8d2b-eeb16456a4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8053e0e-c889-4fd9-93a4-34aca7ff2948", "tag": "1bc16d83-9b0d-4671-a5c4-86ffb6abc091"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:54.933240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-48fec344-d5d6-4752-8734-9bbf15be29a8 req-6c77f89b-16c7-4af3-8d2b-eeb16456a4c8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.934110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-48fec344-d5d6-4752-8734-9bbf15be29a8 req-6c77f89b-16c7-4af3-8d2b-eeb16456a4c8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.934782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-48fec344-d5d6-4752-8734-9bbf15be29a8 req-6c77f89b-16c7-4af3-8d2b-eeb16456a4c8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.947648 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-48fec344-d5d6-4752-8734-9bbf15be29a8 req-6c77f89b-16c7-4af3-8d2b-eeb16456a4c8 service nova] Creating event network-changed:1bc16d83-9b0d-4671-a5c4-86ffb6abc091 for instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 on n-h1-850499-14 Oct 04 18:13:54.954387 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-48fec344-d5d6-4752-8734-9bbf15be29a8 req-6c77f89b-16c7-4af3-8d2b-eeb16456a4c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049219 Oct 04 18:13:54.955295 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1489/2921] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:54.961246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9f4a83a3-ffc0-4dd3-8628-a4784061720b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d12f1550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:55.439357 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9f4a83a3-ffc0-4dd3-8628-a4784061720b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c6a0ffe3-559d-44fd-838f-347ab785438d" status: 202 len: 0 microversion: 2.1 time: 0.482845 Oct 04 18:13:55.443138 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1490/2922] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:13:54 2022] DELETE /compute/v2.1/os-security-groups/c6a0ffe3-559d-44fd-838f-347ab785438d => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:55.445237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2303f3ec-564e-4fce-8b83-acc5dbcc5235 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d13b23a0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:55.454524 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2303f3ec-564e-4fce-8b83-acc5dbcc5235 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-654544332" status: 200 len: 512 microversion: 2.2 time: 0.012833 Oct 04 18:13:55.455085 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1491/2923] 10.222.0.18 () {60 vars in 1255 bytes} [Tue Oct 4 18:13:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-654544332 => generated 512 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:55.460006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:55.460747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:55.470087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:55.470593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:55.471137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:55.471769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:55.472235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:55.472676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:55.782761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:55.795423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:55.796917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:55.798091 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e4419449-9ba0-4181-bc27-eeb5c77d7713 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1879 microversion: 2.32 time: 0.342064 Oct 04 18:13:55.798837 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1492/2924] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:55 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1879 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:55.805024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac372edc-eb72-4df9-8d40-cd29ec7230e6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:55.805687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac372edc-eb72-4df9-8d40-cd29ec7230e6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:55.812616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac372edc-eb72-4df9-8d40-cd29ec7230e6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:55.813701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac372edc-eb72-4df9-8d40-cd29ec7230e6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:55.814509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac372edc-eb72-4df9-8d40-cd29ec7230e6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:55.826294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac372edc-eb72-4df9-8d40-cd29ec7230e6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:55.827324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac372edc-eb72-4df9-8d40-cd29ec7230e6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:55.827805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac372edc-eb72-4df9-8d40-cd29ec7230e6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.106242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:56.110708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ac372edc-eb72-4df9-8d40-cd29ec7230e6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.119694 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac372edc-eb72-4df9-8d40-cd29ec7230e6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1315 microversion: 2.1 time: 0.319183 Oct 04 18:13:56.120290 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1493/2925] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:55 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:56.125359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49b91282-f7a3-4979-8620-76e0e2ca8414 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d1333430>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:56.130659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=12 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:56.167296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-49b91282-f7a3-4979-8620-76e0e2ca8414 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:13:56.178762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.security_group_api [None req-49b91282-f7a3-4979-8620-76e0e2ca8414 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Neutron security group c6a0ffe3-559d-44fd-838f-347ab785438d not found {{(pid=122332) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:13:56.179489 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-49b91282-f7a3-4979-8620-76e0e2ca8414 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:13:56.179489 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-759e6a02-7c2e-41ba-8d75-bae45ac64d3f'] Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49b91282-f7a3-4979-8620-76e0e2ca8414 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-security-groups/c6a0ffe3-559d-44fd-838f-347ab785438d HTTP/1.1 Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:13:56.181327 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: exception: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-759e6a02-7c2e-41ba-8d75-bae45ac64d3f'] Oct 04 18:13:56.182803 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'c6a0ffe3-559d-44fd-838f-347ab785438d'} Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:13:56.183643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-759e6a02-7c2e-41ba-8d75-bae45ac64d3f'] Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:13:56.184761 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-759e6a02-7c2e-41ba-8d75-bae45ac64d3f'] Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-759e6a02-7c2e-41ba-8d75-bae45ac64d3f'] Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:56.185810 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:56.187559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:56.187559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:56.187559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:56.187559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:56.187559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:13:56.187559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-759e6a02-7c2e-41ba-8d75-bae45ac64d3f'] Oct 04 18:13:56.187559 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:13:56.189069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49b91282-f7a3-4979-8620-76e0e2ca8414 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:13:56.189069 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-759e6a02-7c2e-41ba-8d75-bae45ac64d3f'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:56.190176 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49b91282-f7a3-4979-8620-76e0e2ca8414 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/c6a0ffe3-559d-44fd-838f-347ab785438d" status: 404 len: 194 microversion: 2.1 time: 0.068935 Oct 04 18:13:56.192129 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1494/2926] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:13:56 2022] GET /compute/v2.1/os-security-groups/c6a0ffe3-559d-44fd-838f-347ab785438d => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:56.197060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f6d26cac-f758-4186-873e-b4cd6ac79b21 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d12c7ee0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:56.222218 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f6d26cac-f758-4186-873e-b4cd6ac79b21 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654544332" status: 204 len: 0 microversion: 2.2 time: 0.028843 Oct 04 18:13:56.222822 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1495/2927] 10.222.0.18 () {60 vars in 1258 bytes} [Tue Oct 4 18:13:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654544332 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:56.227614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a6269e95-66de-42a3-9aa0-1f86f1d203bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:56.228478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a6269e95-66de-42a3-9aa0-1f86f1d203bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:56.237506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6269e95-66de-42a3-9aa0-1f86f1d203bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.238072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6269e95-66de-42a3-9aa0-1f86f1d203bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.239140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6269e95-66de-42a3-9aa0-1f86f1d203bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.239852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6269e95-66de-42a3-9aa0-1f86f1d203bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.240323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6269e95-66de-42a3-9aa0-1f86f1d203bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.240759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6269e95-66de-42a3-9aa0-1f86f1d203bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.452661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a6269e95-66de-42a3-9aa0-1f86f1d203bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.463745 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a6269e95-66de-42a3-9aa0-1f86f1d203bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1318 microversion: 2.1 time: 0.239704 Oct 04 18:13:56.464516 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1496/2928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:56 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:56.470198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-3f1c4d03-dbe7-468e-b94a-5fec9311d51f req-395cddb6-c5c3-4de2-81ce-36b4651eb9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40", "name": "network-vif-plugged", "status": "completed", "tag": "41d51df9-d9f3-4fb7-ade7-3b2c4ff0fdc4"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:56.480209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3f1c4d03-dbe7-468e-b94a-5fec9311d51f req-395cddb6-c5c3-4de2-81ce-36b4651eb9e6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.480688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3f1c4d03-dbe7-468e-b94a-5fec9311d51f req-395cddb6-c5c3-4de2-81ce-36b4651eb9e6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.481123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3f1c4d03-dbe7-468e-b94a-5fec9311d51f req-395cddb6-c5c3-4de2-81ce-36b4651eb9e6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.493624 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-3f1c4d03-dbe7-468e-b94a-5fec9311d51f req-395cddb6-c5c3-4de2-81ce-36b4651eb9e6 service nova] Creating event network-vif-plugged:41d51df9-d9f3-4fb7-ade7-3b2c4ff0fdc4 for instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 on n-h1-850499-14 Oct 04 18:13:56.498677 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-3f1c4d03-dbe7-468e-b94a-5fec9311d51f req-395cddb6-c5c3-4de2-81ce-36b4651eb9e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033029 Oct 04 18:13:56.499619 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1497/2929] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:56.504684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:56.505612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:56.539710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.552130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.553243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.553729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.554763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.555232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.577923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Building network info cache for instance {{(pid=122331) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:13:56.876116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.885084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.887035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.888196 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b53f2d0b-734a-4940-a612-531861702907 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1280 microversion: 2.25 time: 0.387669 Oct 04 18:13:56.888761 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1498/2930] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:56 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1280 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:56.893521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-087d3286-c34b-4a30-abf2-b64799f496be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:56.894131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-087d3286-c34b-4a30-abf2-b64799f496be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:56.900053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-087d3286-c34b-4a30-abf2-b64799f496be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.900727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-087d3286-c34b-4a30-abf2-b64799f496be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.901406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-087d3286-c34b-4a30-abf2-b64799f496be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.902106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-087d3286-c34b-4a30-abf2-b64799f496be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.902765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-087d3286-c34b-4a30-abf2-b64799f496be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.903403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-087d3286-c34b-4a30-abf2-b64799f496be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.100324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-087d3286-c34b-4a30-abf2-b64799f496be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:57.108978 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-087d3286-c34b-4a30-abf2-b64799f496be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1325 microversion: 2.1 time: 0.218366 Oct 04 18:13:57.109807 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1499/2931] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:56 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1325 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:57.123054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00a24ca0-723c-4198-882c-3a3dda70ba7c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: .version_select at 0x7fd4d1333160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-695055457", "description": "tempest-description-739550915"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:57.435051 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00a24ca0-723c-4198-882c-3a3dda70ba7c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.323889 Oct 04 18:13:57.436966 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1500/2932] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:13:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:57.445531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dff773a7-0178-44d2-b726-768f3cca7948 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Action: 'create', calling method: .version_select at 0x7fd4d12c7160>, body: {"keypair": {"name": "tempest-keypair-1057522232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIx5sxrS+D4Wu5MnicGZSOotHpQx0NmLgQi6wPt6V7TQaLTp3vUKG6uUAH95PbQazkfKapqxsMfcvdsBqRxHJf0acenAjXEOHRHv2MX0WumjG8SN8R6WurNCpBiDrSbgQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:57.449505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Updating instance_info_cache with network_info: [{"id": "0657bd03-e275-4cc6-8a1c-2040ba2533e3", "address": "fa:16:3e:24:fe:28", "network": {"id": "69b13a93-21c6-4fd2-9113-725fac9d7bbf", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1099716879-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "81f7c69bc5f14725b40bcc5cccece335", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0657bd03-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122331) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:13:57.470978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Releasing lock "refresh_cache-b8dcc660-4ee0-4c03-994c-bd8c00eea140" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:13:57.472068 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3936f74e-e5d6-43ca-b58a-cf0b300cec79 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "POST /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140/action" status: 202 len: 0 microversion: 2.1 time: 2.609731 Oct 04 18:13:57.472705 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1433/2933] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:54 2022] POST /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140/action => generated 0 bytes in 2612 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:13:57.477185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e4cc1c62-294e-4611-b3dc-9476f7b251a0 req-351492ba-fd70-4afb-847c-99b91761617d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8dcc660-4ee0-4c03-994c-bd8c00eea140", "tag": "0657bd03-e275-4cc6-8a1c-2040ba2533e3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:57.488351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-dff773a7-0178-44d2-b726-768f3cca7948 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:57.493999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e4cc1c62-294e-4611-b3dc-9476f7b251a0 req-351492ba-fd70-4afb-847c-99b91761617d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.494674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-dff773a7-0178-44d2-b726-768f3cca7948 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for user 711b1f472d0b4677b52c0b487e16c68b and project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:57.494815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e4cc1c62-294e-4611-b3dc-9476f7b251a0 req-351492ba-fd70-4afb-847c-99b91761617d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.495202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e4cc1c62-294e-4611-b3dc-9476f7b251a0 req-351492ba-fd70-4afb-847c-99b91761617d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.508377 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e4cc1c62-294e-4611-b3dc-9476f7b251a0 req-351492ba-fd70-4afb-847c-99b91761617d service nova] Creating event network-changed:0657bd03-e275-4cc6-8a1c-2040ba2533e3 for instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 on n-h2-850499-14 Oct 04 18:13:57.513581 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e4cc1c62-294e-4611-b3dc-9476f7b251a0 req-351492ba-fd70-4afb-847c-99b91761617d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039662 Oct 04 18:13:57.514214 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1434/2934] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:57.519814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:57.520586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:57.521998 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dff773a7-0178-44d2-b726-768f3cca7948 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.083643 Oct 04 18:13:57.527166 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1501/2935] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 4 18:13:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:13:57.527345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.527697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.528139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.529246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.530687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.531533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.532645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e362dc4-6796-4d98-babb-cd73e2145f71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:57.533436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e362dc4-6796-4d98-babb-cd73e2145f71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:57.540740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e362dc4-6796-4d98-babb-cd73e2145f71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.541348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e362dc4-6796-4d98-babb-cd73e2145f71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.541861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e362dc4-6796-4d98-babb-cd73e2145f71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.542657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e362dc4-6796-4d98-babb-cd73e2145f71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.543483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e362dc4-6796-4d98-babb-cd73e2145f71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.543989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e362dc4-6796-4d98-babb-cd73e2145f71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.084410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e362dc4-6796-4d98-babb-cd73e2145f71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:58.089323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:58.095413 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e362dc4-6796-4d98-babb-cd73e2145f71 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1315 microversion: 2.1 time: 0.566804 Oct 04 18:13:58.096006 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1502/2936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:57 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:58.100802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9649b0a5-6736-488c-931e-2d0850927d24 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: .version_select at 0x7fd4d1b11160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2042440549", "description": "tempest-description-1181149666"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:58.114916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:58.116404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:58.117686 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-70ae03dd-9909-433e-a60b-df43888b6bbb tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2829 microversion: 2.32 time: 0.602033 Oct 04 18:13:58.118260 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1435/2937] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:57 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2829 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:58.128968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.9"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:58.303266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:58.311920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.312510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.313186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.314374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.315341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.316172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.357449 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9649b0a5-6736-488c-931e-2d0850927d24 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.260109 Oct 04 18:13:58.358164 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1503/2938] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:13:58 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:58.362933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f70ad88d-d2a3-4ab6-8197-ed2f228c4f0f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:58.363843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f70ad88d-d2a3-4ab6-8197-ed2f228c4f0f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:58.371092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f70ad88d-d2a3-4ab6-8197-ed2f228c4f0f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.371673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f70ad88d-d2a3-4ab6-8197-ed2f228c4f0f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.372271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f70ad88d-d2a3-4ab6-8197-ed2f228c4f0f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.373300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f70ad88d-d2a3-4ab6-8197-ed2f228c4f0f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.374518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f70ad88d-d2a3-4ab6-8197-ed2f228c4f0f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.374943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f70ad88d-d2a3-4ab6-8197-ed2f228c4f0f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.639644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f70ad88d-d2a3-4ab6-8197-ed2f228c4f0f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:58.648826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "refresh_cache-b8dcc660-4ee0-4c03-994c-bd8c00eea140" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:13:58.649904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquired lock "refresh_cache-b8dcc660-4ee0-4c03-994c-bd8c00eea140" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:13:58.653094 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f70ad88d-d2a3-4ab6-8197-ed2f228c4f0f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1318 microversion: 2.1 time: 0.293631 Oct 04 18:13:58.653809 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1504/2939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:58 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:58.661781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-730e39d0-ff47-4639-81c2-63f7d1e88984 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d12efdc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:58.687920 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-730e39d0-ff47-4639-81c2-63f7d1e88984 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057522232" status: 204 len: 0 microversion: 2.2 time: 0.033037 Oct 04 18:13:58.691025 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1505/2940] 10.222.0.18 () {60 vars in 1261 bytes} [Tue Oct 4 18:13:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057522232 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:58.699844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:58.701372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:58.734559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.736402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.739664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.740697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.741237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.741682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.600284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.611213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.612638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.613754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fcc0f336-9d43-438e-88a6-894117903fef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1280 microversion: 2.25 time: 0.921928 Oct 04 18:13:59.614321 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1506/2941] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:58 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1280 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:59.618722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5905dec6-cca8-448f-82d8-f84d807e3173 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:59.619463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5905dec6-cca8-448f-82d8-f84d807e3173 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:59.625508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5905dec6-cca8-448f-82d8-f84d807e3173 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.625999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5905dec6-cca8-448f-82d8-f84d807e3173 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.626435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5905dec6-cca8-448f-82d8-f84d807e3173 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.627168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5905dec6-cca8-448f-82d8-f84d807e3173 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.627622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5905dec6-cca8-448f-82d8-f84d807e3173 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.628671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5905dec6-cca8-448f-82d8-f84d807e3173 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.923766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5905dec6-cca8-448f-82d8-f84d807e3173 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.932893 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5905dec6-cca8-448f-82d8-f84d807e3173 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1325 microversion: 2.1 time: 0.317544 Oct 04 18:13:59.933462 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1507/2942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:59 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1325 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:59.938528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-37d9854d-f788-4a6d-bbd1-3963a61dcd91 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:59.939320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-37d9854d-f788-4a6d-bbd1-3963a61dcd91 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:59.950046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d9854d-f788-4a6d-bbd1-3963a61dcd91 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.950807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d9854d-f788-4a6d-bbd1-3963a61dcd91 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.951335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d9854d-f788-4a6d-bbd1-3963a61dcd91 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.952361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d9854d-f788-4a6d-bbd1-3963a61dcd91 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.953139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d9854d-f788-4a6d-bbd1-3963a61dcd91 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.953630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d9854d-f788-4a6d-bbd1-3963a61dcd91 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.103374 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-37d9854d-f788-4a6d-bbd1-3963a61dcd91 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.168604 Oct 04 18:14:00.106237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Building network info cache for instance {{(pid=122331) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:14:00.112698 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1508/2943] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 4 18:13:59 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7/os-interface => generated 1829 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:00.125199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e2c07f70-935b-4beb-8e8b-0d86d8b719d3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: .version_select at 0x7fd4d13b2040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-579386697", "description": "tempest-description-484230610"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:00.546514 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e2c07f70-935b-4beb-8e8b-0d86d8b719d3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.432166 Oct 04 18:14:00.547315 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1509/2944] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:14:00 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:00.562560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5a470cf1-6cb9-403d-84ad-53cc32a70e6e req-ac8104de-2a6c-48be-8a93-0eff1fb6daf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36c7b27-9927-4f6d-874d-dbf86b9ef895", "name": "network-vif-plugged", "status": "completed", "tag": "b431abe6-8cb4-48b7-b889-3c3dbf59f6d0"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:00.588487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a470cf1-6cb9-403d-84ad-53cc32a70e6e req-ac8104de-2a6c-48be-8a93-0eff1fb6daf9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.589085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a470cf1-6cb9-403d-84ad-53cc32a70e6e req-ac8104de-2a6c-48be-8a93-0eff1fb6daf9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.589637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a470cf1-6cb9-403d-84ad-53cc32a70e6e req-ac8104de-2a6c-48be-8a93-0eff1fb6daf9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.613309 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5a470cf1-6cb9-403d-84ad-53cc32a70e6e req-ac8104de-2a6c-48be-8a93-0eff1fb6daf9 service nova] Creating event network-vif-plugged:b431abe6-8cb4-48b7-b889-3c3dbf59f6d0 for instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 on n-h1-850499-14 Oct 04 18:14:00.626983 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5a470cf1-6cb9-403d-84ad-53cc32a70e6e req-ac8104de-2a6c-48be-8a93-0eff1fb6daf9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065591 Oct 04 18:14:00.627773 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1510/2945] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:00.667461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bbd6a914-26e1-41ca-bf91-0dceaa9fd44b tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Action: 'create', calling method: .version_select at 0x7fd4d13b2ee0>, body: {"keypair": {"name": "tempest-keypair-286316973", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:00.710564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-bbd6a914-26e1-41ca-bf91-0dceaa9fd44b tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:00.721872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-bbd6a914-26e1-41ca-bf91-0dceaa9fd44b tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for user 711b1f472d0b4677b52c0b487e16c68b and project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:00.767607 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bbd6a914-26e1-41ca-bf91-0dceaa9fd44b tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.138145 Oct 04 18:14:00.768445 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1511/2946] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 4 18:14:00 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:14:00.781145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b4b59ac6-2eca-4cb3-982b-8a4a1d5dceea tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:00.781894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4b59ac6-2eca-4cb3-982b-8a4a1d5dceea tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:00.788421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b59ac6-2eca-4cb3-982b-8a4a1d5dceea tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.789004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b59ac6-2eca-4cb3-982b-8a4a1d5dceea tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.789447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b59ac6-2eca-4cb3-982b-8a4a1d5dceea tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.790165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b59ac6-2eca-4cb3-982b-8a4a1d5dceea tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.790630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b59ac6-2eca-4cb3-982b-8a4a1d5dceea tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.791141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b59ac6-2eca-4cb3-982b-8a4a1d5dceea tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.888603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Updating instance_info_cache with network_info: [{"id": "0657bd03-e275-4cc6-8a1c-2040ba2533e3", "address": "fa:16:3e:24:fe:28", "network": {"id": "69b13a93-21c6-4fd2-9113-725fac9d7bbf", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1099716879-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "81f7c69bc5f14725b40bcc5cccece335", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0657bd03-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122331) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:14:00.906659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Releasing lock "refresh_cache-b8dcc660-4ee0-4c03-994c-bd8c00eea140" {{(pid=122331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:14:00.908073 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-85253289-f156-4c28-a828-e9d2833b5e86 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "POST /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140/action" status: 202 len: 0 microversion: 2.1 time: 2.788362 Oct 04 18:14:00.913374 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1436/2947] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:58 2022] POST /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140/action => generated 0 bytes in 2794 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:14:00.919233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c8189fb-c45f-4919-a152-c906ed9c227e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:00.920091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2c8189fb-c45f-4919-a152-c906ed9c227e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:00.930153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8189fb-c45f-4919-a152-c906ed9c227e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.930899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8189fb-c45f-4919-a152-c906ed9c227e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.931552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8189fb-c45f-4919-a152-c906ed9c227e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.932449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8189fb-c45f-4919-a152-c906ed9c227e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.933111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8189fb-c45f-4919-a152-c906ed9c227e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.933869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8189fb-c45f-4919-a152-c906ed9c227e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.129139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b4b59ac6-2eca-4cb3-982b-8a4a1d5dceea tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:01.137414 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b4b59ac6-2eca-4cb3-982b-8a4a1d5dceea tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1501 microversion: 2.1 time: 0.361672 Oct 04 18:14:01.137991 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1512/2948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:00 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1501 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:01.147168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-f367f6e5-57e2-4af7-8b39-a84e417a0722 req-e152e1c7-72f7-4c5b-bd96-9e090ee5fa8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8dcc660-4ee0-4c03-994c-bd8c00eea140", "tag": "0657bd03-e275-4cc6-8a1c-2040ba2533e3"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:01.166251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f367f6e5-57e2-4af7-8b39-a84e417a0722 req-e152e1c7-72f7-4c5b-bd96-9e090ee5fa8d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.166980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f367f6e5-57e2-4af7-8b39-a84e417a0722 req-e152e1c7-72f7-4c5b-bd96-9e090ee5fa8d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.167648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f367f6e5-57e2-4af7-8b39-a84e417a0722 req-e152e1c7-72f7-4c5b-bd96-9e090ee5fa8d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.180303 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-f367f6e5-57e2-4af7-8b39-a84e417a0722 req-e152e1c7-72f7-4c5b-bd96-9e090ee5fa8d service nova] Creating event network-changed:0657bd03-e275-4cc6-8a1c-2040ba2533e3 for instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 on n-h2-850499-14 Oct 04 18:14:01.182986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2c8189fb-c45f-4919-a152-c906ed9c227e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:01.186431 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-f367f6e5-57e2-4af7-8b39-a84e417a0722 req-e152e1c7-72f7-4c5b-bd96-9e090ee5fa8d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042866 Oct 04 18:14:01.187612 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1513/2949] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:01.194600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eef75068-0edd-4f07-875d-f78bdf4355e0 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d13b2280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.194876 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c8189fb-c45f-4919-a152-c906ed9c227e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1318 microversion: 2.1 time: 0.278629 Oct 04 18:14:01.195658 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1437/2950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:00 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:01.203963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.205246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:01.219584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.220459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.221221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.222576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.223314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.224373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.457075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:01.477934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:01.479434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:01.482562 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8bdb5324-eb57-45b6-97fb-fb99142d6333 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1280 microversion: 2.25 time: 0.285114 Oct 04 18:14:01.484123 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1438/2951] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:01 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1280 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:01.493152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f60233d6-2c18-4576-bfe2-157239b5d3ca tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d1f720d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.536539 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f60233d6-2c18-4576-bfe2-157239b5d3ca tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-286316973" status: 204 len: 0 microversion: 2.2 time: 0.051206 Oct 04 18:14:01.545994 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1439/2952] 10.222.0.18 () {60 vars in 1258 bytes} [Tue Oct 4 18:14:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-286316973 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:01.545994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-525b3aff-6528-47eb-a1de-278097f24162 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '.version_select at 0x7fd4d1d3fca0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.933828 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eef75068-0edd-4f07-875d-f78bdf4355e0 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.744308 Oct 04 18:14:01.934576 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1514/2953] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:14:01 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:01.940854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-affbe8c7-91eb-42fd-8d2c-a52e7d294624 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.941906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-affbe8c7-91eb-42fd-8d2c-a52e7d294624 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:01.950344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-affbe8c7-91eb-42fd-8d2c-a52e7d294624 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.950934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-affbe8c7-91eb-42fd-8d2c-a52e7d294624 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.951482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-affbe8c7-91eb-42fd-8d2c-a52e7d294624 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.952774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-affbe8c7-91eb-42fd-8d2c-a52e7d294624 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.953457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-affbe8c7-91eb-42fd-8d2c-a52e7d294624 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.953962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-affbe8c7-91eb-42fd-8d2c-a52e7d294624 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.176470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-affbe8c7-91eb-42fd-8d2c-a52e7d294624 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:02.188231 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-affbe8c7-91eb-42fd-8d2c-a52e7d294624 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1325 microversion: 2.1 time: 0.251604 Oct 04 18:14:02.188905 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1515/2954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:01 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1325 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:02.205377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3bafa645-fdde-439a-84b2-f4050413f091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:02.215284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bafa645-fdde-439a-84b2-f4050413f091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.215805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bafa645-fdde-439a-84b2-f4050413f091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.216500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bafa645-fdde-439a-84b2-f4050413f091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.245323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3bafa645-fdde-439a-84b2-f4050413f091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Going to try to stop instance {{(pid=122332) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:14:02.250283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:02.293542 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3bafa645-fdde-439a-84b2-f4050413f091 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40/action" status: 202 len: 0 microversion: 2.1 time: 0.102276 Oct 04 18:14:02.296227 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1516/2955] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:14:02 2022] POST /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:02.303928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c166cb15-c43b-45d9-9c6f-41c3271f8dad tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Action: 'create', calling method: .version_select at 0x7fd4d1356e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1752106615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNP2vrz1p/3yL8ZQw+aVCZ5sFkkH1kt6zlAwtu/oidrjdNM/YMbng20aEwVKmZlPg7Cratm2dS9NMIyIuaFPqY4ap0NcMR+sA0XrYrLn6Bg0a8LulkIRIEFQA6Io/zvEGw=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:02.324479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c166cb15-c43b-45d9-9c6f-41c3271f8dad tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:02.331275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c166cb15-c43b-45d9-9c6f-41c3271f8dad tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for user 711b1f472d0b4677b52c0b487e16c68b and project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:02.358300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c166cb15-c43b-45d9-9c6f-41c3271f8dad tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.060014 Oct 04 18:14:02.359282 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1517/2956] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 4 18:14:02 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:14:02.364177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-26458be2-a041-4d1c-801a-d5dc79b1c991 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d13825e0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:02.704079 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-26458be2-a041-4d1c-801a-d5dc79b1c991 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9d6a93d4-3464-4dd3-8ea6-f274d013afeb" status: 202 len: 0 microversion: 2.1 time: 0.343389 Oct 04 18:14:02.704791 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1518/2957] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:14:02 2022] DELETE /compute/v2.1/os-security-groups/9d6a93d4-3464-4dd3-8ea6-f274d013afeb => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:02.712562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04491ba7-6075-47b2-88e8-0681e5d694a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:02.713714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-04491ba7-6075-47b2-88e8-0681e5d694a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:02.716151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:02.732091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04491ba7-6075-47b2-88e8-0681e5d694a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.733618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04491ba7-6075-47b2-88e8-0681e5d694a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.734867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04491ba7-6075-47b2-88e8-0681e5d694a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.736145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04491ba7-6075-47b2-88e8-0681e5d694a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.738195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04491ba7-6075-47b2-88e8-0681e5d694a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.739627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04491ba7-6075-47b2-88e8-0681e5d694a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.949327 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-525b3aff-6528-47eb-a1de-278097f24162 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/bd21e227-a592-4259-9198-fc0d9fda1071" status: 202 len: 0 microversion: 2.1 time: 1.411161 Oct 04 18:14:02.954072 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1440/2958] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:14:01 2022] DELETE /compute/v2.1/os-floating-ips/bd21e227-a592-4259-9198-fc0d9fda1071 => generated 0 bytes in 1412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:02.955520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-930adff9-97d8-4de6-8dde-8c06b56f9468 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:02.956082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-930adff9-97d8-4de6-8dde-8c06b56f9468 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:02.969510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-930adff9-97d8-4de6-8dde-8c06b56f9468 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.969628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-930adff9-97d8-4de6-8dde-8c06b56f9468 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.969994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-930adff9-97d8-4de6-8dde-8c06b56f9468 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.970704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-930adff9-97d8-4de6-8dde-8c06b56f9468 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.974036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-930adff9-97d8-4de6-8dde-8c06b56f9468 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.974753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-930adff9-97d8-4de6-8dde-8c06b56f9468 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.027749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-04491ba7-6075-47b2-88e8-0681e5d694a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.037549 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-04491ba7-6075-47b2-88e8-0681e5d694a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1318 microversion: 2.1 time: 0.329403 Oct 04 18:14:03.044117 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1519/2959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:02 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:03.049958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70f6ae9a-db06-4141-b904-e2ba86f21f8e tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Action: 'create', calling method: .version_select at 0x7fd4d1382af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-294540331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPo2wdZVmKZ9WIH0TTKYPt0J1fmKRdShvsbcq6ES2wSqaMHIqYAYS/ESeMbb607dzU5Lx8iFElfj9x7iFmCSPbBby1HfEI08FmBfvnQWnSLBB7JYmSrGcaH/3+jal9JnA=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:03.094627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-70f6ae9a-db06-4141-b904-e2ba86f21f8e tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:03.105613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-70f6ae9a-db06-4141-b904-e2ba86f21f8e tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for user 711b1f472d0b4677b52c0b487e16c68b and project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:03.175757 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70f6ae9a-db06-4141-b904-e2ba86f21f8e tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.130207 Oct 04 18:14:03.177726 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1520/2960] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 4 18:14:03 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:14:03.186162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.188246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.200832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.201930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.203374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.206050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.206770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.207669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.252269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-930adff9-97d8-4de6-8dde-8c06b56f9468 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.263646 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-930adff9-97d8-4de6-8dde-8c06b56f9468 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.312244 Oct 04 18:14:03.264239 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1441/2961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:02 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:03.269010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ea1f3a86-4bc1-4f34-a060-62bf6a7d94ea req-8e7f72ec-0ea7-416b-b12e-0a2818a37b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8053e0e-c889-4fd9-93a4-34aca7ff2948", "name": "network-vif-plugged", "status": "completed", "tag": "1bc16d83-9b0d-4671-a5c4-86ffb6abc091"}, {"server_uuid": "8473402c-8305-4b12-80a3-a58369427df7", "name": "network-vif-plugged", "status": "completed", "tag": "7b4de8e5-02fc-4739-8a0c-a94e47cb8c83"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:03.281200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ea1f3a86-4bc1-4f34-a060-62bf6a7d94ea req-8e7f72ec-0ea7-416b-b12e-0a2818a37b45 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.281691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ea1f3a86-4bc1-4f34-a060-62bf6a7d94ea req-8e7f72ec-0ea7-416b-b12e-0a2818a37b45 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.282129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ea1f3a86-4bc1-4f34-a060-62bf6a7d94ea req-8e7f72ec-0ea7-416b-b12e-0a2818a37b45 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.296729 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ea1f3a86-4bc1-4f34-a060-62bf6a7d94ea req-8e7f72ec-0ea7-416b-b12e-0a2818a37b45 service nova] Creating event network-vif-plugged:1bc16d83-9b0d-4671-a5c4-86ffb6abc091 for instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 on n-h1-850499-14 Oct 04 18:14:03.297241 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ea1f3a86-4bc1-4f34-a060-62bf6a7d94ea req-8e7f72ec-0ea7-416b-b12e-0a2818a37b45 service nova] Creating event network-vif-plugged:7b4de8e5-02fc-4739-8a0c-a94e47cb8c83 for instance 8473402c-8305-4b12-80a3-a58369427df7 on n-h2-850499-14 Oct 04 18:14:03.306649 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ea1f3a86-4bc1-4f34-a060-62bf6a7d94ea req-8e7f72ec-0ea7-416b-b12e-0a2818a37b45 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040989 Oct 04 18:14:03.307462 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1442/2962] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:03.315672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5cd2617e-4333-4a15-b928-84d58b81d6c4 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d1dd0e50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.346947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-5cd2617e-4333-4a15-b928-84d58b81d6c4 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:14:03.348418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-5cd2617e-4333-4a15-b928-84d58b81d6c4 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Neutron security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:14:03.349230 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-5cd2617e-4333-4a15-b928-84d58b81d6c4 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:14:03.349230 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-b5596347-557f-4d9a-b6fe-6d120d8c617d'] Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5cd2617e-4333-4a15-b928-84d58b81d6c4 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-security-groups/9d6a93d4-3464-4dd3-8ea6-f274d013afeb HTTP/1.1 Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:14:03.352685 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: exception: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-b5596347-557f-4d9a-b6fe-6d120d8c617d'] Oct 04 18:14:03.354794 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '9d6a93d4-3464-4dd3-8ea6-f274d013afeb'} Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:03.355958 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5596347-557f-4d9a-b6fe-6d120d8c617d'] Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:14:03.357461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5596347-557f-4d9a-b6fe-6d120d8c617d'] Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5596347-557f-4d9a-b6fe-6d120d8c617d'] Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.360936 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5596347-557f-4d9a-b6fe-6d120d8c617d'] Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5cd2617e-4333-4a15-b928-84d58b81d6c4 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-b5596347-557f-4d9a-b6fe-6d120d8c617d'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5cd2617e-4333-4a15-b928-84d58b81d6c4 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/9d6a93d4-3464-4dd3-8ea6-f274d013afeb" status: 404 len: 194 microversion: 2.1 time: 0.044890 Oct 04 18:14:03.364456 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1443/2963] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:14:03 2022] GET /compute/v2.1/os-security-groups/9d6a93d4-3464-4dd3-8ea6-f274d013afeb => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:03.367701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b58975b-cabf-4ab2-8cf7-db84276177e9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '.version_select at 0x7fd4d1f72b80>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.477098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.486871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.488713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.490093 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-99f0c157-9eb4-4fb0-a6c0-dbef8231a65b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1475 microversion: 2.25 time: 0.309914 Oct 04 18:14:03.504014 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1521/2964] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:03 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1475 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:03.512199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9c387ef8-0321-4e95-86f0-634924876fb4 req-6199b9e3-d2f7-4c75-9931-1adf5464835e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "tag": "3a292832-0947-4c83-ad7e-41e6a929165c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:03.522623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9c387ef8-0321-4e95-86f0-634924876fb4 req-6199b9e3-d2f7-4c75-9931-1adf5464835e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.523468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9c387ef8-0321-4e95-86f0-634924876fb4 req-6199b9e3-d2f7-4c75-9931-1adf5464835e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.524342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9c387ef8-0321-4e95-86f0-634924876fb4 req-6199b9e3-d2f7-4c75-9931-1adf5464835e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.540131 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9c387ef8-0321-4e95-86f0-634924876fb4 req-6199b9e3-d2f7-4c75-9931-1adf5464835e service nova] Creating event network-changed:3a292832-0947-4c83-ad7e-41e6a929165c for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:14:03.551967 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9c387ef8-0321-4e95-86f0-634924876fb4 req-6199b9e3-d2f7-4c75-9931-1adf5464835e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045227 Oct 04 18:14:03.554368 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1522/2965] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:03.565189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e3428044-a4aa-498e-88d8-bfa5c4902100 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Action: 'create', calling method: .version_select at 0x7fd4d13820d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1594582707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFnyVgN8GxJ8gwc0TMSUuxpSE0llBaUR1JuHk+yIp+0BSj3dhDhjy+x+aMGOCQM9JV3dd48ZCdNT07yUKOKuuf9N/5Vsah3ZnHqqedwL6l1dGPrO2ZbvurKgcIdtuRdyQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:03.598824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-e3428044-a4aa-498e-88d8-bfa5c4902100 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:03.605523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-e3428044-a4aa-498e-88d8-bfa5c4902100 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for user 711b1f472d0b4677b52c0b487e16c68b and project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:03.635203 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e3428044-a4aa-498e-88d8-bfa5c4902100 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.077832 Oct 04 18:14:03.636494 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1523/2966] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 4 18:14:03 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:14:03.643430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1c1ed71a-1b42-43a1-a095-a06be9e1b684 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.644598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1c1ed71a-1b42-43a1-a095-a06be9e1b684 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.652384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1ed71a-1b42-43a1-a095-a06be9e1b684 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.653146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1ed71a-1b42-43a1-a095-a06be9e1b684 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.653754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1ed71a-1b42-43a1-a095-a06be9e1b684 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.654638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1ed71a-1b42-43a1-a095-a06be9e1b684 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.655874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1ed71a-1b42-43a1-a095-a06be9e1b684 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.656533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1ed71a-1b42-43a1-a095-a06be9e1b684 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.671238 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b58975b-cabf-4ab2-8cf7-db84276177e9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/ad9c063b-8ae0-4c81-ab53-40fc8746f234" status: 202 len: 0 microversion: 2.1 time: 0.315062 Oct 04 18:14:03.672272 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1444/2967] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:14:03 2022] DELETE /compute/v2.1/os-security-groups/ad9c063b-8ae0-4c81-ab53-40fc8746f234 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:03.678193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d863fcb-a61d-4a67-8c43-17e5d82360a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d1dd0550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.920114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1c1ed71a-1b42-43a1-a095-a06be9e1b684 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.932351 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1c1ed71a-1b42-43a1-a095-a06be9e1b684 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1325 microversion: 2.1 time: 0.294428 Oct 04 18:14:03.944215 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1524/2968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:03 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:03.944215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00148efe-800b-4a54-8cbb-4a1805bdc2db tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.944215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00148efe-800b-4a54-8cbb-4a1805bdc2db tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.951843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00148efe-800b-4a54-8cbb-4a1805bdc2db tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.952700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00148efe-800b-4a54-8cbb-4a1805bdc2db tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.952857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00148efe-800b-4a54-8cbb-4a1805bdc2db tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.953554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00148efe-800b-4a54-8cbb-4a1805bdc2db tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.954116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00148efe-800b-4a54-8cbb-4a1805bdc2db tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.954485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00148efe-800b-4a54-8cbb-4a1805bdc2db tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.174021 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0d863fcb-a61d-4a67-8c43-17e5d82360a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/90bdeb49-844b-47b9-9692-8a302ea9e87f" status: 202 len: 0 microversion: 2.1 time: 0.500652 Oct 04 18:14:04.174622 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1445/2969] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:14:03 2022] DELETE /compute/v2.1/os-security-groups/90bdeb49-844b-47b9-9692-8a302ea9e87f => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:04.183064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-50137427-98b3-4d89-b008-2ebf7cb3c805 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d1f52160>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.187302 n-d-850499-14 devstack@n-api.service[122331]: WARNING oslo_db.sqlalchemy.utils [None req-50137427-98b3-4d89-b008-2ebf7cb3c805 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:14:04.196268 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-50137427-98b3-4d89-b008-2ebf7cb3c805 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.017321 Oct 04 18:14:04.197181 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1446/2970] 10.222.0.18 () {60 vars in 1177 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:04.206933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c8fdab44-4b89-40bd-8fd4-426276486b68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.208428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c8fdab44-4b89-40bd-8fd4-426276486b68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.220189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fdab44-4b89-40bd-8fd4-426276486b68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.221424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fdab44-4b89-40bd-8fd4-426276486b68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.224918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fdab44-4b89-40bd-8fd4-426276486b68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.225695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fdab44-4b89-40bd-8fd4-426276486b68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.226185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fdab44-4b89-40bd-8fd4-426276486b68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.226632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8fdab44-4b89-40bd-8fd4-426276486b68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.229841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-00148efe-800b-4a54-8cbb-4a1805bdc2db tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid a36c7b27-9927-4f6d-874d-dbf86b9ef895 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:04.248847 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00148efe-800b-4a54-8cbb-4a1805bdc2db tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1969 microversion: 2.25 time: 0.314663 Oct 04 18:14:04.256116 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1525/2971] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:03 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:04.261420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-deb8193f-9281-485e-b005-30e89a7b70f7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.262242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-deb8193f-9281-485e-b005-30e89a7b70f7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.267166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c8fdab44-4b89-40bd-8fd4-426276486b68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:04.271270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-deb8193f-9281-485e-b005-30e89a7b70f7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.271854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-deb8193f-9281-485e-b005-30e89a7b70f7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.272372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-deb8193f-9281-485e-b005-30e89a7b70f7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.273160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-deb8193f-9281-485e-b005-30e89a7b70f7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.273741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-deb8193f-9281-485e-b005-30e89a7b70f7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.274343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-deb8193f-9281-485e-b005-30e89a7b70f7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.363198 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c8fdab44-4b89-40bd-8fd4-426276486b68 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 204 len: 0 microversion: 2.1 time: 0.162582 Oct 04 18:14:04.364675 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1447/2972] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:04 2022] DELETE /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:04.371369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db24bbfe-9759-4a31-87c6-8315f65091fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d2193e50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.413489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-db24bbfe-9759-4a31-87c6-8315f65091fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:14:04.414177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-db24bbfe-9759-4a31-87c6-8315f65091fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Neutron security group 90bdeb49-844b-47b9-9692-8a302ea9e87f not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:14:04.414785 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-db24bbfe-9759-4a31-87c6-8315f65091fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:14:04.414785 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-2e9ad8ea-219d-4bdd-a7f5-a5527b356b8c'] Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db24bbfe-9759-4a31-87c6-8315f65091fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-security-groups/90bdeb49-844b-47b9-9692-8a302ea9e87f HTTP/1.1 Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:14:04.417199 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: exception: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-2e9ad8ea-219d-4bdd-a7f5-a5527b356b8c'] Oct 04 18:14:04.418619 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '90bdeb49-844b-47b9-9692-8a302ea9e87f'} Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:04.419601 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e9ad8ea-219d-4bdd-a7f5-a5527b356b8c'] Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:14:04.421428 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e9ad8ea-219d-4bdd-a7f5-a5527b356b8c'] Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e9ad8ea-219d-4bdd-a7f5-a5527b356b8c'] Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:04.423829 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:04.425198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:04.425198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:04.425198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:04.425198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:04.425198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:14:04.425198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e9ad8ea-219d-4bdd-a7f5-a5527b356b8c'] Oct 04 18:14:04.425198 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:04.427220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db24bbfe-9759-4a31-87c6-8315f65091fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:14:04.427220 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-2e9ad8ea-219d-4bdd-a7f5-a5527b356b8c'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:04.428359 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-db24bbfe-9759-4a31-87c6-8315f65091fe tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/90bdeb49-844b-47b9-9692-8a302ea9e87f" status: 404 len: 194 microversion: 2.1 time: 0.061897 Oct 04 18:14:04.428933 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1448/2973] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/os-security-groups/90bdeb49-844b-47b9-9692-8a302ea9e87f => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:04.449698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-251814b2-7cd4-4fa0-94cf-9e5bef459aba tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d1f9b550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.460487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-deb8193f-9281-485e-b005-30e89a7b70f7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.469283 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-deb8193f-9281-485e-b005-30e89a7b70f7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1318 microversion: 2.1 time: 0.211943 Oct 04 18:14:04.469922 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1526/2974] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:04.474550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b6c755e-536b-4c83-a4a8-b2ebb52725d9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.475266 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-251814b2-7cd4-4fa0-94cf-9e5bef459aba tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1594582707" status: 204 len: 0 microversion: 2.2 time: 0.044867 Oct 04 18:14:04.475427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8b6c755e-536b-4c83-a4a8-b2ebb52725d9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.476189 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1449/2975] 10.222.0.18 () {60 vars in 1321 bytes} [Tue Oct 4 18:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1594582707 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:04.481741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b6c755e-536b-4c83-a4a8-b2ebb52725d9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.482236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b6c755e-536b-4c83-a4a8-b2ebb52725d9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.482676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b6c755e-536b-4c83-a4a8-b2ebb52725d9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.484316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b6c755e-536b-4c83-a4a8-b2ebb52725d9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.484780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b6c755e-536b-4c83-a4a8-b2ebb52725d9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.484999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e398b0f8-e5af-4c9b-8d04-75cca287c47e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.485209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b6c755e-536b-4c83-a4a8-b2ebb52725d9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.485970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e398b0f8-e5af-4c9b-8d04-75cca287c47e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.492611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e398b0f8-e5af-4c9b-8d04-75cca287c47e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.493110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e398b0f8-e5af-4c9b-8d04-75cca287c47e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.493595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e398b0f8-e5af-4c9b-8d04-75cca287c47e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.494332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e398b0f8-e5af-4c9b-8d04-75cca287c47e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.494796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e398b0f8-e5af-4c9b-8d04-75cca287c47e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.495261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e398b0f8-e5af-4c9b-8d04-75cca287c47e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.680714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-8b6c755e-536b-4c83-a4a8-b2ebb52725d9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid a36c7b27-9927-4f6d-874d-dbf86b9ef895 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:04.683370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e398b0f8-e5af-4c9b-8d04-75cca287c47e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.691997 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e398b0f8-e5af-4c9b-8d04-75cca287c47e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.211954 Oct 04 18:14:04.694995 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1450/2976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:04.695137 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b6c755e-536b-4c83-a4a8-b2ebb52725d9 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1969 microversion: 2.25 time: 0.222676 Oct 04 18:14:04.697508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8c38fbc9-0485-4cfa-beda-b0d0e5725907 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.698234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c38fbc9-0485-4cfa-beda-b0d0e5725907 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.699094 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1527/2977] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1969 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:04.705009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c38fbc9-0485-4cfa-beda-b0d0e5725907 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.705633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c38fbc9-0485-4cfa-beda-b0d0e5725907 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.706187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c38fbc9-0485-4cfa-beda-b0d0e5725907 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.707161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-842b5427-660a-4c56-b1f8-4221fb016829 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d12d1a60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.707302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c38fbc9-0485-4cfa-beda-b0d0e5725907 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.707825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c38fbc9-0485-4cfa-beda-b0d0e5725907 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.708362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c38fbc9-0485-4cfa-beda-b0d0e5725907 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.843816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:04.967715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8c38fbc9-0485-4cfa-beda-b0d0e5725907 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.976669 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8c38fbc9-0485-4cfa-beda-b0d0e5725907 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1510 microversion: 2.1 time: 0.282941 Oct 04 18:14:04.977249 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1451/2978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1510 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:04.981741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39a85671-88cf-4dae-a40c-36c8ba7c569a tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d1d3f940>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.005863 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39a85671-88cf-4dae-a40c-36c8ba7c569a tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-294540331" status: 204 len: 0 microversion: 2.2 time: 0.027475 Oct 04 18:14:05.006441 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1452/2979] 10.222.0.18 () {60 vars in 1318 bytes} [Tue Oct 4 18:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-294540331 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:05.011023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01cf2e55-df89-41dd-8b1c-5153e1416032 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.015286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01cf2e55-df89-41dd-8b1c-5153e1416032 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.016049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01cf2e55-df89-41dd-8b1c-5153e1416032 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.016503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01cf2e55-df89-41dd-8b1c-5153e1416032 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.017255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01cf2e55-df89-41dd-8b1c-5153e1416032 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.017719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01cf2e55-df89-41dd-8b1c-5153e1416032 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.018165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01cf2e55-df89-41dd-8b1c-5153e1416032 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.024072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:05.046659 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01cf2e55-df89-41dd-8b1c-5153e1416032 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.039186 Oct 04 18:14:05.047407 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1453/2980] 10.222.0.18 () {60 vars in 1217 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:05.052352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-29a2cec2-6450-491e-86dc-68d16145c70e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.053186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-29a2cec2-6450-491e-86dc-68d16145c70e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:05.060470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a2cec2-6450-491e-86dc-68d16145c70e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.060960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a2cec2-6450-491e-86dc-68d16145c70e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.061433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a2cec2-6450-491e-86dc-68d16145c70e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.062143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a2cec2-6450-491e-86dc-68d16145c70e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.062605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a2cec2-6450-491e-86dc-68d16145c70e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.063062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a2cec2-6450-491e-86dc-68d16145c70e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.094309 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-842b5427-660a-4c56-b1f8-4221fb016829 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b" status: 202 len: 0 microversion: 2.1 time: 0.393961 Oct 04 18:14:05.098041 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1528/2981] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:14:04 2022] DELETE /compute/v2.1/os-security-groups/a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:05.099611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6fedded6-9f72-47c1-bb24-e138e327e4a8 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d12d8940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.119514 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6fedded6-9f72-47c1-bb24-e138e327e4a8 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1752106615" status: 204 len: 0 microversion: 2.2 time: 0.023561 Oct 04 18:14:05.120411 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1529/2982] 10.222.0.18 () {60 vars in 1321 bytes} [Tue Oct 4 18:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1752106615 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:05.127875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850499-14", "block_migration": "auto"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:05.130587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:05.137830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.138612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.139304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.140601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.141663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.142530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.180159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'flavor' on Instance uuid a36c7b27-9927-4f6d-874d-dbf86b9ef895 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:05.194395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Going to try to live migrate instance to n-h2-850499-14 {{(pid=122332) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:14:05.239514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-29a2cec2-6450-491e-86dc-68d16145c70e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:05.248489 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-29a2cec2-6450-491e-86dc-68d16145c70e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1325 microversion: 2.1 time: 0.199981 Oct 04 18:14:05.249622 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1454/2983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1325 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:05.254469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-25db6e1c-d13a-4726-9392-d89dc5c1a722 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d62455e0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.283951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-25db6e1c-d13a-4726-9392-d89dc5c1a722 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:14:05.284556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-25db6e1c-d13a-4726-9392-d89dc5c1a722 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Neutron security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:14:05.285104 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-25db6e1c-d13a-4726-9392-d89dc5c1a722 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:14:05.285104 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-cd540eb1-2941-4ed5-8852-24f70fb0edc0'] Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-25db6e1c-d13a-4726-9392-d89dc5c1a722 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-security-groups/a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b HTTP/1.1 Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:14:05.286929 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: exception: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-cd540eb1-2941-4ed5-8852-24f70fb0edc0'] Oct 04 18:14:05.288519 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b'} Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:05.289633 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd540eb1-2941-4ed5-8852-24f70fb0edc0'] Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:14:05.291033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd540eb1-2941-4ed5-8852-24f70fb0edc0'] Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd540eb1-2941-4ed5-8852-24f70fb0edc0'] Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:05.292789 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd540eb1-2941-4ed5-8852-24f70fb0edc0'] Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-25db6e1c-d13a-4726-9392-d89dc5c1a722 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-cd540eb1-2941-4ed5-8852-24f70fb0edc0'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-25db6e1c-d13a-4726-9392-d89dc5c1a722 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b" status: 404 len: 194 microversion: 2.1 time: 0.037663 Oct 04 18:14:05.294149 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1455/2984] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/os-security-groups/a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:05.295009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4af96b38-a066-4a45-a45b-adf21f81cbfc tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Action: 'create', calling method: .version_select at 0x7fd4d1fcc280>, body: {"keypair": {"name": "tempest-keypair-441066243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtKIKGyknP6ltSbCC9sqU1osDPDgtNPxLmzo3tyUlsirqpzBtUvw5n2PExyru/HyYVM9qGYfbcKdNfn/ZZYyJIlrZXS1L2aM+/4QbX9SPoykDlie75hvyKFY30cN/saiQ=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:05.313326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-4af96b38-a066-4a45-a45b-adf21f81cbfc tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:05.319262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-4af96b38-a066-4a45-a45b-adf21f81cbfc tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for user 711b1f472d0b4677b52c0b487e16c68b and project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:05.348452 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4af96b38-a066-4a45-a45b-adf21f81cbfc tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.058206 Oct 04 18:14:05.351802 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1456/2985] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 4 18:14:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:14:05.368667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1cdb08cd-7cf2-4b26-9a93-0a29e1c45717 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d62453a0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.619628 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1cdb08cd-7cf2-4b26-9a93-0a29e1c45717 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.266453 Oct 04 18:14:05.620227 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1457/2986] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:05.625333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-76564f1b-9412-446b-8285-16b591cc4c0d req-03385fa9-e2d1-44ca-b731-e65940256385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da89d46d-4ae1-466f-9889-e1d528e843e5", "name": "network-vif-plugged", "status": "completed", "tag": "4705f29d-c67d-4649-af0a-38b1ead030b6"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:05.636547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-76564f1b-9412-446b-8285-16b591cc4c0d req-03385fa9-e2d1-44ca-b731-e65940256385 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.637034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-76564f1b-9412-446b-8285-16b591cc4c0d req-03385fa9-e2d1-44ca-b731-e65940256385 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.637472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-76564f1b-9412-446b-8285-16b591cc4c0d req-03385fa9-e2d1-44ca-b731-e65940256385 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.649620 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-76564f1b-9412-446b-8285-16b591cc4c0d req-03385fa9-e2d1-44ca-b731-e65940256385 service nova] Creating event network-vif-plugged:4705f29d-c67d-4649-af0a-38b1ead030b6 for instance da89d46d-4ae1-466f-9889-e1d528e843e5 on n-h2-850499-14 Oct 04 18:14:05.654535 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-76564f1b-9412-446b-8285-16b591cc4c0d req-03385fa9-e2d1-44ca-b731-e65940256385 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033183 Oct 04 18:14:05.655205 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1458/2987] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:05.660192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-51eb4e25-f733-42e6-8e67-4d47c340eb41 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d1dd0940>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.668588 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-51eb4e25-f733-42e6-8e67-4d47c340eb41 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-441066243" status: 200 len: 512 microversion: 2.2 time: 0.012288 Oct 04 18:14:05.669124 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1459/2988] 10.222.0.18 () {60 vars in 1255 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-441066243 => generated 512 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:05.673867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-97d46957-0b7c-4539-b048-d96213d44b35 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.674592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-97d46957-0b7c-4539-b048-d96213d44b35 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:05.680710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97d46957-0b7c-4539-b048-d96213d44b35 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.681211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97d46957-0b7c-4539-b048-d96213d44b35 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.681658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97d46957-0b7c-4539-b048-d96213d44b35 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.682362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97d46957-0b7c-4539-b048-d96213d44b35 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.682826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97d46957-0b7c-4539-b048-d96213d44b35 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.683288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97d46957-0b7c-4539-b048-d96213d44b35 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.817735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-97d46957-0b7c-4539-b048-d96213d44b35 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:05.825572 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-97d46957-0b7c-4539-b048-d96213d44b35 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1468 microversion: 2.1 time: 0.155493 Oct 04 18:14:05.826143 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1460/2989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:05.830690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-18df835d-36de-45da-83c1-19db4f8ed13d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: .version_select at 0x7fd4d1f720d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1147880696", "description": "tempest-description-1602331177"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:05.977022 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-18df835d-36de-45da-83c1-19db4f8ed13d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.149795 Oct 04 18:14:05.977717 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1461/2990] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:14:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:05.984817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f371534e-7a2d-4968-954c-35a9a42b35bc tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d1fccd30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.986573 n-d-850499-14 devstack@n-api.service[122331]: WARNING oslo_db.sqlalchemy.utils [None req-f371534e-7a2d-4968-954c-35a9a42b35bc tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:14:05.992029 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f371534e-7a2d-4968-954c-35a9a42b35bc tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.013274 Oct 04 18:14:05.992593 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1462/2991] 10.222.0.18 () {60 vars in 1177 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:05.998108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-71d84ecc-d718-4b98-944b-22db23ecebc1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.998108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-71d84ecc-d718-4b98-944b-22db23ecebc1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:06.004956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71d84ecc-d718-4b98-944b-22db23ecebc1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.005452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71d84ecc-d718-4b98-944b-22db23ecebc1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.005899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71d84ecc-d718-4b98-944b-22db23ecebc1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.006606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71d84ecc-d718-4b98-944b-22db23ecebc1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.007102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71d84ecc-d718-4b98-944b-22db23ecebc1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.007544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71d84ecc-d718-4b98-944b-22db23ecebc1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.138669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-71d84ecc-d718-4b98-944b-22db23ecebc1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.146923 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-71d84ecc-d718-4b98-944b-22db23ecebc1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.153380 Oct 04 18:14:06.147509 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1463/2992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:06.151865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d468cde2-69a9-4cb4-b809-b3cc42999e41 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:06.152468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d468cde2-69a9-4cb4-b809-b3cc42999e41 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:06.157892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d468cde2-69a9-4cb4-b809-b3cc42999e41 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.158374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d468cde2-69a9-4cb4-b809-b3cc42999e41 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.158808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d468cde2-69a9-4cb4-b809-b3cc42999e41 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.159549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d468cde2-69a9-4cb4-b809-b3cc42999e41 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.160004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d468cde2-69a9-4cb4-b809-b3cc42999e41 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.160427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d468cde2-69a9-4cb4-b809-b3cc42999e41 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.289991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d468cde2-69a9-4cb4-b809-b3cc42999e41 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.297847 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d468cde2-69a9-4cb4-b809-b3cc42999e41 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1318 microversion: 2.1 time: 0.149390 Oct 04 18:14:06.298424 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1464/2993] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:06 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:06.303836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-095ab7b9-30b9-47ba-988c-f744c5869428 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: .version_select at 0x7fd4d1ded790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-230524481", "description": "tempest-description-1828925501"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:06.450568 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-095ab7b9-30b9-47ba-988c-f744c5869428 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.150420 Oct 04 18:14:06.451215 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1465/2994] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:14:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:06.456560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1be4b7a1-fda9-4a22-8de6-61bc6d769737 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:06.457339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1be4b7a1-fda9-4a22-8de6-61bc6d769737 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:06.464277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be4b7a1-fda9-4a22-8de6-61bc6d769737 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.464895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be4b7a1-fda9-4a22-8de6-61bc6d769737 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.465425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be4b7a1-fda9-4a22-8de6-61bc6d769737 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.466185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be4b7a1-fda9-4a22-8de6-61bc6d769737 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.466896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be4b7a1-fda9-4a22-8de6-61bc6d769737 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.467394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1be4b7a1-fda9-4a22-8de6-61bc6d769737 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.601570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1be4b7a1-fda9-4a22-8de6-61bc6d769737 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.610655 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1be4b7a1-fda9-4a22-8de6-61bc6d769737 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1510 microversion: 2.1 time: 0.158481 Oct 04 18:14:06.611254 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1466/2995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:06 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:06.615652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca05d4d0-4b69-47e6-95de-e1e3b4776f16 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d12ebd30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:06.633480 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca05d4d0-4b69-47e6-95de-e1e3b4776f16 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441066243" status: 204 len: 0 microversion: 2.2 time: 0.021221 Oct 04 18:14:06.634034 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1467/2996] 10.222.0.18 () {60 vars in 1258 bytes} [Tue Oct 4 18:14:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441066243 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:06.638795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c6df9848-cd44-4b21-9286-b014310157f2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:06.639432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c6df9848-cd44-4b21-9286-b014310157f2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:06.645233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6df9848-cd44-4b21-9286-b014310157f2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.645743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6df9848-cd44-4b21-9286-b014310157f2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.646178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6df9848-cd44-4b21-9286-b014310157f2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.646866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6df9848-cd44-4b21-9286-b014310157f2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.647347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6df9848-cd44-4b21-9286-b014310157f2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.647771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6df9848-cd44-4b21-9286-b014310157f2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.781238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c6df9848-cd44-4b21-9286-b014310157f2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.788895 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c6df9848-cd44-4b21-9286-b014310157f2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1325 microversion: 2.1 time: 0.153928 Oct 04 18:14:06.789464 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1468/2997] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:06 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1325 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:06.794017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-886047631", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "1b953c37-9a80-4e64-aa78-4705930962f1"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:06.851203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] validate_networks() for [('1b953c37-9a80-4e64-aa78-4705930962f1', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:07.225460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:07.226054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:07.226657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:07.227205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:07.227684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:07.238139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.238636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.239113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.239854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.240328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.240763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.252888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:07.259693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Getting quotas for project 83335cd1899d4703b1bfc4a5571f69fd. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:07.265023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Getting quotas for user 3301f186f61e4badb072f9cf536a5887 and project 83335cd1899d4703b1bfc4a5571f69fd. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:07.278608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:07.281039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:07.330105 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45180a3a-cf64-4fe0-9a49-c02d6bc8036f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539428 Oct 04 18:14:07.330728 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1469/2998] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:07.335384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ad288330-4ab3-445f-87f4-d676d2ffa58d tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Action: 'create', calling method: .version_select at 0x7fd4d1f72b80>, body: {"keypair": {"name": "tempest-keypair-1763319599", "type": "x509"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:07.353190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ad288330-4ab3-445f-87f4-d676d2ffa58d tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:07.360458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ad288330-4ab3-445f-87f4-d676d2ffa58d tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for user 711b1f472d0b4677b52c0b487e16c68b and project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:07.376390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.processutils [None req-ad288330-4ab3-445f-87f4-d676d2ffa58d tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpqelnfxg0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpqelnfxg0/temp.key -subj /CN=711b1f472d0b4677b52c0b487e16c68b -extensions v3_req_client {{(pid=122331) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:14:07.552365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.processutils [None req-ad288330-4ab3-445f-87f4-d676d2ffa58d tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpqelnfxg0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpqelnfxg0/temp.key -subj /CN=711b1f472d0b4677b52c0b487e16c68b -extensions v3_req_client" returned: 0 in 0.175s {{(pid=122331) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:14:07.554510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.processutils [None req-ad288330-4ab3-445f-87f4-d676d2ffa58d tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpqelnfxg0/temp.key -password pass: {{(pid=122331) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:14:07.577153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.processutils [None req-ad288330-4ab3-445f-87f4-d676d2ffa58d tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpqelnfxg0/temp.key -password pass:" returned: 0 in 0.022s {{(pid=122331) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:14:07.636003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ad288330-4ab3-445f-87f4-d676d2ffa58d tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:07.641711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ad288330-4ab3-445f-87f4-d676d2ffa58d tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Getting quotas for user 711b1f472d0b4677b52c0b487e16c68b and project acf13fba07d34fc3b7d6c15e7d6f1f6b. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:07.661263 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ad288330-4ab3-445f-87f4-d676d2ffa58d tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.329487 Oct 04 18:14:07.662392 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1470/2999] 10.222.0.18 () {62 vars in 1198 bytes} [Tue Oct 4 18:14:07 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 331 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:07.668123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7b3d7f45-87fa-4be2-ad29-f84793876935 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:07.668981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7b3d7f45-87fa-4be2-ad29-f84793876935 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:07.676175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b3d7f45-87fa-4be2-ad29-f84793876935 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.676724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b3d7f45-87fa-4be2-ad29-f84793876935 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.677185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b3d7f45-87fa-4be2-ad29-f84793876935 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.677938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b3d7f45-87fa-4be2-ad29-f84793876935 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.678655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b3d7f45-87fa-4be2-ad29-f84793876935 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.679112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b3d7f45-87fa-4be2-ad29-f84793876935 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.828325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b3d7f45-87fa-4be2-ad29-f84793876935 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.836465 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7b3d7f45-87fa-4be2-ad29-f84793876935 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.172898 Oct 04 18:14:07.836982 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1471/3000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:07 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:07.841370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b7ee426-ce46-4429-add4-f9c1a2bf34a5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:07.841991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9b7ee426-ce46-4429-add4-f9c1a2bf34a5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:07.848196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b7ee426-ce46-4429-add4-f9c1a2bf34a5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.848698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b7ee426-ce46-4429-add4-f9c1a2bf34a5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.849143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b7ee426-ce46-4429-add4-f9c1a2bf34a5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.849859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b7ee426-ce46-4429-add4-f9c1a2bf34a5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.850346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b7ee426-ce46-4429-add4-f9c1a2bf34a5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.850800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b7ee426-ce46-4429-add4-f9c1a2bf34a5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.982738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b7ee426-ce46-4429-add4-f9c1a2bf34a5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.990920 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b7ee426-ce46-4429-add4-f9c1a2bf34a5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1318 microversion: 2.1 time: 0.152977 Oct 04 18:14:07.991528 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1472/3001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:07 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:07.995912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-59aa0ae9-333d-432a-9a13-6c26affd7f9d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:07.996527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-59aa0ae9-333d-432a-9a13-6c26affd7f9d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:08.002122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59aa0ae9-333d-432a-9a13-6c26affd7f9d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.002611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59aa0ae9-333d-432a-9a13-6c26affd7f9d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.003167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59aa0ae9-333d-432a-9a13-6c26affd7f9d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.003784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59aa0ae9-333d-432a-9a13-6c26affd7f9d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.004246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59aa0ae9-333d-432a-9a13-6c26affd7f9d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.004676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59aa0ae9-333d-432a-9a13-6c26affd7f9d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.069141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-59aa0ae9-333d-432a-9a13-6c26affd7f9d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.077222 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-59aa0ae9-333d-432a-9a13-6c26affd7f9d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1219 microversion: 2.1 time: 0.084551 Oct 04 18:14:08.077837 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1473/3002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:07 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:08.082342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d167e29-4001-413c-9075-ce03eb862382 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:08.082975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9d167e29-4001-413c-9075-ce03eb862382 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:08.088675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d167e29-4001-413c-9075-ce03eb862382 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.089098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d167e29-4001-413c-9075-ce03eb862382 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.089543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d167e29-4001-413c-9075-ce03eb862382 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.090312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d167e29-4001-413c-9075-ce03eb862382 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.090776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d167e29-4001-413c-9075-ce03eb862382 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.091230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d167e29-4001-413c-9075-ce03eb862382 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.228431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9d167e29-4001-413c-9075-ce03eb862382 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.237367 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9d167e29-4001-413c-9075-ce03eb862382 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1510 microversion: 2.1 time: 0.158556 Oct 04 18:14:08.237957 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1474/3003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:08 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:08.242590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e7076ed1-6896-4aed-a7f8-c7b584c26a58 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d1f72040>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:08.251535 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e7076ed1-6896-4aed-a7f8-c7b584c26a58 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-1763319599" status: 200 len: 1534 microversion: 2.2 time: 0.012618 Oct 04 18:14:08.252084 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1475/3004] 10.222.0.18 () {60 vars in 1258 bytes} [Tue Oct 4 18:14:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1763319599 => generated 1534 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:08.257311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9873c7af-424d-43f9-86a6-745878209cdc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:08.257939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9873c7af-424d-43f9-86a6-745878209cdc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:08.263913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9873c7af-424d-43f9-86a6-745878209cdc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.264457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9873c7af-424d-43f9-86a6-745878209cdc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.264899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9873c7af-424d-43f9-86a6-745878209cdc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.265603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9873c7af-424d-43f9-86a6-745878209cdc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.266092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9873c7af-424d-43f9-86a6-745878209cdc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.266527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9873c7af-424d-43f9-86a6-745878209cdc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.403833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9873c7af-424d-43f9-86a6-745878209cdc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.412429 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9873c7af-424d-43f9-86a6-745878209cdc tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1325 microversion: 2.1 time: 0.158686 Oct 04 18:14:08.413020 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1476/3005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:08 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1325 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:08.418252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3805fd5f-f467-450d-80b3-e46e3b4de5e7 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d6245790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:08.422822 n-d-850499-14 devstack@n-api.service[122331]: WARNING oslo_db.sqlalchemy.utils [None req-3805fd5f-f467-450d-80b3-e46e3b4de5e7 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:14:08.428488 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3805fd5f-f467-450d-80b3-e46e3b4de5e7 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.014238 Oct 04 18:14:08.429049 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1477/3006] 10.222.0.18 () {60 vars in 1177 bytes} [Tue Oct 4 18:14:08 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:08.439343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12c574ed-c49a-48c0-81fa-fddd8a1bdd64 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] Calling method '.version_select at 0x7fd4d1f725e0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:08.458167 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12c574ed-c49a-48c0-81fa-fddd8a1bdd64 tempest-KeyPairsV22TestJSON-382853376 tempest-KeyPairsV22TestJSON-382853376-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763319599" status: 204 len: 0 microversion: 2.2 time: 0.022501 Oct 04 18:14:08.458779 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1478/3007] 10.222.0.18 () {60 vars in 1261 bytes} [Tue Oct 4 18:14:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763319599 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:14:08.860929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ec9929f-7e62-46e6-b6bc-951eb07e231b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:08.861782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4ec9929f-7e62-46e6-b6bc-951eb07e231b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:08.869600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec9929f-7e62-46e6-b6bc-951eb07e231b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.870103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec9929f-7e62-46e6-b6bc-951eb07e231b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.870566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec9929f-7e62-46e6-b6bc-951eb07e231b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.871382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec9929f-7e62-46e6-b6bc-951eb07e231b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.871948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec9929f-7e62-46e6-b6bc-951eb07e231b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.872470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ec9929f-7e62-46e6-b6bc-951eb07e231b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.054099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ec9929f-7e62-46e6-b6bc-951eb07e231b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.064249 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4ec9929f-7e62-46e6-b6bc-951eb07e231b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.207394 Oct 04 18:14:09.066985 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1479/3008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:08 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:09.087130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-904ce3ae-8b97-4733-86c4-e85380b84064 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.093178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-904ce3ae-8b97-4733-86c4-e85380b84064 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.101962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904ce3ae-8b97-4733-86c4-e85380b84064 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.103157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904ce3ae-8b97-4733-86c4-e85380b84064 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.103956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904ce3ae-8b97-4733-86c4-e85380b84064 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.105523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904ce3ae-8b97-4733-86c4-e85380b84064 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.106400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904ce3ae-8b97-4733-86c4-e85380b84064 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.106917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904ce3ae-8b97-4733-86c4-e85380b84064 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.272449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-904ce3ae-8b97-4733-86c4-e85380b84064 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.288607 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-904ce3ae-8b97-4733-86c4-e85380b84064 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1318 microversion: 2.1 time: 0.214893 Oct 04 18:14:09.289258 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1480/3009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:09.294670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-26d3fb3b-650a-431c-8500-5dc6f67e52bb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.295319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-26d3fb3b-650a-431c-8500-5dc6f67e52bb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.305720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26d3fb3b-650a-431c-8500-5dc6f67e52bb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.306220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26d3fb3b-650a-431c-8500-5dc6f67e52bb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.306702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26d3fb3b-650a-431c-8500-5dc6f67e52bb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.307439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26d3fb3b-650a-431c-8500-5dc6f67e52bb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.307904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26d3fb3b-650a-431c-8500-5dc6f67e52bb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.308335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26d3fb3b-650a-431c-8500-5dc6f67e52bb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.387624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-26d3fb3b-650a-431c-8500-5dc6f67e52bb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.398829 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-26d3fb3b-650a-431c-8500-5dc6f67e52bb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1211 microversion: 2.1 time: 0.106048 Oct 04 18:14:09.398829 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1481/3010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:09.408031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9973f48d-2e85-490b-8344-03b5cb2ab06c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.408790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9973f48d-2e85-490b-8344-03b5cb2ab06c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.415269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9973f48d-2e85-490b-8344-03b5cb2ab06c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.415773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9973f48d-2e85-490b-8344-03b5cb2ab06c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.416225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9973f48d-2e85-490b-8344-03b5cb2ab06c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.416993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9973f48d-2e85-490b-8344-03b5cb2ab06c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.418076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9973f48d-2e85-490b-8344-03b5cb2ab06c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.418828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9973f48d-2e85-490b-8344-03b5cb2ab06c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.593778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9973f48d-2e85-490b-8344-03b5cb2ab06c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.601594 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9973f48d-2e85-490b-8344-03b5cb2ab06c tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1510 microversion: 2.1 time: 0.202492 Oct 04 18:14:09.611993 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1482/3011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:09.618981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-429b6bbc-95d5-404a-ae60-98b12257f3fd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.619652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-429b6bbc-95d5-404a-ae60-98b12257f3fd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.627264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429b6bbc-95d5-404a-ae60-98b12257f3fd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.627769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429b6bbc-95d5-404a-ae60-98b12257f3fd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.629007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429b6bbc-95d5-404a-ae60-98b12257f3fd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.630222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429b6bbc-95d5-404a-ae60-98b12257f3fd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.630703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429b6bbc-95d5-404a-ae60-98b12257f3fd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.631215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429b6bbc-95d5-404a-ae60-98b12257f3fd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.777303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-429b6bbc-95d5-404a-ae60-98b12257f3fd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.781291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:09.786815 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-429b6bbc-95d5-404a-ae60-98b12257f3fd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1522 microversion: 2.1 time: 0.173329 Oct 04 18:14:09.787628 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1483/3012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:09.814348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f02c0f7-aa5b-4b07-9fa5-9bae9cb5012e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.815270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f02c0f7-aa5b-4b07-9fa5-9bae9cb5012e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.823191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f02c0f7-aa5b-4b07-9fa5-9bae9cb5012e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.823603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f02c0f7-aa5b-4b07-9fa5-9bae9cb5012e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.823914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f02c0f7-aa5b-4b07-9fa5-9bae9cb5012e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.824715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f02c0f7-aa5b-4b07-9fa5-9bae9cb5012e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.825184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f02c0f7-aa5b-4b07-9fa5-9bae9cb5012e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.826035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f02c0f7-aa5b-4b07-9fa5-9bae9cb5012e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.976913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f02c0f7-aa5b-4b07-9fa5-9bae9cb5012e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.988731 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f02c0f7-aa5b-4b07-9fa5-9bae9cb5012e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1522 microversion: 2.1 time: 0.178886 Oct 04 18:14:09.989322 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1484/3013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:09.994261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c062b206-6a7b-499c-99dc-86907beed399 req-7b5e9ca4-b562-4181-a22f-b22080e16b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8dcc660-4ee0-4c03-994c-bd8c00eea140", "name": "network-vif-deleted", "tag": "0657bd03-e275-4cc6-8a1c-2040ba2533e3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:10.005605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c062b206-6a7b-499c-99dc-86907beed399 req-7b5e9ca4-b562-4181-a22f-b22080e16b1e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.006718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c062b206-6a7b-499c-99dc-86907beed399 req-7b5e9ca4-b562-4181-a22f-b22080e16b1e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.007197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c062b206-6a7b-499c-99dc-86907beed399 req-7b5e9ca4-b562-4181-a22f-b22080e16b1e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.019599 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c062b206-6a7b-499c-99dc-86907beed399 req-7b5e9ca4-b562-4181-a22f-b22080e16b1e service nova] Creating event network-vif-deleted:0657bd03-e275-4cc6-8a1c-2040ba2533e3 for instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 on n-h2-850499-14 Oct 04 18:14:10.025491 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c062b206-6a7b-499c-99dc-86907beed399 req-7b5e9ca4-b562-4181-a22f-b22080e16b1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034978 Oct 04 18:14:10.026110 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1485/3014] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:10.031375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06ea0893-deb4-48a3-99b7-5ded4fe7a8e6 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-865103781"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:10.033830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-06ea0893-deb4-48a3-99b7-5ded4fe7a8e6 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:10.039981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ea0893-deb4-48a3-99b7-5ded4fe7a8e6 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.040475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ea0893-deb4-48a3-99b7-5ded4fe7a8e6 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.040921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ea0893-deb4-48a3-99b7-5ded4fe7a8e6 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.041626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ea0893-deb4-48a3-99b7-5ded4fe7a8e6 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.042091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ea0893-deb4-48a3-99b7-5ded4fe7a8e6 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.042524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ea0893-deb4-48a3-99b7-5ded4fe7a8e6 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.273101 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-06ea0893-deb4-48a3-99b7-5ded4fe7a8e6 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "POST /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7/action" status: 202 len: 0 microversion: 2.1 time: 0.245588 Oct 04 18:14:10.273767 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1486/3015] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:14:10 2022] POST /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:14:10.279043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42a3bca7-9ea0-4862-9410-6391f9d41ef4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.280102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42a3bca7-9ea0-4862-9410-6391f9d41ef4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:10.286370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3bca7-9ea0-4862-9410-6391f9d41ef4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.286941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3bca7-9ea0-4862-9410-6391f9d41ef4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.287408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3bca7-9ea0-4862-9410-6391f9d41ef4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.288112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3bca7-9ea0-4862-9410-6391f9d41ef4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.288576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3bca7-9ea0-4862-9410-6391f9d41ef4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.289011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3bca7-9ea0-4862-9410-6391f9d41ef4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.435584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-42a3bca7-9ea0-4862-9410-6391f9d41ef4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.444262 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42a3bca7-9ea0-4862-9410-6391f9d41ef4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.169176 Oct 04 18:14:10.444862 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1487/3016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:10.564875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c8bc1148-3a29-4730-a349-b169a047a909 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Calling method '.version_select at 0x7fd4d1f9b1f0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.576649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8bc1148-3a29-4730-a349-b169a047a909 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.577728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8bc1148-3a29-4730-a349-b169a047a909 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.578178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8bc1148-3a29-4730-a349-b169a047a909 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.578930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8bc1148-3a29-4730-a349-b169a047a909 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.579456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8bc1148-3a29-4730-a349-b169a047a909 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.579924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8bc1148-3a29-4730-a349-b169a047a909 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.599410 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c8bc1148-3a29-4730-a349-b169a047a909 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.153514 Oct 04 18:14:10.600014 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1488/3017] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/limits => generated 511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:10.604445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-52861872-928a-4c1e-aa60-49ae7257311b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '.version_select at 0x7fd4d1834700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.722595 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-52861872-928a-4c1e-aa60-49ae7257311b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "DELETE /compute/v2.1/images/15f13577-4bdd-4d97-87fa-8df1c564ad45" status: 204 len: 0 microversion: 2.1 time: 0.121515 Oct 04 18:14:10.723228 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1489/3018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:10 2022] DELETE /compute/v2.1/images/15f13577-4bdd-4d97-87fa-8df1c564ad45 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:10.727812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8e55a634-99bd-4cd9-b4e1-a8e38cbcf07b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.728464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8e55a634-99bd-4cd9-b4e1-a8e38cbcf07b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:10.735186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e55a634-99bd-4cd9-b4e1-a8e38cbcf07b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.735683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e55a634-99bd-4cd9-b4e1-a8e38cbcf07b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.736129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e55a634-99bd-4cd9-b4e1-a8e38cbcf07b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.736831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e55a634-99bd-4cd9-b4e1-a8e38cbcf07b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.737294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e55a634-99bd-4cd9-b4e1-a8e38cbcf07b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.737729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e55a634-99bd-4cd9-b4e1-a8e38cbcf07b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.879749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8e55a634-99bd-4cd9-b4e1-a8e38cbcf07b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.888474 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8e55a634-99bd-4cd9-b4e1-a8e38cbcf07b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1318 microversion: 2.1 time: 0.164248 Oct 04 18:14:10.889068 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1490/3019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:10.894528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a1d831d9-8ae0-407e-a0aa-678a5d8af76e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.895181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a1d831d9-8ae0-407e-a0aa-678a5d8af76e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:10.901089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1d831d9-8ae0-407e-a0aa-678a5d8af76e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.901586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1d831d9-8ae0-407e-a0aa-678a5d8af76e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.902036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1d831d9-8ae0-407e-a0aa-678a5d8af76e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.903029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1d831d9-8ae0-407e-a0aa-678a5d8af76e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.903501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1d831d9-8ae0-407e-a0aa-678a5d8af76e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.903938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1d831d9-8ae0-407e-a0aa-678a5d8af76e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.973121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a1d831d9-8ae0-407e-a0aa-678a5d8af76e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.984212 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a1d831d9-8ae0-407e-a0aa-678a5d8af76e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1267 microversion: 2.1 time: 0.092711 Oct 04 18:14:10.985065 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1491/3020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:10.991988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-954f0c32-de49-45b7-a612-7807474e9502 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.992616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-954f0c32-de49-45b7-a612-7807474e9502 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.004310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954f0c32-de49-45b7-a612-7807474e9502 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.004915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954f0c32-de49-45b7-a612-7807474e9502 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.005568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954f0c32-de49-45b7-a612-7807474e9502 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.006303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954f0c32-de49-45b7-a612-7807474e9502 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.006807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954f0c32-de49-45b7-a612-7807474e9502 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.007404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954f0c32-de49-45b7-a612-7807474e9502 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.096610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-954f0c32-de49-45b7-a612-7807474e9502 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.104771 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-954f0c32-de49-45b7-a612-7807474e9502 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1294 microversion: 2.1 time: 0.118562 Oct 04 18:14:11.105595 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1492/3021] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:11.127422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-143ee2f6-5489-4b0e-b663-4b25b3d1f700 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-201310128", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:11.187627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-143ee2f6-5489-4b0e-b663-4b25b3d1f700 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:11.522406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-143ee2f6-5489-4b0e-b663-4b25b3d1f700 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Getting quotas for project 731b014c7ff24fb3aab70ff3f32a0b68. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:11.528402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-143ee2f6-5489-4b0e-b663-4b25b3d1f700 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Getting quotas for user 052611f90fc84077a16c84187a6b4c02 and project 731b014c7ff24fb3aab70ff3f32a0b68. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:11.542405 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-143ee2f6-5489-4b0e-b663-4b25b3d1f700 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-143ee2f6-5489-4b0e-b663-4b25b3d1f700 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Request method failure captured: Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 1751 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHfyVaSMO57a4ziZDj2Um0O2mNKNXd5WimcMyMKcwNx5Sy22YpSnfrI_ugl614SK17eBzl71q9FbCYOqyWXP6lH0rny8qtWJBvP5IAeA372FcKrbPYwczYLGLNXYXJoI5FIH9a7LPlHbDlHe0zrBKgdW48fdZiMDMwX_TxKGV05QnYc Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 731b014c7ff24fb3aab70ff3f32a0b68 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-659114642 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_731b014c7ff24fb3aab70ff3f32a0b68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/731b014c7ff24fb3aab70ff3f32a0b68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/731b014c7ff24fb3aab70ff3f32a0b68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/731b014c7ff24fb3aab70ff3f32a0b68"}]}] Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-659114642 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 731b014c7ff24fb3aab70ff3f32a0b68 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-659114642 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-659114642-project Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 052611f90fc84077a16c84187a6b4c02 Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-659114642-project Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-201310128", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:14:11.552193 n-d-850499-14 devstack@n-api.service[122331]: exception: Maximum number of metadata items exceeds 128 Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-201310128', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:14:11.555333 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-143ee2f6-5489-4b0e-b663-4b25b3d1f700 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:11.558883 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-143ee2f6-5489-4b0e-b663-4b25b3d1f700 tempest-AbsoluteLimitsNegativeTestJSON-659114642 tempest-AbsoluteLimitsNegativeTestJSON-659114642-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.437189 Oct 04 18:14:11.560444 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1493/3022] 10.222.0.18 () {60 vars in 1148 bytes} [Tue Oct 4 18:14:11 2022] POST /compute/v2.1/servers => generated 87 bytes in 453 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:14:11.566469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6321cbb9-7785-4400-a30f-4792248c883b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '.version_select at 0x7fd4d1f52e50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.591011 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-6321cbb9-7785-4400-a30f-4792248c883b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Image not found. Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6321cbb9-7785-4400-a30f-4792248c883b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/images/15f13577-4bdd-4d97-87fa-8df1c564ad45 HTTP/1.1 Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: exception: Image not found. Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '15f13577-4bdd-4d97-87fa-8df1c564ad45'} Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 15f13577-4bdd-4d97-87fa-8df1c564ad45 Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:14:11.593399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 15f13577-4bdd-4d97-87fa-8df1c564ad45 could not be found. Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6321cbb9-7785-4400-a30f-4792248c883b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 404 to user: Image not found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6321cbb9-7785-4400-a30f-4792248c883b tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/images/15f13577-4bdd-4d97-87fa-8df1c564ad45" status: 404 len: 62 microversion: 2.1 time: 0.033203 Oct 04 18:14:11.597266 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1494/3023] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/images/15f13577-4bdd-4d97-87fa-8df1c564ad45 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:14:11.603365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d3a8018-2ec0-42d2-b88f-f157e85b0fce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.603365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d3a8018-2ec0-42d2-b88f-f157e85b0fce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.610511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d3a8018-2ec0-42d2-b88f-f157e85b0fce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.611188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d3a8018-2ec0-42d2-b88f-f157e85b0fce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.611653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d3a8018-2ec0-42d2-b88f-f157e85b0fce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.612377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d3a8018-2ec0-42d2-b88f-f157e85b0fce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.612853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d3a8018-2ec0-42d2-b88f-f157e85b0fce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.613292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d3a8018-2ec0-42d2-b88f-f157e85b0fce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.852517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7d3a8018-2ec0-42d2-b88f-f157e85b0fce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.860495 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d3a8018-2ec0-42d2-b88f-f157e85b0fce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.263686 Oct 04 18:14:11.861105 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1495/3024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:11.866163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac7a0c26-2069-486e-98de-3d3a21b23bcf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.866777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ac7a0c26-2069-486e-98de-3d3a21b23bcf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.874864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac7a0c26-2069-486e-98de-3d3a21b23bcf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.875503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac7a0c26-2069-486e-98de-3d3a21b23bcf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.875955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac7a0c26-2069-486e-98de-3d3a21b23bcf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.876663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac7a0c26-2069-486e-98de-3d3a21b23bcf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.877129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac7a0c26-2069-486e-98de-3d3a21b23bcf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.878095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac7a0c26-2069-486e-98de-3d3a21b23bcf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.958252 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-24658b02-5652-4c41-888a-2858b0221d35 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895/action" status: 202 len: 0 microversion: 2.25 time: 6.836576 Oct 04 18:14:11.962226 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1530/3025] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:14:05 2022] POST /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895/action => generated 0 bytes in 6838 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:11.965612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-221bcdbd-b618-4e49-ab60-19e4f0102803 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.966390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-221bcdbd-b618-4e49-ab60-19e4f0102803 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.980252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-221bcdbd-b618-4e49-ab60-19e4f0102803 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.982279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-221bcdbd-b618-4e49-ab60-19e4f0102803 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.983113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-221bcdbd-b618-4e49-ab60-19e4f0102803 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.986587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-221bcdbd-b618-4e49-ab60-19e4f0102803 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.988186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-221bcdbd-b618-4e49-ab60-19e4f0102803 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.991527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-221bcdbd-b618-4e49-ab60-19e4f0102803 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.056442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ac7a0c26-2069-486e-98de-3d3a21b23bcf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.067247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ac7a0c26-2069-486e-98de-3d3a21b23bcf tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1534 microversion: 2.1 time: 0.204199 Oct 04 18:14:12.083933 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1496/3026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1534 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:12.092091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.092826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:12.108515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.109865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.110370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.111327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.112070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.113657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.247560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-221bcdbd-b618-4e49-ab60-19e4f0102803 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.258076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-221bcdbd-b618-4e49-ab60-19e4f0102803 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1468 microversion: 2.1 time: 0.296863 Oct 04 18:14:12.258861 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1531/3027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1468 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:12.264168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8650b853-0e50-45ff-a6c0-4fee4475b15b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.264995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8650b853-0e50-45ff-a6c0-4fee4475b15b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:12.271914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8650b853-0e50-45ff-a6c0-4fee4475b15b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.272711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8650b853-0e50-45ff-a6c0-4fee4475b15b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.273450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8650b853-0e50-45ff-a6c0-4fee4475b15b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.275560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8650b853-0e50-45ff-a6c0-4fee4475b15b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.276332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8650b853-0e50-45ff-a6c0-4fee4475b15b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.276956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8650b853-0e50-45ff-a6c0-4fee4475b15b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.307991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.319145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.320800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.322047 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65cb1be9-e09f-4f50-9bd1-87033a4c7fff tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.237579 Oct 04 18:14:12.331010 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1497/3028] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:12 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:12.331010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.331010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:12.337127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.337627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.338127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.338845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.339362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.339789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.351231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8650b853-0e50-45ff-a6c0-4fee4475b15b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.361864 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8650b853-0e50-45ff-a6c0-4fee4475b15b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1267 microversion: 2.1 time: 0.101668 Oct 04 18:14:12.363270 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1532/3029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:12 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:12.383280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f78e2510-a319-4bd6-acf2-2a6072e8e7d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-515866120"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:12.386723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:12.387043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f78e2510-a319-4bd6-acf2-2a6072e8e7d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:12.394588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.394942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e2510-a319-4bd6-acf2-2a6072e8e7d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.395416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.395802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e2510-a319-4bd6-acf2-2a6072e8e7d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.396438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.396701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e2510-a319-4bd6-acf2-2a6072e8e7d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.397101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lazy-loading 'fault' on Instance uuid b8dcc660-4ee0-4c03-994c-bd8c00eea140 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:12.397601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e2510-a319-4bd6-acf2-2a6072e8e7d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.398078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e2510-a319-4bd6-acf2-2a6072e8e7d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.398514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e2510-a319-4bd6-acf2-2a6072e8e7d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.445964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.460914 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-28aa8bcf-36ca-48a7-a87f-bd271ba22ac9 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1313 microversion: 2.1 time: 0.136766 Oct 04 18:14:12.461763 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1498/3030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:12 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:12.630839 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f78e2510-a319-4bd6-acf2-2a6072e8e7d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "POST /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5/action" status: 202 len: 0 microversion: 2.1 time: 0.266180 Oct 04 18:14:12.635539 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1533/3031] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:14:12 2022] POST /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:14:12.646380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f5ad9cee-a499-43f7-8586-53ca9d13bbbf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1d5b040>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.693391 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f5ad9cee-a499-43f7-8586-53ca9d13bbbf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.050796 Oct 04 18:14:12.701400 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1499/3032] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:12 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:12.890763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1bee0d74-0907-45ad-b98d-da4801cf92df tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.891495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1bee0d74-0907-45ad-b98d-da4801cf92df tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:12.898785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bee0d74-0907-45ad-b98d-da4801cf92df tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.899305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bee0d74-0907-45ad-b98d-da4801cf92df tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.900046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bee0d74-0907-45ad-b98d-da4801cf92df tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.900953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bee0d74-0907-45ad-b98d-da4801cf92df tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.901562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bee0d74-0907-45ad-b98d-da4801cf92df tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.902144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bee0d74-0907-45ad-b98d-da4801cf92df tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.053428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1bee0d74-0907-45ad-b98d-da4801cf92df tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.064083 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1bee0d74-0907-45ad-b98d-da4801cf92df tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.178634 Oct 04 18:14:13.065092 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1534/3033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:12 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:13.096248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75ee3bbd-776b-4c59-82cb-03e0154b7008 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.097193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75ee3bbd-776b-4c59-82cb-03e0154b7008 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.104565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ee3bbd-776b-4c59-82cb-03e0154b7008 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.105262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ee3bbd-776b-4c59-82cb-03e0154b7008 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.105701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ee3bbd-776b-4c59-82cb-03e0154b7008 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.106861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ee3bbd-776b-4c59-82cb-03e0154b7008 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.107443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ee3bbd-776b-4c59-82cb-03e0154b7008 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.107886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ee3bbd-776b-4c59-82cb-03e0154b7008 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.351807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.353421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.368021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.368763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.369418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.370549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.371592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.372275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.412533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:13.613956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=20 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:13.730765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75ee3bbd-776b-4c59-82cb-03e0154b7008 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.751796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.760467 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75ee3bbd-776b-4c59-82cb-03e0154b7008 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1534 microversion: 2.1 time: 0.670018 Oct 04 18:14:13.761032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.761616 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1500/3034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:13 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1534 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:13.763391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.764839 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-873bd536-71be-4315-9885-040f3d41ec84 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.418972 Oct 04 18:14:13.770662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d9184452-2251-4942-a674-ff239a680147 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.772501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d9184452-2251-4942-a674-ff239a680147 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.779628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9184452-2251-4942-a674-ff239a680147 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.779991 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1535/3035] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:13 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:13.780380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9184452-2251-4942-a674-ff239a680147 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.780969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9184452-2251-4942-a674-ff239a680147 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.781820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9184452-2251-4942-a674-ff239a680147 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.782348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9184452-2251-4942-a674-ff239a680147 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.782997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9184452-2251-4942-a674-ff239a680147 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.789084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.789715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.796435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.796927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.797365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.798259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.798714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.799338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.832249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.833012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.833605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.834226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lazy-loading 'fault' on Instance uuid b8dcc660-4ee0-4c03-994c-bd8c00eea140 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:13.862142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d9184452-2251-4942-a674-ff239a680147 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.873282 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d9184452-2251-4942-a674-ff239a680147 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1273 microversion: 2.1 time: 0.109498 Oct 04 18:14:13.882978 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1501/3036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:13 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:13.882978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf8d8095-8e71-499b-a5ca-f1ad4da1e7d1 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1f59310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.898577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.906903 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8d36e32-6c37-459d-90cb-7a9a2cb3b204 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1313 microversion: 2.1 time: 0.125767 Oct 04 18:14:13.907628 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1536/3037] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:13 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1313 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:13.948054 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf8d8095-8e71-499b-a5ca-f1ad4da1e7d1 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.072011 Oct 04 18:14:13.949016 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1502/3038] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:13 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:14.087030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-be4e2cb4-7711-40af-bc35-dd2f3f2fe44e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:14.087649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-be4e2cb4-7711-40af-bc35-dd2f3f2fe44e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:14.094219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4e2cb4-7711-40af-bc35-dd2f3f2fe44e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.094706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4e2cb4-7711-40af-bc35-dd2f3f2fe44e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.095181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4e2cb4-7711-40af-bc35-dd2f3f2fe44e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.096080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4e2cb4-7711-40af-bc35-dd2f3f2fe44e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.096556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4e2cb4-7711-40af-bc35-dd2f3f2fe44e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.096984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4e2cb4-7711-40af-bc35-dd2f3f2fe44e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.261380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be4e2cb4-7711-40af-bc35-dd2f3f2fe44e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:14.269721 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-be4e2cb4-7711-40af-bc35-dd2f3f2fe44e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.186551 Oct 04 18:14:14.270303 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1537/3039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:14 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:14.795445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7bccc78-3971-4747-90d2-3b0a121d575e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:14.796121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a7bccc78-3971-4747-90d2-3b0a121d575e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:14.797171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:14.798243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:14.807698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.809085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.811265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.814016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.814551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7bccc78-3971-4747-90d2-3b0a121d575e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.815291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7bccc78-3971-4747-90d2-3b0a121d575e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.815628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.816169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.816527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7bccc78-3971-4747-90d2-3b0a121d575e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.817269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7bccc78-3971-4747-90d2-3b0a121d575e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.817912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7bccc78-3971-4747-90d2-3b0a121d575e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.818518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7bccc78-3971-4747-90d2-3b0a121d575e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.224385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a7bccc78-3971-4747-90d2-3b0a121d575e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.230521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.237149 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a7bccc78-3971-4747-90d2-3b0a121d575e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1540 microversion: 2.1 time: 0.453259 Oct 04 18:14:15.254377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.254377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.254377 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-facf4a7e-6b61-4e6a-8098-adc9d44e43a0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.460774 Oct 04 18:14:15.256343 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1503/3040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:14 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1540 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:15.263806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-994da331-c196-4389-8a63-cc92b855131d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:15.266544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-994da331-c196-4389-8a63-cc92b855131d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:15.269319 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1538/3041] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:14 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:15.273918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-994da331-c196-4389-8a63-cc92b855131d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.274833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-994da331-c196-4389-8a63-cc92b855131d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.276657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-994da331-c196-4389-8a63-cc92b855131d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.277653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-994da331-c196-4389-8a63-cc92b855131d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.278281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-994da331-c196-4389-8a63-cc92b855131d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.278932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-994da331-c196-4389-8a63-cc92b855131d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.280710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:15.281461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:15.289288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.290249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.290819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.291695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.292293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.292838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.332671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.333339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.333885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.334450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lazy-loading 'fault' on Instance uuid b8dcc660-4ee0-4c03-994c-bd8c00eea140 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:15.469234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4680d09618342e0bf77aca08de5c6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f7c69bc5f14725b40bcc5cccece335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.480636 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-71490986-3366-4ffb-8af3-157c17ea0486 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 200 len: 1313 microversion: 2.1 time: 0.209955 Oct 04 18:14:15.482658 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1539/3042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:15 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:15.490509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5353e09c-cef3-4db9-bb1c-f80bb63bc8ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d13b2ee0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:15.555005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-994da331-c196-4389-8a63-cc92b855131d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.558730 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5353e09c-cef3-4db9-bb1c-f80bb63bc8ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.074658 Oct 04 18:14:15.567495 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-994da331-c196-4389-8a63-cc92b855131d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1315 microversion: 2.1 time: 0.309448 Oct 04 18:14:15.567965 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1540/3043] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:15 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:15.568755 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1504/3044] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:15 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:15.580895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d40d6876-469b-49a2-9d5c-f6f6b9d1e551 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:15.581708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d40d6876-469b-49a2-9d5c-f6f6b9d1e551 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:15.588399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40d6876-469b-49a2-9d5c-f6f6b9d1e551 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.589317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40d6876-469b-49a2-9d5c-f6f6b9d1e551 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.589921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40d6876-469b-49a2-9d5c-f6f6b9d1e551 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.591051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40d6876-469b-49a2-9d5c-f6f6b9d1e551 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.591661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40d6876-469b-49a2-9d5c-f6f6b9d1e551 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.592511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d40d6876-469b-49a2-9d5c-f6f6b9d1e551 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.822321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d40d6876-469b-49a2-9d5c-f6f6b9d1e551 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.831378 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d40d6876-469b-49a2-9d5c-f6f6b9d1e551 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.261741 Oct 04 18:14:15.848070 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1541/3045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:15 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:15.877011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-9b1a48b7-6e49-4486-a750-d3dc609ae603 req-2b197213-6f7c-4708-b521-923c7aab72be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21532f2f-90bb-4233-9a7c-5b8962cff43e", "tag": "31a9b4ee-d65c-47e2-9a98-93ce28c558a6"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:15.896523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9b1a48b7-6e49-4486-a750-d3dc609ae603 req-2b197213-6f7c-4708-b521-923c7aab72be service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.897369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9b1a48b7-6e49-4486-a750-d3dc609ae603 req-2b197213-6f7c-4708-b521-923c7aab72be service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.900712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9b1a48b7-6e49-4486-a750-d3dc609ae603 req-2b197213-6f7c-4708-b521-923c7aab72be service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.913816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:15.929824 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9b1a48b7-6e49-4486-a750-d3dc609ae603 req-2b197213-6f7c-4708-b521-923c7aab72be service nova] Creating event network-changed:31a9b4ee-d65c-47e2-9a98-93ce28c558a6 for instance 21532f2f-90bb-4233-9a7c-5b8962cff43e on n-h2-850499-14 Oct 04 18:14:15.938382 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-9b1a48b7-6e49-4486-a750-d3dc609ae603 req-2b197213-6f7c-4708-b521-923c7aab72be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065130 Oct 04 18:14:15.940434 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1505/3046] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:16.271550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f49fdc88-3872-4972-a7c9-1fdf6c535137 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.274449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f49fdc88-3872-4972-a7c9-1fdf6c535137 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.283490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.284216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.285157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f49fdc88-3872-4972-a7c9-1fdf6c535137 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.285951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f49fdc88-3872-4972-a7c9-1fdf6c535137 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.288115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f49fdc88-3872-4972-a7c9-1fdf6c535137 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.290367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f49fdc88-3872-4972-a7c9-1fdf6c535137 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.292012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f49fdc88-3872-4972-a7c9-1fdf6c535137 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.292566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f49fdc88-3872-4972-a7c9-1fdf6c535137 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.301254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.302148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.303286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.305358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.306089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.306698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.691380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:16.706246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:16.708282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:16.716465 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fbce51b9-3cc5-486a-b577-b67619b55d36 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.438006 Oct 04 18:14:16.737982 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1506/3047] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:16.744838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.750676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] [instance: b8dcc660-4ee0-4c03-994c-bd8c00eea140] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.774680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.774901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.775396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.776152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f49fdc88-3872-4972-a7c9-1fdf6c535137 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:16.776319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.776781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.777286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.787123 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f49fdc88-3872-4972-a7c9-1fdf6c535137 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1540 microversion: 2.1 time: 0.521078 Oct 04 18:14:16.787704 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1542/3048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1540 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:16.794383 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] HTTP exception thrown: Instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 could not be found. Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Request method failure captured: Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 HTTP/1.1 Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHeTr3ABjd-tDB_PWscmQmxQVb7hgganrsEOrGJJ3fTIjeYuMCwDRcjtF-2dIBB5P-qpM47ASK6xoFr7dAfr6lYuCcMPmP-Po8L59fLsElsNM-GN8sDUR79u6EQBzd55-KRDGjddZH6_4e3iR_kFOApktxlk4ivAhrGRRKopsFN2m6A Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 81f7c69bc5f14725b40bcc5cccece335 Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1265137569 Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81f7c69bc5f14725b40bcc5cccece335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81f7c69bc5f14725b40bcc5cccece335"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81f7c69bc5f14725b40bcc5cccece335"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81f7c69bc5f14725b40bcc5cccece335"}]}] Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1265137569 Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 81f7c69bc5f14725b40bcc5cccece335 Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1265137569 Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerRescueTestJSONUnderV235-1265137569-project Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: e4680d09618342e0bf77aca08de5c6eb Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1265137569-project Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 could not be found. Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'b8dcc660-4ee0-4c03-994c-bd8c00eea140'} Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 could not be found. Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 could not be found. Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:16.796885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:16.801631 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:16.801631 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:16.801631 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:16.801631 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:16.801631 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:16.801631 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:16.801631 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 could not be found. Oct 04 18:14:16.801631 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:16.801631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] Returning 404 to user: Instance b8dcc660-4ee0-4c03-994c-bd8c00eea140 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:16.803572 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-729f8114-77a7-495c-ba83-1265c4102d72 tempest-ServerRescueTestJSONUnderV235-1265137569 tempest-ServerRescueTestJSONUnderV235-1265137569-project] 10.222.0.18 "GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140" status: 404 len: 111 microversion: 2.1 time: 0.065027 Oct 04 18:14:16.803713 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1507/3049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/b8dcc660-4ee0-4c03-994c-bd8c00eea140 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:16.808497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5649c07b-c634-453c-b612-b9353be459a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.815799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e2399508-1656-4741-8247-97724dd87682 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d13a8820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.821098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5649c07b-c634-453c-b612-b9353be459a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.830213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5649c07b-c634-453c-b612-b9353be459a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.830724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5649c07b-c634-453c-b612-b9353be459a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.831221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5649c07b-c634-453c-b612-b9353be459a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.834597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5649c07b-c634-453c-b612-b9353be459a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.835751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5649c07b-c634-453c-b612-b9353be459a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.835751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5649c07b-c634-453c-b612-b9353be459a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.919846 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e2399508-1656-4741-8247-97724dd87682 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.128326 Oct 04 18:14:16.923042 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1543/3050] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:16.939079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-57f589f1-3e2f-4f5e-9198-013343bff0f6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.940193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57f589f1-3e2f-4f5e-9198-013343bff0f6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.948396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57f589f1-3e2f-4f5e-9198-013343bff0f6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.949157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57f589f1-3e2f-4f5e-9198-013343bff0f6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.950642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57f589f1-3e2f-4f5e-9198-013343bff0f6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.951684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57f589f1-3e2f-4f5e-9198-013343bff0f6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.953072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57f589f1-3e2f-4f5e-9198-013343bff0f6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.973392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57f589f1-3e2f-4f5e-9198-013343bff0f6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:17.260430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-57f589f1-3e2f-4f5e-9198-013343bff0f6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:17.274338 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-57f589f1-3e2f-4f5e-9198-013343bff0f6 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.342344 Oct 04 18:14:17.292469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5649c07b-c634-453c-b612-b9353be459a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:17.294573 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1544/3051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:17.301917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d9983a3b-3de3-4bcd-be3d-1e61f9507ec8 req-3732a396-ccb4-487d-abec-65dd1593f345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8473402c-8305-4b12-80a3-a58369427df7", "name": "network-vif-plugged", "status": "completed", "tag": "7b4de8e5-02fc-4739-8a0c-a94e47cb8c83"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:17.316598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d9983a3b-3de3-4bcd-be3d-1e61f9507ec8 req-3732a396-ccb4-487d-abec-65dd1593f345 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:17.316820 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5649c07b-c634-453c-b612-b9353be459a3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1315 microversion: 2.1 time: 0.511327 Oct 04 18:14:17.317657 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1508/3052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:17.318281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d9983a3b-3de3-4bcd-be3d-1e61f9507ec8 req-3732a396-ccb4-487d-abec-65dd1593f345 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:17.319176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d9983a3b-3de3-4bcd-be3d-1e61f9507ec8 req-3732a396-ccb4-487d-abec-65dd1593f345 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:17.354843 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d9983a3b-3de3-4bcd-be3d-1e61f9507ec8 req-3732a396-ccb4-487d-abec-65dd1593f345 service nova] Creating event network-vif-plugged:7b4de8e5-02fc-4739-8a0c-a94e47cb8c83 for instance 8473402c-8305-4b12-80a3-a58369427df7 on n-h2-850499-14 Oct 04 18:14:17.366198 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d9983a3b-3de3-4bcd-be3d-1e61f9507ec8 req-3732a396-ccb4-487d-abec-65dd1593f345 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069951 Oct 04 18:14:17.368943 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1545/3053] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:17.750128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:17.750128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:17.768803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:17.770384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:17.771838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:17.773543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:17.775379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:17.776734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:17.819989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-35ff8ee5-bc9e-4729-9bec-98a771f365ff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:17.821164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-35ff8ee5-bc9e-4729-9bec-98a771f365ff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:17.832180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35ff8ee5-bc9e-4729-9bec-98a771f365ff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:17.836974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35ff8ee5-bc9e-4729-9bec-98a771f365ff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:17.837443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35ff8ee5-bc9e-4729-9bec-98a771f365ff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:17.838244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35ff8ee5-bc9e-4729-9bec-98a771f365ff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:17.838719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35ff8ee5-bc9e-4729-9bec-98a771f365ff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:17.839195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35ff8ee5-bc9e-4729-9bec-98a771f365ff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.218560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.231510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.233397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.234637 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-28902612-a908-4dc0-8779-8c6c07462d38 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.492138 Oct 04 18:14:18.241822 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1509/3054] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:17 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:18.247836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-278eef6f-3bed-4054-bc43-e535a60a8f27 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1eec670>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.268110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-35ff8ee5-bc9e-4729-9bec-98a771f365ff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.277395 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-35ff8ee5-bc9e-4729-9bec-98a771f365ff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1540 microversion: 2.1 time: 0.461740 Oct 04 18:14:18.287361 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1546/3055] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:17 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1540 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:18.308424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b9dc875-0cbe-43f6-b686-2de1d9ba237c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.309370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8b9dc875-0cbe-43f6-b686-2de1d9ba237c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:18.322017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b9dc875-0cbe-43f6-b686-2de1d9ba237c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.322726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b9dc875-0cbe-43f6-b686-2de1d9ba237c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.323387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b9dc875-0cbe-43f6-b686-2de1d9ba237c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.324120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b9dc875-0cbe-43f6-b686-2de1d9ba237c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.327530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b9dc875-0cbe-43f6-b686-2de1d9ba237c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.328057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b9dc875-0cbe-43f6-b686-2de1d9ba237c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.335592 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-278eef6f-3bed-4054-bc43-e535a60a8f27 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.091738 Oct 04 18:14:18.337620 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1510/3056] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:18 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:18.344081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6c7ec398-2b4d-4b4b-bacc-479b6b26d4db tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.345542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6c7ec398-2b4d-4b4b-bacc-479b6b26d4db tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:18.353185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7ec398-2b4d-4b4b-bacc-479b6b26d4db tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.354095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7ec398-2b4d-4b4b-bacc-479b6b26d4db tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.355315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7ec398-2b4d-4b4b-bacc-479b6b26d4db tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.356348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7ec398-2b4d-4b4b-bacc-479b6b26d4db tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.357057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7ec398-2b4d-4b4b-bacc-479b6b26d4db tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.357709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7ec398-2b4d-4b4b-bacc-479b6b26d4db tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.215170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6c7ec398-2b4d-4b4b-bacc-479b6b26d4db tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:19.241931 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6c7ec398-2b4d-4b4b-bacc-479b6b26d4db tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1315 microversion: 2.1 time: 0.902519 Oct 04 18:14:19.242854 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1511/3057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:18 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:19.272374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:19.273507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:19.293686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.294333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.294782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.298102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.298857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.300711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.381320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8b9dc875-0cbe-43f6-b686-2de1d9ba237c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:19.396127 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b9dc875-0cbe-43f6-b686-2de1d9ba237c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 1.092716 Oct 04 18:14:19.400737 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1547/3058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:18 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:19.416807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00e4812c-1320-453c-8418-2e6b67218ae5 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:19.430972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00e4812c-1320-453c-8418-2e6b67218ae5 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:19.447243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e4812c-1320-453c-8418-2e6b67218ae5 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.456708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e4812c-1320-453c-8418-2e6b67218ae5 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.457496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e4812c-1320-453c-8418-2e6b67218ae5 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.458792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e4812c-1320-453c-8418-2e6b67218ae5 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.459451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e4812c-1320-453c-8418-2e6b67218ae5 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.465775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e4812c-1320-453c-8418-2e6b67218ae5 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.718148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:19.732161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:19.734585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:19.737139 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-79fd9ca0-959b-43b5-8ea0-346cac9ac196 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.475321 Oct 04 18:14:19.745010 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1512/3059] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:19 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:19.755752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3293a5fc-1585-4e8d-a672-2288345c6a84 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1c64790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:19.860597 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3293a5fc-1585-4e8d-a672-2288345c6a84 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.110948 Oct 04 18:14:19.861373 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1513/3060] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:19 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:19.873085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00e4812c-1320-453c-8418-2e6b67218ae5 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:19.884042 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00e4812c-1320-453c-8418-2e6b67218ae5 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1540 microversion: 2.1 time: 0.479343 Oct 04 18:14:19.903453 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1548/3061] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:19 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1540 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:20.272678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e89705b5-69b4-4563-ab90-2f3c2a6d953f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.276446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e89705b5-69b4-4563-ab90-2f3c2a6d953f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:20.288632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89705b5-69b4-4563-ab90-2f3c2a6d953f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.289155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89705b5-69b4-4563-ab90-2f3c2a6d953f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.289616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89705b5-69b4-4563-ab90-2f3c2a6d953f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.293883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89705b5-69b4-4563-ab90-2f3c2a6d953f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.294649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89705b5-69b4-4563-ab90-2f3c2a6d953f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.295790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e89705b5-69b4-4563-ab90-2f3c2a6d953f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.424705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3aebb425-03ae-46d2-bd9c-0a1bf1cf6cd5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.425333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3aebb425-03ae-46d2-bd9c-0a1bf1cf6cd5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:20.439610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aebb425-03ae-46d2-bd9c-0a1bf1cf6cd5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.442106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aebb425-03ae-46d2-bd9c-0a1bf1cf6cd5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.442338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aebb425-03ae-46d2-bd9c-0a1bf1cf6cd5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.443347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aebb425-03ae-46d2-bd9c-0a1bf1cf6cd5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.445249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aebb425-03ae-46d2-bd9c-0a1bf1cf6cd5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.446611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aebb425-03ae-46d2-bd9c-0a1bf1cf6cd5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.588980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:20.680381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e89705b5-69b4-4563-ab90-2f3c2a6d953f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.694142 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e89705b5-69b4-4563-ab90-2f3c2a6d953f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1315 microversion: 2.1 time: 0.432547 Oct 04 18:14:20.708573 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1514/3062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:20.768359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3aebb425-03ae-46d2-bd9c-0a1bf1cf6cd5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.783019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.784412 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3aebb425-03ae-46d2-bd9c-0a1bf1cf6cd5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.363595 Oct 04 18:14:20.787030 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1549/3063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:20.792262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:20.813585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.814613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.815457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.816480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.817969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.819487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.877896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1eaca97d-8aee-4d0d-8150-c7401bbd32fe tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1e40280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.944962 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1eaca97d-8aee-4d0d-8150-c7401bbd32fe tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.071519 Oct 04 18:14:20.953189 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1550/3064] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:20.982144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c0bfe1aa-690d-4b9b-a8d9-efaba72c6b7a tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.983136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c0bfe1aa-690d-4b9b-a8d9-efaba72c6b7a tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:21.010541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0bfe1aa-690d-4b9b-a8d9-efaba72c6b7a tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.011143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0bfe1aa-690d-4b9b-a8d9-efaba72c6b7a tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.011613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0bfe1aa-690d-4b9b-a8d9-efaba72c6b7a tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.012357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0bfe1aa-690d-4b9b-a8d9-efaba72c6b7a tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.012828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0bfe1aa-690d-4b9b-a8d9-efaba72c6b7a tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.013270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0bfe1aa-690d-4b9b-a8d9-efaba72c6b7a tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.536094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=24 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:21.705028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.722740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.724558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.729914 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2019d57c-5af1-4041-8db1-7b73ce386a0c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.951899 Oct 04 18:14:21.730939 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1515/3065] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:21.742601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-856481a6-117c-403b-8b19-2abfe3e49442 req-bd8d880d-ea6c-4d46-a25b-58439fee509b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da89d46d-4ae1-466f-9889-e1d528e843e5", "name": "network-vif-plugged", "status": "completed", "tag": "4705f29d-c67d-4649-af0a-38b1ead030b6"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:21.772603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-856481a6-117c-403b-8b19-2abfe3e49442 req-bd8d880d-ea6c-4d46-a25b-58439fee509b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.777624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-856481a6-117c-403b-8b19-2abfe3e49442 req-bd8d880d-ea6c-4d46-a25b-58439fee509b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.778169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-856481a6-117c-403b-8b19-2abfe3e49442 req-bd8d880d-ea6c-4d46-a25b-58439fee509b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.817924 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-856481a6-117c-403b-8b19-2abfe3e49442 req-bd8d880d-ea6c-4d46-a25b-58439fee509b service nova] Creating event network-vif-plugged:4705f29d-c67d-4649-af0a-38b1ead030b6 for instance da89d46d-4ae1-466f-9889-e1d528e843e5 on n-h2-850499-14 Oct 04 18:14:21.829036 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-856481a6-117c-403b-8b19-2abfe3e49442 req-bd8d880d-ea6c-4d46-a25b-58439fee509b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091941 Oct 04 18:14:21.830748 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1516/3066] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:21.842090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac2ffe05-a326-4490-b91b-33dc6098c9af tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:21.843610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ac2ffe05-a326-4490-b91b-33dc6098c9af tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:21.850773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2ffe05-a326-4490-b91b-33dc6098c9af tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.851526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2ffe05-a326-4490-b91b-33dc6098c9af tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.852220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2ffe05-a326-4490-b91b-33dc6098c9af tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.853168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2ffe05-a326-4490-b91b-33dc6098c9af tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.854305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2ffe05-a326-4490-b91b-33dc6098c9af tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.855057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac2ffe05-a326-4490-b91b-33dc6098c9af tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.123025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c0bfe1aa-690d-4b9b-a8d9-efaba72c6b7a tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:22.134649 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c0bfe1aa-690d-4b9b-a8d9-efaba72c6b7a tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1540 microversion: 2.1 time: 1.173265 Oct 04 18:14:22.136702 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1551/3067] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1540 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:22.147779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2280c0ec-f847-4621-a520-2e5edab555a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.154780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2280c0ec-f847-4621-a520-2e5edab555a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:22.161263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2280c0ec-f847-4621-a520-2e5edab555a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.161767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2280c0ec-f847-4621-a520-2e5edab555a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.162223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2280c0ec-f847-4621-a520-2e5edab555a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.162925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2280c0ec-f847-4621-a520-2e5edab555a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.163809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2280c0ec-f847-4621-a520-2e5edab555a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.164619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2280c0ec-f847-4621-a520-2e5edab555a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.522618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ac2ffe05-a326-4490-b91b-33dc6098c9af tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:22.532600 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ac2ffe05-a326-4490-b91b-33dc6098c9af tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1315 microversion: 2.1 time: 0.700327 Oct 04 18:14:22.533668 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1517/3068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:21 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:22.551132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7384f9f7-4a9a-4822-883a-aa577c8b75de tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1c64820>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.621464 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7384f9f7-4a9a-4822-883a-aa577c8b75de tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.086331 Oct 04 18:14:22.622092 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1518/3069] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:22 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:22.731053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2280c0ec-f847-4621-a520-2e5edab555a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:22.750715 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2280c0ec-f847-4621-a520-2e5edab555a1 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.612733 Oct 04 18:14:22.751348 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1552/3070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:22 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:22.756501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.757120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:22.766752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.770373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.770850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.771746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.772224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.772663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.158520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b22cf702-6df9-4181-9dc8-cab98c3d08e1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:23.159774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b22cf702-6df9-4181-9dc8-cab98c3d08e1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:23.167053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b22cf702-6df9-4181-9dc8-cab98c3d08e1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.167778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b22cf702-6df9-4181-9dc8-cab98c3d08e1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.168426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b22cf702-6df9-4181-9dc8-cab98c3d08e1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.169386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b22cf702-6df9-4181-9dc8-cab98c3d08e1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.170018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b22cf702-6df9-4181-9dc8-cab98c3d08e1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.170674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b22cf702-6df9-4181-9dc8-cab98c3d08e1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.221852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.246491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.250316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.251953 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef8e0d96-3e88-4bd1-9a78-54ae206831ae tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.499033 Oct 04 18:14:23.252939 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1519/3071] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:22 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:23.564642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-83b01d50-d1ea-47ad-b233-7895d5cc1643 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:23.565479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-83b01d50-d1ea-47ad-b233-7895d5cc1643 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:23.573378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83b01d50-d1ea-47ad-b233-7895d5cc1643 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.574071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83b01d50-d1ea-47ad-b233-7895d5cc1643 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.574637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83b01d50-d1ea-47ad-b233-7895d5cc1643 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.575578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83b01d50-d1ea-47ad-b233-7895d5cc1643 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.576416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83b01d50-d1ea-47ad-b233-7895d5cc1643 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.577531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83b01d50-d1ea-47ad-b233-7895d5cc1643 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.912872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b22cf702-6df9-4181-9dc8-cab98c3d08e1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.933497 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b22cf702-6df9-4181-9dc8-cab98c3d08e1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1540 microversion: 2.1 time: 0.774555 Oct 04 18:14:23.947028 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1553/3072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1540 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:23.947028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ff889f3-3ec8-42f4-8189-2520ca154f00 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d137c430>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:23.997609 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ff889f3-3ec8-42f4-8189-2520ca154f00 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.061389 Oct 04 18:14:23.998222 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1554/3073] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:24.007413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06ba3abd-bc68-4dba-8931-c3ab983d4d0d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.011758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-06ba3abd-bc68-4dba-8931-c3ab983d4d0d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:24.020963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-83b01d50-d1ea-47ad-b233-7895d5cc1643 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:24.023845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06ba3abd-bc68-4dba-8931-c3ab983d4d0d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.024583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06ba3abd-bc68-4dba-8931-c3ab983d4d0d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.025135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06ba3abd-bc68-4dba-8931-c3ab983d4d0d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.026433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06ba3abd-bc68-4dba-8931-c3ab983d4d0d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.027027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06ba3abd-bc68-4dba-8931-c3ab983d4d0d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.028028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06ba3abd-bc68-4dba-8931-c3ab983d4d0d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.076409 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-83b01d50-d1ea-47ad-b233-7895d5cc1643 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1315 microversion: 2.1 time: 0.515556 Oct 04 18:14:24.078863 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1520/3074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:24.283480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.284326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:24.298923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.299554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.299888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.300603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.302529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.303006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.339551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-06ba3abd-bc68-4dba-8931-c3ab983d4d0d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:24.343381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:24.356688 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-06ba3abd-bc68-4dba-8931-c3ab983d4d0d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.354866 Oct 04 18:14:24.359888 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1555/3075] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:24.556470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:24.575659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b8f589f8-71fb-4e31-99d4-2b506d7eb333 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Calling method '.version_select at 0x7fd4d1acbe50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.582432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:24.584052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:24.585285 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d2e098e-6532-4d9e-b937-6c59fd88fa8a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.306936 Oct 04 18:14:24.586388 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1521/3076] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:24 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:24.622053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-b8f589f8-71fb-4e31-99d4-2b506d7eb333 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 does not exist", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:14:24.622746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.security_group_api [None req-b8f589f8-71fb-4e31-99d4-2b506d7eb333 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Neutron security group f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 not found {{(pid=122332) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:14:24.625000 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-b8f589f8-71fb-4e31-99d4-2b506d7eb333 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] HTTP exception thrown: Security group f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 does not exist Oct 04 18:14:24.625000 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-8e06d72d-1be3-4262-9ca4-9c29f3bb6bbb'] Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b8f589f8-71fb-4e31-99d4-2b506d7eb333 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Request method failure captured: Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-security-groups/f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 HTTP/1.1 Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgA8qDk1RlcQb7l8PcXYxV90cg2kVZ5bkNSGpoQi76Fn-Rd0MqzlSKThWiKKXOS0pPnpDy5BCrITtbMgLUZRwylnTHm-eVVkXrqArbx0vKBkN_fQgxwNAe5fCtNNLJSl77CD2I8wCzOSmHrFyZglCaj3qCOtz3dgoh_Jm1LHre-Crw Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9595a564e8f6458697412340a74d897c Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9595a564e8f6458697412340a74d897c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9595a564e8f6458697412340a74d897c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9595a564e8f6458697412340a74d897c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9595a564e8f6458697412340a74d897c"}]}] Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9595a564e8f6458697412340a74d897c Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupsNegativeTestJSON-1261568331-project Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e36352012e344e48bef90a56914c54f9 Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331-project Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: exception: Security group f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 does not exist Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-8e06d72d-1be3-4262-9ca4-9c29f3bb6bbb'] Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8'} Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:14:24.628515 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 does not exist Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e06d72d-1be3-4262-9ca4-9c29f3bb6bbb'] Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 does not exist Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e06d72d-1be3-4262-9ca4-9c29f3bb6bbb'] Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 does not exist Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e06d72d-1be3-4262-9ca4-9c29f3bb6bbb'] Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 does not exist Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e06d72d-1be3-4262-9ca4-9c29f3bb6bbb'] Oct 04 18:14:24.632969 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:24.637631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b8f589f8-71fb-4e31-99d4-2b506d7eb333 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Returning 404 to user: Security group f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 does not exist Oct 04 18:14:24.637631 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-8e06d72d-1be3-4262-9ca4-9c29f3bb6bbb'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:24.638795 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b8f589f8-71fb-4e31-99d4-2b506d7eb333 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8" status: 404 len: 194 microversion: 2.1 time: 0.221789 Oct 04 18:14:24.639968 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1556/3077] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:14:24 2022] DELETE /compute/v2.1/os-security-groups/f5a0e970-1fd5-4f1f-8808-f5ff5ca6acf8 => generated 194 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:14:24.648850 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a1ceb38-16b8-4c67-b3c4-7a3c884cbe19 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003966 Oct 04 18:14:24.649659 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1522/3078] 10.222.0.18 () {58 vars in 1164 bytes} [Tue Oct 4 18:14:24 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:14:24.661514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-088c1633-060f-4fd1-b9c0-07a9c15d14f8 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Calling method '.version_select at 0x7fd4d12ef430>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.839258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-088c1633-060f-4fd1-b9c0-07a9c15d14f8 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.184327 Oct 04 18:14:24.839853 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1557/3079] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:14:24 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:24.855924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-732db8f9-461d-45f9-88f5-64f549fcde98 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Calling method '.version_select at 0x7fd4d2339310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.962415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8ee504a-be4f-4fb3-bd2c-a2e1acb6345f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.963367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e8ee504a-be4f-4fb3-bd2c-a2e1acb6345f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:24.973810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8ee504a-be4f-4fb3-bd2c-a2e1acb6345f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.974616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8ee504a-be4f-4fb3-bd2c-a2e1acb6345f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.975383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8ee504a-be4f-4fb3-bd2c-a2e1acb6345f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.978534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8ee504a-be4f-4fb3-bd2c-a2e1acb6345f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.979243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8ee504a-be4f-4fb3-bd2c-a2e1acb6345f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.979877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8ee504a-be4f-4fb3-bd2c-a2e1acb6345f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.021332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-732db8f9-461d-45f9-88f5-64f549fcde98 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:14:25.022080 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-732db8f9-461d-45f9-88f5-64f549fcde98 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 18:14:25.022080 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-bf72fc9c-ed54-479d-9b64-d274c17ab523'] Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-732db8f9-461d-45f9-88f5-64f549fcde98 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Request method failure captured: Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-security-groups/ae43b7e4-9951-4f6f-91eb-41b786d18436 HTTP/1.1 Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgA8qDk1RlcQb7l8PcXYxV90cg2kVZ5bkNSGpoQi76Fn-Rd0MqzlSKThWiKKXOS0pPnpDy5BCrITtbMgLUZRwylnTHm-eVVkXrqArbx0vKBkN_fQgxwNAe5fCtNNLJSl77CD2I8wCzOSmHrFyZglCaj3qCOtz3dgoh_Jm1LHre-Crw Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9595a564e8f6458697412340a74d897c Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9595a564e8f6458697412340a74d897c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9595a564e8f6458697412340a74d897c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9595a564e8f6458697412340a74d897c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9595a564e8f6458697412340a74d897c"}]}] Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9595a564e8f6458697412340a74d897c Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsNegativeTestJSON-1261568331-project Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: e36352012e344e48bef90a56914c54f9 Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331-project Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: exception: Insufficient rights for removing default security group. Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-bf72fc9c-ed54-479d-9b64-d274c17ab523'] Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'ae43b7e4-9951-4f6f-91eb-41b786d18436'} Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:14:25.025424 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf72fc9c-ed54-479d-9b64-d274c17ab523'] Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf72fc9c-ed54-479d-9b64-d274c17ab523'] Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf72fc9c-ed54-479d-9b64-d274c17ab523'] Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf72fc9c-ed54-479d-9b64-d274c17ab523'] Oct 04 18:14:25.029677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.035970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-732db8f9-461d-45f9-88f5-64f549fcde98 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 18:14:25.035970 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-bf72fc9c-ed54-479d-9b64-d274c17ab523'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:25.041333 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-732db8f9-461d-45f9-88f5-64f549fcde98 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/ae43b7e4-9951-4f6f-91eb-41b786d18436" status: 400 len: 182 microversion: 2.1 time: 0.190082 Oct 04 18:14:25.042385 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1523/3080] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:14:24 2022] DELETE /compute/v2.1/os-security-groups/ae43b7e4-9951-4f6f-91eb-41b786d18436 => generated 182 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:14:25.061497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-82766497-5f68-4e66-8b2e-a55178056ab3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d210bd30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.127919 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-82766497-5f68-4e66-8b2e-a55178056ab3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.075418 Oct 04 18:14:25.128832 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1524/3081] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:25.133889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-513fd9df-541f-4ee5-a3e9-beeb4185e826 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Calling method '.version_select at 0x7fd4d2448310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.217249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8ee504a-be4f-4fb3-bd2c-a2e1acb6345f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.217611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-513fd9df-541f-4ee5-a3e9-beeb4185e826 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:14:25.218539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-513fd9df-541f-4ee5-a3e9-beeb4185e826 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Neutron security group c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:14:25.219350 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-513fd9df-541f-4ee5-a3e9-beeb4185e826 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] HTTP exception thrown: Security group c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 does not exist Oct 04 18:14:25.219350 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-8843b873-0007-45f6-8550-f2c60c84ac2c'] Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-513fd9df-541f-4ee5-a3e9-beeb4185e826 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Request method failure captured: Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-security-groups/c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 HTTP/1.1 Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgA8qDk1RlcQb7l8PcXYxV90cg2kVZ5bkNSGpoQi76Fn-Rd0MqzlSKThWiKKXOS0pPnpDy5BCrITtbMgLUZRwylnTHm-eVVkXrqArbx0vKBkN_fQgxwNAe5fCtNNLJSl77CD2I8wCzOSmHrFyZglCaj3qCOtz3dgoh_Jm1LHre-Crw Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9595a564e8f6458697412340a74d897c Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9595a564e8f6458697412340a74d897c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9595a564e8f6458697412340a74d897c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9595a564e8f6458697412340a74d897c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9595a564e8f6458697412340a74d897c"}]}] Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9595a564e8f6458697412340a74d897c Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsNegativeTestJSON-1261568331-project Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: e36352012e344e48bef90a56914c54f9 Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331-project Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: exception: Security group c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 does not exist Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-8843b873-0007-45f6-8550-f2c60c84ac2c'] Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2'} Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:14:25.221456 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 does not exist Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8843b873-0007-45f6-8550-f2c60c84ac2c'] Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 does not exist Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8843b873-0007-45f6-8550-f2c60c84ac2c'] Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 does not exist Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8843b873-0007-45f6-8550-f2c60c84ac2c'] Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 does not exist Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8843b873-0007-45f6-8550-f2c60c84ac2c'] Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-513fd9df-541f-4ee5-a3e9-beeb4185e826 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Returning 404 to user: Security group c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 does not exist Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-8843b873-0007-45f6-8550-f2c60c84ac2c'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-513fd9df-541f-4ee5-a3e9-beeb4185e826 tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2" status: 404 len: 194 microversion: 2.1 time: 0.093116 Oct 04 18:14:25.225200 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1525/3082] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/os-security-groups/c5279aa8-cc2a-4aa2-848d-b2a1ce2a03e2 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:25.235442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9c9ac6cc-de7c-413e-ab0e-94b596be1ec2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.236095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9c9ac6cc-de7c-413e-ab0e-94b596be1ec2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.238610 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e8ee504a-be4f-4fb3-bd2c-a2e1acb6345f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1540 microversion: 2.1 time: 0.281649 Oct 04 18:14:25.239234 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1558/3083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:24 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1540 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:25.254686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9ac6cc-de7c-413e-ab0e-94b596be1ec2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.254686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9ac6cc-de7c-413e-ab0e-94b596be1ec2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.254686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9ac6cc-de7c-413e-ab0e-94b596be1ec2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.254686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9ac6cc-de7c-413e-ab0e-94b596be1ec2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.254686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9ac6cc-de7c-413e-ab0e-94b596be1ec2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.254686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c9ac6cc-de7c-413e-ab0e-94b596be1ec2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.262160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e571b356-99bc-42a2-9769-51ea2b8c2938 req-5ced8cf4-4838-4744-9cf1-2bac1d52c18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21532f2f-90bb-4233-9a7c-5b8962cff43e", "name": "network-vif-plugged", "status": "completed", "tag": "31a9b4ee-d65c-47e2-9a98-93ce28c558a6"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:25.273908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e571b356-99bc-42a2-9769-51ea2b8c2938 req-5ced8cf4-4838-4744-9cf1-2bac1d52c18c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.274620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e571b356-99bc-42a2-9769-51ea2b8c2938 req-5ced8cf4-4838-4744-9cf1-2bac1d52c18c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.275240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e571b356-99bc-42a2-9769-51ea2b8c2938 req-5ced8cf4-4838-4744-9cf1-2bac1d52c18c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.288559 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e571b356-99bc-42a2-9769-51ea2b8c2938 req-5ced8cf4-4838-4744-9cf1-2bac1d52c18c service nova] Creating event network-vif-plugged:31a9b4ee-d65c-47e2-9a98-93ce28c558a6 for instance 21532f2f-90bb-4233-9a7c-5b8962cff43e on n-h2-850499-14 Oct 04 18:14:25.295094 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e571b356-99bc-42a2-9769-51ea2b8c2938 req-5ced8cf4-4838-4744-9cf1-2bac1d52c18c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037882 Oct 04 18:14:25.296678 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1559/3084] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:25.303952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60c39632-34a5-4e7a-8e9e-8769923f0a4f tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Action: 'update', calling method: .version_select at 0x7fd4d13b2310>, body: {"security_group": {"name": "tempest-sg-725169497", "description": "tempest-description-2016005216"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:25.365645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-60c39632-34a5-4e7a-8e9e-8769923f0a4f tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 does not exist", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:14:25.367458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.security_group_api [None req-60c39632-34a5-4e7a-8e9e-8769923f0a4f tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Neutron security group ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 not found {{(pid=122332) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:14:25.368054 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-60c39632-34a5-4e7a-8e9e-8769923f0a4f tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] HTTP exception thrown: Security group ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 does not exist Oct 04 18:14:25.368054 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-f8dd514b-c082-4801-884a-c0bd6037e096'] Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60c39632-34a5-4e7a-8e9e-8769923f0a4f tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Request method failure captured: Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: request: PUT /compute/v2.1/os-security-groups/ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 HTTP/1.1 Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 101 Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgA8qDk1RlcQb7l8PcXYxV90cg2kVZ5bkNSGpoQi76Fn-Rd0MqzlSKThWiKKXOS0pPnpDy5BCrITtbMgLUZRwylnTHm-eVVkXrqArbx0vKBkN_fQgxwNAe5fCtNNLJSl77CD2I8wCzOSmHrFyZglCaj3qCOtz3dgoh_Jm1LHre-Crw Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9595a564e8f6458697412340a74d897c Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9595a564e8f6458697412340a74d897c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9595a564e8f6458697412340a74d897c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9595a564e8f6458697412340a74d897c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9595a564e8f6458697412340a74d897c"}]}] Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9595a564e8f6458697412340a74d897c Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331 Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupsNegativeTestJSON-1261568331-project Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e36352012e344e48bef90a56914c54f9 Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1261568331-project Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: {"security_group": {"name": "tempest-sg-725169497", "description": "tempest-description-2016005216"}} Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: exception: Security group ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 does not exist Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-f8dd514b-c082-4801-884a-c0bd6037e096'] Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3', 'body': {'security_group': {'name': 'tempest-sg-725169497', 'description': 'tempest-description-2016005216'}}} Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:14:25.370721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 does not exist Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8dd514b-c082-4801-884a-c0bd6037e096'] Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 does not exist Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8dd514b-c082-4801-884a-c0bd6037e096'] Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 does not exist Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8dd514b-c082-4801-884a-c0bd6037e096'] Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 does not exist Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8dd514b-c082-4801-884a-c0bd6037e096'] Oct 04 18:14:25.375750 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:25.382111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60c39632-34a5-4e7a-8e9e-8769923f0a4f tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] Returning 404 to user: Security group ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 does not exist Oct 04 18:14:25.382111 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-f8dd514b-c082-4801-884a-c0bd6037e096'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:25.383116 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-60c39632-34a5-4e7a-8e9e-8769923f0a4f tempest-SecurityGroupsNegativeTestJSON-1261568331 tempest-SecurityGroupsNegativeTestJSON-1261568331-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3" status: 404 len: 194 microversion: 2.1 time: 0.085086 Oct 04 18:14:25.384191 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1560/3085] 10.222.0.18 () {60 vars in 1290 bytes} [Tue Oct 4 18:14:25 2022] PUT /compute/v2.1/os-security-groups/ee4aabf1-c648-4f6a-8b78-2e27fc09a5c3 => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:25.393947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-364e8e57-465d-4187-9376-a0f367cbe980 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.394714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-364e8e57-465d-4187-9376-a0f367cbe980 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.404797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-364e8e57-465d-4187-9376-a0f367cbe980 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.405929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-364e8e57-465d-4187-9376-a0f367cbe980 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.406813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-364e8e57-465d-4187-9376-a0f367cbe980 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.408109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-364e8e57-465d-4187-9376-a0f367cbe980 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.408978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-364e8e57-465d-4187-9376-a0f367cbe980 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.409723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-364e8e57-465d-4187-9376-a0f367cbe980 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.452994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9c9ac6cc-de7c-413e-ab0e-94b596be1ec2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.463168 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9c9ac6cc-de7c-413e-ab0e-94b596be1ec2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1315 microversion: 2.1 time: 0.238551 Oct 04 18:14:25.464219 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1526/3086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:25.611985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.612806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.616980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-364e8e57-465d-4187-9376-a0f367cbe980 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.625572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.626198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.626767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.627682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.627832 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-364e8e57-465d-4187-9376-a0f367cbe980 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.242143 Oct 04 18:14:25.629463 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1561/3087] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:25.631206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.631206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.838480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.860632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.865143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.868093 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd620426-41d7-4c1c-b4f2-869ba5ee0921 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.260275 Oct 04 18:14:25.870356 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1527/3088] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:26.146180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0587482e-0df4-4824-8a2d-7f5fd4486a11 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d13b21f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.234119 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0587482e-0df4-4824-8a2d-7f5fd4486a11 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.092367 Oct 04 18:14:26.234828 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1562/3089] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:26.270040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4859bd99-83c9-43da-845c-6f7b453161f0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.271172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4859bd99-83c9-43da-845c-6f7b453161f0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.279106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4859bd99-83c9-43da-845c-6f7b453161f0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.280028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4859bd99-83c9-43da-845c-6f7b453161f0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.280797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4859bd99-83c9-43da-845c-6f7b453161f0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.282059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4859bd99-83c9-43da-845c-6f7b453161f0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.282929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4859bd99-83c9-43da-845c-6f7b453161f0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.283849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4859bd99-83c9-43da-845c-6f7b453161f0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.486085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4859bd99-83c9-43da-845c-6f7b453161f0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:26.490264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af7d423c-5c02-4b3d-9939-bab046ebc648 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.491020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-af7d423c-5c02-4b3d-9939-bab046ebc648 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.495247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4859bd99-83c9-43da-845c-6f7b453161f0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1535 microversion: 2.1 time: 0.231869 Oct 04 18:14:26.495923 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1528/3090] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1535 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:26.500259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7d423c-5c02-4b3d-9939-bab046ebc648 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.500846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7d423c-5c02-4b3d-9939-bab046ebc648 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.501414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7d423c-5c02-4b3d-9939-bab046ebc648 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.502296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7d423c-5c02-4b3d-9939-bab046ebc648 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.502995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7d423c-5c02-4b3d-9939-bab046ebc648 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.503651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af7d423c-5c02-4b3d-9939-bab046ebc648 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.655281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc8c4560-ab9b-4cc8-a71f-154c5f380c99 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.655931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc8c4560-ab9b-4cc8-a71f-154c5f380c99 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.664736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc8c4560-ab9b-4cc8-a71f-154c5f380c99 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.667533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc8c4560-ab9b-4cc8-a71f-154c5f380c99 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.667834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc8c4560-ab9b-4cc8-a71f-154c5f380c99 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.668921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc8c4560-ab9b-4cc8-a71f-154c5f380c99 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.671974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc8c4560-ab9b-4cc8-a71f-154c5f380c99 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.672783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc8c4560-ab9b-4cc8-a71f-154c5f380c99 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.689342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-af7d423c-5c02-4b3d-9939-bab046ebc648 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:26.698658 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-af7d423c-5c02-4b3d-9939-bab046ebc648 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1315 microversion: 2.1 time: 0.214666 Oct 04 18:14:26.699561 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1563/3091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:26.861672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bc8c4560-ab9b-4cc8-a71f-154c5f380c99 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:26.871497 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc8c4560-ab9b-4cc8-a71f-154c5f380c99 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1511 microversion: 2.1 time: 0.221076 Oct 04 18:14:26.873076 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1529/3092] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:26.898749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.899730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.906935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:26.910168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.911369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.911897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.919358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.920262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.921456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.225536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.239833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.250364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-deade4e8-4757-41c7-ac3b-2f0ba527dc3f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1d3fdc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.251550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.255959 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-94241475-be48-4bad-baf8-527c3ff0a0da tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.359006 Oct 04 18:14:27.275476 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1564/3093] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:27.332944 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-deade4e8-4757-41c7-ac3b-2f0ba527dc3f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.084537 Oct 04 18:14:27.335061 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1530/3094] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:27 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:27.518844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d7939d92-db89-4b99-aad3-c38fc858eb59 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.519606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d7939d92-db89-4b99-aad3-c38fc858eb59 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:27.528518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7939d92-db89-4b99-aad3-c38fc858eb59 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.529077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7939d92-db89-4b99-aad3-c38fc858eb59 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.529519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7939d92-db89-4b99-aad3-c38fc858eb59 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.530506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7939d92-db89-4b99-aad3-c38fc858eb59 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.531467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7939d92-db89-4b99-aad3-c38fc858eb59 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.532818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7939d92-db89-4b99-aad3-c38fc858eb59 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.727781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d2a4465-53ca-4850-bc94-5467ca7a5828 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.729694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d2a4465-53ca-4850-bc94-5467ca7a5828 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:27.740294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d2a4465-53ca-4850-bc94-5467ca7a5828 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.741115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d2a4465-53ca-4850-bc94-5467ca7a5828 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.741735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d2a4465-53ca-4850-bc94-5467ca7a5828 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.754634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d2a4465-53ca-4850-bc94-5467ca7a5828 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.755786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d2a4465-53ca-4850-bc94-5467ca7a5828 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.756467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d2a4465-53ca-4850-bc94-5467ca7a5828 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.055537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d7939d92-db89-4b99-aad3-c38fc858eb59 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:28.066762 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d7939d92-db89-4b99-aad3-c38fc858eb59 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1522 microversion: 2.1 time: 0.552089 Oct 04 18:14:28.071835 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1565/3095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:27 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:28.082809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-14a03fc4-1c4a-43eb-bcc1-0ebb76688442 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.083807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-14a03fc4-1c4a-43eb-bcc1-0ebb76688442 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.096135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14a03fc4-1c4a-43eb-bcc1-0ebb76688442 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.099235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14a03fc4-1c4a-43eb-bcc1-0ebb76688442 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.101159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14a03fc4-1c4a-43eb-bcc1-0ebb76688442 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.103635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14a03fc4-1c4a-43eb-bcc1-0ebb76688442 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.104337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14a03fc4-1c4a-43eb-bcc1-0ebb76688442 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.106006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-14a03fc4-1c4a-43eb-bcc1-0ebb76688442 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.189664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d2a4465-53ca-4850-bc94-5467ca7a5828 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:28.193498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:28.210516 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3d2a4465-53ca-4850-bc94-5467ca7a5828 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1315 microversion: 2.1 time: 0.479458 Oct 04 18:14:28.211435 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1531/3096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:27 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:28.231218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ad099a8-7c2c-4a31-9b13-20f3e056582d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.231868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7ad099a8-7c2c-4a31-9b13-20f3e056582d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.244906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad099a8-7c2c-4a31-9b13-20f3e056582d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.250158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad099a8-7c2c-4a31-9b13-20f3e056582d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.250933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad099a8-7c2c-4a31-9b13-20f3e056582d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.252144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad099a8-7c2c-4a31-9b13-20f3e056582d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.252909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad099a8-7c2c-4a31-9b13-20f3e056582d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.253599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad099a8-7c2c-4a31-9b13-20f3e056582d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.297073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7ad099a8-7c2c-4a31-9b13-20f3e056582d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:28.451052 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ad099a8-7c2c-4a31-9b13-20f3e056582d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 204 len: 0 microversion: 2.1 time: 0.230337 Oct 04 18:14:28.452292 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1532/3097] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:28 2022] DELETE /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:28.461731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.463037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.471378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.472271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.472985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.473965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.474809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.476171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.611224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-14a03fc4-1c4a-43eb-bcc1-0ebb76688442 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:28.627342 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-14a03fc4-1c4a-43eb-bcc1-0ebb76688442 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1488 microversion: 2.1 time: 0.550585 Oct 04 18:14:28.628193 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1566/3098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1488 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:28.640428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f790713a-918a-4967-b825-c4318f301d9f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1acbdc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.740334 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f790713a-918a-4967-b825-c4318f301d9f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.110757 Oct 04 18:14:28.741497 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1567/3099] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:28.747040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f1b15f7-8efa-4bb8-b21b-d2682cf1ffb0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.747970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4f1b15f7-8efa-4bb8-b21b-d2682cf1ffb0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.768568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f1b15f7-8efa-4bb8-b21b-d2682cf1ffb0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.771865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f1b15f7-8efa-4bb8-b21b-d2682cf1ffb0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.773469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f1b15f7-8efa-4bb8-b21b-d2682cf1ffb0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.775257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f1b15f7-8efa-4bb8-b21b-d2682cf1ffb0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.777269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f1b15f7-8efa-4bb8-b21b-d2682cf1ffb0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.778147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f1b15f7-8efa-4bb8-b21b-d2682cf1ffb0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.996310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.022274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.030186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.041939 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7733571f-2b73-48c8-8259-300098b252fd tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.584693 Oct 04 18:14:29.050183 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1533/3100] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:29.089215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6772c5e7-1e0a-4b6b-912a-1eca82a478a9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.090066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6772c5e7-1e0a-4b6b-912a-1eca82a478a9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.104491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6772c5e7-1e0a-4b6b-912a-1eca82a478a9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.111387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6772c5e7-1e0a-4b6b-912a-1eca82a478a9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.111964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6772c5e7-1e0a-4b6b-912a-1eca82a478a9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.113391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6772c5e7-1e0a-4b6b-912a-1eca82a478a9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.114038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6772c5e7-1e0a-4b6b-912a-1eca82a478a9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.115491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6772c5e7-1e0a-4b6b-912a-1eca82a478a9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.196657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6772c5e7-1e0a-4b6b-912a-1eca82a478a9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:29.376740 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6772c5e7-1e0a-4b6b-912a-1eca82a478a9 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 204 len: 0 microversion: 2.1 time: 0.303956 Oct 04 18:14:29.383712 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1534/3101] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:29 2022] DELETE /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:29.390844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2a72e19d-dfa2-4a78-970d-c736c3f75f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.391999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2a72e19d-dfa2-4a78-970d-c736c3f75f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.402185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a72e19d-dfa2-4a78-970d-c736c3f75f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.403662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a72e19d-dfa2-4a78-970d-c736c3f75f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.404431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a72e19d-dfa2-4a78-970d-c736c3f75f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.405970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a72e19d-dfa2-4a78-970d-c736c3f75f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.406853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a72e19d-dfa2-4a78-970d-c736c3f75f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.407597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a72e19d-dfa2-4a78-970d-c736c3f75f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.473364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4f1b15f7-8efa-4bb8-b21b-d2682cf1ffb0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.488380 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f1b15f7-8efa-4bb8-b21b-d2682cf1ffb0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1528 microversion: 2.1 time: 0.745029 Oct 04 18:14:29.492705 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1568/3102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1528 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:29.517639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6cb640a4-88aa-41b6-a344-8b3f9c73d4a4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.518437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6cb640a4-88aa-41b6-a344-8b3f9c73d4a4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.535450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cb640a4-88aa-41b6-a344-8b3f9c73d4a4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.537996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cb640a4-88aa-41b6-a344-8b3f9c73d4a4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.538601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cb640a4-88aa-41b6-a344-8b3f9c73d4a4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.540549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cb640a4-88aa-41b6-a344-8b3f9c73d4a4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.542149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cb640a4-88aa-41b6-a344-8b3f9c73d4a4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.542808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cb640a4-88aa-41b6-a344-8b3f9c73d4a4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.139313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2a72e19d-dfa2-4a78-970d-c736c3f75f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:30.162026 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2a72e19d-dfa2-4a78-970d-c736c3f75f37 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1502 microversion: 2.1 time: 0.776287 Oct 04 18:14:30.165304 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1535/3103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:29 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1502 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:30.186149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b9875512-1066-47e1-bceb-e7cfd2a4db89 req-ba8f5142-8e17-4f4c-8dca-532c8994a04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8473402c-8305-4b12-80a3-a58369427df7", "name": "network-vif-unplugged", "status": "completed", "tag": "7b4de8e5-02fc-4739-8a0c-a94e47cb8c83"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:30.237518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b9875512-1066-47e1-bceb-e7cfd2a4db89 req-ba8f5142-8e17-4f4c-8dca-532c8994a04c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.238019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b9875512-1066-47e1-bceb-e7cfd2a4db89 req-ba8f5142-8e17-4f4c-8dca-532c8994a04c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.238465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b9875512-1066-47e1-bceb-e7cfd2a4db89 req-ba8f5142-8e17-4f4c-8dca-532c8994a04c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.269914 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b9875512-1066-47e1-bceb-e7cfd2a4db89 req-ba8f5142-8e17-4f4c-8dca-532c8994a04c service nova] Creating event network-vif-unplugged:7b4de8e5-02fc-4739-8a0c-a94e47cb8c83 for instance 8473402c-8305-4b12-80a3-a58369427df7 on n-h2-850499-14 Oct 04 18:14:30.274819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6cb640a4-88aa-41b6-a344-8b3f9c73d4a4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:30.284782 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6cb640a4-88aa-41b6-a344-8b3f9c73d4a4 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1494 microversion: 2.1 time: 0.788183 Oct 04 18:14:30.285613 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b9875512-1066-47e1-bceb-e7cfd2a4db89 req-ba8f5142-8e17-4f4c-8dca-532c8994a04c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113587 Oct 04 18:14:30.289282 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1536/3104] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:30.301373 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1569/3105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:29 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1494 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:30.301373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:30.301373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:30.321531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e0905313-55b9-4bb5-a4cf-3d954191bb51 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1c64c10>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:30.332597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.344397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.345628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.351631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.352294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.354289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.422239 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e0905313-55b9-4bb5-a4cf-3d954191bb51 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.115857 Oct 04 18:14:30.448312 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1537/3106] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:30 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:30.468015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8c53d2df-6ad3-48b3-a471-dd185ee3c627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1147880696"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:30.472276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c53d2df-6ad3-48b3-a471-dd185ee3c627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:30.488998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c53d2df-6ad3-48b3-a471-dd185ee3c627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.493069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c53d2df-6ad3-48b3-a471-dd185ee3c627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.493947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c53d2df-6ad3-48b3-a471-dd185ee3c627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.498287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c53d2df-6ad3-48b3-a471-dd185ee3c627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.500029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c53d2df-6ad3-48b3-a471-dd185ee3c627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.504226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c53d2df-6ad3-48b3-a471-dd185ee3c627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.032218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:31.069950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:31.074735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:31.081776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-acdb02bc-ddc0-463a-9e3b-b39a8e825e81 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.779327 Oct 04 18:14:31.085426 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1570/3107] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:30 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:31.104428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c46d28aa-5bb4-4a3a-be7e-a845a3d0463d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:31.106827 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.network.security_group_api [None req-8c53d2df-6ad3-48b3-a471-dd185ee3c627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Adding security group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 to port 31a9b4ee-d65c-47e2-9a98-93ce28c558a6 Oct 04 18:14:31.107477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c46d28aa-5bb4-4a3a-be7e-a845a3d0463d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:31.149316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46d28aa-5bb4-4a3a-be7e-a845a3d0463d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.149829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46d28aa-5bb4-4a3a-be7e-a845a3d0463d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.150279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46d28aa-5bb4-4a3a-be7e-a845a3d0463d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.151116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46d28aa-5bb4-4a3a-be7e-a845a3d0463d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.151565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46d28aa-5bb4-4a3a-be7e-a845a3d0463d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.166217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46d28aa-5bb4-4a3a-be7e-a845a3d0463d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.109284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c46d28aa-5bb4-4a3a-be7e-a845a3d0463d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.118754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c46d28aa-5bb4-4a3a-be7e-a845a3d0463d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1528 microversion: 2.1 time: 1.028371 Oct 04 18:14:32.122854 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1571/3108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:31 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1528 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:32.144131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-08866e98-ffb8-4609-847e-6488043d7f90 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:32.144931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-08866e98-ffb8-4609-847e-6488043d7f90 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:32.153048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08866e98-ffb8-4609-847e-6488043d7f90 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.154036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08866e98-ffb8-4609-847e-6488043d7f90 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.154827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08866e98-ffb8-4609-847e-6488043d7f90 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.156276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08866e98-ffb8-4609-847e-6488043d7f90 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.156845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08866e98-ffb8-4609-847e-6488043d7f90 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.157380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08866e98-ffb8-4609-847e-6488043d7f90 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.630258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08866e98-ffb8-4609-847e-6488043d7f90 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.648459 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-08866e98-ffb8-4609-847e-6488043d7f90 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1494 microversion: 2.1 time: 0.524200 Oct 04 18:14:32.651454 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1572/3109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:32 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1494 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:32.664365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c7a77814-a069-4a68-8884-b511f9a77cfb tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d13a8ca0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:32.771902 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8c53d2df-6ad3-48b3-a471-dd185ee3c627 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e/action" status: 202 len: 0 microversion: 2.1 time: 2.321581 Oct 04 18:14:32.773286 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1538/3110] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:14:30 2022] POST /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e/action => generated 0 bytes in 2324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:32.785332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:32.787080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:32.829056 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c7a77814-a069-4a68-8884-b511f9a77cfb tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.174688 Oct 04 18:14:32.831911 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1573/3111] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:32 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:32.843770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.847202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c0be7cad-a0a9-4fc0-b3ea-67aecc36eb8a req-d0d12a9d-ad77-4073-8a8d-816447523ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21532f2f-90bb-4233-9a7c-5b8962cff43e", "tag": "31a9b4ee-d65c-47e2-9a98-93ce28c558a6"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:32.850789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.851291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.852059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.852567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.852984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.914910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c0be7cad-a0a9-4fc0-b3ea-67aecc36eb8a req-d0d12a9d-ad77-4073-8a8d-816447523ef6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.916551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c0be7cad-a0a9-4fc0-b3ea-67aecc36eb8a req-d0d12a9d-ad77-4073-8a8d-816447523ef6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.917568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c0be7cad-a0a9-4fc0-b3ea-67aecc36eb8a req-d0d12a9d-ad77-4073-8a8d-816447523ef6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.982970 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c0be7cad-a0a9-4fc0-b3ea-67aecc36eb8a req-d0d12a9d-ad77-4073-8a8d-816447523ef6 service nova] Creating event network-changed:31a9b4ee-d65c-47e2-9a98-93ce28c558a6 for instance 21532f2f-90bb-4233-9a7c-5b8962cff43e on n-h2-850499-14 Oct 04 18:14:33.016666 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c0be7cad-a0a9-4fc0-b3ea-67aecc36eb8a req-d0d12a9d-ad77-4073-8a8d-816447523ef6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177524 Oct 04 18:14:33.017697 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1574/3112] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:33.033141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e23bf53e-6266-475d-b935-9ca54fd61839 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d1b30b80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.584585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.604299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.605981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.608688 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ded87938-76aa-4b79-8830-e3f8e9aa1f91 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.833950 Oct 04 18:14:33.619582 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1539/3113] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:32 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:33.630478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f419340c-35d1-4b1b-bc78-ef134689993f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.634463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f419340c-35d1-4b1b-bc78-ef134689993f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:33.651459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f419340c-35d1-4b1b-bc78-ef134689993f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.652365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f419340c-35d1-4b1b-bc78-ef134689993f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.652851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-e23bf53e-6266-475d-b935-9ca54fd61839 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 in use.", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:14:33.654000 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-e23bf53e-6266-475d-b935-9ca54fd61839 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security Group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 in use. Oct 04 18:14:33.654000 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-db9767c5-a31f-401d-b0af-f33ee4c965d5'] Oct 04 18:14:33.654539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f419340c-35d1-4b1b-bc78-ef134689993f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.656320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f419340c-35d1-4b1b-bc78-ef134689993f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e23bf53e-6266-475d-b935-9ca54fd61839 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-security-groups/2511c79e-9bb0-4a91-94ed-6aa131ef5830 HTTP/1.1 Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: exception: Security Group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 in use. Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-db9767c5-a31f-401d-b0af-f33ee4c965d5'] Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '2511c79e-9bb0-4a91-94ed-6aa131ef5830'} Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:14:33.658359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 in use. Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db9767c5-a31f-401d-b0af-f33ee4c965d5'] Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 in use. Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db9767c5-a31f-401d-b0af-f33ee4c965d5'] Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 in use. Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db9767c5-a31f-401d-b0af-f33ee4c965d5'] Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 in use. Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db9767c5-a31f-401d-b0af-f33ee4c965d5'] Oct 04 18:14:33.663134 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:33.665771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e23bf53e-6266-475d-b935-9ca54fd61839 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 400 to user: Security Group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 in use. Oct 04 18:14:33.665771 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-db9767c5-a31f-401d-b0af-f33ee4c965d5'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:33.667383 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e23bf53e-6266-475d-b935-9ca54fd61839 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/2511c79e-9bb0-4a91-94ed-6aa131ef5830" status: 400 len: 185 microversion: 2.1 time: 0.646977 Oct 04 18:14:33.667667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f419340c-35d1-4b1b-bc78-ef134689993f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.669015 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1575/3114] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:14:33 2022] DELETE /compute/v2.1/os-security-groups/2511c79e-9bb0-4a91-94ed-6aa131ef5830 => generated 185 bytes in 650 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:14:33.675358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f419340c-35d1-4b1b-bc78-ef134689993f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.689052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-88c9f190-4649-4736-8e6f-63cd1524e37f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.693102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-88c9f190-4649-4736-8e6f-63cd1524e37f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:33.728843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c9f190-4649-4736-8e6f-63cd1524e37f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.730602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c9f190-4649-4736-8e6f-63cd1524e37f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.732110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c9f190-4649-4736-8e6f-63cd1524e37f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.736179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c9f190-4649-4736-8e6f-63cd1524e37f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.737964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c9f190-4649-4736-8e6f-63cd1524e37f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.738596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c9f190-4649-4736-8e6f-63cd1524e37f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.061195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-88c9f190-4649-4736-8e6f-63cd1524e37f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:34.075088 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-88c9f190-4649-4736-8e6f-63cd1524e37f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1452 microversion: 2.1 time: 0.404127 Oct 04 18:14:34.077909 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1576/3115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:33 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1452 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:34.093728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ff6fa66-8513-4b7d-beca-dcd4e08c2acd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:34.109521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ff6fa66-8513-4b7d-beca-dcd4e08c2acd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:34.122814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ff6fa66-8513-4b7d-beca-dcd4e08c2acd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.124179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ff6fa66-8513-4b7d-beca-dcd4e08c2acd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.127246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ff6fa66-8513-4b7d-beca-dcd4e08c2acd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.129134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ff6fa66-8513-4b7d-beca-dcd4e08c2acd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.132486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ff6fa66-8513-4b7d-beca-dcd4e08c2acd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.133412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ff6fa66-8513-4b7d-beca-dcd4e08c2acd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.346366 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ff6fa66-8513-4b7d-beca-dcd4e08c2acd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e/action" status: 202 len: 0 microversion: 2.1 time: 0.266188 Oct 04 18:14:34.347059 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1577/3116] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:14:34 2022] POST /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:34.357632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-185df841-834c-45eb-84ab-2bd394d777e0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1b300d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:34.483850 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-185df841-834c-45eb-84ab-2bd394d777e0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.129875 Oct 04 18:14:34.484452 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1578/3117] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:34 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:34.497215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c0a7b3ae-d400-4be4-b2fe-3f63d52a670f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:34.511477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c0a7b3ae-d400-4be4-b2fe-3f63d52a670f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:34.526411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0a7b3ae-d400-4be4-b2fe-3f63d52a670f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.528184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0a7b3ae-d400-4be4-b2fe-3f63d52a670f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.530254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0a7b3ae-d400-4be4-b2fe-3f63d52a670f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.531374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0a7b3ae-d400-4be4-b2fe-3f63d52a670f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.533399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0a7b3ae-d400-4be4-b2fe-3f63d52a670f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.534023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0a7b3ae-d400-4be4-b2fe-3f63d52a670f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.711415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f419340c-35d1-4b1b-bc78-ef134689993f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:34.733919 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f419340c-35d1-4b1b-bc78-ef134689993f tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 200 len: 1528 microversion: 2.1 time: 1.107355 Oct 04 18:14:34.734646 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1540/3118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:33 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 1528 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:34.750104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4bc1664d-8240-42be-a3ed-26671e8b5b04 req-81ead5c7-78b4-4f7a-b969-81b8ec88f16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8473402c-8305-4b12-80a3-a58369427df7", "name": "network-vif-deleted", "tag": "7b4de8e5-02fc-4739-8a0c-a94e47cb8c83"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:34.787188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4bc1664d-8240-42be-a3ed-26671e8b5b04 req-81ead5c7-78b4-4f7a-b969-81b8ec88f16b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.788096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4bc1664d-8240-42be-a3ed-26671e8b5b04 req-81ead5c7-78b4-4f7a-b969-81b8ec88f16b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.789155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4bc1664d-8240-42be-a3ed-26671e8b5b04 req-81ead5c7-78b4-4f7a-b969-81b8ec88f16b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.834298 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4bc1664d-8240-42be-a3ed-26671e8b5b04 req-81ead5c7-78b4-4f7a-b969-81b8ec88f16b service nova] Creating event network-vif-deleted:7b4de8e5-02fc-4739-8a0c-a94e47cb8c83 for instance 8473402c-8305-4b12-80a3-a58369427df7 on n-h2-850499-14 Oct 04 18:14:34.850601 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4bc1664d-8240-42be-a3ed-26671e8b5b04 req-81ead5c7-78b4-4f7a-b969-81b8ec88f16b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109526 Oct 04 18:14:34.854182 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1541/3119] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:34.871928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:34.875513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:34.905688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.909050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.911034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.912060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.913609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.918123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.769736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c0a7b3ae-d400-4be4-b2fe-3f63d52a670f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:35.792984 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c0a7b3ae-d400-4be4-b2fe-3f63d52a670f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1573 microversion: 2.1 time: 1.299532 Oct 04 18:14:35.806136 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1579/3120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:34 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1573 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:35.829489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:35.832086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:35.863775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.869492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.871240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.873481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.875301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.876673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.930803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.931435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.933184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.934078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'fault' on Instance uuid 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:35.940107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:36.061103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:36.102649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:36.106773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:36.112841 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-91fa897f-396d-48bd-80ae-fcf56a10ecb4 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 1.255737 Oct 04 18:14:36.115818 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1542/3121] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:34 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:36.144062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5361ff5c-6007-4b26-9d98-7ce35647ce6c req-36286479-cc58-4f4f-8942-eb5198b4ad1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40", "name": "network-vif-deleted", "tag": "41d51df9-d9f3-4fb7-ade7-3b2c4ff0fdc4"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:36.197854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5361ff5c-6007-4b26-9d98-7ce35647ce6c req-36286479-cc58-4f4f-8942-eb5198b4ad1a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.199864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5361ff5c-6007-4b26-9d98-7ce35647ce6c req-36286479-cc58-4f4f-8942-eb5198b4ad1a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.200368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5361ff5c-6007-4b26-9d98-7ce35647ce6c req-36286479-cc58-4f4f-8942-eb5198b4ad1a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.251110 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5361ff5c-6007-4b26-9d98-7ce35647ce6c req-36286479-cc58-4f4f-8942-eb5198b4ad1a service nova] Creating event network-vif-deleted:41d51df9-d9f3-4fb7-ade7-3b2c4ff0fdc4 for instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 on n-h1-850499-14 Oct 04 18:14:36.273275 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5361ff5c-6007-4b26-9d98-7ce35647ce6c req-36286479-cc58-4f4f-8942-eb5198b4ad1a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149244 Oct 04 18:14:36.278743 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1543/3122] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:36.308743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a35fe2a-401d-4b4e-880e-ad0d0a9f4964 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d210bd30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:36.313414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:36.325572 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ad33944-4a5e-443c-9739-6f9561f0d2eb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 200 len: 1305 microversion: 2.1 time: 0.512421 Oct 04 18:14:36.341310 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1580/3123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:35 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 1305 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:36.358750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:36.359513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:36.377661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.378174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.379890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.381719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.384802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.385900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.426654 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 HTTP/1.1 Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '8473402c-8305-4b12-80a3-a58369427df7'} Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:36.433615 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:36.438567 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:36.438567 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:36.438567 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:36.438567 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:36.438567 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:36.438567 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:36.438567 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:14:36.438567 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:36.441128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 404 to user: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:36.448938 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-533bce53-e907-4fb9-9455-e3072583d312 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 404 len: 111 microversion: 2.1 time: 0.104724 Oct 04 18:14:36.449805 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1581/3124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:36 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:36.492449 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a35fe2a-401d-4b4e-880e-ad0d0a9f4964 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.211408 Oct 04 18:14:36.495790 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1544/3125] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:36 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:36.875449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1620608320", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:36.895112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a8b29260-1b48-4de7-b16e-d500c51c6d4a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:36.902357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a8b29260-1b48-4de7-b16e-d500c51c6d4a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:36.927192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8b29260-1b48-4de7-b16e-d500c51c6d4a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.927795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8b29260-1b48-4de7-b16e-d500c51c6d4a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.928474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8b29260-1b48-4de7-b16e-d500c51c6d4a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.931271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8b29260-1b48-4de7-b16e-d500c51c6d4a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.931937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8b29260-1b48-4de7-b16e-d500c51c6d4a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.935592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8b29260-1b48-4de7-b16e-d500c51c6d4a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.040659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] validate_networks() for [('47ff216e-5ac6-47ef-8951-1d8968800e41', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:38.798929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a8b29260-1b48-4de7-b16e-d500c51c6d4a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:38.808074 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a8b29260-1b48-4de7-b16e-d500c51c6d4a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1573 microversion: 2.1 time: 1.965307 Oct 04 18:14:38.815354 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1582/3126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:36 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1573 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:38.834602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:38.838490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:38.852525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.854039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.855841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.859773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.860492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.862354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.632877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:39.662247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:39.676444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:39.680531 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9926e0f2-7ff9-409d-972c-84c367eb1077 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.860663 Oct 04 18:14:39.682422 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1583/3127] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:38 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:39.712819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:39.713751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:39.737599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.738345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.740688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.741739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.742584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.743282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.770339 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 HTTP/1.1 Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40'} Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:39.772956 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:39.778833 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:39.778833 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:39.778833 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:39.778833 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:39.778833 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:39.778833 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:14:39.778833 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:14:39.781000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:39.782071 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8364346b-d55a-4cec-9f37-0d1f8e3925af tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 404 len: 111 microversion: 2.1 time: 0.094009 Oct 04 18:14:39.786366 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1584/3128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:39 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:39.792752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d7133b3f-27f8-45fa-8c2b-c4a030d06ded tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1a78790>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:39.872095 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d7133b3f-27f8-45fa-8c2b-c4a030d06ded tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.083324 Oct 04 18:14:39.874680 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1585/3129] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:39 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:39.882712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5e45c458-f8b6-4f1b-8700-c897631cd24d req-074c6bd8-5564-46b4-b152-6b4397acf886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36c7b27-9927-4f6d-874d-dbf86b9ef895", "name": "network-vif-unplugged", "status": "completed", "tag": "b431abe6-8cb4-48b7-b889-3c3dbf59f6d0"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:39.912463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5e45c458-f8b6-4f1b-8700-c897631cd24d req-074c6bd8-5564-46b4-b152-6b4397acf886 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.913218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5e45c458-f8b6-4f1b-8700-c897631cd24d req-074c6bd8-5564-46b4-b152-6b4397acf886 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.914193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5e45c458-f8b6-4f1b-8700-c897631cd24d req-074c6bd8-5564-46b4-b152-6b4397acf886 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.933789 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5e45c458-f8b6-4f1b-8700-c897631cd24d req-074c6bd8-5564-46b4-b152-6b4397acf886 service nova] Creating event network-vif-unplugged:b431abe6-8cb4-48b7-b889-3c3dbf59f6d0 for instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 on n-h1-850499-14 Oct 04 18:14:39.944768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5e45c458-f8b6-4f1b-8700-c897631cd24d req-074c6bd8-5564-46b4-b152-6b4397acf886 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068238 Oct 04 18:14:39.946111 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1586/3130] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:39.956085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84e58cf7-c479-4dc9-95dc-096d28a053ac tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:39.957028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-84e58cf7-c479-4dc9-95dc-096d28a053ac tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:39.967168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84e58cf7-c479-4dc9-95dc-096d28a053ac tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.968347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84e58cf7-c479-4dc9-95dc-096d28a053ac tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.968963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84e58cf7-c479-4dc9-95dc-096d28a053ac tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.970660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84e58cf7-c479-4dc9-95dc-096d28a053ac tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.972211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84e58cf7-c479-4dc9-95dc-096d28a053ac tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.973446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84e58cf7-c479-4dc9-95dc-096d28a053ac tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.365415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:40.365912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:40.366785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:40.367667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:40.368369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:40.391267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.392309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.393961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.397385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.398652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.399601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.428077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Getting quotas for project ba126ac644f740df852efc20cec70e25. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:40.446710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Getting quotas for user facf0eae1c5d4dff8e957c3ab073c7dd and project ba126ac644f740df852efc20cec70e25. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:40.470653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:40.474217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:40.571181 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1547c835-e11b-4a1c-9bbf-187c9baa2fe0 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.711965 Oct 04 18:14:40.573638 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1545/3131] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 3718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:40.586772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1667282862", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "3460d6d9-0801-4482-b14b-54fef623a1ce"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:40.696930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-84e58cf7-c479-4dc9-95dc-096d28a053ac tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:40.717300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84e58cf7-c479-4dc9-95dc-096d28a053ac tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1571 microversion: 2.1 time: 0.766531 Oct 04 18:14:40.727194 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1587/3132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:39 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1571 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:40.736455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ec39c62-c808-446c-8e9f-bac6d0e278b2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:40.741096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4ec39c62-c808-446c-8e9f-bac6d0e278b2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:40.756961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] validate_networks() for [('3460d6d9-0801-4482-b14b-54fef623a1ce', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:41.081501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4ec39c62-c808-446c-8e9f-bac6d0e278b2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:41.094554 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ec39c62-c808-446c-8e9f-bac6d0e278b2 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1225 microversion: 2.1 time: 0.370640 Oct 04 18:14:41.095181 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1588/3133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:40 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1225 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:41.118084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:41.118735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:41.148101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.150861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.151431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.154552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.159680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.164554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.006820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:42.045090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:42.057828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:42.063611 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6bf0bd05-42d1-4562-9e9e-d1196b67a902 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.956675 Oct 04 18:14:42.064750 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1589/3134] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:41 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:42.070109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aaee55f9-a713-4913-a231-18b9cbcf5c7f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-230524481"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:42.070873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aaee55f9-a713-4913-a231-18b9cbcf5c7f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:42.081239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aaee55f9-a713-4913-a231-18b9cbcf5c7f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.082030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aaee55f9-a713-4913-a231-18b9cbcf5c7f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.083736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aaee55f9-a713-4913-a231-18b9cbcf5c7f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.084784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aaee55f9-a713-4913-a231-18b9cbcf5c7f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.085401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aaee55f9-a713-4913-a231-18b9cbcf5c7f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.086031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aaee55f9-a713-4913-a231-18b9cbcf5c7f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.506264 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.network.security_group_api [None req-aaee55f9-a713-4913-a231-18b9cbcf5c7f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Adding security group 0b44f583-9194-412d-a997-5af0898599b1 to port 31a9b4ee-d65c-47e2-9a98-93ce28c558a6 Oct 04 18:14:42.521267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:42.523027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:42.523531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:42.524155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:42.525005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:42.527997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:42.559250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.560170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.563439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.566764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.574461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.574986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.633849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:42.652474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Getting quotas for user ba39a7cdf309477195a07acb5cdf24f4 and project 9cb88e07ba354759b30d6a779a9218c1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:42.683677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:42.689653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:42.797661 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c63fe88b-9605-45ac-95c3-ea10399d86fe tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.221841 Oct 04 18:14:42.801091 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1546/3135] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:42.810458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d430c56b-0e04-4a7f-8d8b-62a17387f3eb tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d210b940>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:42.902526 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d430c56b-0e04-4a7f-8d8b-62a17387f3eb tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.100095 Oct 04 18:14:42.903760 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1547/3136] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:42 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:42.915577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-08ab8f9c-13b4-43a6-ad3e-8e8e53249d63 req-45d115ad-fb90-444f-90f6-0b8cfe474981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36c7b27-9927-4f6d-874d-dbf86b9ef895", "tag": "b431abe6-8cb4-48b7-b889-3c3dbf59f6d0"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:42.939155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-08ab8f9c-13b4-43a6-ad3e-8e8e53249d63 req-45d115ad-fb90-444f-90f6-0b8cfe474981 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.942005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-08ab8f9c-13b4-43a6-ad3e-8e8e53249d63 req-45d115ad-fb90-444f-90f6-0b8cfe474981 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.943657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-08ab8f9c-13b4-43a6-ad3e-8e8e53249d63 req-45d115ad-fb90-444f-90f6-0b8cfe474981 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.977149 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-08ab8f9c-13b4-43a6-ad3e-8e8e53249d63 req-45d115ad-fb90-444f-90f6-0b8cfe474981 service nova] Creating event network-changed:b431abe6-8cb4-48b7-b889-3c3dbf59f6d0 for instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 on n-h1-850499-14 Oct 04 18:14:42.994946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-08ab8f9c-13b4-43a6-ad3e-8e8e53249d63 req-45d115ad-fb90-444f-90f6-0b8cfe474981 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089530 Oct 04 18:14:42.995633 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1548/3137] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:43.037049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-633a91d6-5551-4ce0-95af-ca30faed74d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:43.044081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-633a91d6-5551-4ce0-95af-ca30faed74d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:43.068289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633a91d6-5551-4ce0-95af-ca30faed74d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.068804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633a91d6-5551-4ce0-95af-ca30faed74d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.069341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633a91d6-5551-4ce0-95af-ca30faed74d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.070068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633a91d6-5551-4ce0-95af-ca30faed74d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.070540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633a91d6-5551-4ce0-95af-ca30faed74d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.070997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633a91d6-5551-4ce0-95af-ca30faed74d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.339303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-633a91d6-5551-4ce0-95af-ca30faed74d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:43.365258 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-633a91d6-5551-4ce0-95af-ca30faed74d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1277 microversion: 2.1 time: 0.349792 Oct 04 18:14:43.414206 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1549/3138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:43 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1277 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:43.464934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-088f06dc-da2a-4230-8b67-bb70f46f8d58 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:43.466878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-088f06dc-da2a-4230-8b67-bb70f46f8d58 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:44.329731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-088f06dc-da2a-4230-8b67-bb70f46f8d58 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:44.348128 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-088f06dc-da2a-4230-8b67-bb70f46f8d58 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1215 microversion: 2.1 time: 0.930202 Oct 04 18:14:44.350178 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1550/3139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:43 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1215 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:44.371716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:44.372414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:44.401828 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aaee55f9-a713-4913-a231-18b9cbcf5c7f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e/action" status: 202 len: 0 microversion: 2.1 time: 2.335749 Oct 04 18:14:44.405680 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1590/3140] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:14:42 2022] POST /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e/action => generated 0 bytes in 2337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:44.405827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.405827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.408825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.409626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.410113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.410558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.687062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-239523606", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:44.796025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] validate_networks() for [('d78eedfe-97d8-4b5e-ac16-1f5f87c44f17', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:46.479473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.490507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.502195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.504564 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27b64127-d152-4240-bf54-1819a5c259ce tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 2.152799 Oct 04 18:14:46.508735 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1551/3141] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:44 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:46.522561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d128c8a4-89b1-461d-a60e-6d04341103e7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d18dc550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.595554 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d128c8a4-89b1-461d-a60e-6d04341103e7 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.078039 Oct 04 18:14:46.597277 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1552/3142] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:46.602743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1313b338-0e48-4ecc-a040-3939418f608d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.603683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1313b338-0e48-4ecc-a040-3939418f608d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.612685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1313b338-0e48-4ecc-a040-3939418f608d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.615565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1313b338-0e48-4ecc-a040-3939418f608d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.616280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1313b338-0e48-4ecc-a040-3939418f608d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.619289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1313b338-0e48-4ecc-a040-3939418f608d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.620148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1313b338-0e48-4ecc-a040-3939418f608d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.620864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1313b338-0e48-4ecc-a040-3939418f608d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.896427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1313b338-0e48-4ecc-a040-3939418f608d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.908290 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1313b338-0e48-4ecc-a040-3939418f608d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1283 microversion: 2.1 time: 0.309687 Oct 04 18:14:46.909563 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1553/3143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1283 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:46.922919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5673d5f0-e2ce-4abd-8583-a2a40cd17b98 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d610f0d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:48.429041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-5673d5f0-e2ce-4abd-8583-a2a40cd17b98 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0b44f583-9194-412d-a997-5af0898599b1 in use.", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:14:48.430989 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-5673d5f0-e2ce-4abd-8583-a2a40cd17b98 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security Group 0b44f583-9194-412d-a997-5af0898599b1 in use. Oct 04 18:14:48.430989 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-d8c2b004-5bce-4be8-ad78-4987757c173a'] Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5673d5f0-e2ce-4abd-8583-a2a40cd17b98 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-security-groups/0b44f583-9194-412d-a997-5af0898599b1 HTTP/1.1 Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: exception: Security Group 0b44f583-9194-412d-a997-5af0898599b1 in use. Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-d8c2b004-5bce-4be8-ad78-4987757c173a'] Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '0b44f583-9194-412d-a997-5af0898599b1'} Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:14:48.434020 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0b44f583-9194-412d-a997-5af0898599b1 in use. Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8c2b004-5bce-4be8-ad78-4987757c173a'] Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0b44f583-9194-412d-a997-5af0898599b1 in use. Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8c2b004-5bce-4be8-ad78-4987757c173a'] Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0b44f583-9194-412d-a997-5af0898599b1 in use. Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8c2b004-5bce-4be8-ad78-4987757c173a'] Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0b44f583-9194-412d-a997-5af0898599b1 in use. Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8c2b004-5bce-4be8-ad78-4987757c173a'] Oct 04 18:14:48.438977 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:14:48.447781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5673d5f0-e2ce-4abd-8583-a2a40cd17b98 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 400 to user: Security Group 0b44f583-9194-412d-a997-5af0898599b1 in use. Oct 04 18:14:48.447781 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-d8c2b004-5bce-4be8-ad78-4987757c173a'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:48.449245 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5673d5f0-e2ce-4abd-8583-a2a40cd17b98 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/0b44f583-9194-412d-a997-5af0898599b1" status: 400 len: 185 microversion: 2.1 time: 1.538008 Oct 04 18:14:48.450475 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1554/3144] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:14:46 2022] DELETE /compute/v2.1/os-security-groups/0b44f583-9194-412d-a997-5af0898599b1 => generated 185 bytes in 1540 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:14:48.645570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-363426811", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "a3d67ed6-ad9f-48a1-902c-dc88b5c66c23"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:48.668221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:48.669538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:48.670279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:48.671009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:48.671672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:48.690042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.690944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.691808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.692837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.696099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.696783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.782289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Getting quotas for project 2dc6a5a16ea349379ec3b867415e27c8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:48.802102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] validate_networks() for [('a3d67ed6-ad9f-48a1-902c-dc88b5c66c23', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:48.807803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Getting quotas for user 1cfad4be58554ff3ab08ae91bfad0854 and project 2dc6a5a16ea349379ec3b867415e27c8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:48.844569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:48.852467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:48.986861 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c38dfe81-2e3a-4872-89e1-d64af789d195 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.582579 Oct 04 18:14:48.998233 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1591/3145] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 4594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:49.028077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c82af7a2-e340-45a5-a977-60c5f44ba3a7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:49.035473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c82af7a2-e340-45a5-a977-60c5f44ba3a7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:49.066488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c82af7a2-e340-45a5-a977-60c5f44ba3a7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.067430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c82af7a2-e340-45a5-a977-60c5f44ba3a7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.067896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c82af7a2-e340-45a5-a977-60c5f44ba3a7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.068640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c82af7a2-e340-45a5-a977-60c5f44ba3a7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.069109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c82af7a2-e340-45a5-a977-60c5f44ba3a7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.072283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c82af7a2-e340-45a5-a977-60c5f44ba3a7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.510754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c82af7a2-e340-45a5-a977-60c5f44ba3a7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:49.524762 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c82af7a2-e340-45a5-a977-60c5f44ba3a7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1315 microversion: 2.1 time: 0.523158 Oct 04 18:14:49.527950 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1592/3146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:48 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:49.539527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-4d979e7f-ce26-486a-bad0-df75d16605e0 req-42843d13-89db-438d-9fe0-6ec0534cceef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21532f2f-90bb-4233-9a7c-5b8962cff43e", "tag": "31a9b4ee-d65c-47e2-9a98-93ce28c558a6"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:49.564259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4d979e7f-ce26-486a-bad0-df75d16605e0 req-42843d13-89db-438d-9fe0-6ec0534cceef service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.568008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4d979e7f-ce26-486a-bad0-df75d16605e0 req-42843d13-89db-438d-9fe0-6ec0534cceef service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.570528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4d979e7f-ce26-486a-bad0-df75d16605e0 req-42843d13-89db-438d-9fe0-6ec0534cceef service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.597948 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-4d979e7f-ce26-486a-bad0-df75d16605e0 req-42843d13-89db-438d-9fe0-6ec0534cceef service nova] Creating event network-changed:31a9b4ee-d65c-47e2-9a98-93ce28c558a6 for instance 21532f2f-90bb-4233-9a7c-5b8962cff43e on n-h2-850499-14 Oct 04 18:14:49.618555 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-4d979e7f-ce26-486a-bad0-df75d16605e0 req-42843d13-89db-438d-9fe0-6ec0534cceef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083777 Oct 04 18:14:49.623582 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1593/3147] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:49.656412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:49.664098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:49.703543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.707328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.709401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.711994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.714462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.718470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.694725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:50.707888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:50.712774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:50.714389 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-60aeab8a-dc90-459b-a658-6ac38a4bfd21 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 1.086135 Oct 04 18:14:50.716789 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1594/3148] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:49 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:50.731141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:50.732142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:50.732809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:50.733697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:50.734307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:50.739202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-417fb1b2-f3c0-4b1d-a1b0-63578772bec4 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1a7e700>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:50.769857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.772493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.775239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.778330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.779201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.782445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.835792 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-417fb1b2-f3c0-4b1d-a1b0-63578772bec4 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.113478 Oct 04 18:14:50.840657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Getting quotas for project 5abaa6b711db435abdb899420464d972. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:50.847057 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1595/3149] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:50 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:50.848041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Getting quotas for user 350bf584a7364c90a6b2a5a05f1cd428 and project 5abaa6b711db435abdb899420464d972. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:50.858695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d7ba872-f945-4b18-8916-094809e40c95 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:50.866501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:50.870046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:50.870440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1d7ba872-f945-4b18-8916-094809e40c95 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:50.889890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d7ba872-f945-4b18-8916-094809e40c95 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.910780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d7ba872-f945-4b18-8916-094809e40c95 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.913341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d7ba872-f945-4b18-8916-094809e40c95 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.915701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d7ba872-f945-4b18-8916-094809e40c95 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.927504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d7ba872-f945-4b18-8916-094809e40c95 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.932382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d7ba872-f945-4b18-8916-094809e40c95 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.950108 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bf41c276-382b-496f-880b-73494a8d6e29 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.498045 Oct 04 18:14:50.951596 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1555/3150] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:50.959482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c4d5c01-ba39-4928-ba8e-43d38a7a3b66 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:50.960222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2c4d5c01-ba39-4928-ba8e-43d38a7a3b66 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:50.968990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c4d5c01-ba39-4928-ba8e-43d38a7a3b66 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.970474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c4d5c01-ba39-4928-ba8e-43d38a7a3b66 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.980051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c4d5c01-ba39-4928-ba8e-43d38a7a3b66 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.981678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c4d5c01-ba39-4928-ba8e-43d38a7a3b66 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.982722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c4d5c01-ba39-4928-ba8e-43d38a7a3b66 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.986507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c4d5c01-ba39-4928-ba8e-43d38a7a3b66 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.020664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:51.039202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2c4d5c01-ba39-4928-ba8e-43d38a7a3b66 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:51.268194 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c4d5c01-ba39-4928-ba8e-43d38a7a3b66 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 204 len: 0 microversion: 2.1 time: 0.314036 Oct 04 18:14:51.269962 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1556/3151] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:50 2022] DELETE /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:51.276744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f7d435bb-8187-43e1-994b-a579c25bc699 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:51.278088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f7d435bb-8187-43e1-994b-a579c25bc699 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:51.294009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d435bb-8187-43e1-994b-a579c25bc699 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.294751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d435bb-8187-43e1-994b-a579c25bc699 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.296512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d435bb-8187-43e1-994b-a579c25bc699 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.297533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d435bb-8187-43e1-994b-a579c25bc699 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.298521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d435bb-8187-43e1-994b-a579c25bc699 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.310042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f7d435bb-8187-43e1-994b-a579c25bc699 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.590281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f7d435bb-8187-43e1-994b-a579c25bc699 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:51.613090 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f7d435bb-8187-43e1-994b-a579c25bc699 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1268 microversion: 2.1 time: 0.341544 Oct 04 18:14:51.616953 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1557/3152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:51 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1268 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:51.626407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-dfb5f291-e351-4771-8ef5-a3e7826615a2 req-d04abed8-6b86-4aef-8be5-d8cfaab18982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4400b05-cc8a-4d94-9f60-4842340d090e", "tag": "e97f02a9-6af2-4ab8-a050-1f645202d2c9"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:51.646391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dfb5f291-e351-4771-8ef5-a3e7826615a2 req-d04abed8-6b86-4aef-8be5-d8cfaab18982 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.646896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dfb5f291-e351-4771-8ef5-a3e7826615a2 req-d04abed8-6b86-4aef-8be5-d8cfaab18982 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.649498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dfb5f291-e351-4771-8ef5-a3e7826615a2 req-d04abed8-6b86-4aef-8be5-d8cfaab18982 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.680159 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-dfb5f291-e351-4771-8ef5-a3e7826615a2 req-d04abed8-6b86-4aef-8be5-d8cfaab18982 service nova] Creating event network-changed:e97f02a9-6af2-4ab8-a050-1f645202d2c9 for instance e4400b05-cc8a-4d94-9f60-4842340d090e on n-h1-850499-14 Oct 04 18:14:51.696849 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-dfb5f291-e351-4771-8ef5-a3e7826615a2 req-d04abed8-6b86-4aef-8be5-d8cfaab18982 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075634 Oct 04 18:14:51.697832 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1558/3153] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:51.710169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-08499c62-cdfa-47e7-b48e-8f4e4e59b737 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:51.710613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08499c62-cdfa-47e7-b48e-8f4e4e59b737 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:51.734350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08499c62-cdfa-47e7-b48e-8f4e4e59b737 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.735037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08499c62-cdfa-47e7-b48e-8f4e4e59b737 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.738170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08499c62-cdfa-47e7-b48e-8f4e4e59b737 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.738930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08499c62-cdfa-47e7-b48e-8f4e4e59b737 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.741285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08499c62-cdfa-47e7-b48e-8f4e4e59b737 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.742215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08499c62-cdfa-47e7-b48e-8f4e4e59b737 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.791879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d7ba872-f945-4b18-8916-094809e40c95 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:51.809018 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d7ba872-f945-4b18-8916-094809e40c95 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.959548 Oct 04 18:14:51.814019 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1596/3154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:50 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:51.830995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4470fa4a-b940-4a1a-9346-c38703d0cb47 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:51.832896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4470fa4a-b940-4a1a-9346-c38703d0cb47 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:52.020373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4470fa4a-b940-4a1a-9346-c38703d0cb47 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:52.033961 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4470fa4a-b940-4a1a-9346-c38703d0cb47 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1217 microversion: 2.1 time: 0.218548 Oct 04 18:14:52.034647 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1597/3155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:51 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:52.039509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-828443b7-6e83-40bc-9079-3b04d04db86f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.047154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-828443b7-6e83-40bc-9079-3b04d04db86f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:52.067994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-828443b7-6e83-40bc-9079-3b04d04db86f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.068819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-828443b7-6e83-40bc-9079-3b04d04db86f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.069447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-828443b7-6e83-40bc-9079-3b04d04db86f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.073446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-828443b7-6e83-40bc-9079-3b04d04db86f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.074732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-828443b7-6e83-40bc-9079-3b04d04db86f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.075365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-828443b7-6e83-40bc-9079-3b04d04db86f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.334799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-08499c62-cdfa-47e7-b48e-8f4e4e59b737 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:52.349419 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-08499c62-cdfa-47e7-b48e-8f4e4e59b737 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1315 microversion: 2.1 time: 0.646036 Oct 04 18:14:52.350008 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1559/3156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:51 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:52.366251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.367179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:52.378546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.385301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.385948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.386882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.387803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.388310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.769495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-828443b7-6e83-40bc-9079-3b04d04db86f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:52.789924 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-828443b7-6e83-40bc-9079-3b04d04db86f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1645 microversion: 2.1 time: 0.753847 Oct 04 18:14:52.791341 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1598/3157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1645 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:52.801042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-497ab410-2c33-4501-b072-49db8d4d168a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1c9e5e0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.874572 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-497ab410-2c33-4501-b072-49db8d4d168a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.081236 Oct 04 18:14:52.889536 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1599/3158] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:52.898220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f6c4d7b9-5d68-48fe-827a-231a66a2f424 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.900300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f6c4d7b9-5d68-48fe-827a-231a66a2f424 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:52.910904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6c4d7b9-5d68-48fe-827a-231a66a2f424 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.911907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6c4d7b9-5d68-48fe-827a-231a66a2f424 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.912682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6c4d7b9-5d68-48fe-827a-231a66a2f424 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.913642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6c4d7b9-5d68-48fe-827a-231a66a2f424 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.914272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6c4d7b9-5d68-48fe-827a-231a66a2f424 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.914935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6c4d7b9-5d68-48fe-827a-231a66a2f424 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.125459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f6c4d7b9-5d68-48fe-827a-231a66a2f424 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:53.141029 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f6c4d7b9-5d68-48fe-827a-231a66a2f424 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1268 microversion: 2.1 time: 0.249485 Oct 04 18:14:53.141635 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1600/3159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:53.153512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d508134-1f49-479c-97c7-2bfef158f89d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.154843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d508134-1f49-479c-97c7-2bfef158f89d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:53.166533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d508134-1f49-479c-97c7-2bfef158f89d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.167391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d508134-1f49-479c-97c7-2bfef158f89d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.168754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d508134-1f49-479c-97c7-2bfef158f89d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.170309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d508134-1f49-479c-97c7-2bfef158f89d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.171222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d508134-1f49-479c-97c7-2bfef158f89d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.172565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d508134-1f49-479c-97c7-2bfef158f89d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.721213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:53.743179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:53.744965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:53.746269 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d8b3844f-9b6c-43ad-b6fd-07e20ac3f6d8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 1.395156 Oct 04 18:14:53.762626 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1560/3160] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:53.774858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-09cabcc3-9eb8-4c28-8d68-72cbe1dab7fc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.783608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-09cabcc3-9eb8-4c28-8d68-72cbe1dab7fc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:53.803270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09cabcc3-9eb8-4c28-8d68-72cbe1dab7fc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.805689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09cabcc3-9eb8-4c28-8d68-72cbe1dab7fc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.807203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09cabcc3-9eb8-4c28-8d68-72cbe1dab7fc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.809542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09cabcc3-9eb8-4c28-8d68-72cbe1dab7fc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.811042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09cabcc3-9eb8-4c28-8d68-72cbe1dab7fc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.814146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09cabcc3-9eb8-4c28-8d68-72cbe1dab7fc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.036077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-09cabcc3-9eb8-4c28-8d68-72cbe1dab7fc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:54.045086 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-09cabcc3-9eb8-4c28-8d68-72cbe1dab7fc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1287 microversion: 2.1 time: 0.280890 Oct 04 18:14:54.046714 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1561/3161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1287 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:54.103979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ebc94e54-46ce-4652-aacb-eff09cd312a5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.105136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ebc94e54-46ce-4652-aacb-eff09cd312a5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:54.116697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebc94e54-46ce-4652-aacb-eff09cd312a5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.116697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebc94e54-46ce-4652-aacb-eff09cd312a5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.116697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebc94e54-46ce-4652-aacb-eff09cd312a5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.116697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebc94e54-46ce-4652-aacb-eff09cd312a5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.116697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebc94e54-46ce-4652-aacb-eff09cd312a5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.116697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebc94e54-46ce-4652-aacb-eff09cd312a5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.731631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d508134-1f49-479c-97c7-2bfef158f89d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:54.741147 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d508134-1f49-479c-97c7-2bfef158f89d tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 1.596402 Oct 04 18:14:54.746717 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1601/3162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:54.771551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-182efed6-c544-45a5-83fb-9ee0f9b04d09 req-117940b2-c85c-4e82-a646-f89e96e060d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18aacc75-5a79-414c-a91a-ff8aac1b347f", "tag": "a4b6fb86-c263-471c-b2a7-4980a2202458"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:54.796888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-182efed6-c544-45a5-83fb-9ee0f9b04d09 req-117940b2-c85c-4e82-a646-f89e96e060d7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.798866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-182efed6-c544-45a5-83fb-9ee0f9b04d09 req-117940b2-c85c-4e82-a646-f89e96e060d7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.800145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-182efed6-c544-45a5-83fb-9ee0f9b04d09 req-117940b2-c85c-4e82-a646-f89e96e060d7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.823382 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-182efed6-c544-45a5-83fb-9ee0f9b04d09 req-117940b2-c85c-4e82-a646-f89e96e060d7 service nova] Creating event network-changed:a4b6fb86-c263-471c-b2a7-4980a2202458 for instance 18aacc75-5a79-414c-a91a-ff8aac1b347f on n-h2-850499-14 Oct 04 18:14:54.833173 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-182efed6-c544-45a5-83fb-9ee0f9b04d09 req-117940b2-c85c-4e82-a646-f89e96e060d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084962 Oct 04 18:14:54.834292 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1602/3163] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:54.841103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1bf5796f-aa97-47d2-8711-765b17bfe0e7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.842055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1bf5796f-aa97-47d2-8711-765b17bfe0e7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:54.851794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bf5796f-aa97-47d2-8711-765b17bfe0e7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.852532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bf5796f-aa97-47d2-8711-765b17bfe0e7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.853168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bf5796f-aa97-47d2-8711-765b17bfe0e7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.854044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bf5796f-aa97-47d2-8711-765b17bfe0e7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.854670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bf5796f-aa97-47d2-8711-765b17bfe0e7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.855471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bf5796f-aa97-47d2-8711-765b17bfe0e7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.244128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ebc94e54-46ce-4652-aacb-eff09cd312a5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:55.256922 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ebc94e54-46ce-4652-aacb-eff09cd312a5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1315 microversion: 2.1 time: 1.205207 Oct 04 18:14:55.257658 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1562/3164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1315 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:55.271114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8da6d02e-9992-4dd9-a3fb-718a11e2572f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d18dcc10>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:55.336241 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8da6d02e-9992-4dd9-a3fb-718a11e2572f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1454 microversion: 2.1 time: 0.077398 Oct 04 18:14:55.346175 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1563/3165] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:55 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:55.351980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1e36b89-9263-43cd-8c9e-8d0a0be46523 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:55.352889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e1e36b89-9263-43cd-8c9e-8d0a0be46523 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:55.361551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e36b89-9263-43cd-8c9e-8d0a0be46523 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.363051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e36b89-9263-43cd-8c9e-8d0a0be46523 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.364532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e36b89-9263-43cd-8c9e-8d0a0be46523 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.366281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e36b89-9263-43cd-8c9e-8d0a0be46523 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.366947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e36b89-9263-43cd-8c9e-8d0a0be46523 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.367624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1e36b89-9263-43cd-8c9e-8d0a0be46523 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.573615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1e36b89-9263-43cd-8c9e-8d0a0be46523 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:55.588607 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1e36b89-9263-43cd-8c9e-8d0a0be46523 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1274 microversion: 2.1 time: 0.240149 Oct 04 18:14:55.589100 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1564/3166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:55 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:55.597594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:55.598668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:55.609421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.609929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.610830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.611511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.611669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.612032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.657942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1bf5796f-aa97-47d2-8711-765b17bfe0e7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:55.667678 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1bf5796f-aa97-47d2-8711-765b17bfe0e7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1645 microversion: 2.1 time: 0.831583 Oct 04 18:14:55.668942 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1603/3167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1645 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:55.674373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed970089-0d40-41c5-960f-d7d5e0d50721 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:55.675386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed970089-0d40-41c5-960f-d7d5e0d50721 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:55.683098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed970089-0d40-41c5-960f-d7d5e0d50721 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.683784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed970089-0d40-41c5-960f-d7d5e0d50721 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.684531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed970089-0d40-41c5-960f-d7d5e0d50721 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.685563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed970089-0d40-41c5-960f-d7d5e0d50721 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.690783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed970089-0d40-41c5-960f-d7d5e0d50721 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.691514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed970089-0d40-41c5-960f-d7d5e0d50721 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.833487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ed970089-0d40-41c5-960f-d7d5e0d50721 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:55.841929 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed970089-0d40-41c5-960f-d7d5e0d50721 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1275 microversion: 2.1 time: 0.171673 Oct 04 18:14:55.869305 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1604/3168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:55 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:55.880861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-39db435f-a9e3-429a-ae21-08f18018e95e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:55.886137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-39db435f-a9e3-429a-ae21-08f18018e95e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:55.895734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39db435f-a9e3-429a-ae21-08f18018e95e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.896557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39db435f-a9e3-429a-ae21-08f18018e95e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.897290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39db435f-a9e3-429a-ae21-08f18018e95e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.898597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39db435f-a9e3-429a-ae21-08f18018e95e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.899316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39db435f-a9e3-429a-ae21-08f18018e95e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.899956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39db435f-a9e3-429a-ae21-08f18018e95e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:56.030887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:56.044994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:56.049821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:56.051606 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-68dbb5e8-7d40-4e9d-bc4f-c6b94f693f22 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.461411 Oct 04 18:14:56.057453 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1565/3169] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:55 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:56.151388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-39db435f-a9e3-429a-ae21-08f18018e95e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:56.161910 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-39db435f-a9e3-429a-ae21-08f18018e95e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.285248 Oct 04 18:14:56.168259 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1605/3170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:55 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:56.280614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-89667557-8992-4120-b52a-f89e60c3f30c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:56.281894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-89667557-8992-4120-b52a-f89e60c3f30c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:56.288816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89667557-8992-4120-b52a-f89e60c3f30c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:56.289685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89667557-8992-4120-b52a-f89e60c3f30c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:56.290304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89667557-8992-4120-b52a-f89e60c3f30c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:56.291382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89667557-8992-4120-b52a-f89e60c3f30c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:56.292168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89667557-8992-4120-b52a-f89e60c3f30c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:56.292818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89667557-8992-4120-b52a-f89e60c3f30c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:56.313306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ffd85353-a4b4-4bef-b2ad-1ff807d805a0 req-d3005dc6-8b10-4b18-acfa-b772a75ea3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21532f2f-90bb-4233-9a7c-5b8962cff43e", "name": "network-vif-deleted", "tag": "31a9b4ee-d65c-47e2-9a98-93ce28c558a6"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:56.347033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ffd85353-a4b4-4bef-b2ad-1ff807d805a0 req-d3005dc6-8b10-4b18-acfa-b772a75ea3b4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:56.347881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ffd85353-a4b4-4bef-b2ad-1ff807d805a0 req-d3005dc6-8b10-4b18-acfa-b772a75ea3b4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:56.349762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ffd85353-a4b4-4bef-b2ad-1ff807d805a0 req-d3005dc6-8b10-4b18-acfa-b772a75ea3b4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:56.373583 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ffd85353-a4b4-4bef-b2ad-1ff807d805a0 req-d3005dc6-8b10-4b18-acfa-b772a75ea3b4 service nova] Creating event network-vif-deleted:31a9b4ee-d65c-47e2-9a98-93ce28c558a6 for instance 21532f2f-90bb-4233-9a7c-5b8962cff43e on n-h2-850499-14 Oct 04 18:14:56.392254 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ffd85353-a4b4-4bef-b2ad-1ff807d805a0 req-d3005dc6-8b10-4b18-acfa-b772a75ea3b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079794 Oct 04 18:14:56.393218 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1606/3171] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:56.399698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4888ff42-6e04-497c-abb2-cb7f915c9bb4 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1b30940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:56.472920 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4888ff42-6e04-497c-abb2-cb7f915c9bb4 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1463 microversion: 2.1 time: 0.077977 Oct 04 18:14:56.484630 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1607/3172] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:56 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1463 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:56.495205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc729a11-76e9-4088-b491-25323e388be4 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d62949d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:56.570920 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc729a11-76e9-4088-b491-25323e388be4 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 200 len: 1463 microversion: 2.1 time: 0.081759 Oct 04 18:14:56.571649 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1608/3173] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:14:56 2022] GET /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 1463 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:56.586595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1714dacd-d3a3-4769-82cf-2990e6d751f9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:56.588025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1714dacd-d3a3-4769-82cf-2990e6d751f9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:56.603295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1714dacd-d3a3-4769-82cf-2990e6d751f9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:56.606858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1714dacd-d3a3-4769-82cf-2990e6d751f9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:56.610448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1714dacd-d3a3-4769-82cf-2990e6d751f9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:56.611431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1714dacd-d3a3-4769-82cf-2990e6d751f9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:56.612065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1714dacd-d3a3-4769-82cf-2990e6d751f9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:56.613303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1714dacd-d3a3-4769-82cf-2990e6d751f9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:56.621169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:56.862040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-89667557-8992-4120-b52a-f89e60c3f30c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:56.890023 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-89667557-8992-4120-b52a-f89e60c3f30c tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1315 microversion: 2.1 time: 0.607227 Oct 04 18:14:56.891094 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1566/3174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:56 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:56.895964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d2a79a22-4c56-4802-a7e8-790ffa47101d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:56.896577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d2a79a22-4c56-4802-a7e8-790ffa47101d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:56.916593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2a79a22-4c56-4802-a7e8-790ffa47101d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:56.917275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2a79a22-4c56-4802-a7e8-790ffa47101d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:56.917892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2a79a22-4c56-4802-a7e8-790ffa47101d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:56.918621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2a79a22-4c56-4802-a7e8-790ffa47101d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:56.919116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2a79a22-4c56-4802-a7e8-790ffa47101d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:56.919548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2a79a22-4c56-4802-a7e8-790ffa47101d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.087457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1714dacd-d3a3-4769-82cf-2990e6d751f9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.104696 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1714dacd-d3a3-4769-82cf-2990e6d751f9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1481 microversion: 2.1 time: 0.522725 Oct 04 18:14:57.110715 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1609/3175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:56 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1481 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:57.115794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8e66c988-e3cf-47bf-bda0-78dc7e86fa65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.116404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8e66c988-e3cf-47bf-bda0-78dc7e86fa65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.122443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:57.124655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e66c988-e3cf-47bf-bda0-78dc7e86fa65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.125548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e66c988-e3cf-47bf-bda0-78dc7e86fa65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.126327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e66c988-e3cf-47bf-bda0-78dc7e86fa65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.127309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e66c988-e3cf-47bf-bda0-78dc7e86fa65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.127944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e66c988-e3cf-47bf-bda0-78dc7e86fa65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.128762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e66c988-e3cf-47bf-bda0-78dc7e86fa65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.242397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8e66c988-e3cf-47bf-bda0-78dc7e86fa65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.252008 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8e66c988-e3cf-47bf-bda0-78dc7e86fa65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1466 microversion: 2.1 time: 0.140006 Oct 04 18:14:57.252920 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1610/3176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:57.259483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-efb57b69-1fe3-4f41-ab60-c0b9aab15f18 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.260437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d2a79a22-4c56-4802-a7e8-790ffa47101d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.260919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-efb57b69-1fe3-4f41-ab60-c0b9aab15f18 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.268398 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d2a79a22-4c56-4802-a7e8-790ffa47101d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.376149 Oct 04 18:14:57.279079 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1567/3177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:56 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:57.279261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efb57b69-1fe3-4f41-ab60-c0b9aab15f18 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.279261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efb57b69-1fe3-4f41-ab60-c0b9aab15f18 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.279261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efb57b69-1fe3-4f41-ab60-c0b9aab15f18 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.279261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efb57b69-1fe3-4f41-ab60-c0b9aab15f18 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.280010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efb57b69-1fe3-4f41-ab60-c0b9aab15f18 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.280906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efb57b69-1fe3-4f41-ab60-c0b9aab15f18 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.283958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-51405ef8-a497-40b9-b489-cfb4f5e78462 req-765b8787-6fa8-44e8-93bd-5b3d467d05aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4400b05-cc8a-4d94-9f60-4842340d090e", "name": "network-vif-plugged", "status": "completed", "tag": "e97f02a9-6af2-4ab8-a050-1f645202d2c9"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:57.294613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51405ef8-a497-40b9-b489-cfb4f5e78462 req-765b8787-6fa8-44e8-93bd-5b3d467d05aa service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.295366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51405ef8-a497-40b9-b489-cfb4f5e78462 req-765b8787-6fa8-44e8-93bd-5b3d467d05aa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.296491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51405ef8-a497-40b9-b489-cfb4f5e78462 req-765b8787-6fa8-44e8-93bd-5b3d467d05aa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.318831 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-51405ef8-a497-40b9-b489-cfb4f5e78462 req-765b8787-6fa8-44e8-93bd-5b3d467d05aa service nova] Creating event network-vif-plugged:e97f02a9-6af2-4ab8-a050-1f645202d2c9 for instance e4400b05-cc8a-4d94-9f60-4842340d090e on n-h1-850499-14 Oct 04 18:14:57.326663 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-51405ef8-a497-40b9-b489-cfb4f5e78462 req-765b8787-6fa8-44e8-93bd-5b3d467d05aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056473 Oct 04 18:14:57.328045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1568/3178] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:57.335749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.336656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.349922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.350591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.351241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.352545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.353031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.353683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.660317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-efb57b69-1fe3-4f41-ab60-c0b9aab15f18 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.669335 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-efb57b69-1fe3-4f41-ab60-c0b9aab15f18 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1317 microversion: 2.1 time: 0.414932 Oct 04 18:14:57.670537 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1611/3179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:57.676029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6307f5c-1d84-4ffa-92a8-0130dfbad3d7 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.676831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d6307f5c-1d84-4ffa-92a8-0130dfbad3d7 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.683356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6307f5c-1d84-4ffa-92a8-0130dfbad3d7 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.683853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6307f5c-1d84-4ffa-92a8-0130dfbad3d7 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.684428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6307f5c-1d84-4ffa-92a8-0130dfbad3d7 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.685459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6307f5c-1d84-4ffa-92a8-0130dfbad3d7 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.685972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6307f5c-1d84-4ffa-92a8-0130dfbad3d7 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.686924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6307f5c-1d84-4ffa-92a8-0130dfbad3d7 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.769196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.777696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.779206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.780957 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d14299d4-e7c2-48a6-8c4f-04192c5b84df tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.450574 Oct 04 18:14:57.781525 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1569/3180] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:57.914193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c081ca2d-ddfb-4bad-91c7-fe890b00c2a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.914815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c081ca2d-ddfb-4bad-91c7-fe890b00c2a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.918716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d6307f5c-1d84-4ffa-92a8-0130dfbad3d7 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.921824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c081ca2d-ddfb-4bad-91c7-fe890b00c2a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.922538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c081ca2d-ddfb-4bad-91c7-fe890b00c2a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.923003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c081ca2d-ddfb-4bad-91c7-fe890b00c2a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.923996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c081ca2d-ddfb-4bad-91c7-fe890b00c2a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.924698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c081ca2d-ddfb-4bad-91c7-fe890b00c2a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.925349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c081ca2d-ddfb-4bad-91c7-fe890b00c2a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.926904 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d6307f5c-1d84-4ffa-92a8-0130dfbad3d7 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.254847 Oct 04 18:14:57.927521 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1612/3181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:58.090640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a0465228-abde-4aeb-adbf-1682ae1a42ef req-b6017044-28e2-4d8c-81ee-1e4147f311a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10872fe-cae9-4db2-88f6-57c26d1eff0a", "tag": "c1fb397a-a183-497c-adcf-34f0bcdaeecb"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:58.101049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a0465228-abde-4aeb-adbf-1682ae1a42ef req-b6017044-28e2-4d8c-81ee-1e4147f311a8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.101623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a0465228-abde-4aeb-adbf-1682ae1a42ef req-b6017044-28e2-4d8c-81ee-1e4147f311a8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.102140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a0465228-abde-4aeb-adbf-1682ae1a42ef req-b6017044-28e2-4d8c-81ee-1e4147f311a8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.114089 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a0465228-abde-4aeb-adbf-1682ae1a42ef req-b6017044-28e2-4d8c-81ee-1e4147f311a8 service nova] Creating event network-changed:c1fb397a-a183-497c-adcf-34f0bcdaeecb for instance e10872fe-cae9-4db2-88f6-57c26d1eff0a on n-h1-850499-14 Oct 04 18:14:58.119521 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a0465228-abde-4aeb-adbf-1682ae1a42ef req-b6017044-28e2-4d8c-81ee-1e4147f311a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033743 Oct 04 18:14:58.120134 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1613/3182] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:58.134359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c081ca2d-ddfb-4bad-91c7-fe890b00c2a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.136367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fad66ab4-81a5-424c-b1d0-e469e1155063 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.139124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fad66ab4-81a5-424c-b1d0-e469e1155063 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.143899 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c081ca2d-ddfb-4bad-91c7-fe890b00c2a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1315 microversion: 2.1 time: 0.234345 Oct 04 18:14:58.144494 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1570/3183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:58.151287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fad66ab4-81a5-424c-b1d0-e469e1155063 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.152103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fad66ab4-81a5-424c-b1d0-e469e1155063 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.152626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fad66ab4-81a5-424c-b1d0-e469e1155063 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.153416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fad66ab4-81a5-424c-b1d0-e469e1155063 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.153888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fad66ab4-81a5-424c-b1d0-e469e1155063 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.154327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fad66ab4-81a5-424c-b1d0-e469e1155063 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.275457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27db8929-6bd3-40e3-aa78-f7f14c07d5f2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.276193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27db8929-6bd3-40e3-aa78-f7f14c07d5f2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.282831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27db8929-6bd3-40e3-aa78-f7f14c07d5f2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.283432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27db8929-6bd3-40e3-aa78-f7f14c07d5f2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.283876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27db8929-6bd3-40e3-aa78-f7f14c07d5f2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.284574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27db8929-6bd3-40e3-aa78-f7f14c07d5f2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.285112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27db8929-6bd3-40e3-aa78-f7f14c07d5f2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.285460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27db8929-6bd3-40e3-aa78-f7f14c07d5f2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.300369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fad66ab4-81a5-424c-b1d0-e469e1155063 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.308594 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fad66ab4-81a5-424c-b1d0-e469e1155063 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1481 microversion: 2.1 time: 0.178726 Oct 04 18:14:58.309168 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1614/3184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1481 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:58.313837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0acdd6f9-284e-4a51-9019-0765cfe6bed2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.314441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0acdd6f9-284e-4a51-9019-0765cfe6bed2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.320275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0acdd6f9-284e-4a51-9019-0765cfe6bed2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.320761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0acdd6f9-284e-4a51-9019-0765cfe6bed2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.321200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0acdd6f9-284e-4a51-9019-0765cfe6bed2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.321888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0acdd6f9-284e-4a51-9019-0765cfe6bed2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.322342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0acdd6f9-284e-4a51-9019-0765cfe6bed2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.322764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0acdd6f9-284e-4a51-9019-0765cfe6bed2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.351846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27db8929-6bd3-40e3-aa78-f7f14c07d5f2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.360789 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27db8929-6bd3-40e3-aa78-f7f14c07d5f2 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1466 microversion: 2.1 time: 0.089123 Oct 04 18:14:58.361376 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1571/3185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1466 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:58.456570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0acdd6f9-284e-4a51-9019-0765cfe6bed2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.464515 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0acdd6f9-284e-4a51-9019-0765cfe6bed2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.154214 Oct 04 18:14:58.471175 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1615/3186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:58.695477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ed71b1b-a727-46ce-96ca-3dcd12362cf6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.696125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4ed71b1b-a727-46ce-96ca-3dcd12362cf6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.703086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ed71b1b-a727-46ce-96ca-3dcd12362cf6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.703567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ed71b1b-a727-46ce-96ca-3dcd12362cf6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.704009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ed71b1b-a727-46ce-96ca-3dcd12362cf6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.704754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ed71b1b-a727-46ce-96ca-3dcd12362cf6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.705175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ed71b1b-a727-46ce-96ca-3dcd12362cf6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.705604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ed71b1b-a727-46ce-96ca-3dcd12362cf6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.805776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.806415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.808455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:58.814789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.815322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.815770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.816480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.816945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.817381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.835163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ed71b1b-a727-46ce-96ca-3dcd12362cf6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.843471 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4ed71b1b-a727-46ce-96ca-3dcd12362cf6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1317 microversion: 2.1 time: 0.151938 Oct 04 18:14:58.844050 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1572/3187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:58.950117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fcf524cd-8c8b-4db2-afc3-1bba22bc5fb1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.951120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fcf524cd-8c8b-4db2-afc3-1bba22bc5fb1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.952449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.957946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf524cd-8c8b-4db2-afc3-1bba22bc5fb1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.958365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf524cd-8c8b-4db2-afc3-1bba22bc5fb1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.958807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf524cd-8c8b-4db2-afc3-1bba22bc5fb1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.959628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf524cd-8c8b-4db2-afc3-1bba22bc5fb1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.960097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf524cd-8c8b-4db2-afc3-1bba22bc5fb1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.960531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcf524cd-8c8b-4db2-afc3-1bba22bc5fb1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.962261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.963743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.964912 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-91aa58f9-a891-4877-8af3-dd30fded5627 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.163414 Oct 04 18:14:58.965470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1616/3188] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:58.980139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:59.126811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fcf524cd-8c8b-4db2-afc3-1bba22bc5fb1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:59.135297 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fcf524cd-8c8b-4db2-afc3-1bba22bc5fb1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.189469 Oct 04 18:14:59.135911 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1573/3189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:59.167452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c98c416-380a-4849-a27e-ff7458a2bf9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:59.168232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c98c416-380a-4849-a27e-ff7458a2bf9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:59.175987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c98c416-380a-4849-a27e-ff7458a2bf9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.176644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c98c416-380a-4849-a27e-ff7458a2bf9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.177088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c98c416-380a-4849-a27e-ff7458a2bf9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.178006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c98c416-380a-4849-a27e-ff7458a2bf9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.178612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c98c416-380a-4849-a27e-ff7458a2bf9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.179090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c98c416-380a-4849-a27e-ff7458a2bf9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.332061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce6f5c9d-0136-476b-bf4d-12d5a9ad06ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:59.333282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ce6f5c9d-0136-476b-bf4d-12d5a9ad06ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:59.340891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6f5c9d-0136-476b-bf4d-12d5a9ad06ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.341939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6f5c9d-0136-476b-bf4d-12d5a9ad06ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.343172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6f5c9d-0136-476b-bf4d-12d5a9ad06ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.346028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6f5c9d-0136-476b-bf4d-12d5a9ad06ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.351777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6f5c9d-0136-476b-bf4d-12d5a9ad06ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.352475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6f5c9d-0136-476b-bf4d-12d5a9ad06ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.501617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3c98c416-380a-4849-a27e-ff7458a2bf9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:59.519238 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c98c416-380a-4849-a27e-ff7458a2bf9f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1315 microversion: 2.1 time: 0.355859 Oct 04 18:14:59.520524 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1617/3190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:59 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:59.536432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:59.537440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:59.553655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.554584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.555877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.563529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.564378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.565171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.612908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.613736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.614433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.615158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lazy-loading 'fault' on Instance uuid 21532f2f-90bb-4233-9a7c-5b8962cff43e {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:00.157831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.162451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce6f5c9d-0136-476b-bf4d-12d5a9ad06ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.168873 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ddbadad7-ad20-4b1a-bf5b-8c79fbd8260e tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 200 len: 1305 microversion: 2.1 time: 0.646663 Oct 04 18:15:00.180688 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce6f5c9d-0136-476b-bf4d-12d5a9ad06ab tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1468 microversion: 2.1 time: 0.850775 Oct 04 18:15:00.180688 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1574/3191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:59 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1468 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:00.193311 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1618/3192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:59 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 1305 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:00.207281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-135677db-7f0f-4878-8044-68985c672766 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:00.208996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0dab3171-c567-4e42-8bd0-e2f55e47ebb3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:00.209325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-135677db-7f0f-4878-8044-68985c672766 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:00.209918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0dab3171-c567-4e42-8bd0-e2f55e47ebb3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:00.218857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135677db-7f0f-4878-8044-68985c672766 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.219407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dab3171-c567-4e42-8bd0-e2f55e47ebb3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.219899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dab3171-c567-4e42-8bd0-e2f55e47ebb3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.220737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dab3171-c567-4e42-8bd0-e2f55e47ebb3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.222297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dab3171-c567-4e42-8bd0-e2f55e47ebb3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.223470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dab3171-c567-4e42-8bd0-e2f55e47ebb3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.224083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dab3171-c567-4e42-8bd0-e2f55e47ebb3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.224633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135677db-7f0f-4878-8044-68985c672766 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.225563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135677db-7f0f-4878-8044-68985c672766 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.228064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135677db-7f0f-4878-8044-68985c672766 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.229817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135677db-7f0f-4878-8044-68985c672766 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.231728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-135677db-7f0f-4878-8044-68985c672766 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.675780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0dab3171-c567-4e42-8bd0-e2f55e47ebb3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.685125 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0dab3171-c567-4e42-8bd0-e2f55e47ebb3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.485978 Oct 04 18:15:00.685945 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1575/3193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:00 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:00.691363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:00.692182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:00.699191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.700023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.700725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.701628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.702662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.703129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.723095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-135677db-7f0f-4878-8044-68985c672766 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.744374 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-135677db-7f0f-4878-8044-68985c672766 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1317 microversion: 2.1 time: 0.548843 Oct 04 18:15:00.745309 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1619/3194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:00 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:00.775144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4be06e3b-0142-4ada-accd-3309d7757579 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:00.775928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4be06e3b-0142-4ada-accd-3309d7757579 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:00.784845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4be06e3b-0142-4ada-accd-3309d7757579 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.790945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4be06e3b-0142-4ada-accd-3309d7757579 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.791558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4be06e3b-0142-4ada-accd-3309d7757579 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.792394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4be06e3b-0142-4ada-accd-3309d7757579 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.792935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4be06e3b-0142-4ada-accd-3309d7757579 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.793438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4be06e3b-0142-4ada-accd-3309d7757579 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.816616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:00.857174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=20 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:00.892952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.901375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.903304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.904736 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e6362aea-1468-462c-8c61-71fff8033381 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1485 microversion: 2.25 time: 0.217158 Oct 04 18:15:00.905474 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1576/3195] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:00 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1485 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:00.910251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b80a689-2644-4391-b7a1-53cd72c0baf3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-585705151"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:00.912836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3b80a689-2644-4391-b7a1-53cd72c0baf3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:00.919849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b80a689-2644-4391-b7a1-53cd72c0baf3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.920353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b80a689-2644-4391-b7a1-53cd72c0baf3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.921299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b80a689-2644-4391-b7a1-53cd72c0baf3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.922273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b80a689-2644-4391-b7a1-53cd72c0baf3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.922909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b80a689-2644-4391-b7a1-53cd72c0baf3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.923701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b80a689-2644-4391-b7a1-53cd72c0baf3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.957170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4be06e3b-0142-4ada-accd-3309d7757579 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.965328 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4be06e3b-0142-4ada-accd-3309d7757579 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.194412 Oct 04 18:15:00.966826 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1620/3196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:00 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:00.971498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9a33e3e2-cad2-4b48-8d31-2e61e5e905d8 req-54f2b1bf-f4fa-4d8b-a518-e9655e3693c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da89d46d-4ae1-466f-9889-e1d528e843e5", "name": "network-vif-unplugged", "status": "completed", "tag": "4705f29d-c67d-4649-af0a-38b1ead030b6"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:00.981525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9a33e3e2-cad2-4b48-8d31-2e61e5e905d8 req-54f2b1bf-f4fa-4d8b-a518-e9655e3693c9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.982380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9a33e3e2-cad2-4b48-8d31-2e61e5e905d8 req-54f2b1bf-f4fa-4d8b-a518-e9655e3693c9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.982830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9a33e3e2-cad2-4b48-8d31-2e61e5e905d8 req-54f2b1bf-f4fa-4d8b-a518-e9655e3693c9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.997291 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9a33e3e2-cad2-4b48-8d31-2e61e5e905d8 req-54f2b1bf-f4fa-4d8b-a518-e9655e3693c9 service nova] Creating event network-vif-unplugged:4705f29d-c67d-4649-af0a-38b1ead030b6 for instance da89d46d-4ae1-466f-9889-e1d528e843e5 on n-h2-850499-14 Oct 04 18:15:01.002892 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9a33e3e2-cad2-4b48-8d31-2e61e5e905d8 req-54f2b1bf-f4fa-4d8b-a518-e9655e3693c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034415 Oct 04 18:15:01.004501 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1621/3197] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:01.009959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1c46636f-d8f6-4740-9f63-c9ae27cb299f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.010711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1c46636f-d8f6-4740-9f63-c9ae27cb299f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.017684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c46636f-d8f6-4740-9f63-c9ae27cb299f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.018243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c46636f-d8f6-4740-9f63-c9ae27cb299f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.018690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c46636f-d8f6-4740-9f63-c9ae27cb299f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.019461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c46636f-d8f6-4740-9f63-c9ae27cb299f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.019919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c46636f-d8f6-4740-9f63-c9ae27cb299f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.020350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c46636f-d8f6-4740-9f63-c9ae27cb299f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.146572 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b80a689-2644-4391-b7a1-53cd72c0baf3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "POST /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948/action" status: 202 len: 0 microversion: 2.1 time: 0.239839 Oct 04 18:15:01.153644 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1577/3198] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:00 2022] POST /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:15:01.153644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-bdb42904-252c-4aaf-9393-61cc53a26835 req-5bdd02d9-e6ef-4fa5-a0fa-e47729b09eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afef2588-b2e9-4b9e-943c-44469215dd64", "tag": "e1f04890-a2cf-4366-ad64-14ecf15d04cf"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:01.163393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bdb42904-252c-4aaf-9393-61cc53a26835 req-5bdd02d9-e6ef-4fa5-a0fa-e47729b09eaf service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.163878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bdb42904-252c-4aaf-9393-61cc53a26835 req-5bdd02d9-e6ef-4fa5-a0fa-e47729b09eaf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.164315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bdb42904-252c-4aaf-9393-61cc53a26835 req-5bdd02d9-e6ef-4fa5-a0fa-e47729b09eaf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.176729 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-bdb42904-252c-4aaf-9393-61cc53a26835 req-5bdd02d9-e6ef-4fa5-a0fa-e47729b09eaf service nova] Creating event network-changed:e1f04890-a2cf-4366-ad64-14ecf15d04cf for instance afef2588-b2e9-4b9e-943c-44469215dd64 on n-h2-850499-14 Oct 04 18:15:01.178781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1c46636f-d8f6-4740-9f63-c9ae27cb299f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:01.182370 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-bdb42904-252c-4aaf-9393-61cc53a26835 req-5bdd02d9-e6ef-4fa5-a0fa-e47729b09eaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033333 Oct 04 18:15:01.183313 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1578/3199] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:01.189563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b1c4fbb-834c-4f24-a299-d428e33c6265 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d18ce9d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.192730 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1c46636f-d8f6-4740-9f63-c9ae27cb299f tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1501 microversion: 2.1 time: 0.186769 Oct 04 18:15:01.199392 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1622/3200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:01.204907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.208495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.231929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.232344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.232754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.238990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.239152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.239639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.251863 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b1c4fbb-834c-4f24-a299-d428e33c6265 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.066987 Oct 04 18:15:01.252770 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1579/3201] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:01.257864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0e60a1b2-f277-420f-84c7-314bfcb619ad tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:01.258663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0e60a1b2-f277-420f-84c7-314bfcb619ad tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.259849 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e HTTP/1.1 Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '21532f2f-90bb-4233-9a7c-5b8962cff43e'} Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:01.261790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:01.266800 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:01.266800 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:01.266800 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:01.266800 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:01.266800 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:01.266800 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:01.266800 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:01.266800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:01.267411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e60a1b2-f277-420f-84c7-314bfcb619ad tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.267738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e60a1b2-f277-420f-84c7-314bfcb619ad tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.268222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e60a1b2-f277-420f-84c7-314bfcb619ad tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.268940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e60a1b2-f277-420f-84c7-314bfcb619ad tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.269401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e60a1b2-f277-420f-84c7-314bfcb619ad tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.269831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e60a1b2-f277-420f-84c7-314bfcb619ad tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.275245 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-75447e1c-2c17-4fbf-afa9-ff75fabc6153 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 404 len: 111 microversion: 2.1 time: 0.064991 Oct 04 18:15:01.277301 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1623/3202] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:01.288366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ec3de4e-1cfc-4ea8-878e-63a528c5562a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d629dc10>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.296334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-0e60a1b2-f277-420f-84c7-314bfcb619ad tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'flavor' on Instance uuid e4400b05-cc8a-4d94-9f60-4842340d090e {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:01.379417 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0e60a1b2-f277-420f-84c7-314bfcb619ad tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "POST /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e/action" status: 202 len: 0 microversion: 2.1 time: 0.124408 Oct 04 18:15:01.380617 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1580/3203] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:01 2022] POST /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:01.391697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-753f283e-039b-4adb-a87c-04981d135d56 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.392668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-753f283e-039b-4adb-a87c-04981d135d56 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.402217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-753f283e-039b-4adb-a87c-04981d135d56 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.402984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-753f283e-039b-4adb-a87c-04981d135d56 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.403595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-753f283e-039b-4adb-a87c-04981d135d56 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.405984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-753f283e-039b-4adb-a87c-04981d135d56 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.406985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-753f283e-039b-4adb-a87c-04981d135d56 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.407600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-753f283e-039b-4adb-a87c-04981d135d56 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.580206 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ec3de4e-1cfc-4ea8-878e-63a528c5562a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/2511c79e-9bb0-4a91-94ed-6aa131ef5830" status: 202 len: 0 microversion: 2.1 time: 0.297666 Oct 04 18:15:01.584114 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1624/3204] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:01 2022] DELETE /compute/v2.1/os-security-groups/2511c79e-9bb0-4a91-94ed-6aa131ef5830 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:15:01.589313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f1846668-6d2d-4d9c-86f2-ce3be54293d7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d1a7e1f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.600644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-753f283e-039b-4adb-a87c-04981d135d56 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:01.612590 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-753f283e-039b-4adb-a87c-04981d135d56 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1509 microversion: 2.1 time: 0.227571 Oct 04 18:15:01.614608 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1581/3205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:01.709148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-390fa977-8836-41ca-9ad2-5b0f62452224 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.709959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-390fa977-8836-41ca-9ad2-5b0f62452224 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.717053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-390fa977-8836-41ca-9ad2-5b0f62452224 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.717729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-390fa977-8836-41ca-9ad2-5b0f62452224 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.718609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-390fa977-8836-41ca-9ad2-5b0f62452224 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.719763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-390fa977-8836-41ca-9ad2-5b0f62452224 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.720341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-390fa977-8836-41ca-9ad2-5b0f62452224 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.720862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-390fa977-8836-41ca-9ad2-5b0f62452224 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.811068 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f1846668-6d2d-4d9c-86f2-ce3be54293d7 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/0b44f583-9194-412d-a997-5af0898599b1" status: 202 len: 0 microversion: 2.1 time: 0.225517 Oct 04 18:15:01.820815 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1625/3206] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:01 2022] DELETE /compute/v2.1/os-security-groups/0b44f583-9194-412d-a997-5af0898599b1 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:01.824119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-19a3c15e-c926-435f-9769-8c23cb62f2e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.824742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-19a3c15e-c926-435f-9769-8c23cb62f2e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.837536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19a3c15e-c926-435f-9769-8c23cb62f2e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.838035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19a3c15e-c926-435f-9769-8c23cb62f2e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.838472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19a3c15e-c926-435f-9769-8c23cb62f2e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.840354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19a3c15e-c926-435f-9769-8c23cb62f2e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.841540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19a3c15e-c926-435f-9769-8c23cb62f2e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.842150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19a3c15e-c926-435f-9769-8c23cb62f2e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.895940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-390fa977-8836-41ca-9ad2-5b0f62452224 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:01.903879 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-390fa977-8836-41ca-9ad2-5b0f62452224 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.198656 Oct 04 18:15:01.904740 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1582/3207] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:01.909801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0131c8dc-e222-4cfb-a4dc-6610b0834493 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'create', calling method: .version_select at 0x7fd4d6174040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1799355056", "description": "tempest-description-290755536"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:02.026058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-19a3c15e-c926-435f-9769-8c23cb62f2e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.028399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=10 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:02.036174 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-19a3c15e-c926-435f-9769-8c23cb62f2e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1317 microversion: 2.1 time: 0.215724 Oct 04 18:15:02.036826 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1626/3208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:02.042138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.042886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.049005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.049633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.049930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.050645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.051119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.051604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.146773 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0131c8dc-e222-4cfb-a4dc-6610b0834493 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.240411 Oct 04 18:15:02.147652 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1583/3209] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 4 18:15:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:02.152434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d3fd3e43-f3fb-418f-bd7e-fb67de94a6be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.153203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d3fd3e43-f3fb-418f-bd7e-fb67de94a6be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.159570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3fd3e43-f3fb-418f-bd7e-fb67de94a6be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.160307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3fd3e43-f3fb-418f-bd7e-fb67de94a6be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.160872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3fd3e43-f3fb-418f-bd7e-fb67de94a6be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.161909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3fd3e43-f3fb-418f-bd7e-fb67de94a6be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.162764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3fd3e43-f3fb-418f-bd7e-fb67de94a6be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.164010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3fd3e43-f3fb-418f-bd7e-fb67de94a6be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.245072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.254084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.255634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.256844 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6577a773-5348-4a2f-bb0b-a38e378a2c3b tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1475 microversion: 2.25 time: 0.219162 Oct 04 18:15:02.257433 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1627/3210] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1475 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:02.262594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7c25983d-2092-4b02-96b1-2791e8902c2a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Action: 'update', calling method: .version_select at 0x7fd4d1b30430>, body: {"security_group": {"name": "tempest-sg-hth-1289126801", "description": "tempest-description-hth-1237448786"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:02.346700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d3fd3e43-f3fb-418f-bd7e-fb67de94a6be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.354442 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d3fd3e43-f3fb-418f-bd7e-fb67de94a6be tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.205635 Oct 04 18:15:02.355028 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1584/3211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:02.367795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-528363bd-89e8-48b0-9733-55fc017c3d49 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1f59790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.427332 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-528363bd-89e8-48b0-9733-55fc017c3d49 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.063352 Oct 04 18:15:02.427939 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1585/3212] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:02.433041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-195399c2-25af-4ab8-8482-582d800786d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '.version_select at 0x7fd4d61740d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.438306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-195399c2-25af-4ab8-8482-582d800786d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.438812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-195399c2-25af-4ab8-8482-582d800786d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.439296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-195399c2-25af-4ab8-8482-582d800786d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.449104 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-195399c2-25af-4ab8-8482-582d800786d1 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1961 microversion: 2.25 time: 0.019779 Oct 04 18:15:02.449723 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1586/3213] 10.222.0.18 () {60 vars in 1184 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/os-migrations => generated 1961 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:02.464828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be561f13-8782-4b8a-9995-7a67e0b24af3 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.465525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be561f13-8782-4b8a-9995-7a67e0b24af3 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.468939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:02.474202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be561f13-8782-4b8a-9995-7a67e0b24af3 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.474830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be561f13-8782-4b8a-9995-7a67e0b24af3 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.475357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be561f13-8782-4b8a-9995-7a67e0b24af3 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.476126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be561f13-8782-4b8a-9995-7a67e0b24af3 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.476664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be561f13-8782-4b8a-9995-7a67e0b24af3 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.477286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be561f13-8782-4b8a-9995-7a67e0b24af3 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.503979 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7c25983d-2092-4b02-96b1-2791e8902c2a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/3221352c-626e-4a1c-a2de-4590f1fa012b" status: 200 len: 218 microversion: 2.1 time: 0.245407 Oct 04 18:15:02.504582 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1628/3214] 10.222.0.18 () {60 vars in 1290 bytes} [Tue Oct 4 18:15:02 2022] PUT /compute/v2.1/os-security-groups/3221352c-626e-4a1c-a2de-4590f1fa012b => generated 218 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:02.518013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00e7c820-66b2-4f2f-8496-acc733c55fcf tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d629dd30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.620985 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00e7c820-66b2-4f2f-8496-acc733c55fcf tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/3221352c-626e-4a1c-a2de-4590f1fa012b" status: 200 len: 218 microversion: 2.1 time: 0.107008 Oct 04 18:15:02.621700 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1629/3215] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/os-security-groups/3221352c-626e-4a1c-a2de-4590f1fa012b => generated 218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:02.635610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9b67fcf1-cad3-4084-9234-f45667e1331b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d12ef430>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.666223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-be561f13-8782-4b8a-9995-7a67e0b24af3 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] Lazy-loading 'services' on Instance uuid a36c7b27-9927-4f6d-874d-dbf86b9ef895 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:02.682047 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be561f13-8782-4b8a-9995-7a67e0b24af3 tempest-LiveAutoBlockMigrationV225Test-945679136 tempest-LiveAutoBlockMigrationV225Test-945679136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1969 microversion: 2.25 time: 0.220685 Oct 04 18:15:02.683317 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1587/3216] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1969 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:15:02.688210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c9cd3693-4d9e-467b-9b8c-a293ea727383 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.689226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c9cd3693-4d9e-467b-9b8c-a293ea727383 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.695426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9cd3693-4d9e-467b-9b8c-a293ea727383 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.696039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9cd3693-4d9e-467b-9b8c-a293ea727383 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.696588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9cd3693-4d9e-467b-9b8c-a293ea727383 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.697379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9cd3693-4d9e-467b-9b8c-a293ea727383 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.697939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9cd3693-4d9e-467b-9b8c-a293ea727383 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.698488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9cd3693-4d9e-467b-9b8c-a293ea727383 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.914393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c9cd3693-4d9e-467b-9b8c-a293ea727383 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.924472 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c9cd3693-4d9e-467b-9b8c-a293ea727383 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1509 microversion: 2.1 time: 0.239755 Oct 04 18:15:02.925195 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1588/3217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:02.927598 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9b67fcf1-cad3-4084-9234-f45667e1331b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/3221352c-626e-4a1c-a2de-4590f1fa012b" status: 202 len: 0 microversion: 2.1 time: 0.295806 Oct 04 18:15:02.928642 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1630/3218] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:02 2022] DELETE /compute/v2.1/os-security-groups/3221352c-626e-4a1c-a2de-4590f1fa012b => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:15:02.934313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6742becd-ca17-4183-88f0-7d0475f233bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.934968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8c78db69-9c9c-45b5-9502-8802ccb2c5ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.935359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6742becd-ca17-4183-88f0-7d0475f233bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.935626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c78db69-9c9c-45b5-9502-8802ccb2c5ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.942204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c78db69-9c9c-45b5-9502-8802ccb2c5ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.942737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c78db69-9c9c-45b5-9502-8802ccb2c5ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.943202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c78db69-9c9c-45b5-9502-8802ccb2c5ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.944274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c78db69-9c9c-45b5-9502-8802ccb2c5ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.944731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c78db69-9c9c-45b5-9502-8802ccb2c5ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.944866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6742becd-ca17-4183-88f0-7d0475f233bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.945521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c78db69-9c9c-45b5-9502-8802ccb2c5ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.945705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6742becd-ca17-4183-88f0-7d0475f233bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.946354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6742becd-ca17-4183-88f0-7d0475f233bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.947238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6742becd-ca17-4183-88f0-7d0475f233bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.947835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6742becd-ca17-4183-88f0-7d0475f233bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.955091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6742becd-ca17-4183-88f0-7d0475f233bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.973157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c78db69-9c9c-45b5-9502-8802ccb2c5ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:03.022654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:03.059134 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8c78db69-9c9c-45b5-9502-8802ccb2c5ef tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 204 len: 0 microversion: 2.25 time: 0.132632 Oct 04 18:15:03.059723 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1589/3219] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:02 2022] DELETE /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:15:03.065062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.065645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.071741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.072853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.073413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.074124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.074586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.075110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.092287 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e HTTP/1.1 Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '21532f2f-90bb-4233-9a7c-5b8962cff43e'} Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:03.094694 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:03.099167 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-30adaa09-9828-41cb-83ea-95fb5131a0df tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 404 len: 111 microversion: 2.1 time: 0.035486 Oct 04 18:15:03.100150 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1590/3220] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:03 2022] DELETE /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:03.104636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-990762b7-f2c3-4940-8773-707580218998 req-39aadd90-76e8-4a07-8da1-426ae6cc2538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18aacc75-5a79-414c-a91a-ff8aac1b347f", "name": "network-vif-plugged", "status": "completed", "tag": "a4b6fb86-c263-471c-b2a7-4980a2202458"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:03.115145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-990762b7-f2c3-4940-8773-707580218998 req-39aadd90-76e8-4a07-8da1-426ae6cc2538 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.115640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-990762b7-f2c3-4940-8773-707580218998 req-39aadd90-76e8-4a07-8da1-426ae6cc2538 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.116079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-990762b7-f2c3-4940-8773-707580218998 req-39aadd90-76e8-4a07-8da1-426ae6cc2538 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.127843 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-990762b7-f2c3-4940-8773-707580218998 req-39aadd90-76e8-4a07-8da1-426ae6cc2538 service nova] Creating event network-vif-plugged:a4b6fb86-c263-471c-b2a7-4980a2202458 for instance 18aacc75-5a79-414c-a91a-ff8aac1b347f on n-h2-850499-14 Oct 04 18:15:03.148940 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-990762b7-f2c3-4940-8773-707580218998 req-39aadd90-76e8-4a07-8da1-426ae6cc2538 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047353 Oct 04 18:15:03.149582 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1591/3221] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:03.157605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fe52e0aa-1c78-4a82-9ad8-58e80c01e31f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.158341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fe52e0aa-1c78-4a82-9ad8-58e80c01e31f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.167928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe52e0aa-1c78-4a82-9ad8-58e80c01e31f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.168646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe52e0aa-1c78-4a82-9ad8-58e80c01e31f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.169704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe52e0aa-1c78-4a82-9ad8-58e80c01e31f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.171075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe52e0aa-1c78-4a82-9ad8-58e80c01e31f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.171911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe52e0aa-1c78-4a82-9ad8-58e80c01e31f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.172536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe52e0aa-1c78-4a82-9ad8-58e80c01e31f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.198050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6742becd-ca17-4183-88f0-7d0475f233bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.210120 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6742becd-ca17-4183-88f0-7d0475f233bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.280122 Oct 04 18:15:03.210865 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1631/3222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:03.217205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.217938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.224312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.225107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.225679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.226553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.227161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.227653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.257610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:03.445281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fe52e0aa-1c78-4a82-9ad8-58e80c01e31f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.459322 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fe52e0aa-1c78-4a82-9ad8-58e80c01e31f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1317 microversion: 2.1 time: 0.308032 Oct 04 18:15:03.460633 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1592/3223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:03.473944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.474754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 21532f2f-90bb-4233-9a7c-5b8962cff43e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.481104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.481604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.482049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.482754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.483358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.483826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.500075 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e HTTP/1.1 Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '21532f2f-90bb-4233-9a7c-5b8962cff43e'} Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.501899 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.507273 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.507273 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.507273 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.507273 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:03.507273 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:03.507273 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. Oct 04 18:15:03.507273 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.507273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Instance 21532f2f-90bb-4233-9a7c-5b8962cff43e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:03.507273 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c63929d-a015-49b3-ac10-cdfb9e19933f tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e" status: 404 len: 111 microversion: 2.1 time: 0.033446 Oct 04 18:15:03.507273 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1593/3224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/servers/21532f2f-90bb-4233-9a7c-5b8962cff43e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:03.509989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-764ff5d2-485f-4c21-a0d4-934572d2cfc8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.510568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-764ff5d2-485f-4c21-a0d4-934572d2cfc8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.518142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764ff5d2-485f-4c21-a0d4-934572d2cfc8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.518686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764ff5d2-485f-4c21-a0d4-934572d2cfc8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.519029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764ff5d2-485f-4c21-a0d4-934572d2cfc8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.519874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764ff5d2-485f-4c21-a0d4-934572d2cfc8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.520349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764ff5d2-485f-4c21-a0d4-934572d2cfc8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.520779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764ff5d2-485f-4c21-a0d4-934572d2cfc8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.522139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.535909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.537399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.538623 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-515520df-dfd1-43b2-8ef2-ac8c7f1f5042 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1481 microversion: 2.25 time: 0.326498 Oct 04 18:15:03.539267 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1632/3225] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1481 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:03.543790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a38eef26-955e-4349-8704-ea645ad5bc03 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d629dd30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.599718 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a38eef26-955e-4349-8704-ea645ad5bc03 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.059403 Oct 04 18:15:03.600303 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1633/3226] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:03.606595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6f502be-f509-4b36-b26e-62e33bf1f154 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d12ef160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.649480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-d6f502be-f509-4b36-b26e-62e33bf1f154 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b44f583-9194-412d-a997-5af0898599b1 does not exist", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:15:03.650257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.security_group_api [None req-d6f502be-f509-4b36-b26e-62e33bf1f154 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Neutron security group 0b44f583-9194-412d-a997-5af0898599b1 not found {{(pid=122332) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:15:03.651016 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d6f502be-f509-4b36-b26e-62e33bf1f154 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security group 0b44f583-9194-412d-a997-5af0898599b1 does not exist Oct 04 18:15:03.651016 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-b2b54986-375d-4188-907a-218f7727634b'] Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6f502be-f509-4b36-b26e-62e33bf1f154 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-security-groups/0b44f583-9194-412d-a997-5af0898599b1 HTTP/1.1 Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: exception: Security group 0b44f583-9194-412d-a997-5af0898599b1 does not exist Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-b2b54986-375d-4188-907a-218f7727634b'] Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '0b44f583-9194-412d-a997-5af0898599b1'} Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:15:03.653262 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b44f583-9194-412d-a997-5af0898599b1 does not exist Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2b54986-375d-4188-907a-218f7727634b'] Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b44f583-9194-412d-a997-5af0898599b1 does not exist Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2b54986-375d-4188-907a-218f7727634b'] Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b44f583-9194-412d-a997-5af0898599b1 does not exist Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2b54986-375d-4188-907a-218f7727634b'] Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b44f583-9194-412d-a997-5af0898599b1 does not exist Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2b54986-375d-4188-907a-218f7727634b'] Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6f502be-f509-4b36-b26e-62e33bf1f154 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Security group 0b44f583-9194-412d-a997-5af0898599b1 does not exist Oct 04 18:15:03.659699 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-b2b54986-375d-4188-907a-218f7727634b'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:03.664200 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d6f502be-f509-4b36-b26e-62e33bf1f154 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/0b44f583-9194-412d-a997-5af0898599b1" status: 404 len: 194 microversion: 2.1 time: 0.062213 Oct 04 18:15:03.664988 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1634/3227] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:03 2022] DELETE /compute/v2.1/os-security-groups/0b44f583-9194-412d-a997-5af0898599b1 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:03.672931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c425fccf-3a64-4bf2-be42-44ea008082cb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d1a7eaf0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.703593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-c425fccf-3a64-4bf2-be42-44ea008082cb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 does not exist", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:15:03.704269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.security_group_api [None req-c425fccf-3a64-4bf2-be42-44ea008082cb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Neutron security group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 not found {{(pid=122332) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:15:03.704899 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-c425fccf-3a64-4bf2-be42-44ea008082cb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 does not exist Oct 04 18:15:03.704899 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-027050ec-846f-4aa9-9025-40df87306466'] Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c425fccf-3a64-4bf2-be42-44ea008082cb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-security-groups/2511c79e-9bb0-4a91-94ed-6aa131ef5830 HTTP/1.1 Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: exception: Security group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 does not exist Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-027050ec-846f-4aa9-9025-40df87306466'] Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '2511c79e-9bb0-4a91-94ed-6aa131ef5830'} Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:15:03.707070 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 does not exist Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-027050ec-846f-4aa9-9025-40df87306466'] Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 does not exist Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-027050ec-846f-4aa9-9025-40df87306466'] Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 does not exist Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-027050ec-846f-4aa9-9025-40df87306466'] Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 does not exist Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-027050ec-846f-4aa9-9025-40df87306466'] Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c425fccf-3a64-4bf2-be42-44ea008082cb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Security group 2511c79e-9bb0-4a91-94ed-6aa131ef5830 does not exist Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-027050ec-846f-4aa9-9025-40df87306466'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c425fccf-3a64-4bf2-be42-44ea008082cb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/2511c79e-9bb0-4a91-94ed-6aa131ef5830" status: 404 len: 194 microversion: 2.1 time: 0.040371 Oct 04 18:15:03.712313 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1635/3228] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:03 2022] DELETE /compute/v2.1/os-security-groups/2511c79e-9bb0-4a91-94ed-6aa131ef5830 => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:03.717452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a48c3fc-914e-48b4-b79f-17145a2d8e50 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d629dd30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.749801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-764ff5d2-485f-4c21-a0d4-934572d2cfc8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.758254 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-764ff5d2-485f-4c21-a0d4-934572d2cfc8 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.252891 Oct 04 18:15:03.758770 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1594/3229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:03.798402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-9a48c3fc-914e-48b4-b79f-17145a2d8e50 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:15:03.799086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.security_group_api [None req-9a48c3fc-914e-48b4-b79f-17145a2d8e50 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Neutron security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b not found {{(pid=122332) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:15:03.799564 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-9a48c3fc-914e-48b4-b79f-17145a2d8e50 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:15:03.799564 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-ca313415-8b87-44c4-b7ec-0cb897546d1f'] Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a48c3fc-914e-48b4-b79f-17145a2d8e50 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-security-groups/a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b HTTP/1.1 Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: exception: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-ca313415-8b87-44c4-b7ec-0cb897546d1f'] Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b'} Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:15:03.801633 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca313415-8b87-44c4-b7ec-0cb897546d1f'] Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca313415-8b87-44c4-b7ec-0cb897546d1f'] Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca313415-8b87-44c4-b7ec-0cb897546d1f'] Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca313415-8b87-44c4-b7ec-0cb897546d1f'] Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a48c3fc-914e-48b4-b79f-17145a2d8e50 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Security group a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b does not exist Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-ca313415-8b87-44c4-b7ec-0cb897546d1f'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a48c3fc-914e-48b4-b79f-17145a2d8e50 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b" status: 404 len: 194 microversion: 2.1 time: 0.089985 Oct 04 18:15:03.808929 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1636/3230] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:03 2022] DELETE /compute/v2.1/os-security-groups/a54518c8-f0b3-4c52-b03c-58ef0c1c8a8b => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:03.816304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c4ef173-98ff-4fc8-b55f-70425d6941f3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d6245790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.860790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-2c4ef173-98ff-4fc8-b55f-70425d6941f3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:15:03.861781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-2c4ef173-98ff-4fc8-b55f-70425d6941f3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Neutron security group 90bdeb49-844b-47b9-9692-8a302ea9e87f not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:15:03.862475 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-2c4ef173-98ff-4fc8-b55f-70425d6941f3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:15:03.862475 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-c10a535e-135e-4a41-b699-4d14dafdcb11'] Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c4ef173-98ff-4fc8-b55f-70425d6941f3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-security-groups/90bdeb49-844b-47b9-9692-8a302ea9e87f HTTP/1.1 Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: exception: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-c10a535e-135e-4a41-b699-4d14dafdcb11'] Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '90bdeb49-844b-47b9-9692-8a302ea9e87f'} Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:15:03.864747 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c10a535e-135e-4a41-b699-4d14dafdcb11'] Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c10a535e-135e-4a41-b699-4d14dafdcb11'] Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c10a535e-135e-4a41-b699-4d14dafdcb11'] Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c10a535e-135e-4a41-b699-4d14dafdcb11'] Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c4ef173-98ff-4fc8-b55f-70425d6941f3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Security group 90bdeb49-844b-47b9-9692-8a302ea9e87f does not exist Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-c10a535e-135e-4a41-b699-4d14dafdcb11'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:03.869629 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c4ef173-98ff-4fc8-b55f-70425d6941f3 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/90bdeb49-844b-47b9-9692-8a302ea9e87f" status: 404 len: 194 microversion: 2.1 time: 0.057262 Oct 04 18:15:03.872885 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1595/3231] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:03 2022] DELETE /compute/v2.1/os-security-groups/90bdeb49-844b-47b9-9692-8a302ea9e87f => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:03.880251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eaabbdf9-cfb7-4a4f-a30d-fe06feaf3f1a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d6294a60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.915124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-eaabbdf9-cfb7-4a4f-a30d-fe06feaf3f1a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:15:03.915879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.security_group_api [None req-eaabbdf9-cfb7-4a4f-a30d-fe06feaf3f1a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Neutron security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb not found {{(pid=122332) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:15:03.916807 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-eaabbdf9-cfb7-4a4f-a30d-fe06feaf3f1a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:15:03.916807 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-d883d8fb-3f89-49b3-ba9f-f0fda573f238'] Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eaabbdf9-cfb7-4a4f-a30d-fe06feaf3f1a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-security-groups/9d6a93d4-3464-4dd3-8ea6-f274d013afeb HTTP/1.1 Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: exception: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-d883d8fb-3f89-49b3-ba9f-f0fda573f238'] Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '9d6a93d4-3464-4dd3-8ea6-f274d013afeb'} Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:15:03.919273 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d883d8fb-3f89-49b3-ba9f-f0fda573f238'] Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d883d8fb-3f89-49b3-ba9f-f0fda573f238'] Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d883d8fb-3f89-49b3-ba9f-f0fda573f238'] Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d883d8fb-3f89-49b3-ba9f-f0fda573f238'] Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eaabbdf9-cfb7-4a4f-a30d-fe06feaf3f1a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Security group 9d6a93d4-3464-4dd3-8ea6-f274d013afeb does not exist Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: Neutron server returns request_ids: ['req-d883d8fb-3f89-49b3-ba9f-f0fda573f238'] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eaabbdf9-cfb7-4a4f-a30d-fe06feaf3f1a tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9d6a93d4-3464-4dd3-8ea6-f274d013afeb" status: 404 len: 194 microversion: 2.1 time: 0.048967 Oct 04 18:15:03.928035 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1637/3232] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:03 2022] DELETE /compute/v2.1/os-security-groups/9d6a93d4-3464-4dd3-8ea6-f274d013afeb => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:03.933405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99f660cb-7503-4fac-b7c2-8f78c9a8c0fd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d18ad1f0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.949450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7fe0d42b-6055-401e-a89e-54210d87b060 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.950188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7fe0d42b-6055-401e-a89e-54210d87b060 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.958119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe0d42b-6055-401e-a89e-54210d87b060 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.958686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe0d42b-6055-401e-a89e-54210d87b060 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.959202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe0d42b-6055-401e-a89e-54210d87b060 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.960024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe0d42b-6055-401e-a89e-54210d87b060 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.960490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe0d42b-6055-401e-a89e-54210d87b060 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.960994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fe0d42b-6055-401e-a89e-54210d87b060 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.991575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG neutronclient.v2_0.client [None req-99f660cb-7503-4fac-b7c2-8f78c9a8c0fd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist", "detail": ""}} {{(pid=122331) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:15:03.992442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-99f660cb-7503-4fac-b7c2-8f78c9a8c0fd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Neutron security group c6a0ffe3-559d-44fd-838f-347ab785438d not found {{(pid=122331) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:15:03.993073 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-99f660cb-7503-4fac-b7c2-8f78c9a8c0fd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:15:03.993073 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-1f982e3d-8d2e-490d-9639-2cbd3302c01d'] Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99f660cb-7503-4fac-b7c2-8f78c9a8c0fd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-security-groups/c6a0ffe3-559d-44fd-838f-347ab785438d HTTP/1.1 Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: exception: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-1f982e3d-8d2e-490d-9639-2cbd3302c01d'] Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c6a0ffe3-559d-44fd-838f-347ab785438d'} Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:15:03.995135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f982e3d-8d2e-490d-9639-2cbd3302c01d'] Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f982e3d-8d2e-490d-9639-2cbd3302c01d'] Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f982e3d-8d2e-490d-9639-2cbd3302c01d'] Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f982e3d-8d2e-490d-9639-2cbd3302c01d'] Oct 04 18:15:04.000293 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:04.002900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99f660cb-7503-4fac-b7c2-8f78c9a8c0fd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Security group c6a0ffe3-559d-44fd-838f-347ab785438d does not exist Oct 04 18:15:04.002900 n-d-850499-14 devstack@n-api.service[122331]: Neutron server returns request_ids: ['req-1f982e3d-8d2e-490d-9639-2cbd3302c01d'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:04.004214 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99f660cb-7503-4fac-b7c2-8f78c9a8c0fd tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c6a0ffe3-559d-44fd-838f-347ab785438d" status: 404 len: 194 microversion: 2.1 time: 0.076637 Oct 04 18:15:04.004976 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1596/3233] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:03 2022] DELETE /compute/v2.1/os-security-groups/c6a0ffe3-559d-44fd-838f-347ab785438d => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:04.014281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf660d12-0d25-4738-94a4-c290f571ed78 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.015406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf660d12-0d25-4738-94a4-c290f571ed78 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.022318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf660d12-0d25-4738-94a4-c290f571ed78 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.022818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf660d12-0d25-4738-94a4-c290f571ed78 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.023303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf660d12-0d25-4738-94a4-c290f571ed78 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.024021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf660d12-0d25-4738-94a4-c290f571ed78 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.024486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf660d12-0d25-4738-94a4-c290f571ed78 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.024920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf660d12-0d25-4738-94a4-c290f571ed78 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.055993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf660d12-0d25-4738-94a4-c290f571ed78 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:04.119791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7fe0d42b-6055-401e-a89e-54210d87b060 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.129372 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7fe0d42b-6055-401e-a89e-54210d87b060 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1492 microversion: 2.1 time: 0.184738 Oct 04 18:15:04.130275 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1638/3234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1492 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:04.152617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-440d3026-e92f-48ad-b538-90af1c5136ce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.153221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-440d3026-e92f-48ad-b538-90af1c5136ce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.159455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-440d3026-e92f-48ad-b538-90af1c5136ce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.159600 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf660d12-0d25-4738-94a4-c290f571ed78 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 204 len: 0 microversion: 2.1 time: 0.149709 Oct 04 18:15:04.159952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-440d3026-e92f-48ad-b538-90af1c5136ce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.160198 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1597/3235] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:04 2022] DELETE /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:04.160408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-440d3026-e92f-48ad-b538-90af1c5136ce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.161191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-440d3026-e92f-48ad-b538-90af1c5136ce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.161664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-440d3026-e92f-48ad-b538-90af1c5136ce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.162109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-440d3026-e92f-48ad-b538-90af1c5136ce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.168762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-026c9ed0-64ad-4f31-8c74-817862c77f7d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.169559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-026c9ed0-64ad-4f31-8c74-817862c77f7d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.175851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-026c9ed0-64ad-4f31-8c74-817862c77f7d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.176438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-026c9ed0-64ad-4f31-8c74-817862c77f7d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.177008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-026c9ed0-64ad-4f31-8c74-817862c77f7d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.177721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-026c9ed0-64ad-4f31-8c74-817862c77f7d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.178187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-026c9ed0-64ad-4f31-8c74-817862c77f7d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.178623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-026c9ed0-64ad-4f31-8c74-817862c77f7d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.190216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-440d3026-e92f-48ad-b538-90af1c5136ce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:04.278343 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-440d3026-e92f-48ad-b538-90af1c5136ce tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 204 len: 0 microversion: 2.1 time: 0.129268 Oct 04 18:15:04.278996 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1639/3236] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:04 2022] DELETE /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:15:04.284386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c0e60880-1c29-4c85-9ba9-f48a142c57f8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.285087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c0e60880-1c29-4c85-9ba9-f48a142c57f8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.290730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0e60880-1c29-4c85-9ba9-f48a142c57f8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.291740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0e60880-1c29-4c85-9ba9-f48a142c57f8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.292307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0e60880-1c29-4c85-9ba9-f48a142c57f8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.293210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0e60880-1c29-4c85-9ba9-f48a142c57f8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.293670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0e60880-1c29-4c85-9ba9-f48a142c57f8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.294280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0e60880-1c29-4c85-9ba9-f48a142c57f8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.379256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-026c9ed0-64ad-4f31-8c74-817862c77f7d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.387254 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-026c9ed0-64ad-4f31-8c74-817862c77f7d tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1648 microversion: 2.1 time: 0.222804 Oct 04 18:15:04.387830 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1598/3237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:04 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1648 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:04.393071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-28ce0014-cd40-4bc7-9d9f-d5117aabd94e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.393684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-28ce0014-cd40-4bc7-9d9f-d5117aabd94e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.399812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28ce0014-cd40-4bc7-9d9f-d5117aabd94e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.400353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28ce0014-cd40-4bc7-9d9f-d5117aabd94e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.400803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28ce0014-cd40-4bc7-9d9f-d5117aabd94e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.401556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28ce0014-cd40-4bc7-9d9f-d5117aabd94e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.402046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28ce0014-cd40-4bc7-9d9f-d5117aabd94e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.402478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28ce0014-cd40-4bc7-9d9f-d5117aabd94e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.485015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c0e60880-1c29-4c85-9ba9-f48a142c57f8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.492921 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c0e60880-1c29-4c85-9ba9-f48a142c57f8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.212721 Oct 04 18:15:04.493502 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1640/3238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:04 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:04.498056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5cbdda88-ed17-42a9-b51d-0e2cbbb575f0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.498674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5cbdda88-ed17-42a9-b51d-0e2cbbb575f0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.505352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cbdda88-ed17-42a9-b51d-0e2cbbb575f0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.506036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cbdda88-ed17-42a9-b51d-0e2cbbb575f0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.506516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cbdda88-ed17-42a9-b51d-0e2cbbb575f0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.507239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cbdda88-ed17-42a9-b51d-0e2cbbb575f0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.507876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cbdda88-ed17-42a9-b51d-0e2cbbb575f0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.508307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5cbdda88-ed17-42a9-b51d-0e2cbbb575f0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.573336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-28ce0014-cd40-4bc7-9d9f-d5117aabd94e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.581861 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-28ce0014-cd40-4bc7-9d9f-d5117aabd94e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1498 microversion: 2.1 time: 0.192830 Oct 04 18:15:04.582445 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1599/3239] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:04 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1498 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:04.587528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.589284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.597577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.598554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.599325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.600200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.600825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.601555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.718218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5cbdda88-ed17-42a9-b51d-0e2cbbb575f0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.726603 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5cbdda88-ed17-42a9-b51d-0e2cbbb575f0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1317 microversion: 2.1 time: 0.232079 Oct 04 18:15:04.727436 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1641/3240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:04 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:04.732438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2c29f5cb-e328-4249-8e1d-f4f94412486f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1c9eb80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.769324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.778024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.779535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.781624 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-43760b85-7b21-4ba9-94a8-7c6ebe0d9f7d tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1481 microversion: 2.25 time: 0.197646 Oct 04 18:15:04.791683 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1600/3241] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:04 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1481 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:04.791860 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2c29f5cb-e328-4249-8e1d-f4f94412486f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.054190 Oct 04 18:15:04.791949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34f53915-ba8f-4fa6-abf2-ab4428c962fb tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.791949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34f53915-ba8f-4fa6-abf2-ab4428c962fb tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.792125 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1642/3242] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:04 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:04.795993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34f53915-ba8f-4fa6-abf2-ab4428c962fb tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.796381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34f53915-ba8f-4fa6-abf2-ab4428c962fb tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.796828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34f53915-ba8f-4fa6-abf2-ab4428c962fb tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.797551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34f53915-ba8f-4fa6-abf2-ab4428c962fb tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.798055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34f53915-ba8f-4fa6-abf2-ab4428c962fb tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.798452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34f53915-ba8f-4fa6-abf2-ab4428c962fb tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.946881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34f53915-ba8f-4fa6-abf2-ab4428c962fb tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.955424 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34f53915-ba8f-4fa6-abf2-ab4428c962fb tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.172158 Oct 04 18:15:04.956029 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1601/3243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:04 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:05.411048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0987a3b9-7104-4dfa-b746-8705561735fb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.411590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0987a3b9-7104-4dfa-b746-8705561735fb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.419284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0987a3b9-7104-4dfa-b746-8705561735fb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.419779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0987a3b9-7104-4dfa-b746-8705561735fb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.420226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0987a3b9-7104-4dfa-b746-8705561735fb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.420989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0987a3b9-7104-4dfa-b746-8705561735fb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.421450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0987a3b9-7104-4dfa-b746-8705561735fb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.421876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0987a3b9-7104-4dfa-b746-8705561735fb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.516909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6281a6bf-fe05-4868-b0ff-c8fdfb2db13e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.517523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6281a6bf-fe05-4868-b0ff-c8fdfb2db13e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.524081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6281a6bf-fe05-4868-b0ff-c8fdfb2db13e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.524577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6281a6bf-fe05-4868-b0ff-c8fdfb2db13e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.525013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6281a6bf-fe05-4868-b0ff-c8fdfb2db13e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.525718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6281a6bf-fe05-4868-b0ff-c8fdfb2db13e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.526172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6281a6bf-fe05-4868-b0ff-c8fdfb2db13e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.526597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6281a6bf-fe05-4868-b0ff-c8fdfb2db13e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.616919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0987a3b9-7104-4dfa-b746-8705561735fb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:05.624727 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0987a3b9-7104-4dfa-b746-8705561735fb tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1648 microversion: 2.1 time: 0.217653 Oct 04 18:15:05.625311 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1643/3244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1648 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:05.631154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-541a922c-6e18-4539-9b6a-06815960962e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.631154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-541a922c-6e18-4539-9b6a-06815960962e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.636224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-541a922c-6e18-4539-9b6a-06815960962e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.636920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-541a922c-6e18-4539-9b6a-06815960962e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.637603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-541a922c-6e18-4539-9b6a-06815960962e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.638487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-541a922c-6e18-4539-9b6a-06815960962e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.638980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-541a922c-6e18-4539-9b6a-06815960962e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.639475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-541a922c-6e18-4539-9b6a-06815960962e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.691945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6281a6bf-fe05-4868-b0ff-c8fdfb2db13e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:05.699629 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6281a6bf-fe05-4868-b0ff-c8fdfb2db13e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.186628 Oct 04 18:15:05.700202 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1602/3245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:05.749764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3825be33-06de-4bbf-aa87-46ca90d1ef35 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.750474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3825be33-06de-4bbf-aa87-46ca90d1ef35 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.756868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3825be33-06de-4bbf-aa87-46ca90d1ef35 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.757359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3825be33-06de-4bbf-aa87-46ca90d1ef35 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.757797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3825be33-06de-4bbf-aa87-46ca90d1ef35 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.758664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3825be33-06de-4bbf-aa87-46ca90d1ef35 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.759156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3825be33-06de-4bbf-aa87-46ca90d1ef35 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.759585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3825be33-06de-4bbf-aa87-46ca90d1ef35 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.775541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-541a922c-6e18-4539-9b6a-06815960962e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:05.783938 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-541a922c-6e18-4539-9b6a-06815960962e tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1498 microversion: 2.1 time: 0.157658 Oct 04 18:15:05.784524 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1644/3246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:05.798031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-999d323c-7816-4019-abda-b172227cf346 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d615f160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.842287 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-999d323c-7816-4019-abda-b172227cf346 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.048462 Oct 04 18:15:05.843394 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1645/3247] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:05.847893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.848510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.855453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.855951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.856410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.857122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.857591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.858025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.907669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3825be33-06de-4bbf-aa87-46ca90d1ef35 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:05.915724 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3825be33-06de-4bbf-aa87-46ca90d1ef35 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1317 microversion: 2.1 time: 0.170056 Oct 04 18:15:05.916374 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1603/3248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:05.978122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40c9fb08-7eec-442c-a787-b4f6277edaff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.978976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-40c9fb08-7eec-442c-a787-b4f6277edaff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.985850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40c9fb08-7eec-442c-a787-b4f6277edaff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.986414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40c9fb08-7eec-442c-a787-b4f6277edaff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.986922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40c9fb08-7eec-442c-a787-b4f6277edaff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.987714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40c9fb08-7eec-442c-a787-b4f6277edaff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.988266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40c9fb08-7eec-442c-a787-b4f6277edaff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.988692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40c9fb08-7eec-442c-a787-b4f6277edaff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.991958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.000303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.001764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.002940 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d9fa787-6ff2-4f25-b308-eedd84d926b1 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1481 microversion: 2.25 time: 0.158623 Oct 04 18:15:06.003727 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1646/3249] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1481 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:06.117220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-40c9fb08-7eec-442c-a787-b4f6277edaff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.125567 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40c9fb08-7eec-442c-a787-b4f6277edaff tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.151773 Oct 04 18:15:06.126128 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1604/3250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:06.647693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9e836389-f795-4b7a-8fb6-047b1c178a65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.648316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9e836389-f795-4b7a-8fb6-047b1c178a65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:06.655317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e836389-f795-4b7a-8fb6-047b1c178a65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.655809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e836389-f795-4b7a-8fb6-047b1c178a65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.656257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e836389-f795-4b7a-8fb6-047b1c178a65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.656972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e836389-f795-4b7a-8fb6-047b1c178a65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.657433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e836389-f795-4b7a-8fb6-047b1c178a65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.657866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e836389-f795-4b7a-8fb6-047b1c178a65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.723805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc1286c5-f499-4183-8a9a-a494139262f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.724498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dc1286c5-f499-4183-8a9a-a494139262f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:06.732190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1286c5-f499-4183-8a9a-a494139262f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.732706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1286c5-f499-4183-8a9a-a494139262f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.733695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1286c5-f499-4183-8a9a-a494139262f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.734479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1286c5-f499-4183-8a9a-a494139262f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.734982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1286c5-f499-4183-8a9a-a494139262f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.735532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc1286c5-f499-4183-8a9a-a494139262f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.937943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9e836389-f795-4b7a-8fb6-047b1c178a65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.945086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc1286c5-f499-4183-8a9a-a494139262f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.946152 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9e836389-f795-4b7a-8fb6-047b1c178a65 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1648 microversion: 2.1 time: 0.302363 Oct 04 18:15:06.946980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1647/3251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1648 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:06.954090 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dc1286c5-f499-4183-8a9a-a494139262f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.235591 Oct 04 18:15:06.954905 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1605/3252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:06.957049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ab427b5-bc93-4a4d-9b34-befc48e14fdb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.957927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ab427b5-bc93-4a4d-9b34-befc48e14fdb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:06.959753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d7ec2e25-b125-450c-aaac-dd8ee659661d tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d18ce790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.966170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ab427b5-bc93-4a4d-9b34-befc48e14fdb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.967146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ab427b5-bc93-4a4d-9b34-befc48e14fdb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.968296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ab427b5-bc93-4a4d-9b34-befc48e14fdb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.968964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ab427b5-bc93-4a4d-9b34-befc48e14fdb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.969432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ab427b5-bc93-4a4d-9b34-befc48e14fdb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.969967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ab427b5-bc93-4a4d-9b34-befc48e14fdb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.013703 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d7ec2e25-b125-450c-aaac-dd8ee659661d tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.057849 Oct 04 18:15:07.019129 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1606/3253] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:07.025573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-83daa8a4-b0b4-4756-9bd5-f65dda9aaa1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:07.026226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-83daa8a4-b0b4-4756-9bd5-f65dda9aaa1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:07.033727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83daa8a4-b0b4-4756-9bd5-f65dda9aaa1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.034288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83daa8a4-b0b4-4756-9bd5-f65dda9aaa1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.034947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83daa8a4-b0b4-4756-9bd5-f65dda9aaa1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.035711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83daa8a4-b0b4-4756-9bd5-f65dda9aaa1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.036175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83daa8a4-b0b4-4756-9bd5-f65dda9aaa1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.036609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83daa8a4-b0b4-4756-9bd5-f65dda9aaa1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.286808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ab427b5-bc93-4a4d-9b34-befc48e14fdb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.295413 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ab427b5-bc93-4a4d-9b34-befc48e14fdb tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1498 microversion: 2.1 time: 0.346625 Oct 04 18:15:07.296138 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1648/3254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1498 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:07.314877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:07.315691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:07.322754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.323434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.324184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.325054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.325628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.326167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.373483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-83daa8a4-b0b4-4756-9bd5-f65dda9aaa1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.382787 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-83daa8a4-b0b4-4756-9bd5-f65dda9aaa1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1317 microversion: 2.1 time: 0.366944 Oct 04 18:15:07.383416 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1607/3255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:07 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:07.396561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d57624a-d835-450f-b2c3-05fbcd66d841 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:07.397189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4d57624a-d835-450f-b2c3-05fbcd66d841 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:07.404092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d57624a-d835-450f-b2c3-05fbcd66d841 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.404609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d57624a-d835-450f-b2c3-05fbcd66d841 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.405566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d57624a-d835-450f-b2c3-05fbcd66d841 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.406481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d57624a-d835-450f-b2c3-05fbcd66d841 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.406976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d57624a-d835-450f-b2c3-05fbcd66d841 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.407397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d57624a-d835-450f-b2c3-05fbcd66d841 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.984349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.993060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.994538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.995765 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b3485ba3-7f78-45ff-97b9-26e6f93ffdb8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1481 microversion: 2.25 time: 0.698378 Oct 04 18:15:07.996727 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1649/3256] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:07 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1481 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:08.004099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ff6a6c47-d889-41ec-ab89-8151bd256cc1 req-fcc011ab-9401-4014-889b-3112f0f46c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10872fe-cae9-4db2-88f6-57c26d1eff0a", "name": "network-vif-plugged", "status": "completed", "tag": "c1fb397a-a183-497c-adcf-34f0bcdaeecb"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:08.016080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ff6a6c47-d889-41ec-ab89-8151bd256cc1 req-fcc011ab-9401-4014-889b-3112f0f46c97 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.017164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ff6a6c47-d889-41ec-ab89-8151bd256cc1 req-fcc011ab-9401-4014-889b-3112f0f46c97 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.017489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ff6a6c47-d889-41ec-ab89-8151bd256cc1 req-fcc011ab-9401-4014-889b-3112f0f46c97 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.033013 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ff6a6c47-d889-41ec-ab89-8151bd256cc1 req-fcc011ab-9401-4014-889b-3112f0f46c97 service nova] Creating event network-vif-plugged:c1fb397a-a183-497c-adcf-34f0bcdaeecb for instance e10872fe-cae9-4db2-88f6-57c26d1eff0a on n-h1-850499-14 Oct 04 18:15:08.038502 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ff6a6c47-d889-41ec-ab89-8151bd256cc1 req-fcc011ab-9401-4014-889b-3112f0f46c97 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040497 Oct 04 18:15:08.042618 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1650/3257] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:08.048089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a9e509a-cf79-42c9-a6ca-a6c7d86a7824 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.048911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a9e509a-cf79-42c9-a6ca-a6c7d86a7824 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:08.056052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a9e509a-cf79-42c9-a6ca-a6c7d86a7824 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.056787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a9e509a-cf79-42c9-a6ca-a6c7d86a7824 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.057576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a9e509a-cf79-42c9-a6ca-a6c7d86a7824 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.058452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a9e509a-cf79-42c9-a6ca-a6c7d86a7824 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.059104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a9e509a-cf79-42c9-a6ca-a6c7d86a7824 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.059720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a9e509a-cf79-42c9-a6ca-a6c7d86a7824 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.069432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4d57624a-d835-450f-b2c3-05fbcd66d841 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.084753 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4d57624a-d835-450f-b2c3-05fbcd66d841 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.691951 Oct 04 18:15:08.085814 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1608/3258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:07 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:08.098611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12fdded6-e735-47ca-af6c-3a054f0c748a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.099757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-12fdded6-e735-47ca-af6c-3a054f0c748a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:08.112239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12fdded6-e735-47ca-af6c-3a054f0c748a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.114695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12fdded6-e735-47ca-af6c-3a054f0c748a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.117935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12fdded6-e735-47ca-af6c-3a054f0c748a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.119247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12fdded6-e735-47ca-af6c-3a054f0c748a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.119858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12fdded6-e735-47ca-af6c-3a054f0c748a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.127570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12fdded6-e735-47ca-af6c-3a054f0c748a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.150055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:08.537112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-12fdded6-e735-47ca-af6c-3a054f0c748a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.541934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a9e509a-cf79-42c9-a6ca-a6c7d86a7824 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.547875 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12fdded6-e735-47ca-af6c-3a054f0c748a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.459930 Oct 04 18:15:08.549229 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1609/3259] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:08.551135 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a9e509a-cf79-42c9-a6ca-a6c7d86a7824 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1648 microversion: 2.1 time: 0.507308 Oct 04 18:15:08.557354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac698685-9ec7-4627-94a2-c8019f728e34 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d6245dc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.568663 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1651/3260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1648 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:08.572855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a4ffdf32-b9d3-4bb7-911c-b8862e4f7ccd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.573706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a4ffdf32-b9d3-4bb7-911c-b8862e4f7ccd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:08.580746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4ffdf32-b9d3-4bb7-911c-b8862e4f7ccd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.581262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4ffdf32-b9d3-4bb7-911c-b8862e4f7ccd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.582241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4ffdf32-b9d3-4bb7-911c-b8862e4f7ccd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.582648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4ffdf32-b9d3-4bb7-911c-b8862e4f7ccd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.583197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4ffdf32-b9d3-4bb7-911c-b8862e4f7ccd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.583663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4ffdf32-b9d3-4bb7-911c-b8862e4f7ccd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.627582 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ac698685-9ec7-4627-94a2-c8019f728e34 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.076801 Oct 04 18:15:08.628246 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1610/3261] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:08.634214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eb62e8ea-b84d-4e9c-bdc3-a718e1603da1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.635158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eb62e8ea-b84d-4e9c-bdc3-a718e1603da1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:08.643094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb62e8ea-b84d-4e9c-bdc3-a718e1603da1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.644247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb62e8ea-b84d-4e9c-bdc3-a718e1603da1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.645342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb62e8ea-b84d-4e9c-bdc3-a718e1603da1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.646293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb62e8ea-b84d-4e9c-bdc3-a718e1603da1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.646984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb62e8ea-b84d-4e9c-bdc3-a718e1603da1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.647645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb62e8ea-b84d-4e9c-bdc3-a718e1603da1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.673621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a4ffdf32-b9d3-4bb7-911c-b8862e4f7ccd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.693207 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a4ffdf32-b9d3-4bb7-911c-b8862e4f7ccd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1456 microversion: 2.1 time: 0.124337 Oct 04 18:15:08.693950 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1652/3262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1456 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:08.711455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-effee93b-e813-4785-aa75-a5dfa3d46a74 req-84c6ec38-96e2-4fca-8a52-1a9e062fa76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4400b05-cc8a-4d94-9f60-4842340d090e", "name": "network-vif-deleted", "tag": "e97f02a9-6af2-4ab8-a050-1f645202d2c9"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:08.732861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-effee93b-e813-4785-aa75-a5dfa3d46a74 req-84c6ec38-96e2-4fca-8a52-1a9e062fa76e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.733560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-effee93b-e813-4785-aa75-a5dfa3d46a74 req-84c6ec38-96e2-4fca-8a52-1a9e062fa76e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.734108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-effee93b-e813-4785-aa75-a5dfa3d46a74 req-84c6ec38-96e2-4fca-8a52-1a9e062fa76e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.749872 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-effee93b-e813-4785-aa75-a5dfa3d46a74 req-84c6ec38-96e2-4fca-8a52-1a9e062fa76e service nova] Creating event network-vif-deleted:e97f02a9-6af2-4ab8-a050-1f645202d2c9 for instance e4400b05-cc8a-4d94-9f60-4842340d090e on n-h1-850499-14 Oct 04 18:15:08.757255 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-effee93b-e813-4785-aa75-a5dfa3d46a74 req-84c6ec38-96e2-4fca-8a52-1a9e062fa76e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054446 Oct 04 18:15:08.758115 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1653/3263] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:08.765305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.766033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:08.775323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.775836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.776349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.783815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.784791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.785521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.875707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eb62e8ea-b84d-4e9c-bdc3-a718e1603da1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.883453 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eb62e8ea-b84d-4e9c-bdc3-a718e1603da1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1317 microversion: 2.1 time: 0.253943 Oct 04 18:15:08.884420 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1611/3264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:08.893332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-19c6199c-79b3-41a0-b112-4461a504a958 req-5075b91e-f36c-4859-8fec-304bf8142a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d683c0-cb6a-46db-a6a3-d956d333aeb6", "name": "network-vif-deleted", "tag": "72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:08.903583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-19c6199c-79b3-41a0-b112-4461a504a958 req-5075b91e-f36c-4859-8fec-304bf8142a2b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.904395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-19c6199c-79b3-41a0-b112-4461a504a958 req-5075b91e-f36c-4859-8fec-304bf8142a2b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.905584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-19c6199c-79b3-41a0-b112-4461a504a958 req-5075b91e-f36c-4859-8fec-304bf8142a2b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.919263 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-19c6199c-79b3-41a0-b112-4461a504a958 req-5075b91e-f36c-4859-8fec-304bf8142a2b service nova] Creating event network-vif-deleted:72aaf8bb-71cc-4c8b-8a61-63eb53ba5b4c for instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 on n-h2-850499-14 Oct 04 18:15:08.925696 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-19c6199c-79b3-41a0-b112-4461a504a958 req-5075b91e-f36c-4859-8fec-304bf8142a2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040347 Oct 04 18:15:08.926666 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1612/3265] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:09.007512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.023739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.024723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.025626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.025762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.026833 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b5aa1787-5370-48a7-bacb-9dd8a6176b95 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2948 microversion: 2.32 time: 0.266643 Oct 04 18:15:09.027567 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1654/3266] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2948 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:09.034880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.035641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.036276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.037066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.037604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.038067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.059352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-941d5763-01ab-4fba-84c3-faa559672057 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.059922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-941d5763-01ab-4fba-84c3-faa559672057 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.066430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-941d5763-01ab-4fba-84c3-faa559672057 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.066930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-941d5763-01ab-4fba-84c3-faa559672057 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.067417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-941d5763-01ab-4fba-84c3-faa559672057 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.068191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-941d5763-01ab-4fba-84c3-faa559672057 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.068654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-941d5763-01ab-4fba-84c3-faa559672057 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.069094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-941d5763-01ab-4fba-84c3-faa559672057 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.179245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.194174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.197136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.198523 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5823b1b9-61e4-4cbc-a739-25a9203376c0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1439 microversion: 2.25 time: 0.180468 Oct 04 18:15:09.199568 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1613/3267] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1439 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:15:09.205300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5e08e1b3-cea4-46ee-a5c1-20917b6378e9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.206201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5e08e1b3-cea4-46ee-a5c1-20917b6378e9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.222248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e08e1b3-cea4-46ee-a5c1-20917b6378e9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.225206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e08e1b3-cea4-46ee-a5c1-20917b6378e9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.225900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e08e1b3-cea4-46ee-a5c1-20917b6378e9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.226786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e08e1b3-cea4-46ee-a5c1-20917b6378e9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.227678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e08e1b3-cea4-46ee-a5c1-20917b6378e9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.228197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e08e1b3-cea4-46ee-a5c1-20917b6378e9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.248969 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-941d5763-01ab-4fba-84c3-faa559672057 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.196387 Oct 04 18:15:09.249839 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1655/3268] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7/os-interface => generated 1829 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:15:09.406107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5e08e1b3-cea4-46ee-a5c1-20917b6378e9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.415467 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5e08e1b3-cea4-46ee-a5c1-20917b6378e9 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1325 microversion: 2.1 time: 0.214350 Oct 04 18:15:09.417867 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1614/3269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:09.577589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c46747e-ea0a-4d5f-98b3-61d9f1c2d57e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.578047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c46747e-ea0a-4d5f-98b3-61d9f1c2d57e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.578226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.578872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.585307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.585812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.586255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.587184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.587818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.588249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.591277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c46747e-ea0a-4d5f-98b3-61d9f1c2d57e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.591829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c46747e-ea0a-4d5f-98b3-61d9f1c2d57e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.592206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c46747e-ea0a-4d5f-98b3-61d9f1c2d57e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.592956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c46747e-ea0a-4d5f-98b3-61d9f1c2d57e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.593415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c46747e-ea0a-4d5f-98b3-61d9f1c2d57e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.593843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c46747e-ea0a-4d5f-98b3-61d9f1c2d57e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.609637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:09.622703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.623502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.624572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.625420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lazy-loading 'fault' on Instance uuid 52d683c0-cb6a-46db-a6a3-d956d333aeb6 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:09.718330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.728027 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7055d574-d228-4fba-9e5e-d21d73b0b1f1 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1306 microversion: 2.1 time: 0.154395 Oct 04 18:15:09.729837 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1615/3270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:09.743372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-692ac83f-17b2-4df2-bd9c-de77defa640c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d18dc160>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.801327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3c46747e-ea0a-4d5f-98b3-61d9f1c2d57e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.813515 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c46747e-ea0a-4d5f-98b3-61d9f1c2d57e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.243747 Oct 04 18:15:09.814622 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1656/3271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:09.817801 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-692ac83f-17b2-4df2-bd9c-de77defa640c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.086845 Oct 04 18:15:09.818526 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1616/3272] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:09.820241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.821223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.837433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.838148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.838598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.839572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.840050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.840492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.878012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.878660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.879347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.879814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lazy-loading 'fault' on Instance uuid e4400b05-cc8a-4d94-9f60-4842340d090e {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:09.907459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3cb1d2e8-083e-4376-89a0-8039f4b01c39 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.908170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3cb1d2e8-083e-4376-89a0-8039f4b01c39 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.928496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cb1d2e8-083e-4376-89a0-8039f4b01c39 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.929102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cb1d2e8-083e-4376-89a0-8039f4b01c39 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.929772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cb1d2e8-083e-4376-89a0-8039f4b01c39 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.930799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cb1d2e8-083e-4376-89a0-8039f4b01c39 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.931377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cb1d2e8-083e-4376-89a0-8039f4b01c39 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.931499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba39a7cdf309477195a07acb5cdf24f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb88e07ba354759b30d6a779a9218c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.931944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cb1d2e8-083e-4376-89a0-8039f4b01c39 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.941139 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5b3db67-dac8-47c9-9aaa-b6268fdf2983 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 200 len: 1305 microversion: 2.1 time: 0.125242 Oct 04 18:15:09.952426 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1657/3273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:10.053997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e7f9d35e-3454-4803-9762-2dac98bd27a3 req-698ce04e-2ac2-483e-a3f2-184585d4997d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afef2588-b2e9-4b9e-943c-44469215dd64", "name": "network-vif-plugged", "status": "completed", "tag": "e1f04890-a2cf-4366-ad64-14ecf15d04cf"}, {"server_uuid": "e8053e0e-c889-4fd9-93a4-34aca7ff2948", "name": "network-vif-plugged", "status": "completed", "tag": "1bc16d83-9b0d-4671-a5c4-86ffb6abc091"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:10.068100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e7f9d35e-3454-4803-9762-2dac98bd27a3 req-698ce04e-2ac2-483e-a3f2-184585d4997d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.068672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e7f9d35e-3454-4803-9762-2dac98bd27a3 req-698ce04e-2ac2-483e-a3f2-184585d4997d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.069199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e7f9d35e-3454-4803-9762-2dac98bd27a3 req-698ce04e-2ac2-483e-a3f2-184585d4997d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.085730 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e7f9d35e-3454-4803-9762-2dac98bd27a3 req-698ce04e-2ac2-483e-a3f2-184585d4997d service nova] Creating event network-vif-plugged:e1f04890-a2cf-4366-ad64-14ecf15d04cf for instance afef2588-b2e9-4b9e-943c-44469215dd64 on n-h2-850499-14 Oct 04 18:15:10.086324 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e7f9d35e-3454-4803-9762-2dac98bd27a3 req-698ce04e-2ac2-483e-a3f2-184585d4997d service nova] Creating event network-vif-plugged:1bc16d83-9b0d-4671-a5c4-86ffb6abc091 for instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 on n-h1-850499-14 Oct 04 18:15:10.095850 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e7f9d35e-3454-4803-9762-2dac98bd27a3 req-698ce04e-2ac2-483e-a3f2-184585d4997d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045527 Oct 04 18:15:10.097064 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1658/3274] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:10.120418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3cb1d2e8-083e-4376-89a0-8039f4b01c39 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:10.129127 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3cb1d2e8-083e-4376-89a0-8039f4b01c39 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1317 microversion: 2.1 time: 0.226336 Oct 04 18:15:10.129764 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1617/3275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:10.226454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.227222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.234770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.235326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.235756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.236608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.237073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.237719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.315466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:10.336513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:10.339716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:10.341025 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ec7b7c8-b78a-49f3-9e2f-6f33a3428769 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1265 microversion: 2.25 time: 0.118994 Oct 04 18:15:10.341993 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1659/3276] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:10.444926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f5eec9e-f93f-408d-8bff-87f848d53a37 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.446325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0f5eec9e-f93f-408d-8bff-87f848d53a37 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.454796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f5eec9e-f93f-408d-8bff-87f848d53a37 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.455950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f5eec9e-f93f-408d-8bff-87f848d53a37 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.456721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f5eec9e-f93f-408d-8bff-87f848d53a37 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.457975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f5eec9e-f93f-408d-8bff-87f848d53a37 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.458675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f5eec9e-f93f-408d-8bff-87f848d53a37 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.459397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f5eec9e-f93f-408d-8bff-87f848d53a37 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.612849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0f5eec9e-f93f-408d-8bff-87f848d53a37 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:10.626114 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0f5eec9e-f93f-408d-8bff-87f848d53a37 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1521 microversion: 2.1 time: 0.185022 Oct 04 18:15:10.627466 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1618/3277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:10.657554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-54b77747-d297-47cd-9001-e3f51516c9dd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.658366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-54b77747-d297-47cd-9001-e3f51516c9dd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.679692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b77747-d297-47cd-9001-e3f51516c9dd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.680268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b77747-d297-47cd-9001-e3f51516c9dd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.680972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b77747-d297-47cd-9001-e3f51516c9dd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.682086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b77747-d297-47cd-9001-e3f51516c9dd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.682545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b77747-d297-47cd-9001-e3f51516c9dd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.682993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b77747-d297-47cd-9001-e3f51516c9dd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.718195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-54b77747-d297-47cd-9001-e3f51516c9dd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:10.755283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.756331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.766018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.767237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.768220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.769294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.769843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.770904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.818737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.820121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.821285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.822216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lazy-loading 'fault' on Instance uuid 52d683c0-cb6a-46db-a6a3-d956d333aeb6 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:10.830094 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-54b77747-d297-47cd-9001-e3f51516c9dd tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "DELETE /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 204 len: 0 microversion: 2.1 time: 0.177912 Oct 04 18:15:10.835700 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1660/3278] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:10 2022] DELETE /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:15:10.842034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7928bd4-ab37-4317-8dad-8dc57089f401 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1bc1f70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.897116 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b7928bd4-ab37-4317-8dad-8dc57089f401 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.059707 Oct 04 18:15:10.898303 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1661/3279] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:10.904539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4befb812-8a1d-4208-b534-ef172a07d988 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.906231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4befb812-8a1d-4208-b534-ef172a07d988 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.914359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4befb812-8a1d-4208-b534-ef172a07d988 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.915266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4befb812-8a1d-4208-b534-ef172a07d988 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.915904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4befb812-8a1d-4208-b534-ef172a07d988 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.917972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4befb812-8a1d-4208-b534-ef172a07d988 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.919723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4befb812-8a1d-4208-b534-ef172a07d988 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.920773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4befb812-8a1d-4208-b534-ef172a07d988 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.928912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:10.944999 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b115f6d-35f2-425b-89ba-add4e4f15c40 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1306 microversion: 2.1 time: 0.195888 Oct 04 18:15:10.945865 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1619/3280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1306 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:10.968075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-359a498e-721a-4350-9213-8c47c1133cd1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.968634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-359a498e-721a-4350-9213-8c47c1133cd1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.985752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-359a498e-721a-4350-9213-8c47c1133cd1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.986331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-359a498e-721a-4350-9213-8c47c1133cd1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.986984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-359a498e-721a-4350-9213-8c47c1133cd1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.987819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-359a498e-721a-4350-9213-8c47c1133cd1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.988182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-359a498e-721a-4350-9213-8c47c1133cd1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.988646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-359a498e-721a-4350-9213-8c47c1133cd1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.194514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4befb812-8a1d-4208-b534-ef172a07d988 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.206072 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4befb812-8a1d-4208-b534-ef172a07d988 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.306397 Oct 04 18:15:11.208737 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1662/3281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:11.220621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e34a2050-5ae5-4e68-95ca-8e352d16dfea req-2f41fe25-f27b-4ad8-95c2-9eb182bcb018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36c7b27-9927-4f6d-874d-dbf86b9ef895", "name": "network-vif-deleted", "tag": "b431abe6-8cb4-48b7-b889-3c3dbf59f6d0"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:11.226300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-359a498e-721a-4350-9213-8c47c1133cd1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.236086 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-359a498e-721a-4350-9213-8c47c1133cd1 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1527 microversion: 2.1 time: 0.277573 Oct 04 18:15:11.237537 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1620/3282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1527 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:11.242629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.243582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.252560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.253967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.254432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.255355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.255994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.256622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.262076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e34a2050-5ae5-4e68-95ca-8e352d16dfea req-2f41fe25-f27b-4ad8-95c2-9eb182bcb018 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.262578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e34a2050-5ae5-4e68-95ca-8e352d16dfea req-2f41fe25-f27b-4ad8-95c2-9eb182bcb018 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.263214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e34a2050-5ae5-4e68-95ca-8e352d16dfea req-2f41fe25-f27b-4ad8-95c2-9eb182bcb018 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.276464 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.278758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e34a2050-5ae5-4e68-95ca-8e352d16dfea req-2f41fe25-f27b-4ad8-95c2-9eb182bcb018 service nova] Creating event network-vif-deleted:b431abe6-8cb4-48b7-b889-3c3dbf59f6d0 for instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 on n-h2-850499-14 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e HTTP/1.1 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e4400b05-cc8a-4d94-9f60-4842340d090e'} Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.282230 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.287772 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.287772 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.287772 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.287772 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:11.287772 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:11.287772 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.287772 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.288291 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e34a2050-5ae5-4e68-95ca-8e352d16dfea req-2f41fe25-f27b-4ad8-95c2-9eb182bcb018 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076953 Oct 04 18:15:11.288291 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1663/3283] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:11.289371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:11.291738 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba72cfc8-5834-407e-97df-a55316548d05 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 404 len: 111 microversion: 2.1 time: 0.052127 Oct 04 18:15:11.293532 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1621/3284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:11.305144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8e79705a-7bbb-4d13-8a96-540675fedea7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.306520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8e79705a-7bbb-4d13-8a96-540675fedea7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.307806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.309339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.314615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e79705a-7bbb-4d13-8a96-540675fedea7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.315395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e79705a-7bbb-4d13-8a96-540675fedea7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.316023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e79705a-7bbb-4d13-8a96-540675fedea7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.316897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e79705a-7bbb-4d13-8a96-540675fedea7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.317576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e79705a-7bbb-4d13-8a96-540675fedea7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.318183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e79705a-7bbb-4d13-8a96-540675fedea7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.325691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.326242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.327473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.328469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.329043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.329757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.346570 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e HTTP/1.1 Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e4400b05-cc8a-4d94-9f60-4842340d090e'} Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:11.348489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.353208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:11.354939 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd1ca0f0-2178-4d8a-8faf-9254461c356d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 404 len: 111 microversion: 2.1 time: 0.054798 Oct 04 18:15:11.355616 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1622/3285] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:11 2022] DELETE /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:11.369527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.370685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: e4400b05-cc8a-4d94-9f60-4842340d090e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.378096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.378843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.379320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.380025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.380621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.381053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.401598 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e HTTP/1.1 Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e4400b05-cc8a-4d94-9f60-4842340d090e'} Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.404387 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.408470 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.408470 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.408470 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.408470 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:11.408470 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:11.408470 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. Oct 04 18:15:11.408470 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.408470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance e4400b05-cc8a-4d94-9f60-4842340d090e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:11.408470 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dc4640ec-fbbb-473a-b4a3-c971abef15b5 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e" status: 404 len: 111 microversion: 2.1 time: 0.045591 Oct 04 18:15:11.410642 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1623/3286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/e4400b05-cc8a-4d94-9f60-4842340d090e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:11.416523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.417197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.424375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.424889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.425337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.426548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.427056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.427490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.539232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.555989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8e79705a-7bbb-4d13-8a96-540675fedea7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.560663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.563041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.564509 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef11acbb-9927-4b89-8515-083a898682de tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1265 microversion: 2.25 time: 0.152812 Oct 04 18:15:11.566011 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8e79705a-7bbb-4d13-8a96-540675fedea7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1506 microversion: 2.1 time: 0.276439 Oct 04 18:15:11.567023 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1664/3287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:11.579514 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1624/3288] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:11.589030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.589938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.591186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ad94438-4661-4213-bc9d-3f1aebbe0447 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.592291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3ad94438-4661-4213-bc9d-3f1aebbe0447 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.592954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:11.598527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.599886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.600911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ad94438-4661-4213-bc9d-3f1aebbe0447 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.601420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ad94438-4661-4213-bc9d-3f1aebbe0447 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.601542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.601869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ad94438-4661-4213-bc9d-3f1aebbe0447 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.602578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ad94438-4661-4213-bc9d-3f1aebbe0447 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.603079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ad94438-4661-4213-bc9d-3f1aebbe0447 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.603245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.603511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ad94438-4661-4213-bc9d-3f1aebbe0447 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.604201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.606907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.625219 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 HTTP/1.1 Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40'} Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:11.627407 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:15:11.631647 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.633593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:11.635567 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d84f3761-4e3d-40cc-9826-d8c3a62c1ef2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 404 len: 111 microversion: 2.1 time: 0.066550 Oct 04 18:15:11.636721 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1665/3289] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:11 2022] DELETE /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:11.645702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.646708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.660880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.661710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.662217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.663216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.663610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.664121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.681174 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 HTTP/1.1 Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40'} Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.682754 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.692470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.692470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.692470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.692470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:11.692470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:11.692470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. Oct 04 18:15:11.692470 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.692470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance 8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:11.692470 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b099826-2d1c-4c27-bc84-86fd16daf0e0 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40" status: 404 len: 111 microversion: 2.1 time: 0.042508 Oct 04 18:15:11.692470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1666/3290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/8d30f03e-0420-4e6b-a8cd-0a3d3de5ba40 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:11.695395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.696015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.702724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.703235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.703682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.704676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.705145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.705587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.727765 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf HTTP/1.1 Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'b5d14a05-8a0f-4911-af5e-e84c9e8076cf'} Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:11.729348 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:11.733877 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d9d387a4-a2cc-42d4-83f6-4227f0e34b35 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 404 len: 111 microversion: 2.1 time: 0.039175 Oct 04 18:15:11.735305 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1667/3291] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:11 2022] DELETE /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:11.739665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.740283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: b5d14a05-8a0f-4911-af5e-e84c9e8076cf] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.746719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.747401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.747856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.749241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.749704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.750370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.769968 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf HTTP/1.1 Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'b5d14a05-8a0f-4911-af5e-e84c9e8076cf'} Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.772972 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.776941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.776941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.776941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.776941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:11.776941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:11.776941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. Oct 04 18:15:11.776941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.779198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance b5d14a05-8a0f-4911-af5e-e84c9e8076cf could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:11.780975 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ca2d22d-90b9-455e-b067-3b958cd383db tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf" status: 404 len: 111 microversion: 2.1 time: 0.045195 Oct 04 18:15:11.781322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3ad94438-4661-4213-bc9d-3f1aebbe0447 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.786039 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1668/3292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/b5d14a05-8a0f-4911-af5e-e84c9e8076cf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:11.790058 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ad94438-4661-4213-bc9d-3f1aebbe0447 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1506 microversion: 2.1 time: 0.202898 Oct 04 18:15:11.791153 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1625/3293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:11.792422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.793146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.803719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.804595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.805261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.806607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.807316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.807965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.819724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:11.825094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.832453 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:15:11.833453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.834230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.834855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.835918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.836567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.837178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 HTTP/1.1 Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '9e3c972a-93d9-42f4-a3ee-840fc973de13'} Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:11.838050 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-168d79ed-d7f8-490b-adc7-13c6615ada6b tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 404 len: 111 microversion: 2.1 time: 0.053512 Oct 04 18:15:11.841961 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1669/3294] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:11 2022] DELETE /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:11.850993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.851884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 9e3c972a-93d9-42f4-a3ee-840fc973de13] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.858796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.859412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.860049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.860835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.861370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.861875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.882464 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 HTTP/1.1 Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '9e3c972a-93d9-42f4-a3ee-840fc973de13'} Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.903291 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.909135 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.909135 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.909135 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.909135 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:11.909135 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:11.909135 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. Oct 04 18:15:11.909135 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.909135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance 9e3c972a-93d9-42f4-a3ee-840fc973de13 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:11.909135 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bd71ba94-7912-4a24-a30b-2988dfa474f7 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13" status: 404 len: 111 microversion: 2.1 time: 0.058512 Oct 04 18:15:11.909135 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1670/3295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/9e3c972a-93d9-42f4-a3ee-840fc973de13 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:11.914853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.915844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 53c91dad-00c1-4391-8481-63cc11613100] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.924774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.925360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.928512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.929252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.929749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.931851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.962032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:11.963294 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100 HTTP/1.1 Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '53c91dad-00c1-4391-8481-63cc11613100'} Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:11.964923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:11.969492 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-db750b60-966d-46f5-97e6-971a79c22a1d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100" status: 404 len: 111 microversion: 2.1 time: 0.055249 Oct 04 18:15:11.971658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:11.971658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:11.972563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:11.972563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:11.979118 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1671/3296] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:11 2022] DELETE /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:11.995408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-08368c4b-4979-417c-b089-ee1df148be94 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d62944c0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.067464 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-08368c4b-4979-417c-b089-ee1df148be94 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.086222 Oct 04 18:15:12.068056 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1672/3297] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:12.075321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.078140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.088943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.089140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.089875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.090483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.091435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.092911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.093522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.101869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.102376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.102821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.110159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.110710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.113106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.132851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.137121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.137768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.138407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lazy-loading 'fault' on Instance uuid 52d683c0-cb6a-46db-a6a3-d956d333aeb6 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:12.177829 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2cecf32b-0418-41a4-9ca5-53bbec9e2e2a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "POST /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a/action" status: 202 len: 1108 microversion: 2.1 time: 0.362263 Oct 04 18:15:12.180791 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1626/3298] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:11 2022] POST /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a/action => generated 1108 bytes in 367 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 04 18:15:12.194698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.195295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.196346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: 53c91dad-00c1-4391-8481-63cc11613100] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.204917 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22d931a7-b0a3-4e29-b39c-27631647eb6b tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1306 microversion: 2.1 time: 0.135023 Oct 04 18:15:12.205818 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1673/3299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1306 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:12.217781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.218211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.218655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.219306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-721a95e5-48ff-47a7-8bc1-4cce571bed89 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.219412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.219879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.220002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-721a95e5-48ff-47a7-8bc1-4cce571bed89 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.220312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.234793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721a95e5-48ff-47a7-8bc1-4cce571bed89 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.235531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721a95e5-48ff-47a7-8bc1-4cce571bed89 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.235983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721a95e5-48ff-47a7-8bc1-4cce571bed89 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.236815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721a95e5-48ff-47a7-8bc1-4cce571bed89 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.238286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721a95e5-48ff-47a7-8bc1-4cce571bed89 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.238778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721a95e5-48ff-47a7-8bc1-4cce571bed89 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.247595 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100 HTTP/1.1 Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '53c91dad-00c1-4391-8481-63cc11613100'} Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.249309 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.254445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.254445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:12.254445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:12.254445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:12.254445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:12.254445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. Oct 04 18:15:12.254445 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.255750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance 53c91dad-00c1-4391-8481-63cc11613100 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:12.256905 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f9809fa-d2c8-442c-bf6e-a0068cd5ce49 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100" status: 404 len: 111 microversion: 2.1 time: 0.074326 Oct 04 18:15:12.257984 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1627/3300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/53c91dad-00c1-4391-8481-63cc11613100 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:12.263216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6476ee36-c35b-49af-b167-5fa87e76ad28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.264158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6476ee36-c35b-49af-b167-5fa87e76ad28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.276213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6476ee36-c35b-49af-b167-5fa87e76ad28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.278768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6476ee36-c35b-49af-b167-5fa87e76ad28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.279549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6476ee36-c35b-49af-b167-5fa87e76ad28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.289367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6476ee36-c35b-49af-b167-5fa87e76ad28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.290124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6476ee36-c35b-49af-b167-5fa87e76ad28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.290721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6476ee36-c35b-49af-b167-5fa87e76ad28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.723818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-721a95e5-48ff-47a7-8bc1-4cce571bed89 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.734578 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-721a95e5-48ff-47a7-8bc1-4cce571bed89 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.527561 Oct 04 18:15:12.743204 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1674/3301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:12.746825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6476ee36-c35b-49af-b167-5fa87e76ad28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.750683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:12.752801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b5837525-ff37-461e-bef6-e76a3c1b4683 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.754084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b5837525-ff37-461e-bef6-e76a3c1b4683 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.760399 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6476ee36-c35b-49af-b167-5fa87e76ad28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.501019 Oct 04 18:15:12.761101 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1628/3302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:12.769137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.778299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.779198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5837525-ff37-461e-bef6-e76a3c1b4683 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.779880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5837525-ff37-461e-bef6-e76a3c1b4683 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.780497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5837525-ff37-461e-bef6-e76a3c1b4683 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.781765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5837525-ff37-461e-bef6-e76a3c1b4683 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.782502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5837525-ff37-461e-bef6-e76a3c1b4683 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.783216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5837525-ff37-461e-bef6-e76a3c1b4683 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.786297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.797426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.798222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.799187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.799988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.800600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.923472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.952797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.958170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.961234 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90ba155e-1f91-45da-853a-599f1e1f763a tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1265 microversion: 2.25 time: 0.199122 Oct 04 18:15:12.963202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b5837525-ff37-461e-bef6-e76a3c1b4683 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.977950 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1629/3303] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:12.982742 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b5837525-ff37-461e-bef6-e76a3c1b4683 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1527 microversion: 2.1 time: 0.237880 Oct 04 18:15:12.984490 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1675/3304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1527 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:13.087945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cc01cf9d-6aef-44f6-abb4-3960a7466365 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d2350f70>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.151664 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cc01cf9d-6aef-44f6-abb4-3960a7466365 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.070653 Oct 04 18:15:13.152686 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1630/3305] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:13.238525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.240138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.248474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.249951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.250567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.251585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.255876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.256444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.346695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.349355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.349828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.351894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lazy-loading 'fault' on Instance uuid 52d683c0-cb6a-46db-a6a3-d956d333aeb6 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:13.460544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3301f186f61e4badb072f9cf536a5887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83335cd1899d4703b1bfc4a5571f69fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:13.471316 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2abf20e6-abe1-4512-9b82-a9d66426c1a8 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 200 len: 1306 microversion: 2.1 time: 0.238883 Oct 04 18:15:13.472977 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1676/3306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 1306 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:13.767432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-742169a0-cd40-4aba-9156-c9661175afa6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.768721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-742169a0-cd40-4aba-9156-c9661175afa6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.783793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-742169a0-cd40-4aba-9156-c9661175afa6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.784311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-742169a0-cd40-4aba-9156-c9661175afa6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.789804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-742169a0-cd40-4aba-9156-c9661175afa6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.791870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-742169a0-cd40-4aba-9156-c9661175afa6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.792981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2235d2f4-bc3f-4e67-9bc1-96da719cc542 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.793966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2235d2f4-bc3f-4e67-9bc1-96da719cc542 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.794097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-742169a0-cd40-4aba-9156-c9661175afa6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.794549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-742169a0-cd40-4aba-9156-c9661175afa6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.814174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2235d2f4-bc3f-4e67-9bc1-96da719cc542 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.818205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2235d2f4-bc3f-4e67-9bc1-96da719cc542 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.819052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2235d2f4-bc3f-4e67-9bc1-96da719cc542 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.820051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2235d2f4-bc3f-4e67-9bc1-96da719cc542 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.821036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2235d2f4-bc3f-4e67-9bc1-96da719cc542 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.821398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2235d2f4-bc3f-4e67-9bc1-96da719cc542 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.266979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-742169a0-cd40-4aba-9156-c9661175afa6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.277387 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-742169a0-cd40-4aba-9156-c9661175afa6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.515140 Oct 04 18:15:14.291752 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1631/3307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:14.293165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2235d2f4-bc3f-4e67-9bc1-96da719cc542 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.299811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.300440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:14.309758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2235d2f4-bc3f-4e67-9bc1-96da719cc542 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1316 microversion: 2.1 time: 0.523374 Oct 04 18:15:14.326294 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1677/3308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:14.336622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.337124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.337792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.338573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-715aeec3-7d05-42b1-8073-a12420b22e53 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.339501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.340292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-715aeec3-7d05-42b1-8073-a12420b22e53 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:14.340941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.345500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.359561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-715aeec3-7d05-42b1-8073-a12420b22e53 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.360254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-715aeec3-7d05-42b1-8073-a12420b22e53 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.360904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-715aeec3-7d05-42b1-8073-a12420b22e53 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.362415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-715aeec3-7d05-42b1-8073-a12420b22e53 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.365027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-715aeec3-7d05-42b1-8073-a12420b22e53 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.365745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-715aeec3-7d05-42b1-8073-a12420b22e53 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.422637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:14.528067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.537955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.545178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.547210 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-af26897a-4eb3-4a9d-87e1-efcebb66e2d0 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1265 microversion: 2.25 time: 0.262459 Oct 04 18:15:14.549739 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1632/3309] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:14 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:14.560115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-26f2e944-8a3b-4692-ba62-0eb20069c28d tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d24fc700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.643000 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-26f2e944-8a3b-4692-ba62-0eb20069c28d tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.091976 Oct 04 18:15:14.643729 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1633/3310] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:14 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:14.652811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.656119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] [instance: 52d683c0-cb6a-46db-a6a3-d956d333aeb6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:14.673087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:14.675813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.676563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.677251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.678189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.678871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.679553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.730131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-715aeec3-7d05-42b1-8073-a12420b22e53 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.738729 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-715aeec3-7d05-42b1-8073-a12420b22e53 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1527 microversion: 2.1 time: 0.410707 Oct 04 18:15:14.740229 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] HTTP exception thrown: Instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 could not be found. Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Request method failure captured: Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 HTTP/1.1 Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHe5BogYxCSwngkmNLEk8KnXOJjOGRBEK7HAytDLZDscNzH94To0e8xCvv34tvXDaj0sLUNbi5UnmDHmc7Sn6oRGeHrtAojGq3o2fvWfMBLO3eSKRttm69we0gN_c5_31LV_HYQRdFaZizidzq8g9ECZL8yu126mMCPJ-SAdwkV7SmM Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83335cd1899d4703b1bfc4a5571f69fd"}]}] Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 83335cd1899d4703b1bfc4a5571f69fd Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1720871806 Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3301f186f61e4badb072f9cf536a5887 Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-SecurityGroupsTestJSON-1720871806-project Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 could not be found. Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '52d683c0-cb6a-46db-a6a3-d956d333aeb6'} Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 could not be found. Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 could not be found. Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.741876 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.746551 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.746551 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.746551 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.746551 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:14.746551 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:14.746551 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 could not be found. Oct 04 18:15:14.746551 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.747368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Returning 404 to user: Instance 52d683c0-cb6a-46db-a6a3-d956d333aeb6 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:14.749278 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1678/3311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:14 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1527 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:14.750146 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-339d1303-2504-4b5b-a485-cef7ea24c39c tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6" status: 404 len: 111 microversion: 2.1 time: 0.105392 Oct 04 18:15:14.755437 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1634/3312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:14 2022] GET /compute/v2.1/servers/52d683c0-cb6a-46db-a6a3-d956d333aeb6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:14.765063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16df66f7-1c7a-4813-806d-8c2d90254942 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d26e0af0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.245876 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-16df66f7-1c7a-4813-806d-8c2d90254942 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/dacdbdf7-ccfe-4d41-bea5-e1eaf9d49b6b" status: 202 len: 0 microversion: 2.1 time: 0.485358 Oct 04 18:15:15.247062 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1679/3313] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:14 2022] DELETE /compute/v2.1/os-security-groups/dacdbdf7-ccfe-4d41-bea5-e1eaf9d49b6b => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:15.255199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f37c644f-177e-484f-962f-213f6cbf6ea6 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] Calling method '.version_select at 0x7fd4d12e8550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.307430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d4e1cd1a-5917-4131-aef6-fb373757eb77 req-71bff4d8-30c2-44bb-8380-0b3cbbde1cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18aacc75-5a79-414c-a91a-ff8aac1b347f", "name": "network-vif-deleted", "tag": "a4b6fb86-c263-471c-b2a7-4980a2202458"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:15.322264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d4e1cd1a-5917-4131-aef6-fb373757eb77 req-71bff4d8-30c2-44bb-8380-0b3cbbde1cfb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.323158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d4e1cd1a-5917-4131-aef6-fb373757eb77 req-71bff4d8-30c2-44bb-8380-0b3cbbde1cfb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.324008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d4e1cd1a-5917-4131-aef6-fb373757eb77 req-71bff4d8-30c2-44bb-8380-0b3cbbde1cfb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.341340 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d4e1cd1a-5917-4131-aef6-fb373757eb77 req-71bff4d8-30c2-44bb-8380-0b3cbbde1cfb service nova] Creating event network-vif-deleted:a4b6fb86-c263-471c-b2a7-4980a2202458 for instance 18aacc75-5a79-414c-a91a-ff8aac1b347f on n-h2-850499-14 Oct 04 18:15:15.349119 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d4e1cd1a-5917-4131-aef6-fb373757eb77 req-71bff4d8-30c2-44bb-8380-0b3cbbde1cfb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055483 Oct 04 18:15:15.355523 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1680/3314] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:15.366198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b4ea7de-86ce-4802-b005-5fc3469f4ae8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.367557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8b4ea7de-86ce-4802-b005-5fc3469f4ae8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:15.383337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7de-86ce-4802-b005-5fc3469f4ae8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.383880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7de-86ce-4802-b005-5fc3469f4ae8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.384323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7de-86ce-4802-b005-5fc3469f4ae8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.386882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7de-86ce-4802-b005-5fc3469f4ae8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.390168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7de-86ce-4802-b005-5fc3469f4ae8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.390815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7de-86ce-4802-b005-5fc3469f4ae8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.812699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8b4ea7de-86ce-4802-b005-5fc3469f4ae8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:15.824556 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b4ea7de-86ce-4802-b005-5fc3469f4ae8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.464692 Oct 04 18:15:15.844582 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1681/3315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:15 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:15.850595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-845ff82d-b6c3-49d9-8892-b839825a6b2f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.851474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-845ff82d-b6c3-49d9-8892-b839825a6b2f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:15.857788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-845ff82d-b6c3-49d9-8892-b839825a6b2f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.859044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-845ff82d-b6c3-49d9-8892-b839825a6b2f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.859687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-845ff82d-b6c3-49d9-8892-b839825a6b2f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.860636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-845ff82d-b6c3-49d9-8892-b839825a6b2f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.861390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-845ff82d-b6c3-49d9-8892-b839825a6b2f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.862708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-845ff82d-b6c3-49d9-8892-b839825a6b2f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.909305 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f37c644f-177e-484f-962f-213f6cbf6ea6 tempest-SecurityGroupsTestJSON-1720871806 tempest-SecurityGroupsTestJSON-1720871806-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/b6491d8b-f1e4-4c74-9083-d50ac2d5c0b8" status: 202 len: 0 microversion: 2.1 time: 0.658147 Oct 04 18:15:15.909904 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1635/3316] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:15 2022] DELETE /compute/v2.1/os-security-groups/b6491d8b-f1e4-4c74-9083-d50ac2d5c0b8 => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:15.914847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.915532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:15.932935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.935543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.936263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.942744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.943425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.944026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.992432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.993140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.993741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.994352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lazy-loading 'fault' on Instance uuid a36c7b27-9927-4f6d-874d-dbf86b9ef895 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:16.051759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:16.066458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:16.068333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:16.069758 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e5c454cb-5760-4d7a-b02f-4f6602a3c342 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1270 microversion: 2.25 time: 0.158631 Oct 04 18:15:16.071752 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1636/3317] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:15 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:16.082666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62c2d2e9-19bb-422c-8ad2-7ecd00a6d928 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12e85e0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:16.139704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-845ff82d-b6c3-49d9-8892-b839825a6b2f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:16.148460 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-845ff82d-b6c3-49d9-8892-b839825a6b2f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.302092 Oct 04 18:15:16.165481 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1682/3318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:15 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:16.170395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:16.176504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:16.182284 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-62c2d2e9-19bb-422c-8ad2-7ecd00a6d928 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.108813 Oct 04 18:15:16.190301 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1637/3319] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:16 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:16.224531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.228723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.230809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.232415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.233627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.235419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.277848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-46927097", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:16.295957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.296822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.297449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.298082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lazy-loading 'fault' on Instance uuid 18aacc75-5a79-414c-a91a-ff8aac1b347f {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:16.377676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facf0eae1c5d4dff8e957c3ab073c7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba126ac644f740df852efc20cec70e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:16.390384 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f2943222-d7df-4f38-9693-7766b0d5a2d3 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 200 len: 1315 microversion: 2.1 time: 0.223709 Oct 04 18:15:16.391221 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1683/3320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:16 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:16.453867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] validate_networks() for [('d78eedfe-97d8-4b5e-ac16-1f5f87c44f17', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:16.853822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-93b071f3-55f0-4824-be1b-b80fca021fd7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:16.854812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-93b071f3-55f0-4824-be1b-b80fca021fd7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:16.868852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93b071f3-55f0-4824-be1b-b80fca021fd7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.871734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93b071f3-55f0-4824-be1b-b80fca021fd7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.872890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93b071f3-55f0-4824-be1b-b80fca021fd7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.875322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93b071f3-55f0-4824-be1b-b80fca021fd7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.876106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93b071f3-55f0-4824-be1b-b80fca021fd7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.879209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93b071f3-55f0-4824-be1b-b80fca021fd7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.347527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:17.348577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:17.349252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:17.350063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:17.353646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:17.374223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.375134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.375794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.376791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.388615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-93b071f3-55f0-4824-be1b-b80fca021fd7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:17.409167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.410932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.418868 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-93b071f3-55f0-4824-be1b-b80fca021fd7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.560990 Oct 04 18:15:17.423487 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1684/3321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:16 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:17.454560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.456883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:17.476512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.477471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.478141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.480361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.481146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.481803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.484923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Getting quotas for project 2dc6a5a16ea349379ec3b867415e27c8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:17.496494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Getting quotas for user 1cfad4be58554ff3ab08ae91bfad0854 and project 2dc6a5a16ea349379ec3b867415e27c8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:17.527214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:17.534036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:17.557407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.559660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.561080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.562140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lazy-loading 'fault' on Instance uuid a36c7b27-9927-4f6d-874d-dbf86b9ef895 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:17.653982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:17.679807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:17.689927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:17.690402 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3dad36ad-874c-4c22-a5d3-04fa9b48ea4c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.415935 Oct 04 18:15:17.693295 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1638/3322] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:15:17.696973 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f32ded35-a323-4d71-afc4-266ac2aa4d66 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 200 len: 1193 microversion: 2.25 time: 0.269752 Oct 04 18:15:17.698926 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1685/3323] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 1193 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:17.721088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.721994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7a7f073a-19ae-4c86-af9e-7ea3613abfa1 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12e8e50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.759585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 18aacc75-5a79-414c-a91a-ff8aac1b347f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:17.768451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.769299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.771581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.779028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.782603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.787982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.813884 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7a7f073a-19ae-4c86-af9e-7ea3613abfa1 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.118570 Oct 04 18:15:17.814496 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1639/3324] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:17.828235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ab72420-f790-4d72-8e95-82ef2152baee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.829774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ab72420-f790-4d72-8e95-82ef2152baee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:17.841022 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Instance 18aacc75-5a79-414c-a91a-ff8aac1b347f could not be found. Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f HTTP/1.1 Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 18aacc75-5a79-414c-a91a-ff8aac1b347f could not be found. Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '18aacc75-5a79-414c-a91a-ff8aac1b347f'} Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18aacc75-5a79-414c-a91a-ff8aac1b347f could not be found. Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18aacc75-5a79-414c-a91a-ff8aac1b347f could not be found. Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.845556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:17.851955 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.851955 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:17.851955 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:17.851955 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:17.851955 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:17.851955 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:17.851955 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18aacc75-5a79-414c-a91a-ff8aac1b347f could not be found. Oct 04 18:15:17.851955 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.851955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 404 to user: Instance 18aacc75-5a79-414c-a91a-ff8aac1b347f could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:17.851955 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac835f59-37b5-4abb-80d0-530212e30381 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f" status: 404 len: 111 microversion: 2.1 time: 0.148165 Oct 04 18:15:17.855266 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1686/3325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/servers/18aacc75-5a79-414c-a91a-ff8aac1b347f => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:17.868047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9358d871-db7c-45cc-b4d4-ff181e7a7678 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '.version_select at 0x7fd4d61f2b80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.899890 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-9358d871-db7c-45cc-b4d4-ff181e7a7678 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Image not found. Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9358d871-db7c-45cc-b4d4-ff181e7a7678 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/15f13577-4bdd-4d97-87fa-8df1c564ad45 HTTP/1.1 Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '15f13577-4bdd-4d97-87fa-8df1c564ad45'} Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 15f13577-4bdd-4d97-87fa-8df1c564ad45 to delete Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 15f13577-4bdd-4d97-87fa-8df1c564ad45 could not be found. Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:17.902500 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:15:17.907056 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.912681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9358d871-db7c-45cc-b4d4-ff181e7a7678 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:17.913784 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9358d871-db7c-45cc-b4d4-ff181e7a7678 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "DELETE /compute/v2.1/images/15f13577-4bdd-4d97-87fa-8df1c564ad45" status: 404 len: 62 microversion: 2.1 time: 0.057570 Oct 04 18:15:17.914880 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1687/3326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:17 2022] DELETE /compute/v2.1/images/15f13577-4bdd-4d97-87fa-8df1c564ad45 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:15:17.928793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.929612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:17.939138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.939989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.940664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.941785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.942470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.943159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.951677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ab72420-f790-4d72-8e95-82ef2152baee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:17.963043 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ab72420-f790-4d72-8e95-82ef2152baee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1215 microversion: 2.1 time: 0.146286 Oct 04 18:15:17.965677 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1640/3327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:17.975051 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 HTTP/1.1 Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '8473402c-8305-4b12-80a3-a58369427df7'} Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:17.976767 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 404 to user: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b668f37d-1b24-4a86-bc4e-a6decb298e9e tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 404 len: 111 microversion: 2.1 time: 0.060804 Oct 04 18:15:17.980755 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1688/3328] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:17 2022] DELETE /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:17.993773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.994644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 8473402c-8305-4b12-80a3-a58369427df7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:18.003975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.004740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.005254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.006046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.006587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.007123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.024662 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 HTTP/1.1 Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '8473402c-8305-4b12-80a3-a58369427df7'} Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:18.038582 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:18.042481 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:18.042481 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:18.042481 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:18.042481 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:18.042481 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:18.042481 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:18.042481 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. Oct 04 18:15:18.042481 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:18.047946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 404 to user: Instance 8473402c-8305-4b12-80a3-a58369427df7 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:18.049095 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d0bbb6b3-874b-484c-8507-e903fc8cc667 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7" status: 404 len: 111 microversion: 2.1 time: 0.061496 Oct 04 18:15:18.055399 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1641/3329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/servers/8473402c-8305-4b12-80a3-a58369427df7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:18.065227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-838c885c-8be7-4503-95ac-d63faa8b5494 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '.version_select at 0x7fd4d6226160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:18.113216 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-838c885c-8be7-4503-95ac-d63faa8b5494 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459062888" status: 202 len: 0 microversion: 2.1 time: 0.053020 Oct 04 18:15:18.115202 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1689/3330] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:15:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459062888 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:18.448798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4db77e44-e6db-43b9-a15c-b2fbdfd5fd6f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:18.449885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4db77e44-e6db-43b9-a15c-b2fbdfd5fd6f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:18.464121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4db77e44-e6db-43b9-a15c-b2fbdfd5fd6f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.483950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4db77e44-e6db-43b9-a15c-b2fbdfd5fd6f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.487748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4db77e44-e6db-43b9-a15c-b2fbdfd5fd6f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.490822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4db77e44-e6db-43b9-a15c-b2fbdfd5fd6f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.493298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4db77e44-e6db-43b9-a15c-b2fbdfd5fd6f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.494104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4db77e44-e6db-43b9-a15c-b2fbdfd5fd6f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.725509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:18.726795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: a36c7b27-9927-4f6d-874d-dbf86b9ef895] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:18.741355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.742341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.743457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.744422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.745060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.745804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.832228 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] HTTP exception thrown: Instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 could not be found. Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Request method failure captured: Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 HTTP/1.1 Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHYqbZQYAPN7b5n6YJZstQZEDdFXJm8CNHRmVjxyE-lH35fzdJDyZfhqj2wDpcXx235k4CA4IACVzB0dEpM9d5Y1iuxvtcf97BQwwNXCmr1zCYq7beNQfXe8X0emp8UpEJs9pw4g53C-V1c5t3dGuD_f_rI_KYm6IB7NtmecKAUY1ic Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 1a630efa59244fbf9426904b7bf00eee Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a630efa59244fbf9426904b7bf00eee"}]}] Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 1a630efa59244fbf9426904b7bf00eee Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-LiveAutoBlockMigrationV225Test-196919755-project Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 9796f56e209540ee967eb5090a1d2dbe Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-196919755-project Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 could not be found. Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'a36c7b27-9927-4f6d-874d-dbf86b9ef895'} Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 could not be found. Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 could not be found. Oct 04 18:15:18.838772 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:18.843672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:18.843672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:18.843672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:18.843672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:18.843672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:18.843672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:18.843672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:18.843672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 could not be found. Oct 04 18:15:18.843672 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:18.848351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Returning 404 to user: Instance a36c7b27-9927-4f6d-874d-dbf86b9ef895 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:18.849486 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b987582-38de-4a23-bd48-1f5c3516b8e8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895" status: 404 len: 111 microversion: 2.25 time: 0.129034 Oct 04 18:15:18.853731 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1690/3331] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:18 2022] GET /compute/v2.1/servers/a36c7b27-9927-4f6d-874d-dbf86b9ef895 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:15:18.866542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ed10e64-e42f-473f-aa9f-36b75d151935 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d62943a0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:19.025827 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ed10e64-e42f-473f-aa9f-36b75d151935 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.165753 Oct 04 18:15:19.028750 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1691/3332] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:18 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:19.042379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b81feb04-d470-4e58-be87-2d1c42c312e1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:19.043350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b81feb04-d470-4e58-be87-2d1c42c312e1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:19.062641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b81feb04-d470-4e58-be87-2d1c42c312e1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.063293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b81feb04-d470-4e58-be87-2d1c42c312e1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.063938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b81feb04-d470-4e58-be87-2d1c42c312e1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.065009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b81feb04-d470-4e58-be87-2d1c42c312e1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.065982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b81feb04-d470-4e58-be87-2d1c42c312e1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.066528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b81feb04-d470-4e58-be87-2d1c42c312e1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.257157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b81feb04-d470-4e58-be87-2d1c42c312e1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:19.267288 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b81feb04-d470-4e58-be87-2d1c42c312e1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1211 microversion: 2.1 time: 0.235724 Oct 04 18:15:19.275922 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1692/3333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:19 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1211 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:19.310013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4db77e44-e6db-43b9-a15c-b2fbdfd5fd6f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:19.331869 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4db77e44-e6db-43b9-a15c-b2fbdfd5fd6f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.887284 Oct 04 18:15:19.344987 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1642/3334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:18 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:20.025619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04736bac-cc84-4f97-a272-af94814f6e48 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '.version_select at 0x7fd4d1e4aa60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:20.045928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4fcd089b-755f-4927-99ed-6c124c8a2216 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1c64310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:20.064045 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-04736bac-cc84-4f97-a272-af94814f6e48 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Image not found. Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04736bac-cc84-4f97-a272-af94814f6e48 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/9cb0204a-ee40-4585-88b5-b5de5b0c9264 HTTP/1.1 Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '9cb0204a-ee40-4585-88b5-b5de5b0c9264'} Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9cb0204a-ee40-4585-88b5-b5de5b0c9264 to delete Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9cb0204a-ee40-4585-88b5-b5de5b0c9264 could not be found. Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:20.065837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04736bac-cc84-4f97-a272-af94814f6e48 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-04736bac-cc84-4f97-a272-af94814f6e48 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "DELETE /compute/v2.1/images/9cb0204a-ee40-4585-88b5-b5de5b0c9264" status: 404 len: 62 microversion: 2.1 time: 0.046439 Oct 04 18:15:20.070841 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1693/3335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:20 2022] DELETE /compute/v2.1/images/9cb0204a-ee40-4585-88b5-b5de5b0c9264 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:15:20.104264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:20.105960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:20.130584 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4fcd089b-755f-4927-99ed-6c124c8a2216 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.091270 Oct 04 18:15:20.132686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.135453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.140242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.141212 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1643/3336] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:20 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:20.141797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.144325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.144945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.203224 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 HTTP/1.1 Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '230fae08-91ae-495a-b756-394b097c7379'} Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:20.222272 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 404 to user: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:20.227119 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-414c9ad8-51aa-4f1b-83ef-d14563aba092 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "DELETE /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 404 len: 111 microversion: 2.1 time: 0.137139 Oct 04 18:15:20.234167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:20.235357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] [instance: 230fae08-91ae-495a-b756-394b097c7379] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:20.238841 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1694/3337] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:20 2022] DELETE /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:20.250578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.252001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.256638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.257640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.259547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.262695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.289523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aef97e7a-ea12-4637-92ba-eafb105095a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:20.290156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aef97e7a-ea12-4637-92ba-eafb105095a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:20.304048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef97e7a-ea12-4637-92ba-eafb105095a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.309861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef97e7a-ea12-4637-92ba-eafb105095a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.310426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef97e7a-ea12-4637-92ba-eafb105095a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.313851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef97e7a-ea12-4637-92ba-eafb105095a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.314365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef97e7a-ea12-4637-92ba-eafb105095a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.314817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef97e7a-ea12-4637-92ba-eafb105095a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.323018 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] HTTP exception thrown: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Request method failure captured: Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 HTTP/1.1 Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHef--gg56bmtPiht_O7GrGQDFaCElBj3kekeAQBhw_U9Y0Fi4fLlvSzQaIF8bqOa7c0YS6fiWx86ou8QKlSqddAowC81zhx7gsjRYZUaqawY0P9P8Jaqv_fYQ-UFfXkxXB65HwHPTbw9aFCQ5ohfUVIkW2IlDpb8mGkbArdt4ksAFY Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba126ac644f740df852efc20cec70e25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba126ac644f740df852efc20cec70e25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba126ac644f740df852efc20cec70e25"}]}] Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ba126ac644f740df852efc20cec70e25 Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566 Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: facf0eae1c5d4dff8e957c3ab073c7dd Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1883239566-project Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '230fae08-91ae-495a-b756-394b097c7379'} Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.324607 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:20.329057 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.329057 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:20.329057 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:20.329057 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:20.329057 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:20.329057 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:20.329057 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. Oct 04 18:15:20.329057 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:20.329057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] Returning 404 to user: Instance 230fae08-91ae-495a-b756-394b097c7379 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:20.329057 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a89c04f5-fa50-4469-92bf-edf8a44a6737 tempest-ImagesOneServerNegativeTestJSON-1883239566 tempest-ImagesOneServerNegativeTestJSON-1883239566-project] 10.222.0.18 "GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379" status: 404 len: 111 microversion: 2.1 time: 0.096531 Oct 04 18:15:20.336785 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1644/3338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:20 2022] GET /compute/v2.1/servers/230fae08-91ae-495a-b756-394b097c7379 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:20.369770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-996de00d-15ff-4cc7-be75-04514553df7f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:20.371886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-996de00d-15ff-4cc7-be75-04514553df7f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:20.399623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996de00d-15ff-4cc7-be75-04514553df7f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.404858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996de00d-15ff-4cc7-be75-04514553df7f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.409372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996de00d-15ff-4cc7-be75-04514553df7f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.410448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996de00d-15ff-4cc7-be75-04514553df7f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.413399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996de00d-15ff-4cc7-be75-04514553df7f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.414045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-996de00d-15ff-4cc7-be75-04514553df7f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.837115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aef97e7a-ea12-4637-92ba-eafb105095a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:20.860570 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aef97e7a-ea12-4637-92ba-eafb105095a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1275 microversion: 2.1 time: 0.574030 Oct 04 18:15:20.872313 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1695/3339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:20 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1275 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:21.156574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f6599d2f-693d-4e6c-acd4-090872e717de tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d621fe50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.255313 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f6599d2f-693d-4e6c-acd4-090872e717de tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.103720 Oct 04 18:15:21.256154 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1696/3340] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:21.261667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-996de00d-15ff-4cc7-be75-04514553df7f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:21.276088 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-996de00d-15ff-4cc7-be75-04514553df7f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.918130 Oct 04 18:15:21.280208 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1645/3341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:20 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:21.524494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.525348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.537748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.542930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.543717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.544651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.545289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.546008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.585317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 HTTP/1.1 Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'a466a26b-a6a8-473e-a42b-e1d1c71c2c35'} Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:21.591192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:15:21.596374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.599522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:21.602403 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78f2f449-799e-4d30-8553-c650d03467dd tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 404 len: 111 microversion: 2.1 time: 0.084835 Oct 04 18:15:21.604244 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1697/3342] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:21 2022] DELETE /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:21.612077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.612900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: a466a26b-a6a8-473e-a42b-e1d1c71c2c35] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.622200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.625047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.625719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.631910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.632676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.633308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.658470 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 HTTP/1.1 Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'a466a26b-a6a8-473e-a42b-e1d1c71c2c35'} Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:21.665287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.669792 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.669792 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:21.669792 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:21.669792 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:21.669792 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:21.669792 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. Oct 04 18:15:21.669792 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.671311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance a466a26b-a6a8-473e-a42b-e1d1c71c2c35 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:21.672394 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-556f6d05-a885-47a3-a53a-7db2e347a806 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35" status: 404 len: 111 microversion: 2.1 time: 0.064780 Oct 04 18:15:21.674486 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1646/3343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/servers/a466a26b-a6a8-473e-a42b-e1d1c71c2c35 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:21.682094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.682870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.694832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.695719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.700362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.701526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.702285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.702891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.737951 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 HTTP/1.1 Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'af0d606d-f41f-40fa-80d3-32974fc534a5'} Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:21.739878 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:15:21.744516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.746857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:21.747945 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-76eb3896-ca4a-4f68-a4f6-45295e5a83a2 tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "DELETE /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 404 len: 111 microversion: 2.1 time: 0.070291 Oct 04 18:15:21.756829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.757786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] [instance: af0d606d-f41f-40fa-80d3-32974fc534a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.765229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.765630 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1698/3344] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:21 2022] DELETE /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:21.767648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.773865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.774935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.775666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.776314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.815480 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] HTTP exception thrown: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Request method failure captured: Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 HTTP/1.1 Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHaNhdhdU_IzGaA0iw-5tNynczlseQjoNUdwvi7zCYFrCjOVwNgzMqnn_7uwqHPSsPO_OMAoz5UcQzKrxFfkCN6Z6hduyrCuVSdlUnZ3-XnLKAvSJ2V5MAt-w9xeCX4wYubegU_3HunsduIBhzSsO2NdFuxyscc7BCal7EgvPqufdiM Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9cb88e07ba354759b30d6a779a9218c1"}]}] Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9cb88e07ba354759b30d6a779a9218c1 Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-63299666 Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ba39a7cdf309477195a07acb5cdf24f4 Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-63299666-project Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'af0d606d-f41f-40fa-80d3-32974fc534a5'} Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:21.820931 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.824885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:21.824885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:21.824885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:21.824885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:21.824885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:21.824885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. Oct 04 18:15:21.824885 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:21.839015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] Returning 404 to user: Instance af0d606d-f41f-40fa-80d3-32974fc534a5 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:21.844064 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bbc2c2ed-667a-45cf-a507-0aa0a009144d tempest-DeleteServersTestJSON-63299666 tempest-DeleteServersTestJSON-63299666-project] 10.222.0.18 "GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5" status: 404 len: 111 microversion: 2.1 time: 0.090992 Oct 04 18:15:21.845221 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1647/3345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/servers/af0d606d-f41f-40fa-80d3-32974fc534a5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:21.885814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7ff586eb-1ea4-4b11-8780-4b0d6fbddda0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.886775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7ff586eb-1ea4-4b11-8780-4b0d6fbddda0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.899721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ff586eb-1ea4-4b11-8780-4b0d6fbddda0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.903253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ff586eb-1ea4-4b11-8780-4b0d6fbddda0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.904087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ff586eb-1ea4-4b11-8780-4b0d6fbddda0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.906768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ff586eb-1ea4-4b11-8780-4b0d6fbddda0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.907491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ff586eb-1ea4-4b11-8780-4b0d6fbddda0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.910568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ff586eb-1ea4-4b11-8780-4b0d6fbddda0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.270994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7391b081-fea0-4f92-be03-068975ac0abc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1315a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:22.305489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7ff586eb-1ea4-4b11-8780-4b0d6fbddda0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:22.325345 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7ff586eb-1ea4-4b11-8780-4b0d6fbddda0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1273 microversion: 2.1 time: 0.443390 Oct 04 18:15:22.349516 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1699/3346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1273 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:22.367299 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7391b081-fea0-4f92-be03-068975ac0abc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.100019 Oct 04 18:15:22.370846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-63ead1c5-bfad-4db2-af39-2c87b9e29613 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:22.376707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-63ead1c5-bfad-4db2-af39-2c87b9e29613 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:22.377957 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1648/3347] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:22 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:22.388179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63ead1c5-bfad-4db2-af39-2c87b9e29613 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:22.391734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63ead1c5-bfad-4db2-af39-2c87b9e29613 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:22.392095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63ead1c5-bfad-4db2-af39-2c87b9e29613 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.395101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63ead1c5-bfad-4db2-af39-2c87b9e29613 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:22.395918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63ead1c5-bfad-4db2-af39-2c87b9e29613 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:22.400710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63ead1c5-bfad-4db2-af39-2c87b9e29613 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.953666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-63ead1c5-bfad-4db2-af39-2c87b9e29613 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:22.964964 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-63ead1c5-bfad-4db2-af39-2c87b9e29613 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.614162 Oct 04 18:15:22.985968 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1700/3348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:22 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:23.354010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c1347cf-81f6-4513-a431-2b532426b927 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:23.355076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3c1347cf-81f6-4513-a431-2b532426b927 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:23.369408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c1347cf-81f6-4513-a431-2b532426b927 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:23.378814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c1347cf-81f6-4513-a431-2b532426b927 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:23.382236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c1347cf-81f6-4513-a431-2b532426b927 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:23.383706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c1347cf-81f6-4513-a431-2b532426b927 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:23.393058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1498b292-1b76-429a-b71a-803e7d2aa546 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d61f2310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:23.393634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c1347cf-81f6-4513-a431-2b532426b927 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:23.394298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c1347cf-81f6-4513-a431-2b532426b927 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:23.475736 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1498b292-1b76-429a-b71a-803e7d2aa546 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.087370 Oct 04 18:15:23.484901 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1701/3349] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:23 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:23.961109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3c1347cf-81f6-4513-a431-2b532426b927 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:23.972184 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3c1347cf-81f6-4513-a431-2b532426b927 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1273 microversion: 2.1 time: 0.622521 Oct 04 18:15:23.982982 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1649/3350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:23 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1273 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:24.000897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d382991f-c7d8-4072-8e08-6c5177b8a95a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:24.003873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d382991f-c7d8-4072-8e08-6c5177b8a95a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:24.025396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d382991f-c7d8-4072-8e08-6c5177b8a95a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.026283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d382991f-c7d8-4072-8e08-6c5177b8a95a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.027878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d382991f-c7d8-4072-8e08-6c5177b8a95a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.029222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d382991f-c7d8-4072-8e08-6c5177b8a95a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.032137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d382991f-c7d8-4072-8e08-6c5177b8a95a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.032987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d382991f-c7d8-4072-8e08-6c5177b8a95a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.412410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d382991f-c7d8-4072-8e08-6c5177b8a95a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:24.428543 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d382991f-c7d8-4072-8e08-6c5177b8a95a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.435119 Oct 04 18:15:24.452347 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1702/3351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:23 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:24.492385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1cce45d5-9858-4d19-b427-ad49309f30cb tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d210b940>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:24.620030 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1cce45d5-9858-4d19-b427-ad49309f30cb tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.128554 Oct 04 18:15:24.621038 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1650/3352] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:24 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:25.000704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a53d9c16-7260-4cf9-b94d-39a5ea1ce04f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:25.001819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a53d9c16-7260-4cf9-b94d-39a5ea1ce04f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:25.015205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a53d9c16-7260-4cf9-b94d-39a5ea1ce04f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.015958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a53d9c16-7260-4cf9-b94d-39a5ea1ce04f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.018315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a53d9c16-7260-4cf9-b94d-39a5ea1ce04f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.019951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a53d9c16-7260-4cf9-b94d-39a5ea1ce04f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.021983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a53d9c16-7260-4cf9-b94d-39a5ea1ce04f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.022694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a53d9c16-7260-4cf9-b94d-39a5ea1ce04f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.460495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-24886e2a-c5e7-4bd8-a699-06a6c1d46875 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:25.461437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-24886e2a-c5e7-4bd8-a699-06a6c1d46875 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:25.474416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24886e2a-c5e7-4bd8-a699-06a6c1d46875 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.475755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24886e2a-c5e7-4bd8-a699-06a6c1d46875 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.477359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24886e2a-c5e7-4bd8-a699-06a6c1d46875 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.479646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24886e2a-c5e7-4bd8-a699-06a6c1d46875 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.480511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24886e2a-c5e7-4bd8-a699-06a6c1d46875 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.482873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24886e2a-c5e7-4bd8-a699-06a6c1d46875 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.573459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a53d9c16-7260-4cf9-b94d-39a5ea1ce04f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:25.586852 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a53d9c16-7260-4cf9-b94d-39a5ea1ce04f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1315 microversion: 2.1 time: 0.591489 Oct 04 18:15:25.589795 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1703/3353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:24 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:25.636100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-360302dd-bc3c-40da-8013-b3bba0e848f2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d618b3a0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:25.735704 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-360302dd-bc3c-40da-8013-b3bba0e848f2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.103413 Oct 04 18:15:25.739459 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1704/3354] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:25 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:25.862208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-24886e2a-c5e7-4bd8-a699-06a6c1d46875 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:25.875683 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-24886e2a-c5e7-4bd8-a699-06a6c1d46875 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.421917 Oct 04 18:15:25.877589 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1651/3355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:25 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:25.911811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2de88192-be6d-4b45-803c-f52a1a09f1e7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:25.912326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2de88192-be6d-4b45-803c-f52a1a09f1e7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:25.924333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2de88192-be6d-4b45-803c-f52a1a09f1e7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.924841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2de88192-be6d-4b45-803c-f52a1a09f1e7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.925293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2de88192-be6d-4b45-803c-f52a1a09f1e7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.937116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2de88192-be6d-4b45-803c-f52a1a09f1e7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.937756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2de88192-be6d-4b45-803c-f52a1a09f1e7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.938531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2de88192-be6d-4b45-803c-f52a1a09f1e7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.997938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2de88192-be6d-4b45-803c-f52a1a09f1e7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:26.048020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:26.209198 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2de88192-be6d-4b45-803c-f52a1a09f1e7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "DELETE /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 204 len: 0 microversion: 2.25 time: 0.299150 Oct 04 18:15:26.211592 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1705/3356] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:25 2022] DELETE /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:15:26.219931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:26.220553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:26.234914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.235762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.236403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.239372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.241858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.243952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.615446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6406fc32-2b7f-40ba-ad90-a9545308e5d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:26.616883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6406fc32-2b7f-40ba-ad90-a9545308e5d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:26.629767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6406fc32-2b7f-40ba-ad90-a9545308e5d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.635347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6406fc32-2b7f-40ba-ad90-a9545308e5d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.636255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6406fc32-2b7f-40ba-ad90-a9545308e5d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.637618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6406fc32-2b7f-40ba-ad90-a9545308e5d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.638377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6406fc32-2b7f-40ba-ad90-a9545308e5d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.642404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6406fc32-2b7f-40ba-ad90-a9545308e5d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.363682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:27.380027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:27.384773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:27.391517 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c3b6eced-a26b-4314-9565-a524eae71336 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1731 microversion: 2.25 time: 1.175870 Oct 04 18:15:27.392460 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1652/3357] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:26 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1731 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:15:27.408346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-947ea25f-10b2-4b81-bb19-503280035808 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1a33820>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:27.463715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:27.521120 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-947ea25f-10b2-4b81-bb19-503280035808 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.127472 Oct 04 18:15:27.529652 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1653/3358] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:27 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:27.554171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd8ec99d-0e62-4bbb-b074-e4ea1c24de98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:27.556706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cd8ec99d-0e62-4bbb-b074-e4ea1c24de98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:27.583642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd8ec99d-0e62-4bbb-b074-e4ea1c24de98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.584190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd8ec99d-0e62-4bbb-b074-e4ea1c24de98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.587527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd8ec99d-0e62-4bbb-b074-e4ea1c24de98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.588478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd8ec99d-0e62-4bbb-b074-e4ea1c24de98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.590690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd8ec99d-0e62-4bbb-b074-e4ea1c24de98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.591766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd8ec99d-0e62-4bbb-b074-e4ea1c24de98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.916736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6406fc32-2b7f-40ba-ad90-a9545308e5d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:27.929632 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6406fc32-2b7f-40ba-ad90-a9545308e5d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1315 microversion: 2.1 time: 1.319437 Oct 04 18:15:27.931947 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1706/3359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:26 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1315 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:27.947074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a68a2531-1c33-43c8-925b-31bd0dfde428 req-bb09361b-a9f2-4482-8e6a-64e1273ebcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cc437e-a891-44ca-a8c7-a2f708fe69d2", "tag": "530bb5dd-e584-4a5c-8353-da9105b3028c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:27.961433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:27.973972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a68a2531-1c33-43c8-925b-31bd0dfde428 req-bb09361b-a9f2-4482-8e6a-64e1273ebcc1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.974729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a68a2531-1c33-43c8-925b-31bd0dfde428 req-bb09361b-a9f2-4482-8e6a-64e1273ebcc1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.976560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a68a2531-1c33-43c8-925b-31bd0dfde428 req-bb09361b-a9f2-4482-8e6a-64e1273ebcc1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:28.012595 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a68a2531-1c33-43c8-925b-31bd0dfde428 req-bb09361b-a9f2-4482-8e6a-64e1273ebcc1 service nova] Creating event network-changed:530bb5dd-e584-4a5c-8353-da9105b3028c for instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 on n-h2-850499-14 Oct 04 18:15:28.025584 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a68a2531-1c33-43c8-925b-31bd0dfde428 req-bb09361b-a9f2-4482-8e6a-64e1273ebcc1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091494 Oct 04 18:15:28.026483 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1707/3360] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:28.121735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd8ec99d-0e62-4bbb-b074-e4ea1c24de98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:28.146899 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd8ec99d-0e62-4bbb-b074-e4ea1c24de98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.615438 Oct 04 18:15:28.147729 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1654/3361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:27 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:28.424579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:28.426015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:28.446590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:28.449375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:28.449868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:28.450623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:28.451136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:28.452165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:28.536170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-85933c14-d150-4bf8-8158-62b374bed602 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d6245af0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:28.607016 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-85933c14-d150-4bf8-8158-62b374bed602 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.074489 Oct 04 18:15:28.613836 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1655/3362] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:28 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:28.960836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd1a41fe-0d29-4d35-83f7-26344a26af9a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:28.962607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cd1a41fe-0d29-4d35-83f7-26344a26af9a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:28.971552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:28.980444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:28.982181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:28.984660 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a82dfa16-8ab1-451c-8167-5b366953f33e tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1731 microversion: 2.25 time: 0.565229 Oct 04 18:15:28.987895 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1708/3363] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:28 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1731 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:29.002761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1a41fe-0d29-4d35-83f7-26344a26af9a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.007430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1a41fe-0d29-4d35-83f7-26344a26af9a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.008001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1a41fe-0d29-4d35-83f7-26344a26af9a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.008856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1a41fe-0d29-4d35-83f7-26344a26af9a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.009445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1a41fe-0d29-4d35-83f7-26344a26af9a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.009993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd1a41fe-0d29-4d35-83f7-26344a26af9a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.170229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52b4f6a3-1ac5-4576-a03e-5d8a55c1f0a9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:29.171964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-52b4f6a3-1ac5-4576-a03e-5d8a55c1f0a9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:29.182604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52b4f6a3-1ac5-4576-a03e-5d8a55c1f0a9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.184354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52b4f6a3-1ac5-4576-a03e-5d8a55c1f0a9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.186787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52b4f6a3-1ac5-4576-a03e-5d8a55c1f0a9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.190265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52b4f6a3-1ac5-4576-a03e-5d8a55c1f0a9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.192227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52b4f6a3-1ac5-4576-a03e-5d8a55c1f0a9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.193438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52b4f6a3-1ac5-4576-a03e-5d8a55c1f0a9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.701086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd1a41fe-0d29-4d35-83f7-26344a26af9a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:29.709124 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd1a41fe-0d29-4d35-83f7-26344a26af9a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1315 microversion: 2.1 time: 0.752650 Oct 04 18:15:29.719825 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1656/3364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:28 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:29.739290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-52b4f6a3-1ac5-4576-a03e-5d8a55c1f0a9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:29.742469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-334069dd-fe21-4162-ab8c-fe902c7b9d8c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1315b80>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:29.752951 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-52b4f6a3-1ac5-4576-a03e-5d8a55c1f0a9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.586708 Oct 04 18:15:29.771883 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1709/3365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:29 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:29.816016 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-334069dd-fe21-4162-ab8c-fe902c7b9d8c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.094290 Oct 04 18:15:29.817084 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1657/3366] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:29 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:30.016553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:30.017171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:30.035965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.045230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.046262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.047055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.047531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.047961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.337022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:30.349274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:30.353329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:30.356882 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00805607-480d-4af6-b1fd-90ab52c2bfa7 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1663 microversion: 2.25 time: 0.345091 Oct 04 18:15:30.370993 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1710/3367] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:30 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1663 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:30.731332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-bb8b43f0-5887-485b-9bb2-2f3b05d5bb3f req-2cac572a-c810-4de3-aee8-6421635f14ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "381cd7a0-7761-4e5b-8b7a-345f828634ea", "name": "network-vif-deleted", "tag": "9a53d5b7-c91a-4800-8ef7-ceb69419fc49"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:30.745064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-95b5a283-021a-4d00-b614-e1c8339af907 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:30.745950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-95b5a283-021a-4d00-b614-e1c8339af907 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:30.768561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b5a283-021a-4d00-b614-e1c8339af907 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.769595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b5a283-021a-4d00-b614-e1c8339af907 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.771476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b5a283-021a-4d00-b614-e1c8339af907 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.772515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b5a283-021a-4d00-b614-e1c8339af907 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.780963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b5a283-021a-4d00-b614-e1c8339af907 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.782913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bb8b43f0-5887-485b-9bb2-2f3b05d5bb3f req-2cac572a-c810-4de3-aee8-6421635f14ee service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.783589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95b5a283-021a-4d00-b614-e1c8339af907 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.791859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bb8b43f0-5887-485b-9bb2-2f3b05d5bb3f req-2cac572a-c810-4de3-aee8-6421635f14ee service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.792579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bb8b43f0-5887-485b-9bb2-2f3b05d5bb3f req-2cac572a-c810-4de3-aee8-6421635f14ee service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.831190 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-bb8b43f0-5887-485b-9bb2-2f3b05d5bb3f req-2cac572a-c810-4de3-aee8-6421635f14ee service nova] Creating event network-vif-deleted:9a53d5b7-c91a-4800-8ef7-ceb69419fc49 for instance 381cd7a0-7761-4e5b-8b7a-345f828634ea on n-h1-850499-14 Oct 04 18:15:30.851188 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-bb8b43f0-5887-485b-9bb2-2f3b05d5bb3f req-2cac572a-c810-4de3-aee8-6421635f14ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124343 Oct 04 18:15:30.852177 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1658/3368] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:30.869973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-85aa5db1-144c-4101-b6ed-208fb63f6b77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:30.874018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-85aa5db1-144c-4101-b6ed-208fb63f6b77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:30.893947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85aa5db1-144c-4101-b6ed-208fb63f6b77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.896541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85aa5db1-144c-4101-b6ed-208fb63f6b77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.898994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85aa5db1-144c-4101-b6ed-208fb63f6b77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.903249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85aa5db1-144c-4101-b6ed-208fb63f6b77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.903962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85aa5db1-144c-4101-b6ed-208fb63f6b77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.907818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85aa5db1-144c-4101-b6ed-208fb63f6b77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.767788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95b5a283-021a-4d00-b614-e1c8339af907 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:31.800643 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-95b5a283-021a-4d00-b614-e1c8339af907 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1315 microversion: 2.1 time: 1.062780 Oct 04 18:15:31.815506 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1711/3369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:30 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:31.827039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03d20a62-bcae-40bb-9994-1eb713f2ff8b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d6182550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:31.891519 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-03d20a62-bcae-40bb-9994-1eb713f2ff8b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.066588 Oct 04 18:15:31.892640 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1712/3370] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:31 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:31.911038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:31.912194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:31.920833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.921735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.922365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.923339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.923969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.924953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.978644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.979479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.980095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.980969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lazy-loading 'fault' on Instance uuid 381cd7a0-7761-4e5b-8b7a-345f828634ea {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:32.043075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:32.065941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:32.067409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:32.073409 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-883cacf2-b38c-453a-80d4-06a50854bf96 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 200 len: 1375 microversion: 2.25 time: 0.168737 Oct 04 18:15:32.081755 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1713/3371] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:31 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:32.125078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-85aa5db1-144c-4101-b6ed-208fb63f6b77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:32.141699 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-85aa5db1-144c-4101-b6ed-208fb63f6b77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 1.288026 Oct 04 18:15:32.163493 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1659/3372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:30 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:32.832324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-15786457-df77-4a1b-bf03-ccda615fbd51 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:32.833173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-15786457-df77-4a1b-bf03-ccda615fbd51 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:32.854154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15786457-df77-4a1b-bf03-ccda615fbd51 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.854649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15786457-df77-4a1b-bf03-ccda615fbd51 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.855133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15786457-df77-4a1b-bf03-ccda615fbd51 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.855884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15786457-df77-4a1b-bf03-ccda615fbd51 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.856330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15786457-df77-4a1b-bf03-ccda615fbd51 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.856766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15786457-df77-4a1b-bf03-ccda615fbd51 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.908742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2254a5a4-c0fe-47b6-9762-bfd9ce4d5237 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1315b80>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:32.984148 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2254a5a4-c0fe-47b6-9762-bfd9ce4d5237 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.079603 Oct 04 18:15:32.985563 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1660/3373] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:32 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:33.111783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:33.112858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 381cd7a0-7761-4e5b-8b7a-345f828634ea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:33.125554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.126830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.127511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.128470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.129101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.129873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.133966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-15786457-df77-4a1b-bf03-ccda615fbd51 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:33.149243 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-15786457-df77-4a1b-bf03-ccda615fbd51 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1315 microversion: 2.1 time: 0.323464 Oct 04 18:15:33.152931 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] HTTP exception thrown: Instance 381cd7a0-7761-4e5b-8b7a-345f828634ea could not be found. Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Request method failure captured: Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea HTTP/1.1 Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYqbZQYAPN7b5n6YJZstQZEDdFXJm8CNHRmVjxyE-lH35fzdJDyZfhqj2wDpcXx235k4CA4IACVzB0dEpM9d5Y1iuxvtcf97BQwwNXCmr1zCYq7beNQfXe8X0emp8UpEJs9pw4g53C-V1c5t3dGuD_f_rI_KYm6IB7NtmecKAUY1ic Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 1a630efa59244fbf9426904b7bf00eee Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a630efa59244fbf9426904b7bf00eee"}]}] Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 1a630efa59244fbf9426904b7bf00eee Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-LiveAutoBlockMigrationV225Test-196919755-project Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 9796f56e209540ee967eb5090a1d2dbe Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-196919755-project Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 381cd7a0-7761-4e5b-8b7a-345f828634ea could not be found. Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '381cd7a0-7761-4e5b-8b7a-345f828634ea'} Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 381cd7a0-7761-4e5b-8b7a-345f828634ea could not be found. Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 381cd7a0-7761-4e5b-8b7a-345f828634ea could not be found. Oct 04 18:15:33.155061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.159425 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:33.159425 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.159425 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:33.159425 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:33.159425 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:33.159425 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:33.159425 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:33.159425 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 381cd7a0-7761-4e5b-8b7a-345f828634ea could not be found. Oct 04 18:15:33.159425 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.162326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Returning 404 to user: Instance 381cd7a0-7761-4e5b-8b7a-345f828634ea could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:33.163935 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-155cfb38-6946-4f0e-8b7b-a8bf3d6ac582 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea" status: 404 len: 111 microversion: 2.25 time: 0.057758 Oct 04 18:15:33.168473 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1661/3374] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:33 2022] GET /compute/v2.1/servers/381cd7a0-7761-4e5b-8b7a-345f828634ea => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:33.171467 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1714/3375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:32 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:33.177129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6c437238-455d-4142-be38-5fd7e53650ad tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '.version_select at 0x7fd4d1276940>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:33.187957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce8b2fbf-52d0-4653-b256-9a06328db56b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:33.192084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ce8b2fbf-52d0-4653-b256-9a06328db56b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:33.211108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:33.213557 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6c437238-455d-4142-be38-5fd7e53650ad tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094405831" status: 204 len: 0 microversion: 2.25 time: 0.042868 Oct 04 18:15:33.216553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b2fbf-52d0-4653-b256-9a06328db56b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.218126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b2fbf-52d0-4653-b256-9a06328db56b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.219326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b2fbf-52d0-4653-b256-9a06328db56b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.222559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b2fbf-52d0-4653-b256-9a06328db56b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.223897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b2fbf-52d0-4653-b256-9a06328db56b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.226216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b2fbf-52d0-4653-b256-9a06328db56b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.227428 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1662/3376] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:15:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094405831 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:15:34.005530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb8033d6-55b6-49b1-a979-c3572a09e3f0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12c05e0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:34.074750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ce8b2fbf-52d0-4653-b256-9a06328db56b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:34.087115 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ce8b2fbf-52d0-4653-b256-9a06328db56b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.909743 Oct 04 18:15:34.087990 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1715/3377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:33 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:34.144360 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb8033d6-55b6-49b1-a979-c3572a09e3f0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.147517 Oct 04 18:15:34.145112 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1663/3378] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:33 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:34.175441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bf9a0f79-abd7-45fa-b018-562a57c6ad5d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:34.176328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bf9a0f79-abd7-45fa-b018-562a57c6ad5d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:34.188538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf9a0f79-abd7-45fa-b018-562a57c6ad5d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:34.191480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf9a0f79-abd7-45fa-b018-562a57c6ad5d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:34.193278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf9a0f79-abd7-45fa-b018-562a57c6ad5d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:34.194574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf9a0f79-abd7-45fa-b018-562a57c6ad5d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:34.196872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf9a0f79-abd7-45fa-b018-562a57c6ad5d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:34.199585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf9a0f79-abd7-45fa-b018-562a57c6ad5d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:34.802941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bf9a0f79-abd7-45fa-b018-562a57c6ad5d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:34.875705 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bf9a0f79-abd7-45fa-b018-562a57c6ad5d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1315 microversion: 2.1 time: 0.693818 Oct 04 18:15:34.886739 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1716/3379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:34 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:35.121584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-46619593-b08a-47bc-b9fa-85a90595aa3c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:35.122404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-46619593-b08a-47bc-b9fa-85a90595aa3c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:35.134000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46619593-b08a-47bc-b9fa-85a90595aa3c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.134776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46619593-b08a-47bc-b9fa-85a90595aa3c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.135637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46619593-b08a-47bc-b9fa-85a90595aa3c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.136529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46619593-b08a-47bc-b9fa-85a90595aa3c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.137212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46619593-b08a-47bc-b9fa-85a90595aa3c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.137812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46619593-b08a-47bc-b9fa-85a90595aa3c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.161236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ef4050e-f832-47e3-996f-fb991560b7e5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d61f6160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:35.269538 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ef4050e-f832-47e3-996f-fb991560b7e5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.112316 Oct 04 18:15:35.270252 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1717/3380] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:35 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:35.464653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1d947d1-7046-4d96-a22a-a17c4dc8cd1f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:35.465177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a1d947d1-7046-4d96-a22a-a17c4dc8cd1f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:35.492578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1d947d1-7046-4d96-a22a-a17c4dc8cd1f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.494083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1d947d1-7046-4d96-a22a-a17c4dc8cd1f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.495311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1d947d1-7046-4d96-a22a-a17c4dc8cd1f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.497211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1d947d1-7046-4d96-a22a-a17c4dc8cd1f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.497856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1d947d1-7046-4d96-a22a-a17c4dc8cd1f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.498593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1d947d1-7046-4d96-a22a-a17c4dc8cd1f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.563250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a1d947d1-7046-4d96-a22a-a17c4dc8cd1f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:35.722625 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1d947d1-7046-4d96-a22a-a17c4dc8cd1f tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 204 len: 0 microversion: 2.25 time: 0.282595 Oct 04 18:15:35.749476 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1718/3381] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:35 2022] DELETE /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:15:35.764010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:35.765284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:35.767633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-46619593-b08a-47bc-b9fa-85a90595aa3c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:35.782701 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-46619593-b08a-47bc-b9fa-85a90595aa3c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.668888 Oct 04 18:15:35.784817 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1664/3382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:35 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:35.792004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.793785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.794521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.797091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.798569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.799372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.901893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ff696b9-a561-42d0-8eed-51bc0459575c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:35.902515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ff696b9-a561-42d0-8eed-51bc0459575c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:35.917493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ff696b9-a561-42d0-8eed-51bc0459575c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.918007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ff696b9-a561-42d0-8eed-51bc0459575c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.918457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ff696b9-a561-42d0-8eed-51bc0459575c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.919205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ff696b9-a561-42d0-8eed-51bc0459575c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.919673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ff696b9-a561-42d0-8eed-51bc0459575c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.920107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ff696b9-a561-42d0-8eed-51bc0459575c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.010987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:36.805950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:36.816330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:36.829388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:36.842305 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-df5448f9-228e-4c20-bedf-83fb0803c6e2 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1548 microversion: 2.25 time: 1.089386 Oct 04 18:15:36.845835 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1719/3383] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:35 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1548 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:37.013192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ff696b9-a561-42d0-8eed-51bc0459575c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:37.026631 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ff696b9-a561-42d0-8eed-51bc0459575c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1315 microversion: 2.1 time: 1.128794 Oct 04 18:15:37.046858 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1665/3384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:35 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1315 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:37.060833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a45816a8-3450-47ac-96c2-caa61a904188 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12c0f70>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:37.154810 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a45816a8-3450-47ac-96c2-caa61a904188 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1454 microversion: 2.1 time: 0.106321 Oct 04 18:15:37.164581 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1666/3385] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:37 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:37.172096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fae78d7e-736d-46dc-a8dc-963d4a94078c req-397c65b0-6788-4c41-8022-5da268c38344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cc437e-a891-44ca-a8c7-a2f708fe69d2", "name": "network-vif-plugged", "status": "completed", "tag": "530bb5dd-e584-4a5c-8353-da9105b3028c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:37.197154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fae78d7e-736d-46dc-a8dc-963d4a94078c req-397c65b0-6788-4c41-8022-5da268c38344 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.204883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fae78d7e-736d-46dc-a8dc-963d4a94078c req-397c65b0-6788-4c41-8022-5da268c38344 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.207066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fae78d7e-736d-46dc-a8dc-963d4a94078c req-397c65b0-6788-4c41-8022-5da268c38344 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.242414 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fae78d7e-736d-46dc-a8dc-963d4a94078c req-397c65b0-6788-4c41-8022-5da268c38344 service nova] Creating event network-vif-plugged:530bb5dd-e584-4a5c-8353-da9105b3028c for instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 on n-h2-850499-14 Oct 04 18:15:37.255817 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fae78d7e-736d-46dc-a8dc-963d4a94078c req-397c65b0-6788-4c41-8022-5da268c38344 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094189 Oct 04 18:15:37.259704 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1667/3386] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:37.270904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b495d556-cfc9-4027-8408-879e16d1ac7d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:37.276250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b495d556-cfc9-4027-8408-879e16d1ac7d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:37.299218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b495d556-cfc9-4027-8408-879e16d1ac7d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.299218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b495d556-cfc9-4027-8408-879e16d1ac7d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.299218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b495d556-cfc9-4027-8408-879e16d1ac7d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.299218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b495d556-cfc9-4027-8408-879e16d1ac7d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.299218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b495d556-cfc9-4027-8408-879e16d1ac7d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.299218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b495d556-cfc9-4027-8408-879e16d1ac7d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.306994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d66b85b-d18e-4264-a554-18b00033a093 tempest-ListImageFiltersNegativeTestJSON-1195994749 tempest-ListImageFiltersNegativeTestJSON-1195994749-project] Calling method '.version_select at 0x7fd4d12efd30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:37.340469 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-7d66b85b-d18e-4264-a554-18b00033a093 tempest-ListImageFiltersNegativeTestJSON-1195994749 tempest-ListImageFiltersNegativeTestJSON-1195994749-project] HTTP exception thrown: Image not found. Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d66b85b-d18e-4264-a554-18b00033a093 tempest-ListImageFiltersNegativeTestJSON-1195994749 tempest-ListImageFiltersNegativeTestJSON-1195994749-project] Request method failure captured: Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/images/f0399526-e421-4420-ba81-0de8a5c3c027 HTTP/1.1 Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHhHkPn79LARfonFuRjLGQt5W7WNDCTMH5wyqw4F1g4mrelBmM8LS4AEfECzSMdFhrJwXM0tEV8QPtuzJ_6TmIDnLqC-cqkZE1uzrlWXI6AwXOAQs1kntAMSRqsiiSWOls8OPZZRHvIgh55s-MzWbdI5btmxnefN-3hs2h8kc0iSTmA Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 32524ecf6c254b6c9c91e8a90c70f42f Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1195994749 Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_32524ecf6c254b6c9c91e8a90c70f42f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/32524ecf6c254b6c9c91e8a90c70f42f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/32524ecf6c254b6c9c91e8a90c70f42f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/32524ecf6c254b6c9c91e8a90c70f42f"}]}] Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1195994749 Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 32524ecf6c254b6c9c91e8a90c70f42f Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1195994749 Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ListImageFiltersNegativeTestJSON-1195994749-project Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 9b30dbc9919e4628bf38affcd2d4e99a Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1195994749-project Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'f0399526-e421-4420-ba81-0de8a5c3c027'} Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f0399526-e421-4420-ba81-0de8a5c3c027 Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:15:37.343713 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0399526-e421-4420-ba81-0de8a5c3c027 could not be found. Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:15:37.349831 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:37.358934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d66b85b-d18e-4264-a554-18b00033a093 tempest-ListImageFiltersNegativeTestJSON-1195994749 tempest-ListImageFiltersNegativeTestJSON-1195994749-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:37.358934 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d66b85b-d18e-4264-a554-18b00033a093 tempest-ListImageFiltersNegativeTestJSON-1195994749 tempest-ListImageFiltersNegativeTestJSON-1195994749-project] 10.222.0.18 "GET /compute/v2.1/images/f0399526-e421-4420-ba81-0de8a5c3c027" status: 404 len: 62 microversion: 2.1 time: 0.510849 Oct 04 18:15:37.358934 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1720/3387] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:36 2022] GET /compute/v2.1/images/f0399526-e421-4420-ba81-0de8a5c3c027 => generated 62 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:15:37.871267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:37.873498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:37.888790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.892525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.893077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.894380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.896511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.897036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.058611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:38.072143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:38.076644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:38.080194 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-940e9894-4d64-47f4-b6f5-b231f598480c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1506 microversion: 2.25 time: 0.214406 Oct 04 18:15:38.083594 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1721/3388] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:37 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:38.088671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d19689ee-26b1-4281-b81e-d2301dad6676 req-f7d8a2ac-c8c0-4e99-8f59-7bfe8d04dbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d488d1-77e8-4d0e-9f33-0b675d54dc67", "name": "network-vif-deleted", "tag": "151409ae-2c91-4671-9adf-e22cfaac01aa"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:38.148827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d19689ee-26b1-4281-b81e-d2301dad6676 req-f7d8a2ac-c8c0-4e99-8f59-7bfe8d04dbc7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.150508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d19689ee-26b1-4281-b81e-d2301dad6676 req-f7d8a2ac-c8c0-4e99-8f59-7bfe8d04dbc7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.152133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d19689ee-26b1-4281-b81e-d2301dad6676 req-f7d8a2ac-c8c0-4e99-8f59-7bfe8d04dbc7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.168949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b495d556-cfc9-4027-8408-879e16d1ac7d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:38.192641 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b495d556-cfc9-4027-8408-879e16d1ac7d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.930988 Oct 04 18:15:38.209382 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d19689ee-26b1-4281-b81e-d2301dad6676 req-f7d8a2ac-c8c0-4e99-8f59-7bfe8d04dbc7 service nova] Creating event network-vif-deleted:151409ae-2c91-4671-9adf-e22cfaac01aa for instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 on n-h1-850499-14 Oct 04 18:15:38.213364 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1668/3389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:37 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:38.226147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b8e90b64-21b2-4cad-993e-9fa9ff631b97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:38.227558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b8e90b64-21b2-4cad-993e-9fa9ff631b97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:38.227706 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d19689ee-26b1-4281-b81e-d2301dad6676 req-f7d8a2ac-c8c0-4e99-8f59-7bfe8d04dbc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142507 Oct 04 18:15:38.228572 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1722/3390] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:38.237749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c36d864-2fb4-4052-b617-d4271345ded2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d611de50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:38.245586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8e90b64-21b2-4cad-993e-9fa9ff631b97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.247287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8e90b64-21b2-4cad-993e-9fa9ff631b97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.247960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8e90b64-21b2-4cad-993e-9fa9ff631b97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.250520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8e90b64-21b2-4cad-993e-9fa9ff631b97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.254038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8e90b64-21b2-4cad-993e-9fa9ff631b97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.256120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8e90b64-21b2-4cad-993e-9fa9ff631b97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.340302 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c36d864-2fb4-4052-b617-d4271345ded2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1463 microversion: 2.1 time: 0.110139 Oct 04 18:15:38.343236 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1723/3391] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:38 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1463 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:38.394358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5d624b94-de47-4e7a-975f-16b4d42526bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1e4aa60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:38.475426 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5d624b94-de47-4e7a-975f-16b4d42526bc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 200 len: 1463 microversion: 2.1 time: 0.120425 Oct 04 18:15:38.476708 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1724/3392] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:38 2022] GET /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 1463 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:38.505844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c9fa4ad-e2d3-48b9-bc07-4e3d3ec8c1a0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:38.506910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c9fa4ad-e2d3-48b9-bc07-4e3d3ec8c1a0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:38.519017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9fa4ad-e2d3-48b9-bc07-4e3d3ec8c1a0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.520576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9fa4ad-e2d3-48b9-bc07-4e3d3ec8c1a0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.521658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9fa4ad-e2d3-48b9-bc07-4e3d3ec8c1a0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.522655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9fa4ad-e2d3-48b9-bc07-4e3d3ec8c1a0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.523584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9fa4ad-e2d3-48b9-bc07-4e3d3ec8c1a0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.524506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c9fa4ad-e2d3-48b9-bc07-4e3d3ec8c1a0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.170287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b8e90b64-21b2-4cad-993e-9fa9ff631b97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:39.207943 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b8e90b64-21b2-4cad-993e-9fa9ff631b97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1315 microversion: 2.1 time: 0.992654 Oct 04 18:15:39.210831 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1669/3393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:38 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1315 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:39.225648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:39.229114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:39.236194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3c9fa4ad-e2d3-48b9-bc07-4e3d3ec8c1a0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:39.249889 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c9fa4ad-e2d3-48b9-bc07-4e3d3ec8c1a0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1468 microversion: 2.1 time: 0.753000 Oct 04 18:15:39.250510 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1725/3394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:38 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1468 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:39.258729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.262128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.268050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ba4b29a3-7cc7-48de-ac34-88e8ba239206 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:39.268699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ba4b29a3-7cc7-48de-ac34-88e8ba239206 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:39.269280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.275916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.276583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.277065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.278207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba4b29a3-7cc7-48de-ac34-88e8ba239206 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.278728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba4b29a3-7cc7-48de-ac34-88e8ba239206 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.279215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba4b29a3-7cc7-48de-ac34-88e8ba239206 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.279982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba4b29a3-7cc7-48de-ac34-88e8ba239206 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.280488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba4b29a3-7cc7-48de-ac34-88e8ba239206 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.280928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba4b29a3-7cc7-48de-ac34-88e8ba239206 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.302012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:39.401858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.403591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.404892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.408834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lazy-loading 'fault' on Instance uuid f8d488d1-77e8-4d0e-9f33-0b675d54dc67 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:39.501593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:39.510928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:39.522410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:39.523973 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-62f27f52-6645-43a2-887b-37a0799cb6c3 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 200 len: 1351 microversion: 2.25 time: 0.311703 Oct 04 18:15:39.535936 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1670/3395] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:39 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 1351 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:39.553259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39e4f0bf-362b-4775-a849-55ee6df8704b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1565912224"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:39.556362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39e4f0bf-362b-4775-a849-55ee6df8704b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:39.571299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e4f0bf-362b-4775-a849-55ee6df8704b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.573026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e4f0bf-362b-4775-a849-55ee6df8704b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.575227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e4f0bf-362b-4775-a849-55ee6df8704b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.581767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e4f0bf-362b-4775-a849-55ee6df8704b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.582546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e4f0bf-362b-4775-a849-55ee6df8704b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.583363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39e4f0bf-362b-4775-a849-55ee6df8704b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.625868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ba4b29a3-7cc7-48de-ac34-88e8ba239206 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:39.634196 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ba4b29a3-7cc7-48de-ac34-88e8ba239206 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.380026 Oct 04 18:15:39.647906 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1726/3396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:39 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:39.686056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1e55ba63-610f-4226-b541-1743af94ef4d req-1fb81043-cce0-4892-86c4-6fbfe82e8130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8053e0e-c889-4fd9-93a4-34aca7ff2948", "name": "network-vif-unplugged", "status": "completed", "tag": "1bc16d83-9b0d-4671-a5c4-86ffb6abc091"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:39.707436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1e55ba63-610f-4226-b541-1743af94ef4d req-1fb81043-cce0-4892-86c4-6fbfe82e8130 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.709214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1e55ba63-610f-4226-b541-1743af94ef4d req-1fb81043-cce0-4892-86c4-6fbfe82e8130 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.709800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1e55ba63-610f-4226-b541-1743af94ef4d req-1fb81043-cce0-4892-86c4-6fbfe82e8130 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.738205 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1e55ba63-610f-4226-b541-1743af94ef4d req-1fb81043-cce0-4892-86c4-6fbfe82e8130 service nova] Creating event network-vif-unplugged:1bc16d83-9b0d-4671-a5c4-86ffb6abc091 for instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 on n-h1-850499-14 Oct 04 18:15:39.749146 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1e55ba63-610f-4226-b541-1743af94ef4d req-1fb81043-cce0-4892-86c4-6fbfe82e8130 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067224 Oct 04 18:15:39.755013 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1727/3397] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:39.923946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39e4f0bf-362b-4775-a849-55ee6df8704b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "POST /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5/action" status: 202 len: 0 microversion: 2.1 time: 0.386362 Oct 04 18:15:39.924922 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1671/3398] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:39 2022] POST /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:15:39.940618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-61ef41e0-c141-428f-a909-f191696e6a12 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1acb160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.015824 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-61ef41e0-c141-428f-a909-f191696e6a12 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.077767 Oct 04 18:15:40.016672 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1728/3399] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:39 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:40.237461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0dcfb99c-f277-4cbf-91de-d6e26b0065cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.238790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0dcfb99c-f277-4cbf-91de-d6e26b0065cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:40.246641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dcfb99c-f277-4cbf-91de-d6e26b0065cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.247998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dcfb99c-f277-4cbf-91de-d6e26b0065cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.250116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dcfb99c-f277-4cbf-91de-d6e26b0065cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.251144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dcfb99c-f277-4cbf-91de-d6e26b0065cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.258119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dcfb99c-f277-4cbf-91de-d6e26b0065cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.258758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dcfb99c-f277-4cbf-91de-d6e26b0065cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.481559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0dcfb99c-f277-4cbf-91de-d6e26b0065cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:40.490596 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0dcfb99c-f277-4cbf-91de-d6e26b0065cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1504 microversion: 2.1 time: 0.260340 Oct 04 18:15:40.491891 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1672/3400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:40 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:40.514090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-061ecac1-b951-4c16-bc05-6ac5d1c716fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.514748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-061ecac1-b951-4c16-bc05-6ac5d1c716fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:40.527790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ecac1-b951-4c16-bc05-6ac5d1c716fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.538898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ecac1-b951-4c16-bc05-6ac5d1c716fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.539993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ecac1-b951-4c16-bc05-6ac5d1c716fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.540128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ecac1-b951-4c16-bc05-6ac5d1c716fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.540784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ecac1-b951-4c16-bc05-6ac5d1c716fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.541232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ecac1-b951-4c16-bc05-6ac5d1c716fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.557024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.557696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: f8d488d1-77e8-4d0e-9f33-0b675d54dc67] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:40.572735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.573253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.573708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.576469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.576995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.577441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.581317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-061ecac1-b951-4c16-bc05-6ac5d1c716fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:40.613018 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] HTTP exception thrown: Instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 could not be found. Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Request method failure captured: Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 HTTP/1.1 Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHYqbZQYAPN7b5n6YJZstQZEDdFXJm8CNHRmVjxyE-lH35fzdJDyZfhqj2wDpcXx235k4CA4IACVzB0dEpM9d5Y1iuxvtcf97BQwwNXCmr1zCYq7beNQfXe8X0emp8UpEJs9pw4g53C-V1c5t3dGuD_f_rI_KYm6IB7NtmecKAUY1ic Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 1a630efa59244fbf9426904b7bf00eee Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a630efa59244fbf9426904b7bf00eee"}]}] Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 1a630efa59244fbf9426904b7bf00eee Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-LiveAutoBlockMigrationV225Test-196919755-project Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 9796f56e209540ee967eb5090a1d2dbe Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-196919755-project Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 could not be found. Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'f8d488d1-77e8-4d0e-9f33-0b675d54dc67'} Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 could not be found. Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 could not be found. Oct 04 18:15:40.620141 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 could not be found. Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Returning 404 to user: Instance f8d488d1-77e8-4d0e-9f33-0b675d54dc67 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-67ae96b1-e777-4082-932e-a79a9fe20484 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67" status: 404 len: 111 microversion: 2.25 time: 0.072024 Oct 04 18:15:40.627403 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1673/3401] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:40 2022] GET /compute/v2.1/servers/f8d488d1-77e8-4d0e-9f33-0b675d54dc67 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:40.636920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-028b53e5-a296-470d-804e-dd46ed582caa tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.639542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-028b53e5-a296-470d-804e-dd46ed582caa tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:40.653854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028b53e5-a296-470d-804e-dd46ed582caa tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.654376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028b53e5-a296-470d-804e-dd46ed582caa tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.657848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028b53e5-a296-470d-804e-dd46ed582caa tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.660499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028b53e5-a296-470d-804e-dd46ed582caa tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.661292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028b53e5-a296-470d-804e-dd46ed582caa tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.663446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028b53e5-a296-470d-804e-dd46ed582caa tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.718141 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-061ecac1-b951-4c16-bc05-6ac5d1c716fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 204 len: 0 microversion: 2.1 time: 0.208129 Oct 04 18:15:40.718787 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1729/3402] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:40 2022] DELETE /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:40.734451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-713597fc-fa48-4a7a-9817-1beb20617439 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.739614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-713597fc-fa48-4a7a-9817-1beb20617439 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:40.743385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-028b53e5-a296-470d-804e-dd46ed582caa tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:40.750773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-713597fc-fa48-4a7a-9817-1beb20617439 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.755960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-713597fc-fa48-4a7a-9817-1beb20617439 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.756465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-713597fc-fa48-4a7a-9817-1beb20617439 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.757213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-713597fc-fa48-4a7a-9817-1beb20617439 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.757682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-713597fc-fa48-4a7a-9817-1beb20617439 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.759449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-713597fc-fa48-4a7a-9817-1beb20617439 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.904132 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-028b53e5-a296-470d-804e-dd46ed582caa tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 204 len: 0 microversion: 2.25 time: 0.275154 Oct 04 18:15:40.905650 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1674/3403] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:40 2022] DELETE /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:15:40.912682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8678914a-0ea7-4a86-81d7-16ebdfbd3f06 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.914451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8678914a-0ea7-4a86-81d7-16ebdfbd3f06 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:40.922093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8678914a-0ea7-4a86-81d7-16ebdfbd3f06 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.922849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8678914a-0ea7-4a86-81d7-16ebdfbd3f06 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.923650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8678914a-0ea7-4a86-81d7-16ebdfbd3f06 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.924829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8678914a-0ea7-4a86-81d7-16ebdfbd3f06 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.925743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8678914a-0ea7-4a86-81d7-16ebdfbd3f06 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.926668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8678914a-0ea7-4a86-81d7-16ebdfbd3f06 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.150476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-713597fc-fa48-4a7a-9817-1beb20617439 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:41.161112 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-713597fc-fa48-4a7a-9817-1beb20617439 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.436834 Oct 04 18:15:41.162170 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1730/3404] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:40 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:41.188407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:41.189551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:41.201514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.203251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.203723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.205632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.206118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.209114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.300588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8678914a-0ea7-4a86-81d7-16ebdfbd3f06 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:41.311720 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8678914a-0ea7-4a86-81d7-16ebdfbd3f06 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1510 microversion: 2.1 time: 0.404474 Oct 04 18:15:41.315822 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1675/3405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:40 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:41.338997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40035398-af53-4531-a145-39178ccfa5ae tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1315ee0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:41.423953 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40035398-af53-4531-a145-39178ccfa5ae tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.082918 Oct 04 18:15:41.424815 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1676/3406] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:41 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:41.620860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:41.629904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:41.631404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:41.632596 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-93d07f45-8b33-4ccf-87d6-58fd2c13b90c tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1563 microversion: 2.25 time: 0.455827 Oct 04 18:15:41.633158 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1731/3407] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:41 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1563 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:41.693139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-853159236", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "8940a5c4-cef3-4098-a480-0c74ba62b5c4"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:41.787640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] validate_networks() for [('8940a5c4-cef3-4098-a480-0c74ba62b5c4', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:42.189707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60364636-b9d3-4da8-b734-1f96c0fae0bb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:42.190446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-60364636-b9d3-4da8-b734-1f96c0fae0bb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:42.203280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60364636-b9d3-4da8-b734-1f96c0fae0bb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.204262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60364636-b9d3-4da8-b734-1f96c0fae0bb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.204827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60364636-b9d3-4da8-b734-1f96c0fae0bb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.206204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60364636-b9d3-4da8-b734-1f96c0fae0bb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.211858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60364636-b9d3-4da8-b734-1f96c0fae0bb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.212642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60364636-b9d3-4da8-b734-1f96c0fae0bb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.646067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-60364636-b9d3-4da8-b734-1f96c0fae0bb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:42.663715 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-60364636-b9d3-4da8-b734-1f96c0fae0bb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.470942 Oct 04 18:15:42.664667 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1732/3408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:42 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:42.670115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2758b4c8-0047-46e9-8cd3-000ef3ae3029 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:42.671676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2758b4c8-0047-46e9-8cd3-000ef3ae3029 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:42.678134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2758b4c8-0047-46e9-8cd3-000ef3ae3029 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.678866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2758b4c8-0047-46e9-8cd3-000ef3ae3029 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.686875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2758b4c8-0047-46e9-8cd3-000ef3ae3029 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.691750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2758b4c8-0047-46e9-8cd3-000ef3ae3029 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.692491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2758b4c8-0047-46e9-8cd3-000ef3ae3029 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.693192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2758b4c8-0047-46e9-8cd3-000ef3ae3029 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.844353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:42.845350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:42.846037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:42.846748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:42.847482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:42.866013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.866981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.867615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.868628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.869266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.869930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.929594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Getting quotas for project f378edebea4842199a63aaa7fdc71e73. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:42.937998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Getting quotas for user ceaf15178a4f42b79889361f0f3aa327 and project f378edebea4842199a63aaa7fdc71e73. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:42.957815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:42.960490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:42.982824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:43.078166 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a76b8cf7-432b-4130-a876-8a7b4fb50101 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566138 Oct 04 18:15:43.079137 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1677/3409] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:15:43.086102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-02b7c847-2810-409d-aaf2-3e1e2090dc50 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12c0b80>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.097182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2758b4c8-0047-46e9-8cd3-000ef3ae3029 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.107912 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2758b4c8-0047-46e9-8cd3-000ef3ae3029 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1510 microversion: 2.1 time: 0.441911 Oct 04 18:15:43.108811 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1733/3410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:42 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:43.115319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.116180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.125005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.125844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.127074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.128503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.129149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.130832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.140294 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-02b7c847-2810-409d-aaf2-3e1e2090dc50 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.059341 Oct 04 18:15:43.141385 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1678/3411] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:43.150564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-bcf06d50-f6c9-451b-8d9b-3f65c0a96a81 req-955c5893-290a-46ba-ab95-3b1732aae79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01d60f-4bfb-4c40-9a29-8734c5aba5ab", "name": "network-vif-deleted", "tag": "d0b9b85c-0770-429a-a7d9-3683ed20319f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:43.165896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bcf06d50-f6c9-451b-8d9b-3f65c0a96a81 req-955c5893-290a-46ba-ab95-3b1732aae79a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.166597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bcf06d50-f6c9-451b-8d9b-3f65c0a96a81 req-955c5893-290a-46ba-ab95-3b1732aae79a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.167328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bcf06d50-f6c9-451b-8d9b-3f65c0a96a81 req-955c5893-290a-46ba-ab95-3b1732aae79a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.182922 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-bcf06d50-f6c9-451b-8d9b-3f65c0a96a81 req-955c5893-290a-46ba-ab95-3b1732aae79a service nova] Creating event network-vif-deleted:d0b9b85c-0770-429a-a7d9-3683ed20319f for instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab on n-h1-850499-14 Oct 04 18:15:43.189780 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-bcf06d50-f6c9-451b-8d9b-3f65c0a96a81 req-955c5893-290a-46ba-ab95-3b1732aae79a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046673 Oct 04 18:15:43.191012 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1679/3412] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:43.197357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2a0dc90e-5c99-4231-9171-6a0f48156337 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.198293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2a0dc90e-5c99-4231-9171-6a0f48156337 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.304022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.324122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.338380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.346774 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cd081b54-5971-480f-b32a-b36d718c83b6 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1521 microversion: 2.25 time: 0.236163 Oct 04 18:15:43.361830 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1734/3413] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:43.378649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2a0dc90e-5c99-4231-9171-6a0f48156337 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.393313 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2a0dc90e-5c99-4231-9171-6a0f48156337 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1216 microversion: 2.1 time: 0.200830 Oct 04 18:15:43.404192 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1680/3414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1216 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:43.698239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f78dc470-3777-453d-a6bc-330ae79d63cf tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.699797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f78dc470-3777-453d-a6bc-330ae79d63cf tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.722612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78dc470-3777-453d-a6bc-330ae79d63cf tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.725323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78dc470-3777-453d-a6bc-330ae79d63cf tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.725990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78dc470-3777-453d-a6bc-330ae79d63cf tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.730755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78dc470-3777-453d-a6bc-330ae79d63cf tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.731535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78dc470-3777-453d-a6bc-330ae79d63cf tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.734846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78dc470-3777-453d-a6bc-330ae79d63cf tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.004968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f78dc470-3777-453d-a6bc-330ae79d63cf tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:44.015815 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f78dc470-3777-453d-a6bc-330ae79d63cf tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1513 microversion: 2.1 time: 0.326885 Oct 04 18:15:44.017065 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1735/3415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1513 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:44.140315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-412a42eb-f800-4c0e-aa11-2a5eae977ada tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.141080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-412a42eb-f800-4c0e-aa11-2a5eae977ada tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.156753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f3ca93ce-d272-432f-be41-f54f2f158d4a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d6079ca0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.194056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-412a42eb-f800-4c0e-aa11-2a5eae977ada tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.197205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-412a42eb-f800-4c0e-aa11-2a5eae977ada tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.200518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-412a42eb-f800-4c0e-aa11-2a5eae977ada tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.204282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-412a42eb-f800-4c0e-aa11-2a5eae977ada tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.209833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-412a42eb-f800-4c0e-aa11-2a5eae977ada tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.211201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-412a42eb-f800-4c0e-aa11-2a5eae977ada tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.292948 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f3ca93ce-d272-432f-be41-f54f2f158d4a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.137497 Oct 04 18:15:44.296870 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1736/3416] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:44.392827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.393765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.447104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.451645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.455584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.457097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.463135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.467749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.658334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-412a42eb-f800-4c0e-aa11-2a5eae977ada tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:44.678078 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-412a42eb-f800-4c0e-aa11-2a5eae977ada tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1510 microversion: 2.1 time: 0.538026 Oct 04 18:15:44.679313 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1681/3417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:44.703524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21cf6d9f-2750-4f2f-8851-43c5420aa0f8 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.704343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21cf6d9f-2750-4f2f-8851-43c5420aa0f8 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.732357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21cf6d9f-2750-4f2f-8851-43c5420aa0f8 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.733100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21cf6d9f-2750-4f2f-8851-43c5420aa0f8 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.734192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21cf6d9f-2750-4f2f-8851-43c5420aa0f8 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.737024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21cf6d9f-2750-4f2f-8851-43c5420aa0f8 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.738755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21cf6d9f-2750-4f2f-8851-43c5420aa0f8 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.740612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21cf6d9f-2750-4f2f-8851-43c5420aa0f8 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.786189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:44.810511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:44.815049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:44.823198 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c48c807c-d492-465f-ac2d-4d3744fc69fb tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1347 microversion: 2.25 time: 0.429645 Oct 04 18:15:44.825910 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1737/3418] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1347 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:15:45.007120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-21cf6d9f-2750-4f2f-8851-43c5420aa0f8 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:45.018947 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21cf6d9f-2750-4f2f-8851-43c5420aa0f8 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1268 microversion: 2.1 time: 0.333442 Oct 04 18:15:45.040561 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1682/3419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1268 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:45.044588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8f73ef5d-6ad1-4855-86d7-7abcdb0030dc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:45.045469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8f73ef5d-6ad1-4855-86d7-7abcdb0030dc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:45.056640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f73ef5d-6ad1-4855-86d7-7abcdb0030dc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.057756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f73ef5d-6ad1-4855-86d7-7abcdb0030dc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.058896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f73ef5d-6ad1-4855-86d7-7abcdb0030dc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.061331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f73ef5d-6ad1-4855-86d7-7abcdb0030dc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.063937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f73ef5d-6ad1-4855-86d7-7abcdb0030dc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.064657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f73ef5d-6ad1-4855-86d7-7abcdb0030dc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.314214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f33b382-8120-41f9-84c8-f0e7943ce108 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12a3670>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:45.318351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8f73ef5d-6ad1-4855-86d7-7abcdb0030dc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:45.328855 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8f73ef5d-6ad1-4855-86d7-7abcdb0030dc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1519 microversion: 2.1 time: 0.292404 Oct 04 18:15:45.329953 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1738/3420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:45 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:45.392321 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f33b382-8120-41f9-84c8-f0e7943ce108 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.083338 Oct 04 18:15:45.404250 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1683/3421] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:45 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:45.713081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1e860c1-eb5b-4075-bb0d-7d84c7f28665 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:45.713673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a1e860c1-eb5b-4075-bb0d-7d84c7f28665 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:45.729208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1e860c1-eb5b-4075-bb0d-7d84c7f28665 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.730707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1e860c1-eb5b-4075-bb0d-7d84c7f28665 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.731592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1e860c1-eb5b-4075-bb0d-7d84c7f28665 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.733812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1e860c1-eb5b-4075-bb0d-7d84c7f28665 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.734705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1e860c1-eb5b-4075-bb0d-7d84c7f28665 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.735774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1e860c1-eb5b-4075-bb0d-7d84c7f28665 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.805681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-353d79b4-28a1-4a02-b456-a9de29bb0972 req-35e61850-f5aa-41ca-b1ab-d1a63ad44b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10872fe-cae9-4db2-88f6-57c26d1eff0a", "name": "network-vif-unplugged", "status": "completed", "tag": "c1fb397a-a183-497c-adcf-34f0bcdaeecb"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:45.835952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-353d79b4-28a1-4a02-b456-a9de29bb0972 req-35e61850-f5aa-41ca-b1ab-d1a63ad44b80 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.836448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-353d79b4-28a1-4a02-b456-a9de29bb0972 req-35e61850-f5aa-41ca-b1ab-d1a63ad44b80 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.837076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-353d79b4-28a1-4a02-b456-a9de29bb0972 req-35e61850-f5aa-41ca-b1ab-d1a63ad44b80 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.874103 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-353d79b4-28a1-4a02-b456-a9de29bb0972 req-35e61850-f5aa-41ca-b1ab-d1a63ad44b80 service nova] Creating event network-vif-unplugged:c1fb397a-a183-497c-adcf-34f0bcdaeecb for instance e10872fe-cae9-4db2-88f6-57c26d1eff0a on n-h1-850499-14 Oct 04 18:15:45.892922 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-353d79b4-28a1-4a02-b456-a9de29bb0972 req-35e61850-f5aa-41ca-b1ab-d1a63ad44b80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090923 Oct 04 18:15:45.894122 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1684/3422] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:45.899562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:45.900545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:45.920332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.921123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.921785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.922750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.927634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.928386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.052260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.053620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.054470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.055153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lazy-loading 'fault' on Instance uuid 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:46.179966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.195604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.204260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9796f56e209540ee967eb5090a1d2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a630efa59244fbf9426904b7bf00eee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.205808 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0c621a34-86a2-483b-81e5-f0b199e17ef8 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 200 len: 1352 microversion: 2.25 time: 0.310260 Oct 04 18:15:46.206418 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1685/3423] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:45 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 1352 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:46.234795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a1e860c1-eb5b-4075-bb0d-7d84c7f28665 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.247923 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1e860c1-eb5b-4075-bb0d-7d84c7f28665 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1510 microversion: 2.1 time: 0.537876 Oct 04 18:15:46.263010 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1739/3424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:45 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1510 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:46.264839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-55db5d3b-cbac-48ac-87d9-187dad006e91 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:46.264839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-55db5d3b-cbac-48ac-87d9-187dad006e91 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:46.272114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55db5d3b-cbac-48ac-87d9-187dad006e91 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.272623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55db5d3b-cbac-48ac-87d9-187dad006e91 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.273069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55db5d3b-cbac-48ac-87d9-187dad006e91 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.273793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55db5d3b-cbac-48ac-87d9-187dad006e91 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.274260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55db5d3b-cbac-48ac-87d9-187dad006e91 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.281114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55db5d3b-cbac-48ac-87d9-187dad006e91 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.368629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2fb564f3-ab49-4954-990f-6550c6755feb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:46.372991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2fb564f3-ab49-4954-990f-6550c6755feb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:46.400377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb564f3-ab49-4954-990f-6550c6755feb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.412119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb564f3-ab49-4954-990f-6550c6755feb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.412668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb564f3-ab49-4954-990f-6550c6755feb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.413432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb564f3-ab49-4954-990f-6550c6755feb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.433217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb564f3-ab49-4954-990f-6550c6755feb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.433718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb564f3-ab49-4954-990f-6550c6755feb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.518083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-55db5d3b-cbac-48ac-87d9-187dad006e91 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.528296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:46.533117 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-55db5d3b-cbac-48ac-87d9-187dad006e91 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1274 microversion: 2.1 time: 0.284094 Oct 04 18:15:46.534194 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1686/3425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:46 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1274 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:46.540620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-09037ebf-491d-476d-ae2e-2a513d81dffb tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d127d670>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:46.627247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-09037ebf-491d-476d-ae2e-2a513d81dffb tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.092354 Oct 04 18:15:46.634076 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1687/3426] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:46 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:46.776160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-eb2b12d5-81a7-4cd5-bada-d280b0a689c4 req-8e19abf2-c9ab-4409-a994-81f9a1281e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cc437e-a891-44ca-a8c7-a2f708fe69d2", "name": "network-vif-deleted", "tag": "530bb5dd-e584-4a5c-8353-da9105b3028c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:46.804003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eb2b12d5-81a7-4cd5-bada-d280b0a689c4 req-8e19abf2-c9ab-4409-a994-81f9a1281e09 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.804501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eb2b12d5-81a7-4cd5-bada-d280b0a689c4 req-8e19abf2-c9ab-4409-a994-81f9a1281e09 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.804941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eb2b12d5-81a7-4cd5-bada-d280b0a689c4 req-8e19abf2-c9ab-4409-a994-81f9a1281e09 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.806412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2fb564f3-ab49-4954-990f-6550c6755feb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.818624 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2fb564f3-ab49-4954-990f-6550c6755feb tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1519 microversion: 2.1 time: 0.466317 Oct 04 18:15:46.819528 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1740/3427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:46 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1519 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:46.838056 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-eb2b12d5-81a7-4cd5-bada-d280b0a689c4 req-8e19abf2-c9ab-4409-a994-81f9a1281e09 service nova] Creating event network-vif-deleted:530bb5dd-e584-4a5c-8353-da9105b3028c for instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 on n-h2-850499-14 Oct 04 18:15:46.843892 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-eb2b12d5-81a7-4cd5-bada-d280b0a689c4 req-8e19abf2-c9ab-4409-a994-81f9a1281e09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071839 Oct 04 18:15:46.844676 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1688/3428] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:47.231779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.233756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] [instance: 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:47.246670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.247335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.254489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.258269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.258885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.264083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.278455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.279445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:47.286231 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] HTTP exception thrown: Instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab could not be found. Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Request method failure captured: Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab HTTP/1.1 Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHYqbZQYAPN7b5n6YJZstQZEDdFXJm8CNHRmVjxyE-lH35fzdJDyZfhqj2wDpcXx235k4CA4IACVzB0dEpM9d5Y1iuxvtcf97BQwwNXCmr1zCYq7beNQfXe8X0emp8UpEJs9pw4g53C-V1c5t3dGuD_f_rI_KYm6IB7NtmecKAUY1ic Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 1a630efa59244fbf9426904b7bf00eee Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a630efa59244fbf9426904b7bf00eee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a630efa59244fbf9426904b7bf00eee"}]}] Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 1a630efa59244fbf9426904b7bf00eee Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-196919755 Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-LiveAutoBlockMigrationV225Test-196919755-project Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 9796f56e209540ee967eb5090a1d2dbe Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-196919755-project Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab could not be found. Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '7d01d60f-4bfb-4c40-9a29-8734c5aba5ab'} Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab could not be found. Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab could not be found. Oct 04 18:15:47.289322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.293688 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:47.293688 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.293688 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:47.293688 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:47.293688 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:47.293688 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:47.293688 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:47.293688 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab could not be found. Oct 04 18:15:47.293688 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.295095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.296662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] Returning 404 to user: Instance 7d01d60f-4bfb-4c40-9a29-8734c5aba5ab could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:47.297883 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b0e34f56-4bcc-4b1e-955b-40f771ff3d67 tempest-LiveAutoBlockMigrationV225Test-196919755 tempest-LiveAutoBlockMigrationV225Test-196919755-project] 10.222.0.18 "GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab" status: 404 len: 111 microversion: 2.25 time: 0.070351 Oct 04 18:15:47.299525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.300227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.301177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.301821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.303942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.327313 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1741/3429] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/7d01d60f-4bfb-4c40-9a29-8734c5aba5ab => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:47.393473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.394038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.394466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.394944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lazy-loading 'fault' on Instance uuid c0cc437e-a891-44ca-a8c7-a2f708fe69d2 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:47.562350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e72554fb-b472-46ae-a250-7cc67f447746 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.563132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e72554fb-b472-46ae-a250-7cc67f447746 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:47.579110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e72554fb-b472-46ae-a250-7cc67f447746 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.579839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e72554fb-b472-46ae-a250-7cc67f447746 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.581462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e72554fb-b472-46ae-a250-7cc67f447746 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.582374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e72554fb-b472-46ae-a250-7cc67f447746 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.597372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e72554fb-b472-46ae-a250-7cc67f447746 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.600355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e72554fb-b472-46ae-a250-7cc67f447746 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.729248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:47.739099 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-61558fc4-5632-4eac-842f-fde02c03f2d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 200 len: 1305 microversion: 2.1 time: 0.467039 Oct 04 18:15:47.745271 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1689/3430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 1305 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:47.759179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ffa3c0c7-2fb7-483d-9bdd-10c25a709cf2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12a3550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.853152 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ffa3c0c7-2fb7-483d-9bdd-10c25a709cf2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.101035 Oct 04 18:15:47.854602 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1690/3431] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:47.866428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e148b748-3b5f-4ef2-bdb9-74919421bd84 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.867259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e148b748-3b5f-4ef2-bdb9-74919421bd84 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:47.874659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e72554fb-b472-46ae-a250-7cc67f447746 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:47.893163 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e72554fb-b472-46ae-a250-7cc67f447746 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1274 microversion: 2.1 time: 0.336979 Oct 04 18:15:47.893658 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1742/3432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1274 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:47.913148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e148b748-3b5f-4ef2-bdb9-74919421bd84 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.913764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e148b748-3b5f-4ef2-bdb9-74919421bd84 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.914233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e148b748-3b5f-4ef2-bdb9-74919421bd84 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.915014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e148b748-3b5f-4ef2-bdb9-74919421bd84 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.916110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e148b748-3b5f-4ef2-bdb9-74919421bd84 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.916558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e148b748-3b5f-4ef2-bdb9-74919421bd84 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.226372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e148b748-3b5f-4ef2-bdb9-74919421bd84 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:48.249519 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e148b748-3b5f-4ef2-bdb9-74919421bd84 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1519 microversion: 2.1 time: 0.393779 Oct 04 18:15:48.250117 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1691/3433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1519 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:48.771757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:48.773283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:48.782208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.782988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.783628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.784953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.786298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.787091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.803976 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 HTTP/1.1 Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'c0cc437e-a891-44ca-a8c7-a2f708fe69d2'} Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:48.805764 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:48.810664 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:48.810664 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:48.810664 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:48.810664 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:48.810664 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:48.810664 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:15:48.810664 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:15:48.811936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:48.813587 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9107e45e-3891-46e4-b3dd-765dc9ac53cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 404 len: 111 microversion: 2.1 time: 0.045590 Oct 04 18:15:48.814690 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1743/3434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:48 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:48.823798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b5c25355-7f25-4d31-ae18-97f1cb9ccdca tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:48.824560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b5c25355-7f25-4d31-ae18-97f1cb9ccdca tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:48.833003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5c25355-7f25-4d31-ae18-97f1cb9ccdca tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.833960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5c25355-7f25-4d31-ae18-97f1cb9ccdca tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.834520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5c25355-7f25-4d31-ae18-97f1cb9ccdca tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.835401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5c25355-7f25-4d31-ae18-97f1cb9ccdca tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.836120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5c25355-7f25-4d31-ae18-97f1cb9ccdca tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.836777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5c25355-7f25-4d31-ae18-97f1cb9ccdca tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.871309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ea24f03-4bfc-439e-ba20-e766679f7b10 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1555160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:48.960484 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ea24f03-4bfc-439e-ba20-e766679f7b10 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.094501 Oct 04 18:15:48.970811 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1744/3435] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:48 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:48.978467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-27b9a7e0-a3f4-4f5d-80f3-68656dc6a704 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:48.979242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-27b9a7e0-a3f4-4f5d-80f3-68656dc6a704 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:48.989954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27b9a7e0-a3f4-4f5d-80f3-68656dc6a704 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.990627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27b9a7e0-a3f4-4f5d-80f3-68656dc6a704 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.991216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27b9a7e0-a3f4-4f5d-80f3-68656dc6a704 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.992198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27b9a7e0-a3f4-4f5d-80f3-68656dc6a704 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.992885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27b9a7e0-a3f4-4f5d-80f3-68656dc6a704 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.993454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27b9a7e0-a3f4-4f5d-80f3-68656dc6a704 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.281585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-27b9a7e0-a3f4-4f5d-80f3-68656dc6a704 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:49.294745 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-27b9a7e0-a3f4-4f5d-80f3-68656dc6a704 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1316 microversion: 2.1 time: 0.322119 Oct 04 18:15:49.297192 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1745/3436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:48 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:49.302413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c9eb523a-32f0-4459-82d6-066660ddf24d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:49.303747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c9eb523a-32f0-4459-82d6-066660ddf24d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:49.313943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9eb523a-32f0-4459-82d6-066660ddf24d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.314844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9eb523a-32f0-4459-82d6-066660ddf24d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.315563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9eb523a-32f0-4459-82d6-066660ddf24d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.317630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9eb523a-32f0-4459-82d6-066660ddf24d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.319589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9eb523a-32f0-4459-82d6-066660ddf24d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.320355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9eb523a-32f0-4459-82d6-066660ddf24d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.382579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:49.419290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b5c25355-7f25-4d31-ae18-97f1cb9ccdca tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:49.440808 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b5c25355-7f25-4d31-ae18-97f1cb9ccdca tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.620545 Oct 04 18:15:49.444126 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1692/3437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:48 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:49.650228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-41785915-a164-431c-b620-3faca7be0102 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-41785915-a164-431c-b620-3faca7be0102 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 163 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": 12345, "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 12345 Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:49.657775 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:49.663117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-41785915-a164-431c-b620-3faca7be0102 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:49.664944 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-41785915-a164-431c-b620-3faca7be0102 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019667 Oct 04 18:15:49.666275 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1693/3438] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:49 2022] POST /compute/v2.1/servers => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:49.675556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e85307b8-3d69-4e1a-a462-928ac46ba1d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:49.677366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e85307b8-3d69-4e1a-a462-928ac46ba1d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:49.687168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e85307b8-3d69-4e1a-a462-928ac46ba1d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.688068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e85307b8-3d69-4e1a-a462-928ac46ba1d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.688860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e85307b8-3d69-4e1a-a462-928ac46ba1d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.690580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e85307b8-3d69-4e1a-a462-928ac46ba1d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.692498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e85307b8-3d69-4e1a-a462-928ac46ba1d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.693262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e85307b8-3d69-4e1a-a462-928ac46ba1d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.798607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c9eb523a-32f0-4459-82d6-066660ddf24d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:49.863266 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c9eb523a-32f0-4459-82d6-066660ddf24d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1519 microversion: 2.1 time: 0.561372 Oct 04 18:15:49.878840 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1746/3439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:49 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1519 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:49.977656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0008602e-b5e1-4a86-a1bd-6f9c749974c0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d6122ee0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.047473 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0008602e-b5e1-4a86-a1bd-6f9c749974c0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.073808 Oct 04 18:15:50.062703 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1747/3440] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:49 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:50.324308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33edaa4b-dbcd-439d-adba-80658ecc1971 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.325482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33edaa4b-dbcd-439d-adba-80658ecc1971 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:50.333677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33edaa4b-dbcd-439d-adba-80658ecc1971 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.344200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33edaa4b-dbcd-439d-adba-80658ecc1971 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.344666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33edaa4b-dbcd-439d-adba-80658ecc1971 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.345429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33edaa4b-dbcd-439d-adba-80658ecc1971 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.345898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33edaa4b-dbcd-439d-adba-80658ecc1971 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.346336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33edaa4b-dbcd-439d-adba-80658ecc1971 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.392926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e85307b8-3d69-4e1a-a462-928ac46ba1d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:50.420471 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e85307b8-3d69-4e1a-a462-928ac46ba1d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.750438 Oct 04 18:15:50.421857 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1694/3441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:49 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:50.446063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c8e4161-52bf-4a66-894f-fb6e8e16fed8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.447039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3c8e4161-52bf-4a66-894f-fb6e8e16fed8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:50.464263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c8e4161-52bf-4a66-894f-fb6e8e16fed8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.465566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c8e4161-52bf-4a66-894f-fb6e8e16fed8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.470357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c8e4161-52bf-4a66-894f-fb6e8e16fed8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.474092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c8e4161-52bf-4a66-894f-fb6e8e16fed8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.474604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c8e4161-52bf-4a66-894f-fb6e8e16fed8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.477105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c8e4161-52bf-4a66-894f-fb6e8e16fed8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.964146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-33edaa4b-dbcd-439d-adba-80658ecc1971 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:51.013461 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33edaa4b-dbcd-439d-adba-80658ecc1971 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1316 microversion: 2.1 time: 0.692637 Oct 04 18:15:51.020391 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1748/3442] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:50 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1316 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:51.040959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-59485096-2d41-406e-acf5-d297fa38c0fb req-e3961b54-0706-4f2b-9651-c1294541ec5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da89d46d-4ae1-466f-9889-e1d528e843e5", "name": "network-vif-plugged", "status": "completed", "tag": "4705f29d-c67d-4649-af0a-38b1ead030b6"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:51.053688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-59485096-2d41-406e-acf5-d297fa38c0fb req-e3961b54-0706-4f2b-9651-c1294541ec5d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.054488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-59485096-2d41-406e-acf5-d297fa38c0fb req-e3961b54-0706-4f2b-9651-c1294541ec5d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.055163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-59485096-2d41-406e-acf5-d297fa38c0fb req-e3961b54-0706-4f2b-9651-c1294541ec5d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.068445 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-59485096-2d41-406e-acf5-d297fa38c0fb req-e3961b54-0706-4f2b-9651-c1294541ec5d service nova] Creating event network-vif-plugged:4705f29d-c67d-4649-af0a-38b1ead030b6 for instance da89d46d-4ae1-466f-9889-e1d528e843e5 on n-h2-850499-14 Oct 04 18:15:51.073962 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-59485096-2d41-406e-acf5-d297fa38c0fb req-e3961b54-0706-4f2b-9651-c1294541ec5d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051249 Oct 04 18:15:51.074940 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1749/3443] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:51.081023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-acff480d-3043-4be5-af73-c97a135435ee tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:51.081990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-acff480d-3043-4be5-af73-c97a135435ee tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:51.088672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acff480d-3043-4be5-af73-c97a135435ee tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.089497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acff480d-3043-4be5-af73-c97a135435ee tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.090133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acff480d-3043-4be5-af73-c97a135435ee tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.091055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acff480d-3043-4be5-af73-c97a135435ee tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.091685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acff480d-3043-4be5-af73-c97a135435ee tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.092286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-acff480d-3043-4be5-af73-c97a135435ee tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.242741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3c8e4161-52bf-4a66-894f-fb6e8e16fed8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:51.253176 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3c8e4161-52bf-4a66-894f-fb6e8e16fed8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.812388 Oct 04 18:15:51.259839 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1695/3444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:50 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:51.267753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-68af2098-7539-451e-843d-9d0bb57ea040 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d6174700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:51.373600 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-68af2098-7539-451e-843d-9d0bb57ea040 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.112136 Oct 04 18:15:51.375802 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1696/3445] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:51 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:51.390652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-acff480d-3043-4be5-af73-c97a135435ee tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:51.402196 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-acff480d-3043-4be5-af73-c97a135435ee tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1519 microversion: 2.1 time: 0.325678 Oct 04 18:15:51.404535 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1750/3446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:51 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1519 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:52.050399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9142995b-fb02-414d-b15c-91051e869609 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.052551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9142995b-fb02-414d-b15c-91051e869609 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.075496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9142995b-fb02-414d-b15c-91051e869609 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.076050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9142995b-fb02-414d-b15c-91051e869609 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.076559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9142995b-fb02-414d-b15c-91051e869609 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.078262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9142995b-fb02-414d-b15c-91051e869609 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.078784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9142995b-fb02-414d-b15c-91051e869609 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.079241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9142995b-fb02-414d-b15c-91051e869609 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.311008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9142995b-fb02-414d-b15c-91051e869609 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:52.322835 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9142995b-fb02-414d-b15c-91051e869609 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1316 microversion: 2.1 time: 0.279577 Oct 04 18:15:52.324937 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1697/3447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:52 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:52.393530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dfb6969c-6c8c-408e-b856-11be20e1da4a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1548700>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.427395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db326e47-32f1-4f30-9886-92726e9aeb70 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.428021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-db326e47-32f1-4f30-9886-92726e9aeb70 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.441485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db326e47-32f1-4f30-9886-92726e9aeb70 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.442023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db326e47-32f1-4f30-9886-92726e9aeb70 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.442474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db326e47-32f1-4f30-9886-92726e9aeb70 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.443905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db326e47-32f1-4f30-9886-92726e9aeb70 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.444377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db326e47-32f1-4f30-9886-92726e9aeb70 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.444799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db326e47-32f1-4f30-9886-92726e9aeb70 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.505175 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dfb6969c-6c8c-408e-b856-11be20e1da4a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.119155 Oct 04 18:15:52.505913 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1751/3448] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:52 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:52.741968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-db326e47-32f1-4f30-9886-92726e9aeb70 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:52.752848 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-db326e47-32f1-4f30-9886-92726e9aeb70 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1519 microversion: 2.1 time: 0.329631 Oct 04 18:15:52.753663 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1698/3449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:52 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1519 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:53.209100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-4b5adbe9-f4c1-481b-b887-aa61ef558a45 req-01de0df3-6edb-41c2-880a-830c76cfa63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d", "tag": "ef6e1b3d-27ec-415e-8f37-f620c17d81ce"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:53.228766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4b5adbe9-f4c1-481b-b887-aa61ef558a45 req-01de0df3-6edb-41c2-880a-830c76cfa63a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.243153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4b5adbe9-f4c1-481b-b887-aa61ef558a45 req-01de0df3-6edb-41c2-880a-830c76cfa63a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.243619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4b5adbe9-f4c1-481b-b887-aa61ef558a45 req-01de0df3-6edb-41c2-880a-830c76cfa63a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.267200 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-4b5adbe9-f4c1-481b-b887-aa61ef558a45 req-01de0df3-6edb-41c2-880a-830c76cfa63a service nova] Creating event network-changed:ef6e1b3d-27ec-415e-8f37-f620c17d81ce for instance c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d on n-h2-850499-14 Oct 04 18:15:53.273404 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-4b5adbe9-f4c1-481b-b887-aa61ef558a45 req-01de0df3-6edb-41c2-880a-830c76cfa63a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069180 Oct 04 18:15:53.275002 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1752/3450] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:53.349784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d6ebf9f-0da6-467f-97fd-c44c47737879 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.350415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4d6ebf9f-0da6-467f-97fd-c44c47737879 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:53.352730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:53.364991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d6ebf9f-0da6-467f-97fd-c44c47737879 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.375283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d6ebf9f-0da6-467f-97fd-c44c47737879 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.376314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d6ebf9f-0da6-467f-97fd-c44c47737879 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.377374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d6ebf9f-0da6-467f-97fd-c44c47737879 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.378150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d6ebf9f-0da6-467f-97fd-c44c47737879 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.392035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d6ebf9f-0da6-467f-97fd-c44c47737879 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.393612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:53.521990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0b8d4e48-edc6-4216-93b5-71503cc0020b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d6226c10>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.606586 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0b8d4e48-edc6-4216-93b5-71503cc0020b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.088767 Oct 04 18:15:53.607792 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1753/3451] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:53.624232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d4f11ce4-9346-4a9b-b1bc-b5784403e66b req-6a0b5d16-fb9d-468c-954d-7e18345ce2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10872fe-cae9-4db2-88f6-57c26d1eff0a", "name": "network-vif-plugged", "status": "completed", "tag": "c1fb397a-a183-497c-adcf-34f0bcdaeecb"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:53.659628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d4f11ce4-9346-4a9b-b1bc-b5784403e66b req-6a0b5d16-fb9d-468c-954d-7e18345ce2c3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.660785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d4f11ce4-9346-4a9b-b1bc-b5784403e66b req-6a0b5d16-fb9d-468c-954d-7e18345ce2c3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.662923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d4f11ce4-9346-4a9b-b1bc-b5784403e66b req-6a0b5d16-fb9d-468c-954d-7e18345ce2c3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.693622 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d4f11ce4-9346-4a9b-b1bc-b5784403e66b req-6a0b5d16-fb9d-468c-954d-7e18345ce2c3 service nova] Creating event network-vif-plugged:c1fb397a-a183-497c-adcf-34f0bcdaeecb for instance e10872fe-cae9-4db2-88f6-57c26d1eff0a on n-h1-850499-14 Oct 04 18:15:53.703106 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d4f11ce4-9346-4a9b-b1bc-b5784403e66b req-6a0b5d16-fb9d-468c-954d-7e18345ce2c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092165 Oct 04 18:15:53.706092 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1754/3452] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:53.744026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4d6ebf9f-0da6-467f-97fd-c44c47737879 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:53.769787 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4d6ebf9f-0da6-467f-97fd-c44c47737879 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1316 microversion: 2.1 time: 0.423820 Oct 04 18:15:53.780951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fb9f1203-3f32-4f6c-9130-ab9552e2f78d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.782033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fb9f1203-3f32-4f6c-9130-ab9552e2f78d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:53.789390 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1699/3453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:53.803743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb9f1203-3f32-4f6c-9130-ab9552e2f78d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.807407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb9f1203-3f32-4f6c-9130-ab9552e2f78d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.810434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb9f1203-3f32-4f6c-9130-ab9552e2f78d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.812858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb9f1203-3f32-4f6c-9130-ab9552e2f78d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.813517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb9f1203-3f32-4f6c-9130-ab9552e2f78d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.814808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb9f1203-3f32-4f6c-9130-ab9552e2f78d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.117104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fb9f1203-3f32-4f6c-9130-ab9552e2f78d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:54.134322 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fb9f1203-3f32-4f6c-9130-ab9552e2f78d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1519 microversion: 2.1 time: 0.359598 Oct 04 18:15:54.147110 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1755/3454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1519 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:54.305013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-075ea3ff-d0a7-450f-8141-23c9b0683944 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1416192600", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "385ef413-258a-4218-91c2-0dff9ca78873", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:54.515310 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-075ea3ff-d0a7-450f-8141-23c9b0683944 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Block Device 385ef413-258a-4218-91c2-0dff9ca78873 is not bootable. Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-075ea3ff-d0a7-450f-8141-23c9b0683944 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 358 Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1416192600", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "385ef413-258a-4218-91c2-0dff9ca78873", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: exception: Block Device 385ef413-258a-4218-91c2-0dff9ca78873 is not bootable. Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1416192600', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '385ef413-258a-4218-91c2-0dff9ca78873'}], 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 385ef413-258a-4218-91c2-0dff9ca78873 is not bootable. Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:54.525483 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 385ef413-258a-4218-91c2-0dff9ca78873 is not bootable. Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 385ef413-258a-4218-91c2-0dff9ca78873 is not bootable. Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-075ea3ff-d0a7-450f-8141-23c9b0683944 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Block Device 385ef413-258a-4218-91c2-0dff9ca78873 is not bootable. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-075ea3ff-d0a7-450f-8141-23c9b0683944 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.226511 Oct 04 18:15:54.530560 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1700/3455] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:54 2022] POST /compute/v2.1/servers => generated 110 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:54.536865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a99f74c-efa6-43b1-b8dc-241b9ed2b532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.537473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4a99f74c-efa6-43b1-b8dc-241b9ed2b532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.551132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a99f74c-efa6-43b1-b8dc-241b9ed2b532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.551634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a99f74c-efa6-43b1-b8dc-241b9ed2b532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.552074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a99f74c-efa6-43b1-b8dc-241b9ed2b532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.552791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a99f74c-efa6-43b1-b8dc-241b9ed2b532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.553246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a99f74c-efa6-43b1-b8dc-241b9ed2b532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.553674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a99f74c-efa6-43b1-b8dc-241b9ed2b532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.627640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-37bf59db-04a7-4eea-b0f2-2c6c9203a4a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1315ee0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.727103 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-37bf59db-04a7-4eea-b0f2-2c6c9203a4a8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.106942 Oct 04 18:15:54.735585 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1701/3456] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:54.811721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9f4092b-27b4-44fd-b0c0-250d71ab28d0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.812362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9f4092b-27b4-44fd-b0c0-250d71ab28d0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.824899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f4092b-27b4-44fd-b0c0-250d71ab28d0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.825404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f4092b-27b4-44fd-b0c0-250d71ab28d0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.826490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f4092b-27b4-44fd-b0c0-250d71ab28d0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.827803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f4092b-27b4-44fd-b0c0-250d71ab28d0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.829207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f4092b-27b4-44fd-b0c0-250d71ab28d0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.830606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f4092b-27b4-44fd-b0c0-250d71ab28d0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.897943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4a99f74c-efa6-43b1-b8dc-241b9ed2b532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:54.907434 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4a99f74c-efa6-43b1-b8dc-241b9ed2b532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.374988 Oct 04 18:15:54.921839 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1756/3457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:54.937058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-422f9cdb-e1ea-4930-8ca3-2f00d061a757 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.937965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-422f9cdb-e1ea-4930-8ca3-2f00d061a757 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.967731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-422f9cdb-e1ea-4930-8ca3-2f00d061a757 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.968531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-422f9cdb-e1ea-4930-8ca3-2f00d061a757 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.969145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-422f9cdb-e1ea-4930-8ca3-2f00d061a757 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.971072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-422f9cdb-e1ea-4930-8ca3-2f00d061a757 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.972127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-422f9cdb-e1ea-4930-8ca3-2f00d061a757 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.972708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-422f9cdb-e1ea-4930-8ca3-2f00d061a757 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.121490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9f4092b-27b4-44fd-b0c0-250d71ab28d0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.135049 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9f4092b-27b4-44fd-b0c0-250d71ab28d0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1316 microversion: 2.1 time: 0.328734 Oct 04 18:15:55.136481 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1702/3458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:55.170984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-221ec721-91a3-437f-81ae-d2f697726fb4 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.172155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-221ec721-91a3-437f-81ae-d2f697726fb4 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.187092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221ec721-91a3-437f-81ae-d2f697726fb4 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.187888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221ec721-91a3-437f-81ae-d2f697726fb4 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.189274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221ec721-91a3-437f-81ae-d2f697726fb4 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.193091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221ec721-91a3-437f-81ae-d2f697726fb4 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.193832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221ec721-91a3-437f-81ae-d2f697726fb4 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.195686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221ec721-91a3-437f-81ae-d2f697726fb4 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.230625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-422f9cdb-e1ea-4930-8ca3-2f00d061a757 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.242509 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-422f9cdb-e1ea-4930-8ca3-2f00d061a757 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.312643 Oct 04 18:15:55.243824 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1757/3459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:55.498400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-221ec721-91a3-437f-81ae-d2f697726fb4 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.506685 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-221ec721-91a3-437f-81ae-d2f697726fb4 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1519 microversion: 2.1 time: 0.345554 Oct 04 18:15:55.507314 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1703/3460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1519 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:55.750327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aea4f70e-19a8-4fe3-8c31-9dd5e24b3950 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1548550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.868533 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aea4f70e-19a8-4fe3-8c31-9dd5e24b3950 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.127395 Oct 04 18:15:55.871833 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1758/3461] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:56.159414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a99a2f7f-cda9-46c2-a963-5866c85bdf45 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.161560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a99a2f7f-cda9-46c2-a963-5866c85bdf45 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.172841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a99a2f7f-cda9-46c2-a963-5866c85bdf45 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.173873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a99a2f7f-cda9-46c2-a963-5866c85bdf45 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.174520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a99a2f7f-cda9-46c2-a963-5866c85bdf45 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.175636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a99a2f7f-cda9-46c2-a963-5866c85bdf45 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.176609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a99a2f7f-cda9-46c2-a963-5866c85bdf45 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.177214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a99a2f7f-cda9-46c2-a963-5866c85bdf45 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.535365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ca35695-602b-4df1-8907-a678f3f37756 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.535919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ca35695-602b-4df1-8907-a678f3f37756 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.546517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca35695-602b-4df1-8907-a678f3f37756 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.549562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca35695-602b-4df1-8907-a678f3f37756 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.550260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca35695-602b-4df1-8907-a678f3f37756 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.551210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca35695-602b-4df1-8907-a678f3f37756 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.558755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca35695-602b-4df1-8907-a678f3f37756 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.559608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ca35695-602b-4df1-8907-a678f3f37756 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.649004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a99a2f7f-cda9-46c2-a963-5866c85bdf45 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:56.657804 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a99a2f7f-cda9-46c2-a963-5866c85bdf45 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1316 microversion: 2.1 time: 0.503519 Oct 04 18:15:56.658318 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1704/3462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:56.891692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b35f4283-d848-458b-b789-f4aba4c5f432 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d129fdc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.990329 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b35f4283-d848-458b-b789-f4aba4c5f432 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.108085 Oct 04 18:15:56.993002 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1705/3463] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:57.259944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ca35695-602b-4df1-8907-a678f3f37756 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.269502 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ca35695-602b-4df1-8907-a678f3f37756 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1504 microversion: 2.1 time: 0.741145 Oct 04 18:15:57.276027 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1759/3464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1504 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:57.285195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-97415452-0164-4a6c-b8c2-b2ab340287f8 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Action: 'create', calling method: .version_select at 0x7fd4d12b20d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-910045267", "policies": ["affinity"]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:57.293068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b04cfce7-dd5a-4d14-a288-78ada71ce984 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.293704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b04cfce7-dd5a-4d14-a288-78ada71ce984 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.310846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04cfce7-dd5a-4d14-a288-78ada71ce984 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.311889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04cfce7-dd5a-4d14-a288-78ada71ce984 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.312348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04cfce7-dd5a-4d14-a288-78ada71ce984 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.313089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04cfce7-dd5a-4d14-a288-78ada71ce984 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.313546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04cfce7-dd5a-4d14-a288-78ada71ce984 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.313969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04cfce7-dd5a-4d14-a288-78ada71ce984 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.345980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-97415452-0164-4a6c-b8c2-b2ab340287f8 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:57.374084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-97415452-0164-4a6c-b8c2-b2ab340287f8 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:57.544867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-97415452-0164-4a6c-b8c2-b2ab340287f8 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:57.556118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-97415452-0164-4a6c-b8c2-b2ab340287f8 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:57.595834 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-97415452-0164-4a6c-b8c2-b2ab340287f8 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.461631 Oct 04 18:15:57.599274 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1706/3465] 10.222.0.18 () {60 vars in 1174 bytes} [Tue Oct 4 18:15:57 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:57.706511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f63456c-f6bd-4b59-8337-220664e7b511 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Action: 'create', calling method: .version_select at 0x7fd4d127d040>, body: {"keypair": {"name": "tempest-keypair-1171675951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzPHpT9Niozw1xn7UMsyvqEScK8tKZEWgqsZ5deDvQfStl5SmGudxh1g/7o0oRUBCy8xB0bme08bkGWEY8PNUcmoW3KX6VEcA/AQEHvmgpg076TwzYGPRf+JXv+w5CrVw=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:57.747520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7f63456c-f6bd-4b59-8337-220664e7b511 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Getting quotas for project 109bbd6392bb4b0faa917253bd5338be. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:57.753955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b04cfce7-dd5a-4d14-a288-78ada71ce984 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.767548 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b04cfce7-dd5a-4d14-a288-78ada71ce984 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 200 len: 1504 microversion: 2.1 time: 0.478175 Oct 04 18:15:57.768949 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1760/3466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:57.781449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7f63456c-f6bd-4b59-8337-220664e7b511 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Getting quotas for user 4f568ffc40c84b99b5439533aeaec9e3 and project 109bbd6392bb4b0faa917253bd5338be. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:57.789318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05220c95-d421-416e-b8d8-91395439761b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Action: 'create', calling method: .version_select at 0x7fd4d1fd0d30>, body: {"server_group": {"name": "tempest-server-group-1849516536", "policies": ["affinity"]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:57.820207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-05220c95-d421-416e-b8d8-91395439761b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:57.829602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-05220c95-d421-416e-b8d8-91395439761b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:57.851983 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f63456c-f6bd-4b59-8337-220664e7b511 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.251147 Oct 04 18:15:57.854136 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1707/3467] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:15:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:57.863811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-044e727f-1f6c-4b4a-a234-afcf08000a53 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.864715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-044e727f-1f6c-4b4a-a234-afcf08000a53 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.873197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044e727f-1f6c-4b4a-a234-afcf08000a53 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.874160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044e727f-1f6c-4b4a-a234-afcf08000a53 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.874866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044e727f-1f6c-4b4a-a234-afcf08000a53 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.875926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044e727f-1f6c-4b4a-a234-afcf08000a53 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.876852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044e727f-1f6c-4b4a-a234-afcf08000a53 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.877677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044e727f-1f6c-4b4a-a234-afcf08000a53 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.932957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:57.961347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-05220c95-d421-416e-b8d8-91395439761b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:57.978986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-05220c95-d421-416e-b8d8-91395439761b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:58.018757 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-05220c95-d421-416e-b8d8-91395439761b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.246078 Oct 04 18:15:58.025218 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1761/3468] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 4 18:15:57 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:58.030386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-397565db-643d-4c8d-902f-005ba5d48f38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.030903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-397565db-643d-4c8d-902f-005ba5d48f38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:58.042834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397565db-643d-4c8d-902f-005ba5d48f38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.044334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397565db-643d-4c8d-902f-005ba5d48f38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.044994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397565db-643d-4c8d-902f-005ba5d48f38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.046445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397565db-643d-4c8d-902f-005ba5d48f38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.047114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397565db-643d-4c8d-902f-005ba5d48f38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.047721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397565db-643d-4c8d-902f-005ba5d48f38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.078223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-397565db-643d-4c8d-902f-005ba5d48f38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:58.188550 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-397565db-643d-4c8d-902f-005ba5d48f38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 204 len: 0 microversion: 2.1 time: 0.161664 Oct 04 18:15:58.189996 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1762/3469] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:58 2022] DELETE /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:58.197730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-923fd511-b205-43d5-af9d-2aeff3554a00 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d615f160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.275707 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-923fd511-b205-43d5-af9d-2aeff3554a00 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.082887 Oct 04 18:15:58.276305 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1763/3470] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:58 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:58.296889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-88fe62f0-5e91-40ac-b15f-2ca68d8333cd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Action: 'create', calling method: .version_select at 0x7fd4d1548700>, body: {"server_group": {"name": "tempest-server-group-1849516536", "policies": ["affinity"]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:58.352237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-88fe62f0-5e91-40ac-b15f-2ca68d8333cd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:58.367331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-88fe62f0-5e91-40ac-b15f-2ca68d8333cd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:58.499493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-88fe62f0-5e91-40ac-b15f-2ca68d8333cd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:58.512884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-88fe62f0-5e91-40ac-b15f-2ca68d8333cd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:58.569373 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-88fe62f0-5e91-40ac-b15f-2ca68d8333cd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.280898 Oct 04 18:15:58.572209 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1764/3471] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 4 18:15:58 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:58.596808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1409007536", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "a3d67ed6-ad9f-48a1-902c-dc88b5c66c23"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:58.735872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] validate_networks() for [('a3d67ed6-ad9f-48a1-902c-dc88b5c66c23', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:58.764074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-044e727f-1f6c-4b4a-a234-afcf08000a53 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:58.774051 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-044e727f-1f6c-4b4a-a234-afcf08000a53 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1316 microversion: 2.1 time: 0.918439 Oct 04 18:15:58.783639 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1708/3472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1316 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:58.804206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7c780b44-11b8-4978-92dd-304bca99e204 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.866604 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7c780b44-11b8-4978-92dd-304bca99e204 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/c8132e75-23db-409e-b389-7375e7eb1c51" status: 204 len: 0 microversion: 2.1 time: 0.081503 Oct 04 18:15:58.869847 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1709/3473] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:15:58 2022] DELETE /compute/v2.1/os-server-groups/c8132e75-23db-409e-b389-7375e7eb1c51 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:58.879639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-92d022ad-b423-4e5f-b09b-b4075cba9031 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.932668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=91,nova_api:DELETE=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:58.941655 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-92d022ad-b423-4e5f-b09b-b4075cba9031 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.067783 Oct 04 18:15:58.945019 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1710/3474] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:15:58 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:58.957581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-914621dd-fb33-4c91-bb88-ab70129f61f4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.037087 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-914621dd-fb33-4c91-bb88-ab70129f61f4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/9364f922-2ee9-4646-b912-b378b36dbba7" status: 204 len: 0 microversion: 2.1 time: 0.084851 Oct 04 18:15:59.040641 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1711/3475] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:15:58 2022] DELETE /compute/v2.1/os-server-groups/9364f922-2ee9-4646-b912-b378b36dbba7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:15:59.046940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6078108b-539f-4464-8403-00128dfcf62b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.072432 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6078108b-539f-4464-8403-00128dfcf62b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.030464 Oct 04 18:15:59.076603 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1712/3476] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:59.093277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3971cf43-b2d0-477a-98f4-08f676d77a19 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Action: 'create', calling method: .version_select at 0x7fd4d129fc10>, body: {"server_group": {"name": "tempest-server-group-1599596630", "policies": ["affinity"]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:59.137733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3971cf43-b2d0-477a-98f4-08f676d77a19 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:59.147966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3971cf43-b2d0-477a-98f4-08f676d77a19 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:59.254445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3971cf43-b2d0-477a-98f4-08f676d77a19 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:59.260798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3971cf43-b2d0-477a-98f4-08f676d77a19 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:59.287755 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3971cf43-b2d0-477a-98f4-08f676d77a19 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.202784 Oct 04 18:15:59.291184 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1713/3477] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 4 18:15:59 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:59.305354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-49be7570-1664-4fff-93a0-96eeede7b412 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2141121557", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "acd24e6c-2248-4327-9505-66fea04436b8", "destination_type": "local"}, {"source_type": "volume", "uuid": "94fde6d3-5880-41a6-a134-b742c02dec24", "destination_type": "invalid"}], "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-49be7570-1664-4fff-93a0-96eeede7b412 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 495 Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2141121557", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "acd24e6c-2248-4327-9505-66fea04436b8", "destination_type": "local"}, {"source_type": "volume", "uuid": "94fde6d3-5880-41a6-a134-b742c02dec24", "destination_type": "invalid"}], "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2141121557', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'acd24e6c-2248-4327-9505-66fea04436b8', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '94fde6d3-5880-41a6-a134-b742c02dec24', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:59.316727 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-49be7570-1664-4fff-93a0-96eeede7b412 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:59.321129 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-49be7570-1664-4fff-93a0-96eeede7b412 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.025979 Oct 04 18:15:59.328752 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1714/3478] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:59 2022] POST /compute/v2.1/servers => generated 155 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:59.335512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1714bbf1-27fe-4942-a2f8-4fabadd18d2e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1a33160>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.401344 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1714bbf1-27fe-4942-a2f8-4fabadd18d2e tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.071458 Oct 04 18:15:59.401921 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1715/3479] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:59.415491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6c02f7d2-7cd0-40c5-83a4-9fb7eac09e8c tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.469544 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6c02f7d2-7cd0-40c5-83a4-9fb7eac09e8c tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/c4327960-2ff5-4374-9770-e2c449c4541f" status: 204 len: 0 microversion: 2.1 time: 0.065682 Oct 04 18:15:59.473112 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1716/3480] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:15:59 2022] DELETE /compute/v2.1/os-server-groups/c4327960-2ff5-4374-9770-e2c449c4541f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:59.484076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d009e5e4-cfdd-4eb2-b221-7943f6a3b505 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.485716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d009e5e4-cfdd-4eb2-b221-7943f6a3b505 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.495602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d009e5e4-cfdd-4eb2-b221-7943f6a3b505 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.496347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d009e5e4-cfdd-4eb2-b221-7943f6a3b505 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.496904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d009e5e4-cfdd-4eb2-b221-7943f6a3b505 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.497732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d009e5e4-cfdd-4eb2-b221-7943f6a3b505 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.498301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d009e5e4-cfdd-4eb2-b221-7943f6a3b505 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.501516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d009e5e4-cfdd-4eb2-b221-7943f6a3b505 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.755682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d009e5e4-cfdd-4eb2-b221-7943f6a3b505 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:00.772346 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d009e5e4-cfdd-4eb2-b221-7943f6a3b505 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 1.297325 Oct 04 18:16:00.773146 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1717/3481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:00.803595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1902b8e0-2a39-43e8-867b-e6c7bf5eb015 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.834568 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1902b8e0-2a39-43e8-867b-e6c7bf5eb015 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034978 Oct 04 18:16:00.838093 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1718/3482] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:00.843499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f18c2988-7a6d-4b1e-82c4-0d943a13dd4e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.849474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f18c2988-7a6d-4b1e-82c4-0d943a13dd4e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.895799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18c2988-7a6d-4b1e-82c4-0d943a13dd4e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.899263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18c2988-7a6d-4b1e-82c4-0d943a13dd4e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.900512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18c2988-7a6d-4b1e-82c4-0d943a13dd4e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.907030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18c2988-7a6d-4b1e-82c4-0d943a13dd4e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.910536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18c2988-7a6d-4b1e-82c4-0d943a13dd4e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.911091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18c2988-7a6d-4b1e-82c4-0d943a13dd4e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.413227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:02.414759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:02.415448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:02.416137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:02.416771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:02.431474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.432873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.433691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.435219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.435880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.436557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.494303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Getting quotas for project 5abaa6b711db435abdb899420464d972. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:02.502765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Getting quotas for user 350bf584a7364c90a6b2a5a05f1cd428 and project 5abaa6b711db435abdb899420464d972. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:02.539957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:02.543528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:02.613723 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d35e2312-4307-4921-84f9-937620619d01 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.030192 Oct 04 18:16:02.621576 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1765/3483] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:02.631370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4890e7e8-0dc6-4a42-8207-54274fe1bf21 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d629d040>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:02.773509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f18c2988-7a6d-4b1e-82c4-0d943a13dd4e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:02.805477 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f18c2988-7a6d-4b1e-82c4-0d943a13dd4e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1316 microversion: 2.1 time: 1.965998 Oct 04 18:16:02.810418 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1719/3484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1316 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:02.825550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-459fc9ad-d7e6-401b-b0c9-1b86f9e8e68a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:02.828129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-459fc9ad-d7e6-401b-b0c9-1b86f9e8e68a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:02.845867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-459fc9ad-d7e6-401b-b0c9-1b86f9e8e68a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.846473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-459fc9ad-d7e6-401b-b0c9-1b86f9e8e68a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.847329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-459fc9ad-d7e6-401b-b0c9-1b86f9e8e68a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.854716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-459fc9ad-d7e6-401b-b0c9-1b86f9e8e68a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.856075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-459fc9ad-d7e6-401b-b0c9-1b86f9e8e68a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.856751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-459fc9ad-d7e6-401b-b0c9-1b86f9e8e68a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.144792 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4890e7e8-0dc6-4a42-8207-54274fe1bf21 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.521753 Oct 04 18:16:03.150073 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1766/3485] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:02 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:03.155675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d253efe2-8521-46db-998b-bfe32e04c0de tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Action: 'create', calling method: .version_select at 0x7fd4d6122550>, body: {"server_group": {"name": "tempest-server-group-1948968245", "policies": ["anti-affinity"]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:03.215572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d253efe2-8521-46db-998b-bfe32e04c0de tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:03.222452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d253efe2-8521-46db-998b-bfe32e04c0de tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:03.296843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d253efe2-8521-46db-998b-bfe32e04c0de tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:03.305074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d253efe2-8521-46db-998b-bfe32e04c0de tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:03.326765 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d253efe2-8521-46db-998b-bfe32e04c0de tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.173907 Oct 04 18:16:03.328720 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1767/3486] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 4 18:16:03 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:03.335204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1292051734", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "dfea8358-1b16-486b-a9cd-090dc5580bc2"}], "security_groups": [{"name": "tempest-securitygroup--1407982607"}], "key_name": "tempest-keypair-1171675951", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:03.735334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-459fc9ad-d7e6-401b-b0c9-1b86f9e8e68a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:03.749808 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-459fc9ad-d7e6-401b-b0c9-1b86f9e8e68a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.936225 Oct 04 18:16:03.752734 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1720/3487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:02 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:03.758515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f44d410d-8f6b-4d62-b0ac-27848299ea0a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.759524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f44d410d-8f6b-4d62-b0ac-27848299ea0a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.767567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f44d410d-8f6b-4d62-b0ac-27848299ea0a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.768573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f44d410d-8f6b-4d62-b0ac-27848299ea0a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.769375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f44d410d-8f6b-4d62-b0ac-27848299ea0a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.770389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f44d410d-8f6b-4d62-b0ac-27848299ea0a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.773176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f44d410d-8f6b-4d62-b0ac-27848299ea0a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.773890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f44d410d-8f6b-4d62-b0ac-27848299ea0a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.005183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f44d410d-8f6b-4d62-b0ac-27848299ea0a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.013599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:04.024082 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f44d410d-8f6b-4d62-b0ac-27848299ea0a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1214 microversion: 2.1 time: 0.269914 Oct 04 18:16:04.026258 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1721/3488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1214 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:04.031000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] validate_networks() for [('dfea8358-1b16-486b-a9cd-090dc5580bc2', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:04.033889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d621fb6-3e7d-46de-a6c0-1b83500f4750 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.076888 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4d621fb6-3e7d-46de-a6c0-1b83500f4750 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/de81bb63-3d5b-40e3-bf55-8f4ce590c898" status: 204 len: 0 microversion: 2.1 time: 0.048901 Oct 04 18:16:04.077759 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1722/3489] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:16:04 2022] DELETE /compute/v2.1/os-server-groups/de81bb63-3d5b-40e3-bf55-8f4ce590c898 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:04.083781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ccbc6bc1-d02d-4c27-9316-21fa15f22129 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.084684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ccbc6bc1-d02d-4c27-9316-21fa15f22129 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.096345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccbc6bc1-d02d-4c27-9316-21fa15f22129 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.097273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccbc6bc1-d02d-4c27-9316-21fa15f22129 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.097965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccbc6bc1-d02d-4c27-9316-21fa15f22129 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.098914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccbc6bc1-d02d-4c27-9316-21fa15f22129 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.099807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccbc6bc1-d02d-4c27-9316-21fa15f22129 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.100403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccbc6bc1-d02d-4c27-9316-21fa15f22129 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.770902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ccbc6bc1-d02d-4c27-9316-21fa15f22129 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.793576 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ccbc6bc1-d02d-4c27-9316-21fa15f22129 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1316 microversion: 2.1 time: 0.704951 Oct 04 18:16:04.794231 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1723/3490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1316 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:04.816093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f53edeeb-98d1-44be-a87e-b0efc05e0442 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1487143963", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f53edeeb-98d1-44be-a87e-b0efc05e0442 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 492 Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1487143963", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1487143963', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.824763 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:16:04.828341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:04.838478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f53edeeb-98d1-44be-a87e-b0efc05e0442 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:04.852535 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f53edeeb-98d1-44be-a87e-b0efc05e0442 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.045188 Oct 04 18:16:04.860161 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1724/3491] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:04 2022] POST /compute/v2.1/servers => generated 624 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:16:04.878525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a81261e4-70e5-4c5b-806d-896936d17b9e tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.944186 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a81261e4-70e5-4c5b-806d-896936d17b9e tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.082880 Oct 04 18:16:04.945063 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1725/3492] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:04.991795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9e452047-ef98-46b4-bfdd-800ea833d0ec tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12b2310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:05.077123 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9e452047-ef98-46b4-bfdd-800ea833d0ec tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.130278 Oct 04 18:16:05.078335 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1726/3493] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:05.092239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7a546eeb-bb43-444c-a8ed-e6862f2825a4 req-3464c374-564b-4c24-8ef9-80978dabcad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10872fe-cae9-4db2-88f6-57c26d1eff0a", "name": "network-vif-deleted", "tag": "c1fb397a-a183-497c-adcf-34f0bcdaeecb"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:05.104031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7a546eeb-bb43-444c-a8ed-e6862f2825a4 req-3464c374-564b-4c24-8ef9-80978dabcad1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.105455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7a546eeb-bb43-444c-a8ed-e6862f2825a4 req-3464c374-564b-4c24-8ef9-80978dabcad1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.106270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7a546eeb-bb43-444c-a8ed-e6862f2825a4 req-3464c374-564b-4c24-8ef9-80978dabcad1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.124305 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7a546eeb-bb43-444c-a8ed-e6862f2825a4 req-3464c374-564b-4c24-8ef9-80978dabcad1 service nova] Creating event network-vif-deleted:c1fb397a-a183-497c-adcf-34f0bcdaeecb for instance e10872fe-cae9-4db2-88f6-57c26d1eff0a on n-h1-850499-14 Oct 04 18:16:05.134513 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7a546eeb-bb43-444c-a8ed-e6862f2825a4 req-3464c374-564b-4c24-8ef9-80978dabcad1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051139 Oct 04 18:16:05.136671 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1727/3494] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:05.148109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36a67356-493c-4fe4-b159-a02e979e07b4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:05.150052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-36a67356-493c-4fe4-b159-a02e979e07b4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.163187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36a67356-493c-4fe4-b159-a02e979e07b4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.168244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36a67356-493c-4fe4-b159-a02e979e07b4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.168886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36a67356-493c-4fe4-b159-a02e979e07b4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.171368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36a67356-493c-4fe4-b159-a02e979e07b4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.172637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36a67356-493c-4fe4-b159-a02e979e07b4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.174152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36a67356-493c-4fe4-b159-a02e979e07b4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.708956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Getting quotas for project 109bbd6392bb4b0faa917253bd5338be. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:05.716686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Getting quotas for user 4f568ffc40c84b99b5439533aeaec9e3 and project 109bbd6392bb4b0faa917253bd5338be. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:05.750970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:05.755773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:05.756554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:05.757137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:05.759188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:05.766838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:05.785936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.786796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.787417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.788519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.789128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.789712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.819561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Getting quotas for project 109bbd6392bb4b0faa917253bd5338be. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:05.825288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Getting quotas for user 4f568ffc40c84b99b5439533aeaec9e3 and project 109bbd6392bb4b0faa917253bd5338be. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:05.841315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:05.844438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:05.879802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-36a67356-493c-4fe4-b159-a02e979e07b4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:05.896556 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-36a67356-493c-4fe4-b159-a02e979e07b4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.755118 Oct 04 18:16:05.914430 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1728/3495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:05 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:05.924311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b0eedcb0-b565-434d-9179-9d81ca11d6a0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:05.925203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b0eedcb0-b565-434d-9179-9d81ca11d6a0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.932941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0eedcb0-b565-434d-9179-9d81ca11d6a0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.933765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0eedcb0-b565-434d-9179-9d81ca11d6a0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.934431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0eedcb0-b565-434d-9179-9d81ca11d6a0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.937204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0eedcb0-b565-434d-9179-9d81ca11d6a0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.937900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0eedcb0-b565-434d-9179-9d81ca11d6a0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.941119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0eedcb0-b565-434d-9179-9d81ca11d6a0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.993515 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8300f77f-4ea4-43b3-a90a-513901466444 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.657847 Oct 04 18:16:05.994581 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1768/3496] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:03 2022] POST /compute/v2.1/servers => generated 407 bytes in 2665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:06.007229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1389780719", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "65f8f7eb-a1c7-4ef7-8654-d16ce4c3d2da"}]}, "os:scheduler_hints": {"group": "45ff0e51-e5ab-46c5-a91a-04352ba67efb"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:06.116272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] validate_networks() for [('65f8f7eb-a1c7-4ef7-8654-d16ce4c3d2da', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:06.545404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0eedcb0-b565-434d-9179-9d81ca11d6a0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:06.554984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b0eedcb0-b565-434d-9179-9d81ca11d6a0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1318 microversion: 2.1 time: 0.638222 Oct 04 18:16:06.568051 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1729/3497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:05 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:06.584105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c25b8647-0f8f-49cc-b258-97d7029c55c2 req-45b91ba5-4389-4b16-b302-ff9a9900b69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d", "name": "network-vif-plugged", "status": "completed", "tag": "ef6e1b3d-27ec-415e-8f37-f620c17d81ce"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:06.595885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c25b8647-0f8f-49cc-b258-97d7029c55c2 req-45b91ba5-4389-4b16-b302-ff9a9900b69d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.596412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c25b8647-0f8f-49cc-b258-97d7029c55c2 req-45b91ba5-4389-4b16-b302-ff9a9900b69d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.597587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c25b8647-0f8f-49cc-b258-97d7029c55c2 req-45b91ba5-4389-4b16-b302-ff9a9900b69d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.636489 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c25b8647-0f8f-49cc-b258-97d7029c55c2 req-45b91ba5-4389-4b16-b302-ff9a9900b69d service nova] Creating event network-vif-plugged:ef6e1b3d-27ec-415e-8f37-f620c17d81ce for instance c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d on n-h2-850499-14 Oct 04 18:16:06.649224 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c25b8647-0f8f-49cc-b258-97d7029c55c2 req-45b91ba5-4389-4b16-b302-ff9a9900b69d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074541 Oct 04 18:16:06.650854 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1730/3498] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:06.664508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f8ccbe8-de35-4cc3-910f-d3c9efe2e4d2 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.667442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f8ccbe8-de35-4cc3-910f-d3c9efe2e4d2 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.680694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8ccbe8-de35-4cc3-910f-d3c9efe2e4d2 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.687018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8ccbe8-de35-4cc3-910f-d3c9efe2e4d2 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.687618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8ccbe8-de35-4cc3-910f-d3c9efe2e4d2 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.688438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8ccbe8-de35-4cc3-910f-d3c9efe2e4d2 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.691489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8ccbe8-de35-4cc3-910f-d3c9efe2e4d2 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.692226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8ccbe8-de35-4cc3-910f-d3c9efe2e4d2 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.864123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f8ccbe8-de35-4cc3-910f-d3c9efe2e4d2 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:07.875402 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f8ccbe8-de35-4cc3-910f-d3c9efe2e4d2 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1316 microversion: 2.1 time: 1.221392 Oct 04 18:16:07.891261 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1731/3499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:06 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1316 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:07.899323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fb0e7f66-6915-4a34-b022-8f9ba8a52d88 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.901477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb0e7f66-6915-4a34-b022-8f9ba8a52d88 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.909126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb0e7f66-6915-4a34-b022-8f9ba8a52d88 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.910018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb0e7f66-6915-4a34-b022-8f9ba8a52d88 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.910549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb0e7f66-6915-4a34-b022-8f9ba8a52d88 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.911890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb0e7f66-6915-4a34-b022-8f9ba8a52d88 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.913271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb0e7f66-6915-4a34-b022-8f9ba8a52d88 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.913778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb0e7f66-6915-4a34-b022-8f9ba8a52d88 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.268637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:08.269654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:08.270551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:08.271567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:08.274644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:08.316018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.316810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.317257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.318025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.318492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.318925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.338086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:08.343750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:08.366113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:08.369594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:08.422312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fb0e7f66-6915-4a34-b022-8f9ba8a52d88 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:08.445001 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fb0e7f66-6915-4a34-b022-8f9ba8a52d88 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.550243 Oct 04 18:16:08.446358 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1732/3500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:07 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.470019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:08.475125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-266dd4e8-e057-4370-8ee8-3e2c6da43a7e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.478246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-266dd4e8-e057-4370-8ee8-3e2c6da43a7e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.485948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-266dd4e8-e057-4370-8ee8-3e2c6da43a7e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.486832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-266dd4e8-e057-4370-8ee8-3e2c6da43a7e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.487689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-266dd4e8-e057-4370-8ee8-3e2c6da43a7e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.489687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-266dd4e8-e057-4370-8ee8-3e2c6da43a7e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.490507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-266dd4e8-e057-4370-8ee8-3e2c6da43a7e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.491208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-266dd4e8-e057-4370-8ee8-3e2c6da43a7e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.496274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:08.622739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:08.628792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Getting quotas for user 6f8977eddab04eefa1d85012926d6aa1 and project 14da52f910ca4b3fa2fa2ae34580a2d2. Resources: {'server_group_members'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:08.663651 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67bc2a43-4ba0-40ac-9b3e-23b6408736d1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.660410 Oct 04 18:16:08.664622 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1769/3501] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:08.681048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7af79555-f480-41b2-918a-1572c29292de tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12e0280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.729723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-266dd4e8-e057-4370-8ee8-3e2c6da43a7e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:08.737626 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-266dd4e8-e057-4370-8ee8-3e2c6da43a7e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1328 microversion: 2.1 time: 0.268744 Oct 04 18:16:08.739252 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7af79555-f480-41b2-918a-1572c29292de tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.073393 Oct 04 18:16:08.740465 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1770/3502] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.744198 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1733/3503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1328 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.745706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5a468414-3081-4146-92d2-845ed459f69c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.746494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5a468414-3081-4146-92d2-845ed459f69c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.749338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-842e136c-0ccf-433b-a90f-015a09fa2963 req-50fb43cd-fc3c-47ba-bbfa-787c04f33988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671406ce-ae77-441a-9e07-3d054c34c4f5", "tag": "f2bffad7-9c35-4420-bb47-a7b54db456ad"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:08.753688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a468414-3081-4146-92d2-845ed459f69c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.754649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a468414-3081-4146-92d2-845ed459f69c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.755297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a468414-3081-4146-92d2-845ed459f69c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.756201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a468414-3081-4146-92d2-845ed459f69c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.756823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a468414-3081-4146-92d2-845ed459f69c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.757421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a468414-3081-4146-92d2-845ed459f69c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.775861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-842e136c-0ccf-433b-a90f-015a09fa2963 req-50fb43cd-fc3c-47ba-bbfa-787c04f33988 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.779411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-842e136c-0ccf-433b-a90f-015a09fa2963 req-50fb43cd-fc3c-47ba-bbfa-787c04f33988 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.779411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-842e136c-0ccf-433b-a90f-015a09fa2963 req-50fb43cd-fc3c-47ba-bbfa-787c04f33988 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.804069 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-842e136c-0ccf-433b-a90f-015a09fa2963 req-50fb43cd-fc3c-47ba-bbfa-787c04f33988 service nova] Creating event network-changed:f2bffad7-9c35-4420-bb47-a7b54db456ad for instance 671406ce-ae77-441a-9e07-3d054c34c4f5 on n-h2-850499-14 Oct 04 18:16:08.818240 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-842e136c-0ccf-433b-a90f-015a09fa2963 req-50fb43cd-fc3c-47ba-bbfa-787c04f33988 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072703 Oct 04 18:16:08.818872 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1734/3504] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:08.825663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d5cc4a3-837d-45f3-b0ef-61a6cc41ec21 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d5cc4a3-837d-45f3-b0ef-61a6cc41ec21 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 416 Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.832794 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:16:08.836539 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:08.846977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d5cc4a3-837d-45f3-b0ef-61a6cc41ec21 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:08.848194 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9d5cc4a3-837d-45f3-b0ef-61a6cc41ec21 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.028004 Oct 04 18:16:08.852286 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1735/3505] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:08 2022] POST /compute/v2.1/servers => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:16:08.860087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-28d12fab-8355-4504-941c-0c1f84b0ba2d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.865605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-28d12fab-8355-4504-941c-0c1f84b0ba2d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.005620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-28d12fab-8355-4504-941c-0c1f84b0ba2d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.013105 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-28d12fab-8355-4504-941c-0c1f84b0ba2d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1213 microversion: 2.1 time: 0.156928 Oct 04 18:16:09.027528 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1736/3506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1213 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:09.042318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b84ff421-1d91-4526-bc5f-ab0903824db5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.045178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b84ff421-1d91-4526-bc5f-ab0903824db5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.060745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b84ff421-1d91-4526-bc5f-ab0903824db5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.072014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b84ff421-1d91-4526-bc5f-ab0903824db5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.072586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b84ff421-1d91-4526-bc5f-ab0903824db5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.085115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b84ff421-1d91-4526-bc5f-ab0903824db5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.085635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b84ff421-1d91-4526-bc5f-ab0903824db5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.086119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b84ff421-1d91-4526-bc5f-ab0903824db5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.580268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5a468414-3081-4146-92d2-845ed459f69c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.590187 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5a468414-3081-4146-92d2-845ed459f69c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1318 microversion: 2.1 time: 0.848489 Oct 04 18:16:09.595736 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1771/3507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1318 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:09.612913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-55c8f604-c4c8-4b9c-8a11-fd982ec4b021 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.613802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-55c8f604-c4c8-4b9c-8a11-fd982ec4b021 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.629472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55c8f604-c4c8-4b9c-8a11-fd982ec4b021 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.630254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55c8f604-c4c8-4b9c-8a11-fd982ec4b021 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.630862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55c8f604-c4c8-4b9c-8a11-fd982ec4b021 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.631995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55c8f604-c4c8-4b9c-8a11-fd982ec4b021 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.632641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55c8f604-c4c8-4b9c-8a11-fd982ec4b021 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.633246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55c8f604-c4c8-4b9c-8a11-fd982ec4b021 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.792708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b84ff421-1d91-4526-bc5f-ab0903824db5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.814195 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b84ff421-1d91-4526-bc5f-ab0903824db5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.778369 Oct 04 18:16:09.815283 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1737/3508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:09.820173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-30f1dc2b-e8ea-4818-9635-bd3387b36ec5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d125b430>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.914625 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-30f1dc2b-e8ea-4818-9635-bd3387b36ec5 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.097938 Oct 04 18:16:09.916060 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1738/3509] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:09.927817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1cbfa735-a942-4db5-90cc-7776c31184c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.928665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1cbfa735-a942-4db5-90cc-7776c31184c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.935850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cbfa735-a942-4db5-90cc-7776c31184c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.936789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cbfa735-a942-4db5-90cc-7776c31184c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.937698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cbfa735-a942-4db5-90cc-7776c31184c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.938653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cbfa735-a942-4db5-90cc-7776c31184c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.939371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cbfa735-a942-4db5-90cc-7776c31184c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.940025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cbfa735-a942-4db5-90cc-7776c31184c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.243291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1cbfa735-a942-4db5-90cc-7776c31184c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.255352 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1cbfa735-a942-4db5-90cc-7776c31184c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1328 microversion: 2.1 time: 0.337339 Oct 04 18:16:10.256192 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1739/3510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1328 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:10.262073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f4d788d-f9b1-410b-b53f-02e1bb6af78b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.265799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0f4d788d-f9b1-410b-b53f-02e1bb6af78b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.302395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4d788d-f9b1-410b-b53f-02e1bb6af78b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.303231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4d788d-f9b1-410b-b53f-02e1bb6af78b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.306579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4d788d-f9b1-410b-b53f-02e1bb6af78b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.312205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-55c8f604-c4c8-4b9c-8a11-fd982ec4b021 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.326192 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-55c8f604-c4c8-4b9c-8a11-fd982ec4b021 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1504 microversion: 2.1 time: 0.727707 Oct 04 18:16:10.326992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1772/3511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1504 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:10.332945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4d788d-f9b1-410b-b53f-02e1bb6af78b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.333737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4d788d-f9b1-410b-b53f-02e1bb6af78b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.334916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4d788d-f9b1-410b-b53f-02e1bb6af78b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.339015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce15c623-c568-4745-8ae1-c4dc32e0a791 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.339962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ce15c623-c568-4745-8ae1-c4dc32e0a791 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.353217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce15c623-c568-4745-8ae1-c4dc32e0a791 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.353778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce15c623-c568-4745-8ae1-c4dc32e0a791 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.354330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce15c623-c568-4745-8ae1-c4dc32e0a791 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.359016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce15c623-c568-4745-8ae1-c4dc32e0a791 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.359697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce15c623-c568-4745-8ae1-c4dc32e0a791 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.360265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce15c623-c568-4745-8ae1-c4dc32e0a791 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.464561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ce15c623-c568-4745-8ae1-c4dc32e0a791 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.474335 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ce15c623-c568-4745-8ae1-c4dc32e0a791 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1265 microversion: 2.1 time: 0.146157 Oct 04 18:16:10.480399 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1773/3512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:10.489541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-462fe453-5ce5-45c8-8584-c45a5a97fd51 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.490088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-462fe453-5ce5-45c8-8584-c45a5a97fd51 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.509429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-462fe453-5ce5-45c8-8584-c45a5a97fd51 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.510425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-462fe453-5ce5-45c8-8584-c45a5a97fd51 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.510883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-462fe453-5ce5-45c8-8584-c45a5a97fd51 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.511885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-462fe453-5ce5-45c8-8584-c45a5a97fd51 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.512674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-462fe453-5ce5-45c8-8584-c45a5a97fd51 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.513306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-462fe453-5ce5-45c8-8584-c45a5a97fd51 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.606807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-462fe453-5ce5-45c8-8584-c45a5a97fd51 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.610445 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-462fe453-5ce5-45c8-8584-c45a5a97fd51 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d/os-instance-actions/req-a76b8cf7-432b-4130-a876-8a7b4fb50101" status: 200 len: 313 microversion: 2.1 time: 0.125975 Oct 04 18:16:10.623040 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1774/3513] 10.222.0.18 () {58 vars in 1419 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d/os-instance-actions/req-a76b8cf7-432b-4130-a876-8a7b4fb50101 => generated 313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:10.639306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a33cb37-2bb1-4f36-a290-c5370be4a2b6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.640930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a33cb37-2bb1-4f36-a290-c5370be4a2b6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.649837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a33cb37-2bb1-4f36-a290-c5370be4a2b6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.651613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a33cb37-2bb1-4f36-a290-c5370be4a2b6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.652576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a33cb37-2bb1-4f36-a290-c5370be4a2b6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.653639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a33cb37-2bb1-4f36-a290-c5370be4a2b6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.654312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a33cb37-2bb1-4f36-a290-c5370be4a2b6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.655031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a33cb37-2bb1-4f36-a290-c5370be4a2b6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.661705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:10.851004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0f4d788d-f9b1-410b-b53f-02e1bb6af78b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.860436 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0f4d788d-f9b1-410b-b53f-02e1bb6af78b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.602880 Oct 04 18:16:10.866781 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1740/3514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:10.875033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf0944be-72b4-4841-b400-8a43414be57f tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:10.877870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf0944be-72b4-4841-b400-8a43414be57f tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.894064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf0944be-72b4-4841-b400-8a43414be57f tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.894864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf0944be-72b4-4841-b400-8a43414be57f tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.895513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf0944be-72b4-4841-b400-8a43414be57f tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.897356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf0944be-72b4-4841-b400-8a43414be57f tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.898002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf0944be-72b4-4841-b400-8a43414be57f tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.902503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf0944be-72b4-4841-b400-8a43414be57f tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.087005 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf0944be-72b4-4841-b400-8a43414be57f tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "POST /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d/action" status: 202 len: 0 microversion: 2.1 time: 0.218467 Oct 04 18:16:11.088078 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1741/3515] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:10 2022] POST /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:11.098309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-23b3c2e5-ce38-4117-b039-0dfa20e1474c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1255d30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.159913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a33cb37-2bb1-4f36-a290-c5370be4a2b6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:11.168739 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a33cb37-2bb1-4f36-a290-c5370be4a2b6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1318 microversion: 2.1 time: 0.544487 Oct 04 18:16:11.189335 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1775/3516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:11.189335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de34bedc-5ab5-4a0d-9e6a-a31dfe11522d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-258688678", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": -1, "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:11.201801 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-23b3c2e5-ce38-4117-b039-0dfa20e1474c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.112221 Oct 04 18:16:11.206482 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1742/3517] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:11.213493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d73417c-dcab-4b9b-aed6-8bfe43b077e3 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.221528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8d73417c-dcab-4b9b-aed6-8bfe43b077e3 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:11.224767 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-de34bedc-5ab5-4a0d-9e6a-a31dfe11522d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de34bedc-5ab5-4a0d-9e6a-a31dfe11522d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 205 Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-258688678", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": -1, "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: exception: Flavor -1 could not be found. Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-258688678', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': -1, 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:11.228263 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 18:16:11.233720 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:11.235789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de34bedc-5ab5-4a0d-9e6a-a31dfe11522d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:11.236337 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de34bedc-5ab5-4a0d-9e6a-a31dfe11522d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.060470 Oct 04 18:16:11.237049 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1776/3518] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:11 2022] POST /compute/v2.1/servers => generated 73 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:16:11.251895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d73417c-dcab-4b9b-aed6-8bfe43b077e3 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.252442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d73417c-dcab-4b9b-aed6-8bfe43b077e3 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.252713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f68525a-4c22-4622-aabf-a12758f32d0a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.253706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4f68525a-4c22-4622-aabf-a12758f32d0a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:11.253990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d73417c-dcab-4b9b-aed6-8bfe43b077e3 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.254755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d73417c-dcab-4b9b-aed6-8bfe43b077e3 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.256362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d73417c-dcab-4b9b-aed6-8bfe43b077e3 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.258195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d73417c-dcab-4b9b-aed6-8bfe43b077e3 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.262494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f68525a-4c22-4622-aabf-a12758f32d0a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.265065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f68525a-4c22-4622-aabf-a12758f32d0a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.267600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f68525a-4c22-4622-aabf-a12758f32d0a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.268686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f68525a-4c22-4622-aabf-a12758f32d0a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.269401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f68525a-4c22-4622-aabf-a12758f32d0a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.270074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f68525a-4c22-4622-aabf-a12758f32d0a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.973041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4f68525a-4c22-4622-aabf-a12758f32d0a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:11.982910 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f68525a-4c22-4622-aabf-a12758f32d0a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.740700 Oct 04 18:16:11.986205 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1777/3519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:11.995147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97d57e7c-c179-4a6e-b25b-4c1232d11e5d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.999412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-97d57e7c-c179-4a6e-b25b-4c1232d11e5d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:12.015817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97d57e7c-c179-4a6e-b25b-4c1232d11e5d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.017917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97d57e7c-c179-4a6e-b25b-4c1232d11e5d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.018655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97d57e7c-c179-4a6e-b25b-4c1232d11e5d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.022052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97d57e7c-c179-4a6e-b25b-4c1232d11e5d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.022773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97d57e7c-c179-4a6e-b25b-4c1232d11e5d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.025630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97d57e7c-c179-4a6e-b25b-4c1232d11e5d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.124741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d73417c-dcab-4b9b-aed6-8bfe43b077e3 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.133367 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8d73417c-dcab-4b9b-aed6-8bfe43b077e3 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1506 microversion: 2.1 time: 0.925197 Oct 04 18:16:12.137791 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1743/3520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1506 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:12.145158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cfed8846-0ca0-42fa-8b71-26dd12d381ee tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:12.148549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cfed8846-0ca0-42fa-8b71-26dd12d381ee tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:12.161886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfed8846-0ca0-42fa-8b71-26dd12d381ee tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.163407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfed8846-0ca0-42fa-8b71-26dd12d381ee tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.167563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfed8846-0ca0-42fa-8b71-26dd12d381ee tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.168571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfed8846-0ca0-42fa-8b71-26dd12d381ee tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.169611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfed8846-0ca0-42fa-8b71-26dd12d381ee tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.171680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfed8846-0ca0-42fa-8b71-26dd12d381ee tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.367156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cfed8846-0ca0-42fa-8b71-26dd12d381ee tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.387050 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cfed8846-0ca0-42fa-8b71-26dd12d381ee tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1271 microversion: 2.1 time: 0.247722 Oct 04 18:16:12.388428 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1744/3521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:12 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:12.393708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-28fb50d7-22ac-41ae-8b4e-d002db449743 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:12.395233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-28fb50d7-22ac-41ae-8b4e-d002db449743 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:12.417000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=9,nova_api:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:12.420690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28fb50d7-22ac-41ae-8b4e-d002db449743 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.421482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28fb50d7-22ac-41ae-8b4e-d002db449743 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.421877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-97d57e7c-c179-4a6e-b25b-4c1232d11e5d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.422453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28fb50d7-22ac-41ae-8b4e-d002db449743 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.423456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28fb50d7-22ac-41ae-8b4e-d002db449743 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.427365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28fb50d7-22ac-41ae-8b4e-d002db449743 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.428152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28fb50d7-22ac-41ae-8b4e-d002db449743 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.438636 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-97d57e7c-c179-4a6e-b25b-4c1232d11e5d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.444529 Oct 04 18:16:12.439819 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1778/3522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:12.454077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6cecd34c-47e4-4fb1-923e-981bf69e1c87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:12.454999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6cecd34c-47e4-4fb1-923e-981bf69e1c87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:12.476661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cecd34c-47e4-4fb1-923e-981bf69e1c87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.477521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cecd34c-47e4-4fb1-923e-981bf69e1c87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.478231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cecd34c-47e4-4fb1-923e-981bf69e1c87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.479373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cecd34c-47e4-4fb1-923e-981bf69e1c87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.480074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cecd34c-47e4-4fb1-923e-981bf69e1c87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.480675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cecd34c-47e4-4fb1-923e-981bf69e1c87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.005937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-28fb50d7-22ac-41ae-8b4e-d002db449743 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.009790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6cecd34c-47e4-4fb1-923e-981bf69e1c87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.026689 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-28fb50d7-22ac-41ae-8b4e-d002db449743 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.636459 Oct 04 18:16:13.027196 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6cecd34c-47e4-4fb1-923e-981bf69e1c87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1318 microversion: 2.1 time: 0.584367 Oct 04 18:16:13.028680 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1745/3523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:12 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.035895 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1779/3524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:12 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.039810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4f73f96e-9cf8-4f76-8bd7-90ecb9e2e7e2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1315f70>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.129184 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4f73f96e-9cf8-4f76-8bd7-90ecb9e2e7e2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.098634 Oct 04 18:16:13.130274 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1746/3525] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.163912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cebbfb58-1059-4743-9ddb-de85821359ad tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.165007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cebbfb58-1059-4743-9ddb-de85821359ad tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.186662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cebbfb58-1059-4743-9ddb-de85821359ad tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.192500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cebbfb58-1059-4743-9ddb-de85821359ad tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.192500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cebbfb58-1059-4743-9ddb-de85821359ad tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.192500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cebbfb58-1059-4743-9ddb-de85821359ad tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.192500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cebbfb58-1059-4743-9ddb-de85821359ad tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.192500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cebbfb58-1059-4743-9ddb-de85821359ad tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.198291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01fdeb3b-5736-42e8-a863-fea8eaa5d235 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-500640205", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01fdeb3b-5736-42e8-a863-fea8eaa5d235 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 172 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-500640205", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-500640205', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi -1 Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:16:13.203581 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:16:13.208677 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:13.211677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01fdeb3b-5736-42e8-a863-fea8eaa5d235 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:13.213743 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01fdeb3b-5736-42e8-a863-fea8eaa5d235 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.019035 Oct 04 18:16:13.216313 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1747/3526] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:13 2022] POST /compute/v2.1/servers => generated 145 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:16:13.224692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-691a0e08-fe88-484d-8e1c-cef62556ef62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.225332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-691a0e08-fe88-484d-8e1c-cef62556ef62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.251918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691a0e08-fe88-484d-8e1c-cef62556ef62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.252427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691a0e08-fe88-484d-8e1c-cef62556ef62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.259670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691a0e08-fe88-484d-8e1c-cef62556ef62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.260706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691a0e08-fe88-484d-8e1c-cef62556ef62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.261383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691a0e08-fe88-484d-8e1c-cef62556ef62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.262264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-691a0e08-fe88-484d-8e1c-cef62556ef62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.724172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cebbfb58-1059-4743-9ddb-de85821359ad tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.734902 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cebbfb58-1059-4743-9ddb-de85821359ad tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1506 microversion: 2.1 time: 0.575711 Oct 04 18:16:13.741449 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1780/3527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.743099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-691a0e08-fe88-484d-8e1c-cef62556ef62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.755458 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-691a0e08-fe88-484d-8e1c-cef62556ef62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.535214 Oct 04 18:16:13.760045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eda4e856-5ab3-43b4-9b31-bd5c9230ae5d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.760922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eda4e856-5ab3-43b4-9b31-bd5c9230ae5d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.767319 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1748/3528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.770746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda4e856-5ab3-43b4-9b31-bd5c9230ae5d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.771472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda4e856-5ab3-43b4-9b31-bd5c9230ae5d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.772110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda4e856-5ab3-43b4-9b31-bd5c9230ae5d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.772988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda4e856-5ab3-43b4-9b31-bd5c9230ae5d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.775517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda4e856-5ab3-43b4-9b31-bd5c9230ae5d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.776170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda4e856-5ab3-43b4-9b31-bd5c9230ae5d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.779788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-764e2807-531f-4fe7-8657-f66ad1e7a325 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.780731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-764e2807-531f-4fe7-8657-f66ad1e7a325 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.787415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764e2807-531f-4fe7-8657-f66ad1e7a325 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.788169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764e2807-531f-4fe7-8657-f66ad1e7a325 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.788800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764e2807-531f-4fe7-8657-f66ad1e7a325 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.789706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764e2807-531f-4fe7-8657-f66ad1e7a325 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.790352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764e2807-531f-4fe7-8657-f66ad1e7a325 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.790976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-764e2807-531f-4fe7-8657-f66ad1e7a325 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.812009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:14.323989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-764e2807-531f-4fe7-8657-f66ad1e7a325 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.334555 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-764e2807-531f-4fe7-8657-f66ad1e7a325 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.566061 Oct 04 18:16:14.340100 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1749/3529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:14.345058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eb77ecd2-8436-47f0-8766-73ca24ca32d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.360644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eb77ecd2-8436-47f0-8766-73ca24ca32d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.367381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb77ecd2-8436-47f0-8766-73ca24ca32d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.368165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb77ecd2-8436-47f0-8766-73ca24ca32d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.368382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb77ecd2-8436-47f0-8766-73ca24ca32d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.369135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb77ecd2-8436-47f0-8766-73ca24ca32d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.369677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb77ecd2-8436-47f0-8766-73ca24ca32d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.375691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb77ecd2-8436-47f0-8766-73ca24ca32d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.377514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eda4e856-5ab3-43b4-9b31-bd5c9230ae5d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.385992 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eda4e856-5ab3-43b4-9b31-bd5c9230ae5d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1313 microversion: 2.1 time: 0.643242 Oct 04 18:16:14.390714 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1781/3530] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:14.406290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f527339e-c73e-4f86-9a35-ac84ecd7a922 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.407241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f527339e-c73e-4f86-9a35-ac84ecd7a922 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.416073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f527339e-c73e-4f86-9a35-ac84ecd7a922 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.416752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f527339e-c73e-4f86-9a35-ac84ecd7a922 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.417356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f527339e-c73e-4f86-9a35-ac84ecd7a922 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.418279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f527339e-c73e-4f86-9a35-ac84ecd7a922 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.418901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f527339e-c73e-4f86-9a35-ac84ecd7a922 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.419647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f527339e-c73e-4f86-9a35-ac84ecd7a922 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.002085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f527339e-c73e-4f86-9a35-ac84ecd7a922 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.016737 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f527339e-c73e-4f86-9a35-ac84ecd7a922 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1318 microversion: 2.1 time: 0.623397 Oct 04 18:16:15.019882 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1782/3531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:15.031868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-93e23bdb-7faa-4acf-898d-07bd14f61b53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12c78b0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.037526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eb77ecd2-8436-47f0-8766-73ca24ca32d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.051957 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eb77ecd2-8436-47f0-8766-73ca24ca32d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.709819 Oct 04 18:16:15.088052 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1750/3532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:15.109664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c3a4ec0-01ca-487d-8ae2-c879e6041d75 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.119561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3c3a4ec0-01ca-487d-8ae2-c879e6041d75 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.124516 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-93e23bdb-7faa-4acf-898d-07bd14f61b53 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.102142 Oct 04 18:16:15.126875 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1783/3533] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:15.153472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c3a4ec0-01ca-487d-8ae2-c879e6041d75 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.158938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c3a4ec0-01ca-487d-8ae2-c879e6041d75 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.163691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c3a4ec0-01ca-487d-8ae2-c879e6041d75 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.165516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c3a4ec0-01ca-487d-8ae2-c879e6041d75 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.169588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c3a4ec0-01ca-487d-8ae2-c879e6041d75 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.170329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c3a4ec0-01ca-487d-8ae2-c879e6041d75 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.362937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a6516129-30ad-461f-9545-e937df41f307 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1080162826", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:15.385971 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-a6516129-30ad-461f-9545-e937df41f307 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a6516129-30ad-461f-9545-e937df41f307 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 216 Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1080162826", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1080162826', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:15.394088 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.398911 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:15.398911 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:15.398911 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:15.398911 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:15.398911 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:15.398911 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:16:15.398911 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:15.402625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a6516129-30ad-461f-9545-e937df41f307 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:15.406564 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a6516129-30ad-461f-9545-e937df41f307 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.053654 Oct 04 18:16:15.408157 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1784/3534] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:15 2022] POST /compute/v2.1/servers => generated 123 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:16:15.425643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f3535891-0050-4c8d-9cfd-b3ddeb4e9203 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.426787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f3535891-0050-4c8d-9cfd-b3ddeb4e9203 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.436004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3535891-0050-4c8d-9cfd-b3ddeb4e9203 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.437400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3535891-0050-4c8d-9cfd-b3ddeb4e9203 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.438154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3535891-0050-4c8d-9cfd-b3ddeb4e9203 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.439268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3535891-0050-4c8d-9cfd-b3ddeb4e9203 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.441198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3535891-0050-4c8d-9cfd-b3ddeb4e9203 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.442433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3535891-0050-4c8d-9cfd-b3ddeb4e9203 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.755114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3c3a4ec0-01ca-487d-8ae2-c879e6041d75 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.775264 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3c3a4ec0-01ca-487d-8ae2-c879e6041d75 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1506 microversion: 2.1 time: 0.683290 Oct 04 18:16:15.782036 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1751/3535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1506 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:15.790733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40df2eab-bb7c-4a50-81a5-d56f93fd764b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.791636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-40df2eab-bb7c-4a50-81a5-d56f93fd764b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.820791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40df2eab-bb7c-4a50-81a5-d56f93fd764b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.822087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40df2eab-bb7c-4a50-81a5-d56f93fd764b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.823659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40df2eab-bb7c-4a50-81a5-d56f93fd764b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.825054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40df2eab-bb7c-4a50-81a5-d56f93fd764b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.841575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40df2eab-bb7c-4a50-81a5-d56f93fd764b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.846481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40df2eab-bb7c-4a50-81a5-d56f93fd764b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.872498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f3535891-0050-4c8d-9cfd-b3ddeb4e9203 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.885551 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f3535891-0050-4c8d-9cfd-b3ddeb4e9203 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.473705 Oct 04 18:16:15.886183 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1785/3536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:15.898518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dd89907f-b851-4191-9d71-238db6bca35c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.902119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dd89907f-b851-4191-9d71-238db6bca35c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.917127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd89907f-b851-4191-9d71-238db6bca35c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.917649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd89907f-b851-4191-9d71-238db6bca35c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.918107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd89907f-b851-4191-9d71-238db6bca35c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.918854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd89907f-b851-4191-9d71-238db6bca35c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.919335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd89907f-b851-4191-9d71-238db6bca35c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.919775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd89907f-b851-4191-9d71-238db6bca35c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.456317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-40df2eab-bb7c-4a50-81a5-d56f93fd764b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.456921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd89907f-b851-4191-9d71-238db6bca35c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.473843 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dd89907f-b851-4191-9d71-238db6bca35c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.584887 Oct 04 18:16:16.474707 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1786/3537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:16.476356 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40df2eab-bb7c-4a50-81a5-d56f93fd764b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1313 microversion: 2.1 time: 0.692827 Oct 04 18:16:16.478232 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1752/3538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:16.486025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca398ed6-f993-473a-be62-1f01ec0ccd64 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.487082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ca398ed6-f993-473a-be62-1f01ec0ccd64 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.497873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca398ed6-f993-473a-be62-1f01ec0ccd64 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.499636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca398ed6-f993-473a-be62-1f01ec0ccd64 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.500422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca398ed6-f993-473a-be62-1f01ec0ccd64 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.501599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca398ed6-f993-473a-be62-1f01ec0ccd64 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.501738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e089826a-9f05-4b03-8387-22c996cc334e req-38df9f4e-024a-4349-95f4-85c052652645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1184e3-4cd3-4bf9-a52e-1047d7e3c682", "tag": "66782b7e-7ca9-4644-8501-a1a346eb483b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:16.502481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca398ed6-f993-473a-be62-1f01ec0ccd64 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.503265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca398ed6-f993-473a-be62-1f01ec0ccd64 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.527863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e089826a-9f05-4b03-8387-22c996cc334e req-38df9f4e-024a-4349-95f4-85c052652645 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.528317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e089826a-9f05-4b03-8387-22c996cc334e req-38df9f4e-024a-4349-95f4-85c052652645 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.528829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e089826a-9f05-4b03-8387-22c996cc334e req-38df9f4e-024a-4349-95f4-85c052652645 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.547004 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e089826a-9f05-4b03-8387-22c996cc334e req-38df9f4e-024a-4349-95f4-85c052652645 service nova] Creating event network-changed:66782b7e-7ca9-4644-8501-a1a346eb483b for instance de1184e3-4cd3-4bf9-a52e-1047d7e3c682 on n-h1-850499-14 Oct 04 18:16:16.569728 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e089826a-9f05-4b03-8387-22c996cc334e req-38df9f4e-024a-4349-95f4-85c052652645 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093323 Oct 04 18:16:16.575040 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1787/3539] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:16.584111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c09df57-50a9-457e-ba30-8556021f075a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1428d30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.742865 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c09df57-50a9-457e-ba30-8556021f075a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1455 microversion: 2.1 time: 0.163245 Oct 04 18:16:16.745556 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1788/3540] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:16.757442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e59e131-c38c-442c-a48f-763160d8f485 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.762378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e59e131-c38c-442c-a48f-763160d8f485 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.782439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e59e131-c38c-442c-a48f-763160d8f485 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.783231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e59e131-c38c-442c-a48f-763160d8f485 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.786033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e59e131-c38c-442c-a48f-763160d8f485 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.787236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e59e131-c38c-442c-a48f-763160d8f485 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.789324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e59e131-c38c-442c-a48f-763160d8f485 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.791183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e59e131-c38c-442c-a48f-763160d8f485 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.888062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ca398ed6-f993-473a-be62-1f01ec0ccd64 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.906893 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca398ed6-f993-473a-be62-1f01ec0ccd64 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1318 microversion: 2.1 time: 0.426850 Oct 04 18:16:16.915103 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1753/3541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:16.921559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aeb227bc-abe2-47e0-ab41-c17e2129930b tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.922483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aeb227bc-abe2-47e0-ab41-c17e2129930b tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.930682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb227bc-abe2-47e0-ab41-c17e2129930b tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.931248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb227bc-abe2-47e0-ab41-c17e2129930b tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.931687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb227bc-abe2-47e0-ab41-c17e2129930b tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.932402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb227bc-abe2-47e0-ab41-c17e2129930b tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.932859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb227bc-abe2-47e0-ab41-c17e2129930b tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.933737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aeb227bc-abe2-47e0-ab41-c17e2129930b tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.585205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aeb227bc-abe2-47e0-ab41-c17e2129930b tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:17.592327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e59e131-c38c-442c-a48f-763160d8f485 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:17.598834 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aeb227bc-abe2-47e0-ab41-c17e2129930b tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1506 microversion: 2.1 time: 0.681319 Oct 04 18:16:17.600540 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1754/3542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1506 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:17.606315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-cceadd02-5eb2-4ed7-8c69-77caf8d64b0c req-58bf5506-bf68-44c8-bec3-27fb25104e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60a0cde-531d-4bb9-b6cd-5ad8954a2f08", "tag": "5ae340a3-b41e-4bbe-b5d1-12a40c3d7d15"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:17.618251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cceadd02-5eb2-4ed7-8c69-77caf8d64b0c req-58bf5506-bf68-44c8-bec3-27fb25104e52 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.618930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cceadd02-5eb2-4ed7-8c69-77caf8d64b0c req-58bf5506-bf68-44c8-bec3-27fb25104e52 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.619735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cceadd02-5eb2-4ed7-8c69-77caf8d64b0c req-58bf5506-bf68-44c8-bec3-27fb25104e52 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.629013 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e59e131-c38c-442c-a48f-763160d8f485 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.881914 Oct 04 18:16:17.630103 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1789/3543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:17.635377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4aa2fdde-3c1b-4d6c-9a36-5c126a2c71c8 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:17.636265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4aa2fdde-3c1b-4d6c-9a36-5c126a2c71c8 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:17.644419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2fdde-3c1b-4d6c-9a36-5c126a2c71c8 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.644913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2fdde-3c1b-4d6c-9a36-5c126a2c71c8 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.646000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2fdde-3c1b-4d6c-9a36-5c126a2c71c8 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.646855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2fdde-3c1b-4d6c-9a36-5c126a2c71c8 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.647626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2fdde-3c1b-4d6c-9a36-5c126a2c71c8 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.648072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2fdde-3c1b-4d6c-9a36-5c126a2c71c8 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.660177 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-cceadd02-5eb2-4ed7-8c69-77caf8d64b0c req-58bf5506-bf68-44c8-bec3-27fb25104e52 service nova] Creating event network-changed:5ae340a3-b41e-4bbe-b5d1-12a40c3d7d15 for instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 on n-h1-850499-14 Oct 04 18:16:17.671145 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-cceadd02-5eb2-4ed7-8c69-77caf8d64b0c req-58bf5506-bf68-44c8-bec3-27fb25104e52 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068933 Oct 04 18:16:17.673711 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1755/3544] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:17.684106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd190420-b4ec-4b02-9d08-84548b92aff3 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:17.685129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cd190420-b4ec-4b02-9d08-84548b92aff3 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:17.692852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd190420-b4ec-4b02-9d08-84548b92aff3 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.693553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd190420-b4ec-4b02-9d08-84548b92aff3 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.694148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd190420-b4ec-4b02-9d08-84548b92aff3 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.695245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd190420-b4ec-4b02-9d08-84548b92aff3 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.695863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd190420-b4ec-4b02-9d08-84548b92aff3 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.696946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd190420-b4ec-4b02-9d08-84548b92aff3 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.862004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4aa2fdde-3c1b-4d6c-9a36-5c126a2c71c8 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:17.877071 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4aa2fdde-3c1b-4d6c-9a36-5c126a2c71c8 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.245697 Oct 04 18:16:17.889149 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1790/3545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:17 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:17.889149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-65f087e2-fab1-4a5b-b476-61985cf61b15 req-5135ea32-20b8-4473-86ca-d54a78df4de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671406ce-ae77-441a-9e07-3d054c34c4f5", "name": "network-vif-plugged", "status": "completed", "tag": "f2bffad7-9c35-4420-bb47-a7b54db456ad"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:17.894987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-65f087e2-fab1-4a5b-b476-61985cf61b15 req-5135ea32-20b8-4473-86ca-d54a78df4de8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.895612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-65f087e2-fab1-4a5b-b476-61985cf61b15 req-5135ea32-20b8-4473-86ca-d54a78df4de8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.896259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-65f087e2-fab1-4a5b-b476-61985cf61b15 req-5135ea32-20b8-4473-86ca-d54a78df4de8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.919549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd190420-b4ec-4b02-9d08-84548b92aff3 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:17.921285 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-65f087e2-fab1-4a5b-b476-61985cf61b15 req-5135ea32-20b8-4473-86ca-d54a78df4de8 service nova] Creating event network-vif-plugged:f2bffad7-9c35-4420-bb47-a7b54db456ad for instance 671406ce-ae77-441a-9e07-3d054c34c4f5 on n-h2-850499-14 Oct 04 18:16:17.928917 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-65f087e2-fab1-4a5b-b476-61985cf61b15 req-5135ea32-20b8-4473-86ca-d54a78df4de8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048497 Oct 04 18:16:17.929998 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd190420-b4ec-4b02-9d08-84548b92aff3 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1313 microversion: 2.1 time: 0.254310 Oct 04 18:16:17.931101 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1756/3546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:17 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:17.933963 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1791/3547] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:17.943444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b3b8c22-7868-41f3-9dc1-8f5c86ad4f87 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1247550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:17.944218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-125a59ca-abdb-4848-94f6-128b6352176a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2020442598", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "key_name": "tempest-key-1886227307", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:17.997588 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b3b8c22-7868-41f3-9dc1-8f5c86ad4f87 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1464 microversion: 2.1 time: 0.064397 Oct 04 18:16:17.998608 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1757/3548] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:17 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1464 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:18.004379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a3ccc792-37cb-4fac-b9f1-504e80f3cac2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.005259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a3ccc792-37cb-4fac-b9f1-504e80f3cac2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.009923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-125a59ca-abdb-4848-94f6-128b6352176a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] validate_networks() for [('d78eedfe-97d8-4b5e-ac16-1f5f87c44f17', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:18.012169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3ccc792-37cb-4fac-b9f1-504e80f3cac2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.012710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3ccc792-37cb-4fac-b9f1-504e80f3cac2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.013321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3ccc792-37cb-4fac-b9f1-504e80f3cac2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.014187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3ccc792-37cb-4fac-b9f1-504e80f3cac2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.015207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3ccc792-37cb-4fac-b9f1-504e80f3cac2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.016146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3ccc792-37cb-4fac-b9f1-504e80f3cac2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.229871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a3ccc792-37cb-4fac-b9f1-504e80f3cac2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.238931 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a3ccc792-37cb-4fac-b9f1-504e80f3cac2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1318 microversion: 2.1 time: 0.238977 Oct 04 18:16:18.239584 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1758/3549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:17 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:18.244496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13aa56a1-d0c6-40fc-8580-f0186e155f54 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d18dcd30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.285089 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-125a59ca-abdb-4848-94f6-128b6352176a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Invalid key_name provided. Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-125a59ca-abdb-4848-94f6-128b6352176a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 247 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2020442598", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "key_name": "tempest-key-1886227307", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid key_name provided. Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2020442598', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'key_name': 'tempest-key-1886227307', 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1886227307 not found for user 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:18.289250 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:18.293749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-125a59ca-abdb-4848-94f6-128b6352176a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid key_name provided. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:18.296187 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-13aa56a1-d0c6-40fc-8580-f0186e155f54 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 200 len: 1464 microversion: 2.1 time: 0.049657 Oct 04 18:16:18.296430 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-125a59ca-abdb-4848-94f6-128b6352176a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.355545 Oct 04 18:16:18.296430 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1792/3550] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:17 2022] POST /compute/v2.1/servers => generated 70 bytes in 357 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:16:18.298200 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1759/3551] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 1464 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:18.300816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0c83b144-c436-4a91-af5f-e702a11212d3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.301455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0c83b144-c436-4a91-af5f-e702a11212d3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.307760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f82773c1-4d59-426c-9390-97203c4dcd3b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.308419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c83b144-c436-4a91-af5f-e702a11212d3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.308631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f82773c1-4d59-426c-9390-97203c4dcd3b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.308912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c83b144-c436-4a91-af5f-e702a11212d3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.309355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c83b144-c436-4a91-af5f-e702a11212d3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.310112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c83b144-c436-4a91-af5f-e702a11212d3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.310752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c83b144-c436-4a91-af5f-e702a11212d3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.311210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c83b144-c436-4a91-af5f-e702a11212d3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.315225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82773c1-4d59-426c-9390-97203c4dcd3b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.315715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82773c1-4d59-426c-9390-97203c4dcd3b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.316149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82773c1-4d59-426c-9390-97203c4dcd3b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.317051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82773c1-4d59-426c-9390-97203c4dcd3b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.317515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82773c1-4d59-426c-9390-97203c4dcd3b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.317939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f82773c1-4d59-426c-9390-97203c4dcd3b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.347227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:18.552484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0c83b144-c436-4a91-af5f-e702a11212d3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.561387 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0c83b144-c436-4a91-af5f-e702a11212d3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.264185 Oct 04 18:16:18.562006 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1793/3552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:18.566139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f82773c1-4d59-426c-9390-97203c4dcd3b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.573949 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f82773c1-4d59-426c-9390-97203c4dcd3b tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1481 microversion: 2.1 time: 0.269900 Oct 04 18:16:18.575058 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1760/3553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1481 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:18.591226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b8d51d6c-e556-4b8f-ac64-065ca28843a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.591923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b8d51d6c-e556-4b8f-ac64-065ca28843a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.598451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8d51d6c-e556-4b8f-ac64-065ca28843a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.599038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8d51d6c-e556-4b8f-ac64-065ca28843a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.599550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8d51d6c-e556-4b8f-ac64-065ca28843a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.600337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8d51d6c-e556-4b8f-ac64-065ca28843a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.600878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8d51d6c-e556-4b8f-ac64-065ca28843a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.601388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8d51d6c-e556-4b8f-ac64-065ca28843a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.636668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=54 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:18.739332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0205b05a-7a1f-4216-a698-256c5079b86d tempest-QuotaClassesAdminTestJSON-231169551 tempest-QuotaClassesAdminTestJSON-231169551-project-admin] Calling method '.version_select at 0x7fd4d12e0430>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.757694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b8d51d6c-e556-4b8f-ac64-065ca28843a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.761113 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0205b05a-7a1f-4216-a698-256c5079b86d tempest-QuotaClassesAdminTestJSON-231169551 tempest-QuotaClassesAdminTestJSON-231169551-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.198032 Oct 04 18:16:18.761897 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1794/3554] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:18.767277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9c4e3426-5538-4028-8a8d-45af8f6a1cb4 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.767880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9c4e3426-5538-4028-8a8d-45af8f6a1cb4 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.770794 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b8d51d6c-e556-4b8f-ac64-065ca28843a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.184078 Oct 04 18:16:18.771311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:18.771748 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1761/3555] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:18.777665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c4e3426-5538-4028-8a8d-45af8f6a1cb4 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.778295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce739c5f-b30d-417c-9989-6cdd00b28653 tempest-QuotaClassesAdminTestJSON-231169551 tempest-QuotaClassesAdminTestJSON-231169551-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d1247820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:18.778430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c4e3426-5538-4028-8a8d-45af8f6a1cb4 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.778773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c4e3426-5538-4028-8a8d-45af8f6a1cb4 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.779510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c4e3426-5538-4028-8a8d-45af8f6a1cb4 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.779971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c4e3426-5538-4028-8a8d-45af8f6a1cb4 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.780965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c4e3426-5538-4028-8a8d-45af8f6a1cb4 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.922732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9c4e3426-5538-4028-8a8d-45af8f6a1cb4 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.931398 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9c4e3426-5538-4028-8a8d-45af8f6a1cb4 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1504 microversion: 2.1 time: 0.168253 Oct 04 18:16:18.932112 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1795/3556] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:18.937581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-170db357-8fe3-46c1-ae85-7bd590f2f64f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.938333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-170db357-8fe3-46c1-ae85-7bd590f2f64f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.944138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170db357-8fe3-46c1-ae85-7bd590f2f64f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.944627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170db357-8fe3-46c1-ae85-7bd590f2f64f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.945070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170db357-8fe3-46c1-ae85-7bd590f2f64f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.945763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170db357-8fe3-46c1-ae85-7bd590f2f64f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.946224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170db357-8fe3-46c1-ae85-7bd590f2f64f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.946655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170db357-8fe3-46c1-ae85-7bd590f2f64f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.002918 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce739c5f-b30d-417c-9989-6cdd00b28653 tempest-QuotaClassesAdminTestJSON-231169551 tempest-QuotaClassesAdminTestJSON-231169551-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.230011 Oct 04 18:16:19.003934 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1762/3557] 10.222.0.18 () {60 vars in 1206 bytes} [Tue Oct 4 18:16:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:19.008528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2cc3e012-ae06-46d4-82a7-11827424ece1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2064105615", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:19.103948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-170db357-8fe3-46c1-ae85-7bd590f2f64f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:19.112565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.security_group_api [None req-2cc3e012-ae06-46d4-82a7-11827424ece1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Neutron security group does_not_exist not found {{(pid=122331) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 18:16:19.113012 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-170db357-8fe3-46c1-ae85-7bd590f2f64f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.179668 Oct 04 18:16:19.113192 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-2cc3e012-ae06-46d4-82a7-11827424ece1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:16:19.114128 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1796/3558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:19.118485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33807685-9bae-470a-b9c0-188eebf4bac7 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.119234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33807685-9bae-470a-b9c0-188eebf4bac7 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2cc3e012-ae06-46d4-82a7-11827424ece1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 258 Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2064105615", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2064105615', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 18:16:19.120712 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.126059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2cc3e012-ae06-46d4-82a7-11827424ece1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:19.130443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33807685-9bae-470a-b9c0-188eebf4bac7 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.130443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33807685-9bae-470a-b9c0-188eebf4bac7 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.130443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33807685-9bae-470a-b9c0-188eebf4bac7 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.130443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33807685-9bae-470a-b9c0-188eebf4bac7 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.130780 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2cc3e012-ae06-46d4-82a7-11827424ece1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.120776 Oct 04 18:16:19.130873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33807685-9bae-470a-b9c0-188eebf4bac7 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.130873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33807685-9bae-470a-b9c0-188eebf4bac7 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.131517 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1763/3559] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:19 2022] POST /compute/v2.1/servers => generated 106 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:16:19.139273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-32bfea63-6888-463c-ad0a-6d78266ed154 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '.version_select at 0x7fd4d27c4550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.140434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-32bfea63-6888-463c-ad0a-6d78266ed154 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.146690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bfea63-6888-463c-ad0a-6d78266ed154 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.147218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bfea63-6888-463c-ad0a-6d78266ed154 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.148183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bfea63-6888-463c-ad0a-6d78266ed154 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.148570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bfea63-6888-463c-ad0a-6d78266ed154 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.149033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bfea63-6888-463c-ad0a-6d78266ed154 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.149469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bfea63-6888-463c-ad0a-6d78266ed154 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.180724 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-32bfea63-6888-463c-ad0a-6d78266ed154 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.048504 Oct 04 18:16:19.181301 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1764/3560] 10.222.0.18 () {58 vars in 1296 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d/os-instance-actions => generated 611 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:19.185951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-338cb507-0f2b-497b-be6c-b6273bac43a7 tempest-QuotaClassesAdminTestJSON-231169551 tempest-QuotaClassesAdminTestJSON-231169551-project-admin] Calling method '.version_select at 0x7fd4d1247790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.198256 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-338cb507-0f2b-497b-be6c-b6273bac43a7 tempest-QuotaClassesAdminTestJSON-231169551 tempest-QuotaClassesAdminTestJSON-231169551-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.015865 Oct 04 18:16:19.198994 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1765/3561] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:19.204084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c972940-8b2f-4a62-8c84-a1db4079fcc0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.204694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4c972940-8b2f-4a62-8c84-a1db4079fcc0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.210630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c972940-8b2f-4a62-8c84-a1db4079fcc0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.211149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c972940-8b2f-4a62-8c84-a1db4079fcc0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.211587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c972940-8b2f-4a62-8c84-a1db4079fcc0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.212460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c972940-8b2f-4a62-8c84-a1db4079fcc0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.212744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c972940-8b2f-4a62-8c84-a1db4079fcc0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.213169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c972940-8b2f-4a62-8c84-a1db4079fcc0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.291887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-33807685-9bae-470a-b9c0-188eebf4bac7 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:19.300849 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33807685-9bae-470a-b9c0-188eebf4bac7 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1313 microversion: 2.1 time: 0.185645 Oct 04 18:16:19.301452 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1797/3562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:19.306082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d2fb7d67-3f23-4326-926f-0960dc5c54f6 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.306576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d2fb7d67-3f23-4326-926f-0960dc5c54f6 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.316917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2fb7d67-3f23-4326-926f-0960dc5c54f6 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.317647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2fb7d67-3f23-4326-926f-0960dc5c54f6 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.318040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2fb7d67-3f23-4326-926f-0960dc5c54f6 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.318845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2fb7d67-3f23-4326-926f-0960dc5c54f6 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.319518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2fb7d67-3f23-4326-926f-0960dc5c54f6 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.319958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d2fb7d67-3f23-4326-926f-0960dc5c54f6 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.346135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d2fb7d67-3f23-4326-926f-0960dc5c54f6 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:19.361845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:19.363526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4c972940-8b2f-4a62-8c84-a1db4079fcc0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:19.372532 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c972940-8b2f-4a62-8c84-a1db4079fcc0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.172602 Oct 04 18:16:19.373203 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1766/3563] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:19.377772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3e504fc9-fc4e-41fe-a7e5-37804e9b47c2 tempest-QuotaClassesAdminTestJSON-231169551 tempest-QuotaClassesAdminTestJSON-231169551-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d129f4c0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:19.428786 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d2fb7d67-3f23-4326-926f-0960dc5c54f6 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 204 len: 0 microversion: 2.1 time: 0.125944 Oct 04 18:16:19.429372 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1798/3564] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:19 2022] DELETE /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:19.434783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-92d5aca0-561f-4b84-99f8-2a58c8aae0f7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.435527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-92d5aca0-561f-4b84-99f8-2a58c8aae0f7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.443127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d5aca0-561f-4b84-99f8-2a58c8aae0f7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.443631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d5aca0-561f-4b84-99f8-2a58c8aae0f7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.444085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d5aca0-561f-4b84-99f8-2a58c8aae0f7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.444798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d5aca0-561f-4b84-99f8-2a58c8aae0f7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.445263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d5aca0-561f-4b84-99f8-2a58c8aae0f7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.445701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d5aca0-561f-4b84-99f8-2a58c8aae0f7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.452225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=22,nova_api:INSERT=7 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:19.490474 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3e504fc9-fc4e-41fe-a7e5-37804e9b47c2 tempest-QuotaClassesAdminTestJSON-231169551 tempest-QuotaClassesAdminTestJSON-231169551-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.116090 Oct 04 18:16:19.491480 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1767/3565] 10.222.0.18 () {60 vars in 1206 bytes} [Tue Oct 4 18:16:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:19.497372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-faa30d66-a3e2-48cf-9be0-7155153bdf38 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.498198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-faa30d66-a3e2-48cf-9be0-7155153bdf38 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.511287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faa30d66-a3e2-48cf-9be0-7155153bdf38 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.511944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faa30d66-a3e2-48cf-9be0-7155153bdf38 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.512613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faa30d66-a3e2-48cf-9be0-7155153bdf38 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.514885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faa30d66-a3e2-48cf-9be0-7155153bdf38 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.515466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faa30d66-a3e2-48cf-9be0-7155153bdf38 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.516022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faa30d66-a3e2-48cf-9be0-7155153bdf38 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.807066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-faa30d66-a3e2-48cf-9be0-7155153bdf38 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:19.812053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-92d5aca0-561f-4b84-99f8-2a58c8aae0f7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:19.826329 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-92d5aca0-561f-4b84-99f8-2a58c8aae0f7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1318 microversion: 2.1 time: 0.395706 Oct 04 18:16:19.828484 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1799/3566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:19.831136 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-faa30d66-a3e2-48cf-9be0-7155153bdf38 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.338350 Oct 04 18:16:19.832234 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1768/3567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:19.833829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-28307d04-897f-46c2-b0d7-9ea113857ad0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.834652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-28307d04-897f-46c2-b0d7-9ea113857ad0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.842026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28307d04-897f-46c2-b0d7-9ea113857ad0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.843227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28307d04-897f-46c2-b0d7-9ea113857ad0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.843933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28307d04-897f-46c2-b0d7-9ea113857ad0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.845000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28307d04-897f-46c2-b0d7-9ea113857ad0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.845686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28307d04-897f-46c2-b0d7-9ea113857ad0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.846487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28307d04-897f-46c2-b0d7-9ea113857ad0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.848081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aebde39c-5cdf-4159-867c-703e095d7883 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.848717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aebde39c-5cdf-4159-867c-703e095d7883 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.863111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebde39c-5cdf-4159-867c-703e095d7883 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.863892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebde39c-5cdf-4159-867c-703e095d7883 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.864565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebde39c-5cdf-4159-867c-703e095d7883 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.865488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebde39c-5cdf-4159-867c-703e095d7883 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.866170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebde39c-5cdf-4159-867c-703e095d7883 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.867157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aebde39c-5cdf-4159-867c-703e095d7883 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.182918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-28307d04-897f-46c2-b0d7-9ea113857ad0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.198122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aebde39c-5cdf-4159-867c-703e095d7883 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.209279 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-28307d04-897f-46c2-b0d7-9ea113857ad0 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1510 microversion: 2.1 time: 0.379485 Oct 04 18:16:20.210899 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aebde39c-5cdf-4159-867c-703e095d7883 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1468 microversion: 2.1 time: 0.377423 Oct 04 18:16:20.211545 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1769/3568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.212873 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1800/3569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1510 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.230642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c7f28b6-b35b-4e69-a041-b6872efbf3dc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.231197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1c7f28b6-b35b-4e69-a041-b6872efbf3dc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: f2172dd9-5184-42cf-9b4f-5087b53cedcd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.232983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d1903437-3a43-4f1d-9762-154f6628090b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.233899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d1903437-3a43-4f1d-9762-154f6628090b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.240489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1903437-3a43-4f1d-9762-154f6628090b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.240720 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-1c7f28b6-b35b-4e69-a041-b6872efbf3dc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance f2172dd9-5184-42cf-9b4f-5087b53cedcd could not be found. Oct 04 18:16:20.241368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1903437-3a43-4f1d-9762-154f6628090b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.241984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1903437-3a43-4f1d-9762-154f6628090b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c7f28b6-b35b-4e69-a041-b6872efbf3dc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/f2172dd9-5184-42cf-9b4f-5087b53cedcd HTTP/1.1 Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance f2172dd9-5184-42cf-9b4f-5087b53cedcd could not be found. Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'f2172dd9-5184-42cf-9b4f-5087b53cedcd'} Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2172dd9-5184-42cf-9b4f-5087b53cedcd could not be found. Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2172dd9-5184-42cf-9b4f-5087b53cedcd could not be found. Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:20.242188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2172dd9-5184-42cf-9b4f-5087b53cedcd could not be found. Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c7f28b6-b35b-4e69-a041-b6872efbf3dc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance f2172dd9-5184-42cf-9b4f-5087b53cedcd could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c7f28b6-b35b-4e69-a041-b6872efbf3dc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2172dd9-5184-42cf-9b4f-5087b53cedcd" status: 404 len: 111 microversion: 2.1 time: 0.031327 Oct 04 18:16:20.246859 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1770/3570] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:20 2022] DELETE /compute/v2.1/servers/f2172dd9-5184-42cf-9b4f-5087b53cedcd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:20.249159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f3e805d1-0e16-4f01-a881-3ce299935e89 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1268e50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.249648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1903437-3a43-4f1d-9762-154f6628090b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.250143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1903437-3a43-4f1d-9762-154f6628090b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.250753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1903437-3a43-4f1d-9762-154f6628090b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.369290 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f3e805d1-0e16-4f01-a881-3ce299935e89 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images?changes-since=2022-10-04T18%3A13%3A42Z" status: 200 len: 1902 microversion: 2.1 time: 0.123480 Oct 04 18:16:20.369891 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1771/3571] 10.222.0.18 () {58 vars in 1199 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/images?changes-since=2022-10-04T18%3A13%3A42Z => generated 1902 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.393561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ea86da6-848d-4d87-b7a2-0d155ad6fd75 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.394274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9ea86da6-848d-4d87-b7a2-0d155ad6fd75 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.400705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea86da6-848d-4d87-b7a2-0d155ad6fd75 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.401239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea86da6-848d-4d87-b7a2-0d155ad6fd75 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.401681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea86da6-848d-4d87-b7a2-0d155ad6fd75 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.402888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea86da6-848d-4d87-b7a2-0d155ad6fd75 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.403251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea86da6-848d-4d87-b7a2-0d155ad6fd75 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.403667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea86da6-848d-4d87-b7a2-0d155ad6fd75 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.536520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d1903437-3a43-4f1d-9762-154f6628090b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.546574 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d1903437-3a43-4f1d-9762-154f6628090b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.331768 Oct 04 18:16:20.547330 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1801/3572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.553701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d5c03002-570f-4970-945d-90157682e50f tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.554326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d5c03002-570f-4970-945d-90157682e50f tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.562260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5c03002-570f-4970-945d-90157682e50f tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.563016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5c03002-570f-4970-945d-90157682e50f tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.563640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5c03002-570f-4970-945d-90157682e50f tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.564517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5c03002-570f-4970-945d-90157682e50f tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.565133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5c03002-570f-4970-945d-90157682e50f tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.565732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5c03002-570f-4970-945d-90157682e50f tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.598674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ea86da6-848d-4d87-b7a2-0d155ad6fd75 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.607806 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ea86da6-848d-4d87-b7a2-0d155ad6fd75 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.236826 Oct 04 18:16:20.608456 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1772/3573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.613071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c8ed711-7df8-4236-a407-f87bf0cba28f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1268af0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.699252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c8ed711-7df8-4236-a407-f87bf0cba28f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1880136309" status: 200 len: 485 microversion: 2.1 time: 0.089525 Oct 04 18:16:20.699829 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1773/3574] 10.222.0.18 () {58 vars in 1231 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1880136309 => generated 485 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:20.711580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-84e23d53-fbec-46b3-a2cf-f24e5893a379 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.712511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-84e23d53-fbec-46b3-a2cf-f24e5893a379 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.715930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d5c03002-570f-4970-945d-90157682e50f tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.720911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84e23d53-fbec-46b3-a2cf-f24e5893a379 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.721553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84e23d53-fbec-46b3-a2cf-f24e5893a379 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.722362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84e23d53-fbec-46b3-a2cf-f24e5893a379 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.723379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84e23d53-fbec-46b3-a2cf-f24e5893a379 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.723853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84e23d53-fbec-46b3-a2cf-f24e5893a379 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.724748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84e23d53-fbec-46b3-a2cf-f24e5893a379 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.725644 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d5c03002-570f-4970-945d-90157682e50f tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1313 microversion: 2.1 time: 0.176860 Oct 04 18:16:20.726542 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1802/3575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.735763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cc8b7466-a085-4543-9521-c032b612fece tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d6122e50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.829391 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cc8b7466-a085-4543-9521-c032b612fece tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images?server=da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 957 microversion: 2.1 time: 0.101430 Oct 04 18:16:20.835968 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1803/3576] 10.222.0.18 () {58 vars in 1209 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/images?server=da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 957 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:20.846218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cfdb325b-5694-4de0-8acd-e02f8c112a4a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1aae700>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.906087 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cfdb325b-5694-4de0-8acd-e02f8c112a4a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fe8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 484 microversion: 2.1 time: 0.064769 Oct 04 18:16:20.906993 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1804/3577] 10.222.0.18 () {58 vars in 1317 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fe8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 484 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:20.915387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-75554e1b-d136-4960-867d-2e4162bc1fb6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.916077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-75554e1b-d136-4960-867d-2e4162bc1fb6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.924212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75554e1b-d136-4960-867d-2e4162bc1fb6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.925277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75554e1b-d136-4960-867d-2e4162bc1fb6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.926182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75554e1b-d136-4960-867d-2e4162bc1fb6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.927766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75554e1b-d136-4960-867d-2e4162bc1fb6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.928776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75554e1b-d136-4960-867d-2e4162bc1fb6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.930143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75554e1b-d136-4960-867d-2e4162bc1fb6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.932464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-84e23d53-fbec-46b3-a2cf-f24e5893a379 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.941597 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-84e23d53-fbec-46b3-a2cf-f24e5893a379 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.240363 Oct 04 18:16:20.942756 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1774/3578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.947406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f1277c8d-a363-4da2-9ace-7a6f18cb46fc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12478b0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.007707 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f1277c8d-a363-4da2-9ace-7a6f18cb46fc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fe8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 484 microversion: 2.1 time: 0.063724 Oct 04 18:16:21.008314 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1775/3579] 10.222.0.18 () {58 vars in 1303 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fe8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 484 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:21.013139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8a53af8-f297-4c9f-b198-d2d5fa7fc0b3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.013632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e8a53af8-f297-4c9f-b198-d2d5fa7fc0b3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:16:21.014141 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-e8a53af8-f297-4c9f-b198-d2d5fa7fc0b3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8a53af8-f297-4c9f-b198-d2d5fa7fc0b3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 9223372036854775808 could not be found. Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '9223372036854775808'} Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.016461 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.024394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.024394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:21.024394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:21.024394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 18:16:21.024394 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.024394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8a53af8-f297-4c9f-b198-d2d5fa7fc0b3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:21.024394 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e8a53af8-f297-4c9f-b198-d2d5fa7fc0b3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008188 Oct 04 18:16:21.024394 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1776/3580] 10.222.0.18 () {58 vars in 1188 bytes} [Tue Oct 4 18:16:21 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:16:21.024394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7b997c19-d598-47cc-88d2-5b7efaa7ad72 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d129f550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.147179 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7b997c19-d598-47cc-88d2-5b7efaa7ad72 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.127572 Oct 04 18:16:21.148233 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1777/3581] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:21.152410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-92de06e9-37b8-4714-8706-dddde97efd47 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.153040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-92de06e9-37b8-4714-8706-dddde97efd47 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.157674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-75554e1b-d136-4960-867d-2e4162bc1fb6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:21.164460 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-75554e1b-d136-4960-867d-2e4162bc1fb6 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1318 microversion: 2.1 time: 0.256693 Oct 04 18:16:21.165043 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1805/3582] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:21.165391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92de06e9-37b8-4714-8706-dddde97efd47 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.165962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92de06e9-37b8-4714-8706-dddde97efd47 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.166577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92de06e9-37b8-4714-8706-dddde97efd47 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.167390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92de06e9-37b8-4714-8706-dddde97efd47 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.167915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92de06e9-37b8-4714-8706-dddde97efd47 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.168437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92de06e9-37b8-4714-8706-dddde97efd47 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.169756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-260cbdbd-629e-4e01-bf34-829574643fdf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1428430>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.242543 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-260cbdbd-629e-4e01-bf34-829574643fdf tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.076160 Oct 04 18:16:21.243717 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1806/3583] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:21.248715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78bfc017-26e9-40af-98ea-0973afa230e9 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.250926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78bfc017-26e9-40af-98ea-0973afa230e9 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.258405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bfc017-26e9-40af-98ea-0973afa230e9 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.259056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bfc017-26e9-40af-98ea-0973afa230e9 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.259724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bfc017-26e9-40af-98ea-0973afa230e9 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.260819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bfc017-26e9-40af-98ea-0973afa230e9 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.261504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bfc017-26e9-40af-98ea-0973afa230e9 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.262165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78bfc017-26e9-40af-98ea-0973afa230e9 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.392124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-92de06e9-37b8-4714-8706-dddde97efd47 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:21.403025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:21.413924 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-92de06e9-37b8-4714-8706-dddde97efd47 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.265071 Oct 04 18:16:21.415575 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1778/3584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:21.421727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d855f07-1f59-40e2-906a-1444fd27b044 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1268af0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.474317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78bfc017-26e9-40af-98ea-0973afa230e9 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:21.485869 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78bfc017-26e9-40af-98ea-0973afa230e9 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1510 microversion: 2.1 time: 0.240582 Oct 04 18:16:21.487602 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1807/3585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1510 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:21.493102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f19d4363-8951-4d7d-9ca1-0aab21cb5266 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.493804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f19d4363-8951-4d7d-9ca1-0aab21cb5266 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.501329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19d4363-8951-4d7d-9ca1-0aab21cb5266 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.501933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19d4363-8951-4d7d-9ca1-0aab21cb5266 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.502457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19d4363-8951-4d7d-9ca1-0aab21cb5266 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.503311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19d4363-8951-4d7d-9ca1-0aab21cb5266 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.503853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19d4363-8951-4d7d-9ca1-0aab21cb5266 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.504361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19d4363-8951-4d7d-9ca1-0aab21cb5266 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.587135 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d855f07-1f59-40e2-906a-1444fd27b044 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.169932 Oct 04 18:16:21.594188 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1779/3586] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:21.599632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ff9cc052-2a2d-4cfb-bfa3-60607c332109 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.600470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ff9cc052-2a2d-4cfb-bfa3-60607c332109 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.608677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff9cc052-2a2d-4cfb-bfa3-60607c332109 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.609483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff9cc052-2a2d-4cfb-bfa3-60607c332109 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.616873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff9cc052-2a2d-4cfb-bfa3-60607c332109 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.618604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff9cc052-2a2d-4cfb-bfa3-60607c332109 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.620329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff9cc052-2a2d-4cfb-bfa3-60607c332109 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.622464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff9cc052-2a2d-4cfb-bfa3-60607c332109 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.745587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f19d4363-8951-4d7d-9ca1-0aab21cb5266 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:21.760356 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f19d4363-8951-4d7d-9ca1-0aab21cb5266 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.271565 Oct 04 18:16:21.760994 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1808/3587] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:21.771638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-30f69ed3-0822-4d5b-9769-63dcce2cf0ff tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1555820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.829657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ff9cc052-2a2d-4cfb-bfa3-60607c332109 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:21.838452 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ff9cc052-2a2d-4cfb-bfa3-60607c332109 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.242644 Oct 04 18:16:21.848852 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1780/3588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:21.859392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-dc8eeabd-0642-45f9-86c0-ffff27b65d88 req-010fb789-6e9d-4064-892f-0415436a201e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da89d46d-4ae1-466f-9889-e1d528e843e5", "name": "network-vif-unplugged", "status": "completed", "tag": "4705f29d-c67d-4649-af0a-38b1ead030b6"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:21.871894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dc8eeabd-0642-45f9-86c0-ffff27b65d88 req-010fb789-6e9d-4064-892f-0415436a201e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.872395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dc8eeabd-0642-45f9-86c0-ffff27b65d88 req-010fb789-6e9d-4064-892f-0415436a201e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.872835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dc8eeabd-0642-45f9-86c0-ffff27b65d88 req-010fb789-6e9d-4064-892f-0415436a201e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.890327 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-30f69ed3-0822-4d5b-9769-63dcce2cf0ff tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T18%3A13%3A37Z" status: 200 len: 6333 microversion: 2.1 time: 0.127514 Oct 04 18:16:21.891549 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1809/3589] 10.222.0.18 () {58 vars in 1220 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T18%3A13%3A37Z => generated 6333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:21.903145 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-dc8eeabd-0642-45f9-86c0-ffff27b65d88 req-010fb789-6e9d-4064-892f-0415436a201e service nova] Creating event network-vif-unplugged:4705f29d-c67d-4649-af0a-38b1ead030b6 for instance da89d46d-4ae1-466f-9889-e1d528e843e5 on n-h2-850499-14 Oct 04 18:16:21.903145 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-dc8eeabd-0642-45f9-86c0-ffff27b65d88 req-010fb789-6e9d-4064-892f-0415436a201e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046669 Oct 04 18:16:21.903145 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1781/3590] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:21.909459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-78447f1c-8396-426f-8738-2501e62ca7a6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.910677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-78447f1c-8396-426f-8738-2501e62ca7a6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.915238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a9dfc16-3f9e-4ed0-abb4-0c13b1e30bc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.915738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1a9dfc16-3f9e-4ed0-abb4-0c13b1e30bc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Failed to fetch instance by id -1 {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:16:21.916266 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-1a9dfc16-3f9e-4ed0-abb4-0c13b1e30bc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a9dfc16-3f9e-4ed0-abb4-0c13b1e30bc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance -1 could not be found. Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '-1'} Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.917884 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.925166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:21.925166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:21.925166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 18:16:21.925166 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.925553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78447f1c-8396-426f-8738-2501e62ca7a6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.925739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a9dfc16-3f9e-4ed0-abb4-0c13b1e30bc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:21.925827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78447f1c-8396-426f-8738-2501e62ca7a6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.925827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78447f1c-8396-426f-8738-2501e62ca7a6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.926000 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1a9dfc16-3f9e-4ed0-abb4-0c13b1e30bc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014434 Oct 04 18:16:21.926086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78447f1c-8396-426f-8738-2501e62ca7a6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.926086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78447f1c-8396-426f-8738-2501e62ca7a6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.926241 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1810/3591] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:21 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:16:21.926324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78447f1c-8396-426f-8738-2501e62ca7a6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.933603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79e914c5-4357-435d-95f6-f64a6449946a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1e4aa60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.994585 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-79e914c5-4357-435d-95f6-f64a6449946a tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1880136309" status: 200 len: 665 microversion: 2.1 time: 0.073049 Oct 04 18:16:21.999902 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1811/3592] 10.222.0.18 () {58 vars in 1252 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1880136309 => generated 665 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:22.005062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5c0262e7-1a66-4304-ba50-2ae9d5c8dfff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.006038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5c0262e7-1a66-4304-ba50-2ae9d5c8dfff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.016469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c0262e7-1a66-4304-ba50-2ae9d5c8dfff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.016975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c0262e7-1a66-4304-ba50-2ae9d5c8dfff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.017426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c0262e7-1a66-4304-ba50-2ae9d5c8dfff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.018144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c0262e7-1a66-4304-ba50-2ae9d5c8dfff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.018895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c0262e7-1a66-4304-ba50-2ae9d5c8dfff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.019360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c0262e7-1a66-4304-ba50-2ae9d5c8dfff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.185592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-78447f1c-8396-426f-8738-2501e62ca7a6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.197583 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-78447f1c-8396-426f-8738-2501e62ca7a6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1313 microversion: 2.1 time: 0.294711 Oct 04 18:16:22.199215 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1782/3593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.207672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34e8c9f3-e206-4442-aad6-fa82ea47d7df tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d128de50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.213048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5c0262e7-1a66-4304-ba50-2ae9d5c8dfff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.221864 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5c0262e7-1a66-4304-ba50-2ae9d5c8dfff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.220802 Oct 04 18:16:22.222993 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1812/3594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.227746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-349e0f4a-2cb9-4788-8ef7-e075761533ad tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.228363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-349e0f4a-2cb9-4788-8ef7-e075761533ad tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.234894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349e0f4a-2cb9-4788-8ef7-e075761533ad tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.235895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349e0f4a-2cb9-4788-8ef7-e075761533ad tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.236565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349e0f4a-2cb9-4788-8ef7-e075761533ad tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.237990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349e0f4a-2cb9-4788-8ef7-e075761533ad tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.238592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349e0f4a-2cb9-4788-8ef7-e075761533ad tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.239273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-349e0f4a-2cb9-4788-8ef7-e075761533ad tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.278350 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34e8c9f3-e206-4442-aad6-fa82ea47d7df tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fe8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1466 microversion: 2.1 time: 0.077771 Oct 04 18:16:22.279081 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1783/3595] 10.222.0.18 () {58 vars in 1338 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fe8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1466 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.291596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-345231a4-c69b-44d1-8ff3-151d9e8c8901 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.292223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-345231a4-c69b-44d1-8ff3-151d9e8c8901 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.299868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345231a4-c69b-44d1-8ff3-151d9e8c8901 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.300372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345231a4-c69b-44d1-8ff3-151d9e8c8901 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.300817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345231a4-c69b-44d1-8ff3-151d9e8c8901 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.301905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345231a4-c69b-44d1-8ff3-151d9e8c8901 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.303105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345231a4-c69b-44d1-8ff3-151d9e8c8901 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.303681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345231a4-c69b-44d1-8ff3-151d9e8c8901 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.431499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-349e0f4a-2cb9-4788-8ef7-e075761533ad tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.441199 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-349e0f4a-2cb9-4788-8ef7-e075761533ad tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1318 microversion: 2.1 time: 0.216910 Oct 04 18:16:22.455456 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1813/3596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.461059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cdecb1ff-4247-463c-87e5-8080314678e8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12c73a0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.493668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-345231a4-c69b-44d1-8ff3-151d9e8c8901 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.502828 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-345231a4-c69b-44d1-8ff3-151d9e8c8901 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.221286 Oct 04 18:16:22.516526 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1784/3597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.522301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb905a7e-96ef-44ff-bbd6-ef525587b970 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.522930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bb905a7e-96ef-44ff-bbd6-ef525587b970 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.532237 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cdecb1ff-4247-463c-87e5-8080314678e8 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fe8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1466 microversion: 2.1 time: 0.075341 Oct 04 18:16:22.532914 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1814/3598] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fe8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1466 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.538027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-441dbbef-cb12-4d81-a7bf-253ac39216e2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:22.538654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-441dbbef-cb12-4d81-a7bf-253ac39216e2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: 6293c699-e049-4952-84b2-e668cf799fae] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.544497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb905a7e-96ef-44ff-bbd6-ef525587b970 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.545168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb905a7e-96ef-44ff-bbd6-ef525587b970 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.545606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb905a7e-96ef-44ff-bbd6-ef525587b970 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.546659 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-441dbbef-cb12-4d81-a7bf-253ac39216e2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 6293c699-e049-4952-84b2-e668cf799fae could not be found. Oct 04 18:16:22.547908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb905a7e-96ef-44ff-bbd6-ef525587b970 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.548469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb905a7e-96ef-44ff-bbd6-ef525587b970 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.549008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb905a7e-96ef-44ff-bbd6-ef525587b970 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-441dbbef-cb12-4d81-a7bf-253ac39216e2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/6293c699-e049-4952-84b2-e668cf799fae/action HTTP/1.1 Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 19 Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: {"forceDelete": {}} Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 6293c699-e049-4952-84b2-e668cf799fae could not be found. Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '6293c699-e049-4952-84b2-e668cf799fae', 'body': {'forceDelete': {}}} Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6293c699-e049-4952-84b2-e668cf799fae could not be found. Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6293c699-e049-4952-84b2-e668cf799fae could not be found. Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.554440 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.559059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:22.559059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:22.559059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6293c699-e049-4952-84b2-e668cf799fae could not be found. Oct 04 18:16:22.559059 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.563438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-441dbbef-cb12-4d81-a7bf-253ac39216e2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 6293c699-e049-4952-84b2-e668cf799fae could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:22.564501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-441dbbef-cb12-4d81-a7bf-253ac39216e2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/6293c699-e049-4952-84b2-e668cf799fae/action" status: 404 len: 111 microversion: 2.1 time: 0.030420 Oct 04 18:16:22.569043 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1815/3599] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:22 2022] POST /compute/v2.1/servers/6293c699-e049-4952-84b2-e668cf799fae/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:22.575950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-19a2b37f-a511-4fba-ae4e-824a710f94d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1428040>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.717136 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-19a2b37f-a511-4fba-ae4e-824a710f94d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.146786 Oct 04 18:16:22.730980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1816/3600] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.730980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d474c53-250f-4579-8317-5446cc9b0521 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.730980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d474c53-250f-4579-8317-5446cc9b0521 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.731521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bb905a7e-96ef-44ff-bbd6-ef525587b970 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.741379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d474c53-250f-4579-8317-5446cc9b0521 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.741873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d474c53-250f-4579-8317-5446cc9b0521 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.742242 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb905a7e-96ef-44ff-bbd6-ef525587b970 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1510 microversion: 2.1 time: 0.224194 Oct 04 18:16:22.742399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d474c53-250f-4579-8317-5446cc9b0521 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.743088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d474c53-250f-4579-8317-5446cc9b0521 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.743543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d474c53-250f-4579-8317-5446cc9b0521 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.743922 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1785/3601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.744337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d474c53-250f-4579-8317-5446cc9b0521 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.748609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4191db3a-7b9f-407d-b818-e03d2e489155 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d11fe940>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.835452 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4191db3a-7b9f-407d-b818-e03d2e489155 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.090358 Oct 04 18:16:22.848537 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1786/3602] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.855384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9736aa70-c8fe-40d2-b7d8-387ab0df90b0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d125b430>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.912303 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9736aa70-c8fe-40d2-b7d8-387ab0df90b0 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/acd24e6c-2248-4327-9505-66fea04436b8" status: 200 len: 784 microversion: 2.1 time: 0.060535 Oct 04 18:16:22.922828 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1787/3603] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/images/acd24e6c-2248-4327-9505-66fea04436b8 => generated 784 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:22.933748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a09959ea-f08d-4a89-b774-cc253b12c448 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.938466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a09959ea-f08d-4a89-b774-cc253b12c448 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.954646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a09959ea-f08d-4a89-b774-cc253b12c448 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.955215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a09959ea-f08d-4a89-b774-cc253b12c448 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.955687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a09959ea-f08d-4a89-b774-cc253b12c448 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.962119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a09959ea-f08d-4a89-b774-cc253b12c448 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.962643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a09959ea-f08d-4a89-b774-cc253b12c448 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.965680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a09959ea-f08d-4a89-b774-cc253b12c448 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.009949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d474c53-250f-4579-8317-5446cc9b0521 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:23.026515 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d474c53-250f-4579-8317-5446cc9b0521 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.306581 Oct 04 18:16:23.027372 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1817/3604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:23.033995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-14241045-077c-42ec-8c22-ed8207d51471 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d12e0040>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.118545 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-14241045-077c-42ec-8c22-ed8207d51471 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.088861 Oct 04 18:16:23.130834 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1818/3605] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:23.136027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e3e18484-c771-4be2-99da-6beda8397d9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.136751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e3e18484-c771-4be2-99da-6beda8397d9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.143342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3e18484-c771-4be2-99da-6beda8397d9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.144111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3e18484-c771-4be2-99da-6beda8397d9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.144737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3e18484-c771-4be2-99da-6beda8397d9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.145649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3e18484-c771-4be2-99da-6beda8397d9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.146109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3e18484-c771-4be2-99da-6beda8397d9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.146719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e3e18484-c771-4be2-99da-6beda8397d9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.169261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a09959ea-f08d-4a89-b774-cc253b12c448 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:23.177968 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a09959ea-f08d-4a89-b774-cc253b12c448 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.254437 Oct 04 18:16:23.178543 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1788/3606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:23.188705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-544f423d-ce7b-49cc-890a-f9bd48774960 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1268ca0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.299848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e3e18484-c771-4be2-99da-6beda8397d9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:23.320184 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e3e18484-c771-4be2-99da-6beda8397d9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.187835 Oct 04 18:16:23.320778 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1819/3607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:23.490793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a952540e-5382-4ecd-8bdb-121b516e9fe4 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Calling method '.version_select at 0x7fd4d615f1f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.577346 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a952540e-5382-4ecd-8bdb-121b516e9fe4 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41" status: 200 len: 371 microversion: 2.1 time: 0.255152 Oct 04 18:16:23.577946 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1820/3608] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 => generated 371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:23.582737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-026af5c9-df73-4a7c-a46a-7393b4b4ef42 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.583760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-026af5c9-df73-4a7c-a46a-7393b4b4ef42 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.590807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026af5c9-df73-4a7c-a46a-7393b4b4ef42 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.591363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026af5c9-df73-4a7c-a46a-7393b4b4ef42 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.591812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026af5c9-df73-4a7c-a46a-7393b4b4ef42 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.593235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026af5c9-df73-4a7c-a46a-7393b4b4ef42 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.593651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026af5c9-df73-4a7c-a46a-7393b4b4ef42 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.594093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026af5c9-df73-4a7c-a46a-7393b4b4ef42 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.738838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-026af5c9-df73-4a7c-a46a-7393b4b4ef42 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:23.748029 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-026af5c9-df73-4a7c-a46a-7393b4b4ef42 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1313 microversion: 2.1 time: 0.168772 Oct 04 18:16:23.748876 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1821/3609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:23.770732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9685a61f-696f-4ea2-a368-93dbe3607552 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:23.773148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9685a61f-696f-4ea2-a368-93dbe3607552 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: 6fa715c5-656e-43ae-8cd1-ce227a143dfb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.778856 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-9685a61f-696f-4ea2-a368-93dbe3607552 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 6fa715c5-656e-43ae-8cd1-ce227a143dfb could not be found. Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9685a61f-696f-4ea2-a368-93dbe3607552 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/6fa715c5-656e-43ae-8cd1-ce227a143dfb/action HTTP/1.1 Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 39 Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: {"os-getConsoleOutput": {"length": 10}} Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 6fa715c5-656e-43ae-8cd1-ce227a143dfb could not be found. Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '6fa715c5-656e-43ae-8cd1-ce227a143dfb', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fa715c5-656e-43ae-8cd1-ce227a143dfb could not be found. Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fa715c5-656e-43ae-8cd1-ce227a143dfb could not be found. Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:23.782877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:23.788136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:23.788136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:23.788136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:23.788136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:23.788136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fa715c5-656e-43ae-8cd1-ce227a143dfb could not be found. Oct 04 18:16:23.788136 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:23.788136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9685a61f-696f-4ea2-a368-93dbe3607552 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 6fa715c5-656e-43ae-8cd1-ce227a143dfb could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:23.788136 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9685a61f-696f-4ea2-a368-93dbe3607552 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/6fa715c5-656e-43ae-8cd1-ce227a143dfb/action" status: 404 len: 111 microversion: 2.1 time: 0.020815 Oct 04 18:16:23.788136 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1822/3610] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:23 2022] POST /compute/v2.1/servers/6fa715c5-656e-43ae-8cd1-ce227a143dfb/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:23.791894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-593117da-b5d4-4d89-bf62-27180ed0dc1c req-10e82748-532f-448d-9a4f-8b562194559f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d", "name": "network-vif-deleted", "tag": "ef6e1b3d-27ec-415e-8f37-f620c17d81ce"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:23.806996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-593117da-b5d4-4d89-bf62-27180ed0dc1c req-10e82748-532f-448d-9a4f-8b562194559f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.807783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-593117da-b5d4-4d89-bf62-27180ed0dc1c req-10e82748-532f-448d-9a4f-8b562194559f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.809041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-593117da-b5d4-4d89-bf62-27180ed0dc1c req-10e82748-532f-448d-9a4f-8b562194559f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.828812 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-593117da-b5d4-4d89-bf62-27180ed0dc1c req-10e82748-532f-448d-9a4f-8b562194559f service nova] Creating event network-vif-deleted:ef6e1b3d-27ec-415e-8f37-f620c17d81ce for instance c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d on n-h2-850499-14 Oct 04 18:16:23.834232 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-593117da-b5d4-4d89-bf62-27180ed0dc1c req-10e82748-532f-448d-9a4f-8b562194559f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046729 Oct 04 18:16:23.835474 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1823/3611] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:23.843324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4484102b-989c-4ebc-94e7-f850a71965c1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.844044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4484102b-989c-4ebc-94e7-f850a71965c1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.848373 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-544f423d-ce7b-49cc-890a-f9bd48774960 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "DELETE /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0" status: 204 len: 0 microversion: 2.1 time: 0.668525 Oct 04 18:16:23.849045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1789/3612] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] DELETE /compute/v2.1/images/055506a6-8c6f-4891-82dd-f7380edf9ad0 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:23.853813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4484102b-989c-4ebc-94e7-f850a71965c1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.853975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-89b60922-16d2-41af-a20c-3d3f824eec91 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d12689d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:23.854406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4484102b-989c-4ebc-94e7-f850a71965c1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.854856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4484102b-989c-4ebc-94e7-f850a71965c1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.855671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4484102b-989c-4ebc-94e7-f850a71965c1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.856143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4484102b-989c-4ebc-94e7-f850a71965c1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.856631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4484102b-989c-4ebc-94e7-f850a71965c1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.926647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=50,nova_cell0:UPDATE=7 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:23.930453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89b60922-16d2-41af-a20c-3d3f824eec91 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.930966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89b60922-16d2-41af-a20c-3d3f824eec91 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.931514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89b60922-16d2-41af-a20c-3d3f824eec91 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.932374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89b60922-16d2-41af-a20c-3d3f824eec91 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.932841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89b60922-16d2-41af-a20c-3d3f824eec91 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.933708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89b60922-16d2-41af-a20c-3d3f824eec91 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.987169 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-89b60922-16d2-41af-a20c-3d3f824eec91 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41" status: 200 len: 328 microversion: 2.1 time: 0.136909 Oct 04 18:16:24.001240 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1790/3613] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:16:23 2022] PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 => generated 328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:24.001240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.001240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.001240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.001240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.001240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.001240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.001938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.001938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.021371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4484102b-989c-4ebc-94e7-f850a71965c1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.030212 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4484102b-989c-4ebc-94e7-f850a71965c1 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1508 microversion: 2.1 time: 0.193376 Oct 04 18:16:24.032285 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1824/3614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:24.035112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.035611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.036050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.036517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lazy-loading 'fault' on Instance uuid c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:24.044626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e9ea3c22-a0ac-46fe-89cb-6e481a3cdd92 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.045284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e9ea3c22-a0ac-46fe-89cb-6e481a3cdd92 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.053128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9ea3c22-a0ac-46fe-89cb-6e481a3cdd92 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.053913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9ea3c22-a0ac-46fe-89cb-6e481a3cdd92 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.055088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9ea3c22-a0ac-46fe-89cb-6e481a3cdd92 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.056029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9ea3c22-a0ac-46fe-89cb-6e481a3cdd92 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.057194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9ea3c22-a0ac-46fe-89cb-6e481a3cdd92 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.057637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9ea3c22-a0ac-46fe-89cb-6e481a3cdd92 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.097105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceaf15178a4f42b79889361f0f3aa327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f378edebea4842199a63aaa7fdc71e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.108856 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-44fe8b7a-1392-44ca-9ede-f9605e9df412 tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 200 len: 1306 microversion: 2.1 time: 0.119421 Oct 04 18:16:24.109480 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1791/3615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 1306 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:24.114027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c169e7e-37e6-4a3a-9d74-d13bcf13dcc6 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d11fe790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.196629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e9ea3c22-a0ac-46fe-89cb-6e481a3cdd92 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.205185 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e9ea3c22-a0ac-46fe-89cb-6e481a3cdd92 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.171809 Oct 04 18:16:24.205737 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1825/3616] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:24 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:24.210587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-93313523-692d-46b8-a755-11603a688329 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.211230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-93313523-692d-46b8-a755-11603a688329 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.219115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93313523-692d-46b8-a755-11603a688329 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.219722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93313523-692d-46b8-a755-11603a688329 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.220269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93313523-692d-46b8-a755-11603a688329 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.220867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93313523-692d-46b8-a755-11603a688329 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.221416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93313523-692d-46b8-a755-11603a688329 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.221745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93313523-692d-46b8-a755-11603a688329 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.384658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-93313523-692d-46b8-a755-11603a688329 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.388127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:24.396333 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-93313523-692d-46b8-a755-11603a688329 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1508 microversion: 2.1 time: 0.189093 Oct 04 18:16:24.397550 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1826/3617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:24 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:24.477847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-101774623", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:24.533899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:24.617248 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3c169e7e-37e6-4a3a-9d74-d13bcf13dcc6 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "DELETE /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4" status: 204 len: 0 microversion: 2.1 time: 0.506522 Oct 04 18:16:24.618281 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1792/3618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:24 2022] DELETE /compute/v2.1/images/aaac8d02-a592-4a5c-992d-da44b0e1cda4 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:24.623672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2d789b5e-1ca0-46d7-b565-3d5acf4ad6c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.625089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2d789b5e-1ca0-46d7-b565-3d5acf4ad6c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.634796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d789b5e-1ca0-46d7-b565-3d5acf4ad6c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.635651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d789b5e-1ca0-46d7-b565-3d5acf4ad6c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.637324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d789b5e-1ca0-46d7-b565-3d5acf4ad6c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.638286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d789b5e-1ca0-46d7-b565-3d5acf4ad6c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.639667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d789b5e-1ca0-46d7-b565-3d5acf4ad6c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.640350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d789b5e-1ca0-46d7-b565-3d5acf4ad6c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.820902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:24.821404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:24.821900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:24.822326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:24.822813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:24.832805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.833299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.833744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.834570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.835376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.835811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.845966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2d789b5e-1ca0-46d7-b565-3d5acf4ad6c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.855128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Getting quotas for project 7875fe6c59d446089e886d3243aa1d41. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:24.855926 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2d789b5e-1ca0-46d7-b565-3d5acf4ad6c9 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.235696 Oct 04 18:16:24.857470 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1793/3619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:24 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:24.861495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Getting quotas for user b2d8c77726a44802a9ec2c2bdcf720ea and project 7875fe6c59d446089e886d3243aa1d41. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:24.865213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df05563c-1626-4555-8815-27615f77ffae tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.866093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df05563c-1626-4555-8815-27615f77ffae tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.875968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df05563c-1626-4555-8815-27615f77ffae tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.877275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df05563c-1626-4555-8815-27615f77ffae tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.877949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df05563c-1626-4555-8815-27615f77ffae tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.879409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df05563c-1626-4555-8815-27615f77ffae tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.880269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df05563c-1626-4555-8815-27615f77ffae tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.880909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.utils [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] cores quota exceeded for 7875fe6c59d446089e886d3243aa1d41, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122332) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:16:24.881697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df05563c-1626-4555-8815-27615f77ffae tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.881821 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Request method failure captured: Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 144 Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHh26kZtYtqyEjP5PFaH2_rOK3mCehDT4K4ky0Qh-YXrgPDfUFuBJr6g8bq4-4YiuVDLqCPl_mFLoq0Apu1bvGAWzsjEUYe5wPVOw9nD1aGApecVeHpg5zTMhRtbkFzH4XjOoA9ZKZ9-VA2WDsywaajiLXXHD3rYsKqNOeLvngSXV-o Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 7875fe6c59d446089e886d3243aa1d41 Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7875fe6c59d446089e886d3243aa1d41"}]}] Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 7875fe6c59d446089e886d3243aa1d41 Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-QuotasAdminNegativeTest-760340112-project Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b2d8c77726a44802a9ec2c2bdcf720ea Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-QuotasAdminNegativeTest-760340112-project Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-101774623", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-101774623', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452'}}} Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:16:24.885931 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fcc27776-b624-4a43-8dcc-0af09b074404 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.488142 Oct 04 18:16:24.891160 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1827/3620] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:24 2022] POST /compute/v2.1/servers => generated 111 bytes in 490 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:24.895004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-83715181-6a83-4dcf-a7a3-fdb03ef15e87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:24.896792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-83715181-6a83-4dcf-a7a3-fdb03ef15e87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.903907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83715181-6a83-4dcf-a7a3-fdb03ef15e87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.904444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83715181-6a83-4dcf-a7a3-fdb03ef15e87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.904887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83715181-6a83-4dcf-a7a3-fdb03ef15e87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.905659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83715181-6a83-4dcf-a7a3-fdb03ef15e87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.906120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83715181-6a83-4dcf-a7a3-fdb03ef15e87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.906552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83715181-6a83-4dcf-a7a3-fdb03ef15e87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.985258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-83715181-6a83-4dcf-a7a3-fdb03ef15e87 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "PUT /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1080 microversion: 2.1 time: 0.095631 Oct 04 18:16:24.985916 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1828/3621] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 4 18:16:24 2022] PUT /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1080 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:25.000384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-64e33320-bfa2-4556-a6e4-2792c6042c4f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1428820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.049821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df05563c-1626-4555-8815-27615f77ffae tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.057897 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df05563c-1626-4555-8815-27615f77ffae tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.198660 Oct 04 18:16:25.058743 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1794/3622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:24 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:25.064634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8a725273-97bc-442c-8deb-2e5683a911ab req-83e7543a-6dbb-43ff-8843-c78d5ab4aa28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60a0cde-531d-4bb9-b6cd-5ad8954a2f08", "name": "network-vif-plugged", "status": "completed", "tag": "5ae340a3-b41e-4bbe-b5d1-12a40c3d7d15"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:25.077584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8a725273-97bc-442c-8deb-2e5683a911ab req-83e7543a-6dbb-43ff-8843-c78d5ab4aa28 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.078204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8a725273-97bc-442c-8deb-2e5683a911ab req-83e7543a-6dbb-43ff-8843-c78d5ab4aa28 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.079046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8a725273-97bc-442c-8deb-2e5683a911ab req-83e7543a-6dbb-43ff-8843-c78d5ab4aa28 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.093481 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8a725273-97bc-442c-8deb-2e5683a911ab req-83e7543a-6dbb-43ff-8843-c78d5ab4aa28 service nova] Creating event network-vif-plugged:5ae340a3-b41e-4bbe-b5d1-12a40c3d7d15 for instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 on n-h1-850499-14 Oct 04 18:16:25.098813 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8a725273-97bc-442c-8deb-2e5683a911ab req-83e7543a-6dbb-43ff-8843-c78d5ab4aa28 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038836 Oct 04 18:16:25.099785 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1795/3623] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:25.105056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e489f6ee-bd56-40fe-a0c0-56148c347f81 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.105946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e489f6ee-bd56-40fe-a0c0-56148c347f81 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.113222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e489f6ee-bd56-40fe-a0c0-56148c347f81 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.113660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e489f6ee-bd56-40fe-a0c0-56148c347f81 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.114110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e489f6ee-bd56-40fe-a0c0-56148c347f81 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.114819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e489f6ee-bd56-40fe-a0c0-56148c347f81 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.115326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e489f6ee-bd56-40fe-a0c0-56148c347f81 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.115759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e489f6ee-bd56-40fe-a0c0-56148c347f81 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.323347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e489f6ee-bd56-40fe-a0c0-56148c347f81 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.332632 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e489f6ee-bd56-40fe-a0c0-56148c347f81 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1313 microversion: 2.1 time: 0.231367 Oct 04 18:16:25.333333 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1796/3624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:25.350916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da39dc79-a61d-49c9-8cf1-3d127a145a7c tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d121c310>, body: {"quota_set": {"cores": 20}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:25.417870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da39dc79-a61d-49c9-8cf1-3d127a145a7c tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.418355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da39dc79-a61d-49c9-8cf1-3d127a145a7c tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.418791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da39dc79-a61d-49c9-8cf1-3d127a145a7c tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.419548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da39dc79-a61d-49c9-8cf1-3d127a145a7c tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.419992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da39dc79-a61d-49c9-8cf1-3d127a145a7c tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.420430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da39dc79-a61d-49c9-8cf1-3d127a145a7c tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.469481 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-64e33320-bfa2-4556-a6e4-2792c6042c4f tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "DELETE /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b" status: 204 len: 0 microversion: 2.1 time: 0.473264 Oct 04 18:16:25.470050 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1829/3625] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:24 2022] DELETE /compute/v2.1/images/a656a3c2-d761-4de8-8fe3-305dfbeea14b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:25.474879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d41f45ea-dc77-4511-8706-11ef9e97679a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.475523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d41f45ea-dc77-4511-8706-11ef9e97679a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.481559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d41f45ea-dc77-4511-8706-11ef9e97679a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.481979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d41f45ea-dc77-4511-8706-11ef9e97679a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.482421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d41f45ea-dc77-4511-8706-11ef9e97679a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.483665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d41f45ea-dc77-4511-8706-11ef9e97679a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.484111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d41f45ea-dc77-4511-8706-11ef9e97679a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.484538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d41f45ea-dc77-4511-8706-11ef9e97679a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.484650 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-da39dc79-a61d-49c9-8cf1-3d127a145a7c tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41" status: 200 len: 329 microversion: 2.1 time: 0.150135 Oct 04 18:16:25.485153 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1797/3626] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:16:25 2022] PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 => generated 329 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:25.489673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d11916ee-39aa-46c4-8657-638d698e88b5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.490282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d11916ee-39aa-46c4-8657-638d698e88b5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: 962e2a06-5a08-4f2a-8ea5-e43c614a7434] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.496566 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-d11916ee-39aa-46c4-8657-638d698e88b5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 962e2a06-5a08-4f2a-8ea5-e43c614a7434 could not be found. Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d11916ee-39aa-46c4-8657-638d698e88b5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/962e2a06-5a08-4f2a-8ea5-e43c614a7434 HTTP/1.1 Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 962e2a06-5a08-4f2a-8ea5-e43c614a7434 could not be found. Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '962e2a06-5a08-4f2a-8ea5-e43c614a7434'} Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 962e2a06-5a08-4f2a-8ea5-e43c614a7434 could not be found. Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962e2a06-5a08-4f2a-8ea5-e43c614a7434 could not be found. Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:25.498158 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:25.503811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:25.503811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:25.503811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:25.503811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962e2a06-5a08-4f2a-8ea5-e43c614a7434 could not be found. Oct 04 18:16:25.503811 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:25.503811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d11916ee-39aa-46c4-8657-638d698e88b5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 962e2a06-5a08-4f2a-8ea5-e43c614a7434 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:25.503811 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d11916ee-39aa-46c4-8657-638d698e88b5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/962e2a06-5a08-4f2a-8ea5-e43c614a7434" status: 404 len: 111 microversion: 2.1 time: 0.013530 Oct 04 18:16:25.503811 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1798/3627] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/962e2a06-5a08-4f2a-8ea5-e43c614a7434 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:25.505423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.506025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] [instance: c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.511641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.512149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.512593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.513294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.513756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.514186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.527934 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] HTTP exception thrown: Instance c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d could not be found. Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Request method failure captured: Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d HTTP/1.1 Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHhN5Wyf_bU93_DAGkmqHJib-8lGG4nzWz-L7_6dHKD0gxUE9qWHdYDxvuxyMuFzp4c5p510hH4nYksmAqxX_V3suaJUYJZPUt0qLhhEaezpEAW8krX52VQmrDz0dZQ75Gb-XW8mx3yZjuHk2S4yHk_6KgC0y2mu7elu3L-BWzErTIs Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: f378edebea4842199a63aaa7fdc71e73 Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-InstanceActionsTestJSON-1976635453 Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f378edebea4842199a63aaa7fdc71e73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f378edebea4842199a63aaa7fdc71e73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f378edebea4842199a63aaa7fdc71e73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f378edebea4842199a63aaa7fdc71e73"}]}] Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-InstanceActionsTestJSON-1976635453 Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: f378edebea4842199a63aaa7fdc71e73 Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1976635453 Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-InstanceActionsTestJSON-1976635453-project Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ceaf15178a4f42b79889361f0f3aa327 Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-InstanceActionsTestJSON-1976635453-project Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d could not be found. Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d'} Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d could not be found. Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d could not be found. Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:25.529449 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:25.535070 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:25.535070 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:25.535070 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:25.535070 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:25.535070 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:25.535070 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d could not be found. Oct 04 18:16:25.535070 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:25.535070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] Returning 404 to user: Instance c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:25.535070 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eeb281a2-b968-44fb-8a5b-28ac37d8f92e tempest-InstanceActionsTestJSON-1976635453 tempest-InstanceActionsTestJSON-1976635453-project] 10.222.0.18 "GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d" status: 404 len: 111 microversion: 2.1 time: 0.029888 Oct 04 18:16:25.535070 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1799/3628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/c616f7c4-3a63-45ed-aa7c-1f0d4e2e920d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:25.536141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f8ecb2f-e3f6-4318-a7c2-8cfbc08bf962 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.536436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9f8ecb2f-e3f6-4318-a7c2-8cfbc08bf962 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.542345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8ecb2f-e3f6-4318-a7c2-8cfbc08bf962 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.542795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8ecb2f-e3f6-4318-a7c2-8cfbc08bf962 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.543276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8ecb2f-e3f6-4318-a7c2-8cfbc08bf962 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.543981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8ecb2f-e3f6-4318-a7c2-8cfbc08bf962 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.546822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8ecb2f-e3f6-4318-a7c2-8cfbc08bf962 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.546822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8ecb2f-e3f6-4318-a7c2-8cfbc08bf962 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.573115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9f8ecb2f-e3f6-4318-a7c2-8cfbc08bf962 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:25.636174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d41f45ea-dc77-4511-8706-11ef9e97679a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.645212 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d41f45ea-dc77-4511-8706-11ef9e97679a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1506 microversion: 2.1 time: 0.174158 Oct 04 18:16:25.646060 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1830/3629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:25.659359 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9f8ecb2f-e3f6-4318-a7c2-8cfbc08bf962 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 204 len: 0 microversion: 2.1 time: 0.126406 Oct 04 18:16:25.660517 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1800/3630] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:25 2022] DELETE /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:25.666979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a65cf2ce-5f31-402d-9346-2c14002d5e8e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.667726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a65cf2ce-5f31-402d-9346-2c14002d5e8e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.672320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bde5e938-464a-4b1b-88f1-8b3df625b7e3 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Calling method '.version_select at 0x7fd4d1277820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.674365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a65cf2ce-5f31-402d-9346-2c14002d5e8e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.674860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a65cf2ce-5f31-402d-9346-2c14002d5e8e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.675326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a65cf2ce-5f31-402d-9346-2c14002d5e8e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.676209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a65cf2ce-5f31-402d-9346-2c14002d5e8e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.676837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a65cf2ce-5f31-402d-9346-2c14002d5e8e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.677309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a65cf2ce-5f31-402d-9346-2c14002d5e8e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.748174 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bde5e938-464a-4b1b-88f1-8b3df625b7e3 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41" status: 200 len: 371 microversion: 2.1 time: 0.087023 Oct 04 18:16:25.748656 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1831/3631] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:25.760858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d377a41-9693-401e-a8a8-435caf814bbd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.761711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1d377a41-9693-401e-a8a8-435caf814bbd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.768649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d377a41-9693-401e-a8a8-435caf814bbd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.769146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d377a41-9693-401e-a8a8-435caf814bbd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.769594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d377a41-9693-401e-a8a8-435caf814bbd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.770385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d377a41-9693-401e-a8a8-435caf814bbd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.770846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d377a41-9693-401e-a8a8-435caf814bbd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.771366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d377a41-9693-401e-a8a8-435caf814bbd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.848171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a65cf2ce-5f31-402d-9346-2c14002d5e8e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.858179 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a65cf2ce-5f31-402d-9346-2c14002d5e8e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.196329 Oct 04 18:16:25.867071 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1801/3632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:25.867071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-83dc0307-d6a4-4b02-80be-e375c0488d77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.867071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-83dc0307-d6a4-4b02-80be-e375c0488d77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.871867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83dc0307-d6a4-4b02-80be-e375c0488d77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.872357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83dc0307-d6a4-4b02-80be-e375c0488d77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.873167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83dc0307-d6a4-4b02-80be-e375c0488d77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.874241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83dc0307-d6a4-4b02-80be-e375c0488d77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.874711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83dc0307-d6a4-4b02-80be-e375c0488d77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.875207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83dc0307-d6a4-4b02-80be-e375c0488d77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.957222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d377a41-9693-401e-a8a8-435caf814bbd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.965093 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d377a41-9693-401e-a8a8-435caf814bbd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1474 microversion: 2.1 time: 0.207988 Oct 04 18:16:25.965686 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1832/3633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1474 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:25.979195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-98d80521-cf8b-4c89-8030-1a468bedd907 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d128b0d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:26.035584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-83dc0307-d6a4-4b02-80be-e375c0488d77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.041165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d80521-cf8b-4c89-8030-1a468bedd907 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.041736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d80521-cf8b-4c89-8030-1a468bedd907 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.042178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d80521-cf8b-4c89-8030-1a468bedd907 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.042912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d80521-cf8b-4c89-8030-1a468bedd907 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.043412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d80521-cf8b-4c89-8030-1a468bedd907 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.043608 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-83dc0307-d6a4-4b02-80be-e375c0488d77 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1506 microversion: 2.1 time: 0.182521 Oct 04 18:16:26.043845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d80521-cf8b-4c89-8030-1a468bedd907 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.044105 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1802/3634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:26.049057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-358a40da-204c-4e8c-bada-5ecb8fe76f8f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:26.049644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-358a40da-204c-4e8c-bada-5ecb8fe76f8f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.056375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-358a40da-204c-4e8c-bada-5ecb8fe76f8f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.056878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-358a40da-204c-4e8c-bada-5ecb8fe76f8f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.057326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-358a40da-204c-4e8c-bada-5ecb8fe76f8f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.058033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-358a40da-204c-4e8c-bada-5ecb8fe76f8f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.058753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-358a40da-204c-4e8c-bada-5ecb8fe76f8f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.059225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-358a40da-204c-4e8c-bada-5ecb8fe76f8f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.113325 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-98d80521-cf8b-4c89-8030-1a468bedd907 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41" status: 200 len: 328 microversion: 2.1 time: 0.146333 Oct 04 18:16:26.115127 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1833/3635] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:16:25 2022] PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 => generated 328 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:26.120797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2af3f7e5-8b93-40ee-aea4-7337686b6ce6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:26.122136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2af3f7e5-8b93-40ee-aea4-7337686b6ce6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.130911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af3f7e5-8b93-40ee-aea4-7337686b6ce6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.131444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af3f7e5-8b93-40ee-aea4-7337686b6ce6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.131895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af3f7e5-8b93-40ee-aea4-7337686b6ce6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.132900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af3f7e5-8b93-40ee-aea4-7337686b6ce6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.133369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af3f7e5-8b93-40ee-aea4-7337686b6ce6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.133804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2af3f7e5-8b93-40ee-aea4-7337686b6ce6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.235938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-358a40da-204c-4e8c-bada-5ecb8fe76f8f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.239988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:26.246721 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-358a40da-204c-4e8c-bada-5ecb8fe76f8f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.201512 Oct 04 18:16:26.247531 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1803/3636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:26 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:26.253348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:26.256716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.265907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.266640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.267303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.268207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.269117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.269760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.320629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2af3f7e5-8b93-40ee-aea4-7337686b6ce6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.329931 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2af3f7e5-8b93-40ee-aea4-7337686b6ce6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.213569 Oct 04 18:16:26.343506 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1834/3637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:26 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:26.364024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:26.364595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:26.364718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1839185042", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:26.365280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:26.365795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:26.366426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:26.441822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:26.447502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.455881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.456603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.457202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.458707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.459571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.460162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.508406 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c4779972-844c-4c68-86ce-f79e6bbd1bfd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "POST /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5/action" status: 202 len: 1112 microversion: 2.1 time: 0.258504 Oct 04 18:16:26.509521 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1804/3638] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:26 2022] POST /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5/action => generated 1112 bytes in 261 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:16:26.514261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6e7be9e8-d240-4d2d-8db0-9700b70043d6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:26.514901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6e7be9e8-d240-4d2d-8db0-9700b70043d6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.529408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e7be9e8-d240-4d2d-8db0-9700b70043d6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.530086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e7be9e8-d240-4d2d-8db0-9700b70043d6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.531045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e7be9e8-d240-4d2d-8db0-9700b70043d6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.532057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e7be9e8-d240-4d2d-8db0-9700b70043d6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.532775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e7be9e8-d240-4d2d-8db0-9700b70043d6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.533347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e7be9e8-d240-4d2d-8db0-9700b70043d6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.762504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:26.763065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:26.763438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:26.763852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:26.764274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:26.771983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6e7be9e8-d240-4d2d-8db0-9700b70043d6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.781365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.781774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.782984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6e7be9e8-d240-4d2d-8db0-9700b70043d6 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1313 microversion: 2.1 time: 0.272286 Oct 04 18:16:26.784066 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1805/3639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:26 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:26.786178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.787199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.788430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.788882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.790655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20f1348b-441b-4913-a65d-a33e2d3a66e2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-100866256", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20f1348b-441b-4913-a65d-a33e2d3a66e2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 237 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-100866256", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-100866256', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.805081 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20f1348b-441b-4913-a65d-a33e2d3a66e2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:26.814641 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20f1348b-441b-4913-a65d-a33e2d3a66e2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020777 Oct 04 18:16:26.820683 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1806/3640] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:26 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:16:26.830723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ceaed870-ed1b-4417-b859-f3cb78759eb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:26.832404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ceaed870-ed1b-4417-b859-f3cb78759eb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.839722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:26.844335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Getting quotas for project 7875fe6c59d446089e886d3243aa1d41. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:26.849088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceaed870-ed1b-4417-b859-f3cb78759eb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.849784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceaed870-ed1b-4417-b859-f3cb78759eb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.850417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceaed870-ed1b-4417-b859-f3cb78759eb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.851208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceaed870-ed1b-4417-b859-f3cb78759eb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.851887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceaed870-ed1b-4417-b859-f3cb78759eb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.852143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Getting quotas for user b2d8c77726a44802a9ec2c2bdcf720ea and project 7875fe6c59d446089e886d3243aa1d41. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:26.852457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceaed870-ed1b-4417-b859-f3cb78759eb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.856120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:26.872999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.utils [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] instances quota exceeded for 7875fe6c59d446089e886d3243aa1d41, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122332) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:16:26.874754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Request method failure captured: Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 145 Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHh26kZtYtqyEjP5PFaH2_rOK3mCehDT4K4ky0Qh-YXrgPDfUFuBJr6g8bq4-4YiuVDLqCPl_mFLoq0Apu1bvGAWzsjEUYe5wPVOw9nD1aGApecVeHpg5zTMhRtbkFzH4XjOoA9ZKZ9-VA2WDsywaajiLXXHD3rYsKqNOeLvngSXV-o Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 7875fe6c59d446089e886d3243aa1d41 Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7875fe6c59d446089e886d3243aa1d41"}]}] Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 7875fe6c59d446089e886d3243aa1d41 Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-QuotasAdminNegativeTest-760340112-project Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b2d8c77726a44802a9ec2c2bdcf720ea Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-QuotasAdminNegativeTest-760340112-project Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1839185042", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1839185042', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452'}}} Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:16:26.876851 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0210ff45-156e-491a-8cb9-d33d167e155e tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.533609 Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1835/3641] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:26 2022] POST /compute/v2.1/servers => generated 119 bytes in 535 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:26.885565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74f36dfb-80ea-4b2e-9707-5037d7558233 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:26.889606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-74f36dfb-80ea-4b2e-9707-5037d7558233 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.892296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f36dfb-80ea-4b2e-9707-5037d7558233 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.893355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f36dfb-80ea-4b2e-9707-5037d7558233 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.893829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f36dfb-80ea-4b2e-9707-5037d7558233 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.894546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f36dfb-80ea-4b2e-9707-5037d7558233 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.895175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f36dfb-80ea-4b2e-9707-5037d7558233 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.895611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74f36dfb-80ea-4b2e-9707-5037d7558233 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.087857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ceaed870-ed1b-4417-b859-f3cb78759eb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:27.095578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-74f36dfb-80ea-4b2e-9707-5037d7558233 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:27.096452 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ceaed870-ed1b-4417-b859-f3cb78759eb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.269934 Oct 04 18:16:27.097118 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1807/3642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:26 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:27.101917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc5392f0-014d-46d6-9b5f-0c4db6198542 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d12b2af0>, body: {"quota_set": {"instances": 10}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:27.118677 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74f36dfb-80ea-4b2e-9707-5037d7558233 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.238331 Oct 04 18:16:27.119502 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1836/3643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:26 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:27.128295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-34b22cef-e62f-4c0d-87b0-fbafbd31f87c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.128963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-34b22cef-e62f-4c0d-87b0-fbafbd31f87c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.135274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34b22cef-e62f-4c0d-87b0-fbafbd31f87c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.135819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34b22cef-e62f-4c0d-87b0-fbafbd31f87c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.136265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34b22cef-e62f-4c0d-87b0-fbafbd31f87c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.137019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34b22cef-e62f-4c0d-87b0-fbafbd31f87c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.137683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34b22cef-e62f-4c0d-87b0-fbafbd31f87c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.138283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34b22cef-e62f-4c0d-87b0-fbafbd31f87c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.184329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5392f0-014d-46d6-9b5f-0c4db6198542 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.185129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5392f0-014d-46d6-9b5f-0c4db6198542 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.185573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5392f0-014d-46d6-9b5f-0c4db6198542 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.186539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5392f0-014d-46d6-9b5f-0c4db6198542 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.187211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5392f0-014d-46d6-9b5f-0c4db6198542 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.187989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc5392f0-014d-46d6-9b5f-0c4db6198542 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.267852 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc5392f0-014d-46d6-9b5f-0c4db6198542 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41" status: 200 len: 329 microversion: 2.1 time: 0.169201 Oct 04 18:16:27.268772 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1808/3644] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:16:27 2022] PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 => generated 329 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:27.285926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e4500f8e-8e66-4e70-9f4b-8d836ee4ad8d req-cd9c7c9b-bc39-4775-b279-a974bf0ac883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1184e3-4cd3-4bf9-a52e-1047d7e3c682", "name": "network-vif-plugged", "status": "completed", "tag": "66782b7e-7ca9-4644-8501-a1a346eb483b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:27.286656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-34b22cef-e62f-4c0d-87b0-fbafbd31f87c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:27.296499 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-34b22cef-e62f-4c0d-87b0-fbafbd31f87c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1474 microversion: 2.1 time: 0.174647 Oct 04 18:16:27.297215 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1837/3645] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1474 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:27.303860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2030870e-86d2-4c13-9386-10b10fd75d62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.304616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2030870e-86d2-4c13-9386-10b10fd75d62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.305072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e4500f8e-8e66-4e70-9f4b-8d836ee4ad8d req-cd9c7c9b-bc39-4775-b279-a974bf0ac883 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.305576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e4500f8e-8e66-4e70-9f4b-8d836ee4ad8d req-cd9c7c9b-bc39-4775-b279-a974bf0ac883 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.308060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e4500f8e-8e66-4e70-9f4b-8d836ee4ad8d req-cd9c7c9b-bc39-4775-b279-a974bf0ac883 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.315477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2030870e-86d2-4c13-9386-10b10fd75d62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.316665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2030870e-86d2-4c13-9386-10b10fd75d62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.317223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2030870e-86d2-4c13-9386-10b10fd75d62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.318059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2030870e-86d2-4c13-9386-10b10fd75d62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.318623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2030870e-86d2-4c13-9386-10b10fd75d62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.319183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2030870e-86d2-4c13-9386-10b10fd75d62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.325308 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e4500f8e-8e66-4e70-9f4b-8d836ee4ad8d req-cd9c7c9b-bc39-4775-b279-a974bf0ac883 service nova] Creating event network-vif-plugged:66782b7e-7ca9-4644-8501-a1a346eb483b for instance de1184e3-4cd3-4bf9-a52e-1047d7e3c682 on n-h1-850499-14 Oct 04 18:16:27.331433 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e4500f8e-8e66-4e70-9f4b-8d836ee4ad8d req-cd9c7c9b-bc39-4775-b279-a974bf0ac883 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061212 Oct 04 18:16:27.332328 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1809/3646] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:27.337911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-52a87b9d-0339-40de-8e2d-8b677654cc20 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Calling method '.version_select at 0x7fd4d11fedc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.430051 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-52a87b9d-0339-40de-8e2d-8b677654cc20 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41" status: 200 len: 371 microversion: 2.1 time: 0.096638 Oct 04 18:16:27.447429 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1810/3647] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:27.452490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4b576e2-662a-492f-a5df-ee13a3322ee6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.453639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4b576e2-662a-492f-a5df-ee13a3322ee6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.460977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4b576e2-662a-492f-a5df-ee13a3322ee6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.462187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4b576e2-662a-492f-a5df-ee13a3322ee6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.462746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4b576e2-662a-492f-a5df-ee13a3322ee6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.463910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4b576e2-662a-492f-a5df-ee13a3322ee6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.464509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4b576e2-662a-492f-a5df-ee13a3322ee6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.465043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4b576e2-662a-492f-a5df-ee13a3322ee6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.497896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2030870e-86d2-4c13-9386-10b10fd75d62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:27.506270 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2030870e-86d2-4c13-9386-10b10fd75d62 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.207349 Oct 04 18:16:27.507464 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1838/3648] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:27.513663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-210edbb8-4cea-4ede-a714-2906446272b7 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d128ba60>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:27.635220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210edbb8-4cea-4ede-a714-2906446272b7 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.635718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210edbb8-4cea-4ede-a714-2906446272b7 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.636158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210edbb8-4cea-4ede-a714-2906446272b7 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.636887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210edbb8-4cea-4ede-a714-2906446272b7 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.637337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210edbb8-4cea-4ede-a714-2906446272b7 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.643694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210edbb8-4cea-4ede-a714-2906446272b7 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.673166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c4b576e2-662a-492f-a5df-ee13a3322ee6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:27.683802 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c4b576e2-662a-492f-a5df-ee13a3322ee6 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.234846 Oct 04 18:16:27.684738 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1811/3649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:27.703722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d9973a9d-4d3f-4361-b6cb-4ba3f5a7bbc5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-223504387", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d9973a9d-4d3f-4361-b6cb-4ba3f5a7bbc5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 234 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-223504387", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-223504387', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:27.712067 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d9973a9d-4d3f-4361-b6cb-4ba3f5a7bbc5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d9973a9d-4d3f-4361-b6cb-4ba3f5a7bbc5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.027623 Oct 04 18:16:27.717073 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1812/3650] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:27 2022] POST /compute/v2.1/servers => generated 133 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:16:27.723783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fb006a6e-2cda-4657-accd-a684aa708e60 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.724489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb006a6e-2cda-4657-accd-a684aa708e60 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.735140 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-210edbb8-4cea-4ede-a714-2906446272b7 tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41" status: 200 len: 325 microversion: 2.1 time: 0.226265 Oct 04 18:16:27.736096 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1839/3651] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:16:27 2022] PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 => generated 325 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:27.736322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb006a6e-2cda-4657-accd-a684aa708e60 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.736933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb006a6e-2cda-4657-accd-a684aa708e60 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.737935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb006a6e-2cda-4657-accd-a684aa708e60 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.738280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb006a6e-2cda-4657-accd-a684aa708e60 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.739005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb006a6e-2cda-4657-accd-a684aa708e60 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.739556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb006a6e-2cda-4657-accd-a684aa708e60 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.807777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f12e69ea-eee1-47e8-aec3-602fff3866df tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.808763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f12e69ea-eee1-47e8-aec3-602fff3866df tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.818779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f12e69ea-eee1-47e8-aec3-602fff3866df tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.819504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f12e69ea-eee1-47e8-aec3-602fff3866df tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.820142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f12e69ea-eee1-47e8-aec3-602fff3866df tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.821218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f12e69ea-eee1-47e8-aec3-602fff3866df tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.821849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f12e69ea-eee1-47e8-aec3-602fff3866df tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.822449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f12e69ea-eee1-47e8-aec3-602fff3866df tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.040661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fb006a6e-2cda-4657-accd-a684aa708e60 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.052229 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fb006a6e-2cda-4657-accd-a684aa708e60 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.332550 Oct 04 18:16:28.053226 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1813/3652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:28.078166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1397305733", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:28.129715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f12e69ea-eee1-47e8-aec3-602fff3866df tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.136945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:28.141557 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f12e69ea-eee1-47e8-aec3-602fff3866df tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1313 microversion: 2.1 time: 0.337515 Oct 04 18:16:28.142238 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1840/3653] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:28.162458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e741c3ca-8b3e-4056-b491-c0a730f4ecd0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:28.163196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e741c3ca-8b3e-4056-b491-c0a730f4ecd0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.172145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e741c3ca-8b3e-4056-b491-c0a730f4ecd0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.172965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e741c3ca-8b3e-4056-b491-c0a730f4ecd0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.173622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e741c3ca-8b3e-4056-b491-c0a730f4ecd0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.174480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e741c3ca-8b3e-4056-b491-c0a730f4ecd0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.175071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e741c3ca-8b3e-4056-b491-c0a730f4ecd0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.175599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e741c3ca-8b3e-4056-b491-c0a730f4ecd0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.515193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e741c3ca-8b3e-4056-b491-c0a730f4ecd0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.523555 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e741c3ca-8b3e-4056-b491-c0a730f4ecd0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.375709 Oct 04 18:16:28.524469 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1841/3654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:28 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:28.529660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a3091fb9-5bf1-41ed-9aba-0d387da1b25b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:28.530583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a3091fb9-5bf1-41ed-9aba-0d387da1b25b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.537213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3091fb9-5bf1-41ed-9aba-0d387da1b25b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.537784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3091fb9-5bf1-41ed-9aba-0d387da1b25b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.538442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3091fb9-5bf1-41ed-9aba-0d387da1b25b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.539245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3091fb9-5bf1-41ed-9aba-0d387da1b25b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.539811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3091fb9-5bf1-41ed-9aba-0d387da1b25b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.540314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3091fb9-5bf1-41ed-9aba-0d387da1b25b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.585216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:28.585977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:28.586983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:28.587617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:28.589585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:28.602311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.603176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.603812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.604663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.605545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.606167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.625900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Getting quotas for project 7875fe6c59d446089e886d3243aa1d41. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:28.631536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Getting quotas for user b2d8c77726a44802a9ec2c2bdcf720ea and project 7875fe6c59d446089e886d3243aa1d41. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:28.645725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.utils [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] ram quota exceeded for 7875fe6c59d446089e886d3243aa1d41, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122331) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:16:28.646186 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Request method failure captured: Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 145 Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHh26kZtYtqyEjP5PFaH2_rOK3mCehDT4K4ky0Qh-YXrgPDfUFuBJr6g8bq4-4YiuVDLqCPl_mFLoq0Apu1bvGAWzsjEUYe5wPVOw9nD1aGApecVeHpg5zTMhRtbkFzH4XjOoA9ZKZ9-VA2WDsywaajiLXXHD3rYsKqNOeLvngSXV-o Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 7875fe6c59d446089e886d3243aa1d41 Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7875fe6c59d446089e886d3243aa1d41"}]}] Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 7875fe6c59d446089e886d3243aa1d41 Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-QuotasAdminNegativeTest-760340112-project Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b2d8c77726a44802a9ec2c2bdcf720ea Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-QuotasAdminNegativeTest-760340112-project Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1397305733", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1397305733', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452'}}} Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:16:28.648781 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:16:28.653526 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.657480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:28.658560 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40ede05b-1414-4fce-a914-d00902ad3ad9 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.588913 Oct 04 18:16:28.659355 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1814/3655] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 606 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:28.664200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2cb601d2-7491-4d65-8c7b-de5817b345cc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:28.665697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2cb601d2-7491-4d65-8c7b-de5817b345cc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.673773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cb601d2-7491-4d65-8c7b-de5817b345cc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.674457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cb601d2-7491-4d65-8c7b-de5817b345cc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.675285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cb601d2-7491-4d65-8c7b-de5817b345cc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.676156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cb601d2-7491-4d65-8c7b-de5817b345cc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.676790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cb601d2-7491-4d65-8c7b-de5817b345cc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.677221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cb601d2-7491-4d65-8c7b-de5817b345cc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.839407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2cb601d2-7491-4d65-8c7b-de5817b345cc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.849250 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2cb601d2-7491-4d65-8c7b-de5817b345cc tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 200 len: 1432 microversion: 2.1 time: 0.188582 Oct 04 18:16:28.850330 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1815/3656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:28 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 1432 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:28.872206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c436f130-9023-4f90-abd5-238c324881fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:28.872780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c436f130-9023-4f90-abd5-238c324881fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: eca21686-cdd4-4373-9a06-3a82379bc300] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.881043 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c436f130-9023-4f90-abd5-238c324881fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance eca21686-cdd4-4373-9a06-3a82379bc300 could not be found. Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c436f130-9023-4f90-abd5-238c324881fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/eca21686-cdd4-4373-9a06-3a82379bc300/action HTTP/1.1 Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 13 Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: {"pause": {}} Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance eca21686-cdd4-4373-9a06-3a82379bc300 could not be found. Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'eca21686-cdd4-4373-9a06-3a82379bc300', 'body': {'pause': {}}} Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca21686-cdd4-4373-9a06-3a82379bc300 could not be found. Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca21686-cdd4-4373-9a06-3a82379bc300 could not be found. Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:28.894258 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:28.898770 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:28.898770 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:28.898770 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca21686-cdd4-4373-9a06-3a82379bc300 could not be found. Oct 04 18:16:28.898770 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.899860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c436f130-9023-4f90-abd5-238c324881fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance eca21686-cdd4-4373-9a06-3a82379bc300 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:28.901700 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c436f130-9023-4f90-abd5-238c324881fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/eca21686-cdd4-4373-9a06-3a82379bc300/action" status: 404 len: 111 microversion: 2.1 time: 0.049746 Oct 04 18:16:28.903843 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1816/3657] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:28 2022] POST /compute/v2.1/servers/eca21686-cdd4-4373-9a06-3a82379bc300/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:28.910748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3091fb9-5bf1-41ed-9aba-0d387da1b25b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.911604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-58284685-2046-4fb6-a26f-45bf89bb281f tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Action: 'update', calling method: .version_select at 0x7fd4d128d9d0>, body: {"quota_set": {"ram": 51200}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:28.936874 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a3091fb9-5bf1-41ed-9aba-0d387da1b25b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.410388 Oct 04 18:16:28.937496 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1842/3658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:28 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:28.953217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-da298260-86f0-45e1-a5fa-e91d434e4187 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:28.954388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-da298260-86f0-45e1-a5fa-e91d434e4187 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.964547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da298260-86f0-45e1-a5fa-e91d434e4187 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.967152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da298260-86f0-45e1-a5fa-e91d434e4187 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.968546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da298260-86f0-45e1-a5fa-e91d434e4187 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.970833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da298260-86f0-45e1-a5fa-e91d434e4187 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.971436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da298260-86f0-45e1-a5fa-e91d434e4187 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.971994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da298260-86f0-45e1-a5fa-e91d434e4187 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.015571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58284685-2046-4fb6-a26f-45bf89bb281f tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.016364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58284685-2046-4fb6-a26f-45bf89bb281f tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.017595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58284685-2046-4fb6-a26f-45bf89bb281f tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.019696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58284685-2046-4fb6-a26f-45bf89bb281f tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.021160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58284685-2046-4fb6-a26f-45bf89bb281f tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.022740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58284685-2046-4fb6-a26f-45bf89bb281f tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.105243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-58284685-2046-4fb6-a26f-45bf89bb281f tempest-QuotasAdminNegativeTest-1909945015 tempest-QuotasAdminNegativeTest-1909945015-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41" status: 200 len: 329 microversion: 2.1 time: 0.198750 Oct 04 18:16:29.106415 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1817/3659] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:16:28 2022] PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 => generated 329 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:29.114217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f323c700-56f7-46c8-ab58-66f7228d0a65 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:29.115207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f323c700-56f7-46c8-ab58-66f7228d0a65 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:29.122368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f323c700-56f7-46c8-ab58-66f7228d0a65 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.122784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f323c700-56f7-46c8-ab58-66f7228d0a65 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.123547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f323c700-56f7-46c8-ab58-66f7228d0a65 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.125071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f323c700-56f7-46c8-ab58-66f7228d0a65 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.125614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f323c700-56f7-46c8-ab58-66f7228d0a65 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.126053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f323c700-56f7-46c8-ab58-66f7228d0a65 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.690198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-da298260-86f0-45e1-a5fa-e91d434e4187 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.699084 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-da298260-86f0-45e1-a5fa-e91d434e4187 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1396 microversion: 2.1 time: 0.757082 Oct 04 18:16:29.699928 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1843/3660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:28 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1396 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:29.705847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c69491a3-a8db-4e1d-8ad5-56c373239947 req-b1a9c1b8-d825-40d5-a62f-adc55c45d7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8053e0e-c889-4fd9-93a4-34aca7ff2948", "name": "network-vif-deleted", "tag": "1bc16d83-9b0d-4671-a5c4-86ffb6abc091"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:29.715682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c69491a3-a8db-4e1d-8ad5-56c373239947 req-b1a9c1b8-d825-40d5-a62f-adc55c45d7ed service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.716165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c69491a3-a8db-4e1d-8ad5-56c373239947 req-b1a9c1b8-d825-40d5-a62f-adc55c45d7ed service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.716599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c69491a3-a8db-4e1d-8ad5-56c373239947 req-b1a9c1b8-d825-40d5-a62f-adc55c45d7ed service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.727576 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c69491a3-a8db-4e1d-8ad5-56c373239947 req-b1a9c1b8-d825-40d5-a62f-adc55c45d7ed service nova] Creating event network-vif-deleted:1bc16d83-9b0d-4671-a5c4-86ffb6abc091 for instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 on n-h1-850499-14 Oct 04 18:16:29.732580 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c69491a3-a8db-4e1d-8ad5-56c373239947 req-b1a9c1b8-d825-40d5-a62f-adc55c45d7ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 Oct 04 18:16:29.733189 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1844/3661] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:29.738361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f323c700-56f7-46c8-ab58-66f7228d0a65 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.738790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bed881b7-3f25-406c-af66-af05d31e2ed5 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Action: 'update', calling method: .version_select at 0x7fd4d1555670>, body: {"quota_set": {"ram": 0}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:29.743831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bed881b7-3f25-406c-af66-af05d31e2ed5 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b2d8c77726a44802a9ec2c2bdcf720ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7875fe6c59d446089e886d3243aa1d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bed881b7-3f25-406c-af66-af05d31e2ed5 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Request method failure captured: Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: request: PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 HTTP/1.1 Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 25 Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHh26kZtYtqyEjP5PFaH2_rOK3mCehDT4K4ky0Qh-YXrgPDfUFuBJr6g8bq4-4YiuVDLqCPl_mFLoq0Apu1bvGAWzsjEUYe5wPVOw9nD1aGApecVeHpg5zTMhRtbkFzH4XjOoA9ZKZ9-VA2WDsywaajiLXXHD3rYsKqNOeLvngSXV-o Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 7875fe6c59d446089e886d3243aa1d41 Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7875fe6c59d446089e886d3243aa1d41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7875fe6c59d446089e886d3243aa1d41"}]}] Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 7875fe6c59d446089e886d3243aa1d41 Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-760340112 Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-QuotasAdminNegativeTest-760340112-project Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b2d8c77726a44802a9ec2c2bdcf720ea Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-QuotasAdminNegativeTest-760340112-project Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: {"quota_set": {"ram": 0}} Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '7875fe6c59d446089e886d3243aa1d41', 'body': {'quota_set': {'ram': 0}}} Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:16:29.746286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:29.750910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bed881b7-3f25-406c-af66-af05d31e2ed5 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:29.753551 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f323c700-56f7-46c8-ab58-66f7228d0a65 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.639254 Oct 04 18:16:29.753717 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bed881b7-3f25-406c-af66-af05d31e2ed5 tempest-QuotasAdminNegativeTest-760340112 tempest-QuotasAdminNegativeTest-760340112-project] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41" status: 403 len: 116 microversion: 2.1 time: 0.013259 Oct 04 18:16:29.753893 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1818/3662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:29 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:29.754053 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1845/3663] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:16:29 2022] PUT /compute/v2.1/os-quota-sets/7875fe6c59d446089e886d3243aa1d41 => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:29.761059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65658c15-ef64-495e-808c-35c9505187dd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:29.761918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65658c15-ef64-495e-808c-35c9505187dd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:29.774042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-42335cb3-bfe6-4f85-a07e-87ce452cfe6d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:29.775515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-42335cb3-bfe6-4f85-a07e-87ce452cfe6d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:29.784950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65658c15-ef64-495e-808c-35c9505187dd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.787862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42335cb3-bfe6-4f85-a07e-87ce452cfe6d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.788263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65658c15-ef64-495e-808c-35c9505187dd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.788382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42335cb3-bfe6-4f85-a07e-87ce452cfe6d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.788831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42335cb3-bfe6-4f85-a07e-87ce452cfe6d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.789287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65658c15-ef64-495e-808c-35c9505187dd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.789559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42335cb3-bfe6-4f85-a07e-87ce452cfe6d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.790030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42335cb3-bfe6-4f85-a07e-87ce452cfe6d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.790462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42335cb3-bfe6-4f85-a07e-87ce452cfe6d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.791436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65658c15-ef64-495e-808c-35c9505187dd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.792030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65658c15-ef64-495e-808c-35c9505187dd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.792592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65658c15-ef64-495e-808c-35c9505187dd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.095472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65658c15-ef64-495e-808c-35c9505187dd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.105114 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65658c15-ef64-495e-808c-35c9505187dd tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1498 microversion: 2.1 time: 0.356253 Oct 04 18:16:30.106531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-42335cb3-bfe6-4f85-a07e-87ce452cfe6d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.112119 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1819/3664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:29 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1498 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:30.118031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.118864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: e8053e0e-c889-4fd9-93a4-34aca7ff2948] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.126813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.127406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.128022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.129297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.129948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.130446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.147694 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] HTTP exception thrown: Instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 could not be found. Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Request method failure captured: Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 HTTP/1.1 Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHfQmWGnXU_-s9vTWwHhsW_IH5JLwivxpSRZV4Vr3OrI2uIhyIUA7Pfj8IDmukIaj2CbY4vJGZYeNWFqOEjvQNpjgk1xLVz3BALaPm1FimFTznuxp2aKQs77bQUv3V8PNFEDeyJkhynqwILtOLwoUtbDC2lB5lMfAUFPRkL37kmTo5w Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: f00e986d888b46509f396884fe32853c Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ListImageFiltersTestJSON-1589620821 Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f00e986d888b46509f396884fe32853c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f00e986d888b46509f396884fe32853c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f00e986d888b46509f396884fe32853c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f00e986d888b46509f396884fe32853c"}]}] Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ListImageFiltersTestJSON-1589620821 Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: f00e986d888b46509f396884fe32853c Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1589620821 Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ListImageFiltersTestJSON-1589620821-project Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 70ef1c6abe074ce9af7b6baaef4721b9 Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ListImageFiltersTestJSON-1589620821-project Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 could not be found. Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e8053e0e-c889-4fd9-93a4-34aca7ff2948'} Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 could not be found. Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 could not be found. Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:30.149613 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:30.154346 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:30.154346 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:30.154346 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:30.154346 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:30.154346 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:30.154346 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 could not be found. Oct 04 18:16:30.154346 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:30.154935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Returning 404 to user: Instance e8053e0e-c889-4fd9-93a4-34aca7ff2948 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:30.155546 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-42335cb3-bfe6-4f85-a07e-87ce452cfe6d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.380838 Oct 04 18:16:30.156078 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-85ae1cdf-d5d7-4cda-9a1e-6c1568dc0647 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948" status: 404 len: 111 microversion: 2.1 time: 0.042044 Oct 04 18:16:30.167022 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1846/3665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:29 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:30.167333 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1820/3666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/e8053e0e-c889-4fd9-93a4-34aca7ff2948 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:30.167333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b7f7246d-c850-442f-a9d0-306a59d8e131 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.167544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d673856-7ad1-42a4-bda9-73d604d604da tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.167544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d673856-7ad1-42a4-bda9-73d604d604da tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.185078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d673856-7ad1-42a4-bda9-73d604d604da tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.187539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d673856-7ad1-42a4-bda9-73d604d604da tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.188175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d673856-7ad1-42a4-bda9-73d604d604da tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.189176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d673856-7ad1-42a4-bda9-73d604d604da tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.190288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d673856-7ad1-42a4-bda9-73d604d604da tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.190530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d673856-7ad1-42a4-bda9-73d604d604da tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.202631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.server_groups [None req-b7f7246d-c850-442f-a9d0-306a59d8e131 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Querying cell c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) for 1 instances {{(pid=122331) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:16:30.203645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7f7246d-c850-442f-a9d0-306a59d8e131 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.204146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7f7246d-c850-442f-a9d0-306a59d8e131 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.204588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7f7246d-c850-442f-a9d0-306a59d8e131 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.227054 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b7f7246d-c850-442f-a9d0-306a59d8e131 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/45ff0e51-e5ab-46c5-a91a-04352ba67efb" status: 200 len: 221 microversion: 2.1 time: 0.067925 Oct 04 18:16:30.228544 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1821/3667] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/os-server-groups/45ff0e51-e5ab-46c5-a91a-04352ba67efb => generated 221 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:30.234506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9760ca21-365a-45e0-ae32-5de81fb84cd3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.235371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9760ca21-365a-45e0-ae32-5de81fb84cd3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.243667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9760ca21-365a-45e0-ae32-5de81fb84cd3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.245749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9760ca21-365a-45e0-ae32-5de81fb84cd3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.246767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9760ca21-365a-45e0-ae32-5de81fb84cd3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.249370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9760ca21-365a-45e0-ae32-5de81fb84cd3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.251028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9760ca21-365a-45e0-ae32-5de81fb84cd3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.265215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9760ca21-365a-45e0-ae32-5de81fb84cd3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.322199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9760ca21-365a-45e0-ae32-5de81fb84cd3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:30.403059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d673856-7ad1-42a4-bda9-73d604d604da tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.423601 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d673856-7ad1-42a4-bda9-73d604d604da tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.266064 Oct 04 18:16:30.426396 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9760ca21-365a-45e0-ae32-5de81fb84cd3 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "DELETE /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 204 len: 0 microversion: 2.1 time: 0.196633 Oct 04 18:16:30.427190 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1822/3668] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:30 2022] DELETE /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:30.429469 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1847/3669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:30.443387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b7e70879-cf8b-444b-8c37-c57d0d72dfbb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:30.445136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b7e70879-cf8b-444b-8c37-c57d0d72dfbb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.448916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb27d4e2-5eb7-4021-9f3c-f3b20993c162 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.449421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb27d4e2-5eb7-4021-9f3c-f3b20993c162 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.454768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7e70879-cf8b-444b-8c37-c57d0d72dfbb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.458032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7e70879-cf8b-444b-8c37-c57d0d72dfbb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.458032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7e70879-cf8b-444b-8c37-c57d0d72dfbb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.458032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7e70879-cf8b-444b-8c37-c57d0d72dfbb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.458032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7e70879-cf8b-444b-8c37-c57d0d72dfbb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.458032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b7e70879-cf8b-444b-8c37-c57d0d72dfbb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.460897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d4e2-5eb7-4021-9f3c-f3b20993c162 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.462045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d4e2-5eb7-4021-9f3c-f3b20993c162 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.463767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d4e2-5eb7-4021-9f3c-f3b20993c162 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.464528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d4e2-5eb7-4021-9f3c-f3b20993c162 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.464997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d4e2-5eb7-4021-9f3c-f3b20993c162 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.465436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d4e2-5eb7-4021-9f3c-f3b20993c162 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.496643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb27d4e2-5eb7-4021-9f3c-f3b20993c162 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:30.515138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:30.540353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:30.569777 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b7e70879-cf8b-444b-8c37-c57d0d72dfbb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 202 len: 0 microversion: 2.1 time: 0.140354 Oct 04 18:16:30.573421 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1823/3670] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:30 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:30.577579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-47757453-2f60-4e55-bc22-479a7daa3408 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.578299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-47757453-2f60-4e55-bc22-479a7daa3408 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.584868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47757453-2f60-4e55-bc22-479a7daa3408 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.585374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47757453-2f60-4e55-bc22-479a7daa3408 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.586016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47757453-2f60-4e55-bc22-479a7daa3408 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.586746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47757453-2f60-4e55-bc22-479a7daa3408 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.587286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47757453-2f60-4e55-bc22-479a7daa3408 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.587851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47757453-2f60-4e55-bc22-479a7daa3408 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.634794 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb27d4e2-5eb7-4021-9f3c-f3b20993c162 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 204 len: 0 microversion: 2.1 time: 0.203460 Oct 04 18:16:30.635979 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1848/3671] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:30 2022] DELETE /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:30.642238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1e642dbf-e3c9-4e84-bc59-b67db2df9aad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.643350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1e642dbf-e3c9-4e84-bc59-b67db2df9aad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.649905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e642dbf-e3c9-4e84-bc59-b67db2df9aad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.650721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e642dbf-e3c9-4e84-bc59-b67db2df9aad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.651657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e642dbf-e3c9-4e84-bc59-b67db2df9aad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.652741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e642dbf-e3c9-4e84-bc59-b67db2df9aad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.653421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e642dbf-e3c9-4e84-bc59-b67db2df9aad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.654068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e642dbf-e3c9-4e84-bc59-b67db2df9aad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.881611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-47757453-2f60-4e55-bc22-479a7daa3408 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.884828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e642dbf-e3c9-4e84-bc59-b67db2df9aad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.894761 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1e642dbf-e3c9-4e84-bc59-b67db2df9aad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1511 microversion: 2.1 time: 0.257369 Oct 04 18:16:30.895504 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-47757453-2f60-4e55-bc22-479a7daa3408 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1474 microversion: 2.1 time: 0.323261 Oct 04 18:16:30.899300 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1849/3672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1511 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:30.904639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4cec4899-f119-4805-882a-3606c9ee5bf4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.905528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4cec4899-f119-4805-882a-3606c9ee5bf4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.908626 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1824/3673] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:30.915892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-428014e4-340b-4192-bab0-2d3cbea70a55 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.917083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-428014e4-340b-4192-bab0-2d3cbea70a55 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.924839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428014e4-340b-4192-bab0-2d3cbea70a55 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.925596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428014e4-340b-4192-bab0-2d3cbea70a55 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.926519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428014e4-340b-4192-bab0-2d3cbea70a55 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.927962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428014e4-340b-4192-bab0-2d3cbea70a55 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.928838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428014e4-340b-4192-bab0-2d3cbea70a55 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.929464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cec4899-f119-4805-882a-3606c9ee5bf4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.929735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428014e4-340b-4192-bab0-2d3cbea70a55 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.929971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cec4899-f119-4805-882a-3606c9ee5bf4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.930426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cec4899-f119-4805-882a-3606c9ee5bf4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.931189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cec4899-f119-4805-882a-3606c9ee5bf4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.931660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cec4899-f119-4805-882a-3606c9ee5bf4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.932099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cec4899-f119-4805-882a-3606c9ee5bf4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.155856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4cec4899-f119-4805-882a-3606c9ee5bf4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.166565 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4cec4899-f119-4805-882a-3606c9ee5bf4 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1504 microversion: 2.1 time: 0.265785 Oct 04 18:16:31.166993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-428014e4-340b-4192-bab0-2d3cbea70a55 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.168484 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1850/3674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:31.189542 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-428014e4-340b-4192-bab0-2d3cbea70a55 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1576 microversion: 2.1 time: 0.279202 Oct 04 18:16:31.190337 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1825/3675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1576 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:31.213845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dfef307d-486b-4db5-a5ed-616360a6603d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.214348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dfef307d-486b-4db5-a5ed-616360a6603d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:31.221510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfef307d-486b-4db5-a5ed-616360a6603d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.221938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfef307d-486b-4db5-a5ed-616360a6603d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.222381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfef307d-486b-4db5-a5ed-616360a6603d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.223128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfef307d-486b-4db5-a5ed-616360a6603d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.223589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfef307d-486b-4db5-a5ed-616360a6603d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.224018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfef307d-486b-4db5-a5ed-616360a6603d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.312845 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dfef307d-486b-4db5-a5ed-616360a6603d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102874 Oct 04 18:16:31.314062 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1851/3676] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:31.454008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3236bf2f-31d4-447b-b5dd-0b3adf58eb30 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.455158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3236bf2f-31d4-447b-b5dd-0b3adf58eb30 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:31.463937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3236bf2f-31d4-447b-b5dd-0b3adf58eb30 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.464603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3236bf2f-31d4-447b-b5dd-0b3adf58eb30 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.465338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3236bf2f-31d4-447b-b5dd-0b3adf58eb30 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.466272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3236bf2f-31d4-447b-b5dd-0b3adf58eb30 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.466923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3236bf2f-31d4-447b-b5dd-0b3adf58eb30 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.467638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3236bf2f-31d4-447b-b5dd-0b3adf58eb30 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.792824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3236bf2f-31d4-447b-b5dd-0b3adf58eb30 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.804558 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3236bf2f-31d4-447b-b5dd-0b3adf58eb30 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.355614 Oct 04 18:16:31.814544 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1826/3677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:31.919850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac2bf369-5eb1-461b-b4e2-97bf2cfc3437 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.920812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac2bf369-5eb1-461b-b4e2-97bf2cfc3437 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:31.936917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aad4e122-a261-476d-8629-4bce8c095c09 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.937734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aad4e122-a261-476d-8629-4bce8c095c09 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:31.938407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac2bf369-5eb1-461b-b4e2-97bf2cfc3437 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.939248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac2bf369-5eb1-461b-b4e2-97bf2cfc3437 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.939959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac2bf369-5eb1-461b-b4e2-97bf2cfc3437 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.940912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac2bf369-5eb1-461b-b4e2-97bf2cfc3437 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.941761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac2bf369-5eb1-461b-b4e2-97bf2cfc3437 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.951679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad4e122-a261-476d-8629-4bce8c095c09 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.952971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad4e122-a261-476d-8629-4bce8c095c09 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.953432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad4e122-a261-476d-8629-4bce8c095c09 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.954173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad4e122-a261-476d-8629-4bce8c095c09 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.954638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad4e122-a261-476d-8629-4bce8c095c09 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.955093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad4e122-a261-476d-8629-4bce8c095c09 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.956865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac2bf369-5eb1-461b-b4e2-97bf2cfc3437 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.440541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aad4e122-a261-476d-8629-4bce8c095c09 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:32.458475 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aad4e122-a261-476d-8629-4bce8c095c09 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1474 microversion: 2.1 time: 0.528435 Oct 04 18:16:32.471348 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1827/3678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1474 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:32.479706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5c8aaed7-481c-482c-b87f-ff9596f496ae tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.480324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5c8aaed7-481c-482c-b87f-ff9596f496ae tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:32.486828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8aaed7-481c-482c-b87f-ff9596f496ae tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.487415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8aaed7-481c-482c-b87f-ff9596f496ae tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.487974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8aaed7-481c-482c-b87f-ff9596f496ae tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.488614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8aaed7-481c-482c-b87f-ff9596f496ae tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.489073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8aaed7-481c-482c-b87f-ff9596f496ae tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.489501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8aaed7-481c-482c-b87f-ff9596f496ae tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.521035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ac2bf369-5eb1-461b-b4e2-97bf2cfc3437 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:32.537002 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac2bf369-5eb1-461b-b4e2-97bf2cfc3437 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1511 microversion: 2.1 time: 0.621605 Oct 04 18:16:32.538559 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1852/3679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1511 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:32.835330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5c8aaed7-481c-482c-b87f-ff9596f496ae tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:32.860229 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5c8aaed7-481c-482c-b87f-ff9596f496ae tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1504 microversion: 2.1 time: 0.375869 Oct 04 18:16:32.863170 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1828/3680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:32.874370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0833e46f-3a22-4199-b27c-31befe42e73c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.875375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0833e46f-3a22-4199-b27c-31befe42e73c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:32.885730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0833e46f-3a22-4199-b27c-31befe42e73c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.887431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0833e46f-3a22-4199-b27c-31befe42e73c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.888586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0833e46f-3a22-4199-b27c-31befe42e73c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.890222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0833e46f-3a22-4199-b27c-31befe42e73c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.893397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0833e46f-3a22-4199-b27c-31befe42e73c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.894156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0833e46f-3a22-4199-b27c-31befe42e73c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.044186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4cfa1c79-49eb-4153-8307-fd184bd9bf25 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.057986 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4cfa1c79-49eb-4153-8307-fd184bd9bf25 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.261832 Oct 04 18:16:33.061246 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1853/3681] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:33.080659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ab9c468-48e0-40d1-9ed7-0facbea7cd9a tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.106490 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ab9c468-48e0-40d1-9ed7-0facbea7cd9a tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.033680 Oct 04 18:16:33.107757 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1854/3682] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:33.124277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5c21265b-5976-4ec8-9cf9-0db026428355 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.145609 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5c21265b-5976-4ec8-9cf9-0db026428355 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025719 Oct 04 18:16:33.147343 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1855/3683] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:33.166908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-31beed66-a93c-4387-b051-5b0b72c228e1 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.181451 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-31beed66-a93c-4387-b051-5b0b72c228e1 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022099 Oct 04 18:16:33.189616 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1856/3684] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:33.196658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cb325c79-90be-4a1c-8edd-a749f1cd7526 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.249472 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cb325c79-90be-4a1c-8edd-a749f1cd7526 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.057673 Oct 04 18:16:33.263279 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1857/3685] 10.222.0.18 () {58 vars in 1165 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:33.263638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0833e46f-3a22-4199-b27c-31befe42e73c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.271450 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0833e46f-3a22-4199-b27c-31befe42e73c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.405772 Oct 04 18:16:33.272026 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1829/3686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:33.285165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-41c5cd36-d502-4c2a-a02d-db699a764197 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.300667 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-41c5cd36-d502-4c2a-a02d-db699a764197 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031900 Oct 04 18:16:33.301218 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1858/3687] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:33.314584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dcde6ce4-8464-4ec6-8cef-dcf147dfdd27 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.340256 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dcde6ce4-8464-4ec6-8cef-dcf147dfdd27 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.030020 Oct 04 18:16:33.341371 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1830/3688] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:33.368529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29a4aed8-28a3-43e1-91b9-303258ec0c89 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.392545 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29a4aed8-28a3-43e1-91b9-303258ec0c89 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.029149 Oct 04 18:16:33.408326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9851242f-fa4c-49e8-b748-9a9409df24ff tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.413008 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1859/3689] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:33.416952 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9851242f-fa4c-49e8-b748-9a9409df24ff tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013221 Oct 04 18:16:33.427635 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1831/3690] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:33.441754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80bbc085-9dcc-4549-9feb-f5d1282a68b9 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.482311 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80bbc085-9dcc-4549-9feb-f5d1282a68b9 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.055025 Oct 04 18:16:33.486058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a26bc6e-c913-4b62-a3ce-462d9ff8794c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.486854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8a26bc6e-c913-4b62-a3ce-462d9ff8794c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:33.494569 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1860/3691] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:33.500439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c289d07f-15af-43bb-8792-7bdd27cae823 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.502638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a26bc6e-c913-4b62-a3ce-462d9ff8794c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.503172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a26bc6e-c913-4b62-a3ce-462d9ff8794c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.503613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a26bc6e-c913-4b62-a3ce-462d9ff8794c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.504336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a26bc6e-c913-4b62-a3ce-462d9ff8794c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.504778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a26bc6e-c913-4b62-a3ce-462d9ff8794c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.505244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a26bc6e-c913-4b62-a3ce-462d9ff8794c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.508685 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c289d07f-15af-43bb-8792-7bdd27cae823 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012544 Oct 04 18:16:33.517067 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1861/3692] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:33.523733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0cde938-d04f-468d-9a5b-9b3af7a2bac1 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.550439 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f0cde938-d04f-468d-9a5b-9b3af7a2bac1 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.031766 Oct 04 18:16:33.552165 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1862/3693] 10.222.0.18 () {58 vars in 1144 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:33.573234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f59b4403-a5c7-4e66-bea4-9e08506a1fcc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.574284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f59b4403-a5c7-4e66-bea4-9e08506a1fcc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:33.582210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f59b4403-a5c7-4e66-bea4-9e08506a1fcc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.583074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f59b4403-a5c7-4e66-bea4-9e08506a1fcc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.583816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f59b4403-a5c7-4e66-bea4-9e08506a1fcc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.584755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f59b4403-a5c7-4e66-bea4-9e08506a1fcc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.585442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f59b4403-a5c7-4e66-bea4-9e08506a1fcc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.586590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f59b4403-a5c7-4e66-bea4-9e08506a1fcc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.939427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a26bc6e-c913-4b62-a3ce-462d9ff8794c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.952609 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a26bc6e-c913-4b62-a3ce-462d9ff8794c tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1474 microversion: 2.1 time: 0.469824 Oct 04 18:16:33.952846 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1832/3694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1474 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:33.961526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-51d81cf2-bb33-4be5-8bd6-97d0a5a6f6cf tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.978299 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-51d81cf2-bb33-4be5-8bd6-97d0a5a6f6cf tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024057 Oct 04 18:16:33.980142 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1833/3695] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:33.986938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-703d3dba-6433-483e-9b5c-813cbbc35cc7 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.993653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-703d3dba-6433-483e-9b5c-813cbbc35cc7 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:33.997452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:34.004272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f59b4403-a5c7-4e66-bea4-9e08506a1fcc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:34.016479 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f59b4403-a5c7-4e66-bea4-9e08506a1fcc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1491 microversion: 2.1 time: 0.450349 Oct 04 18:16:34.017041 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1863/3696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1491 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:34.023788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-703d3dba-6433-483e-9b5c-813cbbc35cc7 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.024372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-703d3dba-6433-483e-9b5c-813cbbc35cc7 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.024813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-703d3dba-6433-483e-9b5c-813cbbc35cc7 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.025599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-703d3dba-6433-483e-9b5c-813cbbc35cc7 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.026059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-703d3dba-6433-483e-9b5c-813cbbc35cc7 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.026489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-703d3dba-6433-483e-9b5c-813cbbc35cc7 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.033340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ca8f2549-3b4d-4c42-a399-b4c666ecf424 req-bf949665-0ce5-4e30-bc3e-df5a79c23114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1184e3-4cd3-4bf9-a52e-1047d7e3c682", "tag": "66782b7e-7ca9-4644-8501-a1a346eb483b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:34.049959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ca8f2549-3b4d-4c42-a399-b4c666ecf424 req-bf949665-0ce5-4e30-bc3e-df5a79c23114 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.052031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ca8f2549-3b4d-4c42-a399-b4c666ecf424 req-bf949665-0ce5-4e30-bc3e-df5a79c23114 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.054036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ca8f2549-3b4d-4c42-a399-b4c666ecf424 req-bf949665-0ce5-4e30-bc3e-df5a79c23114 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.072383 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ca8f2549-3b4d-4c42-a399-b4c666ecf424 req-bf949665-0ce5-4e30-bc3e-df5a79c23114 service nova] Creating event network-changed:66782b7e-7ca9-4644-8501-a1a346eb483b for instance de1184e3-4cd3-4bf9-a52e-1047d7e3c682 on n-h1-850499-14 Oct 04 18:16:34.078843 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ca8f2549-3b4d-4c42-a399-b4c666ecf424 req-bf949665-0ce5-4e30-bc3e-df5a79c23114 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060060 Oct 04 18:16:34.083132 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1864/3697] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:34.089074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.090081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.098085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.098468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.099204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.100128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.100910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.102944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.187930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.188440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.190861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.192320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lazy-loading 'fault' on Instance uuid b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:34.620967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8977eddab04eefa1d85012926d6aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14da52f910ca4b3fa2fa2ae34580a2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:34.631249 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ff57530e-12a3-4119-bc37-a3f19d791aaa tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 200 len: 1303 microversion: 2.1 time: 0.546582 Oct 04 18:16:34.634291 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1865/3698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 1303 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:34.640199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80d322f3-84b2-4c7d-8574-04c5c15620b6 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.722442 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80d322f3-84b2-4c7d-8574-04c5c15620b6 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.086973 Oct 04 18:16:34.736826 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1866/3699] 10.222.0.18 () {58 vars in 1148 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:34.749354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:34.751436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.769590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.772066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.773795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.776641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.778657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.781271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.858653 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Cannot 'pause' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state paused Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action HTTP/1.1 Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 13 Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: {"pause": {}} Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'pause' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state paused Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'afef2588-b2e9-4b9e-943c-44469215dd64', 'body': {'pause': {}}} Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afef2588-b2e9-4b9e-943c-44469215dd64 in vm_state paused. Cannot pause while the instance is in this state. Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state paused Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:34.860588 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:34.864548 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:34.864548 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:34.864548 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:34.864548 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state paused Oct 04 18:16:34.864548 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:34.864548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 409 to user: Cannot 'pause' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state paused {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:34.881182 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b643e7f-9140-447a-82d1-1dd0efb2a2d6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 409 len: 143 microversion: 2.1 time: 0.128561 Oct 04 18:16:34.885564 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1867/3700] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:34 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 143 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:16:34.891687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6bc08b24-575c-414d-8110-0f5d805dd8a5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.892438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6bc08b24-575c-414d-8110-0f5d805dd8a5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.915199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bc08b24-575c-414d-8110-0f5d805dd8a5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.916651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bc08b24-575c-414d-8110-0f5d805dd8a5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.917667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bc08b24-575c-414d-8110-0f5d805dd8a5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.918533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bc08b24-575c-414d-8110-0f5d805dd8a5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.919198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bc08b24-575c-414d-8110-0f5d805dd8a5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.919868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bc08b24-575c-414d-8110-0f5d805dd8a5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.996732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-703d3dba-6433-483e-9b5c-813cbbc35cc7 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:35.013087 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-703d3dba-6433-483e-9b5c-813cbbc35cc7 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1576 microversion: 2.1 time: 1.031649 Oct 04 18:16:35.016548 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1834/3701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1576 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:35.024490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca9a4ec7-012b-46ca-9335-4fbc6cf07d20 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.060757 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca9a4ec7-012b-46ca-9335-4fbc6cf07d20 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.042042 Oct 04 18:16:35.062457 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1835/3702] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:35.076115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-411d481f-42ec-4751-a5eb-0c5cbf194687 req-343d43a5-c58f-44fc-9843-f744aa65e864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da89d46d-4ae1-466f-9889-e1d528e843e5", "name": "network-vif-deleted", "tag": "4705f29d-c67d-4649-af0a-38b1ead030b6"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:35.106727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-411d481f-42ec-4751-a5eb-0c5cbf194687 req-343d43a5-c58f-44fc-9843-f744aa65e864 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.109335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-411d481f-42ec-4751-a5eb-0c5cbf194687 req-343d43a5-c58f-44fc-9843-f744aa65e864 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.113502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-411d481f-42ec-4751-a5eb-0c5cbf194687 req-343d43a5-c58f-44fc-9843-f744aa65e864 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.146029 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-411d481f-42ec-4751-a5eb-0c5cbf194687 req-343d43a5-c58f-44fc-9843-f744aa65e864 service nova] Creating event network-vif-deleted:4705f29d-c67d-4649-af0a-38b1ead030b6 for instance da89d46d-4ae1-466f-9889-e1d528e843e5 on n-h2-850499-14 Oct 04 18:16:35.153288 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-411d481f-42ec-4751-a5eb-0c5cbf194687 req-343d43a5-c58f-44fc-9843-f744aa65e864 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080968 Oct 04 18:16:35.154456 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1836/3703] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:35.163092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c64a5bf0-2792-4a17-9033-d6a20a9881b9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:35.164018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c64a5bf0-2792-4a17-9033-d6a20a9881b9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:35.173051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c64a5bf0-2792-4a17-9033-d6a20a9881b9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.173838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c64a5bf0-2792-4a17-9033-d6a20a9881b9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.174522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c64a5bf0-2792-4a17-9033-d6a20a9881b9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.175563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c64a5bf0-2792-4a17-9033-d6a20a9881b9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.176253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c64a5bf0-2792-4a17-9033-d6a20a9881b9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.176916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c64a5bf0-2792-4a17-9033-d6a20a9881b9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.291846 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c64a5bf0-2792-4a17-9033-d6a20a9881b9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 202 len: 0 microversion: 2.1 time: 0.133656 Oct 04 18:16:35.312054 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1837/3704] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:35 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:35.333478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.334437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:35.349095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.356066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.356534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.357313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.358022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.358613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.468354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.469072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.469540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.470021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lazy-loading 'fault' on Instance uuid da89d46d-4ae1-466f-9889-e1d528e843e5 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:35.517503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6bc08b24-575c-414d-8110-0f5d805dd8a5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:35.527404 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6bc08b24-575c-414d-8110-0f5d805dd8a5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.640528 Oct 04 18:16:35.544935 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1868/3705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:35.555093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4b323d56-4e8e-4e8e-852e-3970363ee920 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.565695 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4b323d56-4e8e-4e8e-852e-3970363ee920 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018202 Oct 04 18:16:35.566666 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1869/3706] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:35.571644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe207035-69f5-4f1f-a4eb-4155df68f229 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.578038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fe207035-69f5-4f1f-a4eb-4155df68f229 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:35.593325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe207035-69f5-4f1f-a4eb-4155df68f229 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.593814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe207035-69f5-4f1f-a4eb-4155df68f229 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.594253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe207035-69f5-4f1f-a4eb-4155df68f229 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.599602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe207035-69f5-4f1f-a4eb-4155df68f229 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.600181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe207035-69f5-4f1f-a4eb-4155df68f229 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.600639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe207035-69f5-4f1f-a4eb-4155df68f229 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.611776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ef1c6abe074ce9af7b6baaef4721b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e986d888b46509f396884fe32853c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:35.629181 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0dbb0b61-6130-405b-b2c8-b7741ba279cd tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 200 len: 1308 microversion: 2.1 time: 0.315741 Oct 04 18:16:35.631259 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1838/3707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:35.664108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-450cead9-d9a0-4787-a68c-68c9281782f6 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.791584 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-450cead9-d9a0-4787-a68c-68c9281782f6 tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.147644 Oct 04 18:16:35.805128 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1839/3708] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:35.823353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.823883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:35.833936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.834697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.837979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.838924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.839627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.842262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.894388 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] HTTP exception thrown: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Request method failure captured: Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 HTTP/1.1 Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHhc5o8IxNm9Hs4C5WbcD9RJZmRYN5XLSlf0xWi95TiUaT7boLyYiakNzMRHOkWv71dpOSp2FvOYK-1wOoBvWkUhzA6Q9hRO1vLvNq8wEw40yI_cmfdFK1JLZrSs1a8gAUkBgjVOT8ZU_1PkuxI6noPkoDySmcp9Cfu3auBCYWYDfwQ Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}] Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6f8977eddab04eefa1d85012926d6aa1 Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'b60a0cde-531d-4bb9-b6cd-5ad8954a2f08'} Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:35.897401 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:35.901652 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:35.901652 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:35.901652 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:35.901652 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:35.901652 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:35.901652 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:35.901652 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:35.904827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Returning 404 to user: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:35.906220 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9af2fd9a-0dbd-4104-80e8-30066cfd6f4b tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 404 len: 111 microversion: 2.1 time: 0.098072 Oct 04 18:16:35.916727 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1840/3709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:35.923971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42a01546-08b9-4024-be7e-e41432f1cfff tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.955921 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42a01546-08b9-4024-be7e-e41432f1cfff tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036242 Oct 04 18:16:35.958258 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1841/3710] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:35.979410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e110029b-8339-4dd0-ad86-c6494088c617 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.027464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.server_groups [None req-e110029b-8339-4dd0-ad86-c6494088c617 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Querying cell c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) for 1 instances {{(pid=122331) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:16:36.028501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e110029b-8339-4dd0-ad86-c6494088c617 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.029290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e110029b-8339-4dd0-ad86-c6494088c617 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.029742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e110029b-8339-4dd0-ad86-c6494088c617 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.041781 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e110029b-8339-4dd0-ad86-c6494088c617 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.082087 Oct 04 18:16:36.043503 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1842/3711] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:36.048790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d22387d8-458f-4f40-bcf4-e07cb381cf9a tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.056944 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d22387d8-458f-4f40-bcf4-e07cb381cf9a tempest-FlavorsV2TestJSON-1272662670 tempest-FlavorsV2TestJSON-1272662670-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012222 Oct 04 18:16:36.057746 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1843/3712] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:36.083859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5c80265c-598e-4382-8002-9e15c62f1ca1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.130498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fe207035-69f5-4f1f-a4eb-4155df68f229 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:36.142288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.server_groups [None req-5c80265c-598e-4382-8002-9e15c62f1ca1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Querying cell c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) for 1 instances {{(pid=122331) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:16:36.143148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c80265c-598e-4382-8002-9e15c62f1ca1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.143566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c80265c-598e-4382-8002-9e15c62f1ca1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.143808 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fe207035-69f5-4f1f-a4eb-4155df68f229 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1498 microversion: 2.1 time: 0.575855 Oct 04 18:16:36.144016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c80265c-598e-4382-8002-9e15c62f1ca1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.147656 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1870/3713] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1498 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:36.177834 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5c80265c-598e-4382-8002-9e15c62f1ca1 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/45ff0e51-e5ab-46c5-a91a-04352ba67efb" status: 200 len: 183 microversion: 2.1 time: 0.100419 Oct 04 18:16:36.179238 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1844/3714] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:16:36 2022] GET /compute/v2.1/os-server-groups/45ff0e51-e5ab-46c5-a91a-04352ba67efb => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:36.191842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.192553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.202617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.206070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.206841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.210171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.210940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.213317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.246042 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] HTTP exception thrown: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Request method failure captured: Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 HTTP/1.1 Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHhc5o8IxNm9Hs4C5WbcD9RJZmRYN5XLSlf0xWi95TiUaT7boLyYiakNzMRHOkWv71dpOSp2FvOYK-1wOoBvWkUhzA6Q9hRO1vLvNq8wEw40yI_cmfdFK1JLZrSs1a8gAUkBgjVOT8ZU_1PkuxI6noPkoDySmcp9Cfu3auBCYWYDfwQ Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}] Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6f8977eddab04eefa1d85012926d6aa1 Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'b60a0cde-531d-4bb9-b6cd-5ad8954a2f08'} Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:36.251866 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:36.256326 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.258282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Returning 404 to user: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:36.259459 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-60ffeddc-e390-4f37-857c-49b52c6e3774 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 404 len: 111 microversion: 2.1 time: 0.072926 Oct 04 18:16:36.260780 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1871/3715] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:36 2022] DELETE /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:36.272434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.273622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] [instance: b60a0cde-531d-4bb9-b6cd-5ad8954a2f08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.289734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.291794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.292268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.293009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.296772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.297221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.347206 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] HTTP exception thrown: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Request method failure captured: Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 HTTP/1.1 Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHhc5o8IxNm9Hs4C5WbcD9RJZmRYN5XLSlf0xWi95TiUaT7boLyYiakNzMRHOkWv71dpOSp2FvOYK-1wOoBvWkUhzA6Q9hRO1vLvNq8wEw40yI_cmfdFK1JLZrSs1a8gAUkBgjVOT8ZU_1PkuxI6noPkoDySmcp9Cfu3auBCYWYDfwQ Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}] Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6f8977eddab04eefa1d85012926d6aa1 Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'b60a0cde-531d-4bb9-b6cd-5ad8954a2f08'} Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.351602 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.356212 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.356212 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.356212 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.356212 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:36.356212 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:36.356212 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. Oct 04 18:16:36.356212 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.356212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Returning 404 to user: Instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:36.356212 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2a7457bf-b1bb-4bd2-a688-dfe14774870d tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08" status: 404 len: 111 microversion: 2.1 time: 0.088949 Oct 04 18:16:36.356212 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1845/3716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:36 2022] GET /compute/v2.1/servers/b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:36.373440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f84b134-e575-4d89-97aa-31cc82eab311 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.396503 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-4f84b134-e575-4d89-97aa-31cc82eab311 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] HTTP exception thrown: Instance group de81bb63-3d5b-40e3-bf55-8f4ce590c898 could not be found. Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f84b134-e575-4d89-97aa-31cc82eab311 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Request method failure captured: Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-server-groups/de81bb63-3d5b-40e3-bf55-8f4ce590c898 HTTP/1.1 Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHhc5o8IxNm9Hs4C5WbcD9RJZmRYN5XLSlf0xWi95TiUaT7boLyYiakNzMRHOkWv71dpOSp2FvOYK-1wOoBvWkUhzA6Q9hRO1vLvNq8wEw40yI_cmfdFK1JLZrSs1a8gAUkBgjVOT8ZU_1PkuxI6noPkoDySmcp9Cfu3auBCYWYDfwQ Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}] Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6f8977eddab04eefa1d85012926d6aa1 Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance group de81bb63-3d5b-40e3-bf55-8f4ce590c898 could not be found. Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'de81bb63-3d5b-40e3-bf55-8f4ce590c898'} Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group de81bb63-3d5b-40e3-bf55-8f4ce590c898 could not be found. Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group de81bb63-3d5b-40e3-bf55-8f4ce590c898 could not be found. Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.404030 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.410409 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.410409 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.410409 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:36.410409 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:36.410409 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group de81bb63-3d5b-40e3-bf55-8f4ce590c898 could not be found. Oct 04 18:16:36.410409 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.410409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f84b134-e575-4d89-97aa-31cc82eab311 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Returning 404 to user: Instance group de81bb63-3d5b-40e3-bf55-8f4ce590c898 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:36.410409 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f84b134-e575-4d89-97aa-31cc82eab311 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/de81bb63-3d5b-40e3-bf55-8f4ce590c898" status: 404 len: 117 microversion: 2.1 time: 0.043765 Oct 04 18:16:36.410409 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1872/3717] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:16:36 2022] DELETE /compute/v2.1/os-server-groups/de81bb63-3d5b-40e3-bf55-8f4ce590c898 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:36.418652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ffd13bc-e03a-4816-b782-ecac8f96518e tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.427045 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-9ffd13bc-e03a-4816-b782-ecac8f96518e tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] HTTP exception thrown: Instance group c4327960-2ff5-4374-9770-e2c449c4541f could not be found. Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ffd13bc-e03a-4816-b782-ecac8f96518e tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Request method failure captured: Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-server-groups/c4327960-2ff5-4374-9770-e2c449c4541f HTTP/1.1 Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHhc5o8IxNm9Hs4C5WbcD9RJZmRYN5XLSlf0xWi95TiUaT7boLyYiakNzMRHOkWv71dpOSp2FvOYK-1wOoBvWkUhzA6Q9hRO1vLvNq8wEw40yI_cmfdFK1JLZrSs1a8gAUkBgjVOT8ZU_1PkuxI6noPkoDySmcp9Cfu3auBCYWYDfwQ Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}] Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6f8977eddab04eefa1d85012926d6aa1 Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance group c4327960-2ff5-4374-9770-e2c449c4541f could not be found. Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c4327960-2ff5-4374-9770-e2c449c4541f'} Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c4327960-2ff5-4374-9770-e2c449c4541f could not be found. Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c4327960-2ff5-4374-9770-e2c449c4541f could not be found. Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.430444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.437618 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.437618 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.437618 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:36.437618 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:36.437618 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c4327960-2ff5-4374-9770-e2c449c4541f could not be found. Oct 04 18:16:36.437618 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.442603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ffd13bc-e03a-4816-b782-ecac8f96518e tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Returning 404 to user: Instance group c4327960-2ff5-4374-9770-e2c449c4541f could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:36.443920 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ffd13bc-e03a-4816-b782-ecac8f96518e tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/c4327960-2ff5-4374-9770-e2c449c4541f" status: 404 len: 117 microversion: 2.1 time: 0.029465 Oct 04 18:16:36.445222 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1846/3718] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:16:36 2022] DELETE /compute/v2.1/os-server-groups/c4327960-2ff5-4374-9770-e2c449c4541f => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:36.452878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ff69f46-cdb9-4a2d-b832-0b69fb83b580 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.469552 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-8ff69f46-cdb9-4a2d-b832-0b69fb83b580 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] HTTP exception thrown: Instance group 9364f922-2ee9-4646-b912-b378b36dbba7 could not be found. Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ff69f46-cdb9-4a2d-b832-0b69fb83b580 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Request method failure captured: Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-server-groups/9364f922-2ee9-4646-b912-b378b36dbba7 HTTP/1.1 Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHhc5o8IxNm9Hs4C5WbcD9RJZmRYN5XLSlf0xWi95TiUaT7boLyYiakNzMRHOkWv71dpOSp2FvOYK-1wOoBvWkUhzA6Q9hRO1vLvNq8wEw40yI_cmfdFK1JLZrSs1a8gAUkBgjVOT8ZU_1PkuxI6noPkoDySmcp9Cfu3auBCYWYDfwQ Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}] Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6f8977eddab04eefa1d85012926d6aa1 Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance group 9364f922-2ee9-4646-b912-b378b36dbba7 could not be found. Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '9364f922-2ee9-4646-b912-b378b36dbba7'} Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9364f922-2ee9-4646-b912-b378b36dbba7 could not be found. Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9364f922-2ee9-4646-b912-b378b36dbba7 could not be found. Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.471391 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.475932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.475932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.475932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:36.475932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:36.475932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9364f922-2ee9-4646-b912-b378b36dbba7 could not be found. Oct 04 18:16:36.475932 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.489586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ff69f46-cdb9-4a2d-b832-0b69fb83b580 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Returning 404 to user: Instance group 9364f922-2ee9-4646-b912-b378b36dbba7 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:36.492545 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8ff69f46-cdb9-4a2d-b832-0b69fb83b580 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/9364f922-2ee9-4646-b912-b378b36dbba7" status: 404 len: 117 microversion: 2.1 time: 0.042162 Oct 04 18:16:36.495037 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1873/3719] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:16:36 2022] DELETE /compute/v2.1/os-server-groups/9364f922-2ee9-4646-b912-b378b36dbba7 => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:36.502206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9da9c3c4-a5a7-48ba-b89f-3de3b4b705cf tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.513269 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-9da9c3c4-a5a7-48ba-b89f-3de3b4b705cf tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] HTTP exception thrown: Instance group c8132e75-23db-409e-b389-7375e7eb1c51 could not be found. Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9da9c3c4-a5a7-48ba-b89f-3de3b4b705cf tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Request method failure captured: Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-server-groups/c8132e75-23db-409e-b389-7375e7eb1c51 HTTP/1.1 Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHhc5o8IxNm9Hs4C5WbcD9RJZmRYN5XLSlf0xWi95TiUaT7boLyYiakNzMRHOkWv71dpOSp2FvOYK-1wOoBvWkUhzA6Q9hRO1vLvNq8wEw40yI_cmfdFK1JLZrSs1a8gAUkBgjVOT8ZU_1PkuxI6noPkoDySmcp9Cfu3auBCYWYDfwQ Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14da52f910ca4b3fa2fa2ae34580a2d2"}]}] Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 14da52f910ca4b3fa2fa2ae34580a2d2 Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerGroupTestJSON-1715068183 Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6f8977eddab04eefa1d85012926d6aa1 Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerGroupTestJSON-1715068183-project Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance group c8132e75-23db-409e-b389-7375e7eb1c51 could not be found. Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c8132e75-23db-409e-b389-7375e7eb1c51'} Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c8132e75-23db-409e-b389-7375e7eb1c51 could not be found. Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c8132e75-23db-409e-b389-7375e7eb1c51 could not be found. Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.516144 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.522826 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.522826 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.522826 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:36.522826 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:36.522826 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c8132e75-23db-409e-b389-7375e7eb1c51 could not be found. Oct 04 18:16:36.522826 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.522826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9da9c3c4-a5a7-48ba-b89f-3de3b4b705cf tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Returning 404 to user: Instance group c8132e75-23db-409e-b389-7375e7eb1c51 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:36.522826 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9da9c3c4-a5a7-48ba-b89f-3de3b4b705cf tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/c8132e75-23db-409e-b389-7375e7eb1c51" status: 404 len: 117 microversion: 2.1 time: 0.022957 Oct 04 18:16:36.522826 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1847/3720] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:16:36 2022] DELETE /compute/v2.1/os-server-groups/c8132e75-23db-409e-b389-7375e7eb1c51 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:36.529625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b59a3d7-ecea-49c3-b570-6e3779d693d9 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.544206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:36.552937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c46411f-b6df-4108-9785-6c7314f249d8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.553590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1c46411f-b6df-4108-9785-6c7314f249d8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.572996 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b59a3d7-ecea-49c3-b570-6e3779d693d9 tempest-ServerGroupTestJSON-1715068183 tempest-ServerGroupTestJSON-1715068183-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/45ff0e51-e5ab-46c5-a91a-04352ba67efb" status: 204 len: 0 microversion: 2.1 time: 0.047405 Oct 04 18:16:36.575488 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1874/3721] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 4 18:16:36 2022] DELETE /compute/v2.1/os-server-groups/45ff0e51-e5ab-46c5-a91a-04352ba67efb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:36.576892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c46411f-b6df-4108-9785-6c7314f249d8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.583755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c46411f-b6df-4108-9785-6c7314f249d8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.584499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c46411f-b6df-4108-9785-6c7314f249d8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.585511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c46411f-b6df-4108-9785-6c7314f249d8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.586165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c46411f-b6df-4108-9785-6c7314f249d8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.586381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-44ca37b7-a685-44aa-b9a7-8898eee6e947 req-9a0132ac-0064-49cf-802b-9819184977c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60a0cde-531d-4bb9-b6cd-5ad8954a2f08", "name": "network-vif-deleted", "tag": "5ae340a3-b41e-4bbe-b5d1-12a40c3d7d15"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:36.588756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c46411f-b6df-4108-9785-6c7314f249d8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.608578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-44ca37b7-a685-44aa-b9a7-8898eee6e947 req-9a0132ac-0064-49cf-802b-9819184977c5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.613754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-44ca37b7-a685-44aa-b9a7-8898eee6e947 req-9a0132ac-0064-49cf-802b-9819184977c5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.617084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-44ca37b7-a685-44aa-b9a7-8898eee6e947 req-9a0132ac-0064-49cf-802b-9819184977c5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.645049 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-44ca37b7-a685-44aa-b9a7-8898eee6e947 req-9a0132ac-0064-49cf-802b-9819184977c5 service nova] Creating event network-vif-deleted:5ae340a3-b41e-4bbe-b5d1-12a40c3d7d15 for instance b60a0cde-531d-4bb9-b6cd-5ad8954a2f08 on n-h1-850499-14 Oct 04 18:16:36.659305 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-44ca37b7-a685-44aa-b9a7-8898eee6e947 req-9a0132ac-0064-49cf-802b-9819184977c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078275 Oct 04 18:16:36.660422 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1875/3722] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:36.666186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.666908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] [instance: da89d46d-4ae1-466f-9889-e1d528e843e5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.674082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.674592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.675067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.675786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.676730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.677519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.708702 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] HTTP exception thrown: Instance da89d46d-4ae1-466f-9889-e1d528e843e5 could not be found. Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Request method failure captured: Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 HTTP/1.1 Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHfQmWGnXU_-s9vTWwHhsW_IH5JLwivxpSRZV4Vr3OrI2uIhyIUA7Pfj8IDmukIaj2CbY4vJGZYeNWFqOEjvQNpjgk1xLVz3BALaPm1FimFTznuxp2aKQs77bQUv3V8PNFEDeyJkhynqwILtOLwoUtbDC2lB5lMfAUFPRkL37kmTo5w Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: f00e986d888b46509f396884fe32853c Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ListImageFiltersTestJSON-1589620821 Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f00e986d888b46509f396884fe32853c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f00e986d888b46509f396884fe32853c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f00e986d888b46509f396884fe32853c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f00e986d888b46509f396884fe32853c"}]}] Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ListImageFiltersTestJSON-1589620821 Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: f00e986d888b46509f396884fe32853c Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1589620821 Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ListImageFiltersTestJSON-1589620821-project Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 70ef1c6abe074ce9af7b6baaef4721b9 Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ListImageFiltersTestJSON-1589620821-project Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance da89d46d-4ae1-466f-9889-e1d528e843e5 could not be found. Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'da89d46d-4ae1-466f-9889-e1d528e843e5'} Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da89d46d-4ae1-466f-9889-e1d528e843e5 could not be found. Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da89d46d-4ae1-466f-9889-e1d528e843e5 could not be found. Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:36.714501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.719666 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:36.719666 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:36.719666 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:36.719666 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:36.719666 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:36.719666 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da89d46d-4ae1-466f-9889-e1d528e843e5 could not be found. Oct 04 18:16:36.719666 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:36.721759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Returning 404 to user: Instance da89d46d-4ae1-466f-9889-e1d528e843e5 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:36.723311 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2b6faed1-2cf3-450d-86b0-5e4af0f05795 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5" status: 404 len: 111 microversion: 2.1 time: 0.061559 Oct 04 18:16:36.724765 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1876/3723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:36 2022] GET /compute/v2.1/servers/da89d46d-4ae1-466f-9889-e1d528e843e5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:36.738807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-14e8e9fe-79ca-4c9f-bfcc-e71513619ab9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1555e50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:37.330154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1c46411f-b6df-4108-9785-6c7314f249d8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:37.343794 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c46411f-b6df-4108-9785-6c7314f249d8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.792840 Oct 04 18:16:37.359776 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1848/3724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:36 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:37.359776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da69ff97-1778-485f-9fb5-8427f9ac5b9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:37.359776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-da69ff97-1778-485f-9fb5-8427f9ac5b9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:37.377425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da69ff97-1778-485f-9fb5-8427f9ac5b9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.379092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da69ff97-1778-485f-9fb5-8427f9ac5b9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.379483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da69ff97-1778-485f-9fb5-8427f9ac5b9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.380234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da69ff97-1778-485f-9fb5-8427f9ac5b9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.383006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da69ff97-1778-485f-9fb5-8427f9ac5b9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.384464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da69ff97-1778-485f-9fb5-8427f9ac5b9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.506073 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-14e8e9fe-79ca-4c9f-bfcc-e71513619ab9 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "DELETE /compute/v2.1/images/546c2568-c2a9-4f17-9fa9-23f12c79f848" status: 204 len: 0 microversion: 2.1 time: 0.776507 Oct 04 18:16:37.506934 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1877/3725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:36 2022] DELETE /compute/v2.1/images/546c2568-c2a9-4f17-9fa9-23f12c79f848 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:16:37.515515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cc3caa4e-edb5-479c-b24d-a3bc1ffe1fb2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d124ef70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:37.675430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:37.729739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=34 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:37.774520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-da69ff97-1778-485f-9fb5-8427f9ac5b9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:37.800292 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-da69ff97-1778-485f-9fb5-8427f9ac5b9c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.452246 Oct 04 18:16:37.802434 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1849/3726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:37 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:37.833128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-69666722-bdfc-4a44-bf5c-a11241e4295e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:37.833831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-69666722-bdfc-4a44-bf5c-a11241e4295e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:37.845110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69666722-bdfc-4a44-bf5c-a11241e4295e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.846082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69666722-bdfc-4a44-bf5c-a11241e4295e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.846857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69666722-bdfc-4a44-bf5c-a11241e4295e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.848779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69666722-bdfc-4a44-bf5c-a11241e4295e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.849473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69666722-bdfc-4a44-bf5c-a11241e4295e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.852103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69666722-bdfc-4a44-bf5c-a11241e4295e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.892416 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cc3caa4e-edb5-479c-b24d-a3bc1ffe1fb2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "DELETE /compute/v2.1/images/fe3a3ebb-2f08-4789-8fde-8601ffa861cb" status: 204 len: 0 microversion: 2.1 time: 0.381224 Oct 04 18:16:37.893669 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1878/3727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:37 2022] DELETE /compute/v2.1/images/fe3a3ebb-2f08-4789-8fde-8601ffa861cb => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:37.902557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0f086728-941a-4a85-b186-9b0fc02236d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] Calling method '.version_select at 0x7fd4d1291d30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:38.147896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-69666722-bdfc-4a44-bf5c-a11241e4295e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.158433 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-69666722-bdfc-4a44-bf5c-a11241e4295e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.331095 Oct 04 18:16:38.176180 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1850/3728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:37 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:38.191012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:38.193911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:38.200959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.201702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.202584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.203619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.204241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.204826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.210388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:38.230098 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0f086728-941a-4a85-b186-9b0fc02236d2 tempest-ListImageFiltersTestJSON-1589620821 tempest-ListImageFiltersTestJSON-1589620821-project] 10.222.0.18 "DELETE /compute/v2.1/images/bfdcb138-50e4-4cf8-9b58-6604494b64ee" status: 204 len: 0 microversion: 2.1 time: 0.332305 Oct 04 18:16:38.230941 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1879/3729] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:37 2022] DELETE /compute/v2.1/images/bfdcb138-50e4-4cf8-9b58-6604494b64ee => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:16:38.241161 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2/action HTTP/1.1 Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 28 Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: {"reboot": {"type": "SOFT"}} Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c0cc437e-a891-44ca-a8c7-a2f708fe69d2', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:38.243709 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:38.247972 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-da5f83c1-5e65-4cb1-a989-f039e555032b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2/action" status: 404 len: 111 microversion: 2.1 time: 0.059361 Oct 04 18:16:38.249816 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1851/3730] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:38 2022] POST /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:16:38.254461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-694518c9-ecdf-4b1e-b8d7-a33d9513b8c2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:38.255125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-694518c9-ecdf-4b1e-b8d7-a33d9513b8c2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:38.266075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694518c9-ecdf-4b1e-b8d7-a33d9513b8c2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.268395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694518c9-ecdf-4b1e-b8d7-a33d9513b8c2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.268873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694518c9-ecdf-4b1e-b8d7-a33d9513b8c2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.269625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694518c9-ecdf-4b1e-b8d7-a33d9513b8c2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.272068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694518c9-ecdf-4b1e-b8d7-a33d9513b8c2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.272514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694518c9-ecdf-4b1e-b8d7-a33d9513b8c2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.369282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-26f51981-6cc5-41f2-8f93-e406b962b85e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:38.370737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-26f51981-6cc5-41f2-8f93-e406b962b85e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:38.397596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26f51981-6cc5-41f2-8f93-e406b962b85e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.401481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26f51981-6cc5-41f2-8f93-e406b962b85e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.408551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26f51981-6cc5-41f2-8f93-e406b962b85e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.415116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26f51981-6cc5-41f2-8f93-e406b962b85e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.416654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26f51981-6cc5-41f2-8f93-e406b962b85e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.418649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26f51981-6cc5-41f2-8f93-e406b962b85e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.844067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-26f51981-6cc5-41f2-8f93-e406b962b85e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.854021 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-26f51981-6cc5-41f2-8f93-e406b962b85e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.490600 Oct 04 18:16:38.857449 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1852/3731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:38 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:38.863387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-694518c9-ecdf-4b1e-b8d7-a33d9513b8c2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.874476 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-694518c9-ecdf-4b1e-b8d7-a33d9513b8c2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.622872 Oct 04 18:16:38.875561 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1880/3732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:38 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:38.917808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-61a1bd48-f11a-42b9-b55f-9237f1b9d8df tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:38.918652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-61a1bd48-f11a-42b9-b55f-9237f1b9d8df tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:38.933159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61a1bd48-f11a-42b9-b55f-9237f1b9d8df tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.933676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61a1bd48-f11a-42b9-b55f-9237f1b9d8df tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.934371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61a1bd48-f11a-42b9-b55f-9237f1b9d8df tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.943610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61a1bd48-f11a-42b9-b55f-9237f1b9d8df tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.944906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61a1bd48-f11a-42b9-b55f-9237f1b9d8df tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.946446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61a1bd48-f11a-42b9-b55f-9237f1b9d8df tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.035609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:39.095880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=39 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:39.293673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61a1bd48-f11a-42b9-b55f-9237f1b9d8df tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:39.303604 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-61a1bd48-f11a-42b9-b55f-9237f1b9d8df tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.389515 Oct 04 18:16:39.305009 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1853/3733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:38 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:39.331158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-94f168ef-d200-4c5c-ae1f-a3386e995047 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:39.333539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-94f168ef-d200-4c5c-ae1f-a3386e995047 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: ec13bed3-f475-4da1-8cf9-9ecaa819e054] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.347574 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-94f168ef-d200-4c5c-ae1f-a3386e995047 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance ec13bed3-f475-4da1-8cf9-9ecaa819e054 could not be found. Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-94f168ef-d200-4c5c-ae1f-a3386e995047 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/ec13bed3-f475-4da1-8cf9-9ecaa819e054/action HTTP/1.1 Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 28 Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: {"reboot": {"type": "SOFT"}} Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ec13bed3-f475-4da1-8cf9-9ecaa819e054 could not be found. Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ec13bed3-f475-4da1-8cf9-9ecaa819e054', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec13bed3-f475-4da1-8cf9-9ecaa819e054 could not be found. Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec13bed3-f475-4da1-8cf9-9ecaa819e054 could not be found. Oct 04 18:16:39.352771 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec13bed3-f475-4da1-8cf9-9ecaa819e054 could not be found. Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-94f168ef-d200-4c5c-ae1f-a3386e995047 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance ec13bed3-f475-4da1-8cf9-9ecaa819e054 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:39.357768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-94f168ef-d200-4c5c-ae1f-a3386e995047 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/ec13bed3-f475-4da1-8cf9-9ecaa819e054/action" status: 404 len: 111 microversion: 2.1 time: 0.027603 Oct 04 18:16:39.365726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d0e2a66-3492-4e6e-be95-d9b148ca930f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.366364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0d0e2a66-3492-4e6e-be95-d9b148ca930f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.367154 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1881/3734] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:39 2022] POST /compute/v2.1/servers/ec13bed3-f475-4da1-8cf9-9ecaa819e054/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:39.383591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d0e2a66-3492-4e6e-be95-d9b148ca930f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.385686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d0e2a66-3492-4e6e-be95-d9b148ca930f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.387238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d0e2a66-3492-4e6e-be95-d9b148ca930f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.387994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d0e2a66-3492-4e6e-be95-d9b148ca930f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.388467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d0e2a66-3492-4e6e-be95-d9b148ca930f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.391249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d0e2a66-3492-4e6e-be95-d9b148ca930f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.715480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0d0e2a66-3492-4e6e-be95-d9b148ca930f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:39.724363 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0d0e2a66-3492-4e6e-be95-d9b148ca930f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.362554 Oct 04 18:16:39.725214 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1854/3735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:39.752172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3e9b3a0c-f311-4d3a-9c9f-af364af0add6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.757868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3e9b3a0c-f311-4d3a-9c9f-af364af0add6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.766753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9b3a0c-f311-4d3a-9c9f-af364af0add6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.767523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9b3a0c-f311-4d3a-9c9f-af364af0add6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.768172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9b3a0c-f311-4d3a-9c9f-af364af0add6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.769086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9b3a0c-f311-4d3a-9c9f-af364af0add6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.769553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9b3a0c-f311-4d3a-9c9f-af364af0add6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.769989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9b3a0c-f311-4d3a-9c9f-af364af0add6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.879793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01c8f270-5e95-461f-9d59-a67561a5cc3e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.880790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01c8f270-5e95-461f-9d59-a67561a5cc3e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.893405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01c8f270-5e95-461f-9d59-a67561a5cc3e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.893966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01c8f270-5e95-461f-9d59-a67561a5cc3e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.894428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01c8f270-5e95-461f-9d59-a67561a5cc3e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.895213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01c8f270-5e95-461f-9d59-a67561a5cc3e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.898704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01c8f270-5e95-461f-9d59-a67561a5cc3e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.899283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01c8f270-5e95-461f-9d59-a67561a5cc3e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.995831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3e9b3a0c-f311-4d3a-9c9f-af364af0add6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.004436 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3e9b3a0c-f311-4d3a-9c9f-af364af0add6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.257401 Oct 04 18:16:40.005405 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1882/3736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:40.032694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:40.035959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:40.053191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.059344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.060310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.061619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.062545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.063482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.110053 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2/action HTTP/1.1 Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 65 Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'c0cc437e-a891-44ca-a8c7-a2f708fe69d2', 'body': {'rebuild': {'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8'}}} Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:16:40.114486 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:16:40.119244 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:40.121479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:40.122753 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ab1c6f1-d4ac-48b2-84b1-0ce6e2777912 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2/action" status: 404 len: 111 microversion: 2.1 time: 0.095324 Oct 04 18:16:40.126718 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1883/3737] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:40 2022] POST /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2/action => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:40.136848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d61eb6b9-6a58-404f-ae5d-a5510cc111ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:40.137680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d61eb6b9-6a58-404f-ae5d-a5510cc111ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:40.150785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d61eb6b9-6a58-404f-ae5d-a5510cc111ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.157503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d61eb6b9-6a58-404f-ae5d-a5510cc111ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.158532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d61eb6b9-6a58-404f-ae5d-a5510cc111ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.159774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d61eb6b9-6a58-404f-ae5d-a5510cc111ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.160428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d61eb6b9-6a58-404f-ae5d-a5510cc111ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.162066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d61eb6b9-6a58-404f-ae5d-a5510cc111ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.431225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01c8f270-5e95-461f-9d59-a67561a5cc3e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.442468 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01c8f270-5e95-461f-9d59-a67561a5cc3e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.568677 Oct 04 18:16:40.449102 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1855/3738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:40.593081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d61eb6b9-6a58-404f-ae5d-a5510cc111ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.610531 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d61eb6b9-6a58-404f-ae5d-a5510cc111ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.479993 Oct 04 18:16:40.617941 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1884/3739] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:40 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:40.644486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a67cdeae-976b-475f-8d33-b27f5b5b495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:40.645506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a67cdeae-976b-475f-8d33-b27f5b5b495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:40.656433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a67cdeae-976b-475f-8d33-b27f5b5b495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.656433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a67cdeae-976b-475f-8d33-b27f5b5b495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.656433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a67cdeae-976b-475f-8d33-b27f5b5b495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.656878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a67cdeae-976b-475f-8d33-b27f5b5b495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.657700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a67cdeae-976b-475f-8d33-b27f5b5b495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.658418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a67cdeae-976b-475f-8d33-b27f5b5b495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.603465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-712040122", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "4cc855b5-1ce4-4517-be4f-7740c555f2ba"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:41.709888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] validate_networks() for [('4cc855b5-1ce4-4517-be4f-7740c555f2ba', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:41.847586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a67cdeae-976b-475f-8d33-b27f5b5b495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:41.863206 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a67cdeae-976b-475f-8d33-b27f5b5b495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 1.222945 Oct 04 18:16:41.864687 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1856/3740] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:40 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:41.869806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a34d8d73-8b47-4ce2-9883-fd5bd5579755 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:41.870663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a34d8d73-8b47-4ce2-9883-fd5bd5579755 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:41.878037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a34d8d73-8b47-4ce2-9883-fd5bd5579755 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.879236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a34d8d73-8b47-4ce2-9883-fd5bd5579755 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.879868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a34d8d73-8b47-4ce2-9883-fd5bd5579755 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.880878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a34d8d73-8b47-4ce2-9883-fd5bd5579755 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.881688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a34d8d73-8b47-4ce2-9883-fd5bd5579755 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.883143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a34d8d73-8b47-4ce2-9883-fd5bd5579755 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.512473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a34d8d73-8b47-4ce2-9883-fd5bd5579755 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.526537 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a34d8d73-8b47-4ce2-9883-fd5bd5579755 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.660447 Oct 04 18:16:42.553182 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1857/3741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:41 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:42.559376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-feadcc4b-34e2-4ea6-b5fe-bce2f4e8f72e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:42.564591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-feadcc4b-34e2-4ea6-b5fe-bce2f4e8f72e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: 0ea2453d-690e-4004-a85d-1f2878c467c9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.573008 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-feadcc4b-34e2-4ea6-b5fe-bce2f4e8f72e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 0ea2453d-690e-4004-a85d-1f2878c467c9 could not be found. Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-feadcc4b-34e2-4ea6-b5fe-bce2f4e8f72e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/0ea2453d-690e-4004-a85d-1f2878c467c9/action HTTP/1.1 Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 65 Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 0ea2453d-690e-4004-a85d-1f2878c467c9 could not be found. Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '0ea2453d-690e-4004-a85d-1f2878c467c9', 'body': {'rebuild': {'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8'}}} Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ea2453d-690e-4004-a85d-1f2878c467c9 could not be found. Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:16:42.576165 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ea2453d-690e-4004-a85d-1f2878c467c9 could not be found. Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ea2453d-690e-4004-a85d-1f2878c467c9 could not be found. Oct 04 18:16:42.582420 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.586488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-feadcc4b-34e2-4ea6-b5fe-bce2f4e8f72e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 0ea2453d-690e-4004-a85d-1f2878c467c9 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:42.590857 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-feadcc4b-34e2-4ea6-b5fe-bce2f4e8f72e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/0ea2453d-690e-4004-a85d-1f2878c467c9/action" status: 404 len: 111 microversion: 2.1 time: 0.036222 Oct 04 18:16:42.591560 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1858/3742] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:42 2022] POST /compute/v2.1/servers/0ea2453d-690e-4004-a85d-1f2878c467c9/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:42.602139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-25d8bef2-3361-433f-86e1-9b49d760ba8c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.604466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-25d8bef2-3361-433f-86e1-9b49d760ba8c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.618140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25d8bef2-3361-433f-86e1-9b49d760ba8c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.618912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25d8bef2-3361-433f-86e1-9b49d760ba8c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.619548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25d8bef2-3361-433f-86e1-9b49d760ba8c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.620430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25d8bef2-3361-433f-86e1-9b49d760ba8c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.621066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25d8bef2-3361-433f-86e1-9b49d760ba8c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.621654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25d8bef2-3361-433f-86e1-9b49d760ba8c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.339421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-25d8bef2-3361-433f-86e1-9b49d760ba8c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:43.357665 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-25d8bef2-3361-433f-86e1-9b49d760ba8c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.759099 Oct 04 18:16:43.359415 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1859/3743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:42 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:43.390258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eac7bdec-079c-4768-bedb-ee8c2f5cb219 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:43.391782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eac7bdec-079c-4768-bedb-ee8c2f5cb219 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:43.406393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eac7bdec-079c-4768-bedb-ee8c2f5cb219 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.407472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eac7bdec-079c-4768-bedb-ee8c2f5cb219 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.408358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eac7bdec-079c-4768-bedb-ee8c2f5cb219 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.409404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eac7bdec-079c-4768-bedb-ee8c2f5cb219 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.410240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eac7bdec-079c-4768-bedb-ee8c2f5cb219 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.411215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eac7bdec-079c-4768-bedb-ee8c2f5cb219 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.657830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:43.658350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:43.658796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:43.659286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:43.659757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:43.680397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.680945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.690306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.696729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.696992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.697307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.751742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Getting quotas for project 2f1e6d8ca0c447259a1f7fae11ddfd5b. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:43.757345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Getting quotas for user b7f5fda3ec0548f7bc6c339776d9ed33 and project 2f1e6d8ca0c447259a1f7fae11ddfd5b. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:43.786204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:43.790246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:43.885199 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c090d4be-af2b-4d20-91be-b990ce4fd8fa tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.817720 Oct 04 18:16:43.894414 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1885/3744] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:43.900337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49d5f146-6649-4984-9a29-ec5a6958fe32 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:43.901211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-49d5f146-6649-4984-9a29-ec5a6958fe32 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:43.910130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d5f146-6649-4984-9a29-ec5a6958fe32 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.910873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d5f146-6649-4984-9a29-ec5a6958fe32 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.912518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d5f146-6649-4984-9a29-ec5a6958fe32 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.914666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d5f146-6649-4984-9a29-ec5a6958fe32 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.915055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d5f146-6649-4984-9a29-ec5a6958fe32 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.915704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d5f146-6649-4984-9a29-ec5a6958fe32 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.152886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eac7bdec-079c-4768-bedb-ee8c2f5cb219 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:44.168949 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eac7bdec-079c-4768-bedb-ee8c2f5cb219 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.784075 Oct 04 18:16:44.170211 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1860/3745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:43 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:44.176225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6179c931-d93b-451b-8e56-0597610d3b8f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:44.190378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6179c931-d93b-451b-8e56-0597610d3b8f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:44.361525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6179c931-d93b-451b-8e56-0597610d3b8f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:44.380473 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6179c931-d93b-451b-8e56-0597610d3b8f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1224 microversion: 2.1 time: 0.207717 Oct 04 18:16:44.406470 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1861/3746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:44 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1224 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:44.437638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2d321ef0-af56-4e02-afaa-48e1c1e4b133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:44.439898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2d321ef0-af56-4e02-afaa-48e1c1e4b133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: 17bedfef-0bb2-4082-9650-eab3c15f3420] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:44.486778 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-2d321ef0-af56-4e02-afaa-48e1c1e4b133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 17bedfef-0bb2-4082-9650-eab3c15f3420 could not be found. Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2d321ef0-af56-4e02-afaa-48e1c1e4b133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/17bedfef-0bb2-4082-9650-eab3c15f3420/action HTTP/1.1 Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 15 Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: {"restore": {}} Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 17bedfef-0bb2-4082-9650-eab3c15f3420 could not be found. Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '17bedfef-0bb2-4082-9650-eab3c15f3420', 'body': {'restore': {}}} Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17bedfef-0bb2-4082-9650-eab3c15f3420 could not be found. Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17bedfef-0bb2-4082-9650-eab3c15f3420 could not be found. Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:44.491841 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:44.497322 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:44.497322 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:44.497322 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17bedfef-0bb2-4082-9650-eab3c15f3420 could not be found. Oct 04 18:16:44.497322 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:44.498884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2d321ef0-af56-4e02-afaa-48e1c1e4b133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 17bedfef-0bb2-4082-9650-eab3c15f3420 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:44.506622 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2d321ef0-af56-4e02-afaa-48e1c1e4b133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/17bedfef-0bb2-4082-9650-eab3c15f3420/action" status: 404 len: 111 microversion: 2.1 time: 0.090186 Oct 04 18:16:44.510508 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1862/3747] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:44 2022] POST /compute/v2.1/servers/17bedfef-0bb2-4082-9650-eab3c15f3420/action => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:44.518844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9280bfd0-30d3-4fcc-aab0-c982effe20be tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:44.519835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9280bfd0-30d3-4fcc-aab0-c982effe20be tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:44.537873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9280bfd0-30d3-4fcc-aab0-c982effe20be tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.538392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9280bfd0-30d3-4fcc-aab0-c982effe20be tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.538843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9280bfd0-30d3-4fcc-aab0-c982effe20be tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.539612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9280bfd0-30d3-4fcc-aab0-c982effe20be tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.540075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9280bfd0-30d3-4fcc-aab0-c982effe20be tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.540712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9280bfd0-30d3-4fcc-aab0-c982effe20be tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.862028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-49d5f146-6649-4984-9a29-ec5a6958fe32 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:44.945390 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49d5f146-6649-4984-9a29-ec5a6958fe32 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 1.027600 Oct 04 18:16:44.956923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9280bfd0-30d3-4fcc-aab0-c982effe20be tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:44.972573 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9280bfd0-30d3-4fcc-aab0-c982effe20be tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.459961 Oct 04 18:16:44.973352 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1863/3748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:44 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:44.977081 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1886/3749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:43 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:45.008278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-345fd690-d1e1-4bf7-b48c-946a147342b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:45.033596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-345fd690-d1e1-4bf7-b48c-946a147342b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:45.078856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345fd690-d1e1-4bf7-b48c-946a147342b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.083751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345fd690-d1e1-4bf7-b48c-946a147342b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.088228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345fd690-d1e1-4bf7-b48c-946a147342b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.093062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345fd690-d1e1-4bf7-b48c-946a147342b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.096904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345fd690-d1e1-4bf7-b48c-946a147342b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.097628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-345fd690-d1e1-4bf7-b48c-946a147342b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.410988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-26689d25-bd0b-40bb-9818-edd6a8c78d69 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:45.411638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-26689d25-bd0b-40bb-9818-edd6a8c78d69 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:45.430460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26689d25-bd0b-40bb-9818-edd6a8c78d69 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.431347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26689d25-bd0b-40bb-9818-edd6a8c78d69 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.431820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26689d25-bd0b-40bb-9818-edd6a8c78d69 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.432966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26689d25-bd0b-40bb-9818-edd6a8c78d69 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.435107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26689d25-bd0b-40bb-9818-edd6a8c78d69 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.437048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26689d25-bd0b-40bb-9818-edd6a8c78d69 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.531806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:45.954860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-26689d25-bd0b-40bb-9818-edd6a8c78d69 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.964671 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-26689d25-bd0b-40bb-9818-edd6a8c78d69 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1228 microversion: 2.1 time: 0.559196 Oct 04 18:16:45.974467 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1887/3750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:45 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1228 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:45.980246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a8b9194-6135-4209-b6e3-dd5d2d47f218 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:45.987530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3a8b9194-6135-4209-b6e3-dd5d2d47f218 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.009357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8b9194-6135-4209-b6e3-dd5d2d47f218 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.010169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8b9194-6135-4209-b6e3-dd5d2d47f218 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.022894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8b9194-6135-4209-b6e3-dd5d2d47f218 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.025212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8b9194-6135-4209-b6e3-dd5d2d47f218 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.026921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8b9194-6135-4209-b6e3-dd5d2d47f218 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.031798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8b9194-6135-4209-b6e3-dd5d2d47f218 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.337689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-345fd690-d1e1-4bf7-b48c-946a147342b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.350411 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-345fd690-d1e1-4bf7-b48c-946a147342b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 1.351325 Oct 04 18:16:46.359420 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1864/3751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:44 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:46.383441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:46.390867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.413810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.415913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.417593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.418419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3a8b9194-6135-4209-b6e3-dd5d2d47f218 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.421662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.422080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.424078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.429311 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3a8b9194-6135-4209-b6e3-dd5d2d47f218 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.453310 Oct 04 18:16:46.434860 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1888/3752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:45 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:46.516425 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Cannot 'restore' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action HTTP/1.1 Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 15 Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: {"restore": {}} Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: exception: Cannot 'restore' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'afef2588-b2e9-4b9e-943c-44469215dd64', 'body': {'restore': {}}} Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afef2588-b2e9-4b9e-943c-44469215dd64 in vm_state active. Cannot restore while the instance is in this state. Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:46.520348 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:46.524587 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:46.524587 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:46.524587 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:46.524587 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:16:46.524587 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:46.528288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 409 to user: Cannot 'restore' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:46.529648 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d6e889fb-f606-4807-84be-4640d11a709c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 409 len: 145 microversion: 2.1 time: 0.151052 Oct 04 18:16:46.531062 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1865/3753] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:46 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 145 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:16:46.539363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-62876082-02b2-4e43-bdcc-17f3b4bd93ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:46.540143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-62876082-02b2-4e43-bdcc-17f3b4bd93ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.560186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62876082-02b2-4e43-bdcc-17f3b4bd93ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.560876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62876082-02b2-4e43-bdcc-17f3b4bd93ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.563602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62876082-02b2-4e43-bdcc-17f3b4bd93ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.567303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62876082-02b2-4e43-bdcc-17f3b4bd93ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.568207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62876082-02b2-4e43-bdcc-17f3b4bd93ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.568844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62876082-02b2-4e43-bdcc-17f3b4bd93ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.002073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fcbac286-8002-42c0-bb03-31582650a52e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:47.002799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fcbac286-8002-42c0-bb03-31582650a52e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.012263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcbac286-8002-42c0-bb03-31582650a52e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.017544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcbac286-8002-42c0-bb03-31582650a52e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.018365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcbac286-8002-42c0-bb03-31582650a52e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.019471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcbac286-8002-42c0-bb03-31582650a52e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.020432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcbac286-8002-42c0-bb03-31582650a52e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.021039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fcbac286-8002-42c0-bb03-31582650a52e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.155599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fcbac286-8002-42c0-bb03-31582650a52e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:47.168288 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fcbac286-8002-42c0-bb03-31582650a52e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1282 microversion: 2.1 time: 0.170779 Oct 04 18:16:47.169658 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1866/3754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:46 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:47.193315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-62876082-02b2-4e43-bdcc-17f3b4bd93ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:47.208139 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-62876082-02b2-4e43-bdcc-17f3b4bd93ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.672908 Oct 04 18:16:47.224844 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1889/3755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:46 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:47.234156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-50aeafca-b4a8-4f39-8507-2bb9442d4377 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:47.234788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-50aeafca-b4a8-4f39-8507-2bb9442d4377 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.243503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50aeafca-b4a8-4f39-8507-2bb9442d4377 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.244245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50aeafca-b4a8-4f39-8507-2bb9442d4377 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.244856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50aeafca-b4a8-4f39-8507-2bb9442d4377 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.245901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50aeafca-b4a8-4f39-8507-2bb9442d4377 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.246578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50aeafca-b4a8-4f39-8507-2bb9442d4377 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.247259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50aeafca-b4a8-4f39-8507-2bb9442d4377 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.457610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4672063a-daf2-4217-905c-4bcf3b780689 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:47.458235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4672063a-daf2-4217-905c-4bcf3b780689 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.476111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4672063a-daf2-4217-905c-4bcf3b780689 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.476610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4672063a-daf2-4217-905c-4bcf3b780689 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.477246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4672063a-daf2-4217-905c-4bcf3b780689 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.489402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4672063a-daf2-4217-905c-4bcf3b780689 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.489911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4672063a-daf2-4217-905c-4bcf3b780689 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.493374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4672063a-daf2-4217-905c-4bcf3b780689 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.705113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-50aeafca-b4a8-4f39-8507-2bb9442d4377 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:47.715675 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-50aeafca-b4a8-4f39-8507-2bb9442d4377 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.486244 Oct 04 18:16:47.720108 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1867/3756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:47 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:47.745003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f5ecff2-9c74-4cd5-b9cf-fd00a184a96e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:47.745864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9f5ecff2-9c74-4cd5-b9cf-fd00a184a96e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: 5f2c2759-0cf6-4a03-9963-9c4b931f9628] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.758240 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-9f5ecff2-9c74-4cd5-b9cf-fd00a184a96e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 5f2c2759-0cf6-4a03-9963-9c4b931f9628 could not be found. Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f5ecff2-9c74-4cd5-b9cf-fd00a184a96e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/5f2c2759-0cf6-4a03-9963-9c4b931f9628/action HTTP/1.1 Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 14 Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: {"resume": {}} Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 5f2c2759-0cf6-4a03-9963-9c4b931f9628 could not be found. Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '5f2c2759-0cf6-4a03-9963-9c4b931f9628', 'body': {'resume': {}}} Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f2c2759-0cf6-4a03-9963-9c4b931f9628 could not be found. Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f2c2759-0cf6-4a03-9963-9c4b931f9628 could not be found. Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:47.774094 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:47.779157 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:47.779157 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:47.779157 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f2c2759-0cf6-4a03-9963-9c4b931f9628 could not be found. Oct 04 18:16:47.779157 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:47.780887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f5ecff2-9c74-4cd5-b9cf-fd00a184a96e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 5f2c2759-0cf6-4a03-9963-9c4b931f9628 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:47.781991 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9f5ecff2-9c74-4cd5-b9cf-fd00a184a96e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/5f2c2759-0cf6-4a03-9963-9c4b931f9628/action" status: 404 len: 111 microversion: 2.1 time: 0.040963 Oct 04 18:16:47.782772 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1868/3757] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:47 2022] POST /compute/v2.1/servers/5f2c2759-0cf6-4a03-9963-9c4b931f9628/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:16:47.791275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-374c92e5-b19e-424c-bcff-4e98b3fdb8fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:47.792151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-374c92e5-b19e-424c-bcff-4e98b3fdb8fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.804977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-374c92e5-b19e-424c-bcff-4e98b3fdb8fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.805790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-374c92e5-b19e-424c-bcff-4e98b3fdb8fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.806390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-374c92e5-b19e-424c-bcff-4e98b3fdb8fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.807321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-374c92e5-b19e-424c-bcff-4e98b3fdb8fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.807945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-374c92e5-b19e-424c-bcff-4e98b3fdb8fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.815259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-374c92e5-b19e-424c-bcff-4e98b3fdb8fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.276432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4672063a-daf2-4217-905c-4bcf3b780689 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:48.289974 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4672063a-daf2-4217-905c-4bcf3b780689 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.833455 Oct 04 18:16:48.294093 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1890/3758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:47 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:48.312507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-becd99f8-b320-40e4-8ef0-acd4e7c5b7ff tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:48.314063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-becd99f8-b320-40e4-8ef0-acd4e7c5b7ff tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:48.342492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-becd99f8-b320-40e4-8ef0-acd4e7c5b7ff tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.345155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-becd99f8-b320-40e4-8ef0-acd4e7c5b7ff tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.346004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-becd99f8-b320-40e4-8ef0-acd4e7c5b7ff tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.346995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-becd99f8-b320-40e4-8ef0-acd4e7c5b7ff tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.349577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-becd99f8-b320-40e4-8ef0-acd4e7c5b7ff tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.350299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-becd99f8-b320-40e4-8ef0-acd4e7c5b7ff tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.402841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-374c92e5-b19e-424c-bcff-4e98b3fdb8fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:48.419520 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-374c92e5-b19e-424c-bcff-4e98b3fdb8fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.631877 Oct 04 18:16:48.422143 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1869/3759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:47 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:48.448757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-68391219-b343-4ecd-84ec-071c116bce5e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:48.449764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-68391219-b343-4ecd-84ec-071c116bce5e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:48.459219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68391219-b343-4ecd-84ec-071c116bce5e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.460008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68391219-b343-4ecd-84ec-071c116bce5e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.460746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68391219-b343-4ecd-84ec-071c116bce5e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.461809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68391219-b343-4ecd-84ec-071c116bce5e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.462516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68391219-b343-4ecd-84ec-071c116bce5e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.463238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68391219-b343-4ecd-84ec-071c116bce5e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.135222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-68391219-b343-4ecd-84ec-071c116bce5e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:49.143613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-becd99f8-b320-40e4-8ef0-acd4e7c5b7ff tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:49.152432 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-becd99f8-b320-40e4-8ef0-acd4e7c5b7ff tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1324 microversion: 2.1 time: 0.855741 Oct 04 18:16:49.156322 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-68391219-b343-4ecd-84ec-071c116bce5e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.712388 Oct 04 18:16:49.156714 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1891/3760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:48 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1324 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:49.174692 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1870/3761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:48 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:49.209000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:49.209857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:49.216196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.221455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.224401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.225548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.226247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.228959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.292005 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Cannot 'resume' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action HTTP/1.1 Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 14 Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: {"resume": {}} Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'resume' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'afef2588-b2e9-4b9e-943c-44469215dd64', 'body': {'resume': {}}} Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afef2588-b2e9-4b9e-943c-44469215dd64 in vm_state active. Cannot resume while the instance is in this state. Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:49.297399 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:49.302428 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:49.302428 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:49.302428 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:49.302428 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:49.302428 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:49.302428 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:16:49.302428 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:49.303220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 409 to user: Cannot 'resume' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:49.304990 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9036a974-9029-483d-9744-3030120cb056 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 409 len: 144 microversion: 2.1 time: 0.100869 Oct 04 18:16:49.310122 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1892/3762] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:49 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 144 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:16:49.318649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1b130231-3c4f-4533-9950-32ce127b510e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:49.319374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1b130231-3c4f-4533-9950-32ce127b510e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:49.338912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b130231-3c4f-4533-9950-32ce127b510e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.344026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b130231-3c4f-4533-9950-32ce127b510e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.344026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b130231-3c4f-4533-9950-32ce127b510e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.344309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b130231-3c4f-4533-9950-32ce127b510e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.344577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b130231-3c4f-4533-9950-32ce127b510e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.347221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5d938412-f49b-4645-a023-c59f4bfc77a0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:49.347879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5d938412-f49b-4645-a023-c59f4bfc77a0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:49.352995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b130231-3c4f-4533-9950-32ce127b510e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.382858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d938412-f49b-4645-a023-c59f4bfc77a0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.387149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d938412-f49b-4645-a023-c59f4bfc77a0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.387678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d938412-f49b-4645-a023-c59f4bfc77a0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.388446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d938412-f49b-4645-a023-c59f4bfc77a0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.388925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d938412-f49b-4645-a023-c59f4bfc77a0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.407208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d938412-f49b-4645-a023-c59f4bfc77a0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.329850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1b130231-3c4f-4533-9950-32ce127b510e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:50.339248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5d938412-f49b-4645-a023-c59f4bfc77a0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:50.354417 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5d938412-f49b-4645-a023-c59f4bfc77a0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 1.030699 Oct 04 18:16:50.358400 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1893/3763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:49 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:50.359617 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1b130231-3c4f-4533-9950-32ce127b510e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 1.043647 Oct 04 18:16:50.381194 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1871/3764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:49 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:50.387837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-645f5b7d-96a9-4306-a2dd-e74406333719 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:50.387990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-76b8527d-e3dc-405b-a0b9-a919c4402c6e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:50.388568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-645f5b7d-96a9-4306-a2dd-e74406333719 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:50.388692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-76b8527d-e3dc-405b-a0b9-a919c4402c6e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:50.395756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-645f5b7d-96a9-4306-a2dd-e74406333719 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:50.399606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b8527d-e3dc-405b-a0b9-a919c4402c6e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:50.400308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-645f5b7d-96a9-4306-a2dd-e74406333719 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:50.400842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-645f5b7d-96a9-4306-a2dd-e74406333719 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.401464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b8527d-e3dc-405b-a0b9-a919c4402c6e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:50.402929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-645f5b7d-96a9-4306-a2dd-e74406333719 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:50.403572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b8527d-e3dc-405b-a0b9-a919c4402c6e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.405648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b8527d-e3dc-405b-a0b9-a919c4402c6e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:50.406153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-645f5b7d-96a9-4306-a2dd-e74406333719 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:50.408748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-645f5b7d-96a9-4306-a2dd-e74406333719 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.419457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b8527d-e3dc-405b-a0b9-a919c4402c6e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:50.423241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76b8527d-e3dc-405b-a0b9-a919c4402c6e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.984579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-76b8527d-e3dc-405b-a0b9-a919c4402c6e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:50.988090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:50.993355 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-76b8527d-e3dc-405b-a0b9-a919c4402c6e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.610775 Oct 04 18:16:51.026158 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1872/3765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:50 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:51.108427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-645f5b7d-96a9-4306-a2dd-e74406333719 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:51.128867 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-645f5b7d-96a9-4306-a2dd-e74406333719 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1324 microversion: 2.1 time: 0.751698 Oct 04 18:16:51.132525 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1894/3766] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:50 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1324 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:51.272016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b9a22b45-713e-4abb-b3d4-6f55e0176601 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b9a22b45-713e-4abb-b3d4-6f55e0176601 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 160 Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "d78eedfe-97d8-4b5e-ac16-1f5f87c44f17"}]}} Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': '', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'networks': [{'uuid': 'd78eedfe-97d8-4b5e-ac16-1f5f87c44f17'}]}}} Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi '' Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:16:51.282482 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:16:51.287115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:51.289936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b9a22b45-713e-4abb-b3d4-6f55e0176601 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:51.297038 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b9a22b45-713e-4abb-b3d4-6f55e0176601 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.029338 Oct 04 18:16:51.300728 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1873/3767] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:51 2022] POST /compute/v2.1/servers => generated 108 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:16:51.306303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d0019978-7428-42d8-9c4e-2c705b5c0481 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:51.307237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d0019978-7428-42d8-9c4e-2c705b5c0481 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:51.324144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0019978-7428-42d8-9c4e-2c705b5c0481 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.324649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0019978-7428-42d8-9c4e-2c705b5c0481 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.325101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0019978-7428-42d8-9c4e-2c705b5c0481 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.325818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0019978-7428-42d8-9c4e-2c705b5c0481 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.326503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0019978-7428-42d8-9c4e-2c705b5c0481 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.326986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d0019978-7428-42d8-9c4e-2c705b5c0481 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.397691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbd7629f-5bef-46cc-bb0e-3c6201356d1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:51.402419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bbd7629f-5bef-46cc-bb0e-3c6201356d1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:51.428929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd7629f-5bef-46cc-bb0e-3c6201356d1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.429442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd7629f-5bef-46cc-bb0e-3c6201356d1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.429894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd7629f-5bef-46cc-bb0e-3c6201356d1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.430621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd7629f-5bef-46cc-bb0e-3c6201356d1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.439261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd7629f-5bef-46cc-bb0e-3c6201356d1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.439957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd7629f-5bef-46cc-bb0e-3c6201356d1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.912953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d0019978-7428-42d8-9c4e-2c705b5c0481 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:51.924168 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d0019978-7428-42d8-9c4e-2c705b5c0481 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.621846 Oct 04 18:16:51.925357 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1895/3768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:51 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:52.026097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bbd7629f-5bef-46cc-bb0e-3c6201356d1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:52.038840 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bbd7629f-5bef-46cc-bb0e-3c6201356d1f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.652769 Oct 04 18:16:52.041918 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1874/3769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:51 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:52.048742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-77666ed7-aad9-41bb-8133-a480d3ef15d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:52.049424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-77666ed7-aad9-41bb-8133-a480d3ef15d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:52.055652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77666ed7-aad9-41bb-8133-a480d3ef15d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.056603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77666ed7-aad9-41bb-8133-a480d3ef15d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.057267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77666ed7-aad9-41bb-8133-a480d3ef15d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.058209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77666ed7-aad9-41bb-8133-a480d3ef15d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.058673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77666ed7-aad9-41bb-8133-a480d3ef15d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.059139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77666ed7-aad9-41bb-8133-a480d3ef15d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.094209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-461b5637-3adc-4e55-94f1-09239acbc1a1 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Action: 'create', calling method: .version_select at 0x7fd4d1253790>, body: {"keypair": {"name": "tempest-keypair-1225497742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiuIgbLAibkQgb3SSXSk8iVI1cQxsLtBUoyvDWkdkMkp8qyjQOtmCNYy2r7XqCW4w13cPXf0LePMRWDtcRfBt55KywjApwjXGKI8gt9nezm+FxGXPbuB9AfWNs7zVqc1A=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:52.112339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-461b5637-3adc-4e55-94f1-09239acbc1a1 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Getting quotas for project ce1ebbd32ca946f6a078df3ef2a268ea. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:52.118455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-461b5637-3adc-4e55-94f1-09239acbc1a1 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Getting quotas for user b731077b730f4881b8a7aeef7bcef20e and project ce1ebbd32ca946f6a078df3ef2a268ea. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:52.146180 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-461b5637-3adc-4e55-94f1-09239acbc1a1 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218848 Oct 04 18:16:52.146795 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1896/3770] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:16:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:52.160757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea91ca7b-e02f-494f-a881-11966192d0dd tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:52.161392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ea91ca7b-e02f-494f-a881-11966192d0dd tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:52.168418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea91ca7b-e02f-494f-a881-11966192d0dd tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.169144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea91ca7b-e02f-494f-a881-11966192d0dd tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.169572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea91ca7b-e02f-494f-a881-11966192d0dd tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.170282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea91ca7b-e02f-494f-a881-11966192d0dd tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.171740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea91ca7b-e02f-494f-a881-11966192d0dd tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.172191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea91ca7b-e02f-494f-a881-11966192d0dd tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.588842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77666ed7-aad9-41bb-8133-a480d3ef15d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:52.604892 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-77666ed7-aad9-41bb-8133-a480d3ef15d4 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.561471 Oct 04 18:16:52.606097 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1875/3771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:52 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:52.631575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4bca7e68-96e7-4f88-9f68-7b1b81c44216 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:52.633034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4bca7e68-96e7-4f88-9f68-7b1b81c44216 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: 03136b03-5c03-4cba-a951-2a43af0fa624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:52.639992 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4bca7e68-96e7-4f88-9f68-7b1b81c44216 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 03136b03-5c03-4cba-a951-2a43af0fa624 could not be found. Oct 04 18:16:52.660222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ea91ca7b-e02f-494f-a881-11966192d0dd tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:52.670245 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ea91ca7b-e02f-494f-a881-11966192d0dd tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1324 microversion: 2.1 time: 0.514807 Oct 04 18:16:52.671133 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1897/3772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:52 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4bca7e68-96e7-4f88-9f68-7b1b81c44216 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/03136b03-5c03-4cba-a951-2a43af0fa624/action HTTP/1.1 Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 14 Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: {"shelve": {}} Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 03136b03-5c03-4cba-a951-2a43af0fa624 could not be found. Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '03136b03-5c03-4cba-a951-2a43af0fa624', 'body': {'shelve': {}}} Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03136b03-5c03-4cba-a951-2a43af0fa624 could not be found. Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03136b03-5c03-4cba-a951-2a43af0fa624 could not be found. Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:52.673344 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:52.678414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:52.678414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:52.678414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03136b03-5c03-4cba-a951-2a43af0fa624 could not be found. Oct 04 18:16:52.678414 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:16:52.678414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4bca7e68-96e7-4f88-9f68-7b1b81c44216 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 03136b03-5c03-4cba-a951-2a43af0fa624 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:52.678414 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4bca7e68-96e7-4f88-9f68-7b1b81c44216 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/03136b03-5c03-4cba-a951-2a43af0fa624/action" status: 404 len: 111 microversion: 2.1 time: 0.048570 Oct 04 18:16:52.681142 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1876/3773] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:52 2022] POST /compute/v2.1/servers/03136b03-5c03-4cba-a951-2a43af0fa624/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:16:52.685248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9ced6208-fb20-4934-b95a-5c2c71d79558 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:52.686921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9ced6208-fb20-4934-b95a-5c2c71d79558 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:52.697142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ced6208-fb20-4934-b95a-5c2c71d79558 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.699695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ced6208-fb20-4934-b95a-5c2c71d79558 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.701410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ced6208-fb20-4934-b95a-5c2c71d79558 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.701830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ced6208-fb20-4934-b95a-5c2c71d79558 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.703858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ced6208-fb20-4934-b95a-5c2c71d79558 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.709227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ced6208-fb20-4934-b95a-5c2c71d79558 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.024527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-62257ae9-a07c-4125-bbd3-367a314b7942 req-6da734cc-97ce-4dcc-b348-d3d174b11837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1696dd9a-3280-44cc-a274-c4512f1a9639", "tag": "eea811d8-6d82-42a0-967e-9b0ea6b0f4a2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:53.036650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-62257ae9-a07c-4125-bbd3-367a314b7942 req-6da734cc-97ce-4dcc-b348-d3d174b11837 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.037428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-62257ae9-a07c-4125-bbd3-367a314b7942 req-6da734cc-97ce-4dcc-b348-d3d174b11837 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.038679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-62257ae9-a07c-4125-bbd3-367a314b7942 req-6da734cc-97ce-4dcc-b348-d3d174b11837 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.053383 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-62257ae9-a07c-4125-bbd3-367a314b7942 req-6da734cc-97ce-4dcc-b348-d3d174b11837 service nova] Creating event network-changed:eea811d8-6d82-42a0-967e-9b0ea6b0f4a2 for instance 1696dd9a-3280-44cc-a274-c4512f1a9639 on n-h1-850499-14 Oct 04 18:16:53.065731 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-62257ae9-a07c-4125-bbd3-367a314b7942 req-6da734cc-97ce-4dcc-b348-d3d174b11837 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044756 Oct 04 18:16:53.069143 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1877/3774] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:53.076323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f8b54a8-bcbf-435c-9c50-c5e9c51863fd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.078056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f8b54a8-bcbf-435c-9c50-c5e9c51863fd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.091382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8b54a8-bcbf-435c-9c50-c5e9c51863fd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.092167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8b54a8-bcbf-435c-9c50-c5e9c51863fd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.092855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8b54a8-bcbf-435c-9c50-c5e9c51863fd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.093746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8b54a8-bcbf-435c-9c50-c5e9c51863fd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.094363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8b54a8-bcbf-435c-9c50-c5e9c51863fd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.095439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f8b54a8-bcbf-435c-9c50-c5e9c51863fd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.591361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9ced6208-fb20-4934-b95a-5c2c71d79558 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.616139 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9ced6208-fb20-4934-b95a-5c2c71d79558 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.935037 Oct 04 18:16:53.646984 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1898/3775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:52 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:53.663741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-984856ac-099a-4fc9-86a7-44e42fafe513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.664472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-984856ac-099a-4fc9-86a7-44e42fafe513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.671985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-984856ac-099a-4fc9-86a7-44e42fafe513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.672520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-984856ac-099a-4fc9-86a7-44e42fafe513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.673895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-984856ac-099a-4fc9-86a7-44e42fafe513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.675086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-984856ac-099a-4fc9-86a7-44e42fafe513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.675785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-984856ac-099a-4fc9-86a7-44e42fafe513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.676428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-984856ac-099a-4fc9-86a7-44e42fafe513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.741523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:53.843946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f8b54a8-bcbf-435c-9c50-c5e9c51863fd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.852449 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f8b54a8-bcbf-435c-9c50-c5e9c51863fd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.781766 Oct 04 18:16:53.852935 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1878/3776] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:53 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:53.867232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80852330-fb9f-4267-baf1-c66c988b2b03 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.867768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80852330-fb9f-4267-baf1-c66c988b2b03 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.882566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80852330-fb9f-4267-baf1-c66c988b2b03 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.883368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80852330-fb9f-4267-baf1-c66c988b2b03 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.893115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80852330-fb9f-4267-baf1-c66c988b2b03 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.894361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80852330-fb9f-4267-baf1-c66c988b2b03 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.894785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80852330-fb9f-4267-baf1-c66c988b2b03 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.895243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80852330-fb9f-4267-baf1-c66c988b2b03 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.292854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-984856ac-099a-4fc9-86a7-44e42fafe513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.318681 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-984856ac-099a-4fc9-86a7-44e42fafe513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.654529 Oct 04 18:16:54.322508 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1899/3777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:53 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:54.345173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-25d88693-cf0d-441d-a373-19f00fb58108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:54.346513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-25d88693-cf0d-441d-a373-19f00fb58108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.365657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-80852330-fb9f-4267-baf1-c66c988b2b03 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.370412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:54.387679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25d88693-cf0d-441d-a373-19f00fb58108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.390644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25d88693-cf0d-441d-a373-19f00fb58108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.391370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25d88693-cf0d-441d-a373-19f00fb58108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.392742 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-80852330-fb9f-4267-baf1-c66c988b2b03 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1324 microversion: 2.1 time: 0.535558 Oct 04 18:16:54.408207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25d88693-cf0d-441d-a373-19f00fb58108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.423023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25d88693-cf0d-441d-a373-19f00fb58108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.423755 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1879/3778] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:53 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1324 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:54.425684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25d88693-cf0d-441d-a373-19f00fb58108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.478968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-25d88693-cf0d-441d-a373-19f00fb58108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lazy-loading 'flavor' on Instance uuid afef2588-b2e9-4b9e-943c-44469215dd64 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:54.762509 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-25d88693-cf0d-441d-a373-19f00fb58108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 202 len: 0 microversion: 2.1 time: 0.421897 Oct 04 18:16:54.764234 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1900/3779] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:54 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:16:54.772180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a570bef3-0438-4758-95e8-fe057c61f50e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.772804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a570bef3-0438-4758-95e8-fe057c61f50e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.784804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a570bef3-0438-4758-95e8-fe057c61f50e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.785445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a570bef3-0438-4758-95e8-fe057c61f50e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.787300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a570bef3-0438-4758-95e8-fe057c61f50e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.790003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a570bef3-0438-4758-95e8-fe057c61f50e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.790796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a570bef3-0438-4758-95e8-fe057c61f50e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.791558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a570bef3-0438-4758-95e8-fe057c61f50e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.885202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5109c2b0-68c9-4384-95e4-d74a92c88a3d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.885933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5109c2b0-68c9-4384-95e4-d74a92c88a3d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.901284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5109c2b0-68c9-4384-95e4-d74a92c88a3d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.901688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5109c2b0-68c9-4384-95e4-d74a92c88a3d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.904467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5109c2b0-68c9-4384-95e4-d74a92c88a3d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.906072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5109c2b0-68c9-4384-95e4-d74a92c88a3d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.907230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5109c2b0-68c9-4384-95e4-d74a92c88a3d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.907856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5109c2b0-68c9-4384-95e4-d74a92c88a3d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.265956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a570bef3-0438-4758-95e8-fe057c61f50e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.279052 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a570bef3-0438-4758-95e8-fe057c61f50e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.510490 Oct 04 18:16:55.283143 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1880/3780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:54 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:55.288613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "82ab23fb-1677-4fba-8610-5599ee4bdb95"}], "security_groups": [{"name": "tempest-securitygroup--1274822215"}], "key_name": "tempest-keypair-1225497742", "user_data": "}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:55.312317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5109c2b0-68c9-4384-95e4-d74a92c88a3d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.321423 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5109c2b0-68c9-4384-95e4-d74a92c88a3d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.444970 Oct 04 18:16:55.325500 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1901/3781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:54 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:55.340839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:55.449454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d9cf23b-9f00-4150-800f-079d5fb0123c tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:55.450093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d9cf23b-9f00-4150-800f-079d5fb0123c tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:55.458875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d9cf23b-9f00-4150-800f-079d5fb0123c tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.459430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d9cf23b-9f00-4150-800f-079d5fb0123c tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.460534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d9cf23b-9f00-4150-800f-079d5fb0123c tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.461536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d9cf23b-9f00-4150-800f-079d5fb0123c tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.462021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d9cf23b-9f00-4150-800f-079d5fb0123c tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.462465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d9cf23b-9f00-4150-800f-079d5fb0123c tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.547168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] validate_networks() for [('82ab23fb-1677-4fba-8610-5599ee4bdb95', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:55.879394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2d9cf23b-9f00-4150-800f-079d5fb0123c tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.891924 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2d9cf23b-9f00-4150-800f-079d5fb0123c tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1324 microversion: 2.1 time: 0.458462 Oct 04 18:16:55.893583 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1902/3782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:55 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:55.992255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4410620-6f63-4ca6-aaa3-7a414125f3e2 tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] Calling method '.version_select at 0x7fd4d13a6a60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.049383 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f4410620-6f63-4ca6-aaa3-7a414125f3e2 tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.153871 Oct 04 18:16:56.050113 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1903/3783] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:16:55 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:56.064664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e4b8bd1f-8911-4cca-867a-47b92af00354 tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] Action: 'create', calling method: .version_select at 0x7fd4d11f3ee0>, body: {"pool": "non_exist_pool"} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:56.172720 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-e4b8bd1f-8911-4cca-867a-47b92af00354 tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] HTTP exception thrown: Floating IP pool not found. Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e4b8bd1f-8911-4cca-867a-47b92af00354 tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] Request method failure captured: Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 26 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHiXFzyaFWFQXqjQ_Sj8iK__ddC2M3B_hlhjLy9D69E9KCAezs1uekK9txC9xykNUvx41RAVY7rpZGnOoH64sxZWxttarJUFmJig-0bFnlzo4XRA7nVXfaO-bhaEo6mzIj9z6kjsqrymxQGCA3CltVTSjgKcThMRQLC8xULJ2EPS1g4 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 27b5679a1f5c42deafc894793c6ab649 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-809877768 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_27b5679a1f5c42deafc894793c6ab649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/27b5679a1f5c42deafc894793c6ab649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/27b5679a1f5c42deafc894793c6ab649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/27b5679a1f5c42deafc894793c6ab649"}]}] Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-809877768 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 27b5679a1f5c42deafc894793c6ab649 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-809877768 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FloatingIPsNegativeTestJSON-809877768-project Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 81ba6d0e561a4f87b98465eac3317189 Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-809877768-project Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: {"pool": "non_exist_pool"} Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: exception: Floating IP pool not found. Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:56.174245 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:56.179595 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 18:16:56.179595 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.180798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e4b8bd1f-8911-4cca-867a-47b92af00354 tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] Returning 404 to user: Floating IP pool not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:56.182105 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e4b8bd1f-8911-4cca-867a-47b92af00354 tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.122849 Oct 04 18:16:56.183222 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1904/3784] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 4 18:16:56 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:16:56.211480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef1329df-ee50-4db6-9f19-6c800f27c6fe tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] Calling method '.version_select at 0x7fd4d1253550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.320646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:56.321129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:56.321704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:56.322295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:56.322728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:56.345913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.346997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.347652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.348622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.349301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.351477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.401382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Getting quotas for project ce1ebbd32ca946f6a078df3ef2a268ea. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:56.415410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG neutronclient.v2_0.client [None req-ef1329df-ee50-4db6-9f19-6c800f27c6fe tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b1cef448-301f-4137-bc6b-b9d9dcabc4ef could not be found", "detail": ""}} {{(pid=122332) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:16:56.416378 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ef1329df-ee50-4db6-9f19-6c800f27c6fe tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] HTTP exception thrown: Floating IP not found for ID b1cef448-301f-4137-bc6b-b9d9dcabc4ef Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef1329df-ee50-4db6-9f19-6c800f27c6fe tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] Request method failure captured: Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-floating-ips/b1cef448-301f-4137-bc6b-b9d9dcabc4ef HTTP/1.1 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHiXFzyaFWFQXqjQ_Sj8iK__ddC2M3B_hlhjLy9D69E9KCAezs1uekK9txC9xykNUvx41RAVY7rpZGnOoH64sxZWxttarJUFmJig-0bFnlzo4XRA7nVXfaO-bhaEo6mzIj9z6kjsqrymxQGCA3CltVTSjgKcThMRQLC8xULJ2EPS1g4 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 27b5679a1f5c42deafc894793c6ab649 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-809877768 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_27b5679a1f5c42deafc894793c6ab649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/27b5679a1f5c42deafc894793c6ab649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/27b5679a1f5c42deafc894793c6ab649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/27b5679a1f5c42deafc894793c6ab649"}]}] Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-809877768 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 27b5679a1f5c42deafc894793c6ab649 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-809877768 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-FloatingIPsNegativeTestJSON-809877768-project Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 81ba6d0e561a4f87b98465eac3317189 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-809877768-project Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: exception: Floating IP not found for ID b1cef448-301f-4137-bc6b-b9d9dcabc4ef Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'b1cef448-301f-4137-bc6b-b9d9dcabc4ef'} Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b1cef448-301f-4137-bc6b-b9d9dcabc4ef could not be found Oct 04 18:16:56.419304 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57c12df4-653b-4f88-a4a4-0e3e4e102cef'] Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b1cef448-301f-4137-bc6b-b9d9dcabc4ef. Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b1cef448-301f-4137-bc6b-b9d9dcabc4ef Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b1cef448-301f-4137-bc6b-b9d9dcabc4ef Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef1329df-ee50-4db6-9f19-6c800f27c6fe tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] Returning 404 to user: Floating IP not found for ID b1cef448-301f-4137-bc6b-b9d9dcabc4ef {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ef1329df-ee50-4db6-9f19-6c800f27c6fe tempest-FloatingIPsNegativeTestJSON-809877768 tempest-FloatingIPsNegativeTestJSON-809877768-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/b1cef448-301f-4137-bc6b-b9d9dcabc4ef" status: 404 len: 111 microversion: 2.1 time: 0.220962 Oct 04 18:16:56.425261 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1905/3785] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:16:56 2022] DELETE /compute/v2.1/os-floating-ips/b1cef448-301f-4137-bc6b-b9d9dcabc4ef => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:56.435078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Getting quotas for user b731077b730f4881b8a7aeef7bcef20e and project ce1ebbd32ca946f6a078df3ef2a268ea. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:56.443008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b77f91a7-a6f5-43ec-846a-e2cea69d495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.443673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b77f91a7-a6f5-43ec-846a-e2cea69d495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.465042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b77f91a7-a6f5-43ec-846a-e2cea69d495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.465883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b77f91a7-a6f5-43ec-846a-e2cea69d495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.466030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b77f91a7-a6f5-43ec-846a-e2cea69d495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.466704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b77f91a7-a6f5-43ec-846a-e2cea69d495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.467233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b77f91a7-a6f5-43ec-846a-e2cea69d495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.467711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b77f91a7-a6f5-43ec-846a-e2cea69d495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.490084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:56.492624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:56.527091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:56.635432 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2522d73a-a843-4f03-bca5-e176e0a27102 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.351029 Oct 04 18:16:56.636369 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1881/3786] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:56.661233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df99039b-25ea-4c57-b33f-3ae248d59e3b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.664992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df99039b-25ea-4c57-b33f-3ae248d59e3b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.691312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df99039b-25ea-4c57-b33f-3ae248d59e3b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.691976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df99039b-25ea-4c57-b33f-3ae248d59e3b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.693830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df99039b-25ea-4c57-b33f-3ae248d59e3b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.695188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df99039b-25ea-4c57-b33f-3ae248d59e3b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.697100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df99039b-25ea-4c57-b33f-3ae248d59e3b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.700076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df99039b-25ea-4c57-b33f-3ae248d59e3b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.270644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b77f91a7-a6f5-43ec-846a-e2cea69d495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.288037 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b77f91a7-a6f5-43ec-846a-e2cea69d495b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.863856 Oct 04 18:16:57.290171 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1906/3787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:57.296897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0774281b-9e76-4f3d-a6e1-4e4f3b5431fd tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:57.304302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0774281b-9e76-4f3d-a6e1-4e4f3b5431fd tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:57.556364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0774281b-9e76-4f3d-a6e1-4e4f3b5431fd tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.577959 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0774281b-9e76-4f3d-a6e1-4e4f3b5431fd tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1226 microversion: 2.1 time: 0.284565 Oct 04 18:16:57.606330 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1907/3788] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:57 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1226 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:57.620570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ee5836e-da99-4739-b2e7-29e38f429b3e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:57.621257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ee5836e-da99-4739-b2e7-29e38f429b3e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:57.664453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ee5836e-da99-4739-b2e7-29e38f429b3e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.664973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ee5836e-da99-4739-b2e7-29e38f429b3e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.672826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ee5836e-da99-4739-b2e7-29e38f429b3e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.674015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ee5836e-da99-4739-b2e7-29e38f429b3e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.674688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ee5836e-da99-4739-b2e7-29e38f429b3e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.675518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ee5836e-da99-4739-b2e7-29e38f429b3e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.694305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df99039b-25ea-4c57-b33f-3ae248d59e3b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.703976 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df99039b-25ea-4c57-b33f-3ae248d59e3b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 1.066331 Oct 04 18:16:57.704807 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1882/3789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:58.290310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ee5836e-da99-4739-b2e7-29e38f429b3e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.305841 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ee5836e-da99-4739-b2e7-29e38f429b3e tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1324 microversion: 2.1 time: 0.698171 Oct 04 18:16:58.325873 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1908/3790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:57 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1324 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:58.345900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a9780a9c-6684-4028-819e-28039cddf831 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.347405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a9780a9c-6684-4028-819e-28039cddf831 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.360556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9780a9c-6684-4028-819e-28039cddf831 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.361067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9780a9c-6684-4028-819e-28039cddf831 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.363172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9780a9c-6684-4028-819e-28039cddf831 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.364721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9780a9c-6684-4028-819e-28039cddf831 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.365404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9780a9c-6684-4028-819e-28039cddf831 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.366012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9780a9c-6684-4028-819e-28039cddf831 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.603201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9cec680-0f08-4ff1-a527-3d0411dd6f9b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.603831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d9cec680-0f08-4ff1-a527-3d0411dd6f9b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.619683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9cec680-0f08-4ff1-a527-3d0411dd6f9b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.626350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9cec680-0f08-4ff1-a527-3d0411dd6f9b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.630580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9cec680-0f08-4ff1-a527-3d0411dd6f9b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.631453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9cec680-0f08-4ff1-a527-3d0411dd6f9b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.631951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9cec680-0f08-4ff1-a527-3d0411dd6f9b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.632395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9cec680-0f08-4ff1-a527-3d0411dd6f9b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.902195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d9cec680-0f08-4ff1-a527-3d0411dd6f9b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.911389 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d9cec680-0f08-4ff1-a527-3d0411dd6f9b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1230 microversion: 2.1 time: 0.312001 Oct 04 18:16:58.927754 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1909/3791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1230 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:58.940672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c7c8dbaa-f963-4728-a932-567ddf253cde tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.947862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c7c8dbaa-f963-4728-a932-567ddf253cde tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.960368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7c8dbaa-f963-4728-a932-567ddf253cde tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.961680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7c8dbaa-f963-4728-a932-567ddf253cde tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.962348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7c8dbaa-f963-4728-a932-567ddf253cde tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.963684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7c8dbaa-f963-4728-a932-567ddf253cde tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.964672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7c8dbaa-f963-4728-a932-567ddf253cde tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.966795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7c8dbaa-f963-4728-a932-567ddf253cde tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.000373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a9780a9c-6684-4028-819e-28039cddf831 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.011693 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a9780a9c-6684-4028-819e-28039cddf831 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.682761 Oct 04 18:16:59.012199 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1883/3792] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:59.260784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b14b62b6-017d-467f-a110-92ce91a7367a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'create', calling method: .version_select at 0x7fd4d11edd30>, body: {"keypair": {"name": "tempest-keypair-35417310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTQqf0AW1oj0KkFLn171qGgX0K76NlZFZPsj5D66u9rk0tihyjysn3LZ5+w1C3UY+D+b9dlLh0QHrrzBOcRYMAQ2hRG/PaTUwPRGAiD5vtla2i1o2YRzidv6+kE60QZvQ=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:59.302149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7c8dbaa-f963-4728-a932-567ddf253cde tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.303450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b14b62b6-017d-467f-a110-92ce91a7367a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Getting quotas for project bc1c88ac592a4375a805aec597fbd50a. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:59.317041 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c7c8dbaa-f963-4728-a932-567ddf253cde tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1517 microversion: 2.1 time: 0.387837 Oct 04 18:16:59.325428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b14b62b6-017d-467f-a110-92ce91a7367a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Getting quotas for user 30a7a667883542e386cb3fd5b65abc90 and project bc1c88ac592a4375a805aec597fbd50a. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:59.331232 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1910/3793] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1517 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:59.348066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-08474e2f-8ac3-4176-a77b-2790baf5e3fe tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.349568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-08474e2f-8ac3-4176-a77b-2790baf5e3fe tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.365229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08474e2f-8ac3-4176-a77b-2790baf5e3fe tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.367296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08474e2f-8ac3-4176-a77b-2790baf5e3fe tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.371116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08474e2f-8ac3-4176-a77b-2790baf5e3fe tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.373477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08474e2f-8ac3-4176-a77b-2790baf5e3fe tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.375405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08474e2f-8ac3-4176-a77b-2790baf5e3fe tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.377241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08474e2f-8ac3-4176-a77b-2790baf5e3fe tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.390338 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b14b62b6-017d-467f-a110-92ce91a7367a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.289741 Oct 04 18:16:59.393206 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1884/3794] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:16:59 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:59.772018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08474e2f-8ac3-4176-a77b-2790baf5e3fe tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.784458 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-08474e2f-8ac3-4176-a77b-2790baf5e3fe tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1324 microversion: 2.1 time: 0.447615 Oct 04 18:16:59.785906 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1911/3795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:59.952678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cca6dadb-a14d-4c67-a7a3-ba03c95ce773 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.953584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cca6dadb-a14d-4c67-a7a3-ba03c95ce773 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.970122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cca6dadb-a14d-4c67-a7a3-ba03c95ce773 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.970941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cca6dadb-a14d-4c67-a7a3-ba03c95ce773 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.971560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cca6dadb-a14d-4c67-a7a3-ba03c95ce773 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.972284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cca6dadb-a14d-4c67-a7a3-ba03c95ce773 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.972919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cca6dadb-a14d-4c67-a7a3-ba03c95ce773 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.973356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cca6dadb-a14d-4c67-a7a3-ba03c95ce773 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.040330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-20d8b4e0-13a2-4aed-a891-99b3a8fef53e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:00.041026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-20d8b4e0-13a2-4aed-a891-99b3a8fef53e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:00.050197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20d8b4e0-13a2-4aed-a891-99b3a8fef53e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.050837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20d8b4e0-13a2-4aed-a891-99b3a8fef53e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.057311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20d8b4e0-13a2-4aed-a891-99b3a8fef53e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.060996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20d8b4e0-13a2-4aed-a891-99b3a8fef53e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.063529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20d8b4e0-13a2-4aed-a891-99b3a8fef53e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.079358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20d8b4e0-13a2-4aed-a891-99b3a8fef53e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.631482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cca6dadb-a14d-4c67-a7a3-ba03c95ce773 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.640313 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cca6dadb-a14d-4c67-a7a3-ba03c95ce773 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1278 microversion: 2.1 time: 0.692587 Oct 04 18:17:00.656082 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1885/3796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1278 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:00.665886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bd7bf8cf-2b32-499d-bc50-eebb0dccb9e5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:00.667561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bd7bf8cf-2b32-499d-bc50-eebb0dccb9e5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:00.687632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd7bf8cf-2b32-499d-bc50-eebb0dccb9e5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.695632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd7bf8cf-2b32-499d-bc50-eebb0dccb9e5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.697076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd7bf8cf-2b32-499d-bc50-eebb0dccb9e5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.700691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd7bf8cf-2b32-499d-bc50-eebb0dccb9e5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.710315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd7bf8cf-2b32-499d-bc50-eebb0dccb9e5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.710794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd7bf8cf-2b32-499d-bc50-eebb0dccb9e5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.909896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-20d8b4e0-13a2-4aed-a891-99b3a8fef53e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.919386 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-20d8b4e0-13a2-4aed-a891-99b3a8fef53e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.883924 Oct 04 18:17:00.919982 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1912/3797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:00 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:00.940985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db209326-3d9e-48f1-b8e7-a66711c5a92f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:00.941629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-db209326-3d9e-48f1-b8e7-a66711c5a92f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:00.953541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db209326-3d9e-48f1-b8e7-a66711c5a92f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.954046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db209326-3d9e-48f1-b8e7-a66711c5a92f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.954499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db209326-3d9e-48f1-b8e7-a66711c5a92f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.955893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db209326-3d9e-48f1-b8e7-a66711c5a92f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.956555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db209326-3d9e-48f1-b8e7-a66711c5a92f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.957168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db209326-3d9e-48f1-b8e7-a66711c5a92f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.154472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bd7bf8cf-2b32-499d-bc50-eebb0dccb9e5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:01.177175 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bd7bf8cf-2b32-499d-bc50-eebb0dccb9e5 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1523 microversion: 2.1 time: 0.519085 Oct 04 18:17:01.178327 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1886/3798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:00 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1523 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:01.242156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-db209326-3d9e-48f1-b8e7-a66711c5a92f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:01.247662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3f85922e-13e7-405a-bdd9-2b58e81b3add req-abdc34c2-e799-4925-ac61-69e1498b402d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1696dd9a-3280-44cc-a274-c4512f1a9639", "name": "network-vif-plugged", "status": "completed", "tag": "eea811d8-6d82-42a0-967e-9b0ea6b0f4a2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:01.252605 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-db209326-3d9e-48f1-b8e7-a66711c5a92f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1324 microversion: 2.1 time: 0.325706 Oct 04 18:17:01.253431 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1913/3799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:00 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1324 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:01.263268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3f85922e-13e7-405a-bdd9-2b58e81b3add req-abdc34c2-e799-4925-ac61-69e1498b402d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.263268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3f85922e-13e7-405a-bdd9-2b58e81b3add req-abdc34c2-e799-4925-ac61-69e1498b402d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.263268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3f85922e-13e7-405a-bdd9-2b58e81b3add req-abdc34c2-e799-4925-ac61-69e1498b402d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.273633 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3f85922e-13e7-405a-bdd9-2b58e81b3add req-abdc34c2-e799-4925-ac61-69e1498b402d service nova] Creating event network-vif-plugged:eea811d8-6d82-42a0-967e-9b0ea6b0f4a2 for instance 1696dd9a-3280-44cc-a274-c4512f1a9639 on n-h1-850499-14 Oct 04 18:17:01.279507 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3f85922e-13e7-405a-bdd9-2b58e81b3add req-abdc34c2-e799-4925-ac61-69e1498b402d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099480 Oct 04 18:17:01.280733 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1887/3800] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:01.535234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2060484953", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbcce575-475a-46b4-9dc0-0dfcdfd87222"}], "security_groups": [{"name": "tempest-securitygroup--2037913750"}], "key_name": "tempest-keypair-35417310", "user_data": "}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:01.668856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4de60908-7888-428d-b7ef-2bd04e7106fb tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:01.669543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4de60908-7888-428d-b7ef-2bd04e7106fb tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:01.681081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4de60908-7888-428d-b7ef-2bd04e7106fb tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.681584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4de60908-7888-428d-b7ef-2bd04e7106fb tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.682027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4de60908-7888-428d-b7ef-2bd04e7106fb tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.682737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4de60908-7888-428d-b7ef-2bd04e7106fb tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.687956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4de60908-7888-428d-b7ef-2bd04e7106fb tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.688473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4de60908-7888-428d-b7ef-2bd04e7106fb tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.807871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] validate_networks() for [('cbcce575-475a-46b4-9dc0-0dfcdfd87222', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:01.813727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4de60908-7888-428d-b7ef-2bd04e7106fb tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:01.822894 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4de60908-7888-428d-b7ef-2bd04e7106fb tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1286 microversion: 2.1 time: 0.159795 Oct 04 18:17:01.824042 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1888/3801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:01 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:01.944933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9bd11851-3840-47e1-b935-330e96275042 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:01.946087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9bd11851-3840-47e1-b935-330e96275042 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:01.959548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bd11851-3840-47e1-b935-330e96275042 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.960114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bd11851-3840-47e1-b935-330e96275042 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.960557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bd11851-3840-47e1-b935-330e96275042 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.961293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bd11851-3840-47e1-b935-330e96275042 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.961756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bd11851-3840-47e1-b935-330e96275042 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.962186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bd11851-3840-47e1-b935-330e96275042 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.277377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:02.330452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9bd11851-3840-47e1-b935-330e96275042 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.338757 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9bd11851-3840-47e1-b935-330e96275042 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.399328 Oct 04 18:17:02.339527 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1889/3802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:01 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:02.344486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb77e25f-c709-44d8-8516-9a0c87f52931 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:02.345288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb77e25f-c709-44d8-8516-9a0c87f52931 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:02.351999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb77e25f-c709-44d8-8516-9a0c87f52931 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.352717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb77e25f-c709-44d8-8516-9a0c87f52931 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.353347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb77e25f-c709-44d8-8516-9a0c87f52931 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.354214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb77e25f-c709-44d8-8516-9a0c87f52931 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.354825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb77e25f-c709-44d8-8516-9a0c87f52931 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.355458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb77e25f-c709-44d8-8516-9a0c87f52931 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.676743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cb77e25f-c709-44d8-8516-9a0c87f52931 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.685514 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb77e25f-c709-44d8-8516-9a0c87f52931 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1523 microversion: 2.1 time: 0.344469 Oct 04 18:17:02.707114 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1890/3803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:02 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:02.710054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:02.711256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:02.711856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:02.712313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-53294602-9a01-406c-874c-44f8e7e53d6f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:02.712496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:02.712895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:02.713270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-53294602-9a01-406c-874c-44f8e7e53d6f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:02.719939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53294602-9a01-406c-874c-44f8e7e53d6f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.720431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53294602-9a01-406c-874c-44f8e7e53d6f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.720891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53294602-9a01-406c-874c-44f8e7e53d6f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.721592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53294602-9a01-406c-874c-44f8e7e53d6f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.722049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53294602-9a01-406c-874c-44f8e7e53d6f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.722481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53294602-9a01-406c-874c-44f8e7e53d6f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.727743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.729430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.730053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.736746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.737449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.738064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.799133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Getting quotas for project bc1c88ac592a4375a805aec597fbd50a. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:02.812392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Getting quotas for user 30a7a667883542e386cb3fd5b65abc90 and project bc1c88ac592a4375a805aec597fbd50a. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:02.832341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:02.834902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:02.892008 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a836627d-b5c6-4f49-9fa8-50c4adbadd58 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.365924 Oct 04 18:17:02.899089 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1914/3804] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:17:02.906440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d3c4997-d3dd-4eff-a383-c0ee5f011541 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:02.907558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d3c4997-d3dd-4eff-a383-c0ee5f011541 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:02.914713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c4997-d3dd-4eff-a383-c0ee5f011541 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.916413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c4997-d3dd-4eff-a383-c0ee5f011541 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.917124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c4997-d3dd-4eff-a383-c0ee5f011541 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.918907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c4997-d3dd-4eff-a383-c0ee5f011541 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.919638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c4997-d3dd-4eff-a383-c0ee5f011541 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.920308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3c4997-d3dd-4eff-a383-c0ee5f011541 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.105724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d3c4997-d3dd-4eff-a383-c0ee5f011541 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.130346 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d3c4997-d3dd-4eff-a383-c0ee5f011541 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1296 microversion: 2.1 time: 0.226650 Oct 04 18:17:03.131460 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1915/3805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:02 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1296 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:03.150941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d978d61d-d1b7-4236-ad1b-8d2eb134facf tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.155874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d978d61d-d1b7-4236-ad1b-8d2eb134facf tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.298222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d978d61d-d1b7-4236-ad1b-8d2eb134facf tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.307129 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d978d61d-d1b7-4236-ad1b-8d2eb134facf tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1236 microversion: 2.1 time: 0.172457 Oct 04 18:17:03.308960 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1916/3806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1236 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:03.327913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-53294602-9a01-406c-874c-44f8e7e53d6f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.340972 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-53294602-9a01-406c-874c-44f8e7e53d6f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1324 microversion: 2.1 time: 0.632798 Oct 04 18:17:03.341567 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1891/3807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:02 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1324 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:03.369330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-68b309cd-2c6a-4841-ac66-aec8fb1a4aa9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.371492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-68b309cd-2c6a-4841-ac66-aec8fb1a4aa9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.389282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b309cd-2c6a-4841-ac66-aec8fb1a4aa9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.390329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b309cd-2c6a-4841-ac66-aec8fb1a4aa9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.390784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b309cd-2c6a-4841-ac66-aec8fb1a4aa9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.393736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b309cd-2c6a-4841-ac66-aec8fb1a4aa9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.394233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b309cd-2c6a-4841-ac66-aec8fb1a4aa9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.394681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b309cd-2c6a-4841-ac66-aec8fb1a4aa9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.707127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-68b309cd-2c6a-4841-ac66-aec8fb1a4aa9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.721625 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-68b309cd-2c6a-4841-ac66-aec8fb1a4aa9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.356462 Oct 04 18:17:03.722327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-16b2dd91-ebde-4eb7-85b9-ed49fbecb52d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.723124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-16b2dd91-ebde-4eb7-85b9-ed49fbecb52d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.724941 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1917/3808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:03.735454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16b2dd91-ebde-4eb7-85b9-ed49fbecb52d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.736083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16b2dd91-ebde-4eb7-85b9-ed49fbecb52d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.736535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16b2dd91-ebde-4eb7-85b9-ed49fbecb52d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.737357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16b2dd91-ebde-4eb7-85b9-ed49fbecb52d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.738428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16b2dd91-ebde-4eb7-85b9-ed49fbecb52d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.739013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16b2dd91-ebde-4eb7-85b9-ed49fbecb52d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.883942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c995513f-4628-4c26-95b9-791ef66ee249 req-6d410b22-1b42-4609-8ce0-0495699ac342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671406ce-ae77-441a-9e07-3d054c34c4f5", "name": "network-vif-unplugged", "status": "completed", "tag": "f2bffad7-9c35-4420-bb47-a7b54db456ad"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:03.898770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c995513f-4628-4c26-95b9-791ef66ee249 req-6d410b22-1b42-4609-8ce0-0495699ac342 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.899685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c995513f-4628-4c26-95b9-791ef66ee249 req-6d410b22-1b42-4609-8ce0-0495699ac342 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.900357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c995513f-4628-4c26-95b9-791ef66ee249 req-6d410b22-1b42-4609-8ce0-0495699ac342 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.918787 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c995513f-4628-4c26-95b9-791ef66ee249 req-6d410b22-1b42-4609-8ce0-0495699ac342 service nova] Creating event network-vif-unplugged:f2bffad7-9c35-4420-bb47-a7b54db456ad for instance 671406ce-ae77-441a-9e07-3d054c34c4f5 on n-h2-850499-14 Oct 04 18:17:03.925640 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c995513f-4628-4c26-95b9-791ef66ee249 req-6d410b22-1b42-4609-8ce0-0495699ac342 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045500 Oct 04 18:17:03.928854 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1918/3809] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:04.161659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b6d5b198-6719-4659-9d6e-157288492be5 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:04.162456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b6d5b198-6719-4659-9d6e-157288492be5 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:04.192227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d5b198-6719-4659-9d6e-157288492be5 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.194290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d5b198-6719-4659-9d6e-157288492be5 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.194808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d5b198-6719-4659-9d6e-157288492be5 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.197584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d5b198-6719-4659-9d6e-157288492be5 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.198078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d5b198-6719-4659-9d6e-157288492be5 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.198544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d5b198-6719-4659-9d6e-157288492be5 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.208277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-16b2dd91-ebde-4eb7-85b9-ed49fbecb52d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.221250 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-16b2dd91-ebde-4eb7-85b9-ed49fbecb52d tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1523 microversion: 2.1 time: 0.510526 Oct 04 18:17:04.239374 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1892/3810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1523 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:04.334924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b02c8a42-ab36-4507-a40c-14ed0773dbe7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:04.335860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b02c8a42-ab36-4507-a40c-14ed0773dbe7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:04.343834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b02c8a42-ab36-4507-a40c-14ed0773dbe7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.346218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b02c8a42-ab36-4507-a40c-14ed0773dbe7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.348778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b02c8a42-ab36-4507-a40c-14ed0773dbe7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.349895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b02c8a42-ab36-4507-a40c-14ed0773dbe7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.350574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b02c8a42-ab36-4507-a40c-14ed0773dbe7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.353590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b02c8a42-ab36-4507-a40c-14ed0773dbe7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.474085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b02c8a42-ab36-4507-a40c-14ed0773dbe7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.486594 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b02c8a42-ab36-4507-a40c-14ed0773dbe7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1288 microversion: 2.1 time: 0.155498 Oct 04 18:17:04.487595 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1893/3811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:04 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1288 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:04.507798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-078513c3-094d-4555-b841-b6e35b2ad8ed tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:04.511209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-078513c3-094d-4555-b841-b6e35b2ad8ed tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:04.526559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-078513c3-094d-4555-b841-b6e35b2ad8ed tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.527704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-078513c3-094d-4555-b841-b6e35b2ad8ed tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.528630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-078513c3-094d-4555-b841-b6e35b2ad8ed tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.531159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-078513c3-094d-4555-b841-b6e35b2ad8ed tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.533422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-078513c3-094d-4555-b841-b6e35b2ad8ed tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.533866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-078513c3-094d-4555-b841-b6e35b2ad8ed tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.577044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6d5b198-6719-4659-9d6e-157288492be5 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.578472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:04.595756 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b6d5b198-6719-4659-9d6e-157288492be5 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1352 microversion: 2.1 time: 0.439485 Oct 04 18:17:04.597057 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1919/3812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:04 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1352 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:04.753321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7dc6f090-aacb-45aa-8860-f85136fcbb26 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:04.756387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7dc6f090-aacb-45aa-8860-f85136fcbb26 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:04.773461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dc6f090-aacb-45aa-8860-f85136fcbb26 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.774820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dc6f090-aacb-45aa-8860-f85136fcbb26 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.777071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dc6f090-aacb-45aa-8860-f85136fcbb26 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.781356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dc6f090-aacb-45aa-8860-f85136fcbb26 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.784389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dc6f090-aacb-45aa-8860-f85136fcbb26 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.785443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dc6f090-aacb-45aa-8860-f85136fcbb26 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.836635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-078513c3-094d-4555-b841-b6e35b2ad8ed tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.851515 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-078513c3-094d-4555-b841-b6e35b2ad8ed tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1520 microversion: 2.1 time: 0.361285 Oct 04 18:17:04.855260 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1894/3813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:04 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1520 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:04.882993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:04.892893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:04.908525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.909024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.909465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.910179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.920256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.921965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.975549 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Request method failure captured: Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639/ips/invalid HTTP/1.1 Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiINyTImdemuWYD0k91acHS_E6bwkpSj_VLIlvI3hD4wrkklwkLI-YQoxxMzzhm1AtuIAsGZw27KzkQqABFqwGopGalyASFNVqTVt642AjbZIZuoGraIDoj4HpmzJiNpApfKLRNiSpLNlqQxagtJ07W2WFvWaU8-_jcOngnlkfXqaI Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2f1e6d8ca0c447259a1f7fae11ddfd5b Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-342992482 Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}] Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-342992482 Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2f1e6d8ca0c447259a1f7fae11ddfd5b Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-342992482 Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerAddressesNegativeTestJSON-342992482-project Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b7f5fda3ec0548f7bc6c339776d9ed33 Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-342992482-project Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance is not a member of specified network Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'server_id': '1696dd9a-3280-44cc-a274-c4512f1a9639', 'id': 'invalid'} Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 18:17:04.994416 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:04.999308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:05.003415 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-420ed32b-e31b-458b-a4cd-5e159ca0e27f tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.125134 Oct 04 18:17:05.007997 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1895/3814] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 18:17:04 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639/ips/invalid => generated 91 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:05.015886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a49e8a7d-1030-445d-9c38-557ebc9bd826 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.025696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a49e8a7d-1030-445d-9c38-557ebc9bd826 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Failed to fetch instance by id 999 {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:17:05.025696 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-a49e8a7d-1030-445d-9c38-557ebc9bd826 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a49e8a7d-1030-445d-9c38-557ebc9bd826 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Request method failure captured: Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiINyTImdemuWYD0k91acHS_E6bwkpSj_VLIlvI3hD4wrkklwkLI-YQoxxMzzhm1AtuIAsGZw27KzkQqABFqwGopGalyASFNVqTVt642AjbZIZuoGraIDoj4HpmzJiNpApfKLRNiSpLNlqQxagtJ07W2WFvWaU8-_jcOngnlkfXqaI Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2f1e6d8ca0c447259a1f7fae11ddfd5b Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-342992482 Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}] Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-342992482 Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2f1e6d8ca0c447259a1f7fae11ddfd5b Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-342992482 Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerAddressesNegativeTestJSON-342992482-project Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b7f5fda3ec0548f7bc6c339776d9ed33 Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-342992482-project Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 999 could not be found. Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'server_id': '999'} Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 18:17:05.029204 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:05.036387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a49e8a7d-1030-445d-9c38-557ebc9bd826 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:05.036387 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a49e8a7d-1030-445d-9c38-557ebc9bd826 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.024201 Oct 04 18:17:05.037464 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1896/3815] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:05.053402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be6e6a61-28ed-4615-b3b1-469e764a70a1 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.053933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be6e6a61-28ed-4615-b3b1-469e764a70a1 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.074802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be6e6a61-28ed-4615-b3b1-469e764a70a1 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.075902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be6e6a61-28ed-4615-b3b1-469e764a70a1 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.076351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be6e6a61-28ed-4615-b3b1-469e764a70a1 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.079443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be6e6a61-28ed-4615-b3b1-469e764a70a1 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.079936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be6e6a61-28ed-4615-b3b1-469e764a70a1 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.080380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be6e6a61-28ed-4615-b3b1-469e764a70a1 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.143512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be6e6a61-28ed-4615-b3b1-469e764a70a1 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:05.232793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7dc6f090-aacb-45aa-8860-f85136fcbb26 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.244920 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7dc6f090-aacb-45aa-8860-f85136fcbb26 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.500769 Oct 04 18:17:05.247691 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1920/3816] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:04 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:05.261880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a705b217-631d-4fd8-8340-9bbe25ce22bd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.266403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a705b217-631d-4fd8-8340-9bbe25ce22bd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.289267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a705b217-631d-4fd8-8340-9bbe25ce22bd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.290189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a705b217-631d-4fd8-8340-9bbe25ce22bd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.290839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a705b217-631d-4fd8-8340-9bbe25ce22bd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.292269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a705b217-631d-4fd8-8340-9bbe25ce22bd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.292915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a705b217-631d-4fd8-8340-9bbe25ce22bd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.294978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a705b217-631d-4fd8-8340-9bbe25ce22bd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.321304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be6e6a61-28ed-4615-b3b1-469e764a70a1 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 204 len: 0 microversion: 2.1 time: 0.276436 Oct 04 18:17:05.323564 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1897/3817] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:05 2022] DELETE /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:17:05.332614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d7369626-6508-4a39-8b0d-41d4e41d0638 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.334156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d7369626-6508-4a39-8b0d-41d4e41d0638 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.343908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7369626-6508-4a39-8b0d-41d4e41d0638 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.344750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7369626-6508-4a39-8b0d-41d4e41d0638 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.345368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7369626-6508-4a39-8b0d-41d4e41d0638 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.346255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7369626-6508-4a39-8b0d-41d4e41d0638 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.347374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7369626-6508-4a39-8b0d-41d4e41d0638 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.348224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7369626-6508-4a39-8b0d-41d4e41d0638 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.742850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d7369626-6508-4a39-8b0d-41d4e41d0638 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.752699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a705b217-631d-4fd8-8340-9bbe25ce22bd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.763562 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a705b217-631d-4fd8-8340-9bbe25ce22bd tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1523 microversion: 2.1 time: 0.514750 Oct 04 18:17:05.766253 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d7369626-6508-4a39-8b0d-41d4e41d0638 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1526 microversion: 2.1 time: 0.439256 Oct 04 18:17:05.779013 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1921/3818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1523 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:05.780915 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1898/3819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1526 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:05.786906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90058831-e786-43b5-9723-7be9d870a5fe tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.792875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90058831-e786-43b5-9723-7be9d870a5fe tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.800363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90058831-e786-43b5-9723-7be9d870a5fe tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.801095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90058831-e786-43b5-9723-7be9d870a5fe tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.801726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90058831-e786-43b5-9723-7be9d870a5fe tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.802628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90058831-e786-43b5-9723-7be9d870a5fe tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.803308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90058831-e786-43b5-9723-7be9d870a5fe tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.804122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90058831-e786-43b5-9723-7be9d870a5fe tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.919627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-afb16828-e2b8-4f4f-af38-db0e47303485 req-6b51e91d-8161-4860-a191-e1f21bc81b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a988be-0960-4297-9ca3-24fc491f115b", "tag": "a021fddf-59d8-48f5-9b97-c86fdab8c417"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:05.938293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-afb16828-e2b8-4f4f-af38-db0e47303485 req-6b51e91d-8161-4860-a191-e1f21bc81b70 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.941417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-afb16828-e2b8-4f4f-af38-db0e47303485 req-6b51e91d-8161-4860-a191-e1f21bc81b70 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.942233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-afb16828-e2b8-4f4f-af38-db0e47303485 req-6b51e91d-8161-4860-a191-e1f21bc81b70 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.954644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90058831-e786-43b5-9723-7be9d870a5fe tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.967487 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90058831-e786-43b5-9723-7be9d870a5fe tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1294 microversion: 2.1 time: 0.183640 Oct 04 18:17:05.969012 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1899/3820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1294 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:05.970514 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-afb16828-e2b8-4f4f-af38-db0e47303485 req-6b51e91d-8161-4860-a191-e1f21bc81b70 service nova] Creating event network-changed:a021fddf-59d8-48f5-9b97-c86fdab8c417 for instance 34a988be-0960-4297-9ca3-24fc491f115b on n-h2-850499-14 Oct 04 18:17:05.977771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-16d8ee13-f5bd-4423-b1eb-c20e47a7f9f0 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.978533 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-afb16828-e2b8-4f4f-af38-db0e47303485 req-6b51e91d-8161-4860-a191-e1f21bc81b70 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194188 Oct 04 18:17:05.979200 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1922/3821] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:05.979442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-16d8ee13-f5bd-4423-b1eb-c20e47a7f9f0 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.000650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16d8ee13-f5bd-4423-b1eb-c20e47a7f9f0 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.003426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16d8ee13-f5bd-4423-b1eb-c20e47a7f9f0 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.004249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16d8ee13-f5bd-4423-b1eb-c20e47a7f9f0 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.005250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16d8ee13-f5bd-4423-b1eb-c20e47a7f9f0 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.008549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16d8ee13-f5bd-4423-b1eb-c20e47a7f9f0 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.009307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16d8ee13-f5bd-4423-b1eb-c20e47a7f9f0 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.202073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-16d8ee13-f5bd-4423-b1eb-c20e47a7f9f0 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:06.210787 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-16d8ee13-f5bd-4423-b1eb-c20e47a7f9f0 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1352 microversion: 2.1 time: 0.238910 Oct 04 18:17:06.213617 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1900/3822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1352 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:06.273685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-539910dd-29c0-40dd-92f9-bc1b0baedc7d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:06.275784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-539910dd-29c0-40dd-92f9-bc1b0baedc7d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.283243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539910dd-29c0-40dd-92f9-bc1b0baedc7d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.283740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539910dd-29c0-40dd-92f9-bc1b0baedc7d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.284184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539910dd-29c0-40dd-92f9-bc1b0baedc7d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.284896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539910dd-29c0-40dd-92f9-bc1b0baedc7d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.285352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539910dd-29c0-40dd-92f9-bc1b0baedc7d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.285993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-539910dd-29c0-40dd-92f9-bc1b0baedc7d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.459786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-539910dd-29c0-40dd-92f9-bc1b0baedc7d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:06.469298 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-539910dd-29c0-40dd-92f9-bc1b0baedc7d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.200752 Oct 04 18:17:06.470364 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1923/3823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:06 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:06.633720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d2f9779d-7e02-4025-9bbd-fbbeceb9ad18 req-b265d5be-3e7f-40b5-8c86-c7e112d1e16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671406ce-ae77-441a-9e07-3d054c34c4f5", "name": "network-vif-plugged", "status": "completed", "tag": "f2bffad7-9c35-4420-bb47-a7b54db456ad"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:06.640088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:06.645389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d2f9779d-7e02-4025-9bbd-fbbeceb9ad18 req-b265d5be-3e7f-40b5-8c86-c7e112d1e16b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.645882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d2f9779d-7e02-4025-9bbd-fbbeceb9ad18 req-b265d5be-3e7f-40b5-8c86-c7e112d1e16b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.646573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d2f9779d-7e02-4025-9bbd-fbbeceb9ad18 req-b265d5be-3e7f-40b5-8c86-c7e112d1e16b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.663871 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d2f9779d-7e02-4025-9bbd-fbbeceb9ad18 req-b265d5be-3e7f-40b5-8c86-c7e112d1e16b service nova] Creating event network-vif-plugged:f2bffad7-9c35-4420-bb47-a7b54db456ad for instance 671406ce-ae77-441a-9e07-3d054c34c4f5 on n-h2-850499-14 Oct 04 18:17:06.668913 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d2f9779d-7e02-4025-9bbd-fbbeceb9ad18 req-b265d5be-3e7f-40b5-8c86-c7e112d1e16b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039350 Oct 04 18:17:06.669546 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1901/3824] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:06.786195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-11dc5824-c7ff-4d36-813f-3480e665061b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:06.786820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-11dc5824-c7ff-4d36-813f-3480e665061b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.796889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11dc5824-c7ff-4d36-813f-3480e665061b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.798487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11dc5824-c7ff-4d36-813f-3480e665061b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.802087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11dc5824-c7ff-4d36-813f-3480e665061b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.803929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11dc5824-c7ff-4d36-813f-3480e665061b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.806100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11dc5824-c7ff-4d36-813f-3480e665061b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.806258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2be328f-936d-49c4-abf3-25acb06e0096 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:06.806737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a2be328f-936d-49c4-abf3-25acb06e0096 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.807183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11dc5824-c7ff-4d36-813f-3480e665061b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.817963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2be328f-936d-49c4-abf3-25acb06e0096 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.819675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2be328f-936d-49c4-abf3-25acb06e0096 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.820141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2be328f-936d-49c4-abf3-25acb06e0096 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.820868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2be328f-936d-49c4-abf3-25acb06e0096 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.821339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2be328f-936d-49c4-abf3-25acb06e0096 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.821774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2be328f-936d-49c4-abf3-25acb06e0096 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.394500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a2be328f-936d-49c4-abf3-25acb06e0096 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.402547 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a2be328f-936d-49c4-abf3-25acb06e0096 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1526 microversion: 2.1 time: 0.600540 Oct 04 18:17:07.403157 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1902/3825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:06 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1526 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:07.414085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dfa44862-c73f-4bc3-bda6-d820b5d14a9e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.424027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dfa44862-c73f-4bc3-bda6-d820b5d14a9e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.450427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfa44862-c73f-4bc3-bda6-d820b5d14a9e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.450937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfa44862-c73f-4bc3-bda6-d820b5d14a9e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.451405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfa44862-c73f-4bc3-bda6-d820b5d14a9e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.452658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfa44862-c73f-4bc3-bda6-d820b5d14a9e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.455025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfa44862-c73f-4bc3-bda6-d820b5d14a9e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.457640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dfa44862-c73f-4bc3-bda6-d820b5d14a9e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.514371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-11dc5824-c7ff-4d36-813f-3480e665061b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.525317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-11dc5824-c7ff-4d36-813f-3480e665061b tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1523 microversion: 2.1 time: 0.740904 Oct 04 18:17:07.526366 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1924/3826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:06 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1523 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:07.539392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b6bbd968-dc46-4697-9102-908c392812dc tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.542922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b6bbd968-dc46-4697-9102-908c392812dc tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.553784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6bbd968-dc46-4697-9102-908c392812dc tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.556796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6bbd968-dc46-4697-9102-908c392812dc tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.557703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6bbd968-dc46-4697-9102-908c392812dc tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.559872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6bbd968-dc46-4697-9102-908c392812dc tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.561136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6bbd968-dc46-4697-9102-908c392812dc tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.561976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6bbd968-dc46-4697-9102-908c392812dc tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.642485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dfa44862-c73f-4bc3-bda6-d820b5d14a9e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.656470 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dfa44862-c73f-4bc3-bda6-d820b5d14a9e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1294 microversion: 2.1 time: 0.246265 Oct 04 18:17:07.657282 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1903/3827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1294 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:07.910287 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ddb44e3e-cf1e-4b45-bd7e-92af206d69eb tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] 10.222.0.18 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.251669 Oct 04 18:17:07.911178 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1904/3828] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 4 18:17:07 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:17:07.942733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9cb30fd4-331d-48ae-b88a-38509996714d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.943420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9cb30fd4-331d-48ae-b88a-38509996714d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.965321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cb30fd4-331d-48ae-b88a-38509996714d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.969110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cb30fd4-331d-48ae-b88a-38509996714d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.971634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cb30fd4-331d-48ae-b88a-38509996714d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.972451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cb30fd4-331d-48ae-b88a-38509996714d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.972958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cb30fd4-331d-48ae-b88a-38509996714d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.975313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cb30fd4-331d-48ae-b88a-38509996714d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.989560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6bbd968-dc46-4697-9102-908c392812dc tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.000584 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b6bbd968-dc46-4697-9102-908c392812dc tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1352 microversion: 2.1 time: 0.472283 Oct 04 18:17:08.004073 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1925/3829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1352 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:08.009950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a673b82-23d6-4852-8c13-adf17bc80436 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Calling method '.version_select at 0x7fd4d1265280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.037947 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-2a673b82-23d6-4852-8c13-adf17bc80436 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] HTTP exception thrown: Image not found. Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a673b82-23d6-4852-8c13-adf17bc80436 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Request method failure captured: Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHijBzIsaGHDuS25DE7vMm5Ln-APAmXJZKUb6PscB93oD1z_BDTwpb2Sk3Fi2GyxxD1L-UFoHUqd-27iVE9xvcM6AuJLHnZ2mMPggMe7-n8FaIUPaLN90QSGAHrfrXV6RbPyGN8aY_kYOCKpwdNOE1-BcPOAjy-M49PuYN04WBYDI-M Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 1b258e11c7124a29bf32711da3359bd7 Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1b258e11c7124a29bf32711da3359bd7"}]}] Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 1b258e11c7124a29bf32711da3359bd7 Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesDeleteNegativeTestJSON-436508125-project Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e671af00c4f54cc5913592b47d18bb3d Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-436508125-project Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '-1'} Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.040516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:17:08.045108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.050036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a673b82-23d6-4852-8c13-adf17bc80436 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:08.051669 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a673b82-23d6-4852-8c13-adf17bc80436 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] 10.222.0.18 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.046283 Oct 04 18:17:08.058088 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1926/3830] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Oct 4 18:17:08 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:08.066062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-071d12e3-b733-43c4-ae4e-e230d9b8ec5d tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Calling method '.version_select at 0x7fd4d12654c0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.095745 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-071d12e3-b733-43c4-ae4e-e230d9b8ec5d tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] HTTP exception thrown: Image not found. Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-071d12e3-b733-43c4-ae4e-e230d9b8ec5d tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Request method failure captured: Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/ed247dcb-d1eb-47a8-9347-d06f6e0b26aj HTTP/1.1 Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHijBzIsaGHDuS25DE7vMm5Ln-APAmXJZKUb6PscB93oD1z_BDTwpb2Sk3Fi2GyxxD1L-UFoHUqd-27iVE9xvcM6AuJLHnZ2mMPggMe7-n8FaIUPaLN90QSGAHrfrXV6RbPyGN8aY_kYOCKpwdNOE1-BcPOAjy-M49PuYN04WBYDI-M Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 1b258e11c7124a29bf32711da3359bd7 Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1b258e11c7124a29bf32711da3359bd7"}]}] Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 1b258e11c7124a29bf32711da3359bd7 Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesDeleteNegativeTestJSON-436508125-project Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e671af00c4f54cc5913592b47d18bb3d Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-436508125-project Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ed247dcb-d1eb-47a8-9347-d06f6e0b26aj'} Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ed247dcb-d1eb-47a8-9347-d06f6e0b26aj to delete Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ed247dcb-d1eb-47a8-9347-d06f6e0b26aj could not be found. Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.097877 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:17:08.102433 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.111332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-071d12e3-b733-43c4-ae4e-e230d9b8ec5d tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:08.111332 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-071d12e3-b733-43c4-ae4e-e230d9b8ec5d tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] 10.222.0.18 "DELETE /compute/v2.1/images/ed247dcb-d1eb-47a8-9347-d06f6e0b26aj" status: 404 len: 62 microversion: 2.1 time: 0.043586 Oct 04 18:17:08.111332 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1927/3831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] DELETE /compute/v2.1/images/ed247dcb-d1eb-47a8-9347-d06f6e0b26aj => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:08.129573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9e802171-ced4-493b-a7c2-e121d67c5075 req-53ef4472-37b1-4ed3-9507-609a9459908d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1696dd9a-3280-44cc-a274-c4512f1a9639", "name": "network-vif-deleted", "tag": "eea811d8-6d82-42a0-967e-9b0ea6b0f4a2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:08.143276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9e802171-ced4-493b-a7c2-e121d67c5075 req-53ef4472-37b1-4ed3-9507-609a9459908d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.143775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9e802171-ced4-493b-a7c2-e121d67c5075 req-53ef4472-37b1-4ed3-9507-609a9459908d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.144223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9e802171-ced4-493b-a7c2-e121d67c5075 req-53ef4472-37b1-4ed3-9507-609a9459908d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.162188 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9e802171-ced4-493b-a7c2-e121d67c5075 req-53ef4472-37b1-4ed3-9507-609a9459908d service nova] Creating event network-vif-deleted:eea811d8-6d82-42a0-967e-9b0ea6b0f4a2 for instance 1696dd9a-3280-44cc-a274-c4512f1a9639 on n-h1-850499-14 Oct 04 18:17:08.167286 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9e802171-ced4-493b-a7c2-e121d67c5075 req-53ef4472-37b1-4ed3-9507-609a9459908d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060268 Oct 04 18:17:08.168064 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1928/3832] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:08.173573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ab8d5ab-319d-415e-b32e-72b629c5ef64 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Calling method '.version_select at 0x7fd4d11f8b80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.190160 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-5ab8d5ab-319d-415e-b32e-72b629c5ef64 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] HTTP exception thrown: Image not found. Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ab8d5ab-319d-415e-b32e-72b629c5ef64 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Request method failure captured: Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/ab2add08-0ac1-4836-862f-df509e1500681 HTTP/1.1 Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHijBzIsaGHDuS25DE7vMm5Ln-APAmXJZKUb6PscB93oD1z_BDTwpb2Sk3Fi2GyxxD1L-UFoHUqd-27iVE9xvcM6AuJLHnZ2mMPggMe7-n8FaIUPaLN90QSGAHrfrXV6RbPyGN8aY_kYOCKpwdNOE1-BcPOAjy-M49PuYN04WBYDI-M Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 1b258e11c7124a29bf32711da3359bd7 Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1b258e11c7124a29bf32711da3359bd7"}]}] Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 1b258e11c7124a29bf32711da3359bd7 Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesDeleteNegativeTestJSON-436508125-project Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e671af00c4f54cc5913592b47d18bb3d Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-436508125-project Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ab2add08-0ac1-4836-862f-df509e1500681'} Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ab2add08-0ac1-4836-862f-df509e1500681 to delete Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ab2add08-0ac1-4836-862f-df509e1500681 could not be found. Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.192379 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ab8d5ab-319d-415e-b32e-72b629c5ef64 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:08.197146 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ab8d5ab-319d-415e-b32e-72b629c5ef64 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] 10.222.0.18 "DELETE /compute/v2.1/images/ab2add08-0ac1-4836-862f-df509e1500681" status: 404 len: 62 microversion: 2.1 time: 0.024423 Oct 04 18:17:08.199394 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1929/3833] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:08 2022] DELETE /compute/v2.1/images/ab2add08-0ac1-4836-862f-df509e1500681 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:08.205203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45150cae-9b9b-42d5-9f94-efe4d80456f8 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Calling method '.version_select at 0x7fd4d1265af0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.229484 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-45150cae-9b9b-42d5-9f94-efe4d80456f8 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] HTTP exception thrown: Image not found. Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45150cae-9b9b-42d5-9f94-efe4d80456f8 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Request method failure captured: Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/tempest-invalid-1396310288 HTTP/1.1 Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHijBzIsaGHDuS25DE7vMm5Ln-APAmXJZKUb6PscB93oD1z_BDTwpb2Sk3Fi2GyxxD1L-UFoHUqd-27iVE9xvcM6AuJLHnZ2mMPggMe7-n8FaIUPaLN90QSGAHrfrXV6RbPyGN8aY_kYOCKpwdNOE1-BcPOAjy-M49PuYN04WBYDI-M Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 1b258e11c7124a29bf32711da3359bd7 Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1b258e11c7124a29bf32711da3359bd7"}]}] Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 1b258e11c7124a29bf32711da3359bd7 Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesDeleteNegativeTestJSON-436508125-project Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e671af00c4f54cc5913592b47d18bb3d Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-436508125-project Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'tempest-invalid-1396310288'} Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1396310288 to delete Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1396310288 could not be found. Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.231343 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45150cae-9b9b-42d5-9f94-efe4d80456f8 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:08.237631 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-45150cae-9b9b-42d5-9f94-efe4d80456f8 tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] 10.222.0.18 "DELETE /compute/v2.1/images/tempest-invalid-1396310288" status: 404 len: 62 microversion: 2.1 time: 0.032261 Oct 04 18:17:08.239607 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1930/3834] 10.222.0.18 () {58 vars in 1206 bytes} [Tue Oct 4 18:17:08 2022] DELETE /compute/v2.1/images/tempest-invalid-1396310288 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:08.243607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6356db89-46f3-4d2a-8377-249509876e7c tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Calling method '.version_select at 0x7fd4d1272280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.265818 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-6356db89-46f3-4d2a-8377-249509876e7c tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] HTTP exception thrown: Image not found. Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6356db89-46f3-4d2a-8377-249509876e7c tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Request method failure captured: Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/images/784ea297-4226-446f-811f-7d0fd81008ca HTTP/1.1 Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHijBzIsaGHDuS25DE7vMm5Ln-APAmXJZKUb6PscB93oD1z_BDTwpb2Sk3Fi2GyxxD1L-UFoHUqd-27iVE9xvcM6AuJLHnZ2mMPggMe7-n8FaIUPaLN90QSGAHrfrXV6RbPyGN8aY_kYOCKpwdNOE1-BcPOAjy-M49PuYN04WBYDI-M Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 1b258e11c7124a29bf32711da3359bd7 Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1b258e11c7124a29bf32711da3359bd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1b258e11c7124a29bf32711da3359bd7"}]}] Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 1b258e11c7124a29bf32711da3359bd7 Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-436508125 Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ImagesDeleteNegativeTestJSON-436508125-project Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e671af00c4f54cc5913592b47d18bb3d Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-436508125-project Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: exception: Image not found. Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '784ea297-4226-446f-811f-7d0fd81008ca'} Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 784ea297-4226-446f-811f-7d0fd81008ca to delete Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 784ea297-4226-446f-811f-7d0fd81008ca could not be found. Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.267813 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6356db89-46f3-4d2a-8377-249509876e7c tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] Returning 404 to user: Image not found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6356db89-46f3-4d2a-8377-249509876e7c tempest-ImagesDeleteNegativeTestJSON-436508125 tempest-ImagesDeleteNegativeTestJSON-436508125-project] 10.222.0.18 "DELETE /compute/v2.1/images/784ea297-4226-446f-811f-7d0fd81008ca" status: 404 len: 62 microversion: 2.1 time: 0.031463 Oct 04 18:17:08.278053 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1931/3835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] DELETE /compute/v2.1/images/784ea297-4226-446f-811f-7d0fd81008ca => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:08.320699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9cb30fd4-331d-48ae-b88a-38509996714d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.332474 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9cb30fd4-331d-48ae-b88a-38509996714d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.417541 Oct 04 18:17:08.334534 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1905/3836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:08.433093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.438071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.463445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.464732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.465103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.466605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.468642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.469591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.523377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.523890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.524496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.524979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lazy-loading 'fault' on Instance uuid 1696dd9a-3280-44cc-a274-c4512f1a9639 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:08.529764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:08.551641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b3dae3a9-761b-4e2a-a0d9-2ee34ef2f0af tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.552804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b3dae3a9-761b-4e2a-a0d9-2ee34ef2f0af tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.559372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3dae3a9-761b-4e2a-a0d9-2ee34ef2f0af tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.560363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3dae3a9-761b-4e2a-a0d9-2ee34ef2f0af tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.561203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3dae3a9-761b-4e2a-a0d9-2ee34ef2f0af tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.562633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3dae3a9-761b-4e2a-a0d9-2ee34ef2f0af tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.563426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3dae3a9-761b-4e2a-a0d9-2ee34ef2f0af tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.564066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3dae3a9-761b-4e2a-a0d9-2ee34ef2f0af tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.716729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f5fda3ec0548f7bc6c339776d9ed33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1e6d8ca0c447259a1f7fae11ddfd5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.726781 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac8bd5eb-a2e3-404f-b398-b7037ab526ba tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 200 len: 1314 microversion: 2.1 time: 0.302759 Oct 04 18:17:08.727449 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1932/3837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:08.737939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-557ad821-3d93-4363-ad20-17f0d4ccc718 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.740763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-557ad821-3d93-4363-ad20-17f0d4ccc718 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.756227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-557ad821-3d93-4363-ad20-17f0d4ccc718 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.756743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-557ad821-3d93-4363-ad20-17f0d4ccc718 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.757195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-557ad821-3d93-4363-ad20-17f0d4ccc718 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.757920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-557ad821-3d93-4363-ad20-17f0d4ccc718 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.758425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-557ad821-3d93-4363-ad20-17f0d4ccc718 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.758886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-557ad821-3d93-4363-ad20-17f0d4ccc718 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.911017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3dae3a9-761b-4e2a-a0d9-2ee34ef2f0af tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.921481 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b3dae3a9-761b-4e2a-a0d9-2ee34ef2f0af tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1523 microversion: 2.1 time: 0.373393 Oct 04 18:17:08.923255 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1906/3838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:09.032836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1a97f2d1-5229-4974-bd7b-4cc4346b0222 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:09.033830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1a97f2d1-5229-4974-bd7b-4cc4346b0222 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:09.040139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a97f2d1-5229-4974-bd7b-4cc4346b0222 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.041163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a97f2d1-5229-4974-bd7b-4cc4346b0222 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.041918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a97f2d1-5229-4974-bd7b-4cc4346b0222 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.043468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a97f2d1-5229-4974-bd7b-4cc4346b0222 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.044170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a97f2d1-5229-4974-bd7b-4cc4346b0222 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.044807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a97f2d1-5229-4974-bd7b-4cc4346b0222 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.101586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-557ad821-3d93-4363-ad20-17f0d4ccc718 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.115141 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-557ad821-3d93-4363-ad20-17f0d4ccc718 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1362 microversion: 2.1 time: 0.386420 Oct 04 18:17:09.115893 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1933/3839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:09.268856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1a97f2d1-5229-4974-bd7b-4cc4346b0222 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.276840 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1a97f2d1-5229-4974-bd7b-4cc4346b0222 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1352 microversion: 2.1 time: 0.251024 Oct 04 18:17:09.277414 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1907/3840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1352 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:09.357195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ae4001d0-58c0-497f-bdb8-3af6958b5887 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:09.357870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ae4001d0-58c0-497f-bdb8-3af6958b5887 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:09.364599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae4001d0-58c0-497f-bdb8-3af6958b5887 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.365095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae4001d0-58c0-497f-bdb8-3af6958b5887 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.365551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae4001d0-58c0-497f-bdb8-3af6958b5887 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.366257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae4001d0-58c0-497f-bdb8-3af6958b5887 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.366724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae4001d0-58c0-497f-bdb8-3af6958b5887 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.367194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae4001d0-58c0-497f-bdb8-3af6958b5887 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.639538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ae4001d0-58c0-497f-bdb8-3af6958b5887 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.648968 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ae4001d0-58c0-497f-bdb8-3af6958b5887 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.295511 Oct 04 18:17:09.650143 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1934/3841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:09.752417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:09.753462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] [instance: 1696dd9a-3280-44cc-a274-c4512f1a9639] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:09.758026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:09.768560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.769181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.769736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.770707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.772598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.775636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.797258 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] HTTP exception thrown: Instance 1696dd9a-3280-44cc-a274-c4512f1a9639 could not be found. Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Request method failure captured: Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 HTTP/1.1 Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiINyTImdemuWYD0k91acHS_E6bwkpSj_VLIlvI3hD4wrkklwkLI-YQoxxMzzhm1AtuIAsGZw27KzkQqABFqwGopGalyASFNVqTVt642AjbZIZuoGraIDoj4HpmzJiNpApfKLRNiSpLNlqQxagtJ07W2WFvWaU8-_jcOngnlkfXqaI Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2f1e6d8ca0c447259a1f7fae11ddfd5b Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-342992482 Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f1e6d8ca0c447259a1f7fae11ddfd5b"}]}] Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-342992482 Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2f1e6d8ca0c447259a1f7fae11ddfd5b Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-342992482 Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerAddressesNegativeTestJSON-342992482-project Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b7f5fda3ec0548f7bc6c339776d9ed33 Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-342992482-project Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 1696dd9a-3280-44cc-a274-c4512f1a9639 could not be found. Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '1696dd9a-3280-44cc-a274-c4512f1a9639'} Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1696dd9a-3280-44cc-a274-c4512f1a9639 could not be found. Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1696dd9a-3280-44cc-a274-c4512f1a9639 could not be found. Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:09.800746 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1696dd9a-3280-44cc-a274-c4512f1a9639 could not be found. Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] Returning 404 to user: Instance 1696dd9a-3280-44cc-a274-c4512f1a9639 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6afd71f5-b4f4-439a-bcb5-0835f79c64b9 tempest-ServerAddressesNegativeTestJSON-342992482 tempest-ServerAddressesNegativeTestJSON-342992482-project] 10.222.0.18 "GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639" status: 404 len: 111 microversion: 2.1 time: 0.053895 Oct 04 18:17:09.805916 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1908/3842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/1696dd9a-3280-44cc-a274-c4512f1a9639 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:17:09.924650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a72b172f-52ac-4518-975c-81b2de8ba064 req-f27490db-1ce6-4232-b96d-108034fcc20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b2bfb3-d80f-4ed6-95f0-5face8d7581e", "tag": "8ca68b0b-c2aa-4f1a-a1e6-ab53e4ea8d05"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:09.942616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a72b172f-52ac-4518-975c-81b2de8ba064 req-f27490db-1ce6-4232-b96d-108034fcc20f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.946258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a72b172f-52ac-4518-975c-81b2de8ba064 req-f27490db-1ce6-4232-b96d-108034fcc20f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.946457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c800ea42-6cd7-4076-b575-7ffc547da388 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:09.947312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c800ea42-6cd7-4076-b575-7ffc547da388 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:09.947445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a72b172f-52ac-4518-975c-81b2de8ba064 req-f27490db-1ce6-4232-b96d-108034fcc20f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.959858 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a72b172f-52ac-4518-975c-81b2de8ba064 req-f27490db-1ce6-4232-b96d-108034fcc20f service nova] Creating event network-changed:8ca68b0b-c2aa-4f1a-a1e6-ab53e4ea8d05 for instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e on n-h1-850499-14 Oct 04 18:17:09.961484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c800ea42-6cd7-4076-b575-7ffc547da388 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.963849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c800ea42-6cd7-4076-b575-7ffc547da388 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.965923 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a72b172f-52ac-4518-975c-81b2de8ba064 req-f27490db-1ce6-4232-b96d-108034fcc20f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045884 Oct 04 18:17:09.967192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c800ea42-6cd7-4076-b575-7ffc547da388 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.967356 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1935/3843] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:09.968872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c800ea42-6cd7-4076-b575-7ffc547da388 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.969356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c800ea42-6cd7-4076-b575-7ffc547da388 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.969814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c800ea42-6cd7-4076-b575-7ffc547da388 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.140343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e628fae3-f7dc-473c-b645-0bf8fb2371d3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.141202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e628fae3-f7dc-473c-b645-0bf8fb2371d3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:10.161009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e628fae3-f7dc-473c-b645-0bf8fb2371d3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.162012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e628fae3-f7dc-473c-b645-0bf8fb2371d3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.162461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e628fae3-f7dc-473c-b645-0bf8fb2371d3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.169939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e628fae3-f7dc-473c-b645-0bf8fb2371d3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.170998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e628fae3-f7dc-473c-b645-0bf8fb2371d3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.170998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e628fae3-f7dc-473c-b645-0bf8fb2371d3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.403318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c800ea42-6cd7-4076-b575-7ffc547da388 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.418134 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c800ea42-6cd7-4076-b575-7ffc547da388 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1523 microversion: 2.1 time: 0.475116 Oct 04 18:17:10.427393 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1909/3844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:10.434978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-32bb9905-58c8-4551-986e-dc0d8471d562 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.440944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-32bb9905-58c8-4551-986e-dc0d8471d562 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:10.453126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bb9905-58c8-4551-986e-dc0d8471d562 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.457526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bb9905-58c8-4551-986e-dc0d8471d562 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.458192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bb9905-58c8-4551-986e-dc0d8471d562 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.459146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bb9905-58c8-4551-986e-dc0d8471d562 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.459785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bb9905-58c8-4551-986e-dc0d8471d562 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.460398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32bb9905-58c8-4551-986e-dc0d8471d562 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.585096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e628fae3-f7dc-473c-b645-0bf8fb2371d3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.593386 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e628fae3-f7dc-473c-b645-0bf8fb2371d3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1362 microversion: 2.1 time: 0.457848 Oct 04 18:17:10.593969 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1936/3845] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:10.713887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f3f6b01b-0e8e-444b-a4cd-dece4b86cf02 tempest-ListImagesTestJSON-724679003 tempest-ListImagesTestJSON-724679003-project] Calling method '.version_select at 0x7fd4d13a6f70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.769187 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f3f6b01b-0e8e-444b-a4cd-dece4b86cf02 tempest-ListImagesTestJSON-724679003 tempest-ListImagesTestJSON-724679003-project] 10.222.0.18 "GET /compute/v2.1/images/acd24e6c-2248-4327-9505-66fea04436b8" status: 200 len: 784 microversion: 2.1 time: 0.174164 Oct 04 18:17:10.769792 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1937/3846] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/images/acd24e6c-2248-4327-9505-66fea04436b8 => generated 784 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:10.774919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16613e2a-fc82-43ba-82e0-a1724ac68a01 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.775743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-16613e2a-fc82-43ba-82e0-a1724ac68a01 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:10.784635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16613e2a-fc82-43ba-82e0-a1724ac68a01 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.785405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16613e2a-fc82-43ba-82e0-a1724ac68a01 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.785851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16613e2a-fc82-43ba-82e0-a1724ac68a01 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.786562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16613e2a-fc82-43ba-82e0-a1724ac68a01 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.787051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16613e2a-fc82-43ba-82e0-a1724ac68a01 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.787486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16613e2a-fc82-43ba-82e0-a1724ac68a01 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.803213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-32bb9905-58c8-4551-986e-dc0d8471d562 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.812301 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-32bb9905-58c8-4551-986e-dc0d8471d562 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1352 microversion: 2.1 time: 0.380694 Oct 04 18:17:10.812889 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1910/3847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1352 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:10.820825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dd03a021-beed-4c9c-8d43-09afd07cc67b tempest-ListImagesTestJSON-724679003 tempest-ListImagesTestJSON-724679003-project] Calling method '.version_select at 0x7fd4d10e2040>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.903975 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dd03a021-beed-4c9c-8d43-09afd07cc67b tempest-ListImagesTestJSON-724679003 tempest-ListImagesTestJSON-724679003-project] 10.222.0.18 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.088826 Oct 04 18:17:10.904563 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1911/3848] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/images => generated 445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:10.918267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6bf5a4f9-9742-4b5d-ae10-7540c825e838 tempest-ListImagesTestJSON-724679003 tempest-ListImagesTestJSON-724679003-project] Calling method '.version_select at 0x7fd4d12b2b80>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.977158 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6bf5a4f9-9742-4b5d-ae10-7540c825e838 tempest-ListImagesTestJSON-724679003 tempest-ListImagesTestJSON-724679003-project] 10.222.0.18 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.062891 Oct 04 18:17:10.977985 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1912/3849] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:11.088176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.098108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.099184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Searching by: {'deleted': False, 'project_id': '109bbd6392bb4b0faa917253bd5338be'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:17:11.106098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.106602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.107409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.108357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.108817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.109250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.112568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-16613e2a-fc82-43ba-82e0-a1724ac68a01 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.120816 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-16613e2a-fc82-43ba-82e0-a1724ac68a01 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.349757 Oct 04 18:17:11.121552 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1938/3850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:11.142503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:17:11.175974 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5adb0db5-9e72-4e2f-914e-cb9e6f859e4e tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.094326 Oct 04 18:17:11.176564 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1913/3851] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers => generated 334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:11.191666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.197143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.198326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Searching by: {'deleted': False, 'project_id': '109bbd6392bb4b0faa917253bd5338be'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:17:11.207871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.208375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.208953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.209702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.210281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.210899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.237997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:17:11.270028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=21 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:11.274346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.281789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.282334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.282785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.448488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0beb06ec-2991-4c39-8bb3-a97735bd60b9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.449142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0beb06ec-2991-4c39-8bb3-a97735bd60b9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.469092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0beb06ec-2991-4c39-8bb3-a97735bd60b9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.470036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0beb06ec-2991-4c39-8bb3-a97735bd60b9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.471572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0beb06ec-2991-4c39-8bb3-a97735bd60b9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.472726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0beb06ec-2991-4c39-8bb3-a97735bd60b9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.473573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0beb06ec-2991-4c39-8bb3-a97735bd60b9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.475318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0beb06ec-2991-4c39-8bb3-a97735bd60b9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.881038 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9e2a74c7-2fc2-4794-8430-950ea408f287 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.694771 Oct 04 18:17:11.881642 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1939/3852] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:11.886377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea16c34b-5a3f-4854-8bd9-314fe78adc73 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.887189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ea16c34b-5a3f-4854-8bd9-314fe78adc73 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.893872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16c34b-5a3f-4854-8bd9-314fe78adc73 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.894364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16c34b-5a3f-4854-8bd9-314fe78adc73 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.894809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16c34b-5a3f-4854-8bd9-314fe78adc73 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.895537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16c34b-5a3f-4854-8bd9-314fe78adc73 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.896157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16c34b-5a3f-4854-8bd9-314fe78adc73 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.896863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16c34b-5a3f-4854-8bd9-314fe78adc73 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.937262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0beb06ec-2991-4c39-8bb3-a97735bd60b9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.943380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:11.953524 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0beb06ec-2991-4c39-8bb3-a97735bd60b9 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1508 microversion: 2.1 time: 0.508958 Oct 04 18:17:11.954734 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1914/3853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1508 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:11.959643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f543c86-23ce-48c2-80e5-671f78155a8f tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.960363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2f543c86-23ce-48c2-80e5-671f78155a8f tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.970700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f543c86-23ce-48c2-80e5-671f78155a8f tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.971733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f543c86-23ce-48c2-80e5-671f78155a8f tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.972582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f543c86-23ce-48c2-80e5-671f78155a8f tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.973387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f543c86-23ce-48c2-80e5-671f78155a8f tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.974022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f543c86-23ce-48c2-80e5-671f78155a8f tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.974452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f543c86-23ce-48c2-80e5-671f78155a8f tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.175004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ea16c34b-5a3f-4854-8bd9-314fe78adc73 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:12.184657 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ea16c34b-5a3f-4854-8bd9-314fe78adc73 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1362 microversion: 2.1 time: 0.301780 Oct 04 18:17:12.186183 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1940/3854] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:12.194345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7288adea-3416-4416-a653-d1366344e990 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.203552 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7288adea-3416-4416-a653-d1366344e990 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015955 Oct 04 18:17:12.204853 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1941/3855] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:12.210299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d615453e-a009-429c-aa48-76b55085cdac tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.211074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d615453e-a009-429c-aa48-76b55085cdac tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.218447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d615453e-a009-429c-aa48-76b55085cdac tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.219394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d615453e-a009-429c-aa48-76b55085cdac tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.220185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d615453e-a009-429c-aa48-76b55085cdac tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.221144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d615453e-a009-429c-aa48-76b55085cdac tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.221808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d615453e-a009-429c-aa48-76b55085cdac tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.224179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d615453e-a009-429c-aa48-76b55085cdac tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.416313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2f543c86-23ce-48c2-80e5-671f78155a8f tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:12.423951 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2f543c86-23ce-48c2-80e5-671f78155a8f tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1352 microversion: 2.1 time: 0.468053 Oct 04 18:17:12.440608 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1915/3856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1352 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:12.455887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a889e76-d0e6-43b6-af39-12cbb71e5a81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.456747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a889e76-d0e6-43b6-af39-12cbb71e5a81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.464870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a889e76-d0e6-43b6-af39-12cbb71e5a81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.465371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a889e76-d0e6-43b6-af39-12cbb71e5a81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.465816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a889e76-d0e6-43b6-af39-12cbb71e5a81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.466584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a889e76-d0e6-43b6-af39-12cbb71e5a81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.467076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a889e76-d0e6-43b6-af39-12cbb71e5a81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.467510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a889e76-d0e6-43b6-af39-12cbb71e5a81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.604183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d615453e-a009-429c-aa48-76b55085cdac tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:12.612932 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d615453e-a009-429c-aa48-76b55085cdac tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 200 len: 1508 microversion: 2.1 time: 0.406783 Oct 04 18:17:12.613512 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1942/3857] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 1508 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:12.734821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a0f8ff8c-0ec5-448a-b5c6-8deaf87a8017 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Action: 'create', calling method: .version_select at 0x7fd4d1e31040>, body: {"keypair": {"name": "tempest-keypair-448327630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfcBq7W1DvaQ3w+LqySQqaRQ88moQrzOF9kSLrZZ0UTCPbPLBS6NhmBzu4SxWmThOEkNuylHprMCiorIzraRMcIoLTe3X9gO7C7xlgx8EZDwhkXuon2cg2zRXKnpgdy7w=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:12.751283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-a0f8ff8c-0ec5-448a-b5c6-8deaf87a8017 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:12.756577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-a0f8ff8c-0ec5-448a-b5c6-8deaf87a8017 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for user 9017c8352a4d43c78f7dc90473b58f4e and project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:12.781177 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a0f8ff8c-0ec5-448a-b5c6-8deaf87a8017 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166015 Oct 04 18:17:12.781714 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1943/3858] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:12.786358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7754a545-223a-41cd-a9a3-1c76efb5bf4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.786866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7754a545-223a-41cd-a9a3-1c76efb5bf4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.794930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7754a545-223a-41cd-a9a3-1c76efb5bf4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.795461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7754a545-223a-41cd-a9a3-1c76efb5bf4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.795993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7754a545-223a-41cd-a9a3-1c76efb5bf4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.796713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7754a545-223a-41cd-a9a3-1c76efb5bf4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.797180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7754a545-223a-41cd-a9a3-1c76efb5bf4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.797614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7754a545-223a-41cd-a9a3-1c76efb5bf4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.805714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a889e76-d0e6-43b6-af39-12cbb71e5a81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:12.820374 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a889e76-d0e6-43b6-af39-12cbb71e5a81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1533 microversion: 2.1 time: 0.378009 Oct 04 18:17:12.822192 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1916/3859] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1533 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:12.829387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a8eb7584-04db-4665-855b-35ee559ee54d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.830140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7754a545-223a-41cd-a9a3-1c76efb5bf4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:12.830675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a8eb7584-04db-4665-855b-35ee559ee54d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.842423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8eb7584-04db-4665-855b-35ee559ee54d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.843279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8eb7584-04db-4665-855b-35ee559ee54d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.844165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8eb7584-04db-4665-855b-35ee559ee54d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.845513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8eb7584-04db-4665-855b-35ee559ee54d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.845982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8eb7584-04db-4665-855b-35ee559ee54d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.846577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8eb7584-04db-4665-855b-35ee559ee54d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.875649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a8eb7584-04db-4665-855b-35ee559ee54d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:12.925507 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7754a545-223a-41cd-a9a3-1c76efb5bf4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "DELETE /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 204 len: 0 microversion: 2.1 time: 0.142270 Oct 04 18:17:12.926371 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1944/3860] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:12 2022] DELETE /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:12.941994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d348f9c-e8af-48b3-9010-7fddf424bf84 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Calling method '.version_select at 0x7fd4d1272f70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.951449 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4d348f9c-e8af-48b3-9010-7fddf424bf84 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-448327630" status: 200 len: 497 microversion: 2.1 time: 0.014725 Oct 04 18:17:12.958618 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1945/3861] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-448327630 => generated 497 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:12.965561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b17055d-4fc1-406d-b8be-2152dfcfdf47 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Calling method '.version_select at 0x7fd4d13a6f70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.992124 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2b17055d-4fc1-406d-b8be-2152dfcfdf47 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448327630" status: 202 len: 0 microversion: 2.1 time: 0.030520 Oct 04 18:17:12.992949 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1946/3862] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 4 18:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448327630 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:17:13.001234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:13.006557 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a8eb7584-04db-4665-855b-35ee559ee54d tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 204 len: 0 microversion: 2.1 time: 0.182828 Oct 04 18:17:13.009122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac693d84-6dfd-464f-956b-8b88c2642f55 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Action: 'create', calling method: .version_select at 0x7fd4d120bca0>, body: {"keypair": {"name": "tempest-keypair-1771827644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvb/u1hKrrxDlkrJThFH+llHjAmJz7MhoXcIWKW1Oxsnn2WaphJnL0yo+eJquFQT9nShJget+vVvcesgxqM3flQ41Ux6VBBzaJjqjRzYZGuOQEg6IaJRWykeL0iNmh1jA=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:13.013473 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1917/3863] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:12 2022] DELETE /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:13.022906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0b5e2cc0-fe60-403d-979e-0dd31e6252a4 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:13.027523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0b5e2cc0-fe60-403d-979e-0dd31e6252a4 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:13.031473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ac693d84-6dfd-464f-956b-8b88c2642f55 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:13.040760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b5e2cc0-fe60-403d-979e-0dd31e6252a4 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.041263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b5e2cc0-fe60-403d-979e-0dd31e6252a4 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.041699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b5e2cc0-fe60-403d-979e-0dd31e6252a4 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.042058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ac693d84-6dfd-464f-956b-8b88c2642f55 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for user 9017c8352a4d43c78f7dc90473b58f4e and project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:13.042408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b5e2cc0-fe60-403d-979e-0dd31e6252a4 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.042861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b5e2cc0-fe60-403d-979e-0dd31e6252a4 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.045207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b5e2cc0-fe60-403d-979e-0dd31e6252a4 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.066895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:13.097233 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac693d84-6dfd-464f-956b-8b88c2642f55 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092614 Oct 04 18:17:13.103505 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1947/3864] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:13.105842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-206d906f-c36d-4b02-bd33-6818fd50a263 req-fe1184e7-cbc8-47ce-a93a-e6c1791b229a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a988be-0960-4297-9ca3-24fc491f115b", "name": "network-vif-plugged", "status": "completed", "tag": "a021fddf-59d8-48f5-9b97-c86fdab8c417"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:13.118109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-206d906f-c36d-4b02-bd33-6818fd50a263 req-fe1184e7-cbc8-47ce-a93a-e6c1791b229a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.118824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-206d906f-c36d-4b02-bd33-6818fd50a263 req-fe1184e7-cbc8-47ce-a93a-e6c1791b229a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.119385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-206d906f-c36d-4b02-bd33-6818fd50a263 req-fe1184e7-cbc8-47ce-a93a-e6c1791b229a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.131198 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-206d906f-c36d-4b02-bd33-6818fd50a263 req-fe1184e7-cbc8-47ce-a93a-e6c1791b229a service nova] Creating event network-vif-plugged:a021fddf-59d8-48f5-9b97-c86fdab8c417 for instance 34a988be-0960-4297-9ca3-24fc491f115b on n-h2-850499-14 Oct 04 18:17:13.136231 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-206d906f-c36d-4b02-bd33-6818fd50a263 req-fe1184e7-cbc8-47ce-a93a-e6c1791b229a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035440 Oct 04 18:17:13.137053 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1948/3865] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:13.145566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa0c3c59-fc4d-4d5c-846c-21042272bcc7 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Calling method '.version_select at 0x7fd4d1272e50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:13.164976 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa0c3c59-fc4d-4d5c-846c-21042272bcc7 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771827644" status: 202 len: 0 microversion: 2.1 time: 0.023376 Oct 04 18:17:13.165622 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1949/3866] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771827644 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:13.170516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1445675205", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "a3d67ed6-ad9f-48a1-902c-dc88b5c66c23"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:13.226037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] validate_networks() for [('a3d67ed6-ad9f-48a1-902c-dc88b5c66c23', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:13.427626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0b5e2cc0-fe60-403d-979e-0dd31e6252a4 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.436622 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0b5e2cc0-fe60-403d-979e-0dd31e6252a4 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1700 microversion: 2.1 time: 0.421686 Oct 04 18:17:13.437397 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1918/3867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:13 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1700 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:13.450914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-521eb7be-a76b-4770-b1b6-43209454c9dd tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Action: 'create', calling method: .version_select at 0x7fd4d121c0d0>, body: {"keypair": {"name": "tempest-keypair-931506235", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:13.492203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-521eb7be-a76b-4770-b1b6-43209454c9dd tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:13.503787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-521eb7be-a76b-4770-b1b6-43209454c9dd tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for user 9017c8352a4d43c78f7dc90473b58f4e and project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:13.539488 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-521eb7be-a76b-4770-b1b6-43209454c9dd tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.093313 Oct 04 18:17:13.547206 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1919/3868] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:13 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:13.552738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c36573b9-c793-4ab0-800e-5bb470ba6228 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:13.553461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c36573b9-c793-4ab0-800e-5bb470ba6228 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:13.563309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36573b9-c793-4ab0-800e-5bb470ba6228 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.563813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36573b9-c793-4ab0-800e-5bb470ba6228 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.566916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36573b9-c793-4ab0-800e-5bb470ba6228 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.571249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36573b9-c793-4ab0-800e-5bb470ba6228 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.571769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36573b9-c793-4ab0-800e-5bb470ba6228 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.572212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36573b9-c793-4ab0-800e-5bb470ba6228 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.893063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:13.893858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:13.894545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:13.895191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:13.896368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:13.898243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c36573b9-c793-4ab0-800e-5bb470ba6228 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.906724 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c36573b9-c793-4ab0-800e-5bb470ba6228 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1362 microversion: 2.1 time: 0.358063 Oct 04 18:17:13.907344 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1920/3869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:13 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:13.919286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5e9dfb1e-ce22-4629-beab-353f4643ae85 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:13.919286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5e9dfb1e-ce22-4629-beab-353f4643ae85 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:13.925357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.925980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e9dfb1e-ce22-4629-beab-353f4643ae85 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.926353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.926519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e9dfb1e-ce22-4629-beab-353f4643ae85 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.926918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e9dfb1e-ce22-4629-beab-353f4643ae85 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.927383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.927697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e9dfb1e-ce22-4629-beab-353f4643ae85 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.928164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e9dfb1e-ce22-4629-beab-353f4643ae85 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.928599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e9dfb1e-ce22-4629-beab-353f4643ae85 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.929842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.931571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.932383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.969452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Getting quotas for project 5abaa6b711db435abdb899420464d972. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:13.977458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Getting quotas for user 350bf584a7364c90a6b2a5a05f1cd428 and project 5abaa6b711db435abdb899420464d972. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:13.998871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:14.001805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:14.054352 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2117734-7f68-4cd2-837f-764ea27cd4e8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.887208 Oct 04 18:17:14.055474 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1950/3870] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:17:14.062424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee3d5415-0336-4ec0-9f21-d9b5abe2891d tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Calling method '.version_select at 0x7fd4d120bdc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.087687 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee3d5415-0336-4ec0-9f21-d9b5abe2891d tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-931506235" status: 202 len: 0 microversion: 2.1 time: 0.028754 Oct 04 18:17:14.095294 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1951/3871] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 4 18:17:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-931506235 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:14.101468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-950e8248-ad3f-46a2-a9b5-e7c5fc3ce11f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.102352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-950e8248-ad3f-46a2-a9b5-e7c5fc3ce11f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:14.111082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-950e8248-ad3f-46a2-a9b5-e7c5fc3ce11f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.118126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-950e8248-ad3f-46a2-a9b5-e7c5fc3ce11f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.118814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-950e8248-ad3f-46a2-a9b5-e7c5fc3ce11f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.119608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-950e8248-ad3f-46a2-a9b5-e7c5fc3ce11f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.120080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-950e8248-ad3f-46a2-a9b5-e7c5fc3ce11f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.120844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-950e8248-ad3f-46a2-a9b5-e7c5fc3ce11f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.143149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5e9dfb1e-ce22-4629-beab-353f4643ae85 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:14.154931 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5e9dfb1e-ce22-4629-beab-353f4643ae85 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1352 microversion: 2.1 time: 0.246527 Oct 04 18:17:14.157024 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1921/3872] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:13 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1352 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:14.172244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1779cc14-5f8a-4fb6-92c8-2cda67224f42 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.173390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1779cc14-5f8a-4fb6-92c8-2cda67224f42 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:14.315294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1779cc14-5f8a-4fb6-92c8-2cda67224f42 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:14.329682 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1779cc14-5f8a-4fb6-92c8-2cda67224f42 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1218 microversion: 2.1 time: 0.171422 Oct 04 18:17:14.330766 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1922/3873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:14.335487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-282f0aa3-66c7-4fed-a2fd-c7bcdfe3ae1f tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Action: 'create', calling method: .version_select at 0x7fd4d10e23a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-655216166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKehY2uzXT1Kt4GMUKmw1DSehNqdC0o5e0diECApxuda/WRYLdWxVrNaTHHSzklMJdSHxMiZ7EgMYJbGxUmkBvR5yWVkFcYVa89FmU8aGEbpkQb45N6Yyq+DYAnfZvDQmw=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:14.364736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-282f0aa3-66c7-4fed-a2fd-c7bcdfe3ae1f tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:14.370213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-282f0aa3-66c7-4fed-a2fd-c7bcdfe3ae1f tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for user 9017c8352a4d43c78f7dc90473b58f4e and project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:14.387038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-950e8248-ad3f-46a2-a9b5-e7c5fc3ce11f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:14.398213 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-950e8248-ad3f-46a2-a9b5-e7c5fc3ce11f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1533 microversion: 2.1 time: 0.307155 Oct 04 18:17:14.412293 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1952/3874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1533 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:14.412500 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-282f0aa3-66c7-4fed-a2fd-c7bcdfe3ae1f tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.068390 Oct 04 18:17:14.412500 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1923/3875] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:14.415353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-766454e9-b60d-4bba-b6ac-d107529ade23 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Action: 'create', calling method: .version_select at 0x7fd4d12455e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-833074922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPKgAigxQ/YlBw2DMVq4VU+U6AWQFkokqx1MDltfh1oRuuKFY2JvH/90x0qsVlrCLGcNp0a/OCYbdiYzUFbxrqUbA7JjpZD3EbQwlfSkcoPMcX0suaO62Puj2cjQd5/8g=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:14.431516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-766454e9-b60d-4bba-b6ac-d107529ade23 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:14.438072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-766454e9-b60d-4bba-b6ac-d107529ade23 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for user 9017c8352a4d43c78f7dc90473b58f4e and project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:14.460938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e3393420-7fde-4f70-abe1-546eac592a6f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.461631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e3393420-7fde-4f70-abe1-546eac592a6f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:14.469708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3393420-7fde-4f70-abe1-546eac592a6f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.469932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3393420-7fde-4f70-abe1-546eac592a6f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.470383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3393420-7fde-4f70-abe1-546eac592a6f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.471737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3393420-7fde-4f70-abe1-546eac592a6f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.471737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3393420-7fde-4f70-abe1-546eac592a6f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.483444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3393420-7fde-4f70-abe1-546eac592a6f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.490165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-766454e9-b60d-4bba-b6ac-d107529ade23 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.078391 Oct 04 18:17:14.499748 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1953/3876] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:14.509590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b01f2522-4e89-4a9d-b3b0-fe99e5417a83 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Action: 'create', calling method: .version_select at 0x7fd4d1245430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-881539847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIKuprmhIQFKZxMmg6Gk5rKAdNGx9ZrET7/gAP7Zrv+Atj/amSL7RJwe33Kmj8QIyikSx0zkabXiRNR+UvlzFmGa8Gk8qaLLpBwb1FTsaNdpRDTyXDZDdvcDsAXlhwI/Q=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:14.526765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b01f2522-4e89-4a9d-b3b0-fe99e5417a83 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:14.533094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b01f2522-4e89-4a9d-b3b0-fe99e5417a83 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Getting quotas for user 9017c8352a4d43c78f7dc90473b58f4e and project 86ca77af407d43b78bf3d13ebb958338. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:14.561119 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b01f2522-4e89-4a9d-b3b0-fe99e5417a83 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.059807 Oct 04 18:17:14.563170 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1954/3877] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:14.575061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a8681957-20de-4dd8-a5fd-43eafda72670 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Calling method '.version_select at 0x7fd4d11f8b80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.580479 n-d-850499-14 devstack@n-api.service[122332]: WARNING oslo_db.sqlalchemy.utils [None req-a8681957-20de-4dd8-a5fd-43eafda72670 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:17:14.586720 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a8681957-20de-4dd8-a5fd-43eafda72670 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.016886 Oct 04 18:17:14.587655 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1955/3878] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:14.609501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-156bbc55-46db-40b7-a806-618388fb8447 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Calling method '.version_select at 0x7fd4d1207820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.648819 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-156bbc55-46db-40b7-a806-618388fb8447 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-881539847" status: 202 len: 0 microversion: 2.1 time: 0.053271 Oct 04 18:17:14.652482 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1956/3879] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:17:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-881539847 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:17:14.659989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fa52fc0f-c7d4-4ac7-96bc-a911782fcf82 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Calling method '.version_select at 0x7fd4d120be50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.694600 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fa52fc0f-c7d4-4ac7-96bc-a911782fcf82 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-833074922" status: 202 len: 0 microversion: 2.1 time: 0.040813 Oct 04 18:17:14.698406 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1957/3880] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:17:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-833074922 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:14.704353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ed3457e-f9eb-48cc-9e51-3b6a6ec030b9 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] Calling method '.version_select at 0x7fd4d1272280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.764441 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ed3457e-f9eb-48cc-9e51-3b6a6ec030b9 tempest-KeyPairsV2TestJSON-1724334477 tempest-KeyPairsV2TestJSON-1724334477-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-655216166" status: 202 len: 0 microversion: 2.1 time: 0.064372 Oct 04 18:17:14.769207 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1958/3881] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:17:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-655216166 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:14.849302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e3393420-7fde-4f70-abe1-546eac592a6f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:14.870828 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e3393420-7fde-4f70-abe1-546eac592a6f tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1700 microversion: 2.1 time: 0.413850 Oct 04 18:17:14.872050 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1924/3882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1700 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:14.931811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c66a526-7e3c-43b1-ad16-d128f2d62577 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.932621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c66a526-7e3c-43b1-ad16-d128f2d62577 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:14.957216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c66a526-7e3c-43b1-ad16-d128f2d62577 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.959164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c66a526-7e3c-43b1-ad16-d128f2d62577 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.961872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c66a526-7e3c-43b1-ad16-d128f2d62577 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.984493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c66a526-7e3c-43b1-ad16-d128f2d62577 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.985053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c66a526-7e3c-43b1-ad16-d128f2d62577 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.987899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c66a526-7e3c-43b1-ad16-d128f2d62577 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.181448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6645a32f-df5c-4bfd-b50f-8ebee4bceeb9 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:15.183125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6645a32f-df5c-4bfd-b50f-8ebee4bceeb9 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:15.193179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6645a32f-df5c-4bfd-b50f-8ebee4bceeb9 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.194189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6645a32f-df5c-4bfd-b50f-8ebee4bceeb9 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.194781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6645a32f-df5c-4bfd-b50f-8ebee4bceeb9 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.195882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6645a32f-df5c-4bfd-b50f-8ebee4bceeb9 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.196677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6645a32f-df5c-4bfd-b50f-8ebee4bceeb9 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.197268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6645a32f-df5c-4bfd-b50f-8ebee4bceeb9 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.602834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4c66a526-7e3c-43b1-ad16-d128f2d62577 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.614196 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c66a526-7e3c-43b1-ad16-d128f2d62577 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1362 microversion: 2.1 time: 0.687348 Oct 04 18:17:15.617128 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1959/3883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1362 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:15.627686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d96b105-49d7-4465-8019-723962fac582 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:15.632315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d96b105-49d7-4465-8019-723962fac582 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:15.639188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6645a32f-df5c-4bfd-b50f-8ebee4bceeb9 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.646587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d96b105-49d7-4465-8019-723962fac582 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.649047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d96b105-49d7-4465-8019-723962fac582 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.650140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d96b105-49d7-4465-8019-723962fac582 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.651053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d96b105-49d7-4465-8019-723962fac582 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.651612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d96b105-49d7-4465-8019-723962fac582 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.652111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d96b105-49d7-4465-8019-723962fac582 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.652243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6645a32f-df5c-4bfd-b50f-8ebee4bceeb9 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1352 microversion: 2.1 time: 0.475656 Oct 04 18:17:15.652727 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1925/3884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:15 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1352 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:15.674824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dbadfce0-c717-4a42-8e29-d3343cc95611 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:15.675779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dbadfce0-c717-4a42-8e29-d3343cc95611 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:15.682335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbadfce0-c717-4a42-8e29-d3343cc95611 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.683261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbadfce0-c717-4a42-8e29-d3343cc95611 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.683949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbadfce0-c717-4a42-8e29-d3343cc95611 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.684887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbadfce0-c717-4a42-8e29-d3343cc95611 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.685865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbadfce0-c717-4a42-8e29-d3343cc95611 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.686591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbadfce0-c717-4a42-8e29-d3343cc95611 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.199871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2d96b105-49d7-4465-8019-723962fac582 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:16.215733 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2d96b105-49d7-4465-8019-723962fac582 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1270 microversion: 2.1 time: 0.595870 Oct 04 18:17:16.216351 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1960/3885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:15 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1270 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:16.247739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d08ba039-a485-4209-ba28-ceeb6e81f1af tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:16.248380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d08ba039-a485-4209-ba28-ceeb6e81f1af tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:16.263658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d08ba039-a485-4209-ba28-ceeb6e81f1af tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.264162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d08ba039-a485-4209-ba28-ceeb6e81f1af tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.265135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d08ba039-a485-4209-ba28-ceeb6e81f1af tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.265868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d08ba039-a485-4209-ba28-ceeb6e81f1af tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.266337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d08ba039-a485-4209-ba28-ceeb6e81f1af tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.266776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d08ba039-a485-4209-ba28-ceeb6e81f1af tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.518717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dbadfce0-c717-4a42-8e29-d3343cc95611 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:16.531086 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dbadfce0-c717-4a42-8e29-d3343cc95611 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1533 microversion: 2.1 time: 0.861372 Oct 04 18:17:16.532191 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1926/3886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:15 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1533 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:16.640259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eb73214c-ce19-4a08-90e5-99da1619d0bc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:16.641140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eb73214c-ce19-4a08-90e5-99da1619d0bc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:16.647833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb73214c-ce19-4a08-90e5-99da1619d0bc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.651486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d08ba039-a485-4209-ba28-ceeb6e81f1af tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:16.665898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb73214c-ce19-4a08-90e5-99da1619d0bc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.666539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb73214c-ce19-4a08-90e5-99da1619d0bc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.669544 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d08ba039-a485-4209-ba28-ceeb6e81f1af tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1700 microversion: 2.1 time: 0.433064 Oct 04 18:17:16.670396 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1961/3887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:16 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1700 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:16.673845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb73214c-ce19-4a08-90e5-99da1619d0bc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.678824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb73214c-ce19-4a08-90e5-99da1619d0bc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.679595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb73214c-ce19-4a08-90e5-99da1619d0bc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.686389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e56a82a3-e929-4ab2-a8e6-2efac04dfd1b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:16.690332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e56a82a3-e929-4ab2-a8e6-2efac04dfd1b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:16.704826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56a82a3-e929-4ab2-a8e6-2efac04dfd1b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.710185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56a82a3-e929-4ab2-a8e6-2efac04dfd1b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.710909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56a82a3-e929-4ab2-a8e6-2efac04dfd1b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.714021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56a82a3-e929-4ab2-a8e6-2efac04dfd1b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.714722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56a82a3-e929-4ab2-a8e6-2efac04dfd1b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.716226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e56a82a3-e929-4ab2-a8e6-2efac04dfd1b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.111187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e56a82a3-e929-4ab2-a8e6-2efac04dfd1b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:17.113212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eb73214c-ce19-4a08-90e5-99da1619d0bc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:17.116709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:17.121843 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eb73214c-ce19-4a08-90e5-99da1619d0bc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1362 microversion: 2.1 time: 0.485407 Oct 04 18:17:17.127261 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1927/3888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:16 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:17.133751 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e56a82a3-e929-4ab2-a8e6-2efac04dfd1b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1352 microversion: 2.1 time: 0.460910 Oct 04 18:17:17.134352 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1962/3889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:16 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1352 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:17.147091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-aa226ce5-7cb0-4ca2-9f1d-f8c429e2e2c1 req-17126f84-e1c6-4fec-840b-b0c8ecd9211a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671406ce-ae77-441a-9e07-3d054c34c4f5", "name": "network-vif-unplugged", "status": "completed", "tag": "f2bffad7-9c35-4420-bb47-a7b54db456ad"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:17.172372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-aa226ce5-7cb0-4ca2-9f1d-f8c429e2e2c1 req-17126f84-e1c6-4fec-840b-b0c8ecd9211a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.172871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-aa226ce5-7cb0-4ca2-9f1d-f8c429e2e2c1 req-17126f84-e1c6-4fec-840b-b0c8ecd9211a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.173315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-aa226ce5-7cb0-4ca2-9f1d-f8c429e2e2c1 req-17126f84-e1c6-4fec-840b-b0c8ecd9211a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.185981 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-aa226ce5-7cb0-4ca2-9f1d-f8c429e2e2c1 req-17126f84-e1c6-4fec-840b-b0c8ecd9211a service nova] Creating event network-vif-unplugged:f2bffad7-9c35-4420-bb47-a7b54db456ad for instance 671406ce-ae77-441a-9e07-3d054c34c4f5 on n-h2-850499-14 Oct 04 18:17:17.203260 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-aa226ce5-7cb0-4ca2-9f1d-f8c429e2e2c1 req-17126f84-e1c6-4fec-840b-b0c8ecd9211a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069545 Oct 04 18:17:17.203260 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1928/3890] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:17.238785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ec0bc9fa-156f-414e-b6c0-d7d94193c6d3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.239935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ec0bc9fa-156f-414e-b6c0-d7d94193c6d3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.255302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec0bc9fa-156f-414e-b6c0-d7d94193c6d3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.256166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec0bc9fa-156f-414e-b6c0-d7d94193c6d3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.256862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec0bc9fa-156f-414e-b6c0-d7d94193c6d3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.257827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec0bc9fa-156f-414e-b6c0-d7d94193c6d3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.259035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec0bc9fa-156f-414e-b6c0-d7d94193c6d3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.259706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec0bc9fa-156f-414e-b6c0-d7d94193c6d3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.422766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ec0bc9fa-156f-414e-b6c0-d7d94193c6d3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:17.442563 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ec0bc9fa-156f-414e-b6c0-d7d94193c6d3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1276 microversion: 2.1 time: 0.207475 Oct 04 18:17:17.445732 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1963/3891] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:17 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:17.520656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-db7cc773-dbca-4f4d-b7fc-6f2e173db7ba req-d116aa52-abe0-482a-a713-ef56b361ba2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1184e3-4cd3-4bf9-a52e-1047d7e3c682", "name": "network-vif-deleted", "tag": "66782b7e-7ca9-4644-8501-a1a346eb483b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:17.587407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-db7cc773-dbca-4f4d-b7fc-6f2e173db7ba req-d116aa52-abe0-482a-a713-ef56b361ba2b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.589057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-db7cc773-dbca-4f4d-b7fc-6f2e173db7ba req-d116aa52-abe0-482a-a713-ef56b361ba2b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.592407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-db7cc773-dbca-4f4d-b7fc-6f2e173db7ba req-d116aa52-abe0-482a-a713-ef56b361ba2b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.650073 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-db7cc773-dbca-4f4d-b7fc-6f2e173db7ba req-d116aa52-abe0-482a-a713-ef56b361ba2b service nova] Creating event network-vif-deleted:66782b7e-7ca9-4644-8501-a1a346eb483b for instance de1184e3-4cd3-4bf9-a52e-1047d7e3c682 on n-h1-850499-14 Oct 04 18:17:17.676222 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-db7cc773-dbca-4f4d-b7fc-6f2e173db7ba req-d116aa52-abe0-482a-a713-ef56b361ba2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159997 Oct 04 18:17:17.680548 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1964/3892] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:17.701344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9be5dde2-ee78-4571-a822-2f6e377d1133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.705609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9be5dde2-ee78-4571-a822-2f6e377d1133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.741388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be5dde2-ee78-4571-a822-2f6e377d1133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.747375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be5dde2-ee78-4571-a822-2f6e377d1133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.749082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be5dde2-ee78-4571-a822-2f6e377d1133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.753875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be5dde2-ee78-4571-a822-2f6e377d1133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.754688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be5dde2-ee78-4571-a822-2f6e377d1133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.758114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be5dde2-ee78-4571-a822-2f6e377d1133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.769279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bafe85ed-1ea1-4b1d-a872-3f76feb3a45d tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.770923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bafe85ed-1ea1-4b1d-a872-3f76feb3a45d tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.782164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bafe85ed-1ea1-4b1d-a872-3f76feb3a45d tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.785263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bafe85ed-1ea1-4b1d-a872-3f76feb3a45d tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.787730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bafe85ed-1ea1-4b1d-a872-3f76feb3a45d tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.789387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bafe85ed-1ea1-4b1d-a872-3f76feb3a45d tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.790104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bafe85ed-1ea1-4b1d-a872-3f76feb3a45d tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.791333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bafe85ed-1ea1-4b1d-a872-3f76feb3a45d tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.850053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bafe85ed-1ea1-4b1d-a872-3f76feb3a45d tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:18.046150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9be5dde2-ee78-4571-a822-2f6e377d1133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.053965 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bafe85ed-1ea1-4b1d-a872-3f76feb3a45d tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 204 len: 0 microversion: 2.32 time: 0.704124 Oct 04 18:17:18.055713 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1929/3893] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:17:17 2022] DELETE /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:17:18.056819 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9be5dde2-ee78-4571-a822-2f6e377d1133 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1533 microversion: 2.1 time: 0.374500 Oct 04 18:17:18.057389 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1965/3894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:17 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1533 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:18.065292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:18.066259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:18.069181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:18.070859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:18.073995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.074647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.075196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.075969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.076436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.077245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.082490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.083429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.084147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.085100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.085784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.086853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.130116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.131165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.132618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.134202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lazy-loading 'fault' on Instance uuid de1184e3-4cd3-4bf9-a52e-1047d7e3c682 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:18.278881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.291458 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-946a496f-a135-42b2-81f7-456113b98574 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1360 microversion: 2.1 time: 0.229820 Oct 04 18:17:18.292708 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1930/3895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:18 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1360 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:18.311964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ce19eef-a6ca-4d50-8efe-569a96df56b1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:18.312980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ce19eef-a6ca-4d50-8efe-569a96df56b1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:18.320931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce19eef-a6ca-4d50-8efe-569a96df56b1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.321746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce19eef-a6ca-4d50-8efe-569a96df56b1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.322674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce19eef-a6ca-4d50-8efe-569a96df56b1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.323827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce19eef-a6ca-4d50-8efe-569a96df56b1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.324927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce19eef-a6ca-4d50-8efe-569a96df56b1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.325739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce19eef-a6ca-4d50-8efe-569a96df56b1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.355990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:18.458826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.473265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.474738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.476084 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-957b79f8-51a7-4752-97c8-e818ab18f95a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2954 microversion: 2.32 time: 0.415769 Oct 04 18:17:18.487337 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1966/3896] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:18 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2954 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:18.492147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fbe210cd-75d8-4270-b6d7-8a9b9d98cf52 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:18.492147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fbe210cd-75d8-4270-b6d7-8a9b9d98cf52 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:18.506126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbe210cd-75d8-4270-b6d7-8a9b9d98cf52 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.511230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbe210cd-75d8-4270-b6d7-8a9b9d98cf52 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.511952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbe210cd-75d8-4270-b6d7-8a9b9d98cf52 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.513543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbe210cd-75d8-4270-b6d7-8a9b9d98cf52 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.514206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbe210cd-75d8-4270-b6d7-8a9b9d98cf52 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.515386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbe210cd-75d8-4270-b6d7-8a9b9d98cf52 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.644153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1ce19eef-a6ca-4d50-8efe-569a96df56b1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.652958 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ce19eef-a6ca-4d50-8efe-569a96df56b1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1362 microversion: 2.1 time: 0.358492 Oct 04 18:17:18.653551 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1931/3897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:18 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:18.673852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-26000b36-c005-4587-aca8-86cceabd4062 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:18.674988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-26000b36-c005-4587-aca8-86cceabd4062 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:18.681526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26000b36-c005-4587-aca8-86cceabd4062 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.682361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26000b36-c005-4587-aca8-86cceabd4062 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.683170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26000b36-c005-4587-aca8-86cceabd4062 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.684108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26000b36-c005-4587-aca8-86cceabd4062 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.684922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26000b36-c005-4587-aca8-86cceabd4062 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.686445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26000b36-c005-4587-aca8-86cceabd4062 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.822044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fbe210cd-75d8-4270-b6d7-8a9b9d98cf52 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.842048 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fbe210cd-75d8-4270-b6d7-8a9b9d98cf52 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1542 microversion: 2.1 time: 0.355401 Oct 04 18:17:18.857299 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1967/3898] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:18 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1542 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:19.126476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-26000b36-c005-4587-aca8-86cceabd4062 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:19.136734 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-26000b36-c005-4587-aca8-86cceabd4062 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1318 microversion: 2.1 time: 0.466468 Oct 04 18:17:19.137556 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1932/3899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:18 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:19.151260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-1090c3d3-d734-44ff-b538-a96a71fdf7c9 req-5c8a3a29-b8f2-4b76-b942-48889a67c114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671406ce-ae77-441a-9e07-3d054c34c4f5", "name": "network-vif-deleted", "tag": "f2bffad7-9c35-4420-bb47-a7b54db456ad"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:19.167735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1090c3d3-d734-44ff-b538-a96a71fdf7c9 req-5c8a3a29-b8f2-4b76-b942-48889a67c114 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.168588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1090c3d3-d734-44ff-b538-a96a71fdf7c9 req-5c8a3a29-b8f2-4b76-b942-48889a67c114 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.169391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1090c3d3-d734-44ff-b538-a96a71fdf7c9 req-5c8a3a29-b8f2-4b76-b942-48889a67c114 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.186104 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1090c3d3-d734-44ff-b538-a96a71fdf7c9 req-5c8a3a29-b8f2-4b76-b942-48889a67c114 service nova] Creating event network-vif-deleted:f2bffad7-9c35-4420-bb47-a7b54db456ad for instance 671406ce-ae77-441a-9e07-3d054c34c4f5 on n-h2-850499-14 Oct 04 18:17:19.192825 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-1090c3d3-d734-44ff-b538-a96a71fdf7c9 req-5c8a3a29-b8f2-4b76-b942-48889a67c114 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053901 Oct 04 18:17:19.194295 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1933/3900] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:19.202823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b191a6dd-7c28-4833-aa41-bdf302af995b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.203779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b191a6dd-7c28-4833-aa41-bdf302af995b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.213470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b191a6dd-7c28-4833-aa41-bdf302af995b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.214532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b191a6dd-7c28-4833-aa41-bdf302af995b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.215460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b191a6dd-7c28-4833-aa41-bdf302af995b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.216690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b191a6dd-7c28-4833-aa41-bdf302af995b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.217422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b191a6dd-7c28-4833-aa41-bdf302af995b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.218271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b191a6dd-7c28-4833-aa41-bdf302af995b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.335536 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b191a6dd-7c28-4833-aa41-bdf302af995b tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139526 Oct 04 18:17:19.336140 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1934/3901] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:19.349664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-221b04dd-1fd7-404d-9d8b-387ccbc085aa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.350191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-221b04dd-1fd7-404d-9d8b-387ccbc085aa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.358020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221b04dd-1fd7-404d-9d8b-387ccbc085aa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.359282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221b04dd-1fd7-404d-9d8b-387ccbc085aa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.359904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221b04dd-1fd7-404d-9d8b-387ccbc085aa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.360714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221b04dd-1fd7-404d-9d8b-387ccbc085aa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.361270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221b04dd-1fd7-404d-9d8b-387ccbc085aa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.361933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-221b04dd-1fd7-404d-9d8b-387ccbc085aa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.383283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b650494a-a14d-4194-9780-20785469ddbf tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Action: 'create', calling method: .version_select at 0x7fd4d12a4f70>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATS77BeNjfYmMmLhBw41LK9vbTKg1wgTB0Czgd5xIHnBeMryQDSg8M1InGQSuhRxZOQ8xlIlla48NrKFnC8fqvofJt3Rg7vx4W5hfb1Hfyiq9BspalvS15HidoSoiXeJQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b650494a-a14d-4194-9780-20785469ddbf tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Request method failure captured: Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 257 Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHiu7vILzp8YYAYt3cNiJayT-WtDJngcTgXYP1D5Me3zhmEcELxwNEaJ9NiV2gX5S7NmCBjhSL3I1VCMunrDLumdhMoulzjn0x9vDGPWmxRofhMY2eSxMJf_kpV_HVPlvw2sUuSaIisRSFFf4EzvgKcZYjNblJ4I_QPM2l1WNPAB_KI Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}] Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATS77BeNjfYmMmLhBw41LK9vbTKg1wgTB0Czgd5xIHnBeMryQDSg8M1InGQSuhRxZOQ8xlIlla48NrKFnC8fqvofJt3Rg7vx4W5hfb1Hfyiq9BspalvS15HidoSoiXeJQ=="}} Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATS77BeNjfYmMmLhBw41LK9vbTKg1wgTB0Czgd5xIHnBeMryQDSg8M1InGQSuhRxZOQ8xlIlla48NrKFnC8fqvofJt3Rg7vx4W5hfb1Hfyiq9BspalvS15HidoSoiXeJQ=='}}} Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 18:17:19.388346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b650494a-a14d-4194-9780-20785469ddbf tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:19.396107 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b650494a-a14d-4194-9780-20785469ddbf tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.525919 Oct 04 18:17:19.400683 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1968/3902] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:18 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 541 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:17:19.404654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e459ae75-b4a9-414b-8bbe-8fc91197bb49 req-41230735-11d1-497d-90d2-9ec28f2e272a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b2bfb3-d80f-4ed6-95f0-5face8d7581e", "name": "network-vif-plugged", "status": "completed", "tag": "8ca68b0b-c2aa-4f1a-a1e6-ab53e4ea8d05"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:19.416722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e459ae75-b4a9-414b-8bbe-8fc91197bb49 req-41230735-11d1-497d-90d2-9ec28f2e272a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.417506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e459ae75-b4a9-414b-8bbe-8fc91197bb49 req-41230735-11d1-497d-90d2-9ec28f2e272a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.418203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e459ae75-b4a9-414b-8bbe-8fc91197bb49 req-41230735-11d1-497d-90d2-9ec28f2e272a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.448756 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e459ae75-b4a9-414b-8bbe-8fc91197bb49 req-41230735-11d1-497d-90d2-9ec28f2e272a service nova] Creating event network-vif-plugged:8ca68b0b-c2aa-4f1a-a1e6-ab53e4ea8d05 for instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e on n-h1-850499-14 Oct 04 18:17:19.454860 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e459ae75-b4a9-414b-8bbe-8fc91197bb49 req-41230735-11d1-497d-90d2-9ec28f2e272a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053733 Oct 04 18:17:19.455929 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1969/3903] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:19.464571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.465443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.473155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.474014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.475174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.475905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.476368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.476802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.532634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.533472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.534136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.534876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lazy-loading 'fault' on Instance uuid de1184e3-4cd3-4bf9-a52e-1047d7e3c682 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:19.637229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:19.650294 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d910c52a-317e-49d1-8a82-9f5f23f55e6b tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1360 microversion: 2.1 time: 0.192573 Oct 04 18:17:19.673592 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1970/3904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1360 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:19.685894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b463204-451f-4dcf-89c5-9fe3b86ecdfd tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Action: 'create', calling method: .version_select at 0x7fd4d11f8af0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-733684820", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:19.724370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-6b463204-451f-4dcf-89c5-9fe3b86ecdfd tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Getting quotas for project 6892c9bd854d45f395cb79c5b7b1ceac. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:19.735521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-6b463204-451f-4dcf-89c5-9fe3b86ecdfd tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Getting quotas for user 4cc61ebb10d84127ad41e2130c18559d and project 6892c9bd854d45f395cb79c5b7b1ceac. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:19.740905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:19.769607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-221b04dd-1fd7-404d-9d8b-387ccbc085aa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:19.782530 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-221b04dd-1fd7-404d-9d8b-387ccbc085aa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 0.433640 Oct 04 18:17:19.784665 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1935/3905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:19.790833 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-6b463204-451f-4dcf-89c5-9fe3b86ecdfd tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:19.792325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.793034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.800690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.801800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.802313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.803476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.804253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.804574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b463204-451f-4dcf-89c5-9fe3b86ecdfd tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Request method failure captured: Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 2166 Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHiu7vILzp8YYAYt3cNiJayT-WtDJngcTgXYP1D5Me3zhmEcELxwNEaJ9NiV2gX5S7NmCBjhSL3I1VCMunrDLumdhMoulzjn0x9vDGPWmxRofhMY2eSxMJf_kpV_HVPlvw2sUuSaIisRSFFf4EzvgKcZYjNblJ4I_QPM2l1WNPAB_KI Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}] Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-733684820", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:17:19.808287 n-d-850499-14 devstack@n-api.service[122332]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-733684820', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:19.810973 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b463204-451f-4dcf-89c5-9fe3b86ecdfd tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:19.817834 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6b463204-451f-4dcf-89c5-9fe3b86ecdfd tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.135077 Oct 04 18:17:19.823284 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1971/3906] 10.222.0.18 () {60 vars in 1160 bytes} [Tue Oct 4 18:17:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:17:19.826007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9f80959-e6d8-4a2d-a9ee-5c627ac16155 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.830193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9f80959-e6d8-4a2d-a9ee-5c627ac16155 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.851759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9f80959-e6d8-4a2d-a9ee-5c627ac16155 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.852200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9f80959-e6d8-4a2d-a9ee-5c627ac16155 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.852653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9f80959-e6d8-4a2d-a9ee-5c627ac16155 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.853380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9f80959-e6d8-4a2d-a9ee-5c627ac16155 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.853844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9f80959-e6d8-4a2d-a9ee-5c627ac16155 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.854274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9f80959-e6d8-4a2d-a9ee-5c627ac16155 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.347636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9f80959-e6d8-4a2d-a9ee-5c627ac16155 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.359816 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9f80959-e6d8-4a2d-a9ee-5c627ac16155 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1362 microversion: 2.1 time: 0.539579 Oct 04 18:17:20.360400 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1972/3907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:20.368124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-619f9871-9243-4c2e-bd0f-e11ac63d69bc tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Action: 'create', calling method: .version_select at 0x7fd4d12454c0>, body: {"keypair": {"name": "tempest-keypair-406624769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5xqQz5zEs/FcKR8/mrZ5BhPxDkuqfdpWz2YpG+FquBwtN/hIQQjxLDxxaRHiRGjOfuyNiz/7OjGvuuPrI7CGJNWpmDrdgrzRkaW/KM3+h01JgbTMRSHtFrM1lhSCfZGg=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:20.415270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.422438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-619f9871-9243-4c2e-bd0f-e11ac63d69bc tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Getting quotas for project 6892c9bd854d45f395cb79c5b7b1ceac. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:20.429021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-619f9871-9243-4c2e-bd0f-e11ac63d69bc tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Getting quotas for user 4cc61ebb10d84127ad41e2130c18559d and project 6892c9bd854d45f395cb79c5b7b1ceac. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:20.444851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.446646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.450009 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef3bd9dc-d53f-4858-86a9-be434b2990ba tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2954 microversion: 2.32 time: 0.664278 Oct 04 18:17:20.465623 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-619f9871-9243-4c2e-bd0f-e11ac63d69bc tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099615 Oct 04 18:17:20.467351 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1936/3908] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2954 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:20.471127 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1973/3909] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:20.480496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d611cc6-c6f6-4ae6-8363-6812b59e1291 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:20.481473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4d611cc6-c6f6-4ae6-8363-6812b59e1291 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:20.484411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9882ce9d-fa6a-475a-a477-5ea4c4c13db5 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Action: 'create', calling method: .version_select at 0x7fd4d11b7a60>, body: {"keypair": {"name": "tempest-keypair-406624769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFixM3ow7UoFmfyPdnv/CyjqzXjyRnTvnvj/0dW3cPT74KtpvBn4dDK9VQt6Lt/arXN/ICZbUR/ANZiSQwDZmtSwGz0SrpqLRj8wmMogbQNU0mj/5eV65KMdwI4cPjkQSw=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:20.492093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d611cc6-c6f6-4ae6-8363-6812b59e1291 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.492964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d611cc6-c6f6-4ae6-8363-6812b59e1291 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.493652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d611cc6-c6f6-4ae6-8363-6812b59e1291 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.495689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d611cc6-c6f6-4ae6-8363-6812b59e1291 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.496759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d611cc6-c6f6-4ae6-8363-6812b59e1291 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.497294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d611cc6-c6f6-4ae6-8363-6812b59e1291 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.507563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-9882ce9d-fa6a-475a-a477-5ea4c4c13db5 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Getting quotas for project 6892c9bd854d45f395cb79c5b7b1ceac. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:20.519027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-9882ce9d-fa6a-475a-a477-5ea4c4c13db5 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Getting quotas for user 4cc61ebb10d84127ad41e2130c18559d and project 6892c9bd854d45f395cb79c5b7b1ceac. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:20.559652 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-9882ce9d-fa6a-475a-a477-5ea4c4c13db5 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] HTTP exception thrown: Key pair 'tempest-keypair-406624769' already exists. Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9882ce9d-fa6a-475a-a477-5ea4c4c13db5 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Request method failure captured: Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 272 Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHiu7vILzp8YYAYt3cNiJayT-WtDJngcTgXYP1D5Me3zhmEcELxwNEaJ9NiV2gX5S7NmCBjhSL3I1VCMunrDLumdhMoulzjn0x9vDGPWmxRofhMY2eSxMJf_kpV_HVPlvw2sUuSaIisRSFFf4EzvgKcZYjNblJ4I_QPM2l1WNPAB_KI Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}] Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: {"keypair": {"name": "tempest-keypair-406624769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFixM3ow7UoFmfyPdnv/CyjqzXjyRnTvnvj/0dW3cPT74KtpvBn4dDK9VQt6Lt/arXN/ICZbUR/ANZiSQwDZmtSwGz0SrpqLRj8wmMogbQNU0mj/5eV65KMdwI4cPjkQSw=="}} Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: exception: Key pair 'tempest-keypair-406624769' already exists. Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-406624769', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFixM3ow7UoFmfyPdnv/CyjqzXjyRnTvnvj/0dW3cPT74KtpvBn4dDK9VQt6Lt/arXN/ICZbUR/ANZiSQwDZmtSwGz0SrpqLRj8wmMogbQNU0mj/5eV65KMdwI4cPjkQSw=='}}} Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '4cc61ebb10d84127ad41e2130c18559d-tempest-keypair-406624769' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 18:17:20.564028 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:17:20.569308 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '4cc61ebb10d84127ad41e2130c18559d-tempest-keypair-406624769' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 17, 20, 547012), 'updated_at': None, 'name': 'tempest-keypair-406624769', 'user_id': '4cc61ebb10d84127ad41e2130c18559d', 'fingerprint': 'b6:d3:56:47:17:b9:40:cd:b4:ea:2c:0d:62:c3:7f:9d', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFixM3ow7UoFmfyPdnv/CyjqzXjyRnTvnvj/0dW3cPT74KtpvBn4dDK9VQt6Lt/arXN/ICZbUR/ANZiSQwDZmtSwGz0SrpqLRj8wmMogbQNU0mj/5eV65KMdwI4cPjkQSw==', 'type': 'ssh'}] Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._create() Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-406624769' already exists. Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 18:17:20.580981 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-406624769' already exists. Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-406624769' already exists. Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.589537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9882ce9d-fa6a-475a-a477-5ea4c4c13db5 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Returning 409 to user: Key pair 'tempest-keypair-406624769' already exists. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:20.591837 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9882ce9d-fa6a-475a-a477-5ea4c4c13db5 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.104438 Oct 04 18:17:20.591837 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1974/3910] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:20 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:20.624495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9c9557c5-2fc9-4dbd-9ca4-ab2a8b1e9f14 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Calling method '.version_select at 0x7fd4d11b73a0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:20.676116 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9c9557c5-2fc9-4dbd-9ca4-ab2a8b1e9f14 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-406624769" status: 202 len: 0 microversion: 2.1 time: 0.068460 Oct 04 18:17:20.677918 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1975/3911] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 4 18:17:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-406624769 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:20.691869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:20.692819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:20.708012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.709674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.711579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.712341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.715313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.717336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.808610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.809255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.810736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.811624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lazy-loading 'fault' on Instance uuid de1184e3-4cd3-4bf9-a52e-1047d7e3c682 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:20.886072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f568ffc40c84b99b5439533aeaec9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109bbd6392bb4b0faa917253bd5338be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.901195 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f2f5aae-826e-4574-8c78-b4495b48e8d3 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 200 len: 1360 microversion: 2.1 time: 0.221273 Oct 04 18:17:20.903033 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1976/3912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:20 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 1360 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:20.920240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-92d312cc-8be2-449e-a525-1d0e197ae8f7 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Action: 'create', calling method: .version_select at 0x7fd4d1272ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhVGOneHjgD8Df6gVKj5NwIqW7gQl+fouYBGiAEjx4+QHq6RVTifHH60QYxo70VPR2MSSChhTOVCoQd7xGqM4uoI9ujdy0IPOP/gT9odzFZoj8VfpB3OBsLMx4wBWCBTw=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-92d312cc-8be2-449e-a525-1d0e197ae8f7 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Request method failure captured: Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 247 Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHiu7vILzp8YYAYt3cNiJayT-WtDJngcTgXYP1D5Me3zhmEcELxwNEaJ9NiV2gX5S7NmCBjhSL3I1VCMunrDLumdhMoulzjn0x9vDGPWmxRofhMY2eSxMJf_kpV_HVPlvw2sUuSaIisRSFFf4EzvgKcZYjNblJ4I_QPM2l1WNPAB_KI Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}] Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhVGOneHjgD8Df6gVKj5NwIqW7gQl+fouYBGiAEjx4+QHq6RVTifHH60QYxo70VPR2MSSChhTOVCoQd7xGqM4uoI9ujdy0IPOP/gT9odzFZoj8VfpB3OBsLMx4wBWCBTw=="}} Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhVGOneHjgD8Df6gVKj5NwIqW7gQl+fouYBGiAEjx4+QHq6RVTifHH60QYxo70VPR2MSSChhTOVCoQd7xGqM4uoI9ujdy0IPOP/gT9odzFZoj8VfpB3OBsLMx4wBWCBTw=='}}} Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi '' Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:17:20.928286 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:17:20.932801 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:20.936740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-92d312cc-8be2-449e-a525-1d0e197ae8f7 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:20.938033 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-92d312cc-8be2-449e-a525-1d0e197ae8f7 tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.032934 Oct 04 18:17:20.944084 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1977/3913] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:20 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:17:20.950333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-faf835cf-e9d9-4dc6-9467-e289dd915ab1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:20.951320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-faf835cf-e9d9-4dc6-9467-e289dd915ab1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:20.961696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-faf835cf-e9d9-4dc6-9467-e289dd915ab1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.962460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-faf835cf-e9d9-4dc6-9467-e289dd915ab1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.963128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-faf835cf-e9d9-4dc6-9467-e289dd915ab1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.964052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-faf835cf-e9d9-4dc6-9467-e289dd915ab1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.964703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-faf835cf-e9d9-4dc6-9467-e289dd915ab1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.965327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-faf835cf-e9d9-4dc6-9467-e289dd915ab1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.101592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4d611cc6-c6f6-4ae6-8363-6812b59e1291 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:21.110538 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4d611cc6-c6f6-4ae6-8363-6812b59e1291 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1318 microversion: 2.1 time: 0.641414 Oct 04 18:17:21.116626 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1937/3914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:20 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:21.123256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7543d08c-6045-46b6-8d5d-5c238102f7af tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Action: 'create', calling method: .version_select at 0x7fd4d10b80d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-443182380", "public_key": " "}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:21.148284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:21.167101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7543d08c-6045-46b6-8d5d-5c238102f7af tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Getting quotas for project 6892c9bd854d45f395cb79c5b7b1ceac. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:21.173119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7543d08c-6045-46b6-8d5d-5c238102f7af tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Getting quotas for user 4cc61ebb10d84127ad41e2130c18559d and project 6892c9bd854d45f395cb79c5b7b1ceac. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:21.201689 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-7543d08c-6045-46b6-8d5d-5c238102f7af tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7543d08c-6045-46b6-8d5d-5c238102f7af tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Request method failure captured: Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 94 Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiu7vILzp8YYAYt3cNiJayT-WtDJngcTgXYP1D5Me3zhmEcELxwNEaJ9NiV2gX5S7NmCBjhSL3I1VCMunrDLumdhMoulzjn0x9vDGPWmxRofhMY2eSxMJf_kpV_HVPlvw2sUuSaIisRSFFf4EzvgKcZYjNblJ4I_QPM2l1WNPAB_KI Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}] Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-443182380", "public_key": " "}} Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-443182380', 'public_key': ' '}}} Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.204948 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:21.210640 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.216778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7543d08c-6045-46b6-8d5d-5c238102f7af tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:21.216778 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7543d08c-6045-46b6-8d5d-5c238102f7af tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.095126 Oct 04 18:17:21.217527 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1938/3915] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Oct 4 18:17:21 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:17:21.228263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d49856c-c1ac-4c9e-a62f-0c248253292f tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Action: 'create', calling method: .version_select at 0x7fd4d103c550>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMUOalOUmjJ12q79EFv58U4UxfEg6RMBVAZ9CLlO5HAX60V7F1uPuZXLNHOlyhjSCOQVdCV0PLHYq0CUphaotS1c2zgfIqduUj7mEkdK3vwPXaG863U8SARbgUulyV0Fw=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d49856c-c1ac-4c9e-a62f-0c248253292f tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Request method failure captured: Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 507 Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiu7vILzp8YYAYt3cNiJayT-WtDJngcTgXYP1D5Me3zhmEcELxwNEaJ9NiV2gX5S7NmCBjhSL3I1VCMunrDLumdhMoulzjn0x9vDGPWmxRofhMY2eSxMJf_kpV_HVPlvw2sUuSaIisRSFFf4EzvgKcZYjNblJ4I_QPM2l1WNPAB_KI Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}] Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMUOalOUmjJ12q79EFv58U4UxfEg6RMBVAZ9CLlO5HAX60V7F1uPuZXLNHOlyhjSCOQVdCV0PLHYq0CUphaotS1c2zgfIqduUj7mEkdK3vwPXaG863U8SARbgUulyV0Fw=="}} Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMUOalOUmjJ12q79EFv58U4UxfEg6RMBVAZ9CLlO5HAX60V7F1uPuZXLNHOlyhjSCOQVdCV0PLHYq0CUphaotS1c2zgfIqduUj7mEkdK3vwPXaG863U8SARbgUulyV0Fw=='}}} Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 18:17:21.236953 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:17:21.241142 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.244814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d49856c-c1ac-4c9e-a62f-0c248253292f tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:21.246350 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d49856c-c1ac-4c9e-a62f-0c248253292f tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.022432 Oct 04 18:17:21.247343 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1939/3916] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:21 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:17:21.260050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-145bd91f-34ff-4121-9e1d-fb913892aa5c tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Action: 'create', calling method: .version_select at 0x7fd4d109e700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1962023506", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:21.282539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-145bd91f-34ff-4121-9e1d-fb913892aa5c tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Getting quotas for project 6892c9bd854d45f395cb79c5b7b1ceac. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:21.289608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-145bd91f-34ff-4121-9e1d-fb913892aa5c tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Getting quotas for user 4cc61ebb10d84127ad41e2130c18559d and project 6892c9bd854d45f395cb79c5b7b1ceac. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:21.309569 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-145bd91f-34ff-4121-9e1d-fb913892aa5c tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-145bd91f-34ff-4121-9e1d-fb913892aa5c tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Request method failure captured: Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 118 Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiu7vILzp8YYAYt3cNiJayT-WtDJngcTgXYP1D5Me3zhmEcELxwNEaJ9NiV2gX5S7NmCBjhSL3I1VCMunrDLumdhMoulzjn0x9vDGPWmxRofhMY2eSxMJf_kpV_HVPlvw2sUuSaIisRSFFf4EzvgKcZYjNblJ4I_QPM2l1WNPAB_KI Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}] Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1962023506", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1962023506', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:17:21.313285 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-145bd91f-34ff-4121-9e1d-fb913892aa5c tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:21.318614 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-145bd91f-34ff-4121-9e1d-fb913892aa5c tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.064794 Oct 04 18:17:21.325986 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1940/3917] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:21 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:17:21.332941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0b623095-e5e5-44a6-9ca7-7c570766a16f tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Calling method '.version_select at 0x7fd4d1222310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.352837 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-0b623095-e5e5-44a6-9ca7-7c570766a16f tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1904523166 not found for user 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0b623095-e5e5-44a6-9ca7-7c570766a16f tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Request method failure captured: Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1904523166 HTTP/1.1 Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiu7vILzp8YYAYt3cNiJayT-WtDJngcTgXYP1D5Me3zhmEcELxwNEaJ9NiV2gX5S7NmCBjhSL3I1VCMunrDLumdhMoulzjn0x9vDGPWmxRofhMY2eSxMJf_kpV_HVPlvw2sUuSaIisRSFFf4EzvgKcZYjNblJ4I_QPM2l1WNPAB_KI Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6892c9bd854d45f395cb79c5b7b1ceac"}]}] Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6892c9bd854d45f395cb79c5b7b1ceac Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-175163172 Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-KeyPairsNegativeTestJSON-175163172-project Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: exception: Keypair tempest-keypair-non-existent-1904523166 not found for user 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'tempest-keypair-non-existent-1904523166'} Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1904523166 not found for user 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.356140 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1904523166 not found for user 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1904523166 not found for user 4cc61ebb10d84127ad41e2130c18559d Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0b623095-e5e5-44a6-9ca7-7c570766a16f tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1904523166 not found for user 4cc61ebb10d84127ad41e2130c18559d {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:21.366072 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0b623095-e5e5-44a6-9ca7-7c570766a16f tempest-KeyPairsNegativeTestJSON-175163172 tempest-KeyPairsNegativeTestJSON-175163172-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1904523166" status: 404 len: 145 microversion: 2.1 time: 0.032614 Oct 04 18:17:21.372531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-faf835cf-e9d9-4dc6-9467-e289dd915ab1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:21.373687 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1941/3918] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 4 18:17:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1904523166 => generated 145 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:21.376868 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-faf835cf-e9d9-4dc6-9467-e289dd915ab1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 0.431331 Oct 04 18:17:21.379940 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1978/3919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:20 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:21.394916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2474a696-9bd2-4531-bc4a-45990a95d2be tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.403805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2474a696-9bd2-4531-bc4a-45990a95d2be tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.420585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2474a696-9bd2-4531-bc4a-45990a95d2be tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.421423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2474a696-9bd2-4531-bc4a-45990a95d2be tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.421873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2474a696-9bd2-4531-bc4a-45990a95d2be tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.423363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2474a696-9bd2-4531-bc4a-45990a95d2be tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.423884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2474a696-9bd2-4531-bc4a-45990a95d2be tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.424386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2474a696-9bd2-4531-bc4a-45990a95d2be tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.486739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.487694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.502218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.505651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.507326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.513304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.521481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.522310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.809799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2474a696-9bd2-4531-bc4a-45990a95d2be tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:21.821981 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2474a696-9bd2-4531-bc4a-45990a95d2be tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1362 microversion: 2.1 time: 0.441975 Oct 04 18:17:21.827263 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1942/3920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:21 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:21.832877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-57fde937-0963-4ec3-8e4d-9e2edda7c4d6 req-2f2e5f1b-5204-4e88-8c05-c61f56c5b6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afef2588-b2e9-4b9e-943c-44469215dd64", "name": "network-vif-plugged", "status": "completed", "tag": "e1f04890-a2cf-4366-ad64-14ecf15d04cf"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:21.870006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-57fde937-0963-4ec3-8e4d-9e2edda7c4d6 req-2f2e5f1b-5204-4e88-8c05-c61f56c5b6d6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.870814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-57fde937-0963-4ec3-8e4d-9e2edda7c4d6 req-2f2e5f1b-5204-4e88-8c05-c61f56c5b6d6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.871469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-57fde937-0963-4ec3-8e4d-9e2edda7c4d6 req-2f2e5f1b-5204-4e88-8c05-c61f56c5b6d6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.900188 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-57fde937-0963-4ec3-8e4d-9e2edda7c4d6 req-2f2e5f1b-5204-4e88-8c05-c61f56c5b6d6 service nova] Creating event network-vif-plugged:e1f04890-a2cf-4366-ad64-14ecf15d04cf for instance afef2588-b2e9-4b9e-943c-44469215dd64 on n-h2-850499-14 Oct 04 18:17:21.912357 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-57fde937-0963-4ec3-8e4d-9e2edda7c4d6 req-2f2e5f1b-5204-4e88-8c05-c61f56c5b6d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081831 Oct 04 18:17:21.915242 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1943/3921] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:21.931036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.931831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] [instance: de1184e3-4cd3-4bf9-a52e-1047d7e3c682] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.938419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:21.947441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.948256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.953516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.954669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.955395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.956043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.987139 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] HTTP exception thrown: Instance de1184e3-4cd3-4bf9-a52e-1047d7e3c682 could not be found. Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Request method failure captured: Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 HTTP/1.1 Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHhdhpY_YmBQuqkkF3rbTYz_BFy7GjSQMoh0mpwhvBa0PtmtXQ-GbmLWUd6fa7XRPK1Q41K-U7YtFEQWXxnfRuDgA0PPRDGVu_uxUOBIvH9JxUmpyrERc6_P8Q1kHqJo-4xnCvIAdx_ozeHslRJPLTjmOLaNZONZ-ygDJ8Pq1uxlAV8 Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 109bbd6392bb4b0faa917253bd5338be Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-1166204787 Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_109bbd6392bb4b0faa917253bd5338be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/109bbd6392bb4b0faa917253bd5338be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/109bbd6392bb4b0faa917253bd5338be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/109bbd6392bb4b0faa917253bd5338be"}]}] Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-1166204787 Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 109bbd6392bb4b0faa917253bd5338be Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-1166204787 Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-1166204787-project Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 4f568ffc40c84b99b5439533aeaec9e3 Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-1166204787-project Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance de1184e3-4cd3-4bf9-a52e-1047d7e3c682 could not be found. Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'de1184e3-4cd3-4bf9-a52e-1047d7e3c682'} Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de1184e3-4cd3-4bf9-a52e-1047d7e3c682 could not be found. Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de1184e3-4cd3-4bf9-a52e-1047d7e3c682 could not be found. Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:21.996541 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:22.003429 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:22.003429 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:22.003429 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:22.003429 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:22.003429 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:22.003429 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de1184e3-4cd3-4bf9-a52e-1047d7e3c682 could not be found. Oct 04 18:17:22.003429 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:22.003429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Returning 404 to user: Instance de1184e3-4cd3-4bf9-a52e-1047d7e3c682 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:22.004024 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-453cb250-a1f9-4c23-805c-29b81e0e8d05 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682" status: 404 len: 111 microversion: 2.1 time: 0.077994 Oct 04 18:17:22.004634 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1944/3922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:21 2022] GET /compute/v2.1/servers/de1184e3-4cd3-4bf9-a52e-1047d7e3c682 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:17:22.017604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-efc49ed4-e525-4a9c-8cbc-739fb29c7349 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] Calling method '.version_select at 0x7fd4d10b8a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:22.053438 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-efc49ed4-e525-4a9c-8cbc-739fb29c7349 tempest-ServersTestJSON-1166204787 tempest-ServersTestJSON-1166204787-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171675951" status: 202 len: 0 microversion: 2.1 time: 0.044529 Oct 04 18:17:22.054395 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1945/3923] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:17:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171675951 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:17:22.142410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-64dd1479-140e-42e0-9351-b1ae543b02b0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:22.143424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-64dd1479-140e-42e0-9351-b1ae543b02b0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:22.154045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64dd1479-140e-42e0-9351-b1ae543b02b0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.156626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64dd1479-140e-42e0-9351-b1ae543b02b0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.157372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64dd1479-140e-42e0-9351-b1ae543b02b0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.159171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64dd1479-140e-42e0-9351-b1ae543b02b0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.160507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64dd1479-140e-42e0-9351-b1ae543b02b0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.166271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64dd1479-140e-42e0-9351-b1ae543b02b0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.912235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:22.931131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:22.933961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:22.938141 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-47a9b9b5-57e2-4f56-9d70-5445e5aa5587 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2954 microversion: 2.32 time: 1.455102 Oct 04 18:17:22.939390 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1979/3924] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:21 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2954 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:22.945796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a58ece0b-cab4-4772-8068-285de38df3bd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:22.946716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a58ece0b-cab4-4772-8068-285de38df3bd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:22.954184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a58ece0b-cab4-4772-8068-285de38df3bd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.955147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a58ece0b-cab4-4772-8068-285de38df3bd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.955845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a58ece0b-cab4-4772-8068-285de38df3bd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.956813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a58ece0b-cab4-4772-8068-285de38df3bd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.957500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a58ece0b-cab4-4772-8068-285de38df3bd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.958395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a58ece0b-cab4-4772-8068-285de38df3bd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.491649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a58ece0b-cab4-4772-8068-285de38df3bd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:23.504497 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a58ece0b-cab4-4772-8068-285de38df3bd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 0.560143 Oct 04 18:17:23.523117 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1980/3925] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:22 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:23.533338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-185b76a4-170d-4e46-9121-648949b662a0 req-12cc6e37-ad6d-4811-aa26-0b1bb3762ecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "224ec17d-fb7b-4acb-9c83-e9dcd83fd011", "tag": "25175d2e-4025-4717-9cdc-cb5d0bf8eb50"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:23.572352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-185b76a4-170d-4e46-9121-648949b662a0 req-12cc6e37-ad6d-4811-aa26-0b1bb3762ecd service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.572773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-185b76a4-170d-4e46-9121-648949b662a0 req-12cc6e37-ad6d-4811-aa26-0b1bb3762ecd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.573213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-185b76a4-170d-4e46-9121-648949b662a0 req-12cc6e37-ad6d-4811-aa26-0b1bb3762ecd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.586308 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-185b76a4-170d-4e46-9121-648949b662a0 req-12cc6e37-ad6d-4811-aa26-0b1bb3762ecd service nova] Creating event network-changed:25175d2e-4025-4717-9cdc-cb5d0bf8eb50 for instance 224ec17d-fb7b-4acb-9c83-e9dcd83fd011 on n-h1-850499-14 Oct 04 18:17:23.591944 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-185b76a4-170d-4e46-9121-648949b662a0 req-12cc6e37-ad6d-4811-aa26-0b1bb3762ecd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067189 Oct 04 18:17:23.592608 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1981/3926] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:23.598600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e67416ff-2217-4c5a-8058-53c756eee669 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:23.599333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e67416ff-2217-4c5a-8058-53c756eee669 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:23.608667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e67416ff-2217-4c5a-8058-53c756eee669 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.609217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e67416ff-2217-4c5a-8058-53c756eee669 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.609724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e67416ff-2217-4c5a-8058-53c756eee669 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.610508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e67416ff-2217-4c5a-8058-53c756eee669 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.610941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e67416ff-2217-4c5a-8058-53c756eee669 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.611390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e67416ff-2217-4c5a-8058-53c756eee669 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.792934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-64dd1479-140e-42e0-9351-b1ae543b02b0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:23.806350 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-64dd1479-140e-42e0-9351-b1ae543b02b0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1318 microversion: 2.1 time: 1.668465 Oct 04 18:17:23.811466 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1946/3927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:22 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1318 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:23.836209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-9bdfede9-9cdd-4c90-8308-5ba9ed4e42e6 req-03c686d4-731d-4d81-9016-7cc7c894e6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a988be-0960-4297-9ca3-24fc491f115b", "tag": "a021fddf-59d8-48f5-9b97-c86fdab8c417"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:23.870655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9bdfede9-9cdd-4c90-8308-5ba9ed4e42e6 req-03c686d4-731d-4d81-9016-7cc7c894e6a8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.871617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9bdfede9-9cdd-4c90-8308-5ba9ed4e42e6 req-03c686d4-731d-4d81-9016-7cc7c894e6a8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.872423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9bdfede9-9cdd-4c90-8308-5ba9ed4e42e6 req-03c686d4-731d-4d81-9016-7cc7c894e6a8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.902513 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9bdfede9-9cdd-4c90-8308-5ba9ed4e42e6 req-03c686d4-731d-4d81-9016-7cc7c894e6a8 service nova] Creating event network-changed:a021fddf-59d8-48f5-9b97-c86fdab8c417 for instance 34a988be-0960-4297-9ca3-24fc491f115b on n-h2-850499-14 Oct 04 18:17:23.914984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-9bdfede9-9cdd-4c90-8308-5ba9ed4e42e6 req-03c686d4-731d-4d81-9016-7cc7c894e6a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089967 Oct 04 18:17:23.916027 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1947/3928] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:23.953130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:23.976448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:23.977523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:23.987466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.989783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.991624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.994551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.998892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.001125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.272835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e67416ff-2217-4c5a-8058-53c756eee669 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.292381 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e67416ff-2217-4c5a-8058-53c756eee669 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1549 microversion: 2.1 time: 0.697846 Oct 04 18:17:24.301854 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1982/3929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:23 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1549 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:24.331435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef1e3304-1522-4e81-97b7-de0da03bb317 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:24.332387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ef1e3304-1522-4e81-97b7-de0da03bb317 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:24.353620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1e3304-1522-4e81-97b7-de0da03bb317 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.356701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1e3304-1522-4e81-97b7-de0da03bb317 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.359170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1e3304-1522-4e81-97b7-de0da03bb317 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.364322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1e3304-1522-4e81-97b7-de0da03bb317 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.367120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1e3304-1522-4e81-97b7-de0da03bb317 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.372233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1e3304-1522-4e81-97b7-de0da03bb317 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.670237 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ef1e3304-1522-4e81-97b7-de0da03bb317 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.347136 Oct 04 18:17:24.672470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1983/3930] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:17:24 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/os-interface => generated 285 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:24.687717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c86c910-2805-4ad8-a62d-43d29092b3a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:24.696183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c86c910-2805-4ad8-a62d-43d29092b3a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:24.720310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.733560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c86c910-2805-4ad8-a62d-43d29092b3a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.734587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.735486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c86c910-2805-4ad8-a62d-43d29092b3a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.736946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c86c910-2805-4ad8-a62d-43d29092b3a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.739299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c86c910-2805-4ad8-a62d-43d29092b3a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.741621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c86c910-2805-4ad8-a62d-43d29092b3a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.741872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.742454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c86c910-2805-4ad8-a62d-43d29092b3a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.746385 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e8106f6c-5d9a-46ad-b7e4-5740393655e2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2954 microversion: 2.32 time: 0.772063 Oct 04 18:17:24.748572 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1948/3931] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:23 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2954 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:24.837017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9490e41a-7739-44be-85fe-c68f216287bc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:24.837779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9490e41a-7739-44be-85fe-c68f216287bc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:24.846148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9490e41a-7739-44be-85fe-c68f216287bc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.849645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9490e41a-7739-44be-85fe-c68f216287bc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.850556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9490e41a-7739-44be-85fe-c68f216287bc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.853911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9490e41a-7739-44be-85fe-c68f216287bc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.854692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9490e41a-7739-44be-85fe-c68f216287bc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.856438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9490e41a-7739-44be-85fe-c68f216287bc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.330406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c86c910-2805-4ad8-a62d-43d29092b3a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:25.339593 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c86c910-2805-4ad8-a62d-43d29092b3a2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 0.665112 Oct 04 18:17:25.344746 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1984/3932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:24 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:25.611130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9490e41a-7739-44be-85fe-c68f216287bc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:25.627248 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9490e41a-7739-44be-85fe-c68f216287bc tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1318 microversion: 2.1 time: 0.793972 Oct 04 18:17:25.627996 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1949/3933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:24 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1318 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:25.791991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:25.792616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:25.805351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.805855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.806307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.809947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.817441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.820043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.877717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-445b0e1a-ec84-47ba-8c17-f6ee7fe00034 req-7bf1ed42-ca67-4cea-a293-c27f0b0e1518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-unplugged", "status": "completed", "tag": "e1a15415-f9e0-4b1e-84c8-c5eeef520105"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:25.904540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-445b0e1a-ec84-47ba-8c17-f6ee7fe00034 req-7bf1ed42-ca67-4cea-a293-c27f0b0e1518 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.911079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-445b0e1a-ec84-47ba-8c17-f6ee7fe00034 req-7bf1ed42-ca67-4cea-a293-c27f0b0e1518 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.911826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-445b0e1a-ec84-47ba-8c17-f6ee7fe00034 req-7bf1ed42-ca67-4cea-a293-c27f0b0e1518 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.944812 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-445b0e1a-ec84-47ba-8c17-f6ee7fe00034 req-7bf1ed42-ca67-4cea-a293-c27f0b0e1518 service nova] Creating event network-vif-unplugged:e1a15415-f9e0-4b1e-84c8-c5eeef520105 for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:17:25.957474 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-445b0e1a-ec84-47ba-8c17-f6ee7fe00034 req-7bf1ed42-ca67-4cea-a293-c27f0b0e1518 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084630 Oct 04 18:17:25.958511 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1950/3934] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:26.371181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4adf959-8b4d-44c6-8ef7-0dea160c59fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:26.372279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4adf959-8b4d-44c6-8ef7-0dea160c59fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:26.394612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4adf959-8b4d-44c6-8ef7-0dea160c59fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.395623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4adf959-8b4d-44c6-8ef7-0dea160c59fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.396299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4adf959-8b4d-44c6-8ef7-0dea160c59fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.397245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4adf959-8b4d-44c6-8ef7-0dea160c59fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.403945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4adf959-8b4d-44c6-8ef7-0dea160c59fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.404831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4adf959-8b4d-44c6-8ef7-0dea160c59fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.128831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.141799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.146126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.148266 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2aac50a2-bfda-41a4-bda5-08b9c139812c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2933 microversion: 2.32 time: 1.359728 Oct 04 18:17:27.149764 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1985/3935] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:25 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2933 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:27.178834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5e7c7f2-25f2-4c8c-a6fa-59aac6807f8f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:27.179591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5e7c7f2-25f2-4c8c-a6fa-59aac6807f8f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:27.191482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7c7f2-25f2-4c8c-a6fa-59aac6807f8f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.191993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7c7f2-25f2-4c8c-a6fa-59aac6807f8f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.194728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7c7f2-25f2-4c8c-a6fa-59aac6807f8f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.197318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7c7f2-25f2-4c8c-a6fa-59aac6807f8f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.197827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7c7f2-25f2-4c8c-a6fa-59aac6807f8f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.198426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5e7c7f2-25f2-4c8c-a6fa-59aac6807f8f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.701221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c4adf959-8b4d-44c6-8ef7-0dea160c59fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.716812 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c4adf959-8b4d-44c6-8ef7-0dea160c59fd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 1.350311 Oct 04 18:17:27.732372 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1951/3936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:26 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:27.808695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d49696eb-74bd-43e2-851d-efeca0d268cb req-99ed478b-3ed6-4758-a145-8d9910dc5d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b2bfb3-d80f-4ed6-95f0-5face8d7581e", "tag": "8ca68b0b-c2aa-4f1a-a1e6-ab53e4ea8d05"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:27.832106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d49696eb-74bd-43e2-851d-efeca0d268cb req-99ed478b-3ed6-4758-a145-8d9910dc5d4b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.833610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d49696eb-74bd-43e2-851d-efeca0d268cb req-99ed478b-3ed6-4758-a145-8d9910dc5d4b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.834239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d49696eb-74bd-43e2-851d-efeca0d268cb req-99ed478b-3ed6-4758-a145-8d9910dc5d4b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.855679 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d49696eb-74bd-43e2-851d-efeca0d268cb req-99ed478b-3ed6-4758-a145-8d9910dc5d4b service nova] Creating event network-changed:8ca68b0b-c2aa-4f1a-a1e6-ab53e4ea8d05 for instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e on n-h1-850499-14 Oct 04 18:17:27.872098 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d49696eb-74bd-43e2-851d-efeca0d268cb req-99ed478b-3ed6-4758-a145-8d9910dc5d4b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074151 Oct 04 18:17:27.873221 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1952/3937] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:28.185602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:28.187835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:28.201699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.209155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.212254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.213183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.213919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.216700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.491761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5e7c7f2-25f2-4c8c-a6fa-59aac6807f8f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:28.502273 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5e7c7f2-25f2-4c8c-a6fa-59aac6807f8f tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1318 microversion: 2.1 time: 1.333504 Oct 04 18:17:28.504057 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1986/3938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:27 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1318 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:28.748288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a2d8f549-460d-4822-8b61-c2664ed85250 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:28.749122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a2d8f549-460d-4822-8b61-c2664ed85250 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:28.765233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d8f549-460d-4822-8b61-c2664ed85250 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.779165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d8f549-460d-4822-8b61-c2664ed85250 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.782770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d8f549-460d-4822-8b61-c2664ed85250 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.784441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d8f549-460d-4822-8b61-c2664ed85250 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.785424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d8f549-460d-4822-8b61-c2664ed85250 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.785424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d8f549-460d-4822-8b61-c2664ed85250 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.817436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:29.779181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:29.791813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:29.802814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:29.804145 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d9ff130-8720-4281-9aea-475dcca79ba8 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2912 microversion: 2.32 time: 1.625057 Oct 04 18:17:29.804714 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1953/3939] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:28 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2912 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:29.821389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2e3c73f1-4310-47b8-853f-6bac482a8eda tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:29.825754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2e3c73f1-4310-47b8-853f-6bac482a8eda tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:29.844001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e3c73f1-4310-47b8-853f-6bac482a8eda tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.845745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e3c73f1-4310-47b8-853f-6bac482a8eda tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.846214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e3c73f1-4310-47b8-853f-6bac482a8eda tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.846981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e3c73f1-4310-47b8-853f-6bac482a8eda tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.847461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e3c73f1-4310-47b8-853f-6bac482a8eda tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.847892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e3c73f1-4310-47b8-853f-6bac482a8eda tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.074566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a2d8f549-460d-4822-8b61-c2664ed85250 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.099775 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a2d8f549-460d-4822-8b61-c2664ed85250 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 1.356528 Oct 04 18:17:30.101155 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1987/3940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:28 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:30.108612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-74b113d8-6ad2-481e-94c6-6bafebb57209 req-7dc382b7-117e-470b-a83c-711683f17721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-unplugged", "status": "completed", "tag": "37070eae-6e3f-46e7-9485-0df9262ac25b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:30.123800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-74b113d8-6ad2-481e-94c6-6bafebb57209 req-7dc382b7-117e-470b-a83c-711683f17721 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.125694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-74b113d8-6ad2-481e-94c6-6bafebb57209 req-7dc382b7-117e-470b-a83c-711683f17721 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.127713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-74b113d8-6ad2-481e-94c6-6bafebb57209 req-7dc382b7-117e-470b-a83c-711683f17721 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.195430 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-74b113d8-6ad2-481e-94c6-6bafebb57209 req-7dc382b7-117e-470b-a83c-711683f17721 service nova] Creating event network-vif-unplugged:37070eae-6e3f-46e7-9485-0df9262ac25b for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:17:30.216280 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-74b113d8-6ad2-481e-94c6-6bafebb57209 req-7dc382b7-117e-470b-a83c-711683f17721 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113499 Oct 04 18:17:30.225593 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1988/3941] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:30.734244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2e3c73f1-4310-47b8-853f-6bac482a8eda tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.747696 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2e3c73f1-4310-47b8-853f-6bac482a8eda tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1318 microversion: 2.1 time: 0.938591 Oct 04 18:17:30.764246 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1954/3942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:29 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1318 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:30.837632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:30.838759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:30.843341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=35 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:30.855877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.865039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.865504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.874585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.875253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.875720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.950609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-375f8341-0a4f-48d7-8035-de81bab14c24 req-805eda4a-0abc-4a91-a251-65b2e7e161ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-deleted", "tag": "0363d8a0-489b-4b4b-bfe2-73f68c149109"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:30.967506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-375f8341-0a4f-48d7-8035-de81bab14c24 req-805eda4a-0abc-4a91-a251-65b2e7e161ae service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.972970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-375f8341-0a4f-48d7-8035-de81bab14c24 req-805eda4a-0abc-4a91-a251-65b2e7e161ae service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.975618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-375f8341-0a4f-48d7-8035-de81bab14c24 req-805eda4a-0abc-4a91-a251-65b2e7e161ae service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.439309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=18 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:31.462570 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-375f8341-0a4f-48d7-8035-de81bab14c24 req-805eda4a-0abc-4a91-a251-65b2e7e161ae service nova] Creating event network-vif-deleted:0363d8a0-489b-4b4b-bfe2-73f68c149109 for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:17:31.468552 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-375f8341-0a4f-48d7-8035-de81bab14c24 req-805eda4a-0abc-4a91-a251-65b2e7e161ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.522990 Oct 04 18:17:31.470000 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1955/3943] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:31.476872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e52786c-c503-4c4d-a67d-a59c29b9e428 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:31.477845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e52786c-c503-4c4d-a67d-a59c29b9e428 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:31.486101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e52786c-c503-4c4d-a67d-a59c29b9e428 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.487035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e52786c-c503-4c4d-a67d-a59c29b9e428 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.487666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e52786c-c503-4c4d-a67d-a59c29b9e428 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.488698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e52786c-c503-4c4d-a67d-a59c29b9e428 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.489557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e52786c-c503-4c4d-a67d-a59c29b9e428 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.490178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e52786c-c503-4c4d-a67d-a59c29b9e428 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.018992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.050930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.055270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.058779 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-654f7b7e-375b-4684-b7dd-391a8004024a tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2865 microversion: 2.32 time: 1.225194 Oct 04 18:17:32.086860 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1989/3944] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:30 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2865 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:32.102225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-efc3488b-4926-4f98-8ad6-a36c73f7b363 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:32.115100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-efc3488b-4926-4f98-8ad6-a36c73f7b363 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:32.120457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc3488b-4926-4f98-8ad6-a36c73f7b363 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.120974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc3488b-4926-4f98-8ad6-a36c73f7b363 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.121429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc3488b-4926-4f98-8ad6-a36c73f7b363 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.122174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc3488b-4926-4f98-8ad6-a36c73f7b363 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.122621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc3488b-4926-4f98-8ad6-a36c73f7b363 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.123127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc3488b-4926-4f98-8ad6-a36c73f7b363 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.583061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-efc3488b-4926-4f98-8ad6-a36c73f7b363 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.592771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7e52786c-c503-4c4d-a67d-a59c29b9e428 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.603397 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e52786c-c503-4c4d-a67d-a59c29b9e428 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 1.131971 Oct 04 18:17:32.605910 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-efc3488b-4926-4f98-8ad6-a36c73f7b363 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1318 microversion: 2.1 time: 0.517819 Oct 04 18:17:32.606780 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1956/3945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:31 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:32.609830 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1990/3946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:32 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:32.623371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b4dca361-d250-413c-85d9-b9b01d5dda18 req-683214a8-6b2b-4149-89e6-979ad8e183f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-unplugged", "status": "completed", "tag": "45b63755-90e1-40b1-b12e-372ba302bb3c"}, {"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-unplugged", "status": "completed", "tag": "3a292832-0947-4c83-ad7e-41e6a929165c"}, {"server_uuid": "224ec17d-fb7b-4acb-9c83-e9dcd83fd011", "name": "network-vif-plugged", "status": "completed", "tag": "25175d2e-4025-4717-9cdc-cb5d0bf8eb50"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:32.646866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b4dca361-d250-413c-85d9-b9b01d5dda18 req-683214a8-6b2b-4149-89e6-979ad8e183f6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.647860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b4dca361-d250-413c-85d9-b9b01d5dda18 req-683214a8-6b2b-4149-89e6-979ad8e183f6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.649276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b4dca361-d250-413c-85d9-b9b01d5dda18 req-683214a8-6b2b-4149-89e6-979ad8e183f6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.666686 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b4dca361-d250-413c-85d9-b9b01d5dda18 req-683214a8-6b2b-4149-89e6-979ad8e183f6 service nova] Creating event network-vif-unplugged:45b63755-90e1-40b1-b12e-372ba302bb3c for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:17:32.667865 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b4dca361-d250-413c-85d9-b9b01d5dda18 req-683214a8-6b2b-4149-89e6-979ad8e183f6 service nova] Creating event network-vif-unplugged:3a292832-0947-4c83-ad7e-41e6a929165c for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:17:32.668745 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b4dca361-d250-413c-85d9-b9b01d5dda18 req-683214a8-6b2b-4149-89e6-979ad8e183f6 service nova] Creating event network-vif-plugged:25175d2e-4025-4717-9cdc-cb5d0bf8eb50 for instance 224ec17d-fb7b-4acb-9c83-e9dcd83fd011 on n-h1-850499-14 Oct 04 18:17:32.681311 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b4dca361-d250-413c-85d9-b9b01d5dda18 req-683214a8-6b2b-4149-89e6-979ad8e183f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.070396 Oct 04 18:17:32.682809 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1957/3947] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:33.099678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.100680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.144404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.147895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.149378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.152604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.153732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.154451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.637493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fb16447a-8213-480e-8260-6d10c07d78d7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.639135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb16447a-8213-480e-8260-6d10c07d78d7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.648448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb16447a-8213-480e-8260-6d10c07d78d7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.648917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb16447a-8213-480e-8260-6d10c07d78d7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.649393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb16447a-8213-480e-8260-6d10c07d78d7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.650087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb16447a-8213-480e-8260-6d10c07d78d7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.650738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb16447a-8213-480e-8260-6d10c07d78d7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.651826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb16447a-8213-480e-8260-6d10c07d78d7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.859599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.887515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.888940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.890413 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4b1b9513-a9dc-4304-b88c-a6412e482a83 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2752 microversion: 2.32 time: 0.794776 Oct 04 18:17:33.891367 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1991/3948] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:33 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2752 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:33.896639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-133f03b9-72b5-4525-8127-61c03816628e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.897482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-133f03b9-72b5-4525-8127-61c03816628e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.903979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133f03b9-72b5-4525-8127-61c03816628e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.904769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133f03b9-72b5-4525-8127-61c03816628e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.905502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133f03b9-72b5-4525-8127-61c03816628e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.906478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133f03b9-72b5-4525-8127-61c03816628e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.907182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133f03b9-72b5-4525-8127-61c03816628e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.907857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133f03b9-72b5-4525-8127-61c03816628e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.705993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fb16447a-8213-480e-8260-6d10c07d78d7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.710027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:34.726815 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fb16447a-8213-480e-8260-6d10c07d78d7 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1318 microversion: 2.1 time: 1.098043 Oct 04 18:17:34.734714 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1958/3949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:33 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1318 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:34.744470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fa5d3ee3-6276-44d2-ab9d-111a0bf92bb9 req-0be46d57-345b-4430-96bc-a7b135f62354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-deleted", "tag": "e1a15415-f9e0-4b1e-84c8-c5eeef520105"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:34.791613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fa5d3ee3-6276-44d2-ab9d-111a0bf92bb9 req-0be46d57-345b-4430-96bc-a7b135f62354 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.792093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fa5d3ee3-6276-44d2-ab9d-111a0bf92bb9 req-0be46d57-345b-4430-96bc-a7b135f62354 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.792528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fa5d3ee3-6276-44d2-ab9d-111a0bf92bb9 req-0be46d57-345b-4430-96bc-a7b135f62354 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.838546 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fa5d3ee3-6276-44d2-ab9d-111a0bf92bb9 req-0be46d57-345b-4430-96bc-a7b135f62354 service nova] Creating event network-vif-deleted:e1a15415-f9e0-4b1e-84c8-c5eeef520105 for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:17:34.892494 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fa5d3ee3-6276-44d2-ab9d-111a0bf92bb9 req-0be46d57-345b-4430-96bc-a7b135f62354 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152332 Oct 04 18:17:34.894533 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1959/3950] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:34.939129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.947158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:34.971362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.976541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.977413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.980501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.981511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.982204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.032417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-133f03b9-72b5-4525-8127-61c03816628e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:35.046532 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-133f03b9-72b5-4525-8127-61c03816628e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 1.153845 Oct 04 18:17:35.047777 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1992/3951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:33 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:35.757782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f19be2ca-d1f4-446c-bb32-45396c293bb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:35.758407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f19be2ca-d1f4-446c-bb32-45396c293bb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:35.774804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19be2ca-d1f4-446c-bb32-45396c293bb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.775339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19be2ca-d1f4-446c-bb32-45396c293bb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.775788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19be2ca-d1f4-446c-bb32-45396c293bb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.776508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19be2ca-d1f4-446c-bb32-45396c293bb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.776965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19be2ca-d1f4-446c-bb32-45396c293bb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.777392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f19be2ca-d1f4-446c-bb32-45396c293bb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.270231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.289573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.291806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.298233 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0eb87f7b-d105-460b-9b00-3c78a46d08da tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2592 microversion: 2.32 time: 1.379362 Oct 04 18:17:36.305808 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1960/3952] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:34 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2592 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:36.312441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3870620e-7d88-4b0c-892e-860f2e740930 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:36.328247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3870620e-7d88-4b0c-892e-860f2e740930 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:36.348212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3870620e-7d88-4b0c-892e-860f2e740930 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.356845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3870620e-7d88-4b0c-892e-860f2e740930 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.365538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3870620e-7d88-4b0c-892e-860f2e740930 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.366972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3870620e-7d88-4b0c-892e-860f2e740930 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.367828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3870620e-7d88-4b0c-892e-860f2e740930 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.368746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3870620e-7d88-4b0c-892e-860f2e740930 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.612830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3870620e-7d88-4b0c-892e-860f2e740930 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:37.625857 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3870620e-7d88-4b0c-892e-860f2e740930 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 1.315605 Oct 04 18:17:37.627423 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1961/3953] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:36 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:37.635651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-703b2360-a16e-4849-8fbe-6aaa7c87995e req-3819b40c-6bae-4a91-b375-4be55d0fdbce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-deleted", "tag": "37070eae-6e3f-46e7-9485-0df9262ac25b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:37.671758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-703b2360-a16e-4849-8fbe-6aaa7c87995e req-3819b40c-6bae-4a91-b375-4be55d0fdbce service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.672679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-703b2360-a16e-4849-8fbe-6aaa7c87995e req-3819b40c-6bae-4a91-b375-4be55d0fdbce service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.673365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-703b2360-a16e-4849-8fbe-6aaa7c87995e req-3819b40c-6bae-4a91-b375-4be55d0fdbce service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.704585 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-703b2360-a16e-4849-8fbe-6aaa7c87995e req-3819b40c-6bae-4a91-b375-4be55d0fdbce service nova] Creating event network-vif-deleted:37070eae-6e3f-46e7-9485-0df9262ac25b for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:17:37.714522 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-703b2360-a16e-4849-8fbe-6aaa7c87995e req-3819b40c-6bae-4a91-b375-4be55d0fdbce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082432 Oct 04 18:17:37.715497 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1962/3954] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:37.728968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:37.732840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:37.746089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.750180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.752347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.755308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.756118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.760375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.865705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f19be2ca-d1f4-446c-bb32-45396c293bb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:37.875014 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f19be2ca-d1f4-446c-bb32-45396c293bb2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1507 microversion: 2.1 time: 2.120483 Oct 04 18:17:37.875616 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1993/3955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:35 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1507 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:37.909245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-15ea43b9-4959-4340-a244-0453ccaa3544 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:37.922883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-15ea43b9-4959-4340-a244-0453ccaa3544 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:37.937659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15ea43b9-4959-4340-a244-0453ccaa3544 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.938339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15ea43b9-4959-4340-a244-0453ccaa3544 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.939955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15ea43b9-4959-4340-a244-0453ccaa3544 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.943545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15ea43b9-4959-4340-a244-0453ccaa3544 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.944366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15ea43b9-4959-4340-a244-0453ccaa3544 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.944932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15ea43b9-4959-4340-a244-0453ccaa3544 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.283175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-15ea43b9-4959-4340-a244-0453ccaa3544 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.296593 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-15ea43b9-4959-4340-a244-0453ccaa3544 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1507 microversion: 2.1 time: 0.394758 Oct 04 18:17:38.299396 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1994/3956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:37 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:38.331594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d617b9d4-9db6-4fd5-819a-23a50ca2ed33 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:38.337292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d617b9d4-9db6-4fd5-819a-23a50ca2ed33 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.350622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d617b9d4-9db6-4fd5-819a-23a50ca2ed33 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.357253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d617b9d4-9db6-4fd5-819a-23a50ca2ed33 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.358037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d617b9d4-9db6-4fd5-819a-23a50ca2ed33 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.359574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d617b9d4-9db6-4fd5-819a-23a50ca2ed33 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.360256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d617b9d4-9db6-4fd5-819a-23a50ca2ed33 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.364576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d617b9d4-9db6-4fd5-819a-23a50ca2ed33 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.474076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d617b9d4-9db6-4fd5-819a-23a50ca2ed33 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "PUT /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1079 microversion: 2.1 time: 0.150420 Oct 04 18:17:38.506875 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1995/3957] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 4 18:17:38 2022] PUT /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1079 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:38.512074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9bcb5d6a-51f4-41ec-a5af-7f3bc1245d44 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:38.525575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9bcb5d6a-51f4-41ec-a5af-7f3bc1245d44 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.555842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bcb5d6a-51f4-41ec-a5af-7f3bc1245d44 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.561115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bcb5d6a-51f4-41ec-a5af-7f3bc1245d44 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.564230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bcb5d6a-51f4-41ec-a5af-7f3bc1245d44 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.567597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bcb5d6a-51f4-41ec-a5af-7f3bc1245d44 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.567961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.570852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bcb5d6a-51f4-41ec-a5af-7f3bc1245d44 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.573254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bcb5d6a-51f4-41ec-a5af-7f3bc1245d44 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.588159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.592654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.596816 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d80694c-009d-4930-bf4a-892affce9827 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2431 microversion: 2.32 time: 0.874750 Oct 04 18:17:38.600116 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1963/3958] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:37 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2431 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:38.650126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e99093de-ce9d-4f77-9cfd-6c901b6db0fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:38.651970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e99093de-ce9d-4f77-9cfd-6c901b6db0fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.661017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e99093de-ce9d-4f77-9cfd-6c901b6db0fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.670690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e99093de-ce9d-4f77-9cfd-6c901b6db0fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.674711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e99093de-ce9d-4f77-9cfd-6c901b6db0fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.680541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e99093de-ce9d-4f77-9cfd-6c901b6db0fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.681396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e99093de-ce9d-4f77-9cfd-6c901b6db0fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.687036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e99093de-ce9d-4f77-9cfd-6c901b6db0fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.510132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9bcb5d6a-51f4-41ec-a5af-7f3bc1245d44 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:39.520680 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9bcb5d6a-51f4-41ec-a5af-7f3bc1245d44 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1505 microversion: 2.1 time: 1.012317 Oct 04 18:17:39.522553 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1996/3959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:38 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1505 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:39.550418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bd084df9-fa8e-4674-b1df-b170c5e8f49e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:39.553319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bd084df9-fa8e-4674-b1df-b170c5e8f49e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:39.584498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd084df9-fa8e-4674-b1df-b170c5e8f49e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.585146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd084df9-fa8e-4674-b1df-b170c5e8f49e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.586122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd084df9-fa8e-4674-b1df-b170c5e8f49e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.587273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd084df9-fa8e-4674-b1df-b170c5e8f49e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.587832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd084df9-fa8e-4674-b1df-b170c5e8f49e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.591577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd084df9-fa8e-4674-b1df-b170c5e8f49e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.645780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e99093de-ce9d-4f77-9cfd-6c901b6db0fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:39.662247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e99093de-ce9d-4f77-9cfd-6c901b6db0fe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 1.016306 Oct 04 18:17:39.669391 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1964/3960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:38 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:39.728089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:39.730352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:39.752939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.753468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.753994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.754739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.755239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.755681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.608353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bd084df9-fa8e-4674-b1df-b170c5e8f49e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:40.621217 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bd084df9-fa8e-4674-b1df-b170c5e8f49e tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1505 microversion: 2.1 time: 1.077066 Oct 04 18:17:40.641782 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1997/3961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:39 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1505 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:40.656941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-2847beb3-6182-490e-8d1e-5d6c0e81027c req-bce4539d-2bb8-430d-a0a2-439a2a3372e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-deleted", "tag": "45b63755-90e1-40b1-b12e-372ba302bb3c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:40.684528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2847beb3-6182-490e-8d1e-5d6c0e81027c req-bce4539d-2bb8-430d-a0a2-439a2a3372e7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.685087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2847beb3-6182-490e-8d1e-5d6c0e81027c req-bce4539d-2bb8-430d-a0a2-439a2a3372e7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.685538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2847beb3-6182-490e-8d1e-5d6c0e81027c req-bce4539d-2bb8-430d-a0a2-439a2a3372e7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.717905 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-2847beb3-6182-490e-8d1e-5d6c0e81027c req-bce4539d-2bb8-430d-a0a2-439a2a3372e7 service nova] Creating event network-vif-deleted:45b63755-90e1-40b1-b12e-372ba302bb3c for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:17:40.730734 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-2847beb3-6182-490e-8d1e-5d6c0e81027c req-bce4539d-2bb8-430d-a0a2-439a2a3372e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087581 Oct 04 18:17:40.731733 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1998/3962] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:40.743364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00c4f5bd-b163-43d0-a51b-0232ce5428d0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:40.745933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00c4f5bd-b163-43d0-a51b-0232ce5428d0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:40.769408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00c4f5bd-b163-43d0-a51b-0232ce5428d0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.770624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00c4f5bd-b163-43d0-a51b-0232ce5428d0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.771351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00c4f5bd-b163-43d0-a51b-0232ce5428d0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.774303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00c4f5bd-b163-43d0-a51b-0232ce5428d0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.776340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00c4f5bd-b163-43d0-a51b-0232ce5428d0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.777037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00c4f5bd-b163-43d0-a51b-0232ce5428d0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.816410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:40.826985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:40.833495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:40.835388 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e5f66f34-ba01-472e-a081-e98844a7befa tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2384 microversion: 2.32 time: 1.164635 Oct 04 18:17:40.838881 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1965/3963] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:39 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2384 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:40.853675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a321eb3b-9e5f-4807-b361-51414dfe005f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:40.855817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a321eb3b-9e5f-4807-b361-51414dfe005f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:40.871234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a321eb3b-9e5f-4807-b361-51414dfe005f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.876953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a321eb3b-9e5f-4807-b361-51414dfe005f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.877859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a321eb3b-9e5f-4807-b361-51414dfe005f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.878901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a321eb3b-9e5f-4807-b361-51414dfe005f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.879691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a321eb3b-9e5f-4807-b361-51414dfe005f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.882066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a321eb3b-9e5f-4807-b361-51414dfe005f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.037950 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00c4f5bd-b163-43d0-a51b-0232ce5428d0 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "PUT /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1081 microversion: 2.1 time: 0.304910 Oct 04 18:17:41.038609 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 1999/3964] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 4 18:17:40 2022] PUT /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1081 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:41.069534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b6a32a93-19d4-416e-8fce-d224be032a38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:41.070297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b6a32a93-19d4-416e-8fce-d224be032a38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:41.109210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6a32a93-19d4-416e-8fce-d224be032a38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.113761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6a32a93-19d4-416e-8fce-d224be032a38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.114301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6a32a93-19d4-416e-8fce-d224be032a38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.131212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6a32a93-19d4-416e-8fce-d224be032a38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.131852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6a32a93-19d4-416e-8fce-d224be032a38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.132322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6a32a93-19d4-416e-8fce-d224be032a38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.491131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a321eb3b-9e5f-4807-b361-51414dfe005f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.499581 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a321eb3b-9e5f-4807-b361-51414dfe005f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 0.659003 Oct 04 18:17:41.505533 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1966/3965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:40 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:41.873543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:41.874788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:41.893632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.894152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.894615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.900990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.901869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.902704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.952435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6a32a93-19d4-416e-8fce-d224be032a38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.974894 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b6a32a93-19d4-416e-8fce-d224be032a38 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1507 microversion: 2.1 time: 0.920716 Oct 04 18:17:41.976062 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2000/3966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:41 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1507 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:42.009006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-53741beb-caf7-4f69-8c1d-85f22ca8ab17 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:42.012805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-53741beb-caf7-4f69-8c1d-85f22ca8ab17 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:42.043930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53741beb-caf7-4f69-8c1d-85f22ca8ab17 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.054351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53741beb-caf7-4f69-8c1d-85f22ca8ab17 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.055037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53741beb-caf7-4f69-8c1d-85f22ca8ab17 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.056620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53741beb-caf7-4f69-8c1d-85f22ca8ab17 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.057901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53741beb-caf7-4f69-8c1d-85f22ca8ab17 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.060475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53741beb-caf7-4f69-8c1d-85f22ca8ab17 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.151384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.167020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.168547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.169851 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a556c2d3-a81a-4f5b-9660-0c6400eae580 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2159 microversion: 2.32 time: 0.300492 Oct 04 18:17:42.170798 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1967/3967] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:41 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2159 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:42.529999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee831a03-b41f-4158-8f13-8b9746969813 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:42.529999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ee831a03-b41f-4158-8f13-8b9746969813 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:42.558059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee831a03-b41f-4158-8f13-8b9746969813 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.558880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee831a03-b41f-4158-8f13-8b9746969813 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.559624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee831a03-b41f-4158-8f13-8b9746969813 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.560609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee831a03-b41f-4158-8f13-8b9746969813 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.561360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee831a03-b41f-4158-8f13-8b9746969813 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.566819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee831a03-b41f-4158-8f13-8b9746969813 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.622367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-53741beb-caf7-4f69-8c1d-85f22ca8ab17 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.637105 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-53741beb-caf7-4f69-8c1d-85f22ca8ab17 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1507 microversion: 2.1 time: 1.636983 Oct 04 18:17:43.637957 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2001/3968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:41 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1507 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:43.651383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:43.653399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:43.668943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.669787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.670477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.672194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.673163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.673820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.759960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee831a03-b41f-4158-8f13-8b9746969813 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.781565 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ee831a03-b41f-4158-8f13-8b9746969813 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 1.245582 Oct 04 18:17:43.782463 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1968/3969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:42 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:43.800869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ffd7757-ba2e-4ae4-89e1-15d83c750f4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:43.821778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ffd7757-ba2e-4ae4-89e1-15d83c750f4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:43.849242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ffd7757-ba2e-4ae4-89e1-15d83c750f4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.849660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ffd7757-ba2e-4ae4-89e1-15d83c750f4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.850110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ffd7757-ba2e-4ae4-89e1-15d83c750f4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.858995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ffd7757-ba2e-4ae4-89e1-15d83c750f4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.864989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ffd7757-ba2e-4ae4-89e1-15d83c750f4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.866731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ffd7757-ba2e-4ae4-89e1-15d83c750f4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.894176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.921433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.931342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.939656 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-90a6fcca-14b8-49ad-9f93-18abd3716427 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2159 microversion: 2.32 time: 0.291585 Oct 04 18:17:43.945710 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2002/3970] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:43 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2159 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:43.961890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ffd7757-ba2e-4ae4-89e1-15d83c750f4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:44.172624 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ffd7757-ba2e-4ae4-89e1-15d83c750f4a tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "DELETE /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 204 len: 0 microversion: 2.1 time: 0.381630 Oct 04 18:17:44.173605 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1969/3971] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:43 2022] DELETE /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:44.188316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.188825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.201284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.204740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.205210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.205966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.206436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.206870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.303228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:44.306587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:44.386703 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.compute.api [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Instance is already in deleting state, ignoring this request Oct 04 18:17:44.389230 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-759fa49f-20f6-48f5-9260-f9161c809068 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "DELETE /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 204 len: 0 microversion: 2.1 time: 0.205497 Oct 04 18:17:44.390647 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2003/3972] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:44 2022] DELETE /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:44.411734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-641da1ad-06b8-407f-903d-6bcf1c958289 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.412994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-641da1ad-06b8-407f-903d-6bcf1c958289 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.428012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-641da1ad-06b8-407f-903d-6bcf1c958289 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.429189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-641da1ad-06b8-407f-903d-6bcf1c958289 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.429871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-641da1ad-06b8-407f-903d-6bcf1c958289 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.431040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-641da1ad-06b8-407f-903d-6bcf1c958289 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.431676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-641da1ad-06b8-407f-903d-6bcf1c958289 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.433364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-641da1ad-06b8-407f-903d-6bcf1c958289 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.612979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7b3bc7e9-cf62-4d28-a65f-7c9cdf25d7d7 req-b3088a32-a3fa-4447-abef-4e081991babc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd959367-f389-406d-8ec3-e5dbd3ab8ae7", "name": "network-vif-deleted", "tag": "3a292832-0947-4c83-ad7e-41e6a929165c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:44.640819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7b3bc7e9-cf62-4d28-a65f-7c9cdf25d7d7 req-b3088a32-a3fa-4447-abef-4e081991babc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.642128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7b3bc7e9-cf62-4d28-a65f-7c9cdf25d7d7 req-b3088a32-a3fa-4447-abef-4e081991babc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.644798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7b3bc7e9-cf62-4d28-a65f-7c9cdf25d7d7 req-b3088a32-a3fa-4447-abef-4e081991babc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.676010 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7b3bc7e9-cf62-4d28-a65f-7c9cdf25d7d7 req-b3088a32-a3fa-4447-abef-4e081991babc service nova] Creating event network-vif-deleted:3a292832-0947-4c83-ad7e-41e6a929165c for instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 on n-h1-850499-14 Oct 04 18:17:44.685540 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7b3bc7e9-cf62-4d28-a65f-7c9cdf25d7d7 req-b3088a32-a3fa-4447-abef-4e081991babc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077205 Oct 04 18:17:44.688021 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2004/3973] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:44.803801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-641da1ad-06b8-407f-903d-6bcf1c958289 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:44.810284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8d0f116-4092-47af-a9ec-8315815ae53f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.813069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e8d0f116-4092-47af-a9ec-8315815ae53f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.813725 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-641da1ad-06b8-407f-903d-6bcf1c958289 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1513 microversion: 2.1 time: 0.417163 Oct 04 18:17:44.814317 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1970/3974] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:44 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1513 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:44.831591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8d0f116-4092-47af-a9ec-8315815ae53f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.838829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8d0f116-4092-47af-a9ec-8315815ae53f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.845023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8d0f116-4092-47af-a9ec-8315815ae53f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.851469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8d0f116-4092-47af-a9ec-8315815ae53f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.852349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8d0f116-4092-47af-a9ec-8315815ae53f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.856082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8d0f116-4092-47af-a9ec-8315815ae53f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.972768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.973692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.988991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.989701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.990327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.991271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.991916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.992629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.122337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.141382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.145464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.148784 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6de2089a-6504-4632-8c8c-abb5e829db04 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 2159 microversion: 2.32 time: 0.179470 Oct 04 18:17:45.151468 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1971/3975] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:44 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 2159 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:45.251967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8d0f116-4092-47af-a9ec-8315815ae53f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.269072 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e8d0f116-4092-47af-a9ec-8315815ae53f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1528 microversion: 2.1 time: 0.464258 Oct 04 18:17:45.270309 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2005/3976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:44 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1528 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:45.836917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a04faa9a-b4de-42a9-ba35-008af2d4c2de tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:45.838525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a04faa9a-b4de-42a9-ba35-008af2d4c2de tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:45.853045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a04faa9a-b4de-42a9-ba35-008af2d4c2de tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.865174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a04faa9a-b4de-42a9-ba35-008af2d4c2de tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.866043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a04faa9a-b4de-42a9-ba35-008af2d4c2de tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.867168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a04faa9a-b4de-42a9-ba35-008af2d4c2de tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.867872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a04faa9a-b4de-42a9-ba35-008af2d4c2de tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.868537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a04faa9a-b4de-42a9-ba35-008af2d4c2de tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.178810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:46.179994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:46.199220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.201701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.202363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.204559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.209136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.211460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.530065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a04faa9a-b4de-42a9-ba35-008af2d4c2de tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.543949 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a04faa9a-b4de-42a9-ba35-008af2d4c2de tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1513 microversion: 2.1 time: 0.708417 Oct 04 18:17:46.545754 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1972/3977] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:45 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1513 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:46.555204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75d261b1-5810-4e66-814f-1967d0dac5c3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:46.563615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75d261b1-5810-4e66-814f-1967d0dac5c3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:46.574409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d261b1-5810-4e66-814f-1967d0dac5c3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.575096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d261b1-5810-4e66-814f-1967d0dac5c3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.580673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d261b1-5810-4e66-814f-1967d0dac5c3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.581600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d261b1-5810-4e66-814f-1967d0dac5c3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.582213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d261b1-5810-4e66-814f-1967d0dac5c3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.582765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d261b1-5810-4e66-814f-1967d0dac5c3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.593039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.613415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.615320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.622290 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29c223de-9b0c-4560-86fc-05ff66d51fcc tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.447691 Oct 04 18:17:46.635544 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2006/3978] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:46 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:47.048072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75d261b1-5810-4e66-814f-1967d0dac5c3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:47.062410 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75d261b1-5810-4e66-814f-1967d0dac5c3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1510 microversion: 2.1 time: 0.514675 Oct 04 18:17:47.078558 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1973/3979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:46 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:47.338472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-621345003", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "0ebdce98-8d6a-485e-aab1-77ae7641e1bd"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:47.433081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] validate_networks() for [('0ebdce98-8d6a-485e-aab1-77ae7641e1bd', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:47.570125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-83fac5dc-ead2-4c4a-a38b-94ede803a165 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.570867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-83fac5dc-ead2-4c4a-a38b-94ede803a165 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.588952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fac5dc-ead2-4c4a-a38b-94ede803a165 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.589478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fac5dc-ead2-4c4a-a38b-94ede803a165 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.589934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fac5dc-ead2-4c4a-a38b-94ede803a165 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.594026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fac5dc-ead2-4c4a-a38b-94ede803a165 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.594524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fac5dc-ead2-4c4a-a38b-94ede803a165 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.594991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fac5dc-ead2-4c4a-a38b-94ede803a165 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.876321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-83fac5dc-ead2-4c4a-a38b-94ede803a165 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350bf584a7364c90a6b2a5a05f1cd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abaa6b711db435abdb899420464d972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:47.890770 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-83fac5dc-ead2-4c4a-a38b-94ede803a165 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 200 len: 1471 microversion: 2.1 time: 0.322837 Oct 04 18:17:47.892403 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1974/3980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:47 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:47.905174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.905843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.913687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.914250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.914765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.915719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.916514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.917243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.923711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:48.064644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.100256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.101748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.116175 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a8a35784-0b00-4aaf-b66e-cbb929a4c076 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.217761 Oct 04 18:17:48.117230 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1975/3981] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:47 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:48.148169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d2f4b724-4992-4ea3-adba-33ec256cc789 req-d1873900-1196-43ef-a9d7-dd311d881455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224ec17d-fb7b-4acb-9c83-e9dcd83fd011", "name": "network-vif-deleted", "tag": "25175d2e-4025-4717-9cdc-cb5d0bf8eb50"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:48.191405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d2f4b724-4992-4ea3-adba-33ec256cc789 req-d1873900-1196-43ef-a9d7-dd311d881455 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.191983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d2f4b724-4992-4ea3-adba-33ec256cc789 req-d1873900-1196-43ef-a9d7-dd311d881455 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.192443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d2f4b724-4992-4ea3-adba-33ec256cc789 req-d1873900-1196-43ef-a9d7-dd311d881455 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.221676 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d2f4b724-4992-4ea3-adba-33ec256cc789 req-d1873900-1196-43ef-a9d7-dd311d881455 service nova] Creating event network-vif-deleted:25175d2e-4025-4717-9cdc-cb5d0bf8eb50 for instance 224ec17d-fb7b-4acb-9c83-e9dcd83fd011 on n-h1-850499-14 Oct 04 18:17:48.230701 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d2f4b724-4992-4ea3-adba-33ec256cc789 req-d1873900-1196-43ef-a9d7-dd311d881455 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097514 Oct 04 18:17:48.232018 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1976/3982] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:48.238407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df7430b9-c673-4c71-a2c8-22a34860f70c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.240601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df7430b9-c673-4c71-a2c8-22a34860f70c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:48.249049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df7430b9-c673-4c71-a2c8-22a34860f70c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.250631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df7430b9-c673-4c71-a2c8-22a34860f70c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.252576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df7430b9-c673-4c71-a2c8-22a34860f70c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.269713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df7430b9-c673-4c71-a2c8-22a34860f70c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.270807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df7430b9-c673-4c71-a2c8-22a34860f70c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.271792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df7430b9-c673-4c71-a2c8-22a34860f70c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.613562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df7430b9-c673-4c71-a2c8-22a34860f70c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.623359 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df7430b9-c673-4c71-a2c8-22a34860f70c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1510 microversion: 2.1 time: 0.389818 Oct 04 18:17:48.633504 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1977/3983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:48 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1510 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:48.913875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.914614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 224ec17d-fb7b-4acb-9c83-e9dcd83fd011] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:48.925202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.943932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.944524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.945391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.945941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.946612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.985193 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] HTTP exception thrown: Instance 224ec17d-fb7b-4acb-9c83-e9dcd83fd011 could not be found. Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Request method failure captured: Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 HTTP/1.1 Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgVF2Mu3JKR47ybFvYjuRHr6V7_HdniL8h5nnjtPySa7y5tSrh3A6ho5_urwpJeG7gY2Iyig1qjIQlwOQDxsyuWA8mkBRobMRW8HEkhsdJjiMdra1kzgCQeGxTf9WmPydI_wviCs6JodkEKZ_mCHZGOzIuPNiq-b_QDH8M__co-UWA Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5abaa6b711db435abdb899420464d972 Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5abaa6b711db435abdb899420464d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5abaa6b711db435abdb899420464d972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5abaa6b711db435abdb899420464d972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5abaa6b711db435abdb899420464d972"}]}] Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5abaa6b711db435abdb899420464d972 Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerDiskConfigTestJSON-864211659-project Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 350bf584a7364c90a6b2a5a05f1cd428 Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerDiskConfigTestJSON-864211659-project Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 224ec17d-fb7b-4acb-9c83-e9dcd83fd011 could not be found. Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '224ec17d-fb7b-4acb-9c83-e9dcd83fd011'} Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 224ec17d-fb7b-4acb-9c83-e9dcd83fd011 could not be found. Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 224ec17d-fb7b-4acb-9c83-e9dcd83fd011 could not be found. Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:48.988490 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:48.993773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:48.993773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:48.993773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:48.993773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:48.993773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:48.993773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 224ec17d-fb7b-4acb-9c83-e9dcd83fd011 could not be found. Oct 04 18:17:48.993773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:48.993773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Returning 404 to user: Instance 224ec17d-fb7b-4acb-9c83-e9dcd83fd011 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:48.993773 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-abc0c50b-e927-4059-831d-9d43a221cff8 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011" status: 404 len: 111 microversion: 2.1 time: 0.080243 Oct 04 18:17:48.993773 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1978/3984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:48 2022] GET /compute/v2.1/servers/224ec17d-fb7b-4acb-9c83-e9dcd83fd011 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:17:48.998467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.999013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.024887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.025400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.025855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.026587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.027106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.027547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.065337 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] HTTP exception thrown: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Request method failure captured: Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 HTTP/1.1 Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgVF2Mu3JKR47ybFvYjuRHr6V7_HdniL8h5nnjtPySa7y5tSrh3A6ho5_urwpJeG7gY2Iyig1qjIQlwOQDxsyuWA8mkBRobMRW8HEkhsdJjiMdra1kzgCQeGxTf9WmPydI_wviCs6JodkEKZ_mCHZGOzIuPNiq-b_QDH8M__co-UWA Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5abaa6b711db435abdb899420464d972 Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5abaa6b711db435abdb899420464d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5abaa6b711db435abdb899420464d972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5abaa6b711db435abdb899420464d972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5abaa6b711db435abdb899420464d972"}]}] Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5abaa6b711db435abdb899420464d972 Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerDiskConfigTestJSON-864211659-project Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 350bf584a7364c90a6b2a5a05f1cd428 Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerDiskConfigTestJSON-864211659-project Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '671406ce-ae77-441a-9e07-3d054c34c4f5'} Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:49.068550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. Oct 04 18:17:49.073660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.075803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Returning 404 to user: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:49.076882 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f110ac5e-3df1-4c61-ba23-f75fd85359f2 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "DELETE /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 404 len: 111 microversion: 2.1 time: 0.082217 Oct 04 18:17:49.078767 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1979/3985] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:48 2022] DELETE /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:49.090230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.091234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: 671406ce-ae77-441a-9e07-3d054c34c4f5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.098114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.099128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.099761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.100669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.101353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.101960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.108604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:49.109270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:49.109862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:49.110390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:49.110912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:49.126129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.128531 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] HTTP exception thrown: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. Oct 04 18:17:49.129202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.129950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.130851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.131465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Request method failure captured: Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 HTTP/1.1 Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgVF2Mu3JKR47ybFvYjuRHr6V7_HdniL8h5nnjtPySa7y5tSrh3A6ho5_urwpJeG7gY2Iyig1qjIQlwOQDxsyuWA8mkBRobMRW8HEkhsdJjiMdra1kzgCQeGxTf9WmPydI_wviCs6JodkEKZ_mCHZGOzIuPNiq-b_QDH8M__co-UWA Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5abaa6b711db435abdb899420464d972 Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5abaa6b711db435abdb899420464d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5abaa6b711db435abdb899420464d972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5abaa6b711db435abdb899420464d972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5abaa6b711db435abdb899420464d972"}]}] Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5abaa6b711db435abdb899420464d972 Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerDiskConfigTestJSON-864211659-project Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 350bf584a7364c90a6b2a5a05f1cd428 Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerDiskConfigTestJSON-864211659-project Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '671406ce-ae77-441a-9e07-3d054c34c4f5'} Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:49.135202 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.140852 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.140852 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:49.140852 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:49.140852 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:49.140852 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:49.140852 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. Oct 04 18:17:49.140852 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.140852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Returning 404 to user: Instance 671406ce-ae77-441a-9e07-3d054c34c4f5 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:49.140852 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4ee5b9f9-a9e1-4900-95bd-18f7a680897c tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5" status: 404 len: 111 microversion: 2.1 time: 0.052367 Oct 04 18:17:49.141742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.141843 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1980/3986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/671406ce-ae77-441a-9e07-3d054c34c4f5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:49.146864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.151500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.164164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.164928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.170545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.171635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.172389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.173008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.173890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:49.182491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Getting quotas for project 74575f6588c54244b56819c8f51d2670. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:49.201859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Getting quotas for user f8b0aa6623e74a708f98d032b02038d6 and project 74575f6588c54244b56819c8f51d2670. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:49.204426 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] HTTP exception thrown: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Request method failure captured: Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a HTTP/1.1 Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgVF2Mu3JKR47ybFvYjuRHr6V7_HdniL8h5nnjtPySa7y5tSrh3A6ho5_urwpJeG7gY2Iyig1qjIQlwOQDxsyuWA8mkBRobMRW8HEkhsdJjiMdra1kzgCQeGxTf9WmPydI_wviCs6JodkEKZ_mCHZGOzIuPNiq-b_QDH8M__co-UWA Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5abaa6b711db435abdb899420464d972 Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5abaa6b711db435abdb899420464d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5abaa6b711db435abdb899420464d972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5abaa6b711db435abdb899420464d972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5abaa6b711db435abdb899420464d972"}]}] Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5abaa6b711db435abdb899420464d972 Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerDiskConfigTestJSON-864211659-project Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 350bf584a7364c90a6b2a5a05f1cd428 Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerDiskConfigTestJSON-864211659-project Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e10872fe-cae9-4db2-88f6-57c26d1eff0a'} Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:49.209947 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Returning 404 to user: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6214ecce-7ad2-4a99-96b3-f35f1c4c2fc3 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 404 len: 111 microversion: 2.1 time: 0.068428 Oct 04 18:17:49.217554 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1981/3987] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:49 2022] DELETE /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:49.220277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.229560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.245066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:49.248131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.248725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.249732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.250534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.251048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.251506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.261490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:49.398895 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6a534733-6673-47e7-a725-a8b8ebcb8c82 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.267488 Oct 04 18:17:49.413885 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2007/3988] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:17:49.416734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.432638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.435606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.435909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] [instance: e10872fe-cae9-4db2-88f6-57c26d1eff0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.437371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.438671 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df45acca-1596-497a-b1db-1afdbbe02fc3 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.222301 Oct 04 18:17:49.449860 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1982/3989] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:49.471474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.471989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.474137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.474901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.477842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.478293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.479886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a28c5e3-bdf1-44bb-9a9e-33ac6de7754a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.480509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8a28c5e3-bdf1-44bb-9a9e-33ac6de7754a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.509726 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] HTTP exception thrown: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Request method failure captured: Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a HTTP/1.1 Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgVF2Mu3JKR47ybFvYjuRHr6V7_HdniL8h5nnjtPySa7y5tSrh3A6ho5_urwpJeG7gY2Iyig1qjIQlwOQDxsyuWA8mkBRobMRW8HEkhsdJjiMdra1kzgCQeGxTf9WmPydI_wviCs6JodkEKZ_mCHZGOzIuPNiq-b_QDH8M__co-UWA Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 5abaa6b711db435abdb899420464d972 Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5abaa6b711db435abdb899420464d972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5abaa6b711db435abdb899420464d972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5abaa6b711db435abdb899420464d972"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5abaa6b711db435abdb899420464d972"}]}] Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 5abaa6b711db435abdb899420464d972 Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-864211659 Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerDiskConfigTestJSON-864211659-project Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 350bf584a7364c90a6b2a5a05f1cd428 Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerDiskConfigTestJSON-864211659-project Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'e10872fe-cae9-4db2-88f6-57c26d1eff0a'} Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:49.511439 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.516896 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:49.516896 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:49.516896 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:49.516896 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:49.516896 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:49.516896 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. Oct 04 18:17:49.516896 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:49.516896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] Returning 404 to user: Instance e10872fe-cae9-4db2-88f6-57c26d1eff0a could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:49.521258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-049a1749-29b2-49c5-a97c-5e9f8c845d98 tempest-ServerDiskConfigTestJSON-864211659 tempest-ServerDiskConfigTestJSON-864211659-project] 10.222.0.18 "GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a" status: 404 len: 111 microversion: 2.1 time: 0.110121 Oct 04 18:17:49.522175 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2008/3990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/e10872fe-cae9-4db2-88f6-57c26d1eff0a => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:49.652772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a28c5e3-bdf1-44bb-9a9e-33ac6de7754a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.665155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79ade2ca-52f0-4af1-87eb-d6658747eec3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.665786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-79ade2ca-52f0-4af1-87eb-d6658747eec3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.686077 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a28c5e3-bdf1-44bb-9a9e-33ac6de7754a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1215 microversion: 2.1 time: 0.210264 Oct 04 18:17:49.688444 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1983/3991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:49.692384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ade2ca-52f0-4af1-87eb-d6658747eec3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.693894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ade2ca-52f0-4af1-87eb-d6658747eec3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.695572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ade2ca-52f0-4af1-87eb-d6658747eec3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.699622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ade2ca-52f0-4af1-87eb-d6658747eec3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.702640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ade2ca-52f0-4af1-87eb-d6658747eec3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.703132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ade2ca-52f0-4af1-87eb-d6658747eec3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.238547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-79ade2ca-52f0-4af1-87eb-d6658747eec3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.255561 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-79ade2ca-52f0-4af1-87eb-d6658747eec3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1510 microversion: 2.1 time: 0.595431 Oct 04 18:17:50.257714 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2009/3992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:50.481048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:50.481678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:50.506231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.506737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.516588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b8bb8194-548e-4831-b41c-44901a1e0498 req-73cd2b8f-6c74-4667-accd-8b33ceb23c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afef2588-b2e9-4b9e-943c-44469215dd64", "name": "network-vif-unplugged", "status": "completed", "tag": "e1f04890-a2cf-4366-ad64-14ecf15d04cf"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:50.531592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.532705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.533389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.534015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.546813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b8bb8194-548e-4831-b41c-44901a1e0498 req-73cd2b8f-6c74-4667-accd-8b33ceb23c2d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.554754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b8bb8194-548e-4831-b41c-44901a1e0498 req-73cd2b8f-6c74-4667-accd-8b33ceb23c2d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.555685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b8bb8194-548e-4831-b41c-44901a1e0498 req-73cd2b8f-6c74-4667-accd-8b33ceb23c2d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.588553 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b8bb8194-548e-4831-b41c-44901a1e0498 req-73cd2b8f-6c74-4667-accd-8b33ceb23c2d service nova] Creating event network-vif-unplugged:e1f04890-a2cf-4366-ad64-14ecf15d04cf for instance afef2588-b2e9-4b9e-943c-44469215dd64 on n-h2-850499-14 Oct 04 18:17:50.597624 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b8bb8194-548e-4831-b41c-44901a1e0498 req-73cd2b8f-6c74-4667-accd-8b33ceb23c2d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088514 Oct 04 18:17:50.599752 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2010/3993] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:50.709992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.717035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e2b9814-00fa-49fa-ad81-06b9775e24e0 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:50.718682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e2b9814-00fa-49fa-ad81-06b9775e24e0 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:50.727420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b9814-00fa-49fa-ad81-06b9775e24e0 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.728196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b9814-00fa-49fa-ad81-06b9775e24e0 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.728737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.729149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b9814-00fa-49fa-ad81-06b9775e24e0 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.730022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b9814-00fa-49fa-ad81-06b9775e24e0 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.731392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b9814-00fa-49fa-ad81-06b9775e24e0 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.731545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.732238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e2b9814-00fa-49fa-ad81-06b9775e24e0 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.735503 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ca282fd-6908-4c5e-a871-001fce2d0d87 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.257828 Oct 04 18:17:50.741553 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1984/3994] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:50 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:50.829928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e2b9814-00fa-49fa-ad81-06b9775e24e0 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.843744 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e2b9814-00fa-49fa-ad81-06b9775e24e0 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1219 microversion: 2.1 time: 0.129828 Oct 04 18:17:50.845673 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2011/3995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:50 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:51.285199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a622ece-0f4d-40b3-ad28-d919640d431b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.287881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3a622ece-0f4d-40b3-ad28-d919640d431b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.305152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a622ece-0f4d-40b3-ad28-d919640d431b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.305705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a622ece-0f4d-40b3-ad28-d919640d431b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.306180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a622ece-0f4d-40b3-ad28-d919640d431b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.306928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a622ece-0f4d-40b3-ad28-d919640d431b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.311707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a622ece-0f4d-40b3-ad28-d919640d431b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.315656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a622ece-0f4d-40b3-ad28-d919640d431b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.728962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3a622ece-0f4d-40b3-ad28-d919640d431b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.737516 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a622ece-0f4d-40b3-ad28-d919640d431b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1513 microversion: 2.1 time: 0.457933 Oct 04 18:17:51.744887 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1985/3996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1513 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:51.765609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e873b65-f1d4-41a9-8cad-c1ef3f0d088a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.772292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.773444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e873b65-f1d4-41a9-8cad-c1ef3f0d088a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.779025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.792353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e873b65-f1d4-41a9-8cad-c1ef3f0d088a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.798537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.799979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.800563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e873b65-f1d4-41a9-8cad-c1ef3f0d088a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.801121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e873b65-f1d4-41a9-8cad-c1ef3f0d088a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.801790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.803077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e873b65-f1d4-41a9-8cad-c1ef3f0d088a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.804083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.805174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.806234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e873b65-f1d4-41a9-8cad-c1ef3f0d088a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.806981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.807665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e873b65-f1d4-41a9-8cad-c1ef3f0d088a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.676557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.696341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.699196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.701345 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-23efbfdf-599d-43a1-afe3-dd204bbb70be tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.932940 Oct 04 18:17:52.722890 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1986/3997] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:52.731713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7b96c36-7e84-4a87-a61b-a362157f077f tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:52.733044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a7b96c36-7e84-4a87-a61b-a362157f077f tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:52.747601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:52.749683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b96c36-7e84-4a87-a61b-a362157f077f tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.750692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b96c36-7e84-4a87-a61b-a362157f077f tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.751409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b96c36-7e84-4a87-a61b-a362157f077f tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.752461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b96c36-7e84-4a87-a61b-a362157f077f tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.753182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b96c36-7e84-4a87-a61b-a362157f077f tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.753856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b96c36-7e84-4a87-a61b-a362157f077f tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.059817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e873b65-f1d4-41a9-8cad-c1ef3f0d088a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.084167 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e873b65-f1d4-41a9-8cad-c1ef3f0d088a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1513 microversion: 2.1 time: 1.324390 Oct 04 18:17:53.087273 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2012/3998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1513 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:53.142344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a7b96c36-7e84-4a87-a61b-a362157f077f tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.161756 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a7b96c36-7e84-4a87-a61b-a362157f077f tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1275 microversion: 2.1 time: 0.435978 Oct 04 18:17:53.174353 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1987/3999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:52 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1275 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:53.198283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:53.199152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:53.216986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.217493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.220759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.228302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.230730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.231517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.289654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lazy-loading 'flavor' on Instance uuid afef2588-b2e9-4b9e-943c-44469215dd64 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:53.329772 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Cannot 'shelve' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state shelved_offloaded Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action HTTP/1.1 Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 14 Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: {"shelve": {}} Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'shelve' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state shelved_offloaded Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'afef2588-b2e9-4b9e-943c-44469215dd64', 'body': {'shelve': {}}} Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afef2588-b2e9-4b9e-943c-44469215dd64 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:17:53.331759 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state shelved_offloaded Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state shelved_offloaded Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:17:53.337438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 409 to user: Cannot 'shelve' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state shelved_offloaded {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:53.340009 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f0fbf87-f11d-4223-a500-4e0ea4a07b1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 409 len: 155 microversion: 2.1 time: 0.145913 Oct 04 18:17:53.351470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2013/4000] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:53 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 155 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:17:53.360390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d80fa2fd-f0c1-4a6d-936f-d70b73f4fdfd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:53.360936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d80fa2fd-f0c1-4a6d-936f-d70b73f4fdfd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:53.375004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d80fa2fd-f0c1-4a6d-936f-d70b73f4fdfd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.376302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d80fa2fd-f0c1-4a6d-936f-d70b73f4fdfd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.377058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d80fa2fd-f0c1-4a6d-936f-d70b73f4fdfd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.378680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d80fa2fd-f0c1-4a6d-936f-d70b73f4fdfd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.380009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d80fa2fd-f0c1-4a6d-936f-d70b73f4fdfd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.380698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d80fa2fd-f0c1-4a6d-936f-d70b73f4fdfd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.459233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d80fa2fd-f0c1-4a6d-936f-d70b73f4fdfd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122331) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:17:53.599481 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d80fa2fd-f0c1-4a6d-936f-d70b73f4fdfd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 202 len: 0 microversion: 2.1 time: 0.243583 Oct 04 18:17:53.601837 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1988/4001] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:53 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:17:53.610582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d7668324-eb36-4f1e-b69b-8b6ca7142bf1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:53.611666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d7668324-eb36-4f1e-b69b-8b6ca7142bf1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:53.623088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7668324-eb36-4f1e-b69b-8b6ca7142bf1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.625030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7668324-eb36-4f1e-b69b-8b6ca7142bf1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.625676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7668324-eb36-4f1e-b69b-8b6ca7142bf1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.626591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7668324-eb36-4f1e-b69b-8b6ca7142bf1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.628196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7668324-eb36-4f1e-b69b-8b6ca7142bf1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.630660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7668324-eb36-4f1e-b69b-8b6ca7142bf1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.730871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:53.731757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:53.745336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.746111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.746736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.747693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.748321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.748918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.884831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.904140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.916032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.920251 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-52f6a43b-4582-4802-8b57-2cd8a6764b18 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.192481 Oct 04 18:17:53.923259 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1989/4002] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:53 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:54.203820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-beee75d1-9f87-4ff9-80f0-24f8df0d8133 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.204754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-beee75d1-9f87-4ff9-80f0-24f8df0d8133 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.216305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-beee75d1-9f87-4ff9-80f0-24f8df0d8133 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.216829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-beee75d1-9f87-4ff9-80f0-24f8df0d8133 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.217278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-beee75d1-9f87-4ff9-80f0-24f8df0d8133 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.218044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-beee75d1-9f87-4ff9-80f0-24f8df0d8133 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.218510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-beee75d1-9f87-4ff9-80f0-24f8df0d8133 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.218944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-beee75d1-9f87-4ff9-80f0-24f8df0d8133 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.580877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d7668324-eb36-4f1e-b69b-8b6ca7142bf1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.589653 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d7668324-eb36-4f1e-b69b-8b6ca7142bf1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1461 microversion: 2.1 time: 0.983798 Oct 04 18:17:54.600121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-beee75d1-9f87-4ff9-80f0-24f8df0d8133 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.606784 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2014/4003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:53 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1461 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:54.609778 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-beee75d1-9f87-4ff9-80f0-24f8df0d8133 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1273 microversion: 2.1 time: 0.410540 Oct 04 18:17:54.613554 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1990/4004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1273 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:54.956005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.958005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.966691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.967607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.968420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.969674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.970590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.972246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.093948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.106343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.109870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.112246 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4fc1e93c-7cfa-4b0a-b9bd-8225b8ac4b21 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.161877 Oct 04 18:17:55.129634 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2015/4005] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:55.641696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-54bb8d96-4540-4eb1-bc9e-e32e05b17532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:55.643101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-416501f4-e812-4369-a99d-3b4fdc6b26b7 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:55.645014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-54bb8d96-4540-4eb1-bc9e-e32e05b17532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:55.646744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-416501f4-e812-4369-a99d-3b4fdc6b26b7 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:55.660673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-416501f4-e812-4369-a99d-3b4fdc6b26b7 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.661816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54bb8d96-4540-4eb1-bc9e-e32e05b17532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.662505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-416501f4-e812-4369-a99d-3b4fdc6b26b7 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.664002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-416501f4-e812-4369-a99d-3b4fdc6b26b7 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.665340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54bb8d96-4540-4eb1-bc9e-e32e05b17532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.666448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54bb8d96-4540-4eb1-bc9e-e32e05b17532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.666933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-416501f4-e812-4369-a99d-3b4fdc6b26b7 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.670106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-416501f4-e812-4369-a99d-3b4fdc6b26b7 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.670887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54bb8d96-4540-4eb1-bc9e-e32e05b17532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.672943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-416501f4-e812-4369-a99d-3b4fdc6b26b7 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.673821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54bb8d96-4540-4eb1-bc9e-e32e05b17532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.676229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54bb8d96-4540-4eb1-bc9e-e32e05b17532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.830096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-416501f4-e812-4369-a99d-3b4fdc6b26b7 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.839317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-416501f4-e812-4369-a99d-3b4fdc6b26b7 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1273 microversion: 2.1 time: 0.207161 Oct 04 18:17:55.845118 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2016/4006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:55 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:56.080080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-54bb8d96-4540-4eb1-bc9e-e32e05b17532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.089066 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-54bb8d96-4540-4eb1-bc9e-e32e05b17532 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1461 microversion: 2.1 time: 0.462317 Oct 04 18:17:56.095312 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1991/4007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:55 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1461 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:56.143539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:56.144474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:56.159206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.160017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.160654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.161741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.164242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.164914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.322594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.339343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.341703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.343768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ba66e32-f2df-447a-8aeb-49a1b736ca36 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.203699 Oct 04 18:17:56.344868 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2017/4008] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:56 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:56.870825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c1ec6d54-eaed-4118-9c2c-c9ee0fa2437a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:56.871668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c1ec6d54-eaed-4118-9c2c-c9ee0fa2437a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:56.884743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1ec6d54-eaed-4118-9c2c-c9ee0fa2437a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.887423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1ec6d54-eaed-4118-9c2c-c9ee0fa2437a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.888136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1ec6d54-eaed-4118-9c2c-c9ee0fa2437a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.891566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1ec6d54-eaed-4118-9c2c-c9ee0fa2437a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.892380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1ec6d54-eaed-4118-9c2c-c9ee0fa2437a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.893063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1ec6d54-eaed-4118-9c2c-c9ee0fa2437a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.115049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-36952374-1395-472b-90f3-2e66a82837cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:57.115686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-36952374-1395-472b-90f3-2e66a82837cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:57.127187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36952374-1395-472b-90f3-2e66a82837cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.127609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36952374-1395-472b-90f3-2e66a82837cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.128060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36952374-1395-472b-90f3-2e66a82837cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.128783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36952374-1395-472b-90f3-2e66a82837cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.129246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36952374-1395-472b-90f3-2e66a82837cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.129682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36952374-1395-472b-90f3-2e66a82837cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.234268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c1ec6d54-eaed-4118-9c2c-c9ee0fa2437a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.245956 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c1ec6d54-eaed-4118-9c2c-c9ee0fa2437a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.377192 Oct 04 18:17:57.264132 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1992/4009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:56 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:57.374939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:57.375960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:57.403325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.403978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.405938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.406836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.408427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.414043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.533430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-36952374-1395-472b-90f3-2e66a82837cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.555891 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-36952374-1395-472b-90f3-2e66a82837cd tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.439710 Oct 04 18:17:57.570281 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2018/4010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:57 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:57.693571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.717704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.733671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.737841 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9eafc698-e370-44a6-b26e-97d14b7079d7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.365197 Oct 04 18:17:57.754998 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1993/4011] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:57 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:58.271836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-873d9ea6-051c-4272-a460-4ea61a8c0940 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:58.272459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-873d9ea6-051c-4272-a460-4ea61a8c0940 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:58.297786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873d9ea6-051c-4272-a460-4ea61a8c0940 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.297786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873d9ea6-051c-4272-a460-4ea61a8c0940 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.297786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873d9ea6-051c-4272-a460-4ea61a8c0940 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.297786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873d9ea6-051c-4272-a460-4ea61a8c0940 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.297786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873d9ea6-051c-4272-a460-4ea61a8c0940 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.297786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-873d9ea6-051c-4272-a460-4ea61a8c0940 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.585113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-936d040e-edcb-4a26-ac07-c4e73f614a4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:58.586399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-936d040e-edcb-4a26-ac07-c4e73f614a4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:58.604749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936d040e-edcb-4a26-ac07-c4e73f614a4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.605525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936d040e-edcb-4a26-ac07-c4e73f614a4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.607243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936d040e-edcb-4a26-ac07-c4e73f614a4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.608247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936d040e-edcb-4a26-ac07-c4e73f614a4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.609818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936d040e-edcb-4a26-ac07-c4e73f614a4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.612472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-936d040e-edcb-4a26-ac07-c4e73f614a4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.158693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:59.196014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-936d040e-edcb-4a26-ac07-c4e73f614a4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.206673 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-936d040e-edcb-4a26-ac07-c4e73f614a4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.626803 Oct 04 18:17:59.211317 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1994/4012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:58 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:59.219890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:59.225952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:59.237870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:59.258924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.264582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.265346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.270727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.276272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.277024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.282981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:59.374210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-873d9ea6-051c-4272-a460-4ea61a8c0940 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.384406 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-873d9ea6-051c-4272-a460-4ea61a8c0940 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 1.116444 Oct 04 18:17:59.392940 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2019/4013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:58 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:59.469285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.489658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.499481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.505769 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c8a641fc-841c-43d1-a3db-7d56dd20d8f9 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.290303 Oct 04 18:17:59.516098 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1995/4014] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:59 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:00.239075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6bf1468b-c477-4658-b9a6-c9c962429995 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:00.239642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6bf1468b-c477-4658-b9a6-c9c962429995 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:00.252581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf1468b-c477-4658-b9a6-c9c962429995 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.253091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf1468b-c477-4658-b9a6-c9c962429995 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.253537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf1468b-c477-4658-b9a6-c9c962429995 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.254254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf1468b-c477-4658-b9a6-c9c962429995 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.254711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf1468b-c477-4658-b9a6-c9c962429995 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.268205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bf1468b-c477-4658-b9a6-c9c962429995 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.426421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-757d8c14-46a9-4bcb-837a-4b990e21496d tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:00.427136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-757d8c14-46a9-4bcb-837a-4b990e21496d tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:00.429984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:00.478130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-757d8c14-46a9-4bcb-837a-4b990e21496d tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.480024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-757d8c14-46a9-4bcb-837a-4b990e21496d tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.481505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-757d8c14-46a9-4bcb-837a-4b990e21496d tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.484044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-757d8c14-46a9-4bcb-837a-4b990e21496d tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.487509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-757d8c14-46a9-4bcb-837a-4b990e21496d tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.489167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-757d8c14-46a9-4bcb-837a-4b990e21496d tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.742174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6bf1468b-c477-4658-b9a6-c9c962429995 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.750882 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6bf1468b-c477-4658-b9a6-c9c962429995 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.516345 Oct 04 18:18:00.755805 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2020/4015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:00 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:00.769237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:00.769858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:00.784648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.785363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.785997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.787981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.788452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.788898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.972428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.985424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:00.994494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.997345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.999356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-757d8c14-46a9-4bcb-837a-4b990e21496d tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.007085 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-01f9c279-a9ce-44fa-b8f4-70dcf62ae4b2 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.249839 Oct 04 18:18:01.010641 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2021/4016] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:00 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:01.014204 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-757d8c14-46a9-4bcb-837a-4b990e21496d tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.594262 Oct 04 18:18:01.028031 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1996/4017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:00 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:01.778384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c310221-fd3e-4885-bedb-19769500769d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:01.779632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c310221-fd3e-4885-bedb-19769500769d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:01.831239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c310221-fd3e-4885-bedb-19769500769d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.840272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c310221-fd3e-4885-bedb-19769500769d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.841563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c310221-fd3e-4885-bedb-19769500769d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.843081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c310221-fd3e-4885-bedb-19769500769d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.843974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c310221-fd3e-4885-bedb-19769500769d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.844667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c310221-fd3e-4885-bedb-19769500769d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.035153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:02.035153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:02.054303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.057461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.060835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.066303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.067065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.068693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.647289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.669291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.671862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.684211 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4b5ee411-8d3b-4eda-ac28-ee8d92a365ac tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.654256 Oct 04 18:18:02.707483 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1997/4018] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:02 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:02.737729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-86b5fe85-c07b-45df-a2cb-dd19cc69cf19 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:02.738639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-86b5fe85-c07b-45df-a2cb-dd19cc69cf19 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:02.785030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b5fe85-c07b-45df-a2cb-dd19cc69cf19 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.785688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b5fe85-c07b-45df-a2cb-dd19cc69cf19 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.786206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b5fe85-c07b-45df-a2cb-dd19cc69cf19 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.787081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b5fe85-c07b-45df-a2cb-dd19cc69cf19 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.787535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b5fe85-c07b-45df-a2cb-dd19cc69cf19 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.788024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-86b5fe85-c07b-45df-a2cb-dd19cc69cf19 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.868733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c310221-fd3e-4885-bedb-19769500769d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.901133 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c310221-fd3e-4885-bedb-19769500769d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 1.128202 Oct 04 18:18:02.926052 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2022/4019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:01 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:02.938050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fd176ffe-b437-4040-a604-ce88c173ce22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:02.946010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fd176ffe-b437-4040-a604-ce88c173ce22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:02.977846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd176ffe-b437-4040-a604-ce88c173ce22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.978349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd176ffe-b437-4040-a604-ce88c173ce22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.978787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd176ffe-b437-4040-a604-ce88c173ce22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.010543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd176ffe-b437-4040-a604-ce88c173ce22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.010543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd176ffe-b437-4040-a604-ce88c173ce22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.010881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd176ffe-b437-4040-a604-ce88c173ce22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.155118 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fd176ffe-b437-4040-a604-ce88c173ce22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/ips" status: 200 len: 146 microversion: 2.1 time: 0.227568 Oct 04 18:18:03.155770 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2023/4020] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:18:02 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/ips => generated 146 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:03.196681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1950975e-abaf-4961-90a0-7d6e5cc282b0 req-37598504-9774-45ac-ad16-bdfebc078702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbdbedd-0c7d-4d45-9376-90f5992b43d6", "tag": "fa5a9f83-0fd5-4383-afbe-a468ed9d8c10"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:03.270632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1950975e-abaf-4961-90a0-7d6e5cc282b0 req-37598504-9774-45ac-ad16-bdfebc078702 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.271427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1950975e-abaf-4961-90a0-7d6e5cc282b0 req-37598504-9774-45ac-ad16-bdfebc078702 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.272116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1950975e-abaf-4961-90a0-7d6e5cc282b0 req-37598504-9774-45ac-ad16-bdfebc078702 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.352090 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1950975e-abaf-4961-90a0-7d6e5cc282b0 req-37598504-9774-45ac-ad16-bdfebc078702 service nova] Creating event network-changed:fa5a9f83-0fd5-4383-afbe-a468ed9d8c10 for instance 4cbdbedd-0c7d-4d45-9376-90f5992b43d6 on n-h2-850499-14 Oct 04 18:18:03.369079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-86b5fe85-c07b-45df-a2cb-dd19cc69cf19 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:03.377454 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1950975e-abaf-4961-90a0-7d6e5cc282b0 req-37598504-9774-45ac-ad16-bdfebc078702 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203548 Oct 04 18:18:03.378085 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2024/4021] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:03.384800 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-86b5fe85-c07b-45df-a2cb-dd19cc69cf19 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.675732 Oct 04 18:18:03.388270 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1998/4022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:02 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:03.725322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:03.726046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:03.752258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.752883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.753340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.759579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.762476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.763003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.929954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-642913a0-0557-436a-b707-67841570d154 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:03.930813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-642913a0-0557-436a-b707-67841570d154 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:03.947480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-642913a0-0557-436a-b707-67841570d154 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.953940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-642913a0-0557-436a-b707-67841570d154 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.959985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-642913a0-0557-436a-b707-67841570d154 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.976737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-642913a0-0557-436a-b707-67841570d154 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.980258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-642913a0-0557-436a-b707-67841570d154 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.997689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-642913a0-0557-436a-b707-67841570d154 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.113496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.134180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.135780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.151771 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3131671c-de3f-4e3d-b030-7eb7cc80158f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.432729 Oct 04 18:18:04.173780 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2025/4023] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:03 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:04.418043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-41cc98fb-aca2-4dc0-ab12-ed5010aafa0c tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:04.418744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-41cc98fb-aca2-4dc0-ab12-ed5010aafa0c tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:04.445237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41cc98fb-aca2-4dc0-ab12-ed5010aafa0c tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.445750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41cc98fb-aca2-4dc0-ab12-ed5010aafa0c tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.446203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41cc98fb-aca2-4dc0-ab12-ed5010aafa0c tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.454902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41cc98fb-aca2-4dc0-ab12-ed5010aafa0c tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.458617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41cc98fb-aca2-4dc0-ab12-ed5010aafa0c tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.459167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41cc98fb-aca2-4dc0-ab12-ed5010aafa0c tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.307374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-642913a0-0557-436a-b707-67841570d154 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:05.331381 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-642913a0-0557-436a-b707-67841570d154 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 1.405684 Oct 04 18:18:05.339964 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 1999/4024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:03 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:05.385409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:05.391774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:05.469819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.472114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.474083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.476865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.478759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.480720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.678963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.696991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.704617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.706184 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ecaf2735-19e5-4a08-a6ac-7e368de7a684 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 1.358324 Oct 04 18:18:06.733394 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2000/4025] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:05 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:06.748905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4830c5ec-c15d-46de-a358-03b5ff455b4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:06.774999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4830c5ec-c15d-46de-a358-03b5ff455b4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.797566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4830c5ec-c15d-46de-a358-03b5ff455b4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.798088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4830c5ec-c15d-46de-a358-03b5ff455b4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.805721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4830c5ec-c15d-46de-a358-03b5ff455b4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.806545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4830c5ec-c15d-46de-a358-03b5ff455b4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.809072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4830c5ec-c15d-46de-a358-03b5ff455b4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.810904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4830c5ec-c15d-46de-a358-03b5ff455b4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.892824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-41cc98fb-aca2-4dc0-ab12-ed5010aafa0c tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.908875 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-41cc98fb-aca2-4dc0-ab12-ed5010aafa0c tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 2.493691 Oct 04 18:18:06.910702 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2026/4026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:04 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 2497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:07.308125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4830c5ec-c15d-46de-a358-03b5ff455b4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.328414 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4830c5ec-c15d-46de-a358-03b5ff455b4d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.593096 Oct 04 18:18:07.331726 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2001/4027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:06 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:07.740161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.748629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.759803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.760634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.761253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.763079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.766293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.772357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.947588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.966088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.972918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.975866 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-496f9467-71d2-4a51-a4b6-830ef7319980 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.239787 Oct 04 18:18:07.980204 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2002/4028] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:07 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:08.003265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b25d371e-1ad0-4c5d-ab66-25d022f922cb tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:08.004977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b25d371e-1ad0-4c5d-ab66-25d022f922cb tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:08.014583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-733608120", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "0f4ef4c9-5d0e-443d-9939-8fd5f5f5b311"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:08.025481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b25d371e-1ad0-4c5d-ab66-25d022f922cb tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.027053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b25d371e-1ad0-4c5d-ab66-25d022f922cb tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.027807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b25d371e-1ad0-4c5d-ab66-25d022f922cb tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.030004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b25d371e-1ad0-4c5d-ab66-25d022f922cb tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.031964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b25d371e-1ad0-4c5d-ab66-25d022f922cb tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.033231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b25d371e-1ad0-4c5d-ab66-25d022f922cb tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.293788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b25d371e-1ad0-4c5d-ab66-25d022f922cb tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.304712 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b25d371e-1ad0-4c5d-ab66-25d022f922cb tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.322340 Oct 04 18:18:08.305545 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2003/4029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:07 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:08.355443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d18b143f-3608-4ed8-b89d-fa9a53767ab3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:08.356547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d18b143f-3608-4ed8-b89d-fa9a53767ab3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:08.366555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d18b143f-3608-4ed8-b89d-fa9a53767ab3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.369576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d18b143f-3608-4ed8-b89d-fa9a53767ab3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.370343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d18b143f-3608-4ed8-b89d-fa9a53767ab3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.373103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d18b143f-3608-4ed8-b89d-fa9a53767ab3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.373962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d18b143f-3608-4ed8-b89d-fa9a53767ab3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.377158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d18b143f-3608-4ed8-b89d-fa9a53767ab3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.658868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d18b143f-3608-4ed8-b89d-fa9a53767ab3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.674409 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d18b143f-3608-4ed8-b89d-fa9a53767ab3 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.322979 Oct 04 18:18:08.675156 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2004/4030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:08 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:08.684037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-54029efa-af30-4fdf-9470-dd92eef26aa8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1da8e2d7-9517-4945-aeee-a3880569ac56"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:08.688747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-54029efa-af30-4fdf-9470-dd92eef26aa8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:08.716344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54029efa-af30-4fdf-9470-dd92eef26aa8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.719277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54029efa-af30-4fdf-9470-dd92eef26aa8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.719874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54029efa-af30-4fdf-9470-dd92eef26aa8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.720899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54029efa-af30-4fdf-9470-dd92eef26aa8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.724860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54029efa-af30-4fdf-9470-dd92eef26aa8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.725432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54029efa-af30-4fdf-9470-dd92eef26aa8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.292306 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-54029efa-af30-4fdf-9470-dd92eef26aa8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613198 Oct 04 18:18:09.294205 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2005/4031] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:18:08 2022] POST /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/os-volume_attachments => generated 194 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:09.306855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:09.321075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:09.369793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.371425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.372757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.376267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.377015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.379518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.659480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:09.674211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:09.675741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:09.676985 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd69a891-722e-4a7f-8cf9-8da9cca022db tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.381359 Oct 04 18:18:09.677862 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2006/4032] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:09 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:09.702493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f3633d0b-ccb1-49e1-9e54-ae722d0c2a12 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:09.707168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f3633d0b-ccb1-49e1-9e54-ae722d0c2a12 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:09.726905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3633d0b-ccb1-49e1-9e54-ae722d0c2a12 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.727878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3633d0b-ccb1-49e1-9e54-ae722d0c2a12 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.728664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3633d0b-ccb1-49e1-9e54-ae722d0c2a12 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.729700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3633d0b-ccb1-49e1-9e54-ae722d0c2a12 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.732376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3633d0b-ccb1-49e1-9e54-ae722d0c2a12 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.733349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3633d0b-ccb1-49e1-9e54-ae722d0c2a12 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.042824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f3633d0b-ccb1-49e1-9e54-ae722d0c2a12 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.066055 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f3633d0b-ccb1-49e1-9e54-ae722d0c2a12 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.380374 Oct 04 18:18:10.069152 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2007/4033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:09 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:10.089569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9efd5905-61cd-485f-baf6-9386956ad166 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:10.093663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9efd5905-61cd-485f-baf6-9386956ad166 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:10.123719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9efd5905-61cd-485f-baf6-9386956ad166 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.126986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9efd5905-61cd-485f-baf6-9386956ad166 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.127822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9efd5905-61cd-485f-baf6-9386956ad166 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.129024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9efd5905-61cd-485f-baf6-9386956ad166 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.148160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9efd5905-61cd-485f-baf6-9386956ad166 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.149808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9efd5905-61cd-485f-baf6-9386956ad166 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.691241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9efd5905-61cd-485f-baf6-9386956ad166 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.705658 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9efd5905-61cd-485f-baf6-9386956ad166 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.635067 Oct 04 18:18:10.711558 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2008/4034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:10 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:10.724715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:10.733204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:10.756949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.764511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.766019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.774239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.775212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.776981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.031318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.062031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.076260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.084309 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a40d21e0-ba8a-4298-8564-eb2bad642cd7 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.371360 Oct 04 18:18:11.087247 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2009/4035] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:10 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:11.097716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ab55f09-abeb-460c-9b5a-4894e7a1cd5b tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:11.123486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ab55f09-abeb-460c-9b5a-4894e7a1cd5b tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.165224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ab55f09-abeb-460c-9b5a-4894e7a1cd5b tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.166161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ab55f09-abeb-460c-9b5a-4894e7a1cd5b tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.168744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ab55f09-abeb-460c-9b5a-4894e7a1cd5b tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.169769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ab55f09-abeb-460c-9b5a-4894e7a1cd5b tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.182193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ab55f09-abeb-460c-9b5a-4894e7a1cd5b tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.183927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ab55f09-abeb-460c-9b5a-4894e7a1cd5b tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.261721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:11.662903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ab55f09-abeb-460c-9b5a-4894e7a1cd5b tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.676747 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ab55f09-abeb-460c-9b5a-4894e7a1cd5b tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.583769 Oct 04 18:18:11.677353 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2010/4036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:11.736005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee7ecf46-5ed6-43d2-917f-a3e63e01fe97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:11.736679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ee7ecf46-5ed6-43d2-917f-a3e63e01fe97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.762848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee7ecf46-5ed6-43d2-917f-a3e63e01fe97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.763776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee7ecf46-5ed6-43d2-917f-a3e63e01fe97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.771369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee7ecf46-5ed6-43d2-917f-a3e63e01fe97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.773938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee7ecf46-5ed6-43d2-917f-a3e63e01fe97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.778869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee7ecf46-5ed6-43d2-917f-a3e63e01fe97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.779735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee7ecf46-5ed6-43d2-917f-a3e63e01fe97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.220028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee7ecf46-5ed6-43d2-917f-a3e63e01fe97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:12.260513 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ee7ecf46-5ed6-43d2-917f-a3e63e01fe97 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.522871 Oct 04 18:18:12.279317 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2011/4037] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:12.292816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.295563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.316800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.318174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.319862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.321764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.324193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.328152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.494032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:12.513361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:12.519080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:12.522113 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cef22dd1-983e-40dd-bb3e-74271e700478 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.241330 Oct 04 18:18:12.523023 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2012/4038] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:12 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:12.701216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f8f6694-8dfb-4aaf-9c1d-c4d7ea4d829a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.701911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f8f6694-8dfb-4aaf-9c1d-c4d7ea4d829a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.714596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f8f6694-8dfb-4aaf-9c1d-c4d7ea4d829a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.718508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f8f6694-8dfb-4aaf-9c1d-c4d7ea4d829a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.719011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f8f6694-8dfb-4aaf-9c1d-c4d7ea4d829a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.719783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f8f6694-8dfb-4aaf-9c1d-c4d7ea4d829a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.724188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f8f6694-8dfb-4aaf-9c1d-c4d7ea4d829a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.724790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f8f6694-8dfb-4aaf-9c1d-c4d7ea4d829a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.170911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f8f6694-8dfb-4aaf-9c1d-c4d7ea4d829a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.184419 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f8f6694-8dfb-4aaf-9c1d-c4d7ea4d829a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.487320 Oct 04 18:18:13.202980 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2013/4039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:12 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:13.294468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a737a389-89e2-44fe-9e0b-770916899108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:13.295328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a737a389-89e2-44fe-9e0b-770916899108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:13.309457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a737a389-89e2-44fe-9e0b-770916899108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.310128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a737a389-89e2-44fe-9e0b-770916899108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.311518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a737a389-89e2-44fe-9e0b-770916899108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.314668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a737a389-89e2-44fe-9e0b-770916899108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.316861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a737a389-89e2-44fe-9e0b-770916899108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.319709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a737a389-89e2-44fe-9e0b-770916899108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.701434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a737a389-89e2-44fe-9e0b-770916899108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.711274 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a737a389-89e2-44fe-9e0b-770916899108 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.423741 Oct 04 18:18:13.722686 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2014/4040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:13 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:13.738083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:13.740880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:13.757616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.759354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.760956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.763345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.765523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.768507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.182020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:14.203705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:14.214715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:14.224357 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-163dce0e-b929-4f6e-a3c4-bd82754efe4f tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.500138 Oct 04 18:18:14.225854 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2015/4041] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:13 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:14.235170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5eec6c89-0116-4b59-9fd2-c66da316d60a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:14.236281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5eec6c89-0116-4b59-9fd2-c66da316d60a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:14.272825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec6c89-0116-4b59-9fd2-c66da316d60a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.277666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec6c89-0116-4b59-9fd2-c66da316d60a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.280295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec6c89-0116-4b59-9fd2-c66da316d60a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.287030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec6c89-0116-4b59-9fd2-c66da316d60a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.288824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec6c89-0116-4b59-9fd2-c66da316d60a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.290222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec6c89-0116-4b59-9fd2-c66da316d60a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.189995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5eec6c89-0116-4b59-9fd2-c66da316d60a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:15.199297 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5eec6c89-0116-4b59-9fd2-c66da316d60a tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.971276 Oct 04 18:18:15.203929 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2016/4042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:14 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:15.229178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1cf5666-8235-4847-b267-623e329c76a1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:15.234656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e1cf5666-8235-4847-b267-623e329c76a1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:15.254416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cf5666-8235-4847-b267-623e329c76a1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.267921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cf5666-8235-4847-b267-623e329c76a1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.268784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cf5666-8235-4847-b267-623e329c76a1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.269954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cf5666-8235-4847-b267-623e329c76a1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.270903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cf5666-8235-4847-b267-623e329c76a1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.271768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1cf5666-8235-4847-b267-623e329c76a1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.772759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1cf5666-8235-4847-b267-623e329c76a1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:15.788808 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1cf5666-8235-4847-b267-623e329c76a1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.583304 Oct 04 18:18:15.795514 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2017/4043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:15 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:15.803794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:15.804437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:15.811012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.811749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.812157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.813182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.836104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.836582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.136595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.168220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.179567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbb0f91947e404d931fcc6fe7cfb9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122253078dc44e1fb2f880d0ebecac02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.187444 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-199744a7-eabb-4e97-bd7f-8331c0d422ee tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 200 len: 1604 microversion: 2.32 time: 0.389158 Oct 04 18:18:16.190920 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2018/4044] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:15 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 1604 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:16.233375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-415515f5-fe05-434d-b0bb-626294d2ccf5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.234871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-415515f5-fe05-434d-b0bb-626294d2ccf5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.258585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-415515f5-fe05-434d-b0bb-626294d2ccf5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.260169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-415515f5-fe05-434d-b0bb-626294d2ccf5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.265889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-415515f5-fe05-434d-b0bb-626294d2ccf5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.270401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-415515f5-fe05-434d-b0bb-626294d2ccf5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.271579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-415515f5-fe05-434d-b0bb-626294d2ccf5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.274984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-415515f5-fe05-434d-b0bb-626294d2ccf5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.885182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-415515f5-fe05-434d-b0bb-626294d2ccf5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.898383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=24 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:16.911221 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-415515f5-fe05-434d-b0bb-626294d2ccf5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.681145 Oct 04 18:18:16.936790 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2019/4045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:16.959526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3bcc1a4a-4ea2-4948-b218-0b9d2fb4d829 req-94674a08-fff9-4bbf-91d2-7ec2c69affab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbdbedd-0c7d-4d45-9376-90f5992b43d6", "name": "network-vif-plugged", "status": "completed", "tag": "fa5a9f83-0fd5-4383-afbe-a468ed9d8c10"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:17.014147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3bcc1a4a-4ea2-4948-b218-0b9d2fb4d829 req-94674a08-fff9-4bbf-91d2-7ec2c69affab service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.019350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3bcc1a4a-4ea2-4948-b218-0b9d2fb4d829 req-94674a08-fff9-4bbf-91d2-7ec2c69affab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.019881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3bcc1a4a-4ea2-4948-b218-0b9d2fb4d829 req-94674a08-fff9-4bbf-91d2-7ec2c69affab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.081524 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3bcc1a4a-4ea2-4948-b218-0b9d2fb4d829 req-94674a08-fff9-4bbf-91d2-7ec2c69affab service nova] Creating event network-vif-plugged:fa5a9f83-0fd5-4383-afbe-a468ed9d8c10 for instance 4cbdbedd-0c7d-4d45-9376-90f5992b43d6 on n-h2-850499-14 Oct 04 18:18:17.110016 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3bcc1a4a-4ea2-4948-b218-0b9d2fb4d829 req-94674a08-fff9-4bbf-91d2-7ec2c69affab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166794 Oct 04 18:18:17.112842 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2020/4046] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:17.126723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-35a12e01-1871-4b04-99a7-725435bca75e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.127801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-35a12e01-1871-4b04-99a7-725435bca75e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:17.144569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a12e01-1871-4b04-99a7-725435bca75e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.147548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a12e01-1871-4b04-99a7-725435bca75e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.163263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a12e01-1871-4b04-99a7-725435bca75e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.167437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a12e01-1871-4b04-99a7-725435bca75e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.168455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a12e01-1871-4b04-99a7-725435bca75e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.171725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a12e01-1871-4b04-99a7-725435bca75e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.497390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-35a12e01-1871-4b04-99a7-725435bca75e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:17.508964 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-35a12e01-1871-4b04-99a7-725435bca75e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.394207 Oct 04 18:18:17.511293 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2021/4047] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:17 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:17.520473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.523870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:17.537553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.538335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.541392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.542371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.543050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.547363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.579506 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] HTTP exception thrown: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Request method failure captured: Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 HTTP/1.1 Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHdByQykTqUh1U05I8rP3mJbJzbiOOXyIke2z0kglGUbGx1f2EK4bAnQE0SUbYBojkEqRGPyMm5_WTsR5xrFQ73wSQ4iLWfS_ewmGh0-1-ofzP6eldRGI3jm0BYDsJEUa6V3Ix0k1wzA5R2DyUsUfMx-g0fNl3vTJCENmUnz13bgftc Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 122253078dc44e1fb2f880d0ebecac02 Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TaggedBootDevicesTest-730786783 Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_122253078dc44e1fb2f880d0ebecac02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/122253078dc44e1fb2f880d0ebecac02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/122253078dc44e1fb2f880d0ebecac02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/122253078dc44e1fb2f880d0ebecac02"}]}] Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TaggedBootDevicesTest-730786783 Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 122253078dc44e1fb2f880d0ebecac02 Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TaggedBootDevicesTest-730786783 Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TaggedBootDevicesTest-730786783-project Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 4dbb0f91947e404d931fcc6fe7cfb9db Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TaggedBootDevicesTest-730786783-project Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'dd959367-f389-406d-8ec3-e5dbd3ab8ae7'} Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:17.584900 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.590922 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:17.590922 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:17.590922 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:17.590922 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:17.590922 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:17.590922 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:17.590922 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:17.592681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Returning 404 to user: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:17.594427 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-552fe827-9c4a-487a-b160-6a51bac83eea tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 404 len: 111 microversion: 2.32 time: 0.081956 Oct 04 18:18:17.598856 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2022/4048] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:17 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:17.604145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9024b1d2-c66d-425b-889b-f0e272a679e0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '.version_select at 0x7fd4d1242670>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.653246 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9024b1d2-c66d-425b-889b-f0e272a679e0 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842530237" status: 204 len: 0 microversion: 2.32 time: 0.052870 Oct 04 18:18:17.662830 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2023/4049] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:18:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842530237 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:18:17.951385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d537b6b1-1e99-4417-af06-cc314ccd91af tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.952447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d537b6b1-1e99-4417-af06-cc314ccd91af tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:17.966397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d537b6b1-1e99-4417-af06-cc314ccd91af tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.967316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d537b6b1-1e99-4417-af06-cc314ccd91af tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.968551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d537b6b1-1e99-4417-af06-cc314ccd91af tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.976002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d537b6b1-1e99-4417-af06-cc314ccd91af tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.976855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d537b6b1-1e99-4417-af06-cc314ccd91af tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.977523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d537b6b1-1e99-4417-af06-cc314ccd91af tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.079746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:18.414940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d537b6b1-1e99-4417-af06-cc314ccd91af tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:18.430718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d537b6b1-1e99-4417-af06-cc314ccd91af tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.481812 Oct 04 18:18:18.432083 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2024/4050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:17 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:18.534369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-08c7a186-07a0-4ef8-bc53-ff595ef950b8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:18.536603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08c7a186-07a0-4ef8-bc53-ff595ef950b8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:18.564601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c7a186-07a0-4ef8-bc53-ff595ef950b8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.568196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c7a186-07a0-4ef8-bc53-ff595ef950b8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.572994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c7a186-07a0-4ef8-bc53-ff595ef950b8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.574945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c7a186-07a0-4ef8-bc53-ff595ef950b8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.576515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c7a186-07a0-4ef8-bc53-ff595ef950b8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.585244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c7a186-07a0-4ef8-bc53-ff595ef950b8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.973697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-08c7a186-07a0-4ef8-bc53-ff595ef950b8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:18.991280 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-08c7a186-07a0-4ef8-bc53-ff595ef950b8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.458167 Oct 04 18:18:18.992080 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2025/4051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:18 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:19.458516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dbcba237-3c42-432c-8b76-d9d7d4788e61 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:19.459282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dbcba237-3c42-432c-8b76-d9d7d4788e61 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:19.472544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbcba237-3c42-432c-8b76-d9d7d4788e61 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:19.474620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbcba237-3c42-432c-8b76-d9d7d4788e61 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:19.476604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbcba237-3c42-432c-8b76-d9d7d4788e61 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:19.479580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbcba237-3c42-432c-8b76-d9d7d4788e61 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:19.481939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbcba237-3c42-432c-8b76-d9d7d4788e61 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:19.482855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbcba237-3c42-432c-8b76-d9d7d4788e61 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:19.963599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dbcba237-3c42-432c-8b76-d9d7d4788e61 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:19.978009 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dbcba237-3c42-432c-8b76-d9d7d4788e61 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.524848 Oct 04 18:18:19.987657 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2026/4052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:19 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:20.161873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1545909543", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "b187d281-eb8f-4ee4-893c-375b043fd822"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:20.287845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] validate_networks() for [('0f4ef4c9-5d0e-443d-9939-8fd5f5f5b311', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:20.296723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] validate_networks() for [('b187d281-eb8f-4ee4-893c-375b043fd822', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:21.847740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:21.848267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:21.848825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:21.849591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:21.850630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:21.870727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.871979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.874339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:21.876070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.878465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.879227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:21.915313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:21.915313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:21.915313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:21.915313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:21.915313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:21.925105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Getting quotas for project 953ac3631ecb44ea9ff740d7c30580d9. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:21.927626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.928540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.933210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:21.934453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.935159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.935642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:21.948754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Getting quotas for user 4a286ea854034f17a683a3d326610734 and project 953ac3631ecb44ea9ff740d7c30580d9. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:21.979736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:21.986051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:21.991625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Getting quotas for project fa241395f828490b8aa35ac31d8eace6. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:21.998434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Getting quotas for user 73de5fca90ac4de7ac62dba09cf6e09e and project fa241395f828490b8aa35ac31d8eace6. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:22.018685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:22.021564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:22.095175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:22.106053 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-64cbdd90-7bbf-4a60-9e49-d5d46342f372 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.386330 Oct 04 18:18:22.107551 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2027/4053] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:18:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 14389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:18:22.128506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5be1bc63-777b-4677-99c9-9b7d2c8b87e8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:22.135239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5be1bc63-777b-4677-99c9-9b7d2c8b87e8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:22.138129 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f48bdcb-4a47-407f-8b9a-f2f626892976 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.147023 Oct 04 18:18:22.142183 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2027/4054] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:18:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:18:22.158982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be1bc63-777b-4677-99c9-9b7d2c8b87e8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:22.159729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be1bc63-777b-4677-99c9-9b7d2c8b87e8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:22.162366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be1bc63-777b-4677-99c9-9b7d2c8b87e8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:22.166573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be1bc63-777b-4677-99c9-9b7d2c8b87e8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:22.167993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be1bc63-777b-4677-99c9-9b7d2c8b87e8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:22.169292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5be1bc63-777b-4677-99c9-9b7d2c8b87e8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:22.174370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8af6fb02-0c46-438f-bbee-0393a8315531 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:22.175849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8af6fb02-0c46-438f-bbee-0393a8315531 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:22.215271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8af6fb02-0c46-438f-bbee-0393a8315531 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:22.215795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8af6fb02-0c46-438f-bbee-0393a8315531 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:22.216249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8af6fb02-0c46-438f-bbee-0393a8315531 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:22.221186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8af6fb02-0c46-438f-bbee-0393a8315531 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:22.232793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8af6fb02-0c46-438f-bbee-0393a8315531 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:22.236169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8af6fb02-0c46-438f-bbee-0393a8315531 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:22.826239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8af6fb02-0c46-438f-bbee-0393a8315531 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:22.839519 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8af6fb02-0c46-438f-bbee-0393a8315531 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 0.695818 Oct 04 18:18:22.840162 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2028/4055] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:22 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:22.893267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b9218d6d-a655-4038-aee0-402a53ab0699 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:22.900416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b9218d6d-a655-4038-aee0-402a53ab0699 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:22.944265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5be1bc63-777b-4677-99c9-9b7d2c8b87e8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:22.957997 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5be1bc63-777b-4677-99c9-9b7d2c8b87e8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.838176 Oct 04 18:18:22.960818 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2028/4056] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:22 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:22.973084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f95327d-14c2-4c68-a575-e7397b098a50 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:22.979406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7f95327d-14c2-4c68-a575-e7397b098a50 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:23.449736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f95327d-14c2-4c68-a575-e7397b098a50 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:23.467755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f95327d-14c2-4c68-a575-e7397b098a50 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:23.472678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f95327d-14c2-4c68-a575-e7397b098a50 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:23.478606 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f95327d-14c2-4c68-a575-e7397b098a50 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1259 microversion: 2.21 time: 0.515800 Oct 04 18:18:23.492341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b9218d6d-a655-4038-aee0-402a53ab0699 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:23.509426 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2029/4057] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:22 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1259 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:23.523564 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b9218d6d-a655-4038-aee0-402a53ab0699 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1224 microversion: 2.1 time: 0.638422 Oct 04 18:18:23.529914 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2029/4058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:22 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1224 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:23.862676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4aa2253b-ee04-495e-b3b0-a1183762e561 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:23.863554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4aa2253b-ee04-495e-b3b0-a1183762e561 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:23.882238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2253b-ee04-495e-b3b0-a1183762e561 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:23.884307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2253b-ee04-495e-b3b0-a1183762e561 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:23.887235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2253b-ee04-495e-b3b0-a1183762e561 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:23.889456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2253b-ee04-495e-b3b0-a1183762e561 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:23.891366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2253b-ee04-495e-b3b0-a1183762e561 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:23.894386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4aa2253b-ee04-495e-b3b0-a1183762e561 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:23.987458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-68cd68fb-7cb4-4145-81b5-e1777fb8dfc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:23.988354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-68cd68fb-7cb4-4145-81b5-e1777fb8dfc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:24.003089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68cd68fb-7cb4-4145-81b5-e1777fb8dfc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:24.005863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68cd68fb-7cb4-4145-81b5-e1777fb8dfc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:24.007345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68cd68fb-7cb4-4145-81b5-e1777fb8dfc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:24.011660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68cd68fb-7cb4-4145-81b5-e1777fb8dfc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:24.017649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68cd68fb-7cb4-4145-81b5-e1777fb8dfc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:24.018356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68cd68fb-7cb4-4145-81b5-e1777fb8dfc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:24.929282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4aa2253b-ee04-495e-b3b0-a1183762e561 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:24.956309 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4aa2253b-ee04-495e-b3b0-a1183762e561 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1315 microversion: 2.1 time: 1.097305 Oct 04 18:18:24.957278 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2030/4059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:23 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1315 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:24.962104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:24.962723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:24.982311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-68cd68fb-7cb4-4145-81b5-e1777fb8dfc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:24.985743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:24.986241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:24.986683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:24.987425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:24.987886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:24.988310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:24.991482 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-68cd68fb-7cb4-4145-81b5-e1777fb8dfc6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 1.008156 Oct 04 18:18:24.992085 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2030/4060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:23 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:25.002816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73d4a436-6562-4946-bdb1-4e259c1df784 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:25.009900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73d4a436-6562-4946-bdb1-4e259c1df784 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:25.031041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73d4a436-6562-4946-bdb1-4e259c1df784 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.031820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73d4a436-6562-4946-bdb1-4e259c1df784 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.032292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73d4a436-6562-4946-bdb1-4e259c1df784 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.033057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73d4a436-6562-4946-bdb1-4e259c1df784 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.033534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73d4a436-6562-4946-bdb1-4e259c1df784 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.033975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73d4a436-6562-4946-bdb1-4e259c1df784 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.072282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:25.166105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:25.180268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:25.184893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:25.191289 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1dca276-6e33-46a8-98fc-b264918e2802 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1317 microversion: 2.21 time: 0.232551 Oct 04 18:18:25.203633 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2031/4061] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:24 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:25.205285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:25.206895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:25.226345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.227019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.229447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.230682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.232595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.233172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.269801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-73d4a436-6562-4946-bdb1-4e259c1df784 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:25.273689 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] HTTP exception thrown: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Request method failure captured: Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 HTTP/1.1 Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHdByQykTqUh1U05I8rP3mJbJzbiOOXyIke2z0kglGUbGx1f2EK4bAnQE0SUbYBojkEqRGPyMm5_WTsR5xrFQ73wSQ4iLWfS_ewmGh0-1-ofzP6eldRGI3jm0BYDsJEUa6V3Ix0k1wzA5R2DyUsUfMx-g0fNl3vTJCENmUnz13bgftc Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 122253078dc44e1fb2f880d0ebecac02 Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TaggedBootDevicesTest-730786783 Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_122253078dc44e1fb2f880d0ebecac02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/122253078dc44e1fb2f880d0ebecac02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/122253078dc44e1fb2f880d0ebecac02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/122253078dc44e1fb2f880d0ebecac02"}]}] Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TaggedBootDevicesTest-730786783 Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 122253078dc44e1fb2f880d0ebecac02 Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TaggedBootDevicesTest-730786783 Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TaggedBootDevicesTest-730786783-project Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 4dbb0f91947e404d931fcc6fe7cfb9db Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TaggedBootDevicesTest-730786783-project Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'dd959367-f389-406d-8ec3-e5dbd3ab8ae7'} Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:25.283723 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:25.288635 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.290709 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-73d4a436-6562-4946-bdb1-4e259c1df784 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1276 microversion: 2.1 time: 0.291148 Oct 04 18:18:25.291357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Returning 404 to user: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:25.292383 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-85a47e0b-1abd-4d40-9064-5d793d058b2c tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 404 len: 111 microversion: 2.32 time: 0.097228 Oct 04 18:18:25.296656 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2032/4062] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:18:25 2022] DELETE /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:25.304792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:25.305727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] [instance: dd959367-f389-406d-8ec3-e5dbd3ab8ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:25.310292 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2031/4063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:24 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1276 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:25.318756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.324327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.327501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.330475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.331260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.332015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.361917 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] HTTP exception thrown: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Request method failure captured: Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 HTTP/1.1 Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHdByQykTqUh1U05I8rP3mJbJzbiOOXyIke2z0kglGUbGx1f2EK4bAnQE0SUbYBojkEqRGPyMm5_WTsR5xrFQ73wSQ4iLWfS_ewmGh0-1-ofzP6eldRGI3jm0BYDsJEUa6V3Ix0k1wzA5R2DyUsUfMx-g0fNl3vTJCENmUnz13bgftc Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 122253078dc44e1fb2f880d0ebecac02 Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TaggedBootDevicesTest-730786783 Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_122253078dc44e1fb2f880d0ebecac02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/122253078dc44e1fb2f880d0ebecac02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/122253078dc44e1fb2f880d0ebecac02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/122253078dc44e1fb2f880d0ebecac02"}]}] Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TaggedBootDevicesTest-730786783 Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 122253078dc44e1fb2f880d0ebecac02 Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TaggedBootDevicesTest-730786783 Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TaggedBootDevicesTest-730786783-project Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 4dbb0f91947e404d931fcc6fe7cfb9db Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TaggedBootDevicesTest-730786783-project Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'dd959367-f389-406d-8ec3-e5dbd3ab8ae7'} Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:25.367753 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.374025 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:25.374025 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:25.374025 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:25.374025 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:25.374025 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:25.374025 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. Oct 04 18:18:25.374025 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:25.378590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] Returning 404 to user: Instance dd959367-f389-406d-8ec3-e5dbd3ab8ae7 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:25.381165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ea00e19b-26de-4741-a49f-f1b8cb444e40 tempest-TaggedBootDevicesTest-730786783 tempest-TaggedBootDevicesTest-730786783-project] 10.222.0.18 "GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7" status: 404 len: 111 microversion: 2.32 time: 0.082019 Oct 04 18:18:25.385060 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2033/4064] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:25 2022] GET /compute/v2.1/servers/dd959367-f389-406d-8ec3-e5dbd3ab8ae7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:25.982559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d10af8e-79e3-4b12-930a-1585dae2e1c3 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:25.985309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5d10af8e-79e3-4b12-930a-1585dae2e1c3 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:25.997661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d10af8e-79e3-4b12-930a-1585dae2e1c3 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.998501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d10af8e-79e3-4b12-930a-1585dae2e1c3 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.999767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d10af8e-79e3-4b12-930a-1585dae2e1c3 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.003630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d10af8e-79e3-4b12-930a-1585dae2e1c3 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.004314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d10af8e-79e3-4b12-930a-1585dae2e1c3 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.004964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d10af8e-79e3-4b12-930a-1585dae2e1c3 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.017120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-601704ce-e53e-43b3-9ffb-cfad5ec72edb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:26.018456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-601704ce-e53e-43b3-9ffb-cfad5ec72edb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:26.028798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-601704ce-e53e-43b3-9ffb-cfad5ec72edb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.033996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-601704ce-e53e-43b3-9ffb-cfad5ec72edb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.034775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-601704ce-e53e-43b3-9ffb-cfad5ec72edb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.037165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-601704ce-e53e-43b3-9ffb-cfad5ec72edb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.040073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-601704ce-e53e-43b3-9ffb-cfad5ec72edb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.043225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-601704ce-e53e-43b3-9ffb-cfad5ec72edb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.492406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d10af8e-79e3-4b12-930a-1585dae2e1c3 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:26.506694 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d10af8e-79e3-4b12-930a-1585dae2e1c3 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1503 microversion: 2.1 time: 0.526098 Oct 04 18:18:26.509228 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2032/4065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:25 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1503 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:26.537624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:26.539614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:26.569163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.573037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.579938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.582053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.590125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.595697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.826892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-601704ce-e53e-43b3-9ffb-cfad5ec72edb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:26.847825 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-601704ce-e53e-43b3-9ffb-cfad5ec72edb tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.832793 Oct 04 18:18:26.848898 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2034/4066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:26 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:26.857535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ecf60cf7-ac6e-407c-ae5f-d3611f6586b0 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:26.869335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ecf60cf7-ac6e-407c-ae5f-d3611f6586b0 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:26.886117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf60cf7-ac6e-407c-ae5f-d3611f6586b0 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.886883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf60cf7-ac6e-407c-ae5f-d3611f6586b0 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.887553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf60cf7-ac6e-407c-ae5f-d3611f6586b0 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.888469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf60cf7-ac6e-407c-ae5f-d3611f6586b0 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.889111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf60cf7-ac6e-407c-ae5f-d3611f6586b0 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.889728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecf60cf7-ac6e-407c-ae5f-d3611f6586b0 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.417927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:27.432133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:27.433937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:27.436333 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2b9cdadf-3607-4442-9873-209535f4fedc tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1359 microversion: 2.21 time: 0.925727 Oct 04 18:18:27.446923 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2033/4067] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:26 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1359 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:27.457763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a853f72-2d6c-4932-bf0d-84129cca3658 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:27.465886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3a853f72-2d6c-4932-bf0d-84129cca3658 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:27.487303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a853f72-2d6c-4932-bf0d-84129cca3658 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.487303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a853f72-2d6c-4932-bf0d-84129cca3658 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.487303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a853f72-2d6c-4932-bf0d-84129cca3658 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.487303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a853f72-2d6c-4932-bf0d-84129cca3658 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.487738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a853f72-2d6c-4932-bf0d-84129cca3658 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.487931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a853f72-2d6c-4932-bf0d-84129cca3658 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.618177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ecf60cf7-ac6e-407c-ae5f-d3611f6586b0 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:27.630809 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ecf60cf7-ac6e-407c-ae5f-d3611f6586b0 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1324 microversion: 2.1 time: 0.780034 Oct 04 18:18:27.636630 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2035/4068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:26 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1324 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:27.679807 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a853f72-2d6c-4932-bf0d-84129cca3658 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.230996 Oct 04 18:18:27.681973 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2034/4069] 10.222.0.18 () {58 vars in 1296 bytes} [Tue Oct 4 18:18:27 2022] DELETE /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6/os-server-password => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:27.691201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ad61dd12-48b3-4651-a61e-6f496034c646 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:27.691827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ad61dd12-48b3-4651-a61e-6f496034c646 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:27.705495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad61dd12-48b3-4651-a61e-6f496034c646 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.706304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad61dd12-48b3-4651-a61e-6f496034c646 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.706848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad61dd12-48b3-4651-a61e-6f496034c646 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.707725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad61dd12-48b3-4651-a61e-6f496034c646 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.708275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad61dd12-48b3-4651-a61e-6f496034c646 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.709011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad61dd12-48b3-4651-a61e-6f496034c646 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.773104 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ad61dd12-48b3-4651-a61e-6f496034c646 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.085239 Oct 04 18:18:27.781114 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2036/4070] 10.222.0.18 () {58 vars in 1293 bytes} [Tue Oct 4 18:18:27 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6/os-server-password => generated 16 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:18:27.791793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-280faad5-b5de-4f5a-bee7-f4c615ef4cde tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:27.792538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-280faad5-b5de-4f5a-bee7-f4c615ef4cde tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:27.801615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-280faad5-b5de-4f5a-bee7-f4c615ef4cde tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.802299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-280faad5-b5de-4f5a-bee7-f4c615ef4cde tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.803701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-280faad5-b5de-4f5a-bee7-f4c615ef4cde tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.804852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-280faad5-b5de-4f5a-bee7-f4c615ef4cde tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.805505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-280faad5-b5de-4f5a-bee7-f4c615ef4cde tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.806113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-280faad5-b5de-4f5a-bee7-f4c615ef4cde tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.871096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2f78750b-9f8e-44dd-a1a2-9d0396e42513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:27.871807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2f78750b-9f8e-44dd-a1a2-9d0396e42513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:27.876784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-280faad5-b5de-4f5a-bee7-f4c615ef4cde tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:27.887465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f78750b-9f8e-44dd-a1a2-9d0396e42513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.887962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f78750b-9f8e-44dd-a1a2-9d0396e42513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.888408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f78750b-9f8e-44dd-a1a2-9d0396e42513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.889118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f78750b-9f8e-44dd-a1a2-9d0396e42513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.889581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f78750b-9f8e-44dd-a1a2-9d0396e42513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.890043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f78750b-9f8e-44dd-a1a2-9d0396e42513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.036661 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-280faad5-b5de-4f5a-bee7-f4c615ef4cde tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 204 len: 0 microversion: 2.1 time: 0.249216 Oct 04 18:18:28.037270 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2035/4071] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:27 2022] DELETE /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:28.047817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-41fdd827-c0f7-4d19-8066-55cc7f1ed009 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:28.054299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-41fdd827-c0f7-4d19-8066-55cc7f1ed009 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:28.064748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fdd827-c0f7-4d19-8066-55cc7f1ed009 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.065263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fdd827-c0f7-4d19-8066-55cc7f1ed009 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.065756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fdd827-c0f7-4d19-8066-55cc7f1ed009 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.066494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fdd827-c0f7-4d19-8066-55cc7f1ed009 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.067184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fdd827-c0f7-4d19-8066-55cc7f1ed009 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.067639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41fdd827-c0f7-4d19-8066-55cc7f1ed009 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.341977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f78750b-9f8e-44dd-a1a2-9d0396e42513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:28.355366 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2f78750b-9f8e-44dd-a1a2-9d0396e42513 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.488186 Oct 04 18:18:28.356540 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2037/4072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:27 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:28.364910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c9a3ab29-a6e5-4189-9e92-7ba0c14cb684 req-49256c9d-086a-43b2-b5f2-db35ffd407b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2456a92f-0392-4e29-9757-69aa6d2edee6", "tag": "51435862-093c-4b0c-ba78-8d6cd9b4e704"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:28.386406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c9a3ab29-a6e5-4189-9e92-7ba0c14cb684 req-49256c9d-086a-43b2-b5f2-db35ffd407b1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.389403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c9a3ab29-a6e5-4189-9e92-7ba0c14cb684 req-49256c9d-086a-43b2-b5f2-db35ffd407b1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.390021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c9a3ab29-a6e5-4189-9e92-7ba0c14cb684 req-49256c9d-086a-43b2-b5f2-db35ffd407b1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.414242 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c9a3ab29-a6e5-4189-9e92-7ba0c14cb684 req-49256c9d-086a-43b2-b5f2-db35ffd407b1 service nova] Creating event network-changed:51435862-093c-4b0c-ba78-8d6cd9b4e704 for instance 2456a92f-0392-4e29-9757-69aa6d2edee6 on n-h1-850499-14 Oct 04 18:18:28.419411 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c9a3ab29-a6e5-4189-9e92-7ba0c14cb684 req-49256c9d-086a-43b2-b5f2-db35ffd407b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061538 Oct 04 18:18:28.420425 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2038/4073] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:28.453167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-41fdd827-c0f7-4d19-8066-55cc7f1ed009 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:28.463830 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-41fdd827-c0f7-4d19-8066-55cc7f1ed009 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1509 microversion: 2.1 time: 0.422130 Oct 04 18:18:28.465987 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2036/4074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:28 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:28.470501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:28.471359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:28.482284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.482926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.487688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.488530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.489222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.489845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.576819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3eee7c39-c6f0-4cd9-b1fd-eec1c3c47b54 req-940762c6-1847-4296-908e-d50fa629cca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7ec651f-d081-4ee7-a63a-025f04f9a7c5", "tag": "1f99fc95-a489-4bb7-a070-4eeef4fa18cb"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:28.601780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3eee7c39-c6f0-4cd9-b1fd-eec1c3c47b54 req-940762c6-1847-4296-908e-d50fa629cca1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.607655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3eee7c39-c6f0-4cd9-b1fd-eec1c3c47b54 req-940762c6-1847-4296-908e-d50fa629cca1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.608123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3eee7c39-c6f0-4cd9-b1fd-eec1c3c47b54 req-940762c6-1847-4296-908e-d50fa629cca1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.631848 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3eee7c39-c6f0-4cd9-b1fd-eec1c3c47b54 req-940762c6-1847-4296-908e-d50fa629cca1 service nova] Creating event network-changed:1f99fc95-a489-4bb7-a070-4eeef4fa18cb for instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 on n-h1-850499-14 Oct 04 18:18:28.657178 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3eee7c39-c6f0-4cd9-b1fd-eec1c3c47b54 req-940762c6-1847-4296-908e-d50fa629cca1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084137 Oct 04 18:18:28.664677 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2037/4075] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:28.684155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-407623b1-e59a-454f-a178-b2559707613c tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:28.688757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-407623b1-e59a-454f-a178-b2559707613c tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:28.708368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-407623b1-e59a-454f-a178-b2559707613c tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.709261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-407623b1-e59a-454f-a178-b2559707613c tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.710871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-407623b1-e59a-454f-a178-b2559707613c tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.713694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-407623b1-e59a-454f-a178-b2559707613c tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.714393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-407623b1-e59a-454f-a178-b2559707613c tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.716304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-407623b1-e59a-454f-a178-b2559707613c tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.036116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-407623b1-e59a-454f-a178-b2559707613c tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:29.047667 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-407623b1-e59a-454f-a178-b2559707613c tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1324 microversion: 2.1 time: 0.378833 Oct 04 18:18:29.048442 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2038/4076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:28 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:29.059520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:29.069510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:29.071471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:29.072847 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9b7aa0fc-2db6-43b7-bd92-4ccece2d7bb4 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1359 microversion: 2.21 time: 0.607315 Oct 04 18:18:29.073416 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2039/4077] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:28 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1359 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:29.380121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ab25356-1851-4993-8d4c-44c9302cc1b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:29.381199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ab25356-1851-4993-8d4c-44c9302cc1b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:29.388920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ab25356-1851-4993-8d4c-44c9302cc1b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.389809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ab25356-1851-4993-8d4c-44c9302cc1b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.390875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ab25356-1851-4993-8d4c-44c9302cc1b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.391924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ab25356-1851-4993-8d4c-44c9302cc1b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.392725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ab25356-1851-4993-8d4c-44c9302cc1b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.393616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ab25356-1851-4993-8d4c-44c9302cc1b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.492833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d40e45d-2fb1-4116-b087-3e54bbf40613 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:29.493903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d40e45d-2fb1-4116-b087-3e54bbf40613 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:29.502253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d40e45d-2fb1-4116-b087-3e54bbf40613 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.503192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d40e45d-2fb1-4116-b087-3e54bbf40613 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.503874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d40e45d-2fb1-4116-b087-3e54bbf40613 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.504982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d40e45d-2fb1-4116-b087-3e54bbf40613 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:29.505810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d40e45d-2fb1-4116-b087-3e54bbf40613 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:29.506694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d40e45d-2fb1-4116-b087-3e54bbf40613 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:29.599911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ab25356-1851-4993-8d4c-44c9302cc1b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:29.610550 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ab25356-1851-4993-8d4c-44c9302cc1b6 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.236478 Oct 04 18:18:29.612182 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2039/4078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:29 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:29.699327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d40e45d-2fb1-4116-b087-3e54bbf40613 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:29.708161 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d40e45d-2fb1-4116-b087-3e54bbf40613 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1509 microversion: 2.1 time: 0.220174 Oct 04 18:18:29.708899 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2040/4079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:29 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:30.073703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-09d02acf-8425-4236-8baf-56313bf092a9 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:30.074329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-09d02acf-8425-4236-8baf-56313bf092a9 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:30.084802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d02acf-8425-4236-8baf-56313bf092a9 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.085308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d02acf-8425-4236-8baf-56313bf092a9 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.085754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d02acf-8425-4236-8baf-56313bf092a9 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.086470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d02acf-8425-4236-8baf-56313bf092a9 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.086932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d02acf-8425-4236-8baf-56313bf092a9 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.087400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09d02acf-8425-4236-8baf-56313bf092a9 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.099923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:30.101223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:30.126560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.128739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.130412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.138929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.140362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.159320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.566045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.580605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.582241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.587604 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-97674645-3423-4c38-b142-efbf1ba99d27 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1359 microversion: 2.21 time: 0.487679 Oct 04 18:18:30.588213 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2041/4080] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:30 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1359 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:30.618649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-09d02acf-8425-4236-8baf-56313bf092a9 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.627059 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-09d02acf-8425-4236-8baf-56313bf092a9 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1324 microversion: 2.1 time: 0.557112 Oct 04 18:18:30.627644 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2040/4081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:30 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1324 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:30.634206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ae7fb4f3-1ad0-414d-ac26-8d805e5d654a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:30.634822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ae7fb4f3-1ad0-414d-ac26-8d805e5d654a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:30.641744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7fb4f3-1ad0-414d-ac26-8d805e5d654a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.642236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7fb4f3-1ad0-414d-ac26-8d805e5d654a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.642668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7fb4f3-1ad0-414d-ac26-8d805e5d654a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.643592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7fb4f3-1ad0-414d-ac26-8d805e5d654a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.644207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7fb4f3-1ad0-414d-ac26-8d805e5d654a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.644785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7fb4f3-1ad0-414d-ac26-8d805e5d654a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.738194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ae5684ed-4996-485b-b215-6cfe59777def tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:30.738819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ae5684ed-4996-485b-b215-6cfe59777def tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:30.748823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae5684ed-4996-485b-b215-6cfe59777def tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.750193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae5684ed-4996-485b-b215-6cfe59777def tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.750815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae5684ed-4996-485b-b215-6cfe59777def tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.751726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae5684ed-4996-485b-b215-6cfe59777def tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.759423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae5684ed-4996-485b-b215-6cfe59777def tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.760167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae5684ed-4996-485b-b215-6cfe59777def tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.951027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ae7fb4f3-1ad0-414d-ac26-8d805e5d654a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.976325 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ae7fb4f3-1ad0-414d-ac26-8d805e5d654a tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.345775 Oct 04 18:18:30.981119 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2042/4082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:30 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:31.001101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ae5684ed-4996-485b-b215-6cfe59777def tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:31.013539 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ae5684ed-4996-485b-b215-6cfe59777def tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1509 microversion: 2.1 time: 0.281171 Oct 04 18:18:31.023833 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2041/4083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:30 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:31.288128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b5a3d09b-ff7a-4eaf-a7dc-8caab0384a94 req-9e2bd0bc-18a4-46d6-9d8c-144f2c8de0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbdbedd-0c7d-4d45-9376-90f5992b43d6", "name": "network-vif-deleted", "tag": "fa5a9f83-0fd5-4383-afbe-a468ed9d8c10"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:31.384286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b5a3d09b-ff7a-4eaf-a7dc-8caab0384a94 req-9e2bd0bc-18a4-46d6-9d8c-144f2c8de0be service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.385214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b5a3d09b-ff7a-4eaf-a7dc-8caab0384a94 req-9e2bd0bc-18a4-46d6-9d8c-144f2c8de0be service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.385880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b5a3d09b-ff7a-4eaf-a7dc-8caab0384a94 req-9e2bd0bc-18a4-46d6-9d8c-144f2c8de0be service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.424143 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b5a3d09b-ff7a-4eaf-a7dc-8caab0384a94 req-9e2bd0bc-18a4-46d6-9d8c-144f2c8de0be service nova] Creating event network-vif-deleted:fa5a9f83-0fd5-4383-afbe-a468ed9d8c10 for instance 4cbdbedd-0c7d-4d45-9376-90f5992b43d6 on n-h2-850499-14 Oct 04 18:18:31.436665 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b5a3d09b-ff7a-4eaf-a7dc-8caab0384a94 req-9e2bd0bc-18a4-46d6-9d8c-144f2c8de0be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151473 Oct 04 18:18:31.437410 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2043/4084] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:31.619899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:31.622108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:31.653925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.654810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0813f5a1-6744-41e9-ad9f-e66faee06cdb tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:31.655777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0813f5a1-6744-41e9-ad9f-e66faee06cdb tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:31.656522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.657785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.659860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.661114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.661848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.691166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0813f5a1-6744-41e9-ad9f-e66faee06cdb tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.693609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0813f5a1-6744-41e9-ad9f-e66faee06cdb tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.695929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0813f5a1-6744-41e9-ad9f-e66faee06cdb tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.697138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0813f5a1-6744-41e9-ad9f-e66faee06cdb tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.698917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0813f5a1-6744-41e9-ad9f-e66faee06cdb tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.700318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0813f5a1-6744-41e9-ad9f-e66faee06cdb tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.906235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:31.964177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:32.232667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.250339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.253923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.255420 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b62e5fa0-6459-4552-a8a5-ecf5b9e1da7a tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1359 microversion: 2.21 time: 0.642005 Oct 04 18:18:32.276179 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2042/4085] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:31 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1359 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:32.311880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-bd910dbd-40cd-4af5-8fe5-3276dd9933d4 req-11524733-f80d-4c3a-8c4a-5645fecd91a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afef2588-b2e9-4b9e-943c-44469215dd64", "name": "network-vif-plugged", "status": "completed", "tag": "e1f04890-a2cf-4366-ad64-14ecf15d04cf"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:32.332867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0813f5a1-6744-41e9-ad9f-e66faee06cdb tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.333381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bd910dbd-40cd-4af5-8fe5-3276dd9933d4 req-11524733-f80d-4c3a-8c4a-5645fecd91a9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.340857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bd910dbd-40cd-4af5-8fe5-3276dd9933d4 req-11524733-f80d-4c3a-8c4a-5645fecd91a9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.341473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bd910dbd-40cd-4af5-8fe5-3276dd9933d4 req-11524733-f80d-4c3a-8c4a-5645fecd91a9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.376502 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0813f5a1-6744-41e9-ad9f-e66faee06cdb tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1324 microversion: 2.1 time: 0.725900 Oct 04 18:18:32.381401 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2044/4086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:31 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1324 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:32.395161 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-bd910dbd-40cd-4af5-8fe5-3276dd9933d4 req-11524733-f80d-4c3a-8c4a-5645fecd91a9 service nova] Creating event network-vif-plugged:e1f04890-a2cf-4366-ad64-14ecf15d04cf for instance afef2588-b2e9-4b9e-943c-44469215dd64 on n-h2-850499-14 Oct 04 18:18:32.398595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-58f0b409-fd30-473f-8354-20c316235d1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:32.404138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-58f0b409-fd30-473f-8354-20c316235d1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:32.420305 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-bd910dbd-40cd-4af5-8fe5-3276dd9933d4 req-11524733-f80d-4c3a-8c4a-5645fecd91a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141701 Oct 04 18:18:32.420952 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2043/4087] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:32.425421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58f0b409-fd30-473f-8354-20c316235d1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.427683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58f0b409-fd30-473f-8354-20c316235d1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.428163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58f0b409-fd30-473f-8354-20c316235d1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.430561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58f0b409-fd30-473f-8354-20c316235d1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.430561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58f0b409-fd30-473f-8354-20c316235d1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.433344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58f0b409-fd30-473f-8354-20c316235d1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.471960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:32.472689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:32.509607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.509935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.510393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.511168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.517325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.517836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.631250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.631250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.631250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.631250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lazy-loading 'fault' on Instance uuid 4cbdbedd-0c7d-4d45-9376-90f5992b43d6 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:32.718137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b0aa6623e74a708f98d032b02038d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74575f6588c54244b56819c8f51d2670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.730026 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-83e354c8-5bc0-4822-8f91-8d31809e84e2 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 200 len: 1305 microversion: 2.1 time: 0.302609 Oct 04 18:18:32.730993 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2044/4088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:32 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 1305 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:32.736089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-faed0851-d0d8-4f1d-ad73-c9919a6615f9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:32.752976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faed0851-d0d8-4f1d-ad73-c9919a6615f9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.762483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faed0851-d0d8-4f1d-ad73-c9919a6615f9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.763293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faed0851-d0d8-4f1d-ad73-c9919a6615f9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.788330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-58f0b409-fd30-473f-8354-20c316235d1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.802021 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-58f0b409-fd30-473f-8354-20c316235d1b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.417757 Oct 04 18:18:32.802889 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2045/4089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:32 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:32.892891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-faed0851-d0d8-4f1d-ad73-c9919a6615f9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Going to try to stop instance {{(pid=122331) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:18:32.898606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:32.963286 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-faed0851-d0d8-4f1d-ad73-c9919a6615f9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/action" status: 202 len: 0 microversion: 2.1 time: 0.230704 Oct 04 18:18:32.974206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bf570b7f-4691-42f2-8d18-263bf539cd6e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:32.975868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bf570b7f-4691-42f2-8d18-263bf539cd6e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:32.981653 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2045/4090] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:32 2022] POST /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:18:32.987260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf570b7f-4691-42f2-8d18-263bf539cd6e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.988535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf570b7f-4691-42f2-8d18-263bf539cd6e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.989536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf570b7f-4691-42f2-8d18-263bf539cd6e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.990556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf570b7f-4691-42f2-8d18-263bf539cd6e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.991322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf570b7f-4691-42f2-8d18-263bf539cd6e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.992084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf570b7f-4691-42f2-8d18-263bf539cd6e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.172434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bf570b7f-4691-42f2-8d18-263bf539cd6e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.181903 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bf570b7f-4691-42f2-8d18-263bf539cd6e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.212152 Oct 04 18:18:33.182922 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2046/4091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:32 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:33.286197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:33.286871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:33.294931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.311189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.311879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.312680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.313181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.313898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.402888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49654541-fb86-4481-9261-eea7c79f0182 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:33.403703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-49654541-fb86-4481-9261-eea7c79f0182 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:33.413502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49654541-fb86-4481-9261-eea7c79f0182 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.414531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49654541-fb86-4481-9261-eea7c79f0182 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.415535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49654541-fb86-4481-9261-eea7c79f0182 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.416528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49654541-fb86-4481-9261-eea7c79f0182 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.417229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49654541-fb86-4481-9261-eea7c79f0182 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.417883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49654541-fb86-4481-9261-eea7c79f0182 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.462128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:33.464187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.474191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.476183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.477437 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a59de45b-598d-4aea-8a08-bcf0df751496 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1359 microversion: 2.21 time: 0.196363 Oct 04 18:18:33.479361 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2046/4092] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:33 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:33.600680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-49654541-fb86-4481-9261-eea7c79f0182 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.609831 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49654541-fb86-4481-9261-eea7c79f0182 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1324 microversion: 2.1 time: 0.211791 Oct 04 18:18:33.611529 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2047/4093] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:33 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:33.758424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:33.759670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] [instance: 4cbdbedd-0c7d-4d45-9376-90f5992b43d6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:33.762862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:33.768870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.769456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.769978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.770771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.771464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.772080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.787267 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] HTTP exception thrown: Instance 4cbdbedd-0c7d-4d45-9376-90f5992b43d6 could not be found. Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Request method failure captured: Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 HTTP/1.1 Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHjKhZn95vqnap9jPzhrkFlH5OFG0I6F-xUjIcTtLz3IUlIA9y6KC-Hv0J9MrCNYSUUexkrMPDqLdbcjB3IzJrMLJ6SU4rPysQQdXiEEgTsmxrz1N3Xr1qKXHdmNj-vjd4O5RmljOL1dHb--GEXlEMTo5TC5JcWIxZdfNgEQgEGHT0s Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 74575f6588c54244b56819c8f51d2670 Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerPasswordTestJSON-531114479 Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_74575f6588c54244b56819c8f51d2670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/74575f6588c54244b56819c8f51d2670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/74575f6588c54244b56819c8f51d2670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/74575f6588c54244b56819c8f51d2670"}]}] Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerPasswordTestJSON-531114479 Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 74575f6588c54244b56819c8f51d2670 Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerPasswordTestJSON-531114479 Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerPasswordTestJSON-531114479-project Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: f8b0aa6623e74a708f98d032b02038d6 Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerPasswordTestJSON-531114479-project Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 4cbdbedd-0c7d-4d45-9376-90f5992b43d6 could not be found. Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '4cbdbedd-0c7d-4d45-9376-90f5992b43d6'} Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbdbedd-0c7d-4d45-9376-90f5992b43d6 could not be found. Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbdbedd-0c7d-4d45-9376-90f5992b43d6 could not be found. Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:33.789277 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:33.793848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:33.793848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:33.793848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:33.793848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:33.793848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:33.793848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbdbedd-0c7d-4d45-9376-90f5992b43d6 could not be found. Oct 04 18:18:33.793848 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:33.795734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] Returning 404 to user: Instance 4cbdbedd-0c7d-4d45-9376-90f5992b43d6 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:33.797397 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c13bcc9-1d2b-4a51-86b3-c35f55a68bb5 tempest-ServerPasswordTestJSON-531114479 tempest-ServerPasswordTestJSON-531114479-project] 10.222.0.18 "GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6" status: 404 len: 111 microversion: 2.1 time: 0.042794 Oct 04 18:18:33.798511 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2047/4094] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:33 2022] GET /compute/v2.1/servers/4cbdbedd-0c7d-4d45-9376-90f5992b43d6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:33.832337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-61585fa3-293f-4441-b0a8-4d9ef9bb217e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:33.833060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-61585fa3-293f-4441-b0a8-4d9ef9bb217e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:33.842369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61585fa3-293f-4441-b0a8-4d9ef9bb217e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.844028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61585fa3-293f-4441-b0a8-4d9ef9bb217e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.845098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61585fa3-293f-4441-b0a8-4d9ef9bb217e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.846831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61585fa3-293f-4441-b0a8-4d9ef9bb217e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.847397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61585fa3-293f-4441-b0a8-4d9ef9bb217e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.847899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61585fa3-293f-4441-b0a8-4d9ef9bb217e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.855943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:34.041162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61585fa3-293f-4441-b0a8-4d9ef9bb217e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.055371 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-61585fa3-293f-4441-b0a8-4d9ef9bb217e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 0.228586 Oct 04 18:18:34.064417 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2048/4095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:33 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:34.205791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-09180bfc-31af-43f9-9c57-8943ad0facd9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:34.206785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-09180bfc-31af-43f9-9c57-8943ad0facd9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:34.216541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09180bfc-31af-43f9-9c57-8943ad0facd9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.219745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09180bfc-31af-43f9-9c57-8943ad0facd9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.220383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09180bfc-31af-43f9-9c57-8943ad0facd9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.221597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09180bfc-31af-43f9-9c57-8943ad0facd9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.223772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09180bfc-31af-43f9-9c57-8943ad0facd9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.224314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-09180bfc-31af-43f9-9c57-8943ad0facd9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.398245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-09180bfc-31af-43f9-9c57-8943ad0facd9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.408979 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-09180bfc-31af-43f9-9c57-8943ad0facd9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.207006 Oct 04 18:18:34.409999 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2048/4096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:34 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:34.453658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-eedd3cd8-7e10-4635-b390-843010ff9be4 req-02ea40c7-06ce-46a2-a126-3f41acb30db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2456a92f-0392-4e29-9757-69aa6d2edee6", "name": "network-vif-plugged", "status": "completed", "tag": "51435862-093c-4b0c-ba78-8d6cd9b4e704"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:34.472311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-eedd3cd8-7e10-4635-b390-843010ff9be4 req-02ea40c7-06ce-46a2-a126-3f41acb30db6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.472808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-eedd3cd8-7e10-4635-b390-843010ff9be4 req-02ea40c7-06ce-46a2-a126-3f41acb30db6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.473252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-eedd3cd8-7e10-4635-b390-843010ff9be4 req-02ea40c7-06ce-46a2-a126-3f41acb30db6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.503451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:34.503602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:34.511446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.511957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.512412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.513146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.513612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.514055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.520837 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-eedd3cd8-7e10-4635-b390-843010ff9be4 req-02ea40c7-06ce-46a2-a126-3f41acb30db6 service nova] Creating event network-vif-plugged:51435862-093c-4b0c-ba78-8d6cd9b4e704 for instance 2456a92f-0392-4e29-9757-69aa6d2edee6 on n-h1-850499-14 Oct 04 18:18:34.525898 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-eedd3cd8-7e10-4635-b390-843010ff9be4 req-02ea40c7-06ce-46a2-a126-3f41acb30db6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077669 Oct 04 18:18:34.528312 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2049/4097] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:34.633882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d8c371b9-59d9-4d24-9047-7fddedaa6de1 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:34.634868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d8c371b9-59d9-4d24-9047-7fddedaa6de1 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:34.645726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8c371b9-59d9-4d24-9047-7fddedaa6de1 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.651485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8c371b9-59d9-4d24-9047-7fddedaa6de1 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.652360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8c371b9-59d9-4d24-9047-7fddedaa6de1 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.655928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8c371b9-59d9-4d24-9047-7fddedaa6de1 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.656670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8c371b9-59d9-4d24-9047-7fddedaa6de1 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.657317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8c371b9-59d9-4d24-9047-7fddedaa6de1 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.773056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.787838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.790685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.797134 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-312af2c5-da4b-434d-8dbd-e41c06d220bb tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1359 microversion: 2.21 time: 0.293932 Oct 04 18:18:34.815928 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2049/4098] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:34 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1359 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:34.910399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d8c371b9-59d9-4d24-9047-7fddedaa6de1 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.919501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d8c371b9-59d9-4d24-9047-7fddedaa6de1 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1324 microversion: 2.1 time: 0.289948 Oct 04 18:18:34.920410 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2050/4099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:34 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1324 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:35.084736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-35a2895d-ec6b-4406-b4ee-fbbec3396018 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:35.085488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-35a2895d-ec6b-4406-b4ee-fbbec3396018 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:35.097725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a2895d-ec6b-4406-b4ee-fbbec3396018 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.105044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a2895d-ec6b-4406-b4ee-fbbec3396018 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.106424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a2895d-ec6b-4406-b4ee-fbbec3396018 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.107259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a2895d-ec6b-4406-b4ee-fbbec3396018 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.110132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a2895d-ec6b-4406-b4ee-fbbec3396018 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.111947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35a2895d-ec6b-4406-b4ee-fbbec3396018 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.437210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9917f6e-d354-4cd5-95bb-50f026bbfdb3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:35.437210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9917f6e-d354-4cd5-95bb-50f026bbfdb3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:35.452181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9917f6e-d354-4cd5-95bb-50f026bbfdb3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.453502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9917f6e-d354-4cd5-95bb-50f026bbfdb3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.453966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9917f6e-d354-4cd5-95bb-50f026bbfdb3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.466978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9917f6e-d354-4cd5-95bb-50f026bbfdb3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.476202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9917f6e-d354-4cd5-95bb-50f026bbfdb3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.477020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9917f6e-d354-4cd5-95bb-50f026bbfdb3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.622235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9917f6e-d354-4cd5-95bb-50f026bbfdb3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.641254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-35a2895d-ec6b-4406-b4ee-fbbec3396018 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.643611 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9917f6e-d354-4cd5-95bb-50f026bbfdb3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 1.208706 Oct 04 18:18:36.644280 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2051/4100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:35 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:36.658512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:36.658512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:36.658749 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-35a2895d-ec6b-4406-b4ee-fbbec3396018 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1519 microversion: 2.1 time: 1.570466 Oct 04 18:18:36.664602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:36.665123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:36.665581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.666294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:36.671053 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2050/4101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:35 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1519 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:36.672634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:36.673287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.680120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-851ae542-4c15-4273-aae3-bc4972a00c95 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:36.681455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-851ae542-4c15-4273-aae3-bc4972a00c95 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:36.689254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-851ae542-4c15-4273-aae3-bc4972a00c95 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:36.689762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-851ae542-4c15-4273-aae3-bc4972a00c95 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:36.690296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-851ae542-4c15-4273-aae3-bc4972a00c95 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.692253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-851ae542-4c15-4273-aae3-bc4972a00c95 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:36.693132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-851ae542-4c15-4273-aae3-bc4972a00c95 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:36.693797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-851ae542-4c15-4273-aae3-bc4972a00c95 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.946776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.962079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.964118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.965278 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-31e99482-5401-4e12-bbe2-1fc8dfd5c999 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1359 microversion: 2.21 time: 0.320034 Oct 04 18:18:36.972993 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2052/4102] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:36 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1359 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:36.982638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-26d7394a-7f28-4548-bcfe-f2de4a040eac req-eb094894-93c3-46ca-b078-79988cdc26d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ec651f-d081-4ee7-a63a-025f04f9a7c5", "name": "network-vif-plugged", "status": "completed", "tag": "1f99fc95-a489-4bb7-a070-4eeef4fa18cb"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:37.016244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-26d7394a-7f28-4548-bcfe-f2de4a040eac req-eb094894-93c3-46ca-b078-79988cdc26d8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.016761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-26d7394a-7f28-4548-bcfe-f2de4a040eac req-eb094894-93c3-46ca-b078-79988cdc26d8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.017205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-26d7394a-7f28-4548-bcfe-f2de4a040eac req-eb094894-93c3-46ca-b078-79988cdc26d8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.028938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-851ae542-4c15-4273-aae3-bc4972a00c95 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:37.048988 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-851ae542-4c15-4273-aae3-bc4972a00c95 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1520 microversion: 2.1 time: 0.365266 Oct 04 18:18:37.051047 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2051/4103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:36 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:37.053475 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-26d7394a-7f28-4548-bcfe-f2de4a040eac req-eb094894-93c3-46ca-b078-79988cdc26d8 service nova] Creating event network-vif-plugged:1f99fc95-a489-4bb7-a070-4eeef4fa18cb for instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 on n-h1-850499-14 Oct 04 18:18:37.059050 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-26d7394a-7f28-4548-bcfe-f2de4a040eac req-eb094894-93c3-46ca-b078-79988cdc26d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084681 Oct 04 18:18:37.060692 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2053/4104] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:37.077959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:37.078518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:37.086272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.086774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.087680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.087964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.088424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.088853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.122354 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] HTTP exception thrown: Action 999 not found Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Request method failure captured: Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6/os-instance-actions/999 HTTP/1.1 Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHjfukM7vM1JlCq77BTSe-yVBsI0xHF-ZWbcjt9407ZLkc4uXGzuxI-eqAn-95WTLQEo0TRfa7GNlQGs-v_VLU7C5RuPyW69FrFMwzxVtqc3s8wj8sKDVyJZx7BpC49GQBGsYLhes074KJyKf-utlt2b8tBDEonDmEkFUqYvJZkco4g Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 953ac3631ecb44ea9ff740d7c30580d9 Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1783282222 Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_953ac3631ecb44ea9ff740d7c30580d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/953ac3631ecb44ea9ff740d7c30580d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/953ac3631ecb44ea9ff740d7c30580d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/953ac3631ecb44ea9ff740d7c30580d9"}]}] Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1783282222 Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 953ac3631ecb44ea9ff740d7c30580d9 Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1783282222 Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-InstanceActionsNegativeTestJSON-1783282222-project Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 4a286ea854034f17a683a3d326610734 Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1783282222-project Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: exception: Action 999 not found Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'server_id': '2456a92f-0392-4e29-9757-69aa6d2edee6', 'id': '999'} Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 18:18:37.130894 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:37.135888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Returning 404 to user: Action 999 not found {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:37.136147 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a79211ab-433f-4a90-871c-a12241184fcf tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.061499 Oct 04 18:18:37.139606 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2052/4105] 10.222.0.18 () {58 vars in 1308 bytes} [Tue Oct 4 18:18:37 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6/os-instance-actions/999 => generated 66 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:18:37.151912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d0a874bc-49a3-4d66-be5d-856c71a46ff2 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '.version_select at 0x7fd4d13a6a60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:37.152961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d0a874bc-49a3-4d66-be5d-856c71a46ff2 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:37.162815 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d0a874bc-49a3-4d66-be5d-856c71a46ff2 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] HTTP exception thrown: Instance 15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c could not be found. Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d0a874bc-49a3-4d66-be5d-856c71a46ff2 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Request method failure captured: Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c/os-instance-actions HTTP/1.1 Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHjfukM7vM1JlCq77BTSe-yVBsI0xHF-ZWbcjt9407ZLkc4uXGzuxI-eqAn-95WTLQEo0TRfa7GNlQGs-v_VLU7C5RuPyW69FrFMwzxVtqc3s8wj8sKDVyJZx7BpC49GQBGsYLhes074KJyKf-utlt2b8tBDEonDmEkFUqYvJZkco4g Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 953ac3631ecb44ea9ff740d7c30580d9 Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1783282222 Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_953ac3631ecb44ea9ff740d7c30580d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/953ac3631ecb44ea9ff740d7c30580d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/953ac3631ecb44ea9ff740d7c30580d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/953ac3631ecb44ea9ff740d7c30580d9"}]}] Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1783282222 Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 953ac3631ecb44ea9ff740d7c30580d9 Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1783282222 Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-InstanceActionsNegativeTestJSON-1783282222-project Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 4a286ea854034f17a683a3d326610734 Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1783282222-project Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c could not be found. Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'server_id': '15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c'} Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c could not be found. Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:37.165359 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c could not be found. Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c could not be found. Oct 04 18:18:37.170005 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:37.174787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d0a874bc-49a3-4d66-be5d-856c71a46ff2 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Returning 404 to user: Instance 15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:37.175935 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d0a874bc-49a3-4d66-be5d-856c71a46ff2 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.030311 Oct 04 18:18:37.177739 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2054/4106] 10.222.0.18 () {58 vars in 1296 bytes} [Tue Oct 4 18:18:37 2022] GET /compute/v2.1/servers/15fcd01d-72d8-4bf8-b40b-c7e9d84cc17c/os-instance-actions => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:37.187092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2082c8dc-e0fe-4188-8042-c32ffe9cb1cc tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:37.187880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2082c8dc-e0fe-4188-8042-c32ffe9cb1cc tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:37.194655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2082c8dc-e0fe-4188-8042-c32ffe9cb1cc tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.195028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2082c8dc-e0fe-4188-8042-c32ffe9cb1cc tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.195474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2082c8dc-e0fe-4188-8042-c32ffe9cb1cc tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.196515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2082c8dc-e0fe-4188-8042-c32ffe9cb1cc tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.197144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2082c8dc-e0fe-4188-8042-c32ffe9cb1cc tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.198029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2082c8dc-e0fe-4188-8042-c32ffe9cb1cc tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.235018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2082c8dc-e0fe-4188-8042-c32ffe9cb1cc tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:37.379562 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2082c8dc-e0fe-4188-8042-c32ffe9cb1cc tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 204 len: 0 microversion: 2.1 time: 0.195194 Oct 04 18:18:37.382690 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2053/4107] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:37 2022] DELETE /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:37.392656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e0d16de-b441-4449-a69e-96ccf56ab17a tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:37.393685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6e0d16de-b441-4449-a69e-96ccf56ab17a tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:37.410394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d16de-b441-4449-a69e-96ccf56ab17a tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.411305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d16de-b441-4449-a69e-96ccf56ab17a tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.412745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d16de-b441-4449-a69e-96ccf56ab17a tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.413733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d16de-b441-4449-a69e-96ccf56ab17a tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.414924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d16de-b441-4449-a69e-96ccf56ab17a tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.415536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d16de-b441-4449-a69e-96ccf56ab17a tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.588794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6e0d16de-b441-4449-a69e-96ccf56ab17a tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:37.600754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e0d16de-b441-4449-a69e-96ccf56ab17a tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1526 microversion: 2.1 time: 0.212600 Oct 04 18:18:37.601701 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2055/4108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:37 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1526 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:37.676851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e2a3dcdc-d844-44d6-9bc7-515e25bf9852 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:37.678586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e2a3dcdc-d844-44d6-9bc7-515e25bf9852 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:37.681583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8980b838-ebf2-4947-9de3-7e855c98daa8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:37.682202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8980b838-ebf2-4947-9de3-7e855c98daa8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:37.692758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8980b838-ebf2-4947-9de3-7e855c98daa8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.693272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8980b838-ebf2-4947-9de3-7e855c98daa8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.693719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8980b838-ebf2-4947-9de3-7e855c98daa8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.694451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8980b838-ebf2-4947-9de3-7e855c98daa8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.694914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8980b838-ebf2-4947-9de3-7e855c98daa8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.700235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8980b838-ebf2-4947-9de3-7e855c98daa8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.704721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2a3dcdc-d844-44d6-9bc7-515e25bf9852 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.710026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2a3dcdc-d844-44d6-9bc7-515e25bf9852 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.710569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2a3dcdc-d844-44d6-9bc7-515e25bf9852 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.712075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2a3dcdc-d844-44d6-9bc7-515e25bf9852 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.712585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2a3dcdc-d844-44d6-9bc7-515e25bf9852 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.713035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2a3dcdc-d844-44d6-9bc7-515e25bf9852 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.979238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8980b838-ebf2-4947-9de3-7e855c98daa8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:37.991159 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8980b838-ebf2-4947-9de3-7e855c98daa8 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.312566 Oct 04 18:18:37.993550 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2056/4109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:37 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:38.022590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c6c7541-344b-481f-899e-47e0ec049115 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:38.025005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c6c7541-344b-481f-899e-47e0ec049115 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:38.053607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c6c7541-344b-481f-899e-47e0ec049115 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.054506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c6c7541-344b-481f-899e-47e0ec049115 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.058148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c6c7541-344b-481f-899e-47e0ec049115 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.059185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c6c7541-344b-481f-899e-47e0ec049115 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.059871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c6c7541-344b-481f-899e-47e0ec049115 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.063641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c6c7541-344b-481f-899e-47e0ec049115 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.101573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e2a3dcdc-d844-44d6-9bc7-515e25bf9852 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.120989 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e2a3dcdc-d844-44d6-9bc7-515e25bf9852 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.451386 Oct 04 18:18:38.123956 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2054/4110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:37 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:38.155140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:38.156434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:38.170776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.172761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.174326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.175125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.177379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.178047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.417538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4c6c7541-344b-481f-899e-47e0ec049115 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.427528 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c6c7541-344b-481f-899e-47e0ec049115 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.414166 Oct 04 18:18:38.428470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2057/4111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:38 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:38.468887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ba8bbd8c-2ad0-4843-aa58-78a45bcabd84 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:38.469508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ba8bbd8c-2ad0-4843-aa58-78a45bcabd84 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:38.476205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8bbd8c-2ad0-4843-aa58-78a45bcabd84 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.476960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8bbd8c-2ad0-4843-aa58-78a45bcabd84 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.477580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8bbd8c-2ad0-4843-aa58-78a45bcabd84 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.478462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8bbd8c-2ad0-4843-aa58-78a45bcabd84 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.479119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8bbd8c-2ad0-4843-aa58-78a45bcabd84 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.479923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8bbd8c-2ad0-4843-aa58-78a45bcabd84 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.504296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.514728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.516784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.517935 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c113fbab-d305-45ce-9106-3ea3f70f9b83 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1359 microversion: 2.21 time: 0.389168 Oct 04 18:18:38.518688 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2055/4112] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:38 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1359 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:38.624635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ecdd434-518e-45bb-9daf-15f58b4ca494 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:38.625690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ecdd434-518e-45bb-9daf-15f58b4ca494 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:38.632041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ecdd434-518e-45bb-9daf-15f58b4ca494 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.632646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ecdd434-518e-45bb-9daf-15f58b4ca494 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.633168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ecdd434-518e-45bb-9daf-15f58b4ca494 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.633971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ecdd434-518e-45bb-9daf-15f58b4ca494 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.634516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ecdd434-518e-45bb-9daf-15f58b4ca494 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.649624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ecdd434-518e-45bb-9daf-15f58b4ca494 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.757927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ba8bbd8c-2ad0-4843-aa58-78a45bcabd84 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.768692 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ba8bbd8c-2ad0-4843-aa58-78a45bcabd84 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.303580 Oct 04 18:18:38.769422 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2058/4113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:38 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:38.792177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c53065ee-bf44-4313-9f7d-5ca1617461ad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:38.799362 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-c53065ee-bf44-4313-9f7d-5ca1617461ad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 45944add-a667-4a05-9102-882872608b08 has no mapping to a cell. Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c53065ee-bf44-4313-9f7d-5ca1617461ad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/45944add-a667-4a05-9102-882872608b08/action HTTP/1.1 Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 15 Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: {"os-stop": {}} Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 45944add-a667-4a05-9102-882872608b08 has no mapping to a cell. Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '45944add-a667-4a05-9102-882872608b08', 'body': {'os-stop': {}}} Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 45944add-a667-4a05-9102-882872608b08 has no mapping to a cell. Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:38.811006 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45944add-a667-4a05-9102-882872608b08 has no mapping to a cell. Oct 04 18:18:38.817894 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:38.817894 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:38.817894 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:38.817894 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:38.817894 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:38.817894 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:38.817894 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:38.817894 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:38.817894 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45944add-a667-4a05-9102-882872608b08 has no mapping to a cell. Oct 04 18:18:38.817894 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:38.819506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c53065ee-bf44-4313-9f7d-5ca1617461ad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 45944add-a667-4a05-9102-882872608b08 has no mapping to a cell. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:38.820647 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c53065ee-bf44-4313-9f7d-5ca1617461ad tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/45944add-a667-4a05-9102-882872608b08/action" status: 404 len: 117 microversion: 2.1 time: 0.032464 Oct 04 18:18:38.822432 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2059/4114] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:38 2022] POST /compute/v2.1/servers/45944add-a667-4a05-9102-882872608b08/action => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:18:38.836496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cb691124-40af-4fbd-b944-2d3e939ecf0f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:38.839754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cb691124-40af-4fbd-b944-2d3e939ecf0f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:38.856665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb691124-40af-4fbd-b944-2d3e939ecf0f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.857781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb691124-40af-4fbd-b944-2d3e939ecf0f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.858803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb691124-40af-4fbd-b944-2d3e939ecf0f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.860461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb691124-40af-4fbd-b944-2d3e939ecf0f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.861688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb691124-40af-4fbd-b944-2d3e939ecf0f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.862651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb691124-40af-4fbd-b944-2d3e939ecf0f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.058005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ecdd434-518e-45bb-9daf-15f58b4ca494 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:39.072403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ecdd434-518e-45bb-9daf-15f58b4ca494 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1526 microversion: 2.1 time: 0.451138 Oct 04 18:18:39.088533 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2056/4115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:38 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1526 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:39.147515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6c7d5a57-75a0-4296-8ac6-ecaa6ce60700 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:39.148755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6c7d5a57-75a0-4296-8ac6-ecaa6ce60700 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:39.159414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7d5a57-75a0-4296-8ac6-ecaa6ce60700 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.160150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7d5a57-75a0-4296-8ac6-ecaa6ce60700 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.161474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7d5a57-75a0-4296-8ac6-ecaa6ce60700 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.162217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7d5a57-75a0-4296-8ac6-ecaa6ce60700 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.166660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7d5a57-75a0-4296-8ac6-ecaa6ce60700 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.167404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c7d5a57-75a0-4296-8ac6-ecaa6ce60700 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.172083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cb691124-40af-4fbd-b944-2d3e939ecf0f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:39.182908 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cb691124-40af-4fbd-b944-2d3e939ecf0f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.355922 Oct 04 18:18:39.205848 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2060/4116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:38 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:39.230019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c438744-1bf8-483f-b8c4-93a2749952ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:39.230656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c438744-1bf8-483f-b8c4-93a2749952ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:39.249142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c438744-1bf8-483f-b8c4-93a2749952ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.249723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c438744-1bf8-483f-b8c4-93a2749952ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.255091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c438744-1bf8-483f-b8c4-93a2749952ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.258724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c438744-1bf8-483f-b8c4-93a2749952ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.259497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c438744-1bf8-483f-b8c4-93a2749952ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.260805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c438744-1bf8-483f-b8c4-93a2749952ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.612797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6c7d5a57-75a0-4296-8ac6-ecaa6ce60700 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:39.628021 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6c7d5a57-75a0-4296-8ac6-ecaa6ce60700 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.480996 Oct 04 18:18:39.652460 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2057/4117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:39 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:39.668742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:39.670387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:39.688323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.692023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.692971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.695240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.695996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.697893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.703526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c438744-1bf8-483f-b8c4-93a2749952ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:39.736470 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c438744-1bf8-483f-b8c4-93a2749952ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.515452 Oct 04 18:18:39.750885 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2061/4118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:39 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:39.766168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5974d1a9-b801-4a9f-bdc4-f233e4ac97f5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:39.766855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5974d1a9-b801-4a9f-bdc4-f233e4ac97f5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: 1c3b970a-fe6b-480b-8030-786c10dd32cb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:39.775452 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-5974d1a9-b801-4a9f-bdc4-f233e4ac97f5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 1c3b970a-fe6b-480b-8030-786c10dd32cb could not be found. Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5974d1a9-b801-4a9f-bdc4-f233e4ac97f5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/1c3b970a-fe6b-480b-8030-786c10dd32cb/action HTTP/1.1 Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 15 Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: {"suspend": {}} Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 1c3b970a-fe6b-480b-8030-786c10dd32cb could not be found. Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '1c3b970a-fe6b-480b-8030-786c10dd32cb', 'body': {'suspend': {}}} Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3b970a-fe6b-480b-8030-786c10dd32cb could not be found. Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3b970a-fe6b-480b-8030-786c10dd32cb could not be found. Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:39.777655 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:39.787294 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:39.787294 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:39.787294 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3b970a-fe6b-480b-8030-786c10dd32cb could not be found. Oct 04 18:18:39.787294 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:39.787294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5974d1a9-b801-4a9f-bdc4-f233e4ac97f5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 1c3b970a-fe6b-480b-8030-786c10dd32cb could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:39.787294 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5974d1a9-b801-4a9f-bdc4-f233e4ac97f5 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/1c3b970a-fe6b-480b-8030-786c10dd32cb/action" status: 404 len: 111 microversion: 2.1 time: 0.019751 Oct 04 18:18:39.787294 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2062/4119] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:39 2022] POST /compute/v2.1/servers/1c3b970a-fe6b-480b-8030-786c10dd32cb/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:18:39.793909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7648e5f9-9e64-4d3a-8bb5-9f4643ade4ba tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:39.795983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7648e5f9-9e64-4d3a-8bb5-9f4643ade4ba tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:39.817614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7648e5f9-9e64-4d3a-8bb5-9f4643ade4ba tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.822382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7648e5f9-9e64-4d3a-8bb5-9f4643ade4ba tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.824207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7648e5f9-9e64-4d3a-8bb5-9f4643ade4ba tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.824978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7648e5f9-9e64-4d3a-8bb5-9f4643ade4ba tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.825456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7648e5f9-9e64-4d3a-8bb5-9f4643ade4ba tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.825915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7648e5f9-9e64-4d3a-8bb5-9f4643ade4ba tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.978144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:39.989986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:39.992523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:39.995142 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ea99482-a4c4-4bfe-8861-2da050014939 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1553 microversion: 2.21 time: 0.339082 Oct 04 18:18:39.996328 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2058/4120] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:39 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1553 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:40.007747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7648e5f9-9e64-4d3a-8bb5-9f4643ade4ba tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.043302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c9b2d399-739a-4bf3-b47e-3aa542369db2 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:40.043433 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7648e5f9-9e64-4d3a-8bb5-9f4643ade4ba tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.235960 Oct 04 18:18:40.043541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c9b2d399-739a-4bf3-b47e-3aa542369db2 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:40.043631 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2063/4121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:39 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:40.043716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9b2d399-739a-4bf3-b47e-3aa542369db2 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.043716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9b2d399-739a-4bf3-b47e-3aa542369db2 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.043716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9b2d399-739a-4bf3-b47e-3aa542369db2 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.043716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9b2d399-739a-4bf3-b47e-3aa542369db2 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.043716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9b2d399-739a-4bf3-b47e-3aa542369db2 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.043716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9b2d399-739a-4bf3-b47e-3aa542369db2 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.052722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5dbaf962-2469-48e6-8af0-0166fcd3b1bc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:40.053708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5dbaf962-2469-48e6-8af0-0166fcd3b1bc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:40.058431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c9b2d399-739a-4bf3-b47e-3aa542369db2 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:40.062185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dbaf962-2469-48e6-8af0-0166fcd3b1bc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.062978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dbaf962-2469-48e6-8af0-0166fcd3b1bc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.063715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dbaf962-2469-48e6-8af0-0166fcd3b1bc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.065496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dbaf962-2469-48e6-8af0-0166fcd3b1bc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.067333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dbaf962-2469-48e6-8af0-0166fcd3b1bc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.068162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dbaf962-2469-48e6-8af0-0166fcd3b1bc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.105582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:40.158014 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c9b2d399-739a-4bf3-b47e-3aa542369db2 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 204 len: 0 microversion: 2.21 time: 0.139730 Oct 04 18:18:40.163426 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2059/4122] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:18:40 2022] DELETE /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:18:40.173598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-31c38080-e79a-4aa4-9f78-f4299e3b96ad tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:40.174876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-31c38080-e79a-4aa4-9f78-f4299e3b96ad tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:40.182036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31c38080-e79a-4aa4-9f78-f4299e3b96ad tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.182842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31c38080-e79a-4aa4-9f78-f4299e3b96ad tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.183980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31c38080-e79a-4aa4-9f78-f4299e3b96ad tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.184969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31c38080-e79a-4aa4-9f78-f4299e3b96ad tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.185650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31c38080-e79a-4aa4-9f78-f4299e3b96ad tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.186348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31c38080-e79a-4aa4-9f78-f4299e3b96ad tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.348895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5dbaf962-2469-48e6-8af0-0166fcd3b1bc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.357817 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5dbaf962-2469-48e6-8af0-0166fcd3b1bc tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.309005 Oct 04 18:18:40.378736 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2064/4123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:40 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:40.406364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:40.407049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:40.422136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.423925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.425608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.437773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.438307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.438754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.635879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-31c38080-e79a-4aa4-9f78-f4299e3b96ad tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.645451 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-31c38080-e79a-4aa4-9f78-f4299e3b96ad tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1526 microversion: 2.1 time: 0.480141 Oct 04 18:18:40.650104 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2060/4124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:40 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1526 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:40.663984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c592872d-708e-4a43-9b0b-24e22c0dbb22 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:40.664753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c592872d-708e-4a43-9b0b-24e22c0dbb22 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:40.683210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c592872d-708e-4a43-9b0b-24e22c0dbb22 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.684078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c592872d-708e-4a43-9b0b-24e22c0dbb22 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.684813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c592872d-708e-4a43-9b0b-24e22c0dbb22 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.685824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c592872d-708e-4a43-9b0b-24e22c0dbb22 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.686622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c592872d-708e-4a43-9b0b-24e22c0dbb22 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.687660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c592872d-708e-4a43-9b0b-24e22c0dbb22 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.717884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-c592872d-708e-4a43-9b0b-24e22c0dbb22 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lazy-loading 'flavor' on Instance uuid afef2588-b2e9-4b9e-943c-44469215dd64 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:40.816395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.828251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.830293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.832210 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bfd3ee84-5f2d-4ce5-9c61-1b573c877123 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1559 microversion: 2.21 time: 0.451747 Oct 04 18:18:40.834246 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c592872d-708e-4a43-9b0b-24e22c0dbb22 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 202 len: 0 microversion: 2.1 time: 0.181945 Oct 04 18:18:40.835713 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2061/4125] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:40 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:18:40.841947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c9304874-01ff-4ec5-a929-12426c28480d req-eaa6e24e-3863-4be6-bc34-94f9a921f901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2456a92f-0392-4e29-9757-69aa6d2edee6", "name": "network-vif-deleted", "tag": "51435862-093c-4b0c-ba78-8d6cd9b4e704"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:40.849166 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2065/4126] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:40 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1559 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:40.853652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c9304874-01ff-4ec5-a929-12426c28480d req-eaa6e24e-3863-4be6-bc34-94f9a921f901 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.854510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c9304874-01ff-4ec5-a929-12426c28480d req-eaa6e24e-3863-4be6-bc34-94f9a921f901 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.855277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c9304874-01ff-4ec5-a929-12426c28480d req-eaa6e24e-3863-4be6-bc34-94f9a921f901 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.858288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8260397c-757e-4c42-b4de-ad7a0d8391df tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:40.860421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8260397c-757e-4c42-b4de-ad7a0d8391df tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:40.867281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8260397c-757e-4c42-b4de-ad7a0d8391df tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.868048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8260397c-757e-4c42-b4de-ad7a0d8391df tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.868664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8260397c-757e-4c42-b4de-ad7a0d8391df tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.869531 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c9304874-01ff-4ec5-a929-12426c28480d req-eaa6e24e-3863-4be6-bc34-94f9a921f901 service nova] Creating event network-vif-deleted:51435862-093c-4b0c-ba78-8d6cd9b4e704 for instance 2456a92f-0392-4e29-9757-69aa6d2edee6 on n-h1-850499-14 Oct 04 18:18:40.870435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8260397c-757e-4c42-b4de-ad7a0d8391df tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.871093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8260397c-757e-4c42-b4de-ad7a0d8391df tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.871715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8260397c-757e-4c42-b4de-ad7a0d8391df tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.876386 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c9304874-01ff-4ec5-a929-12426c28480d req-eaa6e24e-3863-4be6-bc34-94f9a921f901 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038877 Oct 04 18:18:40.877147 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2062/4127] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:40.882897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f85e49e1-29aa-42a8-a8c8-37633e7dc04d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:40.891915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f85e49e1-29aa-42a8-a8c8-37633e7dc04d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:40.898994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f85e49e1-29aa-42a8-a8c8-37633e7dc04d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.899673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f85e49e1-29aa-42a8-a8c8-37633e7dc04d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.900236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f85e49e1-29aa-42a8-a8c8-37633e7dc04d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.901736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f85e49e1-29aa-42a8-a8c8-37633e7dc04d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.902644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f85e49e1-29aa-42a8-a8c8-37633e7dc04d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.903287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f85e49e1-29aa-42a8-a8c8-37633e7dc04d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.229276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8260397c-757e-4c42-b4de-ad7a0d8391df tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:41.248800 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8260397c-757e-4c42-b4de-ad7a0d8391df tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.398407 Oct 04 18:18:41.250342 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2066/4128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:40 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:41.286777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f85e49e1-29aa-42a8-a8c8-37633e7dc04d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:41.306853 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f85e49e1-29aa-42a8-a8c8-37633e7dc04d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1514 microversion: 2.1 time: 0.425604 Oct 04 18:18:41.307766 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2063/4129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:40 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1514 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:41.675134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:41.676051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:41.686682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.687819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.688556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.690115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.690743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.691479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.732394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.733214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.733963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.734657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lazy-loading 'fault' on Instance uuid 2456a92f-0392-4e29-9757-69aa6d2edee6 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:41.828745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a286ea854034f17a683a3d326610734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953ac3631ecb44ea9ff740d7c30580d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:41.844367 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c996201-ff79-4ca5-8dce-391056a865b6 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 200 len: 1314 microversion: 2.1 time: 0.170948 Oct 04 18:18:41.862579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:41.864254 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2067/4130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:41 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:41.865024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:41.873768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.875023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.875669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.876813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.889482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.890321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.181902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:42.195147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:42.197042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:42.201162 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f66cc427-8ef6-4adf-816d-ae0dc767e287 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1559 microversion: 2.21 time: 0.343797 Oct 04 18:18:42.204430 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2064/4131] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:41 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1559 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:42.276536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7cbd5305-5343-45ce-88e4-46446238b347 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:42.277256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7cbd5305-5343-45ce-88e4-46446238b347 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:42.305110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:42.312278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cbd5305-5343-45ce-88e4-46446238b347 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.316098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cbd5305-5343-45ce-88e4-46446238b347 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.318930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cbd5305-5343-45ce-88e4-46446238b347 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.321005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cbd5305-5343-45ce-88e4-46446238b347 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.323549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cbd5305-5343-45ce-88e4-46446238b347 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.325525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cbd5305-5343-45ce-88e4-46446238b347 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.344027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eec53638-7038-4a3c-8c44-6b4aa4e9f473 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:42.345276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eec53638-7038-4a3c-8c44-6b4aa4e9f473 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:42.355930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=95,nova_api:UPDATE=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:42.363930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eec53638-7038-4a3c-8c44-6b4aa4e9f473 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.364317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eec53638-7038-4a3c-8c44-6b4aa4e9f473 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.364865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eec53638-7038-4a3c-8c44-6b4aa4e9f473 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.367256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eec53638-7038-4a3c-8c44-6b4aa4e9f473 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.370781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eec53638-7038-4a3c-8c44-6b4aa4e9f473 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.371607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eec53638-7038-4a3c-8c44-6b4aa4e9f473 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.927529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7cbd5305-5343-45ce-88e4-46446238b347 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:42.927529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:42.928246 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7cbd5305-5343-45ce-88e4-46446238b347 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.655973 Oct 04 18:18:42.944902 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2068/4132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:42 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:42.944902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:42.944902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] [instance: 2456a92f-0392-4e29-9757-69aa6d2edee6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:42.950442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.950442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.950937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.952102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.952300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.953077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.986048 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] HTTP exception thrown: Instance 2456a92f-0392-4e29-9757-69aa6d2edee6 could not be found. Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Request method failure captured: Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 HTTP/1.1 Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHjfukM7vM1JlCq77BTSe-yVBsI0xHF-ZWbcjt9407ZLkc4uXGzuxI-eqAn-95WTLQEo0TRfa7GNlQGs-v_VLU7C5RuPyW69FrFMwzxVtqc3s8wj8sKDVyJZx7BpC49GQBGsYLhes074KJyKf-utlt2b8tBDEonDmEkFUqYvJZkco4g Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 953ac3631ecb44ea9ff740d7c30580d9 Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1783282222 Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_953ac3631ecb44ea9ff740d7c30580d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/953ac3631ecb44ea9ff740d7c30580d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/953ac3631ecb44ea9ff740d7c30580d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/953ac3631ecb44ea9ff740d7c30580d9"}]}] Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1783282222 Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 953ac3631ecb44ea9ff740d7c30580d9 Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1783282222 Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-InstanceActionsNegativeTestJSON-1783282222-project Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 4a286ea854034f17a683a3d326610734 Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1783282222-project Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 2456a92f-0392-4e29-9757-69aa6d2edee6 could not be found. Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '2456a92f-0392-4e29-9757-69aa6d2edee6'} Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2456a92f-0392-4e29-9757-69aa6d2edee6 could not be found. Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2456a92f-0392-4e29-9757-69aa6d2edee6 could not be found. Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:42.987937 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:42.993315 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:42.993315 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:42.993315 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:42.993315 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:42.993315 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:42.993315 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:42.993315 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2456a92f-0392-4e29-9757-69aa6d2edee6 could not be found. Oct 04 18:18:42.993315 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:42.993315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] Returning 404 to user: Instance 2456a92f-0392-4e29-9757-69aa6d2edee6 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:42.994742 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-900da9c8-6987-41c6-8ba8-0041c0eeeb37 tempest-InstanceActionsNegativeTestJSON-1783282222 tempest-InstanceActionsNegativeTestJSON-1783282222-project] 10.222.0.18 "GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6" status: 404 len: 111 microversion: 2.1 time: 0.063278 Oct 04 18:18:42.995448 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2069/4133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:42 2022] GET /compute/v2.1/servers/2456a92f-0392-4e29-9757-69aa6d2edee6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:43.024534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eec53638-7038-4a3c-8c44-6b4aa4e9f473 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:43.042444 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eec53638-7038-4a3c-8c44-6b4aa4e9f473 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1497 microversion: 2.1 time: 0.710340 Oct 04 18:18:43.045153 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2065/4134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:42 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1497 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:43.070011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:43.070696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:43.078743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.079967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.080687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.081831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.082510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.083206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.123284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lazy-loading 'flavor' on Instance uuid afef2588-b2e9-4b9e-943c-44469215dd64 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:43.152954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-dabacb35-f31f-4ac4-a240-163511b912fe req-5d3a5721-e67f-453d-827a-c32c7a6d006a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ec651f-d081-4ee7-a63a-025f04f9a7c5", "name": "network-vif-deleted", "tag": "1f99fc95-a489-4bb7-a070-4eeef4fa18cb"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:43.174600 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Cannot 'suspend' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state suspended Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action HTTP/1.1 Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 15 Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: {"suspend": {}} Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'suspend' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state suspended Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'afef2588-b2e9-4b9e-943c-44469215dd64', 'body': {'suspend': {}}} Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afef2588-b2e9-4b9e-943c-44469215dd64 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 18:18:43.176637 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state suspended Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state suspended Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 409 to user: Cannot 'suspend' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state suspended {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-482c00aa-0d09-434a-a8c0-c7fbed46ab43 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 409 len: 148 microversion: 2.1 time: 0.113266 Oct 04 18:18:43.187185 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2070/4135] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:43 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 148 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:18:43.189243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dabacb35-f31f-4ac4-a240-163511b912fe req-5d3a5721-e67f-453d-827a-c32c7a6d006a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.189243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dabacb35-f31f-4ac4-a240-163511b912fe req-5d3a5721-e67f-453d-827a-c32c7a6d006a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.189243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dabacb35-f31f-4ac4-a240-163511b912fe req-5d3a5721-e67f-453d-827a-c32c7a6d006a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.198507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-44e576fb-7d59-428c-bee7-8db7bdce60bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:43.213653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-44e576fb-7d59-428c-bee7-8db7bdce60bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:43.230394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44e576fb-7d59-428c-bee7-8db7bdce60bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.232479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44e576fb-7d59-428c-bee7-8db7bdce60bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.232625 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-dabacb35-f31f-4ac4-a240-163511b912fe req-5d3a5721-e67f-453d-827a-c32c7a6d006a service nova] Creating event network-vif-deleted:1f99fc95-a489-4bb7-a070-4eeef4fa18cb for instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 on n-h1-850499-14 Oct 04 18:18:43.234453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44e576fb-7d59-428c-bee7-8db7bdce60bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.236843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44e576fb-7d59-428c-bee7-8db7bdce60bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.244619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44e576fb-7d59-428c-bee7-8db7bdce60bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.244811 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-dabacb35-f31f-4ac4-a240-163511b912fe req-5d3a5721-e67f-453d-827a-c32c7a6d006a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096365 Oct 04 18:18:43.245534 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2066/4136] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:43.247779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44e576fb-7d59-428c-bee7-8db7bdce60bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.258577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:43.264604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:43.286459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.288999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.289650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.291857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.296785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.297547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.407845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.410491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.411496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.413344 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-44e576fb-7d59-428c-bee7-8db7bdce60bf tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 202 len: 0 microversion: 2.1 time: 0.221261 Oct 04 18:18:43.414008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lazy-loading 'fault' on Instance uuid c7ec651f-d081-4ee7-a63a-025f04f9a7c5 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:43.415244 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2071/4137] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:43 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:18:43.425471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a69827a9-d57d-41fd-8b8d-75c4078004fa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:43.427137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a69827a9-d57d-41fd-8b8d-75c4078004fa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:43.438546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69827a9-d57d-41fd-8b8d-75c4078004fa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.440024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69827a9-d57d-41fd-8b8d-75c4078004fa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.441086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69827a9-d57d-41fd-8b8d-75c4078004fa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.442337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69827a9-d57d-41fd-8b8d-75c4078004fa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.443134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69827a9-d57d-41fd-8b8d-75c4078004fa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.443925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a69827a9-d57d-41fd-8b8d-75c4078004fa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.494078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:43.505999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:43.509484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73de5fca90ac4de7ac62dba09cf6e09e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa241395f828490b8aa35ac31d8eace6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:43.510747 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d9adb3ce-c47d-4949-85c6-161719080217 tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 200 len: 1349 microversion: 2.21 time: 0.263594 Oct 04 18:18:43.511361 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2067/4138] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:43 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 1349 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:43.708691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a69827a9-d57d-41fd-8b8d-75c4078004fa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:43.722149 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a69827a9-d57d-41fd-8b8d-75c4078004fa tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1503 microversion: 2.1 time: 0.301706 Oct 04 18:18:43.722741 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2072/4139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:43 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1503 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:43.959525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4152f7e5-a4d4-4266-9af5-977ed521412b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:43.960608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4152f7e5-a4d4-4266-9af5-977ed521412b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:43.971055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4152f7e5-a4d4-4266-9af5-977ed521412b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.972027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4152f7e5-a4d4-4266-9af5-977ed521412b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.972646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4152f7e5-a4d4-4266-9af5-977ed521412b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.974062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4152f7e5-a4d4-4266-9af5-977ed521412b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.974857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4152f7e5-a4d4-4266-9af5-977ed521412b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.975494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4152f7e5-a4d4-4266-9af5-977ed521412b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.289664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4152f7e5-a4d4-4266-9af5-977ed521412b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:44.306124 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4152f7e5-a4d4-4266-9af5-977ed521412b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.350511 Oct 04 18:18:44.309623 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2068/4140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:43 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:44.540881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:44.541527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:44.553206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.554342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.556442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.559414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.560874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.561322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.599091 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] HTTP exception thrown: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Request method failure captured: Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 HTTP/1.1 Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHjrkeTMMQypaq_MHfHUNbgtRLwPluNyChPrT97W0tex4K6KsCmaR2JtJIdKR3fSHlQ6rcXeZgmA-96t9hu-v_jxPLFd_cPEo332jnPAHZbd2iTwlPVYJk7PUvVCP-uSjqHOglLd9sDNxgQdQr9gVnxW8YDB3EgnOX95I5GVcT_1mvA Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: fa241395f828490b8aa35ac31d8eace6 Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1245087330 Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa241395f828490b8aa35ac31d8eace6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa241395f828490b8aa35ac31d8eace6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa241395f828490b8aa35ac31d8eace6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa241395f828490b8aa35ac31d8eace6"}]}] Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-InstanceActionsV221TestJSON-1245087330 Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: fa241395f828490b8aa35ac31d8eace6 Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1245087330 Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-InstanceActionsV221TestJSON-1245087330-project Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 73de5fca90ac4de7ac62dba09cf6e09e Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-InstanceActionsV221TestJSON-1245087330-project Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'c7ec651f-d081-4ee7-a63a-025f04f9a7c5'} Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.608826 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:44.615430 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.615430 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:44.615430 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:44.615430 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:44.615430 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:44.615430 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:44.615430 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:44.615430 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.615430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Returning 404 to user: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:44.615430 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-af1cc5c5-9f08-4a97-9705-aac12015432c tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 404 len: 111 microversion: 2.21 time: 0.074507 Oct 04 18:18:44.620734 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2073/4141] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:44 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:44.621720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-090de671-ee14-4f4e-967c-2a3c384ea88b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '.version_select at 0x7fd4d18ade50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:44.622538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-090de671-ee14-4f4e-967c-2a3c384ea88b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:44.634081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-090de671-ee14-4f4e-967c-2a3c384ea88b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.634310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-090de671-ee14-4f4e-967c-2a3c384ea88b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.638304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-090de671-ee14-4f4e-967c-2a3c384ea88b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.639385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-090de671-ee14-4f4e-967c-2a3c384ea88b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.640181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-090de671-ee14-4f4e-967c-2a3c384ea88b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.641685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-090de671-ee14-4f4e-967c-2a3c384ea88b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.747804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67d98567-cae2-4728-abb0-24fcc4d1746f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:44.749193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67d98567-cae2-4728-abb0-24fcc4d1746f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:44.769082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d98567-cae2-4728-abb0-24fcc4d1746f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.776473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d98567-cae2-4728-abb0-24fcc4d1746f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.778796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d98567-cae2-4728-abb0-24fcc4d1746f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.789057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d98567-cae2-4728-abb0-24fcc4d1746f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.789920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d98567-cae2-4728-abb0-24fcc4d1746f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.791956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67d98567-cae2-4728-abb0-24fcc4d1746f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.875151 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-090de671-ee14-4f4e-967c-2a3c384ea88b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.250494 Oct 04 18:18:44.876459 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2069/4142] 10.222.0.18 () {60 vars in 1337 bytes} [Tue Oct 4 18:18:44 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5/os-instance-actions => generated 611 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:44.898075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:44.898881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:44.906542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.907536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.908166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.909125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.909809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.910590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.936519 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] HTTP exception thrown: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Request method failure captured: Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 HTTP/1.1 Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHjrkeTMMQypaq_MHfHUNbgtRLwPluNyChPrT97W0tex4K6KsCmaR2JtJIdKR3fSHlQ6rcXeZgmA-96t9hu-v_jxPLFd_cPEo332jnPAHZbd2iTwlPVYJk7PUvVCP-uSjqHOglLd9sDNxgQdQr9gVnxW8YDB3EgnOX95I5GVcT_1mvA Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: fa241395f828490b8aa35ac31d8eace6 Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1245087330 Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa241395f828490b8aa35ac31d8eace6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa241395f828490b8aa35ac31d8eace6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa241395f828490b8aa35ac31d8eace6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa241395f828490b8aa35ac31d8eace6"}]}] Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-InstanceActionsV221TestJSON-1245087330 Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: fa241395f828490b8aa35ac31d8eace6 Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1245087330 Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-InstanceActionsV221TestJSON-1245087330-project Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 73de5fca90ac4de7ac62dba09cf6e09e Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-InstanceActionsV221TestJSON-1245087330-project Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c7ec651f-d081-4ee7-a63a-025f04f9a7c5'} Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:44.938821 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Returning 404 to user: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-96a38ad1-45b4-472b-9a8d-55b08fece36b tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 404 len: 111 microversion: 2.21 time: 0.050344 Oct 04 18:18:44.946819 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2070/4143] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:18:44 2022] DELETE /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:44.957437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:44.958587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] [instance: c7ec651f-d081-4ee7-a63a-025f04f9a7c5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:44.966121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.967151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.967783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.968710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.969344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.969977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:45.007154 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] HTTP exception thrown: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Request method failure captured: Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 HTTP/1.1 Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHjrkeTMMQypaq_MHfHUNbgtRLwPluNyChPrT97W0tex4K6KsCmaR2JtJIdKR3fSHlQ6rcXeZgmA-96t9hu-v_jxPLFd_cPEo332jnPAHZbd2iTwlPVYJk7PUvVCP-uSjqHOglLd9sDNxgQdQr9gVnxW8YDB3EgnOX95I5GVcT_1mvA Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: fa241395f828490b8aa35ac31d8eace6 Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1245087330 Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa241395f828490b8aa35ac31d8eace6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa241395f828490b8aa35ac31d8eace6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa241395f828490b8aa35ac31d8eace6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa241395f828490b8aa35ac31d8eace6"}]}] Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-InstanceActionsV221TestJSON-1245087330 Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: fa241395f828490b8aa35ac31d8eace6 Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1245087330 Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-InstanceActionsV221TestJSON-1245087330-project Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 73de5fca90ac4de7ac62dba09cf6e09e Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-InstanceActionsV221TestJSON-1245087330-project Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c7ec651f-d081-4ee7-a63a-025f04f9a7c5'} Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:45.010190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:45.018795 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:45.018795 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:45.018795 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:45.018795 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:45.018795 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:45.018795 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:45.018795 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. Oct 04 18:18:45.018795 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:45.025188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] Returning 404 to user: Instance c7ec651f-d081-4ee7-a63a-025f04f9a7c5 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:45.026190 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-00c3c946-a83b-48fb-aff0-f5a878c61d9e tempest-InstanceActionsV221TestJSON-1245087330 tempest-InstanceActionsV221TestJSON-1245087330-project] 10.222.0.18 "GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5" status: 404 len: 111 microversion: 2.21 time: 0.073612 Oct 04 18:18:45.031220 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2071/4144] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:44 2022] GET /compute/v2.1/servers/c7ec651f-d081-4ee7-a63a-025f04f9a7c5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:45.337559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a00ac59a-a8e9-4f84-b7c5-19d626e19adc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:45.338488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a00ac59a-a8e9-4f84-b7c5-19d626e19adc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:45.354380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a00ac59a-a8e9-4f84-b7c5-19d626e19adc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:45.355462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a00ac59a-a8e9-4f84-b7c5-19d626e19adc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:45.356014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a00ac59a-a8e9-4f84-b7c5-19d626e19adc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:45.356975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a00ac59a-a8e9-4f84-b7c5-19d626e19adc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:45.357510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a00ac59a-a8e9-4f84-b7c5-19d626e19adc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:45.358063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a00ac59a-a8e9-4f84-b7c5-19d626e19adc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:45.693660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-67d98567-cae2-4728-abb0-24fcc4d1746f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.739641 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67d98567-cae2-4728-abb0-24fcc4d1746f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1503 microversion: 2.1 time: 0.996359 Oct 04 18:18:45.741017 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2074/4145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:44 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1503 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:45.785538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a00ac59a-a8e9-4f84-b7c5-19d626e19adc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.794603 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a00ac59a-a8e9-4f84-b7c5-19d626e19adc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.462148 Oct 04 18:18:45.805950 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2072/4146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:45 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:46.771324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-985cbe33-cc04-47c7-abc8-535f88d90dd9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:46.772627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-985cbe33-cc04-47c7-abc8-535f88d90dd9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:46.787342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-985cbe33-cc04-47c7-abc8-535f88d90dd9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.788126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-985cbe33-cc04-47c7-abc8-535f88d90dd9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.789418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-985cbe33-cc04-47c7-abc8-535f88d90dd9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.790598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-985cbe33-cc04-47c7-abc8-535f88d90dd9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.791249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-985cbe33-cc04-47c7-abc8-535f88d90dd9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.791838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-985cbe33-cc04-47c7-abc8-535f88d90dd9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.822324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1cb642c2-fe37-411f-bf51-d6dbbe24fcfc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:46.823514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1cb642c2-fe37-411f-bf51-d6dbbe24fcfc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:46.837566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cb642c2-fe37-411f-bf51-d6dbbe24fcfc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.839191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cb642c2-fe37-411f-bf51-d6dbbe24fcfc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.839854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cb642c2-fe37-411f-bf51-d6dbbe24fcfc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.840764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cb642c2-fe37-411f-bf51-d6dbbe24fcfc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.841917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cb642c2-fe37-411f-bf51-d6dbbe24fcfc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.842565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cb642c2-fe37-411f-bf51-d6dbbe24fcfc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.227064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-985cbe33-cc04-47c7-abc8-535f88d90dd9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:47.239332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1cb642c2-fe37-411f-bf51-d6dbbe24fcfc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:47.240815 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-985cbe33-cc04-47c7-abc8-535f88d90dd9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1503 microversion: 2.1 time: 0.480372 Oct 04 18:18:47.257075 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2075/4147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:46 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1503 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:47.270025 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1cb642c2-fe37-411f-bf51-d6dbbe24fcfc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.451966 Oct 04 18:18:47.276359 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2073/4148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:46 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:48.280382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c9aac2de-b61f-4da5-bacd-fa8c8e98c1ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:48.282860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c9aac2de-b61f-4da5-bacd-fa8c8e98c1ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:48.290443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9aac2de-b61f-4da5-bacd-fa8c8e98c1ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.291249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9aac2de-b61f-4da5-bacd-fa8c8e98c1ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.291905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9aac2de-b61f-4da5-bacd-fa8c8e98c1ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.292801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9aac2de-b61f-4da5-bacd-fa8c8e98c1ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.293442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9aac2de-b61f-4da5-bacd-fa8c8e98c1ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.294052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9aac2de-b61f-4da5-bacd-fa8c8e98c1ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.302173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-189a2b9b-4eb3-46ad-bbce-0649249ddfc9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:48.303569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-189a2b9b-4eb3-46ad-bbce-0649249ddfc9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:48.318366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-189a2b9b-4eb3-46ad-bbce-0649249ddfc9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.319214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-189a2b9b-4eb3-46ad-bbce-0649249ddfc9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.319986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-189a2b9b-4eb3-46ad-bbce-0649249ddfc9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.320904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-189a2b9b-4eb3-46ad-bbce-0649249ddfc9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.321549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-189a2b9b-4eb3-46ad-bbce-0649249ddfc9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.322177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-189a2b9b-4eb3-46ad-bbce-0649249ddfc9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.722227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c9aac2de-b61f-4da5-bacd-fa8c8e98c1ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:48.737306 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c9aac2de-b61f-4da5-bacd-fa8c8e98c1ed tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1503 microversion: 2.1 time: 0.456767 Oct 04 18:18:48.738758 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2076/4149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:48 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1503 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:48.758787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-189a2b9b-4eb3-46ad-bbce-0649249ddfc9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:48.769565 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-189a2b9b-4eb3-46ad-bbce-0649249ddfc9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.472484 Oct 04 18:18:48.770378 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2074/4150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:48 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:49.766409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74d3cdc5-afbd-49d6-b37f-078441f2c6ee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:49.767241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-74d3cdc5-afbd-49d6-b37f-078441f2c6ee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:49.774934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d3cdc5-afbd-49d6-b37f-078441f2c6ee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:49.777972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d3cdc5-afbd-49d6-b37f-078441f2c6ee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:49.779453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d3cdc5-afbd-49d6-b37f-078441f2c6ee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:49.780469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d3cdc5-afbd-49d6-b37f-078441f2c6ee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:49.782256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d3cdc5-afbd-49d6-b37f-078441f2c6ee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:49.783016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74d3cdc5-afbd-49d6-b37f-078441f2c6ee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:49.794143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9fd5a90-695b-4915-bdfc-58ec569d8bea tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:49.799772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9fd5a90-695b-4915-bdfc-58ec569d8bea tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:49.814791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9fd5a90-695b-4915-bdfc-58ec569d8bea tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:49.815659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9fd5a90-695b-4915-bdfc-58ec569d8bea tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:49.817639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9fd5a90-695b-4915-bdfc-58ec569d8bea tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:49.819835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9fd5a90-695b-4915-bdfc-58ec569d8bea tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:49.825670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9fd5a90-695b-4915-bdfc-58ec569d8bea tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:49.826280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9fd5a90-695b-4915-bdfc-58ec569d8bea tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.257459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-74d3cdc5-afbd-49d6-b37f-078441f2c6ee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:50.275017 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74d3cdc5-afbd-49d6-b37f-078441f2c6ee tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.513745 Oct 04 18:18:50.301946 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2077/4151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:49 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:50.307821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b67f7d4-b86e-4390-a9de-22dca1942650 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Action: 'create', calling method: .version_select at 0x7fd4d1253940>, body: {"keypair": {"name": "tempest-keypair-787895292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv6DUJojiQNeWmp43ul+8yd5KROIcJgTi072PUdiIV7+a7UMW1NemD4IV143P3jT5RcGMtFh0WYpUTAUlglJfktJrbyBs3cW+A27MpVs7q70mWk3b+m4Jn8hgMRdACxyg=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:50.336439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b67f7d4-b86e-4390-a9de-22dca1942650 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Getting quotas for project c4f0c4d3de4e437ba1bc7c659aee2428. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:50.343926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9fd5a90-695b-4915-bdfc-58ec569d8bea tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:50.347732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1b67f7d4-b86e-4390-a9de-22dca1942650 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Getting quotas for user bf74e18995d24935b50f8058a44d5d12 and project c4f0c4d3de4e437ba1bc7c659aee2428. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:50.363622 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9fd5a90-695b-4915-bdfc-58ec569d8bea tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.565168 Oct 04 18:18:50.364249 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2075/4152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:49 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:50.372962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9cd2fb78-2350-4903-b71a-0580f9cc29ac tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:50.373591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9cd2fb78-2350-4903-b71a-0580f9cc29ac tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:50.387217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cd2fb78-2350-4903-b71a-0580f9cc29ac tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.387728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cd2fb78-2350-4903-b71a-0580f9cc29ac tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.388177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cd2fb78-2350-4903-b71a-0580f9cc29ac tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.388376 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b67f7d4-b86e-4390-a9de-22dca1942650 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.084033 Oct 04 18:18:50.388899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cd2fb78-2350-4903-b71a-0580f9cc29ac tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.396186 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2078/4153] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 4 18:18:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:18:50.397042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cd2fb78-2350-4903-b71a-0580f9cc29ac tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.397832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cd2fb78-2350-4903-b71a-0580f9cc29ac tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.453687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:50.979640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9cd2fb78-2350-4903-b71a-0580f9cc29ac tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:51.004132 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9cd2fb78-2350-4903-b71a-0580f9cc29ac tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.638453 Oct 04 18:18:51.005045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2076/4154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:50 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:51.035375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-794db699-0eff-48d2-8607-e9a07948997c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:51.036011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-794db699-0eff-48d2-8607-e9a07948997c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: 702f765c-92e0-4d1f-86da-460374c8f656] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:51.056728 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-794db699-0eff-48d2-8607-e9a07948997c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 702f765c-92e0-4d1f-86da-460374c8f656 could not be found. Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-794db699-0eff-48d2-8607-e9a07948997c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/702f765c-92e0-4d1f-86da-460374c8f656/action HTTP/1.1 Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 15 Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: {"unpause": {}} Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 702f765c-92e0-4d1f-86da-460374c8f656 could not be found. Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '702f765c-92e0-4d1f-86da-460374c8f656', 'body': {'unpause': {}}} Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702f765c-92e0-4d1f-86da-460374c8f656 could not be found. Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702f765c-92e0-4d1f-86da-460374c8f656 could not be found. Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:51.058449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:51.064019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:51.064019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:51.064019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702f765c-92e0-4d1f-86da-460374c8f656 could not be found. Oct 04 18:18:51.064019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:51.064019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-794db699-0eff-48d2-8607-e9a07948997c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 702f765c-92e0-4d1f-86da-460374c8f656 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:51.064019 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-794db699-0eff-48d2-8607-e9a07948997c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/702f765c-92e0-4d1f-86da-460374c8f656/action" status: 404 len: 111 microversion: 2.1 time: 0.032465 Oct 04 18:18:51.071600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7560cf7-209f-4bf3-a0c2-771ea3c456d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:51.072614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a7560cf7-209f-4bf3-a0c2-771ea3c456d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:51.074336 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2079/4155] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:51 2022] POST /compute/v2.1/servers/702f765c-92e0-4d1f-86da-460374c8f656/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:51.081133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7560cf7-209f-4bf3-a0c2-771ea3c456d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.082616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7560cf7-209f-4bf3-a0c2-771ea3c456d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.083626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7560cf7-209f-4bf3-a0c2-771ea3c456d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.084859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7560cf7-209f-4bf3-a0c2-771ea3c456d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.085582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7560cf7-209f-4bf3-a0c2-771ea3c456d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.086777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7560cf7-209f-4bf3-a0c2-771ea3c456d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.389140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fc4378e0-3e51-4f32-ab0c-f9c3a81203d2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:51.390035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fc4378e0-3e51-4f32-ab0c-f9c3a81203d2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:51.407340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc4378e0-3e51-4f32-ab0c-f9c3a81203d2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.412124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc4378e0-3e51-4f32-ab0c-f9c3a81203d2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.414947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc4378e0-3e51-4f32-ab0c-f9c3a81203d2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.417885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc4378e0-3e51-4f32-ab0c-f9c3a81203d2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.419394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc4378e0-3e51-4f32-ab0c-f9c3a81203d2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.420078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc4378e0-3e51-4f32-ab0c-f9c3a81203d2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.509952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a7560cf7-209f-4bf3-a0c2-771ea3c456d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:51.520739 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a7560cf7-209f-4bf3-a0c2-771ea3c456d2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.454688 Oct 04 18:18:51.521600 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2077/4156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:51 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:51.553102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d5d0f486-178b-4301-8169-5ce1149b41ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:51.554856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d5d0f486-178b-4301-8169-5ce1149b41ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:51.567324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d0f486-178b-4301-8169-5ce1149b41ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.568110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d0f486-178b-4301-8169-5ce1149b41ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.568760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d0f486-178b-4301-8169-5ce1149b41ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.569661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d0f486-178b-4301-8169-5ce1149b41ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.573027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d0f486-178b-4301-8169-5ce1149b41ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.573845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d0f486-178b-4301-8169-5ce1149b41ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.054284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fc4378e0-3e51-4f32-ab0c-f9c3a81203d2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.064521 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fc4378e0-3e51-4f32-ab0c-f9c3a81203d2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 0.681117 Oct 04 18:18:52.065126 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2080/4157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:51 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:52.087398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1771aaa3-0a98-4444-8723-8e7fa6516549 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:52.091698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1771aaa3-0a98-4444-8723-8e7fa6516549 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:52.108488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1771aaa3-0a98-4444-8723-8e7fa6516549 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.109065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1771aaa3-0a98-4444-8723-8e7fa6516549 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.109507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1771aaa3-0a98-4444-8723-8e7fa6516549 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.110437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1771aaa3-0a98-4444-8723-8e7fa6516549 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.113908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1771aaa3-0a98-4444-8723-8e7fa6516549 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.114623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1771aaa3-0a98-4444-8723-8e7fa6516549 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.175865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1771aaa3-0a98-4444-8723-8e7fa6516549 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:52.299011 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1771aaa3-0a98-4444-8723-8e7fa6516549 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "DELETE /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 204 len: 0 microversion: 2.1 time: 0.220355 Oct 04 18:18:52.300479 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2081/4158] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:52 2022] DELETE /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:52.321897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c68908ee-0f22-4e68-ac30-9a1a96fee371 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:52.323990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c68908ee-0f22-4e68-ac30-9a1a96fee371 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:52.332187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c68908ee-0f22-4e68-ac30-9a1a96fee371 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.332806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c68908ee-0f22-4e68-ac30-9a1a96fee371 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.333319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c68908ee-0f22-4e68-ac30-9a1a96fee371 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.334201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c68908ee-0f22-4e68-ac30-9a1a96fee371 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.335075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c68908ee-0f22-4e68-ac30-9a1a96fee371 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.335755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c68908ee-0f22-4e68-ac30-9a1a96fee371 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.415212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d5d0f486-178b-4301-8169-5ce1149b41ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.424703 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d5d0f486-178b-4301-8169-5ce1149b41ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.875368 Oct 04 18:18:52.425993 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2078/4159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:51 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:52.450886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:52.451458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:52.485989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.487728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.488860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.490467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.491533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.492248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.521887 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Cannot 'unpause' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action HTTP/1.1 Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 15 Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: {"unpause": {}} Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: exception: Cannot 'unpause' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'afef2588-b2e9-4b9e-943c-44469215dd64', 'body': {'unpause': {}}} Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afef2588-b2e9-4b9e-943c-44469215dd64 in vm_state active. Cannot unpause while the instance is in this state. Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:52.524050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:52.528736 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:52.528736 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:52.528736 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:52.528736 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:18:52.528736 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:52.531642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 409 to user: Cannot 'unpause' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:52.532847 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-98f81803-feb1-4bca-996f-cc4c8264803b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 409 len: 145 microversion: 2.1 time: 0.087196 Oct 04 18:18:52.534172 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2079/4160] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:52 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 145 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:18:52.544050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d60d8f81-6189-4eeb-be65-7e7a7ac71087 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:52.544699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d60d8f81-6189-4eeb-be65-7e7a7ac71087 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:52.555172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d60d8f81-6189-4eeb-be65-7e7a7ac71087 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.555679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d60d8f81-6189-4eeb-be65-7e7a7ac71087 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.556122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d60d8f81-6189-4eeb-be65-7e7a7ac71087 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.556835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d60d8f81-6189-4eeb-be65-7e7a7ac71087 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.557384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d60d8f81-6189-4eeb-be65-7e7a7ac71087 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.565690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d60d8f81-6189-4eeb-be65-7e7a7ac71087 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.782795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c68908ee-0f22-4e68-ac30-9a1a96fee371 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.793070 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c68908ee-0f22-4e68-ac30-9a1a96fee371 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1667 microversion: 2.1 time: 0.480855 Oct 04 18:18:52.797122 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2082/4161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:52 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1667 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:53.091516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0604bbf8-79c3-406a-9bc6-d005128a5fa2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:53.093036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0604bbf8-79c3-406a-9bc6-d005128a5fa2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:53.116213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0604bbf8-79c3-406a-9bc6-d005128a5fa2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.117315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0604bbf8-79c3-406a-9bc6-d005128a5fa2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.119638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0604bbf8-79c3-406a-9bc6-d005128a5fa2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:53.122629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0604bbf8-79c3-406a-9bc6-d005128a5fa2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.124834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0604bbf8-79c3-406a-9bc6-d005128a5fa2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.126829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0604bbf8-79c3-406a-9bc6-d005128a5fa2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:53.149447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d60d8f81-6189-4eeb-be65-7e7a7ac71087 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:53.168051 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d60d8f81-6189-4eeb-be65-7e7a7ac71087 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.629750 Oct 04 18:18:53.173233 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2080/4162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:52 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:53.202518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8fe1cfd7-11c5-40c1-ba8d-3af5b06f693f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:53.204195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8fe1cfd7-11c5-40c1-ba8d-3af5b06f693f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:53.214733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fe1cfd7-11c5-40c1-ba8d-3af5b06f693f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.217604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fe1cfd7-11c5-40c1-ba8d-3af5b06f693f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.218278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fe1cfd7-11c5-40c1-ba8d-3af5b06f693f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:53.226380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fe1cfd7-11c5-40c1-ba8d-3af5b06f693f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.228090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fe1cfd7-11c5-40c1-ba8d-3af5b06f693f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.229854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fe1cfd7-11c5-40c1-ba8d-3af5b06f693f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.221942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8fe1cfd7-11c5-40c1-ba8d-3af5b06f693f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:54.229948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0604bbf8-79c3-406a-9bc6-d005128a5fa2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:54.243483 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0604bbf8-79c3-406a-9bc6-d005128a5fa2 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1723 microversion: 2.1 time: 1.157528 Oct 04 18:18:54.244095 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2083/4163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:53 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1723 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:54.246942 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8fe1cfd7-11c5-40c1-ba8d-3af5b06f693f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 1.052782 Oct 04 18:18:54.248879 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2081/4164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:53 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:54.250846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5f10fc37-aeee-4d0f-843b-e9f5aca26902 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:54.251550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5f10fc37-aeee-4d0f-843b-e9f5aca26902 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:54.281770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4298b00e-0149-4e9f-ad18-3cea09eb05a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:54.282888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4298b00e-0149-4e9f-ad18-3cea09eb05a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: e420aad7-398b-4898-aaf9-cf63b14db5af] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:54.284894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f10fc37-aeee-4d0f-843b-e9f5aca26902 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.286847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f10fc37-aeee-4d0f-843b-e9f5aca26902 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.289944 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4298b00e-0149-4e9f-ad18-3cea09eb05a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance e420aad7-398b-4898-aaf9-cf63b14db5af could not be found. Oct 04 18:18:54.290534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f10fc37-aeee-4d0f-843b-e9f5aca26902 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4298b00e-0149-4e9f-ad18-3cea09eb05a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/e420aad7-398b-4898-aaf9-cf63b14db5af/action HTTP/1.1 Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 18 Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: {"unshelve": null} Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e420aad7-398b-4898-aaf9-cf63b14db5af could not be found. Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e420aad7-398b-4898-aaf9-cf63b14db5af', 'body': {'unshelve': None}} Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e420aad7-398b-4898-aaf9-cf63b14db5af could not be found. Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e420aad7-398b-4898-aaf9-cf63b14db5af could not be found. Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:54.292756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:54.297871 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:54.297871 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:54.297871 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:54.297871 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:54.297871 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:54.297871 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:54.297871 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e420aad7-398b-4898-aaf9-cf63b14db5af could not be found. Oct 04 18:18:54.297871 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:18:54.299469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f10fc37-aeee-4d0f-843b-e9f5aca26902 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.299469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f10fc37-aeee-4d0f-843b-e9f5aca26902 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.299469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f10fc37-aeee-4d0f-843b-e9f5aca26902 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.300913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4298b00e-0149-4e9f-ad18-3cea09eb05a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance e420aad7-398b-4898-aaf9-cf63b14db5af could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:54.302079 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4298b00e-0149-4e9f-ad18-3cea09eb05a7 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/e420aad7-398b-4898-aaf9-cf63b14db5af/action" status: 404 len: 111 microversion: 2.1 time: 0.024593 Oct 04 18:18:54.303375 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2082/4165] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:54 2022] POST /compute/v2.1/servers/e420aad7-398b-4898-aaf9-cf63b14db5af/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:54.313385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-428204ea-e85b-45c1-bbd4-ac4824e443f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:54.314325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-428204ea-e85b-45c1-bbd4-ac4824e443f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:54.323424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428204ea-e85b-45c1-bbd4-ac4824e443f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.324326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428204ea-e85b-45c1-bbd4-ac4824e443f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.325481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428204ea-e85b-45c1-bbd4-ac4824e443f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.327136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428204ea-e85b-45c1-bbd4-ac4824e443f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.328504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428204ea-e85b-45c1-bbd4-ac4824e443f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.329350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-428204ea-e85b-45c1-bbd4-ac4824e443f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.074086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f10fc37-aeee-4d0f-843b-e9f5aca26902 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:55.091444 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5f10fc37-aeee-4d0f-843b-e9f5aca26902 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1667 microversion: 2.1 time: 0.845717 Oct 04 18:18:55.092135 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2084/4166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:54 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1667 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:55.121979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-428204ea-e85b-45c1-bbd4-ac4824e443f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:55.135679 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-428204ea-e85b-45c1-bbd4-ac4824e443f2 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.828209 Oct 04 18:18:55.136274 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2083/4167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:54 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:55.176677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-61c2f245-e6f9-4e93-b005-72651e0f1707 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:55.178039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-61c2f245-e6f9-4e93-b005-72651e0f1707 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:55.192297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61c2f245-e6f9-4e93-b005-72651e0f1707 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.193288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61c2f245-e6f9-4e93-b005-72651e0f1707 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.193922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61c2f245-e6f9-4e93-b005-72651e0f1707 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.199105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61c2f245-e6f9-4e93-b005-72651e0f1707 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.200799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61c2f245-e6f9-4e93-b005-72651e0f1707 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.201934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61c2f245-e6f9-4e93-b005-72651e0f1707 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.279889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0af0f8bd-6d26-44c2-8a2c-51bac0cd1a2f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:55.280524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0af0f8bd-6d26-44c2-8a2c-51bac0cd1a2f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:55.288046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af0f8bd-6d26-44c2-8a2c-51bac0cd1a2f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.288553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af0f8bd-6d26-44c2-8a2c-51bac0cd1a2f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.297653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af0f8bd-6d26-44c2-8a2c-51bac0cd1a2f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.300243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af0f8bd-6d26-44c2-8a2c-51bac0cd1a2f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.301625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af0f8bd-6d26-44c2-8a2c-51bac0cd1a2f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.304352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0af0f8bd-6d26-44c2-8a2c-51bac0cd1a2f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.888519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61c2f245-e6f9-4e93-b005-72651e0f1707 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:55.902418 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-61c2f245-e6f9-4e93-b005-72651e0f1707 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.730448 Oct 04 18:18:55.903808 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2085/4168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:55 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:55.930971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:55.931977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:55.939849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.940754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.941726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.943731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.944412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.945073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.962674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:55.986902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0af0f8bd-6d26-44c2-8a2c-51bac0cd1a2f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:55.997907 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0af0f8bd-6d26-44c2-8a2c-51bac0cd1a2f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1700 microversion: 2.1 time: 0.721942 Oct 04 18:18:55.998821 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2084/4169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:55 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1700 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:56.020709 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Cannot 'unshelve' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action HTTP/1.1 Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 18 Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: {"unshelve": null} Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'unshelve' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'afef2588-b2e9-4b9e-943c-44469215dd64', 'body': {'unshelve': None}} Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afef2588-b2e9-4b9e-943c-44469215dd64 in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:18:56.022945 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active Oct 04 18:18:56.028415 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:56.031751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2aa7c57e-cb76-435d-bf5b-2ed15e6c7ebc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:56.036043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 409 to user: Cannot 'unshelve' instance afef2588-b2e9-4b9e-943c-44469215dd64 while it is in vm_state active {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:56.037234 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6ed4dab4-570e-480a-a4cc-cec6f43f142b tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action" status: 409 len: 146 microversion: 2.1 time: 0.116309 Oct 04 18:18:56.038364 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2086/4170] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:55 2022] POST /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64/action => generated 146 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:18:56.041916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aa7c57e-cb76-435d-bf5b-2ed15e6c7ebc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.042971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aa7c57e-cb76-435d-bf5b-2ed15e6c7ebc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.044756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aa7c57e-cb76-435d-bf5b-2ed15e6c7ebc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.048062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-979b8b37-2314-4703-9885-b0df64d7672c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:56.051500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-979b8b37-2314-4703-9885-b0df64d7672c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:56.066291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8b37-2314-4703-9885-b0df64d7672c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.067127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8b37-2314-4703-9885-b0df64d7672c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.067783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8b37-2314-4703-9885-b0df64d7672c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.076385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8b37-2314-4703-9885-b0df64d7672c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.077176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8b37-2314-4703-9885-b0df64d7672c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.078348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8b37-2314-4703-9885-b0df64d7672c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.091445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2aa7c57e-cb76-435d-bf5b-2ed15e6c7ebc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Going to try to start instance {{(pid=122331) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:18:56.160795 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2aa7c57e-cb76-435d-bf5b-2ed15e6c7ebc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/action" status: 202 len: 0 microversion: 2.1 time: 0.141889 Oct 04 18:18:56.162251 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2085/4171] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:56 2022] POST /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:18:56.173289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2173bef8-a792-4dd0-8f0d-ff0ebc549d80 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:56.175363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2173bef8-a792-4dd0-8f0d-ff0ebc549d80 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:56.202128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2173bef8-a792-4dd0-8f0d-ff0ebc549d80 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.203590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2173bef8-a792-4dd0-8f0d-ff0ebc549d80 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.204062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2173bef8-a792-4dd0-8f0d-ff0ebc549d80 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.204810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2173bef8-a792-4dd0-8f0d-ff0ebc549d80 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.207501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2173bef8-a792-4dd0-8f0d-ff0ebc549d80 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.208520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2173bef8-a792-4dd0-8f0d-ff0ebc549d80 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.928429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-979b8b37-2314-4703-9885-b0df64d7672c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:56.943356 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-979b8b37-2314-4703-9885-b0df64d7672c tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.898971 Oct 04 18:18:56.945038 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2087/4172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:56 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:56.950737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9f12869-f4d0-4407-9589-9b1cc0454e70 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:56.951724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d9f12869-f4d0-4407-9589-9b1cc0454e70 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:56.974801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9f12869-f4d0-4407-9589-9b1cc0454e70 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.975462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9f12869-f4d0-4407-9589-9b1cc0454e70 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.976024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9f12869-f4d0-4407-9589-9b1cc0454e70 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.976908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9f12869-f4d0-4407-9589-9b1cc0454e70 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.977631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9f12869-f4d0-4407-9589-9b1cc0454e70 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.978191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9f12869-f4d0-4407-9589-9b1cc0454e70 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.022999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2173bef8-a792-4dd0-8f0d-ff0ebc549d80 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:57.032420 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2173bef8-a792-4dd0-8f0d-ff0ebc549d80 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1667 microversion: 2.1 time: 0.868560 Oct 04 18:18:57.047536 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2086/4173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:56 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1667 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:57.063963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cdaba352-6582-4ad5-be0c-2a52a52c07d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:57.064872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cdaba352-6582-4ad5-be0c-2a52a52c07d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:57.110242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdaba352-6582-4ad5-be0c-2a52a52c07d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.110774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdaba352-6582-4ad5-be0c-2a52a52c07d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.111266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdaba352-6582-4ad5-be0c-2a52a52c07d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.115013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdaba352-6582-4ad5-be0c-2a52a52c07d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.115634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdaba352-6582-4ad5-be0c-2a52a52c07d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.116117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdaba352-6582-4ad5-be0c-2a52a52c07d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.822172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d9f12869-f4d0-4407-9589-9b1cc0454e70 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:57.836030 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d9f12869-f4d0-4407-9589-9b1cc0454e70 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1709 microversion: 2.1 time: 0.889593 Oct 04 18:18:57.838792 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2088/4174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:56 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1709 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:57.900062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cdaba352-6582-4ad5-be0c-2a52a52c07d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:57.917115 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cdaba352-6582-4ad5-be0c-2a52a52c07d9 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.858288 Oct 04 18:18:57.926290 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2087/4175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:57 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:57.945890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a97cac9-8d1a-4b46-a74b-26770224bbbe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1404800813_updated"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:57.948510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a97cac9-8d1a-4b46-a74b-26770224bbbe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: 6cf230db-2d98-4e61-8e5f-159ff4d3f59e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:57.962322 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-8a97cac9-8d1a-4b46-a74b-26770224bbbe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance 6cf230db-2d98-4e61-8e5f-159ff4d3f59e could not be found. Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a97cac9-8d1a-4b46-a74b-26770224bbbe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: request: PUT /compute/v2.1/servers/6cf230db-2d98-4e61-8e5f-159ff4d3f59e HTTP/1.1 Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 81 Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1404800813_updated"}} Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 6cf230db-2d98-4e61-8e5f-159ff4d3f59e could not be found. Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '6cf230db-2d98-4e61-8e5f-159ff4d3f59e', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1404800813_updated'}}} Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf230db-2d98-4e61-8e5f-159ff4d3f59e could not be found. Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 18:18:57.963923 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf230db-2d98-4e61-8e5f-159ff4d3f59e could not be found. Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf230db-2d98-4e61-8e5f-159ff4d3f59e could not be found. Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a97cac9-8d1a-4b46-a74b-26770224bbbe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance 6cf230db-2d98-4e61-8e5f-159ff4d3f59e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:57.969621 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a97cac9-8d1a-4b46-a74b-26770224bbbe tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "PUT /compute/v2.1/servers/6cf230db-2d98-4e61-8e5f-159ff4d3f59e" status: 404 len: 111 microversion: 2.1 time: 0.023474 Oct 04 18:18:57.978294 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2089/4176] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 4 18:18:57 2022] PUT /compute/v2.1/servers/6cf230db-2d98-4e61-8e5f-159ff4d3f59e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:57.982717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f18cb727-317a-4232-98b5-28853bf5acb1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:57.983387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f18cb727-317a-4232-98b5-28853bf5acb1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:57.993913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18cb727-317a-4232-98b5-28853bf5acb1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.994428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18cb727-317a-4232-98b5-28853bf5acb1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.994884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18cb727-317a-4232-98b5-28853bf5acb1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.995655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18cb727-317a-4232-98b5-28853bf5acb1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.996133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18cb727-317a-4232-98b5-28853bf5acb1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.996569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f18cb727-317a-4232-98b5-28853bf5acb1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.050316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-312653464", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "37ab4069-506c-406f-bfe6-f12d56cb2c28"}, {"port": "f7e7db67-5361-480e-8e11-3112a56563e8", "tag": "port-1"}, {"port": "62491f8c-a00d-4911-9961-75eeaa040635", "tag": "port-2"}, {"uuid": "58caab5d-683d-4387-b811-8a8c80c929af", "tag": "net-1"}, {"uuid": "58caab5d-683d-4387-b811-8a8c80c929af"}, {"uuid": "43471129-a964-48fe-902b-dc1cf19ead01", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "43471129-a964-48fe-902b-dc1cf19ead01", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0093e277-1b1f-4aa7-bd2e-ce5bc3e352c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b50852a9-2ad7-4a83-9c51-311ecfd76a07", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5413feac-1449-421a-b3fe-6caaad7ac734", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1492750898"}], "key_name": "tempest-keypair-787895292", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:58.463757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] validate_networks() for [('37ab4069-506c-406f-bfe6-f12d56cb2c28', None, None, None, None, None), (None, None, 'f7e7db67-5361-480e-8e11-3112a56563e8', None, None, None), (None, None, '62491f8c-a00d-4911-9961-75eeaa040635', None, None, None), ('58caab5d-683d-4387-b811-8a8c80c929af', None, None, None, None, None), ('58caab5d-683d-4387-b811-8a8c80c929af', None, None, None, None, None), ('43471129-a964-48fe-902b-dc1cf19ead01', '10.2.2.100', None, None, None, None), ('43471129-a964-48fe-902b-dc1cf19ead01', '10.2.2.200', None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:58.540163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f18cb727-317a-4232-98b5-28853bf5acb1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:58.549432 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f18cb727-317a-4232-98b5-28853bf5acb1 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.570538 Oct 04 18:18:58.562579 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2088/4177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:57 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:58.576872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.582817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:58.603473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.606010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.607505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.609518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.612106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.614429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.693124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.695579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.696213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.696854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lazy-loading 'fault' on Instance uuid 34a988be-0960-4297-9ca3-24fc491f115b {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:58.798448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b731077b730f4881b8a7aeef7bcef20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ebbd32ca946f6a078df3ef2a268ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:58.810700 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d4208fa2-0095-4c51-b3cf-cee17d9e450e tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 200 len: 1316 microversion: 2.1 time: 0.242734 Oct 04 18:18:58.817528 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2089/4178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:58.827421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d291347e-9b71-4a89-92ce-7944b9441034 req-2a7241a2-4aa1-4198-9260-88301add91cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a988be-0960-4297-9ca3-24fc491f115b", "name": "network-vif-deleted", "tag": "a021fddf-59d8-48f5-9b97-c86fdab8c417"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:58.856268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d291347e-9b71-4a89-92ce-7944b9441034 req-2a7241a2-4aa1-4198-9260-88301add91cc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.857239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d291347e-9b71-4a89-92ce-7944b9441034 req-2a7241a2-4aa1-4198-9260-88301add91cc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.859590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d291347e-9b71-4a89-92ce-7944b9441034 req-2a7241a2-4aa1-4198-9260-88301add91cc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.880113 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d291347e-9b71-4a89-92ce-7944b9441034 req-2a7241a2-4aa1-4198-9260-88301add91cc service nova] Creating event network-vif-deleted:a021fddf-59d8-48f5-9b97-c86fdab8c417 for instance 34a988be-0960-4297-9ca3-24fc491f115b on n-h2-850499-14 Oct 04 18:18:58.893526 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d291347e-9b71-4a89-92ce-7944b9441034 req-2a7241a2-4aa1-4198-9260-88301add91cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072270 Oct 04 18:18:58.895080 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2090/4179] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:58.910198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-07c52a6b-81c1-4b72-a18b-83d3ad79df28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.910929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-07c52a6b-81c1-4b72-a18b-83d3ad79df28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:58.927447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07c52a6b-81c1-4b72-a18b-83d3ad79df28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.928646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07c52a6b-81c1-4b72-a18b-83d3ad79df28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.930656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07c52a6b-81c1-4b72-a18b-83d3ad79df28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.931647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07c52a6b-81c1-4b72-a18b-83d3ad79df28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.934032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07c52a6b-81c1-4b72-a18b-83d3ad79df28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.934712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07c52a6b-81c1-4b72-a18b-83d3ad79df28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:59.856379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-07c52a6b-81c1-4b72-a18b-83d3ad79df28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:59.864479 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-07c52a6b-81c1-4b72-a18b-83d3ad79df28 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.965085 Oct 04 18:18:59.865058 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2091/4180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:59.893384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-59fe2ca0-3004-4cd2-a404-67603fdd547f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:59.899573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-59fe2ca0-3004-4cd2-a404-67603fdd547f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:59.914471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59fe2ca0-3004-4cd2-a404-67603fdd547f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:59.917548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59fe2ca0-3004-4cd2-a404-67603fdd547f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:59.918309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59fe2ca0-3004-4cd2-a404-67603fdd547f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:59.920104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59fe2ca0-3004-4cd2-a404-67603fdd547f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:59.925883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59fe2ca0-3004-4cd2-a404-67603fdd547f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:59.926668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59fe2ca0-3004-4cd2-a404-67603fdd547f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.358409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:00.560408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-59fe2ca0-3004-4cd2-a404-67603fdd547f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:00.582485 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-59fe2ca0-3004-4cd2-a404-67603fdd547f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1713 microversion: 2.1 time: 0.692532 Oct 04 18:19:00.584045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2092/4181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:59 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1713 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:01.215986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-326797936", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "0f5e78c2-ee58-4a7a-8b89-4265647a98d1"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:01.329311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] validate_networks() for [('0f5e78c2-ee58-4a7a-8b89-4265647a98d1', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:02.342205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:02.342830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:02.343482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:02.346466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:02.348680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:02.381753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.384642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.385915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.388242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.393243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.394073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.469941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Getting quotas for project 0483c4cb78934c73b905d16a46988acb. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:02.479634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Getting quotas for user 937d9dd336a84f6e9e11144a6cc4af9e and project 0483c4cb78934c73b905d16a46988acb. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:02.495694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:02.498846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:02.589426 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-006fa1fa-a1bf-4af4-9cb9-9940cedc9eba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.002741 Oct 04 18:19:02.592494 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2093/4182] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:19:02.600002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:02.600818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] [instance: 34a988be-0960-4297-9ca3-24fc491f115b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:02.610383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.611236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.612138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.613225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.614009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.615108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.631686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:02.698150 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] HTTP exception thrown: Instance 34a988be-0960-4297-9ca3-24fc491f115b could not be found. Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Request method failure captured: Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b HTTP/1.1 Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiTpdEgDvL_s6BzCqQ06CYXhA3TWSuucFSzl3GPTV5y9Dxswz7pbEW3EOM-mTV1wK4AaBkiIjWpOHGfTVJoreM7bKbm9YUzRlJX4hn6Xg9yfjsUKVznlBX8hqFmvwS1dAX4u9aDOwedriz0X0QhNcOnFaAYxr0wsSizSaLAxhQkz0s Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ce1ebbd32ca946f6a078df3ef2a268ea Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestFqdnHostnames-459739938 Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ce1ebbd32ca946f6a078df3ef2a268ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ce1ebbd32ca946f6a078df3ef2a268ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ce1ebbd32ca946f6a078df3ef2a268ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ce1ebbd32ca946f6a078df3ef2a268ea"}]}] Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestFqdnHostnames-459739938 Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ce1ebbd32ca946f6a078df3ef2a268ea Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-459739938 Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestFqdnHostnames-459739938-project Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b731077b730f4881b8a7aeef7bcef20e Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestFqdnHostnames-459739938-project Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 34a988be-0960-4297-9ca3-24fc491f115b could not be found. Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '34a988be-0960-4297-9ca3-24fc491f115b'} Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a988be-0960-4297-9ca3-24fc491f115b could not be found. Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a988be-0960-4297-9ca3-24fc491f115b could not be found. Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:02.703130 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.707843 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:02.707843 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:02.707843 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:02.707843 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:02.707843 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:02.707843 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a988be-0960-4297-9ca3-24fc491f115b could not be found. Oct 04 18:19:02.707843 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.710117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Returning 404 to user: Instance 34a988be-0960-4297-9ca3-24fc491f115b could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:02.711279 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2799afa7-08f7-4067-9f26-5f5b26c9c4c7 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b" status: 404 len: 111 microversion: 2.1 time: 0.116995 Oct 04 18:19:02.712970 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2094/4183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:02 2022] GET /compute/v2.1/servers/34a988be-0960-4297-9ca3-24fc491f115b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:02.734255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2739a797-dda8-4a26-9037-cd4b5bda639e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2739a797-dda8-4a26-9037-cd4b5bda639e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 HTTP/1.1 Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 280 Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'afef2588-b2e9-4b9e-943c-44469215dd64', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.738773 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:19:02.742787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:02.751645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2739a797-dda8-4a26-9037-cd4b5bda639e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:02.752649 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2739a797-dda8-4a26-9037-cd4b5bda639e tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "PUT /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 400 len: 619 microversion: 2.1 time: 0.038270 Oct 04 18:19:02.753353 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2095/4184] 10.222.0.18 () {60 vars in 1257 bytes} [Tue Oct 4 18:19:02 2022] PUT /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:03.489886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1670668334", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "551f9b31-9203-4931-be19-08e7dba9bee4"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:03.607735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] validate_networks() for [('551f9b31-9203-4931-be19-08e7dba9bee4', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:04.743486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:04.744621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:04.745321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:04.745961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:04.746583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:04.767648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:04.768349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:04.768973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.771472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:04.772798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:04.776204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.823349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Getting quotas for project 5ce3d6d3d3484f07b73e3c0a59c8cac0. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:04.837775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Getting quotas for user c0e59b12d4914829a6b3e4f7b9f96779 and project 5ce3d6d3d3484f07b73e3c0a59c8cac0. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:04.853946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:04.868681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:04.988880 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6fe9a91e-a669-4b82-a13d-86bba412c4a0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.233173 Oct 04 18:19:04.990273 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2096/4185] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:19:04.996497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:04.997408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:05.027573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.028471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.029381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.030502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.034197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.034998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.084854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:05.087250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:05.088095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:05.088742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:05.089391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:05.112157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.117981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.121516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.122527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.126990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.128519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.193038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Getting quotas for project c4f0c4d3de4e437ba1bc7c659aee2428. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:05.212052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Getting quotas for user bf74e18995d24935b50f8058a44d5d12 and project c4f0c4d3de4e437ba1bc7c659aee2428. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:05.429437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:05.446035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:05.452262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:05.481305 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-60f47952-264a-443f-b8c4-4d9cc6b79d31 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1319 microversion: 2.26 time: 0.464935 Oct 04 18:19:05.495287 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2097/4186] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:04 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:05.521814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c41eb22-7672-44cf-a689-492c4526d994 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] Calling method '.version_select at 0x7fd4d18addc0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:05.573139 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c41eb22-7672-44cf-a689-492c4526d994 tempest-ServersTestFqdnHostnames-459739938 tempest-ServersTestFqdnHostnames-459739938-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225497742" status: 202 len: 0 microversion: 2.1 time: 0.075591 Oct 04 18:19:05.580797 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2098/4187] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:19:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225497742 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:19:05.584661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:05.587924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0093e277-1b1f-4aa7-bd2e-ce5bc3e352c7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b50852a9-2ad7-4a83-9c51-311ecfd76a07',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5413feac-1449-421a-b3fe-6caaad7ac734',volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:05.591468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ead4886a-a569-471c-9056-cee37591d527 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:05.594155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ead4886a-a569-471c-9056-cee37591d527 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:05.602623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:05.612672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead4886a-a569-471c-9056-cee37591d527 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.619863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead4886a-a569-471c-9056-cee37591d527 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.620358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead4886a-a569-471c-9056-cee37591d527 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.621310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead4886a-a569-471c-9056-cee37591d527 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.622000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead4886a-a569-471c-9056-cee37591d527 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.624881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ead4886a-a569-471c-9056-cee37591d527 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:06.361190 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-524ac6b5-ef70-4d23-8ecc-9f8496fd3399 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.315258 Oct 04 18:19:06.376755 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2090/4188] 10.222.0.18 () {62 vars in 1189 bytes} [Tue Oct 4 18:18:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 8332 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:19:06.382109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1580712298", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "551f9b31-9203-4931-be19-08e7dba9bee4"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:06.472311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] validate_networks() for [('551f9b31-9203-4931-be19-08e7dba9bee4', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:06.991618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ead4886a-a569-471c-9056-cee37591d527 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:07.005455 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ead4886a-a569-471c-9056-cee37591d527 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 1.422791 Oct 04 18:19:07.006051 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2099/4189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:05 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:07.020251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a759682-f802-4b8d-ba12-c95d8f22b849 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:07.022475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a759682-f802-4b8d-ba12-c95d8f22b849 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:07.349847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a759682-f802-4b8d-ba12-c95d8f22b849 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:07.370921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a759682-f802-4b8d-ba12-c95d8f22b849 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:07.380447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a759682-f802-4b8d-ba12-c95d8f22b849 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:07.381829 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a759682-f802-4b8d-ba12-c95d8f22b849 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1284 microversion: 2.42 time: 0.371800 Oct 04 18:19:07.391014 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2100/4190] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:07 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1284 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:07.400636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:07.401750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:07.411330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.425585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.426407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:07.428974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.431153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.432133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:07.980018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:07.989734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:07.995564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.004353 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ea29ea4e-8e47-4f67-be14-259170976c6e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1361 microversion: 2.26 time: 0.620435 Oct 04 18:19:08.020262 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2101/4191] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:07 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1361 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:08.029527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-674d43d2-960f-49f1-a693-a0bec4ac5dea tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:08.030571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-674d43d2-960f-49f1-a693-a0bec4ac5dea tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:08.038840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674d43d2-960f-49f1-a693-a0bec4ac5dea tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.039757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674d43d2-960f-49f1-a693-a0bec4ac5dea tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.040474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674d43d2-960f-49f1-a693-a0bec4ac5dea tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.041983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674d43d2-960f-49f1-a693-a0bec4ac5dea tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.042922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674d43d2-960f-49f1-a693-a0bec4ac5dea tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.043623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674d43d2-960f-49f1-a693-a0bec4ac5dea tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.234125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:08.236024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:08.236993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:08.237886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:08.239500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:08.264820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.267435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.268281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.269996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.271090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.271800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.339702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Getting quotas for project 5ce3d6d3d3484f07b73e3c0a59c8cac0. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:08.372568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Getting quotas for user c0e59b12d4914829a6b3e4f7b9f96779 and project 5ce3d6d3d3484f07b73e3c0a59c8cac0. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:08.424084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:08.433139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: de379391-e467-452e-93b4-9fbfe268a32c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:08.565641 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96f998fe-8710-4c28-909c-1eb01cdd672f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.186919 Oct 04 18:19:08.566865 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2091/4192] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:19:08.571550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:08.572171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:08.601628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.605633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.606369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.607360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.607935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.610109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.786565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.837843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.851839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-674d43d2-960f-49f1-a693-a0bec4ac5dea tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.854591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.857008 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ad6e823-fe20-4a90-944d-2b882e270a20 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1574 microversion: 2.42 time: 0.289106 Oct 04 18:19:08.860623 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2092/4193] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:08 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1574 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:08.861900 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-674d43d2-960f-49f1-a693-a0bec4ac5dea tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 0.836675 Oct 04 18:19:08.875010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1166913360", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "451", "networks": [{"uuid": "551f9b31-9203-4931-be19-08e7dba9bee4"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:08.891950 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2102/4194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:08 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:08.908176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4ad4a30-69b1-4f48-bb9d-47540ee2c057 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4ad4a30-69b1-4f48-bb9d-47540ee2c057 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: request: PUT /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 HTTP/1.1 Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 24 Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": ""}} Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'afef2588-b2e9-4b9e-943c-44469215dd64', 'body': {'server': {'name': ''}}} Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi '' Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:19:08.914616 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:19:08.921129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.921129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:08.921129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.921129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:08.921129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:08.921129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:08.921129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:19:08.921129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:19:08.921129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:19:08.921129 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.928879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4ad4a30-69b1-4f48-bb9d-47540ee2c057 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:08.930255 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e4ad4a30-69b1-4f48-bb9d-47540ee2c057 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "PUT /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 400 len: 108 microversion: 2.1 time: 0.037081 Oct 04 18:19:08.934737 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2103/4195] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 4 18:19:08 2022] PUT /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:08.955768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-353a7e43-5244-4a59-bac7-135a554cd989 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:08.959763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-353a7e43-5244-4a59-bac7-135a554cd989 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:08.990310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353a7e43-5244-4a59-bac7-135a554cd989 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.990824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353a7e43-5244-4a59-bac7-135a554cd989 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.991297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353a7e43-5244-4a59-bac7-135a554cd989 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.992017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353a7e43-5244-4a59-bac7-135a554cd989 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.992481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353a7e43-5244-4a59-bac7-135a554cd989 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.992903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353a7e43-5244-4a59-bac7-135a554cd989 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.055388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] validate_networks() for [('551f9b31-9203-4931-be19-08e7dba9bee4', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:10.357583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-353a7e43-5244-4a59-bac7-135a554cd989 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:10.373129 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-353a7e43-5244-4a59-bac7-135a554cd989 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1506 microversion: 2.1 time: 1.435021 Oct 04 18:19:10.374310 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2104/4196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:08 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1506 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:10.379338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:10.386844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:10.408322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:10.409125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:10.409762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:10.410790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:10.411444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:10.412222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:11.604318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:11.631226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:11.640721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:11.642239 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-deb90d0d-235c-4f85-8dd4-14f98c9882ac tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1361 microversion: 2.26 time: 1.266565 Oct 04 18:19:11.648495 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2105/4197] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:10 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1361 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:11.663395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-87015573-26c3-4503-993a-2db0e47f9941 req-4a6df008-2ee6-4746-8f2c-369d1a581c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f79c6d-b0dd-470c-9269-45e3529dec91", "tag": "afaad5f5-e641-405b-985f-5e52dcfd6f42"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:11.688491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-87015573-26c3-4503-993a-2db0e47f9941 req-4a6df008-2ee6-4746-8f2c-369d1a581c15 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:11.690792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-87015573-26c3-4503-993a-2db0e47f9941 req-4a6df008-2ee6-4746-8f2c-369d1a581c15 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:11.691505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-87015573-26c3-4503-993a-2db0e47f9941 req-4a6df008-2ee6-4746-8f2c-369d1a581c15 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:11.713112 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-87015573-26c3-4503-993a-2db0e47f9941 req-4a6df008-2ee6-4746-8f2c-369d1a581c15 service nova] Creating event network-changed:afaad5f5-e641-405b-985f-5e52dcfd6f42 for instance 93f79c6d-b0dd-470c-9269-45e3529dec91 on n-h2-850499-14 Oct 04 18:19:11.723706 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-87015573-26c3-4503-993a-2db0e47f9941 req-4a6df008-2ee6-4746-8f2c-369d1a581c15 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072979 Oct 04 18:19:11.725001 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2106/4198] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:11.735856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:11.736931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:11.745941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:11.747025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:11.747749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:11.749227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:11.751423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:11.752158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.102163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:12.133983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:12.135783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:12.137186 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-56a5d5b2-2196-43c8-8765-d509bf34f3db tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1592 microversion: 2.42 time: 0.410369 Oct 04 18:19:12.141616 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2107/4199] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:11 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1592 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:12.513437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:12.513928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:12.514335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:12.515946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:12.516552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:12.519522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:12.566433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.571919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.572525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.574026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.574668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.575290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.627658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Getting quotas for project 5ce3d6d3d3484f07b73e3c0a59c8cac0. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:12.644114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Getting quotas for user c0e59b12d4914829a6b3e4f7b9f96779 and project 5ce3d6d3d3484f07b73e3c0a59c8cac0. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:12.671853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:12.674243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:12.683637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:12.685218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:12.700813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.701330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.701780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.702727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.704489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.707819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.792985 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed9ea799-1181-4716-a056-8aeaa4c229dd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.927433 Oct 04 18:19:12.796710 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2093/4200] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:19:12.808988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc0347d3-8c5e-4963-86d1-3c943f5e91cd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:12.811229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc0347d3-8c5e-4963-86d1-3c943f5e91cd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:12.956147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dc0347d3-8c5e-4963-86d1-3c943f5e91cd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:12.969912 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc0347d3-8c5e-4963-86d1-3c943f5e91cd tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1221 microversion: 2.1 time: 0.160351 Oct 04 18:19:12.970804 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2094/4201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:12 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1221 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:13.166605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:13.173050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:13.205905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:13.208217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:13.209735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:13.212031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:13.213548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:13.214202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:13.463198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:13.474862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:13.480578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:13.485957 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5bcc30df-7eb4-4fbd-9750-3830c4f5c5d5 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1361 microversion: 2.26 time: 0.814151 Oct 04 18:19:13.490002 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2108/4202] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:12 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1361 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:19:13.549172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:13.564485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:13.568826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:13.570358 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-688d0a5c-14b5-4a5c-a71e-a4e087eddcfd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1592 microversion: 2.42 time: 0.408613 Oct 04 18:19:13.575090 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2095/4203] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:13 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1592 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:19:13.997457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d08590c-b6c6-4917-adc7-630a32483d52 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:13.999429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d08590c-b6c6-4917-adc7-630a32483d52 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:14.012519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d08590c-b6c6-4917-adc7-630a32483d52 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:14.013326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d08590c-b6c6-4917-adc7-630a32483d52 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:14.014660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d08590c-b6c6-4917-adc7-630a32483d52 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:14.017770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d08590c-b6c6-4917-adc7-630a32483d52 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:14.018521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d08590c-b6c6-4917-adc7-630a32483d52 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:14.019213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d08590c-b6c6-4917-adc7-630a32483d52 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:14.369244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c541f76a-b23e-4c2d-819a-36f7220006aa req-1bd26a90-4ec0-4375-a810-e32fc5849600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab02548-c5e1-4e54-8190-17c6503b6e0a", "tag": "9e1c0054-7b2b-4b49-bca7-c6e9e70756b9"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:14.407633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c541f76a-b23e-4c2d-819a-36f7220006aa req-1bd26a90-4ec0-4375-a810-e32fc5849600 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:14.411469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c541f76a-b23e-4c2d-819a-36f7220006aa req-1bd26a90-4ec0-4375-a810-e32fc5849600 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:14.415497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c541f76a-b23e-4c2d-819a-36f7220006aa req-1bd26a90-4ec0-4375-a810-e32fc5849600 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:14.433822 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c541f76a-b23e-4c2d-819a-36f7220006aa req-1bd26a90-4ec0-4375-a810-e32fc5849600 service nova] Creating event network-changed:9e1c0054-7b2b-4b49-bca7-c6e9e70756b9 for instance 3ab02548-c5e1-4e54-8190-17c6503b6e0a on n-h1-850499-14 Oct 04 18:19:14.442297 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c541f76a-b23e-4c2d-819a-36f7220006aa req-1bd26a90-4ec0-4375-a810-e32fc5849600 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078782 Oct 04 18:19:14.448840 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2096/4204] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:14.520740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:14.521754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:14.534281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:14.534791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:14.539735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:14.540942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:14.541669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:14.542287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:14.797850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:15.122143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7d08590c-b6c6-4917-adc7-630a32483d52 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:15.138315 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d08590c-b6c6-4917-adc7-630a32483d52 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1225 microversion: 2.1 time: 1.138968 Oct 04 18:19:15.142041 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2109/4205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:13 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1225 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:15.170745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:15.174175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:15.209041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:15.210835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:15.214083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:15.217105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:15.219513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:15.220119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.279157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:16.303407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:16.304873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:16.316952 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f89efcf0-2b81-42dc-aaee-bf98a4388acd tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1361 microversion: 2.26 time: 1.801525 Oct 04 18:19:16.319799 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2097/4206] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:14 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1361 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:16.343133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fb131004-85bc-41fc-be12-4b1e80b33584 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:16.345640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fb131004-85bc-41fc-be12-4b1e80b33584 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:16.408585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb131004-85bc-41fc-be12-4b1e80b33584 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:16.417088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb131004-85bc-41fc-be12-4b1e80b33584 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:16.420738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb131004-85bc-41fc-be12-4b1e80b33584 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.422325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb131004-85bc-41fc-be12-4b1e80b33584 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:16.427238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb131004-85bc-41fc-be12-4b1e80b33584 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:16.429723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb131004-85bc-41fc-be12-4b1e80b33584 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.514713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:16.554400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:16.564169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:16.574889 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef472e2d-9624-46a1-9a8e-35b71e1afd30 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1660 microversion: 2.42 time: 1.421426 Oct 04 18:19:16.575621 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2110/4207] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:15 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1660 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:17.136109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fb131004-85bc-41fc-be12-4b1e80b33584 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:17.145683 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fb131004-85bc-41fc-be12-4b1e80b33584 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1273 microversion: 2.1 time: 0.821191 Oct 04 18:19:17.146272 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2098/4208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:16 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1273 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:17.347790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:17.348537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:17.358937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=14 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:17.376366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:17.376890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:17.385703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:17.386533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:17.387071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:17.389779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:17.606282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:17.607528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:17.628619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:17.637120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:17.653749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:17.653749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:17.653749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:17.653749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:18.604168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:18.628922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:18.630593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:18.631831 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-82b765b2-f551-43f3-a485-ebec401679df tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1361 microversion: 2.26 time: 1.290157 Oct 04 18:19:18.641820 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2111/4209] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:17 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1361 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:18.659804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a584f4c1-5ea6-4f32-a5bb-8235534a5dc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:18.661190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a584f4c1-5ea6-4f32-a5bb-8235534a5dc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:18.681706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a584f4c1-5ea6-4f32-a5bb-8235534a5dc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:18.682809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a584f4c1-5ea6-4f32-a5bb-8235534a5dc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:18.683481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a584f4c1-5ea6-4f32-a5bb-8235534a5dc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:18.684413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a584f4c1-5ea6-4f32-a5bb-8235534a5dc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:18.686537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a584f4c1-5ea6-4f32-a5bb-8235534a5dc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:18.688355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a584f4c1-5ea6-4f32-a5bb-8235534a5dc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.121929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:19.128446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a584f4c1-5ea6-4f32-a5bb-8235534a5dc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:19.136935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:19.137991 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a584f4c1-5ea6-4f32-a5bb-8235534a5dc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1279 microversion: 2.1 time: 0.494952 Oct 04 18:19:19.141177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:19.147384 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2c276572-2574-47f8-b676-cf5e390f1abe tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1660 microversion: 2.42 time: 1.544130 Oct 04 18:19:19.161786 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2112/4210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:18 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1279 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:19.163357 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2099/4211] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:17 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1660 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:19.663918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:19.665780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:19.730574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:19.731117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:19.754277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.755363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:19.755863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:19.756311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.800692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1023d03a-60c2-4df5-b62c-c1fcffb537f2 req-08909244-4675-41f9-a96a-a48c3f9be5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f79c6d-b0dd-470c-9269-45e3529dec91", "name": "network-vif-plugged", "status": "completed", "tag": "afaad5f5-e641-405b-985f-5e52dcfd6f42"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:19.846304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1023d03a-60c2-4df5-b62c-c1fcffb537f2 req-08909244-4675-41f9-a96a-a48c3f9be5d1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:19.847054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1023d03a-60c2-4df5-b62c-c1fcffb537f2 req-08909244-4675-41f9-a96a-a48c3f9be5d1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:19.851758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1023d03a-60c2-4df5-b62c-c1fcffb537f2 req-08909244-4675-41f9-a96a-a48c3f9be5d1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.941042 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1023d03a-60c2-4df5-b62c-c1fcffb537f2 req-08909244-4675-41f9-a96a-a48c3f9be5d1 service nova] Creating event network-vif-plugged:afaad5f5-e641-405b-985f-5e52dcfd6f42 for instance 93f79c6d-b0dd-470c-9269-45e3529dec91 on n-h2-850499-14 Oct 04 18:19:19.951011 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1023d03a-60c2-4df5-b62c-c1fcffb537f2 req-08909244-4675-41f9-a96a-a48c3f9be5d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154631 Oct 04 18:19:19.953402 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2100/4212] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:20.165808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0eb0f46c-d5d7-4cac-9145-4df19c12302e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:20.167490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0eb0f46c-d5d7-4cac-9145-4df19c12302e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:20.185778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb0f46c-d5d7-4cac-9145-4df19c12302e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.188374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb0f46c-d5d7-4cac-9145-4df19c12302e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.193030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb0f46c-d5d7-4cac-9145-4df19c12302e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.193817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb0f46c-d5d7-4cac-9145-4df19c12302e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.194385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb0f46c-d5d7-4cac-9145-4df19c12302e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.194721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb0f46c-d5d7-4cac-9145-4df19c12302e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.633457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0eb0f46c-d5d7-4cac-9145-4df19c12302e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:20.653111 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0eb0f46c-d5d7-4cac-9145-4df19c12302e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1279 microversion: 2.1 time: 0.493091 Oct 04 18:19:20.659335 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2101/4213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:20 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1279 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:20.675545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:20.678521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:20.703798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.704323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.704780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.709854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.711733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.712390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.820140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:20.850125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:20.856549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:20.864118 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be250adb-7c43-41c9-b440-dff5cc95ca62 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1361 microversion: 2.26 time: 1.199928 Oct 04 18:19:20.864832 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2113/4214] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:19 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1361 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:21.002818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:21.003375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:21.017022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.017580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.018026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.019374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.019847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.020287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.089931 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 HTTP/1.1 Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c0cc437e-a891-44ca-a8c7-a2f708fe69d2'} Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:21.093952 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eb2cdfaa-c103-40a2-9b70-68f57442875f tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 404 len: 111 microversion: 2.1 time: 0.099573 Oct 04 18:19:21.102550 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2114/4215] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:19:20 2022] DELETE /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:19:21.114181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:21.117154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: c0cc437e-a891-44ca-a8c7-a2f708fe69d2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:21.148416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.163455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.164306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.165498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.166220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.167214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.210759 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 HTTP/1.1 Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'c0cc437e-a891-44ca-a8c7-a2f708fe69d2'} Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:21.224842 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:21.230287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:21.230287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:21.230287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:21.230287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:21.230287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:21.230287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. Oct 04 18:19:21.230287 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:21.231770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance c0cc437e-a891-44ca-a8c7-a2f708fe69d2 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:21.234180 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b978e979-bb52-4a82-8bb1-90f577ef0465 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2" status: 404 len: 111 microversion: 2.1 time: 0.129622 Oct 04 18:19:21.247089 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2115/4216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:21 2022] GET /compute/v2.1/servers/c0cc437e-a891-44ca-a8c7-a2f708fe69d2 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:21.260707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1638f7bc-5f91-436d-8665-c5588184cc8d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:21.264420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1638f7bc-5f91-436d-8665-c5588184cc8d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:21.293668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1638f7bc-5f91-436d-8665-c5588184cc8d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.294789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1638f7bc-5f91-436d-8665-c5588184cc8d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.295419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1638f7bc-5f91-436d-8665-c5588184cc8d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.296294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1638f7bc-5f91-436d-8665-c5588184cc8d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.297422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1638f7bc-5f91-436d-8665-c5588184cc8d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.301825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1638f7bc-5f91-436d-8665-c5588184cc8d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.472281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1638f7bc-5f91-436d-8665-c5588184cc8d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:19:21.590386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:21.664247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1638f7bc-5f91-436d-8665-c5588184cc8d tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "DELETE /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 204 len: 0 microversion: 2.1 time: 0.415455 Oct 04 18:19:21.669809 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2116/4217] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:19:21 2022] DELETE /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:19:21.684824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-28416bb3-bb93-40f9-b032-78222d8355ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:21.692836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-28416bb3-bb93-40f9-b032-78222d8355ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:21.705766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28416bb3-bb93-40f9-b032-78222d8355ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.707598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28416bb3-bb93-40f9-b032-78222d8355ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.708937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28416bb3-bb93-40f9-b032-78222d8355ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.710409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28416bb3-bb93-40f9-b032-78222d8355ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.712869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28416bb3-bb93-40f9-b032-78222d8355ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.715932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-28416bb3-bb93-40f9-b032-78222d8355ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.065986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:22.084238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:22.089293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:22.090739 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e8e5a928-a51c-4f0d-acd3-48762f8607c4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1707 microversion: 2.42 time: 1.429506 Oct 04 18:19:22.098006 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2102/4218] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:20 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1707 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:22.109701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-359f3b0e-4f62-42fb-9bfe-f12f341051f0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:22.113895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-359f3b0e-4f62-42fb-9bfe-f12f341051f0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:22.129555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-359f3b0e-4f62-42fb-9bfe-f12f341051f0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.130323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-359f3b0e-4f62-42fb-9bfe-f12f341051f0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.130994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-359f3b0e-4f62-42fb-9bfe-f12f341051f0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.132094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-359f3b0e-4f62-42fb-9bfe-f12f341051f0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.132729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-359f3b0e-4f62-42fb-9bfe-f12f341051f0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.134430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-359f3b0e-4f62-42fb-9bfe-f12f341051f0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.600493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:22.668039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-359f3b0e-4f62-42fb-9bfe-f12f341051f0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:22.681518 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-359f3b0e-4f62-42fb-9bfe-f12f341051f0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1279 microversion: 2.1 time: 0.581926 Oct 04 18:19:22.682730 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2103/4219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:22 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1279 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:22.848843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-60e299ba-ae8f-4286-b758-49da4d161453 req-892248e2-953f-4a5e-924f-7f836288bde4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de379391-e467-452e-93b4-9fbfe268a32c", "tag": "81e9aade-f2b8-4784-a02a-349656092364"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:22.848843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-60e299ba-ae8f-4286-b758-49da4d161453 req-892248e2-953f-4a5e-924f-7f836288bde4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.862560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-60e299ba-ae8f-4286-b758-49da4d161453 req-892248e2-953f-4a5e-924f-7f836288bde4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.868375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-60e299ba-ae8f-4286-b758-49da4d161453 req-892248e2-953f-4a5e-924f-7f836288bde4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.908478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-28416bb3-bb93-40f9-b032-78222d8355ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:22.911188 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-60e299ba-ae8f-4286-b758-49da4d161453 req-892248e2-953f-4a5e-924f-7f836288bde4 service nova] Creating event network-changed:81e9aade-f2b8-4784-a02a-349656092364 for instance de379391-e467-452e-93b4-9fbfe268a32c on n-h1-850499-14 Oct 04 18:19:22.920430 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-28416bb3-bb93-40f9-b032-78222d8355ff tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 1.245550 Oct 04 18:19:22.921012 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2117/4220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:21 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:22.937246 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-60e299ba-ae8f-4286-b758-49da4d161453 req-892248e2-953f-4a5e-924f-7f836288bde4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248962 Oct 04 18:19:22.937246 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2104/4221] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:22.957104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:22.962448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:22.987470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=20 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:22.990220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.995720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.996408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.999263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.999929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:23.003546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:23.120657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:23.121287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:23.137524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:23.138038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:23.138510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:23.139255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:23.139721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:23.140185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.041907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.053729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.059763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.061175 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c39fd6ca-c617-49b9-a6ec-788a8ae26a18 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1361 microversion: 2.26 time: 1.126218 Oct 04 18:19:24.083665 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2105/4222] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:22 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1361 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:24.099265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cab2d3e8-aa8b-407d-9632-477f8d966c99 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:24.100131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cab2d3e8-aa8b-407d-9632-477f8d966c99 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:24.107473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cab2d3e8-aa8b-407d-9632-477f8d966c99 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.108049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cab2d3e8-aa8b-407d-9632-477f8d966c99 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.108493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cab2d3e8-aa8b-407d-9632-477f8d966c99 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.111262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cab2d3e8-aa8b-407d-9632-477f8d966c99 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.112161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cab2d3e8-aa8b-407d-9632-477f8d966c99 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.112754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cab2d3e8-aa8b-407d-9632-477f8d966c99 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.396062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.410798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.412950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.420572 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6335ed73-e193-434c-95f1-7775fe12dee4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1707 microversion: 2.42 time: 1.303775 Oct 04 18:19:24.422455 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2118/4223] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:23 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1707 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:19:24.429822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dbae5cd8-fdf1-4f1a-8794-70b6af36d8ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:24.440037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dbae5cd8-fdf1-4f1a-8794-70b6af36d8ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:24.454151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbae5cd8-fdf1-4f1a-8794-70b6af36d8ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.455139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbae5cd8-fdf1-4f1a-8794-70b6af36d8ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.455814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbae5cd8-fdf1-4f1a-8794-70b6af36d8ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.460334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbae5cd8-fdf1-4f1a-8794-70b6af36d8ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.461416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbae5cd8-fdf1-4f1a-8794-70b6af36d8ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.463860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbae5cd8-fdf1-4f1a-8794-70b6af36d8ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.759001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cab2d3e8-aa8b-407d-9632-477f8d966c99 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.772326 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cab2d3e8-aa8b-407d-9632-477f8d966c99 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1321 microversion: 2.1 time: 0.687375 Oct 04 18:19:24.787751 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2106/4224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:24 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1321 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:24.801375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1f3cfb3f-507d-4d97-9180-d609d6cecc8a req-35a785f0-20a6-498b-a269-3f56753843e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab02548-c5e1-4e54-8190-17c6503b6e0a", "name": "network-vif-plugged", "status": "completed", "tag": "9e1c0054-7b2b-4b49-bca7-c6e9e70756b9"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:24.823227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1f3cfb3f-507d-4d97-9180-d609d6cecc8a req-35a785f0-20a6-498b-a269-3f56753843e1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.823727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1f3cfb3f-507d-4d97-9180-d609d6cecc8a req-35a785f0-20a6-498b-a269-3f56753843e1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.824251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1f3cfb3f-507d-4d97-9180-d609d6cecc8a req-35a785f0-20a6-498b-a269-3f56753843e1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.862499 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1f3cfb3f-507d-4d97-9180-d609d6cecc8a req-35a785f0-20a6-498b-a269-3f56753843e1 service nova] Creating event network-vif-plugged:9e1c0054-7b2b-4b49-bca7-c6e9e70756b9 for instance 3ab02548-c5e1-4e54-8190-17c6503b6e0a on n-h1-850499-14 Oct 04 18:19:24.868974 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1f3cfb3f-507d-4d97-9180-d609d6cecc8a req-35a785f0-20a6-498b-a269-3f56753843e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078058 Oct 04 18:19:24.869929 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2107/4225] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:25.038819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dbae5cd8-fdf1-4f1a-8794-70b6af36d8ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:25.050856 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dbae5cd8-fdf1-4f1a-8794-70b6af36d8ec tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.626998 Oct 04 18:19:25.056384 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2119/4226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:24 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:25.101448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:25.102180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:25.114154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.114873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.115490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.116408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.117053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.117696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.426656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:25.448238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:25.452804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:25.456820 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b457989c-3c2d-43a4-8914-b5eeec2f3fa6 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1546 microversion: 2.26 time: 0.360622 Oct 04 18:19:25.459585 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2108/4227] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:25 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1546 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:25.487140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:25.490699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:25.512980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.513914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.516249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.519743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.520112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.521124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.571368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1939044999", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:25.706122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] validate_networks() for [('de3142d7-cca8-4426-a97f-639f5813dc84', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:25.996563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:26.000112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=99 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:26.021716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:26.024418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:26.025638 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-db20cef7-9b3d-4a28-b12a-72aa148b4410 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1754 microversion: 2.42 time: 0.562784 Oct 04 18:19:26.052712 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2109/4228] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:25 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1754 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:26.073784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d11aa5e0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:26.099604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.100319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.100766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.101779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:26.120169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.120871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.121460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.122721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.125883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.126485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.197153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.197653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.198103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.239120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.239654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.240112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.310547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:26.347471 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00bccd95-c463-45de-b031-09344edd8d4e tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-331053511" status: 201 len: 0 microversion: 2.26 time: 0.292967 Oct 04 18:19:26.353337 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2110/4229] 10.222.0.18 () {62 vars in 1377 bytes} [Tue Oct 4 18:19:26 2022] PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-331053511 => generated 0 bytes in 300 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:19:26.365812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a7278b9-0b58-4c78-9e13-4e29eebee1bc tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:26.366560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a7278b9-0b58-4c78-9e13-4e29eebee1bc tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:26.381092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7278b9-0b58-4c78-9e13-4e29eebee1bc tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.381597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7278b9-0b58-4c78-9e13-4e29eebee1bc tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.382044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7278b9-0b58-4c78-9e13-4e29eebee1bc tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.382757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7278b9-0b58-4c78-9e13-4e29eebee1bc tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.383271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7278b9-0b58-4c78-9e13-4e29eebee1bc tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.388149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a7278b9-0b58-4c78-9e13-4e29eebee1bc tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.545482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:26.547890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:26.548529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:26.549167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:26.549755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:26.563045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.568416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.569905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.571481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.572801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.573474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.615533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Getting quotas for project 525708a3ed7d4de1adc1981ea52f0279. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:26.630567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Getting quotas for user b5597ea7bffb4bf4b76f167c646f8cb6 and project 525708a3ed7d4de1adc1981ea52f0279. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:26.655765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:26.663857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:26.756352 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-71fa1dd5-379d-4954-8e62-8ec665abd1a8 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.316193 Oct 04 18:19:26.757808 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2120/4230] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:19:26.762852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fbd4c993-c5e4-4be6-bb36-fb3b09c51f23 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:26.764463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fbd4c993-c5e4-4be6-bb36-fb3b09c51f23 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:26.773922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbd4c993-c5e4-4be6-bb36-fb3b09c51f23 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.774733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbd4c993-c5e4-4be6-bb36-fb3b09c51f23 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.775379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbd4c993-c5e4-4be6-bb36-fb3b09c51f23 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.776755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbd4c993-c5e4-4be6-bb36-fb3b09c51f23 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.784335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbd4c993-c5e4-4be6-bb36-fb3b09c51f23 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.785113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbd4c993-c5e4-4be6-bb36-fb3b09c51f23 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.013088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9a7278b9-0b58-4c78-9e13-4e29eebee1bc tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:27.028634 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a7278b9-0b58-4c78-9e13-4e29eebee1bc tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1321 microversion: 2.1 time: 0.674012 Oct 04 18:19:27.042980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2111/4231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:26 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1321 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:27.045908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-154aec4e-5491-4f1e-8476-f1cb10b10e77 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d1108b80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.095085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-154aec4e-5491-4f1e-8476-f1cb10b10e77 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.096130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-154aec4e-5491-4f1e-8476-f1cb10b10e77 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.096783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-154aec4e-5491-4f1e-8476-f1cb10b10e77 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.123179 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-154aec4e-5491-4f1e-8476-f1cb10b10e77 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-331053511" status: 204 len: 0 microversion: 2.26 time: 0.085653 Oct 04 18:19:27.129193 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2112/4232] 10.222.0.18 () {60 vars in 1358 bytes} [Tue Oct 4 18:19:27 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-331053511 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:19:27.138623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eb586b58-34bd-4efa-910a-d33ade0f5aad tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.145900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eb586b58-34bd-4efa-910a-d33ade0f5aad tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:27.149909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fbd4c993-c5e4-4be6-bb36-fb3b09c51f23 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:27.162706 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fbd4c993-c5e4-4be6-bb36-fb3b09c51f23 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1512 microversion: 2.1 time: 0.403601 Oct 04 18:19:27.164167 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2121/4233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:26 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:27.170289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.171468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:27.181474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.182187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.182875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.183756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.184386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.197886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.480845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eb586b58-34bd-4efa-910a-d33ade0f5aad tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:27.502410 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eb586b58-34bd-4efa-910a-d33ade0f5aad tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1224 microversion: 2.1 time: 0.369473 Oct 04 18:19:27.503041 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2113/4234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:27 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1224 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:27.517504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d1196160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.536221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.536930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.539718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.540426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:27.573236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.573635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.574093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.583590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.584158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.584627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.642639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.645305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.659307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.722187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:27.747929 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b256b06-a3d2-41be-978e-83aeb1077464 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 204 len: 0 microversion: 2.26 time: 0.242058 Oct 04 18:19:27.750447 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2114/4235] 10.222.0.18 () {60 vars in 1295 bytes} [Tue Oct 4 18:19:27 2022] DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:19:27.761338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c984420f-d609-40c1-9ecf-fc2dc54b3ed4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d117eb80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.787113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c984420f-d609-40c1-9ecf-fc2dc54b3ed4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.801269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c984420f-d609-40c1-9ecf-fc2dc54b3ed4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.804464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c984420f-d609-40c1-9ecf-fc2dc54b3ed4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.837580 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c984420f-d609-40c1-9ecf-fc2dc54b3ed4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 200 len: 12 microversion: 2.26 time: 0.080233 Oct 04 18:19:27.840866 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2115/4236] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 4 18:19:27 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 12 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:27.853902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d117e040>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.884094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.885873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.890980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:27.896283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.899224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:27.910514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:27.913846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.914349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.916224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:27.916867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.917649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.918126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.919648 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f17c3824-c1bb-4c90-a988-7a080adbc476 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1754 microversion: 2.42 time: 0.754055 Oct 04 18:19:27.940081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.942196 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2122/4237] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:27 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1754 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:28.045490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.056007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.056678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.060959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-afde66e4-f842-41c7-b5a2-fc9d216b6b2c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:28.061805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-afde66e4-f842-41c7-b5a2-fc9d216b6b2c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:28.071148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afde66e4-f842-41c7-b5a2-fc9d216b6b2c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.071902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afde66e4-f842-41c7-b5a2-fc9d216b6b2c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.072498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afde66e4-f842-41c7-b5a2-fc9d216b6b2c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.073373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afde66e4-f842-41c7-b5a2-fc9d216b6b2c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.073986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afde66e4-f842-41c7-b5a2-fc9d216b6b2c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.075147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-afde66e4-f842-41c7-b5a2-fc9d216b6b2c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.077567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.078976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.079948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.129107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:28.173103 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3cf32c8f-2223-41c8-a982-849d0c0879c2 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-1275414673" status: 201 len: 0 microversion: 2.26 time: 0.327184 Oct 04 18:19:28.177887 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2116/4238] 10.222.0.18 () {62 vars in 1380 bytes} [Tue Oct 4 18:19:27 2022] PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-1275414673 => generated 0 bytes in 332 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 04 18:19:28.191813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1252d88c-a5bb-4419-8f6c-285112c7ab2f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d11f8700>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:28.214042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1252d88c-a5bb-4419-8f6c-285112c7ab2f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.214552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1252d88c-a5bb-4419-8f6c-285112c7ab2f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.215020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1252d88c-a5bb-4419-8f6c-285112c7ab2f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.238706 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1252d88c-a5bb-4419-8f6c-285112c7ab2f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 200 len: 36 microversion: 2.26 time: 0.057394 Oct 04 18:19:28.240174 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2117/4239] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 4 18:19:28 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 36 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:28.245977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc0adb00-10ef-4b4c-82ea-697c963ede81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:28.247463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc0adb00-10ef-4b4c-82ea-697c963ede81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:28.258284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0adb00-10ef-4b4c-82ea-697c963ede81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.259413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0adb00-10ef-4b4c-82ea-697c963ede81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.260278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0adb00-10ef-4b4c-82ea-697c963ede81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.261236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0adb00-10ef-4b4c-82ea-697c963ede81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.261903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0adb00-10ef-4b4c-82ea-697c963ede81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.263456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc0adb00-10ef-4b4c-82ea-697c963ede81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.319901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-afde66e4-f842-41c7-b5a2-fc9d216b6b2c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:28.329444 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-afde66e4-f842-41c7-b5a2-fc9d216b6b2c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1321 microversion: 2.1 time: 0.272803 Oct 04 18:19:28.330040 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2123/4240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:28 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:28.359899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d18ad700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:28.402609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.406539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.411180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.411779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:28.437593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.439547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.440259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.446270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.450289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.450879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.452722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dc0adb00-10ef-4b4c-82ea-697c963ede81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfad4be58554ff3ab08ae91bfad0854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc6a5a16ea349379ec3b867415e27c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:28.479525 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc0adb00-10ef-4b4c-82ea-697c963ede81 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 200 len: 1470 microversion: 2.1 time: 0.238013 Oct 04 18:19:28.485776 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2118/4241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:28 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 1470 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:28.531466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-928e9974-03dc-40e0-be9c-1ec9e6d5ad70 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:28.532109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-928e9974-03dc-40e0-be9c-1ec9e6d5ad70 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:28.541324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.542106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.542771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.556909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928e9974-03dc-40e0-be9c-1ec9e6d5ad70 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.560124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928e9974-03dc-40e0-be9c-1ec9e6d5ad70 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.564011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928e9974-03dc-40e0-be9c-1ec9e6d5ad70 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.566489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928e9974-03dc-40e0-be9c-1ec9e6d5ad70 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.569976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928e9974-03dc-40e0-be9c-1ec9e6d5ad70 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.572338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-928e9974-03dc-40e0-be9c-1ec9e6d5ad70 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.608905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:28.691233 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4adc6730-61a0-45c4-86d0-3c5ae7691e32 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-1275414673" status: 204 len: 0 microversion: 2.26 time: 0.346879 Oct 04 18:19:28.697924 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2124/4242] 10.222.0.18 () {60 vars in 1364 bytes} [Tue Oct 4 18:19:28 2022] DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-1275414673 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:19:28.715554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-df5633e9-7541-4dd9-a668-e58681b21cc2 req-5d89400d-7fe5-4eda-b6ee-c97214fe30d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afef2588-b2e9-4b9e-943c-44469215dd64", "name": "network-vif-deleted", "tag": "e1f04890-a2cf-4366-ad64-14ecf15d04cf"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:28.727049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-928e9974-03dc-40e0-be9c-1ec9e6d5ad70 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:28.736925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-df5633e9-7541-4dd9-a668-e58681b21cc2 req-5d89400d-7fe5-4eda-b6ee-c97214fe30d3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.741091 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-928e9974-03dc-40e0-be9c-1ec9e6d5ad70 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1276 microversion: 2.1 time: 0.218890 Oct 04 18:19:28.749661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-df5633e9-7541-4dd9-a668-e58681b21cc2 req-5d89400d-7fe5-4eda-b6ee-c97214fe30d3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.755226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-df5633e9-7541-4dd9-a668-e58681b21cc2 req-5d89400d-7fe5-4eda-b6ee-c97214fe30d3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.756354 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2119/4243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:28 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:28.763213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ec259b8-491b-4e90-a229-9ee3c97d1c27 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d124e790>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:28.778284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ec259b8-491b-4e90-a229-9ee3c97d1c27 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.779542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ec259b8-491b-4e90-a229-9ee3c97d1c27 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.780659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ec259b8-491b-4e90-a229-9ee3c97d1c27 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.798881 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-df5633e9-7541-4dd9-a668-e58681b21cc2 req-5d89400d-7fe5-4eda-b6ee-c97214fe30d3 service nova] Creating event network-vif-deleted:e1f04890-a2cf-4366-ad64-14ecf15d04cf for instance afef2588-b2e9-4b9e-943c-44469215dd64 on n-h2-850499-14 Oct 04 18:19:28.802933 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ec259b8-491b-4e90-a229-9ee3c97d1c27 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 200 len: 12 microversion: 2.26 time: 0.045275 Oct 04 18:19:28.807236 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2120/4244] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 4 18:19:28 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:28.814262 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-df5633e9-7541-4dd9-a668-e58681b21cc2 req-5d89400d-7fe5-4eda-b6ee-c97214fe30d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109470 Oct 04 18:19:28.819648 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2125/4245] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:28.825642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d11088b0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:28.841080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.848409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.849167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.849984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:28.857659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.860195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.860790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.861652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.863064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.867637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.924419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.926199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.926794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.955045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:28.956999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:28.957733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:28.970586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.971136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.971591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.972317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.972777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.973225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.986876 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-728d0d7f-b57a-4a04-a37d-eca1c98acbba tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 204 len: 0 microversion: 2.26 time: 0.170856 Oct 04 18:19:28.988301 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2121/4246] 10.222.0.18 () {60 vars in 1295 bytes} [Tue Oct 4 18:19:28 2022] DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:19:29.013329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d1196280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:29.029034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.030503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.031072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.031564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:29.039016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.039524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.039973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.040763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.041234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.041666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.076771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.077290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.078420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.089010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.089510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.090451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.138607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:29.168691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:29.189317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9ffc3173-d8fa-49ea-826e-f747a1f572ee tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-1404068279" status: 201 len: 0 microversion: 2.26 time: 0.190884 Oct 04 18:19:29.191535 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2122/4247] 10.222.0.18 () {62 vars in 1380 bytes} [Tue Oct 4 18:19:28 2022] PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-1404068279 => generated 0 bytes in 199 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:19:29.208654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d1108310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:29.245272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.245791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.246240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.246730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:29.278749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.279291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.285544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.287175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.287624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.291475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.387680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.388533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.388874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.410095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.410567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.415442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.459923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:29.499287 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2d8be8cb-17b5-4229-9820-1c3c9d529c7f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-556732552" status: 201 len: 0 microversion: 2.26 time: 0.303093 Oct 04 18:19:29.506422 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2123/4248] 10.222.0.18 () {62 vars in 1377 bytes} [Tue Oct 4 18:19:29 2022] PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-556732552 => generated 0 bytes in 311 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:19:29.517095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f9c203bf-7e33-4115-87ad-123cdec868c0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:29.524138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f9c203bf-7e33-4115-87ad-123cdec868c0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:29.531628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9c203bf-7e33-4115-87ad-123cdec868c0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.535506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9c203bf-7e33-4115-87ad-123cdec868c0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.536084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9c203bf-7e33-4115-87ad-123cdec868c0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.537597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9c203bf-7e33-4115-87ad-123cdec868c0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.543753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9c203bf-7e33-4115-87ad-123cdec868c0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.544323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9c203bf-7e33-4115-87ad-123cdec868c0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.764579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:29.791488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:29.793705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:29.794919 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ac7373b-ef9f-4122-9933-4d2aaae26d95 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1754 microversion: 2.42 time: 0.843590 Oct 04 18:19:29.804002 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2126/4249] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:28 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1754 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:19:29.809085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d21a5790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:29.840416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.841148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.841737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.842508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:29.862233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.878598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.879461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.880477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.881245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.881884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.928553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.929056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.929508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.976839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:30.017245 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fb3c5791-3303-4abd-9fc8-f05cfabf358d tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 204 len: 0 microversion: 2.26 time: 0.212023 Oct 04 18:19:30.017895 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2127/4250] 10.222.0.18 () {60 vars in 1295 bytes} [Tue Oct 4 18:19:29 2022] DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:19:30.024541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:30.025175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] [instance: afef2588-b2e9-4b9e-943c-44469215dd64] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:30.056635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.057117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.057578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.058318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.058790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.059257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.091741 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] HTTP exception thrown: Instance afef2588-b2e9-4b9e-943c-44469215dd64 could not be found. Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Request method failure captured: Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 HTTP/1.1 Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHgTvm-oAIoZw1T_WNVpCvQnVoZAm6tFCL0ZlU8GOF-aTqm5bdhCJnecuKQ6S7dpdRfGOZ-AXxGT8nTO3u9_m0qp_Qv81UN0Zdon2qeAKLqZb1lyIZfoWCG3vpP50aP6wE5OC1XdFT3wYAaPI2CSELNmLFSozaNUUEkTEtkp8hWbANc Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2dc6a5a16ea349379ec3b867415e27c8"}]}] Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2dc6a5a16ea349379ec3b867415e27c8 Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-272635392 Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 1cfad4be58554ff3ab08ae91bfad0854 Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-272635392-project Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance afef2588-b2e9-4b9e-943c-44469215dd64 could not be found. Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'afef2588-b2e9-4b9e-943c-44469215dd64'} Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afef2588-b2e9-4b9e-943c-44469215dd64 could not be found. Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afef2588-b2e9-4b9e-943c-44469215dd64 could not be found. Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:30.093993 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:30.097725 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:30.097725 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:30.097725 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:30.097725 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:30.097725 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:30.097725 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afef2588-b2e9-4b9e-943c-44469215dd64 could not be found. Oct 04 18:19:30.097725 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:30.097725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] Returning 404 to user: Instance afef2588-b2e9-4b9e-943c-44469215dd64 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:30.097725 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc65ba28-afd0-4428-91ae-401f933bf1d0 tempest-ServersNegativeTestJSON-272635392 tempest-ServersNegativeTestJSON-272635392-project] 10.222.0.18 "GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64" status: 404 len: 111 microversion: 2.1 time: 0.076488 Oct 04 18:19:30.103318 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2128/4251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:30 2022] GET /compute/v2.1/servers/afef2588-b2e9-4b9e-943c-44469215dd64 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:30.116598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6babd3e3-daba-4a3f-8c81-3af0b5804e5b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:30.117243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6babd3e3-daba-4a3f-8c81-3af0b5804e5b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:30.136021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6babd3e3-daba-4a3f-8c81-3af0b5804e5b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.136532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6babd3e3-daba-4a3f-8c81-3af0b5804e5b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.136985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6babd3e3-daba-4a3f-8c81-3af0b5804e5b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.137714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6babd3e3-daba-4a3f-8c81-3af0b5804e5b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.138182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6babd3e3-daba-4a3f-8c81-3af0b5804e5b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.138620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6babd3e3-daba-4a3f-8c81-3af0b5804e5b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.171329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f9c203bf-7e33-4115-87ad-123cdec868c0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:30.180865 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f9c203bf-7e33-4115-87ad-123cdec868c0 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1321 microversion: 2.1 time: 0.672902 Oct 04 18:19:30.185253 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2124/4252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:29 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:30.191310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-87625392-2191-4d08-866d-154ff0fbdcec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d124e280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:30.224050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87625392-2191-4d08-866d-154ff0fbdcec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.230590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87625392-2191-4d08-866d-154ff0fbdcec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.231407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87625392-2191-4d08-866d-154ff0fbdcec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.265909 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-87625392-2191-4d08-866d-154ff0fbdcec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 200 len: 12 microversion: 2.26 time: 0.078686 Oct 04 18:19:30.266696 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2125/4253] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 4 18:19:30 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 12 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:30.286240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d1196b80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:30.306566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.310385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.310851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.311389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:30.330413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.330914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.331393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.332120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.332584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.333024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.341521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6babd3e3-daba-4a3f-8c81-3af0b5804e5b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:30.350774 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6babd3e3-daba-4a3f-8c81-3af0b5804e5b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1282 microversion: 2.1 time: 0.246263 Oct 04 18:19:30.376782 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2129/4254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:30 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1282 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:30.458153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.458861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.461107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.507071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:30.560701 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-13997144-22f6-497c-8ed4-497a997016f8 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 204 len: 0 microversion: 2.26 time: 0.278468 Oct 04 18:19:30.562688 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2126/4255] 10.222.0.18 () {60 vars in 1295 bytes} [Tue Oct 4 18:19:30 2022] DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:19:30.574437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d6174430>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:30.588877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.604517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.605326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.611445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:30.630066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.632915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.633606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.635863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.638091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.638794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.744762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.747346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.747939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.789782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.790414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.790976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.864181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:30.927185 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ee004d6-4450-4d30-9672-5d79871d6018 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-1818517526" status: 201 len: 0 microversion: 2.26 time: 0.346218 Oct 04 18:19:30.928347 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2130/4256] 10.222.0.18 () {62 vars in 1380 bytes} [Tue Oct 4 18:19:30 2022] PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-1818517526 => generated 0 bytes in 358 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:19:30.936373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:30.947325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:30.959915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.962602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.963094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.963842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.964319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.964760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.372802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:31.380374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:31.385429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:31.393949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:31.396355 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-14963a17-8e45-437b-8a01-30962e5b8200 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1801 microversion: 2.42 time: 0.466938 Oct 04 18:19:31.400088 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2131/4257] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:30 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1801 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:31.411045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-dcb7e4cf-1de0-428a-a42d-fd52f24cfc93 req-03489a52-4f11-44f3-a6de-fe5e1f333576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c70bd86-e768-4043-92d9-3e77fef9bea6", "tag": "61b6d22f-c201-441f-9d3e-c4a8a7d91fd2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:31.435487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dcb7e4cf-1de0-428a-a42d-fd52f24cfc93 req-03489a52-4f11-44f3-a6de-fe5e1f333576 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.436221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dcb7e4cf-1de0-428a-a42d-fd52f24cfc93 req-03489a52-4f11-44f3-a6de-fe5e1f333576 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.437290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dcb7e4cf-1de0-428a-a42d-fd52f24cfc93 req-03489a52-4f11-44f3-a6de-fe5e1f333576 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.458551 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-dcb7e4cf-1de0-428a-a42d-fd52f24cfc93 req-03489a52-4f11-44f3-a6de-fe5e1f333576 service nova] Creating event network-changed:61b6d22f-c201-441f-9d3e-c4a8a7d91fd2 for instance 2c70bd86-e768-4043-92d9-3e77fef9bea6 on n-h2-850499-14 Oct 04 18:19:31.464195 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-dcb7e4cf-1de0-428a-a42d-fd52f24cfc93 req-03489a52-4f11-44f3-a6de-fe5e1f333576 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062576 Oct 04 18:19:31.464803 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2132/4258] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:31.485560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d1fccaf0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:31.501502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.508614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.520589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5667f1c1-a0ab-4ef9-9d95-274fb64283a5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Action: 'create', calling method: .version_select at 0x7fd4d1108b80>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:31.528743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.529389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:31.540175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:31.544474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.544989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.545433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.554107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.554607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.555250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.577500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-5667f1c1-a0ab-4ef9-9d95-274fb64283a5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Getting quotas for project efdaa87d89624b37aeb1f3eea159f36a. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:31.589910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-5667f1c1-a0ab-4ef9-9d95-274fb64283a5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Getting quotas for user d508ec06ff6148d393f764e72f71abe2 and project efdaa87d89624b37aeb1f3eea159f36a. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:31.609863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.617309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.619380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.644315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.645030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.645660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.686919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:31.718168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-5667f1c1-a0ab-4ef9-9d95-274fb64283a5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Getting quotas for project efdaa87d89624b37aeb1f3eea159f36a. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:31.734641 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df5ba06c-e61f-457d-812f-0019388d69c4 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-1964753832" status: 201 len: 0 microversion: 2.26 time: 0.265965 Oct 04 18:19:31.735529 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2133/4259] 10.222.0.18 () {62 vars in 1380 bytes} [Tue Oct 4 18:19:31 2022] PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags/tempest-tag-1964753832 => generated 0 bytes in 268 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:19:31.744821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e80d9d8d-010a-4cdc-ba15-cc2370d82628 req-e56aef05-66a7-4abd-90a3-b5d2a455b7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de379391-e467-452e-93b4-9fbfe268a32c", "name": "network-vif-plugged", "status": "completed", "tag": "81e9aade-f2b8-4784-a02a-349656092364"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:31.745260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-5667f1c1-a0ab-4ef9-9d95-274fb64283a5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Getting quotas for user d508ec06ff6148d393f764e72f71abe2 and project efdaa87d89624b37aeb1f3eea159f36a. Resources: {'server_groups'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:31.771668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e80d9d8d-010a-4cdc-ba15-cc2370d82628 req-e56aef05-66a7-4abd-90a3-b5d2a455b7bf service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.772383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e80d9d8d-010a-4cdc-ba15-cc2370d82628 req-e56aef05-66a7-4abd-90a3-b5d2a455b7bf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.773469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e80d9d8d-010a-4cdc-ba15-cc2370d82628 req-e56aef05-66a7-4abd-90a3-b5d2a455b7bf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.796971 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5667f1c1-a0ab-4ef9-9d95-274fb64283a5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.124671 Oct 04 18:19:31.797991 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2127/4260] 10.222.0.18 () {62 vars in 1214 bytes} [Tue Oct 4 18:19:30 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:19:31.804328 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e80d9d8d-010a-4cdc-ba15-cc2370d82628 req-e56aef05-66a7-4abd-90a3-b5d2a455b7bf service nova] Creating event network-vif-plugged:81e9aade-f2b8-4784-a02a-349656092364 for instance de379391-e467-452e-93b4-9fbfe268a32c on n-h1-850499-14 Oct 04 18:19:31.811083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-687f82ff-9d90-4dff-af5a-3743d52e6f8f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:31.811715 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e80d9d8d-010a-4cdc-ba15-cc2370d82628 req-e56aef05-66a7-4abd-90a3-b5d2a455b7bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074762 Oct 04 18:19:31.812411 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2134/4261] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:31.813146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-687f82ff-9d90-4dff-af5a-3743d52e6f8f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:31.817931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-175054a4-d1ef-4f10-ad7a-9f51825aa86e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:31.818650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-175054a4-d1ef-4f10-ad7a-9f51825aa86e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:31.834695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687f82ff-9d90-4dff-af5a-3743d52e6f8f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.836754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687f82ff-9d90-4dff-af5a-3743d52e6f8f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.837464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687f82ff-9d90-4dff-af5a-3743d52e6f8f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.838100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:31.839311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687f82ff-9d90-4dff-af5a-3743d52e6f8f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.841495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687f82ff-9d90-4dff-af5a-3743d52e6f8f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.842808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-175054a4-d1ef-4f10-ad7a-9f51825aa86e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.856794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-687f82ff-9d90-4dff-af5a-3743d52e6f8f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.857428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-175054a4-d1ef-4f10-ad7a-9f51825aa86e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.857931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-175054a4-d1ef-4f10-ad7a-9f51825aa86e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.858706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-175054a4-d1ef-4f10-ad7a-9f51825aa86e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.859750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-175054a4-d1ef-4f10-ad7a-9f51825aa86e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.860364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-175054a4-d1ef-4f10-ad7a-9f51825aa86e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.492543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-175054a4-d1ef-4f10-ad7a-9f51825aa86e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:32.502540 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-175054a4-d1ef-4f10-ad7a-9f51825aa86e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1324 microversion: 2.1 time: 0.688806 Oct 04 18:19:32.519693 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2135/4262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:31 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1324 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:32.526416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Action: 'update_all', calling method: .version_select at 0x7fd4d21a5a60>, body: {"tags": ["tempest-tag-1169190644", "tempest-tag-1937300153"]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:32.538144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.538850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.539551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.540486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:32.547729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.548238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.548686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.549425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.549895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.550619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.599121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.600873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.604367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.607028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-687f82ff-9d90-4dff-af5a-3743d52e6f8f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:32.629035 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-687f82ff-9d90-4dff-af5a-3743d52e6f8f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1321 microversion: 2.1 time: 0.826587 Oct 04 18:19:32.631828 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2128/4263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:31 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1321 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:32.641407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8cef274c-eeab-4ba1-936d-9733caef42f7 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.695520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:32.722306 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8cef274c-eeab-4ba1-936d-9733caef42f7 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.085247 Oct 04 18:19:32.725295 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2129/4264] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 4 18:19:32 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:19:32.733402 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9fa68206-706b-4f91-a497-0d1df0cbe340 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 200 len: 62 microversion: 2.26 time: 0.212206 Oct 04 18:19:32.739205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.739994 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2136/4265] 10.222.0.18 () {62 vars in 1312 bytes} [Tue Oct 4 18:19:32 2022] PUT /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 62 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:32.748171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:32.757278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-329c1b2a-752b-4932-a359-0aad94cec300 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.767071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.772891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.774141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.775204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.775921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.776691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.779722 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-329c1b2a-752b-4932-a359-0aad94cec300 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/7cabd67a-7069-412d-9bd8-10ef455ddeba" status: 200 len: 235 microversion: 2.64 time: 0.035535 Oct 04 18:19:32.780301 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2137/4266] 10.222.0.18 () {60 vars in 1304 bytes} [Tue Oct 4 18:19:32 2022] GET /compute/v2.1/os-server-groups/7cabd67a-7069-412d-9bd8-10ef455ddeba => generated 235 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:19:32.807946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cc855d73-b59a-4b08-bb16-7749c473cc90 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d1d5bb80>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.829621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc855d73-b59a-4b08-bb16-7749c473cc90 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.831616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc855d73-b59a-4b08-bb16-7749c473cc90 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.832168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc855d73-b59a-4b08-bb16-7749c473cc90 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.858563 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cc855d73-b59a-4b08-bb16-7749c473cc90 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 200 len: 62 microversion: 2.26 time: 0.060222 Oct 04 18:19:32.861036 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2138/4267] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 4 18:19:32 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 62 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:32.869741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c705ec97-10f3-479b-a9af-08731369df0d tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.959564 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c705ec97-10f3-479b-a9af-08731369df0d tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/7cabd67a-7069-412d-9bd8-10ef455ddeba" status: 204 len: 0 microversion: 2.64 time: 0.096683 Oct 04 18:19:32.960190 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2139/4268] 10.222.0.18 () {60 vars in 1307 bytes} [Tue Oct 4 18:19:32 2022] DELETE /compute/v2.1/os-server-groups/7cabd67a-7069-412d-9bd8-10ef455ddeba => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:19:32.981465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '.version_select at 0x7fd4d1ece4c0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.999404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.007609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.008314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.008978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:33.024294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.024812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.025268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.026003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.026478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.026927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.076272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.076771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.077225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.105845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'flavor' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:33.137353 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-679ab7cf-12d0-4918-8133-a49ce1ff03ab tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags" status: 204 len: 0 microversion: 2.26 time: 0.170213 Oct 04 18:19:33.138742 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2140/4269] 10.222.0.18 () {60 vars in 1295 bytes} [Tue Oct 4 18:19:32 2022] DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91/tags => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:19:33.148190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-903e288b-7f96-401f-b85d-d48c13e9d2b5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:33.164605 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-903e288b-7f96-401f-b85d-d48c13e9d2b5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] HTTP exception thrown: Instance group 7cabd67a-7069-412d-9bd8-10ef455ddeba could not be found. Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-903e288b-7f96-401f-b85d-d48c13e9d2b5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Request method failure captured: Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-server-groups/7cabd67a-7069-412d-9bd8-10ef455ddeba HTTP/1.1 Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHkytR9PPLJ3wmXXuez3lQFpIKeK9782sGY8e5NhAYK2veKs9HQsJFYR98ipdQuYFi0iuoS-JEtAv33zJy611NO8PrYPFhQqZ4fV_TEfjBFpcp4BMJ3CwrDupOnmH0ripSrro1Gt1M2dviHIz4N3_DgCh5ZeEr28CNcCGHxdWcQihMI Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: efdaa87d89624b37aeb1f3eea159f36a Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerGroup264TestJSON-1007892982 Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_efdaa87d89624b37aeb1f3eea159f36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/efdaa87d89624b37aeb1f3eea159f36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efdaa87d89624b37aeb1f3eea159f36a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efdaa87d89624b37aeb1f3eea159f36a"}]}] Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerGroup264TestJSON-1007892982 Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: efdaa87d89624b37aeb1f3eea159f36a Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1007892982 Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerGroup264TestJSON-1007892982-project Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: d508ec06ff6148d393f764e72f71abe2 Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerGroup264TestJSON-1007892982-project Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance group 7cabd67a-7069-412d-9bd8-10ef455ddeba could not be found. Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '7cabd67a-7069-412d-9bd8-10ef455ddeba'} Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7cabd67a-7069-412d-9bd8-10ef455ddeba could not be found. Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7cabd67a-7069-412d-9bd8-10ef455ddeba could not be found. Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:33.166304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:33.170175 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:33.170175 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:33.170175 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:33.170175 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:33.170175 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7cabd67a-7069-412d-9bd8-10ef455ddeba could not be found. Oct 04 18:19:33.170175 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:33.170175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-903e288b-7f96-401f-b85d-d48c13e9d2b5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] Returning 404 to user: Instance group 7cabd67a-7069-412d-9bd8-10ef455ddeba could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:33.172682 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-903e288b-7f96-401f-b85d-d48c13e9d2b5 tempest-ServerGroup264TestJSON-1007892982 tempest-ServerGroup264TestJSON-1007892982-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/7cabd67a-7069-412d-9bd8-10ef455ddeba" status: 404 len: 117 microversion: 2.64 time: 0.032142 Oct 04 18:19:33.175253 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2141/4270] 10.222.0.18 () {60 vars in 1307 bytes} [Tue Oct 4 18:19:33 2022] DELETE /compute/v2.1/os-server-groups/7cabd67a-7069-412d-9bd8-10ef455ddeba => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:33.186657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a4fdb72b-402a-4497-b151-0fc341964921 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:33.191664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a4fdb72b-402a-4497-b151-0fc341964921 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:33.205960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fdb72b-402a-4497-b151-0fc341964921 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.206629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fdb72b-402a-4497-b151-0fc341964921 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.207772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fdb72b-402a-4497-b151-0fc341964921 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.215263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fdb72b-402a-4497-b151-0fc341964921 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.215993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fdb72b-402a-4497-b151-0fc341964921 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.216600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fdb72b-402a-4497-b151-0fc341964921 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.255899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a4fdb72b-402a-4497-b151-0fc341964921 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:19:33.385569 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a4fdb72b-402a-4497-b151-0fc341964921 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 204 len: 0 microversion: 2.26 time: 0.208706 Oct 04 18:19:33.386100 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2142/4271] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:19:33 2022] DELETE /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:19:33.399206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:33.404095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:33.417206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.423793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.424485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.425409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.426039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.426667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.804681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:33.824558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:33.826570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:33.833401 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b8155a7a-1012-4e6f-bbea-577357d457ed tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1801 microversion: 2.42 time: 1.106733 Oct 04 18:19:33.847195 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2130/4272] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:32 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1801 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:33.873344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-34f22bf2-0fd8-48f6-b7e6-09006a72294a tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:33.877559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-34f22bf2-0fd8-48f6-b7e6-09006a72294a tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:33.904980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f22bf2-0fd8-48f6-b7e6-09006a72294a tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.905792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f22bf2-0fd8-48f6-b7e6-09006a72294a tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.906986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f22bf2-0fd8-48f6-b7e6-09006a72294a tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.908115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f22bf2-0fd8-48f6-b7e6-09006a72294a tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.908646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f22bf2-0fd8-48f6-b7e6-09006a72294a tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.909099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f22bf2-0fd8-48f6-b7e6-09006a72294a tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:34.633146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:34.642143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:34.643638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:34.644862 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-51a318c4-616a-4044-8cc6-d0027c946aec tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1552 microversion: 2.26 time: 1.253719 Oct 04 18:19:34.655346 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2143/4273] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:33 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1552 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:19:34.673232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b810f1b3-3d78-4e0b-8a94-e9e9390615fe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:34.673853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b810f1b3-3d78-4e0b-8a94-e9e9390615fe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:34.680379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b810f1b3-3d78-4e0b-8a94-e9e9390615fe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:34.680879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b810f1b3-3d78-4e0b-8a94-e9e9390615fe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:34.681330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b810f1b3-3d78-4e0b-8a94-e9e9390615fe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:34.682046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b810f1b3-3d78-4e0b-8a94-e9e9390615fe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:34.682511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b810f1b3-3d78-4e0b-8a94-e9e9390615fe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:34.682945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b810f1b3-3d78-4e0b-8a94-e9e9390615fe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:34.968762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-34f22bf2-0fd8-48f6-b7e6-09006a72294a tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:34.986765 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-34f22bf2-0fd8-48f6-b7e6-09006a72294a tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1324 microversion: 2.1 time: 1.137882 Oct 04 18:19:34.989811 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2131/4274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:33 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1324 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:35.003922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:35.005003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:35.017152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.017861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.018654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.019780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.020416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.021003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.677148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b810f1b3-3d78-4e0b-8a94-e9e9390615fe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:35.691621 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b810f1b3-3d78-4e0b-8a94-e9e9390615fe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1321 microversion: 2.1 time: 1.034060 Oct 04 18:19:35.696931 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2144/4275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:34 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1321 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:35.711264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:35.711900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:35.735003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.735579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.736037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.736790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.737253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.737686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:36.286721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:36.309566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:36.315220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:36.316828 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9d1ef29e-a0f5-4009-8bcb-85ebb61f04a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1848 microversion: 2.42 time: 1.322567 Oct 04 18:19:36.320393 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2132/4276] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:34 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1848 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:36.332692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a15a250-22e3-44e1-af4b-3acd16171061 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:36.333352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a15a250-22e3-44e1-af4b-3acd16171061 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:36.357973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a15a250-22e3-44e1-af4b-3acd16171061 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:36.358489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a15a250-22e3-44e1-af4b-3acd16171061 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:36.359493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a15a250-22e3-44e1-af4b-3acd16171061 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:36.365150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a15a250-22e3-44e1-af4b-3acd16171061 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:36.365662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a15a250-22e3-44e1-af4b-3acd16171061 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:36.366112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a15a250-22e3-44e1-af4b-3acd16171061 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:36.595474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:36.645401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:36.760552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:36.769253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:36.770715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:36.781287 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0dbddf77-ba74-4d8c-ac29-edf0c8ec167f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1552 microversion: 2.26 time: 1.082538 Oct 04 18:19:36.782474 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2145/4277] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:35 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1552 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:36.795746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c002ae93-ac00-4048-869d-59e75e500b3d req-f4aafa95-522b-4226-a6e7-08f87e9ca38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c956e93-3292-4f67-859d-9fc45d40384c", "tag": "6a9dffe8-522b-45f4-848e-0f85ae9be3d7"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:36.821416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c002ae93-ac00-4048-869d-59e75e500b3d req-f4aafa95-522b-4226-a6e7-08f87e9ca38b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:36.822169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c002ae93-ac00-4048-869d-59e75e500b3d req-f4aafa95-522b-4226-a6e7-08f87e9ca38b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:36.822760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c002ae93-ac00-4048-869d-59e75e500b3d req-f4aafa95-522b-4226-a6e7-08f87e9ca38b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:36.857942 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c002ae93-ac00-4048-869d-59e75e500b3d req-f4aafa95-522b-4226-a6e7-08f87e9ca38b service nova] Creating event network-changed:6a9dffe8-522b-45f4-848e-0f85ae9be3d7 for instance 7c956e93-3292-4f67-859d-9fc45d40384c on n-h1-850499-14 Oct 04 18:19:36.865300 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c002ae93-ac00-4048-869d-59e75e500b3d req-f4aafa95-522b-4226-a6e7-08f87e9ca38b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081241 Oct 04 18:19:36.866178 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2146/4278] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:36.871765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-de3a9ba2-3ed9-4299-9a55-0855be1d8220 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:36.875932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-de3a9ba2-3ed9-4299-9a55-0855be1d8220 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:36.886934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de3a9ba2-3ed9-4299-9a55-0855be1d8220 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:36.887455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de3a9ba2-3ed9-4299-9a55-0855be1d8220 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:36.887894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de3a9ba2-3ed9-4299-9a55-0855be1d8220 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:36.888794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de3a9ba2-3ed9-4299-9a55-0855be1d8220 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:36.889253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de3a9ba2-3ed9-4299-9a55-0855be1d8220 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:36.889682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de3a9ba2-3ed9-4299-9a55-0855be1d8220 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.003311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9a15a250-22e3-44e1-af4b-3acd16171061 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:37.018896 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a15a250-22e3-44e1-af4b-3acd16171061 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1324 microversion: 2.1 time: 0.697368 Oct 04 18:19:37.019515 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2133/4279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:36 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1324 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:37.346010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:37.346622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:37.355653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.356141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.365894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.366893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.367684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.368253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.477716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-de3a9ba2-3ed9-4299-9a55-0855be1d8220 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:37.491906 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-de3a9ba2-3ed9-4299-9a55-0855be1d8220 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1321 microversion: 2.1 time: 0.624066 Oct 04 18:19:37.509264 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2147/4280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:36 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1321 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:37.704577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d379c34c-f040-465b-adf0-cdb639176c74 req-4f8e6ee1-774f-456c-bdb0-94d970a175d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "tag": "545c6404-6880-41fc-9a80-8ac8aec3c32f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:37.731874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d379c34c-f040-465b-adf0-cdb639176c74 req-4f8e6ee1-774f-456c-bdb0-94d970a175d7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.732376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d379c34c-f040-465b-adf0-cdb639176c74 req-4f8e6ee1-774f-456c-bdb0-94d970a175d7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.732871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d379c34c-f040-465b-adf0-cdb639176c74 req-4f8e6ee1-774f-456c-bdb0-94d970a175d7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.759877 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d379c34c-f040-465b-adf0-cdb639176c74 req-4f8e6ee1-774f-456c-bdb0-94d970a175d7 service nova] Creating event network-changed:545c6404-6880-41fc-9a80-8ac8aec3c32f for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:19:37.765954 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d379c34c-f040-465b-adf0-cdb639176c74 req-4f8e6ee1-774f-456c-bdb0-94d970a175d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067223 Oct 04 18:19:37.767053 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2148/4281] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:37.820745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:37.821614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:37.828670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.829311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.829876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.830860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.831463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.832016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.927329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:37.943819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:37.950381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:37.955193 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1455df5b-ded8-437d-acbb-13902b4863a1 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1848 microversion: 2.42 time: 0.612801 Oct 04 18:19:37.987485 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2134/4282] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:37 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1848 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:38.044669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70bea844-5435-4ec7-919b-e2f381f1062d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:38.048767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-70bea844-5435-4ec7-919b-e2f381f1062d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:38.072496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70bea844-5435-4ec7-919b-e2f381f1062d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.074624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70bea844-5435-4ec7-919b-e2f381f1062d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.077081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70bea844-5435-4ec7-919b-e2f381f1062d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.080854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70bea844-5435-4ec7-919b-e2f381f1062d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.085222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70bea844-5435-4ec7-919b-e2f381f1062d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.086355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70bea844-5435-4ec7-919b-e2f381f1062d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.339168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:38.342713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:38.358408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:38.362393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:38.363864 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6c4ca0fe-d356-4dba-993b-50229692102f tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1552 microversion: 2.26 time: 0.558831 Oct 04 18:19:38.367956 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2149/4283] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:37 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1552 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:38.519423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be1461e9-fabb-439b-a79f-5f55fd22cb2e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:38.520309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be1461e9-fabb-439b-a79f-5f55fd22cb2e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:38.542833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be1461e9-fabb-439b-a79f-5f55fd22cb2e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.544804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be1461e9-fabb-439b-a79f-5f55fd22cb2e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.546013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be1461e9-fabb-439b-a79f-5f55fd22cb2e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.549212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be1461e9-fabb-439b-a79f-5f55fd22cb2e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.550029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be1461e9-fabb-439b-a79f-5f55fd22cb2e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.551641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be1461e9-fabb-439b-a79f-5f55fd22cb2e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.807406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70bea844-5435-4ec7-919b-e2f381f1062d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:38.818837 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70bea844-5435-4ec7-919b-e2f381f1062d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1324 microversion: 2.1 time: 0.780215 Oct 04 18:19:38.819477 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2135/4284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:38 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1324 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:38.850399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5464741f-89a6-4e23-9f12-214b2f21446c req-66fc47e1-25eb-437f-bb28-e32bfb4a314f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c70bd86-e768-4043-92d9-3e77fef9bea6", "name": "network-vif-plugged", "status": "completed", "tag": "61b6d22f-c201-441f-9d3e-c4a8a7d91fd2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:38.870864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5464741f-89a6-4e23-9f12-214b2f21446c req-66fc47e1-25eb-437f-bb28-e32bfb4a314f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.877965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5464741f-89a6-4e23-9f12-214b2f21446c req-66fc47e1-25eb-437f-bb28-e32bfb4a314f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.878490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5464741f-89a6-4e23-9f12-214b2f21446c req-66fc47e1-25eb-437f-bb28-e32bfb4a314f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.908646 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5464741f-89a6-4e23-9f12-214b2f21446c req-66fc47e1-25eb-437f-bb28-e32bfb4a314f service nova] Creating event network-vif-plugged:61b6d22f-c201-441f-9d3e-c4a8a7d91fd2 for instance 2c70bd86-e768-4043-92d9-3e77fef9bea6 on n-h2-850499-14 Oct 04 18:19:38.925571 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5464741f-89a6-4e23-9f12-214b2f21446c req-66fc47e1-25eb-437f-bb28-e32bfb4a314f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080207 Oct 04 18:19:38.926214 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2136/4285] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:38.990185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:38.991100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:39.003016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:39.004072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:39.006308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:39.007228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:39.009333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:39.009923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:39.073732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be1461e9-fabb-439b-a79f-5f55fd22cb2e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:39.083319 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be1461e9-fabb-439b-a79f-5f55fd22cb2e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1321 microversion: 2.1 time: 0.569263 Oct 04 18:19:39.109164 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2150/4286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:38 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:39.397745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:39.398376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:39.411615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:39.412144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:39.412603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:39.413350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:39.413814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:39.419863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.097629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:40.114392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:40.120873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:40.122540 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d3cfd50d-5234-44f8-bf3b-5966ad46dde3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1848 microversion: 2.42 time: 1.136896 Oct 04 18:19:40.125230 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2137/4287] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:38 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1848 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:19:40.135106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a5964ba-521f-4816-b118-4b327308443d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:40.137164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1a5964ba-521f-4816-b118-4b327308443d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:40.149215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5964ba-521f-4816-b118-4b327308443d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.149979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5964ba-521f-4816-b118-4b327308443d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.150590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5964ba-521f-4816-b118-4b327308443d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.151709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5964ba-521f-4816-b118-4b327308443d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.152359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5964ba-521f-4816-b118-4b327308443d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.152948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5964ba-521f-4816-b118-4b327308443d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.165402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:40.180699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:40.183117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:40.184885 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-78d2ab9d-9b1f-48ac-b8a9-b705a03a6380 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1552 microversion: 2.26 time: 0.790954 Oct 04 18:19:40.187661 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2151/4288] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:39 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1552 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:19:40.192948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a89638b1-df7e-4cec-ba49-be0cb6dcfa22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:40.199823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a89638b1-df7e-4cec-ba49-be0cb6dcfa22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:40.213897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89638b1-df7e-4cec-ba49-be0cb6dcfa22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.214739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89638b1-df7e-4cec-ba49-be0cb6dcfa22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.215450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89638b1-df7e-4cec-ba49-be0cb6dcfa22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.217003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89638b1-df7e-4cec-ba49-be0cb6dcfa22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.217684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89638b1-df7e-4cec-ba49-be0cb6dcfa22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.218401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a89638b1-df7e-4cec-ba49-be0cb6dcfa22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.361421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-a89638b1-df7e-4cec-ba49-be0cb6dcfa22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lazy-loading 'services' on Instance uuid e8b2bfb3-d80f-4ed6-95f0-5face8d7581e {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:40.477065 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a89638b1-df7e-4cec-ba49-be0cb6dcfa22 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/os-volume_attachments/1da8e2d7-9517-4945-aeee-a3880569ac56" status: 202 len: 0 microversion: 2.1 time: 0.287684 Oct 04 18:19:40.478521 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2152/4289] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:19:40 2022] DELETE /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/os-volume_attachments/1da8e2d7-9517-4945-aeee-a3880569ac56 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:19:40.501566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d40636f1-2f3f-4c4e-b218-2f91e54329b3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:40.506006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d40636f1-2f3f-4c4e-b218-2f91e54329b3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:40.526505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d40636f1-2f3f-4c4e-b218-2f91e54329b3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.533493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d40636f1-2f3f-4c4e-b218-2f91e54329b3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.533964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d40636f1-2f3f-4c4e-b218-2f91e54329b3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.534757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d40636f1-2f3f-4c4e-b218-2f91e54329b3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.535252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d40636f1-2f3f-4c4e-b218-2f91e54329b3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.537665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d40636f1-2f3f-4c4e-b218-2f91e54329b3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.655158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1a5964ba-521f-4816-b118-4b327308443d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:40.670125 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1a5964ba-521f-4816-b118-4b327308443d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1324 microversion: 2.1 time: 0.541027 Oct 04 18:19:40.675247 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2138/4290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:40 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1324 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:40.993040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ceb3269b-7a55-4e80-9e65-d06c15d7782d req-2209de52-f1af-47bc-a2af-eb95feef5fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f79c6d-b0dd-470c-9269-45e3529dec91", "name": "network-vif-deleted", "tag": "afaad5f5-e641-405b-985f-5e52dcfd6f42"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:41.051661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ceb3269b-7a55-4e80-9e65-d06c15d7782d req-2209de52-f1af-47bc-a2af-eb95feef5fe7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.052326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ceb3269b-7a55-4e80-9e65-d06c15d7782d req-2209de52-f1af-47bc-a2af-eb95feef5fe7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.053095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ceb3269b-7a55-4e80-9e65-d06c15d7782d req-2209de52-f1af-47bc-a2af-eb95feef5fe7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.056800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d40636f1-2f3f-4c4e-b218-2f91e54329b3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:41.098028 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d40636f1-2f3f-4c4e-b218-2f91e54329b3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1321 microversion: 2.1 time: 0.617014 Oct 04 18:19:41.099832 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2153/4291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:40 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:41.141732 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ceb3269b-7a55-4e80-9e65-d06c15d7782d req-2209de52-f1af-47bc-a2af-eb95feef5fe7 service nova] Creating event network-vif-deleted:afaad5f5-e641-405b-985f-5e52dcfd6f42 for instance 93f79c6d-b0dd-470c-9269-45e3529dec91 on n-h2-850499-14 Oct 04 18:19:41.163790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:41.164421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:41.164702 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ceb3269b-7a55-4e80-9e65-d06c15d7782d req-2209de52-f1af-47bc-a2af-eb95feef5fe7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183069 Oct 04 18:19:41.168246 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2139/4292] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:41.195881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.197518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.198843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.200963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.201777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.203721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.222431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:41.223212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:41.240636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.241550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.243242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.245837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.246981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.251341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.337490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.338975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.339684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.340376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lazy-loading 'fault' on Instance uuid 93f79c6d-b0dd-470c-9269-45e3529dec91 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:41.777484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=10 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:41.929089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:41.931368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:41.949283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:41.955644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '937d9dd336a84f6e9e11144a6cc4af9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0483c4cb78934c73b905d16a46988acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:41.956936 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1dd31d3f-5df8-403b-a0be-a3680431e2ca tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 200 len: 1351 microversion: 2.26 time: 0.740594 Oct 04 18:19:41.972043 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2140/4293] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:41 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 1351 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:19:41.997622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84543c2f-e86c-4a74-9cd9-cfbb586e8efc tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:42.003494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-84543c2f-e86c-4a74-9cd9-cfbb586e8efc tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:42.012950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84543c2f-e86c-4a74-9cd9-cfbb586e8efc tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.020733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84543c2f-e86c-4a74-9cd9-cfbb586e8efc tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.021442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84543c2f-e86c-4a74-9cd9-cfbb586e8efc tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.027273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84543c2f-e86c-4a74-9cd9-cfbb586e8efc tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.027954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84543c2f-e86c-4a74-9cd9-cfbb586e8efc tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.028631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84543c2f-e86c-4a74-9cd9-cfbb586e8efc tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.305556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:42.316284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:42.318023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:42.335993 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fb2e0d8d-b9a3-496b-848c-f6438bf01c32 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1869 microversion: 2.42 time: 1.170562 Oct 04 18:19:42.339782 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2154/4294] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:41 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1869 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:42.361311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e97b78c-e378-40a7-9a21-5814db7a104e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:42.361975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1e97b78c-e378-40a7-9a21-5814db7a104e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:42.389034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e97b78c-e378-40a7-9a21-5814db7a104e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.389550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e97b78c-e378-40a7-9a21-5814db7a104e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.390002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e97b78c-e378-40a7-9a21-5814db7a104e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.391282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e97b78c-e378-40a7-9a21-5814db7a104e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.391756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e97b78c-e378-40a7-9a21-5814db7a104e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.392192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e97b78c-e378-40a7-9a21-5814db7a104e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.780309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-84543c2f-e86c-4a74-9cd9-cfbb586e8efc tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:42.794506 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84543c2f-e86c-4a74-9cd9-cfbb586e8efc tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1324 microversion: 2.1 time: 0.827534 Oct 04 18:19:42.800007 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2141/4295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:41 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1324 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:42.935672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1e97b78c-e378-40a7-9a21-5814db7a104e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:42.946157 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1e97b78c-e378-40a7-9a21-5814db7a104e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1512 microversion: 2.1 time: 0.605073 Oct 04 18:19:42.951375 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2155/4296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:42 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1512 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:42.970233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef6b1f32-f410-4a52-8205-aceb6892568d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:42.970863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ef6b1f32-f410-4a52-8205-aceb6892568d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:42.985692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:42.986330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] [instance: 93f79c6d-b0dd-470c-9269-45e3529dec91] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:42.993838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef6b1f32-f410-4a52-8205-aceb6892568d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.994581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef6b1f32-f410-4a52-8205-aceb6892568d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.001327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.002115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef6b1f32-f410-4a52-8205-aceb6892568d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.003070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef6b1f32-f410-4a52-8205-aceb6892568d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.004414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef6b1f32-f410-4a52-8205-aceb6892568d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.006580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.007089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.007836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.008310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.008821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.013471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef6b1f32-f410-4a52-8205-aceb6892568d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.075141 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] HTTP exception thrown: Instance 93f79c6d-b0dd-470c-9269-45e3529dec91 could not be found. Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Request method failure captured: Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 HTTP/1.1 Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHkSJ4OjT8RTm2BZh9-GWDJh0SO7znFmDmMFF8nhaA9-j1Nib0v1uU9p17hpG2xmEIU6oQ3Alv5iNEdIXOdGVp1Y5skMdu2vjGV4JYFvTdoOaDocEkJjxYk8SOCOvw2mWWDHUQpXO5NbzU6RfUB34DCbFKroCQXfvuyD08QiTFiRAUI Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 0483c4cb78934c73b905d16a46988acb Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerTagsTestJSON-1080059360 Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0483c4cb78934c73b905d16a46988acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0483c4cb78934c73b905d16a46988acb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0483c4cb78934c73b905d16a46988acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0483c4cb78934c73b905d16a46988acb"}]}] Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerTagsTestJSON-1080059360 Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 0483c4cb78934c73b905d16a46988acb Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerTagsTestJSON-1080059360 Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerTagsTestJSON-1080059360-project Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 937d9dd336a84f6e9e11144a6cc4af9e Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerTagsTestJSON-1080059360-project Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 93f79c6d-b0dd-470c-9269-45e3529dec91 could not be found. Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '93f79c6d-b0dd-470c-9269-45e3529dec91'} Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f79c6d-b0dd-470c-9269-45e3529dec91 could not be found. Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f79c6d-b0dd-470c-9269-45e3529dec91 could not be found. Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:43.080303 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:43.084569 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:43.084569 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:43.084569 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:43.084569 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:43.084569 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:43.084569 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f79c6d-b0dd-470c-9269-45e3529dec91 could not be found. Oct 04 18:19:43.084569 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:43.084569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] Returning 404 to user: Instance 93f79c6d-b0dd-470c-9269-45e3529dec91 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:43.084569 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6a72071-5a46-41a9-b8e4-1a687df43b68 tempest-ServerTagsTestJSON-1080059360 tempest-ServerTagsTestJSON-1080059360-project] 10.222.0.18 "GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91" status: 404 len: 111 microversion: 2.26 time: 0.100176 Oct 04 18:19:43.084569 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2156/4297] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:42 2022] GET /compute/v2.1/servers/93f79c6d-b0dd-470c-9269-45e3529dec91 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:19:43.092556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-45949db2-22c8-430f-8ef6-b09a345dba3f req-b7ad1a6c-be25-4c98-b464-874a8ab544b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c956e93-3292-4f67-859d-9fc45d40384c", "name": "network-vif-plugged", "status": "completed", "tag": "6a9dffe8-522b-45f4-848e-0f85ae9be3d7"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:43.130457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45949db2-22c8-430f-8ef6-b09a345dba3f req-b7ad1a6c-be25-4c98-b464-874a8ab544b5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.130973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45949db2-22c8-430f-8ef6-b09a345dba3f req-b7ad1a6c-be25-4c98-b464-874a8ab544b5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.131716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45949db2-22c8-430f-8ef6-b09a345dba3f req-b7ad1a6c-be25-4c98-b464-874a8ab544b5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.152150 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-45949db2-22c8-430f-8ef6-b09a345dba3f req-b7ad1a6c-be25-4c98-b464-874a8ab544b5 service nova] Creating event network-vif-plugged:6a9dffe8-522b-45f4-848e-0f85ae9be3d7 for instance 7c956e93-3292-4f67-859d-9fc45d40384c on n-h1-850499-14 Oct 04 18:19:43.164506 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-45949db2-22c8-430f-8ef6-b09a345dba3f req-b7ad1a6c-be25-4c98-b464-874a8ab544b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080535 Oct 04 18:19:43.165618 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2157/4298] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:43.371090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:43.371893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:43.379894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.382200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.382826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.385526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.386394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.389094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.554325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ef6b1f32-f410-4a52-8205-aceb6892568d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:43.565052 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ef6b1f32-f410-4a52-8205-aceb6892568d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1512 microversion: 2.1 time: 0.599035 Oct 04 18:19:43.566330 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2142/4299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:42 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:43.590166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05b868ea-b1fb-4173-9e77-bf12bd92111b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:43.591303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-05b868ea-b1fb-4173-9e77-bf12bd92111b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: de379391-e467-452e-93b4-9fbfe268a32c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:43.598530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05b868ea-b1fb-4173-9e77-bf12bd92111b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.599302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05b868ea-b1fb-4173-9e77-bf12bd92111b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.599907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05b868ea-b1fb-4173-9e77-bf12bd92111b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.600772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05b868ea-b1fb-4173-9e77-bf12bd92111b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.601387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05b868ea-b1fb-4173-9e77-bf12bd92111b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.601971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05b868ea-b1fb-4173-9e77-bf12bd92111b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.160273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.172572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.188418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.189995 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b420499-673c-472c-a51c-501463681fe9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1857 microversion: 2.42 time: 0.824639 Oct 04 18:19:44.197016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-05b868ea-b1fb-4173-9e77-bf12bd92111b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.206112 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2158/4300] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:43 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1857 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:19:44.209089 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-05b868ea-b1fb-4173-9e77-bf12bd92111b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c" status: 200 len: 1513 microversion: 2.1 time: 0.624283 Oct 04 18:19:44.213062 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2143/4301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:43 2022] GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c => generated 1513 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:44.217149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-db81fae1-b4a7-4ec2-9f2a-d97b3d23f65e req-880e58e4-f019-4836-a5ee-e239cb1b8337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "tag": "f7e7db67-5361-480e-8e11-3112a56563e8"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:44.229087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22aa9ace-0655-49c7-b4bf-86df61c5d4ee tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:44.229947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-22aa9ace-0655-49c7-b4bf-86df61c5d4ee tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:44.231113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db81fae1-b4a7-4ec2-9f2a-d97b3d23f65e req-880e58e4-f019-4836-a5ee-e239cb1b8337 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.231788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db81fae1-b4a7-4ec2-9f2a-d97b3d23f65e req-880e58e4-f019-4836-a5ee-e239cb1b8337 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.232565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db81fae1-b4a7-4ec2-9f2a-d97b3d23f65e req-880e58e4-f019-4836-a5ee-e239cb1b8337 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.241616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22aa9ace-0655-49c7-b4bf-86df61c5d4ee tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.244388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22aa9ace-0655-49c7-b4bf-86df61c5d4ee tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.247263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22aa9ace-0655-49c7-b4bf-86df61c5d4ee tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.248264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22aa9ace-0655-49c7-b4bf-86df61c5d4ee tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.248924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22aa9ace-0655-49c7-b4bf-86df61c5d4ee tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.251616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22aa9ace-0655-49c7-b4bf-86df61c5d4ee tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.262157 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-db81fae1-b4a7-4ec2-9f2a-d97b3d23f65e req-880e58e4-f019-4836-a5ee-e239cb1b8337 service nova] Creating event network-changed:f7e7db67-5361-480e-8e11-3112a56563e8 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:19:44.272775 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-db81fae1-b4a7-4ec2-9f2a-d97b3d23f65e req-880e58e4-f019-4836-a5ee-e239cb1b8337 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065285 Oct 04 18:19:44.275022 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2159/4302] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:44.286586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:44.297523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.301596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:44.329000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.333065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.333555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.334526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.335318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.335907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.535738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:44.688025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.696071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.697248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.698047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.917030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-22aa9ace-0655-49c7-b4bf-86df61c5d4ee tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.925888 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22aa9ace-0655-49c7-b4bf-86df61c5d4ee tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1324 microversion: 2.1 time: 0.711485 Oct 04 18:19:44.927043 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2144/4303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:44 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1324 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:44.992081 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65cc948c-ac3c-43ac-9203-bfd9b7feb143 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.715655 Oct 04 18:19:44.993444 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2160/4304] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 4 18:19:44 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:45.029273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.038267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.039038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1670668334', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:45.047388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.048076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.048725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.049622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.050239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.050827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.187953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:45.220221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.220968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:45.232115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.233764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.234279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.235017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.235484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.239448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.283028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.289116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.289617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.290085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.567512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.572162 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d5035cb-5c19-4b73-afc3-899e463aaa7b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1670668334" status: 200 len: 1515 microversion: 2.1 time: 0.546458 Oct 04 18:19:45.573936 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2145/4305] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1670668334 => generated 1515 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:45.601025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.602362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.602925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.604324 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f09601b-545c-4d3f-8bc6-1c9192118552 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.389215 Oct 04 18:19:45.605451 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2161/4306] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:45.622485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.639653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:45.645475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.646165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.646770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.647695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.648315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.648904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.853487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:45.954074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-143324ad-5cac-4ea2-ad76-ebf39bca38e0 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.955230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-143324ad-5cac-4ea2-ad76-ebf39bca38e0 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:45.973868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-143324ad-5cac-4ea2-ad76-ebf39bca38e0 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.975219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-143324ad-5cac-4ea2-ad76-ebf39bca38e0 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.976241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-143324ad-5cac-4ea2-ad76-ebf39bca38e0 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.978780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-143324ad-5cac-4ea2-ad76-ebf39bca38e0 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.979516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-143324ad-5cac-4ea2-ad76-ebf39bca38e0 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.983102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-143324ad-5cac-4ea2-ad76-ebf39bca38e0 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.030022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:46.086727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.087372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.087833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.154562 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e25899ee-5f77-4961-82d9-e01aafb9a50b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 1.556201 Oct 04 18:19:47.156677 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2146/4307] 10.222.0.18 () {58 vars in 1173 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:47.164061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:47.166668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:47.184228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.185387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.187018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.192528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.193499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.195859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.225913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-143324ad-5cac-4ea2-ad76-ebf39bca38e0 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.243566 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-143324ad-5cac-4ea2-ad76-ebf39bca38e0 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1520 microversion: 2.1 time: 1.294191 Oct 04 18:19:47.245941 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2162/4308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1520 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:47.252652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-a189acba-4c74-4f3d-9724-ddbf4340228b req-1ec2ddc4-828b-4bfd-98c2-3d58e6d8a866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "tag": "62491f8c-a00d-4911-9961-75eeaa040635"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:47.271469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a189acba-4c74-4f3d-9724-ddbf4340228b req-1ec2ddc4-828b-4bfd-98c2-3d58e6d8a866 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.272337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a189acba-4c74-4f3d-9724-ddbf4340228b req-1ec2ddc4-828b-4bfd-98c2-3d58e6d8a866 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.272985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a189acba-4c74-4f3d-9724-ddbf4340228b req-1ec2ddc4-828b-4bfd-98c2-3d58e6d8a866 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.324030 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-a189acba-4c74-4f3d-9724-ddbf4340228b req-1ec2ddc4-828b-4bfd-98c2-3d58e6d8a866 service nova] Creating event network-changed:62491f8c-a00d-4911-9961-75eeaa040635 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:19:47.341657 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-a189acba-4c74-4f3d-9724-ddbf4340228b req-1ec2ddc4-828b-4bfd-98c2-3d58e6d8a866 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093535 Oct 04 18:19:47.346306 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2163/4309] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:47.353122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:47.358528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.359380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.servers [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Removing options 'limit' from query {{(pid=122331) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:19:47.361007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:47.375655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.378913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.379624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.388387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.389129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.389705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.474589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.506429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.507088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.510372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.825589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.843945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.845621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.850981 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.691841 Oct 04 18:19:47.854978 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2147/4310] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:47 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:47.856382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:47.857620 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5071facc-4845-4a45-b591-898e109c990e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001443 Oct 04 18:19:47.867576 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2148/4311] 10.222.0.18 () {56 vars in 886 bytes} [Tue Oct 4 18:19:47 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:19:47.873124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4b717e07-973a-4457-95b0-7cb9c5565569 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-688980466", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4b717e07-973a-4457-95b0-7cb9c5565569 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Request method failure captured: Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 242 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHktzMoCIayG0jofh-T2YUJ-yS_VS0baaH7lMZBG7YREEUBf4rHQJQTDHIv1kq63TUbUpIth5Z-_2R8k_PU4_btr1brWhF71zW3uEdeCHWcbytlisea5M4qmaDtcYzFcxzEvwuY-MPToXN8aVrhNn4g3hejtp4zesnCLlQ6wS8As_M8 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}] Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b5597ea7bffb4bf4b76f167c646f8cb6 Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-688980466", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-688980466', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'de3142d7-cca8-4426-a97f-639f5813dc84'}]}}} Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:47.881441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:47.885584 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.888499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4b717e07-973a-4457-95b0-7cb9c5565569 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:47.889609 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4b717e07-973a-4457-95b0-7cb9c5565569 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.020823 Oct 04 18:19:47.890867 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2149/4312] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:47 2022] POST /compute/v2.1/servers => generated 175 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:47.914048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0be44741-31cf-4641-b62c-79bb6b1c6b0c tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:47.914847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0be44741-31cf-4641-b62c-79bb6b1c6b0c tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: e31b3625-f01e-429d-b0b5-66a7ee07917e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:47.923999 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-0be44741-31cf-4641-b62c-79bb6b1c6b0c tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] HTTP exception thrown: Instance e31b3625-f01e-429d-b0b5-66a7ee07917e could not be found. Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0be44741-31cf-4641-b62c-79bb6b1c6b0c tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Request method failure captured: Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/e31b3625-f01e-429d-b0b5-66a7ee07917e/metadata HTTP/1.1 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHktzMoCIayG0jofh-T2YUJ-yS_VS0baaH7lMZBG7YREEUBf4rHQJQTDHIv1kq63TUbUpIth5Z-_2R8k_PU4_btr1brWhF71zW3uEdeCHWcbytlisea5M4qmaDtcYzFcxzEvwuY-MPToXN8aVrhNn4g3hejtp4zesnCLlQ6wS8As_M8 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}] Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b5597ea7bffb4bf4b76f167c646f8cb6 Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance e31b3625-f01e-429d-b0b5-66a7ee07917e could not be found. Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'server_id': 'e31b3625-f01e-429d-b0b5-66a7ee07917e'} Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31b3625-f01e-429d-b0b5-66a7ee07917e could not be found. Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31b3625-f01e-429d-b0b5-66a7ee07917e could not be found. Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:47.944891 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:47.948322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:47.948322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:47.948322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31b3625-f01e-429d-b0b5-66a7ee07917e could not be found. Oct 04 18:19:47.948322 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:47.950195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0be44741-31cf-4641-b62c-79bb6b1c6b0c tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Returning 404 to user: Instance e31b3625-f01e-429d-b0b5-66a7ee07917e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:47.951114 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0be44741-31cf-4641-b62c-79bb6b1c6b0c tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/e31b3625-f01e-429d-b0b5-66a7ee07917e/metadata" status: 404 len: 111 microversion: 2.1 time: 0.042694 Oct 04 18:19:47.955204 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2150/4313] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:19:47 2022] GET /compute/v2.1/servers/e31b3625-f01e-429d-b0b5-66a7ee07917e/metadata => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:19:47.971713 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75f9b33e-2736-4027-89f6-16cdeb78cf25 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.622780 Oct 04 18:19:47.973249 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2164/4314] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:19:47 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:48.005370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.010626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:48.013248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:48.022788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.025282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.027241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.028861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.029598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.031843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.102674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:48.167858 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-13c27450-66a1-44e3-9cca-ca5bb743f540 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.166542 Oct 04 18:19:48.184337 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2151/4315] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:48.184462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.195826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:48.195826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.servers [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Removing options 'limit' from query {{(pid=122331) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:19:48.199120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:48.224514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.226793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.227393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.234414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.239082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.239739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.335771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:48.339609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74613302-755f-4bec-8fe4-3d96afa15f53 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1268152822", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74613302-755f-4bec-8fe4-3d96afa15f53 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Request method failure captured: Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 499 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHktzMoCIayG0jofh-T2YUJ-yS_VS0baaH7lMZBG7YREEUBf4rHQJQTDHIv1kq63TUbUpIth5Z-_2R8k_PU4_btr1brWhF71zW3uEdeCHWcbytlisea5M4qmaDtcYzFcxzEvwuY-MPToXN8aVrhNn4g3hejtp4zesnCLlQ6wS8As_M8 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}] Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b5597ea7bffb4bf4b76f167c646f8cb6 Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1268152822", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1268152822', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'de3142d7-cca8-4426-a97f-639f5813dc84'}]}}} Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:19:48.345074 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.347498 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.349179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74613302-755f-4bec-8fe4-3d96afa15f53 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:48.349254 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74613302-755f-4bec-8fe4-3d96afa15f53 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.013893 Oct 04 18:19:48.350547 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2152/4316] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:48 2022] POST /compute/v2.1/servers => generated 687 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:48.465870 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-76e42c2b-c1ae-4477-a76c-285bf6dfbd0b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.285764 Oct 04 18:19:48.467596 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2165/4317] 10.222.0.18 () {58 vars in 1150 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:48.486979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.492278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:48.493158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:48.510654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.511352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.511975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.512875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.513492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.514081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.572952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:48.580382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36e99144-d7f8-4fc5-89d2-f812cec53693 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1300605804", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36e99144-d7f8-4fc5-89d2-f812cec53693 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Request method failure captured: Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 500 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHktzMoCIayG0jofh-T2YUJ-yS_VS0baaH7lMZBG7YREEUBf4rHQJQTDHIv1kq63TUbUpIth5Z-_2R8k_PU4_btr1brWhF71zW3uEdeCHWcbytlisea5M4qmaDtcYzFcxzEvwuY-MPToXN8aVrhNn4g3hejtp4zesnCLlQ6wS8As_M8 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}] Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b5597ea7bffb4bf4b76f167c646f8cb6 Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1300605804", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1300605804', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'de3142d7-cca8-4426-a97f-639f5813dc84'}]}}} Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:19:48.586946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.589634 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.595853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36e99144-d7f8-4fc5-89d2-f812cec53693 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:48.599274 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-36e99144-d7f8-4fc5-89d2-f812cec53693 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.024445 Oct 04 18:19:48.600077 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2166/4318] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:48 2022] POST /compute/v2.1/servers => generated 689 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:48.617153 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-79819fb2-777a-4e3f-bfe0-8621a519fe32 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.136822 Oct 04 18:19:48.635170 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2153/4319] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/servers => generated 1012 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:48.641116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.649012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:48.649763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:48.672672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca3838aa-2e3a-4275-b761-4c147935162e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-63023138", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca3838aa-2e3a-4275-b761-4c147935162e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Request method failure captured: Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 752 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHktzMoCIayG0jofh-T2YUJ-yS_VS0baaH7lMZBG7YREEUBf4rHQJQTDHIv1kq63TUbUpIth5Z-_2R8k_PU4_btr1brWhF71zW3uEdeCHWcbytlisea5M4qmaDtcYzFcxzEvwuY-MPToXN8aVrhNn4g3hejtp4zesnCLlQ6wS8As_M8 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}] Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b5597ea7bffb4bf4b76f167c646f8cb6 Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-63023138", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-63023138', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'de3142d7-cca8-4426-a97f-639f5813dc84'}]}}} Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:19:48.680346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:19:48.682631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:19:48.684558 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.684558 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.687677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca3838aa-2e3a-4275-b761-4c147935162e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:48.688933 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ca3838aa-2e3a-4275-b761-4c147935162e tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.026645 Oct 04 18:19:48.690065 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2154/4320] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:48 2022] POST /compute/v2.1/servers => generated 1197 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 04 18:19:48.690188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.690655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.693061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.693884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.694351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.694782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.767048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-babed4c1-b9fc-449b-b734-7eab0db068fd tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1067695628", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-babed4c1-b9fc-449b-b734-7eab0db068fd tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Request method failure captured: Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 1266 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHktzMoCIayG0jofh-T2YUJ-yS_VS0baaH7lMZBG7YREEUBf4rHQJQTDHIv1kq63TUbUpIth5Z-_2R8k_PU4_btr1brWhF71zW3uEdeCHWcbytlisea5M4qmaDtcYzFcxzEvwuY-MPToXN8aVrhNn4g3hejtp4zesnCLlQ6wS8As_M8 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}] Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b5597ea7bffb4bf4b76f167c646f8cb6 Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1067695628", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "de3142d7-cca8-4426-a97f-639f5813dc84"}]}} Oct 04 18:19:48.772355 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1067695628', 'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'de3142d7-cca8-4426-a97f-639f5813dc84'}]}}} Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.774165 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:19:48.775366 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:19:48.776908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:19:48.776908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.786726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-babed4c1-b9fc-449b-b734-7eab0db068fd tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:48.787821 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-babed4c1-b9fc-449b-b734-7eab0db068fd tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.025215 Oct 04 18:19:48.788883 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2155/4321] 10.222.0.18 () {60 vars in 1148 bytes} [Tue Oct 4 18:19:48 2022] POST /compute/v2.1/servers => generated 2221 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 04 18:19:48.801703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22e966d1-8c4f-4414-b399-4cdae41f2f6b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.802293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-22e966d1-8c4f-4414-b399-4cdae41f2f6b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 1b2870b6-b7de-40a6-a24b-85bc80fd0e85] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:48.809571 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-22e966d1-8c4f-4414-b399-4cdae41f2f6b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] HTTP exception thrown: Instance 1b2870b6-b7de-40a6-a24b-85bc80fd0e85 could not be found. Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22e966d1-8c4f-4414-b399-4cdae41f2f6b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Request method failure captured: Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/1b2870b6-b7de-40a6-a24b-85bc80fd0e85/metadata/test2 HTTP/1.1 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHktzMoCIayG0jofh-T2YUJ-yS_VS0baaH7lMZBG7YREEUBf4rHQJQTDHIv1kq63TUbUpIth5Z-_2R8k_PU4_btr1brWhF71zW3uEdeCHWcbytlisea5M4qmaDtcYzFcxzEvwuY-MPToXN8aVrhNn4g3hejtp4zesnCLlQ6wS8As_M8 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}] Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b5597ea7bffb4bf4b76f167c646f8cb6 Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 1b2870b6-b7de-40a6-a24b-85bc80fd0e85 could not be found. Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'server_id': '1b2870b6-b7de-40a6-a24b-85bc80fd0e85', 'id': 'test2'} Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2870b6-b7de-40a6-a24b-85bc80fd0e85 could not be found. Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2870b6-b7de-40a6-a24b-85bc80fd0e85 could not be found. Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:48.819507 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:48.825597 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:48.825597 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:48.825597 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2870b6-b7de-40a6-a24b-85bc80fd0e85 could not be found. Oct 04 18:19:48.825597 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:19:48.825597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22e966d1-8c4f-4414-b399-4cdae41f2f6b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Returning 404 to user: Instance 1b2870b6-b7de-40a6-a24b-85bc80fd0e85 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:48.825597 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22e966d1-8c4f-4414-b399-4cdae41f2f6b tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/1b2870b6-b7de-40a6-a24b-85bc80fd0e85/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024471 Oct 04 18:19:48.825597 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2156/4322] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/servers/1b2870b6-b7de-40a6-a24b-85bc80fd0e85/metadata/test2 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:19:48.846997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-76539b00-3000-440b-a611-d40d06cb4b59 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.847921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-76539b00-3000-440b-a611-d40d06cb4b59 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:48.854093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:48.864760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76539b00-3000-440b-a611-d40d06cb4b59 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.866052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76539b00-3000-440b-a611-d40d06cb4b59 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.885815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76539b00-3000-440b-a611-d40d06cb4b59 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.896967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76539b00-3000-440b-a611-d40d06cb4b59 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.907401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76539b00-3000-440b-a611-d40d06cb4b59 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.909760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76539b00-3000-440b-a611-d40d06cb4b59 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.965119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-76539b00-3000-440b-a611-d40d06cb4b59 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:19:49.030016 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a019e82c-6198-4524-a7e6-1795fc3f0695 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.393750 Oct 04 18:19:49.039455 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2167/4323] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:49.056914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.058662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:49.076980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.078649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.079556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.081438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.083281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.084118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.091869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:49.162488 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-76539b00-3000-440b-a611-d40d06cb4b59 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 204 len: 0 microversion: 2.1 time: 0.318957 Oct 04 18:19:49.163946 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2157/4324] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:19:48 2022] DELETE /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:19:49.182895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.189058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:49.191348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.compute.servers [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Removing options 'limit' from query {{(pid=122332) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:19:49.192524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:49.205850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.211642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.217659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.218733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.222305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.223295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.266731 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e9c80fde-b3a4-46f3-a4bc-f38ebe3b104c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.101156 Oct 04 18:19:49.268576 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2158/4325] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:49.278595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e7907c78-0e39-4cbd-bf16-8f9e9b5365b6 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.282818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e7907c78-0e39-4cbd-bf16-8f9e9b5365b6 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:49.290837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7907c78-0e39-4cbd-bf16-8f9e9b5365b6 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.291686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7907c78-0e39-4cbd-bf16-8f9e9b5365b6 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.292351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7907c78-0e39-4cbd-bf16-8f9e9b5365b6 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.293326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7907c78-0e39-4cbd-bf16-8f9e9b5365b6 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.294009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7907c78-0e39-4cbd-bf16-8f9e9b5365b6 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.294702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7907c78-0e39-4cbd-bf16-8f9e9b5365b6 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.518712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:49.534164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:49.536132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:49.540675 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-324189c4-8219-42fb-9302-1529f492255e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.499088 Oct 04 18:19:49.543438 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2168/4326] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:49.561307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.567981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:49.568907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1670668334', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:49.589843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.590561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.591199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.594773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.595437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.596067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.774648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e7907c78-0e39-4cbd-bf16-8f9e9b5365b6 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:49.790592 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e7907c78-0e39-4cbd-bf16-8f9e9b5365b6 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1526 microversion: 2.1 time: 0.520685 Oct 04 18:19:49.795243 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2159/4327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1526 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:49.803350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-288dd15e-4db6-4463-a9e3-b2edf60e305e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:49.808966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:49.818471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-288dd15e-4db6-4463-a9e3-b2edf60e305e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.819246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-288dd15e-4db6-4463-a9e3-b2edf60e305e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.819878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-288dd15e-4db6-4463-a9e3-b2edf60e305e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.887450 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b268f31-7da4-4169-acc0-09c69fc842f2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1670668334" status: 200 len: 346 microversion: 2.1 time: 0.342801 Oct 04 18:19:49.891426 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2169/4328] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1670668334 => generated 346 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:49.893875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-288dd15e-4db6-4463-a9e3-b2edf60e305e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Going to try to stop instance {{(pid=122332) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:19:49.906785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-59a99398-cc1d-4faf-9d14-1ee344f14c02 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:49.914022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59a99398-cc1d-4faf-9d14-1ee344f14c02 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.915379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59a99398-cc1d-4faf-9d14-1ee344f14c02 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.916638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59a99398-cc1d-4faf-9d14-1ee344f14c02 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.945051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-59a99398-cc1d-4faf-9d14-1ee344f14c02 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Going to try to stop instance {{(pid=122331) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:19:49.991211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:50.031307 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-59a99398-cc1d-4faf-9d14-1ee344f14c02 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "POST /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a/action" status: 202 len: 0 microversion: 2.1 time: 0.129057 Oct 04 18:19:50.035938 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2170/4329] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:19:49 2022] POST /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:19:50.046009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db4d28ee-9d49-4bf3-b619-646d4826500b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:50.050605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-db4d28ee-9d49-4bf3-b619-646d4826500b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:50.051510 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-288dd15e-4db6-4463-a9e3-b2edf60e305e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/action" status: 202 len: 0 microversion: 2.1 time: 0.252629 Oct 04 18:19:50.056269 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2160/4330] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:19:49 2022] POST /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:19:50.063316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db4d28ee-9d49-4bf3-b619-646d4826500b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.063828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db4d28ee-9d49-4bf3-b619-646d4826500b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.064281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db4d28ee-9d49-4bf3-b619-646d4826500b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.064993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db4d28ee-9d49-4bf3-b619-646d4826500b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.065660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db4d28ee-9d49-4bf3-b619-646d4826500b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.066251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db4d28ee-9d49-4bf3-b619-646d4826500b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.075791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2282bf93-7249-43f7-8563-717fe9ad7683 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:50.076624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2282bf93-7249-43f7-8563-717fe9ad7683 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:50.089342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2282bf93-7249-43f7-8563-717fe9ad7683 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.091868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2282bf93-7249-43f7-8563-717fe9ad7683 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.092351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2282bf93-7249-43f7-8563-717fe9ad7683 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.095474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2282bf93-7249-43f7-8563-717fe9ad7683 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.095987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2282bf93-7249-43f7-8563-717fe9ad7683 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.099261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2282bf93-7249-43f7-8563-717fe9ad7683 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.379961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2282bf93-7249-43f7-8563-717fe9ad7683 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:50.388534 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2282bf93-7249-43f7-8563-717fe9ad7683 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1677 microversion: 2.1 time: 0.328377 Oct 04 18:19:50.389123 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2161/4331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:50 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1677 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:50.420338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-db4d28ee-9d49-4bf3-b619-646d4826500b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:50.432182 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-db4d28ee-9d49-4bf3-b619-646d4826500b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1522 microversion: 2.1 time: 0.394249 Oct 04 18:19:50.432781 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2171/4332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:50 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:50.554460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-90850311-21a0-40a3-b6ee-b82efe94dfab req-98e6c93f-c59b-4dd1-83ae-36c412912b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "tag": "7f14d244-6f3e-47f6-9928-5704c2b06130"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:50.572186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:50.573403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:50.587352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.588735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.589139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-90850311-21a0-40a3-b6ee-b82efe94dfab req-98e6c93f-c59b-4dd1-83ae-36c412912b47 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.589816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-90850311-21a0-40a3-b6ee-b82efe94dfab req-98e6c93f-c59b-4dd1-83ae-36c412912b47 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.590420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.591047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-90850311-21a0-40a3-b6ee-b82efe94dfab req-98e6c93f-c59b-4dd1-83ae-36c412912b47 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.591955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.595784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.596480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.618529 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-90850311-21a0-40a3-b6ee-b82efe94dfab req-98e6c93f-c59b-4dd1-83ae-36c412912b47 service nova] Creating event network-changed:7f14d244-6f3e-47f6-9928-5704c2b06130 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:19:50.629254 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-90850311-21a0-40a3-b6ee-b82efe94dfab req-98e6c93f-c59b-4dd1-83ae-36c412912b47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079777 Oct 04 18:19:50.632598 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2162/4333] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:50.848879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f115c138-96b9-4563-8ff4-6d880332ba5d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:50.849705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f115c138-96b9-4563-8ff4-6d880332ba5d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:50.862068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f115c138-96b9-4563-8ff4-6d880332ba5d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.862570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f115c138-96b9-4563-8ff4-6d880332ba5d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.864132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f115c138-96b9-4563-8ff4-6d880332ba5d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.865844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f115c138-96b9-4563-8ff4-6d880332ba5d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.867704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f115c138-96b9-4563-8ff4-6d880332ba5d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.868891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f115c138-96b9-4563-8ff4-6d880332ba5d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.032264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:51.046983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:51.049113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:51.052151 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3d4bfd4d-4059-4227-a3ce-4c14185b0cb3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.484395 Oct 04 18:19:51.056106 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2172/4334] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:50 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:51.254515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f115c138-96b9-4563-8ff4-6d880332ba5d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:51.265969 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f115c138-96b9-4563-8ff4-6d880332ba5d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1526 microversion: 2.1 time: 0.423401 Oct 04 18:19:51.267728 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2163/4335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:50 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1526 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:51.415113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5664620a-42a3-48ce-a48a-5d7341733f9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:51.416215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5664620a-42a3-48ce-a48a-5d7341733f9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:51.427445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5664620a-42a3-48ce-a48a-5d7341733f9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.427941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5664620a-42a3-48ce-a48a-5d7341733f9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.428625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5664620a-42a3-48ce-a48a-5d7341733f9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.429359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5664620a-42a3-48ce-a48a-5d7341733f9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.429834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5664620a-42a3-48ce-a48a-5d7341733f9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.430270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5664620a-42a3-48ce-a48a-5d7341733f9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.460557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-826679cf-13a0-45f1-974c-ba0435b1e3da tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:51.461184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-826679cf-13a0-45f1-974c-ba0435b1e3da tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:51.466972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:51.470081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-826679cf-13a0-45f1-974c-ba0435b1e3da tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.470731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-826679cf-13a0-45f1-974c-ba0435b1e3da tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.479023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-826679cf-13a0-45f1-974c-ba0435b1e3da tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.480049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-826679cf-13a0-45f1-974c-ba0435b1e3da tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.480547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-826679cf-13a0-45f1-974c-ba0435b1e3da tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.480999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-826679cf-13a0-45f1-974c-ba0435b1e3da tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.217006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-826679cf-13a0-45f1-974c-ba0435b1e3da tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.231746 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-826679cf-13a0-45f1-974c-ba0435b1e3da tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1522 microversion: 2.1 time: 0.774990 Oct 04 18:19:52.232944 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2164/4336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:51 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1522 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:52.243471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5664620a-42a3-48ce-a48a-5d7341733f9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.257847 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5664620a-42a3-48ce-a48a-5d7341733f9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1677 microversion: 2.1 time: 0.846430 Oct 04 18:19:52.258402 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2173/4337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:51 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1677 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:52.260621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:52.271846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:52.278214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.278720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.279195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.281313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.281802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.282240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.292150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d593f4b-f919-4350-b22a-c696ca0c669d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:52.292783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d593f4b-f919-4350-b22a-c696ca0c669d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:52.295930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:52.303551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d593f4b-f919-4350-b22a-c696ca0c669d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.304063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d593f4b-f919-4350-b22a-c696ca0c669d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.304511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d593f4b-f919-4350-b22a-c696ca0c669d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.305233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d593f4b-f919-4350-b22a-c696ca0c669d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.305705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d593f4b-f919-4350-b22a-c696ca0c669d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.306140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d593f4b-f919-4350-b22a-c696ca0c669d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.600777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d593f4b-f919-4350-b22a-c696ca0c669d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5597ea7bffb4bf4b76f167c646f8cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525708a3ed7d4de1adc1981ea52f0279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.613923 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d593f4b-f919-4350-b22a-c696ca0c669d tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 200 len: 1484 microversion: 2.1 time: 0.326075 Oct 04 18:19:52.615278 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2174/4338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:52 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 1484 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:52.800307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b685e90c-7d00-4966-9b9c-4b1002007a87 req-f5452ee5-9a2e-4a43-a556-4f5d83747c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c956e93-3292-4f67-859d-9fc45d40384c", "name": "network-vif-deleted", "tag": "6a9dffe8-522b-45f4-848e-0f85ae9be3d7"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:52.819004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b685e90c-7d00-4966-9b9c-4b1002007a87 req-f5452ee5-9a2e-4a43-a556-4f5d83747c3c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.819515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b685e90c-7d00-4966-9b9c-4b1002007a87 req-f5452ee5-9a2e-4a43-a556-4f5d83747c3c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.819956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b685e90c-7d00-4966-9b9c-4b1002007a87 req-f5452ee5-9a2e-4a43-a556-4f5d83747c3c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.843002 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b685e90c-7d00-4966-9b9c-4b1002007a87 req-f5452ee5-9a2e-4a43-a556-4f5d83747c3c service nova] Creating event network-vif-deleted:6a9dffe8-522b-45f4-848e-0f85ae9be3d7 for instance 7c956e93-3292-4f67-859d-9fc45d40384c on n-h1-850499-14 Oct 04 18:19:52.852790 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b685e90c-7d00-4966-9b9c-4b1002007a87 req-f5452ee5-9a2e-4a43-a556-4f5d83747c3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057255 Oct 04 18:19:52.856910 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2175/4339] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:52.882639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.902057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.903890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.905295 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a0fa3fd9-afa1-43d2-b720-1d5df20d6109 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.671122 Oct 04 18:19:52.906626 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2165/4340] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:52 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:53.265383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fe3dfd14-b4e0-4d6e-911f-025a73e694aa tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:53.266340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fe3dfd14-b4e0-4d6e-911f-025a73e694aa tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:53.279093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe3dfd14-b4e0-4d6e-911f-025a73e694aa tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.281999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe3dfd14-b4e0-4d6e-911f-025a73e694aa tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.282580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe3dfd14-b4e0-4d6e-911f-025a73e694aa tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.283446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe3dfd14-b4e0-4d6e-911f-025a73e694aa tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.283593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b3067301-3e52-47de-a613-2fcca7d0c337 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:53.284245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe3dfd14-b4e0-4d6e-911f-025a73e694aa tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.284423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b3067301-3e52-47de-a613-2fcca7d0c337 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:53.286081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe3dfd14-b4e0-4d6e-911f-025a73e694aa tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.297516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3067301-3e52-47de-a613-2fcca7d0c337 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.298819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3067301-3e52-47de-a613-2fcca7d0c337 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.299315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3067301-3e52-47de-a613-2fcca7d0c337 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.300054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3067301-3e52-47de-a613-2fcca7d0c337 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.300523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3067301-3e52-47de-a613-2fcca7d0c337 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.300964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3067301-3e52-47de-a613-2fcca7d0c337 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.934054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fe3dfd14-b4e0-4d6e-911f-025a73e694aa tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:53.946052 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fe3dfd14-b4e0-4d6e-911f-025a73e694aa tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1522 microversion: 2.1 time: 0.684444 Oct 04 18:19:53.947264 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2176/4341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:53 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1522 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:53.964969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:53.973431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] [instance: 7c956e93-3292-4f67-859d-9fc45d40384c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:53.992444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.993152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.996020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.998826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.999586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.003160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.049386 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] HTTP exception thrown: Instance 7c956e93-3292-4f67-859d-9fc45d40384c could not be found. Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Request method failure captured: Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c HTTP/1.1 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHktzMoCIayG0jofh-T2YUJ-yS_VS0baaH7lMZBG7YREEUBf4rHQJQTDHIv1kq63TUbUpIth5Z-_2R8k_PU4_btr1brWhF71zW3uEdeCHWcbytlisea5M4qmaDtcYzFcxzEvwuY-MPToXN8aVrhNn4g3hejtp4zesnCLlQ6wS8As_M8 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/525708a3ed7d4de1adc1981ea52f0279"}]}] Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 525708a3ed7d4de1adc1981ea52f0279 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1364003502 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b5597ea7bffb4bf4b76f167c646f8cb6 Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1364003502-project Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 7c956e93-3292-4f67-859d-9fc45d40384c could not be found. Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '7c956e93-3292-4f67-859d-9fc45d40384c'} Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c956e93-3292-4f67-859d-9fc45d40384c could not be found. Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c956e93-3292-4f67-859d-9fc45d40384c could not be found. Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:54.051831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c956e93-3292-4f67-859d-9fc45d40384c could not be found. Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] Returning 404 to user: Instance 7c956e93-3292-4f67-859d-9fc45d40384c could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d47ba685-7b4d-482c-9fe3-bce96d4dec19 tempest-ServerMetadataNegativeTestJSON-1364003502 tempest-ServerMetadataNegativeTestJSON-1364003502-project] 10.222.0.18 "GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c" status: 404 len: 111 microversion: 2.1 time: 0.104770 Oct 04 18:19:54.055135 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2177/4342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:53 2022] GET /compute/v2.1/servers/7c956e93-3292-4f67-859d-9fc45d40384c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:54.067865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b3067301-3e52-47de-a613-2fcca7d0c337 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.081330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-1abddeb8-7276-4dec-aefb-234e0601e933 req-ce2ac9b6-fbf5-4a94-a17b-8d7272b5037e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "tag": "f48712ec-9677-458b-99fe-85da96339737"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:54.083998 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b3067301-3e52-47de-a613-2fcca7d0c337 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1677 microversion: 2.1 time: 0.806234 Oct 04 18:19:54.085740 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2166/4343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:53 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1677 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:54.102554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:54.105352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:54.107929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1abddeb8-7276-4dec-aefb-234e0601e933 req-ce2ac9b6-fbf5-4a94-a17b-8d7272b5037e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.108420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1abddeb8-7276-4dec-aefb-234e0601e933 req-ce2ac9b6-fbf5-4a94-a17b-8d7272b5037e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.108856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1abddeb8-7276-4dec-aefb-234e0601e933 req-ce2ac9b6-fbf5-4a94-a17b-8d7272b5037e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.121722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.123633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.124095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.127880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.130010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.130421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.139681 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1abddeb8-7276-4dec-aefb-234e0601e933 req-ce2ac9b6-fbf5-4a94-a17b-8d7272b5037e service nova] Creating event network-changed:f48712ec-9677-458b-99fe-85da96339737 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:19:54.145950 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-1abddeb8-7276-4dec-aefb-234e0601e933 req-ce2ac9b6-fbf5-4a94-a17b-8d7272b5037e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085832 Oct 04 18:19:54.147480 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2178/4344] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:54.597297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.608637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.611034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.613240 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-73d02a08-61b0-4111-bbe9-2cf6496fa3ca tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.525571 Oct 04 18:19:54.628578 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2167/4345] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:54 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:54.972272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7cd4b158-633e-49e8-aef0-8543f3f96bca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:54.973965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7cd4b158-633e-49e8-aef0-8543f3f96bca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:54.987228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd4b158-633e-49e8-aef0-8543f3f96bca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.987737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd4b158-633e-49e8-aef0-8543f3f96bca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.988191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd4b158-633e-49e8-aef0-8543f3f96bca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.988956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd4b158-633e-49e8-aef0-8543f3f96bca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.993447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd4b158-633e-49e8-aef0-8543f3f96bca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.994301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7cd4b158-633e-49e8-aef0-8543f3f96bca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.036391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-856da837-8a5a-4a78-983e-a29c49ee0d84 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Action: 'create', calling method: .version_select at 0x7fd4d12eb8b0>, body: {"keypair": {"name": "tempest-keypair-1377735783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv+8cEkeRgWJJNibckLR4KlMeCrmkd/C/MxmwgY63Iz5LpfYryqM6QLvd0fyuNmxRSGHeDlOD7tN9NIpdKDQqzI0tH6zE/Tu3cVTMEhDMljeDmyuXZcqds9yF2sVXC3xA=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:55.092050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-856da837-8a5a-4a78-983e-a29c49ee0d84 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Getting quotas for project c3070f4f718546118ef9e4b0d46ba556. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:55.108967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-856da837-8a5a-4a78-983e-a29c49ee0d84 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Getting quotas for user cc0ba4cac1a34c09b91e0e9607a4ae34 and project c3070f4f718546118ef9e4b0d46ba556. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:55.143590 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-856da837-8a5a-4a78-983e-a29c49ee0d84 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.272449 Oct 04 18:19:55.144485 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2179/4346] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:19:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:55.150343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-525c9bc2-2bb6-4832-91cf-6c93078200e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:55.152156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-525c9bc2-2bb6-4832-91cf-6c93078200e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:55.165376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-525c9bc2-2bb6-4832-91cf-6c93078200e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.165966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-525c9bc2-2bb6-4832-91cf-6c93078200e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.166428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-525c9bc2-2bb6-4832-91cf-6c93078200e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.167193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-525c9bc2-2bb6-4832-91cf-6c93078200e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.167664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-525c9bc2-2bb6-4832-91cf-6c93078200e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.168102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-525c9bc2-2bb6-4832-91cf-6c93078200e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.636723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7cd4b158-633e-49e8-aef0-8543f3f96bca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:55.666287 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7cd4b158-633e-49e8-aef0-8543f3f96bca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1522 microversion: 2.1 time: 0.697747 Oct 04 18:19:55.667811 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2168/4347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:54 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1522 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:55.693427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:55.695698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:55.704948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.705726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.706352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.707583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.708322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.709028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.012027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:56.158065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-525c9bc2-2bb6-4832-91cf-6c93078200e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:56.170922 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-525c9bc2-2bb6-4832-91cf-6c93078200e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1677 microversion: 2.1 time: 1.024913 Oct 04 18:19:56.173075 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2180/4348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:55 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1677 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:56.638276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7ee00bc6-ca4a-49cd-9292-f019c43c3401 req-2c15da80-e41c-4240-8af1-005e720503e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "tag": "623d7b7a-45a9-4025-95d1-5ef6a6f8d75f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:56.657198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ee00bc6-ca4a-49cd-9292-f019c43c3401 req-2c15da80-e41c-4240-8af1-005e720503e9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.657685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ee00bc6-ca4a-49cd-9292-f019c43c3401 req-2c15da80-e41c-4240-8af1-005e720503e9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.658926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ee00bc6-ca4a-49cd-9292-f019c43c3401 req-2c15da80-e41c-4240-8af1-005e720503e9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.678174 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7ee00bc6-ca4a-49cd-9292-f019c43c3401 req-2c15da80-e41c-4240-8af1-005e720503e9 service nova] Creating event network-changed:623d7b7a-45a9-4025-95d1-5ef6a6f8d75f for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:19:56.681238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:56.683750 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7ee00bc6-ca4a-49cd-9292-f019c43c3401 req-2c15da80-e41c-4240-8af1-005e720503e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049355 Oct 04 18:19:56.684979 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2181/4349] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:56.710158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75db49f5-f09e-485e-bad8-97970402f27e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:56.710755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:56.712615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:56.713937 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e74ac563-c9de-41ba-b686-cd91d57bcdbb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 1.043994 Oct 04 18:19:56.714794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75db49f5-f09e-485e-bad8-97970402f27e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:56.718609 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2169/4350] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:55 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:56.722334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75db49f5-f09e-485e-bad8-97970402f27e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.722988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75db49f5-f09e-485e-bad8-97970402f27e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.723546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75db49f5-f09e-485e-bad8-97970402f27e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.724360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75db49f5-f09e-485e-bad8-97970402f27e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.724924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75db49f5-f09e-485e-bad8-97970402f27e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.725442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75db49f5-f09e-485e-bad8-97970402f27e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.197169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d84ea274-1692-44d4-a36d-e55838b5eb86 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:57.198666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d84ea274-1692-44d4-a36d-e55838b5eb86 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:57.213041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84ea274-1692-44d4-a36d-e55838b5eb86 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.214255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84ea274-1692-44d4-a36d-e55838b5eb86 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.214993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84ea274-1692-44d4-a36d-e55838b5eb86 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.216634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84ea274-1692-44d4-a36d-e55838b5eb86 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.217521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84ea274-1692-44d4-a36d-e55838b5eb86 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.220016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d84ea274-1692-44d4-a36d-e55838b5eb86 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.246064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75db49f5-f09e-485e-bad8-97970402f27e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:57.259359 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75db49f5-f09e-485e-bad8-97970402f27e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1522 microversion: 2.1 time: 0.568406 Oct 04 18:19:57.262141 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2182/4351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:56 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:57.667826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d84ea274-1692-44d4-a36d-e55838b5eb86 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:57.681116 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d84ea274-1692-44d4-a36d-e55838b5eb86 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1677 microversion: 2.1 time: 0.487875 Oct 04 18:19:57.683374 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2170/4352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:57 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1677 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:57.746576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:57.747259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:57.770051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.770898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.771490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.772489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.772972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.773420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.287183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c3c7d1fc-fb47-426b-b78b-d91eb7005cc8 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:58.287821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c3c7d1fc-fb47-426b-b78b-d91eb7005cc8 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:58.294427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3c7d1fc-fb47-426b-b78b-d91eb7005cc8 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.295234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3c7d1fc-fb47-426b-b78b-d91eb7005cc8 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.295860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3c7d1fc-fb47-426b-b78b-d91eb7005cc8 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.297422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3c7d1fc-fb47-426b-b78b-d91eb7005cc8 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.298040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3c7d1fc-fb47-426b-b78b-d91eb7005cc8 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.298628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3c7d1fc-fb47-426b-b78b-d91eb7005cc8 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.642120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.657908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.662651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.667882 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5c8cf0f6-cbc1-4da1-92a1-32e5d937bc9a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.926726 Oct 04 18:19:58.668685 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2183/4353] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:57 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:58.713027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee345d2e-54c7-49b3-abde-8a04a77b737e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:58.714036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ee345d2e-54c7-49b3-abde-8a04a77b737e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:58.721419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee345d2e-54c7-49b3-abde-8a04a77b737e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.722109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee345d2e-54c7-49b3-abde-8a04a77b737e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.722654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee345d2e-54c7-49b3-abde-8a04a77b737e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.723560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee345d2e-54c7-49b3-abde-8a04a77b737e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.724255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee345d2e-54c7-49b3-abde-8a04a77b737e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.724797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee345d2e-54c7-49b3-abde-8a04a77b737e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.785964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c3c7d1fc-fb47-426b-b78b-d91eb7005cc8 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.804777 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c3c7d1fc-fb47-426b-b78b-d91eb7005cc8 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1522 microversion: 2.1 time: 0.521548 Oct 04 18:19:58.809917 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2171/4354] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:58 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1522 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:58.942875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-680417a2-fca6-45af-8b44-8e4969a4ccf0 req-7be4ec42-7d60-40cf-a3ef-f2afca608b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "tag": "7ea256cc-7dc7-404f-b12e-41602c4c2d87"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:58.956465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-680417a2-fca6-45af-8b44-8e4969a4ccf0 req-7be4ec42-7d60-40cf-a3ef-f2afca608b5f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.957248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-680417a2-fca6-45af-8b44-8e4969a4ccf0 req-7be4ec42-7d60-40cf-a3ef-f2afca608b5f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.957900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-680417a2-fca6-45af-8b44-8e4969a4ccf0 req-7be4ec42-7d60-40cf-a3ef-f2afca608b5f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.981394 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-680417a2-fca6-45af-8b44-8e4969a4ccf0 req-7be4ec42-7d60-40cf-a3ef-f2afca608b5f service nova] Creating event network-changed:7ea256cc-7dc7-404f-b12e-41602c4c2d87 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:19:59.000613 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-680417a2-fca6-45af-8b44-8e4969a4ccf0 req-7be4ec42-7d60-40cf-a3ef-f2afca608b5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056877 Oct 04 18:19:59.002346 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2172/4355] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:59.426383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee345d2e-54c7-49b3-abde-8a04a77b737e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:59.439295 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ee345d2e-54c7-49b3-abde-8a04a77b737e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1677 microversion: 2.1 time: 0.728463 Oct 04 18:19:59.455321 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2184/4356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:58 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1677 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:59.701718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:59.702867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:59.713727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=10 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:59.726853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.727648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.728276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.729261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.729740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.730185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.831910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-685e46fe-5f88-475e-b0d1-ce9cfe6b8d68 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:59.833184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-685e46fe-5f88-475e-b0d1-ce9cfe6b8d68 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:59.841686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:59.847580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-685e46fe-5f88-475e-b0d1-ce9cfe6b8d68 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.850179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-685e46fe-5f88-475e-b0d1-ce9cfe6b8d68 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.851476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-685e46fe-5f88-475e-b0d1-ce9cfe6b8d68 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.853393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-685e46fe-5f88-475e-b0d1-ce9cfe6b8d68 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.862455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-685e46fe-5f88-475e-b0d1-ce9cfe6b8d68 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.863903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-685e46fe-5f88-475e-b0d1-ce9cfe6b8d68 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:00.392934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.398935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-685e46fe-5f88-475e-b0d1-ce9cfe6b8d68 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.407205 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-685e46fe-5f88-475e-b0d1-ce9cfe6b8d68 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1522 microversion: 2.1 time: 0.580646 Oct 04 18:20:00.410798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.411284 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2185/4357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:59 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:00.416888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.420740 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-24036372-adbf-45dc-a759-ed13a118408a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.722927 Oct 04 18:20:00.427265 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2173/4358] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:59 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:00.470081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-16863ddf-fd46-452b-b883-1650b9168e17 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:00.473617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-16863ddf-fd46-452b-b883-1650b9168e17 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:00.484206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16863ddf-fd46-452b-b883-1650b9168e17 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:00.485990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16863ddf-fd46-452b-b883-1650b9168e17 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:00.489514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16863ddf-fd46-452b-b883-1650b9168e17 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:00.494214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16863ddf-fd46-452b-b883-1650b9168e17 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:00.494834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16863ddf-fd46-452b-b883-1650b9168e17 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:00.495691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16863ddf-fd46-452b-b883-1650b9168e17 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.308946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-16863ddf-fd46-452b-b883-1650b9168e17 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:01.320772 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-16863ddf-fd46-452b-b883-1650b9168e17 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1677 microversion: 2.1 time: 0.855929 Oct 04 18:20:01.337352 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2186/4359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:00 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1677 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:01.432418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70daa390-e0d4-4a68-8ed0-565ea0107c2a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:01.434665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-70daa390-e0d4-4a68-8ed0-565ea0107c2a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:01.461230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:01.461986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:01.462121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70daa390-e0d4-4a68-8ed0-565ea0107c2a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.462640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70daa390-e0d4-4a68-8ed0-565ea0107c2a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.463123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70daa390-e0d4-4a68-8ed0-565ea0107c2a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.470872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70daa390-e0d4-4a68-8ed0-565ea0107c2a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.471412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70daa390-e0d4-4a68-8ed0-565ea0107c2a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.472870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70daa390-e0d4-4a68-8ed0-565ea0107c2a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.473639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.476488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.477520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.478425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.485474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.496401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.584930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:02.332010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70daa390-e0d4-4a68-8ed0-565ea0107c2a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.350675 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70daa390-e0d4-4a68-8ed0-565ea0107c2a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1499 microversion: 2.1 time: 0.923754 Oct 04 18:20:02.355743 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2174/4360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:01 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1499 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:02.408929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.429031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.430430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.440204 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-07e57bf1-2447-4c49-b531-400940ce6422 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.983017 Oct 04 18:20:02.441851 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2187/4361] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:01 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:02.452077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1910936814", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bdc421ed-922d-4561-95c6-d17f3732489f"}], "security_groups": [{"name": "tempest-securitygroup--1365199410"}], "key_name": "tempest-keypair-1377735783", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:02.800708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-77f5e31d-49ba-41cf-84ae-235468217066 tempest-QuotasTestJSON-1475232666 tempest-QuotasTestJSON-1475232666-project] Calling method '.version_select at 0x7fd4d155ad30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:03.016322 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-77f5e31d-49ba-41cf-84ae-235468217066 tempest-QuotasTestJSON-1475232666 tempest-QuotasTestJSON-1475232666-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/76e827c15a934f819c163c2c3a553da7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.657712 Oct 04 18:20:03.016942 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2175/4362] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:20:02 2022] GET /compute/v2.1/os-quota-sets/76e827c15a934f819c163c2c3a553da7/defaults => generated 371 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:03.036005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0542d6a7-ff54-42a2-963a-2878e01b34e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:03.062461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] validate_networks() for [('bdc421ed-922d-4561-95c6-d17f3732489f', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:03.069375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0542d6a7-ff54-42a2-963a-2878e01b34e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:03.084275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0542d6a7-ff54-42a2-963a-2878e01b34e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.085229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0542d6a7-ff54-42a2-963a-2878e01b34e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.085761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0542d6a7-ff54-42a2-963a-2878e01b34e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.086570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0542d6a7-ff54-42a2-963a-2878e01b34e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.088111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0542d6a7-ff54-42a2-963a-2878e01b34e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.089523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0542d6a7-ff54-42a2-963a-2878e01b34e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.985155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0542d6a7-ff54-42a2-963a-2878e01b34e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:03.993670 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0542d6a7-ff54-42a2-963a-2878e01b34e8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1654 microversion: 2.1 time: 0.975657 Oct 04 18:20:03.994273 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2176/4363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:03 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1654 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:04.020889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:04.028773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:04.029877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:04.037226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.037964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.038588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.039689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.040347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.041135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.088948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:20:04.139828 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-564daf61-f9c5-4b58-8fc8-a3f712fcb998 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.126118 Oct 04 18:20:04.140751 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2177/4364] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Oct 4 18:20:03 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:04.145832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7ad3d17b-5832-4a7e-ac34-dfbe3c055623 tempest-QuotasTestJSON-1475232666 tempest-QuotasTestJSON-1475232666-project] Calling method '.version_select at 0x7fd4d155a9d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:04.443382 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7ad3d17b-5832-4a7e-ac34-dfbe3c055623 tempest-QuotasTestJSON-1475232666 tempest-QuotasTestJSON-1475232666-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/76e827c15a934f819c163c2c3a553da7" status: 200 len: 371 microversion: 2.1 time: 0.300631 Oct 04 18:20:04.444492 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2178/4365] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 4 18:20:04 2022] GET /compute/v2.1/os-quota-sets/76e827c15a934f819c163c2c3a553da7 => generated 371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:04.454521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:04.455295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:04.464916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.465515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.466028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.466824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.467312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.469144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.945360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Getting quotas for project c3070f4f718546118ef9e4b0d46ba556. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:04.952762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Getting quotas for user cc0ba4cac1a34c09b91e0e9607a4ae34 and project c3070f4f718546118ef9e4b0d46ba556. Resources: dict_keys(['metadata_items']) {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:04.969125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:04.969904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:04.970607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:04.971468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:04.972116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:04.981962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.982467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.982912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.983692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.984222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.984659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.003929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Getting quotas for project c3070f4f718546118ef9e4b0d46ba556. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:05.010500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Getting quotas for user cc0ba4cac1a34c09b91e0e9607a4ae34 and project c3070f4f718546118ef9e4b0d46ba556. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:05.025148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:05.027944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:05.067710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:05.072924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:05.086489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:05.089496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:05.095946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ea7d923c-df5b-426a-9195-571ac76ecab1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.652334 Oct 04 18:20:05.097571 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2188/4366] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 2655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:05.104931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f16c615b-c193-42cd-abfd-974d16aea156 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:05.114775 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb7c9c0d-c620-446b-888a-44f8e42ad534 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.646327 Oct 04 18:20:05.115603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f16c615b-c193-42cd-abfd-974d16aea156 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.115728 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2179/4367] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:04 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:05.116548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f16c615b-c193-42cd-abfd-974d16aea156 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.116994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f16c615b-c193-42cd-abfd-974d16aea156 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.144360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f16c615b-c193-42cd-abfd-974d16aea156 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Going to try to start instance {{(pid=122331) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:20:05.156242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-521754e6-5440-4637-9eb8-4f659cad5f8e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:05.183589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-521754e6-5440-4637-9eb8-4f659cad5f8e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.185948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-521754e6-5440-4637-9eb8-4f659cad5f8e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.186427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-521754e6-5440-4637-9eb8-4f659cad5f8e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.205938 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f16c615b-c193-42cd-abfd-974d16aea156 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/action" status: 202 len: 0 microversion: 2.1 time: 0.103563 Oct 04 18:20:05.206873 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2189/4368] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:05 2022] POST /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:05.235389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-50b1db06-be7b-40fa-8b17-df299378cbda tempest-QuotasTestJSON-1475232666 tempest-QuotasTestJSON-1475232666-project] Calling method '.version_select at 0x7fd4d61c6550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.239529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-521754e6-5440-4637-9eb8-4f659cad5f8e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Going to try to start instance {{(pid=122332) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:20:05.320964 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-521754e6-5440-4637-9eb8-4f659cad5f8e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "POST /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a/action" status: 202 len: 0 microversion: 2.1 time: 0.185838 Oct 04 18:20:05.326159 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2180/4369] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:05 2022] POST /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:05.333319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-71b648bd-f103-4592-8ef7-5434766ad07c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.334764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-71b648bd-f103-4592-8ef7-5434766ad07c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:05.501674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-71b648bd-f103-4592-8ef7-5434766ad07c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:05.513167 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-71b648bd-f103-4592-8ef7-5434766ad07c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1278 microversion: 2.1 time: 0.185197 Oct 04 18:20:05.516342 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2181/4370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:05.538887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-20ec2c7b-6376-46ba-955c-bb3fdc464aa5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.545317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-20ec2c7b-6376-46ba-955c-bb3fdc464aa5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:05.574685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20ec2c7b-6376-46ba-955c-bb3fdc464aa5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.576554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20ec2c7b-6376-46ba-955c-bb3fdc464aa5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.581099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20ec2c7b-6376-46ba-955c-bb3fdc464aa5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.584553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20ec2c7b-6376-46ba-955c-bb3fdc464aa5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.585267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20ec2c7b-6376-46ba-955c-bb3fdc464aa5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.590632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20ec2c7b-6376-46ba-955c-bb3fdc464aa5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.790494 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-50b1db06-be7b-40fa-8b17-df299378cbda tempest-QuotasTestJSON-1475232666 tempest-QuotasTestJSON-1475232666-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/76e827c15a934f819c163c2c3a553da7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.581602 Oct 04 18:20:05.807672 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2190/4371] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/os-quota-sets/76e827c15a934f819c163c2c3a553da7/defaults => generated 371 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:05.813275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-41af5d9a-61b5-4b7c-8059-8e17d5f1562a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.814016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-41af5d9a-61b5-4b7c-8059-8e17d5f1562a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:05.838137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af5d9a-61b5-4b7c-8059-8e17d5f1562a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.839073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af5d9a-61b5-4b7c-8059-8e17d5f1562a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.844264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af5d9a-61b5-4b7c-8059-8e17d5f1562a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.847930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af5d9a-61b5-4b7c-8059-8e17d5f1562a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.851882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af5d9a-61b5-4b7c-8059-8e17d5f1562a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.852672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af5d9a-61b5-4b7c-8059-8e17d5f1562a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.108644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-20ec2c7b-6376-46ba-955c-bb3fdc464aa5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.119900 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-20ec2c7b-6376-46ba-955c-bb3fdc464aa5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1663 microversion: 2.1 time: 0.599699 Oct 04 18:20:06.172277 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2182/4372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1663 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:06.196691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5270e57e-bb53-422f-af3d-5d6e1b741d13 tempest-QuotasTestJSON-1475232666 tempest-QuotasTestJSON-1475232666-project] Calling method '.version_select at 0x7fd4d618b8b0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.385162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-41af5d9a-61b5-4b7c-8059-8e17d5f1562a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.395190 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-41af5d9a-61b5-4b7c-8059-8e17d5f1562a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1508 microversion: 2.1 time: 0.586253 Oct 04 18:20:06.397879 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2191/4373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1508 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:06.414794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.415706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:06.422947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.423643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.424397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.426386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.427043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.427560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.640012 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5270e57e-bb53-422f-af3d-5d6e1b741d13 tempest-QuotasTestJSON-1475232666 tempest-QuotasTestJSON-1475232666-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/76e827c15a934f819c163c2c3a553da7" status: 200 len: 371 microversion: 2.1 time: 0.464766 Oct 04 18:20:06.641123 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2183/4374] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/os-quota-sets/76e827c15a934f819c163c2c3a553da7 => generated 371 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:06.646340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8cc16b86-db1f-4c1e-a68e-0a0dd7ee79ab tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.647185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8cc16b86-db1f-4c1e-a68e-0a0dd7ee79ab tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:06.656951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc16b86-db1f-4c1e-a68e-0a0dd7ee79ab tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.657810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc16b86-db1f-4c1e-a68e-0a0dd7ee79ab tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.658401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc16b86-db1f-4c1e-a68e-0a0dd7ee79ab tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.659660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc16b86-db1f-4c1e-a68e-0a0dd7ee79ab tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.661379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc16b86-db1f-4c1e-a68e-0a0dd7ee79ab tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.662003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8cc16b86-db1f-4c1e-a68e-0a0dd7ee79ab tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.802630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8cc16b86-db1f-4c1e-a68e-0a0dd7ee79ab tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.816965 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8cc16b86-db1f-4c1e-a68e-0a0dd7ee79ab tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1274 microversion: 2.1 time: 0.174487 Oct 04 18:20:06.818802 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2184/4375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:06.920340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-162222017", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:06.926099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.940621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.945261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.948500 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7b270390-6650-4ba9-a0a6-e41d752dc856 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.546939 Oct 04 18:20:06.951595 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2192/4376] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:06.961788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e921d41a-d390-4e41-8664-2d358949cf58 tempest-QuotasTestJSON-1475232666 tempest-QuotasTestJSON-1475232666-project] Calling method '.version_select at 0x7fd4d12eb1f0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:07.011301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] validate_networks() for [('63d10a95-4ae5-444e-b554-0492822e0392', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:07.049507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=19 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:07.074784 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e921d41a-d390-4e41-8664-2d358949cf58 tempest-QuotasTestJSON-1475232666 tempest-QuotasTestJSON-1475232666-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/76e827c15a934f819c163c2c3a553da7?user_id=900b2e7f104844b38a2b090fd6f78ca9" status: 200 len: 371 microversion: 2.1 time: 0.121679 Oct 04 18:20:07.075731 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2193/4377] 10.222.0.18 () {58 vars in 1323 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/os-quota-sets/76e827c15a934f819c163c2c3a553da7?user_id=900b2e7f104844b38a2b090fd6f78ca9 => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:07.152720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d382a46d-6ca0-4e44-b885-5d54a985beee tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:07.153733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d382a46d-6ca0-4e44-b885-5d54a985beee tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:07.166305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d382a46d-6ca0-4e44-b885-5d54a985beee tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:07.166893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d382a46d-6ca0-4e44-b885-5d54a985beee tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:07.167293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d382a46d-6ca0-4e44-b885-5d54a985beee tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:07.170057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d382a46d-6ca0-4e44-b885-5d54a985beee tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:07.170057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d382a46d-6ca0-4e44-b885-5d54a985beee tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:07.170246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d382a46d-6ca0-4e44-b885-5d54a985beee tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.026630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d382a46d-6ca0-4e44-b885-5d54a985beee tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:08.042888 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d382a46d-6ca0-4e44-b885-5d54a985beee tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1663 microversion: 2.1 time: 0.894117 Oct 04 18:20:08.045961 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2194/4378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:07 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1663 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:08.053460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b5f9ecca-f913-42d3-a4f8-99d0bd5b027b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:08.069894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b5f9ecca-f913-42d3-a4f8-99d0bd5b027b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:08.082723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5f9ecca-f913-42d3-a4f8-99d0bd5b027b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.083429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5f9ecca-f913-42d3-a4f8-99d0bd5b027b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.084199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5f9ecca-f913-42d3-a4f8-99d0bd5b027b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.086479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5f9ecca-f913-42d3-a4f8-99d0bd5b027b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.089470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5f9ecca-f913-42d3-a4f8-99d0bd5b027b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.090083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5f9ecca-f913-42d3-a4f8-99d0bd5b027b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.823192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b5f9ecca-f913-42d3-a4f8-99d0bd5b027b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:08.832154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:08.832657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:08.833144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:08.833944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:08.835849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:08.838100 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b5f9ecca-f913-42d3-a4f8-99d0bd5b027b tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1508 microversion: 2.1 time: 0.787798 Oct 04 18:20:08.838937 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2195/4379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:08 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1508 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:08.869402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6023bba0-c7b0-4598-b986-3a0358ca8c77 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:08.869922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.870442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.870744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6023bba0-c7b0-4598-b986-3a0358ca8c77 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:08.877122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.877122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.877122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.877122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.891108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6023bba0-c7b0-4598-b986-3a0358ca8c77 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.891828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6023bba0-c7b0-4598-b986-3a0358ca8c77 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.892574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6023bba0-c7b0-4598-b986-3a0358ca8c77 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.893616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6023bba0-c7b0-4598-b986-3a0358ca8c77 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.895678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6023bba0-c7b0-4598-b986-3a0358ca8c77 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.896850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6023bba0-c7b0-4598-b986-3a0358ca8c77 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.940159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Getting quotas for project 1e47383b87bc4a2aa22f2297c0830e31. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:08.951108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Getting quotas for user a98f26cd0f90410ab0216ff424ff948c and project 1e47383b87bc4a2aa22f2297c0830e31. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:08.981738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:08.984836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:09.037579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6023bba0-c7b0-4598-b986-3a0358ca8c77 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.058552 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6023bba0-c7b0-4598-b986-3a0358ca8c77 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1336 microversion: 2.1 time: 0.201907 Oct 04 18:20:09.085117 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2196/4380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:08 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1336 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:09.113273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:09.115218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:09.125788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:09.125788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:09.126232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.140803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:09.141649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:09.142262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.147263 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a0bd460-3a1f-449b-958f-a56c8cec0b1d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.326667 Oct 04 18:20:09.162842 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2185/4381] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:09.206846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0cfb920f-c049-4849-8074-04347ef1d6d9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:09.207617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0cfb920f-c049-4849-8074-04347ef1d6d9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:09.227998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfb920f-c049-4849-8074-04347ef1d6d9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:09.228561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfb920f-c049-4849-8074-04347ef1d6d9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:09.230077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfb920f-c049-4849-8074-04347ef1d6d9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.233130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfb920f-c049-4849-8074-04347ef1d6d9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:09.236994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfb920f-c049-4849-8074-04347ef1d6d9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:09.238382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfb920f-c049-4849-8074-04347ef1d6d9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.762294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0cfb920f-c049-4849-8074-04347ef1d6d9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.773933 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0cfb920f-c049-4849-8074-04347ef1d6d9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1663 microversion: 2.1 time: 0.609749 Oct 04 18:20:09.776106 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2186/4382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:09 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1663 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:09.785094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-be95d830-cf7e-4100-8e65-f4b38047eb87 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:09.795063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-be95d830-cf7e-4100-8e65-f4b38047eb87 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:09.930372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.944896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.953318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be95d830-cf7e-4100-8e65-f4b38047eb87 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.960724 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-be95d830-cf7e-4100-8e65-f4b38047eb87 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1213 microversion: 2.1 time: 0.183532 Oct 04 18:20:09.971031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.972868 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2187/4383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:09 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1213 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:09.979907 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4024b0a3-13d8-42b9-8f87-dd2e612cfc09 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.892886 Oct 04 18:20:09.987876 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2197/4384] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:09 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:09.988992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04c419cd-5a70-4612-84e8-aad15a4e3ac3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:09.990020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-04c419cd-5a70-4612-84e8-aad15a4e3ac3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:10.006610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04c419cd-5a70-4612-84e8-aad15a4e3ac3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.007382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04c419cd-5a70-4612-84e8-aad15a4e3ac3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.008230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04c419cd-5a70-4612-84e8-aad15a4e3ac3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.009175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04c419cd-5a70-4612-84e8-aad15a4e3ac3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.015303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04c419cd-5a70-4612-84e8-aad15a4e3ac3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.016161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04c419cd-5a70-4612-84e8-aad15a4e3ac3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.082436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a6cea479-4794-4303-8008-577560116b0a tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:10.084015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a6cea479-4794-4303-8008-577560116b0a tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:10.104078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a6cea479-4794-4303-8008-577560116b0a tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.112302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a6cea479-4794-4303-8008-577560116b0a tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.113098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a6cea479-4794-4303-8008-577560116b0a tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.113953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a6cea479-4794-4303-8008-577560116b0a tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.115470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a6cea479-4794-4303-8008-577560116b0a tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.118049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a6cea479-4794-4303-8008-577560116b0a tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.799923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a6cea479-4794-4303-8008-577560116b0a tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:10.820633 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a6cea479-4794-4303-8008-577560116b0a tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1404 microversion: 2.1 time: 0.742376 Oct 04 18:20:10.836113 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2198/4385] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:10 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1404 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:10.847888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e96974dc-e0a6-45ae-9bd5-bb83887d07b8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:10.848533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e96974dc-e0a6-45ae-9bd5-bb83887d07b8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:10.869233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e96974dc-e0a6-45ae-9bd5-bb83887d07b8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.870205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e96974dc-e0a6-45ae-9bd5-bb83887d07b8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.871299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e96974dc-e0a6-45ae-9bd5-bb83887d07b8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.872232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e96974dc-e0a6-45ae-9bd5-bb83887d07b8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.873222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e96974dc-e0a6-45ae-9bd5-bb83887d07b8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.873882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e96974dc-e0a6-45ae-9bd5-bb83887d07b8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.018865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-04c419cd-5a70-4612-84e8-aad15a4e3ac3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.042864 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-04c419cd-5a70-4612-84e8-aad15a4e3ac3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1512 microversion: 2.1 time: 1.068107 Oct 04 18:20:11.045617 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2188/4386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:09 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1512 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:11.051691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-697f78bf-5fc2-4f0e-bec2-2a5ab522dacd tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:11.052888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-697f78bf-5fc2-4f0e-bec2-2a5ab522dacd tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:11.059455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-697f78bf-5fc2-4f0e-bec2-2a5ab522dacd tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.060308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-697f78bf-5fc2-4f0e-bec2-2a5ab522dacd tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.060989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-697f78bf-5fc2-4f0e-bec2-2a5ab522dacd tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.062467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-697f78bf-5fc2-4f0e-bec2-2a5ab522dacd tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.070548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-697f78bf-5fc2-4f0e-bec2-2a5ab522dacd tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.071755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-697f78bf-5fc2-4f0e-bec2-2a5ab522dacd tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.190506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-697f78bf-5fc2-4f0e-bec2-2a5ab522dacd tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.207931 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-697f78bf-5fc2-4f0e-bec2-2a5ab522dacd tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1265 microversion: 2.1 time: 0.160331 Oct 04 18:20:11.209900 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2189/4387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:11 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:11.216423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:11.217414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:11.226218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.226880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.227696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.230062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.230700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.232094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.263461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e96974dc-e0a6-45ae-9bd5-bb83887d07b8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.275884 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e96974dc-e0a6-45ae-9bd5-bb83887d07b8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1667 microversion: 2.1 time: 0.436851 Oct 04 18:20:11.285863 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2199/4388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:10 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1667 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:11.291004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:11.306996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.319656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.servers [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Removing options 'limit' from query {{(pid=122331) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:20:11.320719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:11.322108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.322773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.323507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.324429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.324894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.325526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.327084 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-46bff8de-9487-4f13-ac45-4fa1c5c12fac tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.039793 Oct 04 18:20:11.328084 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2200/4389] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Oct 4 18:20:11 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:20:11.654795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5c9d0410-36d4-4b25-b9a2-7e157801c2b9 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Action: 'create', calling method: .version_select at 0x7fd4d6179310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-756548225", "metadata": {"Type": "work"}}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:11.859205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.872338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.875052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.876500 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-af4beebc-c4dd-47dc-90f3-71c2b88eb0f8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.665397 Oct 04 18:20:11.877999 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2190/4390] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:11 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:11.892692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-72d998fd-c99d-4e8c-bb42-ecbd33486ab2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:11.893781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-72d998fd-c99d-4e8c-bb42-ecbd33486ab2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:11.908053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72d998fd-c99d-4e8c-bb42-ecbd33486ab2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.909391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72d998fd-c99d-4e8c-bb42-ecbd33486ab2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.910135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72d998fd-c99d-4e8c-bb42-ecbd33486ab2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.912001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72d998fd-c99d-4e8c-bb42-ecbd33486ab2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.912758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72d998fd-c99d-4e8c-bb42-ecbd33486ab2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.913948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72d998fd-c99d-4e8c-bb42-ecbd33486ab2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.133547 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5c9d0410-36d4-4b25-b9a2-7e157801c2b9 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.804400 Oct 04 18:20:12.134456 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2201/4391] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Oct 4 18:20:11 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 806 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 18:20:12.148522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5b12ae5d-db8b-4379-b23d-dfa073b96d43 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:12.149162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5b12ae5d-db8b-4379-b23d-dfa073b96d43 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:12.156197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b12ae5d-db8b-4379-b23d-dfa073b96d43 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.156708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b12ae5d-db8b-4379-b23d-dfa073b96d43 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.157154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b12ae5d-db8b-4379-b23d-dfa073b96d43 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.157869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b12ae5d-db8b-4379-b23d-dfa073b96d43 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.158332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b12ae5d-db8b-4379-b23d-dfa073b96d43 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.158762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b12ae5d-db8b-4379-b23d-dfa073b96d43 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.388505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-72d998fd-c99d-4e8c-bb42-ecbd33486ab2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:12.396903 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-72d998fd-c99d-4e8c-bb42-ecbd33486ab2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1512 microversion: 2.1 time: 0.517638 Oct 04 18:20:12.401052 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2191/4392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:11 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1512 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:12.406373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-68e81a6f-7737-46d6-8aaa-a19e09d6de57 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Calling method '.version_select at 0x7fd4d1aae670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:12.537894 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-68e81a6f-7737-46d6-8aaa-a19e09d6de57 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d" status: 200 len: 352 microversion: 2.1 time: 0.135730 Oct 04 18:20:12.538495 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2192/4393] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:20:12 2022] GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d => generated 352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:12.543032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-58764b6a-4144-430d-a7c6-433968954f17 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:12.543809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-58764b6a-4144-430d-a7c6-433968954f17 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:12.557568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58764b6a-4144-430d-a7c6-433968954f17 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.558320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58764b6a-4144-430d-a7c6-433968954f17 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.564383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58764b6a-4144-430d-a7c6-433968954f17 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.565362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58764b6a-4144-430d-a7c6-433968954f17 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.565996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58764b6a-4144-430d-a7c6-433968954f17 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.566778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58764b6a-4144-430d-a7c6-433968954f17 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.592711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b12ae5d-db8b-4379-b23d-dfa073b96d43 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:12.606215 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5b12ae5d-db8b-4379-b23d-dfa073b96d43 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1404 microversion: 2.1 time: 0.470400 Oct 04 18:20:12.608128 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2202/4394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:12 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:12.620734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-efca3a29-6a31-4fdc-89c4-50c3f915850d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:12.623162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-efca3a29-6a31-4fdc-89c4-50c3f915850d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: de379391-e467-452e-93b4-9fbfe268a32c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:12.641429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-efca3a29-6a31-4fdc-89c4-50c3f915850d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.642994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-efca3a29-6a31-4fdc-89c4-50c3f915850d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.644657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-efca3a29-6a31-4fdc-89c4-50c3f915850d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.646862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-efca3a29-6a31-4fdc-89c4-50c3f915850d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.648815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-efca3a29-6a31-4fdc-89c4-50c3f915850d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.649639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-efca3a29-6a31-4fdc-89c4-50c3f915850d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.749119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-58764b6a-4144-430d-a7c6-433968954f17 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:12.759601 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-58764b6a-4144-430d-a7c6-433968954f17 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1271 microversion: 2.1 time: 0.219922 Oct 04 18:20:12.760805 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2193/4395] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:12 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:12.913105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:12.914007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:12.924860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.925933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.926518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.927552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.928351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.928965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:13.501742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-efca3a29-6a31-4fdc-89c4-50c3f915850d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:13.518376 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-efca3a29-6a31-4fdc-89c4-50c3f915850d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c" status: 200 len: 1513 microversion: 2.1 time: 0.908530 Oct 04 18:20:13.519003 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2203/4396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:12 2022] GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c => generated 1513 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:13.541891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef3a33d9-376e-4a05-b81a-bb06e042cdc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:13.542694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef3a33d9-376e-4a05-b81a-bb06e042cdc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:13.550165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3a33d9-376e-4a05-b81a-bb06e042cdc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:13.550885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3a33d9-376e-4a05-b81a-bb06e042cdc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:13.551371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3a33d9-376e-4a05-b81a-bb06e042cdc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:13.552264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3a33d9-376e-4a05-b81a-bb06e042cdc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:13.552884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3a33d9-376e-4a05-b81a-bb06e042cdc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:13.553473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef3a33d9-376e-4a05-b81a-bb06e042cdc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:13.851488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:13.863135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:13.865367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:13.866932 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ca3e743c-1f37-4a27-88ac-e9563dfeaf04 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.959152 Oct 04 18:20:13.880648 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2194/4397] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:12 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:13.904754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-612601a2-cd29-40c3-860e-058fc720b859 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Calling method '.version_select at 0x7fd4d61f6e50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:13.964798 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-612601a2-cd29-40c3-860e-058fc720b859 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d" status: 200 len: 353 microversion: 2.1 time: 0.070631 Oct 04 18:20:13.965667 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2195/4398] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:20:13 2022] GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:13.971480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9f1896d1-2969-4778-809e-252676ce8225 req-1789334e-c87d-416b-96c5-7fdc95c57608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfce2b8c-1451-4e6e-9802-49cad53d29ac", "tag": "75f2329e-67cc-4cb9-abfb-15c8920110ee"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:13.984550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9f1896d1-2969-4778-809e-252676ce8225 req-1789334e-c87d-416b-96c5-7fdc95c57608 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:13.985430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9f1896d1-2969-4778-809e-252676ce8225 req-1789334e-c87d-416b-96c5-7fdc95c57608 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:13.986076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9f1896d1-2969-4778-809e-252676ce8225 req-1789334e-c87d-416b-96c5-7fdc95c57608 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.003699 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9f1896d1-2969-4778-809e-252676ce8225 req-1789334e-c87d-416b-96c5-7fdc95c57608 service nova] Creating event network-changed:75f2329e-67cc-4cb9-abfb-15c8920110ee for instance cfce2b8c-1451-4e6e-9802-49cad53d29ac on n-h1-850499-14 Oct 04 18:20:14.011283 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9f1896d1-2969-4778-809e-252676ce8225 req-1789334e-c87d-416b-96c5-7fdc95c57608 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043708 Oct 04 18:20:14.013829 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2196/4399] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:14.021396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-065c2d13-21e4-486e-ac97-a4c69a6d293c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.022653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-065c2d13-21e4-486e-ac97-a4c69a6d293c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:14.036883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-065c2d13-21e4-486e-ac97-a4c69a6d293c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.037781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-065c2d13-21e4-486e-ac97-a4c69a6d293c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.038245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-065c2d13-21e4-486e-ac97-a4c69a6d293c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.039132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-065c2d13-21e4-486e-ac97-a4c69a6d293c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.039853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-065c2d13-21e4-486e-ac97-a4c69a6d293c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.040451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-065c2d13-21e4-486e-ac97-a4c69a6d293c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.068013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef3a33d9-376e-4a05-b81a-bb06e042cdc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:14.079347 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef3a33d9-376e-4a05-b81a-bb06e042cdc7 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1512 microversion: 2.1 time: 0.541394 Oct 04 18:20:14.088331 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2204/4400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:13 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1512 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:14.112249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f95e7d53-05a1-48d7-9021-2c4dc47a3c49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.113110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f95e7d53-05a1-48d7-9021-2c4dc47a3c49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:14.132193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95e7d53-05a1-48d7-9021-2c4dc47a3c49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.132696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95e7d53-05a1-48d7-9021-2c4dc47a3c49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.133140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95e7d53-05a1-48d7-9021-2c4dc47a3c49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.133859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95e7d53-05a1-48d7-9021-2c4dc47a3c49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.134315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95e7d53-05a1-48d7-9021-2c4dc47a3c49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.134752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f95e7d53-05a1-48d7-9021-2c4dc47a3c49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.601588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-065c2d13-21e4-486e-ac97-a4c69a6d293c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:14.612236 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-065c2d13-21e4-486e-ac97-a4c69a6d293c tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1404 microversion: 2.1 time: 0.596482 Oct 04 18:20:14.613832 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2197/4401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1404 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:14.620227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e12eda2c-b89c-4958-89ef-1b56bfd9090d tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Calling method '.version_select at 0x7fd4d128b940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.652178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f95e7d53-05a1-48d7-9021-2c4dc47a3c49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:14.665630 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f95e7d53-05a1-48d7-9021-2c4dc47a3c49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1313 microversion: 2.1 time: 0.579904 Oct 04 18:20:14.673451 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2205/4402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:14.681501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.697612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:14.701347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:14.716199 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e12eda2c-b89c-4958-89ef-1b56bfd9090d tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d" status: 200 len: 353 microversion: 2.1 time: 0.099678 Oct 04 18:20:14.717395 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2198/4403] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:14.733366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-523d7166-a756-4168-8fe7-35420b098081 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Calling method '.version_select at 0x7fd4d6122e50>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.869768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-523d7166-a756-4168-8fe7-35420b098081 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d" status: 202 len: 0 microversion: 2.1 time: 0.140150 Oct 04 18:20:14.875078 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2199/4404] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:20:14 2022] DELETE /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:14.880277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-710c6f3a-9045-4f91-aefa-d9652354a9d1 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Calling method '.version_select at 0x7fd4d60faa60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.959336 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-710c6f3a-9045-4f91-aefa-d9652354a9d1 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d" status: 200 len: 352 microversion: 2.1 time: 0.083166 Oct 04 18:20:14.968434 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2200/4405] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:14.974888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.975656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:14.984729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.985564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.986198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.987146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.988536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.989051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.993347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:15.011402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.011937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.012602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.013473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.015896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.016339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.162426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:20:15.237764 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d6d6cf69-b373-4d82-b86f-f8227a9a31d1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.561785 Oct 04 18:20:15.239302 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2206/4406] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:15.256138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-53a929d9-81e4-4a65-b23b-a75ddf5f63c6 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:15.260804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-53a929d9-81e4-4a65-b23b-a75ddf5f63c6 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:15.273643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53a929d9-81e4-4a65-b23b-a75ddf5f63c6 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.274401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53a929d9-81e4-4a65-b23b-a75ddf5f63c6 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.277537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53a929d9-81e4-4a65-b23b-a75ddf5f63c6 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.278810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53a929d9-81e4-4a65-b23b-a75ddf5f63c6 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.279504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53a929d9-81e4-4a65-b23b-a75ddf5f63c6 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.282795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53a929d9-81e4-4a65-b23b-a75ddf5f63c6 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.287704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:16.242069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:16.258474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:16.263543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:16.265690 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-384ee7d3-7985-42d5-9a52-0555c0609110 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 1.295912 Oct 04 18:20:16.290058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-53a929d9-81e4-4a65-b23b-a75ddf5f63c6 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:16.296676 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2201/4407] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:16.306067 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-53a929d9-81e4-4a65-b23b-a75ddf5f63c6 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1512 microversion: 2.1 time: 1.054466 Oct 04 18:20:16.306980 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2207/4408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:15 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1512 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:16.327045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33ac31fe-0fbc-4ff7-a3cf-cad13f9ba083 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:16.333278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1472d71b-f6ad-4689-bd42-2ccabd530598 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:16.333649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33ac31fe-0fbc-4ff7-a3cf-cad13f9ba083 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:16.340647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1472d71b-f6ad-4689-bd42-2ccabd530598 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:16.349037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ac31fe-0fbc-4ff7-a3cf-cad13f9ba083 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.350596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ac31fe-0fbc-4ff7-a3cf-cad13f9ba083 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.351216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ac31fe-0fbc-4ff7-a3cf-cad13f9ba083 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.353504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ac31fe-0fbc-4ff7-a3cf-cad13f9ba083 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.355504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ac31fe-0fbc-4ff7-a3cf-cad13f9ba083 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.356102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33ac31fe-0fbc-4ff7-a3cf-cad13f9ba083 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.360597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:16.362983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1472d71b-f6ad-4689-bd42-2ccabd530598 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.367063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1472d71b-f6ad-4689-bd42-2ccabd530598 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.368098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1472d71b-f6ad-4689-bd42-2ccabd530598 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.386181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1472d71b-f6ad-4689-bd42-2ccabd530598 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.388069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1472d71b-f6ad-4689-bd42-2ccabd530598 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.388688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1472d71b-f6ad-4689-bd42-2ccabd530598 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.689305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-33ac31fe-0fbc-4ff7-a3cf-cad13f9ba083 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:16.705935 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33ac31fe-0fbc-4ff7-a3cf-cad13f9ba083 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1404 microversion: 2.1 time: 0.403387 Oct 04 18:20:16.708251 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2202/4409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:16 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:16.717808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a41778e1-35b5-4ae3-a6ae-8a75c31ed885 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Calling method '.version_select at 0x7fd4d61f2f70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:16.851250 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a41778e1-35b5-4ae3-a6ae-8a75c31ed885 tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d" status: 200 len: 352 microversion: 2.1 time: 0.141109 Oct 04 18:20:16.851991 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2203/4410] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:20:16 2022] GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d => generated 352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:16.857094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f420dc59-5c77-4d8b-9e7d-95b7339a625a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:16.857907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f420dc59-5c77-4d8b-9e7d-95b7339a625a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: de379391-e467-452e-93b4-9fbfe268a32c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:16.858422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1472d71b-f6ad-4689-bd42-2ccabd530598 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:16.865502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f420dc59-5c77-4d8b-9e7d-95b7339a625a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.866314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f420dc59-5c77-4d8b-9e7d-95b7339a625a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.867435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f420dc59-5c77-4d8b-9e7d-95b7339a625a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.868407 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1472d71b-f6ad-4689-bd42-2ccabd530598 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1313 microversion: 2.1 time: 0.538827 Oct 04 18:20:16.868566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f420dc59-5c77-4d8b-9e7d-95b7339a625a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.869330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f420dc59-5c77-4d8b-9e7d-95b7339a625a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.869899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f420dc59-5c77-4d8b-9e7d-95b7339a625a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.870999 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2208/4411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:16 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:17.086524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2b53274a-c4d6-47b3-af69-93e17367e31f req-131e2e9c-20e7-4300-93fc-5bb51928c11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8380cc-7414-4d96-bd4b-265dd21f78b0", "tag": "ed52627b-61b9-4928-a2b7-9227419da931"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:17.094425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:17.107646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2b53274a-c4d6-47b3-af69-93e17367e31f req-131e2e9c-20e7-4300-93fc-5bb51928c11d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.115834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2b53274a-c4d6-47b3-af69-93e17367e31f req-131e2e9c-20e7-4300-93fc-5bb51928c11d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.116650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2b53274a-c4d6-47b3-af69-93e17367e31f req-131e2e9c-20e7-4300-93fc-5bb51928c11d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.155545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f420dc59-5c77-4d8b-9e7d-95b7339a625a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:17.157346 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2b53274a-c4d6-47b3-af69-93e17367e31f req-131e2e9c-20e7-4300-93fc-5bb51928c11d service nova] Creating event network-changed:ed52627b-61b9-4928-a2b7-9227419da931 for instance 2a8380cc-7414-4d96-bd4b-265dd21f78b0 on n-h1-850499-14 Oct 04 18:20:17.164373 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f420dc59-5c77-4d8b-9e7d-95b7339a625a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c" status: 200 len: 1513 microversion: 2.1 time: 0.311169 Oct 04 18:20:17.169423 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2204/4412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:16 2022] GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c => generated 1513 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:17.172004 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2b53274a-c4d6-47b3-af69-93e17367e31f req-131e2e9c-20e7-4300-93fc-5bb51928c11d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087513 Oct 04 18:20:17.173165 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2209/4413] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:17.193609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe954b0b-e2ee-4905-b60f-37ab65e94767 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:17.194228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fe954b0b-e2ee-4905-b60f-37ab65e94767 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:17.201426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe954b0b-e2ee-4905-b60f-37ab65e94767 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.201953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe954b0b-e2ee-4905-b60f-37ab65e94767 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.202896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe954b0b-e2ee-4905-b60f-37ab65e94767 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.203631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe954b0b-e2ee-4905-b60f-37ab65e94767 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.204088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe954b0b-e2ee-4905-b60f-37ab65e94767 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.204516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe954b0b-e2ee-4905-b60f-37ab65e94767 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.299409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:17.300096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:17.311215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.311783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.312228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.315386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.315929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.318304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.976685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:17.987016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:18.000187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:18.003809 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5bc8b251-c6f5-4936-a53c-bc01928f8305 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.711826 Oct 04 18:20:18.007628 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2210/4414] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:17 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:18.018607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7796cf3c-579e-42e8-8c76-cb7b51df7dbd tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:18.019764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7796cf3c-579e-42e8-8c76-cb7b51df7dbd tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:18.036304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7796cf3c-579e-42e8-8c76-cb7b51df7dbd tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.037757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7796cf3c-579e-42e8-8c76-cb7b51df7dbd tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.038918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7796cf3c-579e-42e8-8c76-cb7b51df7dbd tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.040390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7796cf3c-579e-42e8-8c76-cb7b51df7dbd tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.042500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7796cf3c-579e-42e8-8c76-cb7b51df7dbd tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.047152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7796cf3c-579e-42e8-8c76-cb7b51df7dbd tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.049845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fe954b0b-e2ee-4905-b60f-37ab65e94767 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:18.055675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:18.067484 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fe954b0b-e2ee-4905-b60f-37ab65e94767 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1512 microversion: 2.1 time: 0.877599 Oct 04 18:20:18.068861 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2205/4415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:17 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1512 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:18.102875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-340314a4-e143-45ca-a3bd-e03c49eb4fde tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Calling method '.version_select at 0x7fd4d1cd9310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:18.217822 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-340314a4-e143-45ca-a3bd-e03c49eb4fde tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d" status: 200 len: 352 microversion: 2.1 time: 0.147598 Oct 04 18:20:18.218489 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2206/4416] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:20:18 2022] GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:18.225312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b768893-1e74-4bc2-8e51-8d68e6ae6a49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:18.226155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b768893-1e74-4bc2-8e51-8d68e6ae6a49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:18.238672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b768893-1e74-4bc2-8e51-8d68e6ae6a49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.239490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b768893-1e74-4bc2-8e51-8d68e6ae6a49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.240102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b768893-1e74-4bc2-8e51-8d68e6ae6a49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.241881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b768893-1e74-4bc2-8e51-8d68e6ae6a49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.242605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b768893-1e74-4bc2-8e51-8d68e6ae6a49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.243245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b768893-1e74-4bc2-8e51-8d68e6ae6a49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.914040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:19.394351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7796cf3c-579e-42e8-8c76-cb7b51df7dbd tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:19.402582 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7796cf3c-579e-42e8-8c76-cb7b51df7dbd tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1404 microversion: 2.1 time: 1.393384 Oct 04 18:20:19.403250 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2211/4417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:18 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1404 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:19.417661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:19.433559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:19.439181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:19.466430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.466991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.467454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.468241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.468708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.469144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.490554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7b768893-1e74-4bc2-8e51-8d68e6ae6a49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:19.501418 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b768893-1e74-4bc2-8e51-8d68e6ae6a49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1313 microversion: 2.1 time: 1.281635 Oct 04 18:20:19.536689 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2207/4418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:18 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1313 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:19.548110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:19.557682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:20:19.558177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:19.573413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.575499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.602740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.607680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.609903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.612242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.795289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:19.808958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.809461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.813733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.960476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=14 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:20.375201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:20.386697 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9636e99c-7ddc-4dc6-998e-7186d623a25f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.977036 Oct 04 18:20:20.395692 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2212/4419] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:20:19 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:20.397861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:20.404645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:20.408300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-905671d0-504f-44d7-86a2-20dde8f91880 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.870344 Oct 04 18:20:20.412655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab84560e-338a-4959-a601-7edb7fe7a48a tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Calling method '.version_select at 0x7fd4d1252a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:20.423151 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2208/4420] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:19 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:20.478164 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ab84560e-338a-4959-a601-7edb7fe7a48a tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] HTTP exception thrown: Volume f36186e4-c761-4238-acc9-e54208188c4d could not be found. Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab84560e-338a-4959-a601-7edb7fe7a48a tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Request method failure captured: Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d HTTP/1.1 Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHlad6Z5bq2IpmWxYcXG33VEvydrchnv9xnrhkBVwksV459t-DKUwj-Z6ZF4AwowBqfkLoPKLi-yaO_Agkb44zI5h6n6bBtw0gh4wYrpt_qcWo3ZmpwMnrqAFr-QBJE1UqX60mB7ZBCfcBks1OLUunNY33a5zOMAm2dYE636F3vgKVs Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2291133bcd12432fa6265d8f2c58fb2e Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-VolumesGetTestJSON-1383109155 Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2291133bcd12432fa6265d8f2c58fb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2291133bcd12432fa6265d8f2c58fb2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2291133bcd12432fa6265d8f2c58fb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2291133bcd12432fa6265d8f2c58fb2e"}]}] Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-VolumesGetTestJSON-1383109155 Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2291133bcd12432fa6265d8f2c58fb2e Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-VolumesGetTestJSON-1383109155 Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-VolumesGetTestJSON-1383109155-project Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: dfbbc2b9eaab4a5eaf3225e42148e12d Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-VolumesGetTestJSON-1383109155-project Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: exception: Volume f36186e4-c761-4238-acc9-e54208188c4d could not be found. Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'f36186e4-c761-4238-acc9-e54208188c4d'} Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f36186e4-c761-4238-acc9-e54208188c4d could not be found. (HTTP 404) (Request-ID: req-49530832-59b3-46fb-9f29-b15e6e08a34a) Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:20:20.481774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f36186e4-c761-4238-acc9-e54208188c4d could not be found. Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f36186e4-c761-4238-acc9-e54208188c4d could not be found. Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f36186e4-c761-4238-acc9-e54208188c4d could not be found. Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab84560e-338a-4959-a601-7edb7fe7a48a tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] Returning 404 to user: Volume f36186e4-c761-4238-acc9-e54208188c4d could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ab84560e-338a-4959-a601-7edb7fe7a48a tempest-VolumesGetTestJSON-1383109155 tempest-VolumesGetTestJSON-1383109155-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d" status: 404 len: 109 microversion: 2.1 time: 0.084458 Oct 04 18:20:20.485264 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2213/4421] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:20:20 2022] GET /compute/v2.1/os-volumes/f36186e4-c761-4238-acc9-e54208188c4d => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:20.492253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9dfe6996-9c42-49bc-8cb7-6aff2635d1ff tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:20.494993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9dfe6996-9c42-49bc-8cb7-6aff2635d1ff tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:20.509611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dfe6996-9c42-49bc-8cb7-6aff2635d1ff tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.512429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dfe6996-9c42-49bc-8cb7-6aff2635d1ff tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.512990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dfe6996-9c42-49bc-8cb7-6aff2635d1ff tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.513835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dfe6996-9c42-49bc-8cb7-6aff2635d1ff tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.514096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dfe6996-9c42-49bc-8cb7-6aff2635d1ff tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.514657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dfe6996-9c42-49bc-8cb7-6aff2635d1ff tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.672756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-480798725", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "5be520db-1d2d-4d71-923d-9d8728cd44bc"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:20.694342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9dfe6996-9c42-49bc-8cb7-6aff2635d1ff tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:20.707684 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9dfe6996-9c42-49bc-8cb7-6aff2635d1ff tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1404 microversion: 2.1 time: 0.221604 Oct 04 18:20:20.713019 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2214/4422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:20 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:20.721520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:20.731712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:20.732410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:20.771457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] validate_networks() for [('5be520db-1d2d-4d71-923d-9d8728cd44bc', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:20.917966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.918722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.919574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.922341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.923523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.924281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.966203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:20:21.027379 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b62e1a8a-a50c-40e5-812e-2c62d4a9b776 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.312954 Oct 04 18:20:21.030175 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2215/4423] 10.222.0.18 () {58 vars in 1150 bytes} [Tue Oct 4 18:20:20 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:21.045915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c2fe4bd-ab80-4b5c-8962-b6f6007eac31 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:21.046592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0c2fe4bd-ab80-4b5c-8962-b6f6007eac31 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:21.064348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c2fe4bd-ab80-4b5c-8962-b6f6007eac31 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.067449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c2fe4bd-ab80-4b5c-8962-b6f6007eac31 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.067939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c2fe4bd-ab80-4b5c-8962-b6f6007eac31 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.071772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c2fe4bd-ab80-4b5c-8962-b6f6007eac31 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.072301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c2fe4bd-ab80-4b5c-8962-b6f6007eac31 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.073473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c2fe4bd-ab80-4b5c-8962-b6f6007eac31 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.383509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0c2fe4bd-ab80-4b5c-8962-b6f6007eac31 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.395595 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0c2fe4bd-ab80-4b5c-8962-b6f6007eac31 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1313 microversion: 2.1 time: 0.364038 Oct 04 18:20:21.396590 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2216/4424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:21.401719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:21.412790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.414149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:21.431046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.431549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.432009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.432733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.433226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.433656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.588817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:20:21.636044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:21.636510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:21.637002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:21.637592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:21.638166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:21.643789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:21.654061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.655107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.655840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.656741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.659136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.660920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.666421 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-075c91a6-7fbf-48c2-aa2b-e3444e1dc7d2 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.267806 Oct 04 18:20:21.667027 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2217/4425] 10.222.0.18 () {58 vars in 1212 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:21.673099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-a6ac3b9f-5a77-47c8-a78b-ecf90f641f83 req-4f88e8b0-3ade-41d9-bb0c-d30ffe4cf5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfce2b8c-1451-4e6e-9802-49cad53d29ac", "name": "network-vif-plugged", "status": "completed", "tag": "75f2329e-67cc-4cb9-abfb-15c8920110ee"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:21.684778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a6ac3b9f-5a77-47c8-a78b-ecf90f641f83 req-4f88e8b0-3ade-41d9-bb0c-d30ffe4cf5f9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.685447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a6ac3b9f-5a77-47c8-a78b-ecf90f641f83 req-4f88e8b0-3ade-41d9-bb0c-d30ffe4cf5f9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.686140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a6ac3b9f-5a77-47c8-a78b-ecf90f641f83 req-4f88e8b0-3ade-41d9-bb0c-d30ffe4cf5f9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.699621 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-a6ac3b9f-5a77-47c8-a78b-ecf90f641f83 req-4f88e8b0-3ade-41d9-bb0c-d30ffe4cf5f9 service nova] Creating event network-vif-plugged:75f2329e-67cc-4cb9-abfb-15c8920110ee for instance cfce2b8c-1451-4e6e-9802-49cad53d29ac on n-h1-850499-14 Oct 04 18:20:21.707520 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-a6ac3b9f-5a77-47c8-a78b-ecf90f641f83 req-4f88e8b0-3ade-41d9-bb0c-d30ffe4cf5f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038846 Oct 04 18:20:21.709074 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2218/4426] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:21.718011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:21.719088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:21.728782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.729719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.730313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.732047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.732994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.733580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.757982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:21.767085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for user 41e49c77352541cb94dcd12277f7ee67 and project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:21.786397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:21.789533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:21.853843 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59197a0c-562e-461b-b41a-635f87111e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436577 Oct 04 18:20:21.861230 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2209/4427] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:21.874051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:21.887281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.891437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:21.910600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.913488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.913488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.916633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.917304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.917815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.128742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:20:22.240317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.252018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.263289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.266579 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-62f23ba3-87df-4612-8a09-770dcb54624f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.556097 Oct 04 18:20:22.268164 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2219/4428] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:22.287308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f5b7a4d6-f101-402f-b704-41273ccfe0e6 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.288458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f5b7a4d6-f101-402f-b704-41273ccfe0e6 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:22.295737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b7a4d6-f101-402f-b704-41273ccfe0e6 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.296313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b7a4d6-f101-402f-b704-41273ccfe0e6 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.296972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b7a4d6-f101-402f-b704-41273ccfe0e6 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.297905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b7a4d6-f101-402f-b704-41273ccfe0e6 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.298359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b7a4d6-f101-402f-b704-41273ccfe0e6 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.298799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5b7a4d6-f101-402f-b704-41273ccfe0e6 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.312488 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f57c0c1-5d1f-48ff-a933-9e15f4b52e5a tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.450027 Oct 04 18:20:22.313085 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2210/4429] 10.222.0.18 () {58 vars in 1196 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:22.328768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cf961525-47cd-488a-a580-d98b071ef19d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.329399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cf961525-47cd-488a-a580-d98b071ef19d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:22.479474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cf961525-47cd-488a-a580-d98b071ef19d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.493271 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cf961525-47cd-488a-a580-d98b071ef19d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1192 microversion: 2.1 time: 0.174864 Oct 04 18:20:22.496614 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2211/4430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:22 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1192 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:22.512023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.523162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.524377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'name': '1670668334', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:22.532232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.532989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.533749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.534732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.535444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.536272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.569652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f5b7a4d6-f101-402f-b704-41273ccfe0e6 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.585871 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f5b7a4d6-f101-402f-b704-41273ccfe0e6 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1404 microversion: 2.1 time: 0.303740 Oct 04 18:20:22.588607 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2220/4431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:22 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1404 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:22.604308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42ed1eb7-fd7d-40d7-abc9-9eb1e3c63388 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.608990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42ed1eb7-fd7d-40d7-abc9-9eb1e3c63388 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:22.625188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ed1eb7-fd7d-40d7-abc9-9eb1e3c63388 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.625688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ed1eb7-fd7d-40d7-abc9-9eb1e3c63388 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.633815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ed1eb7-fd7d-40d7-abc9-9eb1e3c63388 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.634991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ed1eb7-fd7d-40d7-abc9-9eb1e3c63388 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.637098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ed1eb7-fd7d-40d7-abc9-9eb1e3c63388 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.638266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ed1eb7-fd7d-40d7-abc9-9eb1e3c63388 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.725423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:20:22.832878 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-303f7786-1144-4ba0-b95a-f7650b208e82 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?name=1670668334" status: 200 len: 346 microversion: 2.1 time: 0.334635 Oct 04 18:20:22.833630 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2212/4432] 10.222.0.18 () {58 vars in 1156 bytes} [Tue Oct 4 18:20:22 2022] GET /compute/v2.1/servers?name=1670668334 => generated 346 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:22.845465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-42ed1eb7-fd7d-40d7-abc9-9eb1e3c63388 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.847949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.856461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.857210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:22.863338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.863841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.866868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.866868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.866868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.866868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.870487 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42ed1eb7-fd7d-40d7-abc9-9eb1e3c63388 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1313 microversion: 2.1 time: 0.279145 Oct 04 18:20:22.876496 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2221/4433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:22 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:22.968835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:20:23.039259 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a649aa02-c534-49bb-bf87-2e87c6d93356 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.196536 Oct 04 18:20:23.040570 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2213/4434] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Oct 4 18:20:22 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:23.054369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.063348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.064699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-167066833', 'deleted': False, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:23.072912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.074012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.074612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.076123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.076840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.077902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.188896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:20:23.266280 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-357afdc7-bedd-43fe-b25f-4efcb5fc2bdb tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-167066833" status: 200 len: 346 microversion: 2.1 time: 0.216635 Oct 04 18:20:23.266993 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2222/4435] 10.222.0.18 () {58 vars in 1228 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-167066833 => generated 346 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:23.282503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-210cabe7-8454-4cc8-bda3-2f2061f0ae88 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.283193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-210cabe7-8454-4cc8-bda3-2f2061f0ae88 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.297670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210cabe7-8454-4cc8-bda3-2f2061f0ae88 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.298778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210cabe7-8454-4cc8-bda3-2f2061f0ae88 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.299492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210cabe7-8454-4cc8-bda3-2f2061f0ae88 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.301525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.302258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.304948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210cabe7-8454-4cc8-bda3-2f2061f0ae88 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.307037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210cabe7-8454-4cc8-bda3-2f2061f0ae88 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.308974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-210cabe7-8454-4cc8-bda3-2f2061f0ae88 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.314263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.314776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.315255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.315977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.316443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.317144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.352559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-210cabe7-8454-4cc8-bda3-2f2061f0ae88 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:23.478835 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-210cabe7-8454-4cc8-bda3-2f2061f0ae88 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 204 len: 0 microversion: 2.1 time: 0.202502 Oct 04 18:20:23.480386 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2214/4436] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:23 2022] DELETE /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:23.493072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96c496ca-4175-45e5-964b-95ddcb43eaca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.493979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96c496ca-4175-45e5-964b-95ddcb43eaca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.502597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c496ca-4175-45e5-964b-95ddcb43eaca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.503230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c496ca-4175-45e5-964b-95ddcb43eaca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.503771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c496ca-4175-45e5-964b-95ddcb43eaca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.505031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c496ca-4175-45e5-964b-95ddcb43eaca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.505745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c496ca-4175-45e5-964b-95ddcb43eaca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.506492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96c496ca-4175-45e5-964b-95ddcb43eaca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.745469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.767981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.774564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.778775 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b57d1682-6973-471e-a852-67ff2903eedf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.482987 Oct 04 18:20:23.779672 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2223/4437] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:23.807025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2da2911b-a18d-492d-8668-639af9eb4bf4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.807833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2da2911b-a18d-492d-8668-639af9eb4bf4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.814801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2da2911b-a18d-492d-8668-639af9eb4bf4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.815595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2da2911b-a18d-492d-8668-639af9eb4bf4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.816214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2da2911b-a18d-492d-8668-639af9eb4bf4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.817550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2da2911b-a18d-492d-8668-639af9eb4bf4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.818156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2da2911b-a18d-492d-8668-639af9eb4bf4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.818743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2da2911b-a18d-492d-8668-639af9eb4bf4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.832285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96c496ca-4175-45e5-964b-95ddcb43eaca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.842881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:23.848973 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96c496ca-4175-45e5-964b-95ddcb43eaca tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1518 microversion: 2.1 time: 0.361695 Oct 04 18:20:23.850121 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2215/4438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1518 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:23.880105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7142e669-4714-4f36-a50e-7bbf8eb554cc tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.880798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7142e669-4714-4f36-a50e-7bbf8eb554cc tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.901440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7142e669-4714-4f36-a50e-7bbf8eb554cc tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.905168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7142e669-4714-4f36-a50e-7bbf8eb554cc tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.906122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7142e669-4714-4f36-a50e-7bbf8eb554cc tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.906905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7142e669-4714-4f36-a50e-7bbf8eb554cc tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.907410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7142e669-4714-4f36-a50e-7bbf8eb554cc tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.907855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7142e669-4714-4f36-a50e-7bbf8eb554cc tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.943266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2da2911b-a18d-492d-8668-639af9eb4bf4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.969642 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2da2911b-a18d-492d-8668-639af9eb4bf4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1196 microversion: 2.1 time: 0.172041 Oct 04 18:20:23.970236 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2224/4439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1196 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:23.979506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c47ceb1e-2a3a-443e-a933-1e7c58aa2f4e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.980120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c47ceb1e-2a3a-443e-a933-1e7c58aa2f4e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.997217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47ceb1e-2a3a-443e-a933-1e7c58aa2f4e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.997729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47ceb1e-2a3a-443e-a933-1e7c58aa2f4e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.999328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47ceb1e-2a3a-443e-a933-1e7c58aa2f4e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.000737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47ceb1e-2a3a-443e-a933-1e7c58aa2f4e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.003847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47ceb1e-2a3a-443e-a933-1e7c58aa2f4e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.005063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c47ceb1e-2a3a-443e-a933-1e7c58aa2f4e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.197279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7142e669-4714-4f36-a50e-7bbf8eb554cc tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:24.216152 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7142e669-4714-4f36-a50e-7bbf8eb554cc tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1589 microversion: 2.1 time: 0.361478 Oct 04 18:20:24.218727 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2216/4440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1589 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:24.244119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6f5a9282-e84c-423b-a8cf-9d50736e48f9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:24.244660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6f5a9282-e84c-423b-a8cf-9d50736e48f9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:24.257859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f5a9282-e84c-423b-a8cf-9d50736e48f9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.258361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f5a9282-e84c-423b-a8cf-9d50736e48f9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.258361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f5a9282-e84c-423b-a8cf-9d50736e48f9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.265968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f5a9282-e84c-423b-a8cf-9d50736e48f9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.266544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f5a9282-e84c-423b-a8cf-9d50736e48f9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.267068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f5a9282-e84c-423b-a8cf-9d50736e48f9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.275293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c47ceb1e-2a3a-443e-a933-1e7c58aa2f4e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:24.287371 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c47ceb1e-2a3a-443e-a933-1e7c58aa2f4e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1313 microversion: 2.1 time: 0.314878 Oct 04 18:20:24.298981 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2225/4441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:24.403340 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6f5a9282-e84c-423b-a8cf-9d50736e48f9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163384 Oct 04 18:20:24.403952 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2217/4442] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:20:24 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:20:24.812298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:24.813066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:24.831433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.832117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.832689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.833474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.834667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.836007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.872333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-58569660-0939-493a-aff8-3dc31d18a58f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:24.872952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-58569660-0939-493a-aff8-3dc31d18a58f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:24.882584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58569660-0939-493a-aff8-3dc31d18a58f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.883117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58569660-0939-493a-aff8-3dc31d18a58f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.883560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58569660-0939-493a-aff8-3dc31d18a58f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.895187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58569660-0939-493a-aff8-3dc31d18a58f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.907588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58569660-0939-493a-aff8-3dc31d18a58f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.908179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58569660-0939-493a-aff8-3dc31d18a58f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.247447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.261680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.265117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.271803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-58569660-0939-493a-aff8-3dc31d18a58f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.280802 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-58569660-0939-493a-aff8-3dc31d18a58f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1518 microversion: 2.1 time: 0.412470 Oct 04 18:20:25.281763 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cab27d79-e088-4144-b917-1d8392da1df3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.468843 Oct 04 18:20:25.295411 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2226/4443] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:24 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:25.303716 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2218/4444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:24 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1518 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:25.305034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-31beb1d0-59f1-4d85-9037-1b189993edf7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:25.305888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-31beb1d0-59f1-4d85-9037-1b189993edf7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:25.312117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-37d47426-d3e8-4185-b7c6-6ca13e716edb tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:25.314335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-37d47426-d3e8-4185-b7c6-6ca13e716edb tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:25.322276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31beb1d0-59f1-4d85-9037-1b189993edf7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.326015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31beb1d0-59f1-4d85-9037-1b189993edf7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.326730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31beb1d0-59f1-4d85-9037-1b189993edf7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.327659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31beb1d0-59f1-4d85-9037-1b189993edf7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.328273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31beb1d0-59f1-4d85-9037-1b189993edf7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.328846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d47426-d3e8-4185-b7c6-6ca13e716edb tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.330675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-31beb1d0-59f1-4d85-9037-1b189993edf7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.331273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d47426-d3e8-4185-b7c6-6ca13e716edb tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.336098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d47426-d3e8-4185-b7c6-6ca13e716edb tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.337029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d47426-d3e8-4185-b7c6-6ca13e716edb tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.337639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d47426-d3e8-4185-b7c6-6ca13e716edb tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.338204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37d47426-d3e8-4185-b7c6-6ca13e716edb tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.475548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-31beb1d0-59f1-4d85-9037-1b189993edf7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.486310 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-31beb1d0-59f1-4d85-9037-1b189993edf7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1196 microversion: 2.1 time: 0.189747 Oct 04 18:20:25.489466 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2227/4445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:25 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1196 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:25.498798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-233beace-f39e-432f-a703-bd0c87c4c911 req-1366c162-b400-4db6-9d4a-20d2b7c7b7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8380cc-7414-4d96-bd4b-265dd21f78b0", "name": "network-vif-plugged", "status": "completed", "tag": "ed52627b-61b9-4928-a2b7-9227419da931"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:25.525185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-233beace-f39e-432f-a703-bd0c87c4c911 req-1366c162-b400-4db6-9d4a-20d2b7c7b7a4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.525683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-233beace-f39e-432f-a703-bd0c87c4c911 req-1366c162-b400-4db6-9d4a-20d2b7c7b7a4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.528980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-233beace-f39e-432f-a703-bd0c87c4c911 req-1366c162-b400-4db6-9d4a-20d2b7c7b7a4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.543403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-233beace-f39e-432f-a703-bd0c87c4c911 req-1366c162-b400-4db6-9d4a-20d2b7c7b7a4 service nova] Creating event network-vif-plugged:ed52627b-61b9-4928-a2b7-9227419da931 for instance 2a8380cc-7414-4d96-bd4b-265dd21f78b0 on n-h1-850499-14 Oct 04 18:20:25.560758 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-233beace-f39e-432f-a703-bd0c87c4c911 req-1366c162-b400-4db6-9d4a-20d2b7c7b7a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069786 Oct 04 18:20:25.561404 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2228/4446] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:25.682465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-37d47426-d3e8-4185-b7c6-6ca13e716edb tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.694196 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-37d47426-d3e8-4185-b7c6-6ca13e716edb tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1313 microversion: 2.1 time: 0.386155 Oct 04 18:20:25.695165 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2219/4447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:25 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:26.124837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-69233366-77a0-4ea0-ab3b-d97e6860e8e9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.126829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-69233366-77a0-4ea0-ab3b-d97e6860e8e9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.130432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-24f5e72d-b83b-4aba-b235-6c2e3ab78db4 req-7cfb63d2-8b8f-4ef8-a20c-1fb25e01ba12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfce2b8c-1451-4e6e-9802-49cad53d29ac", "tag": "75f2329e-67cc-4cb9-abfb-15c8920110ee"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:26.137643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69233366-77a0-4ea0-ab3b-d97e6860e8e9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.138469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69233366-77a0-4ea0-ab3b-d97e6860e8e9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.139744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69233366-77a0-4ea0-ab3b-d97e6860e8e9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.140938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69233366-77a0-4ea0-ab3b-d97e6860e8e9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.141628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69233366-77a0-4ea0-ab3b-d97e6860e8e9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.143770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69233366-77a0-4ea0-ab3b-d97e6860e8e9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.145435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-24f5e72d-b83b-4aba-b235-6c2e3ab78db4 req-7cfb63d2-8b8f-4ef8-a20c-1fb25e01ba12 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.145932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-24f5e72d-b83b-4aba-b235-6c2e3ab78db4 req-7cfb63d2-8b8f-4ef8-a20c-1fb25e01ba12 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.146371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-24f5e72d-b83b-4aba-b235-6c2e3ab78db4 req-7cfb63d2-8b8f-4ef8-a20c-1fb25e01ba12 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.178091 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-24f5e72d-b83b-4aba-b235-6c2e3ab78db4 req-7cfb63d2-8b8f-4ef8-a20c-1fb25e01ba12 service nova] Creating event network-changed:75f2329e-67cc-4cb9-abfb-15c8920110ee for instance cfce2b8c-1451-4e6e-9802-49cad53d29ac on n-h1-850499-14 Oct 04 18:20:26.192315 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-24f5e72d-b83b-4aba-b235-6c2e3ab78db4 req-7cfb63d2-8b8f-4ef8-a20c-1fb25e01ba12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065143 Oct 04 18:20:26.195182 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2220/4448] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:20:26.309855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-383cb00e-b812-43fc-bdbc-fcdacf5ecc42 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.310840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-383cb00e-b812-43fc-bdbc-fcdacf5ecc42 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.326878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-383cb00e-b812-43fc-bdbc-fcdacf5ecc42 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.329083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-383cb00e-b812-43fc-bdbc-fcdacf5ecc42 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.329544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-383cb00e-b812-43fc-bdbc-fcdacf5ecc42 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.330271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-383cb00e-b812-43fc-bdbc-fcdacf5ecc42 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.330738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-383cb00e-b812-43fc-bdbc-fcdacf5ecc42 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.331251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-383cb00e-b812-43fc-bdbc-fcdacf5ecc42 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.400963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-69233366-77a0-4ea0-ab3b-d97e6860e8e9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.409161 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-69233366-77a0-4ea0-ab3b-d97e6860e8e9 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1589 microversion: 2.1 time: 0.289735 Oct 04 18:20:26.409743 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2229/4449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1589 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:26.432757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.433659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.440231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.444680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.445195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.445945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.446416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.446884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.668839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-383cb00e-b812-43fc-bdbc-fcdacf5ecc42 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.682064 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-383cb00e-b812-43fc-bdbc-fcdacf5ecc42 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1518 microversion: 2.1 time: 0.382639 Oct 04 18:20:26.682573 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2221/4450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1518 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:26.698807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a8c059b9-8df1-423d-817f-17fe282a82a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.699523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a8c059b9-8df1-423d-817f-17fe282a82a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.710459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8c059b9-8df1-423d-817f-17fe282a82a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.710979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8c059b9-8df1-423d-817f-17fe282a82a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.716565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8c059b9-8df1-423d-817f-17fe282a82a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.717994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8c059b9-8df1-423d-817f-17fe282a82a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.718479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8c059b9-8df1-423d-817f-17fe282a82a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.718915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8c059b9-8df1-423d-817f-17fe282a82a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.760095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.781424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.783018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.784293 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b510136-f72b-422a-97e1-d6bb3b5c7471 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.356146 Oct 04 18:20:26.784885 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2230/4451] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:26.802453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aa13f496-356c-42af-a834-4e3a6bb87e90 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.803072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aa13f496-356c-42af-a834-4e3a6bb87e90 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.824240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa13f496-356c-42af-a834-4e3a6bb87e90 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.825040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa13f496-356c-42af-a834-4e3a6bb87e90 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.826119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa13f496-356c-42af-a834-4e3a6bb87e90 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.827395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa13f496-356c-42af-a834-4e3a6bb87e90 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.829045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa13f496-356c-42af-a834-4e3a6bb87e90 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.829709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa13f496-356c-42af-a834-4e3a6bb87e90 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.962352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a8c059b9-8df1-423d-817f-17fe282a82a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.973411 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a8c059b9-8df1-423d-817f-17fe282a82a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1188 microversion: 2.1 time: 0.289728 Oct 04 18:20:26.979596 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2222/4452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:27.181298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa13f496-356c-42af-a834-4e3a6bb87e90 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.190861 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aa13f496-356c-42af-a834-4e3a6bb87e90 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1313 microversion: 2.1 time: 0.394643 Oct 04 18:20:27.195691 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2231/4453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:27.710550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-50a19abc-9bb3-417b-ac7b-c2df17e169e4 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:27.711684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-50a19abc-9bb3-417b-ac7b-c2df17e169e4 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:27.730522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a19abc-9bb3-417b-ac7b-c2df17e169e4 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.733869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a19abc-9bb3-417b-ac7b-c2df17e169e4 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.734549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a19abc-9bb3-417b-ac7b-c2df17e169e4 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.742100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-df23bd5e-decf-47a8-8005-31d1211de478 req-87ed7e5e-e47c-4fd3-8788-e154fffb5802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-plugged", "status": "completed", "tag": "545c6404-6880-41fc-9a80-8ac8aec3c32f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:27.748479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a19abc-9bb3-417b-ac7b-c2df17e169e4 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.754829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a19abc-9bb3-417b-ac7b-c2df17e169e4 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.759127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-50a19abc-9bb3-417b-ac7b-c2df17e169e4 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.775662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-df23bd5e-decf-47a8-8005-31d1211de478 req-87ed7e5e-e47c-4fd3-8788-e154fffb5802 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.780210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-df23bd5e-decf-47a8-8005-31d1211de478 req-87ed7e5e-e47c-4fd3-8788-e154fffb5802 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.784145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-df23bd5e-decf-47a8-8005-31d1211de478 req-87ed7e5e-e47c-4fd3-8788-e154fffb5802 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.817056 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-df23bd5e-decf-47a8-8005-31d1211de478 req-87ed7e5e-e47c-4fd3-8788-e154fffb5802 service nova] Creating event network-vif-plugged:545c6404-6880-41fc-9a80-8ac8aec3c32f for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:20:27.838552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:27.844995 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-df23bd5e-decf-47a8-8005-31d1211de478 req-87ed7e5e-e47c-4fd3-8788-e154fffb5802 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107202 Oct 04 18:20:27.853206 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2232/4454] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:20:27.870152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:27.876792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:27.898341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.902541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.906650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.907651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.908144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.908593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.184482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-50a19abc-9bb3-417b-ac7b-c2df17e169e4 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.199412 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-50a19abc-9bb3-417b-ac7b-c2df17e169e4 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1476 microversion: 2.1 time: 0.493538 Oct 04 18:20:28.200574 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2223/4455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:27 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1476 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:28.208570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-76cb5ce5-c6d3-4bef-b200-351405344cd9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.209198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-76cb5ce5-c6d3-4bef-b200-351405344cd9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:28.226738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76cb5ce5-c6d3-4bef-b200-351405344cd9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.229940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76cb5ce5-c6d3-4bef-b200-351405344cd9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.230418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76cb5ce5-c6d3-4bef-b200-351405344cd9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.231196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76cb5ce5-c6d3-4bef-b200-351405344cd9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.232855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76cb5ce5-c6d3-4bef-b200-351405344cd9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.233298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76cb5ce5-c6d3-4bef-b200-351405344cd9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.472834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-76cb5ce5-c6d3-4bef-b200-351405344cd9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.498935 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-76cb5ce5-c6d3-4bef-b200-351405344cd9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1250 microversion: 2.1 time: 0.297192 Oct 04 18:20:28.504469 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2224/4456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1250 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:28.519191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-720ae5ff-e697-4be6-a5fc-b8e52cc6d46b req-e3f0701a-1997-45cf-a34a-22741b75b168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c70bd86-e768-4043-92d9-3e77fef9bea6", "name": "network-vif-deleted", "tag": "61b6d22f-c201-441f-9d3e-c4a8a7d91fd2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:28.556761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-720ae5ff-e697-4be6-a5fc-b8e52cc6d46b req-e3f0701a-1997-45cf-a34a-22741b75b168 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.557467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-720ae5ff-e697-4be6-a5fc-b8e52cc6d46b req-e3f0701a-1997-45cf-a34a-22741b75b168 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.558330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-720ae5ff-e697-4be6-a5fc-b8e52cc6d46b req-e3f0701a-1997-45cf-a34a-22741b75b168 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.593258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-720ae5ff-e697-4be6-a5fc-b8e52cc6d46b req-e3f0701a-1997-45cf-a34a-22741b75b168 service nova] Creating event network-vif-deleted:61b6d22f-c201-441f-9d3e-c4a8a7d91fd2 for instance 2c70bd86-e768-4043-92d9-3e77fef9bea6 on n-h2-850499-14 Oct 04 18:20:28.610240 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-720ae5ff-e697-4be6-a5fc-b8e52cc6d46b req-e3f0701a-1997-45cf-a34a-22741b75b168 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101960 Oct 04 18:20:28.611169 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2225/4457] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:28.626626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-39a28744-873d-484d-b819-c7070d31cd8d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.630174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-39a28744-873d-484d-b819-c7070d31cd8d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:28.645225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39a28744-873d-484d-b819-c7070d31cd8d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.648245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39a28744-873d-484d-b819-c7070d31cd8d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.648948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39a28744-873d-484d-b819-c7070d31cd8d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.660143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39a28744-873d-484d-b819-c7070d31cd8d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.666137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39a28744-873d-484d-b819-c7070d31cd8d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.667931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-39a28744-873d-484d-b819-c7070d31cd8d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.781856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.799026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.801017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.803622 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-abe2c6b2-9a8e-4152-a2b3-4a15f4265318 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.948544 Oct 04 18:20:28.821287 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2233/4458] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:27 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:29.062906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-39a28744-873d-484d-b819-c7070d31cd8d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:29.077632 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-39a28744-873d-484d-b819-c7070d31cd8d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1499 microversion: 2.1 time: 0.463670 Oct 04 18:20:29.092117 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2226/4459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1499 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:29.102656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1fb4d4f5-8cfe-4839-8f79-d7cfaba4f393 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:29.105460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1fb4d4f5-8cfe-4839-8f79-d7cfaba4f393 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.111906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4d4f5-8cfe-4839-8f79-d7cfaba4f393 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.112854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4d4f5-8cfe-4839-8f79-d7cfaba4f393 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.113642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4d4f5-8cfe-4839-8f79-d7cfaba4f393 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.114594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4d4f5-8cfe-4839-8f79-d7cfaba4f393 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.115329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4d4f5-8cfe-4839-8f79-d7cfaba4f393 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.115981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4d4f5-8cfe-4839-8f79-d7cfaba4f393 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.226120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.226854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.238196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.239536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.241024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.242007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.244428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.246407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.323431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.325593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.327857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.328446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lazy-loading 'fault' on Instance uuid 2c70bd86-e768-4043-92d9-3e77fef9bea6 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:29.486613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:29.498076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33a9efc4-ede5-4845-acd1-67355da12a3c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 200 len: 1311 microversion: 2.1 time: 0.272501 Oct 04 18:20:29.499147 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2227/4460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 1311 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:29.532133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-38c488a2-d458-4a4e-bf44-2bbec6978e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.533199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-38c488a2-d458-4a4e-bf44-2bbec6978e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.549667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38c488a2-d458-4a4e-bf44-2bbec6978e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.550248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38c488a2-d458-4a4e-bf44-2bbec6978e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.554045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38c488a2-d458-4a4e-bf44-2bbec6978e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.556190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38c488a2-d458-4a4e-bf44-2bbec6978e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.556841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38c488a2-d458-4a4e-bf44-2bbec6978e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.558781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38c488a2-d458-4a4e-bf44-2bbec6978e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.636704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-1fb4d4f5-8cfe-4839-8f79-d7cfaba4f393 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lazy-loading 'flavor' on Instance uuid 2a8380cc-7414-4d96-bd4b-265dd21f78b0 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:29.799798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:29.811328 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1fb4d4f5-8cfe-4839-8f79-d7cfaba4f393 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "POST /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0/action" status: 200 len: 32 microversion: 2.1 time: 0.712889 Oct 04 18:20:29.812282 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2234/4461] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:29 2022] POST /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0/action => generated 32 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:20:29.824657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-325319f5-5eb9-4fe6-8b37-f3d85b4954f3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.825840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-325319f5-5eb9-4fe6-8b37-f3d85b4954f3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.861312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-325319f5-5eb9-4fe6-8b37-f3d85b4954f3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.861929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-325319f5-5eb9-4fe6-8b37-f3d85b4954f3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.862392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-325319f5-5eb9-4fe6-8b37-f3d85b4954f3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.866524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-325319f5-5eb9-4fe6-8b37-f3d85b4954f3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.867587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-325319f5-5eb9-4fe6-8b37-f3d85b4954f3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.869361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-325319f5-5eb9-4fe6-8b37-f3d85b4954f3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.887338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-38c488a2-d458-4a4e-bf44-2bbec6978e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:29.897554 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-38c488a2-d458-4a4e-bf44-2bbec6978e4c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.370670 Oct 04 18:20:29.915342 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2228/4462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:29.922612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.923969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.933634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.934311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.934935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.936394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.937019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.937618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.416482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-325319f5-5eb9-4fe6-8b37-f3d85b4954f3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.427633 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-325319f5-5eb9-4fe6-8b37-f3d85b4954f3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.608876 Oct 04 18:20:30.433562 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2235/4463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:30.481406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.499364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.501794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.504096 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ecc6d5fd-f8c7-4a52-8d2b-e3a7e97aa666 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.586748 Oct 04 18:20:30.505359 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2229/4464] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:30.521533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.522336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 2c70bd86-e768-4043-92d9-3e77fef9bea6] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.529780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.530415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.531095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.531975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.532593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.533316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.555689 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] HTTP exception thrown: Instance 2c70bd86-e768-4043-92d9-3e77fef9bea6 could not be found. Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Request method failure captured: Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 HTTP/1.1 Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHkVoSIa5R9msG1EmrtePM-mR8BanHy1vn4-nr_bleQF1jNd3mOHDzDdt4YukQ3hEXuqcC8CJa97ysseghOgzrcGbLjl4-3CVZv9fkcZdKD0L2Vrp8P7W97E8WM24tlPs7mkibDSZ8i0kBxXCB1Fz9rMxXi96idyrDkfMXl3Rfg37DQ Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5ce3d6d3d3484f07b73e3c0a59c8cac0 Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ListServerFiltersTestJSON-717233930 Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}] Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ListServerFiltersTestJSON-717233930 Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5ce3d6d3d3484f07b73e3c0a59c8cac0 Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-717233930 Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ListServerFiltersTestJSON-717233930-project Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: c0e59b12d4914829a6b3e4f7b9f96779 Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ListServerFiltersTestJSON-717233930-project Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 2c70bd86-e768-4043-92d9-3e77fef9bea6 could not be found. Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '2c70bd86-e768-4043-92d9-3e77fef9bea6'} Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c70bd86-e768-4043-92d9-3e77fef9bea6 could not be found. Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c70bd86-e768-4043-92d9-3e77fef9bea6 could not be found. Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:30.557555 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:30.561860 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:30.561860 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:30.561860 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:30.561860 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:30.561860 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:30.561860 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c70bd86-e768-4043-92d9-3e77fef9bea6 could not be found. Oct 04 18:20:30.561860 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:30.563907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Returning 404 to user: Instance 2c70bd86-e768-4043-92d9-3e77fef9bea6 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:30.564981 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c5656177-bd5d-4e03-8f51-cdfc67e9592f tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6" status: 404 len: 111 microversion: 2.1 time: 0.047436 Oct 04 18:20:30.565543 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2236/4465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:30 2022] GET /compute/v2.1/servers/2c70bd86-e768-4043-92d9-3e77fef9bea6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:30.573888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3014bd0d-e02a-4e1e-8a5f-450670a4c760 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.574797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3014bd0d-e02a-4e1e-8a5f-450670a4c760 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: de379391-e467-452e-93b4-9fbfe268a32c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.580972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3014bd0d-e02a-4e1e-8a5f-450670a4c760 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.581817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3014bd0d-e02a-4e1e-8a5f-450670a4c760 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.582465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3014bd0d-e02a-4e1e-8a5f-450670a4c760 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.583394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3014bd0d-e02a-4e1e-8a5f-450670a4c760 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.584045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3014bd0d-e02a-4e1e-8a5f-450670a4c760 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.584666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3014bd0d-e02a-4e1e-8a5f-450670a4c760 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.614834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3014bd0d-e02a-4e1e-8a5f-450670a4c760 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: de379391-e467-452e-93b4-9fbfe268a32c] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:30.702236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c4b73bf3-6ce0-4973-b51b-4fba50a90c46 req-be39ac33-8081-4110-ac01-92e97221324f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e9a3ac3-3557-45f7-b366-9c725dc9cacd", "tag": "c648dcfc-5668-4287-bf56-52c2ada998a3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:30.730068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c4b73bf3-6ce0-4973-b51b-4fba50a90c46 req-be39ac33-8081-4110-ac01-92e97221324f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.733434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c4b73bf3-6ce0-4973-b51b-4fba50a90c46 req-be39ac33-8081-4110-ac01-92e97221324f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.733958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c4b73bf3-6ce0-4973-b51b-4fba50a90c46 req-be39ac33-8081-4110-ac01-92e97221324f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.782365 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c4b73bf3-6ce0-4973-b51b-4fba50a90c46 req-be39ac33-8081-4110-ac01-92e97221324f service nova] Creating event network-changed:c648dcfc-5668-4287-bf56-52c2ada998a3 for instance 1e9a3ac3-3557-45f7-b366-9c725dc9cacd on n-h2-850499-14 Oct 04 18:20:30.796986 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3014bd0d-e02a-4e1e-8a5f-450670a4c760 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c" status: 204 len: 0 microversion: 2.1 time: 0.224569 Oct 04 18:20:30.797850 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2230/4466] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:30 2022] DELETE /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:30.803527 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c4b73bf3-6ce0-4973-b51b-4fba50a90c46 req-be39ac33-8081-4110-ac01-92e97221324f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110829 Oct 04 18:20:30.809384 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2237/4467] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:30.811032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c48e7247-cfe3-4a7c-8dc9-085e7a93992e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.811665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c48e7247-cfe3-4a7c-8dc9-085e7a93992e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: de379391-e467-452e-93b4-9fbfe268a32c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.819419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48e7247-cfe3-4a7c-8dc9-085e7a93992e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.822876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48e7247-cfe3-4a7c-8dc9-085e7a93992e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.823393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48e7247-cfe3-4a7c-8dc9-085e7a93992e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.847585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48e7247-cfe3-4a7c-8dc9-085e7a93992e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.848261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48e7247-cfe3-4a7c-8dc9-085e7a93992e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.849801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48e7247-cfe3-4a7c-8dc9-085e7a93992e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.922871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8e780052-67bb-46f5-a1f2-7bf765a8a3ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.923674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8e780052-67bb-46f5-a1f2-7bf765a8a3ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.932904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e780052-67bb-46f5-a1f2-7bf765a8a3ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.935680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e780052-67bb-46f5-a1f2-7bf765a8a3ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.937297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e780052-67bb-46f5-a1f2-7bf765a8a3ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.938337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e780052-67bb-46f5-a1f2-7bf765a8a3ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.940298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e780052-67bb-46f5-a1f2-7bf765a8a3ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.942428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8e780052-67bb-46f5-a1f2-7bf765a8a3ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.054832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c48e7247-cfe3-4a7c-8dc9-085e7a93992e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:31.082983 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c48e7247-cfe3-4a7c-8dc9-085e7a93992e tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c" status: 200 len: 1519 microversion: 2.1 time: 0.277646 Oct 04 18:20:31.083983 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2231/4468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:30 2022] GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:31.137377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8e780052-67bb-46f5-a1f2-7bf765a8a3ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:31.149020 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8e780052-67bb-46f5-a1f2-7bf765a8a3ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.231046 Oct 04 18:20:31.150366 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2238/4469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:30 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:31.453802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a33408ea-823b-492e-a3a2-2f4d0f3f402f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:31.454696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a33408ea-823b-492e-a3a2-2f4d0f3f402f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:31.461201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a33408ea-823b-492e-a3a2-2f4d0f3f402f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.461891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a33408ea-823b-492e-a3a2-2f4d0f3f402f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.462534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a33408ea-823b-492e-a3a2-2f4d0f3f402f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.463331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a33408ea-823b-492e-a3a2-2f4d0f3f402f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.463852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a33408ea-823b-492e-a3a2-2f4d0f3f402f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.464511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a33408ea-823b-492e-a3a2-2f4d0f3f402f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.534193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:31.535041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:31.542042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.542549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.543348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.544106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.545396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.546124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.726321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a33408ea-823b-492e-a3a2-2f4d0f3f402f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:31.743797 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a33408ea-823b-492e-a3a2-2f4d0f3f402f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.294756 Oct 04 18:20:31.746168 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2232/4470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:31 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.109300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-afc9d2ff-ba3b-4945-9c27-c5ec068c34b1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.110179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-afc9d2ff-ba3b-4945-9c27-c5ec068c34b1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: de379391-e467-452e-93b4-9fbfe268a32c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.118772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc9d2ff-ba3b-4945-9c27-c5ec068c34b1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.120344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc9d2ff-ba3b-4945-9c27-c5ec068c34b1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.121087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc9d2ff-ba3b-4945-9c27-c5ec068c34b1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.123785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc9d2ff-ba3b-4945-9c27-c5ec068c34b1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.125711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc9d2ff-ba3b-4945-9c27-c5ec068c34b1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.126266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc9d2ff-ba3b-4945-9c27-c5ec068c34b1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.197310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.211214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.213968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.215386 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d773ec6b-ed65-49f7-8794-9effa9741e5a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.687814 Oct 04 18:20:32.215968 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2239/4471] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:31 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:32.222473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3436dfaf-d4c1-438f-ba8f-7d0313cd2cd0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.223125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3436dfaf-d4c1-438f-ba8f-7d0313cd2cd0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.235317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3436dfaf-d4c1-438f-ba8f-7d0313cd2cd0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.236071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3436dfaf-d4c1-438f-ba8f-7d0313cd2cd0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.236819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3436dfaf-d4c1-438f-ba8f-7d0313cd2cd0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.239221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3436dfaf-d4c1-438f-ba8f-7d0313cd2cd0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.239948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3436dfaf-d4c1-438f-ba8f-7d0313cd2cd0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.240400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3436dfaf-d4c1-438f-ba8f-7d0313cd2cd0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.357737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-afc9d2ff-ba3b-4945-9c27-c5ec068c34b1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.367907 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-afc9d2ff-ba3b-4945-9c27-c5ec068c34b1 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c" status: 200 len: 1519 microversion: 2.1 time: 0.263107 Oct 04 18:20:32.379158 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2233/4472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:32.500443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3436dfaf-d4c1-438f-ba8f-7d0313cd2cd0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.509935 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3436dfaf-d4c1-438f-ba8f-7d0313cd2cd0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.292658 Oct 04 18:20:32.511090 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2240/4473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.774516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f6e7964e-f46a-4607-8720-0702a939831b tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.776240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f6e7964e-f46a-4607-8720-0702a939831b tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.778443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:32.785258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6e7964e-f46a-4607-8720-0702a939831b tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.786191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6e7964e-f46a-4607-8720-0702a939831b tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.786986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6e7964e-f46a-4607-8720-0702a939831b tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.788111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6e7964e-f46a-4607-8720-0702a939831b tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.788753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6e7964e-f46a-4607-8720-0702a939831b tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.789447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6e7964e-f46a-4607-8720-0702a939831b tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.911653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:33.098305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-cd602a65-836a-42b9-8fb2-4f156ef5200c req-f5765b02-b13d-43bb-a298-e3246f21cb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de379391-e467-452e-93b4-9fbfe268a32c", "name": "network-vif-deleted", "tag": "81e9aade-f2b8-4784-a02a-349656092364"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:33.114158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:33.115054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f6e7964e-f46a-4607-8720-0702a939831b tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.119634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cd602a65-836a-42b9-8fb2-4f156ef5200c req-f5765b02-b13d-43bb-a298-e3246f21cb3d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.120790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cd602a65-836a-42b9-8fb2-4f156ef5200c req-f5765b02-b13d-43bb-a298-e3246f21cb3d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.121945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cd602a65-836a-42b9-8fb2-4f156ef5200c req-f5765b02-b13d-43bb-a298-e3246f21cb3d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.128234 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f6e7964e-f46a-4607-8720-0702a939831b tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.357649 Oct 04 18:20:33.129119 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2234/4474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:33.146572 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-cd602a65-836a-42b9-8fb2-4f156ef5200c req-f5765b02-b13d-43bb-a298-e3246f21cb3d service nova] Creating event network-vif-deleted:81e9aade-f2b8-4784-a02a-349656092364 for instance de379391-e467-452e-93b4-9fbfe268a32c on n-h1-850499-14 Oct 04 18:20:33.153833 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-cd602a65-836a-42b9-8fb2-4f156ef5200c req-f5765b02-b13d-43bb-a298-e3246f21cb3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064384 Oct 04 18:20:33.155655 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2241/4475] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:33.243516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:33.244525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:33.256436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.257245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.257726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.258447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.259032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.259462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.395727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:33.397075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: de379391-e467-452e-93b4-9fbfe268a32c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:33.424105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.426116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.426780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.428792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.429541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.430579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.491950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:33.521767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.522685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.523720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.524387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lazy-loading 'fault' on Instance uuid de379391-e467-452e-93b4-9fbfe268a32c {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:33.626633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.637382 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2246c96d-7421-4fba-bc3d-92bd11aa6e26 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c" status: 200 len: 1311 microversion: 2.1 time: 0.247745 Oct 04 18:20:33.641692 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2242/4476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:33 2022] GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c => generated 1311 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:33.652339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0b797be8-f86b-45e4-9454-57bf79ad1871 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:33.655193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0b797be8-f86b-45e4-9454-57bf79ad1871 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:33.672980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b797be8-f86b-45e4-9454-57bf79ad1871 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.673777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b797be8-f86b-45e4-9454-57bf79ad1871 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.675001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b797be8-f86b-45e4-9454-57bf79ad1871 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.677253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b797be8-f86b-45e4-9454-57bf79ad1871 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.678728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b797be8-f86b-45e4-9454-57bf79ad1871 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.679748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b797be8-f86b-45e4-9454-57bf79ad1871 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.712738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.725265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.726981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.728411 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9fc51841-3b5c-406f-be72-ca797b9b463e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.488518 Oct 04 18:20:33.729355 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2235/4477] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:33 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:33.871901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0b797be8-f86b-45e4-9454-57bf79ad1871 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.880762 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0b797be8-f86b-45e4-9454-57bf79ad1871 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.237754 Oct 04 18:20:33.881835 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2243/4478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:33 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:34.162874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-19e8161c-b526-41fd-b927-f43cc29ac09d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.163578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-19e8161c-b526-41fd-b927-f43cc29ac09d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.173122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19e8161c-b526-41fd-b927-f43cc29ac09d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.174288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19e8161c-b526-41fd-b927-f43cc29ac09d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.174985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19e8161c-b526-41fd-b927-f43cc29ac09d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.175784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19e8161c-b526-41fd-b927-f43cc29ac09d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.176377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19e8161c-b526-41fd-b927-f43cc29ac09d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.176813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19e8161c-b526-41fd-b927-f43cc29ac09d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.336989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-19e8161c-b526-41fd-b927-f43cc29ac09d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:34.347489 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-19e8161c-b526-41fd-b927-f43cc29ac09d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.195300 Oct 04 18:20:34.348914 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2236/4479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:34.665117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.665900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: de379391-e467-452e-93b4-9fbfe268a32c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.673436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.673929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.674371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.675098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.675556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.676305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.691541 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] HTTP exception thrown: Instance de379391-e467-452e-93b4-9fbfe268a32c could not be found. Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Request method failure captured: Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c HTTP/1.1 Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHkVoSIa5R9msG1EmrtePM-mR8BanHy1vn4-nr_bleQF1jNd3mOHDzDdt4YukQ3hEXuqcC8CJa97ysseghOgzrcGbLjl4-3CVZv9fkcZdKD0L2Vrp8P7W97E8WM24tlPs7mkibDSZ8i0kBxXCB1Fz9rMxXi96idyrDkfMXl3Rfg37DQ Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5ce3d6d3d3484f07b73e3c0a59c8cac0 Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ListServerFiltersTestJSON-717233930 Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}] Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ListServerFiltersTestJSON-717233930 Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5ce3d6d3d3484f07b73e3c0a59c8cac0 Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-717233930 Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ListServerFiltersTestJSON-717233930-project Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: c0e59b12d4914829a6b3e4f7b9f96779 Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ListServerFiltersTestJSON-717233930-project Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance de379391-e467-452e-93b4-9fbfe268a32c could not be found. Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'de379391-e467-452e-93b4-9fbfe268a32c'} Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de379391-e467-452e-93b4-9fbfe268a32c could not be found. Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de379391-e467-452e-93b4-9fbfe268a32c could not be found. Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:34.693314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:34.697035 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:34.697035 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:34.697035 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:34.697035 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:34.697035 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:34.697035 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de379391-e467-452e-93b4-9fbfe268a32c could not be found. Oct 04 18:20:34.697035 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:34.697035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Returning 404 to user: Instance de379391-e467-452e-93b4-9fbfe268a32c could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:34.697035 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cfbae895-5e1c-41ee-a4c0-cb9678434b6c tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c" status: 404 len: 111 microversion: 2.1 time: 0.033744 Oct 04 18:20:34.697035 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2244/4480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/de379391-e467-452e-93b4-9fbfe268a32c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:20:34.707306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-278f7bf9-3ec4-405b-83df-5969b7027408 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.707821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-278f7bf9-3ec4-405b-83df-5969b7027408 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.713785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278f7bf9-3ec4-405b-83df-5969b7027408 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.714321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278f7bf9-3ec4-405b-83df-5969b7027408 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.714770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278f7bf9-3ec4-405b-83df-5969b7027408 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.715500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278f7bf9-3ec4-405b-83df-5969b7027408 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.715968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278f7bf9-3ec4-405b-83df-5969b7027408 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.716430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-278f7bf9-3ec4-405b-83df-5969b7027408 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.742507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-278f7bf9-3ec4-405b-83df-5969b7027408 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:34.753910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.754769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.763573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.763573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.763573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.763573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.763979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.764247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.809039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:34.866943 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-278f7bf9-3ec4-405b-83df-5969b7027408 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 204 len: 0 microversion: 2.1 time: 0.163924 Oct 04 18:20:34.867582 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2237/4481] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:34 2022] DELETE /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:34.879263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-694a521d-acb7-4605-acc1-daa9045c6ffe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.880169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-694a521d-acb7-4605-acc1-daa9045c6ffe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.889699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694a521d-acb7-4605-acc1-daa9045c6ffe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.890298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694a521d-acb7-4605-acc1-daa9045c6ffe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.891009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694a521d-acb7-4605-acc1-daa9045c6ffe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.891842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694a521d-acb7-4605-acc1-daa9045c6ffe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.892437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694a521d-acb7-4605-acc1-daa9045c6ffe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.892956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-694a521d-acb7-4605-acc1-daa9045c6ffe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.147281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-694a521d-acb7-4605-acc1-daa9045c6ffe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.159645 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-694a521d-acb7-4605-acc1-daa9045c6ffe tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1518 microversion: 2.1 time: 0.286796 Oct 04 18:20:35.160565 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2238/4482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1518 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:35.168906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-08a783fe-d9a7-4dd1-8429-5fdb86fc0250 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:35.170822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-08a783fe-d9a7-4dd1-8429-5fdb86fc0250 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:35.189124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.194067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08a783fe-d9a7-4dd1-8429-5fdb86fc0250 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.195319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08a783fe-d9a7-4dd1-8429-5fdb86fc0250 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.197278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08a783fe-d9a7-4dd1-8429-5fdb86fc0250 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.198089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08a783fe-d9a7-4dd1-8429-5fdb86fc0250 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.199634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08a783fe-d9a7-4dd1-8429-5fdb86fc0250 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.200147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.201417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08a783fe-d9a7-4dd1-8429-5fdb86fc0250 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.202668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.204190 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-627c8990-4814-4d5a-8333-2cc14efd0674 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.454297 Oct 04 18:20:35.204914 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2245/4483] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:35.215951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-eebc0c4a-8f11-4fd1-bba4-e371f62d9bfe req-7d22ecdb-e937-442c-b083-dd5b9c5adef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-plugged", "status": "completed", "tag": "f48712ec-9677-458b-99fe-85da96339737"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:35.237601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eebc0c4a-8f11-4fd1-bba4-e371f62d9bfe req-7d22ecdb-e937-442c-b083-dd5b9c5adef0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.239897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eebc0c4a-8f11-4fd1-bba4-e371f62d9bfe req-7d22ecdb-e937-442c-b083-dd5b9c5adef0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.240503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eebc0c4a-8f11-4fd1-bba4-e371f62d9bfe req-7d22ecdb-e937-442c-b083-dd5b9c5adef0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.270895 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-eebc0c4a-8f11-4fd1-bba4-e371f62d9bfe req-7d22ecdb-e937-442c-b083-dd5b9c5adef0 service nova] Creating event network-vif-plugged:f48712ec-9677-458b-99fe-85da96339737 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:20:35.291062 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-eebc0c4a-8f11-4fd1-bba4-e371f62d9bfe req-7d22ecdb-e937-442c-b083-dd5b9c5adef0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081064 Oct 04 18:20:35.291710 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2246/4484] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:35.374508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4626a006-ef96-4567-a6a5-0d6525922e67 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:35.376330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4626a006-ef96-4567-a6a5-0d6525922e67 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:35.385697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4626a006-ef96-4567-a6a5-0d6525922e67 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.386481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4626a006-ef96-4567-a6a5-0d6525922e67 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.387101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4626a006-ef96-4567-a6a5-0d6525922e67 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.387973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4626a006-ef96-4567-a6a5-0d6525922e67 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.390576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4626a006-ef96-4567-a6a5-0d6525922e67 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.391453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4626a006-ef96-4567-a6a5-0d6525922e67 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.403287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08a783fe-d9a7-4dd1-8429-5fdb86fc0250 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.415732 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-08a783fe-d9a7-4dd1-8429-5fdb86fc0250 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.254085 Oct 04 18:20:35.416969 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2239/4485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:35 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:35.597670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4626a006-ef96-4567-a6a5-0d6525922e67 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.607706 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4626a006-ef96-4567-a6a5-0d6525922e67 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.238510 Oct 04 18:20:35.608922 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2247/4486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:35 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:36.185687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7267ba0b-e4c5-41ca-8440-3c2918382879 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.186299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7267ba0b-e4c5-41ca-8440-3c2918382879 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.194371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7267ba0b-e4c5-41ca-8440-3c2918382879 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.195137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7267ba0b-e4c5-41ca-8440-3c2918382879 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.195774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7267ba0b-e4c5-41ca-8440-3c2918382879 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.196680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7267ba0b-e4c5-41ca-8440-3c2918382879 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.197288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7267ba0b-e4c5-41ca-8440-3c2918382879 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.197854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7267ba0b-e4c5-41ca-8440-3c2918382879 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.230593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.232287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.244449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.244950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.245387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.246103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.249984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.250496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.576814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7267ba0b-e4c5-41ca-8440-3c2918382879 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.586330 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7267ba0b-e4c5-41ca-8440-3c2918382879 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1518 microversion: 2.1 time: 0.404705 Oct 04 18:20:36.587380 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2240/4487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1518 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:36.597365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-65dffc2c-9207-4cc4-a7e6-df7d31782591 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.598082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-65dffc2c-9207-4cc4-a7e6-df7d31782591 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.611308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.619322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65dffc2c-9207-4cc4-a7e6-df7d31782591 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.620039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65dffc2c-9207-4cc4-a7e6-df7d31782591 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.621068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65dffc2c-9207-4cc4-a7e6-df7d31782591 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.623309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65dffc2c-9207-4cc4-a7e6-df7d31782591 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.624283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65dffc2c-9207-4cc4-a7e6-df7d31782591 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.624921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65dffc2c-9207-4cc4-a7e6-df7d31782591 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.626414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.627976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.629474 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-312fe8ac-32f0-4c99-b4f9-6744b8c81c94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.403580 Oct 04 18:20:36.630183 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2248/4488] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:36.650642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2136ab69-dbcd-4555-a879-1e8b1324ac60 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.650642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2136ab69-dbcd-4555-a879-1e8b1324ac60 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.650642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2136ab69-dbcd-4555-a879-1e8b1324ac60 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.650642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2136ab69-dbcd-4555-a879-1e8b1324ac60 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.650929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2136ab69-dbcd-4555-a879-1e8b1324ac60 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.651628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2136ab69-dbcd-4555-a879-1e8b1324ac60 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.652184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2136ab69-dbcd-4555-a879-1e8b1324ac60 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.652625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2136ab69-dbcd-4555-a879-1e8b1324ac60 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.923767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2136ab69-dbcd-4555-a879-1e8b1324ac60 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.938469 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2136ab69-dbcd-4555-a879-1e8b1324ac60 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.301328 Oct 04 18:20:36.939254 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2249/4489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:36.978695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-65dffc2c-9207-4cc4-a7e6-df7d31782591 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.995141 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-65dffc2c-9207-4cc4-a7e6-df7d31782591 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.401180 Oct 04 18:20:36.997727 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2241/4490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:37.442837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-06b9a032-c654-4115-ab5a-a3b3d2ecb387 req-d6d30216-e59a-4a5d-b59e-355ec050f7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab02548-c5e1-4e54-8190-17c6503b6e0a", "name": "network-vif-deleted", "tag": "9e1c0054-7b2b-4b49-bca7-c6e9e70756b9"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:37.479579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-06b9a032-c654-4115-ab5a-a3b3d2ecb387 req-d6d30216-e59a-4a5d-b59e-355ec050f7d8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.481161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-06b9a032-c654-4115-ab5a-a3b3d2ecb387 req-d6d30216-e59a-4a5d-b59e-355ec050f7d8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.484590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-06b9a032-c654-4115-ab5a-a3b3d2ecb387 req-d6d30216-e59a-4a5d-b59e-355ec050f7d8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.551552 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-06b9a032-c654-4115-ab5a-a3b3d2ecb387 req-d6d30216-e59a-4a5d-b59e-355ec050f7d8 service nova] Creating event network-vif-deleted:9e1c0054-7b2b-4b49-bca7-c6e9e70756b9 for instance 3ab02548-c5e1-4e54-8190-17c6503b6e0a on n-h1-850499-14 Oct 04 18:20:37.573071 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-06b9a032-c654-4115-ab5a-a3b3d2ecb387 req-d6d30216-e59a-4a5d-b59e-355ec050f7d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136575 Oct 04 18:20:37.573724 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2250/4491] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:37.612320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.613639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:37.625786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:37.630259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.631402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.632199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.633424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.634173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.634797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.670042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.671557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:37.695756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.696138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.699480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.702073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.702563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.704364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.747159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.747986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.753855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.754733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lazy-loading 'fault' on Instance uuid 3ab02548-c5e1-4e54-8190-17c6503b6e0a {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:37.880796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e59b12d4914829a6b3e4f7b9f96779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce3d6d3d3484f07b73e3c0a59c8cac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.892595 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-47a37911-b6b8-4830-b6e9-e0decae9636d tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 200 len: 1311 microversion: 2.1 time: 0.283759 Oct 04 18:20:37.908674 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2242/4492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 1311 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:37.915947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d5e273ec-abf1-45a1-8821-9a2d52dfd6ca req-4ac812a5-913c-4292-b8b0-c7ed5d31c13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-plugged", "status": "completed", "tag": "7f14d244-6f3e-47f6-9928-5704c2b06130"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:37.931180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d5e273ec-abf1-45a1-8821-9a2d52dfd6ca req-4ac812a5-913c-4292-b8b0-c7ed5d31c13b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.931867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d5e273ec-abf1-45a1-8821-9a2d52dfd6ca req-4ac812a5-913c-4292-b8b0-c7ed5d31c13b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.932610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d5e273ec-abf1-45a1-8821-9a2d52dfd6ca req-4ac812a5-913c-4292-b8b0-c7ed5d31c13b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.947986 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d5e273ec-abf1-45a1-8821-9a2d52dfd6ca req-4ac812a5-913c-4292-b8b0-c7ed5d31c13b service nova] Creating event network-vif-plugged:7f14d244-6f3e-47f6-9928-5704c2b06130 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:20:37.954536 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d5e273ec-abf1-45a1-8821-9a2d52dfd6ca req-4ac812a5-913c-4292-b8b0-c7ed5d31c13b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044731 Oct 04 18:20:37.955337 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2243/4493] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:37.965988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79e3b487-aea0-498a-a2ed-8c3452b004be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.967946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-79e3b487-aea0-498a-a2ed-8c3452b004be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:37.980264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e3b487-aea0-498a-a2ed-8c3452b004be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.981038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e3b487-aea0-498a-a2ed-8c3452b004be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.981716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e3b487-aea0-498a-a2ed-8c3452b004be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.982659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e3b487-aea0-498a-a2ed-8c3452b004be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.983519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e3b487-aea0-498a-a2ed-8c3452b004be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.984365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e3b487-aea0-498a-a2ed-8c3452b004be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.125047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.142251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.144029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.145450 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4600e1d8-a13e-4ee2-b1a9-81933e808836 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.489829 Oct 04 18:20:38.146712 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2251/4494] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:38.165433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0e8bb5ec-d5fa-40b4-acfe-d8d2d0ef1bf3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.166856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0e8bb5ec-d5fa-40b4-acfe-d8d2d0ef1bf3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.193664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e8bb5ec-d5fa-40b4-acfe-d8d2d0ef1bf3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.194206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e8bb5ec-d5fa-40b4-acfe-d8d2d0ef1bf3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.194659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e8bb5ec-d5fa-40b4-acfe-d8d2d0ef1bf3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.196018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e8bb5ec-d5fa-40b4-acfe-d8d2d0ef1bf3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.196494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e8bb5ec-d5fa-40b4-acfe-d8d2d0ef1bf3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.201767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e8bb5ec-d5fa-40b4-acfe-d8d2d0ef1bf3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.268405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-79e3b487-aea0-498a-a2ed-8c3452b004be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.278517 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-79e3b487-aea0-498a-a2ed-8c3452b004be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.318157 Oct 04 18:20:38.280037 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2244/4495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:38.478160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0e8bb5ec-d5fa-40b4-acfe-d8d2d0ef1bf3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.487190 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0e8bb5ec-d5fa-40b4-acfe-d8d2d0ef1bf3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.339172 Oct 04 18:20:38.487840 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2252/4496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:38.918772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.919933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] [instance: 3ab02548-c5e1-4e54-8190-17c6503b6e0a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.927224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.927714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.928148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.929075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.930138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.930875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.947675 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] HTTP exception thrown: Instance 3ab02548-c5e1-4e54-8190-17c6503b6e0a could not be found. Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Request method failure captured: Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a HTTP/1.1 Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHkVoSIa5R9msG1EmrtePM-mR8BanHy1vn4-nr_bleQF1jNd3mOHDzDdt4YukQ3hEXuqcC8CJa97ysseghOgzrcGbLjl4-3CVZv9fkcZdKD0L2Vrp8P7W97E8WM24tlPs7mkibDSZ8i0kBxXCB1Fz9rMxXi96idyrDkfMXl3Rfg37DQ Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 5ce3d6d3d3484f07b73e3c0a59c8cac0 Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ListServerFiltersTestJSON-717233930 Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ce3d6d3d3484f07b73e3c0a59c8cac0"}]}] Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ListServerFiltersTestJSON-717233930 Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 5ce3d6d3d3484f07b73e3c0a59c8cac0 Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-717233930 Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ListServerFiltersTestJSON-717233930-project Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: c0e59b12d4914829a6b3e4f7b9f96779 Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ListServerFiltersTestJSON-717233930-project Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 3ab02548-c5e1-4e54-8190-17c6503b6e0a could not be found. Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '3ab02548-c5e1-4e54-8190-17c6503b6e0a'} Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ab02548-c5e1-4e54-8190-17c6503b6e0a could not be found. Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ab02548-c5e1-4e54-8190-17c6503b6e0a could not be found. Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:38.949356 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.953355 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:38.953355 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:38.953355 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:38.953355 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:38.953355 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:38.953355 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ab02548-c5e1-4e54-8190-17c6503b6e0a could not be found. Oct 04 18:20:38.953355 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.953355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] Returning 404 to user: Instance 3ab02548-c5e1-4e54-8190-17c6503b6e0a could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:38.953355 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-69d2a49b-452c-402e-bc9c-4bd0fb5f4cd3 tempest-ListServerFiltersTestJSON-717233930 tempest-ListServerFiltersTestJSON-717233930-project] 10.222.0.18 "GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a" status: 404 len: 111 microversion: 2.1 time: 0.036485 Oct 04 18:20:38.955226 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2245/4497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/3ab02548-c5e1-4e54-8190-17c6503b6e0a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:39.175357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.176115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.182467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.182984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.183432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.184137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.184609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.188639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.306380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-013cfd7a-9a56-453d-8519-6077ded42255 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.307044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-013cfd7a-9a56-453d-8519-6077ded42255 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.314799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013cfd7a-9a56-453d-8519-6077ded42255 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.315317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013cfd7a-9a56-453d-8519-6077ded42255 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.315759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013cfd7a-9a56-453d-8519-6077ded42255 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.316716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013cfd7a-9a56-453d-8519-6077ded42255 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.317174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013cfd7a-9a56-453d-8519-6077ded42255 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.317601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013cfd7a-9a56-453d-8519-6077ded42255 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.510361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:39.533171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:39.533757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-013cfd7a-9a56-453d-8519-6077ded42255 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:39.536174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:39.538401 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a38c4144-f4ae-40e8-a590-07faf22b3af6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.366912 Oct 04 18:20:39.539743 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2253/4498] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:39 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:39.555443 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-013cfd7a-9a56-453d-8519-6077ded42255 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.239690 Oct 04 18:20:39.555443 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2246/4499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:39 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:39.555443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-983eb07a-1e58-4c98-b31d-65d29bc3650f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.555443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-983eb07a-1e58-4c98-b31d-65d29bc3650f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.555443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-983eb07a-1e58-4c98-b31d-65d29bc3650f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.555443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-983eb07a-1e58-4c98-b31d-65d29bc3650f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.555443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-983eb07a-1e58-4c98-b31d-65d29bc3650f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.556351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-983eb07a-1e58-4c98-b31d-65d29bc3650f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.556881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-983eb07a-1e58-4c98-b31d-65d29bc3650f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.557580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-983eb07a-1e58-4c98-b31d-65d29bc3650f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.733982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-983eb07a-1e58-4c98-b31d-65d29bc3650f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:39.755650 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-983eb07a-1e58-4c98-b31d-65d29bc3650f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.211648 Oct 04 18:20:39.756298 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2247/4500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:39 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:39.996828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-274e07f5-55a2-4c3a-b9f0-cc1c7be1c1ce req-63f8dc28-e91b-43f7-8b81-145a0663e655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-plugged", "status": "completed", "tag": "7ea256cc-7dc7-404f-b12e-41602c4c2d87"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:40.013097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-274e07f5-55a2-4c3a-b9f0-cc1c7be1c1ce req-63f8dc28-e91b-43f7-8b81-145a0663e655 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.013930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-274e07f5-55a2-4c3a-b9f0-cc1c7be1c1ce req-63f8dc28-e91b-43f7-8b81-145a0663e655 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.014612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-274e07f5-55a2-4c3a-b9f0-cc1c7be1c1ce req-63f8dc28-e91b-43f7-8b81-145a0663e655 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.031243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-274e07f5-55a2-4c3a-b9f0-cc1c7be1c1ce req-63f8dc28-e91b-43f7-8b81-145a0663e655 service nova] Creating event network-vif-plugged:7ea256cc-7dc7-404f-b12e-41602c4c2d87 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:20:40.037321 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-274e07f5-55a2-4c3a-b9f0-cc1c7be1c1ce req-63f8dc28-e91b-43f7-8b81-145a0663e655 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045174 Oct 04 18:20:40.038566 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2254/4501] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:40.565920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-87a03ad7-567f-4b8a-a1cc-b61c63a19808 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:40.566795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-87a03ad7-567f-4b8a-a1cc-b61c63a19808 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:40.571440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:40.572429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:40.575093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87a03ad7-567f-4b8a-a1cc-b61c63a19808 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.576299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87a03ad7-567f-4b8a-a1cc-b61c63a19808 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.576908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87a03ad7-567f-4b8a-a1cc-b61c63a19808 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.577781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87a03ad7-567f-4b8a-a1cc-b61c63a19808 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.578400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87a03ad7-567f-4b8a-a1cc-b61c63a19808 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.579057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-87a03ad7-567f-4b8a-a1cc-b61c63a19808 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.590573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.591682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.592200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.594509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.595894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.597318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.883039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-87a03ad7-567f-4b8a-a1cc-b61c63a19808 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.898948 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-87a03ad7-567f-4b8a-a1cc-b61c63a19808 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.336159 Oct 04 18:20:40.906585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.915583 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2248/4502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:40 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:40.918501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.921316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.922823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59f128d8-12de-4cce-80df-2939935e1a17 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:40.923561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59f128d8-12de-4cce-80df-2939935e1a17 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:40.923864 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f9fd5d4-2692-4386-9a2c-406707eff1f6 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.358757 Oct 04 18:20:40.924912 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2255/4503] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:40 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:40.929831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59f128d8-12de-4cce-80df-2939935e1a17 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.930430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59f128d8-12de-4cce-80df-2939935e1a17 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.931219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59f128d8-12de-4cce-80df-2939935e1a17 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.932010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59f128d8-12de-4cce-80df-2939935e1a17 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.932651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59f128d8-12de-4cce-80df-2939935e1a17 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.933257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59f128d8-12de-4cce-80df-2939935e1a17 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.095851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-59f128d8-12de-4cce-80df-2939935e1a17 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:41.105465 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59f128d8-12de-4cce-80df-2939935e1a17 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.188582 Oct 04 18:20:41.106038 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2249/4504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:40 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:41.926417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6a428f4b-1d2b-42ee-93db-84117d1d153e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.927070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6a428f4b-1d2b-42ee-93db-84117d1d153e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.934267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a428f4b-1d2b-42ee-93db-84117d1d153e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.935055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a428f4b-1d2b-42ee-93db-84117d1d153e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.935502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a428f4b-1d2b-42ee-93db-84117d1d153e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.936406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a428f4b-1d2b-42ee-93db-84117d1d153e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.937045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a428f4b-1d2b-42ee-93db-84117d1d153e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.937637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a428f4b-1d2b-42ee-93db-84117d1d153e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.957683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.958569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.972220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.973247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.974172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.975347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.975914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.980042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.188165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6a428f4b-1d2b-42ee-93db-84117d1d153e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.202783 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6a428f4b-1d2b-42ee-93db-84117d1d153e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.280208 Oct 04 18:20:42.203401 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2256/4505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:42.222999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b9f8c8b1-c3d0-49fa-ae3a-3ae2ae715fd2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.223935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b9f8c8b1-c3d0-49fa-ae3a-3ae2ae715fd2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:42.230852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f8c8b1-c3d0-49fa-ae3a-3ae2ae715fd2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.232124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f8c8b1-c3d0-49fa-ae3a-3ae2ae715fd2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.232724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f8c8b1-c3d0-49fa-ae3a-3ae2ae715fd2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.233773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f8c8b1-c3d0-49fa-ae3a-3ae2ae715fd2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.234382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f8c8b1-c3d0-49fa-ae3a-3ae2ae715fd2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.234982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f8c8b1-c3d0-49fa-ae3a-3ae2ae715fd2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.245802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.256680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.258146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.259584 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-68f35e07-255a-4977-9d74-2282bc0312dd tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.313791 Oct 04 18:20:42.260631 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2250/4506] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:42.410040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b9f8c8b1-c3d0-49fa-ae3a-3ae2ae715fd2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.420032 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b9f8c8b1-c3d0-49fa-ae3a-3ae2ae715fd2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.200440 Oct 04 18:20:42.421291 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2257/4507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:42 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:43.228770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ae00a034-0089-45b3-af37-c4284af1781d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.231865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ae00a034-0089-45b3-af37-c4284af1781d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.244448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae00a034-0089-45b3-af37-c4284af1781d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.245284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae00a034-0089-45b3-af37-c4284af1781d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.246079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae00a034-0089-45b3-af37-c4284af1781d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.248012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae00a034-0089-45b3-af37-c4284af1781d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.248823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae00a034-0089-45b3-af37-c4284af1781d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.249411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae00a034-0089-45b3-af37-c4284af1781d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.289670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.290695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.294870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:43.307083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.307736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.308031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.308881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.309201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.310181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.726743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ae00a034-0089-45b3-af37-c4284af1781d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.736438 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ae00a034-0089-45b3-af37-c4284af1781d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.514375 Oct 04 18:20:43.739419 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2251/4508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:43.753452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ea1beb3-d541-4c89-a855-c88461a70141 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.754404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6ea1beb3-d541-4c89-a855-c88461a70141 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.772490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea1beb3-d541-4c89-a855-c88461a70141 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.773140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea1beb3-d541-4c89-a855-c88461a70141 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.773594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea1beb3-d541-4c89-a855-c88461a70141 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.775535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea1beb3-d541-4c89-a855-c88461a70141 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.776014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea1beb3-d541-4c89-a855-c88461a70141 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.776451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ea1beb3-d541-4c89-a855-c88461a70141 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.881374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.894892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.896390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.902024 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3c0e90b7-da1c-4f27-9619-c9420279dccf tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.616595 Oct 04 18:20:43.904182 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2258/4509] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:44.071316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6ea1beb3-d541-4c89-a855-c88461a70141 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:44.086873 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6ea1beb3-d541-4c89-a855-c88461a70141 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.345259 Oct 04 18:20:44.099660 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2252/4510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:44.419747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-18181296-80b2-4a22-87f4-b3621e585278 req-57fd4f5d-50d8-48aa-9585-7df67feb7193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-plugged", "status": "completed", "tag": "623d7b7a-45a9-4025-95d1-5ef6a6f8d75f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:44.458521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-18181296-80b2-4a22-87f4-b3621e585278 req-57fd4f5d-50d8-48aa-9585-7df67feb7193 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.459144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-18181296-80b2-4a22-87f4-b3621e585278 req-57fd4f5d-50d8-48aa-9585-7df67feb7193 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.459935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-18181296-80b2-4a22-87f4-b3621e585278 req-57fd4f5d-50d8-48aa-9585-7df67feb7193 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.480577 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-18181296-80b2-4a22-87f4-b3621e585278 req-57fd4f5d-50d8-48aa-9585-7df67feb7193 service nova] Creating event network-vif-plugged:623d7b7a-45a9-4025-95d1-5ef6a6f8d75f for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:20:44.488388 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-18181296-80b2-4a22-87f4-b3621e585278 req-57fd4f5d-50d8-48aa-9585-7df67feb7193 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074048 Oct 04 18:20:44.490363 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2259/4511] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:44.769287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b27cf63d-f27f-4b61-8e42-a9b4e5fe08ed tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:44.772460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b27cf63d-f27f-4b61-8e42-a9b4e5fe08ed tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:44.784168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b27cf63d-f27f-4b61-8e42-a9b4e5fe08ed tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.787883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b27cf63d-f27f-4b61-8e42-a9b4e5fe08ed tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.788690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b27cf63d-f27f-4b61-8e42-a9b4e5fe08ed tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.789703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b27cf63d-f27f-4b61-8e42-a9b4e5fe08ed tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.790381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b27cf63d-f27f-4b61-8e42-a9b4e5fe08ed tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.796580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b27cf63d-f27f-4b61-8e42-a9b4e5fe08ed tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.933627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:44.934493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:44.952674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.953208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.953658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.954402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.954869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.955333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.890761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b27cf63d-f27f-4b61-8e42-a9b4e5fe08ed tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:45.902577 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b27cf63d-f27f-4b61-8e42-a9b4e5fe08ed tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 1.140857 Oct 04 18:20:45.904764 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2253/4512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:44 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:45.911829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a972dd0e-8525-4e3b-9185-96df53c6d976 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:45.913425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a972dd0e-8525-4e3b-9185-96df53c6d976 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:45.920893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a972dd0e-8525-4e3b-9185-96df53c6d976 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.921512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a972dd0e-8525-4e3b-9185-96df53c6d976 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.922140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a972dd0e-8525-4e3b-9185-96df53c6d976 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.922768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a972dd0e-8525-4e3b-9185-96df53c6d976 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.924682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a972dd0e-8525-4e3b-9185-96df53c6d976 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.925603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a972dd0e-8525-4e3b-9185-96df53c6d976 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.952368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:45.969256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:45.971764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:45.978902 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b68b4609-d376-4028-bc37-6814eea07002 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 1.048289 Oct 04 18:20:45.979537 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2260/4513] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:44 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:46.257888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a972dd0e-8525-4e3b-9185-96df53c6d976 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:46.263835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:46.270207 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a972dd0e-8525-4e3b-9185-96df53c6d976 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.363896 Oct 04 18:20:46.271215 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2254/4514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:45 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:46.653587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-45b7e485-9c5b-44b3-9ede-b3f8007de292 req-801587f0-464e-4a88-a43d-02f6bdfe72c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-plugged", "status": "completed", "tag": "62491f8c-a00d-4911-9961-75eeaa040635"}, {"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-plugged", "status": "completed", "tag": "f7e7db67-5361-480e-8e11-3112a56563e8"}, {"server_uuid": "1e9a3ac3-3557-45f7-b366-9c725dc9cacd", "name": "network-vif-plugged", "status": "completed", "tag": "c648dcfc-5668-4287-bf56-52c2ada998a3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:46.669980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45b7e485-9c5b-44b3-9ede-b3f8007de292 req-801587f0-464e-4a88-a43d-02f6bdfe72c2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.671382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45b7e485-9c5b-44b3-9ede-b3f8007de292 req-801587f0-464e-4a88-a43d-02f6bdfe72c2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.672076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45b7e485-9c5b-44b3-9ede-b3f8007de292 req-801587f0-464e-4a88-a43d-02f6bdfe72c2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.692304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-45b7e485-9c5b-44b3-9ede-b3f8007de292 req-801587f0-464e-4a88-a43d-02f6bdfe72c2 service nova] Creating event network-vif-plugged:62491f8c-a00d-4911-9961-75eeaa040635 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:20:46.693305 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-45b7e485-9c5b-44b3-9ede-b3f8007de292 req-801587f0-464e-4a88-a43d-02f6bdfe72c2 service nova] Creating event network-vif-plugged:f7e7db67-5361-480e-8e11-3112a56563e8 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:20:46.694143 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-45b7e485-9c5b-44b3-9ede-b3f8007de292 req-801587f0-464e-4a88-a43d-02f6bdfe72c2 service nova] Creating event network-vif-plugged:c648dcfc-5668-4287-bf56-52c2ada998a3 for instance 1e9a3ac3-3557-45f7-b366-9c725dc9cacd on n-h2-850499-14 Oct 04 18:20:46.702753 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-45b7e485-9c5b-44b3-9ede-b3f8007de292 req-801587f0-464e-4a88-a43d-02f6bdfe72c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.052763 Oct 04 18:20:46.704238 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2261/4515] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:46.928295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aab2fe93-aa8b-4f21-bb19-a0ac5f64ff28 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:46.928920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aab2fe93-aa8b-4f21-bb19-a0ac5f64ff28 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:46.960842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aab2fe93-aa8b-4f21-bb19-a0ac5f64ff28 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.961382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aab2fe93-aa8b-4f21-bb19-a0ac5f64ff28 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.965079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aab2fe93-aa8b-4f21-bb19-a0ac5f64ff28 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.966372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aab2fe93-aa8b-4f21-bb19-a0ac5f64ff28 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.966852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aab2fe93-aa8b-4f21-bb19-a0ac5f64ff28 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.976484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aab2fe93-aa8b-4f21-bb19-a0ac5f64ff28 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.009778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:47.010620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:47.021377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.021888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.022337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.025612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.029068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.030389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.372570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.376545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:47.383734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.394321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aab2fe93-aa8b-4f21-bb19-a0ac5f64ff28 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.405246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.406380 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aab2fe93-aa8b-4f21-bb19-a0ac5f64ff28 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.483438 Oct 04 18:20:47.407544 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2255/4516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:46 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:47.414054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-89a5d66d-c3c9-4d0e-ae96-afea8282cdcf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:47.414981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-89a5d66d-c3c9-4d0e-ae96-afea8282cdcf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:47.422788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89a5d66d-c3c9-4d0e-ae96-afea8282cdcf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.423655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89a5d66d-c3c9-4d0e-ae96-afea8282cdcf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.424315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89a5d66d-c3c9-4d0e-ae96-afea8282cdcf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.425386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89a5d66d-c3c9-4d0e-ae96-afea8282cdcf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.426061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89a5d66d-c3c9-4d0e-ae96-afea8282cdcf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.426702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89a5d66d-c3c9-4d0e-ae96-afea8282cdcf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.427470 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aa77ee01-9869-4f7d-9a87-c5bba9759960 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.415710 Oct 04 18:20:47.432120 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2262/4517] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:47 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:47.650990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-89a5d66d-c3c9-4d0e-ae96-afea8282cdcf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.665109 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-89a5d66d-c3c9-4d0e-ae96-afea8282cdcf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.255685 Oct 04 18:20:47.669121 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2256/4518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:47 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:48.433539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b4b73c5b-b7d9-4225-aae1-62d3dc5a776d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.434221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b4b73c5b-b7d9-4225-aae1-62d3dc5a776d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:48.446373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b73c5b-b7d9-4225-aae1-62d3dc5a776d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.446373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b73c5b-b7d9-4225-aae1-62d3dc5a776d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.446691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b73c5b-b7d9-4225-aae1-62d3dc5a776d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.449551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b73c5b-b7d9-4225-aae1-62d3dc5a776d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.452223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b73c5b-b7d9-4225-aae1-62d3dc5a776d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.456252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.456872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:48.462302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b73c5b-b7d9-4225-aae1-62d3dc5a776d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.468569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.470149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.474562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.477125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.478420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.479527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.800343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b4b73c5b-b7d9-4225-aae1-62d3dc5a776d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:48.813050 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b4b73c5b-b7d9-4225-aae1-62d3dc5a776d tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.383255 Oct 04 18:20:48.813660 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2263/4519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:48.822990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f719b696-823e-4c74-9415-a9504fe12e86 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.824073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f719b696-823e-4c74-9415-a9504fe12e86 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:48.847387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:48.849954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f719b696-823e-4c74-9415-a9504fe12e86 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.850481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f719b696-823e-4c74-9415-a9504fe12e86 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.851556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f719b696-823e-4c74-9415-a9504fe12e86 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.852311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f719b696-823e-4c74-9415-a9504fe12e86 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.852788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f719b696-823e-4c74-9415-a9504fe12e86 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.853235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f719b696-823e-4c74-9415-a9504fe12e86 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.870193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:48.875266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:48.877206 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d4bac0b5-a6c4-425b-8f8c-42d987e3f905 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1878 microversion: 2.42 time: 0.425159 Oct 04 18:20:48.879717 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2257/4520] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1878 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:49.125261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f719b696-823e-4c74-9415-a9504fe12e86 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:49.144300 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f719b696-823e-4c74-9415-a9504fe12e86 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1292 microversion: 2.1 time: 0.329469 Oct 04 18:20:49.155286 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2264/4521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1292 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:49.844490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a8818ce6-66aa-41dd-a6be-d81b6d064889 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:49.845193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a8818ce6-66aa-41dd-a6be-d81b6d064889 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:49.853919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8818ce6-66aa-41dd-a6be-d81b6d064889 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.854480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8818ce6-66aa-41dd-a6be-d81b6d064889 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.854934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8818ce6-66aa-41dd-a6be-d81b6d064889 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.855818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8818ce6-66aa-41dd-a6be-d81b6d064889 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.856321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8818ce6-66aa-41dd-a6be-d81b6d064889 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.856757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8818ce6-66aa-41dd-a6be-d81b6d064889 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.026260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1922094996", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "bf153d21-e8e7-49e5-8d30-06d0c90e6431"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:50.034131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a8818ce6-66aa-41dd-a6be-d81b6d064889 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.047490 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a8818ce6-66aa-41dd-a6be-d81b6d064889 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.208122 Oct 04 18:20:50.048663 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2265/4522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:49 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:50.055913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.057308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.067074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.068787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.069421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.070502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.071336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.072425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.111552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] validate_networks() for [('bf153d21-e8e7-49e5-8d30-06d0c90e6431', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:50.521826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.536155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.538439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.540355 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7c4ce4be-506b-4765-a983-18e802eb7592 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2834 microversion: 2.42 time: 0.490583 Oct 04 18:20:50.541181 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2266/4523] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2834 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:50.547240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-23300cdc-2164-4c9d-b039-f8912d71f1d2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.548252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-23300cdc-2164-4c9d-b039-f8912d71f1d2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.554905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23300cdc-2164-4c9d-b039-f8912d71f1d2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.556143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23300cdc-2164-4c9d-b039-f8912d71f1d2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.556965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23300cdc-2164-4c9d-b039-f8912d71f1d2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.558093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23300cdc-2164-4c9d-b039-f8912d71f1d2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.559679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23300cdc-2164-4c9d-b039-f8912d71f1d2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.560343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23300cdc-2164-4c9d-b039-f8912d71f1d2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.857474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23300cdc-2164-4c9d-b039-f8912d71f1d2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.873762 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-23300cdc-2164-4c9d-b039-f8912d71f1d2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1473 microversion: 2.1 time: 0.331186 Oct 04 18:20:50.895689 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2267/4524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1473 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:50.908271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f87cf29-c2f6-4cb5-be1a-34188c4a1b92 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.909019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f87cf29-c2f6-4cb5-be1a-34188c4a1b92 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.916928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f87cf29-c2f6-4cb5-be1a-34188c4a1b92 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.917818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f87cf29-c2f6-4cb5-be1a-34188c4a1b92 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.918896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f87cf29-c2f6-4cb5-be1a-34188c4a1b92 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.919575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:50.920094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f87cf29-c2f6-4cb5-be1a-34188c4a1b92 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.920898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:50.921010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f87cf29-c2f6-4cb5-be1a-34188c4a1b92 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.921288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f87cf29-c2f6-4cb5-be1a-34188c4a1b92 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.921394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:50.921804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:50.922385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:50.933229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.933719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.934465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.935535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.936219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.936897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.960035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Getting quotas for project c658c675bc1846669c38a1b22d3b1098. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:50.969606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Getting quotas for user 6962aec4d9994696bbe5c6d168f62228 and project c658c675bc1846669c38a1b22d3b1098. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:50.991081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Going to run 2 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:50.993903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: e204a6f7-c18e-4943-9fcf-5de83ec21ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:51.037144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=e204a6f7-c18e-4943-9fcf-5de83ec21ae7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:51.099038 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f87cf29-c2f6-4cb5-be1a-34188c4a1b92 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.197283 Oct 04 18:20:51.110351 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2268/4525] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e/os-interface => generated 1831 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:51.115497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bfec18d1-a674-4e2c-a093-6b47968dc791 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:51.116118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bfec18d1-a674-4e2c-a093-6b47968dc791 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:51.123777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfec18d1-a674-4e2c-a093-6b47968dc791 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.125584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfec18d1-a674-4e2c-a093-6b47968dc791 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.126203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfec18d1-a674-4e2c-a093-6b47968dc791 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.127143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfec18d1-a674-4e2c-a093-6b47968dc791 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.127448 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b4aa28cf-304c-4a49-b05b-047574ec22cf tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464228 Oct 04 18:20:51.128259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfec18d1-a674-4e2c-a093-6b47968dc791 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.128584 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2258/4526] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:51.129041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bfec18d1-a674-4e2c-a093-6b47968dc791 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.135193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-729423998", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:51.228794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] validate_networks() for [('5be520db-1d2d-4d71-923d-9d8728cd44bc', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:51.454293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bfec18d1-a674-4e2c-a093-6b47968dc791 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:51.465924 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bfec18d1-a674-4e2c-a093-6b47968dc791 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.353438 Oct 04 18:20:51.466525 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2269/4527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:51 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:51.486089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e47c1d53-9966-43e2-90de-c84abffaca9a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:51.514833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e47c1d53-9966-43e2-90de-c84abffaca9a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:51.524924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e47c1d53-9966-43e2-90de-c84abffaca9a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Searching by: {'deleted': False, 'project_id': 'c658c675bc1846669c38a1b22d3b1098'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:20:51.587788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e47c1d53-9966-43e2-90de-c84abffaca9a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.590590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e47c1d53-9966-43e2-90de-c84abffaca9a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.594093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e47c1d53-9966-43e2-90de-c84abffaca9a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.604315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e47c1d53-9966-43e2-90de-c84abffaca9a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.606483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e47c1d53-9966-43e2-90de-c84abffaca9a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.607140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e47c1d53-9966-43e2-90de-c84abffaca9a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.656663 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e47c1d53-9966-43e2-90de-c84abffaca9a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.187136 Oct 04 18:20:51.657885 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2270/4528] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:20:51 2022] GET /compute/v2.1/servers => generated 677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:51.687075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f0ad29d5-195a-4b4f-a56e-dbfec372e0dc tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:51.688038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f0ad29d5-195a-4b4f-a56e-dbfec372e0dc tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:51.830060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f0ad29d5-195a-4b4f-a56e-dbfec372e0dc tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:51.854831 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f0ad29d5-195a-4b4f-a56e-dbfec372e0dc tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1220 microversion: 2.1 time: 0.170544 Oct 04 18:20:51.859737 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2271/4529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:51 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1220 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:52.372802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:52.373360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:52.373752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:52.374152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:52.374754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:52.396755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.397265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.397716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.398457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.398926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.399389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.490940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a6778a8-46ad-4f2a-8f31-23a4c96ecdb6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.492153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a6778a8-46ad-4f2a-8f31-23a4c96ecdb6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:52.500059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:52.507068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6778a8-46ad-4f2a-8f31-23a4c96ecdb6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.508132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6778a8-46ad-4f2a-8f31-23a4c96ecdb6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.509113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6778a8-46ad-4f2a-8f31-23a4c96ecdb6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.510313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for user 41e49c77352541cb94dcd12277f7ee67 and project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:52.511242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6778a8-46ad-4f2a-8f31-23a4c96ecdb6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.514926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6778a8-46ad-4f2a-8f31-23a4c96ecdb6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.515629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6778a8-46ad-4f2a-8f31-23a4c96ecdb6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.543959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:52.546121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 744d2399-52cf-4121-82bc-e219e5982b85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:52.629294 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cf7fc85c-b1be-4d9d-9cc6-114ae2486270 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499454 Oct 04 18:20:52.630674 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2259/4530] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:52.645019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-57c515c2-e8c3-482e-b818-175802a85e4a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.646152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57c515c2-e8c3-482e-b818-175802a85e4a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 744d2399-52cf-4121-82bc-e219e5982b85] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:52.689546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57c515c2-e8c3-482e-b818-175802a85e4a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 744d2399-52cf-4121-82bc-e219e5982b85] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:52.827653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a6778a8-46ad-4f2a-8f31-23a4c96ecdb6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:52.845351 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a6778a8-46ad-4f2a-8f31-23a4c96ecdb6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.354802 Oct 04 18:20:52.855749 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2272/4531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:52 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:52.892277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e12adad0-ff21-4769-a4a9-a5ecb30972b1 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.895952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e12adad0-ff21-4769-a4a9-a5ecb30972b1 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:52.928241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e12adad0-ff21-4769-a4a9-a5ecb30972b1 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.930359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e12adad0-ff21-4769-a4a9-a5ecb30972b1 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.935349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e12adad0-ff21-4769-a4a9-a5ecb30972b1 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.937984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e12adad0-ff21-4769-a4a9-a5ecb30972b1 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.938553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e12adad0-ff21-4769-a4a9-a5ecb30972b1 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.941789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e12adad0-ff21-4769-a4a9-a5ecb30972b1 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.105812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e12adad0-ff21-4769-a4a9-a5ecb30972b1 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:53.116894 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e12adad0-ff21-4769-a4a9-a5ecb30972b1 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1272 microversion: 2.1 time: 0.237594 Oct 04 18:20:53.118254 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2273/4532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:52 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:53.462666 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.scheduler.client.report [None req-57c515c2-e8c3-482e-b818-175802a85e4a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Deleted allocations for instance 744d2399-52cf-4121-82bc-e219e5982b85 Oct 04 18:20:53.468239 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.compute.api [None req-57c515c2-e8c3-482e-b818-175802a85e4a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 744d2399-52cf-4121-82bc-e219e5982b85] Instance Mapping does not exist while attempting local delete cleanup. Oct 04 18:20:53.470083 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-57c515c2-e8c3-482e-b818-175802a85e4a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85" status: 204 len: 0 microversion: 2.1 time: 0.830274 Oct 04 18:20:53.472267 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2260/4533] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:52 2022] DELETE /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:20:53.487526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5adef101-235e-4a0f-b4bd-c8826e7cf58a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:53.488326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5adef101-235e-4a0f-b4bd-c8826e7cf58a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 744d2399-52cf-4121-82bc-e219e5982b85] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:53.514252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-5adef101-235e-4a0f-b4bd-c8826e7cf58a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5adef101-235e-4a0f-b4bd-c8826e7cf58a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85 HTTP/1.1 Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '744d2399-52cf-4121-82bc-e219e5982b85'} Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:53.522341 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:53.526874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:53.526874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:53.526874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:20:53.526874 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:20:53.526874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5adef101-235e-4a0f-b4bd-c8826e7cf58a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:53.531981 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5adef101-235e-4a0f-b4bd-c8826e7cf58a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85" status: 404 len: 111 microversion: 2.1 time: 0.053359 Oct 04 18:20:53.534512 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2274/4534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:53 2022] GET /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:20:53.868939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-790056f3-b072-440a-95d2-94d6d465796a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:53.869561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-790056f3-b072-440a-95d2-94d6d465796a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:53.883518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-790056f3-b072-440a-95d2-94d6d465796a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.884014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-790056f3-b072-440a-95d2-94d6d465796a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.884453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-790056f3-b072-440a-95d2-94d6d465796a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.885165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-790056f3-b072-440a-95d2-94d6d465796a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.885620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-790056f3-b072-440a-95d2-94d6d465796a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.886048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-790056f3-b072-440a-95d2-94d6d465796a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.915998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-af81738a-9264-4b6b-acca-c2193e69506b req-fe5586e3-d35e-4071-b18e-bc05570f1689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "tag": "545c6404-6880-41fc-9a80-8ac8aec3c32f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:53.946665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af81738a-9264-4b6b-acca-c2193e69506b req-fe5586e3-d35e-4071-b18e-bc05570f1689 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.950739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af81738a-9264-4b6b-acca-c2193e69506b req-fe5586e3-d35e-4071-b18e-bc05570f1689 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.951282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af81738a-9264-4b6b-acca-c2193e69506b req-fe5586e3-d35e-4071-b18e-bc05570f1689 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.984828 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-af81738a-9264-4b6b-acca-c2193e69506b req-fe5586e3-d35e-4071-b18e-bc05570f1689 service nova] Creating event network-changed:545c6404-6880-41fc-9a80-8ac8aec3c32f for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:20:53.997147 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-af81738a-9264-4b6b-acca-c2193e69506b req-fe5586e3-d35e-4071-b18e-bc05570f1689 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085010 Oct 04 18:20:53.998610 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2275/4535] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:20:54.005634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1991082943", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "5be520db-1d2d-4d71-923d-9d8728cd44bc"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:54.071716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] validate_networks() for [('5be520db-1d2d-4d71-923d-9d8728cd44bc', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:54.497261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-790056f3-b072-440a-95d2-94d6d465796a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:54.506684 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-790056f3-b072-440a-95d2-94d6d465796a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.641707 Oct 04 18:20:54.511281 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2261/4536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:53 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:54.520724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8f71b2dd-bf0e-4e05-a538-cefa1670e2ff tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:54.521342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8f71b2dd-bf0e-4e05-a538-cefa1670e2ff tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:54.546657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f71b2dd-bf0e-4e05-a538-cefa1670e2ff tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.547484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f71b2dd-bf0e-4e05-a538-cefa1670e2ff tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.549809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f71b2dd-bf0e-4e05-a538-cefa1670e2ff tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.550723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f71b2dd-bf0e-4e05-a538-cefa1670e2ff tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.552090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f71b2dd-bf0e-4e05-a538-cefa1670e2ff tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.553119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f71b2dd-bf0e-4e05-a538-cefa1670e2ff tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.835996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8f71b2dd-bf0e-4e05-a538-cefa1670e2ff tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:54.848870 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8f71b2dd-bf0e-4e05-a538-cefa1670e2ff tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1278 microversion: 2.1 time: 0.331860 Oct 04 18:20:54.849471 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2262/4537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:54 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1278 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:54.880973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d86e56d8-25dd-4f7d-9d87-bb81a9e53b34 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:54.896439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d86e56d8-25dd-4f7d-9d87-bb81a9e53b34 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:54.924676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d86e56d8-25dd-4f7d-9d87-bb81a9e53b34 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.929157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d86e56d8-25dd-4f7d-9d87-bb81a9e53b34 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.929945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d86e56d8-25dd-4f7d-9d87-bb81a9e53b34 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.931801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d86e56d8-25dd-4f7d-9d87-bb81a9e53b34 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.938160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d86e56d8-25dd-4f7d-9d87-bb81a9e53b34 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.939324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d86e56d8-25dd-4f7d-9d87-bb81a9e53b34 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.023826 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d86e56d8-25dd-4f7d-9d87-bb81a9e53b34 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148863 Oct 04 18:20:55.035214 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2263/4538] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:20:54 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e/os-volume_attachments => generated 25 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:20:55.170827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3aee61d6-ef61-43b5-9054-2005f8119b30 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:55.171538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3aee61d6-ef61-43b5-9054-2005f8119b30 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:55.178237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aee61d6-ef61-43b5-9054-2005f8119b30 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.179253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aee61d6-ef61-43b5-9054-2005f8119b30 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.179917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aee61d6-ef61-43b5-9054-2005f8119b30 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.180876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aee61d6-ef61-43b5-9054-2005f8119b30 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.181567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aee61d6-ef61-43b5-9054-2005f8119b30 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.182215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aee61d6-ef61-43b5-9054-2005f8119b30 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.220339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3aee61d6-ef61-43b5-9054-2005f8119b30 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:55.422004 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3aee61d6-ef61-43b5-9054-2005f8119b30 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 204 len: 0 microversion: 2.1 time: 0.255399 Oct 04 18:20:55.428660 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2264/4539] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:55 2022] DELETE /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:55.444665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5d2434ba-5429-4297-b5a9-affaba558773 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:55.447204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5d2434ba-5429-4297-b5a9-affaba558773 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:55.465690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d2434ba-5429-4297-b5a9-affaba558773 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.466426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d2434ba-5429-4297-b5a9-affaba558773 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.469431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d2434ba-5429-4297-b5a9-affaba558773 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.470479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d2434ba-5429-4297-b5a9-affaba558773 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.471931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d2434ba-5429-4297-b5a9-affaba558773 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.474043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d2434ba-5429-4297-b5a9-affaba558773 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.559977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:55.561169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:55.562110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:55.562895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:55.566110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:55.593178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.593685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.594128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.594868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.595389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.595820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.684271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:55.711459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for user 41e49c77352541cb94dcd12277f7ee67 and project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:55.747728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:55.750377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:55.809892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5d2434ba-5429-4297-b5a9-affaba558773 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:55.822218 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5d2434ba-5429-4297-b5a9-affaba558773 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1673 microversion: 2.1 time: 0.388255 Oct 04 18:20:55.822824 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2265/4540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:55 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1673 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:55.847225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97591887-5dcd-49f2-ae84-30f8ea72c4aa tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:55.848293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-97591887-5dcd-49f2-ae84-30f8ea72c4aa tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:55.863392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97591887-5dcd-49f2-ae84-30f8ea72c4aa tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.863903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97591887-5dcd-49f2-ae84-30f8ea72c4aa tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.864586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97591887-5dcd-49f2-ae84-30f8ea72c4aa tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.865314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97591887-5dcd-49f2-ae84-30f8ea72c4aa tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.867129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97591887-5dcd-49f2-ae84-30f8ea72c4aa tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.867593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97591887-5dcd-49f2-ae84-30f8ea72c4aa tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.873998 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6698a9f8-e584-4488-b638-01ec398e256c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.873921 Oct 04 18:20:55.877635 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2276/4541] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:55.898483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f05b69ab-e4a8-4b2b-b557-4b3fb55845be tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:55.899474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f05b69ab-e4a8-4b2b-b557-4b3fb55845be tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:55.909845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05b69ab-e4a8-4b2b-b557-4b3fb55845be tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.910357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05b69ab-e4a8-4b2b-b557-4b3fb55845be tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.910791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05b69ab-e4a8-4b2b-b557-4b3fb55845be tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.911528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05b69ab-e4a8-4b2b-b557-4b3fb55845be tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.911988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05b69ab-e4a8-4b2b-b557-4b3fb55845be tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.920243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05b69ab-e4a8-4b2b-b557-4b3fb55845be tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.103676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f05b69ab-e4a8-4b2b-b557-4b3fb55845be tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:56.113298 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f05b69ab-e4a8-4b2b-b557-4b3fb55845be tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1278 microversion: 2.1 time: 0.234232 Oct 04 18:20:56.132402 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2277/4542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:55 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:56.144692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e59e130c-c21d-4d90-9087-96e816ce7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:56.145312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e59e130c-c21d-4d90-9087-96e816ce7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:56.289130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e59e130c-c21d-4d90-9087-96e816ce7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:56.296753 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e59e130c-c21d-4d90-9087-96e816ce7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1221 microversion: 2.1 time: 0.163429 Oct 04 18:20:56.312359 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2278/4543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:56 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1221 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:56.334533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-97591887-5dcd-49f2-ae84-30f8ea72c4aa tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:56.348217 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-97591887-5dcd-49f2-ae84-30f8ea72c4aa tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.519116 Oct 04 18:20:56.359658 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2266/4544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:55 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:56.850272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1820b1ad-bc32-4a5b-83ef-37f170de2b79 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:56.851716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1820b1ad-bc32-4a5b-83ef-37f170de2b79 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:56.877283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1820b1ad-bc32-4a5b-83ef-37f170de2b79 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.878199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1820b1ad-bc32-4a5b-83ef-37f170de2b79 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.879807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1820b1ad-bc32-4a5b-83ef-37f170de2b79 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.881435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1820b1ad-bc32-4a5b-83ef-37f170de2b79 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.895418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1820b1ad-bc32-4a5b-83ef-37f170de2b79 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.897602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1820b1ad-bc32-4a5b-83ef-37f170de2b79 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.154800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1820b1ad-bc32-4a5b-83ef-37f170de2b79 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:57.155983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51667cdd-702d-4c99-bbca-29116a29c5e5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:57.157262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-51667cdd-702d-4c99-bbca-29116a29c5e5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:57.161021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:57.178394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51667cdd-702d-4c99-bbca-29116a29c5e5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.178923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51667cdd-702d-4c99-bbca-29116a29c5e5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.179392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51667cdd-702d-4c99-bbca-29116a29c5e5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.180118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51667cdd-702d-4c99-bbca-29116a29c5e5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.180583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51667cdd-702d-4c99-bbca-29116a29c5e5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.181017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51667cdd-702d-4c99-bbca-29116a29c5e5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.183322 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1820b1ad-bc32-4a5b-83ef-37f170de2b79 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1673 microversion: 2.1 time: 0.337122 Oct 04 18:20:57.201688 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2279/4545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:56 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1673 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:57.322585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d79d8e55-08de-4826-8c1a-b660261597e5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:57.323567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d79d8e55-08de-4826-8c1a-b660261597e5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:57.343613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d79d8e55-08de-4826-8c1a-b660261597e5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.344117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d79d8e55-08de-4826-8c1a-b660261597e5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.354036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d79d8e55-08de-4826-8c1a-b660261597e5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.354824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d79d8e55-08de-4826-8c1a-b660261597e5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.355395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d79d8e55-08de-4826-8c1a-b660261597e5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.355839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d79d8e55-08de-4826-8c1a-b660261597e5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.180052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d79d8e55-08de-4826-8c1a-b660261597e5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:58.196650 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d79d8e55-08de-4826-8c1a-b660261597e5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1273 microversion: 2.1 time: 0.880777 Oct 04 18:20:58.207682 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2280/4546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:57 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1273 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:58.213037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7cb740ef-ebfc-4545-96ab-4c24598dc4ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:58.213756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7cb740ef-ebfc-4545-96ab-4c24598dc4ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:58.228972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cb740ef-ebfc-4545-96ab-4c24598dc4ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.229476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cb740ef-ebfc-4545-96ab-4c24598dc4ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.230011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cb740ef-ebfc-4545-96ab-4c24598dc4ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.230711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cb740ef-ebfc-4545-96ab-4c24598dc4ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.232046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cb740ef-ebfc-4545-96ab-4c24598dc4ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.232980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cb740ef-ebfc-4545-96ab-4c24598dc4ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.404895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-51667cdd-702d-4c99-bbca-29116a29c5e5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:58.412838 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-51667cdd-702d-4c99-bbca-29116a29c5e5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1320 microversion: 2.1 time: 1.261571 Oct 04 18:20:58.434850 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2267/4547] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:57 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1320 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:58.442038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-cb2d935d-ef94-4446-9f9c-bf3511b5358b req-7b46699d-b979-4da4-a98b-be9a39c2df44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e204a6f7-c18e-4943-9fcf-5de83ec21ae7", "tag": "efa272d3-5dd2-40ed-8566-cada96d72754"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:58.465369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cb2d935d-ef94-4446-9f9c-bf3511b5358b req-7b46699d-b979-4da4-a98b-be9a39c2df44 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.472024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cb2d935d-ef94-4446-9f9c-bf3511b5358b req-7b46699d-b979-4da4-a98b-be9a39c2df44 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.484452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cb2d935d-ef94-4446-9f9c-bf3511b5358b req-7b46699d-b979-4da4-a98b-be9a39c2df44 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.517280 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-cb2d935d-ef94-4446-9f9c-bf3511b5358b req-7b46699d-b979-4da4-a98b-be9a39c2df44 service nova] Creating event network-changed:efa272d3-5dd2-40ed-8566-cada96d72754 for instance e204a6f7-c18e-4943-9fcf-5de83ec21ae7 on n-h2-850499-14 Oct 04 18:20:58.525990 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-cb2d935d-ef94-4446-9f9c-bf3511b5358b req-7b46699d-b979-4da4-a98b-be9a39c2df44 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087675 Oct 04 18:20:58.527340 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2268/4548] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:58.533817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d8755a6-3513-4603-a58a-15a86dd81c3e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:58.535172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d8755a6-3513-4603-a58a-15a86dd81c3e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:58.545412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d8755a6-3513-4603-a58a-15a86dd81c3e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.546770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d8755a6-3513-4603-a58a-15a86dd81c3e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.547474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d8755a6-3513-4603-a58a-15a86dd81c3e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.548383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d8755a6-3513-4603-a58a-15a86dd81c3e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.549076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d8755a6-3513-4603-a58a-15a86dd81c3e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.549717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d8755a6-3513-4603-a58a-15a86dd81c3e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.726381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7cb740ef-ebfc-4545-96ab-4c24598dc4ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:58.737154 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7cb740ef-ebfc-4545-96ab-4c24598dc4ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.538680 Oct 04 18:20:58.737842 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2281/4549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:58 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:59.013029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d8755a6-3513-4603-a58a-15a86dd81c3e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:59.021964 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d8755a6-3513-4603-a58a-15a86dd81c3e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1673 microversion: 2.1 time: 0.493248 Oct 04 18:20:59.023330 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2269/4550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:58 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1673 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:59.223655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45e2a5f7-01c0-48aa-b458-1fa7db583225 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.223655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45e2a5f7-01c0-48aa-b458-1fa7db583225 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.229691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45e2a5f7-01c0-48aa-b458-1fa7db583225 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.230852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45e2a5f7-01c0-48aa-b458-1fa7db583225 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.231619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45e2a5f7-01c0-48aa-b458-1fa7db583225 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.232608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45e2a5f7-01c0-48aa-b458-1fa7db583225 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.233493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45e2a5f7-01c0-48aa-b458-1fa7db583225 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.234079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45e2a5f7-01c0-48aa-b458-1fa7db583225 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.415947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-45e2a5f7-01c0-48aa-b458-1fa7db583225 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:59.429495 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45e2a5f7-01c0-48aa-b458-1fa7db583225 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1279 microversion: 2.1 time: 0.211388 Oct 04 18:20:59.442388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9e8d007d-72e8-4415-bacd-11b63d3afca0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.443021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9e8d007d-72e8-4415-bacd-11b63d3afca0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.448073 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2282/4551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1279 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:59.459203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e8d007d-72e8-4415-bacd-11b63d3afca0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.460812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e8d007d-72e8-4415-bacd-11b63d3afca0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.461318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e8d007d-72e8-4415-bacd-11b63d3afca0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.462130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e8d007d-72e8-4415-bacd-11b63d3afca0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.462878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e8d007d-72e8-4415-bacd-11b63d3afca0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.463395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e8d007d-72e8-4415-bacd-11b63d3afca0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.763896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d6a567ee-00c8-40a3-8245-95171ad8eb72 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.764788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d6a567ee-00c8-40a3-8245-95171ad8eb72 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.780700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6a567ee-00c8-40a3-8245-95171ad8eb72 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.781321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6a567ee-00c8-40a3-8245-95171ad8eb72 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.783269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6a567ee-00c8-40a3-8245-95171ad8eb72 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.785560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6a567ee-00c8-40a3-8245-95171ad8eb72 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.788495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6a567ee-00c8-40a3-8245-95171ad8eb72 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.788856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6a567ee-00c8-40a3-8245-95171ad8eb72 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.811925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9e8d007d-72e8-4415-bacd-11b63d3afca0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:59.820870 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9e8d007d-72e8-4415-bacd-11b63d3afca0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1320 microversion: 2.1 time: 0.382501 Oct 04 18:20:59.829002 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2270/4552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:00.047863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e356c640-f389-466f-869a-1d4a98c11da9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:00.048610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e356c640-f389-466f-869a-1d4a98c11da9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:00.056780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e356c640-f389-466f-869a-1d4a98c11da9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.057708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e356c640-f389-466f-869a-1d4a98c11da9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.058770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e356c640-f389-466f-869a-1d4a98c11da9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.060643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e356c640-f389-466f-869a-1d4a98c11da9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.062015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e356c640-f389-466f-869a-1d4a98c11da9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.063473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e356c640-f389-466f-869a-1d4a98c11da9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.221850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e356c640-f389-466f-869a-1d4a98c11da9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.231158 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e356c640-f389-466f-869a-1d4a98c11da9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1605 microversion: 2.1 time: 0.189176 Oct 04 18:21:00.232476 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2271/4553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:00 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1605 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:00.282071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d6a567ee-00c8-40a3-8245-95171ad8eb72 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.293830 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d6a567ee-00c8-40a3-8245-95171ad8eb72 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.537297 Oct 04 18:21:00.326045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2283/4554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:00.359994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-de7914f3-1883-4cdc-99c0-739b0f3dcb6c req-d9413d1f-45fe-45c0-9584-17f638f65037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6feedde2-a663-42e2-bf40-d4e075b76053", "tag": "ed15c40b-0de4-4b81-b870-2576c898aa7a"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:00.379737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-de7914f3-1883-4cdc-99c0-739b0f3dcb6c req-d9413d1f-45fe-45c0-9584-17f638f65037 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.382625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-de7914f3-1883-4cdc-99c0-739b0f3dcb6c req-d9413d1f-45fe-45c0-9584-17f638f65037 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.384064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-de7914f3-1883-4cdc-99c0-739b0f3dcb6c req-d9413d1f-45fe-45c0-9584-17f638f65037 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.411570 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-de7914f3-1883-4cdc-99c0-739b0f3dcb6c req-d9413d1f-45fe-45c0-9584-17f638f65037 service nova] Creating event network-changed:ed15c40b-0de4-4b81-b870-2576c898aa7a for instance 6feedde2-a663-42e2-bf40-d4e075b76053 on n-h1-850499-14 Oct 04 18:21:00.444689 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-de7914f3-1883-4cdc-99c0-739b0f3dcb6c req-d9413d1f-45fe-45c0-9584-17f638f65037 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073584 Oct 04 18:21:00.448668 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2272/4555] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:00.456102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-49019e0b-1155-43e2-9939-69740f13db07 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:00.457045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-49019e0b-1155-43e2-9939-69740f13db07 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:00.466185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49019e0b-1155-43e2-9939-69740f13db07 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.467220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49019e0b-1155-43e2-9939-69740f13db07 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.467891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49019e0b-1155-43e2-9939-69740f13db07 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.469210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49019e0b-1155-43e2-9939-69740f13db07 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.470036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49019e0b-1155-43e2-9939-69740f13db07 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.470780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49019e0b-1155-43e2-9939-69740f13db07 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.858862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-49019e0b-1155-43e2-9939-69740f13db07 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.879345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e180552-5c02-4fc1-95e2-df89d579cc4e tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:00.893418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6e180552-5c02-4fc1-95e2-df89d579cc4e tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:00.904252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:00.919075 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-49019e0b-1155-43e2-9939-69740f13db07 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.469024 Oct 04 18:21:00.934020 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2284/4556] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:00 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:00.938154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e180552-5c02-4fc1-95e2-df89d579cc4e tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.940182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e180552-5c02-4fc1-95e2-df89d579cc4e tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.940919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e180552-5c02-4fc1-95e2-df89d579cc4e tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.941704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e180552-5c02-4fc1-95e2-df89d579cc4e tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.943120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e180552-5c02-4fc1-95e2-df89d579cc4e tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.943730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e180552-5c02-4fc1-95e2-df89d579cc4e tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.968300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:01.253892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6e180552-5c02-4fc1-95e2-df89d579cc4e tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:01.257270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:01.257972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:01.268371 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e180552-5c02-4fc1-95e2-df89d579cc4e tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1320 microversion: 2.1 time: 0.417727 Oct 04 18:21:01.269189 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2273/4557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:00 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1320 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:01.284248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.284248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.284248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.284248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.284248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.284248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.330694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6aaf583b-02fe-43f3-b94b-6769f47cb7d9 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:01.332217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6aaf583b-02fe-43f3-b94b-6769f47cb7d9 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:01.344795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6aaf583b-02fe-43f3-b94b-6769f47cb7d9 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.345597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6aaf583b-02fe-43f3-b94b-6769f47cb7d9 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.348052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6aaf583b-02fe-43f3-b94b-6769f47cb7d9 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.351425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6aaf583b-02fe-43f3-b94b-6769f47cb7d9 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.352135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6aaf583b-02fe-43f3-b94b-6769f47cb7d9 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.353000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6aaf583b-02fe-43f3-b94b-6769f47cb7d9 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.356282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.359782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.361958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.362834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lazy-loading 'fault' on Instance uuid e8b2bfb3-d80f-4ed6-95f0-5face8d7581e {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:01.478264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:01.487915 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a4bd4a24-c22d-43a0-9d13-90d4edcd1847 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1326 microversion: 2.1 time: 0.236689 Oct 04 18:21:01.491680 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2285/4558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:01 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1326 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:01.567777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6aaf583b-02fe-43f3-b94b-6769f47cb7d9 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:01.578799 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6aaf583b-02fe-43f3-b94b-6769f47cb7d9 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.253376 Oct 04 18:21:01.579750 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2274/4559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:01 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:01.961175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9760c94-a732-4312-9870-c10ab4f452d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:01.962062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9760c94-a732-4312-9870-c10ab4f452d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:01.975330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9760c94-a732-4312-9870-c10ab4f452d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.975952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9760c94-a732-4312-9870-c10ab4f452d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.976514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9760c94-a732-4312-9870-c10ab4f452d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.977563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9760c94-a732-4312-9870-c10ab4f452d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.979482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9760c94-a732-4312-9870-c10ab4f452d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.980366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9760c94-a732-4312-9870-c10ab4f452d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.277893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9760c94-a732-4312-9870-c10ab4f452d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:02.290064 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9760c94-a732-4312-9870-c10ab4f452d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.331819 Oct 04 18:21:02.306981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-98afce1d-ea99-4ed3-80c7-8ec16e594c5a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.306981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-98afce1d-ea99-4ed3-80c7-8ec16e594c5a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.306981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98afce1d-ea99-4ed3-80c7-8ec16e594c5a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.306981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98afce1d-ea99-4ed3-80c7-8ec16e594c5a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.311352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98afce1d-ea99-4ed3-80c7-8ec16e594c5a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.313238 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2286/4560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:01 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:02.316574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98afce1d-ea99-4ed3-80c7-8ec16e594c5a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.317223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98afce1d-ea99-4ed3-80c7-8ec16e594c5a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.318001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98afce1d-ea99-4ed3-80c7-8ec16e594c5a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.429933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:02.479293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-56eaf63a-f9c1-4125-95cf-970db69a1cf4 req-bcb3b465-c09b-4fe3-919f-8a7a6087740b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b2bfb3-d80f-4ed6-95f0-5face8d7581e", "name": "network-vif-deleted", "tag": "8ca68b0b-c2aa-4f1a-a1e6-ab53e4ea8d05"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:02.500401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-56eaf63a-f9c1-4125-95cf-970db69a1cf4 req-bcb3b465-c09b-4fe3-919f-8a7a6087740b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.500915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-56eaf63a-f9c1-4125-95cf-970db69a1cf4 req-bcb3b465-c09b-4fe3-919f-8a7a6087740b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.501363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-56eaf63a-f9c1-4125-95cf-970db69a1cf4 req-bcb3b465-c09b-4fe3-919f-8a7a6087740b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.516759 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-56eaf63a-f9c1-4125-95cf-970db69a1cf4 req-bcb3b465-c09b-4fe3-919f-8a7a6087740b service nova] Creating event network-vif-deleted:8ca68b0b-c2aa-4f1a-a1e6-ab53e4ea8d05 for instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e on n-h1-850499-14 Oct 04 18:21:02.524331 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-56eaf63a-f9c1-4125-95cf-970db69a1cf4 req-bcb3b465-c09b-4fe3-919f-8a7a6087740b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048661 Oct 04 18:21:02.528248 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2287/4561] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:02.535777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.536817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.545475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.548434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.549066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.554446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.554987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.556988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.559138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-98afce1d-ea99-4ed3-80c7-8ec16e594c5a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:02.569102 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-98afce1d-ea99-4ed3-80c7-8ec16e594c5a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1320 microversion: 2.1 time: 0.277114 Oct 04 18:21:02.570862 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2275/4562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1320 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:02.601780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1336dd9-e774-444a-9816-35fc006230b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.603012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1336dd9-e774-444a-9816-35fc006230b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.607957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.608919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.610286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.611011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lazy-loading 'fault' on Instance uuid e8b2bfb3-d80f-4ed6-95f0-5face8d7581e {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:02.621810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1336dd9-e774-444a-9816-35fc006230b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.622943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1336dd9-e774-444a-9816-35fc006230b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.623636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1336dd9-e774-444a-9816-35fc006230b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.625066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1336dd9-e774-444a-9816-35fc006230b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.625910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1336dd9-e774-444a-9816-35fc006230b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.627252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1336dd9-e774-444a-9816-35fc006230b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.674651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:02.685290 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ea8e213-e118-4671-800d-928538764416 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 200 len: 1326 microversion: 2.1 time: 0.155329 Oct 04 18:21:02.698986 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2288/4563] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 1326 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:02.804435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1336dd9-e774-444a-9816-35fc006230b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:02.817084 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1336dd9-e774-444a-9816-35fc006230b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.220037 Oct 04 18:21:02.818535 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2276/4564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:03.319424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d20d9188-0a30-4fad-be0f-ae5db42f64aa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.320572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d20d9188-0a30-4fad-be0f-ae5db42f64aa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.335392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d20d9188-0a30-4fad-be0f-ae5db42f64aa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.336685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d20d9188-0a30-4fad-be0f-ae5db42f64aa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.337378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d20d9188-0a30-4fad-be0f-ae5db42f64aa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.338311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d20d9188-0a30-4fad-be0f-ae5db42f64aa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.356356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d20d9188-0a30-4fad-be0f-ae5db42f64aa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.357229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d20d9188-0a30-4fad-be0f-ae5db42f64aa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.453215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e4a8b4de-e667-4b71-8e34-d4f290330126 req-cc151a76-eef5-473d-a404-61ff45fd8f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337526af-4c84-413b-8133-569a131bd502", "tag": "d193e9b9-c710-4bdd-8956-f06e03065ec9"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:03.467367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=14 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:03.471498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e4a8b4de-e667-4b71-8e34-d4f290330126 req-cc151a76-eef5-473d-a404-61ff45fd8f2d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.472193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e4a8b4de-e667-4b71-8e34-d4f290330126 req-cc151a76-eef5-473d-a404-61ff45fd8f2d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.472859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e4a8b4de-e667-4b71-8e34-d4f290330126 req-cc151a76-eef5-473d-a404-61ff45fd8f2d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.488454 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e4a8b4de-e667-4b71-8e34-d4f290330126 req-cc151a76-eef5-473d-a404-61ff45fd8f2d service nova] Creating event network-changed:d193e9b9-c710-4bdd-8956-f06e03065ec9 for instance 337526af-4c84-413b-8133-569a131bd502 on n-h2-850499-14 Oct 04 18:21:03.501752 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e4a8b4de-e667-4b71-8e34-d4f290330126 req-cc151a76-eef5-473d-a404-61ff45fd8f2d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054596 Oct 04 18:21:03.502855 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2277/4565] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:03.597183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8772641-e1cd-4e08-a2c5-14e0f61251d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.599314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e8772641-e1cd-4e08-a2c5-14e0f61251d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.609101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8772641-e1cd-4e08-a2c5-14e0f61251d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.609984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8772641-e1cd-4e08-a2c5-14e0f61251d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.610442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8772641-e1cd-4e08-a2c5-14e0f61251d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.611205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8772641-e1cd-4e08-a2c5-14e0f61251d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.611681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8772641-e1cd-4e08-a2c5-14e0f61251d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.612120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8772641-e1cd-4e08-a2c5-14e0f61251d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.635379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d20d9188-0a30-4fad-be0f-ae5db42f64aa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:03.646662 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d20d9188-0a30-4fad-be0f-ae5db42f64aa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.332180 Oct 04 18:21:03.647373 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2289/4566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:03.713838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.715200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.725483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.726632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.727314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.729758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.731338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.732365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.757724 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] HTTP exception thrown: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Request method failure captured: Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e HTTP/1.1 Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiadBR6CysqB9yQB7F3JCvpxSsHyJy0mT-tgRWF_4lkLmYkkkTp1u1LEfav-pltaOFx0CfYYdxcvpLc7IE6xO_IBD4LnIiLlflwVpTuqGv9AgUpWCxZeowjz_bFhv4B46eKGMU-BFvZTsvjnzUTpwWR7cCngsvmitcf8RBsZh_NOKM Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}] Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 30a7a667883542e386cb3fd5b65abc90 Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e8b2bfb3-d80f-4ed6-95f0-5face8d7581e'} Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:03.769314 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:21:03.773771 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:03.773771 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:03.773771 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:03.773771 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:03.773771 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:03.773771 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:21:03.773771 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:21:03.791367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Returning 404 to user: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:03.794532 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9750e9e6-9083-41f3-80b0-6e46847b11c1 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 404 len: 111 microversion: 2.1 time: 0.088668 Oct 04 18:21:03.795581 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2290/4567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:03.805452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca133788-1360-42da-9697-95548f5781bf tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '.version_select at 0x7fd4d1dd9040>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.862607 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca133788-1360-42da-9697-95548f5781bf tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-35417310" status: 202 len: 0 microversion: 2.1 time: 0.061357 Oct 04 18:21:03.864061 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2291/4568] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Oct 4 18:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-35417310 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:21:03.871625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ca0d952-4e7b-41ae-8af3-43b2ca047c98 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.872549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ca0d952-4e7b-41ae-8af3-43b2ca047c98 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.881994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca0d952-4e7b-41ae-8af3-43b2ca047c98 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.882601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca0d952-4e7b-41ae-8af3-43b2ca047c98 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.883178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca0d952-4e7b-41ae-8af3-43b2ca047c98 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.883994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca0d952-4e7b-41ae-8af3-43b2ca047c98 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.884588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca0d952-4e7b-41ae-8af3-43b2ca047c98 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.885122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca0d952-4e7b-41ae-8af3-43b2ca047c98 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.065973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8772641-e1cd-4e08-a2c5-14e0f61251d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:04.073754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e8772641-e1cd-4e08-a2c5-14e0f61251d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1320 microversion: 2.1 time: 0.482078 Oct 04 18:21:04.087400 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2278/4569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:04.192667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ca0d952-4e7b-41ae-8af3-43b2ca047c98 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:04.203581 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ca0d952-4e7b-41ae-8af3-43b2ca047c98 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.337335 Oct 04 18:21:04.204619 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2292/4570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:04.671357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ada39bb-83bd-42a7-89af-31cd60016d50 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:04.672170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ada39bb-83bd-42a7-89af-31cd60016d50 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:04.680780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ada39bb-83bd-42a7-89af-31cd60016d50 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.682228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ada39bb-83bd-42a7-89af-31cd60016d50 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.682842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ada39bb-83bd-42a7-89af-31cd60016d50 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.683879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ada39bb-83bd-42a7-89af-31cd60016d50 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.684500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ada39bb-83bd-42a7-89af-31cd60016d50 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.685092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ada39bb-83bd-42a7-89af-31cd60016d50 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.098299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a8b1c88b-b8be-4359-9853-e1bd74a80513 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:05.098923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a8b1c88b-b8be-4359-9853-e1bd74a80513 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:05.111164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b1c88b-b8be-4359-9853-e1bd74a80513 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.111625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b1c88b-b8be-4359-9853-e1bd74a80513 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.115674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b1c88b-b8be-4359-9853-e1bd74a80513 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.116444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b1c88b-b8be-4359-9853-e1bd74a80513 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.116979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b1c88b-b8be-4359-9853-e1bd74a80513 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.117724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8b1c88b-b8be-4359-9853-e1bd74a80513 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.492940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ada39bb-83bd-42a7-89af-31cd60016d50 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:05.504801 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ada39bb-83bd-42a7-89af-31cd60016d50 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.838464 Oct 04 18:21:05.512854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a8b1c88b-b8be-4359-9853-e1bd74a80513 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:05.520307 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2279/4571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:04 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:05.524492 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a8b1c88b-b8be-4359-9853-e1bd74a80513 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1320 microversion: 2.1 time: 0.430383 Oct 04 18:21:05.530099 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2293/4572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:05.534538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-53decc7d-9306-468c-843d-1c1491b60ec0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:05.537696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-53decc7d-9306-468c-843d-1c1491b60ec0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:05.547492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b32dc87-fd30-4a55-a930-cf9f46245530 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'create', calling method: .version_select at 0x7fd4d6179550>, body: {"keypair": {"name": "tempest-keypair-944967292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Xe+qwadpMRmwp7tRxG7Ndrop3sZdnvOXT/fDpMgd6QMY49l5AO0C0oDJJLyZ7TKdy50onWlplG98xhSjhhgs/epvnHxUL572K0uLiYOQBzkyXrtXn0oUWsGjY7IKAeA=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:05.554163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53decc7d-9306-468c-843d-1c1491b60ec0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.556140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53decc7d-9306-468c-843d-1c1491b60ec0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.558712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53decc7d-9306-468c-843d-1c1491b60ec0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.559871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53decc7d-9306-468c-843d-1c1491b60ec0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.560589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53decc7d-9306-468c-843d-1c1491b60ec0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.561697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53decc7d-9306-468c-843d-1c1491b60ec0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.588123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-9b32dc87-fd30-4a55-a930-cf9f46245530 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Getting quotas for project bc1c88ac592a4375a805aec597fbd50a. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:05.604421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:05.606276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-9b32dc87-fd30-4a55-a930-cf9f46245530 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Getting quotas for user 30a7a667883542e386cb3fd5b65abc90 and project bc1c88ac592a4375a805aec597fbd50a. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:05.658758 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b32dc87-fd30-4a55-a930-cf9f46245530 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121731 Oct 04 18:21:05.660229 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2294/4573] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:21:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:05.833128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-53decc7d-9306-468c-843d-1c1491b60ec0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:05.842634 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-53decc7d-9306-468c-843d-1c1491b60ec0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1505 microversion: 2.1 time: 0.320909 Oct 04 18:21:05.843256 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2280/4574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:05.890259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-af22b2ef-2dbb-4149-96c7-03ca342ac27e req-d0bb75e3-f9f0-4dd3-924f-a04772032306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e204a6f7-c18e-4943-9fcf-5de83ec21ae7", "name": "network-vif-plugged", "status": "completed", "tag": "efa272d3-5dd2-40ed-8566-cada96d72754"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:05.900011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:05.902142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af22b2ef-2dbb-4149-96c7-03ca342ac27e req-d0bb75e3-f9f0-4dd3-924f-a04772032306 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.902733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af22b2ef-2dbb-4149-96c7-03ca342ac27e req-d0bb75e3-f9f0-4dd3-924f-a04772032306 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.903538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af22b2ef-2dbb-4149-96c7-03ca342ac27e req-d0bb75e3-f9f0-4dd3-924f-a04772032306 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.916526 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-af22b2ef-2dbb-4149-96c7-03ca342ac27e req-d0bb75e3-f9f0-4dd3-924f-a04772032306 service nova] Creating event network-vif-plugged:efa272d3-5dd2-40ed-8566-cada96d72754 for instance e204a6f7-c18e-4943-9fcf-5de83ec21ae7 on n-h2-850499-14 Oct 04 18:21:05.923373 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-af22b2ef-2dbb-4149-96c7-03ca342ac27e req-d0bb75e3-f9f0-4dd3-924f-a04772032306 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037578 Oct 04 18:21:05.924209 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2295/4575] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:06.540065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3dd0d470-f605-4649-a329-75759c02bafd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.540976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3dd0d470-f605-4649-a329-75759c02bafd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.549604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd0d470-f605-4649-a329-75759c02bafd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.550061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd0d470-f605-4649-a329-75759c02bafd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.550722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd0d470-f605-4649-a329-75759c02bafd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.551653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd0d470-f605-4649-a329-75759c02bafd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.560086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-96ad7072-765c-4ff2-9200-13a984cb7d8c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.561443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-96ad7072-765c-4ff2-9200-13a984cb7d8c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.563500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd0d470-f605-4649-a329-75759c02bafd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.564503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd0d470-f605-4649-a329-75759c02bafd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.573557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96ad7072-765c-4ff2-9200-13a984cb7d8c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.575387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96ad7072-765c-4ff2-9200-13a984cb7d8c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.576300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96ad7072-765c-4ff2-9200-13a984cb7d8c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.577296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96ad7072-765c-4ff2-9200-13a984cb7d8c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.580402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96ad7072-765c-4ff2-9200-13a984cb7d8c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.581048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-96ad7072-765c-4ff2-9200-13a984cb7d8c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.862796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3dd0d470-f605-4649-a329-75759c02bafd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:06.871525 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3dd0d470-f605-4649-a329-75759c02bafd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.335438 Oct 04 18:21:06.872031 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2281/4576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:06 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:06.892113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-81918e81-803f-4424-962d-82f21d0a6be5 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.894213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-81918e81-803f-4424-962d-82f21d0a6be5 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.902499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81918e81-803f-4424-962d-82f21d0a6be5 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.903363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81918e81-803f-4424-962d-82f21d0a6be5 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.903885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81918e81-803f-4424-962d-82f21d0a6be5 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.904678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81918e81-803f-4424-962d-82f21d0a6be5 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.905539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81918e81-803f-4424-962d-82f21d0a6be5 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.905999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81918e81-803f-4424-962d-82f21d0a6be5 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.107946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-96ad7072-765c-4ff2-9200-13a984cb7d8c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:07.117684 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-96ad7072-765c-4ff2-9200-13a984cb7d8c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1320 microversion: 2.1 time: 0.563703 Oct 04 18:21:07.125850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2296/4577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:06 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1320 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:07.169360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-81918e81-803f-4424-962d-82f21d0a6be5 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:07.186507 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-81918e81-803f-4424-962d-82f21d0a6be5 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1485 microversion: 2.1 time: 0.299737 Oct 04 18:21:07.187535 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2282/4578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:06 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1485 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:07.372317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1446076029", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:07.466016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] validate_networks() for [('63d10a95-4ae5-444e-b554-0492822e0392', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:07.894923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-261e7ca4-80db-454e-a8a2-fcb9f7140e22 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:07.895921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-261e7ca4-80db-454e-a8a2-fcb9f7140e22 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:07.903512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261e7ca4-80db-454e-a8a2-fcb9f7140e22 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.904030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261e7ca4-80db-454e-a8a2-fcb9f7140e22 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.904449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261e7ca4-80db-454e-a8a2-fcb9f7140e22 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.905180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261e7ca4-80db-454e-a8a2-fcb9f7140e22 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.905634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261e7ca4-80db-454e-a8a2-fcb9f7140e22 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.906237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261e7ca4-80db-454e-a8a2-fcb9f7140e22 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.249898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-261e7ca4-80db-454e-a8a2-fcb9f7140e22 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.258452 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-261e7ca4-80db-454e-a8a2-fcb9f7140e22 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.367393 Oct 04 18:21:08.259727 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2283/4579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:07 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:08.265033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a827abf6-a256-44d3-91b7-139190d41749 req-b5643123-b3a4-4e76-8e7c-de9ce3aa7495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6feedde2-a663-42e2-bf40-d4e075b76053", "name": "network-vif-plugged", "status": "completed", "tag": "ed15c40b-0de4-4b81-b870-2576c898aa7a"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:08.276430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a827abf6-a256-44d3-91b7-139190d41749 req-b5643123-b3a4-4e76-8e7c-de9ce3aa7495 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.277716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a827abf6-a256-44d3-91b7-139190d41749 req-b5643123-b3a4-4e76-8e7c-de9ce3aa7495 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.278507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a827abf6-a256-44d3-91b7-139190d41749 req-b5643123-b3a4-4e76-8e7c-de9ce3aa7495 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.291061 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a827abf6-a256-44d3-91b7-139190d41749 req-b5643123-b3a4-4e76-8e7c-de9ce3aa7495 service nova] Creating event network-vif-plugged:ed15c40b-0de4-4b81-b870-2576c898aa7a for instance 6feedde2-a663-42e2-bf40-d4e075b76053 on n-h1-850499-14 Oct 04 18:21:08.296113 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a827abf6-a256-44d3-91b7-139190d41749 req-b5643123-b3a4-4e76-8e7c-de9ce3aa7495 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034861 Oct 04 18:21:08.296718 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2284/4580] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:08.302110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b0e2653e-99fe-4a0f-a0c1-eacc25b74877 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:08.302817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b0e2653e-99fe-4a0f-a0c1-eacc25b74877 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:08.309284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e2653e-99fe-4a0f-a0c1-eacc25b74877 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.309782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e2653e-99fe-4a0f-a0c1-eacc25b74877 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.310224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e2653e-99fe-4a0f-a0c1-eacc25b74877 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.311057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e2653e-99fe-4a0f-a0c1-eacc25b74877 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.311406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e2653e-99fe-4a0f-a0c1-eacc25b74877 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.312026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e2653e-99fe-4a0f-a0c1-eacc25b74877 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.544205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:08.544709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:08.545102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:08.546426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:08.546865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:08.572691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.573978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.575246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.576290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.577080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.577525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.610881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Getting quotas for project 1e47383b87bc4a2aa22f2297c0830e31. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:08.620008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Getting quotas for user a98f26cd0f90410ab0216ff424ff948c and project 1e47383b87bc4a2aa22f2297c0830e31. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:08.637983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:08.640394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:08.693495 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9348b579-d0e1-486a-b7df-bfa6f342779e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.330931 Oct 04 18:21:08.695296 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2297/4581] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:21:08.701104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b0e2653e-99fe-4a0f-a0c1-eacc25b74877 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.702275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-361675335", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbcce575-475a-46b4-9dc0-0dfcdfd87222"}], "security_groups": [{"name": "tempest-securitygroup--1111669162"}], "key_name": "tempest-keypair-944967292", "user_data": "}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:08.710723 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b0e2653e-99fe-4a0f-a0c1-eacc25b74877 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1320 microversion: 2.1 time: 0.412643 Oct 04 18:21:08.711351 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2285/4582] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:08 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1320 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:08.716362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-90627596-1602-4e0f-936d-c5411ece17c4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:08.716978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-90627596-1602-4e0f-936d-c5411ece17c4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:08.810503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90627596-1602-4e0f-936d-c5411ece17c4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.818019 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-90627596-1602-4e0f-936d-c5411ece17c4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1214 microversion: 2.1 time: 0.105661 Oct 04 18:21:08.826009 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2286/4583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:08 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:08.877933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] validate_networks() for [('cbcce575-475a-46b4-9dc0-0dfcdfd87222', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:09.285387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8560f124-b6c1-4306-b38d-13317582c760 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.286817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8560f124-b6c1-4306-b38d-13317582c760 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.294567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8560f124-b6c1-4306-b38d-13317582c760 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.295654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8560f124-b6c1-4306-b38d-13317582c760 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.296181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8560f124-b6c1-4306-b38d-13317582c760 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.296999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8560f124-b6c1-4306-b38d-13317582c760 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.297531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8560f124-b6c1-4306-b38d-13317582c760 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.298031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8560f124-b6c1-4306-b38d-13317582c760 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.413432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:09.414237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:09.415793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:09.418115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:09.419281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:09.449761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.450583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.451289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.452208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.452835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.453544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.475335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Getting quotas for project bc1c88ac592a4375a805aec597fbd50a. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:09.482940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Getting quotas for user 30a7a667883542e386cb3fd5b65abc90 and project bc1c88ac592a4375a805aec597fbd50a. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:09.501459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:09.504685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:09.544566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8560f124-b6c1-4306-b38d-13317582c760 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:09.554281 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8560f124-b6c1-4306-b38d-13317582c760 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.272964 Oct 04 18:21:09.554875 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2287/4584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:09.593311 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef459095-49fd-4c87-9f54-9c62fa104f0b tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.896800 Oct 04 18:21:09.597433 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2298/4585] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:21:09.619541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a236ebee-342c-41a3-9a26-aa32284d605f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.620451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a236ebee-342c-41a3-9a26-aa32284d605f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.729364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a236ebee-342c-41a3-9a26-aa32284d605f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:09.737551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7a08d863-d025-4272-8ed5-bf5cdd244d59 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.738436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7a08d863-d025-4272-8ed5-bf5cdd244d59 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.747734 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a236ebee-342c-41a3-9a26-aa32284d605f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1236 microversion: 2.1 time: 0.142656 Oct 04 18:21:09.749607 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2288/4586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1236 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:09.755418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a08d863-d025-4272-8ed5-bf5cdd244d59 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.756158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a08d863-d025-4272-8ed5-bf5cdd244d59 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.756767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a08d863-d025-4272-8ed5-bf5cdd244d59 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.757776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a08d863-d025-4272-8ed5-bf5cdd244d59 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.758488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a08d863-d025-4272-8ed5-bf5cdd244d59 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.759113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a08d863-d025-4272-8ed5-bf5cdd244d59 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.849959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96883648-7571-4bdc-a9c8-e9375e4cea49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.850633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96883648-7571-4bdc-a9c8-e9375e4cea49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.867629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96883648-7571-4bdc-a9c8-e9375e4cea49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.871372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96883648-7571-4bdc-a9c8-e9375e4cea49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.871853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96883648-7571-4bdc-a9c8-e9375e4cea49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.872847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96883648-7571-4bdc-a9c8-e9375e4cea49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.875013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96883648-7571-4bdc-a9c8-e9375e4cea49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.877267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96883648-7571-4bdc-a9c8-e9375e4cea49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.039382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96883648-7571-4bdc-a9c8-e9375e4cea49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.072016 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96883648-7571-4bdc-a9c8-e9375e4cea49 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1210 microversion: 2.1 time: 0.234402 Oct 04 18:21:10.083859 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2289/4587] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1210 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:10.094649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7a08d863-d025-4272-8ed5-bf5cdd244d59 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.112007 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7a08d863-d025-4272-8ed5-bf5cdd244d59 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1320 microversion: 2.1 time: 0.377563 Oct 04 18:21:10.118793 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2299/4588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:10.581000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-009a5bcb-9d44-4c52-ae43-4cc029457db1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.581805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-009a5bcb-9d44-4c52-ae43-4cc029457db1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:10.590128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009a5bcb-9d44-4c52-ae43-4cc029457db1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.590624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009a5bcb-9d44-4c52-ae43-4cc029457db1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.591284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009a5bcb-9d44-4c52-ae43-4cc029457db1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.592018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009a5bcb-9d44-4c52-ae43-4cc029457db1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.592608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009a5bcb-9d44-4c52-ae43-4cc029457db1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.593048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009a5bcb-9d44-4c52-ae43-4cc029457db1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.773352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6a979713-738b-4203-b4e9-5e3e987512f3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.777668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6a979713-738b-4203-b4e9-5e3e987512f3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:10.783149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a979713-738b-4203-b4e9-5e3e987512f3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.783663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a979713-738b-4203-b4e9-5e3e987512f3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.784118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a979713-738b-4203-b4e9-5e3e987512f3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.784838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a979713-738b-4203-b4e9-5e3e987512f3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.785524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a979713-738b-4203-b4e9-5e3e987512f3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.785964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a979713-738b-4203-b4e9-5e3e987512f3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.831315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-009a5bcb-9d44-4c52-ae43-4cc029457db1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.846943 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-009a5bcb-9d44-4c52-ae43-4cc029457db1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.271101 Oct 04 18:21:10.847558 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2290/4589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:10.897384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6a979713-738b-4203-b4e9-5e3e987512f3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.906644 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6a979713-738b-4203-b4e9-5e3e987512f3 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1232 microversion: 2.1 time: 0.137894 Oct 04 18:21:10.907280 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2300/4590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1232 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:11.098258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b8cd365c-6b6f-4bdc-badb-af5685ef6a43 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.098983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b8cd365c-6b6f-4bdc-badb-af5685ef6a43 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:11.108944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8cd365c-6b6f-4bdc-badb-af5685ef6a43 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.111945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8cd365c-6b6f-4bdc-badb-af5685ef6a43 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.112612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8cd365c-6b6f-4bdc-badb-af5685ef6a43 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.113999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8cd365c-6b6f-4bdc-badb-af5685ef6a43 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.116723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8cd365c-6b6f-4bdc-badb-af5685ef6a43 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.117362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8cd365c-6b6f-4bdc-badb-af5685ef6a43 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.137708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-56d500ab-becc-4cdf-b152-b01aa2717484 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.138577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-56d500ab-becc-4cdf-b152-b01aa2717484 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:11.145392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56d500ab-becc-4cdf-b152-b01aa2717484 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.146261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56d500ab-becc-4cdf-b152-b01aa2717484 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.155711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56d500ab-becc-4cdf-b152-b01aa2717484 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.156979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56d500ab-becc-4cdf-b152-b01aa2717484 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.159748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56d500ab-becc-4cdf-b152-b01aa2717484 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.160491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56d500ab-becc-4cdf-b152-b01aa2717484 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.233364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b8cd365c-6b6f-4bdc-badb-af5685ef6a43 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:11.245315 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b8cd365c-6b6f-4bdc-badb-af5685ef6a43 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1284 microversion: 2.1 time: 0.150985 Oct 04 18:21:11.246224 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2291/4591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:11.453904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-56d500ab-becc-4cdf-b152-b01aa2717484 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:11.463294 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-56d500ab-becc-4cdf-b152-b01aa2717484 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 200 len: 1507 microversion: 2.1 time: 0.330061 Oct 04 18:21:11.464077 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2301/4592] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:11.489253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-18b6f848-3535-418a-b8f1-ab227a16c1a7 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.490043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-18b6f848-3535-418a-b8f1-ab227a16c1a7 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: e204a6f7-c18e-4943-9fcf-5de83ec21ae7] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:11.503848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18b6f848-3535-418a-b8f1-ab227a16c1a7 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.508428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18b6f848-3535-418a-b8f1-ab227a16c1a7 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.509197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18b6f848-3535-418a-b8f1-ab227a16c1a7 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.512533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18b6f848-3535-418a-b8f1-ab227a16c1a7 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.513883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18b6f848-3535-418a-b8f1-ab227a16c1a7 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.514390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18b6f848-3535-418a-b8f1-ab227a16c1a7 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.763603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-18b6f848-3535-418a-b8f1-ab227a16c1a7 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:11.775306 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-18b6f848-3535-418a-b8f1-ab227a16c1a7 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/e204a6f7-c18e-4943-9fcf-5de83ec21ae7" status: 200 len: 1508 microversion: 2.1 time: 0.288109 Oct 04 18:21:11.776155 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2292/4593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/servers/e204a6f7-c18e-4943-9fcf-5de83ec21ae7 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:11.801588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a10ed660-19e4-487a-b885-eeedab9b1b4a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.802842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a10ed660-19e4-487a-b885-eeedab9b1b4a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: e204a6f7-c18e-4943-9fcf-5de83ec21ae7] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:11.819261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10ed660-19e4-487a-b885-eeedab9b1b4a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.822491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10ed660-19e4-487a-b885-eeedab9b1b4a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.827235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10ed660-19e4-487a-b885-eeedab9b1b4a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.828357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10ed660-19e4-487a-b885-eeedab9b1b4a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.829029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10ed660-19e4-487a-b885-eeedab9b1b4a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.829632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10ed660-19e4-487a-b885-eeedab9b1b4a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.867223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a10ed660-19e4-487a-b885-eeedab9b1b4a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: e204a6f7-c18e-4943-9fcf-5de83ec21ae7] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:11.872808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-980e9470-4224-4a87-a443-fe89908a35f3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.873631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-980e9470-4224-4a87-a443-fe89908a35f3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:11.887629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980e9470-4224-4a87-a443-fe89908a35f3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.888382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980e9470-4224-4a87-a443-fe89908a35f3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.889077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980e9470-4224-4a87-a443-fe89908a35f3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.889786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980e9470-4224-4a87-a443-fe89908a35f3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.890307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980e9470-4224-4a87-a443-fe89908a35f3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.891734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980e9470-4224-4a87-a443-fe89908a35f3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.949976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:11.998065 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a10ed660-19e4-487a-b885-eeedab9b1b4a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e204a6f7-c18e-4943-9fcf-5de83ec21ae7" status: 204 len: 0 microversion: 2.1 time: 0.200124 Oct 04 18:21:11.999449 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2302/4594] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:11 2022] DELETE /compute/v2.1/servers/e204a6f7-c18e-4943-9fcf-5de83ec21ae7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:12.010194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f7e688c-14d7-4cf5-bae5-a278644cfc89 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:12.011702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2f7e688c-14d7-4cf5-bae5-a278644cfc89 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:12.018749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7e688c-14d7-4cf5-bae5-a278644cfc89 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.019411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7e688c-14d7-4cf5-bae5-a278644cfc89 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.019958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7e688c-14d7-4cf5-bae5-a278644cfc89 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.020749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7e688c-14d7-4cf5-bae5-a278644cfc89 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.021205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7e688c-14d7-4cf5-bae5-a278644cfc89 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.021787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f7e688c-14d7-4cf5-bae5-a278644cfc89 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.202200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2f7e688c-14d7-4cf5-bae5-a278644cfc89 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:12.216627 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2f7e688c-14d7-4cf5-bae5-a278644cfc89 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1306 microversion: 2.1 time: 0.215643 Oct 04 18:21:12.217264 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2303/4595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1306 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:12.226976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f374f166-88ab-4f2a-9b6b-8e34b69e6df5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:12.227509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f374f166-88ab-4f2a-9b6b-8e34b69e6df5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:12.234685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f374f166-88ab-4f2a-9b6b-8e34b69e6df5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.235233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f374f166-88ab-4f2a-9b6b-8e34b69e6df5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.235902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f374f166-88ab-4f2a-9b6b-8e34b69e6df5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.236996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f374f166-88ab-4f2a-9b6b-8e34b69e6df5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.237627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f374f166-88ab-4f2a-9b6b-8e34b69e6df5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.239812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f374f166-88ab-4f2a-9b6b-8e34b69e6df5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.266223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:12.272337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f374f166-88ab-4f2a-9b6b-8e34b69e6df5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 6feedde2-a663-42e2-bf40-d4e075b76053] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:12.327457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-980e9470-4224-4a87-a443-fe89908a35f3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:12.358135 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-980e9470-4224-4a87-a443-fe89908a35f3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.491091 Oct 04 18:21:12.359423 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2293/4596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:12.367040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f79cd4c-5c8c-41cf-b4d1-ce7c8fbc3140 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:12.368662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f79cd4c-5c8c-41cf-b4d1-ce7c8fbc3140 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:12.379230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f79cd4c-5c8c-41cf-b4d1-ce7c8fbc3140 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.380172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f79cd4c-5c8c-41cf-b4d1-ce7c8fbc3140 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.381055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f79cd4c-5c8c-41cf-b4d1-ce7c8fbc3140 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.382591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f79cd4c-5c8c-41cf-b4d1-ce7c8fbc3140 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.383444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f79cd4c-5c8c-41cf-b4d1-ce7c8fbc3140 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.384754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f79cd4c-5c8c-41cf-b4d1-ce7c8fbc3140 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.428727 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f374f166-88ab-4f2a-9b6b-8e34b69e6df5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053" status: 204 len: 0 microversion: 2.1 time: 0.210176 Oct 04 18:21:12.453537 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2304/4597] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:12 2022] DELETE /compute/v2.1/servers/6feedde2-a663-42e2-bf40-d4e075b76053 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:12.653337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-979051136", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "bf153d21-e8e7-49e5-8d30-06d0c90e6431"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:12.727571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] validate_networks() for [('bf153d21-e8e7-49e5-8d30-06d0c90e6431', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:13.146475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1f79cd4c-5c8c-41cf-b4d1-ce7c8fbc3140 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.155771 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f79cd4c-5c8c-41cf-b4d1-ce7c8fbc3140 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1314 microversion: 2.1 time: 0.793475 Oct 04 18:21:13.156587 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2294/4598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:12 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.161606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-30955a96-26b7-43ce-829a-7018ba8a4bd4 req-89ee9d93-7ea1-4637-a011-2498af525849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337526af-4c84-413b-8133-569a131bd502", "name": "network-vif-plugged", "status": "completed", "tag": "d193e9b9-c710-4bdd-8956-f06e03065ec9"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:13.173315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-30955a96-26b7-43ce-829a-7018ba8a4bd4 req-89ee9d93-7ea1-4637-a011-2498af525849 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.174151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-30955a96-26b7-43ce-829a-7018ba8a4bd4 req-89ee9d93-7ea1-4637-a011-2498af525849 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.174802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-30955a96-26b7-43ce-829a-7018ba8a4bd4 req-89ee9d93-7ea1-4637-a011-2498af525849 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.187125 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-30955a96-26b7-43ce-829a-7018ba8a4bd4 req-89ee9d93-7ea1-4637-a011-2498af525849 service nova] Creating event network-vif-plugged:d193e9b9-c710-4bdd-8956-f06e03065ec9 for instance 337526af-4c84-413b-8133-569a131bd502 on n-h2-850499-14 Oct 04 18:21:13.192579 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-30955a96-26b7-43ce-829a-7018ba8a4bd4 req-89ee9d93-7ea1-4637-a011-2498af525849 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034410 Oct 04 18:21:13.193263 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2295/4599] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:13.423344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] Calling method '.version_select at 0x7fd4d2adb820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.425860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.426361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.427092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.442534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.443430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.444103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.453562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:13.454014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:13.454575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:13.455274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:13.455851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:13.456012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.456531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.457045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.463355 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9be558e6-3e08-49b0-9b5c-d29fdddaa661 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1390430566-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.268705 Oct 04 18:21:13.464089 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2296/4600] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:13.468760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d985667f-542f-4970-b78f-c3e5fd64088f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.469733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.469997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d985667f-542f-4970-b78f-c3e5fd64088f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.470236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.476686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d985667f-542f-4970-b78f-c3e5fd64088f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.477175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d985667f-542f-4970-b78f-c3e5fd64088f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.477615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d985667f-542f-4970-b78f-c3e5fd64088f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.478319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d985667f-542f-4970-b78f-c3e5fd64088f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.478782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d985667f-542f-4970-b78f-c3e5fd64088f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.479767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d985667f-542f-4970-b78f-c3e5fd64088f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.479874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.480788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.481358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.481810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.504501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Getting quotas for project c658c675bc1846669c38a1b22d3b1098. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:13.511600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Getting quotas for user 6962aec4d9994696bbe5c6d168f62228 and project c658c675bc1846669c38a1b22d3b1098. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:13.526023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Going to run 2 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:13.528938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:13.566042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=ad37c778-7726-4ad7-a88d-0b3b7a553570,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:13.577054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d985667f-542f-4970-b78f-c3e5fd64088f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.586158 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d985667f-542f-4970-b78f-c3e5fd64088f tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1294 microversion: 2.1 time: 0.120658 Oct 04 18:21:13.587399 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2297/4601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.597368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6442a14c-26ba-4a21-9352-0bd90c6e1636 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.598372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6442a14c-26ba-4a21-9352-0bd90c6e1636 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.606777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6442a14c-26ba-4a21-9352-0bd90c6e1636 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.611112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6442a14c-26ba-4a21-9352-0bd90c6e1636 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.611887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6442a14c-26ba-4a21-9352-0bd90c6e1636 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.612845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6442a14c-26ba-4a21-9352-0bd90c6e1636 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.613514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6442a14c-26ba-4a21-9352-0bd90c6e1636 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.614152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6442a14c-26ba-4a21-9352-0bd90c6e1636 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.634769 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75d44562-d86a-41da-b6c5-089d86f4f8a6 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.986310 Oct 04 18:21:13.639188 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2305/4602] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:12 2022] POST /compute/v2.1/servers => generated 32 bytes in 992 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:21:13.645215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.651814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.652548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Searching by: {'deleted': False, 'project_id': 'c658c675bc1846669c38a1b22d3b1098'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:21:13.672958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.673468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.673917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.674884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.675573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.676051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.705981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:21:13.737018 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75ce5761-20bf-4c67-9dce-d429eb71da4c tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.096643 Oct 04 18:21:13.746418 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2306/4603] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.754315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-19378721-0536-4d71-b83f-fb7e5fd5e6cc tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.754315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-19378721-0536-4d71-b83f-fb7e5fd5e6cc tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.885578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-19378721-0536-4d71-b83f-fb7e5fd5e6cc tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.893927 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-19378721-0536-4d71-b83f-fb7e5fd5e6cc tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1217 microversion: 2.1 time: 0.146347 Oct 04 18:21:13.895140 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2307/4604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:14.028651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6442a14c-26ba-4a21-9352-0bd90c6e1636 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:14.041152 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6442a14c-26ba-4a21-9352-0bd90c6e1636 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.452123 Oct 04 18:21:14.043393 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2298/4605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:14.180643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b28e5ffd-b57e-43ea-b4fd-c05c5f5b3118 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:14.181395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b28e5ffd-b57e-43ea-b4fd-c05c5f5b3118 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:14.197274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b28e5ffd-b57e-43ea-b4fd-c05c5f5b3118 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.198593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b28e5ffd-b57e-43ea-b4fd-c05c5f5b3118 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.202698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b28e5ffd-b57e-43ea-b4fd-c05c5f5b3118 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.203976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b28e5ffd-b57e-43ea-b4fd-c05c5f5b3118 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.206010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b28e5ffd-b57e-43ea-b4fd-c05c5f5b3118 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.207798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b28e5ffd-b57e-43ea-b4fd-c05c5f5b3118 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.288540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:14.297763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:14.298936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Searching by: {'deleted': False, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:21:14.304565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.305345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.306003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.307007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.307758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.308971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.352446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:21:14.391404 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ecc418b8-028b-4073-ba43-3b4364632777 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.106681 Oct 04 18:21:14.392313 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2299/4606] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 18:21:14 2022] GET /compute/v2.1/servers => generated 340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:14.406816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:14.411905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:14.413138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Searching by: {'deleted': False, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:21:14.419451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.420579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.421302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.422899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.423663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.424701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.480584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:21:14.548661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:14.560824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.561659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.562182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.845094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b28e5ffd-b57e-43ea-b4fd-c05c5f5b3118 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:14.873672 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b28e5ffd-b57e-43ea-b4fd-c05c5f5b3118 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1314 microversion: 2.1 time: 0.695576 Oct 04 18:21:14.890846 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2308/4607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:14 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:14.890846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5c55e7bf-be59-43c5-af5f-04d69673a16d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:14.890846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5c55e7bf-be59-43c5-af5f-04d69673a16d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:14.895531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c55e7bf-be59-43c5-af5f-04d69673a16d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.896397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c55e7bf-be59-43c5-af5f-04d69673a16d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.897387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c55e7bf-be59-43c5-af5f-04d69673a16d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.898184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c55e7bf-be59-43c5-af5f-04d69673a16d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.898701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c55e7bf-be59-43c5-af5f-04d69673a16d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.899246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c55e7bf-be59-43c5-af5f-04d69673a16d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.091689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5c55e7bf-be59-43c5-af5f-04d69673a16d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:15.108052 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5c55e7bf-be59-43c5-af5f-04d69673a16d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1294 microversion: 2.1 time: 0.231001 Oct 04 18:21:15.117771 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-abc4cb18-ebae-4fb5-86c8-d81e4cbd2b96 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.716827 Oct 04 18:21:15.118626 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2300/4608] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:21:14 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:15.136658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fa787375-95aa-48d5-a6af-62c3c57dbcf4 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.137538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fa787375-95aa-48d5-a6af-62c3c57dbcf4 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:15.139665 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2309/4609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:14 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1294 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:15.148979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa787375-95aa-48d5-a6af-62c3c57dbcf4 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.149760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa787375-95aa-48d5-a6af-62c3c57dbcf4 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.150367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa787375-95aa-48d5-a6af-62c3c57dbcf4 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.151357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa787375-95aa-48d5-a6af-62c3c57dbcf4 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.152001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa787375-95aa-48d5-a6af-62c3c57dbcf4 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.155088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9467923a-8809-48f1-9ed6-a11be580564c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.155735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9467923a-8809-48f1-9ed6-a11be580564c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:15.156005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa787375-95aa-48d5-a6af-62c3c57dbcf4 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.176900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=13,nova_api:UPDATE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:15.188076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9467923a-8809-48f1-9ed6-a11be580564c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.189571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9467923a-8809-48f1-9ed6-a11be580564c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.190526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9467923a-8809-48f1-9ed6-a11be580564c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.191922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9467923a-8809-48f1-9ed6-a11be580564c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.192602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9467923a-8809-48f1-9ed6-a11be580564c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.193522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9467923a-8809-48f1-9ed6-a11be580564c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.511392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fa787375-95aa-48d5-a6af-62c3c57dbcf4 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:15.518799 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fa787375-95aa-48d5-a6af-62c3c57dbcf4 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1269 microversion: 2.1 time: 0.398896 Oct 04 18:21:15.521422 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2301/4610] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1269 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:15.527929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f36bdb14-c192-4ebf-98a3-128983adec66 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.536290 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f36bdb14-c192-4ebf-98a3-128983adec66 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012677 Oct 04 18:21:15.537405 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2302/4611] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:15.686514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9467923a-8809-48f1-9ed6-a11be580564c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:15.696561 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9467923a-8809-48f1-9ed6-a11be580564c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 0.554936 Oct 04 18:21:15.697508 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2310/4612] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:15.900444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c3e50cfd-e446-48c7-9197-c5c1ce8e50f0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.901612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c3e50cfd-e446-48c7-9197-c5c1ce8e50f0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:15.912624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3e50cfd-e446-48c7-9197-c5c1ce8e50f0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.913127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3e50cfd-e446-48c7-9197-c5c1ce8e50f0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.919625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3e50cfd-e446-48c7-9197-c5c1ce8e50f0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.920623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3e50cfd-e446-48c7-9197-c5c1ce8e50f0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.921300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3e50cfd-e446-48c7-9197-c5c1ce8e50f0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.921927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3e50cfd-e446-48c7-9197-c5c1ce8e50f0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.145748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d9da6f6-d846-4801-97b9-5b48bdcce173 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.146502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0d9da6f6-d846-4801-97b9-5b48bdcce173 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:16.154780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9da6f6-d846-4801-97b9-5b48bdcce173 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.155306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9da6f6-d846-4801-97b9-5b48bdcce173 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.155757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9da6f6-d846-4801-97b9-5b48bdcce173 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.156472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9da6f6-d846-4801-97b9-5b48bdcce173 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.156936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9da6f6-d846-4801-97b9-5b48bdcce173 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.157366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9da6f6-d846-4801-97b9-5b48bdcce173 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.328482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0d9da6f6-d846-4801-97b9-5b48bdcce173 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:16.341133 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0d9da6f6-d846-4801-97b9-5b48bdcce173 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1294 microversion: 2.1 time: 0.199211 Oct 04 18:21:16.372240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c3e50cfd-e446-48c7-9197-c5c1ce8e50f0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:16.380149 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2311/4613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:16 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1294 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:16.383091 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c3e50cfd-e446-48c7-9197-c5c1ce8e50f0 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1314 microversion: 2.1 time: 0.489137 Oct 04 18:21:16.384317 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2303/4614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:16.534591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-11eb50d9-3c11-4a4f-8747-c8f00ad56a67 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.538933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-11eb50d9-3c11-4a4f-8747-c8f00ad56a67 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:16.547770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-667b4bce-f70e-42fd-9c72-614fbcb5883b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.548540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-667b4bce-f70e-42fd-9c72-614fbcb5883b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:16.556398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11eb50d9-3c11-4a4f-8747-c8f00ad56a67 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.557533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11eb50d9-3c11-4a4f-8747-c8f00ad56a67 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.559716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11eb50d9-3c11-4a4f-8747-c8f00ad56a67 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.561873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-667b4bce-f70e-42fd-9c72-614fbcb5883b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.562393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-667b4bce-f70e-42fd-9c72-614fbcb5883b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.562734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11eb50d9-3c11-4a4f-8747-c8f00ad56a67 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.562847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-667b4bce-f70e-42fd-9c72-614fbcb5883b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.563638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11eb50d9-3c11-4a4f-8747-c8f00ad56a67 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.564310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11eb50d9-3c11-4a4f-8747-c8f00ad56a67 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.565924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-667b4bce-f70e-42fd-9c72-614fbcb5883b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.569332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-667b4bce-f70e-42fd-9c72-614fbcb5883b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.569864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-667b4bce-f70e-42fd-9c72-614fbcb5883b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.641913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-11eb50d9-3c11-4a4f-8747-c8f00ad56a67 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:16.772348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-667b4bce-f70e-42fd-9c72-614fbcb5883b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:16.793070 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-667b4bce-f70e-42fd-9c72-614fbcb5883b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1275 microversion: 2.1 time: 0.243604 Oct 04 18:21:16.793070 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2304/4615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:16 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:16.818612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-44c0174c-8ac5-47b3-a68f-80fb863b1655 req-63bc42f7-a665-4396-a51f-ad6676a51efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6feedde2-a663-42e2-bf40-d4e075b76053", "name": "network-vif-deleted", "tag": "ed15c40b-0de4-4b81-b870-2576c898aa7a"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:16.842821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-44c0174c-8ac5-47b3-a68f-80fb863b1655 req-63bc42f7-a665-4396-a51f-ad6676a51efa service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.846024 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-11eb50d9-3c11-4a4f-8747-c8f00ad56a67 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 204 len: 0 microversion: 2.1 time: 0.326147 Oct 04 18:21:16.847018 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2312/4616] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:16 2022] DELETE /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:16.849628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-44c0174c-8ac5-47b3-a68f-80fb863b1655 req-63bc42f7-a665-4396-a51f-ad6676a51efa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.854746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-439cd849-8465-4766-b4f1-064aed5387ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.855213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-44c0174c-8ac5-47b3-a68f-80fb863b1655 req-63bc42f7-a665-4396-a51f-ad6676a51efa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.861808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-439cd849-8465-4766-b4f1-064aed5387ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:16.873654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-439cd849-8465-4766-b4f1-064aed5387ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.874165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-439cd849-8465-4766-b4f1-064aed5387ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.874616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-439cd849-8465-4766-b4f1-064aed5387ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.875375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-439cd849-8465-4766-b4f1-064aed5387ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.875845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-439cd849-8465-4766-b4f1-064aed5387ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.876287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-439cd849-8465-4766-b4f1-064aed5387ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.881460 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-44c0174c-8ac5-47b3-a68f-80fb863b1655 req-63bc42f7-a665-4396-a51f-ad6676a51efa service nova] Creating event network-vif-deleted:ed15c40b-0de4-4b81-b870-2576c898aa7a for instance 6feedde2-a663-42e2-bf40-d4e075b76053 on n-h1-850499-14 Oct 04 18:21:16.891333 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-44c0174c-8ac5-47b3-a68f-80fb863b1655 req-63bc42f7-a665-4396-a51f-ad6676a51efa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097561 Oct 04 18:21:16.892564 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2305/4617] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:16.900652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e10ffb96-7d96-406b-89f4-b1e2f0d0f945 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.909621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e10ffb96-7d96-406b-89f4-b1e2f0d0f945 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:16.924229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10ffb96-7d96-406b-89f4-b1e2f0d0f945 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.924725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10ffb96-7d96-406b-89f4-b1e2f0d0f945 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.925177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10ffb96-7d96-406b-89f4-b1e2f0d0f945 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.925907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10ffb96-7d96-406b-89f4-b1e2f0d0f945 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.926378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10ffb96-7d96-406b-89f4-b1e2f0d0f945 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.926816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10ffb96-7d96-406b-89f4-b1e2f0d0f945 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.816995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e10ffb96-7d96-406b-89f4-b1e2f0d0f945 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:17.826575 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e10ffb96-7d96-406b-89f4-b1e2f0d0f945 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1713 microversion: 2.1 time: 0.932559 Oct 04 18:21:17.840897 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2306/4618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:16 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1713 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:17.851208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-439cd849-8465-4766-b4f1-064aed5387ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:17.862790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-76e50da6-41b4-46f8-a326-2aa4f0a30b54 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.863175 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-439cd849-8465-4766-b4f1-064aed5387ab tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1321 microversion: 2.1 time: 1.014749 Oct 04 18:21:17.866766 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2313/4619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:16 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1321 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:17.870720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-76e50da6-41b4-46f8-a326-2aa4f0a30b54 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.878290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ca18db0-f867-409c-a6df-6179e6b1d1ef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.878933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ca18db0-f867-409c-a6df-6179e6b1d1ef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.882883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76e50da6-41b4-46f8-a326-2aa4f0a30b54 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.883522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76e50da6-41b4-46f8-a326-2aa4f0a30b54 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.884216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76e50da6-41b4-46f8-a326-2aa4f0a30b54 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.885282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76e50da6-41b4-46f8-a326-2aa4f0a30b54 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.886068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76e50da6-41b4-46f8-a326-2aa4f0a30b54 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.886813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76e50da6-41b4-46f8-a326-2aa4f0a30b54 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.896258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca18db0-f867-409c-a6df-6179e6b1d1ef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.896776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca18db0-f867-409c-a6df-6179e6b1d1ef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.897228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca18db0-f867-409c-a6df-6179e6b1d1ef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.897960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca18db0-f867-409c-a6df-6179e6b1d1ef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.898432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca18db0-f867-409c-a6df-6179e6b1d1ef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.898874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ca18db0-f867-409c-a6df-6179e6b1d1ef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.172972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-76e50da6-41b4-46f8-a326-2aa4f0a30b54 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.184748 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-76e50da6-41b4-46f8-a326-2aa4f0a30b54 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.342482 Oct 04 18:21:18.185537 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2307/4620] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:17 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:18.196175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1ca18db0-f867-409c-a6df-6179e6b1d1ef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.214993 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ca18db0-f867-409c-a6df-6179e6b1d1ef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1314 microversion: 2.1 time: 0.343058 Oct 04 18:21:18.217855 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2314/4621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:17 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:18.223667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-84f96aac-1897-4c89-bb07-979b15f64b98 req-f2d0569e-0140-49a4-b411-91f50b8a4d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429dcfa4-74db-46e5-9a98-db882b272ca4", "tag": "c123cb18-ad97-4e5a-8909-e5bf85c7654b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:18.235401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-84f96aac-1897-4c89-bb07-979b15f64b98 req-f2d0569e-0140-49a4-b411-91f50b8a4d73 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.236159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-84f96aac-1897-4c89-bb07-979b15f64b98 req-f2d0569e-0140-49a4-b411-91f50b8a4d73 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.236736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-84f96aac-1897-4c89-bb07-979b15f64b98 req-f2d0569e-0140-49a4-b411-91f50b8a4d73 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.253187 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-84f96aac-1897-4c89-bb07-979b15f64b98 req-f2d0569e-0140-49a4-b411-91f50b8a4d73 service nova] Creating event network-changed:c123cb18-ad97-4e5a-8909-e5bf85c7654b for instance 429dcfa4-74db-46e5-9a98-db882b272ca4 on n-h1-850499-14 Oct 04 18:21:18.254445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2d47bb0c-1989-4855-8835-5d18e8d6569f tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:18.257581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2d47bb0c-1989-4855-8835-5d18e8d6569f tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:18.260729 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-84f96aac-1897-4c89-bb07-979b15f64b98 req-f2d0569e-0140-49a4-b411-91f50b8a4d73 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044986 Oct 04 18:21:18.261931 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2308/4622] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:18.271907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d47bb0c-1989-4855-8835-5d18e8d6569f tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.272427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d47bb0c-1989-4855-8835-5d18e8d6569f tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.272884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d47bb0c-1989-4855-8835-5d18e8d6569f tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.273784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d47bb0c-1989-4855-8835-5d18e8d6569f tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.275297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d47bb0c-1989-4855-8835-5d18e8d6569f tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.278287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2d47bb0c-1989-4855-8835-5d18e8d6569f tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.712152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2d47bb0c-1989-4855-8835-5d18e8d6569f tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.724831 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2d47bb0c-1989-4855-8835-5d18e8d6569f tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1317 microversion: 2.1 time: 0.492690 Oct 04 18:21:18.728363 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2315/4623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:18 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:18.864488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-42b0353a-3977-4f08-a617-f9ffb78abee1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:18.866129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-42b0353a-3977-4f08-a617-f9ffb78abee1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:18.875491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42b0353a-3977-4f08-a617-f9ffb78abee1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.876221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42b0353a-3977-4f08-a617-f9ffb78abee1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.877339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42b0353a-3977-4f08-a617-f9ffb78abee1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.878271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42b0353a-3977-4f08-a617-f9ffb78abee1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.880045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42b0353a-3977-4f08-a617-f9ffb78abee1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.880959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42b0353a-3977-4f08-a617-f9ffb78abee1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.897300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd8bc296-0c34-40e9-a1d9-9d5ca2df4639 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:18.899417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd8bc296-0c34-40e9-a1d9-9d5ca2df4639 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:18.909766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd8bc296-0c34-40e9-a1d9-9d5ca2df4639 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.912164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd8bc296-0c34-40e9-a1d9-9d5ca2df4639 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.913855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd8bc296-0c34-40e9-a1d9-9d5ca2df4639 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.915006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd8bc296-0c34-40e9-a1d9-9d5ca2df4639 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.937513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd8bc296-0c34-40e9-a1d9-9d5ca2df4639 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.941896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd8bc296-0c34-40e9-a1d9-9d5ca2df4639 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.564800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-42b0353a-3977-4f08-a617-f9ffb78abee1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:19.565414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fd8bc296-0c34-40e9-a1d9-9d5ca2df4639 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:19.609527 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-42b0353a-3977-4f08-a617-f9ffb78abee1 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1713 microversion: 2.1 time: 0.755327 Oct 04 18:21:19.610137 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2309/4624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:18 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1713 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:19.618015 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd8bc296-0c34-40e9-a1d9-9d5ca2df4639 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1502 microversion: 2.1 time: 0.726061 Oct 04 18:21:19.619572 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2316/4625] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:18 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1502 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:19.627135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-37c14313-1989-4772-8490-57a44a472bf5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.628302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-37c14313-1989-4772-8490-57a44a472bf5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:19.640403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a40560b3-d95a-4398-af20-e93db4ff0a05 req-21560bf8-7c4c-41c1-ba62-f70571252ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e204a6f7-c18e-4943-9fcf-5de83ec21ae7", "name": "network-vif-deleted", "tag": "efa272d3-5dd2-40ed-8566-cada96d72754"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:19.641087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37c14313-1989-4772-8490-57a44a472bf5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.642561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37c14313-1989-4772-8490-57a44a472bf5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.643292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37c14313-1989-4772-8490-57a44a472bf5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.645427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37c14313-1989-4772-8490-57a44a472bf5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.647901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37c14313-1989-4772-8490-57a44a472bf5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.649347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37c14313-1989-4772-8490-57a44a472bf5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.660483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a40560b3-d95a-4398-af20-e93db4ff0a05 req-21560bf8-7c4c-41c1-ba62-f70571252ab9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.661933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a40560b3-d95a-4398-af20-e93db4ff0a05 req-21560bf8-7c4c-41c1-ba62-f70571252ab9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.662375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a40560b3-d95a-4398-af20-e93db4ff0a05 req-21560bf8-7c4c-41c1-ba62-f70571252ab9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.687833 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a40560b3-d95a-4398-af20-e93db4ff0a05 req-21560bf8-7c4c-41c1-ba62-f70571252ab9 service nova] Creating event network-vif-deleted:efa272d3-5dd2-40ed-8566-cada96d72754 for instance e204a6f7-c18e-4943-9fcf-5de83ec21ae7 on n-h2-850499-14 Oct 04 18:21:19.697974 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a40560b3-d95a-4398-af20-e93db4ff0a05 req-21560bf8-7c4c-41c1-ba62-f70571252ab9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068799 Oct 04 18:21:19.700742 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2310/4626] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:19.714670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca9bb961-30f8-483a-a21f-40079645895e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.715484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ca9bb961-30f8-483a-a21f-40079645895e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:19.723229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca9bb961-30f8-483a-a21f-40079645895e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.724056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca9bb961-30f8-483a-a21f-40079645895e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.724697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca9bb961-30f8-483a-a21f-40079645895e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.725597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca9bb961-30f8-483a-a21f-40079645895e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.726432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca9bb961-30f8-483a-a21f-40079645895e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.727106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca9bb961-30f8-483a-a21f-40079645895e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.061836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-37c14313-1989-4772-8490-57a44a472bf5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.081315 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-37c14313-1989-4772-8490-57a44a472bf5 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.460350 Oct 04 18:21:20.096837 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2317/4627] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:19 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:20.101365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f89c6505-1f53-465c-be3e-8599b3995817 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.101916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f89c6505-1f53-465c-be3e-8599b3995817 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.111632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f89c6505-1f53-465c-be3e-8599b3995817 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.112294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f89c6505-1f53-465c-be3e-8599b3995817 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.112741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f89c6505-1f53-465c-be3e-8599b3995817 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.113460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f89c6505-1f53-465c-be3e-8599b3995817 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.113693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ca9bb961-30f8-483a-a21f-40079645895e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.114257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f89c6505-1f53-465c-be3e-8599b3995817 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.114450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f89c6505-1f53-465c-be3e-8599b3995817 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.127503 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ca9bb961-30f8-483a-a21f-40079645895e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1314 microversion: 2.1 time: 0.423688 Oct 04 18:21:20.132481 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2311/4628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:19 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:20.144108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fdb0bbbd-3a0e-4117-abdd-00ec4c2dcfee tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.148299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fdb0bbbd-3a0e-4117-abdd-00ec4c2dcfee tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.164019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdb0bbbd-3a0e-4117-abdd-00ec4c2dcfee tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.164760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdb0bbbd-3a0e-4117-abdd-00ec4c2dcfee tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.165222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdb0bbbd-3a0e-4117-abdd-00ec4c2dcfee tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.165960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdb0bbbd-3a0e-4117-abdd-00ec4c2dcfee tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.166982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdb0bbbd-3a0e-4117-abdd-00ec4c2dcfee tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.167419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdb0bbbd-3a0e-4117-abdd-00ec4c2dcfee tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.436920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f89c6505-1f53-465c-be3e-8599b3995817 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.469070 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f89c6505-1f53-465c-be3e-8599b3995817 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1502 microversion: 2.1 time: 0.377580 Oct 04 18:21:20.470880 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2318/4629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:20 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1502 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:20.488605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fdb0bbbd-3a0e-4117-abdd-00ec4c2dcfee tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.492239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:20.494261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-faf71ca7-c693-4a51-aae7-5e61d4e3e691 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.497647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-faf71ca7-c693-4a51-aae7-5e61d4e3e691 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.498617 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fdb0bbbd-3a0e-4117-abdd-00ec4c2dcfee tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1317 microversion: 2.1 time: 0.361694 Oct 04 18:21:20.512585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faf71ca7-c693-4a51-aae7-5e61d4e3e691 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.514256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faf71ca7-c693-4a51-aae7-5e61d4e3e691 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.514642 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2312/4630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:20 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:20.517074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faf71ca7-c693-4a51-aae7-5e61d4e3e691 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.518119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faf71ca7-c693-4a51-aae7-5e61d4e3e691 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.519581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faf71ca7-c693-4a51-aae7-5e61d4e3e691 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.521468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faf71ca7-c693-4a51-aae7-5e61d4e3e691 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.532988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:20.533624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e6b7434d-08e3-409f-886b-d5b2d359ad3e req-b9b94b3f-8f3d-48a7-8b26-47b1d49187df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1908ea35-63c6-453c-b505-ce3990be8cef", "tag": "31735e56-335a-4bc6-b09b-b79a0198b3b9"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:20.547621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:20.549676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e6b7434d-08e3-409f-886b-d5b2d359ad3e req-b9b94b3f-8f3d-48a7-8b26-47b1d49187df service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.550359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e6b7434d-08e3-409f-886b-d5b2d359ad3e req-b9b94b3f-8f3d-48a7-8b26-47b1d49187df service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.550799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e6b7434d-08e3-409f-886b-d5b2d359ad3e req-b9b94b3f-8f3d-48a7-8b26-47b1d49187df service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.587385 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e6b7434d-08e3-409f-886b-d5b2d359ad3e req-b9b94b3f-8f3d-48a7-8b26-47b1d49187df service nova] Creating event network-changed:31735e56-335a-4bc6-b09b-b79a0198b3b9 for instance 1908ea35-63c6-453c-b505-ce3990be8cef on n-h1-850499-14 Oct 04 18:21:20.596577 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e6b7434d-08e3-409f-886b-d5b2d359ad3e req-b9b94b3f-8f3d-48a7-8b26-47b1d49187df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070384 Oct 04 18:21:20.603209 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2313/4631] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:20.607132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-faf71ca7-c693-4a51-aae7-5e61d4e3e691 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:20.634264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b562b46d-cbfb-4392-97cb-6872022191b4 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.634912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b562b46d-cbfb-4392-97cb-6872022191b4 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.647517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b562b46d-cbfb-4392-97cb-6872022191b4 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.648166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b562b46d-cbfb-4392-97cb-6872022191b4 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.649047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b562b46d-cbfb-4392-97cb-6872022191b4 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.659312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b562b46d-cbfb-4392-97cb-6872022191b4 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.660006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b562b46d-cbfb-4392-97cb-6872022191b4 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.662620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b562b46d-cbfb-4392-97cb-6872022191b4 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.732677 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-faf71ca7-c693-4a51-aae7-5e61d4e3e691 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 204 len: 0 microversion: 2.1 time: 0.243688 Oct 04 18:21:20.733319 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2319/4632] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:20 2022] DELETE /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:20.745513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-72807864-2516-42e2-879b-263c3a0f44c1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.746326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-72807864-2516-42e2-879b-263c3a0f44c1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.752994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72807864-2516-42e2-879b-263c3a0f44c1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.754043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72807864-2516-42e2-879b-263c3a0f44c1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.754506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72807864-2516-42e2-879b-263c3a0f44c1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.755963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72807864-2516-42e2-879b-263c3a0f44c1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.756092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72807864-2516-42e2-879b-263c3a0f44c1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.756589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72807864-2516-42e2-879b-263c3a0f44c1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.979290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b562b46d-cbfb-4392-97cb-6872022191b4 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.987598 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b562b46d-cbfb-4392-97cb-6872022191b4 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1713 microversion: 2.1 time: 0.357541 Oct 04 18:21:20.988184 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2314/4633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:20 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1713 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:21.035244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-72807864-2516-42e2-879b-263c3a0f44c1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:21.044138 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-72807864-2516-42e2-879b-263c3a0f44c1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1508 microversion: 2.1 time: 0.305114 Oct 04 18:21:21.059493 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2320/4634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:20 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:21.110092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e0b2ee3b-2203-4b97-82da-34a3b9585ee7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.110783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e0b2ee3b-2203-4b97-82da-34a3b9585ee7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:21.122030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0b2ee3b-2203-4b97-82da-34a3b9585ee7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.124178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0b2ee3b-2203-4b97-82da-34a3b9585ee7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.125079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0b2ee3b-2203-4b97-82da-34a3b9585ee7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.126396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0b2ee3b-2203-4b97-82da-34a3b9585ee7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.128123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0b2ee3b-2203-4b97-82da-34a3b9585ee7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.129154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0b2ee3b-2203-4b97-82da-34a3b9585ee7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.161709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d049dc5b-3a61-4c33-84ec-2f44525e1907 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.163754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d049dc5b-3a61-4c33-84ec-2f44525e1907 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:21.180204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d049dc5b-3a61-4c33-84ec-2f44525e1907 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.181942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d049dc5b-3a61-4c33-84ec-2f44525e1907 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.183374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d049dc5b-3a61-4c33-84ec-2f44525e1907 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.184791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d049dc5b-3a61-4c33-84ec-2f44525e1907 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.187594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d049dc5b-3a61-4c33-84ec-2f44525e1907 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.188054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d049dc5b-3a61-4c33-84ec-2f44525e1907 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.672361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e0b2ee3b-2203-4b97-82da-34a3b9585ee7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:21.689137 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e0b2ee3b-2203-4b97-82da-34a3b9585ee7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.584865 Oct 04 18:21:21.704780 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2315/4635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:21.713705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d81bb27-d673-4b99-90c3-c325f8186686 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.741672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d81bb27-d673-4b99-90c3-c325f8186686 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:21.743345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d049dc5b-3a61-4c33-84ec-2f44525e1907 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:21.752793 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d049dc5b-3a61-4c33-84ec-2f44525e1907 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1314 microversion: 2.1 time: 0.598788 Oct 04 18:21:21.759136 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2321/4636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:21.789519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d81bb27-d673-4b99-90c3-c325f8186686 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.794275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d81bb27-d673-4b99-90c3-c325f8186686 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.794879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d81bb27-d673-4b99-90c3-c325f8186686 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.797991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d81bb27-d673-4b99-90c3-c325f8186686 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.799849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d81bb27-d673-4b99-90c3-c325f8186686 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.804496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d81bb27-d673-4b99-90c3-c325f8186686 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.958831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] Calling method '.version_select at 0x7fd4d1df3ca0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.961483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.962065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.962612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.983154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.984028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.984724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.998699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.000528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.001333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.013654 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a18e74d7-95bd-482a-bd86-17c0da43fac5 tempest-PortsAdminExtendedAttrsTestJSON-772840996 tempest-PortsAdminExtendedAttrsTestJSON-772840996-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.251605 Oct 04 18:21:22.029464 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2322/4637] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:22.034921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-24ba6298-4836-4323-b76d-de639c0cdb45 req-7209028f-f790-49c4-bdda-6df109c0f920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc89347-39d7-460e-9c1a-a8bebbd91aea", "tag": "f4cda60d-7696-43af-bb92-16208888b299"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:22.065790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24ba6298-4836-4323-b76d-de639c0cdb45 req-7209028f-f790-49c4-bdda-6df109c0f920 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.067038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24ba6298-4836-4323-b76d-de639c0cdb45 req-7209028f-f790-49c4-bdda-6df109c0f920 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.067654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24ba6298-4836-4323-b76d-de639c0cdb45 req-7209028f-f790-49c4-bdda-6df109c0f920 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.093841 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-24ba6298-4836-4323-b76d-de639c0cdb45 req-7209028f-f790-49c4-bdda-6df109c0f920 service nova] Creating event network-changed:f4cda60d-7696-43af-bb92-16208888b299 for instance 4cc89347-39d7-460e-9c1a-a8bebbd91aea on n-h1-850499-14 Oct 04 18:21:22.109622 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-24ba6298-4836-4323-b76d-de639c0cdb45 req-7209028f-f790-49c4-bdda-6df109c0f920 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078004 Oct 04 18:21:22.110531 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2323/4638] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:22.122634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:22.123654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:22.134561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.135465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.137918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.138891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.139630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.140320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.215803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.217080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.217783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.218415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lazy-loading 'fault' on Instance uuid cfce2b8c-1451-4e6e-9802-49cad53d29ac {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:22.503967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0ba4cac1a34c09b91e0e9607a4ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3070f4f718546118ef9e4b0d46ba556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:22.512839 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ceb5d3f3-ea58-48f7-bcee-e0fa07045560 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 200 len: 1368 microversion: 2.1 time: 0.398628 Oct 04 18:21:22.525266 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2324/4639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:22 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 1368 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:22.534984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d81bb27-d673-4b99-90c3-c325f8186686 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:22.535814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ad812fb-fd0a-411d-a4d6-2abad62e501f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:22.536716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7ad812fb-fd0a-411d-a4d6-2abad62e501f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:22.544505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad812fb-fd0a-411d-a4d6-2abad62e501f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.545332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad812fb-fd0a-411d-a4d6-2abad62e501f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.546014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad812fb-fd0a-411d-a4d6-2abad62e501f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.547013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad812fb-fd0a-411d-a4d6-2abad62e501f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.547698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad812fb-fd0a-411d-a4d6-2abad62e501f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.548355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ad812fb-fd0a-411d-a4d6-2abad62e501f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.554824 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d81bb27-d673-4b99-90c3-c325f8186686 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1317 microversion: 2.1 time: 0.837462 Oct 04 18:21:22.555490 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2316/4640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1317 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:22.721050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4bcde6b2-ec7a-43fd-9729-9b397dc1411d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:22.721946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4bcde6b2-ec7a-43fd-9729-9b397dc1411d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:22.748511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bcde6b2-ec7a-43fd-9729-9b397dc1411d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.749402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bcde6b2-ec7a-43fd-9729-9b397dc1411d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.750047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bcde6b2-ec7a-43fd-9729-9b397dc1411d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.751091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bcde6b2-ec7a-43fd-9729-9b397dc1411d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.751695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bcde6b2-ec7a-43fd-9729-9b397dc1411d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.752276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bcde6b2-ec7a-43fd-9729-9b397dc1411d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.233314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7ad812fb-fd0a-411d-a4d6-2abad62e501f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:23.269420 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ad812fb-fd0a-411d-a4d6-2abad62e501f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1508 microversion: 2.1 time: 0.740496 Oct 04 18:21:23.272676 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2325/4641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:22 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1508 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:23.286110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a95f3fa5-ad9f-4e49-ab7b-a288d6ba6daf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:23.289083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a95f3fa5-ad9f-4e49-ab7b-a288d6ba6daf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:23.305841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a95f3fa5-ad9f-4e49-ab7b-a288d6ba6daf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.307038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a95f3fa5-ad9f-4e49-ab7b-a288d6ba6daf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.309333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a95f3fa5-ad9f-4e49-ab7b-a288d6ba6daf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.311798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a95f3fa5-ad9f-4e49-ab7b-a288d6ba6daf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.312717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a95f3fa5-ad9f-4e49-ab7b-a288d6ba6daf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.313400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a95f3fa5-ad9f-4e49-ab7b-a288d6ba6daf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.357703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4bcde6b2-ec7a-43fd-9729-9b397dc1411d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:23.368913 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4bcde6b2-ec7a-43fd-9729-9b397dc1411d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.653515 Oct 04 18:21:23.374791 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2317/4642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:22 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:23.543342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:23.544987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] [instance: cfce2b8c-1451-4e6e-9802-49cad53d29ac] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:23.553164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.553939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.554821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.556074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.557431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.558174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.608618 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] HTTP exception thrown: Instance cfce2b8c-1451-4e6e-9802-49cad53d29ac could not be found. Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Request method failure captured: Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac HTTP/1.1 Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHlKFfzEy3yvh0B14-2AGenDlTOYonkuYwRsiJcDxSBdE90BW7q_nQDqCYVQxaxjdPnFxTnW3iwBrxjkplRLCk41twTJwRK1mzYFuoymQEO5AGwSBDPZzNufYicqe_7TriYP_Iw7vUjweNYxTUgbNQJ5qG-aNN8t_CaLoT0nYzBq8zY Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: c3070f4f718546118ef9e4b0d46ba556 Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersTestManualDisk-518915372 Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c3070f4f718546118ef9e4b0d46ba556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c3070f4f718546118ef9e4b0d46ba556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c3070f4f718546118ef9e4b0d46ba556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c3070f4f718546118ef9e4b0d46ba556"}]}] Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersTestManualDisk-518915372 Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: c3070f4f718546118ef9e4b0d46ba556 Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersTestManualDisk-518915372 Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersTestManualDisk-518915372-project Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: cc0ba4cac1a34c09b91e0e9607a4ae34 Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersTestManualDisk-518915372-project Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance cfce2b8c-1451-4e6e-9802-49cad53d29ac could not be found. Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'cfce2b8c-1451-4e6e-9802-49cad53d29ac'} Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfce2b8c-1451-4e6e-9802-49cad53d29ac could not be found. Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfce2b8c-1451-4e6e-9802-49cad53d29ac could not be found. Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:23.609721 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:23.613980 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:23.613980 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:23.613980 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:23.613980 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:23.613980 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:23.613980 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfce2b8c-1451-4e6e-9802-49cad53d29ac could not be found. Oct 04 18:21:23.613980 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:23.613980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Returning 404 to user: Instance cfce2b8c-1451-4e6e-9802-49cad53d29ac could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:23.613980 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f03177b5-9cf5-4782-83bd-680c7dc34b20 tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac" status: 404 len: 111 microversion: 2.1 time: 0.073485 Oct 04 18:21:23.621966 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2318/4643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:23 2022] GET /compute/v2.1/servers/cfce2b8c-1451-4e6e-9802-49cad53d29ac => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:21:23.632732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-37986f11-35e1-45a2-a105-6a6530e4cc80 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:23.634077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-37986f11-35e1-45a2-a105-6a6530e4cc80 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:23.645435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37986f11-35e1-45a2-a105-6a6530e4cc80 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.646748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37986f11-35e1-45a2-a105-6a6530e4cc80 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.647994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37986f11-35e1-45a2-a105-6a6530e4cc80 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.649196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37986f11-35e1-45a2-a105-6a6530e4cc80 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.651585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37986f11-35e1-45a2-a105-6a6530e4cc80 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.652490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37986f11-35e1-45a2-a105-6a6530e4cc80 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.690180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:23.891080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=34 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:24.002341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a95f3fa5-ad9f-4e49-ab7b-a288d6ba6daf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.014013 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a95f3fa5-ad9f-4e49-ab7b-a288d6ba6daf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1314 microversion: 2.1 time: 0.739317 Oct 04 18:21:24.029020 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2326/4644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:23 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:24.040021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-30cb58e2-6872-4cae-bda6-94752d444d8d tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] Calling method '.version_select at 0x7fd4d1c20700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:24.070348 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-30cb58e2-6872-4cae-bda6-94752d444d8d tempest-ServersTestManualDisk-518915372 tempest-ServersTestManualDisk-518915372-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377735783" status: 202 len: 0 microversion: 2.1 time: 0.039016 Oct 04 18:21:24.071584 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2327/4645] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:21:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377735783 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:21:24.137612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-37986f11-35e1-45a2-a105-6a6530e4cc80 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.154083 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-37986f11-35e1-45a2-a105-6a6530e4cc80 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1317 microversion: 2.1 time: 0.530173 Oct 04 18:21:24.155313 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2319/4646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:23 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:24.162223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-15fe6bc5-48e4-403c-846f-f7c008be21ed req-e612c17c-b1cb-41fd-aa31-48abc75fc66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfce2b8c-1451-4e6e-9802-49cad53d29ac", "name": "network-vif-deleted", "tag": "75f2329e-67cc-4cb9-abfb-15c8920110ee"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:24.183826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-15fe6bc5-48e4-403c-846f-f7c008be21ed req-e612c17c-b1cb-41fd-aa31-48abc75fc66a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.184529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-15fe6bc5-48e4-403c-846f-f7c008be21ed req-e612c17c-b1cb-41fd-aa31-48abc75fc66a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.188674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-15fe6bc5-48e4-403c-846f-f7c008be21ed req-e612c17c-b1cb-41fd-aa31-48abc75fc66a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.206443 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-15fe6bc5-48e4-403c-846f-f7c008be21ed req-e612c17c-b1cb-41fd-aa31-48abc75fc66a service nova] Creating event network-vif-deleted:75f2329e-67cc-4cb9-abfb-15c8920110ee for instance cfce2b8c-1451-4e6e-9802-49cad53d29ac on n-h1-850499-14 Oct 04 18:21:24.212128 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-15fe6bc5-48e4-403c-846f-f7c008be21ed req-e612c17c-b1cb-41fd-aa31-48abc75fc66a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076624 Oct 04 18:21:24.214118 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2328/4647] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:24.306307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51f4c9a3-cd9c-4054-bbc6-f55416b4174e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:24.307930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-51f4c9a3-cd9c-4054-bbc6-f55416b4174e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:24.321290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51f4c9a3-cd9c-4054-bbc6-f55416b4174e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.322134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51f4c9a3-cd9c-4054-bbc6-f55416b4174e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.323109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51f4c9a3-cd9c-4054-bbc6-f55416b4174e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.324135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51f4c9a3-cd9c-4054-bbc6-f55416b4174e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.324833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51f4c9a3-cd9c-4054-bbc6-f55416b4174e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.325522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51f4c9a3-cd9c-4054-bbc6-f55416b4174e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.400811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e09c539-935e-4f91-8b79-7d70b78c990a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:24.402305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1e09c539-935e-4f91-8b79-7d70b78c990a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:24.410169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e09c539-935e-4f91-8b79-7d70b78c990a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.411385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e09c539-935e-4f91-8b79-7d70b78c990a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.411842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e09c539-935e-4f91-8b79-7d70b78c990a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.412811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e09c539-935e-4f91-8b79-7d70b78c990a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.413457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e09c539-935e-4f91-8b79-7d70b78c990a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.413898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e09c539-935e-4f91-8b79-7d70b78c990a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.443881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:24.546079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:24.927266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-51f4c9a3-cd9c-4054-bbc6-f55416b4174e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.938912 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-51f4c9a3-cd9c-4054-bbc6-f55416b4174e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1508 microversion: 2.1 time: 0.643526 Oct 04 18:21:24.940115 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2320/4648] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:24 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1508 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:24.982056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1e09c539-935e-4f91-8b79-7d70b78c990a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.992387 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1e09c539-935e-4f91-8b79-7d70b78c990a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.595780 Oct 04 18:21:25.008998 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2329/4649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:24 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:25.046392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9b981c5-c403-48df-b89a-484e6051d4b2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.047676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d9b981c5-c403-48df-b89a-484e6051d4b2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:25.058428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9b981c5-c403-48df-b89a-484e6051d4b2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.058428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9b981c5-c403-48df-b89a-484e6051d4b2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.058843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9b981c5-c403-48df-b89a-484e6051d4b2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.060249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9b981c5-c403-48df-b89a-484e6051d4b2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.060970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9b981c5-c403-48df-b89a-484e6051d4b2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.061454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9b981c5-c403-48df-b89a-484e6051d4b2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.180740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c3bf1296-b7c5-4f83-8a51-1ac369012469 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.181538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c3bf1296-b7c5-4f83-8a51-1ac369012469 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:25.188407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3bf1296-b7c5-4f83-8a51-1ac369012469 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.188914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3bf1296-b7c5-4f83-8a51-1ac369012469 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.189349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3bf1296-b7c5-4f83-8a51-1ac369012469 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.190304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3bf1296-b7c5-4f83-8a51-1ac369012469 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.190945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3bf1296-b7c5-4f83-8a51-1ac369012469 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.191401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3bf1296-b7c5-4f83-8a51-1ac369012469 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.733545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d9b981c5-c403-48df-b89a-484e6051d4b2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:25.748259 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d9b981c5-c403-48df-b89a-484e6051d4b2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1314 microversion: 2.1 time: 0.710361 Oct 04 18:21:25.782313 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2321/4650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:25 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:25.804206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ec58095d-2590-447b-a843-6dd581f4fbae req-9e6eb926-0c81-429b-8e2c-433386079ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429dcfa4-74db-46e5-9a98-db882b272ca4", "name": "network-vif-plugged", "status": "completed", "tag": "c123cb18-ad97-4e5a-8909-e5bf85c7654b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:25.829112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ec58095d-2590-447b-a843-6dd581f4fbae req-9e6eb926-0c81-429b-8e2c-433386079ece service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.833642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ec58095d-2590-447b-a843-6dd581f4fbae req-9e6eb926-0c81-429b-8e2c-433386079ece service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.834432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ec58095d-2590-447b-a843-6dd581f4fbae req-9e6eb926-0c81-429b-8e2c-433386079ece service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.860390 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ec58095d-2590-447b-a843-6dd581f4fbae req-9e6eb926-0c81-429b-8e2c-433386079ece service nova] Creating event network-vif-plugged:c123cb18-ad97-4e5a-8909-e5bf85c7654b for instance 429dcfa4-74db-46e5-9a98-db882b272ca4 on n-h1-850499-14 Oct 04 18:21:25.923510 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ec58095d-2590-447b-a843-6dd581f4fbae req-9e6eb926-0c81-429b-8e2c-433386079ece service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121038 Oct 04 18:21:25.926432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c3bf1296-b7c5-4f83-8a51-1ac369012469 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:25.931215 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2322/4651] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:25.937584 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c3bf1296-b7c5-4f83-8a51-1ac369012469 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1317 microversion: 2.1 time: 0.760890 Oct 04 18:21:25.942592 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2330/4652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:25 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1317 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:25.945365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c4fcab30-10dc-46fa-9df0-1645c2b06ad7 req-a8e804d9-10c3-4041-a1d3-e370dac81461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337526af-4c84-413b-8133-569a131bd502", "name": "network-vif-deleted", "tag": "d193e9b9-c710-4bdd-8956-f06e03065ec9"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:25.966660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d148a81-0ef1-46d4-9e0b-9a22af840f8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.967547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d148a81-0ef1-46d4-9e0b-9a22af840f8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:25.968903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c4fcab30-10dc-46fa-9df0-1645c2b06ad7 req-a8e804d9-10c3-4041-a1d3-e370dac81461 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.969623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c4fcab30-10dc-46fa-9df0-1645c2b06ad7 req-a8e804d9-10c3-4041-a1d3-e370dac81461 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.970738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c4fcab30-10dc-46fa-9df0-1645c2b06ad7 req-a8e804d9-10c3-4041-a1d3-e370dac81461 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.986571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d148a81-0ef1-46d4-9e0b-9a22af840f8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.987108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d148a81-0ef1-46d4-9e0b-9a22af840f8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.987755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d148a81-0ef1-46d4-9e0b-9a22af840f8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.987949 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c4fcab30-10dc-46fa-9df0-1645c2b06ad7 req-a8e804d9-10c3-4041-a1d3-e370dac81461 service nova] Creating event network-vif-deleted:d193e9b9-c710-4bdd-8956-f06e03065ec9 for instance 337526af-4c84-413b-8133-569a131bd502 on n-h2-850499-14 Oct 04 18:21:25.988798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d148a81-0ef1-46d4-9e0b-9a22af840f8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.989420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d148a81-0ef1-46d4-9e0b-9a22af840f8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.990004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d148a81-0ef1-46d4-9e0b-9a22af840f8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.004080 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c4fcab30-10dc-46fa-9df0-1645c2b06ad7 req-a8e804d9-10c3-4041-a1d3-e370dac81461 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066222 Oct 04 18:21:26.007435 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2323/4653] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:26.019049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-454c75bf-7e98-4937-aa7d-2c8a6557ef69 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:26.019726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-454c75bf-7e98-4937-aa7d-2c8a6557ef69 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:26.033547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454c75bf-7e98-4937-aa7d-2c8a6557ef69 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.034706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454c75bf-7e98-4937-aa7d-2c8a6557ef69 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.035361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454c75bf-7e98-4937-aa7d-2c8a6557ef69 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.036242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454c75bf-7e98-4937-aa7d-2c8a6557ef69 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.036908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454c75bf-7e98-4937-aa7d-2c8a6557ef69 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.037497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-454c75bf-7e98-4937-aa7d-2c8a6557ef69 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.109082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7d148a81-0ef1-46d4-9e0b-9a22af840f8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:26.122850 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d148a81-0ef1-46d4-9e0b-9a22af840f8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1306 microversion: 2.1 time: 0.160566 Oct 04 18:21:26.141565 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2331/4654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:25 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1306 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:26.292155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f7a50241-04c7-41c9-86b1-e8a118299fb4 req-093d127d-a88e-40b7-9f66-036dd5d545d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad37c778-7726-4ad7-a88d-0b3b7a553570", "tag": "d769a7d1-6909-4c4b-9e87-f525d4a01160"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:26.313134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f7a50241-04c7-41c9-86b1-e8a118299fb4 req-093d127d-a88e-40b7-9f66-036dd5d545d1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.313659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f7a50241-04c7-41c9-86b1-e8a118299fb4 req-093d127d-a88e-40b7-9f66-036dd5d545d1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.314100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f7a50241-04c7-41c9-86b1-e8a118299fb4 req-093d127d-a88e-40b7-9f66-036dd5d545d1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.341324 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f7a50241-04c7-41c9-86b1-e8a118299fb4 req-093d127d-a88e-40b7-9f66-036dd5d545d1 service nova] Creating event network-changed:d769a7d1-6909-4c4b-9e87-f525d4a01160 for instance ad37c778-7726-4ad7-a88d-0b3b7a553570 on n-h2-850499-14 Oct 04 18:21:26.346687 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f7a50241-04c7-41c9-86b1-e8a118299fb4 req-093d127d-a88e-40b7-9f66-036dd5d545d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060311 Oct 04 18:21:26.348058 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2332/4655] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:26.395460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-454c75bf-7e98-4937-aa7d-2c8a6557ef69 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:26.404512 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-454c75bf-7e98-4937-aa7d-2c8a6557ef69 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.389760 Oct 04 18:21:26.420854 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2324/4656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:26.777844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-85a5dd19-cdf7-4016-96bf-0e389f9754ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:26.778828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-85a5dd19-cdf7-4016-96bf-0e389f9754ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:26.789038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85a5dd19-cdf7-4016-96bf-0e389f9754ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.790056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85a5dd19-cdf7-4016-96bf-0e389f9754ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.790915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85a5dd19-cdf7-4016-96bf-0e389f9754ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.792603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85a5dd19-cdf7-4016-96bf-0e389f9754ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.793361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85a5dd19-cdf7-4016-96bf-0e389f9754ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.793963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85a5dd19-cdf7-4016-96bf-0e389f9754ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.965150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85f170af-9c75-48f2-a21e-56fe05c04f23 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:26.966123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-85f170af-9c75-48f2-a21e-56fe05c04f23 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:26.972685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85f170af-9c75-48f2-a21e-56fe05c04f23 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.973500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85f170af-9c75-48f2-a21e-56fe05c04f23 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.974008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85f170af-9c75-48f2-a21e-56fe05c04f23 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.975073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85f170af-9c75-48f2-a21e-56fe05c04f23 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.975846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85f170af-9c75-48f2-a21e-56fe05c04f23 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.976506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85f170af-9c75-48f2-a21e-56fe05c04f23 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.121228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-85a5dd19-cdf7-4016-96bf-0e389f9754ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:27.136639 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-85a5dd19-cdf7-4016-96bf-0e389f9754ee tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1314 microversion: 2.1 time: 0.364301 Oct 04 18:21:27.137594 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2333/4657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:27.156448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.157566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:27.166592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.167826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.168783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.169699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.170348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.170789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.225938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.226919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.227852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.229037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lazy-loading 'fault' on Instance uuid 337526af-4c84-413b-8133-569a131bd502 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:27.249663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-85f170af-9c75-48f2-a21e-56fe05c04f23 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:27.257804 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-85f170af-9c75-48f2-a21e-56fe05c04f23 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1317 microversion: 2.1 time: 0.296646 Oct 04 18:21:27.258776 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2325/4658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:27.278872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:27.288483 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1e3762bc-63bd-4d7d-b7f4-0a5553891844 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1311 microversion: 2.1 time: 0.140153 Oct 04 18:21:27.289497 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2334/4659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1311 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:27.434161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6afa08c4-9e57-430d-af93-d15f1c2973a9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.435293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6afa08c4-9e57-430d-af93-d15f1c2973a9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:27.444249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6afa08c4-9e57-430d-af93-d15f1c2973a9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.445064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6afa08c4-9e57-430d-af93-d15f1c2973a9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.445512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6afa08c4-9e57-430d-af93-d15f1c2973a9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.446230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6afa08c4-9e57-430d-af93-d15f1c2973a9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.446767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6afa08c4-9e57-430d-af93-d15f1c2973a9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.447757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6afa08c4-9e57-430d-af93-d15f1c2973a9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.599749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6afa08c4-9e57-430d-af93-d15f1c2973a9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:27.608258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6afa08c4-9e57-430d-af93-d15f1c2973a9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.179650 Oct 04 18:21:27.609086 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2326/4660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:27.946361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-51f05450-942a-412e-ae94-2a74bd99817a req-89013e20-a368-4295-8975-9a43f133aa53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc89347-39d7-460e-9c1a-a8bebbd91aea", "name": "network-vif-plugged", "status": "completed", "tag": "f4cda60d-7696-43af-bb92-16208888b299"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:27.959790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51f05450-942a-412e-ae94-2a74bd99817a req-89013e20-a368-4295-8975-9a43f133aa53 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.960396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51f05450-942a-412e-ae94-2a74bd99817a req-89013e20-a368-4295-8975-9a43f133aa53 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.960905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51f05450-942a-412e-ae94-2a74bd99817a req-89013e20-a368-4295-8975-9a43f133aa53 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.975385 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-51f05450-942a-412e-ae94-2a74bd99817a req-89013e20-a368-4295-8975-9a43f133aa53 service nova] Creating event network-vif-plugged:f4cda60d-7696-43af-bb92-16208888b299 for instance 4cc89347-39d7-460e-9c1a-a8bebbd91aea on n-h1-850499-14 Oct 04 18:21:27.981995 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-51f05450-942a-412e-ae94-2a74bd99817a req-89013e20-a368-4295-8975-9a43f133aa53 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040030 Oct 04 18:21:27.982629 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2335/4661] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:28.165152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a4e5f2b-5fc5-4716-a56b-75e0ea6575d3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.166678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3a4e5f2b-5fc5-4716-a56b-75e0ea6575d3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:28.174057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a4e5f2b-5fc5-4716-a56b-75e0ea6575d3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.174597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a4e5f2b-5fc5-4716-a56b-75e0ea6575d3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.175115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a4e5f2b-5fc5-4716-a56b-75e0ea6575d3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.175960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a4e5f2b-5fc5-4716-a56b-75e0ea6575d3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.176421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a4e5f2b-5fc5-4716-a56b-75e0ea6575d3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.176894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a4e5f2b-5fc5-4716-a56b-75e0ea6575d3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.285314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b58e208-b2a7-4337-b2e7-83ffa7ed944a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.286308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3b58e208-b2a7-4337-b2e7-83ffa7ed944a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:28.294184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b58e208-b2a7-4337-b2e7-83ffa7ed944a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.294713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b58e208-b2a7-4337-b2e7-83ffa7ed944a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.295456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b58e208-b2a7-4337-b2e7-83ffa7ed944a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.296346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b58e208-b2a7-4337-b2e7-83ffa7ed944a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.296775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b58e208-b2a7-4337-b2e7-83ffa7ed944a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.297292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b58e208-b2a7-4337-b2e7-83ffa7ed944a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.320984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3a4e5f2b-5fc5-4716-a56b-75e0ea6575d3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.329274 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3a4e5f2b-5fc5-4716-a56b-75e0ea6575d3 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1314 microversion: 2.1 time: 0.168554 Oct 04 18:21:28.342611 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2327/4662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.342611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.342611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:28.343281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.343281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.343721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.347362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.347865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.348360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.388908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.389665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.390385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.391017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lazy-loading 'fault' on Instance uuid 337526af-4c84-413b-8133-569a131bd502 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:28.476169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.485123 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-044faac1-70f4-4124-8ac7-868a6c3d1e2e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1311 microversion: 2.1 time: 0.154068 Oct 04 18:21:28.486305 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2328/4663] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1311 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.514519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b58e208-b2a7-4337-b2e7-83ffa7ed944a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.523899 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b58e208-b2a7-4337-b2e7-83ffa7ed944a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1317 microversion: 2.1 time: 0.243706 Oct 04 18:21:28.524906 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2336/4664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:28.632463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6a9359fd-247d-4ec6-b133-94ddebc24384 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.633441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6a9359fd-247d-4ec6-b133-94ddebc24384 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:28.640748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a9359fd-247d-4ec6-b133-94ddebc24384 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.641274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a9359fd-247d-4ec6-b133-94ddebc24384 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.641849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a9359fd-247d-4ec6-b133-94ddebc24384 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.642627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a9359fd-247d-4ec6-b133-94ddebc24384 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.643227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a9359fd-247d-4ec6-b133-94ddebc24384 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.643815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a9359fd-247d-4ec6-b133-94ddebc24384 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.865143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6a9359fd-247d-4ec6-b133-94ddebc24384 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.874829 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6a9359fd-247d-4ec6-b133-94ddebc24384 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.246409 Oct 04 18:21:28.875769 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2329/4665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:29.357464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d827eb43-3ec6-49d7-b256-bb460ec7c461 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.359043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d827eb43-3ec6-49d7-b256-bb460ec7c461 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.381409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d827eb43-3ec6-49d7-b256-bb460ec7c461 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.382408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d827eb43-3ec6-49d7-b256-bb460ec7c461 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.385365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d827eb43-3ec6-49d7-b256-bb460ec7c461 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.388001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d827eb43-3ec6-49d7-b256-bb460ec7c461 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.388512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d827eb43-3ec6-49d7-b256-bb460ec7c461 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.388966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d827eb43-3ec6-49d7-b256-bb460ec7c461 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.402483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:29.509365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.509993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.518281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.519237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.519897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.520854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.521608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.522280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.562559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.563466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.564430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.565378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lazy-loading 'fault' on Instance uuid 337526af-4c84-413b-8133-569a131bd502 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:29.715526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:29.729375 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f78e38d9-941a-4ca6-b48f-145f3f3b04a2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 200 len: 1311 microversion: 2.1 time: 0.224638 Oct 04 18:21:29.745529 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2330/4666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 1311 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:29.756117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed43c8c5-ba81-4ebc-8efd-b95e2fa2649b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.757527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed43c8c5-ba81-4ebc-8efd-b95e2fa2649b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.770638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed43c8c5-ba81-4ebc-8efd-b95e2fa2649b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.771806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed43c8c5-ba81-4ebc-8efd-b95e2fa2649b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.772761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed43c8c5-ba81-4ebc-8efd-b95e2fa2649b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.774277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed43c8c5-ba81-4ebc-8efd-b95e2fa2649b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.775867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed43c8c5-ba81-4ebc-8efd-b95e2fa2649b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.777067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed43c8c5-ba81-4ebc-8efd-b95e2fa2649b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.799570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d827eb43-3ec6-49d7-b256-bb460ec7c461 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:29.813594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:29.816136 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d827eb43-3ec6-49d7-b256-bb460ec7c461 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1500 microversion: 2.1 time: 0.462316 Oct 04 18:21:29.821378 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2337/4667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1500 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:29.845626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-954047f8-346b-4bd1-8bbf-bf5e58860955 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:29.848728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-954047f8-346b-4bd1-8bbf-bf5e58860955 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.855852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954047f8-346b-4bd1-8bbf-bf5e58860955 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.856807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954047f8-346b-4bd1-8bbf-bf5e58860955 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.872240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954047f8-346b-4bd1-8bbf-bf5e58860955 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.873633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954047f8-346b-4bd1-8bbf-bf5e58860955 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.874580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954047f8-346b-4bd1-8bbf-bf5e58860955 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.875046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-954047f8-346b-4bd1-8bbf-bf5e58860955 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.908206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-954047f8-346b-4bd1-8bbf-bf5e58860955 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lazy-loading 'flavor' on Instance uuid 429dcfa4-74db-46e5-9a98-db882b272ca4 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:30.026269 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-954047f8-346b-4bd1-8bbf-bf5e58860955 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "POST /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4/action" status: 200 len: 32 microversion: 2.1 time: 0.185624 Oct 04 18:21:30.027715 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2338/4668] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:21:29 2022] POST /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:21:30.034022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e4fccc2-b813-4188-8a94-5b879946d116 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:30.035010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e4fccc2-b813-4188-8a94-5b879946d116 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:30.042474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e4fccc2-b813-4188-8a94-5b879946d116 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.043425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e4fccc2-b813-4188-8a94-5b879946d116 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.044063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e4fccc2-b813-4188-8a94-5b879946d116 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.044977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e4fccc2-b813-4188-8a94-5b879946d116 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.045731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e4fccc2-b813-4188-8a94-5b879946d116 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.046438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e4fccc2-b813-4188-8a94-5b879946d116 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.290153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ed43c8c5-ba81-4ebc-8efd-b95e2fa2649b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:30.307111 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed43c8c5-ba81-4ebc-8efd-b95e2fa2649b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1317 microversion: 2.1 time: 0.559800 Oct 04 18:21:30.308126 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2331/4669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:30.315357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b083bb66-1703-4bdc-9a35-361222fda05f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:30.331822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b083bb66-1703-4bdc-9a35-361222fda05f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:30.342299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b083bb66-1703-4bdc-9a35-361222fda05f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.343081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b083bb66-1703-4bdc-9a35-361222fda05f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.343532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b083bb66-1703-4bdc-9a35-361222fda05f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.344292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b083bb66-1703-4bdc-9a35-361222fda05f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.349098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b083bb66-1703-4bdc-9a35-361222fda05f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.349566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b083bb66-1703-4bdc-9a35-361222fda05f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.484059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7e4fccc2-b813-4188-8a94-5b879946d116 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:30.500733 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e4fccc2-b813-4188-8a94-5b879946d116 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.471241 Oct 04 18:21:30.502777 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2339/4670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:30 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:30.683473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b083bb66-1703-4bdc-9a35-361222fda05f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:30.704571 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b083bb66-1703-4bdc-9a35-361222fda05f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.394969 Oct 04 18:21:30.721872 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2332/4671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:30 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:30.762022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:30.762801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:30.783808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.785112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.786267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.788615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.789896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.791591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.825801 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 HTTP/1.1 Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '337526af-4c84-413b-8133-569a131bd502'} Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:21:30.830095 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:30.839844 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:30.839844 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:30.839844 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:30.839844 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:30.839844 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:21:30.839844 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:21:30.842491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:30.843945 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-da445a78-5b88-4944-b5ee-ae08473e2bdd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 404 len: 111 microversion: 2.1 time: 0.090234 Oct 04 18:21:30.849131 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2340/4672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:30 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:30.863337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49c50e23-2a09-402f-ae8a-aff4d875293e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'create', calling method: .version_select at 0x7fd4d1299550>, body: {"keypair": {"name": "tempest-key-1202317906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6AJb7iKzctx8W+eeqeMfO7TMdATU4L0Ty1WlQnCFF4s0EfNhcM+TOtXNLB8h+SU8chlRNgf8CEJVwwfuTrZkAYDIJFvrvQgn/P240KWGcxBP9IB28+NVw5qNDpprZ8sA=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:30.900176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-49c50e23-2a09-402f-ae8a-aff4d875293e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for project 055e605a53014ca29fa6416b576060e8. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:30.913413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-49c50e23-2a09-402f-ae8a-aff4d875293e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for user 41e49c77352541cb94dcd12277f7ee67 and project 055e605a53014ca29fa6416b576060e8. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:30.974335 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49c50e23-2a09-402f-ae8a-aff4d875293e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.115739 Oct 04 18:21:30.975262 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2333/4673] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:21:30 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:30.987104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ec7e5f44-8275-469b-9c97-d8e37abca6d1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '.version_select at 0x7fd4d1fcc280>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:30.994575 n-d-850499-14 devstack@n-api.service[122331]: WARNING oslo_db.sqlalchemy.utils [None req-ec7e5f44-8275-469b-9c97-d8e37abca6d1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:21:31.005430 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ec7e5f44-8275-469b-9c97-d8e37abca6d1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.022346 Oct 04 18:21:31.009985 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2341/4674] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:21:30 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:31.202727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-85427646", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "key_name": "tempest-key-1202317906", "networks": [{"uuid": "5be520db-1d2d-4d71-923d-9d8728cd44bc"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:31.292283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] validate_networks() for [('5be520db-1d2d-4d71-923d-9d8728cd44bc', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:31.334019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ecc90567-39c2-4527-89b1-947e132f9572 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:31.335174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ecc90567-39c2-4527-89b1-947e132f9572 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:31.353973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecc90567-39c2-4527-89b1-947e132f9572 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.354777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecc90567-39c2-4527-89b1-947e132f9572 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.355574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecc90567-39c2-4527-89b1-947e132f9572 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.356805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecc90567-39c2-4527-89b1-947e132f9572 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.357453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecc90567-39c2-4527-89b1-947e132f9572 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.358075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ecc90567-39c2-4527-89b1-947e132f9572 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.809170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ecc90567-39c2-4527-89b1-947e132f9572 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:31.827910 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ecc90567-39c2-4527-89b1-947e132f9572 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 200 len: 1505 microversion: 2.1 time: 0.500191 Oct 04 18:21:31.830512 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2342/4675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:31 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:31.838933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1cc3bb45-73d6-4936-9c67-25f3502e4ee9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:31.840600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1cc3bb45-73d6-4936-9c67-25f3502e4ee9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:31.858751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cc3bb45-73d6-4936-9c67-25f3502e4ee9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.862716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cc3bb45-73d6-4936-9c67-25f3502e4ee9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.863830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cc3bb45-73d6-4936-9c67-25f3502e4ee9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.865668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cc3bb45-73d6-4936-9c67-25f3502e4ee9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.868114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cc3bb45-73d6-4936-9c67-25f3502e4ee9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.870241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1cc3bb45-73d6-4936-9c67-25f3502e4ee9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.168296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1cc3bb45-73d6-4936-9c67-25f3502e4ee9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:32.179142 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1cc3bb45-73d6-4936-9c67-25f3502e4ee9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.346089 Oct 04 18:21:32.197974 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2343/4676] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:31 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:32.205225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:32.206339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:32.206922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:32.207393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:32.208596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:32.219568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7599b615-8241-4c40-aac8-bae65d60100b req-1a20d8f4-8412-4df2-b7a9-cbae55509502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1908ea35-63c6-453c-b505-ce3990be8cef", "name": "network-vif-plugged", "status": "completed", "tag": "31735e56-335a-4bc6-b09b-b79a0198b3b9"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:32.222847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.223370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.223816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.224552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.225018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.230128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.245930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7599b615-8241-4c40-aac8-bae65d60100b req-1a20d8f4-8412-4df2-b7a9-cbae55509502 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.246623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7599b615-8241-4c40-aac8-bae65d60100b req-1a20d8f4-8412-4df2-b7a9-cbae55509502 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.247127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7599b615-8241-4c40-aac8-bae65d60100b req-1a20d8f4-8412-4df2-b7a9-cbae55509502 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.263164 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7599b615-8241-4c40-aac8-bae65d60100b req-1a20d8f4-8412-4df2-b7a9-cbae55509502 service nova] Creating event network-vif-plugged:31735e56-335a-4bc6-b09b-b79a0198b3b9 for instance 1908ea35-63c6-453c-b505-ce3990be8cef on n-h1-850499-14 Oct 04 18:21:32.271638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:32.283416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for user 41e49c77352541cb94dcd12277f7ee67 and project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:32.284890 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7599b615-8241-4c40-aac8-bae65d60100b req-1a20d8f4-8412-4df2-b7a9-cbae55509502 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080616 Oct 04 18:21:32.285954 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2344/4677] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:32.299604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d1ccc0f3-ae9d-45e6-b979-59be165ec4f6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:32.301420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d1ccc0f3-ae9d-45e6-b979-59be165ec4f6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:32.318591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0f3-ae9d-45e6-b979-59be165ec4f6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.320077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0f3-ae9d-45e6-b979-59be165ec4f6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.321053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0f3-ae9d-45e6-b979-59be165ec4f6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.322864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0f3-ae9d-45e6-b979-59be165ec4f6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.324641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:32.325322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0f3-ae9d-45e6-b979-59be165ec4f6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.327918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:32.329359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0f3-ae9d-45e6-b979-59be165ec4f6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.442346 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d497d6b-6a3d-406f-b761-339c4f009fb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.250249 Oct 04 18:21:32.451137 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2334/4678] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:21:32.458276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c4a1f912-96b0-41d0-ae4e-abfa1ced71b0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:32.459461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c4a1f912-96b0-41d0-ae4e-abfa1ced71b0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:32.467855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4a1f912-96b0-41d0-ae4e-abfa1ced71b0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.469615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4a1f912-96b0-41d0-ae4e-abfa1ced71b0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.470080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4a1f912-96b0-41d0-ae4e-abfa1ced71b0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.470903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4a1f912-96b0-41d0-ae4e-abfa1ced71b0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.471595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4a1f912-96b0-41d0-ae4e-abfa1ced71b0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.472479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4a1f912-96b0-41d0-ae4e-abfa1ced71b0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.804354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d1ccc0f3-ae9d-45e6-b979-59be165ec4f6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:32.818972 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d1ccc0f3-ae9d-45e6-b979-59be165ec4f6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.530409 Oct 04 18:21:32.819729 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2345/4679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:32 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:32.843709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40856d77-ad8a-46bb-91b9-9b08637e4920 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:32.844637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-40856d77-ad8a-46bb-91b9-9b08637e4920 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:32.848229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c4a1f912-96b0-41d0-ae4e-abfa1ced71b0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:32.862234 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c4a1f912-96b0-41d0-ae4e-abfa1ced71b0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 200 len: 1317 microversion: 2.1 time: 0.407135 Oct 04 18:21:32.864370 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2335/4680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:32 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:32.916251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-40856d77-ad8a-46bb-91b9-9b08637e4920 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:32.923547 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40856d77-ad8a-46bb-91b9-9b08637e4920 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1227 microversion: 2.1 time: 0.087532 Oct 04 18:21:32.924502 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2346/4681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:32 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1227 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:33.205728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-27d6df0d-fec0-4633-a2af-a3c0bf546378 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:33.207628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-27d6df0d-fec0-4633-a2af-a3c0bf546378 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:33.223857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27d6df0d-fec0-4633-a2af-a3c0bf546378 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.224439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27d6df0d-fec0-4633-a2af-a3c0bf546378 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.224987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27d6df0d-fec0-4633-a2af-a3c0bf546378 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.226018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27d6df0d-fec0-4633-a2af-a3c0bf546378 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.226599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27d6df0d-fec0-4633-a2af-a3c0bf546378 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.227329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27d6df0d-fec0-4633-a2af-a3c0bf546378 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.424203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-27d6df0d-fec0-4633-a2af-a3c0bf546378 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:33.440850 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-27d6df0d-fec0-4633-a2af-a3c0bf546378 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.238564 Oct 04 18:21:33.442120 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2336/4682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:33 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:33.857832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b107e138-91e9-44ed-887a-e74f8649870c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:33.858521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b107e138-91e9-44ed-887a-e74f8649870c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:33.879051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107e138-91e9-44ed-887a-e74f8649870c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.881129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107e138-91e9-44ed-887a-e74f8649870c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.882264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107e138-91e9-44ed-887a-e74f8649870c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.888820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b6778289-11be-44f9-ba6e-bcd1b84d31d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:33.889596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b6778289-11be-44f9-ba6e-bcd1b84d31d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:33.896200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107e138-91e9-44ed-887a-e74f8649870c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.896710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107e138-91e9-44ed-887a-e74f8649870c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.897161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b107e138-91e9-44ed-887a-e74f8649870c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.907477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6778289-11be-44f9-ba6e-bcd1b84d31d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.911186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6778289-11be-44f9-ba6e-bcd1b84d31d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.911669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6778289-11be-44f9-ba6e-bcd1b84d31d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.912393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6778289-11be-44f9-ba6e-bcd1b84d31d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.912860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6778289-11be-44f9-ba6e-bcd1b84d31d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.916562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6778289-11be-44f9-ba6e-bcd1b84d31d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.290167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b107e138-91e9-44ed-887a-e74f8649870c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:34.303704 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b107e138-91e9-44ed-887a-e74f8649870c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.464407 Oct 04 18:21:34.304606 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2347/4683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:33 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:34.323578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bea0b3a0-5ae1-47aa-a0a6-34f100b462e6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:34.324489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bea0b3a0-5ae1-47aa-a0a6-34f100b462e6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:34.341326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bea0b3a0-5ae1-47aa-a0a6-34f100b462e6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.341846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bea0b3a0-5ae1-47aa-a0a6-34f100b462e6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.342295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bea0b3a0-5ae1-47aa-a0a6-34f100b462e6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.343046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bea0b3a0-5ae1-47aa-a0a6-34f100b462e6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.343678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bea0b3a0-5ae1-47aa-a0a6-34f100b462e6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.344273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bea0b3a0-5ae1-47aa-a0a6-34f100b462e6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.385798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6778289-11be-44f9-ba6e-bcd1b84d31d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:34.394096 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b6778289-11be-44f9-ba6e-bcd1b84d31d0 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 200 len: 1317 microversion: 2.1 time: 0.509432 Oct 04 18:21:34.398271 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2337/4684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:33 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:34.417525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-82b98c6d-2b1b-448a-b52c-4e4438f70d90 req-d38312d5-a1d3-492c-b738-e3d24fa59ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad37c778-7726-4ad7-a88d-0b3b7a553570", "name": "network-vif-plugged", "status": "completed", "tag": "d769a7d1-6909-4c4b-9e87-f525d4a01160"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:34.448166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-82b98c6d-2b1b-448a-b52c-4e4438f70d90 req-d38312d5-a1d3-492c-b738-e3d24fa59ee7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.452331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-82b98c6d-2b1b-448a-b52c-4e4438f70d90 req-d38312d5-a1d3-492c-b738-e3d24fa59ee7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.453151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-82b98c6d-2b1b-448a-b52c-4e4438f70d90 req-d38312d5-a1d3-492c-b738-e3d24fa59ee7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.538201 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-82b98c6d-2b1b-448a-b52c-4e4438f70d90 req-d38312d5-a1d3-492c-b738-e3d24fa59ee7 service nova] Creating event network-vif-plugged:d769a7d1-6909-4c4b-9e87-f525d4a01160 for instance ad37c778-7726-4ad7-a88d-0b3b7a553570 on n-h2-850499-14 Oct 04 18:21:34.557680 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-82b98c6d-2b1b-448a-b52c-4e4438f70d90 req-d38312d5-a1d3-492c-b738-e3d24fa59ee7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154764 Oct 04 18:21:34.558697 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2338/4685] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:34.561316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bea0b3a0-5ae1-47aa-a0a6-34f100b462e6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:34.570373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9045e5a2-99bc-4fe3-a28e-715646801d62 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:34.571175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9045e5a2-99bc-4fe3-a28e-715646801d62 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:34.574768 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bea0b3a0-5ae1-47aa-a0a6-34f100b462e6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1287 microversion: 2.1 time: 0.266730 Oct 04 18:21:34.577649 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2348/4686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:34 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1287 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:34.588669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9045e5a2-99bc-4fe3-a28e-715646801d62 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.590192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9045e5a2-99bc-4fe3-a28e-715646801d62 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.590822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9045e5a2-99bc-4fe3-a28e-715646801d62 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.591887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9045e5a2-99bc-4fe3-a28e-715646801d62 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.592529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9045e5a2-99bc-4fe3-a28e-715646801d62 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.593281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9045e5a2-99bc-4fe3-a28e-715646801d62 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.102409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9045e5a2-99bc-4fe3-a28e-715646801d62 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:35.112233 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9045e5a2-99bc-4fe3-a28e-715646801d62 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1362 microversion: 2.1 time: 0.548849 Oct 04 18:21:35.113075 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2339/4687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:34 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1362 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:35.331671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-759a5fa7-b998-4c76-85a8-89ebe208ef93 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.332877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-759a5fa7-b998-4c76-85a8-89ebe208ef93 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.337115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:35.341329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-759a5fa7-b998-4c76-85a8-89ebe208ef93 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.342017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-759a5fa7-b998-4c76-85a8-89ebe208ef93 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.342626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-759a5fa7-b998-4c76-85a8-89ebe208ef93 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.343532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-759a5fa7-b998-4c76-85a8-89ebe208ef93 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.344178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-759a5fa7-b998-4c76-85a8-89ebe208ef93 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.344775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-759a5fa7-b998-4c76-85a8-89ebe208ef93 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.420784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5686b04-2034-43f6-8bf8-82c2a33439a3 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.424096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5686b04-2034-43f6-8bf8-82c2a33439a3 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.432532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5686b04-2034-43f6-8bf8-82c2a33439a3 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.433342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5686b04-2034-43f6-8bf8-82c2a33439a3 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.433952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5686b04-2034-43f6-8bf8-82c2a33439a3 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.434819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5686b04-2034-43f6-8bf8-82c2a33439a3 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.435505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5686b04-2034-43f6-8bf8-82c2a33439a3 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.436144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5686b04-2034-43f6-8bf8-82c2a33439a3 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.875473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-759a5fa7-b998-4c76-85a8-89ebe208ef93 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:35.884318 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-759a5fa7-b998-4c76-85a8-89ebe208ef93 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.556493 Oct 04 18:21:35.890376 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2349/4688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:35 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:35.904080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-50d607cb-04ba-4911-934e-1db06046f135 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.905077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-50d607cb-04ba-4911-934e-1db06046f135 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.920789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50d607cb-04ba-4911-934e-1db06046f135 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.921530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50d607cb-04ba-4911-934e-1db06046f135 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.922337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50d607cb-04ba-4911-934e-1db06046f135 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.923291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50d607cb-04ba-4911-934e-1db06046f135 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.923939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50d607cb-04ba-4911-934e-1db06046f135 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.924529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50d607cb-04ba-4911-934e-1db06046f135 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.957868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5686b04-2034-43f6-8bf8-82c2a33439a3 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:35.967289 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5686b04-2034-43f6-8bf8-82c2a33439a3 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 200 len: 1317 microversion: 2.1 time: 0.551081 Oct 04 18:21:35.993193 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2340/4689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:35 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:36.136950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-531c1daa-e599-4263-9456-a1c5a86104dc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:36.137865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-531c1daa-e599-4263-9456-a1c5a86104dc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:36.145924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-531c1daa-e599-4263-9456-a1c5a86104dc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.146659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-531c1daa-e599-4263-9456-a1c5a86104dc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.147308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-531c1daa-e599-4263-9456-a1c5a86104dc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.148249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-531c1daa-e599-4263-9456-a1c5a86104dc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.148890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-531c1daa-e599-4263-9456-a1c5a86104dc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.149490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-531c1daa-e599-4263-9456-a1c5a86104dc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.749211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-50d607cb-04ba-4911-934e-1db06046f135 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:36.763587 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-50d607cb-04ba-4911-934e-1db06046f135 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.872065 Oct 04 18:21:36.764877 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2350/4690] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:35 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:36.874892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-531c1daa-e599-4263-9456-a1c5a86104dc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:36.883144 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-531c1daa-e599-4263-9456-a1c5a86104dc tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1548 microversion: 2.1 time: 0.750047 Oct 04 18:21:36.908207 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2341/4691] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:36 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1548 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:36.917170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-683e48b3-734c-4890-b926-ef6c349d71d8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:36.918245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-683e48b3-734c-4890-b926-ef6c349d71d8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:36.932101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683e48b3-734c-4890-b926-ef6c349d71d8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.932760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5850ffc2-01a0-4a8e-b354-c989365fc708 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:36.933221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683e48b3-734c-4890-b926-ef6c349d71d8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.933388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5850ffc2-01a0-4a8e-b354-c989365fc708 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:36.933792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683e48b3-734c-4890-b926-ef6c349d71d8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.934829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683e48b3-734c-4890-b926-ef6c349d71d8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.935407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683e48b3-734c-4890-b926-ef6c349d71d8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.935978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683e48b3-734c-4890-b926-ef6c349d71d8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.949895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5850ffc2-01a0-4a8e-b354-c989365fc708 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.950401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5850ffc2-01a0-4a8e-b354-c989365fc708 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.950850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5850ffc2-01a0-4a8e-b354-c989365fc708 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.951595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5850ffc2-01a0-4a8e-b354-c989365fc708 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.952060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5850ffc2-01a0-4a8e-b354-c989365fc708 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.952494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5850ffc2-01a0-4a8e-b354-c989365fc708 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.092563 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-683e48b3-734c-4890-b926-ef6c349d71d8 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185174 Oct 04 18:21:37.093705 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2351/4692] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:21:36 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:37.105708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd774904-356d-491f-93cb-318810424d2b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:37.106641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd774904-356d-491f-93cb-318810424d2b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:37.116064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd774904-356d-491f-93cb-318810424d2b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.116859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd774904-356d-491f-93cb-318810424d2b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.117544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd774904-356d-491f-93cb-318810424d2b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.119429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd774904-356d-491f-93cb-318810424d2b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.120770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd774904-356d-491f-93cb-318810424d2b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.121366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd774904-356d-491f-93cb-318810424d2b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.291765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5850ffc2-01a0-4a8e-b354-c989365fc708 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:37.300194 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5850ffc2-01a0-4a8e-b354-c989365fc708 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.384082 Oct 04 18:21:37.300779 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2342/4693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:36 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:37.404131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fd774904-356d-491f-93cb-318810424d2b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:37.412223 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd774904-356d-491f-93cb-318810424d2b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 200 len: 1317 microversion: 2.1 time: 0.317156 Oct 04 18:21:37.425745 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2352/4694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:37 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:37.786461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a441629f-eb76-4a35-82c9-094d9a343a63 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:37.787110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a441629f-eb76-4a35-82c9-094d9a343a63 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:37.800044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a441629f-eb76-4a35-82c9-094d9a343a63 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.800585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a441629f-eb76-4a35-82c9-094d9a343a63 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.801202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a441629f-eb76-4a35-82c9-094d9a343a63 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.802056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a441629f-eb76-4a35-82c9-094d9a343a63 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.802593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a441629f-eb76-4a35-82c9-094d9a343a63 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.802942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a441629f-eb76-4a35-82c9-094d9a343a63 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.931788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e6b6a57c-ac40-4f31-85bc-bab18397e6ce req-ad38c0c0-e4ea-46a6-ba6b-c43177045166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49466338-d6de-477e-a4a6-050f58898810", "tag": "92b99760-d297-4423-9b88-ef1e10be8857"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:37.950830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e6b6a57c-ac40-4f31-85bc-bab18397e6ce req-ad38c0c0-e4ea-46a6-ba6b-c43177045166 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.952219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e6b6a57c-ac40-4f31-85bc-bab18397e6ce req-ad38c0c0-e4ea-46a6-ba6b-c43177045166 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.952869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e6b6a57c-ac40-4f31-85bc-bab18397e6ce req-ad38c0c0-e4ea-46a6-ba6b-c43177045166 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.971709 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e6b6a57c-ac40-4f31-85bc-bab18397e6ce req-ad38c0c0-e4ea-46a6-ba6b-c43177045166 service nova] Creating event network-changed:92b99760-d297-4423-9b88-ef1e10be8857 for instance 49466338-d6de-477e-a4a6-050f58898810 on n-h2-850499-14 Oct 04 18:21:37.978416 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e6b6a57c-ac40-4f31-85bc-bab18397e6ce req-ad38c0c0-e4ea-46a6-ba6b-c43177045166 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050767 Oct 04 18:21:37.980854 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2353/4695] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:38.327524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db08362b-1805-46e4-80bc-87fa741885be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:38.328255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-db08362b-1805-46e4-80bc-87fa741885be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:38.339211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db08362b-1805-46e4-80bc-87fa741885be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.339724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db08362b-1805-46e4-80bc-87fa741885be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.340179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db08362b-1805-46e4-80bc-87fa741885be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.340920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db08362b-1805-46e4-80bc-87fa741885be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.341392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db08362b-1805-46e4-80bc-87fa741885be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.341831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db08362b-1805-46e4-80bc-87fa741885be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.367392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a441629f-eb76-4a35-82c9-094d9a343a63 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:38.382661 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a441629f-eb76-4a35-82c9-094d9a343a63 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.600039 Oct 04 18:21:38.384780 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2343/4696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:37 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:38.439760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-325fb06e-d25e-4851-8ea1-1fa4d49a3671 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:38.441544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-325fb06e-d25e-4851-8ea1-1fa4d49a3671 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:38.461074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-325fb06e-d25e-4851-8ea1-1fa4d49a3671 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.462633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-325fb06e-d25e-4851-8ea1-1fa4d49a3671 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.463453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-325fb06e-d25e-4851-8ea1-1fa4d49a3671 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.464818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-325fb06e-d25e-4851-8ea1-1fa4d49a3671 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.467224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-325fb06e-d25e-4851-8ea1-1fa4d49a3671 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.468247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-325fb06e-d25e-4851-8ea1-1fa4d49a3671 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.874327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-db08362b-1805-46e4-80bc-87fa741885be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:38.888248 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-db08362b-1805-46e4-80bc-87fa741885be tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.566691 Oct 04 18:21:38.905182 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2354/4697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:38 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:38.962929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-325fb06e-d25e-4851-8ea1-1fa4d49a3671 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:38.975449 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-325fb06e-d25e-4851-8ea1-1fa4d49a3671 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 200 len: 1504 microversion: 2.1 time: 0.540738 Oct 04 18:21:38.978114 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2344/4698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:38 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:39.004925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-caae3cf8-f22e-48b8-8bcc-b40a9a37d8ef tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:39.006093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-caae3cf8-f22e-48b8-8bcc-b40a9a37d8ef tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:39.016078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caae3cf8-f22e-48b8-8bcc-b40a9a37d8ef tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.016770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caae3cf8-f22e-48b8-8bcc-b40a9a37d8ef tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.017411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caae3cf8-f22e-48b8-8bcc-b40a9a37d8ef tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.018358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caae3cf8-f22e-48b8-8bcc-b40a9a37d8ef tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.019030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caae3cf8-f22e-48b8-8bcc-b40a9a37d8ef tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.019620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caae3cf8-f22e-48b8-8bcc-b40a9a37d8ef tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.057370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-caae3cf8-f22e-48b8-8bcc-b40a9a37d8ef tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:39.108123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:39.171446 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-caae3cf8-f22e-48b8-8bcc-b40a9a37d8ef tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 204 len: 0 microversion: 2.1 time: 0.171551 Oct 04 18:21:39.172969 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2355/4699] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:38 2022] DELETE /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:39.181428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-13d27388-5188-4c98-a1d3-1953b1e20340 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:39.182247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-13d27388-5188-4c98-a1d3-1953b1e20340 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:39.224383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d27388-5188-4c98-a1d3-1953b1e20340 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.228521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d27388-5188-4c98-a1d3-1953b1e20340 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.229094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d27388-5188-4c98-a1d3-1953b1e20340 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.230822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d27388-5188-4c98-a1d3-1953b1e20340 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.232888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d27388-5188-4c98-a1d3-1953b1e20340 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.234465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d27388-5188-4c98-a1d3-1953b1e20340 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.294784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-13d27388-5188-4c98-a1d3-1953b1e20340 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:39.412651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aad1faea-a4b3-4bc6-87da-cc5348b85ed8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:39.414604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aad1faea-a4b3-4bc6-87da-cc5348b85ed8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:39.435659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad1faea-a4b3-4bc6-87da-cc5348b85ed8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.437236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad1faea-a4b3-4bc6-87da-cc5348b85ed8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.438103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad1faea-a4b3-4bc6-87da-cc5348b85ed8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.440068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad1faea-a4b3-4bc6-87da-cc5348b85ed8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.443491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad1faea-a4b3-4bc6-87da-cc5348b85ed8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.444389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aad1faea-a4b3-4bc6-87da-cc5348b85ed8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.466418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:39.479345 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-13d27388-5188-4c98-a1d3-1953b1e20340 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 204 len: 0 microversion: 2.1 time: 0.301834 Oct 04 18:21:39.482802 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2345/4700] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:39 2022] DELETE /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:39.495671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-889c0b05-8ece-4d4e-84c5-27019ec3113a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:39.498556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-889c0b05-8ece-4d4e-84c5-27019ec3113a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:39.514189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-889c0b05-8ece-4d4e-84c5-27019ec3113a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.520084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-889c0b05-8ece-4d4e-84c5-27019ec3113a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.520553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-889c0b05-8ece-4d4e-84c5-27019ec3113a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.521311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-889c0b05-8ece-4d4e-84c5-27019ec3113a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.521762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-889c0b05-8ece-4d4e-84c5-27019ec3113a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.522201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-889c0b05-8ece-4d4e-84c5-27019ec3113a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.363359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aad1faea-a4b3-4bc6-87da-cc5348b85ed8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:40.373554 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aad1faea-a4b3-4bc6-87da-cc5348b85ed8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.966889 Oct 04 18:21:40.390565 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2356/4701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:39 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:40.396382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-449cecd2-4e5c-40be-b648-058186a3e7bc tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:40.397434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-449cecd2-4e5c-40be-b648-058186a3e7bc tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:40.404597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-449cecd2-4e5c-40be-b648-058186a3e7bc tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.405471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-449cecd2-4e5c-40be-b648-058186a3e7bc tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.406143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-449cecd2-4e5c-40be-b648-058186a3e7bc tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.407237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-449cecd2-4e5c-40be-b648-058186a3e7bc tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.407952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-449cecd2-4e5c-40be-b648-058186a3e7bc tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.408624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-449cecd2-4e5c-40be-b648-058186a3e7bc tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.545038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-889c0b05-8ece-4d4e-84c5-27019ec3113a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:40.553903 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-889c0b05-8ece-4d4e-84c5-27019ec3113a tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 200 len: 1510 microversion: 2.1 time: 1.065191 Oct 04 18:21:40.561547 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2346/4702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:39 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 1510 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:40.564980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-faf52cd6-e986-4d48-b0e8-a1b9810cd2b7 req-50939ba0-0109-44cb-b255-12e7be097973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1908ea35-63c6-453c-b505-ce3990be8cef", "tag": "31735e56-335a-4bc6-b09b-b79a0198b3b9"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:40.597011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-faf52cd6-e986-4d48-b0e8-a1b9810cd2b7 req-50939ba0-0109-44cb-b255-12e7be097973 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.597505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-faf52cd6-e986-4d48-b0e8-a1b9810cd2b7 req-50939ba0-0109-44cb-b255-12e7be097973 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.597951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-faf52cd6-e986-4d48-b0e8-a1b9810cd2b7 req-50939ba0-0109-44cb-b255-12e7be097973 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.610393 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-faf52cd6-e986-4d48-b0e8-a1b9810cd2b7 req-50939ba0-0109-44cb-b255-12e7be097973 service nova] Creating event network-changed:31735e56-335a-4bc6-b09b-b79a0198b3b9 for instance 1908ea35-63c6-453c-b505-ce3990be8cef on n-h1-850499-14 Oct 04 18:21:40.624751 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-faf52cd6-e986-4d48-b0e8-a1b9810cd2b7 req-50939ba0-0109-44cb-b255-12e7be097973 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063592 Oct 04 18:21:40.625812 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2347/4703] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:40.902616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-449cecd2-4e5c-40be-b648-058186a3e7bc tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:40.912435 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-449cecd2-4e5c-40be-b648-058186a3e7bc tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.520211 Oct 04 18:21:40.913042 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2357/4704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:40 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:41.412620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dd95cddd-a106-4ab7-a21b-18c5bd7ec541 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:41.413419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dd95cddd-a106-4ab7-a21b-18c5bd7ec541 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:41.435985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd95cddd-a106-4ab7-a21b-18c5bd7ec541 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.437066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd95cddd-a106-4ab7-a21b-18c5bd7ec541 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.445116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd95cddd-a106-4ab7-a21b-18c5bd7ec541 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.446125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd95cddd-a106-4ab7-a21b-18c5bd7ec541 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.446937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd95cddd-a106-4ab7-a21b-18c5bd7ec541 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.447608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd95cddd-a106-4ab7-a21b-18c5bd7ec541 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.589930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a52ffc6-02d6-433a-8bc4-b43d8184b4ea tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:41.590672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a52ffc6-02d6-433a-8bc4-b43d8184b4ea tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:41.600045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a52ffc6-02d6-433a-8bc4-b43d8184b4ea tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.600650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a52ffc6-02d6-433a-8bc4-b43d8184b4ea tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.601219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a52ffc6-02d6-433a-8bc4-b43d8184b4ea tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.602312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a52ffc6-02d6-433a-8bc4-b43d8184b4ea tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.606481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a52ffc6-02d6-433a-8bc4-b43d8184b4ea tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.607058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a52ffc6-02d6-433a-8bc4-b43d8184b4ea tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.942801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd95cddd-a106-4ab7-a21b-18c5bd7ec541 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:41.960332 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dd95cddd-a106-4ab7-a21b-18c5bd7ec541 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.566221 Oct 04 18:21:41.964822 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2348/4705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:41 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:41.992677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-344846af-313f-4253-9b4e-2078ce2d4dc6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:41.993943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-344846af-313f-4253-9b4e-2078ce2d4dc6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:42.025508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344846af-313f-4253-9b4e-2078ce2d4dc6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.027264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344846af-313f-4253-9b4e-2078ce2d4dc6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.030506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344846af-313f-4253-9b4e-2078ce2d4dc6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.031595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344846af-313f-4253-9b4e-2078ce2d4dc6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.033205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344846af-313f-4253-9b4e-2078ce2d4dc6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.035597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344846af-313f-4253-9b4e-2078ce2d4dc6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.109911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:42.163807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9a52ffc6-02d6-433a-8bc4-b43d8184b4ea tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:42.173727 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a52ffc6-02d6-433a-8bc4-b43d8184b4ea tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 200 len: 1510 microversion: 2.1 time: 0.595630 Oct 04 18:21:42.186871 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2358/4706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:41 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 1510 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:42.252947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:42.306295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=10 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:42.567909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-344846af-313f-4253-9b4e-2078ce2d4dc6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:42.582053 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-344846af-313f-4253-9b4e-2078ce2d4dc6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.615963 Oct 04 18:21:42.582646 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2349/4707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:41 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:42.989349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-608524f3-be83-4b10-9f70-71d5b964129f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:42.990619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-608524f3-be83-4b10-9f70-71d5b964129f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:43.003484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:43.006389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-608524f3-be83-4b10-9f70-71d5b964129f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.007877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-608524f3-be83-4b10-9f70-71d5b964129f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.008658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-608524f3-be83-4b10-9f70-71d5b964129f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.009759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-608524f3-be83-4b10-9f70-71d5b964129f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.010731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-608524f3-be83-4b10-9f70-71d5b964129f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.011699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-608524f3-be83-4b10-9f70-71d5b964129f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.213634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ca1670a-7436-416c-ab69-381658b380b5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:43.214909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ca1670a-7436-416c-ab69-381658b380b5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:43.217718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-608524f3-be83-4b10-9f70-71d5b964129f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:43.221602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca1670a-7436-416c-ab69-381658b380b5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.222323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca1670a-7436-416c-ab69-381658b380b5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.222940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca1670a-7436-416c-ab69-381658b380b5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.223914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca1670a-7436-416c-ab69-381658b380b5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.224533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca1670a-7436-416c-ab69-381658b380b5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.225186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ca1670a-7436-416c-ab69-381658b380b5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.229100 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-608524f3-be83-4b10-9f70-71d5b964129f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.244906 Oct 04 18:21:43.230546 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2359/4708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:42 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:43.493138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ca1670a-7436-416c-ab69-381658b380b5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:43.509908 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ca1670a-7436-416c-ab69-381658b380b5 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 200 len: 1510 microversion: 2.1 time: 0.300972 Oct 04 18:21:43.516299 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2350/4709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:43 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:43.592112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ada9ee1b-4e94-4768-babd-2aa2fa1e8cc2 req-00ff2331-8b91-43e8-b079-64b58785cb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad37c778-7726-4ad7-a88d-0b3b7a553570", "name": "network-vif-deleted", "tag": "d769a7d1-6909-4c4b-9e87-f525d4a01160"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:43.615492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd650c05-b343-44c9-a72b-2c2210c33726 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:43.616509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cd650c05-b343-44c9-a72b-2c2210c33726 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:43.630452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd650c05-b343-44c9-a72b-2c2210c33726 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.631411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd650c05-b343-44c9-a72b-2c2210c33726 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.634845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ada9ee1b-4e94-4768-babd-2aa2fa1e8cc2 req-00ff2331-8b91-43e8-b079-64b58785cb46 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.635654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ada9ee1b-4e94-4768-babd-2aa2fa1e8cc2 req-00ff2331-8b91-43e8-b079-64b58785cb46 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.635907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd650c05-b343-44c9-a72b-2c2210c33726 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.636610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ada9ee1b-4e94-4768-babd-2aa2fa1e8cc2 req-00ff2331-8b91-43e8-b079-64b58785cb46 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.639669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd650c05-b343-44c9-a72b-2c2210c33726 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.640164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd650c05-b343-44c9-a72b-2c2210c33726 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.640603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd650c05-b343-44c9-a72b-2c2210c33726 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.673922 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ada9ee1b-4e94-4768-babd-2aa2fa1e8cc2 req-00ff2331-8b91-43e8-b079-64b58785cb46 service nova] Creating event network-vif-deleted:d769a7d1-6909-4c4b-9e87-f525d4a01160 for instance ad37c778-7726-4ad7-a88d-0b3b7a553570 on n-h2-850499-14 Oct 04 18:21:43.680116 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ada9ee1b-4e94-4768-babd-2aa2fa1e8cc2 req-00ff2331-8b91-43e8-b079-64b58785cb46 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096797 Oct 04 18:21:43.681525 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2360/4710] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:43.992198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cd650c05-b343-44c9-a72b-2c2210c33726 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:44.004856 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cd650c05-b343-44c9-a72b-2c2210c33726 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.398875 Oct 04 18:21:44.023633 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2351/4711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:43 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:44.256149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a1055bc-c775-4baf-a12f-1a10b1407d7a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:44.261256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3a1055bc-c775-4baf-a12f-1a10b1407d7a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:44.268797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a1055bc-c775-4baf-a12f-1a10b1407d7a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.269310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a1055bc-c775-4baf-a12f-1a10b1407d7a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.270183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a1055bc-c775-4baf-a12f-1a10b1407d7a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.270993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a1055bc-c775-4baf-a12f-1a10b1407d7a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.271666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a1055bc-c775-4baf-a12f-1a10b1407d7a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.272305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a1055bc-c775-4baf-a12f-1a10b1407d7a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.540589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df2148e7-1f61-49b8-8de5-7a6e5d823129 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:44.541218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-df2148e7-1f61-49b8-8de5-7a6e5d823129 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:44.555351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df2148e7-1f61-49b8-8de5-7a6e5d823129 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.555796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df2148e7-1f61-49b8-8de5-7a6e5d823129 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.559192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df2148e7-1f61-49b8-8de5-7a6e5d823129 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.559999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df2148e7-1f61-49b8-8de5-7a6e5d823129 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.560492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df2148e7-1f61-49b8-8de5-7a6e5d823129 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.561630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df2148e7-1f61-49b8-8de5-7a6e5d823129 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.566246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3a1055bc-c775-4baf-a12f-1a10b1407d7a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:44.577738 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a1055bc-c775-4baf-a12f-1a10b1407d7a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.325791 Oct 04 18:21:44.578657 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2361/4712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:44 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:44.747824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-df2148e7-1f61-49b8-8de5-7a6e5d823129 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:44.768998 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-df2148e7-1f61-49b8-8de5-7a6e5d823129 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 200 len: 1468 microversion: 2.1 time: 0.224522 Oct 04 18:21:44.769707 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2352/4713] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:44 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 1468 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:45.032003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8935347a-9a48-4a82-ad2f-c1952bc8ead7 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:45.033332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8935347a-9a48-4a82-ad2f-c1952bc8ead7 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:45.047897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8935347a-9a48-4a82-ad2f-c1952bc8ead7 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.049157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8935347a-9a48-4a82-ad2f-c1952bc8ead7 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.050063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8935347a-9a48-4a82-ad2f-c1952bc8ead7 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.052566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8935347a-9a48-4a82-ad2f-c1952bc8ead7 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.054227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8935347a-9a48-4a82-ad2f-c1952bc8ead7 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.056059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8935347a-9a48-4a82-ad2f-c1952bc8ead7 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.398862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8935347a-9a48-4a82-ad2f-c1952bc8ead7 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:45.418317 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8935347a-9a48-4a82-ad2f-c1952bc8ead7 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.392014 Oct 04 18:21:45.432022 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2362/4714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:45 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:45.605498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-089628af-024c-4feb-9573-9eaf032a1a2d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:45.606566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-089628af-024c-4feb-9573-9eaf032a1a2d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:45.622375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-089628af-024c-4feb-9573-9eaf032a1a2d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.626051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-089628af-024c-4feb-9573-9eaf032a1a2d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.628268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-089628af-024c-4feb-9573-9eaf032a1a2d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.629611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-089628af-024c-4feb-9573-9eaf032a1a2d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.633990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-089628af-024c-4feb-9573-9eaf032a1a2d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.634776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-089628af-024c-4feb-9573-9eaf032a1a2d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.751005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-20cf926b-a64a-464b-84c0-3970b81480e0 req-42f4ed5c-b8c5-427b-878a-745827d2b38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc89347-39d7-460e-9c1a-a8bebbd91aea", "name": "network-vif-deleted", "tag": "f4cda60d-7696-43af-bb92-16208888b299"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:45.787997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-20cf926b-a64a-464b-84c0-3970b81480e0 req-42f4ed5c-b8c5-427b-878a-745827d2b38a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.790022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-20cf926b-a64a-464b-84c0-3970b81480e0 req-42f4ed5c-b8c5-427b-878a-745827d2b38a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.797615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-20cf926b-a64a-464b-84c0-3970b81480e0 req-42f4ed5c-b8c5-427b-878a-745827d2b38a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.830416 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-20cf926b-a64a-464b-84c0-3970b81480e0 req-42f4ed5c-b8c5-427b-878a-745827d2b38a service nova] Creating event network-vif-deleted:f4cda60d-7696-43af-bb92-16208888b299 for instance 4cc89347-39d7-460e-9c1a-a8bebbd91aea on n-h1-850499-14 Oct 04 18:21:45.846308 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-20cf926b-a64a-464b-84c0-3970b81480e0 req-42f4ed5c-b8c5-427b-878a-745827d2b38a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099708 Oct 04 18:21:45.847980 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2363/4715] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:45.863357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:45.869872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:45.908959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.910469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.921193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.925179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.930589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.931641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.976084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-089628af-024c-4feb-9573-9eaf032a1a2d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:45.988451 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-089628af-024c-4feb-9573-9eaf032a1a2d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.387318 Oct 04 18:21:46.014893 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2353/4716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:45 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:46.049712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.057619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.058473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.059411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lazy-loading 'fault' on Instance uuid ad37c778-7726-4ad7-a88d-0b3b7a553570 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:46.120536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6962aec4d9994696bbe5c6d168f62228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c658c675bc1846669c38a1b22d3b1098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:46.131590 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-71a92b15-e629-49de-bbbe-74428001a935 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 200 len: 1307 microversion: 2.1 time: 0.281825 Oct 04 18:21:46.132818 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2364/4717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:45 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:46.451643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d65a2b9-73b4-481e-a4b5-8e2fe1f1bcef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:46.452282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d65a2b9-73b4-481e-a4b5-8e2fe1f1bcef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:46.458715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d65a2b9-73b4-481e-a4b5-8e2fe1f1bcef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.459242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d65a2b9-73b4-481e-a4b5-8e2fe1f1bcef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.459872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d65a2b9-73b4-481e-a4b5-8e2fe1f1bcef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.472183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d65a2b9-73b4-481e-a4b5-8e2fe1f1bcef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.473526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d65a2b9-73b4-481e-a4b5-8e2fe1f1bcef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.474158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d65a2b9-73b4-481e-a4b5-8e2fe1f1bcef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.814635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d65a2b9-73b4-481e-a4b5-8e2fe1f1bcef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:46.825781 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d65a2b9-73b4-481e-a4b5-8e2fe1f1bcef tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.381256 Oct 04 18:21:46.839752 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2354/4718] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:46 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:47.023658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a4b67c91-d3aa-46d4-8318-177e7b59deb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:47.024846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a4b67c91-d3aa-46d4-8318-177e7b59deb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:47.042448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b67c91-d3aa-46d4-8318-177e7b59deb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.044278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b67c91-d3aa-46d4-8318-177e7b59deb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.046805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b67c91-d3aa-46d4-8318-177e7b59deb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.050601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b67c91-d3aa-46d4-8318-177e7b59deb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.053431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b67c91-d3aa-46d4-8318-177e7b59deb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.055760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4b67c91-d3aa-46d4-8318-177e7b59deb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.161655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:47.162559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: ad37c778-7726-4ad7-a88d-0b3b7a553570] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:47.170754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.171551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.172149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.173065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.173692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.174319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.208244 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] HTTP exception thrown: Instance ad37c778-7726-4ad7-a88d-0b3b7a553570 could not be found. Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Request method failure captured: Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 HTTP/1.1 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHmBo66wOWPLB-59AVP7hpAvKLk0BO_GVoqr5kjwfEnyJ_LuREoP_rV2GsOahrzc7lJGiKiZ6S6AZE47_0NWI34i3PCbDX3WcJ34sBzTiFpUABYPsd4oK2gIfFT5ITbvbUGEWOIJV7n1fcEJmhDQ7Kdz3VUcFo_OsmAKIPac7J72798 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: c658c675bc1846669c38a1b22d3b1098 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-MultipleCreateTestJSON-486630548 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c658c675bc1846669c38a1b22d3b1098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c658c675bc1846669c38a1b22d3b1098"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c658c675bc1846669c38a1b22d3b1098"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c658c675bc1846669c38a1b22d3b1098"}]}] Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-MultipleCreateTestJSON-486630548 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: c658c675bc1846669c38a1b22d3b1098 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-MultipleCreateTestJSON-486630548 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-MultipleCreateTestJSON-486630548-project Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6962aec4d9994696bbe5c6d168f62228 Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-MultipleCreateTestJSON-486630548-project Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ad37c778-7726-4ad7-a88d-0b3b7a553570 could not be found. Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ad37c778-7726-4ad7-a88d-0b3b7a553570'} Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad37c778-7726-4ad7-a88d-0b3b7a553570 could not be found. Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad37c778-7726-4ad7-a88d-0b3b7a553570 could not be found. Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:47.212214 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:47.217150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:47.217150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:47.217150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:47.217150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:47.217150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:47.217150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad37c778-7726-4ad7-a88d-0b3b7a553570 could not be found. Oct 04 18:21:47.217150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:47.218828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Returning 404 to user: Instance ad37c778-7726-4ad7-a88d-0b3b7a553570 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:47.219974 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ce10ddb-431c-4e13-ad3e-17884a0c6839 tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570" status: 404 len: 111 microversion: 2.1 time: 0.062257 Oct 04 18:21:47.221052 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2355/4719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:47 2022] GET /compute/v2.1/servers/ad37c778-7726-4ad7-a88d-0b3b7a553570 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:47.241941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:47.242930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] [instance: 4cc89347-39d7-460e-9c1a-a8bebbd91aea] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:47.250810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.251652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.252290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.254191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.254898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.255740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.296302 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] HTTP exception thrown: Instance 4cc89347-39d7-460e-9c1a-a8bebbd91aea could not be found. Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Request method failure captured: Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea HTTP/1.1 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHmBo66wOWPLB-59AVP7hpAvKLk0BO_GVoqr5kjwfEnyJ_LuREoP_rV2GsOahrzc7lJGiKiZ6S6AZE47_0NWI34i3PCbDX3WcJ34sBzTiFpUABYPsd4oK2gIfFT5ITbvbUGEWOIJV7n1fcEJmhDQ7Kdz3VUcFo_OsmAKIPac7J72798 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: c658c675bc1846669c38a1b22d3b1098 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-MultipleCreateTestJSON-486630548 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c658c675bc1846669c38a1b22d3b1098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c658c675bc1846669c38a1b22d3b1098"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c658c675bc1846669c38a1b22d3b1098"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c658c675bc1846669c38a1b22d3b1098"}]}] Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-MultipleCreateTestJSON-486630548 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: c658c675bc1846669c38a1b22d3b1098 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-MultipleCreateTestJSON-486630548 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-MultipleCreateTestJSON-486630548-project Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6962aec4d9994696bbe5c6d168f62228 Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-MultipleCreateTestJSON-486630548-project Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4cc89347-39d7-460e-9c1a-a8bebbd91aea could not be found. Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4cc89347-39d7-460e-9c1a-a8bebbd91aea'} Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc89347-39d7-460e-9c1a-a8bebbd91aea could not be found. Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc89347-39d7-460e-9c1a-a8bebbd91aea could not be found. Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:47.301280 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:47.305625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:47.305625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:47.305625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:47.305625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:47.305625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:47.305625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc89347-39d7-460e-9c1a-a8bebbd91aea could not be found. Oct 04 18:21:47.305625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:21:47.305625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] Returning 404 to user: Instance 4cc89347-39d7-460e-9c1a-a8bebbd91aea could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:47.306189 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5907af2-5c3f-460c-bf93-dba2c843ac4b tempest-MultipleCreateTestJSON-486630548 tempest-MultipleCreateTestJSON-486630548-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea" status: 404 len: 111 microversion: 2.1 time: 0.080024 Oct 04 18:21:47.313995 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2356/4720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:47 2022] GET /compute/v2.1/servers/4cc89347-39d7-460e-9c1a-a8bebbd91aea => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:21:47.573480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a4b67c91-d3aa-46d4-8318-177e7b59deb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:47.596238 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a4b67c91-d3aa-46d4-8318-177e7b59deb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.576780 Oct 04 18:21:47.618805 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2365/4721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:47 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:47.826397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-071f7a78-7697-4789-b641-4b6e5b4a1016 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'create', calling method: .version_select at 0x7fd4d621f790>, body: {"keypair": {"name": "tempest-keypair-1489579588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfpACxS4nTu3HyByR9vb6Pln9pxoZzj0KW6V4VMFOfopEWeGpg7BhFXfWlpRHYWDOY9niWpatSO0Q61XpDiRCcNLAcDKCNJdxWkQnRoYWmTbZpr7nvytbPdgPGpLKNPAQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:47.852325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-071f7a78-7697-4789-b641-4b6e5b4a1016 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for project e2ee0993b0954950949c8afffb90617c. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:47.853076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20f4dbf6-1d88-4d93-b099-c1b631cba292 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:47.853896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20f4dbf6-1d88-4d93-b099-c1b631cba292 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:47.862338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-071f7a78-7697-4789-b641-4b6e5b4a1016 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for user 6591acf0ba4648abac6cc8ac8ddd560e and project e2ee0993b0954950949c8afffb90617c. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:47.868721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20f4dbf6-1d88-4d93-b099-c1b631cba292 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.869292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20f4dbf6-1d88-4d93-b099-c1b631cba292 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.871526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20f4dbf6-1d88-4d93-b099-c1b631cba292 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.873218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20f4dbf6-1d88-4d93-b099-c1b631cba292 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.873728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20f4dbf6-1d88-4d93-b099-c1b631cba292 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.875206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20f4dbf6-1d88-4d93-b099-c1b631cba292 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.908509 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-071f7a78-7697-4789-b641-4b6e5b4a1016 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.308906 Oct 04 18:21:47.910214 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2357/4722] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:21:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:48.587602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-20f4dbf6-1d88-4d93-b099-c1b631cba292 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:48.602473 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20f4dbf6-1d88-4d93-b099-c1b631cba292 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.755534 Oct 04 18:21:48.619814 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2366/4723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:47 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:48.631845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9be7431d-9d68-4d4a-8418-f5ed83fb7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:48.632640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9be7431d-9d68-4d4a-8418-f5ed83fb7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:48.642786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be7431d-9d68-4d4a-8418-f5ed83fb7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:48.642786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be7431d-9d68-4d4a-8418-f5ed83fb7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:48.647543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be7431d-9d68-4d4a-8418-f5ed83fb7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:48.648550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be7431d-9d68-4d4a-8418-f5ed83fb7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:48.649297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be7431d-9d68-4d4a-8418-f5ed83fb7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:48.655620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be7431d-9d68-4d4a-8418-f5ed83fb7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:48.937916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9be7431d-9d68-4d4a-8418-f5ed83fb7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:48.955983 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9be7431d-9d68-4d4a-8418-f5ed83fb7374 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.328162 Oct 04 18:21:48.956646 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2358/4724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:48 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:49.630665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a28315c-3b09-460e-9aa9-bd4841760902 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:49.631396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a28315c-3b09-460e-9aa9-bd4841760902 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:49.643904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a28315c-3b09-460e-9aa9-bd4841760902 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.648457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a28315c-3b09-460e-9aa9-bd4841760902 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.648956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a28315c-3b09-460e-9aa9-bd4841760902 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.649807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a28315c-3b09-460e-9aa9-bd4841760902 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.650423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a28315c-3b09-460e-9aa9-bd4841760902 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.650984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a28315c-3b09-460e-9aa9-bd4841760902 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.992222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-387590a3-be1a-4550-9031-794a2e973af7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:49.995329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-387590a3-be1a-4550-9031-794a2e973af7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:50.007649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-387590a3-be1a-4550-9031-794a2e973af7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.012035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-387590a3-be1a-4550-9031-794a2e973af7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.012761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-387590a3-be1a-4550-9031-794a2e973af7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.013738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-387590a3-be1a-4550-9031-794a2e973af7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.014429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-387590a3-be1a-4550-9031-794a2e973af7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.017043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-387590a3-be1a-4550-9031-794a2e973af7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.604842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a28315c-3b09-460e-9aa9-bd4841760902 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:50.613045 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a28315c-3b09-460e-9aa9-bd4841760902 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.987034 Oct 04 18:21:50.613951 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2367/4725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:49 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:50.632166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1626069874", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68212092-c97c-4a48-819f-9516513174c4"}], "security_groups": [{"name": "tempest-securitygroup--1036313665"}], "key_name": "tempest-keypair-1489579588", "user_data": "}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:50.690478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-387590a3-be1a-4550-9031-794a2e973af7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:50.699528 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-387590a3-be1a-4550-9031-794a2e973af7 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.722372 Oct 04 18:21:50.700689 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2359/4726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:49 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:50.856938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] validate_networks() for [('68212092-c97c-4a48-819f-9516513174c4', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:51.097102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-0f5c008f-f019-4018-85f8-65ec0cce6eb8 req-80cdb1b4-cb6d-48ae-b4e3-83ccc66a8218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49466338-d6de-477e-a4a6-050f58898810", "name": "network-vif-plugged", "status": "completed", "tag": "92b99760-d297-4423-9b88-ef1e10be8857"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:51.116880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0f5c008f-f019-4018-85f8-65ec0cce6eb8 req-80cdb1b4-cb6d-48ae-b4e3-83ccc66a8218 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.117776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0f5c008f-f019-4018-85f8-65ec0cce6eb8 req-80cdb1b4-cb6d-48ae-b4e3-83ccc66a8218 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.119781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0f5c008f-f019-4018-85f8-65ec0cce6eb8 req-80cdb1b4-cb6d-48ae-b4e3-83ccc66a8218 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.151505 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-0f5c008f-f019-4018-85f8-65ec0cce6eb8 req-80cdb1b4-cb6d-48ae-b4e3-83ccc66a8218 service nova] Creating event network-vif-plugged:92b99760-d297-4423-9b88-ef1e10be8857 for instance 49466338-d6de-477e-a4a6-050f58898810 on n-h2-850499-14 Oct 04 18:21:51.159247 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-0f5c008f-f019-4018-85f8-65ec0cce6eb8 req-80cdb1b4-cb6d-48ae-b4e3-83ccc66a8218 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065703 Oct 04 18:21:51.160532 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2360/4727] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:51.641044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-054f26ee-dcc0-4ade-b973-7a0dc6f683bf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:51.642851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-054f26ee-dcc0-4ade-b973-7a0dc6f683bf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:51.650354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054f26ee-dcc0-4ade-b973-7a0dc6f683bf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.650864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054f26ee-dcc0-4ade-b973-7a0dc6f683bf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.651378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054f26ee-dcc0-4ade-b973-7a0dc6f683bf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.652093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054f26ee-dcc0-4ade-b973-7a0dc6f683bf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.652672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054f26ee-dcc0-4ade-b973-7a0dc6f683bf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.653185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-054f26ee-dcc0-4ade-b973-7a0dc6f683bf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:52.265896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:52.267097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:52.267771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:52.268406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:52.269176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:52.287759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:52.289864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:52.293211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:52.294055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:52.294544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:52.297171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:52.334630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-054f26ee-dcc0-4ade-b973-7a0dc6f683bf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:52.342903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for project e2ee0993b0954950949c8afffb90617c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:52.358683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for user 6591acf0ba4648abac6cc8ac8ddd560e and project e2ee0993b0954950949c8afffb90617c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:52.360195 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-054f26ee-dcc0-4ade-b973-7a0dc6f683bf tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.725872 Oct 04 18:21:52.365169 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2361/4728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:51 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:52.391865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d2a8576-0ffe-455c-87af-466606577bcd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:52.394334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4d2a8576-0ffe-455c-87af-466606577bcd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:52.394477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:52.399261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:52.411904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d2a8576-0ffe-455c-87af-466606577bcd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:52.412467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d2a8576-0ffe-455c-87af-466606577bcd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:52.412957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d2a8576-0ffe-455c-87af-466606577bcd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:52.413897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d2a8576-0ffe-455c-87af-466606577bcd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:52.416020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d2a8576-0ffe-455c-87af-466606577bcd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:52.417854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d2a8576-0ffe-455c-87af-466606577bcd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:52.524622 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-debe2e09-9c07-4c2a-9e4d-ba31202ee9ba tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.909462 Oct 04 18:21:52.525609 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2368/4729] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:21:52.537936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f1c38d9-9ee9-44a8-8564-4c8ce074ad42 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:52.538570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f1c38d9-9ee9-44a8-8564-4c8ce074ad42 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:52.997543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f1c38d9-9ee9-44a8-8564-4c8ce074ad42 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:53.005074 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f1c38d9-9ee9-44a8-8564-4c8ce074ad42 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1239 microversion: 2.1 time: 0.471502 Oct 04 18:21:53.011285 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2369/4730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:52 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1239 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:53.267456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4d2a8576-0ffe-455c-87af-466606577bcd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:53.305799 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4d2a8576-0ffe-455c-87af-466606577bcd tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1327 microversion: 2.1 time: 0.933434 Oct 04 18:21:53.306996 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2362/4731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:52 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1327 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:53.392327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9e37bb61-912f-4895-be12-284ccd4f97af tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:53.393903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9e37bb61-912f-4895-be12-284ccd4f97af tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:53.405835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e37bb61-912f-4895-be12-284ccd4f97af tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:53.406361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e37bb61-912f-4895-be12-284ccd4f97af tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:53.410907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e37bb61-912f-4895-be12-284ccd4f97af tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:53.413973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e37bb61-912f-4895-be12-284ccd4f97af tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:53.415039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e37bb61-912f-4895-be12-284ccd4f97af tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:53.421667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e37bb61-912f-4895-be12-284ccd4f97af tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:53.714629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9e37bb61-912f-4895-be12-284ccd4f97af tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:53.734321 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9e37bb61-912f-4895-be12-284ccd4f97af tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.346220 Oct 04 18:21:53.736411 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2370/4732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:53 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:54.033116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6a66e2ec-6857-44af-a507-0260c910c74e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:54.033749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6a66e2ec-6857-44af-a507-0260c910c74e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:54.044633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a66e2ec-6857-44af-a507-0260c910c74e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.047186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a66e2ec-6857-44af-a507-0260c910c74e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.048437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a66e2ec-6857-44af-a507-0260c910c74e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.049453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a66e2ec-6857-44af-a507-0260c910c74e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.053479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a66e2ec-6857-44af-a507-0260c910c74e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.054222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a66e2ec-6857-44af-a507-0260c910c74e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.210127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6a66e2ec-6857-44af-a507-0260c910c74e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:54.222702 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6a66e2ec-6857-44af-a507-0260c910c74e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1291 microversion: 2.1 time: 0.191870 Oct 04 18:21:54.223842 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2363/4733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:54 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1291 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:54.329777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee968deb-fb7d-4d05-81b0-9702473339e0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:54.330867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ee968deb-fb7d-4d05-81b0-9702473339e0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:54.338067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee968deb-fb7d-4d05-81b0-9702473339e0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.338806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee968deb-fb7d-4d05-81b0-9702473339e0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.339508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee968deb-fb7d-4d05-81b0-9702473339e0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.341405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee968deb-fb7d-4d05-81b0-9702473339e0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.342281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee968deb-fb7d-4d05-81b0-9702473339e0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.342793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee968deb-fb7d-4d05-81b0-9702473339e0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.589875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee968deb-fb7d-4d05-81b0-9702473339e0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:54.606462 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ee968deb-fb7d-4d05-81b0-9702473339e0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1509 microversion: 2.1 time: 0.280329 Oct 04 18:21:54.607271 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2371/4734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:54 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:54.632108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5511c1f-3a25-44cd-9ede-2e3af4c5316d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:54.632743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5511c1f-3a25-44cd-9ede-2e3af4c5316d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:54.640858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5511c1f-3a25-44cd-9ede-2e3af4c5316d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.641499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5511c1f-3a25-44cd-9ede-2e3af4c5316d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.642122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5511c1f-3a25-44cd-9ede-2e3af4c5316d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.643372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5511c1f-3a25-44cd-9ede-2e3af4c5316d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.644103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5511c1f-3a25-44cd-9ede-2e3af4c5316d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.644789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5511c1f-3a25-44cd-9ede-2e3af4c5316d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.758432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d98bef06-b5bb-40a5-a8a2-8f5b4a5e223e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:54.759954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d98bef06-b5bb-40a5-a8a2-8f5b4a5e223e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:54.767274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98bef06-b5bb-40a5-a8a2-8f5b4a5e223e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.768099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98bef06-b5bb-40a5-a8a2-8f5b4a5e223e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.768710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98bef06-b5bb-40a5-a8a2-8f5b4a5e223e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.769614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98bef06-b5bb-40a5-a8a2-8f5b4a5e223e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.770238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98bef06-b5bb-40a5-a8a2-8f5b4a5e223e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.770934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d98bef06-b5bb-40a5-a8a2-8f5b4a5e223e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.067426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5511c1f-3a25-44cd-9ede-2e3af4c5316d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:55.074367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d98bef06-b5bb-40a5-a8a2-8f5b4a5e223e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:55.083858 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5511c1f-3a25-44cd-9ede-2e3af4c5316d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1509 microversion: 2.1 time: 0.456814 Oct 04 18:21:55.085242 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d98bef06-b5bb-40a5-a8a2-8f5b4a5e223e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.331214 Oct 04 18:21:55.086858 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2372/4735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:54 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:55.091563 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2364/4736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:54 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1509 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:55.106611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a0d5241f-7847-48d5-b1ae-4e3fe37079a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.107399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a0d5241f-7847-48d5-b1ae-4e3fe37079a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:55.115030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5241f-7847-48d5-b1ae-4e3fe37079a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.115556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5241f-7847-48d5-b1ae-4e3fe37079a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.116010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5241f-7847-48d5-b1ae-4e3fe37079a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.116730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5241f-7847-48d5-b1ae-4e3fe37079a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.117743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5241f-7847-48d5-b1ae-4e3fe37079a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.118366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5241f-7847-48d5-b1ae-4e3fe37079a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.145520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a0d5241f-7847-48d5-b1ae-4e3fe37079a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:55.149868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:55.242865 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a0d5241f-7847-48d5-b1ae-4e3fe37079a1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 204 len: 0 microversion: 2.1 time: 0.139333 Oct 04 18:21:55.243749 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2373/4737] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:55 2022] DELETE /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:55.250634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9f084b31-ffe0-4251-85a1-fdb10cb08526 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.251739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9f084b31-ffe0-4251-85a1-fdb10cb08526 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:55.263219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f084b31-ffe0-4251-85a1-fdb10cb08526 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.263777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f724d33-de84-48e8-bb22-15976393e09b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.264708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2f724d33-de84-48e8-bb22-15976393e09b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:55.266241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f084b31-ffe0-4251-85a1-fdb10cb08526 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.268057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f084b31-ffe0-4251-85a1-fdb10cb08526 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.270318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f084b31-ffe0-4251-85a1-fdb10cb08526 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.270939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f084b31-ffe0-4251-85a1-fdb10cb08526 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.272040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f084b31-ffe0-4251-85a1-fdb10cb08526 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.273057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f724d33-de84-48e8-bb22-15976393e09b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.273770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f724d33-de84-48e8-bb22-15976393e09b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.274370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f724d33-de84-48e8-bb22-15976393e09b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.275282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f724d33-de84-48e8-bb22-15976393e09b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.275896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f724d33-de84-48e8-bb22-15976393e09b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.276626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f724d33-de84-48e8-bb22-15976393e09b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.372493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9f084b31-ffe0-4251-85a1-fdb10cb08526 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:55.382924 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9f084b31-ffe0-4251-85a1-fdb10cb08526 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1297 microversion: 2.1 time: 0.136827 Oct 04 18:21:55.395804 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2365/4738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:55 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1297 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:55.475880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2f724d33-de84-48e8-bb22-15976393e09b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:55.485710 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2f724d33-de84-48e8-bb22-15976393e09b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1515 microversion: 2.1 time: 0.226477 Oct 04 18:21:55.491013 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2374/4739] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:55 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:56.111764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9ce0d042-bd2c-4b02-85e4-c86980f5e367 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:56.113049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9ce0d042-bd2c-4b02-85e4-c86980f5e367 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:56.130780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce0d042-bd2c-4b02-85e4-c86980f5e367 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.132184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce0d042-bd2c-4b02-85e4-c86980f5e367 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.132671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce0d042-bd2c-4b02-85e4-c86980f5e367 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.136618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce0d042-bd2c-4b02-85e4-c86980f5e367 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.137315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce0d042-bd2c-4b02-85e4-c86980f5e367 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.139958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce0d042-bd2c-4b02-85e4-c86980f5e367 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.350356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9ce0d042-bd2c-4b02-85e4-c86980f5e367 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:56.365680 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9ce0d042-bd2c-4b02-85e4-c86980f5e367 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.258102 Oct 04 18:21:56.379195 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2366/4740] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:56 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:56.407745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-76175df2-dfa7-4ef4-8032-9af0312239df tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:56.408366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-76175df2-dfa7-4ef4-8032-9af0312239df tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:56.470225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76175df2-dfa7-4ef4-8032-9af0312239df tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.472958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76175df2-dfa7-4ef4-8032-9af0312239df tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.476288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76175df2-dfa7-4ef4-8032-9af0312239df tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.495417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76175df2-dfa7-4ef4-8032-9af0312239df tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.501426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76175df2-dfa7-4ef4-8032-9af0312239df tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.502016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76175df2-dfa7-4ef4-8032-9af0312239df tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.509828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6f4162c0-dc37-47c1-a6f7-a4a57159d6f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:56.510443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6f4162c0-dc37-47c1-a6f7-a4a57159d6f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:56.528425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4162c0-dc37-47c1-a6f7-a4a57159d6f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.528915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4162c0-dc37-47c1-a6f7-a4a57159d6f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.529359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4162c0-dc37-47c1-a6f7-a4a57159d6f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.530076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4162c0-dc37-47c1-a6f7-a4a57159d6f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.530530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4162c0-dc37-47c1-a6f7-a4a57159d6f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.530993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4162c0-dc37-47c1-a6f7-a4a57159d6f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.650006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-76175df2-dfa7-4ef4-8032-9af0312239df tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:56.661282 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-76175df2-dfa7-4ef4-8032-9af0312239df tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1297 microversion: 2.1 time: 0.257563 Oct 04 18:21:56.669077 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2375/4741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:56 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1297 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:56.820265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6f4162c0-dc37-47c1-a6f7-a4a57159d6f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:56.831080 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6f4162c0-dc37-47c1-a6f7-a4a57159d6f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1515 microversion: 2.1 time: 0.325190 Oct 04 18:21:56.832278 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2367/4742] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:56 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1515 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:57.389528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c793f504-22ec-4d30-8064-7234c00ff92f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:57.390170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c793f504-22ec-4d30-8064-7234c00ff92f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:57.408958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c793f504-22ec-4d30-8064-7234c00ff92f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.409583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c793f504-22ec-4d30-8064-7234c00ff92f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.409915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c793f504-22ec-4d30-8064-7234c00ff92f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.412623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c793f504-22ec-4d30-8064-7234c00ff92f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.415449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c793f504-22ec-4d30-8064-7234c00ff92f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.418017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c793f504-22ec-4d30-8064-7234c00ff92f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.704744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7fb722ef-4836-4fd6-87be-4a736b230476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:57.706091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7fb722ef-4836-4fd6-87be-4a736b230476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:57.729732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fb722ef-4836-4fd6-87be-4a736b230476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.730368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fb722ef-4836-4fd6-87be-4a736b230476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.730798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fb722ef-4836-4fd6-87be-4a736b230476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.731556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fb722ef-4836-4fd6-87be-4a736b230476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.737322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fb722ef-4836-4fd6-87be-4a736b230476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.742753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7fb722ef-4836-4fd6-87be-4a736b230476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.874101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:58.025530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7fb722ef-4836-4fd6-87be-4a736b230476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:58.043295 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7fb722ef-4836-4fd6-87be-4a736b230476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1297 microversion: 2.1 time: 0.342842 Oct 04 18:21:58.046670 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2368/4743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:57 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1297 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:58.055432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c793f504-22ec-4d30-8064-7234c00ff92f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:58.063355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78d05532-4d7c-4bec-9b8e-cb8ed34f840b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:58.065554 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c793f504-22ec-4d30-8064-7234c00ff92f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.679858 Oct 04 18:21:58.066406 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2376/4744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:57 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:58.066907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78d05532-4d7c-4bec-9b8e-cb8ed34f840b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:58.084584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78d05532-4d7c-4bec-9b8e-cb8ed34f840b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.092275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78d05532-4d7c-4bec-9b8e-cb8ed34f840b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.093577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78d05532-4d7c-4bec-9b8e-cb8ed34f840b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.094676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78d05532-4d7c-4bec-9b8e-cb8ed34f840b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.095395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78d05532-4d7c-4bec-9b8e-cb8ed34f840b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.096041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78d05532-4d7c-4bec-9b8e-cb8ed34f840b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.104090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:58.440779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78d05532-4d7c-4bec-9b8e-cb8ed34f840b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:58.457132 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78d05532-4d7c-4bec-9b8e-cb8ed34f840b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1515 microversion: 2.1 time: 0.402888 Oct 04 18:21:58.461428 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2369/4745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:58 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1515 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:58.508452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1765526406", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": "none"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:58.634313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:58.634765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:58.635282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:58.635702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:58.636227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:58.654873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.655463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.656014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.657345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.657817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.658301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.707335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Getting quotas for project 8067b1329b1a48d4a9e45c2fcabd5ddd. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:58.725043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Getting quotas for user f568dfc78f354fbba444302130d1bba0 and project 8067b1329b1a48d4a9e45c2fcabd5ddd. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:58.759733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:58.762518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:58.793595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:58.912754 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-49049788-b6ef-4332-9db3-633aa905a8c1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.709411 Oct 04 18:21:58.914608 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2377/4746] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:21:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:21:58.941022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3439ee98-03a6-41a4-bf5b-8a793b6b9914 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:58.942165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3439ee98-03a6-41a4-bf5b-8a793b6b9914 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:59.076201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-46243305-cc24-4a3a-9af3-29d82bd3face tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.077085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-46243305-cc24-4a3a-9af3-29d82bd3face tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:59.090366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46243305-cc24-4a3a-9af3-29d82bd3face tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.091293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46243305-cc24-4a3a-9af3-29d82bd3face tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.092199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46243305-cc24-4a3a-9af3-29d82bd3face tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.093159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46243305-cc24-4a3a-9af3-29d82bd3face tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.097400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46243305-cc24-4a3a-9af3-29d82bd3face tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.098088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46243305-cc24-4a3a-9af3-29d82bd3face tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.386497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3439ee98-03a6-41a4-bf5b-8a793b6b9914 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:59.403155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3439ee98-03a6-41a4-bf5b-8a793b6b9914 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:59.404807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3439ee98-03a6-41a4-bf5b-8a793b6b9914 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:59.419563 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3439ee98-03a6-41a4-bf5b-8a793b6b9914 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468" status: 200 len: 1278 microversion: 2.47 time: 0.486686 Oct 04 18:21:59.432103 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2370/4747] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:21:58 2022] GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 => generated 1278 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:21:59.457862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2fc8774-dc41-469b-b40b-dd72bfde9cd2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.463395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2fc8774-dc41-469b-b40b-dd72bfde9cd2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:59.495285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2fc8774-dc41-469b-b40b-dd72bfde9cd2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.503383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2fc8774-dc41-469b-b40b-dd72bfde9cd2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.504882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2fc8774-dc41-469b-b40b-dd72bfde9cd2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.507093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2fc8774-dc41-469b-b40b-dd72bfde9cd2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.511641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2fc8774-dc41-469b-b40b-dd72bfde9cd2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.513205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2fc8774-dc41-469b-b40b-dd72bfde9cd2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.540136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-46243305-cc24-4a3a-9af3-29d82bd3face tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:59.553234 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-46243305-cc24-4a3a-9af3-29d82bd3face tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1297 microversion: 2.1 time: 0.484170 Oct 04 18:21:59.565759 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2378/4748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1297 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:59.565759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.565759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:59.626983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.655106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.657031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.660250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.662465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.665105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.774034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.774552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.775082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.775736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lazy-loading 'fault' on Instance uuid 49466338-d6de-477e-a4a6-050f58898810 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:59.868394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:59.898015 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b773e210-dd0b-439a-a998-4725c2b18d40 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 200 len: 1317 microversion: 2.1 time: 0.337760 Oct 04 18:21:59.898606 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2379/4749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:59.922314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fc3b3892-3c4d-4aa1-8352-cd155b9d6705 req-cc9bf43b-9b3f-4fe6-a576-63518847882d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49466338-d6de-477e-a4a6-050f58898810", "name": "network-vif-deleted", "tag": "92b99760-d297-4423-9b88-ef1e10be8857"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:59.987985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fc3b3892-3c4d-4aa1-8352-cd155b9d6705 req-cc9bf43b-9b3f-4fe6-a576-63518847882d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.988973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fc3b3892-3c4d-4aa1-8352-cd155b9d6705 req-cc9bf43b-9b3f-4fe6-a576-63518847882d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.991154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fc3b3892-3c4d-4aa1-8352-cd155b9d6705 req-cc9bf43b-9b3f-4fe6-a576-63518847882d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.001360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2fc8774-dc41-469b-b40b-dd72bfde9cd2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:00.013959 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2fc8774-dc41-469b-b40b-dd72bfde9cd2 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.580389 Oct 04 18:22:00.018341 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2371/4750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:00.041503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-925121429", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": "none"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:00.042156 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fc3b3892-3c4d-4aa1-8352-cd155b9d6705 req-cc9bf43b-9b3f-4fe6-a576-63518847882d service nova] Creating event network-vif-deleted:92b99760-d297-4423-9b88-ef1e10be8857 for instance 49466338-d6de-477e-a4a6-050f58898810 on n-h2-850499-14 Oct 04 18:22:00.053284 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fc3b3892-3c4d-4aa1-8352-cd155b9d6705 req-cc9bf43b-9b3f-4fe6-a576-63518847882d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153402 Oct 04 18:22:00.055292 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2380/4751] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:00.141603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:00.142518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:00.143235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:00.144478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:00.145127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:00.157471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.159413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.160035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.161130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.161782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.162613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.198933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Getting quotas for project 8067b1329b1a48d4a9e45c2fcabd5ddd. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:00.206814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Getting quotas for user f568dfc78f354fbba444302130d1bba0 and project 8067b1329b1a48d4a9e45c2fcabd5ddd. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:00.224860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:00.229205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:00.297041 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0cfd2a13-c009-40e8-b9e7-5b8d1d7569f6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.277164 Oct 04 18:22:00.299280 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2372/4752] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:22:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:22:00.318750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a6478e4-6fad-4b06-83c8-1ec35a8a7563 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:00.321976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8a6478e4-6fad-4b06-83c8-1ec35a8a7563 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:00.383036 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a6478e4-6fad-4b06-83c8-1ec35a8a7563 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "PUT /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 991 microversion: 2.47 time: 0.073070 Oct 04 18:22:00.385042 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2381/4753] 10.222.0.18 () {62 vars in 1297 bytes} [Tue Oct 4 18:22:00 2022] PUT /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:00.409348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-88e37d80-e718-4d3d-89a3-d38c93634a55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:00.410132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-88e37d80-e718-4d3d-89a3-d38c93634a55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:00.490104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-88e37d80-e718-4d3d-89a3-d38c93634a55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:00.534900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-88e37d80-e718-4d3d-89a3-d38c93634a55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:00.540777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-88e37d80-e718-4d3d-89a3-d38c93634a55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:00.545464 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-88e37d80-e718-4d3d-89a3-d38c93634a55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1277 microversion: 2.47 time: 0.140133 Oct 04 18:22:00.567179 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2373/4754] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:00 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:00.593143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2135b891-9c39-463e-931a-83fa6cd36cb9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:00.594714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2135b891-9c39-463e-931a-83fa6cd36cb9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:00.610077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2135b891-9c39-463e-931a-83fa6cd36cb9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.610619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2135b891-9c39-463e-931a-83fa6cd36cb9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.611089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2135b891-9c39-463e-931a-83fa6cd36cb9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.613454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2135b891-9c39-463e-931a-83fa6cd36cb9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.617325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2135b891-9c39-463e-931a-83fa6cd36cb9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.621038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2135b891-9c39-463e-931a-83fa6cd36cb9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.922515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:00.923698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:00.940334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.944285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.944757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.950671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.951234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.951700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.996240 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 HTTP/1.1 Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '49466338-d6de-477e-a4a6-050f58898810'} Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:00.998305 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:01.003497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:01.003497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:01.003497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:01.003497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:01.003497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:22:01.003497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:01.003497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:01.003497 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f0c90ddf-e9a6-4e08-bb21-7ba909d6c64e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 404 len: 111 microversion: 2.1 time: 0.081424 Oct 04 18:22:01.003497 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2374/4755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:00 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:01.009680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4abef753-fc70-4304-bcec-119c407b8139 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '.version_select at 0x7fd4d615bc10>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:01.034655 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4abef753-fc70-4304-bcec-119c407b8139 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-key-1202317906" status: 202 len: 0 microversion: 2.1 time: 0.029035 Oct 04 18:22:01.035730 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2375/4756] 10.222.0.18 () {58 vars in 1209 bytes} [Tue Oct 4 18:22:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1202317906 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:22:01.049312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-795ffd2d-d693-4729-bdd1-56548abd5d68 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:01.049312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-795ffd2d-d693-4729-bdd1-56548abd5d68 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:01.062277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795ffd2d-d693-4729-bdd1-56548abd5d68 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.062510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795ffd2d-d693-4729-bdd1-56548abd5d68 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.062945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795ffd2d-d693-4729-bdd1-56548abd5d68 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.068494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795ffd2d-d693-4729-bdd1-56548abd5d68 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.068989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795ffd2d-d693-4729-bdd1-56548abd5d68 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.069434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795ffd2d-d693-4729-bdd1-56548abd5d68 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.207092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2135b891-9c39-463e-931a-83fa6cd36cb9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.219967 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2135b891-9c39-463e-931a-83fa6cd36cb9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.630725 Oct 04 18:22:01.221307 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2382/4757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:00 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:01.227186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:01.228190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:01.236226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.236807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.237530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.238331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.239023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.240357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.572137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-795ffd2d-d693-4729-bdd1-56548abd5d68 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.581294 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-795ffd2d-d693-4729-bdd1-56548abd5d68 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.536665 Oct 04 18:22:01.582321 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2376/4758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:01 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:01.587513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-105365941", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "5be520db-1d2d-4d71-923d-9d8728cd44bc"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:01.670267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] validate_networks() for [('5be520db-1d2d-4d71-923d-9d8728cd44bc', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:01.768018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.785203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.786669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.788191 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d758ea8e-eec5-4396-92a4-39a9c9ed8744 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2952 microversion: 2.42 time: 0.565704 Oct 04 18:22:01.788840 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2383/4759] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:01 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2952 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:01.793878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:01.794706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:01.800836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.801335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.801966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.802683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.803243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.803617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.947052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.967274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.971140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.981723 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-33967c2a-d4f7-43c9-b6c9-6d9f94d2fe23 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1273 microversion: 2.47 time: 0.182461 Oct 04 18:22:01.994991 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2384/4760] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:01 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:01.994991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e1ff5eb6-4fc6-4024-98ab-180fc605e5cc req-3549dd09-3e2c-4f32-97d7-0aea60e01e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1681ab-db4a-4528-99da-649ffa9a93a0", "tag": "2d48ba84-42ef-46d1-b6ba-69e426d07f1c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:02.030446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e1ff5eb6-4fc6-4024-98ab-180fc605e5cc req-3549dd09-3e2c-4f32-97d7-0aea60e01e5c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.031122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e1ff5eb6-4fc6-4024-98ab-180fc605e5cc req-3549dd09-3e2c-4f32-97d7-0aea60e01e5c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.034332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e1ff5eb6-4fc6-4024-98ab-180fc605e5cc req-3549dd09-3e2c-4f32-97d7-0aea60e01e5c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.050523 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e1ff5eb6-4fc6-4024-98ab-180fc605e5cc req-3549dd09-3e2c-4f32-97d7-0aea60e01e5c service nova] Creating event network-changed:2d48ba84-42ef-46d1-b6ba-69e426d07f1c for instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 on n-h2-850499-14 Oct 04 18:22:02.059435 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e1ff5eb6-4fc6-4024-98ab-180fc605e5cc req-3549dd09-3e2c-4f32-97d7-0aea60e01e5c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074957 Oct 04 18:22:02.060492 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2385/4761] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:02.066249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-497312e8-a111-4aaa-84e2-339ccce9b561 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.066947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-497312e8-a111-4aaa-84e2-339ccce9b561 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.074576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497312e8-a111-4aaa-84e2-339ccce9b561 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.075252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497312e8-a111-4aaa-84e2-339ccce9b561 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.075818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497312e8-a111-4aaa-84e2-339ccce9b561 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.076621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497312e8-a111-4aaa-84e2-339ccce9b561 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.077317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497312e8-a111-4aaa-84e2-339ccce9b561 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.077951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-497312e8-a111-4aaa-84e2-339ccce9b561 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.301576 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-497312e8-a111-4aaa-84e2-339ccce9b561 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.239742 Oct 04 18:22:02.302183 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2386/4762] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e/os-interface => generated 1831 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:02.318669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2710aefa-10d5-40d8-ac54-baace0dd7781 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.320578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2710aefa-10d5-40d8-ac54-baace0dd7781 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.328092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2710aefa-10d5-40d8-ac54-baace0dd7781 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.329186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2710aefa-10d5-40d8-ac54-baace0dd7781 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.329967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2710aefa-10d5-40d8-ac54-baace0dd7781 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.331063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2710aefa-10d5-40d8-ac54-baace0dd7781 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.331881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2710aefa-10d5-40d8-ac54-baace0dd7781 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.333132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2710aefa-10d5-40d8-ac54-baace0dd7781 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.725121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2710aefa-10d5-40d8-ac54-baace0dd7781 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:02.735123 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2710aefa-10d5-40d8-ac54-baace0dd7781 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.431517 Oct 04 18:22:02.736158 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2387/4763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:02.742267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-215547e4-a27f-4170-854f-748760b4386c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.743459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-215547e4-a27f-4170-854f-748760b4386c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.751602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-215547e4-a27f-4170-854f-748760b4386c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.752781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-215547e4-a27f-4170-854f-748760b4386c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.753676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-215547e4-a27f-4170-854f-748760b4386c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.754789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-215547e4-a27f-4170-854f-748760b4386c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.755551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-215547e4-a27f-4170-854f-748760b4386c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.756202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-215547e4-a27f-4170-854f-748760b4386c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.300411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:03.300966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:03.301597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:03.302094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:03.303869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:03.328732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.352818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.355403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.356681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.357543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.358313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.436479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:03.464143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:03.467428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for user 41e49c77352541cb94dcd12277f7ee67 and project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:03.548933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:03.557870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:03.609023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-215547e4-a27f-4170-854f-748760b4386c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:03.634813 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-215547e4-a27f-4170-854f-748760b4386c tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1486 microversion: 2.1 time: 0.896273 Oct 04 18:22:03.644201 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2388/4764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1486 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:03.684402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:03.685027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:03.723295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.735051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.736775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.737480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.737990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.738448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.808353 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-efc35474-4a75-4e1c-a449-d4dcad924853 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.224636 Oct 04 18:22:03.826978 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2377/4765] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:03.844387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9dc19782-d18f-47c7-8e11-4e8ddd442b1f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:03.844729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9dc19782-d18f-47c7-8e11-4e8ddd442b1f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:03.876861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc19782-d18f-47c7-8e11-4e8ddd442b1f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.883513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc19782-d18f-47c7-8e11-4e8ddd442b1f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.884014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc19782-d18f-47c7-8e11-4e8ddd442b1f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.884793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc19782-d18f-47c7-8e11-4e8ddd442b1f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.885369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc19782-d18f-47c7-8e11-4e8ddd442b1f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.885815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9dc19782-d18f-47c7-8e11-4e8ddd442b1f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.025779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.049246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.057109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.059188 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-61c16934-ba60-466e-8374-d346a12e862d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1347 microversion: 2.47 time: 0.413835 Oct 04 18:22:04.076499 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2389/4766] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:03 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1347 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:04.098071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a61a643-81c7-4e4e-8299-cdcca3a56967 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:04.100366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a61a643-81c7-4e4e-8299-cdcca3a56967 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:04.117109 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9dc19782-d18f-47c7-8e11-4e8ddd442b1f tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "POST /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4/action" status: 202 len: 0 microversion: 2.1 time: 0.288195 Oct 04 18:22:04.117539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a61a643-81c7-4e4e-8299-cdcca3a56967 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.118704 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2378/4767] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:22:03 2022] POST /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:22:04.119727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a61a643-81c7-4e4e-8299-cdcca3a56967 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.121372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a61a643-81c7-4e4e-8299-cdcca3a56967 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.123569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a61a643-81c7-4e4e-8299-cdcca3a56967 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.126366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a61a643-81c7-4e4e-8299-cdcca3a56967 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.127027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a61a643-81c7-4e4e-8299-cdcca3a56967 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.135959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ba8509fc-e080-4ae8-8349-4e7b3ef727a0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:04.136749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ba8509fc-e080-4ae8-8349-4e7b3ef727a0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:04.289206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ba8509fc-e080-4ae8-8349-4e7b3ef727a0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.301391 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ba8509fc-e080-4ae8-8349-4e7b3ef727a0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1208 microversion: 2.1 time: 0.175525 Oct 04 18:22:04.318893 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2379/4768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:04 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1208 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:04.324972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c751dc48-a92b-4028-9a2d-41271e54fc32 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:04.325776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c751dc48-a92b-4028-9a2d-41271e54fc32 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:04.346751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c751dc48-a92b-4028-9a2d-41271e54fc32 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.347390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c751dc48-a92b-4028-9a2d-41271e54fc32 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.347852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c751dc48-a92b-4028-9a2d-41271e54fc32 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.349834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c751dc48-a92b-4028-9a2d-41271e54fc32 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.350316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c751dc48-a92b-4028-9a2d-41271e54fc32 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.350760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c751dc48-a92b-4028-9a2d-41271e54fc32 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.575646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a61a643-81c7-4e4e-8299-cdcca3a56967 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.589169 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a61a643-81c7-4e4e-8299-cdcca3a56967 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.504188 Oct 04 18:22:04.589779 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2390/4769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:04 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:04.667443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c751dc48-a92b-4028-9a2d-41271e54fc32 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.684906 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c751dc48-a92b-4028-9a2d-41271e54fc32 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1494 microversion: 2.1 time: 0.363634 Oct 04 18:22:04.688850 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2380/4770] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:04 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1494 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:05.094141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:05.094924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:05.110436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.111126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.111730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.112602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.114436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.115007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.254921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:05.262360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:05.267688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:05.271283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:05.277070 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01fa6bb0-cb9b-4c50-b378-ff3e1692e994 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1347 microversion: 2.47 time: 0.187371 Oct 04 18:22:05.281380 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2391/4771] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:05 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1347 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:05.325627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3544a1ce-f1c6-4e9e-9c17-d862c5a7bf1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:05.326670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3544a1ce-f1c6-4e9e-9c17-d862c5a7bf1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:05.342272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3544a1ce-f1c6-4e9e-9c17-d862c5a7bf1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.345448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3544a1ce-f1c6-4e9e-9c17-d862c5a7bf1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.347575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3544a1ce-f1c6-4e9e-9c17-d862c5a7bf1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.352011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3544a1ce-f1c6-4e9e-9c17-d862c5a7bf1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.352989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3544a1ce-f1c6-4e9e-9c17-d862c5a7bf1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.353761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3544a1ce-f1c6-4e9e-9c17-d862c5a7bf1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.539870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3544a1ce-f1c6-4e9e-9c17-d862c5a7bf1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:05.552872 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3544a1ce-f1c6-4e9e-9c17-d862c5a7bf1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1204 microversion: 2.1 time: 0.231061 Oct 04 18:22:05.554613 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2381/4772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:05 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1204 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:05.614861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4f1abaa0-6f3f-416a-8653-7a16d430ce5b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:05.615756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4f1abaa0-6f3f-416a-8653-7a16d430ce5b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:05.625398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1abaa0-6f3f-416a-8653-7a16d430ce5b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.626122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1abaa0-6f3f-416a-8653-7a16d430ce5b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.626863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1abaa0-6f3f-416a-8653-7a16d430ce5b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.628120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1abaa0-6f3f-416a-8653-7a16d430ce5b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.628858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1abaa0-6f3f-416a-8653-7a16d430ce5b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.629536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1abaa0-6f3f-416a-8653-7a16d430ce5b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.712343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0cd96eb8-1b8d-41d8-96d7-4a70bb5f3239 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:05.713720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0cd96eb8-1b8d-41d8-96d7-4a70bb5f3239 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:05.722421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cd96eb8-1b8d-41d8-96d7-4a70bb5f3239 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.723737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cd96eb8-1b8d-41d8-96d7-4a70bb5f3239 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.724448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cd96eb8-1b8d-41d8-96d7-4a70bb5f3239 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.725408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cd96eb8-1b8d-41d8-96d7-4a70bb5f3239 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.726167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cd96eb8-1b8d-41d8-96d7-4a70bb5f3239 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.726841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cd96eb8-1b8d-41d8-96d7-4a70bb5f3239 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.233685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4f1abaa0-6f3f-416a-8653-7a16d430ce5b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:06.242464 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4f1abaa0-6f3f-416a-8653-7a16d430ce5b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.631865 Oct 04 18:22:06.245610 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2392/4773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:05 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:06.269945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0cd96eb8-1b8d-41d8-96d7-4a70bb5f3239 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:06.287738 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0cd96eb8-1b8d-41d8-96d7-4a70bb5f3239 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1494 microversion: 2.1 time: 0.581264 Oct 04 18:22:06.288791 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2382/4774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:05 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1494 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:06.310284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:06.311367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:06.318947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.320123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.320646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.323100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.324080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.325663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.586617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ffb5efa7-aa78-49bb-8fe3-738a8622ebfe tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:06.587135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ffb5efa7-aa78-49bb-8fe3-738a8622ebfe tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:06.594122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffb5efa7-aa78-49bb-8fe3-738a8622ebfe tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.594690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffb5efa7-aa78-49bb-8fe3-738a8622ebfe tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.595742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffb5efa7-aa78-49bb-8fe3-738a8622ebfe tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.596341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:06.597399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffb5efa7-aa78-49bb-8fe3-738a8622ebfe tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.598680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffb5efa7-aa78-49bb-8fe3-738a8622ebfe tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.599518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffb5efa7-aa78-49bb-8fe3-738a8622ebfe tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.609762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:06.611344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:06.614450 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9e824687-4f4d-4fae-a47f-0f74e91586dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1335 microversion: 2.47 time: 0.308064 Oct 04 18:22:06.621394 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2393/4775] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:06 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1335 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:06.703137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ffb5efa7-aa78-49bb-8fe3-738a8622ebfe tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:06.710925 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ffb5efa7-aa78-49bb-8fe3-738a8622ebfe tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1260 microversion: 2.1 time: 0.137329 Oct 04 18:22:06.712050 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2383/4776] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:06 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1260 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:07.274030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f0e8f40-3fa9-4667-bc8e-a4738a8792d8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:07.275293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f0e8f40-3fa9-4667-bc8e-a4738a8792d8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:07.283039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e8f40-3fa9-4667-bc8e-a4738a8792d8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.283763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e8f40-3fa9-4667-bc8e-a4738a8792d8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.284406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e8f40-3fa9-4667-bc8e-a4738a8792d8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.285490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e8f40-3fa9-4667-bc8e-a4738a8792d8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.287071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e8f40-3fa9-4667-bc8e-a4738a8792d8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.287790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e8f40-3fa9-4667-bc8e-a4738a8792d8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.313916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ea8fff8-1559-4c6a-aa55-640db177bdb1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:07.314546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ea8fff8-1559-4c6a-aa55-640db177bdb1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:07.324143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ea8fff8-1559-4c6a-aa55-640db177bdb1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.324588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ea8fff8-1559-4c6a-aa55-640db177bdb1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.325038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ea8fff8-1559-4c6a-aa55-640db177bdb1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.325749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ea8fff8-1559-4c6a-aa55-640db177bdb1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.326337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ea8fff8-1559-4c6a-aa55-640db177bdb1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.326642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ea8fff8-1559-4c6a-aa55-640db177bdb1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.618537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f0e8f40-3fa9-4667-bc8e-a4738a8792d8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.631616 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f0e8f40-3fa9-4667-bc8e-a4738a8792d8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.363125 Oct 04 18:22:07.632507 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2394/4777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:07 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:07.657972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ea8fff8-1559-4c6a-aa55-640db177bdb1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.663688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:07.664558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:07.669180 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ea8fff8-1559-4c6a-aa55-640db177bdb1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1494 microversion: 2.1 time: 0.359405 Oct 04 18:22:07.676126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.676599 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2384/4778] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:07 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1494 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:07.677280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.677890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.678800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.679960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.680573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.735914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a20d0b39-f292-4dc3-9f65-7df08118227e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:07.737784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a20d0b39-f292-4dc3-9f65-7df08118227e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:07.745834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20d0b39-f292-4dc3-9f65-7df08118227e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.753432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.761350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20d0b39-f292-4dc3-9f65-7df08118227e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.762525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.763269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20d0b39-f292-4dc3-9f65-7df08118227e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.764036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.765212 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be9081a2-1dbc-4a7e-a238-f9a260f7e070 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1335 microversion: 2.47 time: 0.113020 Oct 04 18:22:07.769409 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2395/4779] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:07 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1335 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:07.769658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20d0b39-f292-4dc3-9f65-7df08118227e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.770785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20d0b39-f292-4dc3-9f65-7df08118227e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.771855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a20d0b39-f292-4dc3-9f65-7df08118227e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.889167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a20d0b39-f292-4dc3-9f65-7df08118227e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.901501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a20d0b39-f292-4dc3-9f65-7df08118227e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1268 microversion: 2.1 time: 0.171039 Oct 04 18:22:07.902094 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2385/4780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:07 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:08.657346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6b3d20bf-5952-4c61-9159-3e7aa337cfbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:08.658703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6b3d20bf-5952-4c61-9159-3e7aa337cfbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:08.669783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b3d20bf-5952-4c61-9159-3e7aa337cfbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.670520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b3d20bf-5952-4c61-9159-3e7aa337cfbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.671350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b3d20bf-5952-4c61-9159-3e7aa337cfbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.672701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b3d20bf-5952-4c61-9159-3e7aa337cfbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.673518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b3d20bf-5952-4c61-9159-3e7aa337cfbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.674189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b3d20bf-5952-4c61-9159-3e7aa337cfbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.697723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-537426b8-7790-4216-9340-689cbec32c92 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:08.699185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-537426b8-7790-4216-9340-689cbec32c92 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:08.707990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-537426b8-7790-4216-9340-689cbec32c92 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.712655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:08.715833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-537426b8-7790-4216-9340-689cbec32c92 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.718298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-537426b8-7790-4216-9340-689cbec32c92 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.719971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-537426b8-7790-4216-9340-689cbec32c92 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.722619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-537426b8-7790-4216-9340-689cbec32c92 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.723312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-537426b8-7790-4216-9340-689cbec32c92 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.742608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=14 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:09.048218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6b3d20bf-5952-4c61-9159-3e7aa337cfbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:09.062985 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6b3d20bf-5952-4c61-9159-3e7aa337cfbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.409980 Oct 04 18:22:09.064306 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2396/4781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:08 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:09.074313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.077356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.085393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.087972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.088646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.090228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.091383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.092198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.128642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-537426b8-7790-4216-9340-689cbec32c92 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:09.144969 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-537426b8-7790-4216-9340-689cbec32c92 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1500 microversion: 2.1 time: 0.449948 Oct 04 18:22:09.145868 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2386/4782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:08 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1500 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:09.161340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-32bd7fae-d0b5-42e7-ad6c-96592502040d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.163845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-32bd7fae-d0b5-42e7-ad6c-96592502040d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.194895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32bd7fae-d0b5-42e7-ad6c-96592502040d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.198060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32bd7fae-d0b5-42e7-ad6c-96592502040d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.198746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32bd7fae-d0b5-42e7-ad6c-96592502040d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.200566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32bd7fae-d0b5-42e7-ad6c-96592502040d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.202163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32bd7fae-d0b5-42e7-ad6c-96592502040d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.204728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32bd7fae-d0b5-42e7-ad6c-96592502040d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.419150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:09.433974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:09.438989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:09.441575 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-98dfdfd2-9cb9-4ace-b0db-73dd0aaa3bca tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1335 microversion: 2.47 time: 0.376135 Oct 04 18:22:09.443154 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2397/4783] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:09 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1335 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:09.448818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80633aa4-b0f9-4656-946e-c6b396670cfe tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.457303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80633aa4-b0f9-4656-946e-c6b396670cfe tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.468701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80633aa4-b0f9-4656-946e-c6b396670cfe tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.469861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80633aa4-b0f9-4656-946e-c6b396670cfe tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.470528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80633aa4-b0f9-4656-946e-c6b396670cfe tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.471694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80633aa4-b0f9-4656-946e-c6b396670cfe tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.472648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80633aa4-b0f9-4656-946e-c6b396670cfe tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.473305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80633aa4-b0f9-4656-946e-c6b396670cfe tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.520372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80633aa4-b0f9-4656-946e-c6b396670cfe tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:09.654651 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-80633aa4-b0f9-4656-946e-c6b396670cfe tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "DELETE /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 204 len: 0 microversion: 2.1 time: 0.208013 Oct 04 18:22:09.655317 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2398/4784] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:22:09 2022] DELETE /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:22:09.667830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20512c5a-240a-41ea-9651-2edba76a97b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.669160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20512c5a-240a-41ea-9651-2edba76a97b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.682547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20512c5a-240a-41ea-9651-2edba76a97b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.683201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20512c5a-240a-41ea-9651-2edba76a97b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.683836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20512c5a-240a-41ea-9651-2edba76a97b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.684949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20512c5a-240a-41ea-9651-2edba76a97b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.685682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20512c5a-240a-41ea-9651-2edba76a97b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.686329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20512c5a-240a-41ea-9651-2edba76a97b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.687591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-32bd7fae-d0b5-42e7-ad6c-96592502040d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:09.699129 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-32bd7fae-d0b5-42e7-ad6c-96592502040d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1308 microversion: 2.1 time: 0.550451 Oct 04 18:22:09.699728 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2387/4785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:09 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:09.969696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-20512c5a-240a-41ea-9651-2edba76a97b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:09.982740 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20512c5a-240a-41ea-9651-2edba76a97b6 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.321368 Oct 04 18:22:09.984372 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2399/4786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:09 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:10.088768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c6c3cf8d-69b4-465d-8904-81ba168587f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:10.089819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c6c3cf8d-69b4-465d-8904-81ba168587f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:10.098306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6c3cf8d-69b4-465d-8904-81ba168587f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.099053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6c3cf8d-69b4-465d-8904-81ba168587f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.099836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6c3cf8d-69b4-465d-8904-81ba168587f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.100452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6c3cf8d-69b4-465d-8904-81ba168587f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.101182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6c3cf8d-69b4-465d-8904-81ba168587f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.101812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6c3cf8d-69b4-465d-8904-81ba168587f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.336473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c6c3cf8d-69b4-465d-8904-81ba168587f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.350469 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c6c3cf8d-69b4-465d-8904-81ba168587f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.266583 Oct 04 18:22:10.363065 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2388/4787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:10 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:10.470112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:10.470733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:10.479768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.483421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.484309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.485053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.485525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.485955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.570426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.587028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.589867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.591206 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce17bfc2-5428-48bc-8a2c-1a6a72f8efdb tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1335 microversion: 2.47 time: 0.125349 Oct 04 18:22:10.592124 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2400/4788] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:10 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1335 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:10.730498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-93672667-fb20-48f6-aa64-384204312915 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:10.731255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-93672667-fb20-48f6-aa64-384204312915 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:10.740681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93672667-fb20-48f6-aa64-384204312915 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.747363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93672667-fb20-48f6-aa64-384204312915 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.747900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93672667-fb20-48f6-aa64-384204312915 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.748652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93672667-fb20-48f6-aa64-384204312915 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.749120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93672667-fb20-48f6-aa64-384204312915 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.749552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93672667-fb20-48f6-aa64-384204312915 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.089735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-93672667-fb20-48f6-aa64-384204312915 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:11.108273 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-93672667-fb20-48f6-aa64-384204312915 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1308 microversion: 2.1 time: 0.386114 Oct 04 18:22:11.111884 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2389/4789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:10 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:11.125421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-15dcf35f-485a-4629-af04-dc939e5c238a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:11.126340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-15dcf35f-485a-4629-af04-dc939e5c238a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:11.143013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15dcf35f-485a-4629-af04-dc939e5c238a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.144674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15dcf35f-485a-4629-af04-dc939e5c238a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.145955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15dcf35f-485a-4629-af04-dc939e5c238a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.150418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15dcf35f-485a-4629-af04-dc939e5c238a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.151059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15dcf35f-485a-4629-af04-dc939e5c238a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.151735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15dcf35f-485a-4629-af04-dc939e5c238a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.184126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2165bb27-4acf-422f-9c22-0de0e621e2e8 req-b9c0aed6-5fe7-490b-9be6-b6ebd00beae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f162d0-8dc1-4492-ae25-95ac5531f187", "tag": "a53fc705-c8db-4111-a431-435e2a585025"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:11.200433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2165bb27-4acf-422f-9c22-0de0e621e2e8 req-b9c0aed6-5fe7-490b-9be6-b6ebd00beae8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.201230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2165bb27-4acf-422f-9c22-0de0e621e2e8 req-b9c0aed6-5fe7-490b-9be6-b6ebd00beae8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.202323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2165bb27-4acf-422f-9c22-0de0e621e2e8 req-b9c0aed6-5fe7-490b-9be6-b6ebd00beae8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.239452 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2165bb27-4acf-422f-9c22-0de0e621e2e8 req-b9c0aed6-5fe7-490b-9be6-b6ebd00beae8 service nova] Creating event network-changed:a53fc705-c8db-4111-a431-435e2a585025 for instance 17f162d0-8dc1-4492-ae25-95ac5531f187 on n-h1-850499-14 Oct 04 18:22:11.255308 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2165bb27-4acf-422f-9c22-0de0e621e2e8 req-b9c0aed6-5fe7-490b-9be6-b6ebd00beae8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325324 Oct 04 18:22:11.258458 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2401/4790] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:11.376381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ea100567-102d-4b75-b0c4-ba9b9bcac738 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:11.377476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ea100567-102d-4b75-b0c4-ba9b9bcac738 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:11.384596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea100567-102d-4b75-b0c4-ba9b9bcac738 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.385398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea100567-102d-4b75-b0c4-ba9b9bcac738 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.386093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea100567-102d-4b75-b0c4-ba9b9bcac738 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.387173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea100567-102d-4b75-b0c4-ba9b9bcac738 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.387841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea100567-102d-4b75-b0c4-ba9b9bcac738 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.388274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea100567-102d-4b75-b0c4-ba9b9bcac738 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.388980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-15dcf35f-485a-4629-af04-dc939e5c238a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:11.392828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:11.403740 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-15dcf35f-485a-4629-af04-dc939e5c238a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.290372 Oct 04 18:22:11.413110 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2390/4791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:11 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:11.540539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ea100567-102d-4b75-b0c4-ba9b9bcac738 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:11.548943 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ea100567-102d-4b75-b0c4-ba9b9bcac738 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.176953 Oct 04 18:22:11.559651 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2402/4792] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:11 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:11.618620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:11.619553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:11.627814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.628784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.629627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.631395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.632495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.632929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.730152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:11.740113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:11.743346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:11.745130 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d8f2ebf7-2e1c-45f1-bdef-58cd20eecf3d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1335 microversion: 2.47 time: 0.131753 Oct 04 18:22:11.754421 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2391/4793] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:11 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1335 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:12.145331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0dc1b50d-d1a5-46b7-8675-4b28c18c0a5d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:12.146398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0dc1b50d-d1a5-46b7-8675-4b28c18c0a5d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:12.155329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dc1b50d-d1a5-46b7-8675-4b28c18c0a5d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.156348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dc1b50d-d1a5-46b7-8675-4b28c18c0a5d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.157002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dc1b50d-d1a5-46b7-8675-4b28c18c0a5d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.157934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dc1b50d-d1a5-46b7-8675-4b28c18c0a5d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.159316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dc1b50d-d1a5-46b7-8675-4b28c18c0a5d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.160966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0dc1b50d-d1a5-46b7-8675-4b28c18c0a5d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.430553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3181a87c-829d-4f23-9020-1d30ee6b949e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:12.431211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3181a87c-829d-4f23-9020-1d30ee6b949e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:12.438339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3181a87c-829d-4f23-9020-1d30ee6b949e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.439461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3181a87c-829d-4f23-9020-1d30ee6b949e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.440297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3181a87c-829d-4f23-9020-1d30ee6b949e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.441040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3181a87c-829d-4f23-9020-1d30ee6b949e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.441504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3181a87c-829d-4f23-9020-1d30ee6b949e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.441936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3181a87c-829d-4f23-9020-1d30ee6b949e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.567685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0dc1b50d-d1a5-46b7-8675-4b28c18c0a5d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:12.574644 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0dc1b50d-d1a5-46b7-8675-4b28c18c0a5d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1308 microversion: 2.1 time: 0.434265 Oct 04 18:22:12.586976 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2403/4794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:12 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:12.598524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34a0bb00-da70-4906-9bb1-2017ba5fabed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:12.598524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34a0bb00-da70-4906-9bb1-2017ba5fabed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:12.624529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a0bb00-da70-4906-9bb1-2017ba5fabed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.625099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a0bb00-da70-4906-9bb1-2017ba5fabed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.625552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a0bb00-da70-4906-9bb1-2017ba5fabed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.626277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a0bb00-da70-4906-9bb1-2017ba5fabed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.626791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a0bb00-da70-4906-9bb1-2017ba5fabed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.627271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34a0bb00-da70-4906-9bb1-2017ba5fabed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.819686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3181a87c-829d-4f23-9020-1d30ee6b949e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:12.847571 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3181a87c-829d-4f23-9020-1d30ee6b949e tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1506 microversion: 2.1 time: 0.421392 Oct 04 18:22:12.854403 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2392/4795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:12 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:12.867368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:12.868363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:12.885031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.886629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.888133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.889077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.889752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.890375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.023227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:13.062583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:13.067344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:13.072616 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eeff32d5-d1c6-428c-8d76-80a108b784ac tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1335 microversion: 2.47 time: 0.216683 Oct 04 18:22:13.076542 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2393/4796] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:12 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1335 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:13.079497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34a0bb00-da70-4906-9bb1-2017ba5fabed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:13.097234 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34a0bb00-da70-4906-9bb1-2017ba5fabed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.510327 Oct 04 18:22:13.097234 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2404/4797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:12 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:13.628768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e52fc5de-35a4-490d-806e-641a80b5aa3a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:13.632116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e52fc5de-35a4-490d-806e-641a80b5aa3a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:13.634179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:13.656526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e52fc5de-35a4-490d-806e-641a80b5aa3a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.657104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e52fc5de-35a4-490d-806e-641a80b5aa3a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.657589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e52fc5de-35a4-490d-806e-641a80b5aa3a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.664775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e52fc5de-35a4-490d-806e-641a80b5aa3a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.667223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e52fc5de-35a4-490d-806e-641a80b5aa3a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.667683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e52fc5de-35a4-490d-806e-641a80b5aa3a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.950498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7de98a32-3e73-4ec9-a6d5-339ff120d093 req-1fc81ea7-a485-4c2e-b819-33dbf9f07a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1681ab-db4a-4528-99da-649ffa9a93a0", "name": "network-vif-plugged", "status": "completed", "tag": "2d48ba84-42ef-46d1-b6ba-69e426d07f1c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:13.960221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7de98a32-3e73-4ec9-a6d5-339ff120d093 req-1fc81ea7-a485-4c2e-b819-33dbf9f07a54 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.960980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7de98a32-3e73-4ec9-a6d5-339ff120d093 req-1fc81ea7-a485-4c2e-b819-33dbf9f07a54 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.961590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7de98a32-3e73-4ec9-a6d5-339ff120d093 req-1fc81ea7-a485-4c2e-b819-33dbf9f07a54 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.974501 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7de98a32-3e73-4ec9-a6d5-339ff120d093 req-1fc81ea7-a485-4c2e-b819-33dbf9f07a54 service nova] Creating event network-vif-plugged:2d48ba84-42ef-46d1-b6ba-69e426d07f1c for instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 on n-h2-850499-14 Oct 04 18:22:13.979648 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7de98a32-3e73-4ec9-a6d5-339ff120d093 req-1fc81ea7-a485-4c2e-b819-33dbf9f07a54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098996 Oct 04 18:22:13.980621 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2405/4798] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:13.986549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ffa6e674-5a51-4cf0-bf13-280415afa4ce tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:13.987579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ffa6e674-5a51-4cf0-bf13-280415afa4ce tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:13.994658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffa6e674-5a51-4cf0-bf13-280415afa4ce tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.995196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffa6e674-5a51-4cf0-bf13-280415afa4ce tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.995650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffa6e674-5a51-4cf0-bf13-280415afa4ce tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.996366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffa6e674-5a51-4cf0-bf13-280415afa4ce tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.996834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffa6e674-5a51-4cf0-bf13-280415afa4ce tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.997271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffa6e674-5a51-4cf0-bf13-280415afa4ce tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.018758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e52fc5de-35a4-490d-806e-641a80b5aa3a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.027325 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e52fc5de-35a4-490d-806e-641a80b5aa3a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1308 microversion: 2.1 time: 0.410917 Oct 04 18:22:14.031362 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2394/4799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:13 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:14.109126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ffa6e674-5a51-4cf0-bf13-280415afa4ce tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.121521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:14.122153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:14.133698 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ffa6e674-5a51-4cf0-bf13-280415afa4ce tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1464 microversion: 2.1 time: 0.150203 Oct 04 18:22:14.146977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.146977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.146977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.146977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.146977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.146977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.148844 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2406/4800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:13 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:14.157204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3e126811-7b50-487f-80ad-62ba0c3c18f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:14.158195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3e126811-7b50-487f-80ad-62ba0c3c18f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:14.165959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e126811-7b50-487f-80ad-62ba0c3c18f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.166708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e126811-7b50-487f-80ad-62ba0c3c18f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.167374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e126811-7b50-487f-80ad-62ba0c3c18f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.168276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e126811-7b50-487f-80ad-62ba0c3c18f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.169008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e126811-7b50-487f-80ad-62ba0c3c18f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.169607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e126811-7b50-487f-80ad-62ba0c3c18f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.294802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=18 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:14.365317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.383909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.386484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.387860 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5452f053-a748-458a-b899-16f425cdc6a1 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1335 microversion: 2.47 time: 0.270049 Oct 04 18:22:14.388696 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2395/4801] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:14 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1335 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:14.395647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ddf4dda1-d5b2-4a3e-819b-37e1a86ee2ec req-ce75a93b-6008-460e-9214-c1a314ff29eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429dcfa4-74db-46e5-9a98-db882b272ca4", "name": "network-vif-deleted", "tag": "c123cb18-ad97-4e5a-8909-e5bf85c7654b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:14.407416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ddf4dda1-d5b2-4a3e-819b-37e1a86ee2ec req-ce75a93b-6008-460e-9214-c1a314ff29eb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.407881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ddf4dda1-d5b2-4a3e-819b-37e1a86ee2ec req-ce75a93b-6008-460e-9214-c1a314ff29eb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.408507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ddf4dda1-d5b2-4a3e-819b-37e1a86ee2ec req-ce75a93b-6008-460e-9214-c1a314ff29eb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.424688 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ddf4dda1-d5b2-4a3e-819b-37e1a86ee2ec req-ce75a93b-6008-460e-9214-c1a314ff29eb service nova] Creating event network-vif-deleted:c123cb18-ad97-4e5a-8909-e5bf85c7654b for instance 429dcfa4-74db-46e5-9a98-db882b272ca4 on n-h1-850499-14 Oct 04 18:22:14.430380 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ddf4dda1-d5b2-4a3e-819b-37e1a86ee2ec req-ce75a93b-6008-460e-9214-c1a314ff29eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040192 Oct 04 18:22:14.432161 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2396/4802] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:14.548885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3e126811-7b50-487f-80ad-62ba0c3c18f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.556806 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3e126811-7b50-487f-80ad-62ba0c3c18f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.406498 Oct 04 18:22:14.557815 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2407/4803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:14 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:15.053380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52d2f058-1dcb-4718-aa98-bf56b2c04295 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:15.054722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-52d2f058-1dcb-4718-aa98-bf56b2c04295 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.071562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d2f058-1dcb-4718-aa98-bf56b2c04295 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.072129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d2f058-1dcb-4718-aa98-bf56b2c04295 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.072560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d2f058-1dcb-4718-aa98-bf56b2c04295 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.073285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d2f058-1dcb-4718-aa98-bf56b2c04295 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.073741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d2f058-1dcb-4718-aa98-bf56b2c04295 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.074239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52d2f058-1dcb-4718-aa98-bf56b2c04295 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.165067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:15.166643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.199166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.201266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.202579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.205422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.208179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.209495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.217286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:15.253488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.254076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.254735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.255461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lazy-loading 'fault' on Instance uuid 429dcfa4-74db-46e5-9a98-db882b272ca4 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:15.379570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:15.403403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d9b50fb1-0a76-480d-b890-a3c4b9de5a86 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 200 len: 1304 microversion: 2.1 time: 0.242089 Oct 04 18:22:15.404914 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2408/4804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:15 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 1304 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:15.420701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:15.428690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.436795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.437465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.444052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.445271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.446303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.447155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.688169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-52d2f058-1dcb-4718-aa98-bf56b2c04295 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:15.703130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:15.717679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:15.719195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:15.719892 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-52d2f058-1dcb-4718-aa98-bf56b2c04295 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1308 microversion: 2.1 time: 0.670577 Oct 04 18:22:15.721453 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-16cc7d63-c370-42c7-9439-dc4dae893b55 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1356 microversion: 2.47 time: 0.311504 Oct 04 18:22:15.732063 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2397/4805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:15 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1308 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:15.743375 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2409/4806] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:15 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1356 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:15.756503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eda53749-45dc-474a-8b49-777eae1d2291 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:15.756842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:15.765090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.774779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eda53749-45dc-474a-8b49-777eae1d2291 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.777144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.780882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.782860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.785243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.787423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.789252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.796194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda53749-45dc-474a-8b49-777eae1d2291 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.797828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda53749-45dc-474a-8b49-777eae1d2291 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.818393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda53749-45dc-474a-8b49-777eae1d2291 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.834272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda53749-45dc-474a-8b49-777eae1d2291 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.835599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda53749-45dc-474a-8b49-777eae1d2291 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.836066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eda53749-45dc-474a-8b49-777eae1d2291 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.898562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:15.899020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:15.899499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:15.899916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:15.900860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:15.986514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.994708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.995566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.996175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.997092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.997743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.998336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.045984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-73a1f319-a7ef-4017-9867-c8e5f8048597 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "POST /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443/action" status: 202 len: 1078 microversion: 2.47 time: 0.293046 Oct 04 18:22:16.061712 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2410/4807] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:22:15 2022] POST /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443/action => generated 1078 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:22:16.071770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:16.072641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:16.080549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.081243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.081691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.082789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.083478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.084079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.145202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eda53749-45dc-474a-8b49-777eae1d2291 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:16.158096 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eda53749-45dc-474a-8b49-777eae1d2291 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1365 microversion: 2.1 time: 0.422654 Oct 04 18:22:16.165602 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2398/4808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:15 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1365 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:16.217093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:16.231809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:16.240299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:16.243090 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-966a0173-09f3-4f3b-8826-9dff2590976f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.176945 Oct 04 18:22:16.255208 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2411/4809] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:16 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:16.436606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:16.437327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 429dcfa4-74db-46e5-9a98-db882b272ca4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:16.450215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.450752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.451218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.454514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.455227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.455682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.472338 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] HTTP exception thrown: Instance 429dcfa4-74db-46e5-9a98-db882b272ca4 could not be found. Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Request method failure captured: Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 HTTP/1.1 Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHlWOf2Qfu56bUkN0AEKEsV7HJU10VYwKZIKbxWR5lC7CZdkkMzXyLtZRN_MF9QGc3T4BFXZc4CN8qtdTRvSYz3FdD6DVLGIUjPSIF3-7KRQfGnh6PwT8kcAsr8_fiWE6-iJwG_uhQaj5tT-_y1NgJBFauEfv5xVt9gkmmPx4nTvNnk Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 1e47383b87bc4a2aa22f2297c0830e31 Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerRescueTestJSON-1001605432 Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1e47383b87bc4a2aa22f2297c0830e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1e47383b87bc4a2aa22f2297c0830e31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e47383b87bc4a2aa22f2297c0830e31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e47383b87bc4a2aa22f2297c0830e31"}]}] Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerRescueTestJSON-1001605432 Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 1e47383b87bc4a2aa22f2297c0830e31 Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerRescueTestJSON-1001605432 Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerRescueTestJSON-1001605432-project Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: a98f26cd0f90410ab0216ff424ff948c Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerRescueTestJSON-1001605432-project Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 429dcfa4-74db-46e5-9a98-db882b272ca4 could not be found. Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '429dcfa4-74db-46e5-9a98-db882b272ca4'} Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429dcfa4-74db-46e5-9a98-db882b272ca4 could not be found. Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429dcfa4-74db-46e5-9a98-db882b272ca4 could not be found. Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:16.474022 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:16.479123 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:16.479123 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:16.479123 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:16.479123 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:16.479123 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:16.479123 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429dcfa4-74db-46e5-9a98-db882b272ca4 could not be found. Oct 04 18:22:16.479123 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:16.480633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Returning 404 to user: Instance 429dcfa4-74db-46e5-9a98-db882b272ca4 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:16.481694 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-11d6486c-fe70-4afb-8806-a60bcbc76526 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4" status: 404 len: 111 microversion: 2.1 time: 0.056627 Oct 04 18:22:16.482748 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2399/4810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:16 2022] GET /compute/v2.1/servers/429dcfa4-74db-46e5-9a98-db882b272ca4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:16.491823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5dbfd5a6-a9a4-4b29-af8d-ca146673d538 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:16.492979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5dbfd5a6-a9a4-4b29-af8d-ca146673d538 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:16.505825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dbfd5a6-a9a4-4b29-af8d-ca146673d538 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.507065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dbfd5a6-a9a4-4b29-af8d-ca146673d538 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.507685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dbfd5a6-a9a4-4b29-af8d-ca146673d538 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.508690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dbfd5a6-a9a4-4b29-af8d-ca146673d538 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.509388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dbfd5a6-a9a4-4b29-af8d-ca146673d538 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.510068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5dbfd5a6-a9a4-4b29-af8d-ca146673d538 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.557545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5dbfd5a6-a9a4-4b29-af8d-ca146673d538 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:16.684031 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5dbfd5a6-a9a4-4b29-af8d-ca146673d538 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 204 len: 0 microversion: 2.1 time: 0.196731 Oct 04 18:22:16.685495 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2412/4811] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:22:16 2022] DELETE /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:22:16.694355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-783952c9-b331-4c53-81e3-15be1edb5c9a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:16.695015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-783952c9-b331-4c53-81e3-15be1edb5c9a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:16.701979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-783952c9-b331-4c53-81e3-15be1edb5c9a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.703213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-783952c9-b331-4c53-81e3-15be1edb5c9a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.703841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-783952c9-b331-4c53-81e3-15be1edb5c9a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.704723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-783952c9-b331-4c53-81e3-15be1edb5c9a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.705374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-783952c9-b331-4c53-81e3-15be1edb5c9a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.705966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-783952c9-b331-4c53-81e3-15be1edb5c9a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.748731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-33145bfa-e1e8-4fb9-b94b-fa2f0f94613f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:16.751379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-33145bfa-e1e8-4fb9-b94b-fa2f0f94613f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:16.754490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:16.767599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33145bfa-e1e8-4fb9-b94b-fa2f0f94613f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.768428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33145bfa-e1e8-4fb9-b94b-fa2f0f94613f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.768919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33145bfa-e1e8-4fb9-b94b-fa2f0f94613f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.769627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33145bfa-e1e8-4fb9-b94b-fa2f0f94613f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.770101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33145bfa-e1e8-4fb9-b94b-fa2f0f94613f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.770538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33145bfa-e1e8-4fb9-b94b-fa2f0f94613f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.990300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-783952c9-b331-4c53-81e3-15be1edb5c9a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.005179 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-783952c9-b331-4c53-81e3-15be1edb5c9a tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1491 microversion: 2.1 time: 0.315248 Oct 04 18:22:17.006138 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2400/4812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:16 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1491 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:17.089164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-33145bfa-e1e8-4fb9-b94b-fa2f0f94613f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.100444 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-33145bfa-e1e8-4fb9-b94b-fa2f0f94613f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1308 microversion: 2.1 time: 0.357629 Oct 04 18:22:17.101189 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2413/4813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:16 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:17.184445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c59cbfe-a504-46fb-8e97-715deb0f2a37 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:17.185438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c59cbfe-a504-46fb-8e97-715deb0f2a37 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:17.195239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c59cbfe-a504-46fb-8e97-715deb0f2a37 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.195847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c59cbfe-a504-46fb-8e97-715deb0f2a37 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.196545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c59cbfe-a504-46fb-8e97-715deb0f2a37 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.197400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c59cbfe-a504-46fb-8e97-715deb0f2a37 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.197990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c59cbfe-a504-46fb-8e97-715deb0f2a37 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.198577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c59cbfe-a504-46fb-8e97-715deb0f2a37 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.272465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:17.273112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:17.284893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.285409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.285901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.286643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.287158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.288136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.394813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.405579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.407465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.408479 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-23915282-2b36-460c-a1a0-d34f3c651734 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.140369 Oct 04 18:22:17.409400 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2414/4814] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:17 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:17.426323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4c59cbfe-a504-46fb-8e97-715deb0f2a37 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.442894 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c59cbfe-a504-46fb-8e97-715deb0f2a37 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1551 microversion: 2.1 time: 0.262739 Oct 04 18:22:17.445013 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2401/4815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:17 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1551 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:17.472592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e5eb3863-7096-41a9-b3c7-5ee3de2fc5e1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:17.473246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e5eb3863-7096-41a9-b3c7-5ee3de2fc5e1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:17.480770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5eb3863-7096-41a9-b3c7-5ee3de2fc5e1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.481397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5eb3863-7096-41a9-b3c7-5ee3de2fc5e1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.481942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5eb3863-7096-41a9-b3c7-5ee3de2fc5e1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.483188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5eb3863-7096-41a9-b3c7-5ee3de2fc5e1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.483530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5eb3863-7096-41a9-b3c7-5ee3de2fc5e1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.484092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5eb3863-7096-41a9-b3c7-5ee3de2fc5e1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.577353 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e5eb3863-7096-41a9-b3c7-5ee3de2fc5e1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109214 Oct 04 18:22:17.578067 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2415/4816] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:22:17 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:18.031866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cc097a3e-5617-466b-8510-01c0cc614ac1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:18.033399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cc097a3e-5617-466b-8510-01c0cc614ac1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:18.048987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc097a3e-5617-466b-8510-01c0cc614ac1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.050108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc097a3e-5617-466b-8510-01c0cc614ac1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.051605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc097a3e-5617-466b-8510-01c0cc614ac1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.055289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc097a3e-5617-466b-8510-01c0cc614ac1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.056160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc097a3e-5617-466b-8510-01c0cc614ac1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.059022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc097a3e-5617-466b-8510-01c0cc614ac1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.128759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d9d7a50-9544-4ed2-a0ec-224c5a11838e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:18.129780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0d9d7a50-9544-4ed2-a0ec-224c5a11838e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:18.148578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9d7a50-9544-4ed2-a0ec-224c5a11838e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.150163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9d7a50-9544-4ed2-a0ec-224c5a11838e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.151880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9d7a50-9544-4ed2-a0ec-224c5a11838e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.153374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9d7a50-9544-4ed2-a0ec-224c5a11838e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.155201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9d7a50-9544-4ed2-a0ec-224c5a11838e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.155811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d9d7a50-9544-4ed2-a0ec-224c5a11838e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.484298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cc097a3e-5617-466b-8510-01c0cc614ac1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:18.500523 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cc097a3e-5617-466b-8510-01c0cc614ac1 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1491 microversion: 2.1 time: 0.474837 Oct 04 18:22:18.518199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0d9d7a50-9544-4ed2-a0ec-224c5a11838e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:18.520880 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2402/4817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:18 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1491 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:18.528489 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0d9d7a50-9544-4ed2-a0ec-224c5a11838e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1308 microversion: 2.1 time: 0.405001 Oct 04 18:22:18.529625 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2416/4818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:18 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:18.530833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:18.531499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:18.537617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.538121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.538567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.539310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.540016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.540667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.619731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:18.630289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:18.633750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:18.634507 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d99d2b43-9d0b-4e02-8165-1b2a47b7205a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.110439 Oct 04 18:22:18.635142 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2403/4819] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:18 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:19.530498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ed328c94-11d1-44bc-9f40-9a1b286e4eff tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:19.532840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ed328c94-11d1-44bc-9f40-9a1b286e4eff tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:19.543644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed328c94-11d1-44bc-9f40-9a1b286e4eff tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.544561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed328c94-11d1-44bc-9f40-9a1b286e4eff tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.545211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed328c94-11d1-44bc-9f40-9a1b286e4eff tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.553552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5534ead4-e81b-466a-bea5-4bd53b31ad99 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:19.554973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5534ead4-e81b-466a-bea5-4bd53b31ad99 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:19.562233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed328c94-11d1-44bc-9f40-9a1b286e4eff tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.564487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed328c94-11d1-44bc-9f40-9a1b286e4eff tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.565164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed328c94-11d1-44bc-9f40-9a1b286e4eff tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.597413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5534ead4-e81b-466a-bea5-4bd53b31ad99 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.598361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5534ead4-e81b-466a-bea5-4bd53b31ad99 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.601078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5534ead4-e81b-466a-bea5-4bd53b31ad99 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.604009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5534ead4-e81b-466a-bea5-4bd53b31ad99 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.604009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5534ead4-e81b-466a-bea5-4bd53b31ad99 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.605150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5534ead4-e81b-466a-bea5-4bd53b31ad99 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.161249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5534ead4-e81b-466a-bea5-4bd53b31ad99 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:20.176973 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5534ead4-e81b-466a-bea5-4bd53b31ad99 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1308 microversion: 2.1 time: 0.628563 Oct 04 18:22:20.179871 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2404/4820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:19 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1308 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:20.193579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:20.194995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:20.203901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.204641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.205243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.206780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.207554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.208202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.223115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ed328c94-11d1-44bc-9f40-9a1b286e4eff tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:20.238221 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ed328c94-11d1-44bc-9f40-9a1b286e4eff tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1491 microversion: 2.1 time: 0.710105 Oct 04 18:22:20.245890 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2417/4821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:19 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1491 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:20.262786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7737d941-7ed3-4068-b741-9b910ba3d187 req-474aeae2-4099-4706-97c1-c8265632e3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f162d0-8dc1-4492-ae25-95ac5531f187", "name": "network-vif-plugged", "status": "completed", "tag": "a53fc705-c8db-4111-a431-435e2a585025"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:20.297654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7737d941-7ed3-4068-b741-9b910ba3d187 req-474aeae2-4099-4706-97c1-c8265632e3f2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.299131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7737d941-7ed3-4068-b741-9b910ba3d187 req-474aeae2-4099-4706-97c1-c8265632e3f2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.300672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7737d941-7ed3-4068-b741-9b910ba3d187 req-474aeae2-4099-4706-97c1-c8265632e3f2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.333003 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7737d941-7ed3-4068-b741-9b910ba3d187 req-474aeae2-4099-4706-97c1-c8265632e3f2 service nova] Creating event network-vif-plugged:a53fc705-c8db-4111-a431-435e2a585025 for instance 17f162d0-8dc1-4492-ae25-95ac5531f187 on n-h1-850499-14 Oct 04 18:22:20.338871 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7737d941-7ed3-4068-b741-9b910ba3d187 req-474aeae2-4099-4706-97c1-c8265632e3f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090307 Oct 04 18:22:20.340919 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2418/4822] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:20.347115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-28b05d89-41a9-40e8-b783-6d0751e06afd req-b03c0c37-be65-42d9-bb70-c0f0fad16349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1681ab-db4a-4528-99da-649ffa9a93a0", "tag": "2d48ba84-42ef-46d1-b6ba-69e426d07f1c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:20.360354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-28b05d89-41a9-40e8-b783-6d0751e06afd req-b03c0c37-be65-42d9-bb70-c0f0fad16349 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.361110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-28b05d89-41a9-40e8-b783-6d0751e06afd req-b03c0c37-be65-42d9-bb70-c0f0fad16349 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.362022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-28b05d89-41a9-40e8-b783-6d0751e06afd req-b03c0c37-be65-42d9-bb70-c0f0fad16349 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.376917 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-28b05d89-41a9-40e8-b783-6d0751e06afd req-b03c0c37-be65-42d9-bb70-c0f0fad16349 service nova] Creating event network-changed:2d48ba84-42ef-46d1-b6ba-69e426d07f1c for instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 on n-h2-850499-14 Oct 04 18:22:20.384397 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-28b05d89-41a9-40e8-b783-6d0751e06afd req-b03c0c37-be65-42d9-bb70-c0f0fad16349 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041215 Oct 04 18:22:20.385244 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2419/4823] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:20.397305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e2bd266e-94bc-4b41-9d9c-02d3652f2439 req-7047acc0-22e0-4372-b477-17708a693566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8380cc-7414-4d96-bd4b-265dd21f78b0", "name": "network-vif-deleted", "tag": "ed52627b-61b9-4928-a2b7-9227419da931"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:20.404686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:20.415555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e2bd266e-94bc-4b41-9d9c-02d3652f2439 req-7047acc0-22e0-4372-b477-17708a693566 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.416275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e2bd266e-94bc-4b41-9d9c-02d3652f2439 req-7047acc0-22e0-4372-b477-17708a693566 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.416925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e2bd266e-94bc-4b41-9d9c-02d3652f2439 req-7047acc0-22e0-4372-b477-17708a693566 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.418738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:20.422060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:20.427911 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f55a4a6b-3cff-4a07-94c8-d6e476526f65 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.245511 Oct 04 18:22:20.428995 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2405/4824] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:20 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:20.435529 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e2bd266e-94bc-4b41-9d9c-02d3652f2439 req-7047acc0-22e0-4372-b477-17708a693566 service nova] Creating event network-vif-deleted:ed52627b-61b9-4928-a2b7-9227419da931 for instance 2a8380cc-7414-4d96-bd4b-265dd21f78b0 on n-h1-850499-14 Oct 04 18:22:20.441017 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e2bd266e-94bc-4b41-9d9c-02d3652f2439 req-7047acc0-22e0-4372-b477-17708a693566 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054262 Oct 04 18:22:20.441641 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2420/4825] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:21.215337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1e552ec0-c924-4898-bd31-97c9d2c769d0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:21.216534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1e552ec0-c924-4898-bd31-97c9d2c769d0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:21.234096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e552ec0-c924-4898-bd31-97c9d2c769d0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.236496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e552ec0-c924-4898-bd31-97c9d2c769d0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.237524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e552ec0-c924-4898-bd31-97c9d2c769d0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.238531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e552ec0-c924-4898-bd31-97c9d2c769d0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.239336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e552ec0-c924-4898-bd31-97c9d2c769d0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.239988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e552ec0-c924-4898-bd31-97c9d2c769d0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.267209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:21.268752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:21.283342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.283954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.285209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.288253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.291517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.293044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.342703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.343584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.344294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.344961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lazy-loading 'fault' on Instance uuid 2a8380cc-7414-4d96-bd4b-265dd21f78b0 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:21.575985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a98f26cd0f90410ab0216ff424ff948c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e47383b87bc4a2aa22f2297c0830e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:21.589271 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c5c035e-f438-49c9-b853-d4b5ff49fc48 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 200 len: 1303 microversion: 2.1 time: 0.328698 Oct 04 18:22:21.602024 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2421/4826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:21 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 1303 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:21.623282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:21.624427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:21.632953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.633688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.634353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.635341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.636256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.637535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.794697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:21.803484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:21.818462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e552ec0-c924-4898-bd31-97c9d2c769d0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:21.819889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:21.823853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:21.825768 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3dc6ebd7-3ce8-4272-a96b-e0026f39f8dc tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.222268 Oct 04 18:22:21.827455 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2422/4827] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:21 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:21.827748 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1e552ec0-c924-4898-bd31-97c9d2c769d0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1308 microversion: 2.1 time: 0.626451 Oct 04 18:22:21.828374 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2406/4828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:21 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1308 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:22.626168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:22.627519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] [instance: 2a8380cc-7414-4d96-bd4b-265dd21f78b0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:22.641736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:22.642256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:22.642705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:22.648956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:22.650531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:22.651662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:22.676127 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] HTTP exception thrown: Instance 2a8380cc-7414-4d96-bd4b-265dd21f78b0 could not be found. Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Request method failure captured: Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 HTTP/1.1 Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHlWOf2Qfu56bUkN0AEKEsV7HJU10VYwKZIKbxWR5lC7CZdkkMzXyLtZRN_MF9QGc3T4BFXZc4CN8qtdTRvSYz3FdD6DVLGIUjPSIF3-7KRQfGnh6PwT8kcAsr8_fiWE6-iJwG_uhQaj5tT-_y1NgJBFauEfv5xVt9gkmmPx4nTvNnk Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 1e47383b87bc4a2aa22f2297c0830e31 Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerRescueTestJSON-1001605432 Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1e47383b87bc4a2aa22f2297c0830e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1e47383b87bc4a2aa22f2297c0830e31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e47383b87bc4a2aa22f2297c0830e31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e47383b87bc4a2aa22f2297c0830e31"}]}] Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerRescueTestJSON-1001605432 Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 1e47383b87bc4a2aa22f2297c0830e31 Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerRescueTestJSON-1001605432 Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerRescueTestJSON-1001605432-project Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: a98f26cd0f90410ab0216ff424ff948c Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerRescueTestJSON-1001605432-project Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 2a8380cc-7414-4d96-bd4b-265dd21f78b0 could not be found. Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '2a8380cc-7414-4d96-bd4b-265dd21f78b0'} Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a8380cc-7414-4d96-bd4b-265dd21f78b0 could not be found. Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a8380cc-7414-4d96-bd4b-265dd21f78b0 could not be found. Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:22.678171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:22:22.682489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:22.682489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:22.682489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:22.682489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:22.682489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:22.682489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a8380cc-7414-4d96-bd4b-265dd21f78b0 could not be found. Oct 04 18:22:22.682489 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:22:22.684033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] Returning 404 to user: Instance 2a8380cc-7414-4d96-bd4b-265dd21f78b0 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:22.685143 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c4996753-108d-418e-b4fa-16e351e18bc4 tempest-ServerRescueTestJSON-1001605432 tempest-ServerRescueTestJSON-1001605432-project] 10.222.0.18 "GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0" status: 404 len: 111 microversion: 2.1 time: 0.063203 Oct 04 18:22:22.686279 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2423/4829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:22 2022] GET /compute/v2.1/servers/2a8380cc-7414-4d96-bd4b-265dd21f78b0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:22.858016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b7bd75e-a178-4218-b5ed-9d9347259e31 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:22.858609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:22.859461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:22.860407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8b7bd75e-a178-4218-b5ed-9d9347259e31 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:22.871093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:22.874685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:22.875405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:22.876353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:22.877145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:22.878622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:22.891387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b7bd75e-a178-4218-b5ed-9d9347259e31 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:22.893139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b7bd75e-a178-4218-b5ed-9d9347259e31 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:22.894445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b7bd75e-a178-4218-b5ed-9d9347259e31 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:22.895468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b7bd75e-a178-4218-b5ed-9d9347259e31 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:22.897432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b7bd75e-a178-4218-b5ed-9d9347259e31 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:22.898194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b7bd75e-a178-4218-b5ed-9d9347259e31 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:23.106059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:23.116136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:23.123710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:23.125322 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c45ef1d9-d00a-4689-b3b1-46b410cac94c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.271603 Oct 04 18:22:23.125915 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2424/4830] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:22 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:23.434477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8b7bd75e-a178-4218-b5ed-9d9347259e31 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:23.452928 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b7bd75e-a178-4218-b5ed-9d9347259e31 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1489 microversion: 2.1 time: 0.597590 Oct 04 18:22:23.463672 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2407/4831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:22 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1489 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:23.603200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-105365941", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "5be520db-1d2d-4d71-923d-9d8728cd44bc"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:23.691008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] validate_networks() for [('5be520db-1d2d-4d71-923d-9d8728cd44bc', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:24.043168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-43e5976c-bb97-46e0-a60c-72ee5e6180f4 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:24.051789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-43e5976c-bb97-46e0-a60c-72ee5e6180f4 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:24.065485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43e5976c-bb97-46e0-a60c-72ee5e6180f4 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.069089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43e5976c-bb97-46e0-a60c-72ee5e6180f4 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.069829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43e5976c-bb97-46e0-a60c-72ee5e6180f4 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.074278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43e5976c-bb97-46e0-a60c-72ee5e6180f4 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.075793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43e5976c-bb97-46e0-a60c-72ee5e6180f4 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.076315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43e5976c-bb97-46e0-a60c-72ee5e6180f4 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.106596 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-43e5976c-bb97-46e0-a60c-72ee5e6180f4 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/ips" status: 200 len: 146 microversion: 2.1 time: 0.397198 Oct 04 18:22:24.110873 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2408/4832] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:22:23 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/ips => generated 146 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:24.153654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:24.154787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:24.170388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.171349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.172193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.173177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.173878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.174534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.179875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:24.417489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:24.429032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:24.430582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:24.431853 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b621b0b1-25cb-4dff-8614-fa6444821f73 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.282801 Oct 04 18:22:24.432431 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2409/4833] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:24 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:25.209800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:25.210945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:25.211627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:25.212212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:25.212805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:25.241480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:25.242296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:25.243419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:25.244391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:25.245024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:25.246098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:25.303687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:25.315110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for user 41e49c77352541cb94dcd12277f7ee67 and project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:25.351470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:25.353821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:25.462184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:25.462806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:25.466691 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-429f450d-d18c-4a40-a4d0-44dc72fb87c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.867457 Oct 04 18:22:25.470840 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2425/4834] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:25.473704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:25.474210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:25.475205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:25.475931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:25.476485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:25.476812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:25.482179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-66df37cd-e615-4f21-aa33-7a5e2110c745 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:25.482848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-66df37cd-e615-4f21-aa33-7a5e2110c745 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:25.661845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:25.677480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:25.682184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:25.691412 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96ddb166-c1d5-4bdc-b040-419accaae264 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.233076 Oct 04 18:22:25.713137 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2410/4835] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:25 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:25.735353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-66df37cd-e615-4f21-aa33-7a5e2110c745 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:25.760609 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-66df37cd-e615-4f21-aa33-7a5e2110c745 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1208 microversion: 2.1 time: 0.272825 Oct 04 18:22:25.765008 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2426/4836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:25 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1208 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:26.729661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:26.730385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:26.740217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.741340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.744848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.746372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.750517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.751609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.792680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4427539-cf21-4be6-9dc3-784f7a81fb1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:26.793846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e4427539-cf21-4be6-9dc3-784f7a81fb1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:26.800577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4427539-cf21-4be6-9dc3-784f7a81fb1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.801292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4427539-cf21-4be6-9dc3-784f7a81fb1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.801935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4427539-cf21-4be6-9dc3-784f7a81fb1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.803395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4427539-cf21-4be6-9dc3-784f7a81fb1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.804029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4427539-cf21-4be6-9dc3-784f7a81fb1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.804628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4427539-cf21-4be6-9dc3-784f7a81fb1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.964359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:26.972743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:26.974195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:26.976080 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a34e17a-433d-4f9d-96d2-3340640280f5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.261206 Oct 04 18:22:26.977100 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2411/4837] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:26 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:26.977796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e4427539-cf21-4be6-9dc3-784f7a81fb1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:26.983626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67401218-076c-400a-bcb1-fbe74472133a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bcc2917-a334-4701-8f45-a442510fe63e"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:26.986381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67401218-076c-400a-bcb1-fbe74472133a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:26.986620 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e4427539-cf21-4be6-9dc3-784f7a81fb1f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1260 microversion: 2.1 time: 0.198932 Oct 04 18:22:26.987279 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2427/4838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:26 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:27.009709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67401218-076c-400a-bcb1-fbe74472133a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.010219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67401218-076c-400a-bcb1-fbe74472133a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.010899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67401218-076c-400a-bcb1-fbe74472133a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.011645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67401218-076c-400a-bcb1-fbe74472133a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.012110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67401218-076c-400a-bcb1-fbe74472133a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.012566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67401218-076c-400a-bcb1-fbe74472133a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.385847 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67401218-076c-400a-bcb1-fbe74472133a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406326 Oct 04 18:22:27.392272 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2412/4839] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:22:26 2022] POST /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:28.006498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:28.007998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:28.014270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af8ae582-b326-4ea9-ada0-3e12e5a178b0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:28.015701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-af8ae582-b326-4ea9-ada0-3e12e5a178b0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:28.031807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.033393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af8ae582-b326-4ea9-ada0-3e12e5a178b0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.034194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.035157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af8ae582-b326-4ea9-ada0-3e12e5a178b0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.035918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.037327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af8ae582-b326-4ea9-ada0-3e12e5a178b0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.037706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.039587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af8ae582-b326-4ea9-ada0-3e12e5a178b0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.040112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.040808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.042071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af8ae582-b326-4ea9-ada0-3e12e5a178b0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.043651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af8ae582-b326-4ea9-ada0-3e12e5a178b0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.453389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-af8ae582-b326-4ea9-ada0-3e12e5a178b0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:28.468914 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-af8ae582-b326-4ea9-ada0-3e12e5a178b0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1266 microversion: 2.1 time: 0.458858 Oct 04 18:22:28.470262 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2413/4840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:28 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1266 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:28.479252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:28.493168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:28.494623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:28.506215 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6e15162d-2ff1-4a28-a46d-14000e04f696 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.503113 Oct 04 18:22:28.507397 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2428/4841] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:28 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:29.494235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d2f1f0b-5fcb-4884-b099-b4a7974fdc11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:29.495470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1d2f1f0b-5fcb-4884-b099-b4a7974fdc11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:29.508955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d2f1f0b-5fcb-4884-b099-b4a7974fdc11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.509733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d2f1f0b-5fcb-4884-b099-b4a7974fdc11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.510357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d2f1f0b-5fcb-4884-b099-b4a7974fdc11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.514326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d2f1f0b-5fcb-4884-b099-b4a7974fdc11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.515592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d2f1f0b-5fcb-4884-b099-b4a7974fdc11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.516201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d2f1f0b-5fcb-4884-b099-b4a7974fdc11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.538859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:29.540984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:29.561611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.566945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.568294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.569172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.569648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.573490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.948540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.970056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.978483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.989189 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f09fb7bb-5af9-4ba3-bb2c-1435f1aff9ec tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.449125 Oct 04 18:22:29.992551 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2429/4842] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:29 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:30.376352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d2f1f0b-5fcb-4884-b099-b4a7974fdc11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:30.389216 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d2f1f0b-5fcb-4884-b099-b4a7974fdc11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1308 microversion: 2.1 time: 0.899201 Oct 04 18:22:30.402865 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2414/4843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:29 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1308 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:31.018690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:31.019558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:31.034532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.035285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.035779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.036611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.037386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.040804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.195812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.223045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.228339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.234169 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9423dd98-bacc-4bb0-bcc8-7032a71c9d30 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.216321 Oct 04 18:22:31.237774 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2430/4844] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:31 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:31.414939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-508b8f38-3fb7-422c-876e-612a58b380b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:31.415635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-508b8f38-3fb7-422c-876e-612a58b380b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:31.428767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-508b8f38-3fb7-422c-876e-612a58b380b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.431198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-508b8f38-3fb7-422c-876e-612a58b380b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.431716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-508b8f38-3fb7-422c-876e-612a58b380b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.432464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-508b8f38-3fb7-422c-876e-612a58b380b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.432938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-508b8f38-3fb7-422c-876e-612a58b380b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.435678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-508b8f38-3fb7-422c-876e-612a58b380b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.581534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-88b7d947-32b1-422e-ab51-06ad88a8c848 req-d51a2580-c64a-4e96-bde7-0a4ca6ffe9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ae85e2-1194-4df1-bd8d-281764a602a2", "tag": "86a516bb-c239-4534-b6e5-3a344f93aff3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:31.598496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-88b7d947-32b1-422e-ab51-06ad88a8c848 req-d51a2580-c64a-4e96-bde7-0a4ca6ffe9e3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.599153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-88b7d947-32b1-422e-ab51-06ad88a8c848 req-d51a2580-c64a-4e96-bde7-0a4ca6ffe9e3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.600192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-88b7d947-32b1-422e-ab51-06ad88a8c848 req-d51a2580-c64a-4e96-bde7-0a4ca6ffe9e3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.615100 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-88b7d947-32b1-422e-ab51-06ad88a8c848 req-d51a2580-c64a-4e96-bde7-0a4ca6ffe9e3 service nova] Creating event network-changed:86a516bb-c239-4534-b6e5-3a344f93aff3 for instance e0ae85e2-1194-4df1-bd8d-281764a602a2 on n-h1-850499-14 Oct 04 18:22:31.623718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-88b7d947-32b1-422e-ab51-06ad88a8c848 req-d51a2580-c64a-4e96-bde7-0a4ca6ffe9e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045338 Oct 04 18:22:31.624471 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2431/4845] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:31.820012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-508b8f38-3fb7-422c-876e-612a58b380b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.839345 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-508b8f38-3fb7-422c-876e-612a58b380b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1308 microversion: 2.1 time: 0.428612 Oct 04 18:22:31.855032 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2415/4846] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:31 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1308 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:32.262878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:32.264190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:32.282319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.283337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.283947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.284845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.288119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.288941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.447966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:32.458943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:32.460661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:32.461876 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1caf6e4f-49e9-44dd-8d75-476c608ad3c9 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.203448 Oct 04 18:22:32.462655 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2432/4847] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:32 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:32.865682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a2d46b89-e51b-46e7-bdde-3a1743e2fcb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:32.866504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a2d46b89-e51b-46e7-bdde-3a1743e2fcb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:32.882135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d46b89-e51b-46e7-bdde-3a1743e2fcb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.883529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d46b89-e51b-46e7-bdde-3a1743e2fcb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.884186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d46b89-e51b-46e7-bdde-3a1743e2fcb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.887582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d46b89-e51b-46e7-bdde-3a1743e2fcb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.888246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d46b89-e51b-46e7-bdde-3a1743e2fcb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.890781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2d46b89-e51b-46e7-bdde-3a1743e2fcb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.163256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a2d46b89-e51b-46e7-bdde-3a1743e2fcb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.173055 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a2d46b89-e51b-46e7-bdde-3a1743e2fcb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1308 microversion: 2.1 time: 0.311216 Oct 04 18:22:33.173055 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2416/4848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:32 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:33.491888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:33.492523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:33.507093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.507927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.508529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.509584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.510222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.510820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.765166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.776371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.779563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.781113 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ae3c6c2-862d-4907-b084-de9a2953dfe2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.293176 Oct 04 18:22:33.797306 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2433/4849] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:33 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:34.207089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ca854ff-7d68-4e03-810f-285c5b642887 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:34.212314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ca854ff-7d68-4e03-810f-285c5b642887 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:34.223366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:34.225474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ca854ff-7d68-4e03-810f-285c5b642887 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.226093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ca854ff-7d68-4e03-810f-285c5b642887 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.226821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ca854ff-7d68-4e03-810f-285c5b642887 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.228505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ca854ff-7d68-4e03-810f-285c5b642887 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.229816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ca854ff-7d68-4e03-810f-285c5b642887 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.230432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ca854ff-7d68-4e03-810f-285c5b642887 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.448112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ca854ff-7d68-4e03-810f-285c5b642887 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:34.458426 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ca854ff-7d68-4e03-810f-285c5b642887 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1308 microversion: 2.1 time: 0.263738 Oct 04 18:22:34.461548 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2417/4850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:34 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:34.810234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:34.811202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:34.822419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.823168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.823768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.824666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.825705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.826292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.932164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:34.945196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:34.950257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:34.951672 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7a0ad032-eb33-4b63-a9fd-ec6d34f80b26 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.145314 Oct 04 18:22:34.953940 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2434/4851] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:34 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:35.484073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-390ce1b8-acf0-46b6-b1a2-d74e83af0d80 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:35.484690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-390ce1b8-acf0-46b6-b1a2-d74e83af0d80 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:35.501353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-390ce1b8-acf0-46b6-b1a2-d74e83af0d80 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.502134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-390ce1b8-acf0-46b6-b1a2-d74e83af0d80 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.503087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-390ce1b8-acf0-46b6-b1a2-d74e83af0d80 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.503957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-390ce1b8-acf0-46b6-b1a2-d74e83af0d80 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.504728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-390ce1b8-acf0-46b6-b1a2-d74e83af0d80 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.505334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-390ce1b8-acf0-46b6-b1a2-d74e83af0d80 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.763964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-390ce1b8-acf0-46b6-b1a2-d74e83af0d80 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.774715 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-390ce1b8-acf0-46b6-b1a2-d74e83af0d80 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1308 microversion: 2.1 time: 0.294272 Oct 04 18:22:35.775330 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2418/4852] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:35 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1308 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:35.981937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:35.982555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:35.985429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:35.986471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:36.003279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.010308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.011805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.012674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.014777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.017068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.128147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:36.152319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:36.153779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:36.160191 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fde75df2-04ed-43d1-92e6-cb4e028bc83f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.182245 Oct 04 18:22:36.162714 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2435/4853] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:35 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:36.800998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-09421577-0747-470b-9d07-cf8ad8583e21 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:36.803061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-09421577-0747-470b-9d07-cf8ad8583e21 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:36.817036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09421577-0747-470b-9d07-cf8ad8583e21 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.818915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09421577-0747-470b-9d07-cf8ad8583e21 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.819778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09421577-0747-470b-9d07-cf8ad8583e21 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.820942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09421577-0747-470b-9d07-cf8ad8583e21 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.823417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09421577-0747-470b-9d07-cf8ad8583e21 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.824850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09421577-0747-470b-9d07-cf8ad8583e21 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.189558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:37.189943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:37.206684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:37.207349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:37.207907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.209266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:37.209851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:37.210400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.427045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:37.454844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:37.461852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:37.463129 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-93b74ef3-256b-4665-9d52-a7a7aec8f78c tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.278376 Oct 04 18:22:37.463699 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2436/4854] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:37 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:37.600603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-09421577-0747-470b-9d07-cf8ad8583e21 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:37.610365 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-09421577-0747-470b-9d07-cf8ad8583e21 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1308 microversion: 2.1 time: 0.813386 Oct 04 18:22:37.612409 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2419/4855] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:36 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1308 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:38.496959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:38.497607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:38.511975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.512490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.512938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.517860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.518354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.519821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.635965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bda64faa-057a-4629-9aa6-4a0872ce2ab6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:38.637092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bda64faa-057a-4629-9aa6-4a0872ce2ab6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:38.649336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda64faa-057a-4629-9aa6-4a0872ce2ab6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.649842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda64faa-057a-4629-9aa6-4a0872ce2ab6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.657110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda64faa-057a-4629-9aa6-4a0872ce2ab6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.658196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda64faa-057a-4629-9aa6-4a0872ce2ab6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.658930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda64faa-057a-4629-9aa6-4a0872ce2ab6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.659891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda64faa-057a-4629-9aa6-4a0872ce2ab6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.732238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:38.748932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:38.750506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:38.760291 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-06fb7485-3c83-4154-bc41-33af3229b840 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.274020 Oct 04 18:22:38.790237 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2437/4856] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:39.035655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bda64faa-057a-4629-9aa6-4a0872ce2ab6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.057421 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bda64faa-057a-4629-9aa6-4a0872ce2ab6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1308 microversion: 2.1 time: 0.415165 Oct 04 18:22:39.058509 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2420/4857] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1308 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:39.174618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-45f7b6bb-8562-4962-b152-e04f93139015 req-3180d28f-a50c-453b-a32d-cdf7ce4e4528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ae85e2-1194-4df1-bd8d-281764a602a2", "name": "network-vif-plugged", "status": "completed", "tag": "86a516bb-c239-4534-b6e5-3a344f93aff3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:39.193485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45f7b6bb-8562-4962-b152-e04f93139015 req-3180d28f-a50c-453b-a32d-cdf7ce4e4528 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.197041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45f7b6bb-8562-4962-b152-e04f93139015 req-3180d28f-a50c-453b-a32d-cdf7ce4e4528 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.197185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45f7b6bb-8562-4962-b152-e04f93139015 req-3180d28f-a50c-453b-a32d-cdf7ce4e4528 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.231797 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-45f7b6bb-8562-4962-b152-e04f93139015 req-3180d28f-a50c-453b-a32d-cdf7ce4e4528 service nova] Creating event network-vif-plugged:86a516bb-c239-4534-b6e5-3a344f93aff3 for instance e0ae85e2-1194-4df1-bd8d-281764a602a2 on n-h1-850499-14 Oct 04 18:22:39.267622 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-45f7b6bb-8562-4962-b152-e04f93139015 req-3180d28f-a50c-453b-a32d-cdf7ce4e4528 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088838 Oct 04 18:22:39.268314 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2438/4858] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:39.800996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:39.802676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:39.822749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.828983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.829497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.830923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.834123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.836407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.082605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6791f1ef-2f1e-4a15-989f-455186d0bfb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:40.088987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6791f1ef-2f1e-4a15-989f-455186d0bfb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:40.130571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6791f1ef-2f1e-4a15-989f-455186d0bfb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.134215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6791f1ef-2f1e-4a15-989f-455186d0bfb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.135573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6791f1ef-2f1e-4a15-989f-455186d0bfb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.136846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6791f1ef-2f1e-4a15-989f-455186d0bfb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.141192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6791f1ef-2f1e-4a15-989f-455186d0bfb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.144779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6791f1ef-2f1e-4a15-989f-455186d0bfb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.164612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.197671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.213145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.223302 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c40bc72c-de37-4a46-9a8d-c5cf1142be5d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.424236 Oct 04 18:22:40.224123 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2421/4859] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:39 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:40.699379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6791f1ef-2f1e-4a15-989f-455186d0bfb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.708361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6791f1ef-2f1e-4a15-989f-455186d0bfb1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1308 microversion: 2.1 time: 0.630186 Oct 04 18:22:40.720156 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2439/4860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:40 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1308 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:40.949415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-beb4877e-ba70-407c-bd59-11cb8bbdb0ef tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:40.959049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-beb4877e-ba70-407c-bd59-11cb8bbdb0ef tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:40.969339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-beb4877e-ba70-407c-bd59-11cb8bbdb0ef tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.970324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-beb4877e-ba70-407c-bd59-11cb8bbdb0ef tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.971179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-beb4877e-ba70-407c-bd59-11cb8bbdb0ef tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.972785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-beb4877e-ba70-407c-bd59-11cb8bbdb0ef tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.973541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-beb4877e-ba70-407c-bd59-11cb8bbdb0ef tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.974991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-beb4877e-ba70-407c-bd59-11cb8bbdb0ef tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.014795 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-beb4877e-ba70-407c-bd59-11cb8bbdb0ef tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074301 Oct 04 18:22:41.016079 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2422/4861] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:22:40 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:41.029636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ceeb5c4-fd58-4f47-a373-ae0984cfd699 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.030541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9ceeb5c4-fd58-4f47-a373-ae0984cfd699 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.038120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ceeb5c4-fd58-4f47-a373-ae0984cfd699 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.038977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ceeb5c4-fd58-4f47-a373-ae0984cfd699 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.039641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ceeb5c4-fd58-4f47-a373-ae0984cfd699 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.040579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ceeb5c4-fd58-4f47-a373-ae0984cfd699 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.041316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ceeb5c4-fd58-4f47-a373-ae0984cfd699 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.042114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ceeb5c4-fd58-4f47-a373-ae0984cfd699 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.137816 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ceeb5c4-fd58-4f47-a373-ae0984cfd699 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments/5bcc2917-a334-4701-8f45-a442510fe63e" status: 200 len: 194 microversion: 2.1 time: 0.112446 Oct 04 18:22:41.139439 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2440/4862] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments/5bcc2917-a334-4701-8f45-a442510fe63e => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:41.258563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.261279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.278908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.279711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.280415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.281362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.282045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.282919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.546155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:41.563304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:41.565494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:41.576428 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6fef650c-aea6-44ea-a55c-0e4d6f932798 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.322151 Oct 04 18:22:41.578156 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2423/4863] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:41.744731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6fa05875-fb44-455e-a819-7d5d5f8b8b8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.745697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6fa05875-fb44-455e-a819-7d5d5f8b8b8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.761052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fa05875-fb44-455e-a819-7d5d5f8b8b8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.761811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fa05875-fb44-455e-a819-7d5d5f8b8b8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.762533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fa05875-fb44-455e-a819-7d5d5f8b8b8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.764061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fa05875-fb44-455e-a819-7d5d5f8b8b8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.765929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fa05875-fb44-455e-a819-7d5d5f8b8b8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.767901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6fa05875-fb44-455e-a819-7d5d5f8b8b8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.571106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6fa05875-fb44-455e-a819-7d5d5f8b8b8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:42.606410 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6fa05875-fb44-455e-a819-7d5d5f8b8b8b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1489 microversion: 2.1 time: 0.865678 Oct 04 18:22:42.607030 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2441/4864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1489 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:42.626736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:42.631046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:42.636839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9284afad-2ab8-4f53-a4f5-74ca85a3fff3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:42.637603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9284afad-2ab8-4f53-a4f5-74ca85a3fff3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:42.643697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.644208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.645268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.646034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.646497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.655301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.660904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9284afad-2ab8-4f53-a4f5-74ca85a3fff3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.668351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9284afad-2ab8-4f53-a4f5-74ca85a3fff3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.669028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9284afad-2ab8-4f53-a4f5-74ca85a3fff3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.670387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9284afad-2ab8-4f53-a4f5-74ca85a3fff3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.672425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9284afad-2ab8-4f53-a4f5-74ca85a3fff3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.672871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9284afad-2ab8-4f53-a4f5-74ca85a3fff3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.696944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:42.853843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:42.865263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:42.866710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:42.867950 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-44536e0c-dbaa-4e32-9eda-9421c71ee6e2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.264117 Oct 04 18:22:42.887130 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2424/4865] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:42 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:43.114082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9284afad-2ab8-4f53-a4f5-74ca85a3fff3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:43.130718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9284afad-2ab8-4f53-a4f5-74ca85a3fff3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1489 microversion: 2.1 time: 0.494771 Oct 04 18:22:43.133084 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2442/4866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:42 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1489 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:43.163520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-545827262", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:43.164160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb3cd184-92c8-4d52-a25f-30a8eef2bd01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.165381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bb3cd184-92c8-4d52-a25f-30a8eef2bd01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:43.184767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb3cd184-92c8-4d52-a25f-30a8eef2bd01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.185819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb3cd184-92c8-4d52-a25f-30a8eef2bd01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.186498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb3cd184-92c8-4d52-a25f-30a8eef2bd01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.188130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb3cd184-92c8-4d52-a25f-30a8eef2bd01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.191109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb3cd184-92c8-4d52-a25f-30a8eef2bd01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.194000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb3cd184-92c8-4d52-a25f-30a8eef2bd01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.244641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:43.270981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] validate_networks() for [('c0332781-7a65-44bd-97e9-499f026b4225', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:43.603711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bb3cd184-92c8-4d52-a25f-30a8eef2bd01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:43.623308 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb3cd184-92c8-4d52-a25f-30a8eef2bd01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1489 microversion: 2.1 time: 0.467521 Oct 04 18:22:43.626071 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2443/4867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1489 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:43.650851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b9f35cfe-82ae-4647-a59d-68c90618d55a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.652081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b9f35cfe-82ae-4647-a59d-68c90618d55a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:43.661595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f35cfe-82ae-4647-a59d-68c90618d55a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.662779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f35cfe-82ae-4647-a59d-68c90618d55a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.663460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f35cfe-82ae-4647-a59d-68c90618d55a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.664407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f35cfe-82ae-4647-a59d-68c90618d55a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.665103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f35cfe-82ae-4647-a59d-68c90618d55a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.665998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9f35cfe-82ae-4647-a59d-68c90618d55a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.700373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b9f35cfe-82ae-4647-a59d-68c90618d55a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:43.834576 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b9f35cfe-82ae-4647-a59d-68c90618d55a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 204 len: 0 microversion: 2.1 time: 0.187529 Oct 04 18:22:43.836080 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2444/4868] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:22:43 2022] DELETE /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:22:43.845002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f34e8dd7-3476-499a-8289-51d206517db8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.845919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f34e8dd7-3476-499a-8289-51d206517db8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:43.853890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f34e8dd7-3476-499a-8289-51d206517db8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.854485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f34e8dd7-3476-499a-8289-51d206517db8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.855660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f34e8dd7-3476-499a-8289-51d206517db8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.857281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f34e8dd7-3476-499a-8289-51d206517db8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.857885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f34e8dd7-3476-499a-8289-51d206517db8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.858404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f34e8dd7-3476-499a-8289-51d206517db8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.237261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f34e8dd7-3476-499a-8289-51d206517db8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.255860 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f34e8dd7-3476-499a-8289-51d206517db8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1495 microversion: 2.1 time: 0.415096 Oct 04 18:22:44.258871 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2445/4869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1495 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:44.285575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:44.286856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:44.287521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:44.288029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:44.288521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:44.293631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:44.295993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:44.307627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.309499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.310146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.310759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.311008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.312131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.312391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.313386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.313513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.314675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.315244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.320548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.352560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Getting quotas for project ab1cdc33329a4a10970e67390f750163. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:44.359371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Getting quotas for user 5a7fc8671d264393bfb0465438b598d1 and project ab1cdc33329a4a10970e67390f750163. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:44.374733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:44.377470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:44.407987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.419699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.421104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.422719 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ffce546e-2580-469f-8757-dbf3a107bbb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.162357 Oct 04 18:22:44.423321 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2446/4870] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:44 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:44.429086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e394c18-4f41-4f16-8997-b4ac9d3ab677 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f2ed74d-1cd5-43e1-b517-b9767a51b2f7"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:44.445464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e394c18-4f41-4f16-8997-b4ac9d3ab677 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:44.452342 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-82537463-d579-420c-984d-8c2921a8936c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.562310 Oct 04 18:22:44.453664 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2425/4871] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:44.465222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e394c18-4f41-4f16-8997-b4ac9d3ab677 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.465998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e394c18-4f41-4f16-8997-b4ac9d3ab677 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.466613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e394c18-4f41-4f16-8997-b4ac9d3ab677 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.467530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e394c18-4f41-4f16-8997-b4ac9d3ab677 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.468204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e394c18-4f41-4f16-8997-b4ac9d3ab677 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.468843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e394c18-4f41-4f16-8997-b4ac9d3ab677 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.476322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-817e2512-a06d-47a3-9b16-ae5958f5db46 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:44.477421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-817e2512-a06d-47a3-9b16-ae5958f5db46 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:44.564992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-817e2512-a06d-47a3-9b16-ae5958f5db46 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.588239 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-817e2512-a06d-47a3-9b16-ae5958f5db46 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1221 microversion: 2.1 time: 0.123261 Oct 04 18:22:44.588746 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2426/4872] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:44 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1221 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:44.754046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1411379020", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:44.850394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] validate_networks() for [('c0332781-7a65-44bd-97e9-499f026b4225', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:45.317532 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e394c18-4f41-4f16-8997-b4ac9d3ab677 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "POST /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.892583 Oct 04 18:22:45.318201 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2447/4873] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:22:44 2022] POST /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments => generated 194 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:45.332072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-29214606-c9bf-4386-a5c4-7ad5921818cb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:45.332796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-29214606-c9bf-4386-a5c4-7ad5921818cb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:45.351333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29214606-c9bf-4386-a5c4-7ad5921818cb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.351840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29214606-c9bf-4386-a5c4-7ad5921818cb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.352336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29214606-c9bf-4386-a5c4-7ad5921818cb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.355957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29214606-c9bf-4386-a5c4-7ad5921818cb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.356468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29214606-c9bf-4386-a5c4-7ad5921818cb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.358245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29214606-c9bf-4386-a5c4-7ad5921818cb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.365195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:45.365825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:45.366756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:45.367308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:45.367941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:45.392968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.393552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.394738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.400644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.402383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.404390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.455421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Getting quotas for project ab1cdc33329a4a10970e67390f750163. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:45.463504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Getting quotas for user 5a7fc8671d264393bfb0465438b598d1 and project ab1cdc33329a4a10970e67390f750163. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:45.482936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:45.486218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:45.578308 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10ee6e06-8692-4e67-bf10-9592708986e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.827208 Oct 04 18:22:45.580998 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2427/4874] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:22:45.594386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:45.614986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:45.644642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.646450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.647178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.648164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.648863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.649511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.959828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.969752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.978285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.979686 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29011658-de86-4cfa-b541-39b9f9efb093 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.397084 Oct 04 18:22:45.986482 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2428/4875] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:45 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:45.997408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-57f37e47-e6d7-4afe-a21c-339031b4add2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:45.998382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57f37e47-e6d7-4afe-a21c-339031b4add2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:46.306877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-57f37e47-e6d7-4afe-a21c-339031b4add2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.327304 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-57f37e47-e6d7-4afe-a21c-339031b4add2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1222 microversion: 2.1 time: 0.339224 Oct 04 18:22:46.328274 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2429/4876] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:45 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1222 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:46.346181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-29214606-c9bf-4386-a5c4-7ad5921818cb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.371804 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-29214606-c9bf-4386-a5c4-7ad5921818cb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1495 microversion: 2.1 time: 1.049798 Oct 04 18:22:46.385963 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2448/4877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:45 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1495 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:47.004915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:47.005556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:47.025877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.035006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.035939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.038577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.039103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.039556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.347223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.357117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75ec7643-2e1b-4fea-a235-f2928e1883e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:47.358382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75ec7643-2e1b-4fea-a235-f2928e1883e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:47.363923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:47.365142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.369802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.374203 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-40e7645c-7ff8-44ef-862d-ce8e198bce90 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.373271 Oct 04 18:22:47.377022 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2430/4878] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:47.402015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-559b6345-f9cd-4124-9114-46c83a688d92 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:47.403260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-559b6345-f9cd-4124-9114-46c83a688d92 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:47.408381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ec7643-2e1b-4fea-a235-f2928e1883e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.409842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ec7643-2e1b-4fea-a235-f2928e1883e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.412157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ec7643-2e1b-4fea-a235-f2928e1883e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.418777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-559b6345-f9cd-4124-9114-46c83a688d92 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.419897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-559b6345-f9cd-4124-9114-46c83a688d92 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.420158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ec7643-2e1b-4fea-a235-f2928e1883e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.420547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-559b6345-f9cd-4124-9114-46c83a688d92 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.421013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ec7643-2e1b-4fea-a235-f2928e1883e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.421472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-559b6345-f9cd-4124-9114-46c83a688d92 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.421826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75ec7643-2e1b-4fea-a235-f2928e1883e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.422178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-559b6345-f9cd-4124-9114-46c83a688d92 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.422723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-559b6345-f9cd-4124-9114-46c83a688d92 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.694360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75ec7643-2e1b-4fea-a235-f2928e1883e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.706108 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75ec7643-2e1b-4fea-a235-f2928e1883e3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1274 microversion: 2.1 time: 0.353252 Oct 04 18:22:47.711683 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2449/4879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:47 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1274 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:48.029925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-559b6345-f9cd-4124-9114-46c83a688d92 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.052327 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-559b6345-f9cd-4124-9114-46c83a688d92 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1495 microversion: 2.1 time: 0.655384 Oct 04 18:22:48.052937 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2431/4880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:47 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1495 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:48.415529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:48.416198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:48.449301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.453975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.456563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.460118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.465123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.465291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.635638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.667833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.679111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.680756 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21a039b9-1695-4fad-916a-10f22709415d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.272559 Oct 04 18:22:48.687396 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2450/4881] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:48 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:48.734079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eb8a8454-53e6-42b9-847b-e2a0251ea71c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:48.734784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eb8a8454-53e6-42b9-847b-e2a0251ea71c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:48.766302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8a8454-53e6-42b9-847b-e2a0251ea71c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.767034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8a8454-53e6-42b9-847b-e2a0251ea71c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.767732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8a8454-53e6-42b9-847b-e2a0251ea71c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.771238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8a8454-53e6-42b9-847b-e2a0251ea71c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.771902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8a8454-53e6-42b9-847b-e2a0251ea71c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.772586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8a8454-53e6-42b9-847b-e2a0251ea71c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.829145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-14ba56ac-ee4b-47a6-a034-43fa4c5eebb6 req-19bf03e9-21aa-42f8-b6c0-b0498515389b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ae85e2-1194-4df1-bd8d-281764a602a2", "name": "network-vif-deleted", "tag": "86a516bb-c239-4534-b6e5-3a344f93aff3"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:48.850640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-14ba56ac-ee4b-47a6-a034-43fa4c5eebb6 req-19bf03e9-21aa-42f8-b6c0-b0498515389b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.857507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-14ba56ac-ee4b-47a6-a034-43fa4c5eebb6 req-19bf03e9-21aa-42f8-b6c0-b0498515389b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.871522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-14ba56ac-ee4b-47a6-a034-43fa4c5eebb6 req-19bf03e9-21aa-42f8-b6c0-b0498515389b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.918200 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-14ba56ac-ee4b-47a6-a034-43fa4c5eebb6 req-19bf03e9-21aa-42f8-b6c0-b0498515389b service nova] Creating event network-vif-deleted:86a516bb-c239-4534-b6e5-3a344f93aff3 for instance e0ae85e2-1194-4df1-bd8d-281764a602a2 on n-h1-850499-14 Oct 04 18:22:48.937041 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-14ba56ac-ee4b-47a6-a034-43fa4c5eebb6 req-19bf03e9-21aa-42f8-b6c0-b0498515389b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114161 Oct 04 18:22:48.938494 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2451/4882] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:49.032883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eb8a8454-53e6-42b9-847b-e2a0251ea71c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.045348 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eb8a8454-53e6-42b9-847b-e2a0251ea71c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1280 microversion: 2.1 time: 0.315279 Oct 04 18:22:49.046254 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2432/4883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:48 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1280 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:49.082163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.085413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:49.116229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.118787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.120553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.123110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.123851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.125252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.322262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.324508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.324868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.325362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lazy-loading 'fault' on Instance uuid e0ae85e2-1194-4df1-bd8d-281764a602a2 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:49.455225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.466403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-208cd8c2-342e-4066-862e-e88e23f50bf8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 200 len: 1298 microversion: 2.1 time: 0.390294 Oct 04 18:22:49.470289 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2452/4884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 1298 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:49.711802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.712427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:49.725638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.726176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.732400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.732636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.733301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.736355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.940754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.958177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.960127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.970697 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2b73a544-40b8-43e1-bd05-552da77d63c2 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.257018 Oct 04 18:22:49.971681 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2433/4885] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:50.070093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06677309-66ff-447b-9402-35b0bf524866 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.070818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-06677309-66ff-447b-9402-35b0bf524866 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:50.084068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06677309-66ff-447b-9402-35b0bf524866 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.086066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06677309-66ff-447b-9402-35b0bf524866 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.086811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06677309-66ff-447b-9402-35b0bf524866 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.087980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06677309-66ff-447b-9402-35b0bf524866 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.088651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06677309-66ff-447b-9402-35b0bf524866 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.089617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06677309-66ff-447b-9402-35b0bf524866 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.289403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-06677309-66ff-447b-9402-35b0bf524866 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:50.302627 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-06677309-66ff-447b-9402-35b0bf524866 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1280 microversion: 2.1 time: 0.237432 Oct 04 18:22:50.307603 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2453/4886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:50.496257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.497612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:50.510113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.510623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.511105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.511827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.512284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.512717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.597794 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 HTTP/1.1 Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'e0ae85e2-1194-4df1-bd8d-281764a602a2'} Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.599648 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.605528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:50.605528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:50.605528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:50.605528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:50.605528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:22:50.605528 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.605528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:50.615056 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-17f5f644-b421-40c3-89d8-d2c229313f25 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 404 len: 111 microversion: 2.1 time: 0.122791 Oct 04 18:22:50.620108 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2434/4887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:50.629605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eddb1f23-c81c-49e8-8f2a-67b09bad91f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.630659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eddb1f23-c81c-49e8-8f2a-67b09bad91f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:50.640380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eddb1f23-c81c-49e8-8f2a-67b09bad91f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.654741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eddb1f23-c81c-49e8-8f2a-67b09bad91f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.656439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eddb1f23-c81c-49e8-8f2a-67b09bad91f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.662879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eddb1f23-c81c-49e8-8f2a-67b09bad91f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.663452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eddb1f23-c81c-49e8-8f2a-67b09bad91f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.663944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eddb1f23-c81c-49e8-8f2a-67b09bad91f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.742163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eddb1f23-c81c-49e8-8f2a-67b09bad91f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:50.862598 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eddb1f23-c81c-49e8-8f2a-67b09bad91f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 204 len: 0 microversion: 2.1 time: 0.237911 Oct 04 18:22:50.864797 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2454/4888] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:22:50 2022] DELETE /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:22:50.875806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a4133f0-6078-4951-af54-96dd5d389801 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.876916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1a4133f0-6078-4951-af54-96dd5d389801 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:50.885899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a4133f0-6078-4951-af54-96dd5d389801 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.886592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a4133f0-6078-4951-af54-96dd5d389801 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.889384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a4133f0-6078-4951-af54-96dd5d389801 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.890368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a4133f0-6078-4951-af54-96dd5d389801 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.891247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a4133f0-6078-4951-af54-96dd5d389801 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.892670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a4133f0-6078-4951-af54-96dd5d389801 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.002765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:51.003570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:51.013187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.023743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.024417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.026027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.026726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.027391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.085444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:51.381416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.403039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.404597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.405890 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b3a90884-72c1-42fd-8926-ef06c8a02837 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.407801 Oct 04 18:22:51.407777 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2455/4889] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:51.421082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbeddab3-36f6-401c-8438-33f386ffc417 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:51.421836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bbeddab3-36f6-401c-8438-33f386ffc417 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:51.458102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbeddab3-36f6-401c-8438-33f386ffc417 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.460551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbeddab3-36f6-401c-8438-33f386ffc417 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.465900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbeddab3-36f6-401c-8438-33f386ffc417 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.467436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbeddab3-36f6-401c-8438-33f386ffc417 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.468054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbeddab3-36f6-401c-8438-33f386ffc417 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.468605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbeddab3-36f6-401c-8438-33f386ffc417 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.816454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1a4133f0-6078-4951-af54-96dd5d389801 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.826287 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1a4133f0-6078-4951-af54-96dd5d389801 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1495 microversion: 2.1 time: 0.956847 Oct 04 18:22:51.844659 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2435/4890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1495 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:51.885729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9e79b600-9733-4ec8-8b87-ef8095ba827a req-0f7f415c-7e5c-4ce5-886f-e1271518d8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5bebc4-0fb3-4027-a4ff-4ff8301fc986", "tag": "ece89644-26b6-4a98-bb80-88892df0fa10"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:51.917596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9e79b600-9733-4ec8-8b87-ef8095ba827a req-0f7f415c-7e5c-4ce5-886f-e1271518d8e6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.918083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9e79b600-9733-4ec8-8b87-ef8095ba827a req-0f7f415c-7e5c-4ce5-886f-e1271518d8e6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.918520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9e79b600-9733-4ec8-8b87-ef8095ba827a req-0f7f415c-7e5c-4ce5-886f-e1271518d8e6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.948970 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9e79b600-9733-4ec8-8b87-ef8095ba827a req-0f7f415c-7e5c-4ce5-886f-e1271518d8e6 service nova] Creating event network-changed:ece89644-26b6-4a98-bb80-88892df0fa10 for instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 on n-h2-850499-14 Oct 04 18:22:51.985735 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9e79b600-9733-4ec8-8b87-ef8095ba827a req-0f7f415c-7e5c-4ce5-886f-e1271518d8e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098088 Oct 04 18:22:51.986416 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2436/4891] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:52.070400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bbeddab3-36f6-401c-8438-33f386ffc417 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.086792 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bbeddab3-36f6-401c-8438-33f386ffc417 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1322 microversion: 2.1 time: 0.669674 Oct 04 18:22:52.088899 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2456/4892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:51 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1322 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:52.436038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:52.437038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:52.452408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.452696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.453117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.453902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.456814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.457948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.623001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.634594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.636095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.637300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-761e0a0e-08c6-47db-a350-41b9168ed40d tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.205705 Oct 04 18:22:52.670482 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2437/4893] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:52 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:52.853148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-41af9a6d-dadb-456f-9060-838553950dc6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:52.853936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-41af9a6d-dadb-456f-9060-838553950dc6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:52.873031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af9a6d-dadb-456f-9060-838553950dc6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.873548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af9a6d-dadb-456f-9060-838553950dc6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.874003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af9a6d-dadb-456f-9060-838553950dc6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.876693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af9a6d-dadb-456f-9060-838553950dc6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.877194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af9a6d-dadb-456f-9060-838553950dc6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.877639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-41af9a6d-dadb-456f-9060-838553950dc6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.113040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8c7c31f1-074b-4548-b1f4-83f686ed696a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:53.114929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8c7c31f1-074b-4548-b1f4-83f686ed696a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:53.130719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c7c31f1-074b-4548-b1f4-83f686ed696a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.131526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c7c31f1-074b-4548-b1f4-83f686ed696a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.133454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c7c31f1-074b-4548-b1f4-83f686ed696a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.134417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c7c31f1-074b-4548-b1f4-83f686ed696a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.136848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c7c31f1-074b-4548-b1f4-83f686ed696a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.137526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8c7c31f1-074b-4548-b1f4-83f686ed696a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.058147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-41af9a6d-dadb-456f-9060-838553950dc6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.072007 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-41af9a6d-dadb-456f-9060-838553950dc6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1495 microversion: 2.1 time: 1.223297 Oct 04 18:22:54.072614 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2457/4894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:52 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1495 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:54.082736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:54.084490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:54.104883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.105400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.105854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.106576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.107148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.107588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.186569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8c7c31f1-074b-4548-b1f4-83f686ed696a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.196833 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8c7c31f1-074b-4548-b1f4-83f686ed696a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1322 microversion: 2.1 time: 1.089077 Oct 04 18:22:54.203849 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2438/4895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:53 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1322 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:54.253729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-175c430a-0b87-4b21-b453-e83e30c7a918 req-183686eb-d7f8-467e-8443-2b11b4f11de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e05a66-3878-4adf-8aca-e4879467c8f2", "tag": "e6773ea1-ffb3-4c35-9826-3ff945971cd7"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:54.281281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-175c430a-0b87-4b21-b453-e83e30c7a918 req-183686eb-d7f8-467e-8443-2b11b4f11de6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.282049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-175c430a-0b87-4b21-b453-e83e30c7a918 req-183686eb-d7f8-467e-8443-2b11b4f11de6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.282690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-175c430a-0b87-4b21-b453-e83e30c7a918 req-183686eb-d7f8-467e-8443-2b11b4f11de6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.309244 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-175c430a-0b87-4b21-b453-e83e30c7a918 req-183686eb-d7f8-467e-8443-2b11b4f11de6 service nova] Creating event network-changed:e6773ea1-ffb3-4c35-9826-3ff945971cd7 for instance f2e05a66-3878-4adf-8aca-e4879467c8f2 on n-h1-850499-14 Oct 04 18:22:54.320718 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-175c430a-0b87-4b21-b453-e83e30c7a918 req-183686eb-d7f8-467e-8443-2b11b4f11de6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076636 Oct 04 18:22:54.321346 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2439/4896] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:54.393736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.421549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.426441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.428053 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-87919d5b-6a75-4195-aa20-28a8c1b9edc5 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.350555 Oct 04 18:22:54.448975 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2458/4897] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:54 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:54.860554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a5d741fc-2bfe-46e6-9c47-0a6c18caa076 req-26eb3a52-7dee-426c-b14f-4fd2116d5855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f162d0-8dc1-4492-ae25-95ac5531f187", "name": "network-vif-deleted", "tag": "a53fc705-c8db-4111-a431-435e2a585025"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:54.884045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a5d741fc-2bfe-46e6-9c47-0a6c18caa076 req-26eb3a52-7dee-426c-b14f-4fd2116d5855 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.884552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a5d741fc-2bfe-46e6-9c47-0a6c18caa076 req-26eb3a52-7dee-426c-b14f-4fd2116d5855 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.886792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a5d741fc-2bfe-46e6-9c47-0a6c18caa076 req-26eb3a52-7dee-426c-b14f-4fd2116d5855 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.929175 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a5d741fc-2bfe-46e6-9c47-0a6c18caa076 req-26eb3a52-7dee-426c-b14f-4fd2116d5855 service nova] Creating event network-vif-deleted:a53fc705-c8db-4111-a431-435e2a585025 for instance 17f162d0-8dc1-4492-ae25-95ac5531f187 on n-h1-850499-14 Oct 04 18:22:54.944330 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a5d741fc-2bfe-46e6-9c47-0a6c18caa076 req-26eb3a52-7dee-426c-b14f-4fd2116d5855 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088500 Oct 04 18:22:54.944918 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2440/4898] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:55.103818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:55.106246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:55.126654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.127498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.128450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.131404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.132077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.132810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.184382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.185083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.185801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.186275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lazy-loading 'fault' on Instance uuid 17f162d0-8dc1-4492-ae25-95ac5531f187 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:55.234022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-be171d5c-3b27-47ba-91c9-a7852c81a013 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:55.235402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-be171d5c-3b27-47ba-91c9-a7852c81a013 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:55.241363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.246416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be171d5c-3b27-47ba-91c9-a7852c81a013 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.246930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be171d5c-3b27-47ba-91c9-a7852c81a013 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.247413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be171d5c-3b27-47ba-91c9-a7852c81a013 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.248574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be171d5c-3b27-47ba-91c9-a7852c81a013 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.250107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be171d5c-3b27-47ba-91c9-a7852c81a013 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.251659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be171d5c-3b27-47ba-91c9-a7852c81a013 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.259095 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-344eca35-7476-47cf-a4ba-9c615042ba1a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1298 microversion: 2.1 time: 0.161928 Oct 04 18:22:55.260851 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2459/4899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:55 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1298 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:55.412153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:55.438698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be171d5c-3b27-47ba-91c9-a7852c81a013 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.453036 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-be171d5c-3b27-47ba-91c9-a7852c81a013 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1322 microversion: 2.1 time: 0.227910 Oct 04 18:22:55.453633 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2441/4900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:55 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:55.481015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:55.481548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:55.489435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.489936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.490376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.491785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.492430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.493038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.566558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.591681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.603037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.604392 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-58e72499-6265-4631-9589-9584fb6bdfb3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.129020 Oct 04 18:22:55.605193 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2460/4901] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:55 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:56.284577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.286473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.301085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.303546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.304240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.306210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.307784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.310177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.359293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=16 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:56.388491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.388981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.389422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.389873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lazy-loading 'fault' on Instance uuid 17f162d0-8dc1-4492-ae25-95ac5531f187 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:56.478106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f9c416c3-77b2-478c-9520-739140da2c15 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.479553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f9c416c3-77b2-478c-9520-739140da2c15 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.503607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9c416c3-77b2-478c-9520-739140da2c15 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.504884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9c416c3-77b2-478c-9520-739140da2c15 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.504884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9c416c3-77b2-478c-9520-739140da2c15 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.505444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9c416c3-77b2-478c-9520-739140da2c15 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.505909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9c416c3-77b2-478c-9520-739140da2c15 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.506342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f9c416c3-77b2-478c-9520-739140da2c15 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.529361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.596630 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c9c8462e-232f-409c-8bb9-1c2e515d3625 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 200 len: 1298 microversion: 2.1 time: 0.315761 Oct 04 18:22:56.597860 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2442/4902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 1298 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:56.650149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.652009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.674253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.675467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.677247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.678692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.682068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.682706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.838762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.853522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.856441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.858902 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0321291c-ae3c-48c9-923e-eee67a74c01f tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.228588 Oct 04 18:22:56.871693 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2443/4903] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:56.915936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f9c416c3-77b2-478c-9520-739140da2c15 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.930803 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f9c416c3-77b2-478c-9520-739140da2c15 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1322 microversion: 2.1 time: 0.456951 Oct 04 18:22:56.932343 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2461/4904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:57.623828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.624857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.632635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.633199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.633703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.634465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.635109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.635623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.650376 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 HTTP/1.1 Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '17f162d0-8dc1-4492-ae25-95ac5531f187'} Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:57.652292 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:57.656776 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:57.656776 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:57.656776 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:57.656776 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:57.656776 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:22:57.656776 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:22:57.657829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:57.658665 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3a8bda5a-e4c5-4358-8984-ff998a5cde33 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 404 len: 111 microversion: 2.1 time: 0.039119 Oct 04 18:22:57.659249 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2444/4905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:57.775671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1464676836", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "5be520db-1d2d-4d71-923d-9d8728cd44bc"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:57.860956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] validate_networks() for [('5be520db-1d2d-4d71-923d-9d8728cd44bc', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:57.889638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.890255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.898579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.899517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.900324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.901159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.901762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.908423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.146791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:58.166877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:58.168774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:58.171238 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c122f3ac-6df0-402c-bb0a-ecf7a3ce4683 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.285285 Oct 04 18:22:58.193314 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2445/4906] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:58.199434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b6b83fae-5616-4182-88f0-f38249e9c9b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:58.200106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b6b83fae-5616-4182-88f0-f38249e9c9b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:58.221946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b83fae-5616-4182-88f0-f38249e9c9b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.223421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b83fae-5616-4182-88f0-f38249e9c9b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.228689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b83fae-5616-4182-88f0-f38249e9c9b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.229567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b83fae-5616-4182-88f0-f38249e9c9b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.230291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b83fae-5616-4182-88f0-f38249e9c9b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.230839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6b83fae-5616-4182-88f0-f38249e9c9b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.548193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6b83fae-5616-4182-88f0-f38249e9c9b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:58.568382 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b6b83fae-5616-4182-88f0-f38249e9c9b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1322 microversion: 2.1 time: 0.373466 Oct 04 18:22:58.569710 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2446/4907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:58 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:58.985691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:58.986217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:58.986624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:58.987017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:58.989687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:59.001886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.002623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.003374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.004932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.005619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.006219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.039272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:59.047701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for user 41e49c77352541cb94dcd12277f7ee67 and project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:59.065796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:59.068966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:59.125794 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-561a8be9-29c2-41cf-a265-5d8d4ddb41c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.354057 Oct 04 18:22:59.126468 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2462/4908] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:59.138425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-779133eb-75b1-4d9b-8109-7da23c5bcf49 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:59.139072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-779133eb-75b1-4d9b-8109-7da23c5bcf49 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.202345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:59.203452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.216918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.217780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.218568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.220442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.222572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.223287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-779133eb-75b1-4d9b-8109-7da23c5bcf49 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.224818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.234108 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-779133eb-75b1-4d9b-8109-7da23c5bcf49 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1209 microversion: 2.1 time: 0.098893 Oct 04 18:22:59.244980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2447/4909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:59 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:59.327752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.337894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.339683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.341322 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3c7f4e2b-0fc9-40c3-80f6-97eb7917f0fe tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1365 microversion: 2.47 time: 0.146196 Oct 04 18:22:59.342631 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2463/4910] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:59 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:59.597562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9509ba80-2f2f-44fa-86ca-958c658dfb59 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:59.598466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9509ba80-2f2f-44fa-86ca-958c658dfb59 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.611177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9509ba80-2f2f-44fa-86ca-958c658dfb59 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.612020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9509ba80-2f2f-44fa-86ca-958c658dfb59 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.614566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9509ba80-2f2f-44fa-86ca-958c658dfb59 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.615513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9509ba80-2f2f-44fa-86ca-958c658dfb59 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.619566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9509ba80-2f2f-44fa-86ca-958c658dfb59 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.620005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9509ba80-2f2f-44fa-86ca-958c658dfb59 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.649644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:59.825220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9509ba80-2f2f-44fa-86ca-958c658dfb59 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.834438 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9509ba80-2f2f-44fa-86ca-958c658dfb59 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1322 microversion: 2.1 time: 0.242684 Oct 04 18:22:59.835043 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2448/4911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:59 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:00.051294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e50f1164-e836-4948-8baa-bc6f7527b2b8 req-bbce5ebb-ab9f-4b29-87aa-cec882b0ce5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e05a66-3878-4adf-8aca-e4879467c8f2", "name": "network-vif-plugged", "status": "completed", "tag": "e6773ea1-ffb3-4c35-9826-3ff945971cd7"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:00.078522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e50f1164-e836-4948-8baa-bc6f7527b2b8 req-bbce5ebb-ab9f-4b29-87aa-cec882b0ce5f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.079292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e50f1164-e836-4948-8baa-bc6f7527b2b8 req-bbce5ebb-ab9f-4b29-87aa-cec882b0ce5f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.079901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e50f1164-e836-4948-8baa-bc6f7527b2b8 req-bbce5ebb-ab9f-4b29-87aa-cec882b0ce5f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.106520 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e50f1164-e836-4948-8baa-bc6f7527b2b8 req-bbce5ebb-ab9f-4b29-87aa-cec882b0ce5f service nova] Creating event network-vif-plugged:e6773ea1-ffb3-4c35-9826-3ff945971cd7 for instance f2e05a66-3878-4adf-8aca-e4879467c8f2 on n-h1-850499-14 Oct 04 18:23:00.125860 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e50f1164-e836-4948-8baa-bc6f7527b2b8 req-bbce5ebb-ab9f-4b29-87aa-cec882b0ce5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078660 Oct 04 18:23:00.126645 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2464/4912] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:00.259850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05a151b0-a914-4f0c-873f-d9915a191d02 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:00.261117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-05a151b0-a914-4f0c-873f-d9915a191d02 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:00.270322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:00.273046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a151b0-a914-4f0c-873f-d9915a191d02 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.273752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a151b0-a914-4f0c-873f-d9915a191d02 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.274396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a151b0-a914-4f0c-873f-d9915a191d02 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.277559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a151b0-a914-4f0c-873f-d9915a191d02 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.278213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a151b0-a914-4f0c-873f-d9915a191d02 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.278809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a151b0-a914-4f0c-873f-d9915a191d02 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.371083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:00.372163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:00.382449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.394017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.395366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.396648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.397339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.397942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.412358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-05a151b0-a914-4f0c-873f-d9915a191d02 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.429912 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-05a151b0-a914-4f0c-873f-d9915a191d02 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1261 microversion: 2.1 time: 0.175386 Oct 04 18:23:00.444424 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2449/4913] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:00 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:00.535728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.545723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.547490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.549039 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4076b088-80c5-480c-8b65-2c46d7f37e08 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1371 microversion: 2.47 time: 0.183506 Oct 04 18:23:00.550202 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2465/4914] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:00 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:23:00.859232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca329592-c87f-4f02-a7f0-a94f0784151b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:00.860218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ca329592-c87f-4f02-a7f0-a94f0784151b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:00.869724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca329592-c87f-4f02-a7f0-a94f0784151b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.870383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca329592-c87f-4f02-a7f0-a94f0784151b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.871612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca329592-c87f-4f02-a7f0-a94f0784151b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.874794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca329592-c87f-4f02-a7f0-a94f0784151b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.875581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca329592-c87f-4f02-a7f0-a94f0784151b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.876277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ca329592-c87f-4f02-a7f0-a94f0784151b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.448883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ca329592-c87f-4f02-a7f0-a94f0784151b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.457232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce6bc45e-84ed-4aa5-9f0c-57197e72163e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.457768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ca329592-c87f-4f02-a7f0-a94f0784151b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1322 microversion: 2.1 time: 0.602479 Oct 04 18:23:01.457876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ce6bc45e-84ed-4aa5-9f0c-57197e72163e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:01.459572 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2450/4915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:00 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:01.474858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6bc45e-84ed-4aa5-9f0c-57197e72163e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.475776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6bc45e-84ed-4aa5-9f0c-57197e72163e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.476279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6bc45e-84ed-4aa5-9f0c-57197e72163e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.477162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6bc45e-84ed-4aa5-9f0c-57197e72163e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.478159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6bc45e-84ed-4aa5-9f0c-57197e72163e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.478578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6bc45e-84ed-4aa5-9f0c-57197e72163e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.556276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce6bc45e-84ed-4aa5-9f0c-57197e72163e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.567002 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce6bc45e-84ed-4aa5-9f0c-57197e72163e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1279 microversion: 2.1 time: 0.114914 Oct 04 18:23:01.579202 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2466/4916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:01 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1279 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:01.579735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.580826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:01.588790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.589289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.589838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.590836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.591284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.592708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.662104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.671306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.673014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.674202 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c265bbd9-4274-4a15-8cd9-98f7fb63435a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1371 microversion: 2.47 time: 0.100532 Oct 04 18:23:01.674771 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2451/4917] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:01 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:02.173129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-6d9e6991-061a-4431-96e9-f0e321f00442 req-5241d664-44cf-4f41-b4d6-b0e389580092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5bebc4-0fb3-4027-a4ff-4ff8301fc986", "name": "network-vif-plugged", "status": "completed", "tag": "ece89644-26b6-4a98-bb80-88892df0fa10"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:02.187339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6d9e6991-061a-4431-96e9-f0e321f00442 req-5241d664-44cf-4f41-b4d6-b0e389580092 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.188407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6d9e6991-061a-4431-96e9-f0e321f00442 req-5241d664-44cf-4f41-b4d6-b0e389580092 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.189049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6d9e6991-061a-4431-96e9-f0e321f00442 req-5241d664-44cf-4f41-b4d6-b0e389580092 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.203880 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-6d9e6991-061a-4431-96e9-f0e321f00442 req-5241d664-44cf-4f41-b4d6-b0e389580092 service nova] Creating event network-vif-plugged:ece89644-26b6-4a98-bb80-88892df0fa10 for instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 on n-h2-850499-14 Oct 04 18:23:02.209562 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-6d9e6991-061a-4431-96e9-f0e321f00442 req-5241d664-44cf-4f41-b4d6-b0e389580092 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044047 Oct 04 18:23:02.214509 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2467/4918] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:02.469789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-41e8961f-acc8-4601-8860-52216872268e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:02.474131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-41e8961f-acc8-4601-8860-52216872268e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:02.485756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f1bd88f-2b05-41a6-bc31-c893d9ff30de tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:02.487736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f1bd88f-2b05-41a6-bc31-c893d9ff30de tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:02.495653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e8961f-acc8-4601-8860-52216872268e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.496259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e8961f-acc8-4601-8860-52216872268e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.496680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e8961f-acc8-4601-8860-52216872268e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.503263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e8961f-acc8-4601-8860-52216872268e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.504164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e8961f-acc8-4601-8860-52216872268e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.504805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41e8961f-acc8-4601-8860-52216872268e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.510019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f1bd88f-2b05-41a6-bc31-c893d9ff30de tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.511065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f1bd88f-2b05-41a6-bc31-c893d9ff30de tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.511757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f1bd88f-2b05-41a6-bc31-c893d9ff30de tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.512737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f1bd88f-2b05-41a6-bc31-c893d9ff30de tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.513420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f1bd88f-2b05-41a6-bc31-c893d9ff30de tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.514222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f1bd88f-2b05-41a6-bc31-c893d9ff30de tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.956508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f1bd88f-2b05-41a6-bc31-c893d9ff30de tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:02.989717 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f1bd88f-2b05-41a6-bc31-c893d9ff30de tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1516 microversion: 2.1 time: 0.509559 Oct 04 18:23:02.990940 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2468/4919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:02 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1516 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:02.996116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b0d379d7-af8e-422d-a917-438ae89124b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:02.997030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b0d379d7-af8e-422d-a917-438ae89124b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.021508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0d379d7-af8e-422d-a917-438ae89124b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.022007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0d379d7-af8e-422d-a917-438ae89124b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.022451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0d379d7-af8e-422d-a917-438ae89124b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.024411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0d379d7-af8e-422d-a917-438ae89124b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.027449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0d379d7-af8e-422d-a917-438ae89124b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.027969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0d379d7-af8e-422d-a917-438ae89124b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.028837 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-41e8961f-acc8-4601-8860-52216872268e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.575726 Oct 04 18:23:03.030387 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2452/4920] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:23:02 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments => generated 371 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:03.035451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:03.036190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.046069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.046936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.047697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.048698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.049718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.050983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.216198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:03.232549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:03.234500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:03.237013 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de0e4e76-f14d-47d0-a189-7e0086e483c3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1371 microversion: 2.47 time: 0.205174 Oct 04 18:23:03.237584 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2453/4921] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:03 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:03.250103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f75f47c1-927e-41ba-9a9d-9207c206cad9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:03.252554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f75f47c1-927e-41ba-9a9d-9207c206cad9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.273438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f75f47c1-927e-41ba-9a9d-9207c206cad9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.273973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f75f47c1-927e-41ba-9a9d-9207c206cad9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.274478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f75f47c1-927e-41ba-9a9d-9207c206cad9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.276021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f75f47c1-927e-41ba-9a9d-9207c206cad9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.277517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f75f47c1-927e-41ba-9a9d-9207c206cad9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.277968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f75f47c1-927e-41ba-9a9d-9207c206cad9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.323058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f75f47c1-927e-41ba-9a9d-9207c206cad9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lazy-loading 'flavor' on Instance uuid f2e05a66-3878-4adf-8aca-e4879467c8f2 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:03.447708 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f75f47c1-927e-41ba-9a9d-9207c206cad9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2/action" status: 200 len: 32 microversion: 2.1 time: 0.200596 Oct 04 18:23:03.448600 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2454/4922] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:03 2022] POST /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:23:03.457775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df81c900-ee8e-4e62-930f-e9c854593770 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:03.459301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-df81c900-ee8e-4e62-930f-e9c854593770 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.471175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df81c900-ee8e-4e62-930f-e9c854593770 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.472990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df81c900-ee8e-4e62-930f-e9c854593770 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.473500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df81c900-ee8e-4e62-930f-e9c854593770 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.476241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df81c900-ee8e-4e62-930f-e9c854593770 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.476631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df81c900-ee8e-4e62-930f-e9c854593770 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.477633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df81c900-ee8e-4e62-930f-e9c854593770 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.499327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0d379d7-af8e-422d-a917-438ae89124b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:03.511428 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b0d379d7-af8e-422d-a917-438ae89124b9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1309 microversion: 2.1 time: 0.519125 Oct 04 18:23:03.519219 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-df81c900-ee8e-4e62-930f-e9c854593770 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments/5bcc2917-a334-4701-8f45-a442510fe63e" status: 200 len: 194 microversion: 2.1 time: 0.069082 Oct 04 18:23:03.520758 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2455/4923] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Oct 4 18:23:03 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments/5bcc2917-a334-4701-8f45-a442510fe63e => generated 194 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:03.524210 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2469/4924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:02 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1309 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:03.525971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-90b8ad3c-fa0d-4a32-b388-b0b43d890e0c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:03.527196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-90b8ad3c-fa0d-4a32-b388-b0b43d890e0c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.533821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90b8ad3c-fa0d-4a32-b388-b0b43d890e0c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.534540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90b8ad3c-fa0d-4a32-b388-b0b43d890e0c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.535299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d7740c4-a6ea-48ce-9ad4-b22dca63b100 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:03.535889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90b8ad3c-fa0d-4a32-b388-b0b43d890e0c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.536159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5d7740c4-a6ea-48ce-9ad4-b22dca63b100 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.537397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90b8ad3c-fa0d-4a32-b388-b0b43d890e0c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.538033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90b8ad3c-fa0d-4a32-b388-b0b43d890e0c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.538635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90b8ad3c-fa0d-4a32-b388-b0b43d890e0c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.542874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d7740c4-a6ea-48ce-9ad4-b22dca63b100 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.543474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d7740c4-a6ea-48ce-9ad4-b22dca63b100 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.543924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d7740c4-a6ea-48ce-9ad4-b22dca63b100 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.544651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d7740c4-a6ea-48ce-9ad4-b22dca63b100 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.545251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d7740c4-a6ea-48ce-9ad4-b22dca63b100 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.545695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d7740c4-a6ea-48ce-9ad4-b22dca63b100 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.642600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-5d7740c4-a6ea-48ce-9ad4-b22dca63b100 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lazy-loading 'services' on Instance uuid 1908ea35-63c6-453c-b505-ce3990be8cef {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:03.741387 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d7740c4-a6ea-48ce-9ad4-b22dca63b100 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments/5bcc2917-a334-4701-8f45-a442510fe63e" status: 202 len: 0 microversion: 2.1 time: 0.208807 Oct 04 18:23:03.761191 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2470/4925] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:23:03 2022] DELETE /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments/5bcc2917-a334-4701-8f45-a442510fe63e => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:03.849981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-0b9b2b9e-5686-47fd-8966-311fec4e0e27 req-b89d1b44-3d02-4146-b2f9-eff9c811a4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac9e6ac-3620-4023-bc53-1b6706fd2f82", "tag": "928ba257-fce5-4424-ae7b-917acc406c08"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:03.874414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0b9b2b9e-5686-47fd-8966-311fec4e0e27 req-b89d1b44-3d02-4146-b2f9-eff9c811a4ef service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.875506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0b9b2b9e-5686-47fd-8966-311fec4e0e27 req-b89d1b44-3d02-4146-b2f9-eff9c811a4ef service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.883231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0b9b2b9e-5686-47fd-8966-311fec4e0e27 req-b89d1b44-3d02-4146-b2f9-eff9c811a4ef service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.912486 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-0b9b2b9e-5686-47fd-8966-311fec4e0e27 req-b89d1b44-3d02-4146-b2f9-eff9c811a4ef service nova] Creating event network-changed:928ba257-fce5-4424-ae7b-917acc406c08 for instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 on n-h1-850499-14 Oct 04 18:23:03.919257 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-0b9b2b9e-5686-47fd-8966-311fec4e0e27 req-b89d1b44-3d02-4146-b2f9-eff9c811a4ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075648 Oct 04 18:23:03.920478 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2471/4926] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:23:04.007927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90b8ad3c-fa0d-4a32-b388-b0b43d890e0c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.031136 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-90b8ad3c-fa0d-4a32-b388-b0b43d890e0c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.507195 Oct 04 18:23:04.033529 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2456/4927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:03 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:04.263037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.264060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:04.274652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.275192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.275636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.276346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.276841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.277620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.419047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.430081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.432510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.433750 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-125baa98-e5c3-4e17-ab28-7a601c3a658e tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1371 microversion: 2.47 time: 0.175407 Oct 04 18:23:04.434920 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2472/4928] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:04 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:04.536854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-814a9ae8-be16-4ee1-a03a-955e859d285b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.537488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-814a9ae8-be16-4ee1-a03a-955e859d285b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:04.545412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-814a9ae8-be16-4ee1-a03a-955e859d285b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.545929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-814a9ae8-be16-4ee1-a03a-955e859d285b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.546381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-814a9ae8-be16-4ee1-a03a-955e859d285b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.547139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-814a9ae8-be16-4ee1-a03a-955e859d285b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.547864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-814a9ae8-be16-4ee1-a03a-955e859d285b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.548312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-814a9ae8-be16-4ee1-a03a-955e859d285b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.988725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-814a9ae8-be16-4ee1-a03a-955e859d285b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.998174 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-814a9ae8-be16-4ee1-a03a-955e859d285b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1309 microversion: 2.1 time: 0.465715 Oct 04 18:23:04.999399 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2457/4929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:04 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1309 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:05.061267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ce4e125-9b35-4c4d-81e9-6f9d1d9672f5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:05.063310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ce4e125-9b35-4c4d-81e9-6f9d1d9672f5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:05.072884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ce4e125-9b35-4c4d-81e9-6f9d1d9672f5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.073660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ce4e125-9b35-4c4d-81e9-6f9d1d9672f5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.074318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ce4e125-9b35-4c4d-81e9-6f9d1d9672f5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.075393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ce4e125-9b35-4c4d-81e9-6f9d1d9672f5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.076308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ce4e125-9b35-4c4d-81e9-6f9d1d9672f5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.077224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ce4e125-9b35-4c4d-81e9-6f9d1d9672f5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.311914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ce4e125-9b35-4c4d-81e9-6f9d1d9672f5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:05.315843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:05.321350 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ce4e125-9b35-4c4d-81e9-6f9d1d9672f5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.267401 Oct 04 18:23:05.321949 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2473/4930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:05 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:05.464990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:05.465901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:05.480311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.490287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.490513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.491340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.492005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.492766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.587875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:05.598067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:05.599749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:05.601104 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70842ebb-079a-41aa-a2c0-5fbc07a7a5e3 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1371 microversion: 2.47 time: 0.141577 Oct 04 18:23:05.602136 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2458/4931] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:05 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:06.045813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4478908-9023-46ec-b571-2d0da8103b0e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:06.049824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f4478908-9023-46ec-b571-2d0da8103b0e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:06.090922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4478908-9023-46ec-b571-2d0da8103b0e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.091703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4478908-9023-46ec-b571-2d0da8103b0e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.104584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4478908-9023-46ec-b571-2d0da8103b0e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.113313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4478908-9023-46ec-b571-2d0da8103b0e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.114201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4478908-9023-46ec-b571-2d0da8103b0e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.114889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4478908-9023-46ec-b571-2d0da8103b0e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.345142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96655c42-87f5-4b91-8385-7db458887122 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:06.346099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96655c42-87f5-4b91-8385-7db458887122 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:06.359521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96655c42-87f5-4b91-8385-7db458887122 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.360040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96655c42-87f5-4b91-8385-7db458887122 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.362315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96655c42-87f5-4b91-8385-7db458887122 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.364883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96655c42-87f5-4b91-8385-7db458887122 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.365599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96655c42-87f5-4b91-8385-7db458887122 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.369241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96655c42-87f5-4b91-8385-7db458887122 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.627257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f4478908-9023-46ec-b571-2d0da8103b0e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.639043 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f4478908-9023-46ec-b571-2d0da8103b0e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1309 microversion: 2.1 time: 0.621358 Oct 04 18:23:06.660344 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2474/4932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:06 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1309 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:06.665647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:06.666279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:06.682072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.682591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.683074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.685423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.687585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.693900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.754074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96655c42-87f5-4b91-8385-7db458887122 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.777487 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96655c42-87f5-4b91-8385-7db458887122 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.434439 Oct 04 18:23:06.778103 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2459/4933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:06 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:06.909046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.923384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.934467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.946092 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-88787939-1e72-47cb-9720-ddadf262899a tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1356 microversion: 2.47 time: 0.284597 Oct 04 18:23:06.947249 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2475/4934] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:06 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1356 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:06.975166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:06.985926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.987744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Searching by: {'deleted': False, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:23:06.999181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.999664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.006233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.007531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.009693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.010337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.199431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:23:07.318322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.325973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.326551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.327085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.339737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.341668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.424305 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee67b917-6f37-4b6a-92f8-81958f942a11 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.454024 Oct 04 18:23:07.424984 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2460/4935] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 4 18:23:06 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:07.464245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06dd64ce-de65-48b5-9fba-f880faf02b4b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:07.465505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-06dd64ce-de65-48b5-9fba-f880faf02b4b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.484169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06dd64ce-de65-48b5-9fba-f880faf02b4b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.485560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06dd64ce-de65-48b5-9fba-f880faf02b4b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.486243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06dd64ce-de65-48b5-9fba-f880faf02b4b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.488281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06dd64ce-de65-48b5-9fba-f880faf02b4b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.489365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06dd64ce-de65-48b5-9fba-f880faf02b4b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.490053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06dd64ce-de65-48b5-9fba-f880faf02b4b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.536926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-06dd64ce-de65-48b5-9fba-f880faf02b4b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:07.664500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2149c6d1-8de3-45b5-be50-fd599e5b0a23 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:07.665451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2149c6d1-8de3-45b5-be50-fd599e5b0a23 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.694886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2149c6d1-8de3-45b5-be50-fd599e5b0a23 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.695487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2149c6d1-8de3-45b5-be50-fd599e5b0a23 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.696052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2149c6d1-8de3-45b5-be50-fd599e5b0a23 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.698131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2149c6d1-8de3-45b5-be50-fd599e5b0a23 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.698846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2149c6d1-8de3-45b5-be50-fd599e5b0a23 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.699472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2149c6d1-8de3-45b5-be50-fd599e5b0a23 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.699590 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-06dd64ce-de65-48b5-9fba-f880faf02b4b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 204 len: 0 microversion: 2.47 time: 0.239631 Oct 04 18:23:07.700583 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2476/4936] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:23:07 2022] DELETE /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:23:07.713627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:07.714564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.723629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.725308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.725835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.726750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.727695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.729081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.895225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.919539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.924313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.929805 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-569b9a41-b9ee-404b-a939-533017a72cd0 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1362 microversion: 2.47 time: 0.224644 Oct 04 18:23:07.940045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2477/4937] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:07 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:07.969037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-24ee46cd-34c8-476a-a6b2-5d65199c65bf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:07.969677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-24ee46cd-34c8-476a-a6b2-5d65199c65bf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.981363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24ee46cd-34c8-476a-a6b2-5d65199c65bf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.982190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24ee46cd-34c8-476a-a6b2-5d65199c65bf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.982875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24ee46cd-34c8-476a-a6b2-5d65199c65bf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.983818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24ee46cd-34c8-476a-a6b2-5d65199c65bf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.984512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24ee46cd-34c8-476a-a6b2-5d65199c65bf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.985242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24ee46cd-34c8-476a-a6b2-5d65199c65bf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.063489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2149c6d1-8de3-45b5-be50-fd599e5b0a23 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:08.083725 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2149c6d1-8de3-45b5-be50-fd599e5b0a23 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1309 microversion: 2.1 time: 0.425579 Oct 04 18:23:08.090562 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2461/4938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:07 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1309 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:08.223483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-24ee46cd-34c8-476a-a6b2-5d65199c65bf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:08.237449 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-24ee46cd-34c8-476a-a6b2-5d65199c65bf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.295417 Oct 04 18:23:08.239437 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2478/4939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:07 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:08.969637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:08.970273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:08.990917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.991476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.991931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.992672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.993158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.993585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.031662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:09.114281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-05dbcb75-4727-4c57-8261-ce39f29e986f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:09.115754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-05dbcb75-4727-4c57-8261-ce39f29e986f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:09.119919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:09.123272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:09.132020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05dbcb75-4727-4c57-8261-ce39f29e986f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.132935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05dbcb75-4727-4c57-8261-ce39f29e986f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.133593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05dbcb75-4727-4c57-8261-ce39f29e986f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.134519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05dbcb75-4727-4c57-8261-ce39f29e986f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.135382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05dbcb75-4727-4c57-8261-ce39f29e986f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.136850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05dbcb75-4727-4c57-8261-ce39f29e986f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.291911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.310335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.312684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.314316 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ae7f3449-a676-40bf-9b0b-660ff194f4b6 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1362 microversion: 2.47 time: 0.356515 Oct 04 18:23:09.315964 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2462/4940] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:08 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:09.330223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b363458c-b4c0-424c-83c8-aae7ee493af1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:09.331190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b363458c-b4c0-424c-83c8-aae7ee493af1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:09.342802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b363458c-b4c0-424c-83c8-aae7ee493af1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.351487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b363458c-b4c0-424c-83c8-aae7ee493af1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.352389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b363458c-b4c0-424c-83c8-aae7ee493af1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.355246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b363458c-b4c0-424c-83c8-aae7ee493af1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.355997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b363458c-b4c0-424c-83c8-aae7ee493af1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.356732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b363458c-b4c0-424c-83c8-aae7ee493af1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.423795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-05dbcb75-4727-4c57-8261-ce39f29e986f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.453101 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-05dbcb75-4727-4c57-8261-ce39f29e986f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1309 microversion: 2.1 time: 0.343306 Oct 04 18:23:09.454475 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2479/4941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:09 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1309 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:09.780929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b363458c-b4c0-424c-83c8-aae7ee493af1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.790389 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b363458c-b4c0-424c-83c8-aae7ee493af1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.472057 Oct 04 18:23:09.798040 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2463/4942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:09 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:10.077341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4d1f8927-8f6a-41ab-a4f5-524110cd4eb5 req-bd96d560-2ef8-41e1-a64d-ff14a664eadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac9e6ac-3620-4023-bc53-1b6706fd2f82", "name": "network-vif-plugged", "status": "completed", "tag": "928ba257-fce5-4424-ae7b-917acc406c08"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:10.103413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4d1f8927-8f6a-41ab-a4f5-524110cd4eb5 req-bd96d560-2ef8-41e1-a64d-ff14a664eadf service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.112057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4d1f8927-8f6a-41ab-a4f5-524110cd4eb5 req-bd96d560-2ef8-41e1-a64d-ff14a664eadf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.115446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4d1f8927-8f6a-41ab-a4f5-524110cd4eb5 req-bd96d560-2ef8-41e1-a64d-ff14a664eadf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.164923 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4d1f8927-8f6a-41ab-a4f5-524110cd4eb5 req-bd96d560-2ef8-41e1-a64d-ff14a664eadf service nova] Creating event network-vif-plugged:928ba257-fce5-4424-ae7b-917acc406c08 for instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 on n-h1-850499-14 Oct 04 18:23:10.177769 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4d1f8927-8f6a-41ab-a4f5-524110cd4eb5 req-bd96d560-2ef8-41e1-a64d-ff14a664eadf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108574 Oct 04 18:23:10.181757 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2480/4943] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:10.347757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.349005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.370214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.372337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.373478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.374228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.374834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.375970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.484052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01a96029-727c-49cf-ae8b-52d1fc6b22e1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.484788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01a96029-727c-49cf-ae8b-52d1fc6b22e1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.498506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a96029-727c-49cf-ae8b-52d1fc6b22e1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.500955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a96029-727c-49cf-ae8b-52d1fc6b22e1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.501434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a96029-727c-49cf-ae8b-52d1fc6b22e1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.502187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a96029-727c-49cf-ae8b-52d1fc6b22e1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.502667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a96029-727c-49cf-ae8b-52d1fc6b22e1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.505658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01a96029-727c-49cf-ae8b-52d1fc6b22e1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.508460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:10.532219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:10.535000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:10.536614 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c7736180-481e-4efd-86eb-e8e2d0136a57 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1362 microversion: 2.47 time: 0.195303 Oct 04 18:23:10.537402 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2464/4944] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:10 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:10.817975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e08e98ee-680b-45ba-9e25-424c0abbb4f6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.818792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e08e98ee-680b-45ba-9e25-424c0abbb4f6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.830786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01a96029-727c-49cf-ae8b-52d1fc6b22e1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:10.839414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e08e98ee-680b-45ba-9e25-424c0abbb4f6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.843099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e08e98ee-680b-45ba-9e25-424c0abbb4f6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.846726 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01a96029-727c-49cf-ae8b-52d1fc6b22e1 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1309 microversion: 2.1 time: 0.371818 Oct 04 18:23:10.848656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e08e98ee-680b-45ba-9e25-424c0abbb4f6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.849570 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2481/4945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:10 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:10.851195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e08e98ee-680b-45ba-9e25-424c0abbb4f6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.852907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e08e98ee-680b-45ba-9e25-424c0abbb4f6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.854875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e08e98ee-680b-45ba-9e25-424c0abbb4f6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.864548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a0a13430-0e6d-419a-a149-24c71b5c533d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.867000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a0a13430-0e6d-419a-a149-24c71b5c533d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.887189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0a13430-0e6d-419a-a149-24c71b5c533d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.887712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0a13430-0e6d-419a-a149-24c71b5c533d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.888176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0a13430-0e6d-419a-a149-24c71b5c533d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.888989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0a13430-0e6d-419a-a149-24c71b5c533d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.889469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0a13430-0e6d-419a-a149-24c71b5c533d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.889914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0a13430-0e6d-419a-a149-24c71b5c533d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.912059 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e08e98ee-680b-45ba-9e25-424c0abbb4f6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments/7f2ed74d-1cd5-43e1-b517-b9767a51b2f7" status: 200 len: 194 microversion: 2.1 time: 0.103517 Oct 04 18:23:10.912963 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2465/4946] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Oct 4 18:23:10 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments/7f2ed74d-1cd5-43e1-b517-b9767a51b2f7 => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:10.937950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c2f15dc-dcf9-4b0f-a83a-d7ec41bec889 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.938566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c2f15dc-dcf9-4b0f-a83a-d7ec41bec889 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.953094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2f15dc-dcf9-4b0f-a83a-d7ec41bec889 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.953972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2f15dc-dcf9-4b0f-a83a-d7ec41bec889 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.954596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2f15dc-dcf9-4b0f-a83a-d7ec41bec889 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.957294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2f15dc-dcf9-4b0f-a83a-d7ec41bec889 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.958221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2f15dc-dcf9-4b0f-a83a-d7ec41bec889 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.959020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c2f15dc-dcf9-4b0f-a83a-d7ec41bec889 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.100069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a0a13430-0e6d-419a-a149-24c71b5c533d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:11.124346 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a0a13430-0e6d-419a-a149-24c71b5c533d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.270004 Oct 04 18:23:11.125826 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2482/4947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:10 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:11.184492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-3c2f15dc-dcf9-4b0f-a83a-d7ec41bec889 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lazy-loading 'services' on Instance uuid 1908ea35-63c6-453c-b505-ce3990be8cef {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:11.330142 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c2f15dc-dcf9-4b0f-a83a-d7ec41bec889 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments/7f2ed74d-1cd5-43e1-b517-b9767a51b2f7" status: 202 len: 0 microversion: 2.1 time: 0.404449 Oct 04 18:23:11.330898 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2466/4948] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:23:10 2022] DELETE /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments/7f2ed74d-1cd5-43e1-b517-b9767a51b2f7 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:11.586652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:11.587392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:11.595699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.596226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.598747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.600964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.601784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.602217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.646800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:11.648526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.649042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.649858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.650816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lazy-loading 'fault' on Instance uuid b77bc8a4-c511-45fb-8754-e51058a80443 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:11.698752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:11.715051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:11.719926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:11.724273 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5beff510-4fe6-4947-b362-79de715c7771 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 200 len: 1367 microversion: 2.47 time: 0.145624 Oct 04 18:23:11.725511 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2483/4949] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:11 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:11.882880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-763f98d9-f3d1-4231-9ba0-a56b4ebea5b2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:11.884249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-763f98d9-f3d1-4231-9ba0-a56b4ebea5b2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:11.891594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-763f98d9-f3d1-4231-9ba0-a56b4ebea5b2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.892190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-763f98d9-f3d1-4231-9ba0-a56b4ebea5b2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.892784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-763f98d9-f3d1-4231-9ba0-a56b4ebea5b2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.893596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-763f98d9-f3d1-4231-9ba0-a56b4ebea5b2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.894097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-763f98d9-f3d1-4231-9ba0-a56b4ebea5b2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.894532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-763f98d9-f3d1-4231-9ba0-a56b4ebea5b2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.041535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-763f98d9-f3d1-4231-9ba0-a56b4ebea5b2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:12.052160 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-763f98d9-f3d1-4231-9ba0-a56b4ebea5b2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1309 microversion: 2.1 time: 0.174813 Oct 04 18:23:12.053011 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2467/4950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:11 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:12.149177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f48c204-2edd-45e5-a7ab-01444c681a6f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:12.150001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f48c204-2edd-45e5-a7ab-01444c681a6f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:12.156509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f48c204-2edd-45e5-a7ab-01444c681a6f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.156999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f48c204-2edd-45e5-a7ab-01444c681a6f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.157633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f48c204-2edd-45e5-a7ab-01444c681a6f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.158630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f48c204-2edd-45e5-a7ab-01444c681a6f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.159289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f48c204-2edd-45e5-a7ab-01444c681a6f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.160559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f48c204-2edd-45e5-a7ab-01444c681a6f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.340504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f48c204-2edd-45e5-a7ab-01444c681a6f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:12.351943 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f48c204-2edd-45e5-a7ab-01444c681a6f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.206586 Oct 04 18:23:12.353765 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2484/4951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:12 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:12.749572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:12.750463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: b77bc8a4-c511-45fb-8754-e51058a80443] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:12.756682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.757361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.757969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.758832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.759493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.760091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.775163 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] HTTP exception thrown: Instance b77bc8a4-c511-45fb-8754-e51058a80443 could not be found. Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Request method failure captured: Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 HTTP/1.1 Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHnFeT--RnD8L8QYOZaHu33XME0Xgwdhgya77VpQe_wdZbTF527cZ3Z_DXYCBdBPiHhCi5P09Ui5UtAcYMpsuXSc9hC_fkBPKshMoBEW_o7cA5fQscnURlCdu07eLZrbmRnwRtnMkp5FmMsMqR_rdrXUDEd0NtpRCGmS4NvgB_mrwBw Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 8067b1329b1a48d4a9e45c2fcabd5ddd Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerShowV247Test-1965120285 Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8067b1329b1a48d4a9e45c2fcabd5ddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8067b1329b1a48d4a9e45c2fcabd5ddd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8067b1329b1a48d4a9e45c2fcabd5ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8067b1329b1a48d4a9e45c2fcabd5ddd"}]}] Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerShowV247Test-1965120285 Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 8067b1329b1a48d4a9e45c2fcabd5ddd Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerShowV247Test-1965120285 Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerShowV247Test-1965120285-project Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: f568dfc78f354fbba444302130d1bba0 Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerShowV247Test-1965120285-project Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance b77bc8a4-c511-45fb-8754-e51058a80443 could not be found. Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'b77bc8a4-c511-45fb-8754-e51058a80443'} Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b77bc8a4-c511-45fb-8754-e51058a80443 could not be found. Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b77bc8a4-c511-45fb-8754-e51058a80443 could not be found. Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:12.776875 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:12.782137 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:12.782137 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:12.782137 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:12.782137 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:12.782137 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:12.782137 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b77bc8a4-c511-45fb-8754-e51058a80443 could not be found. Oct 04 18:23:12.782137 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:12.782137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Returning 404 to user: Instance b77bc8a4-c511-45fb-8754-e51058a80443 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:12.782137 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f80ab867-c819-4dea-b332-ea453705ba52 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443" status: 404 len: 111 microversion: 2.47 time: 0.032552 Oct 04 18:23:12.782137 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2468/4952] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:12 2022] GET /compute/v2.1/servers/b77bc8a4-c511-45fb-8754-e51058a80443 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:23:12.792704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-67f4eb65-06ca-4c68-a802-517a18c1d8ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:12.793826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-67f4eb65-06ca-4c68-a802-517a18c1d8ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:12.802874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67f4eb65-06ca-4c68-a802-517a18c1d8ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.804709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67f4eb65-06ca-4c68-a802-517a18c1d8ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.805586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67f4eb65-06ca-4c68-a802-517a18c1d8ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.806750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67f4eb65-06ca-4c68-a802-517a18c1d8ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.807439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67f4eb65-06ca-4c68-a802-517a18c1d8ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.808078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67f4eb65-06ca-4c68-a802-517a18c1d8ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.841551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-67f4eb65-06ca-4c68-a802-517a18c1d8ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:12.952467 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-67f4eb65-06ca-4c68-a802-517a18c1d8ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468" status: 204 len: 0 microversion: 2.47 time: 0.162971 Oct 04 18:23:12.953963 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2485/4953] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:23:12 2022] DELETE /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:23:12.962186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:12.963116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:12.970119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.970739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.971435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.972886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.973849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.974376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.068587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.077659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-533ea0c7-ae0b-497b-a35c-973d21bc20b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.077870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.078620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-533ea0c7-ae0b-497b-a35c-973d21bc20b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.079265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.083451 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-91065744-407c-4b49-9d93-567db2391709 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468" status: 200 len: 1363 microversion: 2.47 time: 0.125091 Oct 04 18:23:13.084236 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2469/4954] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:12 2022] GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 => generated 1363 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:13.102515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-533ea0c7-ae0b-497b-a35c-973d21bc20b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.103705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-533ea0c7-ae0b-497b-a35c-973d21bc20b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.105574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-533ea0c7-ae0b-497b-a35c-973d21bc20b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.107029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-533ea0c7-ae0b-497b-a35c-973d21bc20b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.109237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-533ea0c7-ae0b-497b-a35c-973d21bc20b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.109788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-533ea0c7-ae0b-497b-a35c-973d21bc20b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.286143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-533ea0c7-ae0b-497b-a35c-973d21bc20b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.295858 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-533ea0c7-ae0b-497b-a35c-973d21bc20b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1491 microversion: 2.1 time: 0.223365 Oct 04 18:23:13.296505 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2486/4955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:13 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1491 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:13.321471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc40d616-f32e-4bfb-b3b9-ff1f7242b051 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:13.324609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc40d616-f32e-4bfb-b3b9-ff1f7242b051 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.332862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc40d616-f32e-4bfb-b3b9-ff1f7242b051 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.333396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc40d616-f32e-4bfb-b3b9-ff1f7242b051 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.333831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc40d616-f32e-4bfb-b3b9-ff1f7242b051 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.335352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc40d616-f32e-4bfb-b3b9-ff1f7242b051 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.335984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc40d616-f32e-4bfb-b3b9-ff1f7242b051 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.336587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc40d616-f32e-4bfb-b3b9-ff1f7242b051 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.381072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b1e5fe0c-20db-4cdf-b2f7-5e0b1bdeae88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.381702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b1e5fe0c-20db-4cdf-b2f7-5e0b1bdeae88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.413794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1e5fe0c-20db-4cdf-b2f7-5e0b1bdeae88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.414375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1e5fe0c-20db-4cdf-b2f7-5e0b1bdeae88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.414838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1e5fe0c-20db-4cdf-b2f7-5e0b1bdeae88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.415630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1e5fe0c-20db-4cdf-b2f7-5e0b1bdeae88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.416104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1e5fe0c-20db-4cdf-b2f7-5e0b1bdeae88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.416545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1e5fe0c-20db-4cdf-b2f7-5e0b1bdeae88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.421201 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc40d616-f32e-4bfb-b3b9-ff1f7242b051 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "PUT /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1086 microversion: 2.1 time: 0.103896 Oct 04 18:23:13.436933 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2470/4956] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 4 18:23:13 2022] PUT /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1086 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:13.445285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f2cf3387-200e-4bdf-a836-29fe51c49753 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.448042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f2cf3387-200e-4bdf-a836-29fe51c49753 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.454169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:13.457404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2cf3387-200e-4bdf-a836-29fe51c49753 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.457916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2cf3387-200e-4bdf-a836-29fe51c49753 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.458369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2cf3387-200e-4bdf-a836-29fe51c49753 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.459237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2cf3387-200e-4bdf-a836-29fe51c49753 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.459991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2cf3387-200e-4bdf-a836-29fe51c49753 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.460439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2cf3387-200e-4bdf-a836-29fe51c49753 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.664591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1e5fe0c-20db-4cdf-b2f7-5e0b1bdeae88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.692224 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b1e5fe0c-20db-4cdf-b2f7-5e0b1bdeae88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.316004 Oct 04 18:23:13.695125 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2487/4957] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:13 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:13.737380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f2cf3387-200e-4bdf-a836-29fe51c49753 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.747265 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f2cf3387-200e-4bdf-a836-29fe51c49753 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1512 microversion: 2.1 time: 0.305795 Oct 04 18:23:13.749024 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2471/4958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:13 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:13.772601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e0972611-1579-4b69-aab9-ab35412eda75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.773865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e0972611-1579-4b69-aab9-ab35412eda75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.781355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0972611-1579-4b69-aab9-ab35412eda75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.782041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0972611-1579-4b69-aab9-ab35412eda75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.782713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0972611-1579-4b69-aab9-ab35412eda75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.784124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0972611-1579-4b69-aab9-ab35412eda75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.784889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0972611-1579-4b69-aab9-ab35412eda75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.785805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0972611-1579-4b69-aab9-ab35412eda75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.982842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e0972611-1579-4b69-aab9-ab35412eda75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.991400 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e0972611-1579-4b69-aab9-ab35412eda75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1512 microversion: 2.1 time: 0.223795 Oct 04 18:23:13.992519 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2488/4959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:13 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:14.013963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9fed18e6-0296-4d01-ac33-3c64b085a3f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:14.015051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9fed18e6-0296-4d01-ac33-3c64b085a3f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.023072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed18e6-0296-4d01-ac33-3c64b085a3f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.023806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed18e6-0296-4d01-ac33-3c64b085a3f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.024425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed18e6-0296-4d01-ac33-3c64b085a3f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.025282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed18e6-0296-4d01-ac33-3c64b085a3f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.025882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed18e6-0296-4d01-ac33-3c64b085a3f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.026479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed18e6-0296-4d01-ac33-3c64b085a3f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.056045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9fed18e6-0296-4d01-ac33-3c64b085a3f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:14.111440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:14.112060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.124171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.125827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.126285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.129330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.130536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.131109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.170538 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9fed18e6-0296-4d01-ac33-3c64b085a3f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 204 len: 0 microversion: 2.1 time: 0.159949 Oct 04 18:23:14.171013 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2472/4960] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:14 2022] DELETE /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:23:14.182701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7805374a-9793-469d-803a-525dacd49930 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:14.183939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7805374a-9793-469d-803a-525dacd49930 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.192706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7805374a-9793-469d-803a-525dacd49930 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.193648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7805374a-9793-469d-803a-525dacd49930 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.194286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7805374a-9793-469d-803a-525dacd49930 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.195709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7805374a-9793-469d-803a-525dacd49930 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.196359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7805374a-9793-469d-803a-525dacd49930 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.196966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7805374a-9793-469d-803a-525dacd49930 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.278868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.293384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.297970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.308878 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b1664612-13e2-415a-a745-fa7c2e0077ae tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468" status: 200 len: 1363 microversion: 2.47 time: 0.193049 Oct 04 18:23:14.309489 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2489/4961] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:14 2022] GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:14.409923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7805374a-9793-469d-803a-525dacd49930 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.419293 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7805374a-9793-469d-803a-525dacd49930 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1518 microversion: 2.1 time: 0.241514 Oct 04 18:23:14.420070 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2473/4962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:14 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:14.717660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4ed9195-a7cd-47b3-a363-6d5fead48e2d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:14.718202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f4ed9195-a7cd-47b3-a363-6d5fead48e2d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.725081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4ed9195-a7cd-47b3-a363-6d5fead48e2d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.725584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4ed9195-a7cd-47b3-a363-6d5fead48e2d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.726033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4ed9195-a7cd-47b3-a363-6d5fead48e2d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.726778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4ed9195-a7cd-47b3-a363-6d5fead48e2d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.727286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4ed9195-a7cd-47b3-a363-6d5fead48e2d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.727726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4ed9195-a7cd-47b3-a363-6d5fead48e2d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.886682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f4ed9195-a7cd-47b3-a363-6d5fead48e2d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.896488 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f4ed9195-a7cd-47b3-a363-6d5fead48e2d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.182434 Oct 04 18:23:14.897854 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2490/4963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:14 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:15.336670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:15.338595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:15.349666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.350486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.351167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.352151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.353151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.353756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.445861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:15.448476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8467226-490e-41e7-9e15-192d43f6e7f2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:15.452338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e8467226-490e-41e7-9e15-192d43f6e7f2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:15.462814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:15.464861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:15.466520 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7883d887-a840-43d9-84c4-88a90a933468 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468" status: 200 len: 1363 microversion: 2.47 time: 0.133632 Oct 04 18:23:15.468793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8467226-490e-41e7-9e15-192d43f6e7f2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.469631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8467226-490e-41e7-9e15-192d43f6e7f2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.471282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8467226-490e-41e7-9e15-192d43f6e7f2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.473371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8467226-490e-41e7-9e15-192d43f6e7f2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.476238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8467226-490e-41e7-9e15-192d43f6e7f2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.477061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8467226-490e-41e7-9e15-192d43f6e7f2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.480087 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2474/4964] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:15 2022] GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:15.766378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8467226-490e-41e7-9e15-192d43f6e7f2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:15.776813 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e8467226-490e-41e7-9e15-192d43f6e7f2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1518 microversion: 2.1 time: 0.336724 Oct 04 18:23:15.777716 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2491/4965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:15 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1518 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:15.927656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aff59e0b-b03c-4bed-adc4-0ed51df49a4e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:15.928618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aff59e0b-b03c-4bed-adc4-0ed51df49a4e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:15.943240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aff59e0b-b03c-4bed-adc4-0ed51df49a4e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.944115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aff59e0b-b03c-4bed-adc4-0ed51df49a4e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.945835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aff59e0b-b03c-4bed-adc4-0ed51df49a4e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.947427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aff59e0b-b03c-4bed-adc4-0ed51df49a4e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.948481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aff59e0b-b03c-4bed-adc4-0ed51df49a4e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.953680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aff59e0b-b03c-4bed-adc4-0ed51df49a4e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.243803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aff59e0b-b03c-4bed-adc4-0ed51df49a4e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.252752 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aff59e0b-b03c-4bed-adc4-0ed51df49a4e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.335885 Oct 04 18:23:16.254918 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2475/4966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:15 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:16.503550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:16.505239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.531580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.535520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.536114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.537633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.542969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.546039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.645359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.650019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.650650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.651531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lazy-loading 'fault' on Instance uuid 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:16.694152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a21fdfaa-1e2b-40f3-a3ab-c1ac34cb62e1 req-364af6f3-e9ed-4571-a85f-5d5d7d518adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac9e6ac-3620-4023-bc53-1b6706fd2f82", "name": "network-vif-deleted", "tag": "928ba257-fce5-4424-ae7b-917acc406c08"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:16.720520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a21fdfaa-1e2b-40f3-a3ab-c1ac34cb62e1 req-364af6f3-e9ed-4571-a85f-5d5d7d518adb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.721020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a21fdfaa-1e2b-40f3-a3ab-c1ac34cb62e1 req-364af6f3-e9ed-4571-a85f-5d5d7d518adb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.721516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a21fdfaa-1e2b-40f3-a3ab-c1ac34cb62e1 req-364af6f3-e9ed-4571-a85f-5d5d7d518adb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.749566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.757911 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a21fdfaa-1e2b-40f3-a3ab-c1ac34cb62e1 req-364af6f3-e9ed-4571-a85f-5d5d7d518adb service nova] Creating event network-vif-deleted:928ba257-fce5-4424-ae7b-917acc406c08 for instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 on n-h1-850499-14 Oct 04 18:23:16.771338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.774892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f568dfc78f354fbba444302130d1bba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8067b1329b1a48d4a9e45c2fcabd5ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.776181 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2b650b70-360c-4476-8b8a-91f633bf4718 tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468" status: 200 len: 1368 microversion: 2.47 time: 0.284184 Oct 04 18:23:16.777041 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a21fdfaa-1e2b-40f3-a3ab-c1ac34cb62e1 req-364af6f3-e9ed-4571-a85f-5d5d7d518adb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082743 Oct 04 18:23:16.777847 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2476/4967] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:16.787774 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2492/4968] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:16 2022] GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:16.805230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:16.805871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.819071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.819579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.820206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.821101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.824496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.825211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.880337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:16.915589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.916461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.917249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.918189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lazy-loading 'fault' on Instance uuid fac9e6ac-3620-4023-bc53-1b6706fd2f82 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:16.977585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.990884 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fa2e5fa6-3387-4cce-a664-2ded66af99a6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 200 len: 1320 microversion: 2.1 time: 0.189825 Oct 04 18:23:16.992198 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2477/4969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:16 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 1320 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:17.278813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b9d86f73-8bf6-4472-ba5d-684bc9c28a11 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:17.280473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b9d86f73-8bf6-4472-ba5d-684bc9c28a11 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:17.293356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9d86f73-8bf6-4472-ba5d-684bc9c28a11 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.293869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9d86f73-8bf6-4472-ba5d-684bc9c28a11 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.294314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9d86f73-8bf6-4472-ba5d-684bc9c28a11 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.295608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9d86f73-8bf6-4472-ba5d-684bc9c28a11 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.296244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9d86f73-8bf6-4472-ba5d-684bc9c28a11 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.296692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9d86f73-8bf6-4472-ba5d-684bc9c28a11 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.496708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b9d86f73-8bf6-4472-ba5d-684bc9c28a11 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:17.505227 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b9d86f73-8bf6-4472-ba5d-684bc9c28a11 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.232933 Oct 04 18:23:17.512828 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2493/4970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:17 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:17.818669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:17.819893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] [instance: 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:17.821858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:17.823304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:17.831234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.831234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.831630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.832342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.833009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.833442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.848542 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] HTTP exception thrown: Instance 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 could not be found. Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Request method failure captured: Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 HTTP/1.1 Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHnFeT--RnD8L8QYOZaHu33XME0Xgwdhgya77VpQe_wdZbTF527cZ3Z_DXYCBdBPiHhCi5P09Ui5UtAcYMpsuXSc9hC_fkBPKshMoBEW_o7cA5fQscnURlCdu07eLZrbmRnwRtnMkp5FmMsMqR_rdrXUDEd0NtpRCGmS4NvgB_mrwBw Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 8067b1329b1a48d4a9e45c2fcabd5ddd Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerShowV247Test-1965120285 Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8067b1329b1a48d4a9e45c2fcabd5ddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8067b1329b1a48d4a9e45c2fcabd5ddd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8067b1329b1a48d4a9e45c2fcabd5ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8067b1329b1a48d4a9e45c2fcabd5ddd"}]}] Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerShowV247Test-1965120285 Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 8067b1329b1a48d4a9e45c2fcabd5ddd Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerShowV247Test-1965120285 Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerShowV247Test-1965120285-project Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: f568dfc78f354fbba444302130d1bba0 Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerShowV247Test-1965120285-project Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 could not be found. Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '1ddcdd6e-21f7-4291-93c0-ffbf9e7db468'} Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 could not be found. Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 could not be found. Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:17.850224 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:17.855861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:17.855861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:17.855861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:17.855861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:17.855861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:17.855861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 could not be found. Oct 04 18:23:17.855861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:17.855861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] Returning 404 to user: Instance 1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:17.855861 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-414178cb-16c1-4da0-ba1e-c8f6b2e3817b tempest-ServerShowV247Test-1965120285 tempest-ServerShowV247Test-1965120285-project] 10.222.0.18 "GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468" status: 404 len: 111 microversion: 2.47 time: 0.037723 Oct 04 18:23:17.855861 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2478/4971] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:17 2022] GET /compute/v2.1/servers/1ddcdd6e-21f7-4291-93c0-ffbf9e7db468 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:23:18.028077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:18.028686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:18.036802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.037385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.038046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.038995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.040090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.040090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.060245 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 HTTP/1.1 Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'fac9e6ac-3620-4023-bc53-1b6706fd2f82'} Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:18.062809 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:18.067882 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:18.067882 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:18.067882 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:18.067882 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:18.067882 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:23:18.067882 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:18.067882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:18.067882 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-904e7a7c-7632-4049-b530-4bbd666bcd58 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 404 len: 111 microversion: 2.1 time: 0.040603 Oct 04 18:23:18.076547 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2494/4972] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:18 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:18.151781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05a3c048-a57d-4a23-aeec-0b31b18ae5b6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:18.154122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-05a3c048-a57d-4a23-aeec-0b31b18ae5b6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:18.160574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a3c048-a57d-4a23-aeec-0b31b18ae5b6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.161277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a3c048-a57d-4a23-aeec-0b31b18ae5b6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.161876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a3c048-a57d-4a23-aeec-0b31b18ae5b6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.162802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a3c048-a57d-4a23-aeec-0b31b18ae5b6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.163471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a3c048-a57d-4a23-aeec-0b31b18ae5b6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.164089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a3c048-a57d-4a23-aeec-0b31b18ae5b6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.218946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-496911577", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "5be520db-1d2d-4d71-923d-9d8728cd44bc"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:18.231097 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-05a3c048-a57d-4a23-aeec-0b31b18ae5b6 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083552 Oct 04 18:23:18.232386 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2479/4973] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:23:18 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:23:18.294253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] validate_networks() for [('5be520db-1d2d-4d71-923d-9d8728cd44bc', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:23:18.432881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c413ca06-2738-4333-94b3-ace97dd5523a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:18.435128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c413ca06-2738-4333-94b3-ace97dd5523a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:18.452967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c413ca06-2738-4333-94b3-ace97dd5523a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.453512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c413ca06-2738-4333-94b3-ace97dd5523a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.453975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c413ca06-2738-4333-94b3-ace97dd5523a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.457300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c413ca06-2738-4333-94b3-ace97dd5523a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.457899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c413ca06-2738-4333-94b3-ace97dd5523a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.458496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c413ca06-2738-4333-94b3-ace97dd5523a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.518310 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c413ca06-2738-4333-94b3-ace97dd5523a tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094095 Oct 04 18:23:18.521272 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2480/4974] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:23:18 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:23:18.528573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2fdfc39e-f91d-476f-af79-09626675ed09 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:18.529399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2fdfc39e-f91d-476f-af79-09626675ed09 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:18.538718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fdfc39e-f91d-476f-af79-09626675ed09 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.539427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fdfc39e-f91d-476f-af79-09626675ed09 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.540335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fdfc39e-f91d-476f-af79-09626675ed09 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.541491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fdfc39e-f91d-476f-af79-09626675ed09 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.542287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fdfc39e-f91d-476f-af79-09626675ed09 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.543055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fdfc39e-f91d-476f-af79-09626675ed09 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.959653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2fdfc39e-f91d-476f-af79-09626675ed09 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:18.973531 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2fdfc39e-f91d-476f-af79-09626675ed09 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.449062 Oct 04 18:23:18.983205 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2481/4975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:18 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:18.995762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9d3a8df-b881-4f9a-86a3-f3e1bf3b2148 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:18.998647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9d3a8df-b881-4f9a-86a3-f3e1bf3b2148 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:19.008196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3a8df-b881-4f9a-86a3-f3e1bf3b2148 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.008954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3a8df-b881-4f9a-86a3-f3e1bf3b2148 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.009386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3a8df-b881-4f9a-86a3-f3e1bf3b2148 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.010272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3a8df-b881-4f9a-86a3-f3e1bf3b2148 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.010735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3a8df-b881-4f9a-86a3-f3e1bf3b2148 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.011207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9d3a8df-b881-4f9a-86a3-f3e1bf3b2148 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.043229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9d3a8df-b881-4f9a-86a3-f3e1bf3b2148 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:19.121407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:23:19.122118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:23:19.122421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:23:19.123162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:23:19.123661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:23:19.134338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.134844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.135324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.136056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.136580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.137014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.157563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:23:19.164671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Getting quotas for user 41e49c77352541cb94dcd12277f7ee67 and project 055e605a53014ca29fa6416b576060e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:23:19.180752 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9d3a8df-b881-4f9a-86a3-f3e1bf3b2148 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 204 len: 0 microversion: 2.1 time: 0.194077 Oct 04 18:23:19.181921 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2482/4976] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:18 2022] DELETE /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:23:19.185509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:23:19.185509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:23:19.196552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99e2b7a4-80f2-49bf-9ac3-e92e0a38774d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:19.197848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-99e2b7a4-80f2-49bf-9ac3-e92e0a38774d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:19.206805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e2b7a4-80f2-49bf-9ac3-e92e0a38774d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.207527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e2b7a4-80f2-49bf-9ac3-e92e0a38774d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.208184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e2b7a4-80f2-49bf-9ac3-e92e0a38774d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.209552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e2b7a4-80f2-49bf-9ac3-e92e0a38774d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.210349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e2b7a4-80f2-49bf-9ac3-e92e0a38774d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.211048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99e2b7a4-80f2-49bf-9ac3-e92e0a38774d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.249643 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-210ae271-6203-4cf6-b0b0-8bdc13edd95f tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.034212 Oct 04 18:23:19.257729 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2495/4977] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:23:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:23:19.263802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ae610eb-69eb-448d-b64b-c4f6b5c8fa29 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:19.264563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ae610eb-69eb-448d-b64b-c4f6b5c8fa29 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:19.452278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ae610eb-69eb-448d-b64b-c4f6b5c8fa29 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:19.462897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-99e2b7a4-80f2-49bf-9ac3-e92e0a38774d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:19.479599 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-99e2b7a4-80f2-49bf-9ac3-e92e0a38774d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1673 microversion: 2.1 time: 0.290721 Oct 04 18:23:19.481418 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ae610eb-69eb-448d-b64b-c4f6b5c8fa29 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1208 microversion: 2.1 time: 0.221437 Oct 04 18:23:19.482279 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2483/4978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:19 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1673 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:19.498396 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2496/4979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:19 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1208 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:20.002758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-197e311b-9ee8-4251-a67a-64a28024d9f0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:20.004720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-197e311b-9ee8-4251-a67a-64a28024d9f0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:20.014910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-197e311b-9ee8-4251-a67a-64a28024d9f0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.015602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-197e311b-9ee8-4251-a67a-64a28024d9f0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.016491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-197e311b-9ee8-4251-a67a-64a28024d9f0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.017584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-197e311b-9ee8-4251-a67a-64a28024d9f0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.019865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-197e311b-9ee8-4251-a67a-64a28024d9f0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.020474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-197e311b-9ee8-4251-a67a-64a28024d9f0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.243808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-197e311b-9ee8-4251-a67a-64a28024d9f0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:20.252776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-197e311b-9ee8-4251-a67a-64a28024d9f0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.257480 Oct 04 18:23:20.254315 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2484/4980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:19 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:20.516174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a27c7874-e2a7-47ec-aa62-f0a5aaa920c7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:20.516802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a27c7874-e2a7-47ec-aa62-f0a5aaa920c7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:20.518121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00abe11b-a811-4521-90ff-0857af4964ad tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:20.520470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00abe11b-a811-4521-90ff-0857af4964ad tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:20.535097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a27c7874-e2a7-47ec-aa62-f0a5aaa920c7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.536265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a27c7874-e2a7-47ec-aa62-f0a5aaa920c7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.536711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a27c7874-e2a7-47ec-aa62-f0a5aaa920c7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.537440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a27c7874-e2a7-47ec-aa62-f0a5aaa920c7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.538985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00abe11b-a811-4521-90ff-0857af4964ad tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.539513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00abe11b-a811-4521-90ff-0857af4964ad tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.539957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00abe11b-a811-4521-90ff-0857af4964ad tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.540640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00abe11b-a811-4521-90ff-0857af4964ad tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.541390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a27c7874-e2a7-47ec-aa62-f0a5aaa920c7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.541925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a27c7874-e2a7-47ec-aa62-f0a5aaa920c7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.542913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00abe11b-a811-4521-90ff-0857af4964ad tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.543387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00abe11b-a811-4521-90ff-0857af4964ad tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.661757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-00abe11b-a811-4521-90ff-0857af4964ad tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:20.674596 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-00abe11b-a811-4521-90ff-0857af4964ad tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1212 microversion: 2.1 time: 0.169428 Oct 04 18:23:20.688544 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2497/4981] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:20 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1212 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:20.839245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a27c7874-e2a7-47ec-aa62-f0a5aaa920c7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:20.849399 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a27c7874-e2a7-47ec-aa62-f0a5aaa920c7 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1673 microversion: 2.1 time: 0.344958 Oct 04 18:23:20.850079 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2485/4982] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:20 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1673 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:21.278191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e5c76942-e5da-4809-86c7-090705c358be tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:21.279467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e5c76942-e5da-4809-86c7-090705c358be tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.287536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c76942-e5da-4809-86c7-090705c358be tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.288469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c76942-e5da-4809-86c7-090705c358be tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.289370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c76942-e5da-4809-86c7-090705c358be tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.290602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c76942-e5da-4809-86c7-090705c358be tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.291316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c76942-e5da-4809-86c7-090705c358be tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.291978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c76942-e5da-4809-86c7-090705c358be tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.716275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af982e37-7169-498e-b76a-c4601655957d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:21.717485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-af982e37-7169-498e-b76a-c4601655957d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.726660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af982e37-7169-498e-b76a-c4601655957d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.733527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af982e37-7169-498e-b76a-c4601655957d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.734009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af982e37-7169-498e-b76a-c4601655957d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.734776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af982e37-7169-498e-b76a-c4601655957d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.735284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af982e37-7169-498e-b76a-c4601655957d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.735723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af982e37-7169-498e-b76a-c4601655957d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.845929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5c76942-e5da-4809-86c7-090705c358be tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:21.857949 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e5c76942-e5da-4809-86c7-090705c358be tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.583913 Oct 04 18:23:21.867287 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2498/4983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:21 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:21.879055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f02ddcc-eab8-4407-ae81-2e42b2f2304c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:21.891860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0f02ddcc-eab8-4407-ae81-2e42b2f2304c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.916683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f02ddcc-eab8-4407-ae81-2e42b2f2304c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.919533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f02ddcc-eab8-4407-ae81-2e42b2f2304c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.926352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f02ddcc-eab8-4407-ae81-2e42b2f2304c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.928971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f02ddcc-eab8-4407-ae81-2e42b2f2304c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.929572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f02ddcc-eab8-4407-ae81-2e42b2f2304c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.937884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f02ddcc-eab8-4407-ae81-2e42b2f2304c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.990833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-af982e37-7169-498e-b76a-c4601655957d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:22.002010 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-af982e37-7169-498e-b76a-c4601655957d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1260 microversion: 2.1 time: 0.289862 Oct 04 18:23:22.004869 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2486/4984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:21 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1260 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:22.589203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0f02ddcc-eab8-4407-ae81-2e42b2f2304c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:22.604533 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0f02ddcc-eab8-4407-ae81-2e42b2f2304c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1673 microversion: 2.1 time: 0.733413 Oct 04 18:23:22.615041 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2499/4985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:21 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1673 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:22.890633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7aa94112-268b-43a5-81b5-79aed89cfefc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:22.892216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7aa94112-268b-43a5-81b5-79aed89cfefc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:22.960207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aa94112-268b-43a5-81b5-79aed89cfefc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.965281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aa94112-268b-43a5-81b5-79aed89cfefc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.966373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aa94112-268b-43a5-81b5-79aed89cfefc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.973698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aa94112-268b-43a5-81b5-79aed89cfefc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.974902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aa94112-268b-43a5-81b5-79aed89cfefc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.977842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aa94112-268b-43a5-81b5-79aed89cfefc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.033357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45b7cf8e-9ff8-47c7-bde0-f837911de0d3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:23.037595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45b7cf8e-9ff8-47c7-bde0-f837911de0d3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:23.050004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7cf8e-9ff8-47c7-bde0-f837911de0d3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.051014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7cf8e-9ff8-47c7-bde0-f837911de0d3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.051645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7cf8e-9ff8-47c7-bde0-f837911de0d3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.052590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7cf8e-9ff8-47c7-bde0-f837911de0d3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.055004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7cf8e-9ff8-47c7-bde0-f837911de0d3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.057067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7cf8e-9ff8-47c7-bde0-f837911de0d3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.396089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-45b7cf8e-9ff8-47c7-bde0-f837911de0d3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:23.410585 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45b7cf8e-9ff8-47c7-bde0-f837911de0d3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1266 microversion: 2.1 time: 0.379453 Oct 04 18:23:23.412753 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2500/4986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:23 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1266 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:23.424943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7ef9c140-e0c1-46f9-a3ab-71bac9a6f8d2 req-1d95332d-f270-4241-a0f7-d996d87679e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1908ea35-63c6-453c-b505-ce3990be8cef", "name": "network-vif-deleted", "tag": "31735e56-335a-4bc6-b09b-b79a0198b3b9"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:23.453031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ef9c140-e0c1-46f9-a3ab-71bac9a6f8d2 req-1d95332d-f270-4241-a0f7-d996d87679e9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.453621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ef9c140-e0c1-46f9-a3ab-71bac9a6f8d2 req-1d95332d-f270-4241-a0f7-d996d87679e9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.454050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ef9c140-e0c1-46f9-a3ab-71bac9a6f8d2 req-1d95332d-f270-4241-a0f7-d996d87679e9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.488884 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7ef9c140-e0c1-46f9-a3ab-71bac9a6f8d2 req-1d95332d-f270-4241-a0f7-d996d87679e9 service nova] Creating event network-vif-deleted:31735e56-335a-4bc6-b09b-b79a0198b3b9 for instance 1908ea35-63c6-453c-b505-ce3990be8cef on n-h1-850499-14 Oct 04 18:23:23.505532 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7ef9c140-e0c1-46f9-a3ab-71bac9a6f8d2 req-1d95332d-f270-4241-a0f7-d996d87679e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089171 Oct 04 18:23:23.509543 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2501/4987] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:23.636087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:23.637351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:23.650086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.654178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.654844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.655766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.658060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.661280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.748521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.749031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.753150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.753638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lazy-loading 'fault' on Instance uuid 1908ea35-63c6-453c-b505-ce3990be8cef {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:23.985346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7aa94112-268b-43a5-81b5-79aed89cfefc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:24.003980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30a7a667883542e386cb3fd5b65abc90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c88ac592a4375a805aec597fbd50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:24.008586 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7aa94112-268b-43a5-81b5-79aed89cfefc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 1.116831 Oct 04 18:23:24.020647 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2487/4988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:22 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:24.020749 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-97c4db9c-c339-4c3a-a1f3-30d662ef3cd0 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 200 len: 1326 microversion: 2.1 time: 0.386279 Oct 04 18:23:24.020749 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2502/4989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:23 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 1326 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:24.440810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2017827e-ffea-44c2-81cf-89a5ddfbc097 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:24.441473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2017827e-ffea-44c2-81cf-89a5ddfbc097 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:24.450190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2017827e-ffea-44c2-81cf-89a5ddfbc097 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.451364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2017827e-ffea-44c2-81cf-89a5ddfbc097 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.452056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2017827e-ffea-44c2-81cf-89a5ddfbc097 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.452995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2017827e-ffea-44c2-81cf-89a5ddfbc097 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.453697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2017827e-ffea-44c2-81cf-89a5ddfbc097 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.454330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2017827e-ffea-44c2-81cf-89a5ddfbc097 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.630985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2017827e-ffea-44c2-81cf-89a5ddfbc097 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:24.646204 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2017827e-ffea-44c2-81cf-89a5ddfbc097 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1266 microversion: 2.1 time: 0.209764 Oct 04 18:23:24.651544 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2488/4990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:24 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:25.047066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.047675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.048743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c83bbd3d-fe3c-4a5d-827d-b64fd2eb2b13 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.052246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c83bbd3d-fe3c-4a5d-827d-b64fd2eb2b13 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.060923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.061728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.062743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.065750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.066747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.067579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.071853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83bbd3d-fe3c-4a5d-827d-b64fd2eb2b13 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.072722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83bbd3d-fe3c-4a5d-827d-b64fd2eb2b13 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.073337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83bbd3d-fe3c-4a5d-827d-b64fd2eb2b13 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.074227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83bbd3d-fe3c-4a5d-827d-b64fd2eb2b13 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.074850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83bbd3d-fe3c-4a5d-827d-b64fd2eb2b13 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.075588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83bbd3d-fe3c-4a5d-827d-b64fd2eb2b13 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.098206 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] HTTP exception thrown: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Request method failure captured: Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef HTTP/1.1 Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHiadBR6CysqB9yQB7F3JCvpxSsHyJy0mT-tgRWF_4lkLmYkkkTp1u1LEfav-pltaOFx0CfYYdxcvpLc7IE6xO_IBD4LnIiLlflwVpTuqGv9AgUpWCxZeowjz_bFhv4B46eKGMU-BFvZTsvjnzUTpwWR7cCngsvmitcf8RBsZh_NOKM Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}] Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 30a7a667883542e386cb3fd5b65abc90 Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '1908ea35-63c6-453c-b505-ce3990be8cef'} Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.104799 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.109231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.109231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.109231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.109231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:25.109231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:25.109231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:25.109231 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.110546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Returning 404 to user: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:25.114029 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f311495c-9850-42c1-ba6b-e58d8c16da9d tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 404 len: 111 microversion: 2.1 time: 0.070937 Oct 04 18:23:25.114919 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2489/4991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:25 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:23:25.127151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f7d059cf-b57f-4846-8f9c-7aa77de1810e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '.version_select at 0x7fd4d1b30820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.146163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:25.155851 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f7d059cf-b57f-4846-8f9c-7aa77de1810e tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-944967292" status: 202 len: 0 microversion: 2.1 time: 0.035869 Oct 04 18:23:25.156661 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2490/4992] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 4 18:23:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-944967292 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:23:25.476113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c83bbd3d-fe3c-4a5d-827d-b64fd2eb2b13 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:25.486194 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c83bbd3d-fe3c-4a5d-827d-b64fd2eb2b13 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.452091 Oct 04 18:23:25.495255 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2503/4993] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:25 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:25.682863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-587fdf71-173b-4591-b3a6-cc6261b754f0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.683908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-587fdf71-173b-4591-b3a6-cc6261b754f0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.700528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-587fdf71-173b-4591-b3a6-cc6261b754f0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.704976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-587fdf71-173b-4591-b3a6-cc6261b754f0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.707826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-587fdf71-173b-4591-b3a6-cc6261b754f0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.710065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-587fdf71-173b-4591-b3a6-cc6261b754f0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.713963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-587fdf71-173b-4591-b3a6-cc6261b754f0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.719879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-587fdf71-173b-4591-b3a6-cc6261b754f0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.174800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-587fdf71-173b-4591-b3a6-cc6261b754f0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:26.182890 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-587fdf71-173b-4591-b3a6-cc6261b754f0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1308 microversion: 2.1 time: 0.509556 Oct 04 18:23:26.196555 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2491/4994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:25 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1308 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:26.524134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-38b1815c-0088-4ef7-b785-6cbd79a32cde tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:26.525811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-38b1815c-0088-4ef7-b785-6cbd79a32cde tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:26.540341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b1815c-0088-4ef7-b785-6cbd79a32cde tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.541216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b1815c-0088-4ef7-b785-6cbd79a32cde tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.542258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b1815c-0088-4ef7-b785-6cbd79a32cde tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.543943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b1815c-0088-4ef7-b785-6cbd79a32cde tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.545216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b1815c-0088-4ef7-b785-6cbd79a32cde tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.545951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b1815c-0088-4ef7-b785-6cbd79a32cde tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.213011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-013f597e-efef-4981-a7d0-2c0248854b3b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:27.214010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-013f597e-efef-4981-a7d0-2c0248854b3b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:27.231653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013f597e-efef-4981-a7d0-2c0248854b3b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:27.232152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013f597e-efef-4981-a7d0-2c0248854b3b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:27.232592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013f597e-efef-4981-a7d0-2c0248854b3b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.233307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013f597e-efef-4981-a7d0-2c0248854b3b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:27.233765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013f597e-efef-4981-a7d0-2c0248854b3b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:27.234193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-013f597e-efef-4981-a7d0-2c0248854b3b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.305119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-38b1815c-0088-4ef7-b785-6cbd79a32cde tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.315628 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-38b1815c-0088-4ef7-b785-6cbd79a32cde tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.800441 Oct 04 18:23:27.328488 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2504/4995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:26 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:27.673396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-013f597e-efef-4981-a7d0-2c0248854b3b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.687330 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-013f597e-efef-4981-a7d0-2c0248854b3b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1308 microversion: 2.1 time: 0.481334 Oct 04 18:23:27.688835 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2492/4996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:27 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1308 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:28.338933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ef59af6-b4ed-4f1f-ae97-6b6233bbca86 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:28.339568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9ef59af6-b4ed-4f1f-ae97-6b6233bbca86 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:28.351090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef59af6-b4ed-4f1f-ae97-6b6233bbca86 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.365090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef59af6-b4ed-4f1f-ae97-6b6233bbca86 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.366196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef59af6-b4ed-4f1f-ae97-6b6233bbca86 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.367337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef59af6-b4ed-4f1f-ae97-6b6233bbca86 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.368493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef59af6-b4ed-4f1f-ae97-6b6233bbca86 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.369428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef59af6-b4ed-4f1f-ae97-6b6233bbca86 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.717591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e825c61b-3271-4ec7-aa25-f5000b37a9f8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:28.718654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e825c61b-3271-4ec7-aa25-f5000b37a9f8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:28.735966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e825c61b-3271-4ec7-aa25-f5000b37a9f8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.736814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e825c61b-3271-4ec7-aa25-f5000b37a9f8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.739465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e825c61b-3271-4ec7-aa25-f5000b37a9f8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.740702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e825c61b-3271-4ec7-aa25-f5000b37a9f8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.742176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e825c61b-3271-4ec7-aa25-f5000b37a9f8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.743722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e825c61b-3271-4ec7-aa25-f5000b37a9f8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.151286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:29.479404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:29.545565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e825c61b-3271-4ec7-aa25-f5000b37a9f8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:29.555066 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e825c61b-3271-4ec7-aa25-f5000b37a9f8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1308 microversion: 2.1 time: 0.842775 Oct 04 18:23:29.565101 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2493/4997] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:28 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1308 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:29.565101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-292f4a12-be80-41c1-a9a9-0c8f3c5693a0 req-253b2bc5-2fce-4859-ac33-ab659a01f817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c70006-2657-45c6-8510-4894b51c1bad", "tag": "64e822ca-fc96-49b1-8f5d-cabaf5508b13"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:29.571618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-292f4a12-be80-41c1-a9a9-0c8f3c5693a0 req-253b2bc5-2fce-4859-ac33-ab659a01f817 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.572177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-292f4a12-be80-41c1-a9a9-0c8f3c5693a0 req-253b2bc5-2fce-4859-ac33-ab659a01f817 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.572696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-292f4a12-be80-41c1-a9a9-0c8f3c5693a0 req-253b2bc5-2fce-4859-ac33-ab659a01f817 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.585586 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-292f4a12-be80-41c1-a9a9-0c8f3c5693a0 req-253b2bc5-2fce-4859-ac33-ab659a01f817 service nova] Creating event network-changed:64e822ca-fc96-49b1-8f5d-cabaf5508b13 for instance f5c70006-2657-45c6-8510-4894b51c1bad on n-h1-850499-14 Oct 04 18:23:29.591149 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-292f4a12-be80-41c1-a9a9-0c8f3c5693a0 req-253b2bc5-2fce-4859-ac33-ab659a01f817 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033727 Oct 04 18:23:29.592341 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2494/4998] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:29.613355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ef59af6-b4ed-4f1f-ae97-6b6233bbca86 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:29.625813 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ef59af6-b4ed-4f1f-ae97-6b6233bbca86 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 1.290812 Oct 04 18:23:29.643784 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2505/4999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:28 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:30.584471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2baf43c8-067e-4cda-9c19-6a0cff8f33c4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:30.585375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2baf43c8-067e-4cda-9c19-6a0cff8f33c4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:30.616289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2baf43c8-067e-4cda-9c19-6a0cff8f33c4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.617123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2baf43c8-067e-4cda-9c19-6a0cff8f33c4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.617928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2baf43c8-067e-4cda-9c19-6a0cff8f33c4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.618944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2baf43c8-067e-4cda-9c19-6a0cff8f33c4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.619707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2baf43c8-067e-4cda-9c19-6a0cff8f33c4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.620452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2baf43c8-067e-4cda-9c19-6a0cff8f33c4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.642071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:30.653496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-70dfa08f-45e3-4b4f-a0b8-660939f2cf5a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:30.654491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-70dfa08f-45e3-4b4f-a0b8-660939f2cf5a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:30.674263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70dfa08f-45e3-4b4f-a0b8-660939f2cf5a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.686879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70dfa08f-45e3-4b4f-a0b8-660939f2cf5a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.691605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70dfa08f-45e3-4b4f-a0b8-660939f2cf5a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.692542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70dfa08f-45e3-4b4f-a0b8-660939f2cf5a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.719242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70dfa08f-45e3-4b4f-a0b8-660939f2cf5a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.720038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70dfa08f-45e3-4b4f-a0b8-660939f2cf5a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.835324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:31.574928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2baf43c8-067e-4cda-9c19-6a0cff8f33c4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:31.591810 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2baf43c8-067e-4cda-9c19-6a0cff8f33c4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1308 microversion: 2.1 time: 1.014032 Oct 04 18:23:31.594103 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2495/5000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:30 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1308 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:31.616810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-70dfa08f-45e3-4b4f-a0b8-660939f2cf5a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:31.626422 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-70dfa08f-45e3-4b4f-a0b8-660939f2cf5a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.976886 Oct 04 18:23:31.627593 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2506/5001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:30 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:32.617046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:32.617667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:32.637276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.637634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.638086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.638802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.639298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.639729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.654055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13e975d7-169e-48b3-90c2-9d7780c8fc99 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:32.655908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-13e975d7-169e-48b3-90c2-9d7780c8fc99 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:32.672166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13e975d7-169e-48b3-90c2-9d7780c8fc99 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.674834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13e975d7-169e-48b3-90c2-9d7780c8fc99 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.675521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13e975d7-169e-48b3-90c2-9d7780c8fc99 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.678940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13e975d7-169e-48b3-90c2-9d7780c8fc99 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.680875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13e975d7-169e-48b3-90c2-9d7780c8fc99 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.683929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13e975d7-169e-48b3-90c2-9d7780c8fc99 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:33.420079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:33.433033 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1308 microversion: 2.1 time: 0.819975 Oct 04 18:23:33.437469 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2496/5002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:32 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1308 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:33.442145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:33.455972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-13e975d7-169e-48b3-90c2-9d7780c8fc99 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:33.458102 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b03eaaa0-213f-4fb1-ad6c-386234abc123 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002889 Oct 04 18:23:33.461100 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2497/5003] 10.222.0.18 () {56 vars in 886 bytes} [Tue Oct 4 18:23:33 2022] GET /compute/ => generated 377 bytes in 21 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:23:33.472260 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-13e975d7-169e-48b3-90c2-9d7780c8fc99 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.825950 Oct 04 18:23:33.478144 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2507/5004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:32 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:34.463404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f5386a7d-f6c5-4650-abb6-7b959326a970 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:34.465299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f5386a7d-f6c5-4650-abb6-7b959326a970 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:34.491812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5386a7d-f6c5-4650-abb6-7b959326a970 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.494437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5386a7d-f6c5-4650-abb6-7b959326a970 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.497941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5386a7d-f6c5-4650-abb6-7b959326a970 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.499433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb711453-b011-440e-a96a-9852718b44d7 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:34.500066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bb711453-b011-440e-a96a-9852718b44d7 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:34.502695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5386a7d-f6c5-4650-abb6-7b959326a970 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.504208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5386a7d-f6c5-4650-abb6-7b959326a970 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.507096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5386a7d-f6c5-4650-abb6-7b959326a970 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.515256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb711453-b011-440e-a96a-9852718b44d7 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.515763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb711453-b011-440e-a96a-9852718b44d7 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.516213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb711453-b011-440e-a96a-9852718b44d7 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.524920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb711453-b011-440e-a96a-9852718b44d7 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.525663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb711453-b011-440e-a96a-9852718b44d7 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.529774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb711453-b011-440e-a96a-9852718b44d7 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.848727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bb711453-b011-440e-a96a-9852718b44d7 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:34.864295 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb711453-b011-440e-a96a-9852718b44d7 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.370405 Oct 04 18:23:34.865191 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2508/5005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:34 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:34.895499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f5386a7d-f6c5-4650-abb6-7b959326a970 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:34.907309 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f5386a7d-f6c5-4650-abb6-7b959326a970 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1308 microversion: 2.1 time: 0.450892 Oct 04 18:23:34.909468 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2498/5006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:34 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1308 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:35.889218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4b0c14d9-e8ed-4a16-9a53-fc342e7551b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:35.889844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4b0c14d9-e8ed-4a16-9a53-fc342e7551b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:35.902340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b0c14d9-e8ed-4a16-9a53-fc342e7551b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.902853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b0c14d9-e8ed-4a16-9a53-fc342e7551b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.903341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b0c14d9-e8ed-4a16-9a53-fc342e7551b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:35.904065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b0c14d9-e8ed-4a16-9a53-fc342e7551b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.904535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b0c14d9-e8ed-4a16-9a53-fc342e7551b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.909114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b0c14d9-e8ed-4a16-9a53-fc342e7551b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:35.929944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b5b00eee-bb19-4859-a59d-210956ae6516 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:35.930573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b5b00eee-bb19-4859-a59d-210956ae6516 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:35.946803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b00eee-bb19-4859-a59d-210956ae6516 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.953206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b00eee-bb19-4859-a59d-210956ae6516 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.953715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b00eee-bb19-4859-a59d-210956ae6516 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:35.957395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b00eee-bb19-4859-a59d-210956ae6516 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.958003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b00eee-bb19-4859-a59d-210956ae6516 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.958667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b00eee-bb19-4859-a59d-210956ae6516 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.621665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4b0c14d9-e8ed-4a16-9a53-fc342e7551b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.648677 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4b0c14d9-e8ed-4a16-9a53-fc342e7551b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.761671 Oct 04 18:23:36.651487 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2509/5007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:35 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:36.716636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f53accc4-62c9-4625-8b73-0738b39aa344 req-90f2ad01-8e4e-4d45-add8-e6536aa6b772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c70006-2657-45c6-8510-4894b51c1bad", "name": "network-vif-plugged", "status": "completed", "tag": "64e822ca-fc96-49b1-8f5d-cabaf5508b13"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:36.742144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b5b00eee-bb19-4859-a59d-210956ae6516 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.744217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f53accc4-62c9-4625-8b73-0738b39aa344 req-90f2ad01-8e4e-4d45-add8-e6536aa6b772 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:36.744715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f53accc4-62c9-4625-8b73-0738b39aa344 req-90f2ad01-8e4e-4d45-add8-e6536aa6b772 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:36.745160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f53accc4-62c9-4625-8b73-0738b39aa344 req-90f2ad01-8e4e-4d45-add8-e6536aa6b772 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.750758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b5b00eee-bb19-4859-a59d-210956ae6516 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1308 microversion: 2.1 time: 0.824705 Oct 04 18:23:36.755055 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2499/5008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:35 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1308 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:36.799659 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f53accc4-62c9-4625-8b73-0738b39aa344 req-90f2ad01-8e4e-4d45-add8-e6536aa6b772 service nova] Creating event network-vif-plugged:64e822ca-fc96-49b1-8f5d-cabaf5508b13 for instance f5c70006-2657-45c6-8510-4894b51c1bad on n-h1-850499-14 Oct 04 18:23:36.822526 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f53accc4-62c9-4625-8b73-0738b39aa344 req-90f2ad01-8e4e-4d45-add8-e6536aa6b772 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110590 Oct 04 18:23:36.824403 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2510/5009] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:37.677998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a5d5beb-5bf9-4068-b2cd-0893ab12a9c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:37.678619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1a5d5beb-5bf9-4068-b2cd-0893ab12a9c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:37.694764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5d5beb-5bf9-4068-b2cd-0893ab12a9c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.695507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5d5beb-5bf9-4068-b2cd-0893ab12a9c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.697738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5d5beb-5bf9-4068-b2cd-0893ab12a9c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.702412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5d5beb-5bf9-4068-b2cd-0893ab12a9c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.705802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5d5beb-5bf9-4068-b2cd-0893ab12a9c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.708212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a5d5beb-5bf9-4068-b2cd-0893ab12a9c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.779003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ffbe34d4-cca0-4e65-b5d9-15d500070502 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:37.780453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ffbe34d4-cca0-4e65-b5d9-15d500070502 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:37.794406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffbe34d4-cca0-4e65-b5d9-15d500070502 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.800687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffbe34d4-cca0-4e65-b5d9-15d500070502 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.801362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffbe34d4-cca0-4e65-b5d9-15d500070502 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.802311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffbe34d4-cca0-4e65-b5d9-15d500070502 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.803119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffbe34d4-cca0-4e65-b5d9-15d500070502 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.803717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ffbe34d4-cca0-4e65-b5d9-15d500070502 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:38.310372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ffbe34d4-cca0-4e65-b5d9-15d500070502 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:38.323071 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ffbe34d4-cca0-4e65-b5d9-15d500070502 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1308 microversion: 2.1 time: 0.549260 Oct 04 18:23:38.327330 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2511/5010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:37 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:38.607955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1a5d5beb-5bf9-4068-b2cd-0893ab12a9c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:38.624565 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1a5d5beb-5bf9-4068-b2cd-0893ab12a9c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1522 microversion: 2.1 time: 0.948130 Oct 04 18:23:38.635707 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2500/5011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:37 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1522 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:38.976370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:38.977133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:38.992542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:38.994119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:38.998212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.004071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.005990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.006553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.037406 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] HTTP exception thrown: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Request method failure captured: Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef HTTP/1.1 Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiadBR6CysqB9yQB7F3JCvpxSsHyJy0mT-tgRWF_4lkLmYkkkTp1u1LEfav-pltaOFx0CfYYdxcvpLc7IE6xO_IBD4LnIiLlflwVpTuqGv9AgUpWCxZeowjz_bFhv4B46eKGMU-BFvZTsvjnzUTpwWR7cCngsvmitcf8RBsZh_NOKM Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}] Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 30a7a667883542e386cb3fd5b65abc90 Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '1908ea35-63c6-453c-b505-ce3990be8cef'} Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:39.042704 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:39.048468 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:39.051278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Returning 404 to user: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:39.053482 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-569f7c58-e9b7-4fd5-ae14-210816dafc83 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 404 len: 111 microversion: 2.1 time: 0.081448 Oct 04 18:23:39.054239 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2512/5012] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:38 2022] DELETE /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:39.066012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:39.066631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: 1908ea35-63c6-453c-b505-ce3990be8cef] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:39.081790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.084748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.085939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.088642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.089266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.090075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.125989 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] HTTP exception thrown: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Request method failure captured: Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef HTTP/1.1 Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHiadBR6CysqB9yQB7F3JCvpxSsHyJy0mT-tgRWF_4lkLmYkkkTp1u1LEfav-pltaOFx0CfYYdxcvpLc7IE6xO_IBD4LnIiLlflwVpTuqGv9AgUpWCxZeowjz_bFhv4B46eKGMU-BFvZTsvjnzUTpwWR7cCngsvmitcf8RBsZh_NOKM Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}] Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 30a7a667883542e386cb3fd5b65abc90 Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '1908ea35-63c6-453c-b505-ce3990be8cef'} Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:39.132697 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:39.138554 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:39.138554 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:39.138554 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:39.138554 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:39.138554 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:39.138554 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. Oct 04 18:23:39.138554 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:39.138554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Returning 404 to user: Instance 1908ea35-63c6-453c-b505-ce3990be8cef could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:39.140394 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d4b5b2f2-bd39-4c6f-ac84-983644d8858c tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef" status: 404 len: 111 microversion: 2.1 time: 0.081611 Oct 04 18:23:39.147513 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2501/5013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:39 2022] GET /compute/v2.1/servers/1908ea35-63c6-453c-b505-ce3990be8cef => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:39.354639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8861db13-f1d5-4d29-89cf-a28ae48ab7fb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:39.355727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8861db13-f1d5-4d29-89cf-a28ae48ab7fb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:39.366172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8861db13-f1d5-4d29-89cf-a28ae48ab7fb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.367502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8861db13-f1d5-4d29-89cf-a28ae48ab7fb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.369529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8861db13-f1d5-4d29-89cf-a28ae48ab7fb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.370601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8861db13-f1d5-4d29-89cf-a28ae48ab7fb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.372543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8861db13-f1d5-4d29-89cf-a28ae48ab7fb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.375544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8861db13-f1d5-4d29-89cf-a28ae48ab7fb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.652615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eb31b722-ca5e-4b84-b7c3-8c7378c44ca1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:39.653588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eb31b722-ca5e-4b84-b7c3-8c7378c44ca1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:39.666622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb31b722-ca5e-4b84-b7c3-8c7378c44ca1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.679740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb31b722-ca5e-4b84-b7c3-8c7378c44ca1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.684005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb31b722-ca5e-4b84-b7c3-8c7378c44ca1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.685209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb31b722-ca5e-4b84-b7c3-8c7378c44ca1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.687946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb31b722-ca5e-4b84-b7c3-8c7378c44ca1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.688610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb31b722-ca5e-4b84-b7c3-8c7378c44ca1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.940898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8861db13-f1d5-4d29-89cf-a28ae48ab7fb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:39.952791 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8861db13-f1d5-4d29-89cf-a28ae48ab7fb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1308 microversion: 2.1 time: 0.602814 Oct 04 18:23:39.957560 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2513/5014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:39 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:40.620860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eb31b722-ca5e-4b84-b7c3-8c7378c44ca1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:40.630392 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eb31b722-ca5e-4b84-b7c3-8c7378c44ca1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1502 microversion: 2.1 time: 0.984508 Oct 04 18:23:40.632040 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2502/5015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:39 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1502 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:40.662680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99fa796b-dce9-4eb0-9d5a-0f46c2c50b31 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:40.671485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99fa796b-dce9-4eb0-9d5a-0f46c2c50b31 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:40.683473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99fa796b-dce9-4eb0-9d5a-0f46c2c50b31 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:40.683986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99fa796b-dce9-4eb0-9d5a-0f46c2c50b31 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:40.684430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99fa796b-dce9-4eb0-9d5a-0f46c2c50b31 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:40.693526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99fa796b-dce9-4eb0-9d5a-0f46c2c50b31 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:40.694043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99fa796b-dce9-4eb0-9d5a-0f46c2c50b31 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:40.697884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99fa796b-dce9-4eb0-9d5a-0f46c2c50b31 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:40.981535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-23f36cc5-99c1-4f62-9dee-ee8948a07c30 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:40.982085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-23f36cc5-99c1-4f62-9dee-ee8948a07c30 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:40.994185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23f36cc5-99c1-4f62-9dee-ee8948a07c30 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:40.994689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23f36cc5-99c1-4f62-9dee-ee8948a07c30 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:40.995167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23f36cc5-99c1-4f62-9dee-ee8948a07c30 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:40.995885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23f36cc5-99c1-4f62-9dee-ee8948a07c30 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:40.996345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23f36cc5-99c1-4f62-9dee-ee8948a07c30 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:40.996774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23f36cc5-99c1-4f62-9dee-ee8948a07c30 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.115360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-99fa796b-dce9-4eb0-9d5a-0f46c2c50b31 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:41.128570 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99fa796b-dce9-4eb0-9d5a-0f46c2c50b31 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1515 microversion: 2.1 time: 0.471260 Oct 04 18:23:41.130942 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2514/5016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:40 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1515 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:41.154774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba4f9d1c-b228-44dc-ae21-b61ca094a761 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:41.160410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba4f9d1c-b228-44dc-ae21-b61ca094a761 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: e73d3991-eec9-424e-b526-67f6c0766ad0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:41.170394 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ba4f9d1c-b228-44dc-ae21-b61ca094a761 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] HTTP exception thrown: Instance e73d3991-eec9-424e-b526-67f6c0766ad0 could not be found. Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba4f9d1c-b228-44dc-ae21-b61ca094a761 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Request method failure captured: Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/e73d3991-eec9-424e-b526-67f6c0766ad0/action HTTP/1.1 Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 14 Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHnytef4l2dTU_iEGj2JHMj914KTgOcJXrZhkr0wpO7nRbM8OarsMPEpoh7kshRbzuhK9viViE8Sc8SnS-I9yNZdiPzuJrN6shc_HK2tbFONi9WDFR1vVIu70L5UasJlaDkchO8edMdo-N8WJ-RTGom7YRcTfKpi8ODDI4s0GHlW8GE Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab1cdc33329a4a10970e67390f750163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}] Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 5a7fc8671d264393bfb0465438b598d1 Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: {"rescue": {}} Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e73d3991-eec9-424e-b526-67f6c0766ad0 could not be found. Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e73d3991-eec9-424e-b526-67f6c0766ad0', 'body': {'rescue': {}}} Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73d3991-eec9-424e-b526-67f6c0766ad0 could not be found. Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73d3991-eec9-424e-b526-67f6c0766ad0 could not be found. Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:41.181688 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:41.187157 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:41.187157 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:41.187157 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:41.187157 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:41.187157 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73d3991-eec9-424e-b526-67f6c0766ad0 could not be found. Oct 04 18:23:41.187157 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:41.188130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba4f9d1c-b228-44dc-ae21-b61ca094a761 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Returning 404 to user: Instance e73d3991-eec9-424e-b526-67f6c0766ad0 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:41.189915 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba4f9d1c-b228-44dc-ae21-b61ca094a761 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/e73d3991-eec9-424e-b526-67f6c0766ad0/action" status: 404 len: 111 microversion: 2.1 time: 0.040882 Oct 04 18:23:41.192046 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2515/5017] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:41 2022] POST /compute/v2.1/servers/e73d3991-eec9-424e-b526-67f6c0766ad0/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:41.199988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-231025c7-ee13-4f90-97d5-4d7e3ec24055 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:41.200687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-231025c7-ee13-4f90-97d5-4d7e3ec24055 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:41.208374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-231025c7-ee13-4f90-97d5-4d7e3ec24055 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.209126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-231025c7-ee13-4f90-97d5-4d7e3ec24055 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.209947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-231025c7-ee13-4f90-97d5-4d7e3ec24055 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.210914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-231025c7-ee13-4f90-97d5-4d7e3ec24055 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.211622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-231025c7-ee13-4f90-97d5-4d7e3ec24055 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.212277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-231025c7-ee13-4f90-97d5-4d7e3ec24055 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.306552 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-231025c7-ee13-4f90-97d5-4d7e3ec24055 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action" status: 202 len: 0 microversion: 2.1 time: 0.109847 Oct 04 18:23:41.307773 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2516/5018] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:41 2022] POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:23:41.343369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e5c5b67e-7a90-4e48-a7ef-45329ec88b94 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:41.344904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e5c5b67e-7a90-4e48-a7ef-45329ec88b94 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:41.352642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c5b67e-7a90-4e48-a7ef-45329ec88b94 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.353506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c5b67e-7a90-4e48-a7ef-45329ec88b94 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.354178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c5b67e-7a90-4e48-a7ef-45329ec88b94 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.355304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c5b67e-7a90-4e48-a7ef-45329ec88b94 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.355945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c5b67e-7a90-4e48-a7ef-45329ec88b94 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.356667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5c5b67e-7a90-4e48-a7ef-45329ec88b94 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.513592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-23f36cc5-99c1-4f62-9dee-ee8948a07c30 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:41.523684 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-23f36cc5-99c1-4f62-9dee-ee8948a07c30 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1489 microversion: 2.1 time: 0.546007 Oct 04 18:23:41.535911 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2503/5019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:40 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1489 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:41.548415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03e02015-ab98-44b3-a30a-003e7c88f495 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1635632638"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:41.552228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-03e02015-ab98-44b3-a30a-003e7c88f495 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:41.564063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03e02015-ab98-44b3-a30a-003e7c88f495 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.564626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03e02015-ab98-44b3-a30a-003e7c88f495 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.565322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03e02015-ab98-44b3-a30a-003e7c88f495 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.568806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03e02015-ab98-44b3-a30a-003e7c88f495 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.569915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03e02015-ab98-44b3-a30a-003e7c88f495 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.572366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03e02015-ab98-44b3-a30a-003e7c88f495 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.641619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5c5b67e-7a90-4e48-a7ef-45329ec88b94 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:41.660572 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e5c5b67e-7a90-4e48-a7ef-45329ec88b94 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1520 microversion: 2.1 time: 0.326227 Oct 04 18:23:41.662305 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2517/5020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:41 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:41.700824 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-03e02015-ab98-44b3-a30a-003e7c88f495 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "PUT /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1075 microversion: 2.1 time: 0.157331 Oct 04 18:23:41.706192 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2504/5021] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 4 18:23:41 2022] PUT /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1075 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:41.727834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ad1fb406-5022-4c7d-9b9f-980ba51ded43 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:41.728282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ad1fb406-5022-4c7d-9b9f-980ba51ded43 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:41.731834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:41.757358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad1fb406-5022-4c7d-9b9f-980ba51ded43 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.757887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad1fb406-5022-4c7d-9b9f-980ba51ded43 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.758343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad1fb406-5022-4c7d-9b9f-980ba51ded43 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.763714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad1fb406-5022-4c7d-9b9f-980ba51ded43 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.766884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad1fb406-5022-4c7d-9b9f-980ba51ded43 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.767966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad1fb406-5022-4c7d-9b9f-980ba51ded43 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.052052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ad1fb406-5022-4c7d-9b9f-980ba51ded43 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.063233 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ad1fb406-5022-4c7d-9b9f-980ba51ded43 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1501 microversion: 2.1 time: 0.339429 Oct 04 18:23:42.063824 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2518/5022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:41 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1501 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:42.087158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a60910b6-b5f2-4c75-8854-85bf6d1e48bb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:42.087853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a60910b6-b5f2-4c75-8854-85bf6d1e48bb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:42.098715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a60910b6-b5f2-4c75-8854-85bf6d1e48bb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.101414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a60910b6-b5f2-4c75-8854-85bf6d1e48bb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.101683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a60910b6-b5f2-4c75-8854-85bf6d1e48bb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.106402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a60910b6-b5f2-4c75-8854-85bf6d1e48bb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.107181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a60910b6-b5f2-4c75-8854-85bf6d1e48bb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.107807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a60910b6-b5f2-4c75-8854-85bf6d1e48bb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.389776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a60910b6-b5f2-4c75-8854-85bf6d1e48bb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.399128 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a60910b6-b5f2-4c75-8854-85bf6d1e48bb tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1501 microversion: 2.1 time: 0.316343 Oct 04 18:23:42.399699 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2505/5023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:42 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:42.423326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b762d18-1af3-4276-8f18-7700cad3e804 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:42.439078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b762d18-1af3-4276-8f18-7700cad3e804 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.440233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b762d18-1af3-4276-8f18-7700cad3e804 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.440750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b762d18-1af3-4276-8f18-7700cad3e804 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.494420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9b762d18-1af3-4276-8f18-7700cad3e804 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Going to try to stop instance {{(pid=122331) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:23:42.552900 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b762d18-1af3-4276-8f18-7700cad3e804 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "POST /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad/action" status: 202 len: 0 microversion: 2.1 time: 0.132995 Oct 04 18:23:42.554306 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2519/5024] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:42 2022] POST /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:42.562482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-77af2231-d6b2-4741-b6e1-d55063d1d980 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:42.563678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-77af2231-d6b2-4741-b6e1-d55063d1d980 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:42.576873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77af2231-d6b2-4741-b6e1-d55063d1d980 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.582482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77af2231-d6b2-4741-b6e1-d55063d1d980 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.585800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77af2231-d6b2-4741-b6e1-d55063d1d980 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.586943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77af2231-d6b2-4741-b6e1-d55063d1d980 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.587696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77af2231-d6b2-4741-b6e1-d55063d1d980 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.588392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77af2231-d6b2-4741-b6e1-d55063d1d980 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.689636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3abc2d11-0000-4f01-b3ca-e1a4965c0d23 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:42.690367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3abc2d11-0000-4f01-b3ca-e1a4965c0d23 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:42.706767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3abc2d11-0000-4f01-b3ca-e1a4965c0d23 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.723137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3abc2d11-0000-4f01-b3ca-e1a4965c0d23 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.725061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3abc2d11-0000-4f01-b3ca-e1a4965c0d23 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.726540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3abc2d11-0000-4f01-b3ca-e1a4965c0d23 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.727107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3abc2d11-0000-4f01-b3ca-e1a4965c0d23 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.739802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3abc2d11-0000-4f01-b3ca-e1a4965c0d23 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.917842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-77af2231-d6b2-4741-b6e1-d55063d1d980 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.928442 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-77af2231-d6b2-4741-b6e1-d55063d1d980 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.370087 Oct 04 18:23:42.929311 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2506/5025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:42 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:42.973056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3abc2d11-0000-4f01-b3ca-e1a4965c0d23 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.981744 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3abc2d11-0000-4f01-b3ca-e1a4965c0d23 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1500 microversion: 2.1 time: 0.299956 Oct 04 18:23:42.982330 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2520/5026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:42 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1500 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:43.010810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:43.013425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.027828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.028339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.028787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.029537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.029966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.030466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.084334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lazy-loading 'flavor' on Instance uuid 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:43.117301 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] HTTP exception thrown: Cannot 'rescue' instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 while it is in vm_state paused Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Request method failure captured: Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action HTTP/1.1 Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 14 Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHnytef4l2dTU_iEGj2JHMj914KTgOcJXrZhkr0wpO7nRbM8OarsMPEpoh7kshRbzuhK9viViE8Sc8SnS-I9yNZdiPzuJrN6shc_HK2tbFONi9WDFR1vVIu70L5UasJlaDkchO8edMdo-N8WJ-RTGom7YRcTfKpi8ODDI4s0GHlW8GE Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab1cdc33329a4a10970e67390f750163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}] Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5a7fc8671d264393bfb0465438b598d1 Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: {"rescue": {}} Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'rescue' instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 while it is in vm_state paused Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '2c5bebc4-0fb3-4027-a4ff-4ff8301fc986', 'body': {'rescue': {}}} Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 while it is in vm_state paused Oct 04 18:23:43.122196 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 while it is in vm_state paused Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Returning 409 to user: Cannot 'rescue' instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 while it is in vm_state paused {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96838ca4-1de3-4729-9e1d-2b208920a706 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action" status: 409 len: 144 microversion: 2.1 time: 0.119225 Oct 04 18:23:43.126996 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2507/5027] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:43 2022] POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action => generated 144 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:23:43.134196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0afcf9ec-ef1f-46f6-ad69-3cff682d9925 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:43.134800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0afcf9ec-ef1f-46f6-ad69-3cff682d9925 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.150025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0afcf9ec-ef1f-46f6-ad69-3cff682d9925 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.150788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0afcf9ec-ef1f-46f6-ad69-3cff682d9925 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.151606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0afcf9ec-ef1f-46f6-ad69-3cff682d9925 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.152616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0afcf9ec-ef1f-46f6-ad69-3cff682d9925 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.154276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0afcf9ec-ef1f-46f6-ad69-3cff682d9925 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.155548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0afcf9ec-ef1f-46f6-ad69-3cff682d9925 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.297789 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0afcf9ec-ef1f-46f6-ad69-3cff682d9925 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action" status: 202 len: 0 microversion: 2.1 time: 0.167223 Oct 04 18:23:43.299629 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2521/5028] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:43 2022] POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:43.308853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85279a88-e57b-4ad1-b3fb-6a547a05ccaa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:43.309558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-85279a88-e57b-4ad1-b3fb-6a547a05ccaa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.327347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85279a88-e57b-4ad1-b3fb-6a547a05ccaa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.329026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85279a88-e57b-4ad1-b3fb-6a547a05ccaa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.330801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85279a88-e57b-4ad1-b3fb-6a547a05ccaa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.335579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85279a88-e57b-4ad1-b3fb-6a547a05ccaa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.336145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85279a88-e57b-4ad1-b3fb-6a547a05ccaa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.336612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85279a88-e57b-4ad1-b3fb-6a547a05ccaa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.700993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-85279a88-e57b-4ad1-b3fb-6a547a05ccaa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:43.710147 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-85279a88-e57b-4ad1-b3fb-6a547a05ccaa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1507 microversion: 2.1 time: 0.406369 Oct 04 18:23:43.723147 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2508/5029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:43 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1507 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:43.855265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:43.855839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.883803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.888999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.890516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.893890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.894646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.895368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.922565 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] HTTP exception thrown: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Request method failure captured: Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e HTTP/1.1 Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHiadBR6CysqB9yQB7F3JCvpxSsHyJy0mT-tgRWF_4lkLmYkkkTp1u1LEfav-pltaOFx0CfYYdxcvpLc7IE6xO_IBD4LnIiLlflwVpTuqGv9AgUpWCxZeowjz_bFhv4B46eKGMU-BFvZTsvjnzUTpwWR7cCngsvmitcf8RBsZh_NOKM Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}] Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 30a7a667883542e386cb3fd5b65abc90 Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e8b2bfb3-d80f-4ed6-95f0-5face8d7581e'} Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:43.925819 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:23:43.930612 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:43.934875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Returning 404 to user: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:43.936013 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ec8b64ef-c378-4dc2-b59c-71dd6f5fc4e9 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 404 len: 111 microversion: 2.1 time: 0.086318 Oct 04 18:23:43.937613 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2522/5030] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:43 2022] DELETE /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:43.945877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:43.946772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] [instance: e8b2bfb3-d80f-4ed6-95f0-5face8d7581e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.956183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.957955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.959621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d533a45-3eb9-46e9-aed2-ebf0eddc0daa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:43.960418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8d533a45-3eb9-46e9-aed2-ebf0eddc0daa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.960694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.963237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.964473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.966410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.978740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d533a45-3eb9-46e9-aed2-ebf0eddc0daa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.979279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d533a45-3eb9-46e9-aed2-ebf0eddc0daa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.979940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d533a45-3eb9-46e9-aed2-ebf0eddc0daa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.980841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d533a45-3eb9-46e9-aed2-ebf0eddc0daa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.981469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d533a45-3eb9-46e9-aed2-ebf0eddc0daa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.982056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d533a45-3eb9-46e9-aed2-ebf0eddc0daa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.990598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:44.008307 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] HTTP exception thrown: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Request method failure captured: Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e HTTP/1.1 Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHiadBR6CysqB9yQB7F3JCvpxSsHyJy0mT-tgRWF_4lkLmYkkkTp1u1LEfav-pltaOFx0CfYYdxcvpLc7IE6xO_IBD4LnIiLlflwVpTuqGv9AgUpWCxZeowjz_bFhv4B46eKGMU-BFvZTsvjnzUTpwWR7cCngsvmitcf8RBsZh_NOKM Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bc1c88ac592a4375a805aec597fbd50a"}]}] Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bc1c88ac592a4375a805aec597fbd50a Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1238086399 Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 30a7a667883542e386cb3fd5b65abc90 Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeTestJSON-1238086399-project Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'e8b2bfb3-d80f-4ed6-95f0-5face8d7581e'} Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:44.014069 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:44.018730 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:44.018730 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:44.018730 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:44.018730 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:44.018730 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:44.018730 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. Oct 04 18:23:44.018730 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:44.023379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] Returning 404 to user: Instance e8b2bfb3-d80f-4ed6-95f0-5face8d7581e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:44.024916 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d5d56ea-dd4d-4afe-aff8-a51135c17633 tempest-AttachVolumeTestJSON-1238086399 tempest-AttachVolumeTestJSON-1238086399-project] 10.222.0.18 "GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e" status: 404 len: 111 microversion: 2.1 time: 0.083027 Oct 04 18:23:44.027871 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2509/5031] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:43 2022] GET /compute/v2.1/servers/e8b2bfb3-d80f-4ed6-95f0-5face8d7581e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:44.390327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d533a45-3eb9-46e9-aed2-ebf0eddc0daa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.401093 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8d533a45-3eb9-46e9-aed2-ebf0eddc0daa tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.450513 Oct 04 18:23:44.402247 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2523/5032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:43 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:44.737378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eaecad91-9e16-42d3-976c-f69f18d5582e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:44.738395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eaecad91-9e16-42d3-976c-f69f18d5582e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:44.755483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaecad91-9e16-42d3-976c-f69f18d5582e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:44.756280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaecad91-9e16-42d3-976c-f69f18d5582e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:44.756747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaecad91-9e16-42d3-976c-f69f18d5582e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:44.760673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaecad91-9e16-42d3-976c-f69f18d5582e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:44.762283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaecad91-9e16-42d3-976c-f69f18d5582e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:44.762750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaecad91-9e16-42d3-976c-f69f18d5582e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:44.977884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eaecad91-9e16-42d3-976c-f69f18d5582e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.995504 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eaecad91-9e16-42d3-976c-f69f18d5582e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1515 microversion: 2.1 time: 0.263960 Oct 04 18:23:44.998072 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2510/5033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:44 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:45.429410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be14b8ca-f268-49fb-b041-daee74dfc060 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:45.430119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be14b8ca-f268-49fb-b041-daee74dfc060 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:45.455268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be14b8ca-f268-49fb-b041-daee74dfc060 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.460173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be14b8ca-f268-49fb-b041-daee74dfc060 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.461315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be14b8ca-f268-49fb-b041-daee74dfc060 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.462805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be14b8ca-f268-49fb-b041-daee74dfc060 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.466742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be14b8ca-f268-49fb-b041-daee74dfc060 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.470173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be14b8ca-f268-49fb-b041-daee74dfc060 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:46.085493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be14b8ca-f268-49fb-b041-daee74dfc060 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:46.096569 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be14b8ca-f268-49fb-b041-daee74dfc060 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.671751 Oct 04 18:23:46.099101 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2524/5034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:45 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:47.120415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd59f2e5-599d-4a7d-995f-ff12f635a2e8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:47.121651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cd59f2e5-599d-4a7d-995f-ff12f635a2e8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:47.163458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd59f2e5-599d-4a7d-995f-ff12f635a2e8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:47.168466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd59f2e5-599d-4a7d-995f-ff12f635a2e8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:47.169225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd59f2e5-599d-4a7d-995f-ff12f635a2e8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:47.170151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd59f2e5-599d-4a7d-995f-ff12f635a2e8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:47.173225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd59f2e5-599d-4a7d-995f-ff12f635a2e8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:47.174198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd59f2e5-599d-4a7d-995f-ff12f635a2e8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:47.677083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cd59f2e5-599d-4a7d-995f-ff12f635a2e8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:47.691409 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cd59f2e5-599d-4a7d-995f-ff12f635a2e8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.575172 Oct 04 18:23:47.696417 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2511/5035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:47 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:47.975793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-279ca3f7-b146-4aa6-bbe4-5f32d22421f3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:47.978798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-279ca3f7-b146-4aa6-bbe4-5f32d22421f3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:47.990379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279ca3f7-b146-4aa6-bbe4-5f32d22421f3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:47.991548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279ca3f7-b146-4aa6-bbe4-5f32d22421f3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:47.993743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279ca3f7-b146-4aa6-bbe4-5f32d22421f3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:47.994742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279ca3f7-b146-4aa6-bbe4-5f32d22421f3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:47.997605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279ca3f7-b146-4aa6-bbe4-5f32d22421f3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:47.998346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-279ca3f7-b146-4aa6-bbe4-5f32d22421f3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.075875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-279ca3f7-b146-4aa6-bbe4-5f32d22421f3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lazy-loading 'flavor' on Instance uuid 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:48.259033 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-279ca3f7-b146-4aa6-bbe4-5f32d22421f3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action" status: 200 len: 32 microversion: 2.1 time: 0.287524 Oct 04 18:23:48.264447 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2525/5036] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:47 2022] POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action => generated 32 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:23:48.271609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d644c78-2ef4-4818-99f4-cd791695e23f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:48.273303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3d644c78-2ef4-4818-99f4-cd791695e23f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:48.284808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d644c78-2ef4-4818-99f4-cd791695e23f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.286066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d644c78-2ef4-4818-99f4-cd791695e23f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.289843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d644c78-2ef4-4818-99f4-cd791695e23f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.291169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d644c78-2ef4-4818-99f4-cd791695e23f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.291856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d644c78-2ef4-4818-99f4-cd791695e23f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.292613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d644c78-2ef4-4818-99f4-cd791695e23f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.723382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6153e00d-af70-413a-b49d-52fe967621e4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:48.724367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6153e00d-af70-413a-b49d-52fe967621e4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:48.744641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6153e00d-af70-413a-b49d-52fe967621e4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.745672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6153e00d-af70-413a-b49d-52fe967621e4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.746313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6153e00d-af70-413a-b49d-52fe967621e4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.753940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6153e00d-af70-413a-b49d-52fe967621e4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.754720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6153e00d-af70-413a-b49d-52fe967621e4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.755511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6153e00d-af70-413a-b49d-52fe967621e4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.762472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3d644c78-2ef4-4818-99f4-cd791695e23f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:48.778336 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3d644c78-2ef4-4818-99f4-cd791695e23f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.511660 Oct 04 18:23:48.784151 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2512/5037] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:48 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:49.125685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6153e00d-af70-413a-b49d-52fe967621e4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:49.141384 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6153e00d-af70-413a-b49d-52fe967621e4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.423425 Oct 04 18:23:49.143079 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2526/5038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:48 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:49.809477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74c6fd6c-c9d5-4b71-89d3-4c389dc519a0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:49.816546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6670ffb-59a1-4ca7-a890-b5701056a011 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:49.819984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f6670ffb-59a1-4ca7-a890-b5701056a011 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:49.820256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-74c6fd6c-c9d5-4b71-89d3-4c389dc519a0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:49.836184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c6fd6c-c9d5-4b71-89d3-4c389dc519a0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.845258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6670ffb-59a1-4ca7-a890-b5701056a011 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.849921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6670ffb-59a1-4ca7-a890-b5701056a011 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.851614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c6fd6c-c9d5-4b71-89d3-4c389dc519a0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.854304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6670ffb-59a1-4ca7-a890-b5701056a011 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.854665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c6fd6c-c9d5-4b71-89d3-4c389dc519a0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.858516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c6fd6c-c9d5-4b71-89d3-4c389dc519a0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.859201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6670ffb-59a1-4ca7-a890-b5701056a011 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.859974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c6fd6c-c9d5-4b71-89d3-4c389dc519a0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.860127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6670ffb-59a1-4ca7-a890-b5701056a011 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.860497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6670ffb-59a1-4ca7-a890-b5701056a011 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.864945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c6fd6c-c9d5-4b71-89d3-4c389dc519a0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.927118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:50.598037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f6670ffb-59a1-4ca7-a890-b5701056a011 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:50.614136 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6670ffb-59a1-4ca7-a890-b5701056a011 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.798509 Oct 04 18:23:50.617635 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2527/5039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:49 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:50.624664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-74c6fd6c-c9d5-4b71-89d3-4c389dc519a0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:50.639354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-48b336f6-f0f6-4736-97b0-2891622eac77 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:50.640351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-48b336f6-f0f6-4736-97b0-2891622eac77 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:50.643383 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74c6fd6c-c9d5-4b71-89d3-4c389dc519a0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.838101 Oct 04 18:23:50.659889 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2513/5040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:49 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:50.675008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cb6564e0-415e-47b6-89de-c6bbbc6272ef tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:50.676240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cb6564e0-415e-47b6-89de-c6bbbc6272ef tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:50.677621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48b336f6-f0f6-4736-97b0-2891622eac77 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.678130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48b336f6-f0f6-4736-97b0-2891622eac77 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.678676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48b336f6-f0f6-4736-97b0-2891622eac77 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.689156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48b336f6-f0f6-4736-97b0-2891622eac77 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.691605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48b336f6-f0f6-4736-97b0-2891622eac77 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.693448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb6564e0-415e-47b6-89de-c6bbbc6272ef tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.695299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb6564e0-415e-47b6-89de-c6bbbc6272ef tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.696294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb6564e0-415e-47b6-89de-c6bbbc6272ef tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.698685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb6564e0-415e-47b6-89de-c6bbbc6272ef tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.699391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb6564e0-415e-47b6-89de-c6bbbc6272ef tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.700437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb6564e0-415e-47b6-89de-c6bbbc6272ef tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.707694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48b336f6-f0f6-4736-97b0-2891622eac77 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.666188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-48b336f6-f0f6-4736-97b0-2891622eac77 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.683242 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-48b336f6-f0f6-4736-97b0-2891622eac77 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 1.061127 Oct 04 18:23:51.683885 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2528/5041] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:50 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:51.704981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb94cfdd-a088-4091-8e84-3cd3fe897611 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.708783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bb94cfdd-a088-4091-8e84-3cd3fe897611 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:51.717143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cb6564e0-415e-47b6-89de-c6bbbc6272ef tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.731752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb94cfdd-a088-4091-8e84-3cd3fe897611 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.732353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb94cfdd-a088-4091-8e84-3cd3fe897611 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.733414 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cb6564e0-415e-47b6-89de-c6bbbc6272ef tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 1.066120 Oct 04 18:23:51.737367 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2514/5042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:50 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:51.738135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb94cfdd-a088-4091-8e84-3cd3fe897611 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.739203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb94cfdd-a088-4091-8e84-3cd3fe897611 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.739693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb94cfdd-a088-4091-8e84-3cd3fe897611 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.740125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb94cfdd-a088-4091-8e84-3cd3fe897611 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.765357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1867ead-72f9-4c3a-b726-feba79490a46 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.766321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1867ead-72f9-4c3a-b726-feba79490a46 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:51.786942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1867ead-72f9-4c3a-b726-feba79490a46 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.793493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1867ead-72f9-4c3a-b726-feba79490a46 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.798738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1867ead-72f9-4c3a-b726-feba79490a46 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.800621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1867ead-72f9-4c3a-b726-feba79490a46 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.804189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1867ead-72f9-4c3a-b726-feba79490a46 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.804646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1867ead-72f9-4c3a-b726-feba79490a46 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.284249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e1867ead-72f9-4c3a-b726-feba79490a46 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:52.294743 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1867ead-72f9-4c3a-b726-feba79490a46 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.533665 Oct 04 18:23:52.295361 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2515/5043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:51 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:52.319665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-36c0d6dd-cc6c-4169-ac32-fb3b1c205f0e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1532545621"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:52.322500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-36c0d6dd-cc6c-4169-ac32-fb3b1c205f0e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:52.348778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c0d6dd-cc6c-4169-ac32-fb3b1c205f0e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.350983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c0d6dd-cc6c-4169-ac32-fb3b1c205f0e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.351616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c0d6dd-cc6c-4169-ac32-fb3b1c205f0e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.356761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c0d6dd-cc6c-4169-ac32-fb3b1c205f0e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.357519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c0d6dd-cc6c-4169-ac32-fb3b1c205f0e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.359017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36c0d6dd-cc6c-4169-ac32-fb3b1c205f0e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.550931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bb94cfdd-a088-4091-8e84-3cd3fe897611 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:52.560873 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb94cfdd-a088-4091-8e84-3cd3fe897611 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.873775 Oct 04 18:23:52.567406 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2529/5044] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:51 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:52.708904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7b35313d-06f4-440d-a04c-2dcb67c7ae6b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:52.709559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7b35313d-06f4-440d-a04c-2dcb67c7ae6b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:52.727413 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-36c0d6dd-cc6c-4169-ac32-fb3b1c205f0e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.411808 Oct 04 18:23:52.731293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b35313d-06f4-440d-a04c-2dcb67c7ae6b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.731803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b35313d-06f4-440d-a04c-2dcb67c7ae6b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.733200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b35313d-06f4-440d-a04c-2dcb67c7ae6b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.733948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b35313d-06f4-440d-a04c-2dcb67c7ae6b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.734519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b35313d-06f4-440d-a04c-2dcb67c7ae6b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.734873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7b35313d-06f4-440d-a04c-2dcb67c7ae6b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.739356 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2516/5045] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:52 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 04 18:23:53.197172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7b35313d-06f4-440d-a04c-2dcb67c7ae6b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.226735 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7b35313d-06f4-440d-a04c-2dcb67c7ae6b tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.522586 Oct 04 18:23:53.229246 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2530/5046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:52 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:53.591211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1008be1f-2c77-4845-8633-1b424c6579b5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:53.592072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1008be1f-2c77-4845-8633-1b424c6579b5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:53.601579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1008be1f-2c77-4845-8633-1b424c6579b5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:53.611456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1008be1f-2c77-4845-8633-1b424c6579b5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:53.613454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1008be1f-2c77-4845-8633-1b424c6579b5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:53.614611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1008be1f-2c77-4845-8633-1b424c6579b5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:53.618562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1008be1f-2c77-4845-8633-1b424c6579b5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:53.620578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1008be1f-2c77-4845-8633-1b424c6579b5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.053151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1008be1f-2c77-4845-8633-1b424c6579b5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:54.065186 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1008be1f-2c77-4845-8633-1b424c6579b5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.479104 Oct 04 18:23:54.067008 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2517/5047] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:53 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:54.256482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7892f9de-740a-45fe-9d53-761fdb122dc2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.257351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7892f9de-740a-45fe-9d53-761fdb122dc2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:54.263735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7892f9de-740a-45fe-9d53-761fdb122dc2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.264485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7892f9de-740a-45fe-9d53-761fdb122dc2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.265139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7892f9de-740a-45fe-9d53-761fdb122dc2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.266084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7892f9de-740a-45fe-9d53-761fdb122dc2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.266784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7892f9de-740a-45fe-9d53-761fdb122dc2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.267471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7892f9de-740a-45fe-9d53-761fdb122dc2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.440124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7892f9de-740a-45fe-9d53-761fdb122dc2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:54.449791 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7892f9de-740a-45fe-9d53-761fdb122dc2 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.196788 Oct 04 18:23:54.453411 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2518/5048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:54 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:54.545216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d5b75e28-ed0b-42c4-aad0-edbcbf23cd1e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Action: 'create', calling method: .version_select at 0x7fd4d104d700>, body: {"keypair": {"name": "tempest-keypair-1684364586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/WpyFfVXGIEYjjvKJBSFc7Ljaz/nJstFgFmrtlGF8GhGI2VXC+QUusmXLSFmTi0WuZtfn89SlkSxw40HVV9nhx24QKijYmuNv+MbWlliVh6IGHZadphF7vG7W6aYOqtQ=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:54.567208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-d5b75e28-ed0b-42c4-aad0-edbcbf23cd1e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Getting quotas for project 880b25dfcd7c4a2ab247dd7855993dc8. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:23:54.574484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-d5b75e28-ed0b-42c4-aad0-edbcbf23cd1e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Getting quotas for user e5b5b2a021cb49279d695bdeed577655 and project 880b25dfcd7c4a2ab247dd7855993dc8. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:23:54.608082 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d5b75e28-ed0b-42c4-aad0-edbcbf23cd1e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.453623 Oct 04 18:23:54.608930 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2531/5049] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 4 18:23:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 456 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:23:54.628703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dfa08458-15f8-4ba6-a351-cd3e32f431cc tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Action: 'create', calling method: .version_select at 0x7fd4d6226ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1467952980", "metadata": {"Type": "work"}}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dfa08458-15f8-4ba6-a351-cd3e32f431cc tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Request method failure captured: Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 122 Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHo68dCEfg4JDWegkvpUd0qPGhUXr4bkdrAH4VfsKKwJOPTzjoCm9a0B6UfLQ0Lk_wi2o0PDtLkce6ZKRa4MpAL9DTWOLT-j1l_eOuDxVMWjtlmjeezYeXUlYWZ0lbqRFDxWQZWdCqMTrPb6cCxGH3TdRj_pdJqQXQH8Rq4aQBf38Xk Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}] Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 66a3d3a7deb74018ad5c7c2fa54c8ef0 Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1467952980", "metadata": {"Type": "work"}}} Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1467952980', 'metadata': {'Type': 'work'}}}} Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:23:54.634079 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dfa08458-15f8-4ba6-a351-cd3e32f431cc tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dfa08458-15f8-4ba6-a351-cd3e32f431cc tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.097233 Oct 04 18:23:54.638368 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2519/5050] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Oct 4 18:23:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:23:54.648814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9af66969-fc7e-4501-b1e2-13ce54d754ae tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Action: 'create', calling method: .version_select at 0x7fd4d0b5d5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-264540808", "metadata": {"Type": "work"}}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9af66969-fc7e-4501-b1e2-13ce54d754ae tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Request method failure captured: Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 119 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHo68dCEfg4JDWegkvpUd0qPGhUXr4bkdrAH4VfsKKwJOPTzjoCm9a0B6UfLQ0Lk_wi2o0PDtLkce6ZKRa4MpAL9DTWOLT-j1l_eOuDxVMWjtlmjeezYeXUlYWZ0lbqRFDxWQZWdCqMTrPb6cCxGH3TdRj_pdJqQXQH8Rq4aQBf38Xk Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}] Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 66a3d3a7deb74018ad5c7c2fa54c8ef0 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-264540808", "metadata": {"Type": "work"}}} Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-264540808', 'metadata': {'Type': 'work'}}}} Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi '0' Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:23:54.656537 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:23:54.662173 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.665776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9af66969-fc7e-4501-b1e2-13ce54d754ae tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:54.666731 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9af66969-fc7e-4501-b1e2-13ce54d754ae tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023732 Oct 04 18:23:54.674145 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2532/5051] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Oct 4 18:23:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:23:54.680283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d3d388e-89a0-482c-b5b4-d90989387fbd tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Action: 'create', calling method: .version_select at 0x7fd4d60fa040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-373165213", "metadata": {"Type": "work"}}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d3d388e-89a0-482c-b5b4-d90989387fbd tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Request method failure captured: Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 118 Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHo68dCEfg4JDWegkvpUd0qPGhUXr4bkdrAH4VfsKKwJOPTzjoCm9a0B6UfLQ0Lk_wi2o0PDtLkce6ZKRa4MpAL9DTWOLT-j1l_eOuDxVMWjtlmjeezYeXUlYWZ0lbqRFDxWQZWdCqMTrPb6cCxGH3TdRj_pdJqQXQH8Rq4aQBf38Xk Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}] Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 66a3d3a7deb74018ad5c7c2fa54c8ef0 Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-373165213", "metadata": {"Type": "work"}}} Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-373165213', 'metadata': {'Type': 'work'}}}} Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi '' Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:23:54.685282 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.691463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d3d388e-89a0-482c-b5b4-d90989387fbd tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:54.693561 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3d3d388e-89a0-482c-b5b4-d90989387fbd tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017950 Oct 04 18:23:54.699503 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2520/5052] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Oct 4 18:23:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:23:54.707172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-441358b7-9fad-4bb6-aa76-bf3318898e68 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Calling method '.version_select at 0x7fd4d0bb14c0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.752653 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-441358b7-9fad-4bb6-aa76-bf3318898e68 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] HTTP exception thrown: Volume tempest-invalid-1694895840 could not be found. Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-441358b7-9fad-4bb6-aa76-bf3318898e68 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Request method failure captured: Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1694895840 HTTP/1.1 Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHo68dCEfg4JDWegkvpUd0qPGhUXr4bkdrAH4VfsKKwJOPTzjoCm9a0B6UfLQ0Lk_wi2o0PDtLkce6ZKRa4MpAL9DTWOLT-j1l_eOuDxVMWjtlmjeezYeXUlYWZ0lbqRFDxWQZWdCqMTrPb6cCxGH3TdRj_pdJqQXQH8Rq4aQBf38Xk Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}] Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 66a3d3a7deb74018ad5c7c2fa54c8ef0 Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: exception: Volume tempest-invalid-1694895840 could not be found. Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'tempest-invalid-1694895840'} Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1694895840 could not be found. (HTTP 404) (Request-ID: req-200f9322-99e6-4638-9db2-273fd71a5e95) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:23:54.754703 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1694895840 could not be found. Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1694895840 could not be found. Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1694895840 could not be found. Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-441358b7-9fad-4bb6-aa76-bf3318898e68 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Returning 404 to user: Volume tempest-invalid-1694895840 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-441358b7-9fad-4bb6-aa76-bf3318898e68 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1694895840" status: 404 len: 99 microversion: 2.1 time: 0.055455 Oct 04 18:23:54.759870 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2533/5053] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 4 18:23:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1694895840 => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:23:54.769474 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d38a55de-aba2-4ab4-b7b2-eeb02a4e096b tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004383 Oct 04 18:23:54.770260 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2521/5054] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Oct 4 18:23:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:23:54.795156 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f785e2ba-4bfe-4051-9bf0-d568de8a1504 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013192 Oct 04 18:23:54.812203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16a80c03-7066-4b61-a7c1-f7ca87ce3f8c tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Calling method '.version_select at 0x7fd4d299c0d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.814741 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2534/5055] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 4 18:23:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:23:54.864831 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-16a80c03-7066-4b61-a7c1-f7ca87ce3f8c tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] HTTP exception thrown: Volume eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a could not be found. Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16a80c03-7066-4b61-a7c1-f7ca87ce3f8c tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Request method failure captured: Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/os-volumes/eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a HTTP/1.1 Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHo68dCEfg4JDWegkvpUd0qPGhUXr4bkdrAH4VfsKKwJOPTzjoCm9a0B6UfLQ0Lk_wi2o0PDtLkce6ZKRa4MpAL9DTWOLT-j1l_eOuDxVMWjtlmjeezYeXUlYWZ0lbqRFDxWQZWdCqMTrPb6cCxGH3TdRj_pdJqQXQH8Rq4aQBf38Xk Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}] Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 66a3d3a7deb74018ad5c7c2fa54c8ef0 Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: exception: Volume eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a could not be found. Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a'} Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a could not be found. (HTTP 404) (Request-ID: req-0dd5e9ad-8a4d-4910-95b3-270a94792753) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:23:54.867102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a could not be found. Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a could not be found. Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a could not be found. Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16a80c03-7066-4b61-a7c1-f7ca87ce3f8c tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Returning 404 to user: Volume eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-16a80c03-7066-4b61-a7c1-f7ca87ce3f8c tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a" status: 404 len: 109 microversion: 2.1 time: 0.066271 Oct 04 18:23:54.871375 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2522/5056] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:23:54 2022] DELETE /compute/v2.1/os-volumes/eedd37b6-3c20-4d8a-a12c-f7a4ba75dc6a => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:54.880608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e6f2193a-689e-47b2-a871-1afeca211052 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Calling method '.version_select at 0x7fd4d0bb1af0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.950999 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-e6f2193a-689e-47b2-a871-1afeca211052 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] HTTP exception thrown: Volume 45ec7db2-8a55-407b-83f7-d5407d6ad4af could not be found. Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e6f2193a-689e-47b2-a871-1afeca211052 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Request method failure captured: Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/os-volumes/45ec7db2-8a55-407b-83f7-d5407d6ad4af HTTP/1.1 Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHo68dCEfg4JDWegkvpUd0qPGhUXr4bkdrAH4VfsKKwJOPTzjoCm9a0B6UfLQ0Lk_wi2o0PDtLkce6ZKRa4MpAL9DTWOLT-j1l_eOuDxVMWjtlmjeezYeXUlYWZ0lbqRFDxWQZWdCqMTrPb6cCxGH3TdRj_pdJqQXQH8Rq4aQBf38Xk Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edb2358d01ab4ac2ba356218abcef197"}]}] Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: edb2358d01ab4ac2ba356218abcef197 Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-VolumesNegativeTest-1207796282 Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 66a3d3a7deb74018ad5c7c2fa54c8ef0 Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-VolumesNegativeTest-1207796282-project Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: exception: Volume 45ec7db2-8a55-407b-83f7-d5407d6ad4af could not be found. Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '45ec7db2-8a55-407b-83f7-d5407d6ad4af'} Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45ec7db2-8a55-407b-83f7-d5407d6ad4af could not be found. (HTTP 404) (Request-ID: req-15b85d29-ec78-407c-b3dd-124e05b67c35) Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:23:54.953878 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45ec7db2-8a55-407b-83f7-d5407d6ad4af could not be found. Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45ec7db2-8a55-407b-83f7-d5407d6ad4af could not be found. Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45ec7db2-8a55-407b-83f7-d5407d6ad4af could not be found. Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e6f2193a-689e-47b2-a871-1afeca211052 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] Returning 404 to user: Volume 45ec7db2-8a55-407b-83f7-d5407d6ad4af could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:54.958316 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e6f2193a-689e-47b2-a871-1afeca211052 tempest-VolumesNegativeTest-1207796282 tempest-VolumesNegativeTest-1207796282-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/45ec7db2-8a55-407b-83f7-d5407d6ad4af" status: 404 len: 109 microversion: 2.1 time: 0.079835 Oct 04 18:23:54.964384 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2535/5057] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:23:54 2022] GET /compute/v2.1/os-volumes/45ec7db2-8a55-407b-83f7-d5407d6ad4af => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:55.090904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ec8ae0c-dad2-4517-91f3-b5ae0774ed1a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:55.092480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ec8ae0c-dad2-4517-91f3-b5ae0774ed1a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:55.108158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ec8ae0c-dad2-4517-91f3-b5ae0774ed1a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.109071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ec8ae0c-dad2-4517-91f3-b5ae0774ed1a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.111960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ec8ae0c-dad2-4517-91f3-b5ae0774ed1a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.113979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ec8ae0c-dad2-4517-91f3-b5ae0774ed1a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.115458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ec8ae0c-dad2-4517-91f3-b5ae0774ed1a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.117132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ec8ae0c-dad2-4517-91f3-b5ae0774ed1a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.480424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a24f8e0e-0789-45d5-b09f-b95d62f3608c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:55.481614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a24f8e0e-0789-45d5-b09f-b95d62f3608c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:55.482132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ec8ae0c-dad2-4517-91f3-b5ae0774ed1a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:55.498731 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ec8ae0c-dad2-4517-91f3-b5ae0774ed1a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.410167 Oct 04 18:23:55.499386 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2523/5058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:55 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:55.507024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a24f8e0e-0789-45d5-b09f-b95d62f3608c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.507560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a24f8e0e-0789-45d5-b09f-b95d62f3608c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.508082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a24f8e0e-0789-45d5-b09f-b95d62f3608c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.508902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a24f8e0e-0789-45d5-b09f-b95d62f3608c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.509439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a24f8e0e-0789-45d5-b09f-b95d62f3608c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.509956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a24f8e0e-0789-45d5-b09f-b95d62f3608c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.887504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a24f8e0e-0789-45d5-b09f-b95d62f3608c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:55.901809 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a24f8e0e-0789-45d5-b09f-b95d62f3608c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.428198 Oct 04 18:23:55.903757 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2536/5059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:55 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:56.531174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef0f0e0f-735c-49ef-b920-4d8f919bf9b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.531927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ef0f0e0f-735c-49ef-b920-4d8f919bf9b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.534486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=57 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:56.544475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef0f0e0f-735c-49ef-b920-4d8f919bf9b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.550662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef0f0e0f-735c-49ef-b920-4d8f919bf9b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.551574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef0f0e0f-735c-49ef-b920-4d8f919bf9b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.553688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef0f0e0f-735c-49ef-b920-4d8f919bf9b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.555571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef0f0e0f-735c-49ef-b920-4d8f919bf9b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.557399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef0f0e0f-735c-49ef-b920-4d8f919bf9b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.928570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-220af0f5-ebab-4cd9-9e76-0de5faf14d65 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.930087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-220af0f5-ebab-4cd9-9e76-0de5faf14d65 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.947026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-220af0f5-ebab-4cd9-9e76-0de5faf14d65 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.947772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-220af0f5-ebab-4cd9-9e76-0de5faf14d65 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.948408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-220af0f5-ebab-4cd9-9e76-0de5faf14d65 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.949403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-220af0f5-ebab-4cd9-9e76-0de5faf14d65 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.950097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-220af0f5-ebab-4cd9-9e76-0de5faf14d65 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.951346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-220af0f5-ebab-4cd9-9e76-0de5faf14d65 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.059976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ef0f0e0f-735c-49ef-b920-4d8f919bf9b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.089801 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ef0f0e0f-735c-49ef-b920-4d8f919bf9b9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.562897 Oct 04 18:23:57.091774 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2524/5060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:56 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:57.358558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-220af0f5-ebab-4cd9-9e76-0de5faf14d65 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.381771 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-220af0f5-ebab-4cd9-9e76-0de5faf14d65 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.457567 Oct 04 18:23:57.400980 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2537/5061] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:56 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:57.428817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1442780397", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2c76a8-0540-4afc-b328-f1ba2df44ce2"}], "security_groups": [{"name": "tempest-securitygroup--604848104"}], "key_name": "tempest-keypair-1684364586", "user_data": "}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:57.666926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] validate_networks() for [('be2c76a8-0540-4afc-b328-f1ba2df44ce2', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:23:58.115457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e0e9a878-8dde-49d9-aeb4-87142aaa2cf9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:58.116722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e0e9a878-8dde-49d9-aeb4-87142aaa2cf9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:58.129892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0e9a878-8dde-49d9-aeb4-87142aaa2cf9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.130764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0e9a878-8dde-49d9-aeb4-87142aaa2cf9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.131255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0e9a878-8dde-49d9-aeb4-87142aaa2cf9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.132013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0e9a878-8dde-49d9-aeb4-87142aaa2cf9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.132481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0e9a878-8dde-49d9-aeb4-87142aaa2cf9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.132943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0e9a878-8dde-49d9-aeb4-87142aaa2cf9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.838761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e0e9a878-8dde-49d9-aeb4-87142aaa2cf9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.857214 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e0e9a878-8dde-49d9-aeb4-87142aaa2cf9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.737620 Oct 04 18:23:58.873661 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2538/5062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:58 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:58.882507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df4be877-1c18-4d1d-9de8-101a3a9a268a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:58.884269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df4be877-1c18-4d1d-9de8-101a3a9a268a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:58.897012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df4be877-1c18-4d1d-9de8-101a3a9a268a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.897795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df4be877-1c18-4d1d-9de8-101a3a9a268a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.898672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df4be877-1c18-4d1d-9de8-101a3a9a268a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.899606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df4be877-1c18-4d1d-9de8-101a3a9a268a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.900240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df4be877-1c18-4d1d-9de8-101a3a9a268a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.900847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df4be877-1c18-4d1d-9de8-101a3a9a268a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.024080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:23:59.024606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:23:59.026475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:23:59.027650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:23:59.028900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:23:59.056560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.060944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.062027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.068223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.075938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.076777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.128822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Getting quotas for project 880b25dfcd7c4a2ab247dd7855993dc8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:23:59.147690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Getting quotas for user e5b5b2a021cb49279d695bdeed577655 and project 880b25dfcd7c4a2ab247dd7855993dc8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:23:59.199420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:23:59.202721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:23:59.259307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df4be877-1c18-4d1d-9de8-101a3a9a268a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.279815 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df4be877-1c18-4d1d-9de8-101a3a9a268a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.404145 Oct 04 18:23:59.284236 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2539/5063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:58 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:59.320093 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-62d79c5e-4f26-41bc-8fd7-dbe03d1c2434 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.898396 Oct 04 18:23:59.325296 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2525/5064] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:23:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:23:59.346375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5b1a5572-a2f3-4105-ab9b-0d1dacb0af09 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:59.354347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5b1a5572-a2f3-4105-ab9b-0d1dacb0af09 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:59.455445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b1a5572-a2f3-4105-ab9b-0d1dacb0af09 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.463762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b1a5572-a2f3-4105-ab9b-0d1dacb0af09 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.465349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b1a5572-a2f3-4105-ab9b-0d1dacb0af09 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.466691 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5b1a5572-a2f3-4105-ab9b-0d1dacb0af09 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1282 microversion: 2.20 time: 0.137587 Oct 04 18:23:59.467827 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2540/5065] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:59 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:59.884379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-65f02649-b3fc-42d0-b6f9-4bb9c1b301fe tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:59.885786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-65f02649-b3fc-42d0-b6f9-4bb9c1b301fe tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:59.904282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65f02649-b3fc-42d0-b6f9-4bb9c1b301fe tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.906199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65f02649-b3fc-42d0-b6f9-4bb9c1b301fe tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.908265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65f02649-b3fc-42d0-b6f9-4bb9c1b301fe tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.910401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65f02649-b3fc-42d0-b6f9-4bb9c1b301fe tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.911891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65f02649-b3fc-42d0-b6f9-4bb9c1b301fe tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.912360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65f02649-b3fc-42d0-b6f9-4bb9c1b301fe tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.167485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-65f02649-b3fc-42d0-b6f9-4bb9c1b301fe tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.180218 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-65f02649-b3fc-42d0-b6f9-4bb9c1b301fe tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.302032 Oct 04 18:24:00.181758 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2526/5066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:59 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:00.306948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3e814336-b68a-4c4d-9663-43ca09febfa9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:00.308842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3e814336-b68a-4c4d-9663-43ca09febfa9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:00.318546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e814336-b68a-4c4d-9663-43ca09febfa9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.324485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e814336-b68a-4c4d-9663-43ca09febfa9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.324946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e814336-b68a-4c4d-9663-43ca09febfa9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.325692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e814336-b68a-4c4d-9663-43ca09febfa9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.326164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e814336-b68a-4c4d-9663-43ca09febfa9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.327874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e814336-b68a-4c4d-9663-43ca09febfa9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.493469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:00.494148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:00.506152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.507142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.508263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.510090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.510798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.512319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.536327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3e814336-b68a-4c4d-9663-43ca09febfa9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.549809 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3e814336-b68a-4c4d-9663-43ca09febfa9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.246835 Oct 04 18:24:00.550625 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2541/5067] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:00 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:00.733204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.744794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.746516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.747929 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6277731b-e38d-46ee-87e7-b830214de615 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1278 microversion: 2.20 time: 0.258332 Oct 04 18:24:00.755221 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2527/5068] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:00 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:01.205588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f3fb346b-360c-4ebc-a4a6-45bc7ea1fa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.206247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f3fb346b-360c-4ebc-a4a6-45bc7ea1fa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.215025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb346b-360c-4ebc-a4a6-45bc7ea1fa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.215942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb346b-360c-4ebc-a4a6-45bc7ea1fa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.216621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb346b-360c-4ebc-a4a6-45bc7ea1fa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.217588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb346b-360c-4ebc-a4a6-45bc7ea1fa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.218279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb346b-360c-4ebc-a4a6-45bc7ea1fa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.219208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb346b-360c-4ebc-a4a6-45bc7ea1fa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.433076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f3fb346b-360c-4ebc-a4a6-45bc7ea1fa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.443735 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f3fb346b-360c-4ebc-a4a6-45bc7ea1fa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.243415 Oct 04 18:24:01.447058 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2542/5069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:01.576386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-734eaa16-244e-42fc-85f5-eb4489e186be tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.577321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-734eaa16-244e-42fc-85f5-eb4489e186be tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.588939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-734eaa16-244e-42fc-85f5-eb4489e186be tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.589436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-734eaa16-244e-42fc-85f5-eb4489e186be tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.590085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-734eaa16-244e-42fc-85f5-eb4489e186be tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.591107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-734eaa16-244e-42fc-85f5-eb4489e186be tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.591590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-734eaa16-244e-42fc-85f5-eb4489e186be tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.592069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-734eaa16-244e-42fc-85f5-eb4489e186be tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.753206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-734eaa16-244e-42fc-85f5-eb4489e186be tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.761967 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-734eaa16-244e-42fc-85f5-eb4489e186be tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.191726 Oct 04 18:24:01.762936 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2528/5070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:01.773762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.774884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.783098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.783982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.784776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.785704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.786379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.786893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.879778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.883755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:01.898628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.901158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.905866 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce95494c-5774-419e-b57d-6b7bb5efa0e3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1352 microversion: 2.20 time: 0.135138 Oct 04 18:24:01.908427 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2543/5071] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:02.473152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0108b0ef-a9c7-4c11-bf65-4aed159864dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.474142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0108b0ef-a9c7-4c11-bf65-4aed159864dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.494055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0108b0ef-a9c7-4c11-bf65-4aed159864dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.494695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0108b0ef-a9c7-4c11-bf65-4aed159864dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.495189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0108b0ef-a9c7-4c11-bf65-4aed159864dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.495937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0108b0ef-a9c7-4c11-bf65-4aed159864dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.497051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0108b0ef-a9c7-4c11-bf65-4aed159864dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.497498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0108b0ef-a9c7-4c11-bf65-4aed159864dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.686050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0108b0ef-a9c7-4c11-bf65-4aed159864dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:02.699051 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0108b0ef-a9c7-4c11-bf65-4aed159864dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.232388 Oct 04 18:24:02.700821 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2529/5072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:02.719806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8c9a2d59-c2a8-40af-a5fd-4fbc26338178 req-7aafdf93-1bd5-4af1-80f8-545f743d08ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1681ab-db4a-4528-99da-649ffa9a93a0", "name": "network-vif-plugged", "status": "completed", "tag": "2d48ba84-42ef-46d1-b6ba-69e426d07f1c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:02.732100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8c9a2d59-c2a8-40af-a5fd-4fbc26338178 req-7aafdf93-1bd5-4af1-80f8-545f743d08ac service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.732846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8c9a2d59-c2a8-40af-a5fd-4fbc26338178 req-7aafdf93-1bd5-4af1-80f8-545f743d08ac service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.733507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8c9a2d59-c2a8-40af-a5fd-4fbc26338178 req-7aafdf93-1bd5-4af1-80f8-545f743d08ac service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.748708 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8c9a2d59-c2a8-40af-a5fd-4fbc26338178 req-7aafdf93-1bd5-4af1-80f8-545f743d08ac service nova] Creating event network-vif-plugged:2d48ba84-42ef-46d1-b6ba-69e426d07f1c for instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 on n-h2-850499-14 Oct 04 18:24:02.757184 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8c9a2d59-c2a8-40af-a5fd-4fbc26338178 req-7aafdf93-1bd5-4af1-80f8-545f743d08ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057787 Oct 04 18:24:02.760482 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2544/5073] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:02.790904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f02ae332-52ad-436e-84e7-4bc8b2145833 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.792192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f02ae332-52ad-436e-84e7-4bc8b2145833 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.805143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f02ae332-52ad-436e-84e7-4bc8b2145833 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.806002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f02ae332-52ad-436e-84e7-4bc8b2145833 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.807154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f02ae332-52ad-436e-84e7-4bc8b2145833 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.808149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f02ae332-52ad-436e-84e7-4bc8b2145833 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.808841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f02ae332-52ad-436e-84e7-4bc8b2145833 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.809497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f02ae332-52ad-436e-84e7-4bc8b2145833 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.934657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.935351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.943561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.944344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.945030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.945995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.946706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.947317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.108374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.113488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f02ae332-52ad-436e-84e7-4bc8b2145833 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.122269 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f02ae332-52ad-436e-84e7-4bc8b2145833 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.337575 Oct 04 18:24:03.123443 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2530/5074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:03.128615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.130208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.131425 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-82427409-bbbb-46b9-8bc2-6122b146396d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1352 microversion: 2.20 time: 0.201813 Oct 04 18:24:03.132291 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2545/5075] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1352 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:03.725633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f83505f9-5dff-4231-bcc2-d80c37a226b8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:03.727840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f83505f9-5dff-4231-bcc2-d80c37a226b8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:03.740123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f83505f9-5dff-4231-bcc2-d80c37a226b8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.741119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f83505f9-5dff-4231-bcc2-d80c37a226b8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.742585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f83505f9-5dff-4231-bcc2-d80c37a226b8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.743947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f83505f9-5dff-4231-bcc2-d80c37a226b8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.745068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f83505f9-5dff-4231-bcc2-d80c37a226b8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.746112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f83505f9-5dff-4231-bcc2-d80c37a226b8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.995830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f83505f9-5dff-4231-bcc2-d80c37a226b8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.008376 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f83505f9-5dff-4231-bcc2-d80c37a226b8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.287057 Oct 04 18:24:04.014635 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2531/5076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:03 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:04.148161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-76c71cc1-80f8-41b1-b301-dd1f694fda01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:04.150504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-76c71cc1-80f8-41b1-b301-dd1f694fda01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:04.160297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:04.162804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:04.173294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76c71cc1-80f8-41b1-b301-dd1f694fda01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.173792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76c71cc1-80f8-41b1-b301-dd1f694fda01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.174315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76c71cc1-80f8-41b1-b301-dd1f694fda01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.175065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76c71cc1-80f8-41b1-b301-dd1f694fda01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.175536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76c71cc1-80f8-41b1-b301-dd1f694fda01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.176000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76c71cc1-80f8-41b1-b301-dd1f694fda01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.179274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.179894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.180397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.181344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.182682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.183349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.402554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.414214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.427118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.432029 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c273fb89-c72e-4094-b09c-54cd8e23ad7b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1340 microversion: 2.20 time: 0.276657 Oct 04 18:24:04.433390 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2532/5077] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:04 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1340 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:04.564563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-76c71cc1-80f8-41b1-b301-dd1f694fda01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.594926 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-76c71cc1-80f8-41b1-b301-dd1f694fda01 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.449748 Oct 04 18:24:04.599556 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2546/5078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:04 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:05.038716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d265b37-15de-4c4e-a226-37c3dce4fc21 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:05.039806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3d265b37-15de-4c4e-a226-37c3dce4fc21 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:05.067697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d265b37-15de-4c4e-a226-37c3dce4fc21 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.068498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d265b37-15de-4c4e-a226-37c3dce4fc21 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.069257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d265b37-15de-4c4e-a226-37c3dce4fc21 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.070464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d265b37-15de-4c4e-a226-37c3dce4fc21 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.072785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d265b37-15de-4c4e-a226-37c3dce4fc21 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.076837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d265b37-15de-4c4e-a226-37c3dce4fc21 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.117501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:05.284058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3d265b37-15de-4c4e-a226-37c3dce4fc21 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.296192 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3d265b37-15de-4c4e-a226-37c3dce4fc21 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.265586 Oct 04 18:24:05.299605 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2533/5079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:05 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:05.463696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:05.465688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:05.480338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.483402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.485769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.488212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.488867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.489979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.625363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1913ee80-d9ae-4119-b27e-27f8d77d179c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:05.626803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1913ee80-d9ae-4119-b27e-27f8d77d179c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:05.638086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1913ee80-d9ae-4119-b27e-27f8d77d179c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.640274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1913ee80-d9ae-4119-b27e-27f8d77d179c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.640893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1913ee80-d9ae-4119-b27e-27f8d77d179c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.645545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1913ee80-d9ae-4119-b27e-27f8d77d179c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.646041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1913ee80-d9ae-4119-b27e-27f8d77d179c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.646483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1913ee80-d9ae-4119-b27e-27f8d77d179c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.712065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.721859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.727528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.731611 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c9a2014b-df9f-405e-8c2d-3e7fc154faa9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1407 microversion: 2.20 time: 0.273514 Oct 04 18:24:05.732193 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2547/5080] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:05 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:05.914232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1913ee80-d9ae-4119-b27e-27f8d77d179c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.928592 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1913ee80-d9ae-4119-b27e-27f8d77d179c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.308563 Oct 04 18:24:05.929732 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2534/5081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:05 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:06.325550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b24628bb-7510-4e3b-b9d7-4edea08865e5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:06.326603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b24628bb-7510-4e3b-b9d7-4edea08865e5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:06.339666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24628bb-7510-4e3b-b9d7-4edea08865e5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.340786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24628bb-7510-4e3b-b9d7-4edea08865e5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.343402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24628bb-7510-4e3b-b9d7-4edea08865e5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.344988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24628bb-7510-4e3b-b9d7-4edea08865e5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.345775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24628bb-7510-4e3b-b9d7-4edea08865e5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.349407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24628bb-7510-4e3b-b9d7-4edea08865e5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.670336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b24628bb-7510-4e3b-b9d7-4edea08865e5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:06.682714 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b24628bb-7510-4e3b-b9d7-4edea08865e5 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1501 microversion: 2.1 time: 0.361502 Oct 04 18:24:06.684348 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2548/5082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:06 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1501 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:06.708075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b28b4cd-b72f-4256-9483-3415dbd7bc9b"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:06.711295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:06.720651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.721596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.722286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.723345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.724087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.724848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.759363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:06.760140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:06.774558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.778696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.779668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.780662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.782312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.783243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.789971 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] HTTP exception thrown: Cannot 'attach_volume' instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 while it is in vm_state rescued Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Request method failure captured: Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/os-volume_attachments HTTP/1.1 Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 74 Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHnytef4l2dTU_iEGj2JHMj914KTgOcJXrZhkr0wpO7nRbM8OarsMPEpoh7kshRbzuhK9viViE8Sc8SnS-I9yNZdiPzuJrN6shc_HK2tbFONi9WDFR1vVIu70L5UasJlaDkchO8edMdo-N8WJ-RTGom7YRcTfKpi8ODDI4s0GHlW8GE Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab1cdc33329a4a10970e67390f750163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}] Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5a7fc8671d264393bfb0465438b598d1 Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: {"volumeAttachment": {"volumeId": "0b28b4cd-b72f-4256-9483-3415dbd7bc9b"}} Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'attach_volume' instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 while it is in vm_state rescued Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'server_id': '2c5bebc4-0fb3-4027-a4ff-4ff8301fc986', 'body': {'volumeAttachment': {'volumeId': '0b28b4cd-b72f-4256-9483-3415dbd7bc9b'}}} Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 18:24:06.791705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 while it is in vm_state rescued Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 while it is in vm_state rescued Oct 04 18:24:06.796929 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:06.801582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Returning 409 to user: Cannot 'attach_volume' instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 while it is in vm_state rescued {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:06.802472 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-79303403-7a6c-480e-bfdc-07ccbce89a32 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.099090 Oct 04 18:24:06.803080 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2535/5083] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:24:06 2022] POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/os-volume_attachments => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:24:06.812415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03080dab-3e1a-49d3-b26b-22b1b7e242ee tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:06.813807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-03080dab-3e1a-49d3-b26b-22b1b7e242ee tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:06.824460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03080dab-3e1a-49d3-b26b-22b1b7e242ee tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.826022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03080dab-3e1a-49d3-b26b-22b1b7e242ee tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.827013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03080dab-3e1a-49d3-b26b-22b1b7e242ee tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.828696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03080dab-3e1a-49d3-b26b-22b1b7e242ee tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.829741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03080dab-3e1a-49d3-b26b-22b1b7e242ee tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.830661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03080dab-3e1a-49d3-b26b-22b1b7e242ee tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.960445 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-03080dab-3e1a-49d3-b26b-22b1b7e242ee tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action" status: 202 len: 0 microversion: 2.1 time: 0.152385 Oct 04 18:24:06.963120 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2536/5084] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:24:06 2022] POST /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:24:06.972187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0da52bc5-515f-4d58-abe6-d2e5a2fac9a5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:06.977166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0da52bc5-515f-4d58-abe6-d2e5a2fac9a5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:06.990772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0da52bc5-515f-4d58-abe6-d2e5a2fac9a5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.991876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0da52bc5-515f-4d58-abe6-d2e5a2fac9a5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.992325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0da52bc5-515f-4d58-abe6-d2e5a2fac9a5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.993043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0da52bc5-515f-4d58-abe6-d2e5a2fac9a5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.993510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0da52bc5-515f-4d58-abe6-d2e5a2fac9a5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.993929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0da52bc5-515f-4d58-abe6-d2e5a2fac9a5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.355171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.392318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.394795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.397975 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e672c7c4-eac3-4f95-b136-38eb0d96d29e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1407 microversion: 2.20 time: 0.644322 Oct 04 18:24:07.407295 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2549/5085] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:06 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1407 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:07.419800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5fd83b27-f306-4807-b138-5a33626bc8ae tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:07.420952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5fd83b27-f306-4807-b138-5a33626bc8ae tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:07.459101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fd83b27-f306-4807-b138-5a33626bc8ae tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.459626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fd83b27-f306-4807-b138-5a33626bc8ae tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.462777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fd83b27-f306-4807-b138-5a33626bc8ae tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.463598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fd83b27-f306-4807-b138-5a33626bc8ae tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.466721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fd83b27-f306-4807-b138-5a33626bc8ae tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.467945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5fd83b27-f306-4807-b138-5a33626bc8ae tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.584541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0da52bc5-515f-4d58-abe6-d2e5a2fac9a5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.595957 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0da52bc5-515f-4d58-abe6-d2e5a2fac9a5 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.631748 Oct 04 18:24:07.613676 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2537/5086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:06 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:07.619757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-fdb58ff9-9378-4b89-b667-25589e8c6ab5 req-db0f6229-e645-4c37-a2e6-0d4b2b1ed2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d39c1d8-8eed-462d-af88-bd613d502347", "tag": "12e1280e-928a-4b59-9480-9e0bba1dd891"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:07.634035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fdb58ff9-9378-4b89-b667-25589e8c6ab5 req-db0f6229-e645-4c37-a2e6-0d4b2b1ed2e6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.634530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fdb58ff9-9378-4b89-b667-25589e8c6ab5 req-db0f6229-e645-4c37-a2e6-0d4b2b1ed2e6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.634997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fdb58ff9-9378-4b89-b667-25589e8c6ab5 req-db0f6229-e645-4c37-a2e6-0d4b2b1ed2e6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.648878 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-fdb58ff9-9378-4b89-b667-25589e8c6ab5 req-db0f6229-e645-4c37-a2e6-0d4b2b1ed2e6 service nova] Creating event network-changed:12e1280e-928a-4b59-9480-9e0bba1dd891 for instance 9d39c1d8-8eed-462d-af88-bd613d502347 on n-h2-850499-14 Oct 04 18:24:07.654153 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-fdb58ff9-9378-4b89-b667-25589e8c6ab5 req-db0f6229-e645-4c37-a2e6-0d4b2b1ed2e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038942 Oct 04 18:24:07.655071 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2538/5087] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:07.896000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5fd83b27-f306-4807-b138-5a33626bc8ae tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.919904 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5fd83b27-f306-4807-b138-5a33626bc8ae tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1509 microversion: 2.1 time: 0.509259 Oct 04 18:24:07.921044 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2550/5088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:07 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1509 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:08.450570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:08.451233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:08.473596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.475086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.482221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.483656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.485508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.486465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.843750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8ccd46d-c04c-40b1-bbab-a9e4f82a41ae tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:08.844993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f8ccd46d-c04c-40b1-bbab-a9e4f82a41ae tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:08.871643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8ccd46d-c04c-40b1-bbab-a9e4f82a41ae tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.873888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8ccd46d-c04c-40b1-bbab-a9e4f82a41ae tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.876376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8ccd46d-c04c-40b1-bbab-a9e4f82a41ae tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.881970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8ccd46d-c04c-40b1-bbab-a9e4f82a41ae tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.882914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8ccd46d-c04c-40b1-bbab-a9e4f82a41ae tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.883765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8ccd46d-c04c-40b1-bbab-a9e4f82a41ae tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.905087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:08.918098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:08.920563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:08.921974 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b1dd5b38-18bc-4ab3-98f8-0e42b130c80e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1407 microversion: 2.20 time: 0.492616 Oct 04 18:24:08.923806 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2551/5089] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:08 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:08.934169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d91c5ca0-c5fc-4ff8-9a30-abf3e80c38c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:08.935237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d91c5ca0-c5fc-4ff8-9a30-abf3e80c38c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:08.956775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f8ccd46d-c04c-40b1-bbab-a9e4f82a41ae tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:08.959759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d91c5ca0-c5fc-4ff8-9a30-abf3e80c38c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.963109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d91c5ca0-c5fc-4ff8-9a30-abf3e80c38c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.963797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d91c5ca0-c5fc-4ff8-9a30-abf3e80c38c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.966196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d91c5ca0-c5fc-4ff8-9a30-abf3e80c38c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.966889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d91c5ca0-c5fc-4ff8-9a30-abf3e80c38c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.968646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d91c5ca0-c5fc-4ff8-9a30-abf3e80c38c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.099889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:09.195319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:09.232688 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8ccd46d-c04c-40b1-bbab-a9e4f82a41ae tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "DELETE /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 204 len: 0 microversion: 2.42 time: 0.906279 Oct 04 18:24:09.235363 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2539/5090] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:24:08 2022] DELETE /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 0 bytes in 913 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:24:09.248554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-01df5e73-f3b8-4986-ab09-a0c2b46b79a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:09.254462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-01df5e73-f3b8-4986-ab09-a0c2b46b79a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:09.272617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01df5e73-f3b8-4986-ab09-a0c2b46b79a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.273877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01df5e73-f3b8-4986-ab09-a0c2b46b79a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.274668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01df5e73-f3b8-4986-ab09-a0c2b46b79a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.275822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01df5e73-f3b8-4986-ab09-a0c2b46b79a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.276864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01df5e73-f3b8-4986-ab09-a0c2b46b79a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.280783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01df5e73-f3b8-4986-ab09-a0c2b46b79a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.332551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d91c5ca0-c5fc-4ff8-9a30-abf3e80c38c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:09.352009 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d91c5ca0-c5fc-4ff8-9a30-abf3e80c38c9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.423599 Oct 04 18:24:09.359118 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2552/5091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:08 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:09.368279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:09.376232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:09.390588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.391802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.392419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.393286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.393748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.394442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.461825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:09.724076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-01df5e73-f3b8-4986-ab09-a0c2b46b79a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:09.742855 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-01df5e73-f3b8-4986-ab09-a0c2b46b79a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1509 microversion: 2.1 time: 0.505119 Oct 04 18:24:09.744019 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2540/5092] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:09 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1509 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:09.813789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:09.834113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:09.835756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:09.840328 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3d37fcae-0191-475f-ab29-f8f14ef88f36 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2958 microversion: 2.42 time: 0.478918 Oct 04 18:24:09.840922 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2553/5093] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:09 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2958 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:09.957074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:09.957688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:09.970601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.974860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.976295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.977115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.977653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.978316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.157515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.169458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.171942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.174235 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84b373aa-27f4-4805-b909-8e2c46f7ff23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1407 microversion: 2.20 time: 0.220897 Oct 04 18:24:10.175707 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2541/5094] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:09 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:10.382446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-de12ca26-d258-4265-a7e3-c79a3b919627 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:10.383927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-de12ca26-d258-4265-a7e3-c79a3b919627 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:10.396336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de12ca26-d258-4265-a7e3-c79a3b919627 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.397076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de12ca26-d258-4265-a7e3-c79a3b919627 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.397753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de12ca26-d258-4265-a7e3-c79a3b919627 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.399240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de12ca26-d258-4265-a7e3-c79a3b919627 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.403707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de12ca26-d258-4265-a7e3-c79a3b919627 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.404296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de12ca26-d258-4265-a7e3-c79a3b919627 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.669492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-de12ca26-d258-4265-a7e3-c79a3b919627 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.688197 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-de12ca26-d258-4265-a7e3-c79a3b919627 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.308961 Oct 04 18:24:10.703947 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2554/5095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:10 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:10.786004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-610fae26-a70e-429b-b013-3ee8b1ec8ba9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:10.786947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-610fae26-a70e-429b-b013-3ee8b1ec8ba9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:10.800377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-610fae26-a70e-429b-b013-3ee8b1ec8ba9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.801720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-610fae26-a70e-429b-b013-3ee8b1ec8ba9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.803048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-610fae26-a70e-429b-b013-3ee8b1ec8ba9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.804977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-610fae26-a70e-429b-b013-3ee8b1ec8ba9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.810998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-610fae26-a70e-429b-b013-3ee8b1ec8ba9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.812128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-610fae26-a70e-429b-b013-3ee8b1ec8ba9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.871734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:10.872628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:10.896518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.900557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.901186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.904833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.905874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.907855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.737316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-610fae26-a70e-429b-b013-3ee8b1ec8ba9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:11.763118 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-610fae26-a70e-429b-b013-3ee8b1ec8ba9 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1509 microversion: 2.1 time: 0.989736 Oct 04 18:24:11.783456 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2542/5096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:10 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1509 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:11.792267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:11.793154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:11.802897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.803815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.804456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.805712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.806434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.807055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.089170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.105878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.111150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.112672 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-06a5a48a-1054-4ba9-b605-0d37bdf9b49d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2958 microversion: 2.42 time: 1.246150 Oct 04 18:24:12.128265 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2555/5097] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:10 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2958 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:12.153668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-16dd39ab-cc19-434b-a83d-fc6759055e89 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:12.154497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-16dd39ab-cc19-434b-a83d-fc6759055e89 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:12.162468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:12.164558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16dd39ab-cc19-434b-a83d-fc6759055e89 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.165871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16dd39ab-cc19-434b-a83d-fc6759055e89 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.166697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16dd39ab-cc19-434b-a83d-fc6759055e89 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.168947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16dd39ab-cc19-434b-a83d-fc6759055e89 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.170505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16dd39ab-cc19-434b-a83d-fc6759055e89 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.171212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16dd39ab-cc19-434b-a83d-fc6759055e89 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.256364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.265026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.269291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.271162 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2b389af0-2392-4ee3-b2e1-be4c06d11f19 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1407 microversion: 2.20 time: 0.486429 Oct 04 18:24:12.272131 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2543/5098] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:11 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:12.474343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-16dd39ab-cc19-434b-a83d-fc6759055e89 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.482252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-16dd39ab-cc19-434b-a83d-fc6759055e89 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1511 microversion: 2.1 time: 0.352566 Oct 04 18:24:12.482848 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2556/5099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:12 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:12.722777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2114802680", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "627bee18-3b4d-4ae1-bf07-0c3f7ca4ab04"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:12.795916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04b359a1-aee1-4835-9c98-d5c15abcc731 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:12.796516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-04b359a1-aee1-4835-9c98-d5c15abcc731 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:12.807781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b359a1-aee1-4835-9c98-d5c15abcc731 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.808195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] validate_networks() for [('627bee18-3b4d-4ae1-bf07-0c3f7ca4ab04', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:24:12.808639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b359a1-aee1-4835-9c98-d5c15abcc731 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.810296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b359a1-aee1-4835-9c98-d5c15abcc731 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.811288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b359a1-aee1-4835-9c98-d5c15abcc731 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.811995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b359a1-aee1-4835-9c98-d5c15abcc731 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.813897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04b359a1-aee1-4835-9c98-d5c15abcc731 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.073848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-04b359a1-aee1-4835-9c98-d5c15abcc731 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.104181 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04b359a1-aee1-4835-9c98-d5c15abcc731 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1509 microversion: 2.1 time: 0.311806 Oct 04 18:24:13.110312 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2557/5100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:12 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1509 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:13.150205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:13.151215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.167693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.168449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.169098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.170025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.172547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.173094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.409108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:13.409857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:13.410516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:13.411566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:13.412157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:13.426220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.427064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.427692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.428632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.429267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.430279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.453297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Getting quotas for project 1253a9f61f654272b0acaeafc636d08c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:13.459687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Getting quotas for user 59d57850f20044c4bb31536dd0bb4ff6 and project 1253a9f61f654272b0acaeafc636d08c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:13.464436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.476493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:24:13.480414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:13.495748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.508723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.513363 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-43dfc9f0-b823-493c-b5a3-48a58ebe9d57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2958 microversion: 2.42 time: 0.368935 Oct 04 18:24:13.515271 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2558/5101] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:13 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2958 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:13.523856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:13.524691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.534635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.535690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.536393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.537297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.537889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.538418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.566005 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2d1a8756-ed93-4a0f-84a7-90d658ecd2df tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847790 Oct 04 18:24:13.578410 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2544/5102] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:24:13.588681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4414d21b-ce14-4c97-a554-0b5edd256b11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:13.590060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4414d21b-ce14-4c97-a554-0b5edd256b11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.602372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4414d21b-ce14-4c97-a554-0b5edd256b11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.603496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4414d21b-ce14-4c97-a554-0b5edd256b11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.604664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4414d21b-ce14-4c97-a554-0b5edd256b11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.605625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4414d21b-ce14-4c97-a554-0b5edd256b11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.606255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4414d21b-ce14-4c97-a554-0b5edd256b11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.606855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4414d21b-ce14-4c97-a554-0b5edd256b11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.827533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.849440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.851536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.853835 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5da77082-244a-4be7-9f06-f88411c6409b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1407 microversion: 2.20 time: 0.336650 Oct 04 18:24:13.858460 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2559/5103] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:13 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:13.875009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-15599738-1988-4a3b-96f1-296d7e1972a2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:13.876165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15599738-1988-4a3b-96f1-296d7e1972a2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.898189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4414d21b-ce14-4c97-a554-0b5edd256b11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.910033 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4414d21b-ce14-4c97-a554-0b5edd256b11 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1488 microversion: 2.1 time: 0.329645 Oct 04 18:24:13.910779 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2545/5104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:13 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1488 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:13.937941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5da7be44-ce32-4241-8535-ce4debcf9bb4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-986159148"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:13.940921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5da7be44-ce32-4241-8535-ce4debcf9bb4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.956774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5da7be44-ce32-4241-8535-ce4debcf9bb4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.957564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5da7be44-ce32-4241-8535-ce4debcf9bb4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.958396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5da7be44-ce32-4241-8535-ce4debcf9bb4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.959412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5da7be44-ce32-4241-8535-ce4debcf9bb4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.960212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5da7be44-ce32-4241-8535-ce4debcf9bb4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.960871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5da7be44-ce32-4241-8535-ce4debcf9bb4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.966940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-15599738-1988-4a3b-96f1-296d7e1972a2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.978748 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-15599738-1988-4a3b-96f1-296d7e1972a2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1214 microversion: 2.1 time: 0.114048 Oct 04 18:24:13.979368 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2560/5105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:13 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:14.051772 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5da7be44-ce32-4241-8535-ce4debcf9bb4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "PUT /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1060 microversion: 2.1 time: 0.118367 Oct 04 18:24:14.053328 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2546/5106] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 4 18:24:13 2022] PUT /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1060 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:14.081483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ec96f774-e1ee-423e-8dca-6e70897cc276 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:14.082583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ec96f774-e1ee-423e-8dca-6e70897cc276 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:14.100532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec96f774-e1ee-423e-8dca-6e70897cc276 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.101099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec96f774-e1ee-423e-8dca-6e70897cc276 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.104249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec96f774-e1ee-423e-8dca-6e70897cc276 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.107247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec96f774-e1ee-423e-8dca-6e70897cc276 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.110508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec96f774-e1ee-423e-8dca-6e70897cc276 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.112860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec96f774-e1ee-423e-8dca-6e70897cc276 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.138101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee50d707-d527-4478-97a8-1540e48491dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:14.138777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ee50d707-d527-4478-97a8-1540e48491dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:14.155018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee50d707-d527-4478-97a8-1540e48491dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.155535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee50d707-d527-4478-97a8-1540e48491dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.157449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee50d707-d527-4478-97a8-1540e48491dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.158364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee50d707-d527-4478-97a8-1540e48491dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.159484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee50d707-d527-4478-97a8-1540e48491dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.162572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee50d707-d527-4478-97a8-1540e48491dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.914243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ec96f774-e1ee-423e-8dca-6e70897cc276 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:14.932522 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ec96f774-e1ee-423e-8dca-6e70897cc276 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1487 microversion: 2.1 time: 0.858105 Oct 04 18:24:14.935921 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2561/5107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:14 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1487 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:14.952182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:14.953587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:14.975660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.979220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.981681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.986050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.988192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.990512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.005901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:15.357519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ee50d707-d527-4478-97a8-1540e48491dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.368978 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee50d707-d527-4478-97a8-1540e48491dc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1509 microversion: 2.1 time: 1.235861 Oct 04 18:24:15.376006 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2547/5108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:14 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1509 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:15.381933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:15.391930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:15.413761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.414681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.415270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.416215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.417285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.417884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.472655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:15.525272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.552011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.553834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.556416 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce6cd400-fdde-41f9-9890-9b0352991195 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2958 microversion: 2.42 time: 0.616075 Oct 04 18:24:15.557385 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2562/5109] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:14 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2958 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:15.563817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba90fbbd-1474-486d-ae9c-845613b5440d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:15.564858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba90fbbd-1474-486d-ae9c-845613b5440d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:15.576022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba90fbbd-1474-486d-ae9c-845613b5440d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.576686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba90fbbd-1474-486d-ae9c-845613b5440d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.579060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba90fbbd-1474-486d-ae9c-845613b5440d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.581169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba90fbbd-1474-486d-ae9c-845613b5440d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.581613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba90fbbd-1474-486d-ae9c-845613b5440d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.582447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba90fbbd-1474-486d-ae9c-845613b5440d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.987819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.008830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.018982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.026481 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-922ad1c6-d252-4854-8f72-fd8a273db444 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1407 microversion: 2.20 time: 0.647133 Oct 04 18:24:16.030204 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2548/5110] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:15 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1407 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:16.047839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d28bd44-0668-4014-ab1d-d4264ecbd581 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:16.053889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d28bd44-0668-4014-ab1d-d4264ecbd581 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:16.075376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d28bd44-0668-4014-ab1d-d4264ecbd581 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.079873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d28bd44-0668-4014-ab1d-d4264ecbd581 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.080423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d28bd44-0668-4014-ab1d-d4264ecbd581 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.084821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d28bd44-0668-4014-ab1d-d4264ecbd581 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.085356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d28bd44-0668-4014-ab1d-d4264ecbd581 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.085818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d28bd44-0668-4014-ab1d-d4264ecbd581 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.308678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ba90fbbd-1474-486d-ae9c-845613b5440d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.321409 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba90fbbd-1474-486d-ae9c-845613b5440d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1487 microversion: 2.1 time: 0.761882 Oct 04 18:24:16.322445 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2563/5111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:15 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1487 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:16.348109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4b39dc42-c169-4ca0-87a9-1ec8aadae4ec tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:16.349065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4b39dc42-c169-4ca0-87a9-1ec8aadae4ec tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:16.363495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b39dc42-c169-4ca0-87a9-1ec8aadae4ec tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.365154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b39dc42-c169-4ca0-87a9-1ec8aadae4ec tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.367995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b39dc42-c169-4ca0-87a9-1ec8aadae4ec tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.370845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b39dc42-c169-4ca0-87a9-1ec8aadae4ec tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.372400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b39dc42-c169-4ca0-87a9-1ec8aadae4ec tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.376595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b39dc42-c169-4ca0-87a9-1ec8aadae4ec tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.431088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d28bd44-0668-4014-ab1d-d4264ecbd581 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.463345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4b39dc42-c169-4ca0-87a9-1ec8aadae4ec tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:16.470766 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d28bd44-0668-4014-ab1d-d4264ecbd581 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1284 microversion: 2.1 time: 0.432416 Oct 04 18:24:16.474614 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2549/5112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:16 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1284 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:16.496381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-26eaf656-c2f5-445d-99fe-0fd89b157129 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:16.497026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-26eaf656-c2f5-445d-99fe-0fd89b157129 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:16.528337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26eaf656-c2f5-445d-99fe-0fd89b157129 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.528860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26eaf656-c2f5-445d-99fe-0fd89b157129 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.529320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26eaf656-c2f5-445d-99fe-0fd89b157129 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.530054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26eaf656-c2f5-445d-99fe-0fd89b157129 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.530542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26eaf656-c2f5-445d-99fe-0fd89b157129 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.530999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26eaf656-c2f5-445d-99fe-0fd89b157129 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.689142 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4b39dc42-c169-4ca0-87a9-1ec8aadae4ec tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 204 len: 0 microversion: 2.1 time: 0.344481 Oct 04 18:24:16.689948 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2564/5113] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:16 2022] DELETE /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:24:16.697889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:16.699154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:16.707682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.708648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.709465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.710570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.711476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.715032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.183513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-26eaf656-c2f5-445d-99fe-0fd89b157129 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.193696 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-26eaf656-c2f5-445d-99fe-0fd89b157129 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1509 microversion: 2.1 time: 0.717699 Oct 04 18:24:17.194860 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2550/5114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:16 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1509 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:17.203152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2935ab12-25e6-47d9-8d17-d83b4a892a75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:17.206593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2935ab12-25e6-47d9-8d17-d83b4a892a75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:17.217178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.221623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2935ab12-25e6-47d9-8d17-d83b4a892a75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.229517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.233745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.238941 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e14d0751-ea75-4b69-beea-65c9ccdc0bb9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2958 microversion: 2.42 time: 0.547151 Oct 04 18:24:17.239877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2935ab12-25e6-47d9-8d17-d83b4a892a75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.240603 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2565/5115] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:16 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2958 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:17.240931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2935ab12-25e6-47d9-8d17-d83b4a892a75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.241850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2935ab12-25e6-47d9-8d17-d83b4a892a75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.244563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2935ab12-25e6-47d9-8d17-d83b4a892a75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.245184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2935ab12-25e6-47d9-8d17-d83b4a892a75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.252488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:17.253131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:17.270389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.270979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.271587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.272337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.272806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.273241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.683193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2935ab12-25e6-47d9-8d17-d83b4a892a75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.699540 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2935ab12-25e6-47d9-8d17-d83b4a892a75 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1493 microversion: 2.1 time: 0.501182 Oct 04 18:24:17.700218 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2551/5116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:17 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1493 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:17.714086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e91e1888-bd58-47b6-950b-f1c666f95cc3 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:17.714824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e91e1888-bd58-47b6-950b-f1c666f95cc3 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:17.726851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91e1888-bd58-47b6-950b-f1c666f95cc3 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.727383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91e1888-bd58-47b6-950b-f1c666f95cc3 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.731541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91e1888-bd58-47b6-950b-f1c666f95cc3 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.732159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91e1888-bd58-47b6-950b-f1c666f95cc3 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.732642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91e1888-bd58-47b6-950b-f1c666f95cc3 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.733083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e91e1888-bd58-47b6-950b-f1c666f95cc3 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.784596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.797876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.804664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.811985 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f7139d2-b7ae-4604-8eaf-6eee35b7d2c2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1407 microversion: 2.20 time: 0.570001 Oct 04 18:24:17.815781 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2566/5117] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:17 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1407 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:18.004987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e91e1888-bd58-47b6-950b-f1c666f95cc3 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:18.022266 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e91e1888-bd58-47b6-950b-f1c666f95cc3 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1272 microversion: 2.1 time: 0.316438 Oct 04 18:24:18.024571 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2552/5118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:17 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:18.172658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-a610b51b-f6b6-469b-b9c6-3401bf723661 req-9d45a2ae-8c19-4929-b10a-c267da78f856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d39c1d8-8eed-462d-af88-bd613d502347", "name": "network-vif-plugged", "status": "completed", "tag": "12e1280e-928a-4b59-9480-9e0bba1dd891"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:18.202442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a610b51b-f6b6-469b-b9c6-3401bf723661 req-9d45a2ae-8c19-4929-b10a-c267da78f856 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.205752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a610b51b-f6b6-469b-b9c6-3401bf723661 req-9d45a2ae-8c19-4929-b10a-c267da78f856 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.207040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a610b51b-f6b6-469b-b9c6-3401bf723661 req-9d45a2ae-8c19-4929-b10a-c267da78f856 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.223807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8f2beab7-f783-411b-84bc-9d8c6ceaf5c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:18.224757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8f2beab7-f783-411b-84bc-9d8c6ceaf5c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:18.237861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f2beab7-f783-411b-84bc-9d8c6ceaf5c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.241122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f2beab7-f783-411b-84bc-9d8c6ceaf5c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.241793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f2beab7-f783-411b-84bc-9d8c6ceaf5c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.243585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f2beab7-f783-411b-84bc-9d8c6ceaf5c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.247852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f2beab7-f783-411b-84bc-9d8c6ceaf5c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.256719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f2beab7-f783-411b-84bc-9d8c6ceaf5c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.279890 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-a610b51b-f6b6-469b-b9c6-3401bf723661 req-9d45a2ae-8c19-4929-b10a-c267da78f856 service nova] Creating event network-vif-plugged:12e1280e-928a-4b59-9480-9e0bba1dd891 for instance 9d39c1d8-8eed-462d-af88-bd613d502347 on n-h2-850499-14 Oct 04 18:24:18.295485 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-a610b51b-f6b6-469b-b9c6-3401bf723661 req-9d45a2ae-8c19-4929-b10a-c267da78f856 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127828 Oct 04 18:24:18.306300 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2567/5119] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:18.333139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:18.334167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:18.345929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.346874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.347534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.348543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.349287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.349989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.115258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8f2beab7-f783-411b-84bc-9d8c6ceaf5c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.127815 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8f2beab7-f783-411b-84bc-9d8c6ceaf5c1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1515 microversion: 2.1 time: 0.909016 Oct 04 18:24:19.130114 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2553/5120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:18 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1515 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:19.142796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b75b16ee-553c-4551-a069-b4a79c44d669 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:19.144809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b75b16ee-553c-4551-a069-b4a79c44d669 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:19.166533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75b16ee-553c-4551-a069-b4a79c44d669 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.172444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75b16ee-553c-4551-a069-b4a79c44d669 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.173370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75b16ee-553c-4551-a069-b4a79c44d669 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.174359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75b16ee-553c-4551-a069-b4a79c44d669 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.179826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75b16ee-553c-4551-a069-b4a79c44d669 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.180305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b75b16ee-553c-4551-a069-b4a79c44d669 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.747036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.764166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b75b16ee-553c-4551-a069-b4a79c44d669 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.776745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.780924 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b75b16ee-553c-4551-a069-b4a79c44d669 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 200 len: 1451 microversion: 2.1 time: 0.649508 Oct 04 18:24:19.786835 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2554/5121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:19 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 1451 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:19.792588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.796324 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0e434e4f-b927-4ca1-8ca4-4f77629db4c5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2958 microversion: 2.42 time: 1.484223 Oct 04 18:24:19.800132 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2568/5122] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:18 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2958 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:19.802590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:19.807130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:19.811032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6b5755a9-5e40-4aa3-a5ca-a4b036dac4e2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:19.814357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6b5755a9-5e40-4aa3-a5ca-a4b036dac4e2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:19.827424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.835415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.837530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.840737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.842352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b5755a9-5e40-4aa3-a5ca-a4b036dac4e2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.848145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.848569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b5755a9-5e40-4aa3-a5ca-a4b036dac4e2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.851058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b5755a9-5e40-4aa3-a5ca-a4b036dac4e2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.855911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.860957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b5755a9-5e40-4aa3-a5ca-a4b036dac4e2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.863222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b5755a9-5e40-4aa3-a5ca-a4b036dac4e2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.865712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b5755a9-5e40-4aa3-a5ca-a4b036dac4e2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.318525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6b5755a9-5e40-4aa3-a5ca-a4b036dac4e2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.330264 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6b5755a9-5e40-4aa3-a5ca-a4b036dac4e2 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1314 microversion: 2.1 time: 0.525200 Oct 04 18:24:20.331614 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2569/5123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:19 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:20.348051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f8100cc5-6ff1-48d7-895b-45171a684ad1 req-aeb00ea5-cc52-4bff-8e93-75ffaedb5499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c70006-2657-45c6-8510-4894b51c1bad", "name": "network-vif-deleted", "tag": "64e822ca-fc96-49b1-8f5d-cabaf5508b13"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:20.370179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f8100cc5-6ff1-48d7-895b-45171a684ad1 req-aeb00ea5-cc52-4bff-8e93-75ffaedb5499 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.370948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f8100cc5-6ff1-48d7-895b-45171a684ad1 req-aeb00ea5-cc52-4bff-8e93-75ffaedb5499 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.371692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f8100cc5-6ff1-48d7-895b-45171a684ad1 req-aeb00ea5-cc52-4bff-8e93-75ffaedb5499 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.388242 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f8100cc5-6ff1-48d7-895b-45171a684ad1 req-aeb00ea5-cc52-4bff-8e93-75ffaedb5499 service nova] Creating event network-vif-deleted:64e822ca-fc96-49b1-8f5d-cabaf5508b13 for instance f5c70006-2657-45c6-8510-4894b51c1bad on n-h1-850499-14 Oct 04 18:24:20.394259 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f8100cc5-6ff1-48d7-895b-45171a684ad1 req-aeb00ea5-cc52-4bff-8e93-75ffaedb5499 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059372 Oct 04 18:24:20.395470 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2570/5124] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:20.460474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.476027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.486237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.490466 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2701227-46f6-4b3a-b6ec-544136fc98ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1407 microversion: 2.20 time: 0.702148 Oct 04 18:24:20.494225 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2555/5125] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:19 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1407 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:20.842641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:20.845397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:20.846109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:20.860002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:20.862899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:20.877807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.895708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.897827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.901371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.907848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.909690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.913136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.923587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.928635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.929893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.947293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.948519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.003922 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad HTTP/1.1 Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'f5c70006-2657-45c6-8510-4894b51c1bad'} Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.020720 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.026055 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:21.026055 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:21.026055 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:21.026055 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:21.026055 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.026055 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.026055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:21.031695 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-abcf3a69-2648-4b33-9f8c-d465a4abe23d tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 404 len: 111 microversion: 2.1 time: 0.197394 Oct 04 18:24:21.038123 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2571/5126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:20 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:21.081523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.082469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:21.127376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.137856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.145492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.156421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.160088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.160625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.208875 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad HTTP/1.1 Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'f5c70006-2657-45c6-8510-4894b51c1bad'} Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:21.210767 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.215036 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.215036 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:21.215036 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.215036 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.215036 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:21.215036 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:21.215036 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:21.215036 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:21.215036 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.215036 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.217755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:21.232023 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2f4aa56d-46fb-47bb-9439-7b39857451f6 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 404 len: 111 microversion: 2.1 time: 0.164783 Oct 04 18:24:21.232913 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2572/5127] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:21 2022] DELETE /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:21.241142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.242566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: f5c70006-2657-45c6-8510-4894b51c1bad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:21.253128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.253928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.254583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.255529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.256205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.256821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.291077 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad HTTP/1.1 Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'f5c70006-2657-45c6-8510-4894b51c1bad'} Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.293471 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.298371 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:21.298371 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:21.298371 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:21.298371 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:21.298371 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. Oct 04 18:24:21.298371 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.300297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance f5c70006-2657-45c6-8510-4894b51c1bad could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:21.301598 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f2d9e45c-7561-495f-8f6b-9d4e306bffa4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad" status: 404 len: 111 microversion: 2.1 time: 0.064164 Oct 04 18:24:21.302725 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2573/5128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/servers/f5c70006-2657-45c6-8510-4894b51c1bad => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:24:21.312641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.315247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:21.332889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.333657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.335477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.348994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.351940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.354429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.386169 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 HTTP/1.1 Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'fac9e6ac-3620-4023-bc53-1b6706fd2f82'} Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:21.388071 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:24:21.393517 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.393517 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:21.393517 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.393517 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.393517 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:21.393517 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:21.393517 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:21.393517 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:21.393517 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:24:21.393517 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.395711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:21.397486 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ae004eb-43ce-469b-b78a-bc4ba9b1a4b3 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 404 len: 111 microversion: 2.1 time: 0.091058 Oct 04 18:24:21.398260 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2574/5129] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:21 2022] DELETE /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:24:21.405109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9c569e30-4cf2-4308-b809-ca174f23d822 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.406461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9c569e30-4cf2-4308-b809-ca174f23d822 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:21.415603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c569e30-4cf2-4308-b809-ca174f23d822 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.416529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c569e30-4cf2-4308-b809-ca174f23d822 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.417262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c569e30-4cf2-4308-b809-ca174f23d822 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.418007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c569e30-4cf2-4308-b809-ca174f23d822 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.418477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c569e30-4cf2-4308-b809-ca174f23d822 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.418922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c569e30-4cf2-4308-b809-ca174f23d822 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.751138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.768989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.771999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.774393 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-200a0079-8c4e-4299-80e4-3acfd3d29ee2 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2958 microversion: 2.42 time: 0.937181 Oct 04 18:24:21.790991 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2556/5130] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:20 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2958 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:21.790991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.790991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: fac9e6ac-3620-4023-bc53-1b6706fd2f82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:21.803652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.806726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.807694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.808610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.810054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.817232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.855209 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 HTTP/1.1 Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'fac9e6ac-3620-4023-bc53-1b6706fd2f82'} Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.860351 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:21.864968 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:21.864968 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:21.864968 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:21.864968 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:21.864968 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. Oct 04 18:24:21.864968 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:21.867986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance fac9e6ac-3620-4023-bc53-1b6706fd2f82 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:21.870864 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a2042c26-49fa-4c22-9ac9-e7ba3dd31420 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82" status: 404 len: 111 microversion: 2.1 time: 0.091657 Oct 04 18:24:21.872039 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2557/5131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/servers/fac9e6ac-3620-4023-bc53-1b6706fd2f82 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:21.885590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.887663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:21.910690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.911494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.912151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.913106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.913772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.917299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.357398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9c569e30-4cf2-4308-b809-ca174f23d822 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.370161 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9c569e30-4cf2-4308-b809-ca174f23d822 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1314 microversion: 2.1 time: 0.969934 Oct 04 18:24:22.379174 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2575/5132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1314 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:22.384000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:22.384711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:22.410754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.419845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.421807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.422746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.429900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.430592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.463375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.504631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.509732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.511426 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bc181194-449c-41f8-9951-12e28645b821 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1600 microversion: 2.20 time: 0.637490 Oct 04 18:24:22.521421 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 HTTP/1.1 Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e0ae85e2-1194-4df1-bd8d-281764a602a2'} Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:22.523085 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:22.527113 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a2de74ad-1c9c-4343-b3ab-6906f3aafecf tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 404 len: 111 microversion: 2.1 time: 0.145028 Oct 04 18:24:22.535674 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2576/5133] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:22 2022] DELETE /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:22.546396 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2558/5134] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1600 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:22.552762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ffb6dda6-8c6f-4bd4-9b17-49cf42b3ccba req-d17bcad4-9464-4161-9ebc-f904d15d54f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-unplugged", "status": "completed", "tag": "f48712ec-9677-458b-99fe-85da96339737"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:22.555058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b8d0284b-9d43-42d8-8b7c-e63d4e30300d req-415a3bf3-d473-49ed-a5ec-b8f05f5d05e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecabaaa8-5ecc-4d05-85e3-4a05096e80d4", "tag": "da539f2a-9d32-4dfa-945b-68d5f5105d61"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:22.571879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b8d0284b-9d43-42d8-8b7c-e63d4e30300d req-415a3bf3-d473-49ed-a5ec-b8f05f5d05e0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.572675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b8d0284b-9d43-42d8-8b7c-e63d4e30300d req-415a3bf3-d473-49ed-a5ec-b8f05f5d05e0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.573324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b8d0284b-9d43-42d8-8b7c-e63d4e30300d req-415a3bf3-d473-49ed-a5ec-b8f05f5d05e0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.594134 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b8d0284b-9d43-42d8-8b7c-e63d4e30300d req-415a3bf3-d473-49ed-a5ec-b8f05f5d05e0 service nova] Creating event network-changed:da539f2a-9d32-4dfa-945b-68d5f5105d61 for instance ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 on n-h1-850499-14 Oct 04 18:24:22.595575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ffb6dda6-8c6f-4bd4-9b17-49cf42b3ccba req-d17bcad4-9464-4161-9ebc-f904d15d54f6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.596092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ffb6dda6-8c6f-4bd4-9b17-49cf42b3ccba req-d17bcad4-9464-4161-9ebc-f904d15d54f6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.599246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ffb6dda6-8c6f-4bd4-9b17-49cf42b3ccba req-d17bcad4-9464-4161-9ebc-f904d15d54f6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.601634 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b8d0284b-9d43-42d8-8b7c-e63d4e30300d req-415a3bf3-d473-49ed-a5ec-b8f05f5d05e0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053257 Oct 04 18:24:22.602589 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2559/5135] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:22.608381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f6cc43c3-7ec6-4ad5-a9b7-e0cf06c859a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'create', calling method: .version_select at 0x7fd4d12ef1f0>, body: {"keypair": {"name": "tempest-keypair-878718764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbomwOFPN+7WFgQekQC4WRfh/eh79/lrcaue8Dq40MQGTL/qx42LVBWI2Au8YrWCu9fXa03TgZPJHiFe+5UrjQ4vxGfGaail//xO87rHPrtptWp9NhuTEcDBJfPjdCnYg=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:22.626499 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ffb6dda6-8c6f-4bd4-9b17-49cf42b3ccba req-d17bcad4-9464-4161-9ebc-f904d15d54f6 service nova] Creating event network-vif-unplugged:f48712ec-9677-458b-99fe-85da96339737 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:22.632921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f6cc43c3-7ec6-4ad5-a9b7-e0cf06c859a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Getting quotas for project ab1cdc33329a4a10970e67390f750163. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:22.640180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f6cc43c3-7ec6-4ad5-a9b7-e0cf06c859a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Getting quotas for user 5a7fc8671d264393bfb0465438b598d1 and project ab1cdc33329a4a10970e67390f750163. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:22.641263 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ffb6dda6-8c6f-4bd4-9b17-49cf42b3ccba req-d17bcad4-9464-4161-9ebc-f904d15d54f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104130 Oct 04 18:24:22.643473 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2577/5136] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:22.654505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:22.657656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: e0ae85e2-1194-4df1-bd8d-281764a602a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:22.675020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.675947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.678674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.681109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.682404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.683780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.696247 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f6cc43c3-7ec6-4ad5-a9b7-e0cf06c859a1 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.090128 Oct 04 18:24:22.697992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2560/5137] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:24:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:22.704206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1ea9f2b-d831-446a-bb65-25baafe002b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:22.706169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b1ea9f2b-d831-446a-bb65-25baafe002b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:22.713409 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 HTTP/1.1 Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'e0ae85e2-1194-4df1-bd8d-281764a602a2'} Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.715780 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:22.720824 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:22.720824 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:22.720824 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:22.720824 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:22.720824 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. Oct 04 18:24:22.720824 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.722920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1ea9f2b-d831-446a-bb65-25baafe002b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.722920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1ea9f2b-d831-446a-bb65-25baafe002b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.722920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1ea9f2b-d831-446a-bb65-25baafe002b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.722920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1ea9f2b-d831-446a-bb65-25baafe002b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.722920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1ea9f2b-d831-446a-bb65-25baafe002b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.722920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1ea9f2b-d831-446a-bb65-25baafe002b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.724995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance e0ae85e2-1194-4df1-bd8d-281764a602a2 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:22.727477 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bf89b67e-b57a-4686-a4d9-9dad5c87120a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2" status: 404 len: 111 microversion: 2.1 time: 0.082852 Oct 04 18:24:22.728271 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2578/5138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:22 2022] GET /compute/v2.1/servers/e0ae85e2-1194-4df1-bd8d-281764a602a2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:22.740573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:22.742504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:22.754066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.754993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.755964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.757513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.758361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.759251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.797485 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 HTTP/1.1 Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '17f162d0-8dc1-4492-ae25-95ac5531f187'} Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:22.802189 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:22.808349 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0f4dcc75-bf7b-4bce-9539-9c82e2ed2dc0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 404 len: 111 microversion: 2.1 time: 0.074445 Oct 04 18:24:22.813588 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2579/5139] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:22 2022] DELETE /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:22.826889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:22.827932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:22.839871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.843915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.843915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.844775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.845311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.845988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.443816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:23.976655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:24.121964 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b1ea9f2b-d831-446a-bb65-25baafe002b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-interface" status: 200 len: 285 microversion: 2.20 time: 1.422398 Oct 04 18:24:24.123289 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2561/5140] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 4 18:24:22 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-interface => generated 285 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:24:24.128329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.128940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 17f162d0-8dc1-4492-ae25-95ac5531f187] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.149367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.149868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.169170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.170146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.170644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.178554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.253435 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 HTTP/1.1 Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '17f162d0-8dc1-4492-ae25-95ac5531f187'} Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.258225 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.264593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.264593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.264593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.264593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.264593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. Oct 04 18:24:24.264593 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.268218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 17f162d0-8dc1-4492-ae25-95ac5531f187 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.269510 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33eb7230-3ea9-4705-a585-124bd7103507 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187" status: 404 len: 111 microversion: 2.1 time: 0.145204 Oct 04 18:24:24.274146 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2562/5141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/17f162d0-8dc1-4492-ae25-95ac5531f187 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.285315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2f9bb406-4faf-4590-b638-2094a0e284e9 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.286417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2f9bb406-4faf-4590-b638-2094a0e284e9 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.297082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9bb406-4faf-4590-b638-2094a0e284e9 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.299331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9bb406-4faf-4590-b638-2094a0e284e9 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.300175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9bb406-4faf-4590-b638-2094a0e284e9 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.301218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9bb406-4faf-4590-b638-2094a0e284e9 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.301945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9bb406-4faf-4590-b638-2094a0e284e9 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.302643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9bb406-4faf-4590-b638-2094a0e284e9 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.306115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.322641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.325547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.326839 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-43058177-7988-4501-ae85-945b7798e7c9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2937 microversion: 2.42 time: 1.515526 Oct 04 18:24:24.331134 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2580/5142] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:22 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2937 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:24.346980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.348005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.354529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.357898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.359696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.361534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.362004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.362436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.410649 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 HTTP/1.1 Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '49466338-d6de-477e-a4a6-050f58898810'} Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.420253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:24:24.425554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.425554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.425554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.425554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.425554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.425554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.425554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.425554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.425554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:24:24.425554 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.427232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.428121 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d7906f3-0437-4a60-bda1-31877abd9942 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 404 len: 111 microversion: 2.1 time: 0.095811 Oct 04 18:24:24.429482 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2581/5143] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:24 2022] DELETE /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.454232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.459924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 49466338-d6de-477e-a4a6-050f58898810] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.479918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.480290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.480735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.481540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.482004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.482433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.520438 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 HTTP/1.1 Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '49466338-d6de-477e-a4a6-050f58898810'} Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.522304 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.527356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.527356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.527356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.527356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.527356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. Oct 04 18:24:24.527356 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.531767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 49466338-d6de-477e-a4a6-050f58898810 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.536501 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-62be9543-03db-4738-a7da-33f40e48bd3e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810" status: 404 len: 111 microversion: 2.1 time: 0.098139 Oct 04 18:24:24.537307 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2582/5144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/49466338-d6de-477e-a4a6-050f58898810 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.546032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.548379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.563642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.564447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.570332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.571964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.573910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.575441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.608163 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 HTTP/1.1 Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '337526af-4c84-413b-8133-569a131bd502'} Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.612271 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:24:24.617033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.617033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.617033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.617033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.617033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.617033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.617033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.617033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.617033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:24:24.617033 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.618593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.619680 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90baa03c-b7cb-4e58-b948-23f2433fd449 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 404 len: 111 microversion: 2.1 time: 0.078066 Oct 04 18:24:24.621145 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2583/5145] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:24 2022] DELETE /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.636472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.637394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 337526af-4c84-413b-8133-569a131bd502] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.649053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.649807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.650425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.652064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.656377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.657001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.699018 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 HTTP/1.1 Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '337526af-4c84-413b-8133-569a131bd502'} Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.700881 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.705256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.705256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.705256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.705256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.705256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. Oct 04 18:24:24.705256 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.707936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 337526af-4c84-413b-8133-569a131bd502 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.711417 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f91e55b-8225-436a-a763-701c7edbe17a tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502" status: 404 len: 111 microversion: 2.1 time: 0.083285 Oct 04 18:24:24.712201 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2584/5146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/337526af-4c84-413b-8133-569a131bd502 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.725187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-63656cdc-1cf3-48a8-a640-c6b89955200e req-c41d66c4-5e81-443a-ac6b-91f1b841b7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-unplugged", "status": "completed", "tag": "7f14d244-6f3e-47f6-9928-5704c2b06130"}, {"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-unplugged", "status": "completed", "tag": "7ea256cc-7dc7-404f-b12e-41602c4c2d87"}, {"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-unplugged", "status": "completed", "tag": "62491f8c-a00d-4911-9961-75eeaa040635"}, {"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-unplugged", "status": "completed", "tag": "623d7b7a-45a9-4025-95d1-5ef6a6f8d75f"}, {"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-unplugged", "status": "completed", "tag": "545c6404-6880-41fc-9a80-8ac8aec3c32f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:24.737765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-63656cdc-1cf3-48a8-a640-c6b89955200e req-c41d66c4-5e81-443a-ac6b-91f1b841b7e1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.738558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-63656cdc-1cf3-48a8-a640-c6b89955200e req-c41d66c4-5e81-443a-ac6b-91f1b841b7e1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.739253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-63656cdc-1cf3-48a8-a640-c6b89955200e req-c41d66c4-5e81-443a-ac6b-91f1b841b7e1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.753486 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-63656cdc-1cf3-48a8-a640-c6b89955200e req-c41d66c4-5e81-443a-ac6b-91f1b841b7e1 service nova] Creating event network-vif-unplugged:7f14d244-6f3e-47f6-9928-5704c2b06130 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:24.755988 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-63656cdc-1cf3-48a8-a640-c6b89955200e req-c41d66c4-5e81-443a-ac6b-91f1b841b7e1 service nova] Creating event network-vif-unplugged:7ea256cc-7dc7-404f-b12e-41602c4c2d87 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:24.756522 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-63656cdc-1cf3-48a8-a640-c6b89955200e req-c41d66c4-5e81-443a-ac6b-91f1b841b7e1 service nova] Creating event network-vif-unplugged:62491f8c-a00d-4911-9961-75eeaa040635 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:24.760332 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-63656cdc-1cf3-48a8-a640-c6b89955200e req-c41d66c4-5e81-443a-ac6b-91f1b841b7e1 service nova] Creating event network-vif-unplugged:623d7b7a-45a9-4025-95d1-5ef6a6f8d75f for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:24.760860 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-63656cdc-1cf3-48a8-a640-c6b89955200e req-c41d66c4-5e81-443a-ac6b-91f1b841b7e1 service nova] Creating event network-vif-unplugged:545c6404-6880-41fc-9a80-8ac8aec3c32f for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:24.777190 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-63656cdc-1cf3-48a8-a640-c6b89955200e req-c41d66c4-5e81-443a-ac6b-91f1b841b7e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.055510 Oct 04 18:24:24.781692 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2585/5147] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:24.785657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-560cdac7-4cfd-4075-99aa-f329df78c79c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.786266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-560cdac7-4cfd-4075-99aa-f329df78c79c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 744d2399-52cf-4121-82bc-e219e5982b85] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.797280 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-560cdac7-4cfd-4075-99aa-f329df78c79c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-560cdac7-4cfd-4075-99aa-f329df78c79c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85 HTTP/1.1 Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '744d2399-52cf-4121-82bc-e219e5982b85'} Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.801008 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.806692 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.806692 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.806692 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.806692 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.806692 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.806692 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:24:24.806692 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.806692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-560cdac7-4cfd-4075-99aa-f329df78c79c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.806692 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-560cdac7-4cfd-4075-99aa-f329df78c79c tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85" status: 404 len: 111 microversion: 2.1 time: 0.025082 Oct 04 18:24:24.806692 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2586/5148] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:24 2022] DELETE /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.815931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ddce1705-bc5e-4a2f-9f8a-00679f28fb05 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.820449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ddce1705-bc5e-4a2f-9f8a-00679f28fb05 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 744d2399-52cf-4121-82bc-e219e5982b85] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.851706 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ddce1705-bc5e-4a2f-9f8a-00679f28fb05 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ddce1705-bc5e-4a2f-9f8a-00679f28fb05 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85 HTTP/1.1 Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '744d2399-52cf-4121-82bc-e219e5982b85'} Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.855660 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.860117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.860117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.860117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. Oct 04 18:24:24.860117 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.861743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ddce1705-bc5e-4a2f-9f8a-00679f28fb05 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 744d2399-52cf-4121-82bc-e219e5982b85 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.864478 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ddce1705-bc5e-4a2f-9f8a-00679f28fb05 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85" status: 404 len: 111 microversion: 2.1 time: 0.051647 Oct 04 18:24:24.868105 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2587/5149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/744d2399-52cf-4121-82bc-e219e5982b85 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.883127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-644de63a-25f6-427e-9d86-8cae173b2018 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.883943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-644de63a-25f6-427e-9d86-8cae173b2018 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.900598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-644de63a-25f6-427e-9d86-8cae173b2018 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.901503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-644de63a-25f6-427e-9d86-8cae173b2018 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.903908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-644de63a-25f6-427e-9d86-8cae173b2018 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.904857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-644de63a-25f6-427e-9d86-8cae173b2018 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.908090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-644de63a-25f6-427e-9d86-8cae173b2018 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.908793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-644de63a-25f6-427e-9d86-8cae173b2018 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.971904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f9bb406-4faf-4590-b638-2094a0e284e9 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.975126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-644de63a-25f6-427e-9d86-8cae173b2018 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:24.980915 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2f9bb406-4faf-4590-b638-2094a0e284e9 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1314 microversion: 2.1 time: 0.705142 Oct 04 18:24:24.985355 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2563/5150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:25.100804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:25.176681 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-644de63a-25f6-427e-9d86-8cae173b2018 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 204 len: 0 microversion: 2.1 time: 0.305665 Oct 04 18:24:25.178399 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2588/5151] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:24 2022] DELETE /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:24:25.188299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3dbc743e-264b-4ba5-a67d-47a2434d21c0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.189317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3dbc743e-264b-4ba5-a67d-47a2434d21c0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:25.201873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dbc743e-264b-4ba5-a67d-47a2434d21c0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.203241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dbc743e-264b-4ba5-a67d-47a2434d21c0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.203932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dbc743e-264b-4ba5-a67d-47a2434d21c0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.204896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dbc743e-264b-4ba5-a67d-47a2434d21c0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.206304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dbc743e-264b-4ba5-a67d-47a2434d21c0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.207387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dbc743e-264b-4ba5-a67d-47a2434d21c0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.368593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.369217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:25.376353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.376862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.377306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.378016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.378479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.378913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.400426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3dbc743e-264b-4ba5-a67d-47a2434d21c0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.419104 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3dbc743e-264b-4ba5-a67d-47a2434d21c0 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1479 microversion: 2.1 time: 0.235975 Oct 04 18:24:25.420485 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2564/5152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:25 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1479 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:25.642770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.658057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.661113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.664158 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f33ee58a-12bd-4ba2-aa5e-ff2dec5cb324 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2916 microversion: 2.42 time: 0.299903 Oct 04 18:24:25.666760 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2589/5153] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:25 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2916 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:26.009848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-89fd5d9b-b8fd-4e38-83de-eb860fa3a8fa tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:26.010586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-89fd5d9b-b8fd-4e38-83de-eb860fa3a8fa tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:26.022284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89fd5d9b-b8fd-4e38-83de-eb860fa3a8fa tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.022890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89fd5d9b-b8fd-4e38-83de-eb860fa3a8fa tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.023436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89fd5d9b-b8fd-4e38-83de-eb860fa3a8fa tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.025456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89fd5d9b-b8fd-4e38-83de-eb860fa3a8fa tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.027438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89fd5d9b-b8fd-4e38-83de-eb860fa3a8fa tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.027926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89fd5d9b-b8fd-4e38-83de-eb860fa3a8fa tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.444858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-24c15136-936f-4a0c-ac36-aff3d668596e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:26.445428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-24c15136-936f-4a0c-ac36-aff3d668596e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:26.460264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24c15136-936f-4a0c-ac36-aff3d668596e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.460774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24c15136-936f-4a0c-ac36-aff3d668596e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.461223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24c15136-936f-4a0c-ac36-aff3d668596e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.461950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24c15136-936f-4a0c-ac36-aff3d668596e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.462411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24c15136-936f-4a0c-ac36-aff3d668596e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.462842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-24c15136-936f-4a0c-ac36-aff3d668596e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.308944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-89fd5d9b-b8fd-4e38-83de-eb860fa3a8fa tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.319361 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-89fd5d9b-b8fd-4e38-83de-eb860fa3a8fa tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1314 microversion: 2.1 time: 1.312572 Oct 04 18:24:27.341249 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2565/5154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:26 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1314 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:27.363568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:27.365775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:27.381140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.383034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.383491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.384231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.384692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.385124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.803161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-24c15136-936f-4a0c-ac36-aff3d668596e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.810743 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-24c15136-936f-4a0c-ac36-aff3d668596e tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1479 microversion: 2.1 time: 1.370645 Oct 04 18:24:27.830596 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2590/5155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:26 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1479 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:27.845660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-23c8ead7-38ae-4cd6-aca5-976095bdbb45 req-d00649b2-a9db-4a2f-a708-e6b681a2240a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d39c1d8-8eed-462d-af88-bd613d502347", "tag": "12e1280e-928a-4b59-9480-9e0bba1dd891"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:27.881440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-23c8ead7-38ae-4cd6-aca5-976095bdbb45 req-d00649b2-a9db-4a2f-a708-e6b681a2240a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.881944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-23c8ead7-38ae-4cd6-aca5-976095bdbb45 req-d00649b2-a9db-4a2f-a708-e6b681a2240a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.882382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-23c8ead7-38ae-4cd6-aca5-976095bdbb45 req-d00649b2-a9db-4a2f-a708-e6b681a2240a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.917336 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-23c8ead7-38ae-4cd6-aca5-976095bdbb45 req-d00649b2-a9db-4a2f-a708-e6b681a2240a service nova] Creating event network-changed:12e1280e-928a-4b59-9480-9e0bba1dd891 for instance 9d39c1d8-8eed-462d-af88-bd613d502347 on n-h2-850499-14 Oct 04 18:24:27.934298 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-23c8ead7-38ae-4cd6-aca5-976095bdbb45 req-d00649b2-a9db-4a2f-a708-e6b681a2240a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101698 Oct 04 18:24:27.938804 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2591/5156] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:28.354448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5478cf2c-3e8b-4653-8077-01d8772da03b tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:28.363862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5478cf2c-3e8b-4653-8077-01d8772da03b tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:28.392066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5478cf2c-3e8b-4653-8077-01d8772da03b tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.392663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5478cf2c-3e8b-4653-8077-01d8772da03b tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.393130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5478cf2c-3e8b-4653-8077-01d8772da03b tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.393907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5478cf2c-3e8b-4653-8077-01d8772da03b tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.394373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5478cf2c-3e8b-4653-8077-01d8772da03b tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.394807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5478cf2c-3e8b-4653-8077-01d8772da03b tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.474216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:28.490323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:28.496958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:28.498543 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-289b3cab-64d1-4d6a-99d9-8a7c54eef308 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2916 microversion: 2.42 time: 1.155976 Oct 04 18:24:28.524021 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2566/5157] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:27 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2916 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:28.842917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d8ead4e6-c0b9-4114-ba63-6e861c8762c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:28.843959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d8ead4e6-c0b9-4114-ba63-6e861c8762c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:28.851537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8ead4e6-c0b9-4114-ba63-6e861c8762c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.856419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8ead4e6-c0b9-4114-ba63-6e861c8762c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.857694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8ead4e6-c0b9-4114-ba63-6e861c8762c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.859180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8ead4e6-c0b9-4114-ba63-6e861c8762c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.862445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8ead4e6-c0b9-4114-ba63-6e861c8762c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.864123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d8ead4e6-c0b9-4114-ba63-6e861c8762c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:29.192534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5478cf2c-3e8b-4653-8077-01d8772da03b tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:29.208568 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5478cf2c-3e8b-4653-8077-01d8772da03b tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1314 microversion: 2.1 time: 0.860744 Oct 04 18:24:29.212533 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2592/5158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:28 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:29.506508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d8ead4e6-c0b9-4114-ba63-6e861c8762c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:29.531371 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d8ead4e6-c0b9-4114-ba63-6e861c8762c8 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1479 microversion: 2.1 time: 0.695067 Oct 04 18:24:29.536391 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2567/5159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:28 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1479 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:29.547745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:29.548373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:29.578326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:29.587966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:29.590320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:29.593037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:29.597529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:29.598546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.014044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-034bdc1d-8d89-4bd9-be41-e8b963e44ff4 req-c0c62bf0-84dd-45b1-8ce9-696e626781c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-deleted", "tag": "545c6404-6880-41fc-9a80-8ac8aec3c32f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:30.040035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-034bdc1d-8d89-4bd9-be41-e8b963e44ff4 req-c0c62bf0-84dd-45b1-8ce9-696e626781c2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.050414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-034bdc1d-8d89-4bd9-be41-e8b963e44ff4 req-c0c62bf0-84dd-45b1-8ce9-696e626781c2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.055428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-034bdc1d-8d89-4bd9-be41-e8b963e44ff4 req-c0c62bf0-84dd-45b1-8ce9-696e626781c2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.097747 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-034bdc1d-8d89-4bd9-be41-e8b963e44ff4 req-c0c62bf0-84dd-45b1-8ce9-696e626781c2 service nova] Creating event network-vif-deleted:545c6404-6880-41fc-9a80-8ac8aec3c32f for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:30.133156 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-034bdc1d-8d89-4bd9-be41-e8b963e44ff4 req-c0c62bf0-84dd-45b1-8ce9-696e626781c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122619 Oct 04 18:24:30.136884 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2568/5160] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:30.239478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa54625f-422e-44c2-88b9-016614d995f7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:30.241132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aa54625f-422e-44c2-88b9-016614d995f7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:30.244858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:30.269864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa54625f-422e-44c2-88b9-016614d995f7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.282128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:30.288639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:30.296966 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b0bd2014-ec7a-416f-909e-4dc6cf6e406e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2869 microversion: 2.42 time: 0.751594 Oct 04 18:24:30.297687 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2593/5161] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:29 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2869 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:30.297992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa54625f-422e-44c2-88b9-016614d995f7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.300816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa54625f-422e-44c2-88b9-016614d995f7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.301603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa54625f-422e-44c2-88b9-016614d995f7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.305808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa54625f-422e-44c2-88b9-016614d995f7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.308989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa54625f-422e-44c2-88b9-016614d995f7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.326432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:30.571351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c30576c-c8d7-4ae3-9f37-780382d265f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:30.572617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1c30576c-c8d7-4ae3-9f37-780382d265f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:30.595662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c30576c-c8d7-4ae3-9f37-780382d265f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.596436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c30576c-c8d7-4ae3-9f37-780382d265f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.597574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c30576c-c8d7-4ae3-9f37-780382d265f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.603370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c30576c-c8d7-4ae3-9f37-780382d265f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.609572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c30576c-c8d7-4ae3-9f37-780382d265f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.611409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c30576c-c8d7-4ae3-9f37-780382d265f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.849782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1c30576c-c8d7-4ae3-9f37-780382d265f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e49c77352541cb94dcd12277f7ee67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055e605a53014ca29fa6416b576060e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:30.860539 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c30576c-c8d7-4ae3-9f37-780382d265f9 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 200 len: 1437 microversion: 2.1 time: 0.296610 Oct 04 18:24:30.865822 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2594/5162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:30 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 1437 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:30.875218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aa54625f-422e-44c2-88b9-016614d995f7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:30.881733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1772858837", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0332781-7a65-44bd-97e9-499f026b4225"}], "security_groups": [{"name": "tempest-securitygroup--2131519496"}], "key_name": "tempest-keypair-878718764", "user_data": "}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:30.882365 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa54625f-422e-44c2-88b9-016614d995f7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1314 microversion: 2.1 time: 0.651024 Oct 04 18:24:30.894980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2569/5163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:30 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:30.894980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e909b1f3-80d5-4986-9e23-f197c034e681 req-c2381394-defe-46bf-9bd6-dff93a9f7a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecabaaa8-5ecc-4d05-85e3-4a05096e80d4", "name": "network-vif-plugged", "status": "completed", "tag": "da539f2a-9d32-4dfa-945b-68d5f5105d61"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:30.947811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e909b1f3-80d5-4986-9e23-f197c034e681 req-c2381394-defe-46bf-9bd6-dff93a9f7a8a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.948310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e909b1f3-80d5-4986-9e23-f197c034e681 req-c2381394-defe-46bf-9bd6-dff93a9f7a8a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.948755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e909b1f3-80d5-4986-9e23-f197c034e681 req-c2381394-defe-46bf-9bd6-dff93a9f7a8a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:31.018566 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e909b1f3-80d5-4986-9e23-f197c034e681 req-c2381394-defe-46bf-9bd6-dff93a9f7a8a service nova] Creating event network-vif-plugged:da539f2a-9d32-4dfa-945b-68d5f5105d61 for instance ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 on n-h1-850499-14 Oct 04 18:24:31.055822 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e909b1f3-80d5-4986-9e23-f197c034e681 req-c2381394-defe-46bf-9bd6-dff93a9f7a8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170784 Oct 04 18:24:31.056471 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2570/5164] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:31.184475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] validate_networks() for [('c0332781-7a65-44bd-97e9-499f026b4225', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:24:31.329582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:31.330923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:31.347497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:31.348005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:31.356958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:31.357838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:31.359580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:31.364278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:32.621205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:32.675979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=10 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:32.683511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:32.688540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:32.691536 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-029a9952-9e51-44b0-8fd8-49c002bc8e0d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2531 microversion: 2.42 time: 1.366921 Oct 04 18:24:32.695470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2571/5165] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:31 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2531 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:32.708289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:32.713114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] [instance: 1e9a3ac3-3557-45f7-b366-9c725dc9cacd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:32.752549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:32.752549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:32.760964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:32.771645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:32.779850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:32.780818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:32.860136 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] HTTP exception thrown: Instance 1e9a3ac3-3557-45f7-b366-9c725dc9cacd could not be found. Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Request method failure captured: Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd HTTP/1.1 Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHljHs2D6Nl-W70gPL5VSjSOS9czR-ApxghKNLitw2DGIq5M04WlWe7H39dpoxk-oDebclimtMogg8QMGg7BlKanXhA3tpkqPxc4gXz3i8nvcczKQKPADu9yFVt_0ULI-KUFeAAtDT4u7EG4bcP4ByKWny1-jmP5uTyRLFPcmf_XQ1Y Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_055e605a53014ca29fa6416b576060e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/055e605a53014ca29fa6416b576060e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/055e605a53014ca29fa6416b576060e8"}]}] Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersTestJSON-703253508 Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 055e605a53014ca29fa6416b576060e8 Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersTestJSON-703253508 Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersTestJSON-703253508-project Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 41e49c77352541cb94dcd12277f7ee67 Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersTestJSON-703253508-project Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 1e9a3ac3-3557-45f7-b366-9c725dc9cacd could not be found. Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '1e9a3ac3-3557-45f7-b366-9c725dc9cacd'} Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e9a3ac3-3557-45f7-b366-9c725dc9cacd could not be found. Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e9a3ac3-3557-45f7-b366-9c725dc9cacd could not be found. Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:32.880867 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:32.885307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:32.885307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:32.885307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:32.885307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:32.885307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e9a3ac3-3557-45f7-b366-9c725dc9cacd could not be found. Oct 04 18:24:32.885307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:32.894102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] Returning 404 to user: Instance 1e9a3ac3-3557-45f7-b366-9c725dc9cacd could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:32.894926 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-156499d0-b6ab-4149-9953-cb71730270d4 tempest-ServersTestJSON-703253508 tempest-ServersTestJSON-703253508-project] 10.222.0.18 "GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd" status: 404 len: 111 microversion: 2.1 time: 0.198395 Oct 04 18:24:32.895537 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2572/5166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:32 2022] GET /compute/v2.1/servers/1e9a3ac3-3557-45f7-b366-9c725dc9cacd => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:32.920871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dcef29bb-a614-4e1c-a5e1-f346dd07f5e1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:32.928814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dcef29bb-a614-4e1c-a5e1-f346dd07f5e1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:32.953784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcef29bb-a614-4e1c-a5e1-f346dd07f5e1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:32.959263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcef29bb-a614-4e1c-a5e1-f346dd07f5e1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:32.961308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcef29bb-a614-4e1c-a5e1-f346dd07f5e1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:32.964752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcef29bb-a614-4e1c-a5e1-f346dd07f5e1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:32.966681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcef29bb-a614-4e1c-a5e1-f346dd07f5e1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:32.970358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dcef29bb-a614-4e1c-a5e1-f346dd07f5e1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.413916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:33.414588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:33.414843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:33.415541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:33.416178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:33.427405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:33.428205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:33.428924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.429890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:33.430589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:33.431313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.453883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Getting quotas for project ab1cdc33329a4a10970e67390f750163. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:33.459860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:33.462066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Getting quotas for user 5a7fc8671d264393bfb0465438b598d1 and project ab1cdc33329a4a10970e67390f750163. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:33.480239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:24:33.483210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:33.594412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dcef29bb-a614-4e1c-a5e1-f346dd07f5e1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:33.597376 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f21ea445-8d04-49d6-9f77-5908a22b1d5b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.730334 Oct 04 18:24:33.604387 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dcef29bb-a614-4e1c-a5e1-f346dd07f5e1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1314 microversion: 2.1 time: 0.699416 Oct 04 18:24:33.607390 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2595/5167] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:24:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 2740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:24:33.617212 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2573/5168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:32 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:33.619939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-9632b992-1703-48f5-beab-c0f835a3e1dc req-6f7ba36c-3b58-43bb-b5c7-7516381bd565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9a3ac3-3557-45f7-b366-9c725dc9cacd", "name": "network-vif-deleted", "tag": "c648dcfc-5668-4287-bf56-52c2ada998a3"}, {"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-deleted", "tag": "7ea256cc-7dc7-404f-b12e-41602c4c2d87"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:33.628057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc4a4223-4c61-4c95-a4aa-3291440434b6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:33.644713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9632b992-1703-48f5-beab-c0f835a3e1dc req-6f7ba36c-3b58-43bb-b5c7-7516381bd565 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:33.647649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc4a4223-4c61-4c95-a4aa-3291440434b6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:33.648775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9632b992-1703-48f5-beab-c0f835a3e1dc req-6f7ba36c-3b58-43bb-b5c7-7516381bd565 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:33.663230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9632b992-1703-48f5-beab-c0f835a3e1dc req-6f7ba36c-3b58-43bb-b5c7-7516381bd565 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.700880 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9632b992-1703-48f5-beab-c0f835a3e1dc req-6f7ba36c-3b58-43bb-b5c7-7516381bd565 service nova] Creating event network-vif-deleted:c648dcfc-5668-4287-bf56-52c2ada998a3 for instance 1e9a3ac3-3557-45f7-b366-9c725dc9cacd on n-h2-850499-14 Oct 04 18:24:33.704074 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9632b992-1703-48f5-beab-c0f835a3e1dc req-6f7ba36c-3b58-43bb-b5c7-7516381bd565 service nova] Creating event network-vif-deleted:7ea256cc-7dc7-404f-b12e-41602c4c2d87 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:33.724057 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-9632b992-1703-48f5-beab-c0f835a3e1dc req-6f7ba36c-3b58-43bb-b5c7-7516381bd565 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115037 Oct 04 18:24:33.727608 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2596/5169] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:33.738558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:33.741890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:33.757563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:33.759120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:33.761260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.762591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:33.766204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:33.766942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.837547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dc4a4223-4c61-4c95-a4aa-3291440434b6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:33.849319 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc4a4223-4c61-4c95-a4aa-3291440434b6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1245 microversion: 2.1 time: 0.230260 Oct 04 18:24:33.850663 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2574/5170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:33 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1245 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:34.073492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:34.088076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:34.100798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:34.102116 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-70cfa6a6-b23a-4c11-828d-d3a9c7200f57 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2437 microversion: 2.42 time: 0.373079 Oct 04 18:24:34.102705 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2597/5171] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:33 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2437 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:34.645930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0818c635-332b-49b5-8ab3-a3be9f82bd66 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:34.646727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0818c635-332b-49b5-8ab3-a3be9f82bd66 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:34.668446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0818c635-332b-49b5-8ab3-a3be9f82bd66 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:34.673346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0818c635-332b-49b5-8ab3-a3be9f82bd66 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:34.674556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0818c635-332b-49b5-8ab3-a3be9f82bd66 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:34.679811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0818c635-332b-49b5-8ab3-a3be9f82bd66 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:34.684604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0818c635-332b-49b5-8ab3-a3be9f82bd66 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:34.685993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0818c635-332b-49b5-8ab3-a3be9f82bd66 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:34.872957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8c6627a1-a60b-46ec-9728-f38df869aa88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:34.874946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c6627a1-a60b-46ec-9728-f38df869aa88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:34.986288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8c6627a1-a60b-46ec-9728-f38df869aa88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:34.993922 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8c6627a1-a60b-46ec-9728-f38df869aa88 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1245 microversion: 2.1 time: 0.124718 Oct 04 18:24:34.994531 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2598/5172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:34 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:35.045277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0818c635-332b-49b5-8ab3-a3be9f82bd66 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.065861 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0818c635-332b-49b5-8ab3-a3be9f82bd66 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1498 microversion: 2.1 time: 0.425489 Oct 04 18:24:35.067717 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2575/5173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:34 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1498 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:35.130685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:35.131363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:35.147040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.147570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.156649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.161031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.161541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.165489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.200728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1bae037b-83b6-4538-9b64-b337539361ed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:35.202009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1bae037b-83b6-4538-9b64-b337539361ed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:35.210853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bae037b-83b6-4538-9b64-b337539361ed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.211638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bae037b-83b6-4538-9b64-b337539361ed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.214250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bae037b-83b6-4538-9b64-b337539361ed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.215189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bae037b-83b6-4538-9b64-b337539361ed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.215821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bae037b-83b6-4538-9b64-b337539361ed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.216420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bae037b-83b6-4538-9b64-b337539361ed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.654131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1bae037b-83b6-4538-9b64-b337539361ed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.659657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.672255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.673995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.676287 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c60b2b23-2b59-41e9-80c8-21eb011a0620 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 2323 microversion: 2.42 time: 0.549799 Oct 04 18:24:35.678429 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2599/5174] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:35 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 2323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:35.683045 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1bae037b-83b6-4538-9b64-b337539361ed tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.486773 Oct 04 18:24:35.685747 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2576/5175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:35 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:35.828716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2260aa55-4a8e-4ebf-bb24-04b50b79d492 req-837e51b4-5a08-4f3b-b156-231b9ac5f526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-deleted", "tag": "f48712ec-9677-458b-99fe-85da96339737"}, {"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-deleted", "tag": "623d7b7a-45a9-4025-95d1-5ef6a6f8d75f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:35.857790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2260aa55-4a8e-4ebf-bb24-04b50b79d492 req-837e51b4-5a08-4f3b-b156-231b9ac5f526 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.858303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2260aa55-4a8e-4ebf-bb24-04b50b79d492 req-837e51b4-5a08-4f3b-b156-231b9ac5f526 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.861472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2260aa55-4a8e-4ebf-bb24-04b50b79d492 req-837e51b4-5a08-4f3b-b156-231b9ac5f526 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.888974 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2260aa55-4a8e-4ebf-bb24-04b50b79d492 req-837e51b4-5a08-4f3b-b156-231b9ac5f526 service nova] Creating event network-vif-deleted:f48712ec-9677-458b-99fe-85da96339737 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:35.903168 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2260aa55-4a8e-4ebf-bb24-04b50b79d492 req-837e51b4-5a08-4f3b-b156-231b9ac5f526 service nova] Creating event network-vif-deleted:623d7b7a-45a9-4025-95d1-5ef6a6f8d75f for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:35.921879 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2260aa55-4a8e-4ebf-bb24-04b50b79d492 req-837e51b4-5a08-4f3b-b156-231b9ac5f526 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103010 Oct 04 18:24:35.926234 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2600/5176] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:35.955452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-24d69d19-164b-4ecb-9418-0762ec2e3144 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:35.956397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-24d69d19-164b-4ecb-9418-0762ec2e3144 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:35.983480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24d69d19-164b-4ecb-9418-0762ec2e3144 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.985327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24d69d19-164b-4ecb-9418-0762ec2e3144 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.988063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24d69d19-164b-4ecb-9418-0762ec2e3144 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.988836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24d69d19-164b-4ecb-9418-0762ec2e3144 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.989306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24d69d19-164b-4ecb-9418-0762ec2e3144 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.989745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24d69d19-164b-4ecb-9418-0762ec2e3144 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.021191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1b1e85df-b72e-4f75-8af5-38cb8127ba3b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:36.022199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1b1e85df-b72e-4f75-8af5-38cb8127ba3b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:36.046379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b1e85df-b72e-4f75-8af5-38cb8127ba3b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.047492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b1e85df-b72e-4f75-8af5-38cb8127ba3b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.049494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b1e85df-b72e-4f75-8af5-38cb8127ba3b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.051713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b1e85df-b72e-4f75-8af5-38cb8127ba3b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.053119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b1e85df-b72e-4f75-8af5-38cb8127ba3b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.058351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b1e85df-b72e-4f75-8af5-38cb8127ba3b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.099649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-24d69d19-164b-4ecb-9418-0762ec2e3144 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:36.200534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1b1e85df-b72e-4f75-8af5-38cb8127ba3b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:36.228242 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1b1e85df-b72e-4f75-8af5-38cb8127ba3b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1297 microversion: 2.1 time: 0.209117 Oct 04 18:24:36.236422 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2601/5177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:36 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1297 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:36.278581 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-24d69d19-164b-4ecb-9418-0762ec2e3144 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 204 len: 0 microversion: 2.1 time: 0.327700 Oct 04 18:24:36.279757 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2577/5178] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:35 2022] DELETE /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:24:36.287926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f24e84c-98fb-48f8-882e-915191c8be45 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:36.288548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9f24e84c-98fb-48f8-882e-915191c8be45 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:36.297795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f24e84c-98fb-48f8-882e-915191c8be45 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.298294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f24e84c-98fb-48f8-882e-915191c8be45 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.298738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f24e84c-98fb-48f8-882e-915191c8be45 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.299497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f24e84c-98fb-48f8-882e-915191c8be45 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.299957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f24e84c-98fb-48f8-882e-915191c8be45 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.300386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f24e84c-98fb-48f8-882e-915191c8be45 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.548083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f24e84c-98fb-48f8-882e-915191c8be45 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:36.562247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9f24e84c-98fb-48f8-882e-915191c8be45 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1504 microversion: 2.1 time: 0.277876 Oct 04 18:24:36.563408 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2602/5179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:36 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:36.712303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:36.713129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:36.714166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-686113e8-b692-4195-b435-d75997ef7476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:36.714902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-686113e8-b692-4195-b435-d75997ef7476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:36.734871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-686113e8-b692-4195-b435-d75997ef7476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.742313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.743369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.745958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.750503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.751343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-686113e8-b692-4195-b435-d75997ef7476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.751569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.751922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-686113e8-b692-4195-b435-d75997ef7476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.752419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.752704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-686113e8-b692-4195-b435-d75997ef7476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.753200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-686113e8-b692-4195-b435-d75997ef7476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.761363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-686113e8-b692-4195-b435-d75997ef7476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.937908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:36.986821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:36.989956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:36.991247 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ec35a9ff-5b6d-43d6-b9a8-6feb8ecb7a9c tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.287301 Oct 04 18:24:37.009212 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2578/5180] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:36 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:37.182630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-686113e8-b692-4195-b435-d75997ef7476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:37.198083 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-686113e8-b692-4195-b435-d75997ef7476 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.487944 Oct 04 18:24:37.214986 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2603/5181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:36 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:37.230390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6bb74b0a-b9c5-49e0-a0f4-05f1d36f3728 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1428925868"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:37.236297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6bb74b0a-b9c5-49e0-a0f4-05f1d36f3728 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:37.258346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cae0872b-6950-4940-90dc-df11594550ce tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:37.259078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cae0872b-6950-4940-90dc-df11594550ce tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:37.262723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bb74b0a-b9c5-49e0-a0f4-05f1d36f3728 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:37.263262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bb74b0a-b9c5-49e0-a0f4-05f1d36f3728 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:37.263717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bb74b0a-b9c5-49e0-a0f4-05f1d36f3728 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.265046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bb74b0a-b9c5-49e0-a0f4-05f1d36f3728 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:37.265616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bb74b0a-b9c5-49e0-a0f4-05f1d36f3728 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:37.266062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6bb74b0a-b9c5-49e0-a0f4-05f1d36f3728 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.271293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cae0872b-6950-4940-90dc-df11594550ce tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:37.271816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cae0872b-6950-4940-90dc-df11594550ce tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:37.272273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cae0872b-6950-4940-90dc-df11594550ce tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.275220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cae0872b-6950-4940-90dc-df11594550ce tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:37.275727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cae0872b-6950-4940-90dc-df11594550ce tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:37.276824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cae0872b-6950-4940-90dc-df11594550ce tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.396354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cae0872b-6950-4940-90dc-df11594550ce tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:37.404112 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cae0872b-6950-4940-90dc-df11594550ce tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1303 microversion: 2.1 time: 0.150583 Oct 04 18:24:37.408859 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2604/5182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:37 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:37.586551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c37389e-3c45-4f46-9296-0fd79902f363 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:37.587581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4c37389e-3c45-4f46-9296-0fd79902f363 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:37.629622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c37389e-3c45-4f46-9296-0fd79902f363 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:37.630459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c37389e-3c45-4f46-9296-0fd79902f363 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:37.635392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c37389e-3c45-4f46-9296-0fd79902f363 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.640097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c37389e-3c45-4f46-9296-0fd79902f363 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:37.642083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c37389e-3c45-4f46-9296-0fd79902f363 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:37.642640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c37389e-3c45-4f46-9296-0fd79902f363 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.728589 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6bb74b0a-b9c5-49e0-a0f4-05f1d36f3728 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.501818 Oct 04 18:24:37.751774 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2579/5183] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:24:37 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:24:37.982272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-aa173c49-e1ab-40ca-be6a-d2909b637555 req-76ba4c4d-0daa-4431-ba8d-bff1a4946cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ec30a2-5c37-47e9-8267-94546b5a146e", "name": "network-vif-deleted", "tag": "7f14d244-6f3e-47f6-9928-5704c2b06130"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:38.002943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-aa173c49-e1ab-40ca-be6a-d2909b637555 req-76ba4c4d-0daa-4431-ba8d-bff1a4946cb9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.011310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-aa173c49-e1ab-40ca-be6a-d2909b637555 req-76ba4c4d-0daa-4431-ba8d-bff1a4946cb9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.011957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-aa173c49-e1ab-40ca-be6a-d2909b637555 req-76ba4c4d-0daa-4431-ba8d-bff1a4946cb9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.036566 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-aa173c49-e1ab-40ca-be6a-d2909b637555 req-76ba4c4d-0daa-4431-ba8d-bff1a4946cb9 service nova] Creating event network-vif-deleted:7f14d244-6f3e-47f6-9928-5704c2b06130 for instance 79ec30a2-5c37-47e9-8267-94546b5a146e on n-h2-850499-14 Oct 04 18:24:38.050454 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-aa173c49-e1ab-40ca-be6a-d2909b637555 req-76ba4c4d-0daa-4431-ba8d-bff1a4946cb9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069285 Oct 04 18:24:38.052472 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2580/5184] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:38.064680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:38.066837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:38.079381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.083523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.085540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.087205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.087917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.094422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.135386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4c37389e-3c45-4f46-9296-0fd79902f363 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:38.151587 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c37389e-3c45-4f46-9296-0fd79902f363 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1504 microversion: 2.1 time: 0.565785 Oct 04 18:24:38.152452 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2605/5185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:37 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1504 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:38.173780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-a97a28e1-ad8f-430d-8457-c6ed27d3eeb8 req-e429306a-1289-4da4-b4f8-ffc3265d3f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1681ab-db4a-4528-99da-649ffa9a93a0", "name": "network-vif-unplugged", "status": "completed", "tag": "2d48ba84-42ef-46d1-b6ba-69e426d07f1c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:38.214748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a97a28e1-ad8f-430d-8457-c6ed27d3eeb8 req-e429306a-1289-4da4-b4f8-ffc3265d3f93 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.215420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a97a28e1-ad8f-430d-8457-c6ed27d3eeb8 req-e429306a-1289-4da4-b4f8-ffc3265d3f93 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.218770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a97a28e1-ad8f-430d-8457-c6ed27d3eeb8 req-e429306a-1289-4da4-b4f8-ffc3265d3f93 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.271481 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-a97a28e1-ad8f-430d-8457-c6ed27d3eeb8 req-e429306a-1289-4da4-b4f8-ffc3265d3f93 service nova] Creating event network-vif-unplugged:2d48ba84-42ef-46d1-b6ba-69e426d07f1c for instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 on n-h2-850499-14 Oct 04 18:24:38.291536 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-a97a28e1-ad8f-430d-8457-c6ed27d3eeb8 req-e429306a-1289-4da4-b4f8-ffc3265d3f93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133492 Oct 04 18:24:38.298851 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2606/5186] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:38.331141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:38.351460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:38.352922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:38.354347 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f175f13a-112e-4c0c-8e9f-667ee5710da9 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.300453 Oct 04 18:24:38.355125 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2581/5187] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:38 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:38.432128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7da7be0e-df1a-4add-a97b-7884c0616c96 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:38.432853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7da7be0e-df1a-4add-a97b-7884c0616c96 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:38.444699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7da7be0e-df1a-4add-a97b-7884c0616c96 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.445210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7da7be0e-df1a-4add-a97b-7884c0616c96 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.445663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7da7be0e-df1a-4add-a97b-7884c0616c96 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.446384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7da7be0e-df1a-4add-a97b-7884c0616c96 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.451884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7da7be0e-df1a-4add-a97b-7884c0616c96 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.452424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7da7be0e-df1a-4add-a97b-7884c0616c96 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.570997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7da7be0e-df1a-4add-a97b-7884c0616c96 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:38.582068 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7da7be0e-df1a-4add-a97b-7884c0616c96 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1303 microversion: 2.1 time: 0.154461 Oct 04 18:24:38.583235 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2607/5188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:38 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:39.190109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d4dd181f-9e45-48e1-97f2-1e5fd8b963f4 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:39.191076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d4dd181f-9e45-48e1-97f2-1e5fd8b963f4 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:39.228220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4dd181f-9e45-48e1-97f2-1e5fd8b963f4 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.231283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4dd181f-9e45-48e1-97f2-1e5fd8b963f4 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.238368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4dd181f-9e45-48e1-97f2-1e5fd8b963f4 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:39.239607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4dd181f-9e45-48e1-97f2-1e5fd8b963f4 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.240112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4dd181f-9e45-48e1-97f2-1e5fd8b963f4 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.240546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4dd181f-9e45-48e1-97f2-1e5fd8b963f4 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:39.320752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:39.433577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a1224290-c0b6-402c-932f-e68ff7f4ff8a req-03470ff8-1d0b-497a-84f8-b86a6960985b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecabaaa8-5ecc-4d05-85e3-4a05096e80d4", "name": "network-vif-deleted", "tag": "da539f2a-9d32-4dfa-945b-68d5f5105d61"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:39.469520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1224290-c0b6-402c-932f-e68ff7f4ff8a req-03470ff8-1d0b-497a-84f8-b86a6960985b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.470031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1224290-c0b6-402c-932f-e68ff7f4ff8a req-03470ff8-1d0b-497a-84f8-b86a6960985b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.470477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1224290-c0b6-402c-932f-e68ff7f4ff8a req-03470ff8-1d0b-497a-84f8-b86a6960985b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:39.501184 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a1224290-c0b6-402c-932f-e68ff7f4ff8a req-03470ff8-1d0b-497a-84f8-b86a6960985b service nova] Creating event network-vif-deleted:da539f2a-9d32-4dfa-945b-68d5f5105d61 for instance ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 on n-h1-850499-14 Oct 04 18:24:39.519283 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a1224290-c0b6-402c-932f-e68ff7f4ff8a req-03470ff8-1d0b-497a-84f8-b86a6960985b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.386834 Oct 04 18:24:39.522980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2582/5189] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:39.535915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:39.540487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d4dd181f-9e45-48e1-97f2-1e5fd8b963f4 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:39.551534 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d4dd181f-9e45-48e1-97f2-1e5fd8b963f4 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 200 len: 1299 microversion: 2.1 time: 0.375524 Oct 04 18:24:39.552139 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2608/5190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:39 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 1299 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:39.552622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:39.569132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.569902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.573273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:39.577791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.578285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.578743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:39.610771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17658c82-dcad-41f0-a7d4-188858e129db tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:39.611729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17658c82-dcad-41f0-a7d4-188858e129db tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:39.631347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17658c82-dcad-41f0-a7d4-188858e129db tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.632232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17658c82-dcad-41f0-a7d4-188858e129db tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.635274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17658c82-dcad-41f0-a7d4-188858e129db tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:39.636224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17658c82-dcad-41f0-a7d4-188858e129db tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.636927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17658c82-dcad-41f0-a7d4-188858e129db tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.639790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17658c82-dcad-41f0-a7d4-188858e129db tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:39.728380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:39.743518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:39.746027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:39.754665 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c63b85fe-b379-4428-bb65-451e4d4a850d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.230391 Oct 04 18:24:39.755319 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2583/5191] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:39 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:40.073193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17658c82-dcad-41f0-a7d4-188858e129db tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:40.082542 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17658c82-dcad-41f0-a7d4-188858e129db tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1371 microversion: 2.1 time: 0.477339 Oct 04 18:24:40.096050 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2609/5192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:39 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1371 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:40.581447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:40.582082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: ecabaaa8-5ecc-4d05-85e3-4a05096e80d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:40.597875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:40.606178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:40.606908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:40.607818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:40.608477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:40.613818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:40.696844 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] HTTP exception thrown: Instance ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 could not be found. Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Request method failure captured: Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 HTTP/1.1 Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHpI4kne1NoLZF7FDxbORJmQGAQFxtH221lUa3mfFtJmB0azqdx56UaEtUQ2taNZ71YUabDDoBg7XdV4Iu3zXBuZxMsabPPCp2V4v-rDA_RGu2dmWUJstZxdbRhs0yKOoGPHV56OpSjIusE_me7DeW8nAYiQckTZ6ZaeEL3SndrMfU4 Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 1253a9f61f654272b0acaeafc636d08c Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesActionsTest-567102486 Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1253a9f61f654272b0acaeafc636d08c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1253a9f61f654272b0acaeafc636d08c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1253a9f61f654272b0acaeafc636d08c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1253a9f61f654272b0acaeafc636d08c"}]}] Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesActionsTest-567102486 Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 1253a9f61f654272b0acaeafc636d08c Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesActionsTest-567102486 Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesActionsTest-567102486-project Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 59d57850f20044c4bb31536dd0bb4ff6 Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesActionsTest-567102486-project Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 could not be found. Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ecabaaa8-5ecc-4d05-85e3-4a05096e80d4'} Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 could not be found. Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 could not be found. Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:40.710534 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:40.716656 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:40.716656 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:40.716656 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:40.716656 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:40.716656 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:40.716656 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 could not be found. Oct 04 18:24:40.716656 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:24:40.720260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Returning 404 to user: Instance ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:40.724189 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a07c44c-3049-4457-a566-0a739e34c168 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4" status: 404 len: 111 microversion: 2.1 time: 0.153960 Oct 04 18:24:40.733045 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2584/5193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:40 2022] GET /compute/v2.1/servers/ecabaaa8-5ecc-4d05-85e3-4a05096e80d4 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:40.787496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:40.788828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:40.798812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:40.809943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:40.812292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:40.816657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:40.817387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:40.818990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:40.959158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-632105494", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "627bee18-3b4d-4ae1-bf07-0c3f7ca4ab04"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:41.037848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:41.055193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] validate_networks() for [('627bee18-3b4d-4ae1-bf07-0c3f7ca4ab04', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:24:41.068976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:41.074362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:41.076389 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-af78507d-1fbb-4dbc-bc01-ad7ae3f63d5d tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.293067 Oct 04 18:24:41.078515 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2610/5194] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:40 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:41.106665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a9140ed7-c955-4d3d-a974-33917f255b34 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:41.107313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a9140ed7-c955-4d3d-a974-33917f255b34 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:41.118916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9140ed7-c955-4d3d-a974-33917f255b34 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:41.120544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9140ed7-c955-4d3d-a974-33917f255b34 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:41.121015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9140ed7-c955-4d3d-a974-33917f255b34 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:41.124186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9140ed7-c955-4d3d-a974-33917f255b34 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:41.124769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9140ed7-c955-4d3d-a974-33917f255b34 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:41.125225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9140ed7-c955-4d3d-a974-33917f255b34 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:41.565360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a9140ed7-c955-4d3d-a974-33917f255b34 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:41.590097 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a9140ed7-c955-4d3d-a974-33917f255b34 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1371 microversion: 2.1 time: 0.488243 Oct 04 18:24:41.591625 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2611/5195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:41 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1371 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:42.032209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5a9bfec6-648a-4cae-9280-7e14fbcfad2b req-8454cc3c-2c11-440e-a745-d034117f7ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ac8a47-83c9-442a-a1a4-6e09347c397a", "tag": "21099c8b-7c1c-4c05-a556-37ef73f83087"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:42.058775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5a9bfec6-648a-4cae-9280-7e14fbcfad2b req-8454cc3c-2c11-440e-a745-d034117f7ba5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.060267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5a9bfec6-648a-4cae-9280-7e14fbcfad2b req-8454cc3c-2c11-440e-a745-d034117f7ba5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.064560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5a9bfec6-648a-4cae-9280-7e14fbcfad2b req-8454cc3c-2c11-440e-a745-d034117f7ba5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.086083 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5a9bfec6-648a-4cae-9280-7e14fbcfad2b req-8454cc3c-2c11-440e-a745-d034117f7ba5 service nova] Creating event network-changed:21099c8b-7c1c-4c05-a556-37ef73f83087 for instance 66ac8a47-83c9-442a-a1a4-6e09347c397a on n-h2-850499-14 Oct 04 18:24:42.113162 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5a9bfec6-648a-4cae-9280-7e14fbcfad2b req-8454cc3c-2c11-440e-a745-d034117f7ba5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083921 Oct 04 18:24:42.115387 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2612/5196] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:42.135695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.136788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:42.144985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.145999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.146632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.147935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.148570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.149171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.293572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:42.303574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:42.305369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:42.306774 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-553045c0-a3bf-4d9b-8ce0-9c4177360562 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.187188 Oct 04 18:24:42.307553 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2613/5197] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:42.345661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:42.346206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:42.347238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:42.347780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:42.348337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:42.366599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.379752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.380371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.381350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.381924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.382918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.442624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Getting quotas for project 1253a9f61f654272b0acaeafc636d08c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:42.460130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Getting quotas for user 59d57850f20044c4bb31536dd0bb4ff6 and project 1253a9f61f654272b0acaeafc636d08c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:42.503922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:24:42.506755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:42.582675 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a90d1ee-5737-4530-9926-a5142ef77c13 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631396 Oct 04 18:24:42.584080 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2585/5198] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:24:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:24:42.595743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf852df3-9c21-4a55-b464-07a3dfb59d2e tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.596386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf852df3-9c21-4a55-b464-07a3dfb59d2e tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:42.619207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eef5e41f-3764-43c6-b196-c5c5e9d1e609 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.619956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eef5e41f-3764-43c6-b196-c5c5e9d1e609 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:42.634224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef5e41f-3764-43c6-b196-c5c5e9d1e609 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.636666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef5e41f-3764-43c6-b196-c5c5e9d1e609 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.638143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef5e41f-3764-43c6-b196-c5c5e9d1e609 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.642681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef5e41f-3764-43c6-b196-c5c5e9d1e609 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.643410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef5e41f-3764-43c6-b196-c5c5e9d1e609 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.643956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef5e41f-3764-43c6-b196-c5c5e9d1e609 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.705701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cf852df3-9c21-4a55-b464-07a3dfb59d2e tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:42.713017 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf852df3-9c21-4a55-b464-07a3dfb59d2e tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1213 microversion: 2.1 time: 0.121106 Oct 04 18:24:42.713547 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2614/5199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:43.129811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eef5e41f-3764-43c6-b196-c5c5e9d1e609 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.163890 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eef5e41f-3764-43c6-b196-c5c5e9d1e609 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1371 microversion: 2.1 time: 0.549952 Oct 04 18:24:43.167062 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2586/5200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1371 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:43.335337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:43.336128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:43.358767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.359333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.359787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.362720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.365271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.365939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.466439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:43.517479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.533677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.536086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.537308 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f252a79b-ca85-4d27-8a1f-64cf5249830e tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.205884 Oct 04 18:24:43.537939 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2615/5201] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:43 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:43.750789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-467d4824-2cdf-4eb7-af25-34d2d2fd94c8 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:43.755760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-467d4824-2cdf-4eb7-af25-34d2d2fd94c8 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:43.764998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467d4824-2cdf-4eb7-af25-34d2d2fd94c8 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.765677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467d4824-2cdf-4eb7-af25-34d2d2fd94c8 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.766143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467d4824-2cdf-4eb7-af25-34d2d2fd94c8 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.766866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467d4824-2cdf-4eb7-af25-34d2d2fd94c8 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.767377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467d4824-2cdf-4eb7-af25-34d2d2fd94c8 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.767808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467d4824-2cdf-4eb7-af25-34d2d2fd94c8 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.839617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-467d4824-2cdf-4eb7-af25-34d2d2fd94c8 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.843604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:43.870435 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-467d4824-2cdf-4eb7-af25-34d2d2fd94c8 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1209 microversion: 2.1 time: 0.129485 Oct 04 18:24:43.888363 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2587/5202] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:43 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1209 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:44.193056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e33cb699-669b-4722-a980-d8031f7ab890 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:44.193711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e33cb699-669b-4722-a980-d8031f7ab890 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:44.208364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33cb699-669b-4722-a980-d8031f7ab890 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.209055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33cb699-669b-4722-a980-d8031f7ab890 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.210420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33cb699-669b-4722-a980-d8031f7ab890 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.211241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33cb699-669b-4722-a980-d8031f7ab890 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.215702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33cb699-669b-4722-a980-d8031f7ab890 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.216203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e33cb699-669b-4722-a980-d8031f7ab890 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.422988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e33cb699-669b-4722-a980-d8031f7ab890 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:44.433112 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e33cb699-669b-4722-a980-d8031f7ab890 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1371 microversion: 2.1 time: 0.247386 Oct 04 18:24:44.433702 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2616/5203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:44 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:44.569291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:44.570053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:44.586997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.587724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.588717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.590476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.591938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.592516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.780637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:44.802092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:44.811799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:44.813758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ef8a48f-283b-43fd-b4e3-9ecf901679fb tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.250238 Oct 04 18:24:44.817888 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2588/5204] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:44 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:44.896060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eaae61b1-bf98-44ab-8b16-cae3cb8e38c7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:44.896876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eaae61b1-bf98-44ab-8b16-cae3cb8e38c7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:44.903208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaae61b1-bf98-44ab-8b16-cae3cb8e38c7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.903910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaae61b1-bf98-44ab-8b16-cae3cb8e38c7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.904701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaae61b1-bf98-44ab-8b16-cae3cb8e38c7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.906116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaae61b1-bf98-44ab-8b16-cae3cb8e38c7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.906822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaae61b1-bf98-44ab-8b16-cae3cb8e38c7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.907806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaae61b1-bf98-44ab-8b16-cae3cb8e38c7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.029355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eaae61b1-bf98-44ab-8b16-cae3cb8e38c7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:45.041424 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eaae61b1-bf98-44ab-8b16-cae3cb8e38c7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1271 microversion: 2.1 time: 0.149158 Oct 04 18:24:45.043222 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2617/5205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:44 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:45.459268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3563c1c3-d7d2-4355-b8cd-4a4129c2f906 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:45.460201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3563c1c3-d7d2-4355-b8cd-4a4129c2f906 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:45.467856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3563c1c3-d7d2-4355-b8cd-4a4129c2f906 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.468365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3563c1c3-d7d2-4355-b8cd-4a4129c2f906 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.468815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3563c1c3-d7d2-4355-b8cd-4a4129c2f906 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.469531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3563c1c3-d7d2-4355-b8cd-4a4129c2f906 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.473136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3563c1c3-d7d2-4355-b8cd-4a4129c2f906 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.479287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3563c1c3-d7d2-4355-b8cd-4a4129c2f906 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.805609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3563c1c3-d7d2-4355-b8cd-4a4129c2f906 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:45.830534 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3563c1c3-d7d2-4355-b8cd-4a4129c2f906 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1371 microversion: 2.1 time: 0.361882 Oct 04 18:24:45.830534 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2589/5206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:45 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:45.849136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:45.849757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:45.855524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:45.868755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.869428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.869925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.870634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.871364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.873415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-157611711", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": "none"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:45.879673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.980331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:45.980769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:45.981256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:45.981672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:45.982093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:45.992214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.992712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.993159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.993902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.994367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.994800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:46.021890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Getting quotas for project fa0a3c97e95e41b0bdd48ab659863bf9. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:46.030378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Getting quotas for user 61aac75b993e49a3adf23515cb05fa76 and project fa0a3c97e95e41b0bdd48ab659863bf9. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:46.043235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.049945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:24:46.052715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:46.057825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.063058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.064312 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6caf189e-7572-4849-a794-44080041aa94 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.220607 Oct 04 18:24:46.064880 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2590/5207] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:45 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:46.081341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c3cfe2c-4579-4fe5-976d-a95927d3004a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:46.081984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c3cfe2c-4579-4fe5-976d-a95927d3004a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:46.099088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c3cfe2c-4579-4fe5-976d-a95927d3004a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:46.099603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c3cfe2c-4579-4fe5-976d-a95927d3004a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:46.100049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c3cfe2c-4579-4fe5-976d-a95927d3004a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:46.100772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c3cfe2c-4579-4fe5-976d-a95927d3004a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:46.101230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c3cfe2c-4579-4fe5-976d-a95927d3004a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:46.101667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c3cfe2c-4579-4fe5-976d-a95927d3004a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:46.137507 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-225cba1c-9669-4c30-ba1b-17af8bbb62b4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.564380 Oct 04 18:24:46.138929 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2618/5208] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:24:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:24:46.150671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f336d4d5-c109-43bc-8696-a6543a1d149a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:46.151709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f336d4d5-c109-43bc-8696-a6543a1d149a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:46.350216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f336d4d5-c109-43bc-8696-a6543a1d149a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.386177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f336d4d5-c109-43bc-8696-a6543a1d149a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.388408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f336d4d5-c109-43bc-8696-a6543a1d149a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.389989 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f336d4d5-c109-43bc-8696-a6543a1d149a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1277 microversion: 2.54 time: 0.243331 Oct 04 18:24:46.393588 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2619/5209] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:46 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:46.398762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d915d06e-5af2-40d1-b9c3-42553170f4f8 req-fa6ef931-ffd1-4d14-92b9-88ff76b1cbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1681ab-db4a-4528-99da-649ffa9a93a0", "name": "network-vif-plugged", "status": "completed", "tag": "2d48ba84-42ef-46d1-b6ba-69e426d07f1c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:46.431147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d915d06e-5af2-40d1-b9c3-42553170f4f8 req-fa6ef931-ffd1-4d14-92b9-88ff76b1cbf6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:46.434131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d915d06e-5af2-40d1-b9c3-42553170f4f8 req-fa6ef931-ffd1-4d14-92b9-88ff76b1cbf6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:46.434856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d915d06e-5af2-40d1-b9c3-42553170f4f8 req-fa6ef931-ffd1-4d14-92b9-88ff76b1cbf6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:46.476050 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d915d06e-5af2-40d1-b9c3-42553170f4f8 req-fa6ef931-ffd1-4d14-92b9-88ff76b1cbf6 service nova] Creating event network-vif-plugged:2d48ba84-42ef-46d1-b6ba-69e426d07f1c for instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 on n-h2-850499-14 Oct 04 18:24:46.495252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d915d06e-5af2-40d1-b9c3-42553170f4f8 req-fa6ef931-ffd1-4d14-92b9-88ff76b1cbf6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100379 Oct 04 18:24:46.500374 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2620/5210] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:46.520098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c3cfe2c-4579-4fe5-976d-a95927d3004a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.530493 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c3cfe2c-4579-4fe5-976d-a95927d3004a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1313 microversion: 2.1 time: 0.453802 Oct 04 18:24:46.537427 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2591/5211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:46 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:46.857687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5a483a73-377e-40a0-bd0a-979bacbe8409 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:46.859985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5a483a73-377e-40a0-bd0a-979bacbe8409 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:46.874595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a483a73-377e-40a0-bd0a-979bacbe8409 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:46.876000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a483a73-377e-40a0-bd0a-979bacbe8409 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:46.876661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a483a73-377e-40a0-bd0a-979bacbe8409 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:46.879677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a483a73-377e-40a0-bd0a-979bacbe8409 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:46.881109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a483a73-377e-40a0-bd0a-979bacbe8409 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:46.881952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a483a73-377e-40a0-bd0a-979bacbe8409 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.093224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:47.094450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:47.104881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.108837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.109896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.111040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.111721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.112262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.323149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.349682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.353214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.355224 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5b614585-5ef2-46d3-91c0-74347c45c295 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.266633 Oct 04 18:24:47.371643 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2592/5212] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:47 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:47.422068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:47.422923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:47.434305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.435716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.436985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.438077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.441539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.442314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.512659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5a483a73-377e-40a0-bd0a-979bacbe8409 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.521365 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5a483a73-377e-40a0-bd0a-979bacbe8409 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1371 microversion: 2.1 time: 0.671262 Oct 04 18:24:47.528019 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2621/5213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:46 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1371 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:47.564509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-88e7d9fe-2021-4987-9805-da8cf18ca9b7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:47.565137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-88e7d9fe-2021-4987-9805-da8cf18ca9b7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:47.577524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88e7d9fe-2021-4987-9805-da8cf18ca9b7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.579656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88e7d9fe-2021-4987-9805-da8cf18ca9b7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.580247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88e7d9fe-2021-4987-9805-da8cf18ca9b7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.583247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88e7d9fe-2021-4987-9805-da8cf18ca9b7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.583738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88e7d9fe-2021-4987-9805-da8cf18ca9b7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.583877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.584180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88e7d9fe-2021-4987-9805-da8cf18ca9b7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.598063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.602800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.604332 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-34f20ed7-49e3-472e-bf65-9bde682253d4 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1329 microversion: 2.54 time: 0.187181 Oct 04 18:24:47.611014 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2593/5214] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:47 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1329 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:47.841745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d6730a94-e066-4cd5-b02e-d454f74d4315 req-c0fa845f-200e-4f8a-b912-cb66e843a784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61017eb-8d52-42ee-8769-b33e4a81803f", "tag": "dc24a34d-7c73-45a5-b69a-e794cde576e9"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:47.842716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-88e7d9fe-2021-4987-9805-da8cf18ca9b7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:47.856294 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-88e7d9fe-2021-4987-9805-da8cf18ca9b7 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1313 microversion: 2.1 time: 0.297245 Oct 04 18:24:47.861420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d6730a94-e066-4cd5-b02e-d454f74d4315 req-c0fa845f-200e-4f8a-b912-cb66e843a784 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.863516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d6730a94-e066-4cd5-b02e-d454f74d4315 req-c0fa845f-200e-4f8a-b912-cb66e843a784 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.864111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d6730a94-e066-4cd5-b02e-d454f74d4315 req-c0fa845f-200e-4f8a-b912-cb66e843a784 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.867343 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2622/5215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:47 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:47.888750 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d6730a94-e066-4cd5-b02e-d454f74d4315 req-c0fa845f-200e-4f8a-b912-cb66e843a784 service nova] Creating event network-changed:dc24a34d-7c73-45a5-b69a-e794cde576e9 for instance a61017eb-8d52-42ee-8769-b33e4a81803f on n-h1-850499-14 Oct 04 18:24:47.898540 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d6730a94-e066-4cd5-b02e-d454f74d4315 req-c0fa845f-200e-4f8a-b912-cb66e843a784 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060631 Oct 04 18:24:47.901447 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2594/5216] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:48.383894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:48.384577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:48.401856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.402357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.403011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.403924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.404549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.405213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.522661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:48.532250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:48.533706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:48.534901 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-43092a46-7314-4026-986f-956d5f57e24a tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.154889 Oct 04 18:24:48.540752 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2623/5217] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:48 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:48.559425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-92ced19b-d360-4a4a-a538-dc3946146e6d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:48.560928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-92ced19b-d360-4a4a-a538-dc3946146e6d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:48.570831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92ced19b-d360-4a4a-a538-dc3946146e6d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.573128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92ced19b-d360-4a4a-a538-dc3946146e6d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.573959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92ced19b-d360-4a4a-a538-dc3946146e6d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.574878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92ced19b-d360-4a4a-a538-dc3946146e6d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.575533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92ced19b-d360-4a4a-a538-dc3946146e6d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.576756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92ced19b-d360-4a4a-a538-dc3946146e6d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.638091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:48.639652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:48.652392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.653686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.654460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.657450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.658069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.661202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.804722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:48.819071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:48.820643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:48.824251 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-61f0662b-3810-446f-af60-619c170dff07 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1335 microversion: 2.54 time: 0.190331 Oct 04 18:24:48.850219 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2624/5218] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:48 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1335 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:48.875297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-92ced19b-d360-4a4a-a538-dc3946146e6d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:48.883455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ea233dc1-6ef0-443e-b2f6-c2b1c83162ef tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:48.884019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ea233dc1-6ef0-443e-b2f6-c2b1c83162ef tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:48.892779 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-92ced19b-d360-4a4a-a538-dc3946146e6d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1371 microversion: 2.1 time: 0.337828 Oct 04 18:24:48.894513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea233dc1-6ef0-443e-b2f6-c2b1c83162ef tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.895056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea233dc1-6ef0-443e-b2f6-c2b1c83162ef tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.895506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea233dc1-6ef0-443e-b2f6-c2b1c83162ef tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.896233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea233dc1-6ef0-443e-b2f6-c2b1c83162ef tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.896691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea233dc1-6ef0-443e-b2f6-c2b1c83162ef tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.897907 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2595/5219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:48 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1371 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:48.902164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea233dc1-6ef0-443e-b2f6-c2b1c83162ef tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.234870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ea233dc1-6ef0-443e-b2f6-c2b1c83162ef tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.243761 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ea233dc1-6ef0-443e-b2f6-c2b1c83162ef tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1313 microversion: 2.1 time: 0.364509 Oct 04 18:24:49.244354 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2625/5220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:48 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:49.565503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:49.566821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:49.574924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.576417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.577102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.577992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.578607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.579233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.712455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.735565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.740279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.743513 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c71c645-a3cf-4a20-9a1c-21bacb8e182b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.181650 Oct 04 18:24:49.759480 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2596/5221] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:49 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:49.858219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:49.859877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:49.868046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.868692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.869369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.870363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.871429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.872211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.924676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a96d6ff1-473a-4792-9ed1-03fafe202658 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:49.925935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a96d6ff1-473a-4792-9ed1-03fafe202658 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:49.933755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a96d6ff1-473a-4792-9ed1-03fafe202658 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.934697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a96d6ff1-473a-4792-9ed1-03fafe202658 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.935741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a96d6ff1-473a-4792-9ed1-03fafe202658 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.937078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a96d6ff1-473a-4792-9ed1-03fafe202658 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.937804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a96d6ff1-473a-4792-9ed1-03fafe202658 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.938486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a96d6ff1-473a-4792-9ed1-03fafe202658 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.967424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.977404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.984621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.985961 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5b8de349-eb5b-4129-9623-4f4d2d9f0ad9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1335 microversion: 2.54 time: 0.132471 Oct 04 18:24:49.989112 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2626/5222] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:49 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1335 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:50.105196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a96d6ff1-473a-4792-9ed1-03fafe202658 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:50.114782 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a96d6ff1-473a-4792-9ed1-03fafe202658 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1371 microversion: 2.1 time: 0.194986 Oct 04 18:24:50.115705 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2597/5223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:49 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:50.275304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a468e194-0899-4dba-8a67-e4566c70bc3d tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:50.276278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a468e194-0899-4dba-8a67-e4566c70bc3d tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:50.285898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a468e194-0899-4dba-8a67-e4566c70bc3d tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:50.286813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a468e194-0899-4dba-8a67-e4566c70bc3d tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:50.287618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a468e194-0899-4dba-8a67-e4566c70bc3d tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:50.290639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a468e194-0899-4dba-8a67-e4566c70bc3d tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:50.291324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a468e194-0899-4dba-8a67-e4566c70bc3d tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:50.291923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a468e194-0899-4dba-8a67-e4566c70bc3d tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:50.473056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a468e194-0899-4dba-8a67-e4566c70bc3d tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:50.484342 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a468e194-0899-4dba-8a67-e4566c70bc3d tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1313 microversion: 2.1 time: 0.212651 Oct 04 18:24:50.486256 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2627/5224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:50 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:50.778439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:50.783770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:50.801423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:50.804181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:50.809519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:50.810677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:50.812054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:50.812735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:50.957794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:50.969197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:50.970672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:50.971913 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee87f1d8-b611-4875-b3f0-df783e4785a5 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.203488 Oct 04 18:24:50.977737 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2598/5225] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:50 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:51.017651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:51.018583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:51.034678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.037571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.038710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.040916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.042265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.043809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.115756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5580ab1d-21ac-45a6-b99f-36ffe571c117 req-bfe9db61-7d27-4a6f-9efe-c2dc54ee2e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ac8a47-83c9-442a-a1a4-6e09347c397a", "name": "network-vif-plugged", "status": "completed", "tag": "21099c8b-7c1c-4c05-a556-37ef73f83087"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:51.131758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5580ab1d-21ac-45a6-b99f-36ffe571c117 req-bfe9db61-7d27-4a6f-9efe-c2dc54ee2e29 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.135191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5580ab1d-21ac-45a6-b99f-36ffe571c117 req-bfe9db61-7d27-4a6f-9efe-c2dc54ee2e29 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.138159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5580ab1d-21ac-45a6-b99f-36ffe571c117 req-bfe9db61-7d27-4a6f-9efe-c2dc54ee2e29 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.159881 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5580ab1d-21ac-45a6-b99f-36ffe571c117 req-bfe9db61-7d27-4a6f-9efe-c2dc54ee2e29 service nova] Creating event network-vif-plugged:21099c8b-7c1c-4c05-a556-37ef73f83087 for instance 66ac8a47-83c9-442a-a1a4-6e09347c397a on n-h2-850499-14 Oct 04 18:24:51.166302 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5580ab1d-21ac-45a6-b99f-36ffe571c117 req-bfe9db61-7d27-4a6f-9efe-c2dc54ee2e29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054040 Oct 04 18:24:51.167123 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2599/5226] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:51.177548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bd4def39-f174-47e5-b083-d45cecdd0231 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:51.178451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bd4def39-f174-47e5-b083-d45cecdd0231 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:51.187415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd4def39-f174-47e5-b083-d45cecdd0231 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.188162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd4def39-f174-47e5-b083-d45cecdd0231 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.190286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd4def39-f174-47e5-b083-d45cecdd0231 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.191278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd4def39-f174-47e5-b083-d45cecdd0231 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.192806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd4def39-f174-47e5-b083-d45cecdd0231 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.193688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd4def39-f174-47e5-b083-d45cecdd0231 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.209526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:51.230117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:51.235072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:51.236844 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9426816-5782-48cf-b2a0-4e385c8efc86 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1335 microversion: 2.54 time: 0.225454 Oct 04 18:24:51.238699 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2628/5227] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:51 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1335 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:51.510563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-56ac9d73-7917-4f00-a4b0-26dc6cfbef63 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:51.512329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-56ac9d73-7917-4f00-a4b0-26dc6cfbef63 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:51.529876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac9d73-7917-4f00-a4b0-26dc6cfbef63 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.532596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac9d73-7917-4f00-a4b0-26dc6cfbef63 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.533402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac9d73-7917-4f00-a4b0-26dc6cfbef63 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.536524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac9d73-7917-4f00-a4b0-26dc6cfbef63 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.537703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac9d73-7917-4f00-a4b0-26dc6cfbef63 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.539324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac9d73-7917-4f00-a4b0-26dc6cfbef63 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.592442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:51.778332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bd4def39-f174-47e5-b083-d45cecdd0231 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:51.791611 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bd4def39-f174-47e5-b083-d45cecdd0231 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1371 microversion: 2.1 time: 0.622371 Oct 04 18:24:51.795613 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2600/5228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:51 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1371 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:51.994123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-56ac9d73-7917-4f00-a4b0-26dc6cfbef63 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.002200 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-56ac9d73-7917-4f00-a4b0-26dc6cfbef63 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1313 microversion: 2.1 time: 0.498327 Oct 04 18:24:52.017492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:52.017492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:52.017963 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2629/5229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:51 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:52.023212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.024279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.024733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.025595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.026067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.026502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.173475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.191545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.193270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.203792 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f3bafb31-fd36-4291-94e9-73d462065b97 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.196282 Oct 04 18:24:52.223909 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2601/5230] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:51 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:52.264453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:52.265079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:52.282629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.283420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.284047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.284938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.287192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.287831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.491138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.505866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.510247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.513145 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c82a7eec-fadb-460d-97ad-6e161f9e38a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1356 microversion: 2.54 time: 0.253058 Oct 04 18:24:52.549442 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2630/5231] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:52 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1356 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:52.556663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-75cb9146-8d98-484d-ad23-14ac1d0ecdba tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Action: 'create', calling method: .version_select at 0x7fd4d1a78790>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1088582581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiXz2f8y2AqsSQTcGhxB74sCzozuZ629eXhiw0OfZpR5HbU21om8e9pEfXFoMZZxqjnpdZS9OxN/MaasiHuKKuhDghWVXZya2CneHPnuRGxVXyl5CwkGZkRQSw3vZXt9w=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:52.585379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:52.586147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:52.617978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-75cb9146-8d98-484d-ad23-14ac1d0ecdba tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Getting quotas for project fa0a3c97e95e41b0bdd48ab659863bf9. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:52.632424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-75cb9146-8d98-484d-ad23-14ac1d0ecdba tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Getting quotas for user 61aac75b993e49a3adf23515cb05fa76 and project fa0a3c97e95e41b0bdd48ab659863bf9. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:52.711474 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-75cb9146-8d98-484d-ad23-14ac1d0ecdba tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.157280 Oct 04 18:24:52.725342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1088582581", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:52.728404 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2602/5232] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 4 18:24:52 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:24:52.728920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:52.752504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:52.754901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.757059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.761147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.764369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.765071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.769192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.831910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9e2f8e0b-c2a6-4610-a391-78f0423b9808 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:52.836158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9e2f8e0b-c2a6-4610-a391-78f0423b9808 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:52.849954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2f8e0b-c2a6-4610-a391-78f0423b9808 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.854322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2f8e0b-c2a6-4610-a391-78f0423b9808 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.855752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2f8e0b-c2a6-4610-a391-78f0423b9808 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.864362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2f8e0b-c2a6-4610-a391-78f0423b9808 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.864889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2f8e0b-c2a6-4610-a391-78f0423b9808 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.865356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2f8e0b-c2a6-4610-a391-78f0423b9808 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.143340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9e2f8e0b-c2a6-4610-a391-78f0423b9808 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:53.154308 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9e2f8e0b-c2a6-4610-a391-78f0423b9808 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1371 microversion: 2.1 time: 0.330515 Oct 04 18:24:53.158102 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2603/5233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:52 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:53.164991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c7db9fef-a095-4a54-a7e1-23e6382bd419 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:53.174888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c7db9fef-a095-4a54-a7e1-23e6382bd419 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:53.187655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7db9fef-a095-4a54-a7e1-23e6382bd419 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.188410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7db9fef-a095-4a54-a7e1-23e6382bd419 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.189046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7db9fef-a095-4a54-a7e1-23e6382bd419 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.190144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7db9fef-a095-4a54-a7e1-23e6382bd419 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.192055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7db9fef-a095-4a54-a7e1-23e6382bd419 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.192967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7db9fef-a095-4a54-a7e1-23e6382bd419 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.316621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:53.330570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:53.331554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:53.337680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:53.340104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:53.499466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7db9fef-a095-4a54-a7e1-23e6382bd419 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:53.510168 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c7db9fef-a095-4a54-a7e1-23e6382bd419 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1313 microversion: 2.1 time: 0.349673 Oct 04 18:24:53.510792 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2604/5234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:53 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:53.527755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:53.529273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:53.568615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.569139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.569598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.571741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.572322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.586863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.614654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:53.625011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.636518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.638382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.640123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.644146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.644889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.750098 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6e5f1266-3729-4143-94c2-8f526829e3af tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "POST /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8/action" status: 202 len: 1139 microversion: 2.54 time: 1.029791 Oct 04 18:24:53.750762 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2631/5235] 10.222.0.18 () {62 vars in 1320 bytes} [Tue Oct 4 18:24:52 2022] POST /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8/action => generated 1139 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:24:53.773866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:53.775161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:53.786784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.791076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.791727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.792658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.793294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.793906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.829024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:53.847863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:53.853603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:53.860739 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3206e3b5-c03b-47c9-8a15-3a800043bbc7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.341092 Oct 04 18:24:53.862649 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2605/5236] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:53 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:53.972707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:53.984332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:53.986250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:53.987829 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-949e7a48-0945-4aac-bd61-e08a09573b70 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.219608 Oct 04 18:24:53.988963 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2632/5237] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:53 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:54.189215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-868bf513-0bc4-42f1-8fbe-6a67a81c5d9f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:54.194539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-868bf513-0bc4-42f1-8fbe-6a67a81c5d9f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:54.213632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-868bf513-0bc4-42f1-8fbe-6a67a81c5d9f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.214632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-868bf513-0bc4-42f1-8fbe-6a67a81c5d9f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.215612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-868bf513-0bc4-42f1-8fbe-6a67a81c5d9f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.217461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-868bf513-0bc4-42f1-8fbe-6a67a81c5d9f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.218636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-868bf513-0bc4-42f1-8fbe-6a67a81c5d9f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.219809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-868bf513-0bc4-42f1-8fbe-6a67a81c5d9f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.463130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-868bf513-0bc4-42f1-8fbe-6a67a81c5d9f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:54.467482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:54.486003 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-868bf513-0bc4-42f1-8fbe-6a67a81c5d9f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1564 microversion: 2.1 time: 0.303212 Oct 04 18:24:54.506649 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2606/5238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:54 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1564 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:54.516021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c158e10c-fc37-4708-b77c-25744e099d7b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:54.516613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c158e10c-fc37-4708-b77c-25744e099d7b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:54.530525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c158e10c-fc37-4708-b77c-25744e099d7b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.531156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c158e10c-fc37-4708-b77c-25744e099d7b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.535564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c158e10c-fc37-4708-b77c-25744e099d7b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.536747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c158e10c-fc37-4708-b77c-25744e099d7b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.537314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c158e10c-fc37-4708-b77c-25744e099d7b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.537836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c158e10c-fc37-4708-b77c-25744e099d7b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.542298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b50ea4b0-f716-4117-9338-53053374788f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:54.543410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b50ea4b0-f716-4117-9338-53053374788f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:54.554453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b50ea4b0-f716-4117-9338-53053374788f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.556927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b50ea4b0-f716-4117-9338-53053374788f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.560927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b50ea4b0-f716-4117-9338-53053374788f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.562840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b50ea4b0-f716-4117-9338-53053374788f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.567330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b50ea4b0-f716-4117-9338-53053374788f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.568020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b50ea4b0-f716-4117-9338-53053374788f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.816503 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c158e10c-fc37-4708-b77c-25744e099d7b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.305252 Oct 04 18:24:54.817100 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2633/5239] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:24:54 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-interface => generated 284 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:54.821641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-090b8329-4293-419d-918c-21fdab083f47 req-4a0ac243-5322-4484-a3a6-f073d5bbb4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61017eb-8d52-42ee-8769-b33e4a81803f", "name": "network-vif-plugged", "status": "completed", "tag": "dc24a34d-7c73-45a5-b69a-e794cde576e9"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:54.875443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-090b8329-4293-419d-918c-21fdab083f47 req-4a0ac243-5322-4484-a3a6-f073d5bbb4f2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.876213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-090b8329-4293-419d-918c-21fdab083f47 req-4a0ac243-5322-4484-a3a6-f073d5bbb4f2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.876893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-090b8329-4293-419d-918c-21fdab083f47 req-4a0ac243-5322-4484-a3a6-f073d5bbb4f2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.921461 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-090b8329-4293-419d-918c-21fdab083f47 req-4a0ac243-5322-4484-a3a6-f073d5bbb4f2 service nova] Creating event network-vif-plugged:dc24a34d-7c73-45a5-b69a-e794cde576e9 for instance a61017eb-8d52-42ee-8769-b33e4a81803f on n-h1-850499-14 Oct 04 18:24:54.945086 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-090b8329-4293-419d-918c-21fdab083f47 req-4a0ac243-5322-4484-a3a6-f073d5bbb4f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125016 Oct 04 18:24:54.947748 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2634/5240] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:54.970165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:54.972130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:54.989996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.993753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.994426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.995432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.996947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.999528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.154326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b50ea4b0-f716-4117-9338-53053374788f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:55.168758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b50ea4b0-f716-4117-9338-53053374788f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1313 microversion: 2.1 time: 0.630271 Oct 04 18:24:55.184214 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2607/5241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:54 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:55.202217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:55.203901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:55.211556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.212308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.213488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.214608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.215335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.215934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.243892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:55.261277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:55.268319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:55.274515 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd9d6c68-072f-4e21-9b59-7e9738e77e8b tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.323446 Oct 04 18:24:55.278025 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2635/5242] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:54 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:55.413727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:55.432238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:55.435194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:55.437421 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ce1d7bae-0e63-491e-b236-326b6476be72 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.251788 Oct 04 18:24:55.438325 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2608/5243] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:55 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:56.199786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd558ec7-59b9-4cff-ac47-9761e1363fb1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:56.200327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cd558ec7-59b9-4cff-ac47-9761e1363fb1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:56.214861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:56.227065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd558ec7-59b9-4cff-ac47-9761e1363fb1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.227613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd558ec7-59b9-4cff-ac47-9761e1363fb1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.228068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd558ec7-59b9-4cff-ac47-9761e1363fb1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:56.228793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd558ec7-59b9-4cff-ac47-9761e1363fb1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.229264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd558ec7-59b9-4cff-ac47-9761e1363fb1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.229693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd558ec7-59b9-4cff-ac47-9761e1363fb1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:56.302281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:56.302798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:56.335016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.338826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.339635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:56.340802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.344012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.344640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:56.359237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=18 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:56.569298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:56.632397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:56.641881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:56.644004 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f6c5946-9626-4fe4-94b7-2bb1b2e10cde tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.346071 Oct 04 18:24:56.654922 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2609/5244] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:56 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:56.687540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:56.692198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:56.727435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd558ec7-59b9-4cff-ac47-9761e1363fb1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:56.732274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.736528 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd558ec7-59b9-4cff-ac47-9761e1363fb1 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1313 microversion: 2.1 time: 0.543359 Oct 04 18:24:56.741535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.742077 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2636/5245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:56 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:56.744369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:56.754059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.757455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.764640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.058249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:57.074675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:57.076565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:57.082836 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70b7be2a-c84e-4a0f-81c9-1f33fdc8003a tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.423867 Oct 04 18:24:57.087104 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2610/5246] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:56 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:57.196838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4232a51b-5369-484c-908b-9702d03dea1b req-101ec66c-e319-414d-9746-8168aeeaa42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ac8a47-83c9-442a-a1a4-6e09347c397a", "tag": "21099c8b-7c1c-4c05-a556-37ef73f83087"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:57.223043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4232a51b-5369-484c-908b-9702d03dea1b req-101ec66c-e319-414d-9746-8168aeeaa42c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:57.225093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4232a51b-5369-484c-908b-9702d03dea1b req-101ec66c-e319-414d-9746-8168aeeaa42c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:57.228587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4232a51b-5369-484c-908b-9702d03dea1b req-101ec66c-e319-414d-9746-8168aeeaa42c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.251942 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4232a51b-5369-484c-908b-9702d03dea1b req-101ec66c-e319-414d-9746-8168aeeaa42c service nova] Creating event network-changed:21099c8b-7c1c-4c05-a556-37ef73f83087 for instance 66ac8a47-83c9-442a-a1a4-6e09347c397a on n-h2-850499-14 Oct 04 18:24:57.264858 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4232a51b-5369-484c-908b-9702d03dea1b req-101ec66c-e319-414d-9746-8168aeeaa42c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071004 Oct 04 18:24:57.271064 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2637/5247] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:57.683550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:57.686627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:57.702177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:57.704236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:57.705064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.706782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:57.708008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:57.711605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.762631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a195510-1b31-4242-b487-837e685e6b77 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:57.763973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a195510-1b31-4242-b487-837e685e6b77 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:57.781213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a195510-1b31-4242-b487-837e685e6b77 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:57.781719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a195510-1b31-4242-b487-837e685e6b77 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:57.784574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a195510-1b31-4242-b487-837e685e6b77 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.785315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a195510-1b31-4242-b487-837e685e6b77 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:57.789046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a195510-1b31-4242-b487-837e685e6b77 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:57.789539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a195510-1b31-4242-b487-837e685e6b77 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.944083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:57.970541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:57.974570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:57.988529 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5128ce84-ce59-4251-87b9-81ee0eecb4c3 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.309204 Oct 04 18:24:58.002986 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2611/5248] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:57 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:58.113159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:58.113777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:58.121714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:58.122210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:58.131959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:58.132733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:58.133214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:58.133753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:58.326410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a195510-1b31-4242-b487-837e685e6b77 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:58.335904 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a195510-1b31-4242-b487-837e685e6b77 tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1497 microversion: 2.1 time: 0.577701 Oct 04 18:24:58.367559 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2638/5249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:57 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1497 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:58.851863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:58.868792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:58.874622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:58.878430 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8dee2ce8-2f01-4ea5-85ab-dc3748f392e8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.768010 Oct 04 18:24:58.893518 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2612/5250] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:58 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:59.019207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:59.020090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:59.031187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.034611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.037295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.041300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.044545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.045952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.238605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:59.260750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:59.264958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:59.266701 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-47685190-5bda-4002-9f7e-7ad55cdca03f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.251383 Oct 04 18:24:59.269601 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2639/5251] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:59 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:59.324326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d2901a5-4841-4f8b-b1de-653e4904464f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:59.325113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d2901a5-4841-4f8b-b1de-653e4904464f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:59.335286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2901a5-4841-4f8b-b1de-653e4904464f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.339122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2901a5-4841-4f8b-b1de-653e4904464f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.339884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2901a5-4841-4f8b-b1de-653e4904464f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.340802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2901a5-4841-4f8b-b1de-653e4904464f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.343669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2901a5-4841-4f8b-b1de-653e4904464f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.344307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d2901a5-4841-4f8b-b1de-653e4904464f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.418577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d2901a5-4841-4f8b-b1de-653e4904464f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:59.588510 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d2901a5-4841-4f8b-b1de-653e4904464f tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 204 len: 0 microversion: 2.1 time: 0.268342 Oct 04 18:24:59.590367 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2613/5252] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:59 2022] DELETE /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:24:59.602085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dcaea460-7836-4627-a9b5-94161454052c tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:59.602724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dcaea460-7836-4627-a9b5-94161454052c tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:59.624209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcaea460-7836-4627-a9b5-94161454052c tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.627805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcaea460-7836-4627-a9b5-94161454052c tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.630554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcaea460-7836-4627-a9b5-94161454052c tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.631664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcaea460-7836-4627-a9b5-94161454052c tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.634110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcaea460-7836-4627-a9b5-94161454052c tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.635458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dcaea460-7836-4627-a9b5-94161454052c tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.909469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:59.910182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:59.926168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.927140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.938805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.939856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.940537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.941143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:00.761303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:00.777553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:00.788940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:00.791505 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-66d03c15-58ff-41cd-8ce1-bae4bf9365a6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.887019 Oct 04 18:25:00.795614 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2614/5253] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:59 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:00.805614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:00.806242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:00.832659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:00.833450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:00.833893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:00.834603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:00.835103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:00.835557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:01.072657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dcaea460-7836-4627-a9b5-94161454052c tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:01.096257 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dcaea460-7836-4627-a9b5-94161454052c tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1503 microversion: 2.1 time: 1.500601 Oct 04 18:25:01.096865 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2640/5254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:59 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1503 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:01.146917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:01.165763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:01.167896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:01.169401 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-66062994-7b73-4285-b376-1080fa76bfe7 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.372508 Oct 04 18:25:01.171062 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2615/5255] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:00 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:01.828058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:01.838123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:01.858962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:01.866210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:01.866680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:01.869494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:01.869494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:01.869494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.125845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4eb1c7ec-3c4e-42b8-8f06-007233b14feb tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:02.125845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4eb1c7ec-3c4e-42b8-8f06-007233b14feb tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:02.148043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:02.154888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4eb1c7ec-3c4e-42b8-8f06-007233b14feb tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.168179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:02.169814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:02.181454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4eb1c7ec-3c4e-42b8-8f06-007233b14feb tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.184157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4eb1c7ec-3c4e-42b8-8f06-007233b14feb tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.184821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4eb1c7ec-3c4e-42b8-8f06-007233b14feb tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.185853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4eb1c7ec-3c4e-42b8-8f06-007233b14feb tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.186715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4eb1c7ec-3c4e-42b8-8f06-007233b14feb tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.200162 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b437f455-5204-4ac5-949a-71b7c0b3a945 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.350158 Oct 04 18:25:02.207369 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2641/5256] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:01 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:02.228545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:02.229414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:02.242410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.248732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.249410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.250341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.251002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.251632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.494746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:02.507055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:02.516830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:02.520681 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e8824c0b-0d75-4c02-9bb5-37a2e0c964da tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1603 microversion: 2.42 time: 0.311976 Oct 04 18:25:02.521506 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2642/5257] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:02 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1603 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:02.668971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:03.078476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4eb1c7ec-3c4e-42b8-8f06-007233b14feb tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d57850f20044c4bb31536dd0bb4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1253a9f61f654272b0acaeafc636d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:03.087353 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4eb1c7ec-3c4e-42b8-8f06-007233b14feb tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 200 len: 1503 microversion: 2.1 time: 0.966823 Oct 04 18:25:03.095754 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2616/5258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:02 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 1503 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:03.151451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3f4cb6c8-3e1b-4874-8c36-6b0ba2148de1 req-18d38a16-07ab-465d-9f23-f7070b0a6e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61017eb-8d52-42ee-8769-b33e4a81803f", "name": "network-vif-deleted", "tag": "dc24a34d-7c73-45a5-b69a-e794cde576e9"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:03.194241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3f4cb6c8-3e1b-4874-8c36-6b0ba2148de1 req-18d38a16-07ab-465d-9f23-f7070b0a6e95 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:03.195161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3f4cb6c8-3e1b-4874-8c36-6b0ba2148de1 req-18d38a16-07ab-465d-9f23-f7070b0a6e95 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:03.195827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3f4cb6c8-3e1b-4874-8c36-6b0ba2148de1 req-18d38a16-07ab-465d-9f23-f7070b0a6e95 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.217020 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3f4cb6c8-3e1b-4874-8c36-6b0ba2148de1 req-18d38a16-07ab-465d-9f23-f7070b0a6e95 service nova] Creating event network-vif-deleted:dc24a34d-7c73-45a5-b69a-e794cde576e9 for instance a61017eb-8d52-42ee-8769-b33e4a81803f on n-h1-850499-14 Oct 04 18:25:03.223328 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3f4cb6c8-3e1b-4874-8c36-6b0ba2148de1 req-18d38a16-07ab-465d-9f23-f7070b0a6e95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081208 Oct 04 18:25:03.223569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:03.224153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:03.225319 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2643/5259] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:03.238574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:03.239098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:03.239548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.240254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:03.240711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:03.241137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.458940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:03.471594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:03.474378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:03.476834 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ff885aa-ef7b-4774-8cf3-2077933e1718 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.257210 Oct 04 18:25:03.477975 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2617/5260] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:03 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:25:03.553710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:03.561629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:03.587796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:03.590196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:03.593402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.594425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:03.595104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:03.597455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.651900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:03.652705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:03.653453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.654689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lazy-loading 'fault' on Instance uuid 79ec30a2-5c37-47e9-8267-94546b5a146e {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:03.724465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:03.742750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:03.750269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf74e18995d24935b50f8058a44d5d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f0c4d3de4e437ba1bc7c659aee2428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:03.752595 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e3bacdf9-8db2-49b9-9dc8-28576351a0a8 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 200 len: 1608 microversion: 2.42 time: 0.205411 Oct 04 18:25:03.753980 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2644/5261] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:03 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 1608 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:04.119881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.120505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] [instance: a61017eb-8d52-42ee-8769-b33e4a81803f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:04.133024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.133810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.134425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.135353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.136062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.136751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.179349 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] HTTP exception thrown: Instance a61017eb-8d52-42ee-8769-b33e4a81803f could not be found. Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Request method failure captured: Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f HTTP/1.1 Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHpI4kne1NoLZF7FDxbORJmQGAQFxtH221lUa3mfFtJmB0azqdx56UaEtUQ2taNZ71YUabDDoBg7XdV4Iu3zXBuZxMsabPPCp2V4v-rDA_RGu2dmWUJstZxdbRhs0yKOoGPHV56OpSjIusE_me7DeW8nAYiQckTZ6ZaeEL3SndrMfU4 Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 1253a9f61f654272b0acaeafc636d08c Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesActionsTest-567102486 Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1253a9f61f654272b0acaeafc636d08c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1253a9f61f654272b0acaeafc636d08c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1253a9f61f654272b0acaeafc636d08c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1253a9f61f654272b0acaeafc636d08c"}]}] Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesActionsTest-567102486 Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 1253a9f61f654272b0acaeafc636d08c Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesActionsTest-567102486 Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesActionsTest-567102486-project Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 59d57850f20044c4bb31536dd0bb4ff6 Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesActionsTest-567102486-project Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance a61017eb-8d52-42ee-8769-b33e4a81803f could not be found. Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'a61017eb-8d52-42ee-8769-b33e4a81803f'} Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a61017eb-8d52-42ee-8769-b33e4a81803f could not be found. Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a61017eb-8d52-42ee-8769-b33e4a81803f could not be found. Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:04.183018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.189789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:04.189789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:04.189789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:04.189789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:04.189789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:04.189789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a61017eb-8d52-42ee-8769-b33e4a81803f could not be found. Oct 04 18:25:04.189789 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.192031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] Returning 404 to user: Instance a61017eb-8d52-42ee-8769-b33e4a81803f could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:04.193862 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00a59239-ff2f-445b-bfe0-21d20f13b25a tempest-VolumesActionsTest-567102486 tempest-VolumesActionsTest-567102486-project] 10.222.0.18 "GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f" status: 404 len: 111 microversion: 2.1 time: 0.077792 Oct 04 18:25:04.217419 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2618/5262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:04 2022] GET /compute/v2.1/servers/a61017eb-8d52-42ee-8769-b33e4a81803f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:04.506260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.506967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:04.549419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.551879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.552595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.558870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.559604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.563551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.628641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:04.783053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.785992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:04.802690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:04.807592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.808103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.808551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.809280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.809752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.810296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.820213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:04.821824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:04.823113 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b8672ef-35fc-4c14-998e-9c1430ad7fc2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.322548 Oct 04 18:25:04.849054 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2645/5263] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:04 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:04.856271 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] HTTP exception thrown: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Request method failure captured: Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e HTTP/1.1 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHjDheBxHaXjxi2bCBTVoh9XhzEGZvuN28xFFylrz4e1buWNfAlgXab_EPqSvEFkYf5xXE1qRE6B3Nkn6HoHpZqf-pIPskgw5RcDhTd9RBQrQ2nbYphvQTPnP4AZKbG8zJi9VfuAKjArOj6Ntl1MRBnjQPVKCvza2yiWpkeFuSQn_Yk Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: c4f0c4d3de4e437ba1bc7c659aee2428 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1048839638 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c4f0c4d3de4e437ba1bc7c659aee2428"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c4f0c4d3de4e437ba1bc7c659aee2428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c4f0c4d3de4e437ba1bc7c659aee2428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c4f0c4d3de4e437ba1bc7c659aee2428"}]}] Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1048839638 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: c4f0c4d3de4e437ba1bc7c659aee2428 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1048839638 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TaggedBootDevicesTest_v242-1048839638-project Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: bf74e18995d24935b50f8058a44d5d12 Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1048839638-project Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '79ec30a2-5c37-47e9-8267-94546b5a146e'} Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.858378 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:04.863454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.863454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:04.863454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:04.863454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:04.863454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:04.863454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:04.863454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:04.863454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.863454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Returning 404 to user: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:04.893764 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-236d11c3-1e61-4dd6-9723-73a81dc80488 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 404 len: 111 microversion: 2.42 time: 0.114919 Oct 04 18:25:04.894676 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2619/5264] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:04 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:25:04.904918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17049364-0f99-42a5-b611-6f2c5b0d9f6f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '.version_select at 0x7fd4d0ae5040>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.947386 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17049364-0f99-42a5-b611-6f2c5b0d9f6f tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-787895292" status: 204 len: 0 microversion: 2.42 time: 0.047859 Oct 04 18:25:04.948257 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2646/5265] 10.222.0.18 () {60 vars in 1259 bytes} [Tue Oct 4 18:25:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-787895292 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:25:05.854254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:05.855415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:05.868728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.869505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.872424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:05.874217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.874901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.875570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.059799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:06.076328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:06.083694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:06.085054 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5f6cddbf-3352-42c7-85b6-672a4bd39fec tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.234921 Oct 04 18:25:06.086091 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2620/5266] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:05 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:07.116475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:07.117102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:07.126058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:07.131171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:07.131639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:07.132399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:07.132871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:07.139584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:07.384604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:07.394218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:07.402467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:07.406658 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-492ab874-0197-4ef1-8816-f84416531acf tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.293131 Oct 04 18:25:07.423355 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2647/5267] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:07 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:08.440972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:08.442468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:08.452513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:08.462548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:08.467238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:08.468498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:08.469215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:08.469907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:08.749864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:08.777530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:08.795247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:08.820629 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9fbb2ae-b7fd-4efc-8a86-350e3ddac9c8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.383652 Oct 04 18:25:08.832355 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2621/5268] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:08 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:09.862586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:09.868010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:09.878409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:09.879707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:09.881110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:09.885141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:09.886350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:09.887125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:10.058982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:10.078175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:10.089085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:10.094080 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ef46acf-9b20-4704-903e-3d0b7a48d8cc tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.240685 Oct 04 18:25:10.098646 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2648/5269] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:09 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:11.127697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:11.128201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:11.138284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:11.147282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:11.148219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:11.149136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:11.149643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:11.150089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:11.430483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:11.452315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:11.462629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:11.473646 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c777aec9-a47f-4772-9194-db740e9ec640 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.344790 Oct 04 18:25:11.474307 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2622/5270] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:11 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:12.504741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:12.506159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:12.531956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.540003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.543867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.555455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.564976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.578850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.802312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:12.838227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:12.849586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:12.851634 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-314ac1b7-60a0-4df3-865f-382c853a55c9 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.352303 Oct 04 18:25:12.855166 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2649/5271] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:12 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:13.883970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:13.884551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:13.904558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:13.905352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:13.905983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:13.915220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:13.915977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:13.916597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:13.922930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:14.400173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:14.420390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:14.425283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:14.430117 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6a927580-610c-4ab4-90bd-81878f66564d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.550886 Oct 04 18:25:14.434558 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2623/5272] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:13 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:15.465845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:15.467303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:15.499128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.500090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.503732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.506383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.506900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.517720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.586784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:15.587464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:15.608850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.612374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.612990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.620083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.627841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.628608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.683730 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] HTTP exception thrown: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Request method failure captured: Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e HTTP/1.1 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHjDheBxHaXjxi2bCBTVoh9XhzEGZvuN28xFFylrz4e1buWNfAlgXab_EPqSvEFkYf5xXE1qRE6B3Nkn6HoHpZqf-pIPskgw5RcDhTd9RBQrQ2nbYphvQTPnP4AZKbG8zJi9VfuAKjArOj6Ntl1MRBnjQPVKCvza2yiWpkeFuSQn_Yk Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: c4f0c4d3de4e437ba1bc7c659aee2428 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1048839638 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c4f0c4d3de4e437ba1bc7c659aee2428"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c4f0c4d3de4e437ba1bc7c659aee2428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c4f0c4d3de4e437ba1bc7c659aee2428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c4f0c4d3de4e437ba1bc7c659aee2428"}]}] Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1048839638 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: c4f0c4d3de4e437ba1bc7c659aee2428 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1048839638 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TaggedBootDevicesTest_v242-1048839638-project Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: bf74e18995d24935b50f8058a44d5d12 Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1048839638-project Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '79ec30a2-5c37-47e9-8267-94546b5a146e'} Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:15.697631 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Returning 404 to user: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:15.708048 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-55463b61-49ce-44e1-85e7-f0f32d0e5004 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "DELETE /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 404 len: 111 microversion: 2.42 time: 0.121116 Oct 04 18:25:15.709186 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2624/5273] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:25:15 2022] DELETE /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:25:15.714076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:15.735851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] [instance: 79ec30a2-5c37-47e9-8267-94546b5a146e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:15.749570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.750210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.751426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.762921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.763562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.764117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.765572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:15.794511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:15.796017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:15.797250 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a6d9f76-ca5f-4e58-8a42-517a1424c5b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.337699 Oct 04 18:25:15.803790 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] HTTP exception thrown: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:15.808459 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2650/5274] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:15 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Request method failure captured: Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e HTTP/1.1 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHjDheBxHaXjxi2bCBTVoh9XhzEGZvuN28xFFylrz4e1buWNfAlgXab_EPqSvEFkYf5xXE1qRE6B3Nkn6HoHpZqf-pIPskgw5RcDhTd9RBQrQ2nbYphvQTPnP4AZKbG8zJi9VfuAKjArOj6Ntl1MRBnjQPVKCvza2yiWpkeFuSQn_Yk Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: c4f0c4d3de4e437ba1bc7c659aee2428 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1048839638 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c4f0c4d3de4e437ba1bc7c659aee2428"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c4f0c4d3de4e437ba1bc7c659aee2428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c4f0c4d3de4e437ba1bc7c659aee2428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c4f0c4d3de4e437ba1bc7c659aee2428"}]}] Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1048839638 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: c4f0c4d3de4e437ba1bc7c659aee2428 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1048839638 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TaggedBootDevicesTest_v242-1048839638-project Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: bf74e18995d24935b50f8058a44d5d12 Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1048839638-project Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '79ec30a2-5c37-47e9-8267-94546b5a146e'} Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:15.810454 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:15.815873 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:15.815873 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:15.815873 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:15.815873 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:15.815873 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:15.815873 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:15.815873 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. Oct 04 18:25:15.815873 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:15.817848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] Returning 404 to user: Instance 79ec30a2-5c37-47e9-8267-94546b5a146e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:15.825767 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-93948e2a-0f45-4521-b38b-dc6184a3a0a4 tempest-TaggedBootDevicesTest_v242-1048839638 tempest-TaggedBootDevicesTest_v242-1048839638-project] 10.222.0.18 "GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e" status: 404 len: 111 microversion: 2.42 time: 0.115343 Oct 04 18:25:15.826514 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2625/5275] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:15 2022] GET /compute/v2.1/servers/79ec30a2-5c37-47e9-8267-94546b5a146e => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:25:16.836991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:16.838197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:16.850124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:16.850856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:16.851597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:16.852500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:16.853131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:16.853721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:17.070202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02880aa7-1f9c-41ea-bb9b-d81f442e0976 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:17.071450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-02880aa7-1f9c-41ea-bb9b-d81f442e0976 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:17.075105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:17.096559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02880aa7-1f9c-41ea-bb9b-d81f442e0976 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:17.097300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02880aa7-1f9c-41ea-bb9b-d81f442e0976 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:17.097917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02880aa7-1f9c-41ea-bb9b-d81f442e0976 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:17.099066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02880aa7-1f9c-41ea-bb9b-d81f442e0976 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:17.099704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02880aa7-1f9c-41ea-bb9b-d81f442e0976 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:17.100447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02880aa7-1f9c-41ea-bb9b-d81f442e0976 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:17.314844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:17.327938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:17.330169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:17.331840 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4dc47938-ceeb-494a-874f-7cbb4c78ffb7 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.499805 Oct 04 18:25:17.333478 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2651/5276] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:16 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:17.834517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-02880aa7-1f9c-41ea-bb9b-d81f442e0976 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:17.850163 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-02880aa7-1f9c-41ea-bb9b-d81f442e0976 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.783661 Oct 04 18:25:17.868213 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2626/5277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:17 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:18.362826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:18.365721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:18.380454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:18.380962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:18.381408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:18.385382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:18.386563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:18.389237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:18.766404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:18.803744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:18.811387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:18.820530 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e7d53b8c-791e-472b-8ce7-09188a32df71 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.457117 Oct 04 18:25:18.821971 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2652/5278] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:18 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:18.883546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d1bf5b3-b855-4196-b903-a148d07b4b71 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:18.884763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4d1bf5b3-b855-4196-b903-a148d07b4b71 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:18.901246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d1bf5b3-b855-4196-b903-a148d07b4b71 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:18.908346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d1bf5b3-b855-4196-b903-a148d07b4b71 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:18.910550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d1bf5b3-b855-4196-b903-a148d07b4b71 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:18.911920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d1bf5b3-b855-4196-b903-a148d07b4b71 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:18.914131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d1bf5b3-b855-4196-b903-a148d07b4b71 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:18.916591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d1bf5b3-b855-4196-b903-a148d07b4b71 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.368681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4d1bf5b3-b855-4196-b903-a148d07b4b71 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:19.401822 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4d1bf5b3-b855-4196-b903-a148d07b4b71 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.521141 Oct 04 18:25:19.420971 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2627/5279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:18 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:19.435693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d3474d34-dec9-4666-a34b-5e7f31f95a4c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-640925920"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:19.438542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d3474d34-dec9-4666-a34b-5e7f31f95a4c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:19.490579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3474d34-dec9-4666-a34b-5e7f31f95a4c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.491598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3474d34-dec9-4666-a34b-5e7f31f95a4c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.497755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3474d34-dec9-4666-a34b-5e7f31f95a4c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.502372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3474d34-dec9-4666-a34b-5e7f31f95a4c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.504382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3474d34-dec9-4666-a34b-5e7f31f95a4c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.512977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3474d34-dec9-4666-a34b-5e7f31f95a4c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.856885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:19.857668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:19.873441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.874296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.876933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.878871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.879547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.882181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:20.096404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:20.110669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:20.118848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:20.120505 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fc9fa075-90a6-40d5-911f-9a184847d5b6 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.271811 Oct 04 18:25:20.125720 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2628/5280] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:19 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:20.161003 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d3474d34-dec9-4666-a34b-5e7f31f95a4c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.724438 Oct 04 18:25:20.164967 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2653/5281] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:25:19 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:25:20.171285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a6326000-4377-42cb-ae6b-c74533cf891f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:20.172513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a6326000-4377-42cb-ae6b-c74533cf891f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:20.191231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6326000-4377-42cb-ae6b-c74533cf891f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:20.194417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6326000-4377-42cb-ae6b-c74533cf891f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:20.194904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6326000-4377-42cb-ae6b-c74533cf891f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:20.195711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6326000-4377-42cb-ae6b-c74533cf891f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:20.196185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6326000-4377-42cb-ae6b-c74533cf891f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:20.202429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6326000-4377-42cb-ae6b-c74533cf891f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:20.621407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a6326000-4377-42cb-ae6b-c74533cf891f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:20.630144 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a6326000-4377-42cb-ae6b-c74533cf891f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.463704 Oct 04 18:25:20.633514 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2629/5282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:20 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:21.158570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:21.159509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:21.177991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.183035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.189966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.191014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.193720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.196331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.285491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-21b347d8-412f-45e6-8ec2-50f563403344 req-35baec0a-283f-4050-b693-9108c6373f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1681ab-db4a-4528-99da-649ffa9a93a0", "name": "network-vif-unplugged", "status": "completed", "tag": "2d48ba84-42ef-46d1-b6ba-69e426d07f1c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:21.313483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-21b347d8-412f-45e6-8ec2-50f563403344 req-35baec0a-283f-4050-b693-9108c6373f90 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.318160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-21b347d8-412f-45e6-8ec2-50f563403344 req-35baec0a-283f-4050-b693-9108c6373f90 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.319482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-21b347d8-412f-45e6-8ec2-50f563403344 req-35baec0a-283f-4050-b693-9108c6373f90 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.360405 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-21b347d8-412f-45e6-8ec2-50f563403344 req-35baec0a-283f-4050-b693-9108c6373f90 service nova] Creating event network-vif-unplugged:2d48ba84-42ef-46d1-b6ba-69e426d07f1c for instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 on n-h2-850499-14 Oct 04 18:25:21.380082 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-21b347d8-412f-45e6-8ec2-50f563403344 req-35baec0a-283f-4050-b693-9108c6373f90 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098258 Oct 04 18:25:21.380977 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2630/5283] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:21.518028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:21.541305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:21.543407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:21.544914 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a3f8d940-b9b1-4ad5-977b-db81607dd8ea tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.391381 Oct 04 18:25:21.561260 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2654/5284] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:21 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:21.663129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4477991d-7ae8-4ba9-b670-3d30f00138f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:21.663999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4477991d-7ae8-4ba9-b670-3d30f00138f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:21.681604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4477991d-7ae8-4ba9-b670-3d30f00138f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.682571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4477991d-7ae8-4ba9-b670-3d30f00138f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.683521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4477991d-7ae8-4ba9-b670-3d30f00138f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.685321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4477991d-7ae8-4ba9-b670-3d30f00138f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.686274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4477991d-7ae8-4ba9-b670-3d30f00138f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.687130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4477991d-7ae8-4ba9-b670-3d30f00138f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:22.062229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4477991d-7ae8-4ba9-b670-3d30f00138f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:22.074570 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4477991d-7ae8-4ba9-b670-3d30f00138f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.421555 Oct 04 18:25:22.079122 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2631/5285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:21 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:22.574315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:22.575769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:22.588545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:22.589350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:22.590034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:22.595577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:22.596743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:22.597549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:22.780213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:22.787731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:22.800070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:22.804227 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-71396517-a62c-4182-8ff1-567612f925b2 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.234367 Oct 04 18:25:22.809328 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2655/5286] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:22 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:23.105324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e9561e4a-c6a0-4d80-a363-6cf898846d11 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:23.106141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e9561e4a-c6a0-4d80-a363-6cf898846d11 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:23.127790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9561e4a-c6a0-4d80-a363-6cf898846d11 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.148055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9561e4a-c6a0-4d80-a363-6cf898846d11 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.149783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9561e4a-c6a0-4d80-a363-6cf898846d11 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.150976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9561e4a-c6a0-4d80-a363-6cf898846d11 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.152784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9561e4a-c6a0-4d80-a363-6cf898846d11 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.160256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9561e4a-c6a0-4d80-a363-6cf898846d11 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.598650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e9561e4a-c6a0-4d80-a363-6cf898846d11 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:23.609989 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e9561e4a-c6a0-4d80-a363-6cf898846d11 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.508859 Oct 04 18:25:23.625061 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2632/5287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:23 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:23.844320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:23.845764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:23.859147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:23.861488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.862709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.867113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.868115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.868762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.869366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.013436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:24.024604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:24.026341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:24.027805 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8ffd75ec-8061-47ae-8aab-40f63907c693 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.195721 Oct 04 18:25:24.053625 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2656/5288] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:23 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:24.505105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e5451b13-8e7a-4ec5-8c07-50966e1a4cc7 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Action: 'create', calling method: .version_select at 0x7fd4d618b700>, body: {"keypair": {"name": "tempest-TestServerBasicOps-601380098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8XheakJ96kX4h54rolcauOe8W9DYLmjqY7j+VTnJWfwGNZQqsYBqg4ttLOK6ecAewmZeMw+0NFZOLncw2lT7B3ylJJLj5QZkHWMOVUSA4UaVE5z6s+t8Bvh7t0paxjLw=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:24.545807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-e5451b13-8e7a-4ec5-8c07-50966e1a4cc7 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Getting quotas for project a649636bf6484226940a46cff7514e4d. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:25:24.560497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-e5451b13-8e7a-4ec5-8c07-50966e1a4cc7 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Getting quotas for user 57555d380c604b848af04599aaeec6f5 and project a649636bf6484226940a46cff7514e4d. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:25:24.601463 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e5451b13-8e7a-4ec5-8c07-50966e1a4cc7 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.553595 Oct 04 18:25:24.607467 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2633/5289] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:25:24 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:24.636648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-132c825e-87b9-4114-b95b-8bda93152325 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:24.637721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-132c825e-87b9-4114-b95b-8bda93152325 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:24.644965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132c825e-87b9-4114-b95b-8bda93152325 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.654929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132c825e-87b9-4114-b95b-8bda93152325 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.657190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132c825e-87b9-4114-b95b-8bda93152325 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.658083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132c825e-87b9-4114-b95b-8bda93152325 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.670141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132c825e-87b9-4114-b95b-8bda93152325 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.670754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132c825e-87b9-4114-b95b-8bda93152325 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.061970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:25.063188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:25.079714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:25.080671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:25.083576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.084603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:25.085240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:25.087176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.399394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-132c825e-87b9-4114-b95b-8bda93152325 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:25.407898 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-132c825e-87b9-4114-b95b-8bda93152325 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1687 microversion: 2.1 time: 0.775064 Oct 04 18:25:25.412783 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2657/5290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:24 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1687 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:25.445564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:25.464728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:25.470641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:25.476502 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-935c6ed6-6e1c-4ea5-9ecf-b51f0cf1dae8 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.424810 Oct 04 18:25:25.494299 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2634/5291] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:25 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:26.439570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb5d93aa-61d8-4f84-85ed-294824ad4625 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:26.440825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bb5d93aa-61d8-4f84-85ed-294824ad4625 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:26.461267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb5d93aa-61d8-4f84-85ed-294824ad4625 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.471642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb5d93aa-61d8-4f84-85ed-294824ad4625 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.474232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb5d93aa-61d8-4f84-85ed-294824ad4625 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.475066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb5d93aa-61d8-4f84-85ed-294824ad4625 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.475568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb5d93aa-61d8-4f84-85ed-294824ad4625 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.483290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb5d93aa-61d8-4f84-85ed-294824ad4625 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.513434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:26.516080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:26.535914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.539990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.544842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.548759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.554715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.555909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.776110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:26.790108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:26.796310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:26.800010 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5fe81433-276e-4a1d-856b-18f13353aa96 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1408 microversion: 2.54 time: 0.292691 Oct 04 18:25:26.802936 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2635/5292] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:26 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:27.124275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bb5d93aa-61d8-4f84-85ed-294824ad4625 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:27.143966 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb5d93aa-61d8-4f84-85ed-294824ad4625 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1687 microversion: 2.1 time: 0.708558 Oct 04 18:25:27.155121 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2658/5293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:26 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1687 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:27.848711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:27.853173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:27.880003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:27.881787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:27.884905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:27.888967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:27.890851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:27.894916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.158133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:28.167829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:28.175301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-52599972-3f7d-4ddb-a8d6-dd8bd73fda1e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:28.176542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-52599972-3f7d-4ddb-a8d6-dd8bd73fda1e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:28.185503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52599972-3f7d-4ddb-a8d6-dd8bd73fda1e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.186264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52599972-3f7d-4ddb-a8d6-dd8bd73fda1e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.186715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52599972-3f7d-4ddb-a8d6-dd8bd73fda1e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.193377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:28.203461 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-61bced56-2ea5-4de9-8090-ceee55bdce67 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1414 microversion: 2.54 time: 0.374665 Oct 04 18:25:28.204955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52599972-3f7d-4ddb-a8d6-dd8bd73fda1e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.206388 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2636/5294] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:27 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1414 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:28.207127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52599972-3f7d-4ddb-a8d6-dd8bd73fda1e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.215768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52599972-3f7d-4ddb-a8d6-dd8bd73fda1e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.248758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1462722699", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-601380098", "security_groups": [{"name": "tempest-secgroup-smoke-1200758011"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "a238ed93-0a18-4389-aef7-59b095ad6db4"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:28.650863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] validate_networks() for [('a238ed93-0a18-4389-aef7-59b095ad6db4', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:25:28.766164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-52599972-3f7d-4ddb-a8d6-dd8bd73fda1e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:28.778662 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-52599972-3f7d-4ddb-a8d6-dd8bd73fda1e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1687 microversion: 2.1 time: 0.605198 Oct 04 18:25:28.783286 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2659/5295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:28 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1687 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:29.238344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:29.239047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:29.252607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.253116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.253571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.254294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.254760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.255223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.402680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:29.432213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:29.434644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:29.436368 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8dd0e12e-c375-40e8-b6a5-6848a1b21895 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1414 microversion: 2.54 time: 0.202832 Oct 04 18:25:29.437150 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2660/5296] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:29 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1414 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:25:29.530253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Getting quotas for project a649636bf6484226940a46cff7514e4d. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:25:29.538454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Getting quotas for user 57555d380c604b848af04599aaeec6f5 and project a649636bf6484226940a46cff7514e4d. Resources: dict_keys(['metadata_items']) {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:25:29.553316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:25:29.554255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:25:29.555032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:25:29.555701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:25:29.556501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:25:29.598682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.598682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.599397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.602136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.602769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.603254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.661885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Getting quotas for project a649636bf6484226940a46cff7514e4d. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:25:29.677366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Getting quotas for user 57555d380c604b848af04599aaeec6f5 and project a649636bf6484226940a46cff7514e4d. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:25:29.714566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:25:29.727307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:25:29.807165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f57280cd-bd4b-4909-935b-f975dce421f9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:29.808444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f57280cd-bd4b-4909-935b-f975dce421f9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:29.826361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f57280cd-bd4b-4909-935b-f975dce421f9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.833168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f57280cd-bd4b-4909-935b-f975dce421f9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.834056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f57280cd-bd4b-4909-935b-f975dce421f9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.835513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f57280cd-bd4b-4909-935b-f975dce421f9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.839184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f57280cd-bd4b-4909-935b-f975dce421f9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.845409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f57280cd-bd4b-4909-935b-f975dce421f9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.896727 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-561db602-d66d-4b39-af3a-5e1814848e70 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.661342 Oct 04 18:25:29.920131 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2637/5297] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:25:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:25:29.958096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9ad72264-c4d6-469e-a51a-dcac249511ef tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:29.958730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9ad72264-c4d6-469e-a51a-dcac249511ef tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:30.197027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9ad72264-c4d6-469e-a51a-dcac249511ef tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:30.214326 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9ad72264-c4d6-469e-a51a-dcac249511ef tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1302 microversion: 2.1 time: 0.286669 Oct 04 18:25:30.215863 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2638/5298] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:29 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1302 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:30.396809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f57280cd-bd4b-4909-935b-f975dce421f9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:30.404259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:30.407816 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f57280cd-bd4b-4909-935b-f975dce421f9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1687 microversion: 2.1 time: 0.606029 Oct 04 18:25:30.413058 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2661/5299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:29 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1687 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:30.470157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:30.471748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:30.485195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:30.489298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:30.490010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:30.490971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:30.491638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:30.492288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:30.624136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:30.635418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:30.637255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:30.638640 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e01308e1-50e5-4576-b4a8-9525457bbc60 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1399 microversion: 2.54 time: 0.172652 Oct 04 18:25:30.639881 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2639/5300] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:30 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1399 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:25:30.667264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c89b0011-6417-457a-85d4-7bcbf8ca0e6f tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '.version_select at 0x7fd4d0b1a4c0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:30.692170 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c89b0011-6417-457a-85d4-7bcbf8ca0e6f tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1088582581" status: 204 len: 0 microversion: 2.54 time: 0.029581 Oct 04 18:25:30.693380 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2662/5301] 10.222.0.18 () {60 vars in 1319 bytes} [Tue Oct 4 18:25:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1088582581 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:25:30.705545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-68b2447f-b3fe-470b-b588-433265118086 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:30.706194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-68b2447f-b3fe-470b-b588-433265118086 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:30.718631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b2447f-b3fe-470b-b588-433265118086 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:30.719186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b2447f-b3fe-470b-b588-433265118086 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:30.719716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b2447f-b3fe-470b-b588-433265118086 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:30.722676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b2447f-b3fe-470b-b588-433265118086 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:30.723196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b2447f-b3fe-470b-b588-433265118086 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:30.726474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68b2447f-b3fe-470b-b588-433265118086 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:30.846009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-68b2447f-b3fe-470b-b588-433265118086 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:31.141149 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-68b2447f-b3fe-470b-b588-433265118086 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 204 len: 0 microversion: 2.54 time: 0.438116 Oct 04 18:25:31.146781 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2640/5302] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:25:30 2022] DELETE /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:25:31.157169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:31.157914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:31.187731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.191519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.202244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.213816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.214337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.214784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.238098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ccde8420-fd72-4c5c-9fd6-66905c4527e6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:31.238818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ccde8420-fd72-4c5c-9fd6-66905c4527e6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:31.253796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccde8420-fd72-4c5c-9fd6-66905c4527e6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.254307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccde8420-fd72-4c5c-9fd6-66905c4527e6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.256296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccde8420-fd72-4c5c-9fd6-66905c4527e6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.258309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccde8420-fd72-4c5c-9fd6-66905c4527e6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.265292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccde8420-fd72-4c5c-9fd6-66905c4527e6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.266680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccde8420-fd72-4c5c-9fd6-66905c4527e6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.548315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:31.581356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:31.584222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:31.593283 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e7854507-4770-407e-b1a1-3eca265add36 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1405 microversion: 2.54 time: 0.442239 Oct 04 18:25:31.594898 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2663/5303] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:31 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:31.630265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-69701235-2451-4ff5-87ca-67e9079ba953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:31.647820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-69701235-2451-4ff5-87ca-67e9079ba953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:31.663272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69701235-2451-4ff5-87ca-67e9079ba953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.666272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69701235-2451-4ff5-87ca-67e9079ba953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.666979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69701235-2451-4ff5-87ca-67e9079ba953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.667933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69701235-2451-4ff5-87ca-67e9079ba953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.669825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69701235-2451-4ff5-87ca-67e9079ba953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.670490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69701235-2451-4ff5-87ca-67e9079ba953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.670930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ccde8420-fd72-4c5c-9fd6-66905c4527e6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:31.681185 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ccde8420-fd72-4c5c-9fd6-66905c4527e6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1306 microversion: 2.1 time: 0.447171 Oct 04 18:25:31.681998 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2641/5304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:31 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1306 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:31.910570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-21f5f2d6-b529-4705-9f60-1210e4f98053 req-d27c3560-099e-4ea1-9550-70dd56b242ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1681ab-db4a-4528-99da-649ffa9a93a0", "name": "network-vif-plugged", "status": "completed", "tag": "2d48ba84-42ef-46d1-b6ba-69e426d07f1c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:31.931027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-21f5f2d6-b529-4705-9f60-1210e4f98053 req-d27c3560-099e-4ea1-9550-70dd56b242ff service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.938439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-21f5f2d6-b529-4705-9f60-1210e4f98053 req-d27c3560-099e-4ea1-9550-70dd56b242ff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.939493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-21f5f2d6-b529-4705-9f60-1210e4f98053 req-d27c3560-099e-4ea1-9550-70dd56b242ff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.994566 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-21f5f2d6-b529-4705-9f60-1210e4f98053 req-d27c3560-099e-4ea1-9550-70dd56b242ff service nova] Creating event network-vif-plugged:2d48ba84-42ef-46d1-b6ba-69e426d07f1c for instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 on n-h2-850499-14 Oct 04 18:25:32.003484 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-21f5f2d6-b529-4705-9f60-1210e4f98053 req-d27c3560-099e-4ea1-9550-70dd56b242ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096743 Oct 04 18:25:32.023420 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2642/5305] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:32.043087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-69701235-2451-4ff5-87ca-67e9079ba953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:32.058033 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-69701235-2451-4ff5-87ca-67e9079ba953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1687 microversion: 2.1 time: 0.461662 Oct 04 18:25:32.060381 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2664/5306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:31 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1687 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:32.641679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:32.642759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:32.657076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.658164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.658829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.659815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.660495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.663497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.696453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:32.704678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3cebb9ae-1169-40fb-a0f6-d112eba58f77 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:32.705927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3cebb9ae-1169-40fb-a0f6-d112eba58f77 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:32.721626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cebb9ae-1169-40fb-a0f6-d112eba58f77 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.722127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cebb9ae-1169-40fb-a0f6-d112eba58f77 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.722566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cebb9ae-1169-40fb-a0f6-d112eba58f77 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.723769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cebb9ae-1169-40fb-a0f6-d112eba58f77 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.724234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cebb9ae-1169-40fb-a0f6-d112eba58f77 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.724660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cebb9ae-1169-40fb-a0f6-d112eba58f77 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.785756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:32.802509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:32.804659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:32.812493 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eaeb6093-2603-4b22-96a5-38f7d06d1bf5 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1405 microversion: 2.54 time: 0.181310 Oct 04 18:25:32.827916 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2643/5307] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:32 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:32.853268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3cebb9ae-1169-40fb-a0f6-d112eba58f77 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:32.862120 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3cebb9ae-1169-40fb-a0f6-d112eba58f77 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1354 microversion: 2.1 time: 0.161054 Oct 04 18:25:32.862704 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2665/5308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:32 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:33.088021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-21d5b13d-f35a-4e56-a20c-f09d82e7847c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:33.089092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-21d5b13d-f35a-4e56-a20c-f09d82e7847c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:33.100390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d5b13d-f35a-4e56-a20c-f09d82e7847c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:33.116518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d5b13d-f35a-4e56-a20c-f09d82e7847c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:33.123197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d5b13d-f35a-4e56-a20c-f09d82e7847c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:33.144110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d5b13d-f35a-4e56-a20c-f09d82e7847c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:33.149431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d5b13d-f35a-4e56-a20c-f09d82e7847c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:33.151545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d5b13d-f35a-4e56-a20c-f09d82e7847c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:33.579348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-21d5b13d-f35a-4e56-a20c-f09d82e7847c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:33.595124 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-21d5b13d-f35a-4e56-a20c-f09d82e7847c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1687 microversion: 2.1 time: 0.511980 Oct 04 18:25:33.596270 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2644/5309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:33 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1687 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:33.843823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:33.846866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:33.863723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:33.865117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:33.866669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:33.868762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:33.871024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:33.873859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:33.890788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df4c5afc-b5ad-45d2-add4-68d20880d9d1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:33.893289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-df4c5afc-b5ad-45d2-add4-68d20880d9d1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:33.901691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df4c5afc-b5ad-45d2-add4-68d20880d9d1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:33.908632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df4c5afc-b5ad-45d2-add4-68d20880d9d1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:33.909401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df4c5afc-b5ad-45d2-add4-68d20880d9d1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:33.910513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df4c5afc-b5ad-45d2-add4-68d20880d9d1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:33.911215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df4c5afc-b5ad-45d2-add4-68d20880d9d1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:33.918707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df4c5afc-b5ad-45d2-add4-68d20880d9d1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.003940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:34.004777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:34.005427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.007766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lazy-loading 'fault' on Instance uuid 9eeecabc-e2ba-409f-9883-5fbb681a56a8 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:34.122430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-df4c5afc-b5ad-45d2-add4-68d20880d9d1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:34.132606 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-df4c5afc-b5ad-45d2-add4-68d20880d9d1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1360 microversion: 2.1 time: 0.246521 Oct 04 18:25:34.136966 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2645/5310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:33 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1360 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:34.195512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:34.206252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:34.211776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61aac75b993e49a3adf23515cb05fa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0a3c97e95e41b0bdd48ab659863bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:34.213022 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e87e0eb9-4df8-4016-8446-d6e678fedae1 tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 200 len: 1410 microversion: 2.54 time: 0.374675 Oct 04 18:25:34.225833 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2666/5311] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:33 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 1410 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:25:34.625066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6385e074-17d9-4cd3-b8a9-100048070924 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:34.625962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6385e074-17d9-4cd3-b8a9-100048070924 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:34.640410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6385e074-17d9-4cd3-b8a9-100048070924 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:34.641205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6385e074-17d9-4cd3-b8a9-100048070924 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:34.641858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6385e074-17d9-4cd3-b8a9-100048070924 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.648101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6385e074-17d9-4cd3-b8a9-100048070924 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:34.648926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6385e074-17d9-4cd3-b8a9-100048070924 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:34.649555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6385e074-17d9-4cd3-b8a9-100048070924 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:35.002811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6385e074-17d9-4cd3-b8a9-100048070924 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:35.013983 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6385e074-17d9-4cd3-b8a9-100048070924 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.395945 Oct 04 18:25:35.028564 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2646/5312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:34 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:35.161185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a03b245-6339-4159-9cfe-7bf406896e86 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:35.161734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a03b245-6339-4159-9cfe-7bf406896e86 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:35.173280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a03b245-6339-4159-9cfe-7bf406896e86 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:35.183753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a03b245-6339-4159-9cfe-7bf406896e86 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:35.185014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a03b245-6339-4159-9cfe-7bf406896e86 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:35.186202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a03b245-6339-4159-9cfe-7bf406896e86 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:35.186842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a03b245-6339-4159-9cfe-7bf406896e86 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:35.190104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a03b245-6339-4159-9cfe-7bf406896e86 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:35.244261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:35.245625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] [instance: 9eeecabc-e2ba-409f-9883-5fbb681a56a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:35.278309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:35.279833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:35.280663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:35.282608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:35.283121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:35.307390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:35.329198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9a03b245-6339-4159-9cfe-7bf406896e86 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:35.356510 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] HTTP exception thrown: Instance 9eeecabc-e2ba-409f-9883-5fbb681a56a8 could not be found. Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Request method failure captured: Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 HTTP/1.1 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHptTzaDNrDAo2sztj657fGjKh6t48-oUKKkgt0CEJws_kdJ_gVXJvOowuTOBGw6dVNk-Hrf_IzRpuK92WnYxJUYQ7YlprusELagIRJauE5uLG9ANN7-ZRK9nyOVC7dARKv3PEMTQzSZKpQIENu-ifecEJnyHNOtBpIzY-TT_d6fkk8 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: fa0a3c97e95e41b0bdd48ab659863bf9 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerShowV254Test-1125300574 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa0a3c97e95e41b0bdd48ab659863bf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa0a3c97e95e41b0bdd48ab659863bf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa0a3c97e95e41b0bdd48ab659863bf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa0a3c97e95e41b0bdd48ab659863bf9"}]}] Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerShowV254Test-1125300574 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: fa0a3c97e95e41b0bdd48ab659863bf9 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerShowV254Test-1125300574 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerShowV254Test-1125300574-project Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 61aac75b993e49a3adf23515cb05fa76 Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerShowV254Test-1125300574-project Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 9eeecabc-e2ba-409f-9883-5fbb681a56a8 could not be found. Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '9eeecabc-e2ba-409f-9883-5fbb681a56a8'} Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eeecabc-e2ba-409f-9883-5fbb681a56a8 could not be found. Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eeecabc-e2ba-409f-9883-5fbb681a56a8 could not be found. Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:35.358222 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:35.368769 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:35.368769 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:35.368769 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:35.368769 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:35.368769 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:35.368769 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eeecabc-e2ba-409f-9883-5fbb681a56a8 could not be found. Oct 04 18:25:35.368769 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:25:35.368769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] Returning 404 to user: Instance 9eeecabc-e2ba-409f-9883-5fbb681a56a8 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:35.368769 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ec6e4923-95cd-4201-9441-858bef36338d tempest-ServerShowV254Test-1125300574 tempest-ServerShowV254Test-1125300574-project] 10.222.0.18 "GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8" status: 404 len: 111 microversion: 2.54 time: 0.122943 Oct 04 18:25:35.368769 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2647/5313] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:25:35 2022] GET /compute/v2.1/servers/9eeecabc-e2ba-409f-9883-5fbb681a56a8 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:25:35.369755 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a03b245-6339-4159-9cfe-7bf406896e86 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1360 microversion: 2.1 time: 0.211588 Oct 04 18:25:35.369755 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2667/5314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:35 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1360 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:36.046452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fec5572d-f353-449f-acaa-10a39903017b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:36.047093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fec5572d-f353-449f-acaa-10a39903017b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:36.070345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fec5572d-f353-449f-acaa-10a39903017b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:36.070856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fec5572d-f353-449f-acaa-10a39903017b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:36.071339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fec5572d-f353-449f-acaa-10a39903017b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:36.072067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fec5572d-f353-449f-acaa-10a39903017b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:36.072537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fec5572d-f353-449f-acaa-10a39903017b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:36.072974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fec5572d-f353-449f-acaa-10a39903017b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:36.396861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c5032b8-7b6b-487d-814f-c5e983c47169 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:36.397360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4c5032b8-7b6b-487d-814f-c5e983c47169 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:36.419138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5032b8-7b6b-487d-814f-c5e983c47169 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:36.419648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5032b8-7b6b-487d-814f-c5e983c47169 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:36.420095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5032b8-7b6b-487d-814f-c5e983c47169 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:36.432919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5032b8-7b6b-487d-814f-c5e983c47169 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:36.433877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5032b8-7b6b-487d-814f-c5e983c47169 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:36.434533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c5032b8-7b6b-487d-814f-c5e983c47169 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:36.452781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fec5572d-f353-449f-acaa-10a39903017b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:36.469347 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fec5572d-f353-449f-acaa-10a39903017b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.426809 Oct 04 18:25:36.469937 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2648/5315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:36 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:36.881645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4c5032b8-7b6b-487d-814f-c5e983c47169 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:36.890268 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c5032b8-7b6b-487d-814f-c5e983c47169 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 0.497358 Oct 04 18:25:36.894593 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2668/5316] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:36 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:37.506483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-38108c96-dfc5-4912-8835-df60e3a7a7ca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:37.506905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-38108c96-dfc5-4912-8835-df60e3a7a7ca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:37.531654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38108c96-dfc5-4912-8835-df60e3a7a7ca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:37.532180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38108c96-dfc5-4912-8835-df60e3a7a7ca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:37.532638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38108c96-dfc5-4912-8835-df60e3a7a7ca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:37.534540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38108c96-dfc5-4912-8835-df60e3a7a7ca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:37.535068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38108c96-dfc5-4912-8835-df60e3a7a7ca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:37.535517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38108c96-dfc5-4912-8835-df60e3a7a7ca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:37.916802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-edb27779-0610-45ab-b6ad-8e72cea0a670 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:37.917367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-edb27779-0610-45ab-b6ad-8e72cea0a670 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:37.932930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edb27779-0610-45ab-b6ad-8e72cea0a670 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:37.940040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edb27779-0610-45ab-b6ad-8e72cea0a670 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:37.940804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edb27779-0610-45ab-b6ad-8e72cea0a670 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:37.941771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edb27779-0610-45ab-b6ad-8e72cea0a670 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:37.947682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edb27779-0610-45ab-b6ad-8e72cea0a670 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:37.948477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edb27779-0610-45ab-b6ad-8e72cea0a670 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:38.844922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-38108c96-dfc5-4912-8835-df60e3a7a7ca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:38.860947 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-38108c96-dfc5-4912-8835-df60e3a7a7ca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 1.366411 Oct 04 18:25:38.861556 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2649/5317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:37 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:38.877336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-edb27779-0610-45ab-b6ad-8e72cea0a670 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:38.888173 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-edb27779-0610-45ab-b6ad-8e72cea0a670 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 0.975314 Oct 04 18:25:38.893587 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2669/5318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:37 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:39.889649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c16848fb-3c50-49fa-8d2d-a15129c55053 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:39.893744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c16848fb-3c50-49fa-8d2d-a15129c55053 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:39.901899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:39.921296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-167aaced-1010-4397-bb6c-d2b81508a638 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:39.921908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-167aaced-1010-4397-bb6c-d2b81508a638 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:39.924512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16848fb-3c50-49fa-8d2d-a15129c55053 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:39.927174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16848fb-3c50-49fa-8d2d-a15129c55053 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:39.928256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16848fb-3c50-49fa-8d2d-a15129c55053 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:39.929613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16848fb-3c50-49fa-8d2d-a15129c55053 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:39.931272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16848fb-3c50-49fa-8d2d-a15129c55053 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:39.940208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16848fb-3c50-49fa-8d2d-a15129c55053 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:39.945513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-167aaced-1010-4397-bb6c-d2b81508a638 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:39.947974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-167aaced-1010-4397-bb6c-d2b81508a638 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:39.948731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-167aaced-1010-4397-bb6c-d2b81508a638 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:39.950901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-167aaced-1010-4397-bb6c-d2b81508a638 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:39.954075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-167aaced-1010-4397-bb6c-d2b81508a638 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:39.960011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-167aaced-1010-4397-bb6c-d2b81508a638 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:40.203050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=16 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:40.339563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c16848fb-3c50-49fa-8d2d-a15129c55053 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:40.353678 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c16848fb-3c50-49fa-8d2d-a15129c55053 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.468122 Oct 04 18:25:40.354861 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2650/5319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:39 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:40.361182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-167aaced-1010-4397-bb6c-d2b81508a638 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:40.390773 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-167aaced-1010-4397-bb6c-d2b81508a638 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 0.472958 Oct 04 18:25:40.393701 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2670/5320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:39 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:40.732620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-315541c7-ef9f-4af1-b55a-0d0a2f2f0232 tempest-ExtensionsTest-1114364192 tempest-ExtensionsTest-1114364192-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:40.735079 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-315541c7-ef9f-4af1-b55a-0d0a2f2f0232 tempest-ExtensionsTest-1114364192 tempest-ExtensionsTest-1114364192-project] 10.222.0.18 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.378360 Oct 04 18:25:40.737251 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2651/5321] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 4 18:25:40 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:40.746304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-85583a47-9680-44a1-a47f-e06ba55c6431 tempest-ExtensionsTest-1114364192 tempest-ExtensionsTest-1114364192-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:40.748593 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-85583a47-9680-44a1-a47f-e06ba55c6431 tempest-ExtensionsTest-1114364192 tempest-ExtensionsTest-1114364192-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006194 Oct 04 18:25:40.749638 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2671/5322] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Oct 4 18:25:40 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:25:41.384197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5c024b9e-70b7-490a-b80f-245862d007f0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:41.386304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5c024b9e-70b7-490a-b80f-245862d007f0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:41.404441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c024b9e-70b7-490a-b80f-245862d007f0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.409319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c024b9e-70b7-490a-b80f-245862d007f0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.412159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c024b9e-70b7-490a-b80f-245862d007f0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.422834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df6fd377-35d1-4401-aeb5-055ce483a0ce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:41.424452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df6fd377-35d1-4401-aeb5-055ce483a0ce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:41.434520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c024b9e-70b7-490a-b80f-245862d007f0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.435644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c024b9e-70b7-490a-b80f-245862d007f0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.437314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c024b9e-70b7-490a-b80f-245862d007f0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.453246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df6fd377-35d1-4401-aeb5-055ce483a0ce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.454769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df6fd377-35d1-4401-aeb5-055ce483a0ce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.460710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df6fd377-35d1-4401-aeb5-055ce483a0ce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.470213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df6fd377-35d1-4401-aeb5-055ce483a0ce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.476968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df6fd377-35d1-4401-aeb5-055ce483a0ce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.478080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df6fd377-35d1-4401-aeb5-055ce483a0ce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:42.039863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5c024b9e-70b7-490a-b80f-245862d007f0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:42.050995 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5c024b9e-70b7-490a-b80f-245862d007f0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.674219 Oct 04 18:25:42.060661 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2652/5323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:41 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:42.066833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a1ab0ee3-af72-4bdd-96d9-3bf9cb4fa89f req-ab242a55-793b-4603-9ad0-1b8833b01dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df321891-81e0-43b2-8e9a-fdd610b9bad3", "tag": "187c1114-4c06-41d8-be5d-26034d3929ce"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:42.114928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1ab0ee3-af72-4bdd-96d9-3bf9cb4fa89f req-ab242a55-793b-4603-9ad0-1b8833b01dab service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:42.118176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1ab0ee3-af72-4bdd-96d9-3bf9cb4fa89f req-ab242a55-793b-4603-9ad0-1b8833b01dab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:42.118627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1ab0ee3-af72-4bdd-96d9-3bf9cb4fa89f req-ab242a55-793b-4603-9ad0-1b8833b01dab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:42.160975 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a1ab0ee3-af72-4bdd-96d9-3bf9cb4fa89f req-ab242a55-793b-4603-9ad0-1b8833b01dab service nova] Creating event network-changed:187c1114-4c06-41d8-be5d-26034d3929ce for instance df321891-81e0-43b2-8e9a-fdd610b9bad3 on n-h2-850499-14 Oct 04 18:25:42.176157 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a1ab0ee3-af72-4bdd-96d9-3bf9cb4fa89f req-ab242a55-793b-4603-9ad0-1b8833b01dab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112669 Oct 04 18:25:42.178160 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2653/5324] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:42.251882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df6fd377-35d1-4401-aeb5-055ce483a0ce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:42.269455 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df6fd377-35d1-4401-aeb5-055ce483a0ce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 0.848328 Oct 04 18:25:42.272154 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2672/5325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:41 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:43.089891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9b29938c-63d7-4b9b-8d37-5a9494dadf83 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:43.093421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9b29938c-63d7-4b9b-8d37-5a9494dadf83 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:43.116028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b29938c-63d7-4b9b-8d37-5a9494dadf83 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.118074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b29938c-63d7-4b9b-8d37-5a9494dadf83 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.120764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b29938c-63d7-4b9b-8d37-5a9494dadf83 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.122600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b29938c-63d7-4b9b-8d37-5a9494dadf83 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.123879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b29938c-63d7-4b9b-8d37-5a9494dadf83 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.126133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9b29938c-63d7-4b9b-8d37-5a9494dadf83 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.295160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af9befb6-1d5c-4167-86c9-a98994e1e08a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:43.296591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-af9befb6-1d5c-4167-86c9-a98994e1e08a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:43.311429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af9befb6-1d5c-4167-86c9-a98994e1e08a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.312233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af9befb6-1d5c-4167-86c9-a98994e1e08a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.312880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af9befb6-1d5c-4167-86c9-a98994e1e08a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.313808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af9befb6-1d5c-4167-86c9-a98994e1e08a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.315517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af9befb6-1d5c-4167-86c9-a98994e1e08a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.316161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af9befb6-1d5c-4167-86c9-a98994e1e08a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.609917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9b29938c-63d7-4b9b-8d37-5a9494dadf83 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:43.635635 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9b29938c-63d7-4b9b-8d37-5a9494dadf83 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.552599 Oct 04 18:25:43.640409 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2654/5326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:43 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:43.959920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af9befb6-1d5c-4167-86c9-a98994e1e08a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:43.969521 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-af9befb6-1d5c-4167-86c9-a98994e1e08a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 0.679549 Oct 04 18:25:43.985293 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2673/5327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:43 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:44.665329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ce8afd9-e48d-4f92-8d99-48ffe2c191af tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:44.666148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ce8afd9-e48d-4f92-8d99-48ffe2c191af tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:44.688243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd9-e48d-4f92-8d99-48ffe2c191af tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.689483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd9-e48d-4f92-8d99-48ffe2c191af tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.690190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd9-e48d-4f92-8d99-48ffe2c191af tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.693816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd9-e48d-4f92-8d99-48ffe2c191af tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.694665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd9-e48d-4f92-8d99-48ffe2c191af tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.695814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ce8afd9-e48d-4f92-8d99-48ffe2c191af tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.996540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5389ff0c-f913-418d-9769-2835a0190e59 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:44.997884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5389ff0c-f913-418d-9769-2835a0190e59 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:45.008894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5389ff0c-f913-418d-9769-2835a0190e59 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:45.011683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5389ff0c-f913-418d-9769-2835a0190e59 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:45.016897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5389ff0c-f913-418d-9769-2835a0190e59 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:45.018219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5389ff0c-f913-418d-9769-2835a0190e59 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:45.018967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5389ff0c-f913-418d-9769-2835a0190e59 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:45.019653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5389ff0c-f913-418d-9769-2835a0190e59 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:45.377852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ce8afd9-e48d-4f92-8d99-48ffe2c191af tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:45.393375 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ce8afd9-e48d-4f92-8d99-48ffe2c191af tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.732141 Oct 04 18:25:45.393973 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2655/5328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:44 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:45.600260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5389ff0c-f913-418d-9769-2835a0190e59 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:45.614484 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5389ff0c-f913-418d-9769-2835a0190e59 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 0.622459 Oct 04 18:25:45.617092 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2674/5329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:44 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:45.707955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b6bbf4a-8652-43b5-9025-bbe9f3875479 tempest-ComputeTenantNetworksTest-1988745670 tempest-ComputeTenantNetworksTest-1988745670-project] Calling method '.version_select at 0x7fd4d117eb80>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:46.273057 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2b6bbf4a-8652-43b5-9025-bbe9f3875479 tempest-ComputeTenantNetworksTest-1988745670 tempest-ComputeTenantNetworksTest-1988745670-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.765671 Oct 04 18:25:46.274099 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2656/5330] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 4 18:25:45 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:46.285330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-701b8cb8-60a8-478a-b3bc-dceb2ad94ee2 tempest-ComputeTenantNetworksTest-1988745670 tempest-ComputeTenantNetworksTest-1988745670-project] Calling method '.version_select at 0x7fd4d0a3e430>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:46.416950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-76a79a1a-8d31-4acb-b46f-784b415ba8de tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:46.418061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-76a79a1a-8d31-4acb-b46f-784b415ba8de tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:46.436408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:46.439363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a79a1a-8d31-4acb-b46f-784b415ba8de tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:46.440091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a79a1a-8d31-4acb-b46f-784b415ba8de tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:46.440739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a79a1a-8d31-4acb-b46f-784b415ba8de tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:46.441671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a79a1a-8d31-4acb-b46f-784b415ba8de tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:46.442311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a79a1a-8d31-4acb-b46f-784b415ba8de tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:46.442924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a79a1a-8d31-4acb-b46f-784b415ba8de tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:46.544076 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-701b8cb8-60a8-478a-b3bc-dceb2ad94ee2 tempest-ComputeTenantNetworksTest-1988745670 tempest-ComputeTenantNetworksTest-1988745670-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks/b9838442-c313-4ad9-9df7-83c77849d035" status: 200 len: 140 microversion: 2.1 time: 0.262537 Oct 04 18:25:46.550987 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2675/5331] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:25:46 2022] GET /compute/v2.1/os-tenant-networks/b9838442-c313-4ad9-9df7-83c77849d035 => generated 140 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:46.641976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-32919295-7265-4b92-83f1-0d189d0d76dc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:46.642886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-32919295-7265-4b92-83f1-0d189d0d76dc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:46.661181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32919295-7265-4b92-83f1-0d189d0d76dc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:46.661919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32919295-7265-4b92-83f1-0d189d0d76dc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:46.664515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32919295-7265-4b92-83f1-0d189d0d76dc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:46.676134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32919295-7265-4b92-83f1-0d189d0d76dc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:46.676893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32919295-7265-4b92-83f1-0d189d0d76dc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:46.677539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32919295-7265-4b92-83f1-0d189d0d76dc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:47.139303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-76a79a1a-8d31-4acb-b46f-784b415ba8de tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:47.160026 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-76a79a1a-8d31-4acb-b46f-784b415ba8de tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.746857 Oct 04 18:25:47.164878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-32919295-7265-4b92-83f1-0d189d0d76dc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:47.180518 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-32919295-7265-4b92-83f1-0d189d0d76dc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 0.543601 Oct 04 18:25:47.200449 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2676/5332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:46 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:47.201013 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2657/5333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:46 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:48.232664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d1ff9454-65d5-4892-bace-9c6949c8190d tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:48.235882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb503b3b-e2b9-495c-b2b5-cca6181b2df5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:48.243194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d1ff9454-65d5-4892-bace-9c6949c8190d tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:48.243550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb503b3b-e2b9-495c-b2b5-cca6181b2df5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:48.274044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ff9454-65d5-4892-bace-9c6949c8190d tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.278228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ff9454-65d5-4892-bace-9c6949c8190d tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.278692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb503b3b-e2b9-495c-b2b5-cca6181b2df5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.279260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ff9454-65d5-4892-bace-9c6949c8190d tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.280318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb503b3b-e2b9-495c-b2b5-cca6181b2df5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.281858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ff9454-65d5-4892-bace-9c6949c8190d tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.285328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb503b3b-e2b9-495c-b2b5-cca6181b2df5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.286294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ff9454-65d5-4892-bace-9c6949c8190d tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.287259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb503b3b-e2b9-495c-b2b5-cca6181b2df5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.287909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1ff9454-65d5-4892-bace-9c6949c8190d tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.289530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb503b3b-e2b9-495c-b2b5-cca6181b2df5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.291882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb503b3b-e2b9-495c-b2b5-cca6181b2df5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:49.571436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb503b3b-e2b9-495c-b2b5-cca6181b2df5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:49.581906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d1ff9454-65d5-4892-bace-9c6949c8190d tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:49.596588 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb503b3b-e2b9-495c-b2b5-cca6181b2df5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 1.365327 Oct 04 18:25:49.601092 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2658/5334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:48 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:49.602051 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d1ff9454-65d5-4892-bace-9c6949c8190d tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 1.392215 Oct 04 18:25:49.604749 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2677/5335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:48 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:50.633954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7b754ea-fd81-4035-9666-9e6b9d2ec4fe tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:50.635704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80ea0c38-1088-4c9f-a6e0-75608b6c2154 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:50.636469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a7b754ea-fd81-4035-9666-9e6b9d2ec4fe tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:50.637753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-80ea0c38-1088-4c9f-a6e0-75608b6c2154 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:50.665989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b754ea-fd81-4035-9666-9e6b9d2ec4fe tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.669192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b754ea-fd81-4035-9666-9e6b9d2ec4fe tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.670685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ea0c38-1088-4c9f-a6e0-75608b6c2154 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.671408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b754ea-fd81-4035-9666-9e6b9d2ec4fe tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.673202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ea0c38-1088-4c9f-a6e0-75608b6c2154 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.675364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b754ea-fd81-4035-9666-9e6b9d2ec4fe tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.677980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ea0c38-1088-4c9f-a6e0-75608b6c2154 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.679436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b754ea-fd81-4035-9666-9e6b9d2ec4fe tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.681433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ea0c38-1088-4c9f-a6e0-75608b6c2154 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.681889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7b754ea-fd81-4035-9666-9e6b9d2ec4fe tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.686329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ea0c38-1088-4c9f-a6e0-75608b6c2154 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.691337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80ea0c38-1088-4c9f-a6e0-75608b6c2154 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.290350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-80ea0c38-1088-4c9f-a6e0-75608b6c2154 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:51.299396 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80ea0c38-1088-4c9f-a6e0-75608b6c2154 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.674545 Oct 04 18:25:51.315013 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2659/5336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:50 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:51.339282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a7b754ea-fd81-4035-9666-9e6b9d2ec4fe tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:51.354024 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a7b754ea-fd81-4035-9666-9e6b9d2ec4fe tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 0.729930 Oct 04 18:25:51.394223 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2678/5337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:50 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:52.331211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2896bd8-7c36-4869-8d79-526561a9e95d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:52.331821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2896bd8-7c36-4869-8d79-526561a9e95d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:52.350555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2896bd8-7c36-4869-8d79-526561a9e95d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.351275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2896bd8-7c36-4869-8d79-526561a9e95d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.351746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2896bd8-7c36-4869-8d79-526561a9e95d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.352516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2896bd8-7c36-4869-8d79-526561a9e95d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.352985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2896bd8-7c36-4869-8d79-526561a9e95d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.353471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2896bd8-7c36-4869-8d79-526561a9e95d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.379898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-844f4241-7720-4149-bf74-892ddf3ec83e tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:52.381114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-844f4241-7720-4149-bf74-892ddf3ec83e tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:52.403943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-844f4241-7720-4149-bf74-892ddf3ec83e tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.404916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-844f4241-7720-4149-bf74-892ddf3ec83e tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.410777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-844f4241-7720-4149-bf74-892ddf3ec83e tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.414851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-844f4241-7720-4149-bf74-892ddf3ec83e tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.415737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-844f4241-7720-4149-bf74-892ddf3ec83e tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.416607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-844f4241-7720-4149-bf74-892ddf3ec83e tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.840511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2896bd8-7c36-4869-8d79-526561a9e95d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:52.853731 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2896bd8-7c36-4869-8d79-526561a9e95d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.526272 Oct 04 18:25:52.856783 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2660/5338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:52 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:52.879476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-844f4241-7720-4149-bf74-892ddf3ec83e tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:52.894757 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-844f4241-7720-4149-bf74-892ddf3ec83e tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 0.520475 Oct 04 18:25:52.898111 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2679/5339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:52 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:53.460252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-27615072-11d9-4771-992d-56a5f1f1aa64 req-a089a7f3-376d-493c-8467-e368e4a7d9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df321891-81e0-43b2-8e9a-fdd610b9bad3", "name": "network-vif-plugged", "status": "completed", "tag": "187c1114-4c06-41d8-be5d-26034d3929ce"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:53.496209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-27615072-11d9-4771-992d-56a5f1f1aa64 req-a089a7f3-376d-493c-8467-e368e4a7d9e1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.497279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-27615072-11d9-4771-992d-56a5f1f1aa64 req-a089a7f3-376d-493c-8467-e368e4a7d9e1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.498283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-27615072-11d9-4771-992d-56a5f1f1aa64 req-a089a7f3-376d-493c-8467-e368e4a7d9e1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.531447 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-27615072-11d9-4771-992d-56a5f1f1aa64 req-a089a7f3-376d-493c-8467-e368e4a7d9e1 service nova] Creating event network-vif-plugged:187c1114-4c06-41d8-be5d-26034d3929ce for instance df321891-81e0-43b2-8e9a-fdd610b9bad3 on n-h2-850499-14 Oct 04 18:25:53.550253 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-27615072-11d9-4771-992d-56a5f1f1aa64 req-a089a7f3-376d-493c-8467-e368e4a7d9e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095752 Oct 04 18:25:53.555734 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2661/5340] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:53.879440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2cd8e9bf-926b-4a6b-a391-e79e25e01a9b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:53.880192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2cd8e9bf-926b-4a6b-a391-e79e25e01a9b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:53.904950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:53.921918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cd8e9bf-926b-4a6b-a391-e79e25e01a9b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.926423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cd8e9bf-926b-4a6b-a391-e79e25e01a9b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.928809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cd8e9bf-926b-4a6b-a391-e79e25e01a9b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.929916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cd8e9bf-926b-4a6b-a391-e79e25e01a9b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.935941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0787dc2c-17f2-4e76-830e-d38b56035f98 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:53.936943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0787dc2c-17f2-4e76-830e-d38b56035f98 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:53.941188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cd8e9bf-926b-4a6b-a391-e79e25e01a9b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.941789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2cd8e9bf-926b-4a6b-a391-e79e25e01a9b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.951661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0787dc2c-17f2-4e76-830e-d38b56035f98 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.952616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0787dc2c-17f2-4e76-830e-d38b56035f98 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.954239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0787dc2c-17f2-4e76-830e-d38b56035f98 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.955234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0787dc2c-17f2-4e76-830e-d38b56035f98 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.957744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0787dc2c-17f2-4e76-830e-d38b56035f98 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.958467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0787dc2c-17f2-4e76-830e-d38b56035f98 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:54.361513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0787dc2c-17f2-4e76-830e-d38b56035f98 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:54.370685 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0787dc2c-17f2-4e76-830e-d38b56035f98 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 0.440687 Oct 04 18:25:54.378519 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2662/5341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:53 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:54.392957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2cd8e9bf-926b-4a6b-a391-e79e25e01a9b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:54.405089 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2cd8e9bf-926b-4a6b-a391-e79e25e01a9b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.530194 Oct 04 18:25:54.420833 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2680/5342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:53 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:55.406569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9b1945a-9886-418d-9e0f-e4d0e3ca0b38 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:55.408060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9b1945a-9886-418d-9e0f-e4d0e3ca0b38 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:55.429138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80f8c132-ecd9-4f49-9572-894dde909bb7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:55.429898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80f8c132-ecd9-4f49-9572-894dde909bb7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:55.438346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9b1945a-9886-418d-9e0f-e4d0e3ca0b38 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.442575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9b1945a-9886-418d-9e0f-e4d0e3ca0b38 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.443401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9b1945a-9886-418d-9e0f-e4d0e3ca0b38 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.450466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9b1945a-9886-418d-9e0f-e4d0e3ca0b38 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.451103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9b1945a-9886-418d-9e0f-e4d0e3ca0b38 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.452757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9b1945a-9886-418d-9e0f-e4d0e3ca0b38 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.467436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80f8c132-ecd9-4f49-9572-894dde909bb7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.471379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80f8c132-ecd9-4f49-9572-894dde909bb7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.471973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80f8c132-ecd9-4f49-9572-894dde909bb7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.475111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80f8c132-ecd9-4f49-9572-894dde909bb7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.476621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80f8c132-ecd9-4f49-9572-894dde909bb7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.477181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80f8c132-ecd9-4f49-9572-894dde909bb7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.482829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:56.454020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-80f8c132-ecd9-4f49-9572-894dde909bb7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:56.473710 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-80f8c132-ecd9-4f49-9572-894dde909bb7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 1.048231 Oct 04 18:25:56.477622 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2681/5343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:55 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:56.534017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9b1945a-9886-418d-9e0f-e4d0e3ca0b38 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:56.548500 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9b1945a-9886-418d-9e0f-e4d0e3ca0b38 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1428 microversion: 2.1 time: 1.147802 Oct 04 18:25:56.549093 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2663/5344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:55 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1428 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:57.505049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce48cb9c-90bc-42e8-a1d3-d527d1542e8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:57.506860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ce48cb9c-90bc-42e8-a1d3-d527d1542e8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:57.528196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce48cb9c-90bc-42e8-a1d3-d527d1542e8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.528742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce48cb9c-90bc-42e8-a1d3-d527d1542e8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.529291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce48cb9c-90bc-42e8-a1d3-d527d1542e8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.530395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce48cb9c-90bc-42e8-a1d3-d527d1542e8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.531151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce48cb9c-90bc-42e8-a1d3-d527d1542e8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.531687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce48cb9c-90bc-42e8-a1d3-d527d1542e8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.582594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b606dff0-9267-4abc-a86f-26815215565f tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:57.583542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b606dff0-9267-4abc-a86f-26815215565f tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:57.594351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b606dff0-9267-4abc-a86f-26815215565f tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.596115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b606dff0-9267-4abc-a86f-26815215565f tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.598906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b606dff0-9267-4abc-a86f-26815215565f tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.600044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b606dff0-9267-4abc-a86f-26815215565f tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.600769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b606dff0-9267-4abc-a86f-26815215565f tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.601454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b606dff0-9267-4abc-a86f-26815215565f tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.607411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:57.951985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce48cb9c-90bc-42e8-a1d3-d527d1542e8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:57.964922 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce48cb9c-90bc-42e8-a1d3-d527d1542e8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1682 microversion: 2.1 time: 0.464891 Oct 04 18:25:57.979693 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2682/5345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:57 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1682 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:57.980862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b606dff0-9267-4abc-a86f-26815215565f tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:58.002491 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b606dff0-9267-4abc-a86f-26815215565f tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1607 microversion: 2.1 time: 0.424694 Oct 04 18:25:58.003574 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2664/5346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:57 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1607 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:58.031547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7908542c-9f5e-4acf-8d02-56799acaba16 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:58.032188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7908542c-9f5e-4acf-8d02-56799acaba16 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:58.039731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7908542c-9f5e-4acf-8d02-56799acaba16 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.040479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7908542c-9f5e-4acf-8d02-56799acaba16 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.041709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7908542c-9f5e-4acf-8d02-56799acaba16 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.042686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7908542c-9f5e-4acf-8d02-56799acaba16 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.043517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7908542c-9f5e-4acf-8d02-56799acaba16 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.044131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7908542c-9f5e-4acf-8d02-56799acaba16 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.354334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7908542c-9f5e-4acf-8d02-56799acaba16 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:58.366893 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7908542c-9f5e-4acf-8d02-56799acaba16 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1607 microversion: 2.1 time: 0.342219 Oct 04 18:25:58.367789 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2683/5347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:58 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1607 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:58.395007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-725b080a-08b8-444a-a9fa-a7092e721abc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:58.395886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-725b080a-08b8-444a-a9fa-a7092e721abc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:58.404193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-725b080a-08b8-444a-a9fa-a7092e721abc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.406172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-725b080a-08b8-444a-a9fa-a7092e721abc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.408836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-725b080a-08b8-444a-a9fa-a7092e721abc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.410340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-725b080a-08b8-444a-a9fa-a7092e721abc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.410866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-725b080a-08b8-444a-a9fa-a7092e721abc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.415546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-725b080a-08b8-444a-a9fa-a7092e721abc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.994101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-79b43207-dbe6-4e7d-afea-b9c27a2eb86a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:58.995810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-79b43207-dbe6-4e7d-afea-b9c27a2eb86a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:59.010264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79b43207-dbe6-4e7d-afea-b9c27a2eb86a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:59.013641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79b43207-dbe6-4e7d-afea-b9c27a2eb86a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:59.014378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79b43207-dbe6-4e7d-afea-b9c27a2eb86a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:59.015401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79b43207-dbe6-4e7d-afea-b9c27a2eb86a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:59.018278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79b43207-dbe6-4e7d-afea-b9c27a2eb86a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:59.019085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79b43207-dbe6-4e7d-afea-b9c27a2eb86a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:59.947590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-79b43207-dbe6-4e7d-afea-b9c27a2eb86a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:59.963746 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-79b43207-dbe6-4e7d-afea-b9c27a2eb86a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.974763 Oct 04 18:25:59.979883 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2684/5348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:58 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:00.056549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-725b080a-08b8-444a-a9fa-a7092e721abc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:00.069812 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-725b080a-08b8-444a-a9fa-a7092e721abc tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1607 microversion: 2.1 time: 1.677869 Oct 04 18:26:00.071570 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2665/5349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:58 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1607 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:01.218497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-611f6811-5125-4a5f-923a-316890176d77 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:01.221972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-611f6811-5125-4a5f-923a-316890176d77 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:01.232849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-611f6811-5125-4a5f-923a-316890176d77 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:01.233660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-611f6811-5125-4a5f-923a-316890176d77 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:01.234288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-611f6811-5125-4a5f-923a-316890176d77 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:01.235234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-611f6811-5125-4a5f-923a-316890176d77 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:01.235882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-611f6811-5125-4a5f-923a-316890176d77 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:01.236516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-611f6811-5125-4a5f-923a-316890176d77 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:01.614464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b242a712-9b21-4a43-8068-83a2762f462a req-95e6f13f-a7ad-4c7b-8dac-90faf3a3bc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1681ab-db4a-4528-99da-649ffa9a93a0", "name": "network-vif-unplugged", "status": "completed", "tag": "2d48ba84-42ef-46d1-b6ba-69e426d07f1c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:01.620129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-611f6811-5125-4a5f-923a-316890176d77 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:01.632597 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-611f6811-5125-4a5f-923a-316890176d77 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.418422 Oct 04 18:26:01.650333 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2685/5350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:01 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:01.656400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b242a712-9b21-4a43-8068-83a2762f462a req-95e6f13f-a7ad-4c7b-8dac-90faf3a3bc20 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:01.664107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b242a712-9b21-4a43-8068-83a2762f462a req-95e6f13f-a7ad-4c7b-8dac-90faf3a3bc20 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:01.664925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b242a712-9b21-4a43-8068-83a2762f462a req-95e6f13f-a7ad-4c7b-8dac-90faf3a3bc20 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:01.695690 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b242a712-9b21-4a43-8068-83a2762f462a req-95e6f13f-a7ad-4c7b-8dac-90faf3a3bc20 service nova] Creating event network-vif-unplugged:2d48ba84-42ef-46d1-b6ba-69e426d07f1c for instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 on n-h2-850499-14 Oct 04 18:26:01.707837 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b242a712-9b21-4a43-8068-83a2762f462a req-95e6f13f-a7ad-4c7b-8dac-90faf3a3bc20 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097143 Oct 04 18:26:01.710743 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2666/5351] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:03.935291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2875cc81-4c14-42bd-88dd-9fa484daff6f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:03.937496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2875cc81-4c14-42bd-88dd-9fa484daff6f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:03.946858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2875cc81-4c14-42bd-88dd-9fa484daff6f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:03.947764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2875cc81-4c14-42bd-88dd-9fa484daff6f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:03.948641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2875cc81-4c14-42bd-88dd-9fa484daff6f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:03.949531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2875cc81-4c14-42bd-88dd-9fa484daff6f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:03.950517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2875cc81-4c14-42bd-88dd-9fa484daff6f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:03.951150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2875cc81-4c14-42bd-88dd-9fa484daff6f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.347421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2875cc81-4c14-42bd-88dd-9fa484daff6f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:04.356029 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2875cc81-4c14-42bd-88dd-9fa484daff6f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.425958 Oct 04 18:26:04.357548 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2686/5352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:03 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:04.381194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8b8b042c-c8ca-4669-9021-70c7f6d1d1bd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:04.382244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8b8b042c-c8ca-4669-9021-70c7f6d1d1bd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:04.396192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b8b042c-c8ca-4669-9021-70c7f6d1d1bd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.396983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b8b042c-c8ca-4669-9021-70c7f6d1d1bd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.397736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b8b042c-c8ca-4669-9021-70c7f6d1d1bd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.399030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b8b042c-c8ca-4669-9021-70c7f6d1d1bd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.400643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b8b042c-c8ca-4669-9021-70c7f6d1d1bd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.401265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b8b042c-c8ca-4669-9021-70c7f6d1d1bd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.411774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-38734736", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": "none"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:04.759553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:26:04.759999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:26:04.760532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:26:04.762051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:26:04.762520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:26:04.767893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8b8b042c-c8ca-4669-9021-70c7f6d1d1bd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:04.775131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.775635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.776079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.777462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.777927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.778358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.782406 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8b8b042c-c8ca-4669-9021-70c7f6d1d1bd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.405182 Oct 04 18:26:04.783511 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2687/5353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:04 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:04.819959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5e6f95c0-755f-4099-9557-95d9ee82a26e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:04.821931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5e6f95c0-755f-4099-9557-95d9ee82a26e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:04.829198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Getting quotas for project 60c312743a8d44d797f471d27ec1ecf0. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:26:04.835314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Getting quotas for user 634fd1626eb24b958c42d2834f800721 and project 60c312743a8d44d797f471d27ec1ecf0. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:26:04.851820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e6f95c0-755f-4099-9557-95d9ee82a26e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.853517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:26:04.854267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e6f95c0-755f-4099-9557-95d9ee82a26e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.854865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e6f95c0-755f-4099-9557-95d9ee82a26e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.862772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e6f95c0-755f-4099-9557-95d9ee82a26e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.862772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e6f95c0-755f-4099-9557-95d9ee82a26e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.862772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e6f95c0-755f-4099-9557-95d9ee82a26e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.864378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:26:04.924545 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9d740726-6e06-40c2-9e2f-3a7629c0434c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.710426 Oct 04 18:26:04.929042 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2667/5354] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:26:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:26:04.942764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-177e591a-004b-473f-aebd-bef03bb07682 req-b72bbd6d-d8a2-4b9f-9b65-3620969eb75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df321891-81e0-43b2-8e9a-fdd610b9bad3", "tag": "187c1114-4c06-41d8-be5d-26034d3929ce"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:04.964068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-177e591a-004b-473f-aebd-bef03bb07682 req-b72bbd6d-d8a2-4b9f-9b65-3620969eb75e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.964568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-177e591a-004b-473f-aebd-bef03bb07682 req-b72bbd6d-d8a2-4b9f-9b65-3620969eb75e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.965011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-177e591a-004b-473f-aebd-bef03bb07682 req-b72bbd6d-d8a2-4b9f-9b65-3620969eb75e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.992715 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-177e591a-004b-473f-aebd-bef03bb07682 req-b72bbd6d-d8a2-4b9f-9b65-3620969eb75e service nova] Creating event network-changed:187c1114-4c06-41d8-be5d-26034d3929ce for instance df321891-81e0-43b2-8e9a-fdd610b9bad3 on n-h2-850499-14 Oct 04 18:26:04.999512 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-177e591a-004b-473f-aebd-bef03bb07682 req-b72bbd6d-d8a2-4b9f-9b65-3620969eb75e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068059 Oct 04 18:26:05.000568 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2668/5355] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:05.008941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ab79680-0b40-4260-bed7-68f788447de4 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:05.009735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ab79680-0b40-4260-bed7-68f788447de4 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:05.188456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ab79680-0b40-4260-bed7-68f788447de4 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:05.207901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ab79680-0b40-4260-bed7-68f788447de4 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:05.209479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ab79680-0b40-4260-bed7-68f788447de4 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:05.210943 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ab79680-0b40-4260-bed7-68f788447de4 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1276 microversion: 2.57 time: 0.208925 Oct 04 18:26:05.211291 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2669/5356] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:05 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:05.278989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5e6f95c0-755f-4099-9557-95d9ee82a26e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:05.289153 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5e6f95c0-755f-4099-9557-95d9ee82a26e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.480652 Oct 04 18:26:05.290598 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2688/5357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:04 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:05.317507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4db003ce-b2f1-4b39-ae0f-4b761a095149 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:05.320327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4db003ce-b2f1-4b39-ae0f-4b761a095149 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:05.329932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4db003ce-b2f1-4b39-ae0f-4b761a095149 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:05.331644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4db003ce-b2f1-4b39-ae0f-4b761a095149 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:05.332803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4db003ce-b2f1-4b39-ae0f-4b761a095149 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:05.334378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4db003ce-b2f1-4b39-ae0f-4b761a095149 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:05.335487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4db003ce-b2f1-4b39-ae0f-4b761a095149 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:05.336863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4db003ce-b2f1-4b39-ae0f-4b761a095149 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:05.519984 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4db003ce-b2f1-4b39-ae0f-4b761a095149 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.199042 Oct 04 18:26:05.521636 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2670/5358] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:05 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:26:05.537473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9caf5b8d-be82-48d0-83e6-021d816cf6b3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:05.541389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9caf5b8d-be82-48d0-83e6-021d816cf6b3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:05.552498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9caf5b8d-be82-48d0-83e6-021d816cf6b3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:05.553391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9caf5b8d-be82-48d0-83e6-021d816cf6b3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:05.554113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9caf5b8d-be82-48d0-83e6-021d816cf6b3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:05.555130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9caf5b8d-be82-48d0-83e6-021d816cf6b3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:05.555844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9caf5b8d-be82-48d0-83e6-021d816cf6b3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:05.556772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9caf5b8d-be82-48d0-83e6-021d816cf6b3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:06.038928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9caf5b8d-be82-48d0-83e6-021d816cf6b3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:06.048549 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9caf5b8d-be82-48d0-83e6-021d816cf6b3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1671 microversion: 2.1 time: 0.521204 Oct 04 18:26:06.051349 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2689/5359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:05 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1671 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:06.243983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:06.244697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:06.257826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:06.258338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:06.258783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:06.259709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:06.264177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:06.264898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:06.444089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:06.458844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:06.460737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:06.462578 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a335b570-0853-43e0-b77a-1c41dc8fba9d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1272 microversion: 2.57 time: 0.224181 Oct 04 18:26:06.473732 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2671/5360] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:06 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:07.075392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-38555199-7b00-4a37-81b6-36ed08b0da44 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:07.076662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-38555199-7b00-4a37-81b6-36ed08b0da44 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:07.085338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38555199-7b00-4a37-81b6-36ed08b0da44 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:07.085901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38555199-7b00-4a37-81b6-36ed08b0da44 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:07.086342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38555199-7b00-4a37-81b6-36ed08b0da44 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:07.087268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38555199-7b00-4a37-81b6-36ed08b0da44 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:07.087575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38555199-7b00-4a37-81b6-36ed08b0da44 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:07.087998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38555199-7b00-4a37-81b6-36ed08b0da44 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:07.498183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:07.499373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:07.510167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:07.510796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:07.511641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:07.512640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:07.513106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:07.513831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:07.559265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-38555199-7b00-4a37-81b6-36ed08b0da44 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:07.569023 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-38555199-7b00-4a37-81b6-36ed08b0da44 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1676 microversion: 2.1 time: 0.499125 Oct 04 18:26:07.570078 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2690/5361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:07 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1676 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:07.960771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:07.969290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:07.970753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:07.971933 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2daa2627-42c6-4158-8bd3-df9ec9c59388 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1334 microversion: 2.57 time: 0.478423 Oct 04 18:26:07.972716 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2672/5362] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:07 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1334 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:08.593816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04c7dddb-ffd0-4d84-8f67-5db589941e85 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:08.595322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-04c7dddb-ffd0-4d84-8f67-5db589941e85 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:08.603279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c7dddb-ffd0-4d84-8f67-5db589941e85 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:08.604049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c7dddb-ffd0-4d84-8f67-5db589941e85 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:08.605033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c7dddb-ffd0-4d84-8f67-5db589941e85 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:08.605767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c7dddb-ffd0-4d84-8f67-5db589941e85 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:08.606229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c7dddb-ffd0-4d84-8f67-5db589941e85 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:08.606990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04c7dddb-ffd0-4d84-8f67-5db589941e85 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:08.851957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-04c7dddb-ffd0-4d84-8f67-5db589941e85 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:08.860228 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04c7dddb-ffd0-4d84-8f67-5db589941e85 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.270358 Oct 04 18:26:08.860816 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2691/5363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:08 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:08.884502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a521d31c-8320-4470-a80c-4d61c44fea02 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:08.886783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a521d31c-8320-4470-a80c-4d61c44fea02 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:08.894186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a521d31c-8320-4470-a80c-4d61c44fea02 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:08.894931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a521d31c-8320-4470-a80c-4d61c44fea02 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:08.895409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a521d31c-8320-4470-a80c-4d61c44fea02 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:08.896122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a521d31c-8320-4470-a80c-4d61c44fea02 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:08.896595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a521d31c-8320-4470-a80c-4d61c44fea02 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:08.897021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a521d31c-8320-4470-a80c-4d61c44fea02 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:08.987437 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a521d31c-8320-4470-a80c-4d61c44fea02 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 200 len: 324 microversion: 2.1 time: 0.106734 Oct 04 18:26:08.988587 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2673/5364] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:08 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 324 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:08.998188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-de2b5b87-084f-4ff3-a452-6cae4104a19e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:08.999162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:09.000104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:09.000271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-de2b5b87-084f-4ff3-a452-6cae4104a19e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:09.008066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.008751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de2b5b87-084f-4ff3-a452-6cae4104a19e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.009328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de2b5b87-084f-4ff3-a452-6cae4104a19e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.010029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.010446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de2b5b87-084f-4ff3-a452-6cae4104a19e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.010854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.011778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.012398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.012886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de2b5b87-084f-4ff3-a452-6cae4104a19e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.013171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.013678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de2b5b87-084f-4ff3-a452-6cae4104a19e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.014225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de2b5b87-084f-4ff3-a452-6cae4104a19e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.137448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:09.146573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:09.148066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:09.150220 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6a8f6462-956d-4f36-b672-7a366cf1971c tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1334 microversion: 2.57 time: 0.155763 Oct 04 18:26:09.151131 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2674/5365] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:08 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1334 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:09.268222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-de2b5b87-084f-4ff3-a452-6cae4104a19e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:09.277337 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-de2b5b87-084f-4ff3-a452-6cae4104a19e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.282494 Oct 04 18:26:09.278290 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2692/5366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:08 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:09.311480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6eb4f98c-47d8-421d-ad3c-ad72514b549b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:09.312114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6eb4f98c-47d8-421d-ad3c-ad72514b549b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:09.319191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6eb4f98c-47d8-421d-ad3c-ad72514b549b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.319713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6eb4f98c-47d8-421d-ad3c-ad72514b549b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.320161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6eb4f98c-47d8-421d-ad3c-ad72514b549b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.320868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6eb4f98c-47d8-421d-ad3c-ad72514b549b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.321336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6eb4f98c-47d8-421d-ad3c-ad72514b549b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.321773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6eb4f98c-47d8-421d-ad3c-ad72514b549b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.612294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6eb4f98c-47d8-421d-ad3c-ad72514b549b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:09.621743 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6eb4f98c-47d8-421d-ad3c-ad72514b549b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.318627 Oct 04 18:26:09.622846 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2675/5367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:09 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:09.644963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fded6c15-0e24-44b7-8da4-457dc778702a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:09.645814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fded6c15-0e24-44b7-8da4-457dc778702a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:09.653311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fded6c15-0e24-44b7-8da4-457dc778702a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.653812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fded6c15-0e24-44b7-8da4-457dc778702a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.654583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fded6c15-0e24-44b7-8da4-457dc778702a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.655373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fded6c15-0e24-44b7-8da4-457dc778702a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.656074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fded6c15-0e24-44b7-8da4-457dc778702a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.656548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fded6c15-0e24-44b7-8da4-457dc778702a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.913722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fded6c15-0e24-44b7-8da4-457dc778702a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:09.922028 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fded6c15-0e24-44b7-8da4-457dc778702a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.280889 Oct 04 18:26:09.922749 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2693/5368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:09 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:09.944610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0f7a9ed5-2be8-4ab7-8959-d8295cf6ee24 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:09.945223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0f7a9ed5-2be8-4ab7-8959-d8295cf6ee24 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:09.952235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7a9ed5-2be8-4ab7-8959-d8295cf6ee24 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.952727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7a9ed5-2be8-4ab7-8959-d8295cf6ee24 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.953170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7a9ed5-2be8-4ab7-8959-d8295cf6ee24 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.953873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7a9ed5-2be8-4ab7-8959-d8295cf6ee24 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.954334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7a9ed5-2be8-4ab7-8959-d8295cf6ee24 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.954862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7a9ed5-2be8-4ab7-8959-d8295cf6ee24 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.120651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0f7a9ed5-2be8-4ab7-8959-d8295cf6ee24 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:10.129848 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0f7a9ed5-2be8-4ab7-8959-d8295cf6ee24 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.188991 Oct 04 18:26:10.131091 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2676/5369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:09 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:10.180666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:10.182324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:10.192669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.193918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.194820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.196264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.197873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.199581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.279919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:10.293997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1118282487", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "68212092-c97c-4a48-819f-9516513174c4"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:10.303773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:10.305354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:10.306609 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-50735ff6-024d-4cb2-9b9a-098c8027ff3a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1355 microversion: 2.57 time: 0.132635 Oct 04 18:26:10.307349 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2694/5370] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:10 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1355 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:10.332538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:10.335571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:10.342485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.343241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.343919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.344825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.345485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.346111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.365027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] validate_networks() for [('68212092-c97c-4a48-819f-9516513174c4', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:26:10.461015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:26:10.461752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:26:10.462513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:26:10.463131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:26:10.464245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:26:10.549869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:10.559201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.560073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.560977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.562063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.562692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.563311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.596807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:10.611183 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4323c749-a10b-4dc5-a0b3-bc8c00f352c8 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "POST /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04/action" status: 202 len: 1136 microversion: 2.57 time: 0.281991 Oct 04 18:26:10.629105 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2695/5371] 10.222.0.18 () {62 vars in 1320 bytes} [Tue Oct 4 18:26:10 2022] POST /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04/action => generated 1136 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 18:26:10.636410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-042483eb-80a2-401e-aa83-007ac08b91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:10.637219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-042483eb-80a2-401e-aa83-007ac08b91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:10.644585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-042483eb-80a2-401e-aa83-007ac08b91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.645080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-042483eb-80a2-401e-aa83-007ac08b91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.646146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-042483eb-80a2-401e-aa83-007ac08b91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.647135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-042483eb-80a2-401e-aa83-007ac08b91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.647771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-042483eb-80a2-401e-aa83-007ac08b91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.648205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-042483eb-80a2-401e-aa83-007ac08b91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.691694 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-042483eb-80a2-401e-aa83-007ac08b91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/ips" status: 200 len: 153 microversion: 2.20 time: 0.061194 Oct 04 18:26:10.702830 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2696/5372] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Oct 4 18:26:10 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/ips => generated 153 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:26:10.712732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:10.713373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:10.737058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.737722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.738184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.741241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.741734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.743457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.878936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:10.894107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:10.898097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:10.900751 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f9e2575-d9cd-44cf-87fb-6db0ee00311f tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.197901 Oct 04 18:26:10.910001 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2697/5373] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:10 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:10.921355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:26:10.921942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:26:10.922485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:26:10.922914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:26:10.923364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:26:10.936317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.936818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.938392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.940334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.941089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.941541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.983671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for project e2ee0993b0954950949c8afffb90617c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:26:10.994163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for user 6591acf0ba4648abac6cc8ac8ddd560e and project e2ee0993b0954950949c8afffb90617c. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:26:11.013708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:26:11.017703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:26:11.081266 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d90318e-820b-407f-a3d9-566045b6042d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791758 Oct 04 18:26:11.083717 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2677/5374] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:26:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:26:11.098565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2598afdf-2348-4dec-a2a1-8f16856b7122 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:11.102337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2598afdf-2348-4dec-a2a1-8f16856b7122 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:11.224860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2598afdf-2348-4dec-a2a1-8f16856b7122 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:11.232626 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2598afdf-2348-4dec-a2a1-8f16856b7122 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1215 microversion: 2.1 time: 0.141118 Oct 04 18:26:11.238463 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2698/5375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:11 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:11.939070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:11.939971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:11.951392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:11.954915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:11.955454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:11.956235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:11.956794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:11.957141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.072611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:12.081244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:12.083781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:12.085211 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bcb6fe8b-fc28-4da4-b32d-e1d46a68dc90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.151078 Oct 04 18:26:12.086386 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2678/5376] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:11 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:12.262337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-089852bf-ae01-45b0-8863-addfde9816d9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:12.262973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-089852bf-ae01-45b0-8863-addfde9816d9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:12.280889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-089852bf-ae01-45b0-8863-addfde9816d9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.281396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-089852bf-ae01-45b0-8863-addfde9816d9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.281837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-089852bf-ae01-45b0-8863-addfde9816d9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.282544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-089852bf-ae01-45b0-8863-addfde9816d9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.283024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-089852bf-ae01-45b0-8863-addfde9816d9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.283454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-089852bf-ae01-45b0-8863-addfde9816d9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.377039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-089852bf-ae01-45b0-8863-addfde9816d9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:12.386112 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-089852bf-ae01-45b0-8863-addfde9816d9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1267 microversion: 2.1 time: 0.128440 Oct 04 18:26:12.386696 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2699/5377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:12 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:13.114541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:13.115186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:13.124588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.126211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.126733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.127977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.128988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.129752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.217801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:13.233967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:13.236341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:13.238808 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-467dd745-02ed-4c72-a14d-b48a25a5d6de tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.128162 Oct 04 18:26:13.239846 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2679/5378] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:13 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:13.418344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27cabd6e-7f7c-432b-ab35-b3e2953f5f07 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:13.419932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27cabd6e-7f7c-432b-ab35-b3e2953f5f07 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:13.427297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27cabd6e-7f7c-432b-ab35-b3e2953f5f07 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.428089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27cabd6e-7f7c-432b-ab35-b3e2953f5f07 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.428719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27cabd6e-7f7c-432b-ab35-b3e2953f5f07 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.431236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27cabd6e-7f7c-432b-ab35-b3e2953f5f07 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.431871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27cabd6e-7f7c-432b-ab35-b3e2953f5f07 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.433037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27cabd6e-7f7c-432b-ab35-b3e2953f5f07 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.706019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27cabd6e-7f7c-432b-ab35-b3e2953f5f07 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:13.717945 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27cabd6e-7f7c-432b-ab35-b3e2953f5f07 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1315 microversion: 2.1 time: 0.312283 Oct 04 18:26:13.720245 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2700/5379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:13 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:13.936816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a0761725-353c-4d42-91ee-aaeb01b7d2bf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:13.938186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a0761725-353c-4d42-91ee-aaeb01b7d2bf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:13.945878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0761725-353c-4d42-91ee-aaeb01b7d2bf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.946555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0761725-353c-4d42-91ee-aaeb01b7d2bf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.947244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0761725-353c-4d42-91ee-aaeb01b7d2bf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.948509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0761725-353c-4d42-91ee-aaeb01b7d2bf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.949179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0761725-353c-4d42-91ee-aaeb01b7d2bf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.949795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0761725-353c-4d42-91ee-aaeb01b7d2bf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.985030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-a0761725-353c-4d42-91ee-aaeb01b7d2bf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lazy-loading 'flavor' on Instance uuid 9d39c1d8-8eed-462d-af88-bd613d502347 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:26:14.202890 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a0761725-353c-4d42-91ee-aaeb01b7d2bf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "POST /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/action" status: 202 len: 0 microversion: 2.20 time: 0.272633 Oct 04 18:26:14.204651 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2680/5380] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:26:13 2022] POST /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:26:14.219633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:14.219633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:14.223059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.223568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.224016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.224725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.225378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.225981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.265572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:14.278087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:14.288405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.289012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.289746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.290709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.291416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.292123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.683314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:14.688511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:14.695172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:14.696945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:14.698648 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d4d80e2-2bdb-4634-9a40-8825c628a0b5 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.437827 Oct 04 18:26:14.699589 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2681/5381] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:14 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:14.745875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2221d4e2-6015-495c-80a7-abdfed967d9a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:14.746512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2221d4e2-6015-495c-80a7-abdfed967d9a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:14.755129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2221d4e2-6015-495c-80a7-abdfed967d9a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.755642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2221d4e2-6015-495c-80a7-abdfed967d9a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.756137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2221d4e2-6015-495c-80a7-abdfed967d9a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.757152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2221d4e2-6015-495c-80a7-abdfed967d9a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.757623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2221d4e2-6015-495c-80a7-abdfed967d9a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.758061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2221d4e2-6015-495c-80a7-abdfed967d9a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.777420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:14.787694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:14.793110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:14.795403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-284ce3e5-934b-4657-b52e-d7ae0f4ddc21 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.586354 Oct 04 18:26:14.796263 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2701/5382] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:14 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:26:14.917405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fe7c8da0-e2c3-4029-83b6-b3d83b1094ec req-21cb81c0-b21b-4804-a398-64418eed46ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "085114e1-a9d6-41cb-9ac0-e45bf39fc5eb", "tag": "878f61ba-8bad-4710-adbb-aebf79b2e022"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:14.934687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fe7c8da0-e2c3-4029-83b6-b3d83b1094ec req-21cb81c0-b21b-4804-a398-64418eed46ab service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.935476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fe7c8da0-e2c3-4029-83b6-b3d83b1094ec req-21cb81c0-b21b-4804-a398-64418eed46ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.936168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fe7c8da0-e2c3-4029-83b6-b3d83b1094ec req-21cb81c0-b21b-4804-a398-64418eed46ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.950801 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fe7c8da0-e2c3-4029-83b6-b3d83b1094ec req-21cb81c0-b21b-4804-a398-64418eed46ab service nova] Creating event network-changed:878f61ba-8bad-4710-adbb-aebf79b2e022 for instance 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb on n-h1-850499-14 Oct 04 18:26:14.955988 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fe7c8da0-e2c3-4029-83b6-b3d83b1094ec req-21cb81c0-b21b-4804-a398-64418eed46ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043180 Oct 04 18:26:14.956780 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2702/5383] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:15.023854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2221d4e2-6015-495c-80a7-abdfed967d9a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:15.036118 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2221d4e2-6015-495c-80a7-abdfed967d9a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1315 microversion: 2.1 time: 0.291234 Oct 04 18:26:15.054105 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2682/5384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:14 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:15.726386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:15.727134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:15.733986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:15.734490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:15.734935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:15.735677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:15.736124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:15.736550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:15.805821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:15.816457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:15.818292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:15.819714 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d857eaae-0073-4b29-a609-4a94faa8df33 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.098497 Oct 04 18:26:15.820520 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2703/5385] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:15 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:15.822171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:15.822881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:15.830318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:15.830977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:15.831678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:15.832774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:15.833480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:15.834260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:15.991322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:16.002417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:16.004292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:16.005694 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-43fe3bd1-ed56-47ab-b5a2-f4c1d4e370bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.187937 Oct 04 18:26:16.007118 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2683/5386] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:15 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:26:16.064033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1520eba3-8bd4-4518-b150-2a022850c020 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:16.064935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1520eba3-8bd4-4518-b150-2a022850c020 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:16.072053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1520eba3-8bd4-4518-b150-2a022850c020 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:16.076426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1520eba3-8bd4-4518-b150-2a022850c020 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:16.076880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1520eba3-8bd4-4518-b150-2a022850c020 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:16.077612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1520eba3-8bd4-4518-b150-2a022850c020 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:16.078072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1520eba3-8bd4-4518-b150-2a022850c020 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:16.078526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1520eba3-8bd4-4518-b150-2a022850c020 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:16.231088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1520eba3-8bd4-4518-b150-2a022850c020 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:16.240801 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1520eba3-8bd4-4518-b150-2a022850c020 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1315 microversion: 2.1 time: 0.180938 Oct 04 18:26:16.242601 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2704/5387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:16 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:16.847550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:16.850790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:16.853937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:16.861597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:16.862530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:16.863325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:16.865712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:16.866387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:16.867038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:16.986939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:16.997642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:16.999140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:17.000392 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4af7d818-e25f-4473-99cb-07912fae2c7a tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.158733 Oct 04 18:26:17.015609 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2684/5388] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:16 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:17.032863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:17.034025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:17.043413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:17.044102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:17.044736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:17.046365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:17.047742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:17.048352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:17.204063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:17.213013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:17.215082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:17.216311 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a305e1a-6273-4203-9649-86a475c5f57a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.187954 Oct 04 18:26:17.217230 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2705/5389] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:17 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:17.265341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ea8bfc2-7cd3-4959-bcc8-8719566a8349 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:17.266642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8ea8bfc2-7cd3-4959-bcc8-8719566a8349 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:17.272780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ea8bfc2-7cd3-4959-bcc8-8719566a8349 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:17.273362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ea8bfc2-7cd3-4959-bcc8-8719566a8349 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:17.273963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ea8bfc2-7cd3-4959-bcc8-8719566a8349 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:17.274745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ea8bfc2-7cd3-4959-bcc8-8719566a8349 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:17.275349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ea8bfc2-7cd3-4959-bcc8-8719566a8349 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:17.275916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ea8bfc2-7cd3-4959-bcc8-8719566a8349 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:17.424081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8ea8bfc2-7cd3-4959-bcc8-8719566a8349 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:17.433299 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8ea8bfc2-7cd3-4959-bcc8-8719566a8349 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1315 microversion: 2.1 time: 0.171478 Oct 04 18:26:17.434513 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2685/5390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:17 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:18.027886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:18.028530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:18.035935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:18.037162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:18.037821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:18.038572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:18.039035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:18.039661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:18.112252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:18.121177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:18.122536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:18.123761 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f4dc16f0-5c7a-4d47-ab3f-3d62c5c56f15 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.100551 Oct 04 18:26:18.124722 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2706/5391] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:18 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:18.241483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:18.242671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:18.252940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:18.253549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:18.253976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:18.254701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:18.255194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:18.255849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:18.410529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:18.419971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:18.421775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:18.423231 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c21c4a11-f753-474a-a7d6-27584529a0c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.185925 Oct 04 18:26:18.423888 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2686/5392] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:18 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:18.459103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1f59e3d0-9fc8-4816-b7fc-67f2245587cc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:18.459887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1f59e3d0-9fc8-4816-b7fc-67f2245587cc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:18.467676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f59e3d0-9fc8-4816-b7fc-67f2245587cc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:18.468178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f59e3d0-9fc8-4816-b7fc-67f2245587cc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:18.469007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f59e3d0-9fc8-4816-b7fc-67f2245587cc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:18.470118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f59e3d0-9fc8-4816-b7fc-67f2245587cc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:18.470595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f59e3d0-9fc8-4816-b7fc-67f2245587cc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:18.471057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f59e3d0-9fc8-4816-b7fc-67f2245587cc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:18.622111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1f59e3d0-9fc8-4816-b7fc-67f2245587cc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:18.632513 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1f59e3d0-9fc8-4816-b7fc-67f2245587cc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1315 microversion: 2.1 time: 0.179623 Oct 04 18:26:18.647964 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2707/5393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:18 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:19.151557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:19.153042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:19.159541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.160049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.160609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.161967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.162433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.162872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.253266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:19.263029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:19.265237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:19.266752 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de0dfa9d-7686-450c-855b-df7b086b8afe tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.120961 Oct 04 18:26:19.268411 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2687/5394] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:19 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:19.449292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:19.449903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:19.457281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.458012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.458452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.459181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.459634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.460057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.606939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:19.616928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:19.620760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:19.622103 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d576ed85-5e6f-4f9b-b7b5-06ef0f49449c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.176687 Oct 04 18:26:19.627078 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2708/5395] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:19 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:19.662834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1719912d-1603-48e3-becd-432b801af8f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:19.664674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1719912d-1603-48e3-becd-432b801af8f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:19.674778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1719912d-1603-48e3-becd-432b801af8f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.676085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1719912d-1603-48e3-becd-432b801af8f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.676536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1719912d-1603-48e3-becd-432b801af8f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.677892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1719912d-1603-48e3-becd-432b801af8f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.678261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1719912d-1603-48e3-becd-432b801af8f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.678813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1719912d-1603-48e3-becd-432b801af8f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.908804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1719912d-1603-48e3-becd-432b801af8f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:19.917106 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1719912d-1603-48e3-becd-432b801af8f7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1315 microversion: 2.1 time: 0.258848 Oct 04 18:26:19.917689 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2688/5396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:19 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:20.292213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:20.292825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:20.298870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.299390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.299849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.300521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.300974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.301394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.370146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:20.378508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:20.380039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:20.381987 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-60f846b2-00fd-4099-9446-5617b9bed785 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.093653 Oct 04 18:26:20.382564 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2709/5397] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:20 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:26:20.650200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:20.650905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:20.659692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.660195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.660639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.661373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.661820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.662250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.854448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:20.868557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:20.870999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:20.872581 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b6d9aed3-3c24-4c8c-be87-219228d77d99 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.226308 Oct 04 18:26:20.873889 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2689/5398] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:20 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:20.911799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e90eda46-e7c1-42d5-833b-f4adb46f9830 req-51e1e3b1-99cf-4bac-b2ef-cfaf44008a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "085114e1-a9d6-41cb-9ac0-e45bf39fc5eb", "name": "network-vif-plugged", "status": "completed", "tag": "878f61ba-8bad-4710-adbb-aebf79b2e022"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:20.924741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e90eda46-e7c1-42d5-833b-f4adb46f9830 req-51e1e3b1-99cf-4bac-b2ef-cfaf44008a5e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.925774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e90eda46-e7c1-42d5-833b-f4adb46f9830 req-51e1e3b1-99cf-4bac-b2ef-cfaf44008a5e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.926587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e90eda46-e7c1-42d5-833b-f4adb46f9830 req-51e1e3b1-99cf-4bac-b2ef-cfaf44008a5e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.941541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d164b607-c555-4f8c-a595-9d75914c4a76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:20.942285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d164b607-c555-4f8c-a595-9d75914c4a76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:20.951939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d164b607-c555-4f8c-a595-9d75914c4a76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.954983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d164b607-c555-4f8c-a595-9d75914c4a76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.955741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d164b607-c555-4f8c-a595-9d75914c4a76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.956858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d164b607-c555-4f8c-a595-9d75914c4a76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.957401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d164b607-c555-4f8c-a595-9d75914c4a76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.958554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d164b607-c555-4f8c-a595-9d75914c4a76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.959105 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e90eda46-e7c1-42d5-833b-f4adb46f9830 req-51e1e3b1-99cf-4bac-b2ef-cfaf44008a5e service nova] Creating event network-vif-plugged:878f61ba-8bad-4710-adbb-aebf79b2e022 for instance 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb on n-h1-850499-14 Oct 04 18:26:20.960552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:20.972715 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e90eda46-e7c1-42d5-833b-f4adb46f9830 req-51e1e3b1-99cf-4bac-b2ef-cfaf44008a5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061490 Oct 04 18:26:20.973505 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2710/5399] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:21.008717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=14 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:21.148722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d164b607-c555-4f8c-a595-9d75914c4a76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:21.159896 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d164b607-c555-4f8c-a595-9d75914c4a76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1315 microversion: 2.1 time: 0.222583 Oct 04 18:26:21.161308 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2690/5400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:20 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:21.404362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:21.409648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:21.410885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:21.419235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:21.419736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:21.420329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:21.421135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:21.421701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:21.422034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:21.494690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:21.505987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:21.507896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:21.509197 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e74e7536-69b0-4491-a45c-b563f00f6ad6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.105751 Oct 04 18:26:21.509878 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2711/5401] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:21 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:21.900322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:21.901938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:21.910049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:21.910680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:21.911231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:21.912178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:21.912828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:21.913268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:22.059578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:22.069517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:22.071112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:22.072396 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2535aaca-f442-4344-86ec-bfbaf2b160af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.175970 Oct 04 18:26:22.073577 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2691/5402] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:21 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:22.186845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fec79bc5-9e99-4c44-a5c8-c03080d0d1ae tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:22.187497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fec79bc5-9e99-4c44-a5c8-c03080d0d1ae tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:22.197021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fec79bc5-9e99-4c44-a5c8-c03080d0d1ae tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:22.197531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fec79bc5-9e99-4c44-a5c8-c03080d0d1ae tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:22.198140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fec79bc5-9e99-4c44-a5c8-c03080d0d1ae tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:22.198722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fec79bc5-9e99-4c44-a5c8-c03080d0d1ae tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:22.199239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fec79bc5-9e99-4c44-a5c8-c03080d0d1ae tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:22.199676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fec79bc5-9e99-4c44-a5c8-c03080d0d1ae tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:22.354611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fec79bc5-9e99-4c44-a5c8-c03080d0d1ae tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:22.363006 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fec79bc5-9e99-4c44-a5c8-c03080d0d1ae tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1315 microversion: 2.1 time: 0.181114 Oct 04 18:26:22.364308 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2712/5403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:22 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:22.536587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:22.537202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:22.543308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:22.543803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:22.544434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:22.545135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:22.545772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:22.546259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:22.621039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:22.630350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:22.631799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:22.633181 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b975f398-c0b4-4f38-9996-5b66cf5c6ae2 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.100351 Oct 04 18:26:22.634207 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2692/5404] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:22 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:23.099155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:23.100091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:23.108152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.108912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.109540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.110436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.111193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.111629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.343223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:23.358259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:23.365688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:23.367163 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6cca649-31bd-4acd-aade-56a8ef302b3c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.273233 Oct 04 18:26:23.368021 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2713/5405] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:23 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:23.393949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f96081d0-2214-4a4d-88c4-930ae0048767 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:23.396483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f96081d0-2214-4a4d-88c4-930ae0048767 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:23.406035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96081d0-2214-4a4d-88c4-930ae0048767 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.406795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96081d0-2214-4a4d-88c4-930ae0048767 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.407625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96081d0-2214-4a4d-88c4-930ae0048767 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.408799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96081d0-2214-4a4d-88c4-930ae0048767 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.409540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96081d0-2214-4a4d-88c4-930ae0048767 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.410405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96081d0-2214-4a4d-88c4-930ae0048767 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.590813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f96081d0-2214-4a4d-88c4-930ae0048767 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:23.599174 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f96081d0-2214-4a4d-88c4-930ae0048767 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1502 microversion: 2.1 time: 0.214248 Oct 04 18:26:23.599758 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2693/5406] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:23 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:23.622151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba8044a1-2490-47f7-99ca-51b68d9a2374 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:23.628242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba8044a1-2490-47f7-99ca-51b68d9a2374 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.628742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba8044a1-2490-47f7-99ca-51b68d9a2374 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.629172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba8044a1-2490-47f7-99ca-51b68d9a2374 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.659387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:23.660717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:23.662524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba8044a1-2490-47f7-99ca-51b68d9a2374 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Going to try to stop instance {{(pid=122331) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:26:23.667882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.668598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.669038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.669741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.670364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.671160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.682506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:23.714863 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba8044a1-2490-47f7-99ca-51b68d9a2374 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb/action" status: 202 len: 0 microversion: 2.1 time: 0.095594 Oct 04 18:26:23.716118 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2714/5407] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:23 2022] POST /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:26:23.725584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba44f279-fd5e-4322-a13d-d380a1035339 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:23.726644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba44f279-fd5e-4322-a13d-d380a1035339 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:23.734335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44f279-fd5e-4322-a13d-d380a1035339 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.734748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44f279-fd5e-4322-a13d-d380a1035339 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.735220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44f279-fd5e-4322-a13d-d380a1035339 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.736096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44f279-fd5e-4322-a13d-d380a1035339 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.736820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44f279-fd5e-4322-a13d-d380a1035339 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.737558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44f279-fd5e-4322-a13d-d380a1035339 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.764212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:23.773183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:23.774750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:23.776045 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f4ac071f-6c5a-47e4-a22a-570e9b7872bc tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.120414 Oct 04 18:26:23.776612 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2694/5408] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:23 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:23.923871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ba44f279-fd5e-4322-a13d-d380a1035339 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:23.933119 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba44f279-fd5e-4322-a13d-d380a1035339 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.212730 Oct 04 18:26:23.946990 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2715/5409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:23 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:24.396487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:24.397067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:24.403966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:24.404523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:24.405160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:24.406139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:24.406778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:24.407416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:24.595051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:24.605537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:24.607128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:24.608555 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-86b5e8af-f6ff-4320-bb7e-9d21321e9e86 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.216296 Oct 04 18:26:24.609066 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2695/5410] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:24 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:24.803905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:24.804538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:24.808493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=78 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:24.814793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:24.815673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:24.816318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:24.817034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:24.817648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:24.818249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:24.892997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:24.904585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:24.906420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:24.908906 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34aaec6c-b8f0-469a-94d2-25eedd9d2d23 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.109559 Oct 04 18:26:24.910461 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2716/5411] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:24 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:24.961156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-28fbfa46-19db-40f9-a575-5479bd08d509 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:24.961796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-28fbfa46-19db-40f9-a575-5479bd08d509 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:24.970751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28fbfa46-19db-40f9-a575-5479bd08d509 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:24.971390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28fbfa46-19db-40f9-a575-5479bd08d509 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:24.971844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28fbfa46-19db-40f9-a575-5479bd08d509 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:24.972579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28fbfa46-19db-40f9-a575-5479bd08d509 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:24.973082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28fbfa46-19db-40f9-a575-5479bd08d509 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:24.973527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28fbfa46-19db-40f9-a575-5479bd08d509 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:25.129223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-28fbfa46-19db-40f9-a575-5479bd08d509 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:25.140778 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-28fbfa46-19db-40f9-a575-5479bd08d509 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.183032 Oct 04 18:26:25.142054 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2696/5412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:24 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:25.632799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:25.633357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:25.640035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:25.640530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:25.640973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:25.641736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:25.642240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:25.642673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:25.793711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:25.803792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:25.805377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:25.807165 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90655f5f-823e-4ff1-9840-75fca47830d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.177708 Oct 04 18:26:25.808149 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2717/5413] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:25 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:25.937220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:25.937841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:25.945008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:25.945570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:25.946058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:25.946948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:25.948122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:25.948728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:26.026105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:26.034345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:26.035835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:26.037018 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-95a5bf85-2ea1-4dfd-9e5c-f25d2a950098 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.104319 Oct 04 18:26:26.037588 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2697/5414] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:25 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:26.165430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e5e2cf81-a6e6-4646-ad2f-ded610850790 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:26.166050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e5e2cf81-a6e6-4646-ad2f-ded610850790 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:26.173770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5e2cf81-a6e6-4646-ad2f-ded610850790 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:26.174273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5e2cf81-a6e6-4646-ad2f-ded610850790 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:26.174717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5e2cf81-a6e6-4646-ad2f-ded610850790 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:26.175641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5e2cf81-a6e6-4646-ad2f-ded610850790 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:26.176275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5e2cf81-a6e6-4646-ad2f-ded610850790 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:26.176874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5e2cf81-a6e6-4646-ad2f-ded610850790 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:26.333367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5e2cf81-a6e6-4646-ad2f-ded610850790 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:26.346669 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e5e2cf81-a6e6-4646-ad2f-ded610850790 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.184632 Oct 04 18:26:26.348662 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2718/5415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:26 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:26.834647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:26.835564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:26.843387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:26.844422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:26.844745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:26.846121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:26.847203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:26.847651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:26.869327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:27.019738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:27.029789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:27.034666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:27.034666 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-923634f8-9689-44e8-b908-fdb806f7dedf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.202379 Oct 04 18:26:27.034666 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2698/5416] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:26 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:27.066541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:27.067271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:27.075649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:27.076535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:27.077047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:27.077925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:27.078653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:27.079321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:27.166811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:27.179995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:27.181734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:27.183620 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dd847044-dc80-4e73-b9e6-6ad9c19c3fc9 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.121322 Oct 04 18:26:27.184270 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2719/5417] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:27 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:27.374972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3e1b35d8-81e9-462e-9c5d-7b6eba42c71e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:27.376024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3e1b35d8-81e9-462e-9c5d-7b6eba42c71e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:27.383684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e1b35d8-81e9-462e-9c5d-7b6eba42c71e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:27.385383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e1b35d8-81e9-462e-9c5d-7b6eba42c71e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:27.386006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e1b35d8-81e9-462e-9c5d-7b6eba42c71e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:27.386886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e1b35d8-81e9-462e-9c5d-7b6eba42c71e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:27.387370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e1b35d8-81e9-462e-9c5d-7b6eba42c71e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:27.387991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e1b35d8-81e9-462e-9c5d-7b6eba42c71e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:27.543757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3e1b35d8-81e9-462e-9c5d-7b6eba42c71e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:27.552965 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3e1b35d8-81e9-462e-9c5d-7b6eba42c71e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.181645 Oct 04 18:26:27.553567 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2699/5418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:27 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:28.066131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:28.067103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:28.074764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:28.075497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:28.076040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:28.077364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:28.077895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:28.078393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:28.211440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:28.212946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:28.220714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:28.221126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:28.221570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:28.222396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:28.222861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:28.223320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:28.237450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:28.245888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:28.247643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:28.250161 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c324952b-a4f7-4a3b-85ff-53608308b6fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.188284 Oct 04 18:26:28.251517 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2720/5419] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:28 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:28.304933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:28.315512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:28.319903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:28.319903 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3e6c293f-49f7-4dae-bd60-4c29fc03c9d6 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.112928 Oct 04 18:26:28.319903 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2700/5420] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:28 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:26:28.576309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b09d0b0f-5a76-410d-9bf9-b4f583562d6c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:28.576990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b09d0b0f-5a76-410d-9bf9-b4f583562d6c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:28.584966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09d0b0f-5a76-410d-9bf9-b4f583562d6c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:28.585643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09d0b0f-5a76-410d-9bf9-b4f583562d6c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:28.586216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09d0b0f-5a76-410d-9bf9-b4f583562d6c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:28.587226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09d0b0f-5a76-410d-9bf9-b4f583562d6c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:28.587878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09d0b0f-5a76-410d-9bf9-b4f583562d6c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:28.589169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b09d0b0f-5a76-410d-9bf9-b4f583562d6c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:28.735376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b09d0b0f-5a76-410d-9bf9-b4f583562d6c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:28.749371 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b09d0b0f-5a76-410d-9bf9-b4f583562d6c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.176741 Oct 04 18:26:28.750134 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2721/5421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:28 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:29.278935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:29.279930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:29.288264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.289247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.289878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.291275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.291871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.292298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.348345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:29.348969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:29.357833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.358816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.359475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.360893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.361322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.362020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.488872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:29.507839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:29.514143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:29.517281 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0f1f51d4-730c-44d7-aa88-3ca2e8d39378 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.175881 Oct 04 18:26:29.520721 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2722/5422] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:29 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:26:29.589998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:29.603301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:29.605736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:29.607806 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ada517b-20cf-495a-b4a9-3b64f94ae4ca tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.333663 Oct 04 18:26:29.608663 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2701/5423] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:29 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:29.773770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-083a0435-71d3-410a-aee2-60ae8a201ab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:29.774398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-083a0435-71d3-410a-aee2-60ae8a201ab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:29.784401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-083a0435-71d3-410a-aee2-60ae8a201ab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.784997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-083a0435-71d3-410a-aee2-60ae8a201ab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.785448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-083a0435-71d3-410a-aee2-60ae8a201ab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.786167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-083a0435-71d3-410a-aee2-60ae8a201ab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.786627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-083a0435-71d3-410a-aee2-60ae8a201ab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.792091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-083a0435-71d3-410a-aee2-60ae8a201ab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.984485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-083a0435-71d3-410a-aee2-60ae8a201ab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:29.995478 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-083a0435-71d3-410a-aee2-60ae8a201ab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.225511 Oct 04 18:26:29.996663 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2723/5424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:29 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:30.547269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:30.547926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:30.556025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:30.558393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:30.559470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:30.560200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:30.560922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:30.561354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:30.635848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:30.636471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:30.651361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:30.652688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:30.654528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:30.656553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:30.657417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:30.660555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:30.670827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:30.680170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:30.682260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:30.683701 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5d00e43f-80dd-4081-b04c-05c058be3e24 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.140717 Oct 04 18:26:30.684783 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2702/5425] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:30 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:30.901765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:30.912542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:30.914286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:30.916377 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cc02a266-8850-41cb-b81c-51c5a2839c9b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.287171 Oct 04 18:26:30.916855 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2724/5426] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:30 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:26:31.027779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5e6f6a76-5ca7-4101-8403-7932ef7c0546 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:31.028427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5e6f6a76-5ca7-4101-8403-7932ef7c0546 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:31.039067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e6f6a76-5ca7-4101-8403-7932ef7c0546 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:31.039850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e6f6a76-5ca7-4101-8403-7932ef7c0546 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:31.040510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e6f6a76-5ca7-4101-8403-7932ef7c0546 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:31.041983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e6f6a76-5ca7-4101-8403-7932ef7c0546 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:31.042455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e6f6a76-5ca7-4101-8403-7932ef7c0546 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:31.042969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e6f6a76-5ca7-4101-8403-7932ef7c0546 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:31.322160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5e6f6a76-5ca7-4101-8403-7932ef7c0546 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:31.336365 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5e6f6a76-5ca7-4101-8403-7932ef7c0546 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.316222 Oct 04 18:26:31.337506 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2703/5427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:31 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:31.716359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:31.717821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:31.751935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:31.752695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:31.753616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:31.754841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:31.755847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:31.756497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:31.828275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:31.838258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:31.840444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:31.841852 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b85da5e0-d4a3-49ee-8fba-e09cbf963ec0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.132615 Oct 04 18:26:31.842624 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2725/5428] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:31 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:31.949862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:31.950623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:31.960080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:31.961073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:31.961771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:31.963055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:31.964022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:31.964892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.177286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:32.186724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:32.188467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:32.189769 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d39c2c1-6a23-4009-94d2-1c18b11898fe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1746 microversion: 2.20 time: 0.245466 Oct 04 18:26:32.190617 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2704/5429] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:31 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1746 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:32.367326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2aeaa970-6a61-4e68-ba77-37f1c79089db tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:32.368284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2aeaa970-6a61-4e68-ba77-37f1c79089db tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:32.381069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aeaa970-6a61-4e68-ba77-37f1c79089db tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:32.381776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aeaa970-6a61-4e68-ba77-37f1c79089db tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:32.382603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aeaa970-6a61-4e68-ba77-37f1c79089db tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.383399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aeaa970-6a61-4e68-ba77-37f1c79089db tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:32.383873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aeaa970-6a61-4e68-ba77-37f1c79089db tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:32.384311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2aeaa970-6a61-4e68-ba77-37f1c79089db tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.621648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2aeaa970-6a61-4e68-ba77-37f1c79089db tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:32.632705 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2aeaa970-6a61-4e68-ba77-37f1c79089db tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.272018 Oct 04 18:26:32.633620 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2726/5430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:32 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:32.870490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:32.870970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:32.877588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:32.878378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:32.879038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.879933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:32.880567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:32.881172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.960812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:32.973237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:32.975545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:32.977483 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-91fab8eb-da69-492e-8b23-e96fc65021ce tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.110758 Oct 04 18:26:32.978823 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2705/5431] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:32 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:33.216111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:33.217321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:33.224393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.225142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.225773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:33.226502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.227184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.227618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:33.457591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:33.474549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:33.478007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:33.480086 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-02c90973-0b6a-40d3-bd28-f6759ac1f249 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1746 microversion: 2.20 time: 0.267937 Oct 04 18:26:33.481689 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2727/5432] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:33 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1746 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:33.655954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5aae8fcf-b4ea-4e88-b4ce-73bd4dc9140b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:33.656575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5aae8fcf-b4ea-4e88-b4ce-73bd4dc9140b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:33.662913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5aae8fcf-b4ea-4e88-b4ce-73bd4dc9140b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.663704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5aae8fcf-b4ea-4e88-b4ce-73bd4dc9140b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.664151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5aae8fcf-b4ea-4e88-b4ce-73bd4dc9140b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:33.665084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5aae8fcf-b4ea-4e88-b4ce-73bd4dc9140b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.665751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5aae8fcf-b4ea-4e88-b4ce-73bd4dc9140b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.666265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5aae8fcf-b4ea-4e88-b4ce-73bd4dc9140b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:33.711482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4a0a883d-da61-44f2-963d-385c9e0c0bb6 req-244b48d8-80b9-4d24-8876-5801bc742cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d39c1d8-8eed-462d-af88-bd613d502347", "name": "network-vif-plugged", "status": "completed", "tag": "12e1280e-928a-4b59-9480-9e0bba1dd891"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:33.734066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4a0a883d-da61-44f2-963d-385c9e0c0bb6 req-244b48d8-80b9-4d24-8876-5801bc742cb3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.734556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4a0a883d-da61-44f2-963d-385c9e0c0bb6 req-244b48d8-80b9-4d24-8876-5801bc742cb3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.735012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4a0a883d-da61-44f2-963d-385c9e0c0bb6 req-244b48d8-80b9-4d24-8876-5801bc742cb3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:33.759417 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4a0a883d-da61-44f2-963d-385c9e0c0bb6 req-244b48d8-80b9-4d24-8876-5801bc742cb3 service nova] Creating event network-vif-plugged:12e1280e-928a-4b59-9480-9e0bba1dd891 for instance 9d39c1d8-8eed-462d-af88-bd613d502347 on n-h2-850499-14 Oct 04 18:26:33.774183 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4a0a883d-da61-44f2-963d-385c9e0c0bb6 req-244b48d8-80b9-4d24-8876-5801bc742cb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068088 Oct 04 18:26:33.774991 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2728/5433] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:33.845763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5aae8fcf-b4ea-4e88-b4ce-73bd4dc9140b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:33.858400 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5aae8fcf-b4ea-4e88-b4ce-73bd4dc9140b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.206012 Oct 04 18:26:33.872261 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2706/5434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:33 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:34.010619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:34.011019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:34.017723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.018352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.018904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.020241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.020241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.020847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.113760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:34.131798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:34.133692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:34.136361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4ac9f290-472d-48d4-a8f3-645585f10c08 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.133466 Oct 04 18:26:34.139053 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2729/5435] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:34 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:34.507856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:34.509101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:34.516680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.517429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.519096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.519810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.520478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.521125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.729665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:34.738345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:34.739964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:34.741260 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-55be74ca-434b-435a-a69f-8bcd04854432 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1746 microversion: 2.20 time: 0.238177 Oct 04 18:26:34.741925 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2707/5436] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:34 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1746 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:26:34.885908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f5f2967c-b714-47ec-9f6b-9d6ca6aa6d2e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:34.886543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f5f2967c-b714-47ec-9f6b-9d6ca6aa6d2e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:34.897530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5f2967c-b714-47ec-9f6b-9d6ca6aa6d2e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.898059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5f2967c-b714-47ec-9f6b-9d6ca6aa6d2e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.898508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5f2967c-b714-47ec-9f6b-9d6ca6aa6d2e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.899314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5f2967c-b714-47ec-9f6b-9d6ca6aa6d2e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.899788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5f2967c-b714-47ec-9f6b-9d6ca6aa6d2e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.900247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5f2967c-b714-47ec-9f6b-9d6ca6aa6d2e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:35.102562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f5f2967c-b714-47ec-9f6b-9d6ca6aa6d2e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:35.114356 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f5f2967c-b714-47ec-9f6b-9d6ca6aa6d2e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.234298 Oct 04 18:26:35.127459 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2730/5437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:34 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:35.168387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:35.169006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:35.175393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:35.175885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:35.176324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:35.177021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:35.177477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:35.177956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:35.250023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:35.259362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:35.261381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:35.263682 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-28a28ac8-49bc-4e9d-b016-3507df0d439d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.100120 Oct 04 18:26:35.264931 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2708/5438] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:35 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:35.768953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:35.769759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:35.777130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:35.777646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:35.781424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:35.781424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:35.781906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:35.782828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:35.809149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:35.949256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:35.959677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:35.961300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:35.962538 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f5467df5-07f6-4ff6-adb3-85b68b7628cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1746 microversion: 2.20 time: 0.197798 Oct 04 18:26:35.964039 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2731/5439] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:35 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1746 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:36.138203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-370f56a7-0662-4150-80da-5a8ec4a59504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:36.138821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-370f56a7-0662-4150-80da-5a8ec4a59504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:36.145957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370f56a7-0662-4150-80da-5a8ec4a59504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.146920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370f56a7-0662-4150-80da-5a8ec4a59504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.147660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370f56a7-0662-4150-80da-5a8ec4a59504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.148710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370f56a7-0662-4150-80da-5a8ec4a59504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.153270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370f56a7-0662-4150-80da-5a8ec4a59504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.153270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-370f56a7-0662-4150-80da-5a8ec4a59504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.296097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:36.297170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:36.306536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.306536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.307666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.308625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.309278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.309920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.386268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-370f56a7-0662-4150-80da-5a8ec4a59504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:36.408442 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-370f56a7-0662-4150-80da-5a8ec4a59504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.274300 Oct 04 18:26:36.409286 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2709/5440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:36 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:36.519905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:36.530720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:36.532215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:36.533833 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f068064-10e4-457b-aebd-aebdc57e6b11 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.245132 Oct 04 18:26:36.534584 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2732/5441] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:36 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:36.994343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:36.994972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:37.001911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:37.003054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:37.004554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:37.005480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:37.006197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:37.007532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:37.171123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:37.182647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:37.184324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:37.185511 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5f123077-1d81-47ae-8f71-2c88354974db tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1746 microversion: 2.20 time: 0.199410 Oct 04 18:26:37.192716 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2710/5442] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:36 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1746 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:37.444825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2528d365-7dd6-4b67-bb87-04cc00172ef3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:37.445496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2528d365-7dd6-4b67-bb87-04cc00172ef3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:37.453598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2528d365-7dd6-4b67-bb87-04cc00172ef3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:37.454447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2528d365-7dd6-4b67-bb87-04cc00172ef3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:37.455234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2528d365-7dd6-4b67-bb87-04cc00172ef3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:37.455943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2528d365-7dd6-4b67-bb87-04cc00172ef3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:37.456486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2528d365-7dd6-4b67-bb87-04cc00172ef3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:37.456997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2528d365-7dd6-4b67-bb87-04cc00172ef3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:37.563831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:37.564476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:37.571311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:37.572301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:37.573097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:37.574045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:37.574682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:37.575479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:37.666474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:37.674692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:37.676847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:37.678300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d6126f72-8f1b-4ef0-9ad1-7b79ded700da tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.118943 Oct 04 18:26:37.679195 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2711/5443] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:37 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:26:37.707561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2528d365-7dd6-4b67-bb87-04cc00172ef3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:37.717520 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2528d365-7dd6-4b67-bb87-04cc00172ef3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.286440 Oct 04 18:26:37.723609 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2733/5444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:37 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:38.211941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:38.212555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:38.222114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.222614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.223081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.224343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.224812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.225499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.505240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:38.537436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:38.539566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:38.542269 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a036749b-b4bd-4c13-81d8-c2d3e1a2f8cd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1746 microversion: 2.20 time: 0.334008 Oct 04 18:26:38.549287 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2712/5445] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:38 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1746 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:26:38.706895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:38.707580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:38.717681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.717681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.717681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.717994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.718693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.719411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.741600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eefa42ce-1f38-4965-8f8a-c7315f6a8d19 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:38.742273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eefa42ce-1f38-4965-8f8a-c7315f6a8d19 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:38.756836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eefa42ce-1f38-4965-8f8a-c7315f6a8d19 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.756836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eefa42ce-1f38-4965-8f8a-c7315f6a8d19 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.757248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eefa42ce-1f38-4965-8f8a-c7315f6a8d19 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.758360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eefa42ce-1f38-4965-8f8a-c7315f6a8d19 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.759169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eefa42ce-1f38-4965-8f8a-c7315f6a8d19 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.760308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eefa42ce-1f38-4965-8f8a-c7315f6a8d19 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.829397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:38.838822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:38.840536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:38.844286 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-43e78c3d-81f2-4d55-af96-e5a7c3e1c4e1 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.139567 Oct 04 18:26:38.844286 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2734/5446] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:38 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:38.985724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eefa42ce-1f38-4965-8f8a-c7315f6a8d19 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:38.997984 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eefa42ce-1f38-4965-8f8a-c7315f6a8d19 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.260287 Oct 04 18:26:38.998567 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2713/5447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:38 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:39.412804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80b8bc6a-dc69-45c4-a359-f3e582dc8d52 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89d10f33-be6c-4d13-bc12-1bed48e86471"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:39.415490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80b8bc6a-dc69-45c4-a359-f3e582dc8d52 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:39.422273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80b8bc6a-dc69-45c4-a359-f3e582dc8d52 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.422888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80b8bc6a-dc69-45c4-a359-f3e582dc8d52 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.423634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80b8bc6a-dc69-45c4-a359-f3e582dc8d52 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.424452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80b8bc6a-dc69-45c4-a359-f3e582dc8d52 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.425007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80b8bc6a-dc69-45c4-a359-f3e582dc8d52 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.425770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80b8bc6a-dc69-45c4-a359-f3e582dc8d52 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.573665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:39.574287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:39.596393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.596942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.597334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.598043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.598775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.599240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.822846 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-80b8bc6a-dc69-45c4-a359-f3e582dc8d52 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413004 Oct 04 18:26:39.824341 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2735/5448] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:26:39 2022] POST /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:39.834440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:39.844777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:39.849541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:39.850764 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3437cbd0-3992-42ed-acb5-6c973590f54f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1746 microversion: 2.20 time: 0.284973 Oct 04 18:26:39.851448 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2714/5449] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:39 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1746 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:39.869881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:39.871379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:39.882163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.882451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.882900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.883831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.884361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.885499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.990914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:40.001797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:40.005537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:40.006933 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ec5fdf8-fff7-4815-80c8-8f46d5258ed7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.142305 Oct 04 18:26:40.014612 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2736/5450] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:39 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:40.022880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d145499-eff6-4c71-b4c5-bca3612a629a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:40.023590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d145499-eff6-4c71-b4c5-bca3612a629a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:40.031097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d145499-eff6-4c71-b4c5-bca3612a629a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:40.031664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d145499-eff6-4c71-b4c5-bca3612a629a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:40.032178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d145499-eff6-4c71-b4c5-bca3612a629a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:40.032985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d145499-eff6-4c71-b4c5-bca3612a629a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:40.033510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d145499-eff6-4c71-b4c5-bca3612a629a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:40.034045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d145499-eff6-4c71-b4c5-bca3612a629a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:40.073255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:40.234184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d145499-eff6-4c71-b4c5-bca3612a629a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:40.244317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d145499-eff6-4c71-b4c5-bca3612a629a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.225477 Oct 04 18:26:40.246304 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2715/5451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:40 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:40.880286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:40.880909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:40.899553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:40.899553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:40.899553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:40.899553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:40.899553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:40.899553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.037918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:41.038549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:41.072824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.074919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.077031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.078088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.081028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.081754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.279002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:41.294491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:41.299207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:41.304722 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-06525570-e06b-4199-84dc-fc06c26d54d7 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.273645 Oct 04 18:26:41.307209 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2716/5452] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:41 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:41.357195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ad1ac1fe-a723-46a9-83c1-aaf08d74bbfa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:41.365514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:41.368638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ad1ac1fe-a723-46a9-83c1-aaf08d74bbfa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:41.376831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:41.383282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:41.388493 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f3b745a-84a8-4d48-9b82-3a2da05c4047 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.511962 Oct 04 18:26:41.402979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad1ac1fe-a723-46a9-83c1-aaf08d74bbfa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.402979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad1ac1fe-a723-46a9-83c1-aaf08d74bbfa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.403482 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2737/5453] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:40 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:26:41.403717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad1ac1fe-a723-46a9-83c1-aaf08d74bbfa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.403717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad1ac1fe-a723-46a9-83c1-aaf08d74bbfa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.403717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad1ac1fe-a723-46a9-83c1-aaf08d74bbfa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.403717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad1ac1fe-a723-46a9-83c1-aaf08d74bbfa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.707036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ad1ac1fe-a723-46a9-83c1-aaf08d74bbfa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:41.720971 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ad1ac1fe-a723-46a9-83c1-aaf08d74bbfa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.412462 Oct 04 18:26:41.722882 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2717/5454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:41 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:42.335012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:42.335710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:42.347136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.350300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.350756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.352021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.355178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.358240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.419739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:42.420228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:42.436392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.438098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.438780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.440694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.442831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.447901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.530355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:42.554680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:42.556341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:42.557572 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aa94aa5d-5c12-4532-b0ec-46412259f30d tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1364 microversion: 2.57 time: 0.226879 Oct 04 18:26:42.558142 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2738/5455] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:42 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:42.749679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bee6b5b6-0139-4e92-9723-e7c06a1e0abb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:42.750691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bee6b5b6-0139-4e92-9723-e7c06a1e0abb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:42.768833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bee6b5b6-0139-4e92-9723-e7c06a1e0abb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.772625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bee6b5b6-0139-4e92-9723-e7c06a1e0abb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.775622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:42.777429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bee6b5b6-0139-4e92-9723-e7c06a1e0abb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.781562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bee6b5b6-0139-4e92-9723-e7c06a1e0abb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.782576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bee6b5b6-0139-4e92-9723-e7c06a1e0abb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.787293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bee6b5b6-0139-4e92-9723-e7c06a1e0abb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.803751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:42.806050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:42.810318 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a3632c86-b556-4a4f-b39b-b49c113da4d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.395969 Oct 04 18:26:42.813919 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2718/5456] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:42 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:43.028121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bee6b5b6-0139-4e92-9723-e7c06a1e0abb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:43.045061 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bee6b5b6-0139-4e92-9723-e7c06a1e0abb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.299177 Oct 04 18:26:43.050901 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2739/5457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:42 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:43.590394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:43.591795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:43.603781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.607226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.607974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.609127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.609820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.610880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.743354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:43.773804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:43.780119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:43.785211 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0021c63c-aa32-467c-b091-202ff15bc88b tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1370 microversion: 2.57 time: 0.201138 Oct 04 18:26:43.787526 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2719/5458] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:43 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:43.840838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:43.842208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:43.868243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.870526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.872988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.875944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.880960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.883024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:44.080701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c0d321d5-ea19-4063-b10f-1e2d932166d5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:44.081869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c0d321d5-ea19-4063-b10f-1e2d932166d5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:44.109690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0d321d5-ea19-4063-b10f-1e2d932166d5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:44.112034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0d321d5-ea19-4063-b10f-1e2d932166d5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:44.114076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0d321d5-ea19-4063-b10f-1e2d932166d5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:44.117350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0d321d5-ea19-4063-b10f-1e2d932166d5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:44.122135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0d321d5-ea19-4063-b10f-1e2d932166d5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:44.122804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0d321d5-ea19-4063-b10f-1e2d932166d5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:44.627588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:44.641614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:44.644840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:44.648034 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4ef35baf-667c-4c4e-9ac0-82377fddae93 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.813523 Oct 04 18:26:44.652566 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2740/5459] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:43 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:44.700382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c0d321d5-ea19-4063-b10f-1e2d932166d5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:44.710041 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c0d321d5-ea19-4063-b10f-1e2d932166d5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.635676 Oct 04 18:26:44.712260 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2720/5460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:44 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:44.816709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:44.817634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:44.831893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:44.832404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:44.839521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:44.840586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:44.843231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:44.847139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.015650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:45.031073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:45.033224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:45.034807 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7551f6e0-4b6c-4410-b88a-7c1a889b9176 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1370 microversion: 2.57 time: 0.221987 Oct 04 18:26:45.036225 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2741/5461] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:44 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:45.684180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:45.685186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:45.703015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.706032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.706699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.709068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.709858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.710521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.738607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-48256623-0353-49eb-ab5b-c778fc595560 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:45.739537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-48256623-0353-49eb-ab5b-c778fc595560 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:45.748470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48256623-0353-49eb-ab5b-c778fc595560 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.750369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48256623-0353-49eb-ab5b-c778fc595560 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.751660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48256623-0353-49eb-ab5b-c778fc595560 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.753258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48256623-0353-49eb-ab5b-c778fc595560 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.755792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48256623-0353-49eb-ab5b-c778fc595560 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.757070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48256623-0353-49eb-ab5b-c778fc595560 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:46.340288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-48256623-0353-49eb-ab5b-c778fc595560 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:46.347666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:46.362499 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-48256623-0353-49eb-ab5b-c778fc595560 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.628794 Oct 04 18:26:46.364830 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2742/5462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:45 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:46.366285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:46.367743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:46.369495 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e697ae60-d46e-4c95-82f7-295848b40c02 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.690785 Oct 04 18:26:46.372505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:46.373578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:46.381728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:46.382945 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2721/5463] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:45 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:46.383815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:46.386074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:46.387261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:46.388012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:46.388811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:46.990946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:47.008171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:47.011841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:47.014055 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c812bf85-f33a-4778-bcec-6ef7fac6ac90 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1355 microversion: 2.57 time: 0.647833 Oct 04 18:26:47.016886 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2743/5464] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:46 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1355 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:47.054926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-943cc55a-532a-478a-8298-a700184b4540 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:47.055568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-943cc55a-532a-478a-8298-a700184b4540 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:47.065302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=76 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:47.085399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-943cc55a-532a-478a-8298-a700184b4540 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.088135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-943cc55a-532a-478a-8298-a700184b4540 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.089331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-943cc55a-532a-478a-8298-a700184b4540 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.090504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-943cc55a-532a-478a-8298-a700184b4540 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.091527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-943cc55a-532a-478a-8298-a700184b4540 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.094615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-943cc55a-532a-478a-8298-a700184b4540 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.179476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-943cc55a-532a-478a-8298-a700184b4540 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:26:47.419933 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-943cc55a-532a-478a-8298-a700184b4540 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 204 len: 0 microversion: 2.57 time: 0.369482 Oct 04 18:26:47.421179 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2722/5465] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:26:47 2022] DELETE /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:26:47.445528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:47.448044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:47.476410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.478806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.486084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.489322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.490279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.490783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.896703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c41b057b-5d9a-4845-813d-fc03092c581e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:47.897512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c41b057b-5d9a-4845-813d-fc03092c581e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:47.906546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c41b057b-5d9a-4845-813d-fc03092c581e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.907911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c41b057b-5d9a-4845-813d-fc03092c581e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.908631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c41b057b-5d9a-4845-813d-fc03092c581e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.910038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c41b057b-5d9a-4845-813d-fc03092c581e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.938897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c41b057b-5d9a-4845-813d-fc03092c581e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.940830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c41b057b-5d9a-4845-813d-fc03092c581e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.612673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:48.628829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:48.634543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:48.641831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c41b057b-5d9a-4845-813d-fc03092c581e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:48.647215 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c85f3dc1-d177-4522-8d0e-75cea6bb8c48 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 1.224532 Oct 04 18:26:48.647819 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2723/5466] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:47 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:48.680750 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c41b057b-5d9a-4845-813d-fc03092c581e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 1.290584 Oct 04 18:26:48.688797 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2744/5467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:47 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:48.691591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:48.692458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:48.701337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:48.702175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:48.702841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.714980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:48.722050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:48.723828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.910603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:48.942832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:48.944668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:48.948963 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eafdbbac-2054-4415-83e2-51b7e70505f0 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1361 microversion: 2.57 time: 0.300017 Oct 04 18:26:48.953468 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2724/5468] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:48 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:49.679108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:49.679905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:49.699592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:49.701098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:49.704366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:49.705850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:49.706339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:49.706782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:49.716540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c32a28ed-2364-4870-9bd1-a547e897d923 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:49.717294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c32a28ed-2364-4870-9bd1-a547e897d923 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:49.738362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32a28ed-2364-4870-9bd1-a547e897d923 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:49.738782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32a28ed-2364-4870-9bd1-a547e897d923 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:49.739238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32a28ed-2364-4870-9bd1-a547e897d923 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:49.740857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32a28ed-2364-4870-9bd1-a547e897d923 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:49.741816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32a28ed-2364-4870-9bd1-a547e897d923 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:49.743388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c32a28ed-2364-4870-9bd1-a547e897d923 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.145597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:50.162374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:50.164181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:50.164361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c32a28ed-2364-4870-9bd1-a547e897d923 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:50.166251 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ff50d68-4298-4dfc-8ea2-f4cf6d08efec tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.492151 Oct 04 18:26:50.167044 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2745/5469] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:49 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:50.183479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:50.184425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:50.200662 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c32a28ed-2364-4870-9bd1-a547e897d923 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.486071 Oct 04 18:26:50.201584 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2725/5470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:49 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:50.214129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.214566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.215061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.215785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.216254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.216690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.356900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:50.360777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:50.367833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:50.371960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634fd1626eb24b958c42d2834f800721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c312743a8d44d797f471d27ec1ecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:50.374164 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be752ad7-c8ba-4fe5-9978-770e6f705874 tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 200 len: 1361 microversion: 2.57 time: 0.198025 Oct 04 18:26:50.375156 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2746/5471] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:50 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:51.195895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:51.196720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:51.209921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:51.210580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:51.211188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:51.212004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:51.213113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:51.214503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:51.233268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9adee44b-649c-4dc1-9da6-46bbc56fe431 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:51.234569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9adee44b-649c-4dc1-9da6-46bbc56fe431 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:51.261358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9adee44b-649c-4dc1-9da6-46bbc56fe431 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:51.261842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9adee44b-649c-4dc1-9da6-46bbc56fe431 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:51.262374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9adee44b-649c-4dc1-9da6-46bbc56fe431 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:51.271798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9adee44b-649c-4dc1-9da6-46bbc56fe431 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:51.272374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9adee44b-649c-4dc1-9da6-46bbc56fe431 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:51.272842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9adee44b-649c-4dc1-9da6-46bbc56fe431 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:51.641476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:51.652382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:51.654410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:51.656215 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f69a2b52-bb2f-4abc-a490-1f5cb10cde9a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.464501 Oct 04 18:26:51.659264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9adee44b-649c-4dc1-9da6-46bbc56fe431 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:51.668408 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9adee44b-649c-4dc1-9da6-46bbc56fe431 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.442778 Oct 04 18:26:51.671378 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2726/5472] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:51 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:51.672109 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2747/5473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:51 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:51.679600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:51.680235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] [instance: d4357347-8524-4eb4-ae39-96633f167c04] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:51.687461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:51.687972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:51.688418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:51.689133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:51.689633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:51.690027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:51.706727 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] HTTP exception thrown: Instance d4357347-8524-4eb4-ae39-96633f167c04 could not be found. Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Request method failure captured: Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 HTTP/1.1 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHq8GKVwIkF4IK1vsgQXUCdIcQAOmPpy2fOqPXDFsLaRHfz5JWp9281kRri31daWIvekgXl3VM4I66yHVsCATMe4oTTR7DwzaxJyUEXF7abQ1CX3oFDqToL0LiedP79mC7G2J5cNluqjGuZUQL2uABLl7U5L8lnCP6wrY4RHK5LSz3A Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 60c312743a8d44d797f471d27ec1ecf0 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerShowV257Test-1954687325 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_60c312743a8d44d797f471d27ec1ecf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/60c312743a8d44d797f471d27ec1ecf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/60c312743a8d44d797f471d27ec1ecf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/60c312743a8d44d797f471d27ec1ecf0"}]}] Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerShowV257Test-1954687325 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 60c312743a8d44d797f471d27ec1ecf0 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerShowV257Test-1954687325 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerShowV257Test-1954687325-project Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 634fd1626eb24b958c42d2834f800721 Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerShowV257Test-1954687325-project Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance d4357347-8524-4eb4-ae39-96633f167c04 could not be found. Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'd4357347-8524-4eb4-ae39-96633f167c04'} Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4357347-8524-4eb4-ae39-96633f167c04 could not be found. Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4357347-8524-4eb4-ae39-96633f167c04 could not be found. Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:51.708983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:26:51.714621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:51.714621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:51.714621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:51.714621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:51.714621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:51.714621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4357347-8524-4eb4-ae39-96633f167c04 could not be found. Oct 04 18:26:51.714621 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:26:51.716732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] Returning 404 to user: Instance d4357347-8524-4eb4-ae39-96633f167c04 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:51.717851 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee4e3018-a88d-40b6-a1fe-512b80f4aa0e tempest-ServerShowV257Test-1954687325 tempest-ServerShowV257Test-1954687325-project] 10.222.0.18 "GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04" status: 404 len: 111 microversion: 2.57 time: 0.045420 Oct 04 18:26:51.718666 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2727/5474] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:51 2022] GET /compute/v2.1/servers/d4357347-8524-4eb4-ae39-96633f167c04 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:26:52.687395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:52.689586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:52.698407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bffe4ae0-30a9-49dd-946c-70b99157c296 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:52.700061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bffe4ae0-30a9-49dd-946c-70b99157c296 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:52.704473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:52.709370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:52.709978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:52.713690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:52.717229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:52.718211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:52.724976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bffe4ae0-30a9-49dd-946c-70b99157c296 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:52.726035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bffe4ae0-30a9-49dd-946c-70b99157c296 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:52.731946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bffe4ae0-30a9-49dd-946c-70b99157c296 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:52.736834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bffe4ae0-30a9-49dd-946c-70b99157c296 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:52.737920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bffe4ae0-30a9-49dd-946c-70b99157c296 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:52.744181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bffe4ae0-30a9-49dd-946c-70b99157c296 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:53.371697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:53.385037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:53.387743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:53.392499 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-59201711-2a6d-4e09-969d-8a1f9e4bff01 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.711847 Oct 04 18:26:53.394945 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2748/5475] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:52 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:53.590504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bffe4ae0-30a9-49dd-946c-70b99157c296 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:53.604802 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bffe4ae0-30a9-49dd-946c-70b99157c296 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1512 microversion: 2.1 time: 0.905508 Oct 04 18:26:53.616687 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2728/5476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:52 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1512 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:54.425798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:54.426442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:54.462762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:54.463308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:54.463763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:54.464571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:54.464941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:54.465372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:54.637919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f78275c6-cb4e-48b3-bd1d-8cae6a0cdd3a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:54.639924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f78275c6-cb4e-48b3-bd1d-8cae6a0cdd3a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:54.657369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78275c6-cb4e-48b3-bd1d-8cae6a0cdd3a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:54.660850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78275c6-cb4e-48b3-bd1d-8cae6a0cdd3a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:54.664705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78275c6-cb4e-48b3-bd1d-8cae6a0cdd3a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:54.673037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78275c6-cb4e-48b3-bd1d-8cae6a0cdd3a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:54.674083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78275c6-cb4e-48b3-bd1d-8cae6a0cdd3a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:54.674853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f78275c6-cb4e-48b3-bd1d-8cae6a0cdd3a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:55.199965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f78275c6-cb4e-48b3-bd1d-8cae6a0cdd3a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:55.218159 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f78275c6-cb4e-48b3-bd1d-8cae6a0cdd3a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1489 microversion: 2.1 time: 0.585997 Oct 04 18:26:55.223263 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2729/5477] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:54 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1489 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:55.251290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-001f6a7f-8f75-4d7e-889a-b7d3cb6b781f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:55.254477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-001f6a7f-8f75-4d7e-889a-b7d3cb6b781f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:55.276150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-001f6a7f-8f75-4d7e-889a-b7d3cb6b781f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:55.279649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-001f6a7f-8f75-4d7e-889a-b7d3cb6b781f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:55.283245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-001f6a7f-8f75-4d7e-889a-b7d3cb6b781f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:55.286666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-001f6a7f-8f75-4d7e-889a-b7d3cb6b781f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:55.290781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-001f6a7f-8f75-4d7e-889a-b7d3cb6b781f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:55.291796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-001f6a7f-8f75-4d7e-889a-b7d3cb6b781f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:55.462734 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-001f6a7f-8f75-4d7e-889a-b7d3cb6b781f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 200 len: 200 microversion: 2.1 time: 0.214759 Oct 04 18:26:55.463420 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2730/5478] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:55 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 200 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:55.474806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-11510e03-29dc-4c55-9397-1eb6d7a1a131 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:55.475618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-11510e03-29dc-4c55-9397-1eb6d7a1a131 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:55.489366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11510e03-29dc-4c55-9397-1eb6d7a1a131 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:55.490287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11510e03-29dc-4c55-9397-1eb6d7a1a131 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:55.491170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11510e03-29dc-4c55-9397-1eb6d7a1a131 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:55.492192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11510e03-29dc-4c55-9397-1eb6d7a1a131 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:55.492876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11510e03-29dc-4c55-9397-1eb6d7a1a131 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:55.494196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11510e03-29dc-4c55-9397-1eb6d7a1a131 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:55.502340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:56.003529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-11510e03-29dc-4c55-9397-1eb6d7a1a131 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:56.018650 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-11510e03-29dc-4c55-9397-1eb6d7a1a131 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.548071 Oct 04 18:26:56.036321 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2731/5479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:55 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:56.036321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2be1124e-f647-43bc-9cd5-380d53ddaa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:56.036321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2be1124e-f647-43bc-9cd5-380d53ddaa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:56.051139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2be1124e-f647-43bc-9cd5-380d53ddaa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.051663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2be1124e-f647-43bc-9cd5-380d53ddaa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.052125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2be1124e-f647-43bc-9cd5-380d53ddaa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.054208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2be1124e-f647-43bc-9cd5-380d53ddaa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.054700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2be1124e-f647-43bc-9cd5-380d53ddaa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.055184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2be1124e-f647-43bc-9cd5-380d53ddaa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.114692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-2be1124e-f647-43bc-9cd5-380d53ddaa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lazy-loading 'flavor' on Instance uuid 66ac8a47-83c9-442a-a1a4-6e09347c397a {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:26:56.164414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:56.175349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:56.176879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:56.178192 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-379c8c46-bb90-4a0c-b861-ce5b4fd5a728 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 1.757930 Oct 04 18:26:56.178750 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2749/5480] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:54 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:56.185508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2501a4d6-7960-4bec-944f-13b617d5a056 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:56.186927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2501a4d6-7960-4bec-944f-13b617d5a056 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:56.192970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=68 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:56.195638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2501a4d6-7960-4bec-944f-13b617d5a056 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.196422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2501a4d6-7960-4bec-944f-13b617d5a056 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.197550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2501a4d6-7960-4bec-944f-13b617d5a056 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.198452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2501a4d6-7960-4bec-944f-13b617d5a056 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.199159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2501a4d6-7960-4bec-944f-13b617d5a056 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.199768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2501a4d6-7960-4bec-944f-13b617d5a056 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.366603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2501a4d6-7960-4bec-944f-13b617d5a056 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:56.375444 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2501a4d6-7960-4bec-944f-13b617d5a056 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.195279 Oct 04 18:26:56.379899 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2750/5481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:56 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:56.414750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e94d2e99-f3ce-45a2-8ad4-8f9bba89f403 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:56.418844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e94d2e99-f3ce-45a2-8ad4-8f9bba89f403 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:56.426398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e94d2e99-f3ce-45a2-8ad4-8f9bba89f403 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.426891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e94d2e99-f3ce-45a2-8ad4-8f9bba89f403 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.427369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e94d2e99-f3ce-45a2-8ad4-8f9bba89f403 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.428079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e94d2e99-f3ce-45a2-8ad4-8f9bba89f403 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.428542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e94d2e99-f3ce-45a2-8ad4-8f9bba89f403 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.452419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e94d2e99-f3ce-45a2-8ad4-8f9bba89f403 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.525855 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2be1124e-f647-43bc-9cd5-380d53ddaa05 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/action" status: 200 len: 32 microversion: 2.1 time: 0.500137 Oct 04 18:26:56.527686 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2732/5482] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:56 2022] POST /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/action => generated 32 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:26:56.572534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-554bf9ad-fca4-42e7-9c7b-7470465c417c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:56.576843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-554bf9ad-fca4-42e7-9c7b-7470465c417c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:56.597016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554bf9ad-fca4-42e7-9c7b-7470465c417c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.598797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554bf9ad-fca4-42e7-9c7b-7470465c417c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.599690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554bf9ad-fca4-42e7-9c7b-7470465c417c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.604817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554bf9ad-fca4-42e7-9c7b-7470465c417c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.605495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554bf9ad-fca4-42e7-9c7b-7470465c417c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.607013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554bf9ad-fca4-42e7-9c7b-7470465c417c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:57.081812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e94d2e99-f3ce-45a2-8ad4-8f9bba89f403 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:57.095553 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e94d2e99-f3ce-45a2-8ad4-8f9bba89f403 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.683121 Oct 04 18:26:57.096424 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2751/5483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:56 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:57.128854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db38cfe9-f5ba-4b94-8205-b2e94e1e0ab3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:57.135098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-db38cfe9-f5ba-4b94-8205-b2e94e1e0ab3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:57.146323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db38cfe9-f5ba-4b94-8205-b2e94e1e0ab3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:57.150044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db38cfe9-f5ba-4b94-8205-b2e94e1e0ab3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:57.155885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db38cfe9-f5ba-4b94-8205-b2e94e1e0ab3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:57.156977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db38cfe9-f5ba-4b94-8205-b2e94e1e0ab3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:57.157641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db38cfe9-f5ba-4b94-8205-b2e94e1e0ab3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:57.158248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db38cfe9-f5ba-4b94-8205-b2e94e1e0ab3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:57.261213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-554bf9ad-fca4-42e7-9c7b-7470465c417c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:57.284169 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-554bf9ad-fca4-42e7-9c7b-7470465c417c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.737498 Oct 04 18:26:57.284839 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2733/5484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:56 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:57.301597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:57.303732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:57.327697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:57.329019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:57.329795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:57.336373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:57.338461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:57.339929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:57.527381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-db38cfe9-f5ba-4b94-8205-b2e94e1e0ab3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:57.537107 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-db38cfe9-f5ba-4b94-8205-b2e94e1e0ab3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.415356 Oct 04 18:26:57.544356 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2752/5485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:57 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:57.713984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-530283763", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "68212092-c97c-4a48-819f-9516513174c4"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:57.785905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] validate_networks() for [('68212092-c97c-4a48-819f-9516513174c4', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:26:57.996582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:58.015035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:58.016536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:58.017794 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2b3e724c-0f56-4f6d-9bc9-f940554d5703 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.731974 Oct 04 18:26:58.033161 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2734/5486] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:57 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:58.043814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d66ec532-c925-45ed-bd14-d9d7045755f3 tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d0bc7ee0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:58.155897 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d66ec532-c925-45ed-bd14-d9d7045755f3 tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e9cf5ce2-cafe-48ee-b6d0-dc53c1d87d63" status: 200 len: 351 microversion: 2.1 time: 0.135740 Oct 04 18:26:58.164086 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2735/5487] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:26:58 2022] GET /compute/v2.1/os-volumes/e9cf5ce2-cafe-48ee-b6d0-dc53c1d87d63 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:58.309621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-47e24714-985c-4bc1-a94c-f8198dfa4acf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:58.310447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-47e24714-985c-4bc1-a94c-f8198dfa4acf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:58.322788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47e24714-985c-4bc1-a94c-f8198dfa4acf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:58.323363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47e24714-985c-4bc1-a94c-f8198dfa4acf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:58.325368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47e24714-985c-4bc1-a94c-f8198dfa4acf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:58.326110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47e24714-985c-4bc1-a94c-f8198dfa4acf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:58.326787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47e24714-985c-4bc1-a94c-f8198dfa4acf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:58.329879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47e24714-985c-4bc1-a94c-f8198dfa4acf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:58.744779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-47e24714-985c-4bc1-a94c-f8198dfa4acf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:58.757883 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-47e24714-985c-4bc1-a94c-f8198dfa4acf tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.451822 Oct 04 18:26:58.767600 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2736/5488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:58 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:58.819042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:26:58.819541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:26:58.819949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:26:58.820637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:26:58.821181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:26:58.834040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:58.834796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:58.835471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:58.836473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:58.837801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:58.838455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:58.865534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for project e2ee0993b0954950949c8afffb90617c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:26:58.872498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for user 6591acf0ba4648abac6cc8ac8ddd560e and project e2ee0993b0954950949c8afffb90617c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:26:58.889668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:26:58.892740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:26:58.987476 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d0f9b37-c67c-4987-b4ab-6565f8f7dc5f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.279297 Oct 04 18:26:59.001761 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2753/5489] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:26:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:26:59.002512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4591ac0-eb41-4506-8de8-7d504d6860b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:59.003922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f4591ac0-eb41-4506-8de8-7d504d6860b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:59.049214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:59.049834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:59.058622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:59.059202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:59.059651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:59.060376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:59.061082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:59.072063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:59.115075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f4591ac0-eb41-4506-8de8-7d504d6860b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:59.127550 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f4591ac0-eb41-4506-8de8-7d504d6860b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1214 microversion: 2.1 time: 0.130218 Oct 04 18:26:59.130313 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2737/5490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:58 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:59.803146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ba0dc8c8-5a36-45c3-beb5-5cef04a01f37 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:59.803772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ba0dc8c8-5a36-45c3-beb5-5cef04a01f37 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:59.816809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba0dc8c8-5a36-45c3-beb5-5cef04a01f37 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:59.817307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba0dc8c8-5a36-45c3-beb5-5cef04a01f37 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:59.818087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba0dc8c8-5a36-45c3-beb5-5cef04a01f37 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:59.818440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba0dc8c8-5a36-45c3-beb5-5cef04a01f37 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:59.818895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba0dc8c8-5a36-45c3-beb5-5cef04a01f37 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:59.826814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba0dc8c8-5a36-45c3-beb5-5cef04a01f37 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:00.303436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ba0dc8c8-5a36-45c3-beb5-5cef04a01f37 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:00.303436 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ba0dc8c8-5a36-45c3-beb5-5cef04a01f37 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.507237 Oct 04 18:27:00.303436 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2738/5491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:59 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:00.312519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:00.328610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:00.333269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ab0d946-5910-4ac5-8643-f367b7ce522d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:00.334696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6ab0d946-5910-4ac5-8643-f367b7ce522d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:00.335486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:00.339441 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-00ab8954-e906-40eb-a5ec-f72d65cbf3f5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 1.294023 Oct 04 18:27:00.352549 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2754/5492] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:26:59 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:00.433941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6ab0d946-5910-4ac5-8643-f367b7ce522d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:00.442520 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6ab0d946-5910-4ac5-8643-f367b7ce522d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1214 microversion: 2.1 time: 0.124005 Oct 04 18:27:00.447910 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2739/5493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:00 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:00.873779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eea42afe-2133-45c0-94c6-c0a16e30ee1d tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d0a24940>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:00.958336 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eea42afe-2133-45c0-94c6-c0a16e30ee1d tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5967fbf3-81b9-4099-8491-4a29b006d362" status: 200 len: 350 microversion: 2.1 time: 0.090828 Oct 04 18:27:00.959424 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2755/5494] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:27:00 2022] GET /compute/v2.1/os-volumes/5967fbf3-81b9-4099-8491-4a29b006d362 => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:01.331739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-91cb02d1-588b-463c-a493-354e2c058226 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:01.332813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-91cb02d1-588b-463c-a493-354e2c058226 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:01.349240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91cb02d1-588b-463c-a493-354e2c058226 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:01.349759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91cb02d1-588b-463c-a493-354e2c058226 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:01.350215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91cb02d1-588b-463c-a493-354e2c058226 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:01.353783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91cb02d1-588b-463c-a493-354e2c058226 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:01.361503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91cb02d1-588b-463c-a493-354e2c058226 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:01.361972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-91cb02d1-588b-463c-a493-354e2c058226 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:01.379882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:01.379882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:01.408846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:01.409913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:01.411548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:01.419368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:01.421196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:01.424093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:01.841980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-91cb02d1-588b-463c-a493-354e2c058226 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:01.851770 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-91cb02d1-588b-463c-a493-354e2c058226 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.526860 Oct 04 18:27:01.871956 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2740/5495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:01 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:01.882208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f294564f-204d-4dc9-82e5-08058e670caa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:01.885920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f294564f-204d-4dc9-82e5-08058e670caa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:01.895588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f294564f-204d-4dc9-82e5-08058e670caa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:01.901608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f294564f-204d-4dc9-82e5-08058e670caa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:01.902362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f294564f-204d-4dc9-82e5-08058e670caa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:01.903394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f294564f-204d-4dc9-82e5-08058e670caa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:01.904030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f294564f-204d-4dc9-82e5-08058e670caa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:01.907515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f294564f-204d-4dc9-82e5-08058e670caa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:01.920497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:01.937905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:01.948512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:01.954294 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f642583-7e9a-45fd-8548-3415d8d0ed38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.586802 Oct 04 18:27:01.962611 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2756/5496] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:01 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:02.033007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f294564f-204d-4dc9-82e5-08058e670caa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:02.043874 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f294564f-204d-4dc9-82e5-08058e670caa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1266 microversion: 2.1 time: 0.170683 Oct 04 18:27:02.048525 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2741/5497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:01 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:02.884722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a8f8778b-29b5-4486-aacf-982c2b79e755 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:02.886872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a8f8778b-29b5-4486-aacf-982c2b79e755 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:02.903753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f8778b-29b5-4486-aacf-982c2b79e755 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:02.904702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f8778b-29b5-4486-aacf-982c2b79e755 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:02.905456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f8778b-29b5-4486-aacf-982c2b79e755 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:02.906992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f8778b-29b5-4486-aacf-982c2b79e755 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:02.907699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f8778b-29b5-4486-aacf-982c2b79e755 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:02.908372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f8778b-29b5-4486-aacf-982c2b79e755 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:02.995360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:02.996596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:03.005012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:03.005993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:03.006681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:03.008341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:03.009717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:03.010401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:03.589287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a8f8778b-29b5-4486-aacf-982c2b79e755 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:03.592874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:03.601783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:03.604677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:03.605908 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d1edc8d-b885-4834-8e1f-143ea8895d4d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.616524 Oct 04 18:27:03.606472 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2742/5498] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:02 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:03.611591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0dfa37bb-27d3-4267-9d93-b9e0fced1e62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:03.613041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0dfa37bb-27d3-4267-9d93-b9e0fced1e62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:03.620651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0dfa37bb-27d3-4267-9d93-b9e0fced1e62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:03.620883 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a8f8778b-29b5-4486-aacf-982c2b79e755 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.740698 Oct 04 18:27:03.621569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0dfa37bb-27d3-4267-9d93-b9e0fced1e62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:03.622192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0dfa37bb-27d3-4267-9d93-b9e0fced1e62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:03.623124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0dfa37bb-27d3-4267-9d93-b9e0fced1e62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:03.623981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0dfa37bb-27d3-4267-9d93-b9e0fced1e62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:03.624601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0dfa37bb-27d3-4267-9d93-b9e0fced1e62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:03.633536 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2757/5499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:02 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:03.769596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0dfa37bb-27d3-4267-9d93-b9e0fced1e62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:03.781278 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0dfa37bb-27d3-4267-9d93-b9e0fced1e62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1272 microversion: 2.1 time: 0.173511 Oct 04 18:27:03.784371 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2743/5500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:03 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:03.882364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c340b65f-164e-4e80-a9f2-2aa2c1ee7cd3 tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d0aae310>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:03.990192 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c340b65f-164e-4e80-a9f2-2aa2c1ee7cd3 tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1611e121-f56d-450c-a60b-d9f4ba48aff1" status: 200 len: 350 microversion: 2.1 time: 0.112936 Oct 04 18:27:03.991476 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2758/5501] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:27:03 2022] GET /compute/v2.1/os-volumes/1611e121-f56d-450c-a60b-d9f4ba48aff1 => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:04.005136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de0e07af-fa1a-46ad-83e7-2793b549195d tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d0bc70d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.109293 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de0e07af-fa1a-46ad-83e7-2793b549195d tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.108630 Oct 04 18:27:04.109877 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2744/5502] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Oct 4 18:27:03 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:04.127063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-97a45281-09c5-4554-9566-cef2e7867702 tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d0ab73a0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.230065 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-97a45281-09c5-4554-9566-cef2e7867702 tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.107500 Oct 04 18:27:04.239505 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2759/5503] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 4 18:27:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:04.245103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aee1add3-337c-4a4e-a22d-3bf92e56e5ac tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d0bd8160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.339648 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aee1add3-337c-4a4e-a22d-3bf92e56e5ac tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.098398 Oct 04 18:27:04.340238 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2745/5504] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Oct 4 18:27:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:04.355586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ffd906a-6249-4eb6-bdd3-3d2e0c6d4ecf tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d09faca0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.456115 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ffd906a-6249-4eb6-bdd3-3d2e0c6d4ecf tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104962 Oct 04 18:27:04.460033 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2760/5505] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 4 18:27:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:04.472173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-54d1f3be-9b6c-45ba-af2a-b5e75d62cae8 tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d0bd8af0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.591314 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-54d1f3be-9b6c-45ba-af2a-b5e75d62cae8 tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.122871 Oct 04 18:27:04.592263 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2746/5506] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 4 18:27:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:04.607722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c29a8386-93f5-4a82-a9d9-0df0f288627d tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d0aab1f0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.636961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.638054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:04.651512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:04.652791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:04.653436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:04.656068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:04.656742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:04.660947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:04.759492 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c29a8386-93f5-4a82-a9d9-0df0f288627d tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.155155 Oct 04 18:27:04.760386 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2761/5507] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:27:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:04.778019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7e06634-89fe-4b50-9dcc-884e593177d8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.779794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a7e06634-89fe-4b50-9dcc-884e593177d8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:04.789789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e06634-89fe-4b50-9dcc-884e593177d8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:04.790818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e06634-89fe-4b50-9dcc-884e593177d8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:04.791673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e06634-89fe-4b50-9dcc-884e593177d8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:04.792668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e06634-89fe-4b50-9dcc-884e593177d8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:04.793433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e06634-89fe-4b50-9dcc-884e593177d8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:04.794817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e06634-89fe-4b50-9dcc-884e593177d8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:05.094267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:05.115353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:05.117751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:05.121000 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-634f260c-c725-4ca8-9de4-ada41cbf314b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1741 microversion: 2.20 time: 0.488153 Oct 04 18:27:05.122368 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2747/5508] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:04 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1741 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:05.128887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-977e88fc-c67d-420e-81a8-ad25fcc3f9e8 tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d0bc7310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:05.201466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a7e06634-89fe-4b50-9dcc-884e593177d8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:05.213086 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a7e06634-89fe-4b50-9dcc-884e593177d8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.441119 Oct 04 18:27:05.213953 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2762/5509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:04 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:05.231533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2e9e8145-995c-4b99-b89d-b4e4964115a6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:05.232173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2e9e8145-995c-4b99-b89d-b4e4964115a6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:05.244185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e9e8145-995c-4b99-b89d-b4e4964115a6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:05.245134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e9e8145-995c-4b99-b89d-b4e4964115a6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:05.245912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e9e8145-995c-4b99-b89d-b4e4964115a6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:05.246888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e9e8145-995c-4b99-b89d-b4e4964115a6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:05.248575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e9e8145-995c-4b99-b89d-b4e4964115a6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:05.249168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e9e8145-995c-4b99-b89d-b4e4964115a6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:05.264519 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-977e88fc-c67d-420e-81a8-ad25fcc3f9e8 tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.140284 Oct 04 18:27:05.266498 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2748/5510] 10.222.0.18 () {58 vars in 1188 bytes} [Tue Oct 4 18:27:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:05.280651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac44e6cb-5295-421b-affd-8347d850424c tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] Calling method '.version_select at 0x7fd4d0c0f670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:05.375647 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac44e6cb-5295-421b-affd-8347d850424c tempest-VolumesTestJSON-1690612087 tempest-VolumesTestJSON-1690612087-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.098737 Oct 04 18:27:05.383013 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2749/5511] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:27:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:05.586848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2e9e8145-995c-4b99-b89d-b4e4964115a6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:05.597100 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2e9e8145-995c-4b99-b89d-b4e4964115a6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.381870 Oct 04 18:27:05.597983 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2763/5512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:05 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:06.158132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:06.158796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:06.173990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:06.175213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:06.176043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:06.177945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:06.179556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:06.180292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:06.236765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8dfe57f3-b278-456a-9996-64d16eb5f33a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:06.237467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8dfe57f3-b278-456a-9996-64d16eb5f33a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:06.252022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dfe57f3-b278-456a-9996-64d16eb5f33a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:06.252964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dfe57f3-b278-456a-9996-64d16eb5f33a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:06.253645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dfe57f3-b278-456a-9996-64d16eb5f33a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:06.254610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dfe57f3-b278-456a-9996-64d16eb5f33a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:06.266474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dfe57f3-b278-456a-9996-64d16eb5f33a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:06.267410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dfe57f3-b278-456a-9996-64d16eb5f33a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:06.683745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:06.702815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:06.707429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:06.710731 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-85bd8713-25c9-4a4e-990a-8650f76a68c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1723 microversion: 2.20 time: 0.557886 Oct 04 18:27:06.712536 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2750/5513] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:06 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1723 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:06.735155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22fd0682-19f0-430a-9456-4087a8627779 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:06.736079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-22fd0682-19f0-430a-9456-4087a8627779 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:06.751843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fd0682-19f0-430a-9456-4087a8627779 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:06.754921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fd0682-19f0-430a-9456-4087a8627779 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:06.756657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fd0682-19f0-430a-9456-4087a8627779 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:06.759536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fd0682-19f0-430a-9456-4087a8627779 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:06.765035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fd0682-19f0-430a-9456-4087a8627779 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:06.766329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fd0682-19f0-430a-9456-4087a8627779 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:06.990757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8dfe57f3-b278-456a-9996-64d16eb5f33a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:07.019017 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8dfe57f3-b278-456a-9996-64d16eb5f33a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.785897 Oct 04 18:27:07.019653 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2764/5514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:06 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:07.031696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d19053b0-90d6-4d64-bc20-f3c87a9e995c req-3875b263-d162-4a0a-9231-870824a7cafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991828cf-e0c5-4fa4-8235-1ffcf017fac8", "tag": "3678b817-c85d-449f-b74c-c69d2558aaf7"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:07.046598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d19053b0-90d6-4d64-bc20-f3c87a9e995c req-3875b263-d162-4a0a-9231-870824a7cafd service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:07.047924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d19053b0-90d6-4d64-bc20-f3c87a9e995c req-3875b263-d162-4a0a-9231-870824a7cafd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:07.048639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d19053b0-90d6-4d64-bc20-f3c87a9e995c req-3875b263-d162-4a0a-9231-870824a7cafd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:07.072694 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d19053b0-90d6-4d64-bc20-f3c87a9e995c req-3875b263-d162-4a0a-9231-870824a7cafd service nova] Creating event network-changed:3678b817-c85d-449f-b74c-c69d2558aaf7 for instance 991828cf-e0c5-4fa4-8235-1ffcf017fac8 on n-h2-850499-14 Oct 04 18:27:07.078789 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d19053b0-90d6-4d64-bc20-f3c87a9e995c req-3875b263-d162-4a0a-9231-870824a7cafd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050872 Oct 04 18:27:07.079502 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2765/5515] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:07.304788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-22fd0682-19f0-430a-9456-4087a8627779 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:07.330476 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22fd0682-19f0-430a-9456-4087a8627779 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.613898 Oct 04 18:27:07.332126 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2751/5516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:06 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:07.729041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fe75db24-6d46-43ca-8b10-1cd9bb205a6c req-4820bd8c-470a-44ad-b18b-e0108a36de0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d39c1d8-8eed-462d-af88-bd613d502347", "name": "network-vif-unplugged", "status": "completed", "tag": "12e1280e-928a-4b59-9480-9e0bba1dd891"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:07.749367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:07.750676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:07.770588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fe75db24-6d46-43ca-8b10-1cd9bb205a6c req-4820bd8c-470a-44ad-b18b-e0108a36de0f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:07.771004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:07.776432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fe75db24-6d46-43ca-8b10-1cd9bb205a6c req-4820bd8c-470a-44ad-b18b-e0108a36de0f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:07.777378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:07.777916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:07.778894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fe75db24-6d46-43ca-8b10-1cd9bb205a6c req-4820bd8c-470a-44ad-b18b-e0108a36de0f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:07.780385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:07.780931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:07.781382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:07.809735 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fe75db24-6d46-43ca-8b10-1cd9bb205a6c req-4820bd8c-470a-44ad-b18b-e0108a36de0f service nova] Creating event network-vif-unplugged:12e1280e-928a-4b59-9480-9e0bba1dd891 for instance 9d39c1d8-8eed-462d-af88-bd613d502347 on n-h2-850499-14 Oct 04 18:27:07.825508 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fe75db24-6d46-43ca-8b10-1cd9bb205a6c req-4820bd8c-470a-44ad-b18b-e0108a36de0f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103061 Oct 04 18:27:07.826898 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2766/5517] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:08.050502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1913c5de-6a4e-4be1-9d72-42223add6c43 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:08.053715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1913c5de-6a4e-4be1-9d72-42223add6c43 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:08.066555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1913c5de-6a4e-4be1-9d72-42223add6c43 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.067695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1913c5de-6a4e-4be1-9d72-42223add6c43 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.068935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1913c5de-6a4e-4be1-9d72-42223add6c43 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.070467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1913c5de-6a4e-4be1-9d72-42223add6c43 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.074605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1913c5de-6a4e-4be1-9d72-42223add6c43 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.075481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1913c5de-6a4e-4be1-9d72-42223add6c43 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.076123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:08.096525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:08.100439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:08.102761 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-721b7f06-7691-427b-902d-e07fa709bc8b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1723 microversion: 2.20 time: 0.359769 Oct 04 18:27:08.115955 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2752/5518] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:07 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:08.284206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1913c5de-6a4e-4be1-9d72-42223add6c43 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:08.295200 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1913c5de-6a4e-4be1-9d72-42223add6c43 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.252493 Oct 04 18:27:08.308394 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2767/5519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:08 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:08.375156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc5a7da6-f99e-4c12-b859-c62b12d6bb3d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:08.376161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc5a7da6-f99e-4c12-b859-c62b12d6bb3d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:08.395297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc5a7da6-f99e-4c12-b859-c62b12d6bb3d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.395812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc5a7da6-f99e-4c12-b859-c62b12d6bb3d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.396270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc5a7da6-f99e-4c12-b859-c62b12d6bb3d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.396988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc5a7da6-f99e-4c12-b859-c62b12d6bb3d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.397951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc5a7da6-f99e-4c12-b859-c62b12d6bb3d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.399735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc5a7da6-f99e-4c12-b859-c62b12d6bb3d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.664237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dc5a7da6-f99e-4c12-b859-c62b12d6bb3d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:08.667820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:08.673611 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc5a7da6-f99e-4c12-b859-c62b12d6bb3d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.312656 Oct 04 18:27:08.674427 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2753/5520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:08 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:09.129503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:09.130142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:09.133146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:09.134083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:09.147533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:09.148825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:09.149965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.151762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:09.153610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:09.155869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.327349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-72dfa499-1c33-4693-98a7-76a14b9cdff2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:09.328273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-72dfa499-1c33-4693-98a7-76a14b9cdff2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:09.340835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72dfa499-1c33-4693-98a7-76a14b9cdff2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:09.347577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72dfa499-1c33-4693-98a7-76a14b9cdff2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:09.348786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72dfa499-1c33-4693-98a7-76a14b9cdff2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.349839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72dfa499-1c33-4693-98a7-76a14b9cdff2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:09.350588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72dfa499-1c33-4693-98a7-76a14b9cdff2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:09.351306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72dfa499-1c33-4693-98a7-76a14b9cdff2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.453437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:09.466402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:09.473578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:09.475264 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9f827ac9-049d-49ba-b4e7-df4149e856b0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1726 microversion: 2.20 time: 0.349547 Oct 04 18:27:09.476073 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2768/5521] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:09 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1726 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:09.508516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-387e88a2-08f4-4348-af1d-9842c9a87a97 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1aa478d0-355f-4a6c-98bf-d07481520423"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:09.513613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-387e88a2-08f4-4348-af1d-9842c9a87a97 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:09.526670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-387e88a2-08f4-4348-af1d-9842c9a87a97 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:09.528506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-387e88a2-08f4-4348-af1d-9842c9a87a97 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:09.531294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-387e88a2-08f4-4348-af1d-9842c9a87a97 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.533384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-387e88a2-08f4-4348-af1d-9842c9a87a97 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:09.534921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-387e88a2-08f4-4348-af1d-9842c9a87a97 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:09.536154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-387e88a2-08f4-4348-af1d-9842c9a87a97 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.658355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-72dfa499-1c33-4693-98a7-76a14b9cdff2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:09.670509 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-72dfa499-1c33-4693-98a7-76a14b9cdff2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.352013 Oct 04 18:27:09.681367 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2754/5522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:09 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:09.718326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67edaada-d135-4f42-a607-34b7bbd6a696 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:09.720586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67edaada-d135-4f42-a607-34b7bbd6a696 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:09.737255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67edaada-d135-4f42-a607-34b7bbd6a696 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:09.738204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67edaada-d135-4f42-a607-34b7bbd6a696 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:09.739007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67edaada-d135-4f42-a607-34b7bbd6a696 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.740116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67edaada-d135-4f42-a607-34b7bbd6a696 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:09.741112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67edaada-d135-4f42-a607-34b7bbd6a696 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:09.741938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67edaada-d135-4f42-a607-34b7bbd6a696 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.912063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:09.988419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-67edaada-d135-4f42-a607-34b7bbd6a696 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:09.999059 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67edaada-d135-4f42-a607-34b7bbd6a696 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.283617 Oct 04 18:27:09.999819 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2755/5523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:09 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:10.147877 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-387e88a2-08f4-4348-af1d-9842c9a87a97 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "POST /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.646424 Oct 04 18:27:10.148535 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2769/5524] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Oct 4 18:27:09 2022] POST /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments => generated 188 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:27:10.422389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f65c44ea-623c-4eac-8390-259d709edeb9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:10.423990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f65c44ea-623c-4eac-8390-259d709edeb9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:10.447019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f65c44ea-623c-4eac-8390-259d709edeb9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.448425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f65c44ea-623c-4eac-8390-259d709edeb9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.454068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f65c44ea-623c-4eac-8390-259d709edeb9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:10.456118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f65c44ea-623c-4eac-8390-259d709edeb9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.457302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f65c44ea-623c-4eac-8390-259d709edeb9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.458468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f65c44ea-623c-4eac-8390-259d709edeb9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:10.459392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:10.542252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f65c44ea-623c-4eac-8390-259d709edeb9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122332) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:27:10.680876 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f65c44ea-623c-4eac-8390-259d709edeb9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "POST /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/action" status: 202 len: 0 microversion: 2.20 time: 0.267091 Oct 04 18:27:10.682672 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2756/5525] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:27:10 2022] POST /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:27:10.691657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:10.692825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:10.703899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.704853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.705695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:10.713532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.713938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fdc741c4-9660-45af-bff8-41c5c4970474 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:10.715455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.715817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fdc741c4-9660-45af-bff8-41c5c4970474 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:10.717973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:10.743606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdc741c4-9660-45af-bff8-41c5c4970474 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.744489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdc741c4-9660-45af-bff8-41c5c4970474 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.745182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdc741c4-9660-45af-bff8-41c5c4970474 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:10.746771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdc741c4-9660-45af-bff8-41c5c4970474 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.747533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdc741c4-9660-45af-bff8-41c5c4970474 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.748196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdc741c4-9660-45af-bff8-41c5c4970474 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:11.207946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fdc741c4-9660-45af-bff8-41c5c4970474 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:11.223166 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fdc741c4-9660-45af-bff8-41c5c4970474 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.515521 Oct 04 18:27:11.224330 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2757/5526] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:10 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:11.227017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:11.238619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:11.240161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:11.244815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8299ae8-7115-4029-9fad-8d2dce562a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:11.245795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f8299ae8-7115-4029-9fad-8d2dce562a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:11.247120 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90c5cdcb-6832-49ec-8779-31034d1992c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1752 microversion: 2.20 time: 0.554503 Oct 04 18:27:11.270659 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2770/5527] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:10 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1752 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:11.272829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8299ae8-7115-4029-9fad-8d2dce562a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:11.275577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8299ae8-7115-4029-9fad-8d2dce562a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:11.277316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8299ae8-7115-4029-9fad-8d2dce562a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:11.279592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8299ae8-7115-4029-9fad-8d2dce562a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:11.282096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8299ae8-7115-4029-9fad-8d2dce562a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:11.282928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8299ae8-7115-4029-9fad-8d2dce562a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:11.679012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f8299ae8-7115-4029-9fad-8d2dce562a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:11.691965 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8299ae8-7115-4029-9fad-8d2dce562a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.466175 Oct 04 18:27:11.693672 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2758/5528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:11 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:12.264868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-207cd1fc-c323-49a0-9bc6-e9ad2dbfc52a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:12.265676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-207cd1fc-c323-49a0-9bc6-e9ad2dbfc52a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:12.278879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207cd1fc-c323-49a0-9bc6-e9ad2dbfc52a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.279764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207cd1fc-c323-49a0-9bc6-e9ad2dbfc52a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.280426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:12.281409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:12.281991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207cd1fc-c323-49a0-9bc6-e9ad2dbfc52a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.284221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207cd1fc-c323-49a0-9bc6-e9ad2dbfc52a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.284969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207cd1fc-c323-49a0-9bc6-e9ad2dbfc52a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.286377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-207cd1fc-c323-49a0-9bc6-e9ad2dbfc52a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.303667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.304410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.305036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.305821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.306334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.307092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.667970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-207cd1fc-c323-49a0-9bc6-e9ad2dbfc52a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:12.685459 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-207cd1fc-c323-49a0-9bc6-e9ad2dbfc52a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.428748 Oct 04 18:27:12.686221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:12.688108 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2771/5529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:12 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:12.700019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:12.702693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:12.708322 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f06e9bb6-913c-412c-850a-152e1ef97f7f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1754 microversion: 2.20 time: 0.433735 Oct 04 18:27:12.710120 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2759/5530] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:12 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1754 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:12.728023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2240c2f9-3ef9-4240-b9fa-fa4fb87f18ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:12.729249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2240c2f9-3ef9-4240-b9fa-fa4fb87f18ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:12.740931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2240c2f9-3ef9-4240-b9fa-fa4fb87f18ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.741447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2240c2f9-3ef9-4240-b9fa-fa4fb87f18ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.741891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2240c2f9-3ef9-4240-b9fa-fa4fb87f18ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.742652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2240c2f9-3ef9-4240-b9fa-fa4fb87f18ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.743157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2240c2f9-3ef9-4240-b9fa-fa4fb87f18ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.743595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2240c2f9-3ef9-4240-b9fa-fa4fb87f18ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:13.097114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2240c2f9-3ef9-4240-b9fa-fa4fb87f18ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:13.113365 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2240c2f9-3ef9-4240-b9fa-fa4fb87f18ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.398751 Oct 04 18:27:13.114069 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2772/5531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:12 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:13.712922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ac12f78-6aaa-42cc-a607-d70788e4d49d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:13.714330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ac12f78-6aaa-42cc-a607-d70788e4d49d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:13.732031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ac12f78-6aaa-42cc-a607-d70788e4d49d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:13.732824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ac12f78-6aaa-42cc-a607-d70788e4d49d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:13.733551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ac12f78-6aaa-42cc-a607-d70788e4d49d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:13.734738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ac12f78-6aaa-42cc-a607-d70788e4d49d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:13.741858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:13.743323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:13.751757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ac12f78-6aaa-42cc-a607-d70788e4d49d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:13.752541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ac12f78-6aaa-42cc-a607-d70788e4d49d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:13.757449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:13.765195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:13.765902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:13.770397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:13.772913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:13.773571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:14.447629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:14.469081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:14.472901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:14.474171 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e14058b3-4f83-43d0-aef1-444c94478056 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1754 microversion: 2.20 time: 0.736467 Oct 04 18:27:14.474760 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2773/5532] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:13 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1754 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:27:14.501842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-631e86d1-fb00-42b1-b408-5db89c7b7771 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:14.512414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-631e86d1-fb00-42b1-b408-5db89c7b7771 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:14.529659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-631e86d1-fb00-42b1-b408-5db89c7b7771 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:14.530481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-631e86d1-fb00-42b1-b408-5db89c7b7771 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:14.531529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-631e86d1-fb00-42b1-b408-5db89c7b7771 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:14.535368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-631e86d1-fb00-42b1-b408-5db89c7b7771 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:14.536078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-631e86d1-fb00-42b1-b408-5db89c7b7771 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:14.536710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-631e86d1-fb00-42b1-b408-5db89c7b7771 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:14.554273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ac12f78-6aaa-42cc-a607-d70788e4d49d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:14.575166 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ac12f78-6aaa-42cc-a607-d70788e4d49d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.860722 Oct 04 18:27:14.576411 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2760/5533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:13 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:14.894080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-631e86d1-fb00-42b1-b408-5db89c7b7771 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:14.915135 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-631e86d1-fb00-42b1-b408-5db89c7b7771 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.415097 Oct 04 18:27:14.917719 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2774/5534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:15.512133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:15.515756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:15.537661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:15.538178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:15.538631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:15.539408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:15.541840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:15.549264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:15.604209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f68846e-489c-49db-970f-932f0779f4f6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:15.605155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f68846e-489c-49db-970f-932f0779f4f6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:15.619902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f68846e-489c-49db-970f-932f0779f4f6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:15.620689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f68846e-489c-49db-970f-932f0779f4f6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:15.623752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f68846e-489c-49db-970f-932f0779f4f6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:15.624755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f68846e-489c-49db-970f-932f0779f4f6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:15.627969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f68846e-489c-49db-970f-932f0779f4f6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:15.628639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f68846e-489c-49db-970f-932f0779f4f6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:16.020140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:16.029704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:16.038571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:16.040712 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-31f77234-377e-449d-9dc9-28108b9383d4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1754 microversion: 2.20 time: 0.541936 Oct 04 18:27:16.045347 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2761/5535] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:15 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1754 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:16.059357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f094f024-9de0-430d-b2eb-e1bc38fbabdd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:16.061106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f094f024-9de0-430d-b2eb-e1bc38fbabdd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:16.073263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f094f024-9de0-430d-b2eb-e1bc38fbabdd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:16.079263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f094f024-9de0-430d-b2eb-e1bc38fbabdd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:16.080069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f094f024-9de0-430d-b2eb-e1bc38fbabdd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:16.081022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f094f024-9de0-430d-b2eb-e1bc38fbabdd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:16.082141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f094f024-9de0-430d-b2eb-e1bc38fbabdd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:16.083392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f094f024-9de0-430d-b2eb-e1bc38fbabdd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:16.116701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f68846e-489c-49db-970f-932f0779f4f6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:16.131935 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f68846e-489c-49db-970f-932f0779f4f6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.531835 Oct 04 18:27:16.133232 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2775/5536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:15 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:16.326649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f094f024-9de0-430d-b2eb-e1bc38fbabdd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:16.338428 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f094f024-9de0-430d-b2eb-e1bc38fbabdd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.290540 Oct 04 18:27:16.339355 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2762/5537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:16 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:17.074797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:17.076273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:17.091813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.092230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.092678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.093420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.093902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.094331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.160842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed920b00-c5b1-4c68-9b70-c250e5cedbba tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:17.161457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed920b00-c5b1-4c68-9b70-c250e5cedbba tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:17.172391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:17.185438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed920b00-c5b1-4c68-9b70-c250e5cedbba tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.186139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed920b00-c5b1-4c68-9b70-c250e5cedbba tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.186583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed920b00-c5b1-4c68-9b70-c250e5cedbba tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.194711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed920b00-c5b1-4c68-9b70-c250e5cedbba tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.199185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed920b00-c5b1-4c68-9b70-c250e5cedbba tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.204343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed920b00-c5b1-4c68-9b70-c250e5cedbba tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.729701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:17.752977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:17.755275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:17.756425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ed920b00-c5b1-4c68-9b70-c250e5cedbba tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:17.762569 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-05db172f-0aea-477d-b67d-e7262e270bd3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1754 microversion: 2.20 time: 0.692059 Oct 04 18:27:17.769084 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed920b00-c5b1-4c68-9b70-c250e5cedbba tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.610857 Oct 04 18:27:17.770345 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2763/5538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:17 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:17.771831 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2776/5539] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:17 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1754 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:17.778285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-183d512a-881f-4780-ab13-0545b47a7bbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:17.779687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-183d512a-881f-4780-ab13-0545b47a7bbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:17.793505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183d512a-881f-4780-ab13-0545b47a7bbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.794020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183d512a-881f-4780-ab13-0545b47a7bbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.794491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183d512a-881f-4780-ab13-0545b47a7bbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.795239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183d512a-881f-4780-ab13-0545b47a7bbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.795700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183d512a-881f-4780-ab13-0545b47a7bbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.799020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-183d512a-881f-4780-ab13-0545b47a7bbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.399834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-183d512a-881f-4780-ab13-0545b47a7bbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:18.418867 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-183d512a-881f-4780-ab13-0545b47a7bbf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.647161 Oct 04 18:27:18.440791 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2764/5540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:17 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:18.816538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-87f5919c-1722-4364-a944-08f575c598d2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:18.817161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-87f5919c-1722-4364-a944-08f575c598d2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:18.817857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:18.818682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:18.832470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.833263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.833719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.834233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87f5919c-1722-4364-a944-08f575c598d2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.834793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87f5919c-1722-4364-a944-08f575c598d2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.835269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87f5919c-1722-4364-a944-08f575c598d2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.837944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87f5919c-1722-4364-a944-08f575c598d2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.838704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.839557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.840207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.853300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87f5919c-1722-4364-a944-08f575c598d2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.854080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-87f5919c-1722-4364-a944-08f575c598d2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.603336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-87f5919c-1722-4364-a944-08f575c598d2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:19.616170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:19.617174 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-87f5919c-1722-4364-a944-08f575c598d2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.801551 Oct 04 18:27:19.617884 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2777/5541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:18 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:19.678398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:19.686889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:19.693443 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ffa2c470-13dc-468d-ad06-bcca796e0f57 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1754 microversion: 2.20 time: 0.877772 Oct 04 18:27:19.696726 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2765/5542] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:18 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1754 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:19.743393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-76054cd7-da16-47cb-a80c-6c24b4cc4a84 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:19.743884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-76054cd7-da16-47cb-a80c-6c24b4cc4a84 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:19.766933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76054cd7-da16-47cb-a80c-6c24b4cc4a84 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:19.768925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76054cd7-da16-47cb-a80c-6c24b4cc4a84 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:19.769117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76054cd7-da16-47cb-a80c-6c24b4cc4a84 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.770968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76054cd7-da16-47cb-a80c-6c24b4cc4a84 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:19.775784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76054cd7-da16-47cb-a80c-6c24b4cc4a84 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:19.776273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76054cd7-da16-47cb-a80c-6c24b4cc4a84 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.049612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e0c5ae9f-c655-4394-9aff-dc78059a3b65 req-52730697-97ba-4a98-9e0e-846c787273ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991828cf-e0c5-4fa4-8235-1ffcf017fac8", "name": "network-vif-plugged", "status": "completed", "tag": "3678b817-c85d-449f-b74c-c69d2558aaf7"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:20.070165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e0c5ae9f-c655-4394-9aff-dc78059a3b65 req-52730697-97ba-4a98-9e0e-846c787273ab service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.074618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e0c5ae9f-c655-4394-9aff-dc78059a3b65 req-52730697-97ba-4a98-9e0e-846c787273ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.075681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e0c5ae9f-c655-4394-9aff-dc78059a3b65 req-52730697-97ba-4a98-9e0e-846c787273ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.103514 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e0c5ae9f-c655-4394-9aff-dc78059a3b65 req-52730697-97ba-4a98-9e0e-846c787273ab service nova] Creating event network-vif-plugged:3678b817-c85d-449f-b74c-c69d2558aaf7 for instance 991828cf-e0c5-4fa4-8235-1ffcf017fac8 on n-h2-850499-14 Oct 04 18:27:20.112826 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e0c5ae9f-c655-4394-9aff-dc78059a3b65 req-52730697-97ba-4a98-9e0e-846c787273ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.491908 Oct 04 18:27:20.116830 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2778/5543] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:20.178404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-76054cd7-da16-47cb-a80c-6c24b4cc4a84 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:20.196226 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-76054cd7-da16-47cb-a80c-6c24b4cc4a84 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.486324 Oct 04 18:27:20.200253 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2766/5544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:19 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:20.668654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fbb633b9-6994-4d61-93a6-46e29c11c10e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:20.670533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fbb633b9-6994-4d61-93a6-46e29c11c10e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:20.700974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbb633b9-6994-4d61-93a6-46e29c11c10e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.704142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbb633b9-6994-4d61-93a6-46e29c11c10e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.707102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbb633b9-6994-4d61-93a6-46e29c11c10e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.708587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbb633b9-6994-4d61-93a6-46e29c11c10e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.710625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbb633b9-6994-4d61-93a6-46e29c11c10e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.713140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbb633b9-6994-4d61-93a6-46e29c11c10e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.772739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:20.779195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:20.857278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.866331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.872035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.878071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.879335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.881395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:21.360483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fbb633b9-6994-4d61-93a6-46e29c11c10e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:21.378099 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fbb633b9-6994-4d61-93a6-46e29c11c10e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.722548 Oct 04 18:27:21.381214 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2779/5545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:20 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:21.401378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13ee3b0f-a03d-4c22-8afb-49b36bc5bda8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:21.404045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-13ee3b0f-a03d-4c22-8afb-49b36bc5bda8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:21.414093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:21.436777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13ee3b0f-a03d-4c22-8afb-49b36bc5bda8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:21.437812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13ee3b0f-a03d-4c22-8afb-49b36bc5bda8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:21.438633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13ee3b0f-a03d-4c22-8afb-49b36bc5bda8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:21.440998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13ee3b0f-a03d-4c22-8afb-49b36bc5bda8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:21.442017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13ee3b0f-a03d-4c22-8afb-49b36bc5bda8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:21.443499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13ee3b0f-a03d-4c22-8afb-49b36bc5bda8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:21.464992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:21.487895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:21.490168 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d7d22bd3-e016-436a-a547-fe4502cba21b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1754 microversion: 2.20 time: 0.744182 Oct 04 18:27:21.491737 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2767/5546] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:20 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1754 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:22.126203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-13ee3b0f-a03d-4c22-8afb-49b36bc5bda8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:22.162441 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-13ee3b0f-a03d-4c22-8afb-49b36bc5bda8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.777704 Oct 04 18:27:22.168463 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2780/5547] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:21 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:22.423332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8981813c-de9c-46cf-8aed-436a7bb6dcd2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:22.425213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8981813c-de9c-46cf-8aed-436a7bb6dcd2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:22.452771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8981813c-de9c-46cf-8aed-436a7bb6dcd2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:22.453945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8981813c-de9c-46cf-8aed-436a7bb6dcd2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:22.454406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8981813c-de9c-46cf-8aed-436a7bb6dcd2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:22.455157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8981813c-de9c-46cf-8aed-436a7bb6dcd2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:22.456401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8981813c-de9c-46cf-8aed-436a7bb6dcd2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:22.457013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8981813c-de9c-46cf-8aed-436a7bb6dcd2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:22.540035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:22.540773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:22.552917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:22.553800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:22.554283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:22.555108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:22.557684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:22.558326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:22.950175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8981813c-de9c-46cf-8aed-436a7bb6dcd2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:22.962334 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8981813c-de9c-46cf-8aed-436a7bb6dcd2 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 0.542763 Oct 04 18:27:22.970331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:22.975223 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2768/5548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:22 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:22.989689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:22.991898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:22.999802 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-54538cd9-8724-4f55-b2ef-fa971c1cbacc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1754 microversion: 2.20 time: 0.464239 Oct 04 18:27:23.000918 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2781/5549] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:22 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1754 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:27:23.193177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-20e8207b-ae30-485d-8e5c-4b3e21fa0814 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:23.194118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-20e8207b-ae30-485d-8e5c-4b3e21fa0814 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:23.201787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20e8207b-ae30-485d-8e5c-4b3e21fa0814 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:23.202649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20e8207b-ae30-485d-8e5c-4b3e21fa0814 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:23.203430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20e8207b-ae30-485d-8e5c-4b3e21fa0814 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:23.204216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20e8207b-ae30-485d-8e5c-4b3e21fa0814 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:23.204914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20e8207b-ae30-485d-8e5c-4b3e21fa0814 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:23.205561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20e8207b-ae30-485d-8e5c-4b3e21fa0814 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:23.228562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:23.513049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-20e8207b-ae30-485d-8e5c-4b3e21fa0814 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:23.527391 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-20e8207b-ae30-485d-8e5c-4b3e21fa0814 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1314 microversion: 2.1 time: 0.336784 Oct 04 18:27:23.529167 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2769/5550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:23 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:23.989960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9e6c8f7-fa30-4726-aaab-0cce8866044d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:23.992112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9e6c8f7-fa30-4726-aaab-0cce8866044d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:24.004866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9e6c8f7-fa30-4726-aaab-0cce8866044d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.005887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9e6c8f7-fa30-4726-aaab-0cce8866044d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.006861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9e6c8f7-fa30-4726-aaab-0cce8866044d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:24.007869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9e6c8f7-fa30-4726-aaab-0cce8866044d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.009638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9e6c8f7-fa30-4726-aaab-0cce8866044d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.010500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9e6c8f7-fa30-4726-aaab-0cce8866044d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:24.027232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:24.028187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:24.057253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.061685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.062794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:24.064387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.066735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.068270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:24.653254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:24.683341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:24.691392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:24.694943 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d922813f-2937-4166-aa0e-7765bc5e9375 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.673062 Oct 04 18:27:24.721612 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2770/5551] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:24 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:24.730466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4906acd-3483-4fd9-958e-812d4190a6cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:24.741297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4906acd-3483-4fd9-958e-812d4190a6cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:24.749070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4906acd-3483-4fd9-958e-812d4190a6cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.749866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4906acd-3483-4fd9-958e-812d4190a6cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.750507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4906acd-3483-4fd9-958e-812d4190a6cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:24.751250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4906acd-3483-4fd9-958e-812d4190a6cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.751884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4906acd-3483-4fd9-958e-812d4190a6cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.752533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4906acd-3483-4fd9-958e-812d4190a6cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:25.006026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9e6c8f7-fa30-4726-aaab-0cce8866044d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:25.016344 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9e6c8f7-fa30-4726-aaab-0cce8866044d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1735 microversion: 2.1 time: 1.032533 Oct 04 18:27:25.017036 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2782/5552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:23 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1735 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:25.340653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d4906acd-3483-4fd9-958e-812d4190a6cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:25.363837 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d4906acd-3483-4fd9-958e-812d4190a6cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1500 microversion: 2.1 time: 0.640676 Oct 04 18:27:25.375375 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2771/5553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:24 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1500 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:25.389275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d5000061-db93-41d4-8e2b-d29ea8dc7eda tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:25.392475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d5000061-db93-41d4-8e2b-d29ea8dc7eda tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:25.399990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5000061-db93-41d4-8e2b-d29ea8dc7eda tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:25.401125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5000061-db93-41d4-8e2b-d29ea8dc7eda tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:25.401821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5000061-db93-41d4-8e2b-d29ea8dc7eda tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:25.402866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5000061-db93-41d4-8e2b-d29ea8dc7eda tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:25.403462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5000061-db93-41d4-8e2b-d29ea8dc7eda tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:25.404160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5000061-db93-41d4-8e2b-d29ea8dc7eda tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:25.485929 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d5000061-db93-41d4-8e2b-d29ea8dc7eda tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.102216 Oct 04 18:27:25.486998 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2783/5554] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:25 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:25.729181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:25.729726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:25.739058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:25.740711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:25.741638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:25.743264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:25.744900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:25.745589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.041731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a775b081-4233-4227-b339-952afb454728 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:26.043207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a775b081-4233-4227-b339-952afb454728 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:26.071448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a775b081-4233-4227-b339-952afb454728 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.072281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a775b081-4233-4227-b339-952afb454728 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.074449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a775b081-4233-4227-b339-952afb454728 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.075330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a775b081-4233-4227-b339-952afb454728 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.077238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a775b081-4233-4227-b339-952afb454728 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.077949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a775b081-4233-4227-b339-952afb454728 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.339705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:26.349040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:26.357451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:26.358725 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-105388f4-2a1d-4b3f-81b7-4b42305fe982 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.634144 Oct 04 18:27:26.372242 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2772/5555] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:25 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:26.499905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e22f8ac9-7ff3-4a8a-bafb-19ec6fd5a09a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:26.502060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e22f8ac9-7ff3-4a8a-bafb-19ec6fd5a09a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:26.512386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22f8ac9-7ff3-4a8a-bafb-19ec6fd5a09a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.513617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22f8ac9-7ff3-4a8a-bafb-19ec6fd5a09a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.514842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22f8ac9-7ff3-4a8a-bafb-19ec6fd5a09a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.516423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22f8ac9-7ff3-4a8a-bafb-19ec6fd5a09a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.517780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22f8ac9-7ff3-4a8a-bafb-19ec6fd5a09a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.519693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e22f8ac9-7ff3-4a8a-bafb-19ec6fd5a09a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.599994 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e22f8ac9-7ff3-4a8a-bafb-19ec6fd5a09a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.105577 Oct 04 18:27:26.600901 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2773/5556] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:26 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:26.690645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a775b081-4233-4227-b339-952afb454728 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:26.703413 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a775b081-4233-4227-b339-952afb454728 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1715 microversion: 2.1 time: 0.665851 Oct 04 18:27:26.704879 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2784/5557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:26 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1715 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:26.915947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:26.918200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:26.939833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.940608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.941341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.942192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.942938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.943931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.108460 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] HTTP exception thrown: Cannot 'detach_volume' instance 66ac8a47-83c9-442a-a1a4-6e09347c397a while it is in vm_state rescued Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Request method failure captured: Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments/89d10f33-be6c-4d13-bc12-1bed48e86471 HTTP/1.1 Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHnytef4l2dTU_iEGj2JHMj914KTgOcJXrZhkr0wpO7nRbM8OarsMPEpoh7kshRbzuhK9viViE8Sc8SnS-I9yNZdiPzuJrN6shc_HK2tbFONi9WDFR1vVIu70L5UasJlaDkchO8edMdo-N8WJ-RTGom7YRcTfKpi8ODDI4s0GHlW8GE Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab1cdc33329a4a10970e67390f750163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}] Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5a7fc8671d264393bfb0465438b598d1 Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'detach_volume' instance 66ac8a47-83c9-442a-a1a4-6e09347c397a while it is in vm_state rescued Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'server_id': '66ac8a47-83c9-442a-a1a4-6e09347c397a', 'id': '89d10f33-be6c-4d13-bc12-1bed48e86471'} Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 66ac8a47-83c9-442a-a1a4-6e09347c397a in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 66ac8a47-83c9-442a-a1a4-6e09347c397a while it is in vm_state rescued Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:27:27.110513 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:27.116903 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:27.116903 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:27.116903 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:27:27.116903 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:27:27.116903 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 66ac8a47-83c9-442a-a1a4-6e09347c397a while it is in vm_state rescued Oct 04 18:27:27.116903 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:27:27.116903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Returning 409 to user: Cannot 'detach_volume' instance 66ac8a47-83c9-442a-a1a4-6e09347c397a while it is in vm_state rescued {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:27.116903 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-936a86f7-4397-4cea-8619-0e6ae04b0cb0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "DELETE /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments/89d10f33-be6c-4d13-bc12-1bed48e86471" status: 409 len: 152 microversion: 2.1 time: 0.201456 Oct 04 18:27:27.116903 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2774/5558] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:27:26 2022] DELETE /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments/89d10f33-be6c-4d13-bc12-1bed48e86471 => generated 152 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:27:27.123404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef292c25-0a29-4510-a57b-428cae818bed tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:27.123946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef292c25-0a29-4510-a57b-428cae818bed tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:27.128458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:27.135375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef292c25-0a29-4510-a57b-428cae818bed tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.136483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef292c25-0a29-4510-a57b-428cae818bed tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.137120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef292c25-0a29-4510-a57b-428cae818bed tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.138218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef292c25-0a29-4510-a57b-428cae818bed tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.138853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef292c25-0a29-4510-a57b-428cae818bed tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.139533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef292c25-0a29-4510-a57b-428cae818bed tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.185638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:27.273247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef292c25-0a29-4510-a57b-428cae818bed tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/action" status: 202 len: 0 microversion: 2.1 time: 0.153425 Oct 04 18:27:27.274939 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2785/5559] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:27 2022] POST /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:27.283248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d3274504-a2e7-4a2d-aa50-6d8f734d9a42 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:27.283873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d3274504-a2e7-4a2d-aa50-6d8f734d9a42 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:27.294395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3274504-a2e7-4a2d-aa50-6d8f734d9a42 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.295288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3274504-a2e7-4a2d-aa50-6d8f734d9a42 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.296386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3274504-a2e7-4a2d-aa50-6d8f734d9a42 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.297466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3274504-a2e7-4a2d-aa50-6d8f734d9a42 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.298102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3274504-a2e7-4a2d-aa50-6d8f734d9a42 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.298737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3274504-a2e7-4a2d-aa50-6d8f734d9a42 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.388789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:27.390181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:27.403901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.404796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.405697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.406660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.407339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.408006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:28.144595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d3274504-a2e7-4a2d-aa50-6d8f734d9a42 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:28.154564 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d3274504-a2e7-4a2d-aa50-6d8f734d9a42 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1723 microversion: 2.1 time: 0.875274 Oct 04 18:27:28.156085 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2775/5560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:27 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1723 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:28.161549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9d87353b-cc27-48e2-ae16-5e9d4fa9ccc2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:28.161703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:28.165441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9d87353b-cc27-48e2-ae16-5e9d4fa9ccc2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:28.171989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d87353b-cc27-48e2-ae16-5e9d4fa9ccc2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:28.172833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d87353b-cc27-48e2-ae16-5e9d4fa9ccc2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:28.173493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d87353b-cc27-48e2-ae16-5e9d4fa9ccc2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:28.174439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d87353b-cc27-48e2-ae16-5e9d4fa9ccc2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:28.175278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d87353b-cc27-48e2-ae16-5e9d4fa9ccc2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:28.175958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d87353b-cc27-48e2-ae16-5e9d4fa9ccc2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:28.179844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:28.186169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:28.194946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-51ff636a-fcfb-4375-a426-bc975768a12d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.806943 Oct 04 18:27:28.198673 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2786/5561] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:27 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:27:28.212670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8aab9c13-ff6c-475c-a710-223384f9208f req-3dee98d2-746a-4f95-867f-3230541b478f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d39c1d8-8eed-462d-af88-bd613d502347", "tag": "12e1280e-928a-4b59-9480-9e0bba1dd891"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:28.240010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8aab9c13-ff6c-475c-a710-223384f9208f req-3dee98d2-746a-4f95-867f-3230541b478f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:28.241270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8aab9c13-ff6c-475c-a710-223384f9208f req-3dee98d2-746a-4f95-867f-3230541b478f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:28.241913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8aab9c13-ff6c-475c-a710-223384f9208f req-3dee98d2-746a-4f95-867f-3230541b478f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:28.255892 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8aab9c13-ff6c-475c-a710-223384f9208f req-3dee98d2-746a-4f95-867f-3230541b478f service nova] Creating event network-changed:12e1280e-928a-4b59-9480-9e0bba1dd891 for instance 9d39c1d8-8eed-462d-af88-bd613d502347 on n-h1-850499-14 Oct 04 18:27:28.263169 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8aab9c13-ff6c-475c-a710-223384f9208f req-3dee98d2-746a-4f95-867f-3230541b478f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059245 Oct 04 18:27:28.264796 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2787/5562] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:28.284768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9d87353b-cc27-48e2-ae16-5e9d4fa9ccc2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.127144 Oct 04 18:27:28.285672 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2776/5563] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:28 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:29.183344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a48fee09-13c8-40b3-81f4-b5a663c76006 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:29.184271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a48fee09-13c8-40b3-81f4-b5a663c76006 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:29.201163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a48fee09-13c8-40b3-81f4-b5a663c76006 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:29.201669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a48fee09-13c8-40b3-81f4-b5a663c76006 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:29.202190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a48fee09-13c8-40b3-81f4-b5a663c76006 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:29.202910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a48fee09-13c8-40b3-81f4-b5a663c76006 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:29.203404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a48fee09-13c8-40b3-81f4-b5a663c76006 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:29.209037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a48fee09-13c8-40b3-81f4-b5a663c76006 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:29.225382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:29.226094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:29.239278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:29.239774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:29.242352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:29.245796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:29.246196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:29.246822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:29.882367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a48fee09-13c8-40b3-81f4-b5a663c76006 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:29.894136 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a48fee09-13c8-40b3-81f4-b5a663c76006 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1723 microversion: 2.1 time: 0.714947 Oct 04 18:27:29.923310 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2788/5564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:29 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1723 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:29.929006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ad20d160-3c93-4498-89d3-001a1748687d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:29.932130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ad20d160-3c93-4498-89d3-001a1748687d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:29.948264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad20d160-3c93-4498-89d3-001a1748687d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:29.949080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad20d160-3c93-4498-89d3-001a1748687d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:29.949711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad20d160-3c93-4498-89d3-001a1748687d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:29.950837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad20d160-3c93-4498-89d3-001a1748687d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:29.951653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad20d160-3c93-4498-89d3-001a1748687d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:29.952484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad20d160-3c93-4498-89d3-001a1748687d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:30.019033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:30.048836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:30.057580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:30.059399 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7347f096-2ba6-45c6-b4ba-6214e66c2806 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.838982 Oct 04 18:27:30.060280 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2777/5565] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:29 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:30.064783 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ad20d160-3c93-4498-89d3-001a1748687d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.139711 Oct 04 18:27:30.066390 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2789/5566] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:29 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:30.919349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6b3120f-2cb6-47e6-b34a-028b2690f98e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:30.920106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d6b3120f-2cb6-47e6-b34a-028b2690f98e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:30.935381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6b3120f-2cb6-47e6-b34a-028b2690f98e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:30.936217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6b3120f-2cb6-47e6-b34a-028b2690f98e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:30.936774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6b3120f-2cb6-47e6-b34a-028b2690f98e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:30.937632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6b3120f-2cb6-47e6-b34a-028b2690f98e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:30.944202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6b3120f-2cb6-47e6-b34a-028b2690f98e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:30.944687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6b3120f-2cb6-47e6-b34a-028b2690f98e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:31.080164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5007b1d7-08e4-4c44-b67b-0328c1ee02c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:31.097355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5007b1d7-08e4-4c44-b67b-0328c1ee02c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:31.115348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5007b1d7-08e4-4c44-b67b-0328c1ee02c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:31.115867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5007b1d7-08e4-4c44-b67b-0328c1ee02c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:31.116319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5007b1d7-08e4-4c44-b67b-0328c1ee02c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:31.117797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5007b1d7-08e4-4c44-b67b-0328c1ee02c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:31.118279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5007b1d7-08e4-4c44-b67b-0328c1ee02c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:31.119886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5007b1d7-08e4-4c44-b67b-0328c1ee02c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:31.421980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d6b3120f-2cb6-47e6-b34a-028b2690f98e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:31.479825 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d6b3120f-2cb6-47e6-b34a-028b2690f98e tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1723 microversion: 2.1 time: 0.564407 Oct 04 18:27:31.483591 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2778/5567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:30 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1723 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:31.501500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:31.504963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:31.513008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:31.514028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:31.515411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:31.516740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:31.517762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:31.519733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:32.067396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:32.084522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:32.087377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:32.092632 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fb43015d-ea56-4a3e-a797-2426d3c6177f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.606071 Oct 04 18:27:32.095830 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2779/5568] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:31 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:32.522361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2c55bec4-2421-47cd-a9b1-edfaa0892412 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:32.523350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2c55bec4-2421-47cd-a9b1-edfaa0892412 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:32.550755 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5007b1d7-08e4-4c44-b67b-0328c1ee02c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 1.477437 Oct 04 18:27:32.552562 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2790/5569] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:31 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:27:32.554397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c55bec4-2421-47cd-a9b1-edfaa0892412 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:32.557523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c55bec4-2421-47cd-a9b1-edfaa0892412 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:32.560156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c55bec4-2421-47cd-a9b1-edfaa0892412 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:32.562232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c55bec4-2421-47cd-a9b1-edfaa0892412 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:32.563355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c55bec4-2421-47cd-a9b1-edfaa0892412 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:32.565345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c55bec4-2421-47cd-a9b1-edfaa0892412 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:33.131571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:33.133472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:33.146768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:33.147998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:33.149019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:33.150133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:33.150861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:33.152061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:34.095339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2c55bec4-2421-47cd-a9b1-edfaa0892412 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:34.135950 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2c55bec4-2421-47cd-a9b1-edfaa0892412 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1723 microversion: 2.1 time: 1.612186 Oct 04 18:27:34.140755 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2780/5570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:32 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1723 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:34.153328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-07f2e7d1-9066-4d81-9694-238c1fa7c5d0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:34.165278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-07f2e7d1-9066-4d81-9694-238c1fa7c5d0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:34.180750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e7d1-9066-4d81-9694-238c1fa7c5d0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:34.182496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e7d1-9066-4d81-9694-238c1fa7c5d0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:34.183631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e7d1-9066-4d81-9694-238c1fa7c5d0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:34.185408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e7d1-9066-4d81-9694-238c1fa7c5d0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:34.186821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e7d1-9066-4d81-9694-238c1fa7c5d0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:34.189994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e7d1-9066-4d81-9694-238c1fa7c5d0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:34.319903 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-07f2e7d1-9066-4d81-9694-238c1fa7c5d0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.174513 Oct 04 18:27:34.321602 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2781/5571] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:34 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:34.559021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:34.574326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:34.577635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:34.585248 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40ebf6c7-3f25-4126-8b09-e012d973206c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 1.460010 Oct 04 18:27:34.587631 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2791/5572] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:33 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:27:35.193079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-632d6f02-00cd-4433-9e0b-d9d9c42249df tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:35.193922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-632d6f02-00cd-4433-9e0b-d9d9c42249df tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:35.230280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632d6f02-00cd-4433-9e0b-d9d9c42249df tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.235365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632d6f02-00cd-4433-9e0b-d9d9c42249df tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.239732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632d6f02-00cd-4433-9e0b-d9d9c42249df tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.245205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632d6f02-00cd-4433-9e0b-d9d9c42249df tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.256849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632d6f02-00cd-4433-9e0b-d9d9c42249df tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.258089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-632d6f02-00cd-4433-9e0b-d9d9c42249df tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.340490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0cbf562a-491f-4e1f-983c-bc7084405ce8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:35.344428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0cbf562a-491f-4e1f-983c-bc7084405ce8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:35.376277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cbf562a-491f-4e1f-983c-bc7084405ce8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.379693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cbf562a-491f-4e1f-983c-bc7084405ce8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.381536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cbf562a-491f-4e1f-983c-bc7084405ce8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.387981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cbf562a-491f-4e1f-983c-bc7084405ce8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.388925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cbf562a-491f-4e1f-983c-bc7084405ce8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.389571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cbf562a-491f-4e1f-983c-bc7084405ce8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.574646 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0cbf562a-491f-4e1f-983c-bc7084405ce8 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.244180 Oct 04 18:27:35.575773 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2792/5573] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:35 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:27:35.614128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:35.614848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:35.636383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.636926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.637381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.641696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.644192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.644661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.788077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-632d6f02-00cd-4433-9e0b-d9d9c42249df tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:35.801273 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-632d6f02-00cd-4433-9e0b-d9d9c42249df tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1729 microversion: 2.1 time: 0.627191 Oct 04 18:27:35.806747 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2782/5574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:35 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1729 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:35.834483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e543a073-a06b-4bbc-a557-d41e169fe652 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:35.835382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e543a073-a06b-4bbc-a557-d41e169fe652 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:35.871103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e543a073-a06b-4bbc-a557-d41e169fe652 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.872040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e543a073-a06b-4bbc-a557-d41e169fe652 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.876756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e543a073-a06b-4bbc-a557-d41e169fe652 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.880141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e543a073-a06b-4bbc-a557-d41e169fe652 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.886115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e543a073-a06b-4bbc-a557-d41e169fe652 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.886904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e543a073-a06b-4bbc-a557-d41e169fe652 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:36.372351 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e543a073-a06b-4bbc-a557-d41e169fe652 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.542765 Oct 04 18:27:36.373661 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2783/5575] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:27:35 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-interface => generated 284 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:36.508638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:36.536256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:36.546044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:36.549388 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a077993b-5208-4c5d-88bf-70ebd58b5111 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.939671 Oct 04 18:27:36.551276 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2793/5576] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:35 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:36.587139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6713583d-db83-4c1c-921e-7133b4a5fb08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:36.589634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6713583d-db83-4c1c-921e-7133b4a5fb08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:36.599845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6713583d-db83-4c1c-921e-7133b4a5fb08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:36.607273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6713583d-db83-4c1c-921e-7133b4a5fb08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:36.608266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6713583d-db83-4c1c-921e-7133b4a5fb08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:36.610525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6713583d-db83-4c1c-921e-7133b4a5fb08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:36.613192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6713583d-db83-4c1c-921e-7133b4a5fb08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:36.614308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6713583d-db83-4c1c-921e-7133b4a5fb08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:36.724547 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6713583d-db83-4c1c-921e-7133b4a5fb08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.141655 Oct 04 18:27:36.727302 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2784/5577] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:36 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:37.583411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:37.584523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:37.606245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.609523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.610207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:37.613851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.614452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.615009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:37.747564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fac897a3-59b0-4a0f-96a8-69a18226e32c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:37.750166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fac897a3-59b0-4a0f-96a8-69a18226e32c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:37.790480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fac897a3-59b0-4a0f-96a8-69a18226e32c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.794286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fac897a3-59b0-4a0f-96a8-69a18226e32c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.798118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fac897a3-59b0-4a0f-96a8-69a18226e32c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:37.802222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fac897a3-59b0-4a0f-96a8-69a18226e32c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.803014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fac897a3-59b0-4a0f-96a8-69a18226e32c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.807664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fac897a3-59b0-4a0f-96a8-69a18226e32c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:37.950645 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fac897a3-59b0-4a0f-96a8-69a18226e32c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.215099 Oct 04 18:27:37.952880 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2785/5578] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:37 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:38.118707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:38.129248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:38.137600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:38.142837 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27bf65a7-2e1f-4007-9099-cc6f5046ee42 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.564468 Oct 04 18:27:38.146695 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2794/5579] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:37 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:38.970048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9f7404a5-ede0-4e99-8466-ce178a68419c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:38.975674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9f7404a5-ede0-4e99-8466-ce178a68419c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:39.001762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f7404a5-ede0-4e99-8466-ce178a68419c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:39.003089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f7404a5-ede0-4e99-8466-ce178a68419c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:39.003766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f7404a5-ede0-4e99-8466-ce178a68419c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.006676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f7404a5-ede0-4e99-8466-ce178a68419c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:39.007584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f7404a5-ede0-4e99-8466-ce178a68419c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:39.008823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f7404a5-ede0-4e99-8466-ce178a68419c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.133486 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9f7404a5-ede0-4e99-8466-ce178a68419c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.171255 Oct 04 18:27:39.137347 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2786/5580] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:38 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:27:39.182187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:39.187255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:39.207161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:39.208749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:39.211296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.213336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:39.217620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:39.219124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.732593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-51882b39-9812-4b87-b2ea-3ea34b41e1c0 req-3a3c94bd-8a11-4f55-b11b-a20a10be8fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ac8a47-83c9-442a-a1a4-6e09347c397a", "tag": "21099c8b-7c1c-4c05-a556-37ef73f83087"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:39.776787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51882b39-9812-4b87-b2ea-3ea34b41e1c0 req-3a3c94bd-8a11-4f55-b11b-a20a10be8fd7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:39.777513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51882b39-9812-4b87-b2ea-3ea34b41e1c0 req-3a3c94bd-8a11-4f55-b11b-a20a10be8fd7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:39.777977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-51882b39-9812-4b87-b2ea-3ea34b41e1c0 req-3a3c94bd-8a11-4f55-b11b-a20a10be8fd7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.825539 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-51882b39-9812-4b87-b2ea-3ea34b41e1c0 req-3a3c94bd-8a11-4f55-b11b-a20a10be8fd7 service nova] Creating event network-changed:21099c8b-7c1c-4c05-a556-37ef73f83087 for instance 66ac8a47-83c9-442a-a1a4-6e09347c397a on n-h2-850499-14 Oct 04 18:27:39.834050 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-51882b39-9812-4b87-b2ea-3ea34b41e1c0 req-3a3c94bd-8a11-4f55-b11b-a20a10be8fd7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.728261 Oct 04 18:27:39.834516 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2795/5581] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:39.984017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:39.997679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:40.001348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:40.002629 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-26a9c0b5-f035-4399-8b58-119dea402db3 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.830531 Oct 04 18:27:40.015227 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2787/5582] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:39 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:40.150022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a91a3845-910e-4381-abd8-de284f786025 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:40.161083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a91a3845-910e-4381-abd8-de284f786025 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:40.184647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a91a3845-910e-4381-abd8-de284f786025 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:40.187444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a91a3845-910e-4381-abd8-de284f786025 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:40.188632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a91a3845-910e-4381-abd8-de284f786025 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:40.190039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a91a3845-910e-4381-abd8-de284f786025 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:40.191769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a91a3845-910e-4381-abd8-de284f786025 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:40.193578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a91a3845-910e-4381-abd8-de284f786025 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:40.333371 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a91a3845-910e-4381-abd8-de284f786025 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.190000 Oct 04 18:27:40.335374 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2796/5583] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:40 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:41.054584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:41.056812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:41.096774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.099683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.101192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.102968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.103930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.105071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.172206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:41.369549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6c1f9e21-d899-4fcc-880d-3d9e4291fe8c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:41.373023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6c1f9e21-d899-4fcc-880d-3d9e4291fe8c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:41.402537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1f9e21-d899-4fcc-880d-3d9e4291fe8c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.462815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1f9e21-d899-4fcc-880d-3d9e4291fe8c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.463768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1f9e21-d899-4fcc-880d-3d9e4291fe8c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.060s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.464814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1f9e21-d899-4fcc-880d-3d9e4291fe8c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.465448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1f9e21-d899-4fcc-880d-3d9e4291fe8c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.466035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6c1f9e21-d899-4fcc-880d-3d9e4291fe8c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.558189 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6c1f9e21-d899-4fcc-880d-3d9e4291fe8c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 14 microversion: 2.1 time: 0.195885 Oct 04 18:27:41.561906 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2797/5584] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:41 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:27:41.805082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:41.815933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:41.820446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:41.824339 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-75fc9370-e87d-4f0b-8291-0baa30c050dd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.787943 Oct 04 18:27:41.824917 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2788/5585] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:41 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:41.868288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-28682789-a1a5-4aea-bd9a-98209c382dba req-4b93935e-a91e-4c3a-bb4d-822af0b5d7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ac8a47-83c9-442a-a1a4-6e09347c397a", "tag": "21099c8b-7c1c-4c05-a556-37ef73f83087"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:41.886760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-28682789-a1a5-4aea-bd9a-98209c382dba req-4b93935e-a91e-4c3a-bb4d-822af0b5d7e6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.887373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-28682789-a1a5-4aea-bd9a-98209c382dba req-4b93935e-a91e-4c3a-bb4d-822af0b5d7e6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.887827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-28682789-a1a5-4aea-bd9a-98209c382dba req-4b93935e-a91e-4c3a-bb4d-822af0b5d7e6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.916725 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-28682789-a1a5-4aea-bd9a-98209c382dba req-4b93935e-a91e-4c3a-bb4d-822af0b5d7e6 service nova] Creating event network-changed:21099c8b-7c1c-4c05-a556-37ef73f83087 for instance 66ac8a47-83c9-442a-a1a4-6e09347c397a on n-h2-850499-14 Oct 04 18:27:41.928375 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-28682789-a1a5-4aea-bd9a-98209c382dba req-4b93935e-a91e-4c3a-bb4d-822af0b5d7e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065860 Oct 04 18:27:41.934235 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2798/5586] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:42.569756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fd68f38a-5207-4adb-936b-e9d7de20ffbc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:42.573563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fd68f38a-5207-4adb-936b-e9d7de20ffbc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:42.582459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd68f38a-5207-4adb-936b-e9d7de20ffbc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.583258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd68f38a-5207-4adb-936b-e9d7de20ffbc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.583907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd68f38a-5207-4adb-936b-e9d7de20ffbc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.584830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd68f38a-5207-4adb-936b-e9d7de20ffbc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.585548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd68f38a-5207-4adb-936b-e9d7de20ffbc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.586195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd68f38a-5207-4adb-936b-e9d7de20ffbc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.706653 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fd68f38a-5207-4adb-936b-e9d7de20ffbc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action" status: 200 len: 8207 microversion: 2.1 time: 0.140598 Oct 04 18:27:42.707552 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2789/5587] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:42 2022] POST /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8/action => generated 8207 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:42.719556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1636af83-0ad9-4707-82fe-d9f1e8dc7504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:42.720216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1636af83-0ad9-4707-82fe-d9f1e8dc7504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:42.731807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1636af83-0ad9-4707-82fe-d9f1e8dc7504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.732732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1636af83-0ad9-4707-82fe-d9f1e8dc7504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.733328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1636af83-0ad9-4707-82fe-d9f1e8dc7504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.734256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1636af83-0ad9-4707-82fe-d9f1e8dc7504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.735148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1636af83-0ad9-4707-82fe-d9f1e8dc7504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.735770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1636af83-0ad9-4707-82fe-d9f1e8dc7504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.859284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:42.860327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:42.868730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.870491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.871286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.872239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.873533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.874317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.301528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1636af83-0ad9-4707-82fe-d9f1e8dc7504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:43.311082 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1636af83-0ad9-4707-82fe-d9f1e8dc7504 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.596779 Oct 04 18:27:43.312789 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2799/5588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:42 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:43.340733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-97be23a6-fb83-4cdf-b6aa-50c7731218d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:43.341624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-97be23a6-fb83-4cdf-b6aa-50c7731218d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:43.348243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97be23a6-fb83-4cdf-b6aa-50c7731218d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.349146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97be23a6-fb83-4cdf-b6aa-50c7731218d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.349875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97be23a6-fb83-4cdf-b6aa-50c7731218d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.350815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97be23a6-fb83-4cdf-b6aa-50c7731218d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.351551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97be23a6-fb83-4cdf-b6aa-50c7731218d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.352164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97be23a6-fb83-4cdf-b6aa-50c7731218d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.383635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:43.416819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:43.419727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:43.421531 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-caed6202-3ff6-4827-8e94-c4badcf017e6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.570681 Oct 04 18:27:43.423308 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2790/5589] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:42 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:43.673107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-97be23a6-fb83-4cdf-b6aa-50c7731218d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:43.685287 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-97be23a6-fb83-4cdf-b6aa-50c7731218d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.348366 Oct 04 18:27:43.698335 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2800/5590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:43 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:43.712073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a0edde40-25c1-45c5-b53f-abd3ab13076c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:43.712692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a0edde40-25c1-45c5-b53f-abd3ab13076c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:43.725289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0edde40-25c1-45c5-b53f-abd3ab13076c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.726098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0edde40-25c1-45c5-b53f-abd3ab13076c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.726749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0edde40-25c1-45c5-b53f-abd3ab13076c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.727687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0edde40-25c1-45c5-b53f-abd3ab13076c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.728337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0edde40-25c1-45c5-b53f-abd3ab13076c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.728986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0edde40-25c1-45c5-b53f-abd3ab13076c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:44.459323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:44.461512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:44.469426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:44.470157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:44.470756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:44.471692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:44.472315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:44.472896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:44.481163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a0edde40-25c1-45c5-b53f-abd3ab13076c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:44.496729 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a0edde40-25c1-45c5-b53f-abd3ab13076c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.785971 Oct 04 18:27:44.505324 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2791/5591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:43 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:44.533545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45bbc31e-f631-4ba7-9e52-5c86233b33f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:44.534562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-45bbc31e-f631-4ba7-9e52-5c86233b33f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:44.545282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45bbc31e-f631-4ba7-9e52-5c86233b33f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:44.546143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45bbc31e-f631-4ba7-9e52-5c86233b33f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:44.547203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45bbc31e-f631-4ba7-9e52-5c86233b33f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:44.548216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45bbc31e-f631-4ba7-9e52-5c86233b33f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:44.548886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45bbc31e-f631-4ba7-9e52-5c86233b33f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:44.549598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45bbc31e-f631-4ba7-9e52-5c86233b33f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:44.986465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:45.009125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:45.010698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:45.012020 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8486974f-0736-4810-a577-2cf9d20db964 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.557988 Oct 04 18:27:45.014287 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2801/5592] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:44 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:27:45.045524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-45bbc31e-f631-4ba7-9e52-5c86233b33f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:45.057235 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-45bbc31e-f631-4ba7-9e52-5c86233b33f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.528014 Oct 04 18:27:45.063521 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2792/5593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:44 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:45.086139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-714818c0-5bae-46c0-a98c-66ab7ead4de9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:45.086726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-714818c0-5bae-46c0-a98c-66ab7ead4de9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:45.093738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-714818c0-5bae-46c0-a98c-66ab7ead4de9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.094247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-714818c0-5bae-46c0-a98c-66ab7ead4de9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.095871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-714818c0-5bae-46c0-a98c-66ab7ead4de9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.095871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-714818c0-5bae-46c0-a98c-66ab7ead4de9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.096304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-714818c0-5bae-46c0-a98c-66ab7ead4de9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.096906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-714818c0-5bae-46c0-a98c-66ab7ead4de9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.169579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-714818c0-5bae-46c0-a98c-66ab7ead4de9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Locking {{(pid=122331) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 18:27:45.244556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:45.263765 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-714818c0-5bae-46c0-a98c-66ab7ead4de9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.180984 Oct 04 18:27:45.265146 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2802/5594] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:45 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:45.276187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e0d1c9c-fcb8-430a-b317-c72afa9bfa62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:45.277999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6e0d1c9c-fcb8-430a-b317-c72afa9bfa62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:45.285718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d1c9c-fcb8-430a-b317-c72afa9bfa62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.286532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d1c9c-fcb8-430a-b317-c72afa9bfa62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.287195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d1c9c-fcb8-430a-b317-c72afa9bfa62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.288054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d1c9c-fcb8-430a-b317-c72afa9bfa62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.288889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d1c9c-fcb8-430a-b317-c72afa9bfa62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.289458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0d1c9c-fcb8-430a-b317-c72afa9bfa62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.588393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6e0d1c9c-fcb8-430a-b317-c72afa9bfa62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:45.604763 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e0d1c9c-fcb8-430a-b317-c72afa9bfa62 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.333382 Oct 04 18:27:45.614994 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2793/5595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:45 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:45.631876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e2292002-b596-4f81-af70-2eec9bff6b3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:45.639626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2292002-b596-4f81-af70-2eec9bff6b3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.640131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2292002-b596-4f81-af70-2eec9bff6b3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.640589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2292002-b596-4f81-af70-2eec9bff6b3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.695582 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-e2292002-b596-4f81-af70-2eec9bff6b3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] HTTP exception thrown: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 is locked Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e2292002-b596-4f81-af70-2eec9bff6b3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Request method failure captured: Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action HTTP/1.1 Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 15 Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHm7mFpV7kVpFAe322I0w-WcbToIm9PohY5osCk8OGaLf11RZj0UFUC9tV1q-xeF-UFk10scvNzuB-4ARKIb6Uk8_Dkn_Vutyk6sdZIoaEsZ68K2lUGbQxf2_jK4_bKAgJb8bAbto1H0F1qbEkbEcz9qN0dHaLyRYrtviitofT97XeE Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2ee0993b0954950949c8afffb90617c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}] Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-961264841 Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6591acf0ba4648abac6cc8ac8ddd560e Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: {"os-stop": {}} Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 is locked Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '7b1681ab-db4a-4528-99da-649ffa9a93a0', 'body': {'os-stop': {}}} Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 is locked Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 is locked Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 is locked Oct 04 18:27:45.697244 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:27:45.700836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e2292002-b596-4f81-af70-2eec9bff6b3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Returning 409 to user: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 is locked {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:45.700836 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e2292002-b596-4f81-af70-2eec9bff6b3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 409 len: 107 microversion: 2.1 time: 0.070967 Oct 04 18:27:45.708036 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2803/5596] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:45 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 107 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:27:45.716997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0a854c04-5caa-4f05-9db0-8c58b1bfb698 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:45.717787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0a854c04-5caa-4f05-9db0-8c58b1bfb698 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:45.724820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a854c04-5caa-4f05-9db0-8c58b1bfb698 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.731176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a854c04-5caa-4f05-9db0-8c58b1bfb698 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.731844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a854c04-5caa-4f05-9db0-8c58b1bfb698 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.732743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a854c04-5caa-4f05-9db0-8c58b1bfb698 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.733351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a854c04-5caa-4f05-9db0-8c58b1bfb698 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.733949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a854c04-5caa-4f05-9db0-8c58b1bfb698 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.821675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0a854c04-5caa-4f05-9db0-8c58b1bfb698 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Unlocking {{(pid=122332) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:27:45.957167 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0a854c04-5caa-4f05-9db0-8c58b1bfb698 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.244191 Oct 04 18:27:45.961948 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2794/5597] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:45 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:45.975883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7111419d-3843-4785-be52-1c61be718394 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:45.985938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7111419d-3843-4785-be52-1c61be718394 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.988558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7111419d-3843-4785-be52-1c61be718394 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.991158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7111419d-3843-4785-be52-1c61be718394 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.044415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:46.044985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:46.047353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7111419d-3843-4785-be52-1c61be718394 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Going to try to stop instance {{(pid=122331) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:27:46.059749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.071051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.071850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.072761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.073479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.075378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.157075 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7111419d-3843-4785-be52-1c61be718394 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.189453 Oct 04 18:27:46.174206 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2804/5598] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:45 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:46.196370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc478d31-289e-42c2-b187-6a3f7c0808f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:46.197508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dc478d31-289e-42c2-b187-6a3f7c0808f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:46.206169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc478d31-289e-42c2-b187-6a3f7c0808f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.208800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc478d31-289e-42c2-b187-6a3f7c0808f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.213114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc478d31-289e-42c2-b187-6a3f7c0808f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.214288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc478d31-289e-42c2-b187-6a3f7c0808f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.215272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc478d31-289e-42c2-b187-6a3f7c0808f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.217235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc478d31-289e-42c2-b187-6a3f7c0808f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.736874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:46.750926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:46.753022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:46.754916 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9a67f36-eb32-4203-b135-b40d0349b325 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.716376 Oct 04 18:27:46.756267 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2795/5599] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:46 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:46.856677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc478d31-289e-42c2-b187-6a3f7c0808f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:46.865539 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dc478d31-289e-42c2-b187-6a3f7c0808f3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.688812 Oct 04 18:27:46.867063 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2805/5600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:46 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:47.787977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:47.788776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:47.805346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=66 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:47.809790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.810621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.811481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.813568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.818254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.818933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.894551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8729bffd-9481-4624-bcae-6c77215d8b41 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:47.896148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8729bffd-9481-4624-bcae-6c77215d8b41 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:47.928110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8729bffd-9481-4624-bcae-6c77215d8b41 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.928948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8729bffd-9481-4624-bcae-6c77215d8b41 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.929650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8729bffd-9481-4624-bcae-6c77215d8b41 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.930920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8729bffd-9481-4624-bcae-6c77215d8b41 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.931586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8729bffd-9481-4624-bcae-6c77215d8b41 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.932544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8729bffd-9481-4624-bcae-6c77215d8b41 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.393505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:48.405865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:48.407875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:48.410126 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-57b83dbe-9a3c-482b-ba5f-0d94a886430a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.629916 Oct 04 18:27:48.434172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8729bffd-9481-4624-bcae-6c77215d8b41 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:48.438747 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2796/5601] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:47 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:48.446077 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8729bffd-9481-4624-bcae-6c77215d8b41 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.559402 Oct 04 18:27:48.447277 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2806/5602] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:47 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:49.441445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:49.442065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:49.459874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.460969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.461449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.462197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.462673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.463150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.470472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-657210b5-5633-4f71-8acf-fdc38efec3d2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:49.471113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-657210b5-5633-4f71-8acf-fdc38efec3d2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:49.484309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-657210b5-5633-4f71-8acf-fdc38efec3d2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.484825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-657210b5-5633-4f71-8acf-fdc38efec3d2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.485332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-657210b5-5633-4f71-8acf-fdc38efec3d2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.486077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-657210b5-5633-4f71-8acf-fdc38efec3d2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.486560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-657210b5-5633-4f71-8acf-fdc38efec3d2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.487020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-657210b5-5633-4f71-8acf-fdc38efec3d2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.914633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-657210b5-5633-4f71-8acf-fdc38efec3d2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:49.925300 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-657210b5-5633-4f71-8acf-fdc38efec3d2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.458123 Oct 04 18:27:49.926012 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2807/5603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:49 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:49.952359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:49.963872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:49.965698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:49.967246 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4cc2f589-89f9-4c83-918f-35bd8556eebe tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.529972 Oct 04 18:27:49.967980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2797/5604] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:49 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:50.958871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ea5d821-0c7e-4f42-960a-1db065db8c7c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:50.960643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4ea5d821-0c7e-4f42-960a-1db065db8c7c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:50.979280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ea5d821-0c7e-4f42-960a-1db065db8c7c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:50.980829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ea5d821-0c7e-4f42-960a-1db065db8c7c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:50.982342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ea5d821-0c7e-4f42-960a-1db065db8c7c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:50.986152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ea5d821-0c7e-4f42-960a-1db065db8c7c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:50.996351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.000088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:51.005887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ea5d821-0c7e-4f42-960a-1db065db8c7c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.006794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ea5d821-0c7e-4f42-960a-1db065db8c7c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.014976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.015578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.017760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.023676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.024652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.025295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.664877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:51.675385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ea5d821-0c7e-4f42-960a-1db065db8c7c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:51.678593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:51.680581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:51.682208 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d64ca45c-b688-4527-bf37-3b32a0867c50 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.691510 Oct 04 18:27:51.683382 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2798/5605] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:50 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:51.688326 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4ea5d821-0c7e-4f42-960a-1db065db8c7c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.741838 Oct 04 18:27:51.689520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-554707b9-eca3-4d94-b37a-376c30591e51 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.690267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-554707b9-eca3-4d94-b37a-376c30591e51 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:51.695319 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2808/5606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:50 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:51.697958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554707b9-eca3-4d94-b37a-376c30591e51 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.698684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554707b9-eca3-4d94-b37a-376c30591e51 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.699435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554707b9-eca3-4d94-b37a-376c30591e51 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.700407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554707b9-eca3-4d94-b37a-376c30591e51 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.701073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554707b9-eca3-4d94-b37a-376c30591e51 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.701722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-554707b9-eca3-4d94-b37a-376c30591e51 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.751441 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-554707b9-eca3-4d94-b37a-376c30591e51 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.066556 Oct 04 18:27:51.752167 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2799/5607] 10.222.0.18 () {58 vars in 1293 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3/os-server-password => generated 116 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:52.714256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:52.714909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:52.720378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a1daa20-dba6-416e-ac55-c2d80439373b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:52.723487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3a1daa20-dba6-416e-ac55-c2d80439373b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:52.730834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.731384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.732841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.734001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.734109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.734519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.752992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a1daa20-dba6-416e-ac55-c2d80439373b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.753882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a1daa20-dba6-416e-ac55-c2d80439373b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.754602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a1daa20-dba6-416e-ac55-c2d80439373b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.755912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a1daa20-dba6-416e-ac55-c2d80439373b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.756662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a1daa20-dba6-416e-ac55-c2d80439373b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.758831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a1daa20-dba6-416e-ac55-c2d80439373b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.173864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:53.178062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3a1daa20-dba6-416e-ac55-c2d80439373b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:53.183115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:53.187805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:53.189915 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-409198ac-57ef-4808-944e-e4126fc5b34f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.480989 Oct 04 18:27:53.202990 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3a1daa20-dba6-416e-ac55-c2d80439373b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.480201 Oct 04 18:27:53.202990 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2800/5608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:52 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:53.203842 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2809/5609] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:52 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:53.264867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a1b91ec5-6d88-4439-9770-7d51e6c4eda2 req-54e8d298-b661-4078-84f9-fc43c41f9cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d39c1d8-8eed-462d-af88-bd613d502347", "name": "network-vif-plugged", "status": "completed", "tag": "12e1280e-928a-4b59-9480-9e0bba1dd891"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:53.275882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1b91ec5-6d88-4439-9770-7d51e6c4eda2 req-54e8d298-b661-4078-84f9-fc43c41f9cb6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.276374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1b91ec5-6d88-4439-9770-7d51e6c4eda2 req-54e8d298-b661-4078-84f9-fc43c41f9cb6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.276980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1b91ec5-6d88-4439-9770-7d51e6c4eda2 req-54e8d298-b661-4078-84f9-fc43c41f9cb6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.290604 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a1b91ec5-6d88-4439-9770-7d51e6c4eda2 req-54e8d298-b661-4078-84f9-fc43c41f9cb6 service nova] Creating event network-vif-plugged:12e1280e-928a-4b59-9480-9e0bba1dd891 for instance 9d39c1d8-8eed-462d-af88-bd613d502347 on n-h1-850499-14 Oct 04 18:27:53.296384 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a1b91ec5-6d88-4439-9770-7d51e6c4eda2 req-54e8d298-b661-4078-84f9-fc43c41f9cb6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035017 Oct 04 18:27:53.297024 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2801/5610] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:54.220433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.221741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:54.232656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.235007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.235885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.237635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.238247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-36f3ef8e-374c-4a84-8ab6-1915f6bb9237 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.239261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.240774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.242841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-36f3ef8e-374c-4a84-8ab6-1915f6bb9237 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:54.270457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f3ef8e-374c-4a84-8ab6-1915f6bb9237 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.272333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f3ef8e-374c-4a84-8ab6-1915f6bb9237 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.274590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f3ef8e-374c-4a84-8ab6-1915f6bb9237 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.276915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f3ef8e-374c-4a84-8ab6-1915f6bb9237 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.278253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f3ef8e-374c-4a84-8ab6-1915f6bb9237 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.280090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36f3ef8e-374c-4a84-8ab6-1915f6bb9237 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.530176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-36f3ef8e-374c-4a84-8ab6-1915f6bb9237 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:54.543429 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-36f3ef8e-374c-4a84-8ab6-1915f6bb9237 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.321680 Oct 04 18:27:54.555112 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2802/5611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:54 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:54.622837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:54.641258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:54.644592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:54.647165 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-77038bbd-9738-4922-a45a-df0264984ad5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.430608 Oct 04 18:27:54.648548 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2810/5612] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:54 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:55.570111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a19fb44-8497-4726-9aa1-02b35b287abf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.571013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4a19fb44-8497-4726-9aa1-02b35b287abf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:55.583407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a19fb44-8497-4726-9aa1-02b35b287abf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:55.583917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a19fb44-8497-4726-9aa1-02b35b287abf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:55.584365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a19fb44-8497-4726-9aa1-02b35b287abf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:55.585155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a19fb44-8497-4726-9aa1-02b35b287abf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:55.593308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a19fb44-8497-4726-9aa1-02b35b287abf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:55.593929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a19fb44-8497-4726-9aa1-02b35b287abf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:55.681333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.682045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:55.695207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:55.695897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:55.699026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:55.712911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:55.713301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:55.713765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:55.949683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4a19fb44-8497-4726-9aa1-02b35b287abf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:55.965345 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4a19fb44-8497-4726-9aa1-02b35b287abf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.395267 Oct 04 18:27:55.966171 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2803/5613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:56.037890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:56.058054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:56.060210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:56.064195 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3926ec89-c768-4891-a5a1-85a6c4c7f1f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1810 microversion: 2.20 time: 0.392900 Oct 04 18:27:56.065721 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2811/5614] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1810 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:27:56.989373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ff3a488e-5877-47f6-9235-892184852ac9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.990014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ff3a488e-5877-47f6-9235-892184852ac9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:56.998808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff3a488e-5877-47f6-9235-892184852ac9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:56.999389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff3a488e-5877-47f6-9235-892184852ac9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:56.999914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff3a488e-5877-47f6-9235-892184852ac9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.000765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff3a488e-5877-47f6-9235-892184852ac9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.001306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff3a488e-5877-47f6-9235-892184852ac9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.001815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff3a488e-5877-47f6-9235-892184852ac9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.008529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:57.095502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.098295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:57.115281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.116119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.117700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.122380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.123412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.124104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.217386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ff3a488e-5877-47f6-9235-892184852ac9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:57.233011 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ff3a488e-5877-47f6-9235-892184852ac9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1656 microversion: 2.1 time: 0.247906 Oct 04 18:27:57.233633 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2804/5615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:56 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1656 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:57.256613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ff006a8-40ac-4a09-b8ee-72a975de4e96 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:57.275281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ff006a8-40ac-4a09-b8ee-72a975de4e96 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.275801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ff006a8-40ac-4a09-b8ee-72a975de4e96 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.276257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ff006a8-40ac-4a09-b8ee-72a975de4e96 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.326156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6ff006a8-40ac-4a09-b8ee-72a975de4e96 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Going to try to start instance {{(pid=122332) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:27:57.395789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:57.396986 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6ff006a8-40ac-4a09-b8ee-72a975de4e96 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.144582 Oct 04 18:27:57.398391 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2805/5616] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:57 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:57.407775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5db1700-94f7-4c8f-8f89-0536328c0f26 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.408808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5db1700-94f7-4c8f-8f89-0536328c0f26 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:57.415610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:57.417147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5db1700-94f7-4c8f-8f89-0536328c0f26 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.417703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5db1700-94f7-4c8f-8f89-0536328c0f26 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.418169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5db1700-94f7-4c8f-8f89-0536328c0f26 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.419595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5db1700-94f7-4c8f-8f89-0536328c0f26 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.419959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:57.420116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5db1700-94f7-4c8f-8f89-0536328c0f26 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.420556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5db1700-94f7-4c8f-8f89-0536328c0f26 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.422048 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c0602bf3-2a59-4144-bcf9-230c737af57e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1797 microversion: 2.20 time: 0.332433 Oct 04 18:27:57.423197 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2812/5617] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:27:57 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1797 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:27:57.651996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5db1700-94f7-4c8f-8f89-0536328c0f26 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:57.662812 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5db1700-94f7-4c8f-8f89-0536328c0f26 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1665 microversion: 2.1 time: 0.259782 Oct 04 18:27:57.665507 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2806/5618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:57 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1665 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:58.688690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ec81710d-a0e4-438d-9b62-15b89f25425c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:58.689249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ec81710d-a0e4-438d-9b62-15b89f25425c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:58.692071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=56 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:58.697396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec81710d-a0e4-438d-9b62-15b89f25425c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:58.697892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec81710d-a0e4-438d-9b62-15b89f25425c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:58.698334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec81710d-a0e4-438d-9b62-15b89f25425c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:58.699064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec81710d-a0e4-438d-9b62-15b89f25425c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:58.699528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec81710d-a0e4-438d-9b62-15b89f25425c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:58.699956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ec81710d-a0e4-438d-9b62-15b89f25425c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:58.830257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ec81710d-a0e4-438d-9b62-15b89f25425c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:58.838107 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ec81710d-a0e4-438d-9b62-15b89f25425c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1665 microversion: 2.1 time: 0.153689 Oct 04 18:27:58.838834 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2813/5619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:58 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:59.862570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0692c876-6402-4df2-b52c-df5deeccde7a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:59.863223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0692c876-6402-4df2-b52c-df5deeccde7a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:59.874318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0692c876-6402-4df2-b52c-df5deeccde7a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:59.877132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0692c876-6402-4df2-b52c-df5deeccde7a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:59.877855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0692c876-6402-4df2-b52c-df5deeccde7a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:59.878748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0692c876-6402-4df2-b52c-df5deeccde7a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:59.879393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0692c876-6402-4df2-b52c-df5deeccde7a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:59.882203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0692c876-6402-4df2-b52c-df5deeccde7a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.209400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0692c876-6402-4df2-b52c-df5deeccde7a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:00.237443 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0692c876-6402-4df2-b52c-df5deeccde7a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1665 microversion: 2.1 time: 0.379210 Oct 04 18:28:00.243329 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2807/5620] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:59 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1665 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:01.262286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b21f9f11-dcd5-4272-a279-8b3ac8cf4452 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.263913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b21f9f11-dcd5-4272-a279-8b3ac8cf4452 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:01.271679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b21f9f11-dcd5-4272-a279-8b3ac8cf4452 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.272516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b21f9f11-dcd5-4272-a279-8b3ac8cf4452 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.273499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b21f9f11-dcd5-4272-a279-8b3ac8cf4452 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.274432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b21f9f11-dcd5-4272-a279-8b3ac8cf4452 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.275141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b21f9f11-dcd5-4272-a279-8b3ac8cf4452 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.275792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b21f9f11-dcd5-4272-a279-8b3ac8cf4452 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.452352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b21f9f11-dcd5-4272-a279-8b3ac8cf4452 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:01.485579 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b21f9f11-dcd5-4272-a279-8b3ac8cf4452 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.227047 Oct 04 18:28:01.490823 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2814/5621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:01.514652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-916cd0fc-d1ff-41f6-bbc6-ea147eac7204 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.515308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-916cd0fc-d1ff-41f6-bbc6-ea147eac7204 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:01.528721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-916cd0fc-d1ff-41f6-bbc6-ea147eac7204 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.531781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-916cd0fc-d1ff-41f6-bbc6-ea147eac7204 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.532380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-916cd0fc-d1ff-41f6-bbc6-ea147eac7204 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.533687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-916cd0fc-d1ff-41f6-bbc6-ea147eac7204 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.533975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-916cd0fc-d1ff-41f6-bbc6-ea147eac7204 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.534509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-916cd0fc-d1ff-41f6-bbc6-ea147eac7204 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.735273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-916cd0fc-d1ff-41f6-bbc6-ea147eac7204 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:01.748680 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-916cd0fc-d1ff-41f6-bbc6-ea147eac7204 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.237827 Oct 04 18:28:01.750157 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2808/5622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:01.776207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5eb56821-1f18-411b-baf4-b1b627bf008a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:01.777090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5eb56821-1f18-411b-baf4-b1b627bf008a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:01.792331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eb56821-1f18-411b-baf4-b1b627bf008a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.793886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eb56821-1f18-411b-baf4-b1b627bf008a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.795814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eb56821-1f18-411b-baf4-b1b627bf008a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.797780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eb56821-1f18-411b-baf4-b1b627bf008a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.800810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eb56821-1f18-411b-baf4-b1b627bf008a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.801530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eb56821-1f18-411b-baf4-b1b627bf008a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.882625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5eb56821-1f18-411b-baf4-b1b627bf008a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Unlocking {{(pid=122331) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:28:01.936993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:01.941342 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5eb56821-1f18-411b-baf4-b1b627bf008a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.169439 Oct 04 18:28:01.942281 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2815/5623] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:28:01 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:28:01.953563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e3cdc7e-0c4f-45f2-aab1-8836194beefa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.954267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6e3cdc7e-0c4f-45f2-aab1-8836194beefa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:01.964568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e3cdc7e-0c4f-45f2-aab1-8836194beefa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.965488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e3cdc7e-0c4f-45f2-aab1-8836194beefa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.966150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e3cdc7e-0c4f-45f2-aab1-8836194beefa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.967121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e3cdc7e-0c4f-45f2-aab1-8836194beefa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.967862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e3cdc7e-0c4f-45f2-aab1-8836194beefa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.969135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e3cdc7e-0c4f-45f2-aab1-8836194beefa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.189952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6e3cdc7e-0c4f-45f2-aab1-8836194beefa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.213136 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e3cdc7e-0c4f-45f2-aab1-8836194beefa tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.264621 Oct 04 18:28:02.236084 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2809/5624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:02.273943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-014f57d9-aadf-4444-8719-7898f09696cd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.292462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-014f57d9-aadf-4444-8719-7898f09696cd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:02.353212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-014f57d9-aadf-4444-8719-7898f09696cd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.354784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-014f57d9-aadf-4444-8719-7898f09696cd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.356293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-014f57d9-aadf-4444-8719-7898f09696cd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.358275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-014f57d9-aadf-4444-8719-7898f09696cd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.366015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-014f57d9-aadf-4444-8719-7898f09696cd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.368992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-014f57d9-aadf-4444-8719-7898f09696cd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.723241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-014f57d9-aadf-4444-8719-7898f09696cd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.732723 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-014f57d9-aadf-4444-8719-7898f09696cd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.492686 Oct 04 18:28:02.733392 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2816/5625] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:02.755363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa6f0809-6e2f-4f92-822f-99dd9e4c9459 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.755997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aa6f0809-6e2f-4f92-822f-99dd9e4c9459 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:02.765093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6f0809-6e2f-4f92-822f-99dd9e4c9459 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.765970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6f0809-6e2f-4f92-822f-99dd9e4c9459 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.766601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6f0809-6e2f-4f92-822f-99dd9e4c9459 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.767964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6f0809-6e2f-4f92-822f-99dd9e4c9459 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.768591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6f0809-6e2f-4f92-822f-99dd9e4c9459 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.769230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6f0809-6e2f-4f92-822f-99dd9e4c9459 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.041058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aa6f0809-6e2f-4f92-822f-99dd9e4c9459 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:03.049166 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa6f0809-6e2f-4f92-822f-99dd9e4c9459 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.297704 Oct 04 18:28:03.049764 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2810/5626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:03.075386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2221e2c3-cb9f-40a7-be1c-009707b31671 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:03.077015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2221e2c3-cb9f-40a7-be1c-009707b31671 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:03.102029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2221e2c3-cb9f-40a7-be1c-009707b31671 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.107293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2221e2c3-cb9f-40a7-be1c-009707b31671 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.109937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2221e2c3-cb9f-40a7-be1c-009707b31671 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.112052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2221e2c3-cb9f-40a7-be1c-009707b31671 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.114388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2221e2c3-cb9f-40a7-be1c-009707b31671 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.116051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2221e2c3-cb9f-40a7-be1c-009707b31671 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.248131 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2221e2c3-cb9f-40a7-be1c-009707b31671 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.175764 Oct 04 18:28:03.249466 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2817/5627] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:28:03 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:28:03.265542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f54ce239-6712-4221-9c74-b40aae3442f2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:03.267733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f54ce239-6712-4221-9c74-b40aae3442f2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:03.287709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f54ce239-6712-4221-9c74-b40aae3442f2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.288825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f54ce239-6712-4221-9c74-b40aae3442f2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.290223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f54ce239-6712-4221-9c74-b40aae3442f2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.291950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f54ce239-6712-4221-9c74-b40aae3442f2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.292629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f54ce239-6712-4221-9c74-b40aae3442f2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.293292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f54ce239-6712-4221-9c74-b40aae3442f2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.550161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f54ce239-6712-4221-9c74-b40aae3442f2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:03.566832 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f54ce239-6712-4221-9c74-b40aae3442f2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1674 microversion: 2.1 time: 0.313578 Oct 04 18:28:03.569890 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2811/5628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:03 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1674 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:04.601215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8bca6a64-492c-43d8-90a7-0a61fa497f66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:04.602635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8bca6a64-492c-43d8-90a7-0a61fa497f66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:04.609080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bca6a64-492c-43d8-90a7-0a61fa497f66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:04.609581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bca6a64-492c-43d8-90a7-0a61fa497f66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:04.610228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bca6a64-492c-43d8-90a7-0a61fa497f66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.610982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bca6a64-492c-43d8-90a7-0a61fa497f66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:04.611471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bca6a64-492c-43d8-90a7-0a61fa497f66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:04.611977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8bca6a64-492c-43d8-90a7-0a61fa497f66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.869444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8bca6a64-492c-43d8-90a7-0a61fa497f66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:04.884634 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8bca6a64-492c-43d8-90a7-0a61fa497f66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1654 microversion: 2.1 time: 0.288461 Oct 04 18:28:04.886115 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2818/5629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:04 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1654 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:04.906732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aef7cc40-2c77-4659-86d6-40d70a796879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:04.907354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aef7cc40-2c77-4659-86d6-40d70a796879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:04.915118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef7cc40-2c77-4659-86d6-40d70a796879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:04.915822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef7cc40-2c77-4659-86d6-40d70a796879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:04.916411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef7cc40-2c77-4659-86d6-40d70a796879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.917323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef7cc40-2c77-4659-86d6-40d70a796879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:04.917960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef7cc40-2c77-4659-86d6-40d70a796879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:04.918842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aef7cc40-2c77-4659-86d6-40d70a796879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.008576 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aef7cc40-2c77-4659-86d6-40d70a796879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.105279 Oct 04 18:28:05.012479 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2812/5630] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:28:04 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:28:05.017659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a466bace-d389-45ac-9870-59451f55716d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:05.018291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a466bace-d389-45ac-9870-59451f55716d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:05.026984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a466bace-d389-45ac-9870-59451f55716d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:05.027503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a466bace-d389-45ac-9870-59451f55716d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:05.027960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a466bace-d389-45ac-9870-59451f55716d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.030078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a466bace-d389-45ac-9870-59451f55716d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:05.031413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a466bace-d389-45ac-9870-59451f55716d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:05.032083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a466bace-d389-45ac-9870-59451f55716d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.307244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a466bace-d389-45ac-9870-59451f55716d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:05.320057 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a466bace-d389-45ac-9870-59451f55716d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1661 microversion: 2.1 time: 0.306187 Oct 04 18:28:05.322913 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2819/5631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:05 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1661 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:06.349831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-feb98e92-ffb7-41af-af9a-503e8ac5c8fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:06.352773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-feb98e92-ffb7-41af-af9a-503e8ac5c8fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:06.363415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-feb98e92-ffb7-41af-af9a-503e8ac5c8fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.364236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-feb98e92-ffb7-41af-af9a-503e8ac5c8fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.365355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-feb98e92-ffb7-41af-af9a-503e8ac5c8fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.367516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-feb98e92-ffb7-41af-af9a-503e8ac5c8fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.368256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-feb98e92-ffb7-41af-af9a-503e8ac5c8fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.368868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-feb98e92-ffb7-41af-af9a-503e8ac5c8fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.622772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-feb98e92-ffb7-41af-af9a-503e8ac5c8fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:06.637057 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-feb98e92-ffb7-41af-af9a-503e8ac5c8fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.295297 Oct 04 18:28:06.638332 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2813/5632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:06 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:06.665836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-77dd9c2b-43ea-4741-8c8e-d60223aa3134 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:06.667245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-77dd9c2b-43ea-4741-8c8e-d60223aa3134 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:06.676283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77dd9c2b-43ea-4741-8c8e-d60223aa3134 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.677640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77dd9c2b-43ea-4741-8c8e-d60223aa3134 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.678362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77dd9c2b-43ea-4741-8c8e-d60223aa3134 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.679970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77dd9c2b-43ea-4741-8c8e-d60223aa3134 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.680656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77dd9c2b-43ea-4741-8c8e-d60223aa3134 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.681552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77dd9c2b-43ea-4741-8c8e-d60223aa3134 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.942183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77dd9c2b-43ea-4741-8c8e-d60223aa3134 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:06.973160 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-77dd9c2b-43ea-4741-8c8e-d60223aa3134 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.309918 Oct 04 18:28:06.975133 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2820/5633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:06 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:07.002351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e9e90c18-2a2e-4d60-9b7f-15f9946bb863 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:07.002987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e9e90c18-2a2e-4d60-9b7f-15f9946bb863 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:07.013151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9e90c18-2a2e-4d60-9b7f-15f9946bb863 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.013511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9e90c18-2a2e-4d60-9b7f-15f9946bb863 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.014829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9e90c18-2a2e-4d60-9b7f-15f9946bb863 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.015859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9e90c18-2a2e-4d60-9b7f-15f9946bb863 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.016743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9e90c18-2a2e-4d60-9b7f-15f9946bb863 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.017357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9e90c18-2a2e-4d60-9b7f-15f9946bb863 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.280314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e9e90c18-2a2e-4d60-9b7f-15f9946bb863 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:07.290776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e9e90c18-2a2e-4d60-9b7f-15f9946bb863 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.290602 Oct 04 18:28:07.295134 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2814/5634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:06 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:07.316479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-865919e4-d8d3-4cbd-af00-e45cf506de08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:07.317519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-865919e4-d8d3-4cbd-af00-e45cf506de08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:07.324522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-865919e4-d8d3-4cbd-af00-e45cf506de08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.325527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-865919e4-d8d3-4cbd-af00-e45cf506de08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.326273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-865919e4-d8d3-4cbd-af00-e45cf506de08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.327217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-865919e4-d8d3-4cbd-af00-e45cf506de08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.327852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-865919e4-d8d3-4cbd-af00-e45cf506de08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.328416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-865919e4-d8d3-4cbd-af00-e45cf506de08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.545486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-865919e4-d8d3-4cbd-af00-e45cf506de08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:07.554763 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-865919e4-d8d3-4cbd-af00-e45cf506de08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.243912 Oct 04 18:28:07.558696 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2821/5635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:07 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:07.581726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b08a3f8d-4407-4209-b987-71835c0cd86e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:07.582452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b08a3f8d-4407-4209-b987-71835c0cd86e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:07.592524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08a3f8d-4407-4209-b987-71835c0cd86e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.593150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08a3f8d-4407-4209-b987-71835c0cd86e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.593838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08a3f8d-4407-4209-b987-71835c0cd86e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.595423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08a3f8d-4407-4209-b987-71835c0cd86e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.596213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08a3f8d-4407-4209-b987-71835c0cd86e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.597168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08a3f8d-4407-4209-b987-71835c0cd86e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.771517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b08a3f8d-4407-4209-b987-71835c0cd86e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:07.781518 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b08a3f8d-4407-4209-b987-71835c0cd86e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.203625 Oct 04 18:28:07.782271 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2815/5636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:07 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:07.811883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4a78ba9-fcdf-45f7-beea-b52098ada126 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:07.815925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f4a78ba9-fcdf-45f7-beea-b52098ada126 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:07.831542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4a78ba9-fcdf-45f7-beea-b52098ada126 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.832663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4a78ba9-fcdf-45f7-beea-b52098ada126 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.837418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4a78ba9-fcdf-45f7-beea-b52098ada126 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.838842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4a78ba9-fcdf-45f7-beea-b52098ada126 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.839218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4a78ba9-fcdf-45f7-beea-b52098ada126 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.842120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4a78ba9-fcdf-45f7-beea-b52098ada126 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:08.056570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f4a78ba9-fcdf-45f7-beea-b52098ada126 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:08.075057 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f4a78ba9-fcdf-45f7-beea-b52098ada126 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.268925 Oct 04 18:28:08.075981 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2822/5637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:07 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:30.047668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-061ac775-8dff-4905-989b-8b52321930d1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.049595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-061ac775-8dff-4905-989b-8b52321930d1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:30.058696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=39 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:30.063188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:30.074079 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:28:30.074812 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 18:28:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments/1aa478d0-355f-4a6c-98bf-d07481520423 (ip 10.222.0.18) !!! Oct 04 18:28:30.085578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ac775-8dff-4905-989b-8b52321930d1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.086470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ac775-8dff-4905-989b-8b52321930d1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.091838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ac775-8dff-4905-989b-8b52321930d1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.095474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ac775-8dff-4905-989b-8b52321930d1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.100312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ac775-8dff-4905-989b-8b52321930d1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.101557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-061ac775-8dff-4905-989b-8b52321930d1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.192983 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-061ac775-8dff-4905-989b-8b52321930d1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments/1aa478d0-355f-4a6c-98bf-d07481520423" status: 200 len: 194 microversion: 2.20 time: 0.146440 Oct 04 18:28:30.197988 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2816/5638] 10.222.0.18 () {60 vars in 1454 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments/1aa478d0-355f-4a6c-98bf-d07481520423 => generated 194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:30.354664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-25c26588-55f2-4080-b331-9ecfd94cf284 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.355546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-25c26588-55f2-4080-b331-9ecfd94cf284 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:30.368738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=19 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:30.372399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:30.374286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25c26588-55f2-4080-b331-9ecfd94cf284 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.375156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25c26588-55f2-4080-b331-9ecfd94cf284 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.375784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25c26588-55f2-4080-b331-9ecfd94cf284 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.376674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25c26588-55f2-4080-b331-9ecfd94cf284 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.384401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25c26588-55f2-4080-b331-9ecfd94cf284 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.384908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25c26588-55f2-4080-b331-9ecfd94cf284 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.572121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-25c26588-55f2-4080-b331-9ecfd94cf284 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lazy-loading 'services' on Instance uuid 9d39c1d8-8eed-462d-af88-bd613d502347 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:28:30.781122 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-25c26588-55f2-4080-b331-9ecfd94cf284 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments/1aa478d0-355f-4a6c-98bf-d07481520423" status: 202 len: 0 microversion: 2.20 time: 0.432113 Oct 04 18:28:30.793028 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2823/5639] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Oct 4 18:28:30 2022] DELETE /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments/1aa478d0-355f-4a6c-98bf-d07481520423 => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:28:30.805328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ccaed97e-dd9a-41f0-a0d1-562cab2e7c00 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.828252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ccaed97e-dd9a-41f0-a0d1-562cab2e7c00 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:30.851890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccaed97e-dd9a-41f0-a0d1-562cab2e7c00 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.852747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccaed97e-dd9a-41f0-a0d1-562cab2e7c00 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.853465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccaed97e-dd9a-41f0-a0d1-562cab2e7c00 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.854635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccaed97e-dd9a-41f0-a0d1-562cab2e7c00 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.855476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccaed97e-dd9a-41f0-a0d1-562cab2e7c00 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.856229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccaed97e-dd9a-41f0-a0d1-562cab2e7c00 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.920279 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ccaed97e-dd9a-41f0-a0d1-562cab2e7c00 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121293 Oct 04 18:28:30.922415 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2817/5640] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:28:31.937667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ace5756-ba6d-481c-aa9e-5018732b54a2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:31.943200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ace5756-ba6d-481c-aa9e-5018732b54a2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:31.967990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ace5756-ba6d-481c-aa9e-5018732b54a2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.968511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ace5756-ba6d-481c-aa9e-5018732b54a2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.975077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ace5756-ba6d-481c-aa9e-5018732b54a2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.977420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ace5756-ba6d-481c-aa9e-5018732b54a2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.977927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ace5756-ba6d-481c-aa9e-5018732b54a2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.978385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ace5756-ba6d-481c-aa9e-5018732b54a2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.119206 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ace5756-ba6d-481c-aa9e-5018732b54a2 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.188217 Oct 04 18:28:32.122704 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2824/5641] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:28:31 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:28:33.137955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1e59c33-b7c6-460e-91ec-d1c79a42d5d7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:33.140915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1e59c33-b7c6-460e-91ec-d1c79a42d5d7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:33.156554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e59c33-b7c6-460e-91ec-d1c79a42d5d7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.156974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e59c33-b7c6-460e-91ec-d1c79a42d5d7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.157420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e59c33-b7c6-460e-91ec-d1c79a42d5d7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.158142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e59c33-b7c6-460e-91ec-d1c79a42d5d7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.165189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e59c33-b7c6-460e-91ec-d1c79a42d5d7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.165595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e59c33-b7c6-460e-91ec-d1c79a42d5d7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.279601 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1e59c33-b7c6-460e-91ec-d1c79a42d5d7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147138 Oct 04 18:28:33.284795 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2818/5642] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:28:33 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:34.299181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a8f7f43-2020-4c16-8457-2c58edbb872d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:34.302126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3a8f7f43-2020-4c16-8457-2c58edbb872d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:34.325015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a8f7f43-2020-4c16-8457-2c58edbb872d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.325851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a8f7f43-2020-4c16-8457-2c58edbb872d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.326557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a8f7f43-2020-4c16-8457-2c58edbb872d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.329159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a8f7f43-2020-4c16-8457-2c58edbb872d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.337011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a8f7f43-2020-4c16-8457-2c58edbb872d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.338182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a8f7f43-2020-4c16-8457-2c58edbb872d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.410368 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a8f7f43-2020-4c16-8457-2c58edbb872d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116575 Oct 04 18:28:34.412511 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2825/5643] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:28:34 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:35.427478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84ff99a3-4a67-44a3-8a62-e8f64d830c1d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:35.436879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-84ff99a3-4a67-44a3-8a62-e8f64d830c1d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:35.453799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84ff99a3-4a67-44a3-8a62-e8f64d830c1d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:35.454545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84ff99a3-4a67-44a3-8a62-e8f64d830c1d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:35.455251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84ff99a3-4a67-44a3-8a62-e8f64d830c1d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:35.456402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84ff99a3-4a67-44a3-8a62-e8f64d830c1d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:35.457289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84ff99a3-4a67-44a3-8a62-e8f64d830c1d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:35.457939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84ff99a3-4a67-44a3-8a62-e8f64d830c1d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:35.503351 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84ff99a3-4a67-44a3-8a62-e8f64d830c1d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082602 Oct 04 18:28:35.504579 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2819/5644] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:28:35 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:36.517218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a1c26cf7-b429-4f6a-b57e-28f624433028 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.520069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a1c26cf7-b429-4f6a-b57e-28f624433028 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:36.541641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1c26cf7-b429-4f6a-b57e-28f624433028 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.545102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1c26cf7-b429-4f6a-b57e-28f624433028 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.546378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1c26cf7-b429-4f6a-b57e-28f624433028 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.547933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1c26cf7-b429-4f6a-b57e-28f624433028 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.549584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1c26cf7-b429-4f6a-b57e-28f624433028 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.551586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1c26cf7-b429-4f6a-b57e-28f624433028 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.688245 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a1c26cf7-b429-4f6a-b57e-28f624433028 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.175381 Oct 04 18:28:36.699678 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2826/5645] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:28:36 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:37.706398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a05f331e-b493-4a0a-a77f-21bde3e66313 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:37.709585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a05f331e-b493-4a0a-a77f-21bde3e66313 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:37.745310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a05f331e-b493-4a0a-a77f-21bde3e66313 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:37.746244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a05f331e-b493-4a0a-a77f-21bde3e66313 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:37.748972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a05f331e-b493-4a0a-a77f-21bde3e66313 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:37.750446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a05f331e-b493-4a0a-a77f-21bde3e66313 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:37.756458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a05f331e-b493-4a0a-a77f-21bde3e66313 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:37.760571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a05f331e-b493-4a0a-a77f-21bde3e66313 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:37.864528 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a05f331e-b493-4a0a-a77f-21bde3e66313 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161981 Oct 04 18:28:37.865788 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2820/5646] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:28:37 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:38.877490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4fa3a57-514a-4bb7-93e8-352e3a188fa1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:38.881131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e4fa3a57-514a-4bb7-93e8-352e3a188fa1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:38.893007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4fa3a57-514a-4bb7-93e8-352e3a188fa1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:38.900289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4fa3a57-514a-4bb7-93e8-352e3a188fa1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:38.900992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4fa3a57-514a-4bb7-93e8-352e3a188fa1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:38.901924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4fa3a57-514a-4bb7-93e8-352e3a188fa1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:38.902672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4fa3a57-514a-4bb7-93e8-352e3a188fa1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:38.903300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4fa3a57-514a-4bb7-93e8-352e3a188fa1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:38.979223 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e4fa3a57-514a-4bb7-93e8-352e3a188fa1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105756 Oct 04 18:28:38.979835 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2827/5647] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:28:38 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:39.995654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c221a149-f833-46ac-af42-85ff88d5da3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:39.998919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c221a149-f833-46ac-af42-85ff88d5da3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:40.008708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221a149-f833-46ac-af42-85ff88d5da3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.010019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221a149-f833-46ac-af42-85ff88d5da3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.010019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221a149-f833-46ac-af42-85ff88d5da3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.010861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221a149-f833-46ac-af42-85ff88d5da3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.011600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221a149-f833-46ac-af42-85ff88d5da3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.012241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c221a149-f833-46ac-af42-85ff88d5da3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.111288 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c221a149-f833-46ac-af42-85ff88d5da3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.089259 Oct 04 18:28:40.113314 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2821/5648] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:28:39 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:40.218584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d531a8cd-ed1a-4fd3-a133-38c2bc369168 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:40.219497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d531a8cd-ed1a-4fd3-a133-38c2bc369168 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:40.234569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d531a8cd-ed1a-4fd3-a133-38c2bc369168 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.235140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d531a8cd-ed1a-4fd3-a133-38c2bc369168 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.235601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d531a8cd-ed1a-4fd3-a133-38c2bc369168 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.236347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d531a8cd-ed1a-4fd3-a133-38c2bc369168 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.236987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d531a8cd-ed1a-4fd3-a133-38c2bc369168 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.237439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d531a8cd-ed1a-4fd3-a133-38c2bc369168 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.316885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d531a8cd-ed1a-4fd3-a133-38c2bc369168 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:28:40.477159 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d531a8cd-ed1a-4fd3-a133-38c2bc369168 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 204 len: 0 microversion: 2.20 time: 0.262278 Oct 04 18:28:40.478354 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2828/5649] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:28:40 2022] DELETE /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:28:40.486631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:40.487325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:40.502868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.503712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.512405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.513532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.514226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.515642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.038026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:41.073937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:41.077306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:41.079047 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ad8edad8-2fdc-48df-9eb3-f6cd0b8e9120 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.596200 Oct 04 18:28:41.091068 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2822/5650] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:40 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:42.108066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:42.108929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:42.120940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:42.123234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:42.127495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:42.128421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:42.129031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:42.129573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:42.859226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:42.874466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:42.879281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:42.884198 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ab9229a6-c35c-401a-833e-8d99240519a8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1725 microversion: 2.20 time: 0.780559 Oct 04 18:28:42.886194 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2829/5651] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:42 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1725 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:43.926194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:43.928557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:43.939709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:43.942251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:43.943328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:43.946075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:43.947040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:43.947619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:44.171146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:44.190308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:44.191986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:44.195339 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7dfafdc3-9418-457d-a0ad-024d96fc23ab tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1658 microversion: 2.20 time: 0.280673 Oct 04 18:28:44.196491 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2823/5652] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:43 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1658 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:45.057661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-87a8a1d6-60ec-4207-93db-a9dbdbc88970 req-9a2486ca-3755-485f-9cb7-f2293da1c40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d39c1d8-8eed-462d-af88-bd613d502347", "name": "network-vif-deleted", "tag": "12e1280e-928a-4b59-9480-9e0bba1dd891"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:45.100633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-87a8a1d6-60ec-4207-93db-a9dbdbc88970 req-9a2486ca-3755-485f-9cb7-f2293da1c40e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.104846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-87a8a1d6-60ec-4207-93db-a9dbdbc88970 req-9a2486ca-3755-485f-9cb7-f2293da1c40e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.105863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-87a8a1d6-60ec-4207-93db-a9dbdbc88970 req-9a2486ca-3755-485f-9cb7-f2293da1c40e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.131677 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-87a8a1d6-60ec-4207-93db-a9dbdbc88970 req-9a2486ca-3755-485f-9cb7-f2293da1c40e service nova] Creating event network-vif-deleted:12e1280e-928a-4b59-9480-9e0bba1dd891 for instance 9d39c1d8-8eed-462d-af88-bd613d502347 on n-h1-850499-14 Oct 04 18:28:45.137694 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-87a8a1d6-60ec-4207-93db-a9dbdbc88970 req-9a2486ca-3755-485f-9cb7-f2293da1c40e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084855 Oct 04 18:28:45.139194 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2830/5653] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:45.239228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:45.240647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:45.257921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.258728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.260154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.261199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.261831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.262554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.354172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.368656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.369896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.370806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lazy-loading 'fault' on Instance uuid 9d39c1d8-8eed-462d-af88-bd613d502347 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:28:45.954898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:45.968634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:45.970462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:45.971920 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6dc8aa98-aaf5-4ad5-9c58-bc7ce59a1fb6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 200 len: 1372 microversion: 2.20 time: 0.737819 Oct 04 18:28:45.975882 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2824/5654] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:45 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 1372 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:28:47.006657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:47.007563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:47.015722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:47.016396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:47.016945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:47.017996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:47.018356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:47.018896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:47.036504 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] HTTP exception thrown: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Request method failure captured: Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 HTTP/1.1 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHo6CoC1FSPIVrg-hxvx64Lvu37FgZi7a5eitfhfJwkBg9f-xM_F44eAQHOV-RRu6YKGbHKkXgJcSlA7K3HENS6G3T7JGlva_GcVMYqBPSeUA8BTCeKOSQkddS9n3WsTX_Hbg5BWBbHDphM_NL5H-NC4MU6MvAM9yHrYUHieUy34UhM Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}] Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: e5b5b2a021cb49279d695bdeed577655 Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '9d39c1d8-8eed-462d-af88-bd613d502347'} Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:28:47.038868 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Returning 404 to user: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc29a23e-df4c-4f72-ad84-77795437e900 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 404 len: 111 microversion: 2.20 time: 0.039466 Oct 04 18:28:47.042358 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2831/5655] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:46 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:28:47.049557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe043d0c-e072-4812-9bdd-92f114feee92 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '.version_select at 0x7fd4d0b8da60>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:47.081201 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fe043d0c-e072-4812-9bdd-92f114feee92 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684364586" status: 204 len: 0 microversion: 2.20 time: 0.035536 Oct 04 18:28:47.082031 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2825/5656] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 4 18:28:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684364586 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:28:48.806504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e14bc9eb-80be-4175-b35a-de55f9a2c298 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Action: 'create', calling method: .version_select at 0x7fd4d11a9550>, body: {"keypair": {"name": "tempest-keypair-751853134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlLArHlenCg4eR7Nnsp9CEE72YaI1KXWJRyKpqzFVIyOU2Tljegx96e2SQq20rswSXAxk+SlQP7fgmixVpIKRApdUlTSAw5X2fAJySl4+gLNmIzOedpHoONnsU+Wt6g5w=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:48.835178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-e14bc9eb-80be-4175-b35a-de55f9a2c298 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Getting quotas for project 880b25dfcd7c4a2ab247dd7855993dc8. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:48.841863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-e14bc9eb-80be-4175-b35a-de55f9a2c298 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Getting quotas for user e5b5b2a021cb49279d695bdeed577655 and project 880b25dfcd7c4a2ab247dd7855993dc8. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:48.878313 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e14bc9eb-80be-4175-b35a-de55f9a2c298 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.076028 Oct 04 18:28:48.879355 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2832/5657] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 4 18:28:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:28:52.317682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1173596358", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2c76a8-0540-4afc-b328-f1ba2df44ce2"}], "security_groups": [{"name": "tempest-securitygroup--358288619"}], "key_name": "tempest-keypair-751853134", "user_data": "}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:52.550803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] validate_networks() for [('be2c76a8-0540-4afc-b328-f1ba2df44ce2', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:53.945579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:53.948397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:53.950522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:53.951656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:53.953963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:53.978193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:53.979438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:53.980810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:53.982810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:53.983899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:53.985348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:54.019812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Getting quotas for project 880b25dfcd7c4a2ab247dd7855993dc8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:54.027960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Getting quotas for user e5b5b2a021cb49279d695bdeed577655 and project 880b25dfcd7c4a2ab247dd7855993dc8. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:54.046419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:28:54.049643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:28:54.127432 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d60aced2-b5b2-4d8e-8014-fb1c92b198fc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.813661 Oct 04 18:28:54.128469 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2826/5658] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 4 18:28:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:28:54.470552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-960a0023-5fa8-433b-a0cb-b6ee59e41972 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:54.473442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-960a0023-5fa8-433b-a0cb-b6ee59e41972 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:54.577478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-960a0023-5fa8-433b-a0cb-b6ee59e41972 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:54.591481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-960a0023-5fa8-433b-a0cb-b6ee59e41972 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:54.593623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-960a0023-5fa8-433b-a0cb-b6ee59e41972 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:54.595507 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-960a0023-5fa8-433b-a0cb-b6ee59e41972 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1281 microversion: 2.20 time: 0.455093 Oct 04 18:28:54.597077 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2833/5659] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:54 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1281 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:55.597910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fa9f948b-c07b-4db0-bc0d-c66eaa6e33bc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:55.598444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fa9f948b-c07b-4db0-bc0d-c66eaa6e33bc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:55.622189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:55.623512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:55.629140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa9f948b-c07b-4db0-bc0d-c66eaa6e33bc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:55.630739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa9f948b-c07b-4db0-bc0d-c66eaa6e33bc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:55.634518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa9f948b-c07b-4db0-bc0d-c66eaa6e33bc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:55.638264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa9f948b-c07b-4db0-bc0d-c66eaa6e33bc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:55.638937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa9f948b-c07b-4db0-bc0d-c66eaa6e33bc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:55.641841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa9f948b-c07b-4db0-bc0d-c66eaa6e33bc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:55.653300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:55.654826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:55.655746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:55.658366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:55.659785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:55.660971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:55.798097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-fa9f948b-c07b-4db0-bc0d-c66eaa6e33bc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lazy-loading 'services' on Instance uuid 66ac8a47-83c9-442a-a1a4-6e09347c397a {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:28:55.904223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:55.915544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:55.917280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:55.919260 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aa77d35c-45b7-41fe-a2ad-927ef57f814e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1341 microversion: 2.20 time: 0.301017 Oct 04 18:28:55.920883 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2834/5660] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:55 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1341 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:55.929413 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fa9f948b-c07b-4db0-bc0d-c66eaa6e33bc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "DELETE /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments/89d10f33-be6c-4d13-bc12-1bed48e86471" status: 202 len: 0 microversion: 2.1 time: 0.331182 Oct 04 18:28:55.931181 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2827/5661] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:28:55 2022] DELETE /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments/89d10f33-be6c-4d13-bc12-1bed48e86471 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:28:55.960049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d7ccdab-5510-4078-9bde-044ccc826410 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:55.964883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4d7ccdab-5510-4078-9bde-044ccc826410 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:55.977720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d7ccdab-5510-4078-9bde-044ccc826410 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:55.978491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d7ccdab-5510-4078-9bde-044ccc826410 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:55.979719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d7ccdab-5510-4078-9bde-044ccc826410 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:55.980728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d7ccdab-5510-4078-9bde-044ccc826410 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:55.981515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d7ccdab-5510-4078-9bde-044ccc826410 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:55.982120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d7ccdab-5510-4078-9bde-044ccc826410 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.043584 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4d7ccdab-5510-4078-9bde-044ccc826410 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107090 Oct 04 18:28:56.047005 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2835/5662] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:28:55 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:56.950004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:56.950727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:56.966808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.967345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.967784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.970130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.972157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.972765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:57.062078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cc2f63ca-13d4-444d-9a46-f339ef0ac0b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:57.067984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cc2f63ca-13d4-444d-9a46-f339ef0ac0b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:57.076555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc2f63ca-13d4-444d-9a46-f339ef0ac0b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:57.077360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc2f63ca-13d4-444d-9a46-f339ef0ac0b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:57.078195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc2f63ca-13d4-444d-9a46-f339ef0ac0b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:57.079856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc2f63ca-13d4-444d-9a46-f339ef0ac0b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:57.080555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc2f63ca-13d4-444d-9a46-f339ef0ac0b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:57.081929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc2f63ca-13d4-444d-9a46-f339ef0ac0b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:57.133232 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cc2f63ca-13d4-444d-9a46-f339ef0ac0b0 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078912 Oct 04 18:28:57.135746 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2836/5663] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:28:57 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:57.407329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:57.426225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:57.428814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:57.448745 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a7522446-da5a-4df2-9d71-ffaa8979cf9d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1339 microversion: 2.20 time: 0.506048 Oct 04 18:28:57.462016 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2828/5664] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:56 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1339 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:58.149933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d1251c94-ba49-423e-a90e-aa6c8fbb958f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:58.152325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d1251c94-ba49-423e-a90e-aa6c8fbb958f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:58.168907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1251c94-ba49-423e-a90e-aa6c8fbb958f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:58.169897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1251c94-ba49-423e-a90e-aa6c8fbb958f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:58.172210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1251c94-ba49-423e-a90e-aa6c8fbb958f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:58.173179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1251c94-ba49-423e-a90e-aa6c8fbb958f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:58.175664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1251c94-ba49-423e-a90e-aa6c8fbb958f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:58.176341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1251c94-ba49-423e-a90e-aa6c8fbb958f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:58.302903 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d1251c94-ba49-423e-a90e-aa6c8fbb958f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158519 Oct 04 18:28:58.305889 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2837/5665] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:28:58 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:58.487699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:58.489049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:58.507507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:58.516322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:58.524369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:58.525403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:58.526040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:58.526630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:58.963830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:58.972566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:58.974407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:58.975962 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9860b71-1e4b-4263-98bd-23c698db8f74 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1406 microversion: 2.20 time: 0.492557 Oct 04 18:28:58.977109 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2829/5666] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:58 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1406 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:59.316356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-faee9903-05f0-463a-8890-644e37bd3a0d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:59.320467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-faee9903-05f0-463a-8890-644e37bd3a0d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:59.336817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faee9903-05f0-463a-8890-644e37bd3a0d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:59.337332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faee9903-05f0-463a-8890-644e37bd3a0d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:59.337790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faee9903-05f0-463a-8890-644e37bd3a0d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:59.345202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faee9903-05f0-463a-8890-644e37bd3a0d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:59.345894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faee9903-05f0-463a-8890-644e37bd3a0d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:59.346369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-faee9903-05f0-463a-8890-644e37bd3a0d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:59.438401 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-faee9903-05f0-463a-8890-644e37bd3a0d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126222 Oct 04 18:28:59.447036 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2838/5667] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:28:59 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:00.002756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:00.003831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:00.015859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.016351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.016791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.017581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.018045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.018473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.454495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e6a57b52-70d9-4950-a141-d3fa18232524 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:00.457542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e6a57b52-70d9-4950-a141-d3fa18232524 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:00.470785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:00.477160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6a57b52-70d9-4950-a141-d3fa18232524 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.478608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6a57b52-70d9-4950-a141-d3fa18232524 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.480625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6a57b52-70d9-4950-a141-d3fa18232524 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.485342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6a57b52-70d9-4950-a141-d3fa18232524 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.486188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6a57b52-70d9-4950-a141-d3fa18232524 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.486903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6a57b52-70d9-4950-a141-d3fa18232524 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.500740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:00.583702 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e6a57b52-70d9-4950-a141-d3fa18232524 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136990 Oct 04 18:29:00.591578 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2839/5668] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:29:00 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:00.601922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b1561524-114d-4f19-b5e0-49d1dee3b1d5 req-974670d6-09ca-4304-aece-9433c99d8d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d9afae5-6ef4-4bd5-92f8-1d0ed466b280", "tag": "2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:00.633295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b1561524-114d-4f19-b5e0-49d1dee3b1d5 req-974670d6-09ca-4304-aece-9433c99d8d9e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.634043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b1561524-114d-4f19-b5e0-49d1dee3b1d5 req-974670d6-09ca-4304-aece-9433c99d8d9e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.634717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b1561524-114d-4f19-b5e0-49d1dee3b1d5 req-974670d6-09ca-4304-aece-9433c99d8d9e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.649145 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b1561524-114d-4f19-b5e0-49d1dee3b1d5 req-974670d6-09ca-4304-aece-9433c99d8d9e service nova] Creating event network-changed:2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e for instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 on n-h1-850499-14 Oct 04 18:29:00.657590 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b1561524-114d-4f19-b5e0-49d1dee3b1d5 req-974670d6-09ca-4304-aece-9433c99d8d9e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059095 Oct 04 18:29:00.658501 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2840/5669] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:00.766634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:00.775522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:00.785338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:00.787690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:00.790602 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22e39630-9259-422e-9f79-569cb15bba23 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1406 microversion: 2.20 time: 0.792330 Oct 04 18:29:00.792385 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2830/5670] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:59 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1406 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:01.612456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73aefb2d-1e80-41f7-8549-3305dcc54161 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:01.615191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73aefb2d-1e80-41f7-8549-3305dcc54161 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:01.635909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73aefb2d-1e80-41f7-8549-3305dcc54161 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.641546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73aefb2d-1e80-41f7-8549-3305dcc54161 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.642065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73aefb2d-1e80-41f7-8549-3305dcc54161 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.643084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73aefb2d-1e80-41f7-8549-3305dcc54161 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.643735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73aefb2d-1e80-41f7-8549-3305dcc54161 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.644193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73aefb2d-1e80-41f7-8549-3305dcc54161 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.728252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-73aefb2d-1e80-41f7-8549-3305dcc54161 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128330 Oct 04 18:29:01.736598 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2841/5671] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:29:01 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:01.837899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:01.846216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:01.858926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:01.871445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.890621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.891158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.891918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.893450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.894094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.309977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:02.322071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:02.324173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:02.325866 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-631d702b-4452-414c-9aee-4d4478a81cd4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1406 microversion: 2.20 time: 0.509790 Oct 04 18:29:02.331421 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2831/5672] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:01 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1406 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:02.748845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6821bde-0326-4d94-8cef-9df2e377e693 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:02.751549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f6821bde-0326-4d94-8cef-9df2e377e693 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:02.759710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6821bde-0326-4d94-8cef-9df2e377e693 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:02.760242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6821bde-0326-4d94-8cef-9df2e377e693 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:02.760861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6821bde-0326-4d94-8cef-9df2e377e693 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.761602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6821bde-0326-4d94-8cef-9df2e377e693 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:02.762073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6821bde-0326-4d94-8cef-9df2e377e693 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:02.762509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6821bde-0326-4d94-8cef-9df2e377e693 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.798024 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6821bde-0326-4d94-8cef-9df2e377e693 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053200 Oct 04 18:29:02.798623 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2842/5673] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:29:02 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:03.356076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:03.356590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:03.382048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.382775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.383333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.384269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.384800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.385371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.620936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:03.633086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:03.638241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:03.641803 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80b739d3-6e2d-44e5-810f-538e1fed521d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1406 microversion: 2.20 time: 0.289601 Oct 04 18:29:03.642398 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2832/5674] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:03 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:03.812441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fb740e89-330b-4720-8d61-40169f68c16d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:03.814979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb740e89-330b-4720-8d61-40169f68c16d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:03.823014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb740e89-330b-4720-8d61-40169f68c16d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.823608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb740e89-330b-4720-8d61-40169f68c16d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.824130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb740e89-330b-4720-8d61-40169f68c16d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.825091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb740e89-330b-4720-8d61-40169f68c16d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.825636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb740e89-330b-4720-8d61-40169f68c16d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.826147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb740e89-330b-4720-8d61-40169f68c16d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.860638 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fb740e89-330b-4720-8d61-40169f68c16d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052977 Oct 04 18:29:03.861921 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2843/5675] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:29:03 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:03.954731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:03.957433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:03.980450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.993281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.994104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.995675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.996351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.997016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.004540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:04.035688 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] HTTP exception thrown: Cannot 'reboot' instance f2e05a66-3878-4adf-8aca-e4879467c8f2 while it is in vm_state rescued Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Request method failure captured: Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2/action HTTP/1.1 Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 28 Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHnytef4l2dTU_iEGj2JHMj914KTgOcJXrZhkr0wpO7nRbM8OarsMPEpoh7kshRbzuhK9viViE8Sc8SnS-I9yNZdiPzuJrN6shc_HK2tbFONi9WDFR1vVIu70L5UasJlaDkchO8edMdo-N8WJ-RTGom7YRcTfKpi8ODDI4s0GHlW8GE Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab1cdc33329a4a10970e67390f750163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}] Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5a7fc8671d264393bfb0465438b598d1 Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: {"reboot": {"type": "HARD"}} Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: exception: Cannot 'reboot' instance f2e05a66-3878-4adf-8aca-e4879467c8f2 while it is in vm_state rescued Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'f2e05a66-3878-4adf-8aca-e4879467c8f2', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2e05a66-3878-4adf-8aca-e4879467c8f2 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:29:04.038019 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance f2e05a66-3878-4adf-8aca-e4879467c8f2 while it is in vm_state rescued Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance f2e05a66-3878-4adf-8aca-e4879467c8f2 while it is in vm_state rescued Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Returning 409 to user: Cannot 'reboot' instance f2e05a66-3878-4adf-8aca-e4879467c8f2 while it is in vm_state rescued {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:04.041446 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-af3006cc-3503-4dc6-8b69-f46f6b67b214 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2/action" status: 409 len: 145 microversion: 2.1 time: 0.088995 Oct 04 18:29:04.051983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:04.054902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:04.057837 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2833/5676] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:29:03 2022] POST /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2/action => generated 145 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:29:04.063331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.063541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.064076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.064981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.065473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.065919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.096818 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] HTTP exception thrown: Cannot 'rebuild' instance f2e05a66-3878-4adf-8aca-e4879467c8f2 while it is in vm_state rescued Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Request method failure captured: Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2/action HTTP/1.1 Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 65 Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHnytef4l2dTU_iEGj2JHMj914KTgOcJXrZhkr0wpO7nRbM8OarsMPEpoh7kshRbzuhK9viViE8Sc8SnS-I9yNZdiPzuJrN6shc_HK2tbFONi9WDFR1vVIu70L5UasJlaDkchO8edMdo-N8WJ-RTGom7YRcTfKpi8ODDI4s0GHlW8GE Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab1cdc33329a4a10970e67390f750163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}] Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 5a7fc8671d264393bfb0465438b598d1 Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: exception: Cannot 'rebuild' instance f2e05a66-3878-4adf-8aca-e4879467c8f2 while it is in vm_state rescued Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'f2e05a66-3878-4adf-8aca-e4879467c8f2', 'body': {'rebuild': {'imageRef': 'acd24e6c-2248-4327-9505-66fea04436b8'}}} Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2e05a66-3878-4adf-8aca-e4879467c8f2 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:29:04.099484 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance f2e05a66-3878-4adf-8aca-e4879467c8f2 while it is in vm_state rescued Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance f2e05a66-3878-4adf-8aca-e4879467c8f2 while it is in vm_state rescued Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Returning 409 to user: Cannot 'rebuild' instance f2e05a66-3878-4adf-8aca-e4879467c8f2 while it is in vm_state rescued {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f71aa816-392b-404c-adc4-07c0e142cf5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "POST /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2/action" status: 409 len: 146 microversion: 2.1 time: 0.053655 Oct 04 18:29:04.103171 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2844/5677] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:29:04 2022] POST /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2/action => generated 146 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:29:04.113060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e4f63b95-82a0-4bef-a605-076e2f37be5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.113549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e4f63b95-82a0-4bef-a605-076e2f37be5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:04.116132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:04.125413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4f63b95-82a0-4bef-a605-076e2f37be5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.125923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4f63b95-82a0-4bef-a605-076e2f37be5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.126366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4f63b95-82a0-4bef-a605-076e2f37be5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.127180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4f63b95-82a0-4bef-a605-076e2f37be5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.127695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4f63b95-82a0-4bef-a605-076e2f37be5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.128126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4f63b95-82a0-4bef-a605-076e2f37be5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.172476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e4f63b95-82a0-4bef-a605-076e2f37be5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:29:04.288121 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e4f63b95-82a0-4bef-a605-076e2f37be5c tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "DELETE /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 204 len: 0 microversion: 2.1 time: 0.177734 Oct 04 18:29:04.290093 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2834/5678] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:04 2022] DELETE /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:04.300025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-658ea53b-46c8-4ca5-b907-b67d3e853743 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.300624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-658ea53b-46c8-4ca5-b907-b67d3e853743 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:04.309104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-658ea53b-46c8-4ca5-b907-b67d3e853743 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.309845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-658ea53b-46c8-4ca5-b907-b67d3e853743 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.310488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-658ea53b-46c8-4ca5-b907-b67d3e853743 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.312095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-658ea53b-46c8-4ca5-b907-b67d3e853743 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.312760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-658ea53b-46c8-4ca5-b907-b67d3e853743 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.313361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-658ea53b-46c8-4ca5-b907-b67d3e853743 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.509234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-658ea53b-46c8-4ca5-b907-b67d3e853743 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:04.519017 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-658ea53b-46c8-4ca5-b907-b67d3e853743 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1689 microversion: 2.1 time: 0.223595 Oct 04 18:29:04.521424 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2845/5679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1689 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:04.676851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.678343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:04.688536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.694002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.695331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.697834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.700862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.703681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.913823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:04.922029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:04.923517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:04.925614 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d4eb23d-cd34-43b8-ba89-77e3a813d46c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1406 microversion: 2.20 time: 0.259659 Oct 04 18:29:04.927626 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2835/5680] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:05.546315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-46c58b90-371c-40fb-ba08-d00a42bb785f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.547575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-46c58b90-371c-40fb-ba08-d00a42bb785f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:05.553631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:05.569139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46c58b90-371c-40fb-ba08-d00a42bb785f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:05.569656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46c58b90-371c-40fb-ba08-d00a42bb785f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:05.570105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46c58b90-371c-40fb-ba08-d00a42bb785f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:05.570880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46c58b90-371c-40fb-ba08-d00a42bb785f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:05.571538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46c58b90-371c-40fb-ba08-d00a42bb785f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:05.572353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46c58b90-371c-40fb-ba08-d00a42bb785f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:05.795318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-46c58b90-371c-40fb-ba08-d00a42bb785f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:05.803770 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-46c58b90-371c-40fb-ba08-d00a42bb785f tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1689 microversion: 2.1 time: 0.262888 Oct 04 18:29:05.804355 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2846/5681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:05 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1689 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:05.955996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.956982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:05.984442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:05.984442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:05.984442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:05.984442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:05.986419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:05.986994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.307327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:06.319739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:06.326480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:06.329030 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-08d7fcdb-f182-4f49-badf-4a09441ffbdf tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1406 microversion: 2.20 time: 0.377556 Oct 04 18:29:06.335151 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2836/5682] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:05 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:06.831926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42ef7e7b-adc2-495e-88a8-13b2770876c3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:06.832581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42ef7e7b-adc2-495e-88a8-13b2770876c3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:06.851314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ef7e7b-adc2-495e-88a8-13b2770876c3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.851958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ef7e7b-adc2-495e-88a8-13b2770876c3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.852474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ef7e7b-adc2-495e-88a8-13b2770876c3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.853284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ef7e7b-adc2-495e-88a8-13b2770876c3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.853928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ef7e7b-adc2-495e-88a8-13b2770876c3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.854429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ef7e7b-adc2-495e-88a8-13b2770876c3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.200460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-42ef7e7b-adc2-495e-88a8-13b2770876c3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:07.211555 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42ef7e7b-adc2-495e-88a8-13b2770876c3 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1689 microversion: 2.1 time: 0.383695 Oct 04 18:29:07.212146 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2847/5683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:06 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1689 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:07.362814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:07.363568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:07.371600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.372450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.373605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.374577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.375803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.376440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.563028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7088652e-d4ea-40cc-8017-3d9d2594f448 req-2cc7c5b8-3e13-448d-bbf1-059f96cdf0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9afae5-6ef4-4bd5-92f8-1d0ed466b280", "name": "network-vif-plugged", "status": "completed", "tag": "2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:07.577160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7088652e-d4ea-40cc-8017-3d9d2594f448 req-2cc7c5b8-3e13-448d-bbf1-059f96cdf0a7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.577897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7088652e-d4ea-40cc-8017-3d9d2594f448 req-2cc7c5b8-3e13-448d-bbf1-059f96cdf0a7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.578588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7088652e-d4ea-40cc-8017-3d9d2594f448 req-2cc7c5b8-3e13-448d-bbf1-059f96cdf0a7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.601823 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7088652e-d4ea-40cc-8017-3d9d2594f448 req-2cc7c5b8-3e13-448d-bbf1-059f96cdf0a7 service nova] Creating event network-vif-plugged:2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e for instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 on n-h1-850499-14 Oct 04 18:29:07.616838 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7088652e-d4ea-40cc-8017-3d9d2594f448 req-2cc7c5b8-3e13-448d-bbf1-059f96cdf0a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059114 Oct 04 18:29:07.617800 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2848/5684] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:07.681647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:07.701158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:07.703350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:07.706232 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-64a96a6c-6947-480b-b38e-3113a7fe1205 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1406 microversion: 2.20 time: 0.347964 Oct 04 18:29:07.724871 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2837/5685] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:07 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1406 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:08.246247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98373076-9632-4fa4-b7e2-e3cc57383bab tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:08.249135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-98373076-9632-4fa4-b7e2-e3cc57383bab tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:08.257456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98373076-9632-4fa4-b7e2-e3cc57383bab tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.258360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98373076-9632-4fa4-b7e2-e3cc57383bab tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.259212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98373076-9632-4fa4-b7e2-e3cc57383bab tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.260480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98373076-9632-4fa4-b7e2-e3cc57383bab tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.261452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98373076-9632-4fa4-b7e2-e3cc57383bab tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.263920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98373076-9632-4fa4-b7e2-e3cc57383bab tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.517751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-98373076-9632-4fa4-b7e2-e3cc57383bab tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:08.527305 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-98373076-9632-4fa4-b7e2-e3cc57383bab tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1689 microversion: 2.1 time: 0.291385 Oct 04 18:29:08.531563 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2849/5686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:08 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1689 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:08.733107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:08.734239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:08.750595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.751738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.752594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.753588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.754339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.755016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.986473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:09.003985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:09.006775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:09.007969 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7321ae9f-8a8f-4bef-bd40-84e06126069a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1406 microversion: 2.20 time: 0.279150 Oct 04 18:29:09.015577 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2838/5687] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:08 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:09.558032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4b1de993-c522-4d08-b551-e641571909f8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:09.559678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4b1de993-c522-4d08-b551-e641571909f8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:09.568604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b1de993-c522-4d08-b551-e641571909f8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:09.569349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b1de993-c522-4d08-b551-e641571909f8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:09.570069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b1de993-c522-4d08-b551-e641571909f8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:09.571034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b1de993-c522-4d08-b551-e641571909f8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:09.571853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b1de993-c522-4d08-b551-e641571909f8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:09.572770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b1de993-c522-4d08-b551-e641571909f8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:09.863443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4b1de993-c522-4d08-b551-e641571909f8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:09.895562 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4b1de993-c522-4d08-b551-e641571909f8 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1689 microversion: 2.1 time: 0.343920 Oct 04 18:29:09.897108 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2850/5688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:09 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1689 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:10.036354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:10.037785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:10.046785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.047706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.048362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.049467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.050480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.051286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.328027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:10.347057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:10.350490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:10.351818 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fe96426a-3154-49ec-90ad-d98e9df2892a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1599 microversion: 2.20 time: 0.321101 Oct 04 18:29:10.352785 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2839/5689] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:10 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1599 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:10.377155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd0986e2-a417-4bb3-87e5-7a756591b2c8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:10.377667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd0986e2-a417-4bb3-87e5-7a756591b2c8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:10.383914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0986e2-a417-4bb3-87e5-7a756591b2c8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.384421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0986e2-a417-4bb3-87e5-7a756591b2c8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.384874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0986e2-a417-4bb3-87e5-7a756591b2c8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.385602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0986e2-a417-4bb3-87e5-7a756591b2c8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.386075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0986e2-a417-4bb3-87e5-7a756591b2c8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.386515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0986e2-a417-4bb3-87e5-7a756591b2c8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.528992 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd0986e2-a417-4bb3-87e5-7a756591b2c8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.155771 Oct 04 18:29:10.539992 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2851/5690] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 4 18:29:10 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:29:10.922056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a7b291c6-9f23-4605-a1b0-6b1801012f49 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:10.923014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a7b291c6-9f23-4605-a1b0-6b1801012f49 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:10.931131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b291c6-9f23-4605-a1b0-6b1801012f49 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.931633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b291c6-9f23-4605-a1b0-6b1801012f49 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.932078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b291c6-9f23-4605-a1b0-6b1801012f49 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.933089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b291c6-9f23-4605-a1b0-6b1801012f49 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.933713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b291c6-9f23-4605-a1b0-6b1801012f49 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.934396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b291c6-9f23-4605-a1b0-6b1801012f49 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:11.029252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a7b291c6-9f23-4605-a1b0-6b1801012f49 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:11.044141 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a7b291c6-9f23-4605-a1b0-6b1801012f49 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1621 microversion: 2.1 time: 0.126298 Oct 04 18:29:11.059498 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2840/5691] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:10 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1621 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:11.549209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-1a76890e-a8ed-40b8-913b-ef0b9a3e94f3 req-a7c2bdcb-cf02-45b2-ac1b-e4cdd38bf583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ac8a47-83c9-442a-a1a4-6e09347c397a", "name": "network-vif-deleted", "tag": "21099c8b-7c1c-4c05-a556-37ef73f83087"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:11.563177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1a76890e-a8ed-40b8-913b-ef0b9a3e94f3 req-a7c2bdcb-cf02-45b2-ac1b-e4cdd38bf583 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:11.563882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1a76890e-a8ed-40b8-913b-ef0b9a3e94f3 req-a7c2bdcb-cf02-45b2-ac1b-e4cdd38bf583 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:11.564488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1a76890e-a8ed-40b8-913b-ef0b9a3e94f3 req-a7c2bdcb-cf02-45b2-ac1b-e4cdd38bf583 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:11.577837 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1a76890e-a8ed-40b8-913b-ef0b9a3e94f3 req-a7c2bdcb-cf02-45b2-ac1b-e4cdd38bf583 service nova] Creating event network-vif-deleted:21099c8b-7c1c-4c05-a556-37ef73f83087 for instance 66ac8a47-83c9-442a-a1a4-6e09347c397a on n-h2-850499-14 Oct 04 18:29:11.585104 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-1a76890e-a8ed-40b8-913b-ef0b9a3e94f3 req-a7c2bdcb-cf02-45b2-ac1b-e4cdd38bf583 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041300 Oct 04 18:29:11.586187 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2852/5692] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:12.071245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:12.071913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:12.085062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.085570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.086547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.086727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.090490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.091019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.155586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.158081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.162514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.163033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lazy-loading 'fault' on Instance uuid 66ac8a47-83c9-442a-a1a4-6e09347c397a {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:29:12.272475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:12.281650 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fa8683fb-f982-473b-a930-89d0b9110223 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 200 len: 1335 microversion: 2.1 time: 0.215659 Oct 04 18:29:12.292114 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2841/5693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:12 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 1335 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:13.309706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:13.312620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 66ac8a47-83c9-442a-a1a4-6e09347c397a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:13.321255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.321974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.322640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.323604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.324215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.324795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.340985 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] HTTP exception thrown: Instance 66ac8a47-83c9-442a-a1a4-6e09347c397a could not be found. Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Request method failure captured: Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a HTTP/1.1 Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHnytef4l2dTU_iEGj2JHMj914KTgOcJXrZhkr0wpO7nRbM8OarsMPEpoh7kshRbzuhK9viViE8Sc8SnS-I9yNZdiPzuJrN6shc_HK2tbFONi9WDFR1vVIu70L5UasJlaDkchO8edMdo-N8WJ-RTGom7YRcTfKpi8ODDI4s0GHlW8GE Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab1cdc33329a4a10970e67390f750163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}] Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 5a7fc8671d264393bfb0465438b598d1 Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 66ac8a47-83c9-442a-a1a4-6e09347c397a could not be found. Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '66ac8a47-83c9-442a-a1a4-6e09347c397a'} Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66ac8a47-83c9-442a-a1a4-6e09347c397a could not be found. Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66ac8a47-83c9-442a-a1a4-6e09347c397a could not be found. Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:29:13.343560 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:13.348372 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:29:13.348372 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:13.348372 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:13.348372 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:13.348372 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:13.348372 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:13.348372 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66ac8a47-83c9-442a-a1a4-6e09347c397a could not be found. Oct 04 18:29:13.348372 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:29:13.349860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Returning 404 to user: Instance 66ac8a47-83c9-442a-a1a4-6e09347c397a could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:13.350907 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0989adb4-1ed4-4695-927b-ee6d1445b126 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a" status: 404 len: 111 microversion: 2.1 time: 0.047591 Oct 04 18:29:13.351849 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2853/5694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:13 2022] GET /compute/v2.1/servers/66ac8a47-83c9-442a-a1a4-6e09347c397a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:13.361638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-236df0d1-707a-429b-a50e-bfec5b010f65 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '.version_select at 0x7fd4d0b44550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:13.406216 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-236df0d1-707a-429b-a50e-bfec5b010f65 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-878718764" status: 202 len: 0 microversion: 2.1 time: 0.049199 Oct 04 18:29:13.409103 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2842/5695] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 4 18:29:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-878718764 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:13.622603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e426a6e2-aeb3-4a66-b758-68e3f12e5243 req-fce414e1-44b3-4cd8-ac4d-b7ef7632f9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d9afae5-6ef4-4bd5-92f8-1d0ed466b280", "tag": "2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:13.642856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e426a6e2-aeb3-4a66-b758-68e3f12e5243 req-fce414e1-44b3-4cd8-ac4d-b7ef7632f9a9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.644318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e426a6e2-aeb3-4a66-b758-68e3f12e5243 req-fce414e1-44b3-4cd8-ac4d-b7ef7632f9a9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.647497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e426a6e2-aeb3-4a66-b758-68e3f12e5243 req-fce414e1-44b3-4cd8-ac4d-b7ef7632f9a9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.703858 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e426a6e2-aeb3-4a66-b758-68e3f12e5243 req-fce414e1-44b3-4cd8-ac4d-b7ef7632f9a9 service nova] Creating event network-changed:2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e for instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 on n-h1-850499-14 Oct 04 18:29:13.721105 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e426a6e2-aeb3-4a66-b758-68e3f12e5243 req-fce414e1-44b3-4cd8-ac4d-b7ef7632f9a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103644 Oct 04 18:29:13.723773 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2854/5696] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:22.523355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-77f1dd9b-9689-403c-86cf-ef745ca1de8b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:22.524380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-77f1dd9b-9689-403c-86cf-ef745ca1de8b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:22.533664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:22.535012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f1dd9b-9689-403c-86cf-ef745ca1de8b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.536728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f1dd9b-9689-403c-86cf-ef745ca1de8b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.537723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f1dd9b-9689-403c-86cf-ef745ca1de8b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.538741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f1dd9b-9689-403c-86cf-ef745ca1de8b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.539498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f1dd9b-9689-403c-86cf-ef745ca1de8b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.540170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-77f1dd9b-9689-403c-86cf-ef745ca1de8b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.617575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-77f1dd9b-9689-403c-86cf-ef745ca1de8b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:29:22.737818 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-77f1dd9b-9689-403c-86cf-ef745ca1de8b tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 204 len: 0 microversion: 2.1 time: 0.225663 Oct 04 18:29:22.739219 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2843/5697] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:22 2022] DELETE /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:22.749309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e242f24d-7889-4aa9-ae9b-a267b3246d04 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:22.750045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e242f24d-7889-4aa9-ae9b-a267b3246d04 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:22.785386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e242f24d-7889-4aa9-ae9b-a267b3246d04 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.788742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e242f24d-7889-4aa9-ae9b-a267b3246d04 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.789218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e242f24d-7889-4aa9-ae9b-a267b3246d04 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.793627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e242f24d-7889-4aa9-ae9b-a267b3246d04 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.794147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e242f24d-7889-4aa9-ae9b-a267b3246d04 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.794605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e242f24d-7889-4aa9-ae9b-a267b3246d04 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:23.050035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e242f24d-7889-4aa9-ae9b-a267b3246d04 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:23.066147 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e242f24d-7889-4aa9-ae9b-a267b3246d04 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1508 microversion: 2.1 time: 0.322468 Oct 04 18:29:23.088583 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2855/5698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:22 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:24.100669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5b9ba19f-6573-4f61-afb6-f1bbb86f787d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:24.101377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5b9ba19f-6573-4f61-afb6-f1bbb86f787d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:24.120135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b9ba19f-6573-4f61-afb6-f1bbb86f787d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.122864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b9ba19f-6573-4f61-afb6-f1bbb86f787d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.124609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b9ba19f-6573-4f61-afb6-f1bbb86f787d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.125522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b9ba19f-6573-4f61-afb6-f1bbb86f787d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.126996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b9ba19f-6573-4f61-afb6-f1bbb86f787d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.127785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b9ba19f-6573-4f61-afb6-f1bbb86f787d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.237313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5b9ba19f-6573-4f61-afb6-f1bbb86f787d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:24.249512 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5b9ba19f-6573-4f61-afb6-f1bbb86f787d tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 200 len: 1466 microversion: 2.1 time: 0.153329 Oct 04 18:29:24.252962 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2844/5699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:24 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 1466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:24.338804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fcb32116-8a03-4116-84b2-98938cb3bb90 req-0c3ab92b-3b5d-4ad5-b867-3eea631fd115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e05a66-3878-4adf-8aca-e4879467c8f2", "name": "network-vif-deleted", "tag": "e6773ea1-ffb3-4c35-9826-3ff945971cd7"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:24.373768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fcb32116-8a03-4116-84b2-98938cb3bb90 req-0c3ab92b-3b5d-4ad5-b867-3eea631fd115 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.377649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fcb32116-8a03-4116-84b2-98938cb3bb90 req-0c3ab92b-3b5d-4ad5-b867-3eea631fd115 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.378551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fcb32116-8a03-4116-84b2-98938cb3bb90 req-0c3ab92b-3b5d-4ad5-b867-3eea631fd115 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.404390 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fcb32116-8a03-4116-84b2-98938cb3bb90 req-0c3ab92b-3b5d-4ad5-b867-3eea631fd115 service nova] Creating event network-vif-deleted:e6773ea1-ffb3-4c35-9826-3ff945971cd7 for instance f2e05a66-3878-4adf-8aca-e4879467c8f2 on n-h1-850499-14 Oct 04 18:29:24.420541 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fcb32116-8a03-4116-84b2-98938cb3bb90 req-0c3ab92b-3b5d-4ad5-b867-3eea631fd115 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091194 Oct 04 18:29:24.422121 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2856/5700] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:25.281499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.282704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: f2e05a66-3878-4adf-8aca-e4879467c8f2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.292423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.292843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.293342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.294238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.294703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.295177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.312669 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] HTTP exception thrown: Instance f2e05a66-3878-4adf-8aca-e4879467c8f2 could not be found. Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Request method failure captured: Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 HTTP/1.1 Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHnytef4l2dTU_iEGj2JHMj914KTgOcJXrZhkr0wpO7nRbM8OarsMPEpoh7kshRbzuhK9viViE8Sc8SnS-I9yNZdiPzuJrN6shc_HK2tbFONi9WDFR1vVIu70L5UasJlaDkchO8edMdo-N8WJ-RTGom7YRcTfKpi8ODDI4s0GHlW8GE Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab1cdc33329a4a10970e67390f750163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}] Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5a7fc8671d264393bfb0465438b598d1 Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance f2e05a66-3878-4adf-8aca-e4879467c8f2 could not be found. Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'f2e05a66-3878-4adf-8aca-e4879467c8f2'} Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e05a66-3878-4adf-8aca-e4879467c8f2 could not be found. Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e05a66-3878-4adf-8aca-e4879467c8f2 could not be found. Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:25.314346 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:25.318021 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:25.318021 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:25.318021 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:25.318021 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:25.318021 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:25.318021 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:25.318021 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e05a66-3878-4adf-8aca-e4879467c8f2 could not be found. Oct 04 18:29:25.318021 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:25.318021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Returning 404 to user: Instance f2e05a66-3878-4adf-8aca-e4879467c8f2 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:25.318021 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a4e8d398-d268-4724-90a0-d3c4cd06f5cc tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2" status: 404 len: 111 microversion: 2.1 time: 0.040013 Oct 04 18:29:25.319825 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2845/5701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:25 2022] GET /compute/v2.1/servers/f2e05a66-3878-4adf-8aca-e4879467c8f2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:25.324963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-15a10114-410a-470b-90f7-fcd6b56be875 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.325564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15a10114-410a-470b-90f7-fcd6b56be875 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.335797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a10114-410a-470b-90f7-fcd6b56be875 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.336573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a10114-410a-470b-90f7-fcd6b56be875 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.338046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a10114-410a-470b-90f7-fcd6b56be875 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.339350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a10114-410a-470b-90f7-fcd6b56be875 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.340073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a10114-410a-470b-90f7-fcd6b56be875 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.340557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15a10114-410a-470b-90f7-fcd6b56be875 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.390278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15a10114-410a-470b-90f7-fcd6b56be875 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:29:25.507610 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-15a10114-410a-470b-90f7-fcd6b56be875 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 204 len: 0 microversion: 2.1 time: 0.185943 Oct 04 18:29:25.511050 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2857/5702] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:25 2022] DELETE /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:25.523459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-755b3f14-6f75-4b51-baba-6f0c407e04a6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.527335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-755b3f14-6f75-4b51-baba-6f0c407e04a6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.551055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-755b3f14-6f75-4b51-baba-6f0c407e04a6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.551793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-755b3f14-6f75-4b51-baba-6f0c407e04a6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.552250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-755b3f14-6f75-4b51-baba-6f0c407e04a6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.552975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-755b3f14-6f75-4b51-baba-6f0c407e04a6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.553445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-755b3f14-6f75-4b51-baba-6f0c407e04a6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.553876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-755b3f14-6f75-4b51-baba-6f0c407e04a6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.628827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac66eb25-88f1-49fd-85e1-3349a5492186 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:25.630672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ac66eb25-88f1-49fd-85e1-3349a5492186 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.648964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac66eb25-88f1-49fd-85e1-3349a5492186 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.649481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac66eb25-88f1-49fd-85e1-3349a5492186 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.649932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac66eb25-88f1-49fd-85e1-3349a5492186 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.651226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac66eb25-88f1-49fd-85e1-3349a5492186 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.651226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac66eb25-88f1-49fd-85e1-3349a5492186 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.651571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac66eb25-88f1-49fd-85e1-3349a5492186 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.717740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:25.763051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-755b3f14-6f75-4b51-baba-6f0c407e04a6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:25.777276 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-755b3f14-6f75-4b51-baba-6f0c407e04a6 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.264221 Oct 04 18:29:25.779375 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2846/5703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:25 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:25.797351 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ac66eb25-88f1-49fd-85e1-3349a5492186 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.180533 Oct 04 18:29:25.798040 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2858/5704] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:29:25 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:29:25.809110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b4ff9e10-31e0-4848-b651-1676f223e52b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.809849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4ff9e10-31e0-4848-b651-1676f223e52b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.819463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4ff9e10-31e0-4848-b651-1676f223e52b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.820396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4ff9e10-31e0-4848-b651-1676f223e52b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.821175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4ff9e10-31e0-4848-b651-1676f223e52b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.822043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4ff9e10-31e0-4848-b651-1676f223e52b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.822514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4ff9e10-31e0-4848-b651-1676f223e52b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.822943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4ff9e10-31e0-4848-b651-1676f223e52b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.018325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b4ff9e10-31e0-4848-b651-1676f223e52b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:26.030862 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b4ff9e10-31e0-4848-b651-1676f223e52b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1671 microversion: 2.1 time: 0.227135 Oct 04 18:29:26.045390 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2847/5705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:25 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:26.805871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5526374d-0bea-40b6-a436-f07766db88fa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.807746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5526374d-0bea-40b6-a436-f07766db88fa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:26.821760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5526374d-0bea-40b6-a436-f07766db88fa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.822577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5526374d-0bea-40b6-a436-f07766db88fa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.824166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5526374d-0bea-40b6-a436-f07766db88fa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.825689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5526374d-0bea-40b6-a436-f07766db88fa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.827085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5526374d-0bea-40b6-a436-f07766db88fa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.827760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5526374d-0bea-40b6-a436-f07766db88fa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.062837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4ce18373-5f5a-4729-883c-f14f2cec0a28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.064088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4ce18373-5f5a-4729-883c-f14f2cec0a28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:27.066453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5526374d-0bea-40b6-a436-f07766db88fa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:27.077331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ce18373-5f5a-4729-883c-f14f2cec0a28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.078060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ce18373-5f5a-4729-883c-f14f2cec0a28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.078665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ce18373-5f5a-4729-883c-f14f2cec0a28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.079456 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5526374d-0bea-40b6-a436-f07766db88fa tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1521 microversion: 2.1 time: 0.279133 Oct 04 18:29:27.079787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ce18373-5f5a-4729-883c-f14f2cec0a28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.080402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ce18373-5f5a-4729-883c-f14f2cec0a28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.080977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4ce18373-5f5a-4729-883c-f14f2cec0a28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.081234 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2859/5706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:26 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:27.248205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4ce18373-5f5a-4729-883c-f14f2cec0a28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:27.258265 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4ce18373-5f5a-4729-883c-f14f2cec0a28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1671 microversion: 2.1 time: 0.202814 Oct 04 18:29:27.259614 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2848/5707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1671 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:27.841622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e3efcaa0-7f7d-41f2-9f66-1380d26b90c8 req-b8f75232-8516-4543-a84f-26f562a21676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5bebc4-0fb3-4027-a4ff-4ff8301fc986", "name": "network-vif-deleted", "tag": "ece89644-26b6-4a98-bb80-88892df0fa10"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:27.857930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e3efcaa0-7f7d-41f2-9f66-1380d26b90c8 req-b8f75232-8516-4543-a84f-26f562a21676 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.858680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e3efcaa0-7f7d-41f2-9f66-1380d26b90c8 req-b8f75232-8516-4543-a84f-26f562a21676 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.859237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e3efcaa0-7f7d-41f2-9f66-1380d26b90c8 req-b8f75232-8516-4543-a84f-26f562a21676 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.942630 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e3efcaa0-7f7d-41f2-9f66-1380d26b90c8 req-b8f75232-8516-4543-a84f-26f562a21676 service nova] Creating event network-vif-deleted:ece89644-26b6-4a98-bb80-88892df0fa10 for instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 on n-h2-850499-14 Oct 04 18:29:27.971224 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e3efcaa0-7f7d-41f2-9f66-1380d26b90c8 req-b8f75232-8516-4543-a84f-26f562a21676 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133911 Oct 04 18:29:27.975701 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2860/5708] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:28.104917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7da7ccb6-a8fa-4d0d-9217-be3e7d238588 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.104917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7da7ccb6-a8fa-4d0d-9217-be3e7d238588 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.119756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7ccb6-a8fa-4d0d-9217-be3e7d238588 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.120866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7ccb6-a8fa-4d0d-9217-be3e7d238588 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.121526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7ccb6-a8fa-4d0d-9217-be3e7d238588 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.122470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7ccb6-a8fa-4d0d-9217-be3e7d238588 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.123172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7ccb6-a8fa-4d0d-9217-be3e7d238588 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.124482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7da7ccb6-a8fa-4d0d-9217-be3e7d238588 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.282627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2bde5297-7d09-4a89-ad8d-752e2cc9af78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.283427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2bde5297-7d09-4a89-ad8d-752e2cc9af78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.295846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7da7ccb6-a8fa-4d0d-9217-be3e7d238588 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:28.307117 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7da7ccb6-a8fa-4d0d-9217-be3e7d238588 tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1306 microversion: 2.1 time: 0.207447 Oct 04 18:29:28.307952 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2849/5709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1306 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:28.329386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bde5297-7d09-4a89-ad8d-752e2cc9af78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.329980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bde5297-7d09-4a89-ad8d-752e2cc9af78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.330440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bde5297-7d09-4a89-ad8d-752e2cc9af78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.331244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bde5297-7d09-4a89-ad8d-752e2cc9af78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.331723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bde5297-7d09-4a89-ad8d-752e2cc9af78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.332726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bde5297-7d09-4a89-ad8d-752e2cc9af78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.613078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2bde5297-7d09-4a89-ad8d-752e2cc9af78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:28.627247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2bde5297-7d09-4a89-ad8d-752e2cc9af78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1676 microversion: 2.1 time: 0.348988 Oct 04 18:29:28.642247 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2861/5710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1676 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:29.335244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.336536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.346229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.347081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.347704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.349151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.350259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.350797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.415314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.427769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.428232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.428707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lazy-loading 'fault' on Instance uuid 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:29:29.544098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a7fc8671d264393bfb0465438b598d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1cdc33329a4a10970e67390f750163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:29.561852 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9522cbac-12ba-4570-b51c-6168396dcbdb tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 200 len: 1311 microversion: 2.1 time: 0.230411 Oct 04 18:29:29.562453 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2850/5711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:29.653537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1f02922d-0840-4dd2-b2af-4737fbf13efd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.654675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1f02922d-0840-4dd2-b2af-4737fbf13efd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.664123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f02922d-0840-4dd2-b2af-4737fbf13efd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.664958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f02922d-0840-4dd2-b2af-4737fbf13efd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.665934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f02922d-0840-4dd2-b2af-4737fbf13efd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.666883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f02922d-0840-4dd2-b2af-4737fbf13efd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.667763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f02922d-0840-4dd2-b2af-4737fbf13efd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.668795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f02922d-0840-4dd2-b2af-4737fbf13efd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.950855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1f02922d-0840-4dd2-b2af-4737fbf13efd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:29.960887 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1f02922d-0840-4dd2-b2af-4737fbf13efd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.312847 Oct 04 18:29:29.961511 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2862/5712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:30.587143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:30.588159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] [instance: 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:30.596355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.597152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.597924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.598862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.599935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.600772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.625497 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] HTTP exception thrown: Instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 could not be found. Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Request method failure captured: Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 HTTP/1.1 Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHnytef4l2dTU_iEGj2JHMj914KTgOcJXrZhkr0wpO7nRbM8OarsMPEpoh7kshRbzuhK9viViE8Sc8SnS-I9yNZdiPzuJrN6shc_HK2tbFONi9WDFR1vVIu70L5UasJlaDkchO8edMdo-N8WJ-RTGom7YRcTfKpi8ODDI4s0GHlW8GE Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab1cdc33329a4a10970e67390f750163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab1cdc33329a4a10970e67390f750163"}]}] Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: ab1cdc33329a4a10970e67390f750163 Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-150449775 Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 5a7fc8671d264393bfb0465438b598d1 Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerRescueNegativeTestJSON-150449775-project Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 could not be found. Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '2c5bebc4-0fb3-4027-a4ff-4ff8301fc986'} Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 could not be found. Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 could not be found. Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:30.627264 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:30.631556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:30.631556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:30.631556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:30.631556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:30.631556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:30.631556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:30.631556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 could not be found. Oct 04 18:29:30.631556 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:29:30.631556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] Returning 404 to user: Instance 2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:30.631556 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-42d8b5f8-e57f-45d7-b7f8-97f36088f29a tempest-ServerRescueNegativeTestJSON-150449775 tempest-ServerRescueNegativeTestJSON-150449775-project] 10.222.0.18 "GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986" status: 404 len: 111 microversion: 2.1 time: 0.048466 Oct 04 18:29:30.635097 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2851/5713] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:30 2022] GET /compute/v2.1/servers/2c5bebc4-0fb3-4027-a4ff-4ff8301fc986 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:47.741795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3bb35e2c-1aa4-4348-8bbc-175bdb74b99b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:47.748098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3bb35e2c-1aa4-4348-8bbc-175bdb74b99b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:47.763366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:47.768386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:47.807814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb35e2c-1aa4-4348-8bbc-175bdb74b99b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.808751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb35e2c-1aa4-4348-8bbc-175bdb74b99b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.811640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb35e2c-1aa4-4348-8bbc-175bdb74b99b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.816192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb35e2c-1aa4-4348-8bbc-175bdb74b99b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.817024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb35e2c-1aa4-4348-8bbc-175bdb74b99b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.819131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3bb35e2c-1aa4-4348-8bbc-175bdb74b99b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.883957 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3bb35e2c-1aa4-4348-8bbc-175bdb74b99b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/ips" status: 200 len: 153 microversion: 2.20 time: 0.149651 Oct 04 18:29:47.897372 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2863/5714] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Oct 4 18:29:47 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/ips => generated 153 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:29:51.422729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-94d34385-95ce-454e-a4f5-e5dd4dbc29c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:51.424026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-94d34385-95ce-454e-a4f5-e5dd4dbc29c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:51.455810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:51.457220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:51.459181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94d34385-95ce-454e-a4f5-e5dd4dbc29c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:51.460003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94d34385-95ce-454e-a4f5-e5dd4dbc29c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:51.460685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94d34385-95ce-454e-a4f5-e5dd4dbc29c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:51.461647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94d34385-95ce-454e-a4f5-e5dd4dbc29c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:51.462323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94d34385-95ce-454e-a4f5-e5dd4dbc29c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:51.463020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94d34385-95ce-454e-a4f5-e5dd4dbc29c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:51.504054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-94d34385-95ce-454e-a4f5-e5dd4dbc29c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lazy-loading 'flavor' on Instance uuid 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:29:51.810468 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-94d34385-95ce-454e-a4f5-e5dd4dbc29c0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "POST /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/action" status: 202 len: 0 microversion: 2.20 time: 0.391340 Oct 04 18:29:51.811203 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2852/5715] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:29:51 2022] POST /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:51.822165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:51.823633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:51.832323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:51.833292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:51.833982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:51.841878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:51.842685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:51.844331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.419276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:52.431805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:52.438492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:52.440252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9d87c7da-5d8f-493a-bc7f-b5faddab3fb1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.622191 Oct 04 18:29:52.442522 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2864/5716] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:51 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:53.470599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:53.471796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:53.489987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.492049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.495148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.497934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.499807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.503099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.924943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:53.954781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:53.956375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:53.957696 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dd17f1e0-3720-44a7-9098-cb47db7825bd tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.491715 Oct 04 18:29:53.985110 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2853/5717] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:53 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:54.989755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:54.990644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:55.017965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.018503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.021881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.022754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.023291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.026209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.449959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:55.466347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:55.470326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:55.474775 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f1e626a4-d8cd-4f21-8ee5-231f49845d1b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.489657 Oct 04 18:29:55.481457 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2865/5718] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:54 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:56.517177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:56.518743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:56.536245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:56.536885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:56.537520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:56.538999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:56.539697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:56.542212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:56.949770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:56.963398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:56.965168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:56.976539 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-82fa02d4-510f-4b1c-ad37-8d11415404da tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.467064 Oct 04 18:29:56.977419 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2854/5719] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:56 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:58.012351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:58.013586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:58.028865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:58.031886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:58.033757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:58.036711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:58.038692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:58.042809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:58.333901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:58.343048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:58.345129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:58.356797 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d787905b-6729-46fc-bddb-12fa24a05baa tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.355107 Oct 04 18:29:58.358616 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2866/5720] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:58 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:58.523408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1689200171", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "bd47003e-272e-4a64-be32-337aceade525"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:58.614349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] validate_networks() for [('bd47003e-272e-4a64-be32-337aceade525', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:59.393219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:59.395323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:59.408843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.411181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.412048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.415953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.417729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.418403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.856134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:59.874682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:59.878004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:59.882407 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a96a7f2-60b9-4dd9-9815-82306c8e410a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.493139 Oct 04 18:29:59.889450 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2867/5721] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:29:59 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:29:59.922354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:59.924876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:59.929701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:59.930484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:59.931230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:59.947410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.950153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.951433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.960065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.960919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.961741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.997755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Getting quotas for project b22f8d1fb850492a97f96de2bc1b88af. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:00.011996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Getting quotas for user 3c937e148a20416096303f9d43010d26 and project b22f8d1fb850492a97f96de2bc1b88af. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:00.037768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:00.049413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:00.161163 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b1d79aab-b3a7-44ae-965d-0225230de0d9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.149881 Oct 04 18:30:00.162889 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2855/5722] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:30:00.177103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b2a8dfb3-c705-4fab-bb20-6e5a38137edc tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:00.177867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b2a8dfb3-c705-4fab-bb20-6e5a38137edc tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:00.468372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b2a8dfb3-c705-4fab-bb20-6e5a38137edc tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:00.480936 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b2a8dfb3-c705-4fab-bb20-6e5a38137edc tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1228 microversion: 2.1 time: 0.310580 Oct 04 18:30:00.487316 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2868/5723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:00 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1228 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:00.911602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:00.912566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:00.942733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.944518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.945954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.948206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.950293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.976051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:01.301958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:01.313145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:01.314869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:01.316367 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-21a5372c-5af1-4ffc-a263-e4a689ff91d0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.410627 Oct 04 18:30:01.317469 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2856/5724] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:00 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:01.518488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-467ce842-11c9-4171-af73-d16e3f8c1431 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:01.519319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-467ce842-11c9-4171-af73-d16e3f8c1431 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:01.632574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-467ce842-11c9-4171-af73-d16e3f8c1431 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:01.656585 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-467ce842-11c9-4171-af73-d16e3f8c1431 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1228 microversion: 2.1 time: 0.150640 Oct 04 18:30:01.658433 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2869/5725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:01 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1228 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:02.379342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:02.380011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:02.395345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:02.395855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:02.396307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:02.397061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:02.397528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:02.397960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:02.689255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd90f4a9-d428-4e37-8d91-c055f4f24ba6 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:02.690312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cd90f4a9-d428-4e37-8d91-c055f4f24ba6 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:02.721102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd90f4a9-d428-4e37-8d91-c055f4f24ba6 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:02.722781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd90f4a9-d428-4e37-8d91-c055f4f24ba6 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:02.725919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd90f4a9-d428-4e37-8d91-c055f4f24ba6 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:02.727769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd90f4a9-d428-4e37-8d91-c055f4f24ba6 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:02.731746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd90f4a9-d428-4e37-8d91-c055f4f24ba6 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:02.732824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cd90f4a9-d428-4e37-8d91-c055f4f24ba6 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:02.783919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:02.802695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:02.806762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:02.821758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cd2f7313-78e6-4505-ac79-e8cf1ac4c65c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.445488 Oct 04 18:30:02.838217 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2857/5726] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:02 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:03.104413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cd90f4a9-d428-4e37-8d91-c055f4f24ba6 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:03.120691 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd90f4a9-d428-4e37-8d91-c055f4f24ba6 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1280 microversion: 2.1 time: 0.441254 Oct 04 18:30:03.142408 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2870/5727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:02 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1280 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:03.855586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:03.856377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:03.866085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.869496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.870220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:03.871247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.872385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.873085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.148645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99801058-eea0-4c9b-8986-5a32de9a9f7e tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:04.149351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99801058-eea0-4c9b-8986-5a32de9a9f7e tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:04.165581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99801058-eea0-4c9b-8986-5a32de9a9f7e tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.166504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99801058-eea0-4c9b-8986-5a32de9a9f7e tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.167220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99801058-eea0-4c9b-8986-5a32de9a9f7e tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.168209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99801058-eea0-4c9b-8986-5a32de9a9f7e tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.168892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99801058-eea0-4c9b-8986-5a32de9a9f7e tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.169554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99801058-eea0-4c9b-8986-5a32de9a9f7e tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.351341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:04.357558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-99801058-eea0-4c9b-8986-5a32de9a9f7e tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:04.379635 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99801058-eea0-4c9b-8986-5a32de9a9f7e tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1286 microversion: 2.1 time: 0.233256 Oct 04 18:30:04.382545 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2871/5728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:04 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1286 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:04.384147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:04.388378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:04.391940 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c9fd45fc-7cdd-4376-bded-adbae0931f27 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.539985 Oct 04 18:30:04.395022 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2858/5729] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:03 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:05.419128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbfc7415-495e-46ef-9ec3-fded93bc8c1b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:05.420060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:05.420958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bbfc7415-495e-46ef-9ec3-fded93bc8c1b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:05.421641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:05.442068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.445621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.454781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.457009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.460562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.462767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.469525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbfc7415-495e-46ef-9ec3-fded93bc8c1b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.471735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbfc7415-495e-46ef-9ec3-fded93bc8c1b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.472511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbfc7415-495e-46ef-9ec3-fded93bc8c1b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.473455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbfc7415-495e-46ef-9ec3-fded93bc8c1b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.474228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbfc7415-495e-46ef-9ec3-fded93bc8c1b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.474832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbfc7415-495e-46ef-9ec3-fded93bc8c1b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.932616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bbfc7415-495e-46ef-9ec3-fded93bc8c1b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:05.946798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:05.970519 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bbfc7415-495e-46ef-9ec3-fded93bc8c1b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1328 microversion: 2.1 time: 0.567535 Oct 04 18:30:05.996688 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2872/5730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:05 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1328 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:05.997138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:05.999530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:06.001061 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a6748355-f0b5-4c61-8eab-52917b8fd8f1 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.586669 Oct 04 18:30:06.001737 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2859/5731] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:05 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:07.042617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06d3d4e7-ab71-4caf-8760-35e1067da16a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:07.043307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-06d3d4e7-ab71-4caf-8760-35e1067da16a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:07.048380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:07.049042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:07.093850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:07.094240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06d3d4e7-ab71-4caf-8760-35e1067da16a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:07.096315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06d3d4e7-ab71-4caf-8760-35e1067da16a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:07.097325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:07.098022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06d3d4e7-ab71-4caf-8760-35e1067da16a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:07.100988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:07.103571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06d3d4e7-ab71-4caf-8760-35e1067da16a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:07.104504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:07.105602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06d3d4e7-ab71-4caf-8760-35e1067da16a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:07.114770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:07.116501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06d3d4e7-ab71-4caf-8760-35e1067da16a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:07.118665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:07.884207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-06d3d4e7-ab71-4caf-8760-35e1067da16a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:07.923110 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-06d3d4e7-ab71-4caf-8760-35e1067da16a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1328 microversion: 2.1 time: 0.922862 Oct 04 18:30:07.926423 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2873/5732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:06 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1328 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:08.003723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:08.013368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:08.021639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:08.025359 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9be87598-8a31-467d-adb3-45ef4823d489 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.995902 Oct 04 18:30:08.034209 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2860/5733] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:07 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:08.428906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-a1107b45-b70c-43e1-b901-0f9c36c19fc6 req-209ca119-9acd-4e4d-85a5-bd90ae20f770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab6069-c372-43ed-8f1c-babe08d1c765", "tag": "8c42764a-9476-41a7-aa4c-41fd1d695f8d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:08.476622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a1107b45-b70c-43e1-b901-0f9c36c19fc6 req-209ca119-9acd-4e4d-85a5-bd90ae20f770 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.477141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a1107b45-b70c-43e1-b901-0f9c36c19fc6 req-209ca119-9acd-4e4d-85a5-bd90ae20f770 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.477582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a1107b45-b70c-43e1-b901-0f9c36c19fc6 req-209ca119-9acd-4e4d-85a5-bd90ae20f770 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.503575 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-a1107b45-b70c-43e1-b901-0f9c36c19fc6 req-209ca119-9acd-4e4d-85a5-bd90ae20f770 service nova] Creating event network-changed:8c42764a-9476-41a7-aa4c-41fd1d695f8d for instance 4fab6069-c372-43ed-8f1c-babe08d1c765 on n-h1-850499-14 Oct 04 18:30:08.529035 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-a1107b45-b70c-43e1-b901-0f9c36c19fc6 req-209ca119-9acd-4e4d-85a5-bd90ae20f770 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.600548 Oct 04 18:30:08.535531 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2874/5734] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:08.952847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a621ca36-a8b1-4156-bd79-a6262b99369a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.953429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a621ca36-a8b1-4156-bd79-a6262b99369a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:08.969289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a621ca36-a8b1-4156-bd79-a6262b99369a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.971097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a621ca36-a8b1-4156-bd79-a6262b99369a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.972011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a621ca36-a8b1-4156-bd79-a6262b99369a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.973101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a621ca36-a8b1-4156-bd79-a6262b99369a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.973659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a621ca36-a8b1-4156-bd79-a6262b99369a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.974268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a621ca36-a8b1-4156-bd79-a6262b99369a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.058463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:09.060958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:09.072893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:09.085461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:09.086081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.086878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:09.090506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:09.091000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.202756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a621ca36-a8b1-4156-bd79-a6262b99369a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:09.214421 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a621ca36-a8b1-4156-bd79-a6262b99369a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1328 microversion: 2.1 time: 0.264434 Oct 04 18:30:09.227757 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2861/5735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:08 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1328 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:09.402405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:09.414918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:09.421716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:09.423189 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2eade47d-6f24-475d-b08e-554bf86cfd66 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1745 microversion: 2.20 time: 0.369288 Oct 04 18:30:09.462527 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2875/5736] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:09 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1745 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:10.241744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8542c68c-7f81-458d-8f91-44f0942881c9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:10.242536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8542c68c-7f81-458d-8f91-44f0942881c9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:10.257961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:10.261252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:10.274502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542c68c-7f81-458d-8f91-44f0942881c9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.277157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542c68c-7f81-458d-8f91-44f0942881c9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.278783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542c68c-7f81-458d-8f91-44f0942881c9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.280676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542c68c-7f81-458d-8f91-44f0942881c9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.281991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542c68c-7f81-458d-8f91-44f0942881c9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.283441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542c68c-7f81-458d-8f91-44f0942881c9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.459988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:10.462668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:10.485958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.488176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.488669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.489640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.490122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.493580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.544354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8542c68c-7f81-458d-8f91-44f0942881c9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:10.558658 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8542c68c-7f81-458d-8f91-44f0942881c9 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1328 microversion: 2.1 time: 0.321527 Oct 04 18:30:10.561717 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2862/5737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:10 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1328 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:10.862196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:10.879731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:10.889230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:10.890480 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-886cdd99-52b1-4724-a895-fd15b3a37c5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.440476 Oct 04 18:30:10.895678 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2876/5738] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:10 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:11.636385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f9e59c88-51d1-4fb7-9afc-f4887ae54c32 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:11.638356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f9e59c88-51d1-4fb7-9afc-f4887ae54c32 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:11.726022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9e59c88-51d1-4fb7-9afc-f4887ae54c32 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.741994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9e59c88-51d1-4fb7-9afc-f4887ae54c32 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.742670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9e59c88-51d1-4fb7-9afc-f4887ae54c32 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.743681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9e59c88-51d1-4fb7-9afc-f4887ae54c32 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.744240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9e59c88-51d1-4fb7-9afc-f4887ae54c32 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.744687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9e59c88-51d1-4fb7-9afc-f4887ae54c32 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.934772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:11.936478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:11.949311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:11.955736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.956936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.959288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.962350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.963302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.964187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:12.448603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f9e59c88-51d1-4fb7-9afc-f4887ae54c32 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:12.457400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:12.466358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:12.483855 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f9e59c88-51d1-4fb7-9afc-f4887ae54c32 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1328 microversion: 2.1 time: 0.899016 Oct 04 18:30:12.488516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:12.490068 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-15550dd1-efc1-4c36-9f0b-f12fed126287 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.568797 Oct 04 18:30:12.494994 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2877/5739] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:11 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:12.495933 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2863/5740] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:11 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1328 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:13.552542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f919d13-aad7-4e07-ae88-925c7b535a9b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:13.553272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2f919d13-aad7-4e07-ae88-925c7b535a9b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:13.553442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:13.554843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:13.570005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f919d13-aad7-4e07-ae88-925c7b535a9b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.575243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f919d13-aad7-4e07-ae88-925c7b535a9b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.576095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f919d13-aad7-4e07-ae88-925c7b535a9b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.577460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f919d13-aad7-4e07-ae88-925c7b535a9b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.578447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f919d13-aad7-4e07-ae88-925c7b535a9b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.581275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f919d13-aad7-4e07-ae88-925c7b535a9b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.584633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.586791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.587349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.589938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.592019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.594299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.298297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2f919d13-aad7-4e07-ae88-925c7b535a9b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:14.308175 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2f919d13-aad7-4e07-ae88-925c7b535a9b tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1328 microversion: 2.1 time: 0.764022 Oct 04 18:30:14.310475 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2878/5741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:13 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1328 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:14.399199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:14.438622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:14.442768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:14.444362 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b624a4e5-864a-448c-9c37-23d46917b2be tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.902399 Oct 04 18:30:14.457240 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2864/5742] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:13 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:14.639008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2004199476", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "a8c28b83-5f81-4a88-a242-3c9dac4609ca"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:14.753974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9f71f034-a504-4758-b8f7-f4aab8efd1c0 req-6ef838fb-c40a-4170-a714-99a256123eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9afae5-6ef4-4bd5-92f8-1d0ed466b280", "name": "network-vif-plugged", "status": "completed", "tag": "2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:14.776947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] validate_networks() for [('a8c28b83-5f81-4a88-a242-3c9dac4609ca', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:14.790152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9f71f034-a504-4758-b8f7-f4aab8efd1c0 req-6ef838fb-c40a-4170-a714-99a256123eff service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.790885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9f71f034-a504-4758-b8f7-f4aab8efd1c0 req-6ef838fb-c40a-4170-a714-99a256123eff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.791539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9f71f034-a504-4758-b8f7-f4aab8efd1c0 req-6ef838fb-c40a-4170-a714-99a256123eff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.818172 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9f71f034-a504-4758-b8f7-f4aab8efd1c0 req-6ef838fb-c40a-4170-a714-99a256123eff service nova] Creating event network-vif-plugged:2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e for instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 on n-h1-850499-14 Oct 04 18:30:14.832341 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9f71f034-a504-4758-b8f7-f4aab8efd1c0 req-6ef838fb-c40a-4170-a714-99a256123eff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084629 Oct 04 18:30:14.833148 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2865/5743] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:15.339935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c7b24350-885c-4720-a738-7fb903e7cc7a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:15.340758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c7b24350-885c-4720-a738-7fb903e7cc7a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:15.368987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7b24350-885c-4720-a738-7fb903e7cc7a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.369766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7b24350-885c-4720-a738-7fb903e7cc7a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.370370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7b24350-885c-4720-a738-7fb903e7cc7a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.373457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7b24350-885c-4720-a738-7fb903e7cc7a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.374151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7b24350-885c-4720-a738-7fb903e7cc7a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.375737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7b24350-885c-4720-a738-7fb903e7cc7a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.904144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7b24350-885c-4720-a738-7fb903e7cc7a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:15.924404 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c7b24350-885c-4720-a738-7fb903e7cc7a tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1328 microversion: 2.1 time: 0.589771 Oct 04 18:30:15.946540 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2866/5744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:15 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1328 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:15.951991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:15.957203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:15.973566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.977972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.978829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.979789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.982450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.983091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.111816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:16.118989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:16.118989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:16.118989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:16.118989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:16.139508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.140930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.141410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.147125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.147817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.151983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.190701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Getting quotas for project 2da8f7991d2042f6b09a3068daeefbd8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:16.198896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Getting quotas for user cf108d8d502f4e0290e98dac5436e98b and project 2da8f7991d2042f6b09a3068daeefbd8. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:16.218304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:16.223178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:16.299571 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2a36cf44-9b15-495f-839c-d8e42b5562e7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.986283 Oct 04 18:30:16.302886 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2879/5745] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:16.315703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-63bee290-3ab3-4058-a838-c2bd7c45b1d8 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:16.316734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-63bee290-3ab3-4058-a838-c2bd7c45b1d8 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:16.541455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-63bee290-3ab3-4058-a838-c2bd7c45b1d8 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.554200 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-63bee290-3ab3-4058-a838-c2bd7c45b1d8 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1214 microversion: 2.1 time: 0.244962 Oct 04 18:30:16.554850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2880/5746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:16 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1214 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:16.732809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.737567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:16.765020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.771816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.783066 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e8f923fb-7f3c-4e86-a672-b61f3f010983 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.829575 Oct 04 18:30:16.784823 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2867/5747] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:15 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:16.892151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-803bd02a-7d76-4df2-a665-2f8160e1a74f req-a03aeefe-2af1-467d-8ad4-282c0334d8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab6069-c372-43ed-8f1c-babe08d1c765", "name": "network-vif-plugged", "status": "completed", "tag": "8c42764a-9476-41a7-aa4c-41fd1d695f8d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:16.928503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-803bd02a-7d76-4df2-a665-2f8160e1a74f req-a03aeefe-2af1-467d-8ad4-282c0334d8f0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.929011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-803bd02a-7d76-4df2-a665-2f8160e1a74f req-a03aeefe-2af1-467d-8ad4-282c0334d8f0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.929459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-803bd02a-7d76-4df2-a665-2f8160e1a74f req-a03aeefe-2af1-467d-8ad4-282c0334d8f0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.955038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1bc1864-f72f-4156-b96f-a6da93fcdcaa tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:16.955607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a1bc1864-f72f-4156-b96f-a6da93fcdcaa tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:16.979343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bc1864-f72f-4156-b96f-a6da93fcdcaa tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.979883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bc1864-f72f-4156-b96f-a6da93fcdcaa tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.980305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bc1864-f72f-4156-b96f-a6da93fcdcaa tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.981034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bc1864-f72f-4156-b96f-a6da93fcdcaa tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.993787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bc1864-f72f-4156-b96f-a6da93fcdcaa tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.997467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bc1864-f72f-4156-b96f-a6da93fcdcaa tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:17.006603 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-803bd02a-7d76-4df2-a665-2f8160e1a74f req-a03aeefe-2af1-467d-8ad4-282c0334d8f0 service nova] Creating event network-vif-plugged:8c42764a-9476-41a7-aa4c-41fd1d695f8d for instance 4fab6069-c372-43ed-8f1c-babe08d1c765 on n-h1-850499-14 Oct 04 18:30:17.030507 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-803bd02a-7d76-4df2-a665-2f8160e1a74f req-a03aeefe-2af1-467d-8ad4-282c0334d8f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136971 Oct 04 18:30:17.031245 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2881/5748] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:17.536267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a1bc1864-f72f-4156-b96f-a6da93fcdcaa tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:17.548529 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1bc1864-f72f-4156-b96f-a6da93fcdcaa tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1328 microversion: 2.1 time: 0.598887 Oct 04 18:30:17.553853 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2868/5749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:16 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1328 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:17.581412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7129cb7c-c58b-4c64-8fb9-19b7905743c7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:17.586829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7129cb7c-c58b-4c64-8fb9-19b7905743c7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:17.775045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7129cb7c-c58b-4c64-8fb9-19b7905743c7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:17.783153 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7129cb7c-c58b-4c64-8fb9-19b7905743c7 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1214 microversion: 2.1 time: 0.209598 Oct 04 18:30:17.783753 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2882/5750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:17 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:17.810305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:17.810924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:17.820207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:17.820729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:17.821180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:17.822434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:17.823098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:17.823704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.154146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:18.170818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:18.203499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:18.207209 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ad7593a8-a977-4f2e-94d7-0eb2bdbb97cc tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.401270 Oct 04 18:30:18.214432 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2869/5751] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:17 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:18.577817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d00f600-a49f-405c-b213-6d99a79c20e5 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:18.578442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8d00f600-a49f-405c-b213-6d99a79c20e5 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:18.581973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:18.597379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d00f600-a49f-405c-b213-6d99a79c20e5 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.597897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d00f600-a49f-405c-b213-6d99a79c20e5 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.598342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d00f600-a49f-405c-b213-6d99a79c20e5 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.599099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d00f600-a49f-405c-b213-6d99a79c20e5 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.599569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d00f600-a49f-405c-b213-6d99a79c20e5 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.600018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d00f600-a49f-405c-b213-6d99a79c20e5 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.806619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e49ae1ff-33a8-42a6-809f-95a2a1f2d1e9 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:18.807280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e49ae1ff-33a8-42a6-809f-95a2a1f2d1e9 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:18.830278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e49ae1ff-33a8-42a6-809f-95a2a1f2d1e9 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.838505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e49ae1ff-33a8-42a6-809f-95a2a1f2d1e9 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.839129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e49ae1ff-33a8-42a6-809f-95a2a1f2d1e9 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.844106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e49ae1ff-33a8-42a6-809f-95a2a1f2d1e9 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.847391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e49ae1ff-33a8-42a6-809f-95a2a1f2d1e9 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.849111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e49ae1ff-33a8-42a6-809f-95a2a1f2d1e9 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.226358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e49ae1ff-33a8-42a6-809f-95a2a1f2d1e9 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:19.243624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d00f600-a49f-405c-b213-6d99a79c20e5 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:19.255893 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8d00f600-a49f-405c-b213-6d99a79c20e5 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1328 microversion: 2.1 time: 0.681869 Oct 04 18:30:19.260955 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2883/5752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:18 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1328 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:19.296141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:19.296903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:19.303318 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e49ae1ff-33a8-42a6-809f-95a2a1f2d1e9 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1274 microversion: 2.1 time: 0.501198 Oct 04 18:30:19.304551 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2870/5753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:18 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1274 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:19.331431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.338153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.339130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.340317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.343824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.344951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.696631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:19.712483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:19.713888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:19.727879 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-531647f0-4227-47ca-9bf1-b27c1e0d5b3f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.461020 Oct 04 18:30:19.728753 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2884/5754] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:19 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:20.288243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60442a13-b578-4556-9eb0-99f2bd294a29 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:20.289476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-60442a13-b578-4556-9eb0-99f2bd294a29 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:20.302802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60442a13-b578-4556-9eb0-99f2bd294a29 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.303352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60442a13-b578-4556-9eb0-99f2bd294a29 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.303805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60442a13-b578-4556-9eb0-99f2bd294a29 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.315939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60442a13-b578-4556-9eb0-99f2bd294a29 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.316442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60442a13-b578-4556-9eb0-99f2bd294a29 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.316900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60442a13-b578-4556-9eb0-99f2bd294a29 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.331361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ae5efa9-adde-45ed-b9d5-11c5713d61bb tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:20.331991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ae5efa9-adde-45ed-b9d5-11c5713d61bb tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:20.347116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae5efa9-adde-45ed-b9d5-11c5713d61bb tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.347964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae5efa9-adde-45ed-b9d5-11c5713d61bb tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.348580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae5efa9-adde-45ed-b9d5-11c5713d61bb tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.349491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae5efa9-adde-45ed-b9d5-11c5713d61bb tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.350122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae5efa9-adde-45ed-b9d5-11c5713d61bb tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.350833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ae5efa9-adde-45ed-b9d5-11c5713d61bb tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.604611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ae5efa9-adde-45ed-b9d5-11c5713d61bb tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:20.622583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:20.631295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-60442a13-b578-4556-9eb0-99f2bd294a29 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:20.634362 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ae5efa9-adde-45ed-b9d5-11c5713d61bb tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1272 microversion: 2.1 time: 0.305742 Oct 04 18:30:20.635346 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2885/5755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:20 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:20.639738 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-60442a13-b578-4556-9eb0-99f2bd294a29 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1528 microversion: 2.1 time: 0.359812 Oct 04 18:30:20.659985 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2871/5756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:20 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1528 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:20.669531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f1b738bc-275c-4127-9d3c-ffe93495841d tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:20.670637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f1b738bc-275c-4127-9d3c-ffe93495841d tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:20.678305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b738bc-275c-4127-9d3c-ffe93495841d tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.679068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b738bc-275c-4127-9d3c-ffe93495841d tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.679694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b738bc-275c-4127-9d3c-ffe93495841d tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.680795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b738bc-275c-4127-9d3c-ffe93495841d tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.681434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b738bc-275c-4127-9d3c-ffe93495841d tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.682022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f1b738bc-275c-4127-9d3c-ffe93495841d tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.756341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:20.757268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:20.771005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.775430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.777441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.782691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.783388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.784088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.972320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f1b738bc-275c-4127-9d3c-ffe93495841d tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:20.991304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f1b738bc-275c-4127-9d3c-ffe93495841d tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1528 microversion: 2.1 time: 0.325317 Oct 04 18:30:20.992360 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2886/5757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:20 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1528 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:21.109387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:21.132534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:21.134895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:21.137146 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b19302aa-95ff-4574-991a-d6ce50f148d8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.386059 Oct 04 18:30:21.160706 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2872/5758] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:20 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:21.345956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:21.349140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:21.362916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.364264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.365019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.366253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.367237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.367896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.387847 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] HTTP exception thrown: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Request method failure captured: Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 HTTP/1.1 Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHullTAVFnuDexJmR9RSSd_zNJmSvIZz_58_MbmamUGIfVM7NY23fImfUIg6k6iwroEJElq65lFrDw4sp2SuURR_VIOeUiKXye-WWHKF3NYSk9zHIvAqPCcMYYKqs8GwR9B--m4u5YVNo56N9laIYbF-vSKQH3XhYkRApdc-KiehvyQ Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5561586ab48b45c6804ef32f14d848ab Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1309704396 Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5561586ab48b45c6804ef32f14d848ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5561586ab48b45c6804ef32f14d848ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5561586ab48b45c6804ef32f14d848ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5561586ab48b45c6804ef32f14d848ab"}]}] Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1309704396 Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5561586ab48b45c6804ef32f14d848ab Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1309704396 Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1309704396-project Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 666abee7ab7a4e629635ab8fb3349e2a Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1309704396-project Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '4fab6069-c372-43ed-8f1c-babe08d1c765'} Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:21.391831 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:21.396207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Returning 404 to user: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:21.399749 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-029f2fa0-89c5-43f4-b5d6-9835c375a01e tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 404 len: 111 microversion: 2.1 time: 0.383805 Oct 04 18:30:21.404331 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2887/5759] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:21 2022] DELETE /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 111 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:30:21.409888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-66621dc8-f93d-4354-806b-09bac35b2754 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:21.410678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-66621dc8-f93d-4354-806b-09bac35b2754 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:21.422793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66621dc8-f93d-4354-806b-09bac35b2754 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.423551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66621dc8-f93d-4354-806b-09bac35b2754 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.425811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66621dc8-f93d-4354-806b-09bac35b2754 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.429654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66621dc8-f93d-4354-806b-09bac35b2754 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.430326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66621dc8-f93d-4354-806b-09bac35b2754 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.431240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-66621dc8-f93d-4354-806b-09bac35b2754 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.659647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7585ae1c-db04-4225-a61a-68e9d3bc054d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:21.661180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7585ae1c-db04-4225-a61a-68e9d3bc054d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:21.672212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7585ae1c-db04-4225-a61a-68e9d3bc054d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.676531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7585ae1c-db04-4225-a61a-68e9d3bc054d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.678193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7585ae1c-db04-4225-a61a-68e9d3bc054d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.680796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7585ae1c-db04-4225-a61a-68e9d3bc054d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.681538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7585ae1c-db04-4225-a61a-68e9d3bc054d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.682203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7585ae1c-db04-4225-a61a-68e9d3bc054d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.758511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-66621dc8-f93d-4354-806b-09bac35b2754 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:21.767868 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-66621dc8-f93d-4354-806b-09bac35b2754 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1528 microversion: 2.1 time: 0.362172 Oct 04 18:30:21.772341 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2873/5760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:21 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1528 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:21.799471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Action: 'update', calling method: >, body: {"server": {"name": "4fab6069-c372-43ed-8f1c-babe08d1c765_new"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:21.803349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:21.809812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:21.830259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.834376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.835630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.837424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.839056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.839711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.865384 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] HTTP exception thrown: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Request method failure captured: Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: request: PUT /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 HTTP/1.1 Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 64 Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHullTAVFnuDexJmR9RSSd_zNJmSvIZz_58_MbmamUGIfVM7NY23fImfUIg6k6iwroEJElq65lFrDw4sp2SuURR_VIOeUiKXye-WWHKF3NYSk9zHIvAqPCcMYYKqs8GwR9B--m4u5YVNo56N9laIYbF-vSKQH3XhYkRApdc-KiehvyQ Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 5561586ab48b45c6804ef32f14d848ab Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1309704396 Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5561586ab48b45c6804ef32f14d848ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5561586ab48b45c6804ef32f14d848ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5561586ab48b45c6804ef32f14d848ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5561586ab48b45c6804ef32f14d848ab"}]}] Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1309704396 Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 5561586ab48b45c6804ef32f14d848ab Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1309704396 Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1309704396-project Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 666abee7ab7a4e629635ab8fb3349e2a Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1309704396-project Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: {"server": {"name": "4fab6069-c372-43ed-8f1c-babe08d1c765_new"}} Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4fab6069-c372-43ed-8f1c-babe08d1c765', 'body': {'server': {'name': '4fab6069-c372-43ed-8f1c-babe08d1c765_new'}}} Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:21.867467 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:21.873032 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:30:21.875387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] Returning 404 to user: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:21.876652 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cd86021f-925f-41a5-992d-065b867040de tempest-ServersNegativeTestMultiTenantJSON-1309704396 tempest-ServersNegativeTestMultiTenantJSON-1309704396-project] 10.222.0.18 "PUT /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 404 len: 111 microversion: 2.1 time: 0.081481 Oct 04 18:30:21.877790 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2874/5761] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 4 18:30:21 2022] PUT /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:21.887367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-170f5532-a35a-44af-9434-3a08ccc6aac1 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:21.887875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-170f5532-a35a-44af-9434-3a08ccc6aac1 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:21.900110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170f5532-a35a-44af-9434-3a08ccc6aac1 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.900612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170f5532-a35a-44af-9434-3a08ccc6aac1 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.901057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170f5532-a35a-44af-9434-3a08ccc6aac1 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.901777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170f5532-a35a-44af-9434-3a08ccc6aac1 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.902241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170f5532-a35a-44af-9434-3a08ccc6aac1 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.902676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-170f5532-a35a-44af-9434-3a08ccc6aac1 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.949498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-170f5532-a35a-44af-9434-3a08ccc6aac1 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:22.051516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7585ae1c-db04-4225-a61a-68e9d3bc054d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:22.071366 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7585ae1c-db04-4225-a61a-68e9d3bc054d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1314 microversion: 2.1 time: 0.411324 Oct 04 18:30:22.072473 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2888/5762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:21 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:22.074928 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-170f5532-a35a-44af-9434-3a08ccc6aac1 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 204 len: 0 microversion: 2.1 time: 0.187944 Oct 04 18:30:22.084658 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2875/5763] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:21 2022] DELETE /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:30:22.091987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b381a962-ab2e-40de-a1e4-c5c32e621425 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:22.094010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b381a962-ab2e-40de-a1e4-c5c32e621425 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:22.110347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b381a962-ab2e-40de-a1e4-c5c32e621425 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.112561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b381a962-ab2e-40de-a1e4-c5c32e621425 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.113057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b381a962-ab2e-40de-a1e4-c5c32e621425 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:22.113812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b381a962-ab2e-40de-a1e4-c5c32e621425 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.116314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b381a962-ab2e-40de-a1e4-c5c32e621425 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.116949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b381a962-ab2e-40de-a1e4-c5c32e621425 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:22.168275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:22.168986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:22.182516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.183099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.183561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:22.192993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.193434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.193885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:22.382290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b381a962-ab2e-40de-a1e4-c5c32e621425 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:22.391429 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b381a962-ab2e-40de-a1e4-c5c32e621425 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1534 microversion: 2.1 time: 0.308701 Oct 04 18:30:22.407601 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2889/5764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:22 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1534 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:22.973507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:22.985751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:22.988952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:22.990833 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a3818d23-4eac-4bac-9746-fcd6955d2dce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.827091 Oct 04 18:30:23.028771 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2876/5765] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:22 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:23.098763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1da00367-03d3-46cf-bf0b-75f1baf378cf tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:23.099426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1da00367-03d3-46cf-bf0b-75f1baf378cf tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:23.115955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1da00367-03d3-46cf-bf0b-75f1baf378cf tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.116479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1da00367-03d3-46cf-bf0b-75f1baf378cf tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.116941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1da00367-03d3-46cf-bf0b-75f1baf378cf tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.117750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1da00367-03d3-46cf-bf0b-75f1baf378cf tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.118172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1da00367-03d3-46cf-bf0b-75f1baf378cf tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.127277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1da00367-03d3-46cf-bf0b-75f1baf378cf tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.384650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1a79d758-271b-4c13-951f-e448ce6de8bd req-528df8bc-01e7-4293-a940-6d4447adbce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a61b74f-b94c-40b5-8d8b-351168b0c00d", "tag": "6a5c7ab6-f227-4580-aa33-625853f07ace"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:23.408237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1a79d758-271b-4c13-951f-e448ce6de8bd req-528df8bc-01e7-4293-a940-6d4447adbce4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.409481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1a79d758-271b-4c13-951f-e448ce6de8bd req-528df8bc-01e7-4293-a940-6d4447adbce4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.410733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1a79d758-271b-4c13-951f-e448ce6de8bd req-528df8bc-01e7-4293-a940-6d4447adbce4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.417935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1da00367-03d3-46cf-bf0b-75f1baf378cf tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:23.430299 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1da00367-03d3-46cf-bf0b-75f1baf378cf tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1314 microversion: 2.1 time: 0.336465 Oct 04 18:30:23.436349 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1a79d758-271b-4c13-951f-e448ce6de8bd req-528df8bc-01e7-4293-a940-6d4447adbce4 service nova] Creating event network-changed:6a5c7ab6-f227-4580-aa33-625853f07ace for instance 5a61b74f-b94c-40b5-8d8b-351168b0c00d on n-h2-850499-14 Oct 04 18:30:23.449118 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1a79d758-271b-4c13-951f-e448ce6de8bd req-528df8bc-01e7-4293-a940-6d4447adbce4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069293 Oct 04 18:30:23.454510 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2877/5766] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:23.462619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ecdbadf-bbad-4b37-a1a0-64b75fa5ff00 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:23.464408 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2890/5767] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:23 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:23.466851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ecdbadf-bbad-4b37-a1a0-64b75fa5ff00 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:23.475426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ecdbadf-bbad-4b37-a1a0-64b75fa5ff00 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.476487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ecdbadf-bbad-4b37-a1a0-64b75fa5ff00 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.486289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ecdbadf-bbad-4b37-a1a0-64b75fa5ff00 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.488648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ecdbadf-bbad-4b37-a1a0-64b75fa5ff00 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.489895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ecdbadf-bbad-4b37-a1a0-64b75fa5ff00 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.491571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ecdbadf-bbad-4b37-a1a0-64b75fa5ff00 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.020435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:24.021378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:24.034940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.035589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.036054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.036809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.037279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.040034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.118127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ecdbadf-bbad-4b37-a1a0-64b75fa5ff00 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:24.130260 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ecdbadf-bbad-4b37-a1a0-64b75fa5ff00 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1534 microversion: 2.1 time: 0.673287 Oct 04 18:30:24.135069 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2878/5768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:23 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1534 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:24.444673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:24.453509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:24.455172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:24.468612 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dce1a81d-3df0-4eda-8e0d-71b5ed6851ce tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.452272 Oct 04 18:30:24.470254 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2891/5769] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:24 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:24.484401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1439c8be-abd6-4964-a66a-01262496298c tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:24.485400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1439c8be-abd6-4964-a66a-01262496298c tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:24.494405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1439c8be-abd6-4964-a66a-01262496298c tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.495334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1439c8be-abd6-4964-a66a-01262496298c tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.496014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1439c8be-abd6-4964-a66a-01262496298c tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.497024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1439c8be-abd6-4964-a66a-01262496298c tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.497720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1439c8be-abd6-4964-a66a-01262496298c tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.498488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1439c8be-abd6-4964-a66a-01262496298c tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.161467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3643a0b0-8c0b-4def-8eab-e76afb462738 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:25.162099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3643a0b0-8c0b-4def-8eab-e76afb462738 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:25.172332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3643a0b0-8c0b-4def-8eab-e76afb462738 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.172843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3643a0b0-8c0b-4def-8eab-e76afb462738 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.173292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3643a0b0-8c0b-4def-8eab-e76afb462738 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.174015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3643a0b0-8c0b-4def-8eab-e76afb462738 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.181297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3643a0b0-8c0b-4def-8eab-e76afb462738 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.181906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3643a0b0-8c0b-4def-8eab-e76afb462738 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.214539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1439c8be-abd6-4964-a66a-01262496298c tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:25.236300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1439c8be-abd6-4964-a66a-01262496298c tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1314 microversion: 2.1 time: 0.756618 Oct 04 18:30:25.238341 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2879/5770] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:24 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:25.400084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3643a0b0-8c0b-4def-8eab-e76afb462738 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:25.417296 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3643a0b0-8c0b-4def-8eab-e76afb462738 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1492 microversion: 2.1 time: 0.263332 Oct 04 18:30:25.425091 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2892/5771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:25 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1492 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:25.498583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:25.499547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:25.509392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.511526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.512169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.515552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.516254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.516880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.538059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-dcbfacc7-4257-4b1e-8578-42c86432b460 req-906eca45-de93-4d91-9989-8f0a93074cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab6069-c372-43ed-8f1c-babe08d1c765", "name": "network-vif-deleted", "tag": "8c42764a-9476-41a7-aa4c-41fd1d695f8d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:25.575601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dcbfacc7-4257-4b1e-8578-42c86432b460 req-906eca45-de93-4d91-9989-8f0a93074cf7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.576518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dcbfacc7-4257-4b1e-8578-42c86432b460 req-906eca45-de93-4d91-9989-8f0a93074cf7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.578249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dcbfacc7-4257-4b1e-8578-42c86432b460 req-906eca45-de93-4d91-9989-8f0a93074cf7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.615311 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-dcbfacc7-4257-4b1e-8578-42c86432b460 req-906eca45-de93-4d91-9989-8f0a93074cf7 service nova] Creating event network-vif-deleted:8c42764a-9476-41a7-aa4c-41fd1d695f8d for instance 4fab6069-c372-43ed-8f1c-babe08d1c765 on n-h1-850499-14 Oct 04 18:30:25.640223 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-dcbfacc7-4257-4b1e-8578-42c86432b460 req-906eca45-de93-4d91-9989-8f0a93074cf7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106511 Oct 04 18:30:25.641458 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2893/5772] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:25.810660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:25.820670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:25.823796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:25.827568 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b392f08e-b331-42d1-9a10-e8167acec59a tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.332753 Oct 04 18:30:25.830259 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2880/5773] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:25 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:26.271642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-190aa036-29b4-48f1-b7ea-cd9116e50a8a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:26.272732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-190aa036-29b4-48f1-b7ea-cd9116e50a8a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:26.291240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:26.308678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-190aa036-29b4-48f1-b7ea-cd9116e50a8a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.309657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-190aa036-29b4-48f1-b7ea-cd9116e50a8a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.311706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-190aa036-29b4-48f1-b7ea-cd9116e50a8a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.313288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-190aa036-29b4-48f1-b7ea-cd9116e50a8a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.315625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-190aa036-29b4-48f1-b7ea-cd9116e50a8a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.317452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-190aa036-29b4-48f1-b7ea-cd9116e50a8a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.457496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:26.459141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:26.475996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.479354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.480846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.484613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.486963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.487729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.611034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.611761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.613101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.613785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lazy-loading 'fault' on Instance uuid 4fab6069-c372-43ed-8f1c-babe08d1c765 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:26.748945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c937e148a20416096303f9d43010d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f8d1fb850492a97f96de2bc1b88af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:26.757884 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-292e7702-4e06-42ce-9171-507e1e060be7 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 200 len: 1318 microversion: 2.1 time: 0.310485 Oct 04 18:30:26.759046 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2881/5774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:26 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:26.844670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-190aa036-29b4-48f1-b7ea-cd9116e50a8a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:26.858086 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-190aa036-29b4-48f1-b7ea-cd9116e50a8a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1314 microversion: 2.1 time: 0.601243 Oct 04 18:30:26.859010 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2894/5775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:26 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:26.862852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:26.863513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:26.870795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.871499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.872088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.873021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.873798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.874404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.143180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:27.152732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:27.154887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:27.156351 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f2e5d216-b37b-41d2-b205-f4539b76a5c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.299145 Oct 04 18:30:27.181005 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2882/5776] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:26 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:27.785164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:27.789131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] [instance: 4fab6069-c372-43ed-8f1c-babe08d1c765] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:27.812178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:27.821063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.823521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.824406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.825385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.826068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.826696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.860782 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] HTTP exception thrown: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Request method failure captured: Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 HTTP/1.1 Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHuahGsaV9cE8z7j6oh-jJs6jiQkG_KnEVfDzSYG7AFc_VYmGyvHr0ma9pireB9hMr_PdgwKfMG851aRNg2V4BcasV5M7UhqBNRXV3pKmUbzbW7i4GD3dm8m5mxG1xTjtMDuGjOJlo_qt5DgQOY8Jkev1FG9XGLdDR9YNvpFA32r_Wg Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: b22f8d1fb850492a97f96de2bc1b88af Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-12409908 Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b22f8d1fb850492a97f96de2bc1b88af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b22f8d1fb850492a97f96de2bc1b88af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b22f8d1fb850492a97f96de2bc1b88af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b22f8d1fb850492a97f96de2bc1b88af"}]}] Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-12409908 Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: b22f8d1fb850492a97f96de2bc1b88af Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-12409908 Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestMultiTenantJSON-12409908-project Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3c937e148a20416096303f9d43010d26 Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-12409908-project Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '4fab6069-c372-43ed-8f1c-babe08d1c765'} Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:27.864337 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:27.868691 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:27.868691 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:27.868691 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:27.868691 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:27.868691 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:27.868691 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:27.868691 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. Oct 04 18:30:27.868691 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:27.871295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] Returning 404 to user: Instance 4fab6069-c372-43ed-8f1c-babe08d1c765 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:27.872320 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-93ab5102-3431-454f-9905-0a2a45940039 tempest-ServersNegativeTestMultiTenantJSON-12409908 tempest-ServersNegativeTestMultiTenantJSON-12409908-project] 10.222.0.18 "GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765" status: 404 len: 111 microversion: 2.1 time: 0.092715 Oct 04 18:30:27.875873 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2895/5777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:27 2022] GET /compute/v2.1/servers/4fab6069-c372-43ed-8f1c-babe08d1c765 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:27.884400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3dfee083-6512-40e3-9c64-075678437d67 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:27.885185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3dfee083-6512-40e3-9c64-075678437d67 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:27.901433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfee083-6512-40e3-9c64-075678437d67 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.904047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfee083-6512-40e3-9c64-075678437d67 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.907263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfee083-6512-40e3-9c64-075678437d67 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.916899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfee083-6512-40e3-9c64-075678437d67 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.919227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfee083-6512-40e3-9c64-075678437d67 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.923352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfee083-6512-40e3-9c64-075678437d67 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.185651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:28.186287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:28.220272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.221092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.221930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.222847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.223486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.224238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.789043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.830142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.845724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.851951 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c0252e3c-621a-4028-a5bf-102555598372 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.668985 Oct 04 18:30:28.855024 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2896/5778] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:28 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:29.052521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3dfee083-6512-40e3-9c64-075678437d67 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:29.058996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:29.068073 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3dfee083-6512-40e3-9c64-075678437d67 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1314 microversion: 2.1 time: 1.188881 Oct 04 18:30:29.080584 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2883/5779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:27 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1314 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:29.881927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:29.885786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:29.914450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.914981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.915453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.916185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.918277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.929437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:30.116552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7346b82-55b9-4b19-857b-e77bb5b0185d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:30.117800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b7346b82-55b9-4b19-857b-e77bb5b0185d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:30.130663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7346b82-55b9-4b19-857b-e77bb5b0185d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:30.133820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7346b82-55b9-4b19-857b-e77bb5b0185d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:30.134596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7346b82-55b9-4b19-857b-e77bb5b0185d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:30.135568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7346b82-55b9-4b19-857b-e77bb5b0185d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:30.136207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7346b82-55b9-4b19-857b-e77bb5b0185d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:30.138042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7346b82-55b9-4b19-857b-e77bb5b0185d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:30.557186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b7346b82-55b9-4b19-857b-e77bb5b0185d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:30.566162 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b7346b82-55b9-4b19-857b-e77bb5b0185d tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1314 microversion: 2.1 time: 0.475917 Oct 04 18:30:30.578927 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2884/5780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:30 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:30.654289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:30.680813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:30.692045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:30.694728 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a2959876-19ff-463e-8e22-f5c08ef34e10 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.816902 Oct 04 18:30:30.701978 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2897/5781] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:29 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:31.624734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-12daea47-8551-407e-833d-da11831c120f tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:31.627374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-12daea47-8551-407e-833d-da11831c120f tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:31.652545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12daea47-8551-407e-833d-da11831c120f tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.653523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12daea47-8551-407e-833d-da11831c120f tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.654205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12daea47-8551-407e-833d-da11831c120f tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.655467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12daea47-8551-407e-833d-da11831c120f tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.656157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12daea47-8551-407e-833d-da11831c120f tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.656810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12daea47-8551-407e-833d-da11831c120f tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.728043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:31.728824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:31.759472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.760599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.761630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.765552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.766289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.768459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.072057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-12daea47-8551-407e-833d-da11831c120f tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:33.100475 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-12daea47-8551-407e-833d-da11831c120f tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1314 microversion: 2.1 time: 1.497499 Oct 04 18:30:33.103405 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2885/5782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:31 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1314 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:33.122099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-2ac035c0-9051-4325-bfbe-a7a5e366b3c0 req-3d43c03c-0c64-45c0-ae58-b45cfac70b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a61b74f-b94c-40b5-8d8b-351168b0c00d", "name": "network-vif-plugged", "status": "completed", "tag": "6a5c7ab6-f227-4580-aa33-625853f07ace"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:33.137256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:33.156382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2ac035c0-9051-4325-bfbe-a7a5e366b3c0 req-3d43c03c-0c64-45c0-ae58-b45cfac70b58 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.162614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2ac035c0-9051-4325-bfbe-a7a5e366b3c0 req-3d43c03c-0c64-45c0-ae58-b45cfac70b58 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.162759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:33.164271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2ac035c0-9051-4325-bfbe-a7a5e366b3c0 req-3d43c03c-0c64-45c0-ae58-b45cfac70b58 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.167861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:33.169224 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b3378828-b447-445c-8824-0bb7b6b18d0c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 1.446287 Oct 04 18:30:33.169982 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2898/5783] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:31 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:33.197091 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-2ac035c0-9051-4325-bfbe-a7a5e366b3c0 req-3d43c03c-0c64-45c0-ae58-b45cfac70b58 service nova] Creating event network-vif-plugged:6a5c7ab6-f227-4580-aa33-625853f07ace for instance 5a61b74f-b94c-40b5-8d8b-351168b0c00d on n-h2-850499-14 Oct 04 18:30:33.206015 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-2ac035c0-9051-4325-bfbe-a7a5e366b3c0 req-3d43c03c-0c64-45c0-ae58-b45cfac70b58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098755 Oct 04 18:30:33.207412 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2886/5784] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:33.650680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6b822d3-64e7-460c-8053-e0a68ed4ae15 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:33.651700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f6b822d3-64e7-460c-8053-e0a68ed4ae15 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:33.664280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6b822d3-64e7-460c-8053-e0a68ed4ae15 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.665289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6b822d3-64e7-460c-8053-e0a68ed4ae15 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.666149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6b822d3-64e7-460c-8053-e0a68ed4ae15 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.667831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6b822d3-64e7-460c-8053-e0a68ed4ae15 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.668815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6b822d3-64e7-460c-8053-e0a68ed4ae15 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.670058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6b822d3-64e7-460c-8053-e0a68ed4ae15 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.067532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f6b822d3-64e7-460c-8053-e0a68ed4ae15 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:34.085405 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6b822d3-64e7-460c-8053-e0a68ed4ae15 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.448528 Oct 04 18:30:34.086634 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2899/5785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:33 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:34.120645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8daee0a-3e96-4b71-9e75-bcac87def28f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:34.121467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e8daee0a-3e96-4b71-9e75-bcac87def28f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:34.146800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f793a344-bc3b-4757-8486-95417557caee tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:34.147426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f793a344-bc3b-4757-8486-95417557caee tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:34.154004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8daee0a-3e96-4b71-9e75-bcac87def28f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.154756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8daee0a-3e96-4b71-9e75-bcac87def28f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.155512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8daee0a-3e96-4b71-9e75-bcac87def28f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.156525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8daee0a-3e96-4b71-9e75-bcac87def28f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.159922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8daee0a-3e96-4b71-9e75-bcac87def28f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.160638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8daee0a-3e96-4b71-9e75-bcac87def28f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.164015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f793a344-bc3b-4757-8486-95417557caee tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.170446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f793a344-bc3b-4757-8486-95417557caee tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.175959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f793a344-bc3b-4757-8486-95417557caee tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.177117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f793a344-bc3b-4757-8486-95417557caee tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.180888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f793a344-bc3b-4757-8486-95417557caee tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.185019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f793a344-bc3b-4757-8486-95417557caee tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.813005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f793a344-bc3b-4757-8486-95417557caee tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:34.825525 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f793a344-bc3b-4757-8486-95417557caee tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1314 microversion: 2.1 time: 0.698148 Oct 04 18:30:34.827251 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2900/5786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:34 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:34.836015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:34.837928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:34.858896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.860116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.860783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.866148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.866878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.868094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.969247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8daee0a-3e96-4b71-9e75-bcac87def28f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:34.990921 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e8daee0a-3e96-4b71-9e75-bcac87def28f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.876699 Oct 04 18:30:34.998811 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2887/5787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:34 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:35.024081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8998e9f4-a36a-4ad1-acaf-70ae931b3812 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:35.024943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8998e9f4-a36a-4ad1-acaf-70ae931b3812 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:35.041104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8998e9f4-a36a-4ad1-acaf-70ae931b3812 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.043891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8998e9f4-a36a-4ad1-acaf-70ae931b3812 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.045118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8998e9f4-a36a-4ad1-acaf-70ae931b3812 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.046542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8998e9f4-a36a-4ad1-acaf-70ae931b3812 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.047284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8998e9f4-a36a-4ad1-acaf-70ae931b3812 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.047957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8998e9f4-a36a-4ad1-acaf-70ae931b3812 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.419185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:35.475512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:35.503137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:35.505161 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-643ed75a-46c4-4502-87ed-554208aa4fac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.676507 Oct 04 18:30:35.512911 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2901/5788] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:34 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:35.760926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8998e9f4-a36a-4ad1-acaf-70ae931b3812 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:35.777837 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8998e9f4-a36a-4ad1-acaf-70ae931b3812 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.758163 Oct 04 18:30:35.789181 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2888/5789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:35 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:35.808365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e515d6d2-ddc2-4538-b762-81c5b747cf1b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:35.808998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e515d6d2-ddc2-4538-b762-81c5b747cf1b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:35.821164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e515d6d2-ddc2-4538-b762-81c5b747cf1b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.829018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e515d6d2-ddc2-4538-b762-81c5b747cf1b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.829547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e515d6d2-ddc2-4538-b762-81c5b747cf1b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.835991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e515d6d2-ddc2-4538-b762-81c5b747cf1b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.850270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e515d6d2-ddc2-4538-b762-81c5b747cf1b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.853316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e515d6d2-ddc2-4538-b762-81c5b747cf1b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.853953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-782404f2-f457-417d-b48b-b32800e302df tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:35.854844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-782404f2-f457-417d-b48b-b32800e302df tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:35.865744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782404f2-f457-417d-b48b-b32800e302df tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.866523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782404f2-f457-417d-b48b-b32800e302df tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.872893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782404f2-f457-417d-b48b-b32800e302df tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.877397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782404f2-f457-417d-b48b-b32800e302df tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.878195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782404f2-f457-417d-b48b-b32800e302df tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.878806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782404f2-f457-417d-b48b-b32800e302df tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.371845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-782404f2-f457-417d-b48b-b32800e302df tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:36.387792 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-782404f2-f457-417d-b48b-b32800e302df tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1314 microversion: 2.1 time: 0.538248 Oct 04 18:30:36.388630 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2889/5790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:35 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:36.546496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:36.547622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:36.558207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.559137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.560132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.564790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.565734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.566410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.785230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e515d6d2-ddc2-4538-b762-81c5b747cf1b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:36.804354 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e515d6d2-ddc2-4538-b762-81c5b747cf1b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.992567 Oct 04 18:30:36.827696 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2902/5791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:35 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:37.014431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1759229116", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "68212092-c97c-4a48-819f-9516513174c4"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:37.136559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] validate_networks() for [('68212092-c97c-4a48-819f-9516513174c4', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:37.172975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:37.191634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:37.193561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:37.195439 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-93d33658-7cff-41df-99e3-b4c7cc7a2c73 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1740 microversion: 2.20 time: 0.655242 Oct 04 18:30:37.213938 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2890/5792] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:36 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1740 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:37.418377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-642d4bd5-df0e-47ee-bd1d-bfdf30d6aa74 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:37.419042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-642d4bd5-df0e-47ee-bd1d-bfdf30d6aa74 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:37.432810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-642d4bd5-df0e-47ee-bd1d-bfdf30d6aa74 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.438803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-642d4bd5-df0e-47ee-bd1d-bfdf30d6aa74 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.439661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-642d4bd5-df0e-47ee-bd1d-bfdf30d6aa74 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.441161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-642d4bd5-df0e-47ee-bd1d-bfdf30d6aa74 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.442394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-642d4bd5-df0e-47ee-bd1d-bfdf30d6aa74 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.443011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-642d4bd5-df0e-47ee-bd1d-bfdf30d6aa74 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.509346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-642d4bd5-df0e-47ee-bd1d-bfdf30d6aa74 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:38.521591 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-642d4bd5-df0e-47ee-bd1d-bfdf30d6aa74 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1498 microversion: 2.1 time: 1.110575 Oct 04 18:30:38.522948 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2891/5793] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:37 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1498 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:38.529921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:38.531150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:38.539671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:38.540613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:38.541969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.543232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:38.543998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:38.544576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.447476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:39.447916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:39.448566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:39.449179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:39.450911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:39.469291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.470082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.476268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.477134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.477804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.478433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.521203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for project e2ee0993b0954950949c8afffb90617c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:39.538923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for user 6591acf0ba4648abac6cc8ac8ddd560e and project e2ee0993b0954950949c8afffb90617c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:39.565495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:39.570641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:39.598056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:39.612503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:39.615367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:39.618798 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-51917c3d-138d-4bed-815a-1c22c3bea999 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1722 microversion: 2.20 time: 1.092061 Oct 04 18:30:39.634584 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2892/5794] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:38 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1722 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:39.681621 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d8fe82fd-8fec-4d6b-8db7-e57fbb06bb9e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.670659 Oct 04 18:30:39.683763 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2903/5795] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:30:39.696262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8426f30f-fbf0-4405-a530-23af9cf96c36 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:39.697276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8426f30f-fbf0-4405-a530-23af9cf96c36 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.838041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8426f30f-fbf0-4405-a530-23af9cf96c36 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:39.898274 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8426f30f-fbf0-4405-a530-23af9cf96c36 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1215 microversion: 2.1 time: 0.205794 Oct 04 18:30:39.915095 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2893/5796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:39 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:40.652888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.655884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.681710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.685105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.687884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.690378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.691258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.694284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.932531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-82de7bca-40b2-4677-816d-92455997e753 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.933755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-82de7bca-40b2-4677-816d-92455997e753 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:41.077012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-82de7bca-40b2-4677-816d-92455997e753 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:41.085415 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-82de7bca-40b2-4677-816d-92455997e753 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1215 microversion: 2.1 time: 0.157387 Oct 04 18:30:41.088108 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2894/5797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:41.143384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:41.158299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:41.161942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:41.163480 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9aadb94-aa7b-4e55-b378-c239aa1fc3a5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1722 microversion: 2.20 time: 0.520488 Oct 04 18:30:41.164183 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2904/5798] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1722 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:41.920767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e91d53ec-e1ae-4f80-a39a-ff7d40483c31 req-ff327570-5848-4197-ae9f-79baae95d248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9afae5-6ef4-4bd5-92f8-1d0ed466b280", "name": "network-vif-unplugged", "status": "completed", "tag": "2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:41.953632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e91d53ec-e1ae-4f80-a39a-ff7d40483c31 req-ff327570-5848-4197-ae9f-79baae95d248 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.955095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e91d53ec-e1ae-4f80-a39a-ff7d40483c31 req-ff327570-5848-4197-ae9f-79baae95d248 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.955942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e91d53ec-e1ae-4f80-a39a-ff7d40483c31 req-ff327570-5848-4197-ae9f-79baae95d248 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.968679 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e91d53ec-e1ae-4f80-a39a-ff7d40483c31 req-ff327570-5848-4197-ae9f-79baae95d248 service nova] Creating event network-vif-unplugged:2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e for instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 on n-h1-850499-14 Oct 04 18:30:41.975103 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e91d53ec-e1ae-4f80-a39a-ff7d40483c31 req-ff327570-5848-4197-ae9f-79baae95d248 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058796 Oct 04 18:30:41.976473 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2895/5799] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:42.114517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21e5178e-ebdb-46f6-bc5b-4ccb25545af4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.118274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21e5178e-ebdb-46f6-bc5b-4ccb25545af4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.128186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e5178e-ebdb-46f6-bc5b-4ccb25545af4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.128814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e5178e-ebdb-46f6-bc5b-4ccb25545af4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.129273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e5178e-ebdb-46f6-bc5b-4ccb25545af4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.130001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e5178e-ebdb-46f6-bc5b-4ccb25545af4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.130462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e5178e-ebdb-46f6-bc5b-4ccb25545af4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.131269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21e5178e-ebdb-46f6-bc5b-4ccb25545af4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.149791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:42.200383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.202047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.218618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.219725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.220411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.224037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.224895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.225588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.276061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-21e5178e-ebdb-46f6-bc5b-4ccb25545af4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.289487 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21e5178e-ebdb-46f6-bc5b-4ccb25545af4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1267 microversion: 2.1 time: 0.183438 Oct 04 18:30:42.290081 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2905/5800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:42.633484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.651409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.653201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.658635 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9643779d-1bb3-4e3f-93fb-5ecb4d8a1c4f tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1725 microversion: 2.20 time: 0.469435 Oct 04 18:30:42.675419 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2896/5801] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1725 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:42.688633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-49ac2447-0db8-40c2-8cda-f002568a4d38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc90c8d3-66f8-461c-beec-7129f096a4dc"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:42.692865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-49ac2447-0db8-40c2-8cda-f002568a4d38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.702412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49ac2447-0db8-40c2-8cda-f002568a4d38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.703927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49ac2447-0db8-40c2-8cda-f002568a4d38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.704721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49ac2447-0db8-40c2-8cda-f002568a4d38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.706403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49ac2447-0db8-40c2-8cda-f002568a4d38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.707169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49ac2447-0db8-40c2-8cda-f002568a4d38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.708380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49ac2447-0db8-40c2-8cda-f002568a4d38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.270611 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-49ac2447-0db8-40c2-8cda-f002568a4d38 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "POST /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.588802 Oct 04 18:30:43.277626 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2906/5802] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Oct 4 18:30:42 2022] POST /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/os-volume_attachments => generated 188 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:30:43.298829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4245d43c-310f-4eb2-9ed8-d877148b8f3b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.316888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62dbb58f-8e73-45e3-8bd3-056cdc094ee2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.317894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-62dbb58f-8e73-45e3-8bd3-056cdc094ee2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.326464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4245d43c-310f-4eb2-9ed8-d877148b8f3b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.333036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62dbb58f-8e73-45e3-8bd3-056cdc094ee2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.335386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62dbb58f-8e73-45e3-8bd3-056cdc094ee2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.336955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62dbb58f-8e73-45e3-8bd3-056cdc094ee2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.340702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62dbb58f-8e73-45e3-8bd3-056cdc094ee2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.341843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62dbb58f-8e73-45e3-8bd3-056cdc094ee2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.342742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62dbb58f-8e73-45e3-8bd3-056cdc094ee2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.347208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4245d43c-310f-4eb2-9ed8-d877148b8f3b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.348278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4245d43c-310f-4eb2-9ed8-d877148b8f3b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.348835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4245d43c-310f-4eb2-9ed8-d877148b8f3b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.349917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4245d43c-310f-4eb2-9ed8-d877148b8f3b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.350593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4245d43c-310f-4eb2-9ed8-d877148b8f3b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.351131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4245d43c-310f-4eb2-9ed8-d877148b8f3b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.393848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4245d43c-310f-4eb2-9ed8-d877148b8f3b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:43.519244 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4245d43c-310f-4eb2-9ed8-d877148b8f3b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 204 len: 0 microversion: 2.1 time: 0.224585 Oct 04 18:30:43.520073 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2897/5803] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:43 2022] DELETE /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:43.527581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62dbb58f-8e73-45e3-8bd3-056cdc094ee2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:43.534322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d12b043e-2135-41fa-ad7d-e75200a5d4ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.535070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d12b043e-2135-41fa-ad7d-e75200a5d4ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.542005 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-62dbb58f-8e73-45e3-8bd3-056cdc094ee2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1273 microversion: 2.1 time: 0.231208 Oct 04 18:30:43.555003 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2907/5804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:43.555003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9be66806-6078-4054-86cb-119201b54a5b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.555309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12b043e-2135-41fa-ad7d-e75200a5d4ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.555309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12b043e-2135-41fa-ad7d-e75200a5d4ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.555309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12b043e-2135-41fa-ad7d-e75200a5d4ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.555568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9be66806-6078-4054-86cb-119201b54a5b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.559420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12b043e-2135-41fa-ad7d-e75200a5d4ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.559936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12b043e-2135-41fa-ad7d-e75200a5d4ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.560594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12b043e-2135-41fa-ad7d-e75200a5d4ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.567071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9be66806-6078-4054-86cb-119201b54a5b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.568045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9be66806-6078-4054-86cb-119201b54a5b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.568703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9be66806-6078-4054-86cb-119201b54a5b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.569718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9be66806-6078-4054-86cb-119201b54a5b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.570437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9be66806-6078-4054-86cb-119201b54a5b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.572122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9be66806-6078-4054-86cb-119201b54a5b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.875048 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d12b043e-2135-41fa-ad7d-e75200a5d4ba tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/os-volume_attachments/fc90c8d3-66f8-461c-beec-7129f096a4dc" status: 202 len: 0 microversion: 2.20 time: 0.353463 Oct 04 18:30:43.876055 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2898/5805] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Oct 4 18:30:43 2022] DELETE /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/os-volume_attachments/fc90c8d3-66f8-461c-beec-7129f096a4dc => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:43.935338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9be66806-6078-4054-86cb-119201b54a5b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:43.945973 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9be66806-6078-4054-86cb-119201b54a5b tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1504 microversion: 2.1 time: 0.401999 Oct 04 18:30:43.946821 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2908/5806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:43.963791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-439a2617-e5dc-461f-9e2b-a43718a0bc05 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:43.965304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-439a2617-e5dc-461f-9e2b-a43718a0bc05 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.979623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-439a2617-e5dc-461f-9e2b-a43718a0bc05 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.980129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-439a2617-e5dc-461f-9e2b-a43718a0bc05 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.981476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-439a2617-e5dc-461f-9e2b-a43718a0bc05 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.983906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-439a2617-e5dc-461f-9e2b-a43718a0bc05 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.984392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-439a2617-e5dc-461f-9e2b-a43718a0bc05 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.985979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-439a2617-e5dc-461f-9e2b-a43718a0bc05 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.045728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-439a2617-e5dc-461f-9e2b-a43718a0bc05 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122332) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:30:44.078345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:44.138725 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-439a2617-e5dc-461f-9e2b-a43718a0bc05 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "POST /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/action" status: 202 len: 0 microversion: 2.20 time: 0.187086 Oct 04 18:30:44.139664 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2899/5807] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 4 18:30:43 2022] POST /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:44.147927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.149875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:44.179335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.179852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.180302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.181032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.181502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.181936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.568340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4170bce4-5839-4282-b398-c89ae8e1b2d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.569076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4170bce4-5839-4282-b398-c89ae8e1b2d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:44.584299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4170bce4-5839-4282-b398-c89ae8e1b2d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.586647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4170bce4-5839-4282-b398-c89ae8e1b2d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.587996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4170bce4-5839-4282-b398-c89ae8e1b2d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.589399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4170bce4-5839-4282-b398-c89ae8e1b2d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.590124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4170bce4-5839-4282-b398-c89ae8e1b2d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.590806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4170bce4-5839-4282-b398-c89ae8e1b2d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.901153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4170bce4-5839-4282-b398-c89ae8e1b2d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:44.912949 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4170bce4-5839-4282-b398-c89ae8e1b2d3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1315 microversion: 2.1 time: 0.350716 Oct 04 18:30:44.926981 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2900/5808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:44.969584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-788ccc4f-2fba-498c-863e-8dc3602f8283 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.970421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-788ccc4f-2fba-498c-863e-8dc3602f8283 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:44.986381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-788ccc4f-2fba-498c-863e-8dc3602f8283 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.987469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-788ccc4f-2fba-498c-863e-8dc3602f8283 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.988157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-788ccc4f-2fba-498c-863e-8dc3602f8283 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.989082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-788ccc4f-2fba-498c-863e-8dc3602f8283 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.989726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-788ccc4f-2fba-498c-863e-8dc3602f8283 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.990349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-788ccc4f-2fba-498c-863e-8dc3602f8283 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.003835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.012391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.013798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.021933 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aa5ebe9f-344a-441d-9219-6791bea4a40e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1673 microversion: 2.20 time: 0.871014 Oct 04 18:30:45.022897 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2909/5809] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1673 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:45.768729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-788ccc4f-2fba-498c-863e-8dc3602f8283 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.786182 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-788ccc4f-2fba-498c-863e-8dc3602f8283 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1504 microversion: 2.1 time: 0.819824 Oct 04 18:30:45.791162 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2901/5810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1504 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:45.941365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eae43ad5-1471-48d3-b3af-422ba4d4cfca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:45.942303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eae43ad5-1471-48d3-b3af-422ba4d4cfca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:45.949748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eae43ad5-1471-48d3-b3af-422ba4d4cfca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.950732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eae43ad5-1471-48d3-b3af-422ba4d4cfca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.951397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eae43ad5-1471-48d3-b3af-422ba4d4cfca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.952327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eae43ad5-1471-48d3-b3af-422ba4d4cfca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.952979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eae43ad5-1471-48d3-b3af-422ba4d4cfca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.953747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eae43ad5-1471-48d3-b3af-422ba4d4cfca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.053260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.053876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.063450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.064180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.064389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.065636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.066078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.066506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.428128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eae43ad5-1471-48d3-b3af-422ba4d4cfca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.457029 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eae43ad5-1471-48d3-b3af-422ba4d4cfca tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1315 microversion: 2.1 time: 0.520605 Oct 04 18:30:46.461265 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2910/5811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:45 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:46.537321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.556803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.563200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.567682 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bf580c85-9829-4f62-9411-ca2a28bc1e41 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1673 microversion: 2.20 time: 0.518793 Oct 04 18:30:46.572876 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2902/5812] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1673 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:46.824568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ceee35b6-2a77-4a96-a94f-dc2d2a948ac2 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.825576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ceee35b6-2a77-4a96-a94f-dc2d2a948ac2 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.834917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceee35b6-2a77-4a96-a94f-dc2d2a948ac2 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.835842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceee35b6-2a77-4a96-a94f-dc2d2a948ac2 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.836439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceee35b6-2a77-4a96-a94f-dc2d2a948ac2 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.837514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceee35b6-2a77-4a96-a94f-dc2d2a948ac2 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.838130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceee35b6-2a77-4a96-a94f-dc2d2a948ac2 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.838709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceee35b6-2a77-4a96-a94f-dc2d2a948ac2 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.251598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ceee35b6-2a77-4a96-a94f-dc2d2a948ac2 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:47.266142 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ceee35b6-2a77-4a96-a94f-dc2d2a948ac2 tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1504 microversion: 2.1 time: 0.446938 Oct 04 18:30:47.267415 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2911/5813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:47.485969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8a42283-91f2-43ca-bf00-4a15351d82c7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:47.487163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f8a42283-91f2-43ca-bf00-4a15351d82c7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:47.497739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8a42283-91f2-43ca-bf00-4a15351d82c7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.506590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8a42283-91f2-43ca-bf00-4a15351d82c7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.507086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8a42283-91f2-43ca-bf00-4a15351d82c7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.507855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8a42283-91f2-43ca-bf00-4a15351d82c7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.508374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8a42283-91f2-43ca-bf00-4a15351d82c7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.508817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8a42283-91f2-43ca-bf00-4a15351d82c7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.587494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4e84dfe7-2684-4844-ad0f-071952ad6f8f req-4d4a7f75-7307-4a5b-a063-b5552ad0c321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71491fc8-2852-4791-b61a-ab099f09a37e", "tag": "5be61e5e-946e-439c-b904-7bc08044ea77"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:47.630052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4e84dfe7-2684-4844-ad0f-071952ad6f8f req-4d4a7f75-7307-4a5b-a063-b5552ad0c321 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.633124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4e84dfe7-2684-4844-ad0f-071952ad6f8f req-4d4a7f75-7307-4a5b-a063-b5552ad0c321 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.635089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4e84dfe7-2684-4844-ad0f-071952ad6f8f req-4d4a7f75-7307-4a5b-a063-b5552ad0c321 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.666773 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4e84dfe7-2684-4844-ad0f-071952ad6f8f req-4d4a7f75-7307-4a5b-a063-b5552ad0c321 service nova] Creating event network-changed:5be61e5e-946e-439c-b904-7bc08044ea77 for instance 71491fc8-2852-4791-b61a-ab099f09a37e on n-h1-850499-14 Oct 04 18:30:47.695152 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4e84dfe7-2684-4844-ad0f-071952ad6f8f req-4d4a7f75-7307-4a5b-a063-b5552ad0c321 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114020 Oct 04 18:30:47.698431 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2912/5814] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:47.712348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:47.715077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:47.734673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.738496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.739355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.742438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.744253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.745005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.269007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f8a42283-91f2-43ca-bf00-4a15351d82c7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.281541 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8a42283-91f2-43ca-bf00-4a15351d82c7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1315 microversion: 2.1 time: 0.797236 Oct 04 18:30:48.282681 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2903/5815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:47 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:48.295181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6a5e8159-2180-45a1-b8fa-fbba25ac8b2b req-d3d1c140-aba5-4b5c-8fde-ed1f7fb66b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a61b74f-b94c-40b5-8d8b-351168b0c00d", "name": "network-vif-deleted", "tag": "6a5c7ab6-f227-4580-aa33-625853f07ace"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:48.321754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6a5e8159-2180-45a1-b8fa-fbba25ac8b2b req-d3d1c140-aba5-4b5c-8fde-ed1f7fb66b47 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.322524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6a5e8159-2180-45a1-b8fa-fbba25ac8b2b req-d3d1c140-aba5-4b5c-8fde-ed1f7fb66b47 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.323315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6a5e8159-2180-45a1-b8fa-fbba25ac8b2b req-d3d1c140-aba5-4b5c-8fde-ed1f7fb66b47 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.344912 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6a5e8159-2180-45a1-b8fa-fbba25ac8b2b req-d3d1c140-aba5-4b5c-8fde-ed1f7fb66b47 service nova] Creating event network-vif-deleted:6a5c7ab6-f227-4580-aa33-625853f07ace for instance 5a61b74f-b94c-40b5-8d8b-351168b0c00d on n-h2-850499-14 Oct 04 18:30:48.350909 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6a5e8159-2180-45a1-b8fa-fbba25ac8b2b req-d3d1c140-aba5-4b5c-8fde-ed1f7fb66b47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062638 Oct 04 18:30:48.352028 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2904/5816] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:48.359116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:48.360378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:48.371656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.372366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.373015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.374487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.375187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.375788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.428005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.428698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.429304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.430126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lazy-loading 'fault' on Instance uuid 5a61b74f-b94c-40b5-8d8b-351168b0c00d {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:48.456658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.469272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.472437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.475785 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-36928e0e-1bfe-4f9d-be91-322980dafcf7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.772819 Oct 04 18:30:48.476836 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2913/5817] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:47 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:48.530838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf108d8d502f4e0290e98dac5436e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da8f7991d2042f6b09a3068daeefbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.558557 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d36e35b6-73ab-442f-84ad-65d2a9cf4a1a tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 200 len: 1304 microversion: 2.1 time: 0.204798 Oct 04 18:30:48.561787 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2905/5818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:48 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:49.305668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ac4d802-fd3e-418d-ac56-84a3d98fa703 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.306918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ac4d802-fd3e-418d-ac56-84a3d98fa703 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.317048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:49.320620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ac4d802-fd3e-418d-ac56-84a3d98fa703 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.322496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ac4d802-fd3e-418d-ac56-84a3d98fa703 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.324651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ac4d802-fd3e-418d-ac56-84a3d98fa703 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.327713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ac4d802-fd3e-418d-ac56-84a3d98fa703 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.328416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ac4d802-fd3e-418d-ac56-84a3d98fa703 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.329033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ac4d802-fd3e-418d-ac56-84a3d98fa703 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.500518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:49.513146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.514013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.523189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.523800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.524253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.525061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.525535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.526186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.550824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:49.829205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1ac4d802-fd3e-418d-ac56-84a3d98fa703 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:49.839122 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ac4d802-fd3e-418d-ac56-84a3d98fa703 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1315 microversion: 2.1 time: 0.537743 Oct 04 18:30:49.847926 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2914/5819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:49.858712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.866972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] [instance: 5a61b74f-b94c-40b5-8d8b-351168b0c00d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.895868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.896906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.899996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.901471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.905621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.908578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.946590 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] HTTP exception thrown: Instance 5a61b74f-b94c-40b5-8d8b-351168b0c00d could not be found. Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Request method failure captured: Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d HTTP/1.1 Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHuxxQHVqUgYP9i6uvniYmCV6iBXuNorvw8e9kIl0blnUEIsxGcG-TjtoNnA7Bp-9Z93A5qHwecpzrNu-WS6WyT51LDVXD9C3MY0mTVxWU3qG9yZwg5vVTcoel-qeiG5I2rixsmCIke2FL81qdPy0mJLn_4XxYB9wYCekS8GACmLwQY Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2da8f7991d2042f6b09a3068daeefbd8 Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-VolumesActionsTest-236397856 Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2da8f7991d2042f6b09a3068daeefbd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2da8f7991d2042f6b09a3068daeefbd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2da8f7991d2042f6b09a3068daeefbd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2da8f7991d2042f6b09a3068daeefbd8"}]}] Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-VolumesActionsTest-236397856 Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2da8f7991d2042f6b09a3068daeefbd8 Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-VolumesActionsTest-236397856 Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-VolumesActionsTest-236397856-project Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: cf108d8d502f4e0290e98dac5436e98b Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-VolumesActionsTest-236397856-project Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 5a61b74f-b94c-40b5-8d8b-351168b0c00d could not be found. Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '5a61b74f-b94c-40b5-8d8b-351168b0c00d'} Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a61b74f-b94c-40b5-8d8b-351168b0c00d could not be found. Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a61b74f-b94c-40b5-8d8b-351168b0c00d could not be found. Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:49.953713 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.958302 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:49.958302 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:49.958302 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:49.958302 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:49.958302 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:49.958302 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a61b74f-b94c-40b5-8d8b-351168b0c00d could not be found. Oct 04 18:30:49.958302 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.968855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] Returning 404 to user: Instance 5a61b74f-b94c-40b5-8d8b-351168b0c00d could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:49.969933 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-214b8ec4-098f-41fb-af08-96f2cdb7e1ce tempest-VolumesActionsTest-236397856 tempest-VolumesActionsTest-236397856-project] 10.222.0.18 "GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d" status: 404 len: 111 microversion: 2.1 time: 0.119225 Oct 04 18:30:49.970846 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2915/5820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/5a61b74f-b94c-40b5-8d8b-351168b0c00d => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:50.165058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.179148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.182080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.183697 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d6d8433f-d0ce-4fd2-a7b6-d0209d5b9672 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.678499 Oct 04 18:30:50.184901 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2906/5821] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:50.872297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2fa71fdb-d139-4536-9f99-b5cfe6a4beb2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:50.873140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2fa71fdb-d139-4536-9f99-b5cfe6a4beb2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:50.896369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fa71fdb-d139-4536-9f99-b5cfe6a4beb2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.896887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fa71fdb-d139-4536-9f99-b5cfe6a4beb2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.897338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fa71fdb-d139-4536-9f99-b5cfe6a4beb2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.898088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fa71fdb-d139-4536-9f99-b5cfe6a4beb2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.898608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fa71fdb-d139-4536-9f99-b5cfe6a4beb2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.904587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fa71fdb-d139-4536-9f99-b5cfe6a4beb2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.211253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.211879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.228639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:51.238131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.244847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.246439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.247457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.248289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.250063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.613767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2fa71fdb-d139-4536-9f99-b5cfe6a4beb2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.630260 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2fa71fdb-d139-4536-9f99-b5cfe6a4beb2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1315 microversion: 2.1 time: 0.759086 Oct 04 18:30:51.633719 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2916/5822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:50 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:51.928186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.969126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.995498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:52.006273 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2f777090-6781-40f5-b1e9-7253702a65c4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.795641 Oct 04 18:30:52.014644 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2907/5823] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:51 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:52.663291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f740b28a-dcd7-4086-97ab-6fe140910465 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.663945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f740b28a-dcd7-4086-97ab-6fe140910465 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:52.700453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f740b28a-dcd7-4086-97ab-6fe140910465 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.701257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f740b28a-dcd7-4086-97ab-6fe140910465 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.704351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f740b28a-dcd7-4086-97ab-6fe140910465 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.705278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f740b28a-dcd7-4086-97ab-6fe140910465 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.705763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f740b28a-dcd7-4086-97ab-6fe140910465 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.706194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f740b28a-dcd7-4086-97ab-6fe140910465 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.046795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:53.055839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.088568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:53.104271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.105737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.108890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.115892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.122780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.123503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.358091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f740b28a-dcd7-4086-97ab-6fe140910465 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.391017 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f740b28a-dcd7-4086-97ab-6fe140910465 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1315 microversion: 2.1 time: 0.731469 Oct 04 18:30:53.392275 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2917/5824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:53.716851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.730117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.737333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.740917 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d67324c3-680b-4785-867a-cf3e93ed5a43 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.697462 Oct 04 18:30:53.751523 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2908/5825] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:54.413826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cef9ab82-7397-42b1-89e2-ea4af72db38b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.416786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cef9ab82-7397-42b1-89e2-ea4af72db38b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.429430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef9ab82-7397-42b1-89e2-ea4af72db38b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.436371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef9ab82-7397-42b1-89e2-ea4af72db38b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.437195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef9ab82-7397-42b1-89e2-ea4af72db38b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.438460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef9ab82-7397-42b1-89e2-ea4af72db38b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.439952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef9ab82-7397-42b1-89e2-ea4af72db38b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.441099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cef9ab82-7397-42b1-89e2-ea4af72db38b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.742659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cef9ab82-7397-42b1-89e2-ea4af72db38b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.752642 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cef9ab82-7397-42b1-89e2-ea4af72db38b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1315 microversion: 2.1 time: 0.342718 Oct 04 18:30:54.780560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.782024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.786563 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2918/5826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:54.799833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.800798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.801517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.802493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.803185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.803840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.088017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.114159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.120752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.122583 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c7a505a3-b369-49c1-9a4d-ccee45ecc5b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.352472 Oct 04 18:30:55.123842 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2909/5827] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:55.784906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8421021e-5687-45e7-a06c-1075f8f6f092 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.786256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8421021e-5687-45e7-a06c-1075f8f6f092 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.799892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8421021e-5687-45e7-a06c-1075f8f6f092 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.805452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8421021e-5687-45e7-a06c-1075f8f6f092 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.806103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8421021e-5687-45e7-a06c-1075f8f6f092 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.807057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8421021e-5687-45e7-a06c-1075f8f6f092 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.810913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8421021e-5687-45e7-a06c-1075f8f6f092 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.812328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8421021e-5687-45e7-a06c-1075f8f6f092 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.152031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:56.153675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.166318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.167452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.168129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.169326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.170216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.170880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.316807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8421021e-5687-45e7-a06c-1075f8f6f092 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:56.332927 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8421021e-5687-45e7-a06c-1075f8f6f092 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1315 microversion: 2.1 time: 0.548671 Oct 04 18:30:56.336438 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2919/5828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:56.585494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:56.597428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:56.599849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:56.601280 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c46f2061-46fb-41a7-8c75-54d6e9e40210 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.454984 Oct 04 18:30:56.602383 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2910/5829] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:56 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:57.334273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-08829b25-4f03-4f0b-a60a-43c828e4b164 req-5d039d19-1b5b-4956-be83-ec42666b2568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71491fc8-2852-4791-b61a-ab099f09a37e", "name": "network-vif-plugged", "status": "completed", "tag": "5be61e5e-946e-439c-b904-7bc08044ea77"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:57.365856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fb4c9d43-a0b3-4ef3-b166-e83553d6fb3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:57.366592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fb4c9d43-a0b3-4ef3-b166-e83553d6fb3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:57.396861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-08829b25-4f03-4f0b-a60a-43c828e4b164 req-5d039d19-1b5b-4956-be83-ec42666b2568 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.402846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-08829b25-4f03-4f0b-a60a-43c828e4b164 req-5d039d19-1b5b-4956-be83-ec42666b2568 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.403463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb4c9d43-a0b3-4ef3-b166-e83553d6fb3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.404607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-08829b25-4f03-4f0b-a60a-43c828e4b164 req-5d039d19-1b5b-4956-be83-ec42666b2568 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.407257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb4c9d43-a0b3-4ef3-b166-e83553d6fb3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.411563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb4c9d43-a0b3-4ef3-b166-e83553d6fb3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.413881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb4c9d43-a0b3-4ef3-b166-e83553d6fb3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.414915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb4c9d43-a0b3-4ef3-b166-e83553d6fb3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.427935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fb4c9d43-a0b3-4ef3-b166-e83553d6fb3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.466324 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-08829b25-4f03-4f0b-a60a-43c828e4b164 req-5d039d19-1b5b-4956-be83-ec42666b2568 service nova] Creating event network-vif-plugged:5be61e5e-946e-439c-b904-7bc08044ea77 for instance 71491fc8-2852-4791-b61a-ab099f09a37e on n-h1-850499-14 Oct 04 18:30:57.486053 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-08829b25-4f03-4f0b-a60a-43c828e4b164 req-5d039d19-1b5b-4956-be83-ec42666b2568 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155186 Oct 04 18:30:57.488773 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2920/5830] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:57.633558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:57.634724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:57.670370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.671327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.672336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.686555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.693636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.694396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.781502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:58.016059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fb4c9d43-a0b3-4ef3-b166-e83553d6fb3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:58.056316 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fb4c9d43-a0b3-4ef3-b166-e83553d6fb3b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1315 microversion: 2.1 time: 0.698078 Oct 04 18:30:58.057500 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2911/5831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:57 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:58.443540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:58.454899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:58.464325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:58.471211 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-88a2a0fd-ca4b-479f-9dc1-798de4f8b4af tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.842338 Oct 04 18:30:58.475033 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2921/5832] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:57 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:59.087789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f25ecddd-3ea6-48d9-9802-8dbdd136b5ad tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:59.088791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f25ecddd-3ea6-48d9-9802-8dbdd136b5ad tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.119223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f25ecddd-3ea6-48d9-9802-8dbdd136b5ad tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.129285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f25ecddd-3ea6-48d9-9802-8dbdd136b5ad tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.147957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f25ecddd-3ea6-48d9-9802-8dbdd136b5ad tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.148928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f25ecddd-3ea6-48d9-9802-8dbdd136b5ad tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.150897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f25ecddd-3ea6-48d9-9802-8dbdd136b5ad tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.152652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f25ecddd-3ea6-48d9-9802-8dbdd136b5ad tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.505238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:59.505962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.521377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.521882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.522324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.523102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.533810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.534544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.569833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f25ecddd-3ea6-48d9-9802-8dbdd136b5ad tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:59.579527 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f25ecddd-3ea6-48d9-9802-8dbdd136b5ad tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1315 microversion: 2.1 time: 0.497490 Oct 04 18:30:59.583314 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2912/5833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:59 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:00.259095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:00.274330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:00.276176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:00.280394 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17cce8d0-6491-4d65-93f8-9513fc87b578 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.779943 Oct 04 18:31:00.306001 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2922/5834] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:59 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:00.610206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8890581b-1865-4074-91ed-d07817e39a78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:00.611942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8890581b-1865-4074-91ed-d07817e39a78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:00.629157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8890581b-1865-4074-91ed-d07817e39a78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.629817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8890581b-1865-4074-91ed-d07817e39a78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.631827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8890581b-1865-4074-91ed-d07817e39a78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.632826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8890581b-1865-4074-91ed-d07817e39a78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.635536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8890581b-1865-4074-91ed-d07817e39a78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.636861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8890581b-1865-4074-91ed-d07817e39a78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.025113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8890581b-1865-4074-91ed-d07817e39a78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:01.040787 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8890581b-1865-4074-91ed-d07817e39a78 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1501 microversion: 2.1 time: 0.435484 Oct 04 18:31:01.041394 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2913/5835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:00 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1501 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:01.066744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-487a0d1c-5b0e-4968-bf7e-8a16c02b1953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:01.068714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-487a0d1c-5b0e-4968-bf7e-8a16c02b1953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:01.087566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-487a0d1c-5b0e-4968-bf7e-8a16c02b1953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.089658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-487a0d1c-5b0e-4968-bf7e-8a16c02b1953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.091015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-487a0d1c-5b0e-4968-bf7e-8a16c02b1953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.093718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-487a0d1c-5b0e-4968-bf7e-8a16c02b1953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.095995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-487a0d1c-5b0e-4968-bf7e-8a16c02b1953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.098449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-487a0d1c-5b0e-4968-bf7e-8a16c02b1953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.323907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:01.324604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:01.339361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.340054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.340518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.341264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.341732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.342173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.797584 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.network.security_group_api [None req-487a0d1c-5b0e-4968-bf7e-8a16c02b1953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Removing security group 755f8b91-899d-40f3-b5e0-c0be7f4f69b3 from port 5be61e5e-946e-439c-b904-7bc08044ea77 Oct 04 18:31:02.306099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:02.347806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:02.354679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:02.359598 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6b90fee2-c0f3-48d0-9ecf-bb7683cee56c tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 1.039568 Oct 04 18:31:02.361955 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2914/5836] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:01 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:02.796526 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:31:02.801272 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 18:31:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e/action (ip 10.222.0.18) !!! Oct 04 18:31:02.866850 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-487a0d1c-5b0e-4968-bf7e-8a16c02b1953 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e/action" status: 202 len: 0 microversion: 2.1 time: 1.806488 Oct 04 18:31:02.867524 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2923/5837] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:01 2022] POST /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e/action => generated 0 bytes in 1808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:02.875983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-54b3cbf8-5924-4319-97aa-a14d92062b76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:02.876966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-54b3cbf8-5924-4319-97aa-a14d92062b76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:02.902173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b3cbf8-5924-4319-97aa-a14d92062b76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.906656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b3cbf8-5924-4319-97aa-a14d92062b76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.923741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b3cbf8-5924-4319-97aa-a14d92062b76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.923741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b3cbf8-5924-4319-97aa-a14d92062b76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.923741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b3cbf8-5924-4319-97aa-a14d92062b76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.923741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-54b3cbf8-5924-4319-97aa-a14d92062b76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.924131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8d7cd955-0b87-4261-8a46-599911878635 req-07890577-1f95-454b-a2f0-3d1fa7b8177b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71491fc8-2852-4791-b61a-ab099f09a37e", "tag": "5be61e5e-946e-439c-b904-7bc08044ea77"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:02.949786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8d7cd955-0b87-4261-8a46-599911878635 req-07890577-1f95-454b-a2f0-3d1fa7b8177b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.950283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8d7cd955-0b87-4261-8a46-599911878635 req-07890577-1f95-454b-a2f0-3d1fa7b8177b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.950726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8d7cd955-0b87-4261-8a46-599911878635 req-07890577-1f95-454b-a2f0-3d1fa7b8177b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.990493 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8d7cd955-0b87-4261-8a46-599911878635 req-07890577-1f95-454b-a2f0-3d1fa7b8177b service nova] Creating event network-changed:5be61e5e-946e-439c-b904-7bc08044ea77 for instance 71491fc8-2852-4791-b61a-ab099f09a37e on n-h1-850499-14 Oct 04 18:31:03.014863 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8d7cd955-0b87-4261-8a46-599911878635 req-07890577-1f95-454b-a2f0-3d1fa7b8177b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101535 Oct 04 18:31:03.023258 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2924/5838] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:03.224939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-54b3cbf8-5924-4319-97aa-a14d92062b76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:03.227700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:03.241763 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-54b3cbf8-5924-4319-97aa-a14d92062b76 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1459 microversion: 2.1 time: 0.369862 Oct 04 18:31:03.247283 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2915/5839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:02 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1459 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:03.276460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4e208d85-2646-4b57-83e5-e9d1d7454607 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:03.277509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4e208d85-2646-4b57-83e5-e9d1d7454607 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:03.303548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e208d85-2646-4b57-83e5-e9d1d7454607 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:03.307303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e208d85-2646-4b57-83e5-e9d1d7454607 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:03.311002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e208d85-2646-4b57-83e5-e9d1d7454607 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:03.312007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e208d85-2646-4b57-83e5-e9d1d7454607 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:03.314583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e208d85-2646-4b57-83e5-e9d1d7454607 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:03.315227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e208d85-2646-4b57-83e5-e9d1d7454607 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:03.409572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:03.411070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:03.433816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:03.441957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:03.446575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:03.447848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:03.448717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:03.449397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.085311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4e208d85-2646-4b57-83e5-e9d1d7454607 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:04.106596 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4e208d85-2646-4b57-83e5-e9d1d7454607 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.837311 Oct 04 18:31:04.127666 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2925/5840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:03 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:04.144035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d389a047-8630-43e8-8f4c-aafc7c430a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:04.144662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d389a047-8630-43e8-8f4c-aafc7c430a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:04.151165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d389a047-8630-43e8-8f4c-aafc7c430a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.151894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d389a047-8630-43e8-8f4c-aafc7c430a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.152495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d389a047-8630-43e8-8f4c-aafc7c430a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.153578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d389a047-8630-43e8-8f4c-aafc7c430a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.154231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d389a047-8630-43e8-8f4c-aafc7c430a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.155021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d389a047-8630-43e8-8f4c-aafc7c430a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.614043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:04.630732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:04.633372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:04.638425 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f391754e-a816-414c-acdf-b96dd521cea7 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 1.234959 Oct 04 18:31:04.640639 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2916/5841] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:03 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:04.918606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d389a047-8630-43e8-8f4c-aafc7c430a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:04.927933 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d389a047-8630-43e8-8f4c-aafc7c430a9c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.788201 Oct 04 18:31:04.928545 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2926/5842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:04 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:04.952538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8883e01f-ecda-493a-adb8-72b0e6ce85ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:04.953268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8883e01f-ecda-493a-adb8-72b0e6ce85ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:04.966612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8883e01f-ecda-493a-adb8-72b0e6ce85ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.967509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8883e01f-ecda-493a-adb8-72b0e6ce85ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.967976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8883e01f-ecda-493a-adb8-72b0e6ce85ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.974012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8883e01f-ecda-493a-adb8-72b0e6ce85ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.974625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8883e01f-ecda-493a-adb8-72b0e6ce85ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.975169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8883e01f-ecda-493a-adb8-72b0e6ce85ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.304276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8883e01f-ecda-493a-adb8-72b0e6ce85ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:05.324275 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8883e01f-ecda-493a-adb8-72b0e6ce85ee tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.374891 Oct 04 18:31:05.327629 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2917/5843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:04 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:05.357189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1aab5ec7-9fb4-452b-ad52-0f80a741a918 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:05.358101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1aab5ec7-9fb4-452b-ad52-0f80a741a918 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:05.370308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1aab5ec7-9fb4-452b-ad52-0f80a741a918 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.371437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1aab5ec7-9fb4-452b-ad52-0f80a741a918 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.371911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1aab5ec7-9fb4-452b-ad52-0f80a741a918 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.372674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1aab5ec7-9fb4-452b-ad52-0f80a741a918 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.373152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1aab5ec7-9fb4-452b-ad52-0f80a741a918 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.373594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1aab5ec7-9fb4-452b-ad52-0f80a741a918 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.652232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1aab5ec7-9fb4-452b-ad52-0f80a741a918 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:05.665612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:05.666840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:05.674228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.675086 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1aab5ec7-9fb4-452b-ad52-0f80a741a918 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.307929 Oct 04 18:31:05.676220 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2927/5844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:05 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:05.676950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.677645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.678539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.679269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.679844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.903524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-403364485", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "68212092-c97c-4a48-819f-9516513174c4"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:05.990499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:05.998729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] validate_networks() for [('68212092-c97c-4a48-819f-9516513174c4', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:06.000476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.014477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.019398 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-92d80728-1f7c-4246-b015-20a4baee66b5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.357573 Oct 04 18:31:06.020263 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2918/5845] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:05 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:06.672569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:06.673200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:06.673746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:06.674603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:06.675267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:06.687295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.688317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.688998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.690492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.691207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.691931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.717541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for project e2ee0993b0954950949c8afffb90617c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:06.725453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Getting quotas for user 6591acf0ba4648abac6cc8ac8ddd560e and project e2ee0993b0954950949c8afffb90617c. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:06.739414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:06.742118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:06.856436 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f181963d-2021-408e-bd0c-4013bee41e28 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956759 Oct 04 18:31:06.870336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fca77aa2-c5dd-423e-96df-21d2948a2ebc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:06.871577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fca77aa2-c5dd-423e-96df-21d2948a2ebc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:06.877431 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2928/5846] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:07.049967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fca77aa2-c5dd-423e-96df-21d2948a2ebc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:07.057076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:07.057739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:07.075697 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fca77aa2-c5dd-423e-96df-21d2948a2ebc tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1214 microversion: 2.1 time: 0.205199 Oct 04 18:31:07.075989 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2919/5847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:06 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1214 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:07.087379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.087899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.088358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.094117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.094616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.095099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.865322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:07.879354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:07.881626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:07.885401 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5b907186-d872-4557-8c64-4f169406e3ac tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.839207 Oct 04 18:31:07.899153 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2929/5848] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:07 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:31:08.098935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f2e160c0-81ad-4aa9-8766-93b007b16650 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.099671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f2e160c0-81ad-4aa9-8766-93b007b16650 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.111475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e160c0-81ad-4aa9-8766-93b007b16650 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.112071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e160c0-81ad-4aa9-8766-93b007b16650 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.112532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e160c0-81ad-4aa9-8766-93b007b16650 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.123120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e160c0-81ad-4aa9-8766-93b007b16650 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.123777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e160c0-81ad-4aa9-8766-93b007b16650 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.124243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2e160c0-81ad-4aa9-8766-93b007b16650 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.262594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f2e160c0-81ad-4aa9-8766-93b007b16650 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.272633 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f2e160c0-81ad-4aa9-8766-93b007b16650 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1266 microversion: 2.1 time: 0.177682 Oct 04 18:31:08.273277 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2920/5849] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.914289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.916000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.930649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.931307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.931764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.932495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.932967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.933411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.301375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-102e301b-524d-4a9a-a0cf-3bc009402f8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:09.302016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-102e301b-524d-4a9a-a0cf-3bc009402f8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.323240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-102e301b-524d-4a9a-a0cf-3bc009402f8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.323869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-102e301b-524d-4a9a-a0cf-3bc009402f8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.324324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-102e301b-524d-4a9a-a0cf-3bc009402f8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.325094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-102e301b-524d-4a9a-a0cf-3bc009402f8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.325571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-102e301b-524d-4a9a-a0cf-3bc009402f8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.342714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-102e301b-524d-4a9a-a0cf-3bc009402f8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.600184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-102e301b-524d-4a9a-a0cf-3bc009402f8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.610641 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-102e301b-524d-4a9a-a0cf-3bc009402f8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1272 microversion: 2.1 time: 0.317299 Oct 04 18:31:09.616466 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2921/5850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:09 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:09.886177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.896726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.898319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.906533 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e291de0e-586a-418a-897c-fe88b4dadd8d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.993929 Oct 04 18:31:09.907240 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2930/5851] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:10.641985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-979b8112-7c25-4389-909a-d529d74c23bf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:10.641985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-979b8112-7c25-4389-909a-d529d74c23bf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:10.650857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8112-7c25-4389-909a-d529d74c23bf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.651412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8112-7c25-4389-909a-d529d74c23bf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.651874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8112-7c25-4389-909a-d529d74c23bf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.652671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8112-7c25-4389-909a-d529d74c23bf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.653109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8112-7c25-4389-909a-d529d74c23bf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.653643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-979b8112-7c25-4389-909a-d529d74c23bf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.952989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:10.954461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:10.968416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.968996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.969452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.970834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.972194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.972822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.340053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-979b8112-7c25-4389-909a-d529d74c23bf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:11.364547 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-979b8112-7c25-4389-909a-d529d74c23bf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1314 microversion: 2.1 time: 0.723063 Oct 04 18:31:11.367117 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2922/5852] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:10 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:12.209562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.218747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.232492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.233746 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-93700026-8eba-43b1-bf09-6c80f3fbe600 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 1.302583 Oct 04 18:31:12.256138 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2931/5853] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:10 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:12.390983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8e07a75c-e916-43f3-8441-dff6ac813258 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.392284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8e07a75c-e916-43f3-8441-dff6ac813258 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.411874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e07a75c-e916-43f3-8441-dff6ac813258 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.413333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e07a75c-e916-43f3-8441-dff6ac813258 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.413944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e07a75c-e916-43f3-8441-dff6ac813258 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.415222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e07a75c-e916-43f3-8441-dff6ac813258 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.415334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e07a75c-e916-43f3-8441-dff6ac813258 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.415763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e07a75c-e916-43f3-8441-dff6ac813258 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.616440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-1f663221-fd99-4170-a937-0561b48089ac req-b46fddfd-78f3-49b2-8e23-60a44c4279c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be1b109-2224-492a-8031-f678a2916ad3", "tag": "4b90923e-e5bc-4b99-b66d-0f5d4a5e2373"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:12.647802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1f663221-fd99-4170-a937-0561b48089ac req-b46fddfd-78f3-49b2-8e23-60a44c4279c2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.648538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1f663221-fd99-4170-a937-0561b48089ac req-b46fddfd-78f3-49b2-8e23-60a44c4279c2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.649144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1f663221-fd99-4170-a937-0561b48089ac req-b46fddfd-78f3-49b2-8e23-60a44c4279c2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.683969 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1f663221-fd99-4170-a937-0561b48089ac req-b46fddfd-78f3-49b2-8e23-60a44c4279c2 service nova] Creating event network-changed:4b90923e-e5bc-4b99-b66d-0f5d4a5e2373 for instance 2be1b109-2224-492a-8031-f678a2916ad3 on n-h2-850499-14 Oct 04 18:31:12.690060 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-1f663221-fd99-4170-a937-0561b48089ac req-b46fddfd-78f3-49b2-8e23-60a44c4279c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079778 Oct 04 18:31:12.691189 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2932/5854] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:12.785495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8e07a75c-e916-43f3-8441-dff6ac813258 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.799942 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8e07a75c-e916-43f3-8441-dff6ac813258 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1314 microversion: 2.1 time: 0.407072 Oct 04 18:31:12.800785 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2923/5855] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:13.265330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.266348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:13.296258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.296769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.297235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.298015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.299151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.299694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.628827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:13.644075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:13.647063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:13.655572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-3479ada7-ca29-49ed-8c51-735f897cde48 req-9c74116c-5782-4c93-a879-cc4fad90ff8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9afae5-6ef4-4bd5-92f8-1d0ed466b280", "name": "network-vif-plugged", "status": "completed", "tag": "2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:13.661855 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e7e0569c-abb5-48c7-ba85-f4fde6b6a5c5 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.388663 Oct 04 18:31:13.666688 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2933/5856] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:13.674433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3479ada7-ca29-49ed-8c51-735f897cde48 req-9c74116c-5782-4c93-a879-cc4fad90ff8b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.675832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3479ada7-ca29-49ed-8c51-735f897cde48 req-9c74116c-5782-4c93-a879-cc4fad90ff8b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.676935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3479ada7-ca29-49ed-8c51-735f897cde48 req-9c74116c-5782-4c93-a879-cc4fad90ff8b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.692842 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-3479ada7-ca29-49ed-8c51-735f897cde48 req-9c74116c-5782-4c93-a879-cc4fad90ff8b service nova] Creating event network-vif-plugged:2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e for instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 on n-h1-850499-14 Oct 04 18:31:13.699501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-3479ada7-ca29-49ed-8c51-735f897cde48 req-9c74116c-5782-4c93-a879-cc4fad90ff8b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048933 Oct 04 18:31:13.700600 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2924/5857] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:13.823677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3e551157-72ba-47ce-b14f-195528cee0a3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.824488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3e551157-72ba-47ce-b14f-195528cee0a3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:13.839303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e551157-72ba-47ce-b14f-195528cee0a3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.847587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e551157-72ba-47ce-b14f-195528cee0a3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.848182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e551157-72ba-47ce-b14f-195528cee0a3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.849471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e551157-72ba-47ce-b14f-195528cee0a3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.850969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e551157-72ba-47ce-b14f-195528cee0a3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.851720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3e551157-72ba-47ce-b14f-195528cee0a3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.207703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3e551157-72ba-47ce-b14f-195528cee0a3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:14.231850 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3e551157-72ba-47ce-b14f-195528cee0a3 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1314 microversion: 2.1 time: 0.411715 Oct 04 18:31:14.232688 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2934/5858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:14.697940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.698673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:14.710339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.713088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.713567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.714325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.714783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.716834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.079515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:15.090042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:15.094788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:15.099378 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-44fff63d-d16d-4284-9c58-82f2a91ea42e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 0.409316 Oct 04 18:31:15.122972 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2925/5859] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:15.259151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99091f3a-8965-4c9a-ba22-e4002b022ae5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:15.260373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99091f3a-8965-4c9a-ba22-e4002b022ae5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:15.267560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99091f3a-8965-4c9a-ba22-e4002b022ae5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.268284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99091f3a-8965-4c9a-ba22-e4002b022ae5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.268905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99091f3a-8965-4c9a-ba22-e4002b022ae5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.269977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99091f3a-8965-4c9a-ba22-e4002b022ae5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.270574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99091f3a-8965-4c9a-ba22-e4002b022ae5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.271180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99091f3a-8965-4c9a-ba22-e4002b022ae5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.825942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-99091f3a-8965-4c9a-ba22-e4002b022ae5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:15.839594 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99091f3a-8965-4c9a-ba22-e4002b022ae5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1314 microversion: 2.1 time: 0.584341 Oct 04 18:31:15.840203 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2935/5860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:15 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:16.129211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:16.129844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:16.149764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.155387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.156082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.157017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.159797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.160428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.867421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f8e38488-5167-44d4-a9e3-a8fd6a966901 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:16.868743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f8e38488-5167-44d4-a9e3-a8fd6a966901 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:16.882128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:16.883741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:16.898508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8e38488-5167-44d4-a9e3-a8fd6a966901 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.903733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8e38488-5167-44d4-a9e3-a8fd6a966901 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.904373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8e38488-5167-44d4-a9e3-a8fd6a966901 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.907130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8e38488-5167-44d4-a9e3-a8fd6a966901 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.913936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8e38488-5167-44d4-a9e3-a8fd6a966901 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.917022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8e38488-5167-44d4-a9e3-a8fd6a966901 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.061104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:17.368666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.386363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.391142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.394823 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-20a0c038-0421-4967-9a55-356fb6c52f3e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1731 microversion: 2.20 time: 1.267635 Oct 04 18:31:17.411356 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2926/5861] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:16 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1731 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:17.708641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f8e38488-5167-44d4-a9e3-a8fd6a966901 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.737883 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f8e38488-5167-44d4-a9e3-a8fd6a966901 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1314 microversion: 2.1 time: 0.871662 Oct 04 18:31:17.738533 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2936/5862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:16 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:18.427023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:18.427975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:18.456062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.456786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.457379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.458259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.459148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.459753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.764371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d655a72-061a-4374-ab98-fb9e8c5e80b5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:18.764996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0d655a72-061a-4374-ab98-fb9e8c5e80b5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:18.782618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d655a72-061a-4374-ab98-fb9e8c5e80b5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.783243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d655a72-061a-4374-ab98-fb9e8c5e80b5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.783906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d655a72-061a-4374-ab98-fb9e8c5e80b5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.784820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d655a72-061a-4374-ab98-fb9e8c5e80b5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.785477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d655a72-061a-4374-ab98-fb9e8c5e80b5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.785986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d655a72-061a-4374-ab98-fb9e8c5e80b5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.852274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:18.876945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:18.880590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:18.881845 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a6ecd412-9115-4872-b23c-7553888974ed tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1718 microversion: 2.20 time: 0.459965 Oct 04 18:31:18.886845 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2927/5863] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:18 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1718 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:19.358312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0d655a72-061a-4374-ab98-fb9e8c5e80b5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.366897 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0d655a72-061a-4374-ab98-fb9e8c5e80b5 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1314 microversion: 2.1 time: 0.606269 Oct 04 18:31:19.375617 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2937/5864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:18 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:20.411341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-624dbc24-73c2-4104-b82b-8d6db9ad18c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.413251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-624dbc24-73c2-4104-b82b-8d6db9ad18c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:20.427258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624dbc24-73c2-4104-b82b-8d6db9ad18c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.428063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624dbc24-73c2-4104-b82b-8d6db9ad18c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.428688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624dbc24-73c2-4104-b82b-8d6db9ad18c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.429571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624dbc24-73c2-4104-b82b-8d6db9ad18c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.430191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624dbc24-73c2-4104-b82b-8d6db9ad18c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.430780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624dbc24-73c2-4104-b82b-8d6db9ad18c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.797913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-624dbc24-73c2-4104-b82b-8d6db9ad18c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:20.806924 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-624dbc24-73c2-4104-b82b-8d6db9ad18c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1314 microversion: 2.1 time: 0.404890 Oct 04 18:31:20.820274 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2928/5865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:20.967293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-de1c6f71-1e77-4d44-a480-13b4cc7fa6a9 req-89e3c02e-72f9-4bc4-b8d0-411be17171fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be1b109-2224-492a-8031-f678a2916ad3", "name": "network-vif-plugged", "status": "completed", "tag": "4b90923e-e5bc-4b99-b66d-0f5d4a5e2373"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:20.979407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:20.995517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-de1c6f71-1e77-4d44-a480-13b4cc7fa6a9 req-89e3c02e-72f9-4bc4-b8d0-411be17171fc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.996014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-de1c6f71-1e77-4d44-a480-13b4cc7fa6a9 req-89e3c02e-72f9-4bc4-b8d0-411be17171fc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.996453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-de1c6f71-1e77-4d44-a480-13b4cc7fa6a9 req-89e3c02e-72f9-4bc4-b8d0-411be17171fc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:21.019936 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-de1c6f71-1e77-4d44-a480-13b4cc7fa6a9 req-89e3c02e-72f9-4bc4-b8d0-411be17171fc service nova] Creating event network-vif-plugged:4b90923e-e5bc-4b99-b66d-0f5d4a5e2373 for instance 2be1b109-2224-492a-8031-f678a2916ad3 on n-h2-850499-14 Oct 04 18:31:21.025374 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-de1c6f71-1e77-4d44-a480-13b4cc7fa6a9 req-89e3c02e-72f9-4bc4-b8d0-411be17171fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063206 Oct 04 18:31:21.026208 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2938/5866] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:21.842336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5c62da2c-735c-4f12-a55d-42e3899e9047 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:21.842977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5c62da2c-735c-4f12-a55d-42e3899e9047 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:21.856366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c62da2c-735c-4f12-a55d-42e3899e9047 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:21.857562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c62da2c-735c-4f12-a55d-42e3899e9047 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:21.858998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c62da2c-735c-4f12-a55d-42e3899e9047 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:21.861688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c62da2c-735c-4f12-a55d-42e3899e9047 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:21.862182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c62da2c-735c-4f12-a55d-42e3899e9047 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:21.862630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c62da2c-735c-4f12-a55d-42e3899e9047 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.285150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5c62da2c-735c-4f12-a55d-42e3899e9047 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:22.294634 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5c62da2c-735c-4f12-a55d-42e3899e9047 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1314 microversion: 2.1 time: 0.456758 Oct 04 18:31:22.296011 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2929/5867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:21 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:23.323238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-95dcdee1-8a18-432b-94f1-6c7adee01b1c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:23.324070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-95dcdee1-8a18-432b-94f1-6c7adee01b1c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:23.336656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dcdee1-8a18-432b-94f1-6c7adee01b1c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.339084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dcdee1-8a18-432b-94f1-6c7adee01b1c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.339719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dcdee1-8a18-432b-94f1-6c7adee01b1c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.340618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dcdee1-8a18-432b-94f1-6c7adee01b1c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.341239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dcdee1-8a18-432b-94f1-6c7adee01b1c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.341856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dcdee1-8a18-432b-94f1-6c7adee01b1c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.546652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-95dcdee1-8a18-432b-94f1-6c7adee01b1c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:23.559798 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-95dcdee1-8a18-432b-94f1-6c7adee01b1c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1501 microversion: 2.1 time: 0.244783 Oct 04 18:31:23.561233 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2939/5868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:23 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1501 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:23.587534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9ae9d42-050c-4ebc-b620-00c55319388d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:23.588088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9ae9d42-050c-4ebc-b620-00c55319388d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:23.590830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=46 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:23.614797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ae9d42-050c-4ebc-b620-00c55319388d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.615542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ae9d42-050c-4ebc-b620-00c55319388d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.616076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ae9d42-050c-4ebc-b620-00c55319388d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.616907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ae9d42-050c-4ebc-b620-00c55319388d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.617387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ae9d42-050c-4ebc-b620-00c55319388d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.617826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ae9d42-050c-4ebc-b620-00c55319388d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.717966 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9ae9d42-050c-4ebc-b620-00c55319388d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3/action" status: 202 len: 0 microversion: 2.1 time: 0.134246 Oct 04 18:31:23.719324 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2930/5869] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:23 2022] POST /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:23.731962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-965af813-af6f-4dfc-acca-a55eed469070 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:23.733485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-965af813-af6f-4dfc-acca-a55eed469070 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:23.746607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-965af813-af6f-4dfc-acca-a55eed469070 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.747645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-965af813-af6f-4dfc-acca-a55eed469070 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.751150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-965af813-af6f-4dfc-acca-a55eed469070 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.752735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-965af813-af6f-4dfc-acca-a55eed469070 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.753937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-965af813-af6f-4dfc-acca-a55eed469070 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.754673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-965af813-af6f-4dfc-acca-a55eed469070 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.031109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-965af813-af6f-4dfc-acca-a55eed469070 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:24.037167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:24.062326 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-965af813-af6f-4dfc-acca-a55eed469070 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1506 microversion: 2.1 time: 0.337450 Oct 04 18:31:24.085678 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2940/5870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:23 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.098719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-12e7a6b6-3c55-405f-b03c-199d1dfe7d73 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.100594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-12e7a6b6-3c55-405f-b03c-199d1dfe7d73 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.124941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b6-3c55-405f-b03c-199d1dfe7d73 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.124941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b6-3c55-405f-b03c-199d1dfe7d73 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.124941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b6-3c55-405f-b03c-199d1dfe7d73 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.130335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b6-3c55-405f-b03c-199d1dfe7d73 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.132096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b6-3c55-405f-b03c-199d1dfe7d73 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.132721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b6-3c55-405f-b03c-199d1dfe7d73 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.755261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-12e7a6b6-3c55-405f-b03c-199d1dfe7d73 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:25.768563 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-12e7a6b6-3c55-405f-b03c-199d1dfe7d73 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1486 microversion: 2.1 time: 0.677768 Oct 04 18:31:25.769894 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2931/5871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1486 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.797238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c401ce01-1655-4d80-bdcd-ab76d7050c66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:25.799648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c401ce01-1655-4d80-bdcd-ab76d7050c66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.808890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c401ce01-1655-4d80-bdcd-ab76d7050c66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.810167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c401ce01-1655-4d80-bdcd-ab76d7050c66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.810797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c401ce01-1655-4d80-bdcd-ab76d7050c66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.811731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c401ce01-1655-4d80-bdcd-ab76d7050c66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.812542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c401ce01-1655-4d80-bdcd-ab76d7050c66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.813655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c401ce01-1655-4d80-bdcd-ab76d7050c66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.906629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-c401ce01-1655-4d80-bdcd-ab76d7050c66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lazy-loading 'flavor' on Instance uuid 2be1b109-2224-492a-8031-f678a2916ad3 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:26.248549 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c401ce01-1655-4d80-bdcd-ab76d7050c66 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3/action" status: 202 len: 0 microversion: 2.1 time: 0.456798 Oct 04 18:31:26.249367 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2941/5872] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:25 2022] POST /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:31:26.267981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de88e20b-f99a-46a1-ad02-ba4afdb29a88 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.268707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-de88e20b-f99a-46a1-ad02-ba4afdb29a88 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:26.299037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de88e20b-f99a-46a1-ad02-ba4afdb29a88 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.300714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de88e20b-f99a-46a1-ad02-ba4afdb29a88 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.301645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de88e20b-f99a-46a1-ad02-ba4afdb29a88 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.305658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de88e20b-f99a-46a1-ad02-ba4afdb29a88 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.306205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de88e20b-f99a-46a1-ad02-ba4afdb29a88 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.307988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de88e20b-f99a-46a1-ad02-ba4afdb29a88 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.655313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de88e20b-f99a-46a1-ad02-ba4afdb29a88 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.676738 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de88e20b-f99a-46a1-ad02-ba4afdb29a88 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1492 microversion: 2.1 time: 0.420642 Oct 04 18:31:26.677357 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2932/5873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1492 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:27.705380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b65a3e8d-9ae5-44cf-8372-c2e79e3331ac tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.706107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b65a3e8d-9ae5-44cf-8372-c2e79e3331ac tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:27.718007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b65a3e8d-9ae5-44cf-8372-c2e79e3331ac tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.718525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b65a3e8d-9ae5-44cf-8372-c2e79e3331ac tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.733800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b65a3e8d-9ae5-44cf-8372-c2e79e3331ac tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.739618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b65a3e8d-9ae5-44cf-8372-c2e79e3331ac tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.740273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b65a3e8d-9ae5-44cf-8372-c2e79e3331ac tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.740739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b65a3e8d-9ae5-44cf-8372-c2e79e3331ac tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.070708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b65a3e8d-9ae5-44cf-8372-c2e79e3331ac tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.079983 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b65a3e8d-9ae5-44cf-8372-c2e79e3331ac tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1492 microversion: 2.1 time: 0.380488 Oct 04 18:31:28.099663 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2942/5874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1492 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:29.106793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f64fecbc-6163-40b3-85ec-825a35c97a49 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.109304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f64fecbc-6163-40b3-85ec-825a35c97a49 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:29.117078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f64fecbc-6163-40b3-85ec-825a35c97a49 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.117875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f64fecbc-6163-40b3-85ec-825a35c97a49 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.118492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f64fecbc-6163-40b3-85ec-825a35c97a49 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.119418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f64fecbc-6163-40b3-85ec-825a35c97a49 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.120050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f64fecbc-6163-40b3-85ec-825a35c97a49 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.120651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f64fecbc-6163-40b3-85ec-825a35c97a49 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.124230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:29.379019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f64fecbc-6163-40b3-85ec-825a35c97a49 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:29.396134 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f64fecbc-6163-40b3-85ec-825a35c97a49 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1513 microversion: 2.1 time: 0.293110 Oct 04 18:31:29.410555 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2933/5875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1513 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.436830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ba0ebf4-7673-4cc2-838d-6326bd1fabf1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.436830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6ba0ebf4-7673-4cc2-838d-6326bd1fabf1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.457680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ba0ebf4-7673-4cc2-838d-6326bd1fabf1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.458250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ba0ebf4-7673-4cc2-838d-6326bd1fabf1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.458766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ba0ebf4-7673-4cc2-838d-6326bd1fabf1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.459558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ba0ebf4-7673-4cc2-838d-6326bd1fabf1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.460197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ba0ebf4-7673-4cc2-838d-6326bd1fabf1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.460780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ba0ebf4-7673-4cc2-838d-6326bd1fabf1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.627829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ba0ebf4-7673-4cc2-838d-6326bd1fabf1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.637916 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ba0ebf4-7673-4cc2-838d-6326bd1fabf1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1513 microversion: 2.1 time: 0.211628 Oct 04 18:31:30.651298 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2943/5876] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.882295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-73e0a23d-3d96-4391-839b-12f32650fca6 req-eb94f5cf-bb87-46a4-a1f6-275b3f7175a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be1b109-2224-492a-8031-f678a2916ad3", "name": "network-vif-plugged", "status": "completed", "tag": "4b90923e-e5bc-4b99-b66d-0f5d4a5e2373"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:30.897042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-73e0a23d-3d96-4391-839b-12f32650fca6 req-eb94f5cf-bb87-46a4-a1f6-275b3f7175a7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.897819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-73e0a23d-3d96-4391-839b-12f32650fca6 req-eb94f5cf-bb87-46a4-a1f6-275b3f7175a7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.898496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-73e0a23d-3d96-4391-839b-12f32650fca6 req-eb94f5cf-bb87-46a4-a1f6-275b3f7175a7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.912200 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-73e0a23d-3d96-4391-839b-12f32650fca6 req-eb94f5cf-bb87-46a4-a1f6-275b3f7175a7 service nova] Creating event network-vif-plugged:4b90923e-e5bc-4b99-b66d-0f5d4a5e2373 for instance 2be1b109-2224-492a-8031-f678a2916ad3 on n-h2-850499-14 Oct 04 18:31:30.917932 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-73e0a23d-3d96-4391-839b-12f32650fca6 req-eb94f5cf-bb87-46a4-a1f6-275b3f7175a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039944 Oct 04 18:31:30.919721 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2934/5877] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:31.667459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-91a4ea62-9e44-437e-9949-59ad514bbbbb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.668147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-91a4ea62-9e44-437e-9949-59ad514bbbbb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.679234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91a4ea62-9e44-437e-9949-59ad514bbbbb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.681541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91a4ea62-9e44-437e-9949-59ad514bbbbb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.683445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91a4ea62-9e44-437e-9949-59ad514bbbbb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.688000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91a4ea62-9e44-437e-9949-59ad514bbbbb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.691573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91a4ea62-9e44-437e-9949-59ad514bbbbb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.692348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91a4ea62-9e44-437e-9949-59ad514bbbbb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.952702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-91a4ea62-9e44-437e-9949-59ad514bbbbb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.969158 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-91a4ea62-9e44-437e-9949-59ad514bbbbb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1513 microversion: 2.1 time: 0.305760 Oct 04 18:31:31.970268 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2944/5878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.995613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d9e15a7-b538-48fd-a51e-bb784509041b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.996464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1d9e15a7-b538-48fd-a51e-bb784509041b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:33.010386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d9e15a7-b538-48fd-a51e-bb784509041b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.010902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d9e15a7-b538-48fd-a51e-bb784509041b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.011380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d9e15a7-b538-48fd-a51e-bb784509041b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.012123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d9e15a7-b538-48fd-a51e-bb784509041b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.012619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d9e15a7-b538-48fd-a51e-bb784509041b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.013061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d9e15a7-b538-48fd-a51e-bb784509041b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.390150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d9e15a7-b538-48fd-a51e-bb784509041b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.408006 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d9e15a7-b538-48fd-a51e-bb784509041b tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1513 microversion: 2.1 time: 0.418772 Oct 04 18:31:33.409631 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2935/5879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1513 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:34.433923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-69ee30b9-1046-4503-ac56-521e05e7efe2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:34.434890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-69ee30b9-1046-4503-ac56-521e05e7efe2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:34.457173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee30b9-1046-4503-ac56-521e05e7efe2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.457822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee30b9-1046-4503-ac56-521e05e7efe2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.458298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee30b9-1046-4503-ac56-521e05e7efe2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.464332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee30b9-1046-4503-ac56-521e05e7efe2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.464913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee30b9-1046-4503-ac56-521e05e7efe2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.468110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee30b9-1046-4503-ac56-521e05e7efe2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.228884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-69ee30b9-1046-4503-ac56-521e05e7efe2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.242728 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-69ee30b9-1046-4503-ac56-521e05e7efe2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.812598 Oct 04 18:31:35.246151 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2945/5880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:34 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:36.275993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9230222-16dc-4b7c-b733-0297f347fdf7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.278918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d9230222-16dc-4b7c-b733-0297f347fdf7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.294552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9230222-16dc-4b7c-b733-0297f347fdf7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.296846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9230222-16dc-4b7c-b733-0297f347fdf7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.301246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9230222-16dc-4b7c-b733-0297f347fdf7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.303918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9230222-16dc-4b7c-b733-0297f347fdf7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.305476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9230222-16dc-4b7c-b733-0297f347fdf7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.308317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9230222-16dc-4b7c-b733-0297f347fdf7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.811556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d9230222-16dc-4b7c-b733-0297f347fdf7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:36.830802 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d9230222-16dc-4b7c-b733-0297f347fdf7 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.564724 Oct 04 18:31:36.848142 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2936/5881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:37.870134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-633d92e1-12c0-4343-aa74-9913c5209f58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.870779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-633d92e1-12c0-4343-aa74-9913c5209f58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:37.887138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633d92e1-12c0-4343-aa74-9913c5209f58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.888008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633d92e1-12c0-4343-aa74-9913c5209f58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.888881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633d92e1-12c0-4343-aa74-9913c5209f58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.890181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633d92e1-12c0-4343-aa74-9913c5209f58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.890924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633d92e1-12c0-4343-aa74-9913c5209f58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.892117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-633d92e1-12c0-4343-aa74-9913c5209f58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.173148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-633d92e1-12c0-4343-aa74-9913c5209f58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.213294 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-633d92e1-12c0-4343-aa74-9913c5209f58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.348053 Oct 04 18:31:38.232500 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2946/5882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:39.241667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5a0805c3-7949-4d1b-bf33-34eb1da92f87 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:39.242507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5a0805c3-7949-4d1b-bf33-34eb1da92f87 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:39.268003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0805c3-7949-4d1b-bf33-34eb1da92f87 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.268596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0805c3-7949-4d1b-bf33-34eb1da92f87 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.269181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0805c3-7949-4d1b-bf33-34eb1da92f87 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.270030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0805c3-7949-4d1b-bf33-34eb1da92f87 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.270546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0805c3-7949-4d1b-bf33-34eb1da92f87 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.289269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5a0805c3-7949-4d1b-bf33-34eb1da92f87 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.640269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5a0805c3-7949-4d1b-bf33-34eb1da92f87 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.658099 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5a0805c3-7949-4d1b-bf33-34eb1da92f87 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.420343 Oct 04 18:31:39.680204 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2937/5883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:39 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.707663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0b837465-276f-4afe-a86c-3f40e35af53a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.708968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0b837465-276f-4afe-a86c-3f40e35af53a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:40.723710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b837465-276f-4afe-a86c-3f40e35af53a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.727691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b837465-276f-4afe-a86c-3f40e35af53a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.728362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b837465-276f-4afe-a86c-3f40e35af53a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.729282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b837465-276f-4afe-a86c-3f40e35af53a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.729918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b837465-276f-4afe-a86c-3f40e35af53a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.730504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0b837465-276f-4afe-a86c-3f40e35af53a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.100914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0b837465-276f-4afe-a86c-3f40e35af53a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.121768 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0b837465-276f-4afe-a86c-3f40e35af53a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.417981 Oct 04 18:31:41.124556 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2947/5884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:42.154681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0484e156-8b9c-4e61-a261-bb5e8c750c8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.158247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0484e156-8b9c-4e61-a261-bb5e8c750c8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:42.178945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0484e156-8b9c-4e61-a261-bb5e8c750c8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.181131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0484e156-8b9c-4e61-a261-bb5e8c750c8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.182300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0484e156-8b9c-4e61-a261-bb5e8c750c8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.197788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0484e156-8b9c-4e61-a261-bb5e8c750c8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.198696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0484e156-8b9c-4e61-a261-bb5e8c750c8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.202081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0484e156-8b9c-4e61-a261-bb5e8c750c8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.713923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0484e156-8b9c-4e61-a261-bb5e8c750c8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:42.730694 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0484e156-8b9c-4e61-a261-bb5e8c750c8e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.582967 Oct 04 18:31:42.731417 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2938/5885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:43.760220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-028f0553-4349-4e45-a459-d58cdbaa0e82 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.764350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-028f0553-4349-4e45-a459-d58cdbaa0e82 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:43.784010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028f0553-4349-4e45-a459-d58cdbaa0e82 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.787795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028f0553-4349-4e45-a459-d58cdbaa0e82 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.788426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028f0553-4349-4e45-a459-d58cdbaa0e82 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.789357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028f0553-4349-4e45-a459-d58cdbaa0e82 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.789986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028f0553-4349-4e45-a459-d58cdbaa0e82 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.800298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028f0553-4349-4e45-a459-d58cdbaa0e82 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.584309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-028f0553-4349-4e45-a459-d58cdbaa0e82 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:44.599096 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-028f0553-4349-4e45-a459-d58cdbaa0e82 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.842830 Oct 04 18:31:44.599736 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2948/5886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:43 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:45.628250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-24dea152-4dfe-484c-aac8-702d703d3b08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:45.628877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-24dea152-4dfe-484c-aac8-702d703d3b08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:45.645361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24dea152-4dfe-484c-aac8-702d703d3b08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.664182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24dea152-4dfe-484c-aac8-702d703d3b08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.665168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24dea152-4dfe-484c-aac8-702d703d3b08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.667707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24dea152-4dfe-484c-aac8-702d703d3b08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.675137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24dea152-4dfe-484c-aac8-702d703d3b08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.679875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24dea152-4dfe-484c-aac8-702d703d3b08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.071853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-24dea152-4dfe-484c-aac8-702d703d3b08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:46.082545 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-24dea152-4dfe-484c-aac8-702d703d3b08 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.458460 Oct 04 18:31:46.097536 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2939/5887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:45 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:47.132483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-de4d9ba8-afcc-4265-871d-53c5f33250cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.133118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-de4d9ba8-afcc-4265-871d-53c5f33250cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.147215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de4d9ba8-afcc-4265-871d-53c5f33250cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.151466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de4d9ba8-afcc-4265-871d-53c5f33250cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.151953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de4d9ba8-afcc-4265-871d-53c5f33250cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.152718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de4d9ba8-afcc-4265-871d-53c5f33250cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.153194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de4d9ba8-afcc-4265-871d-53c5f33250cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.153726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de4d9ba8-afcc-4265-871d-53c5f33250cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.560688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-de4d9ba8-afcc-4265-871d-53c5f33250cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:47.585073 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-de4d9ba8-afcc-4265-871d-53c5f33250cf tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.448735 Oct 04 18:31:47.585775 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2949/5888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:49.167758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3650b69c-da74-4bad-8019-60ee4aaaa741 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.168948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3650b69c-da74-4bad-8019-60ee4aaaa741 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:49.187556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3650b69c-da74-4bad-8019-60ee4aaaa741 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.195867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3650b69c-da74-4bad-8019-60ee4aaaa741 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.196803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3650b69c-da74-4bad-8019-60ee4aaaa741 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.197980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3650b69c-da74-4bad-8019-60ee4aaaa741 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.198771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3650b69c-da74-4bad-8019-60ee4aaaa741 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.199491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3650b69c-da74-4bad-8019-60ee4aaaa741 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.504315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3650b69c-da74-4bad-8019-60ee4aaaa741 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:49.519062 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3650b69c-da74-4bad-8019-60ee4aaaa741 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.904024 Oct 04 18:31:49.522552 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2940/5889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:48 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:50.556367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20865261-0fcd-418b-9f80-81b4a06fe2f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.557161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20865261-0fcd-418b-9f80-81b4a06fe2f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.577474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20865261-0fcd-418b-9f80-81b4a06fe2f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.595912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20865261-0fcd-418b-9f80-81b4a06fe2f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.600246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20865261-0fcd-418b-9f80-81b4a06fe2f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.603812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20865261-0fcd-418b-9f80-81b4a06fe2f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.607019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20865261-0fcd-418b-9f80-81b4a06fe2f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.611802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20865261-0fcd-418b-9f80-81b4a06fe2f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.003613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-20865261-0fcd-418b-9f80-81b4a06fe2f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:51.013421 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20865261-0fcd-418b-9f80-81b4a06fe2f1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.461445 Oct 04 18:31:51.015244 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2950/5890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:52.040311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4235864f-1768-4b27-8e9e-7076d5262712 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.048966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4235864f-1768-4b27-8e9e-7076d5262712 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:52.077652 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:31:52.092622 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 18:31:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 (ip 10.222.0.18) !!! Oct 04 18:31:52.143390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-22f5f5f5-bf97-49b3-ba83-3d981a012d5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.148402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-22f5f5f5-bf97-49b3-ba83-3d981a012d5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:52.162756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=26 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:52.166324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22f5f5f5-bf97-49b3-ba83-3d981a012d5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.167833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22f5f5f5-bf97-49b3-ba83-3d981a012d5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.168792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22f5f5f5-bf97-49b3-ba83-3d981a012d5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.173051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22f5f5f5-bf97-49b3-ba83-3d981a012d5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.174112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22f5f5f5-bf97-49b3-ba83-3d981a012d5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.175055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22f5f5f5-bf97-49b3-ba83-3d981a012d5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.197295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4235864f-1768-4b27-8e9e-7076d5262712 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.198377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4235864f-1768-4b27-8e9e-7076d5262712 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.199258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4235864f-1768-4b27-8e9e-7076d5262712 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.203490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4235864f-1768-4b27-8e9e-7076d5262712 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.206404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4235864f-1768-4b27-8e9e-7076d5262712 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.207167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4235864f-1768-4b27-8e9e-7076d5262712 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.487761 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-22f5f5f5-bf97-49b3-ba83-3d981a012d5e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.368606 Oct 04 18:31:52.489900 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2951/5891] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 4 18:31:52 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280/os-volume_attachments => generated 25 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:52.604315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-49b8361f-d199-4e98-b702-2d9afada239d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.604969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-49b8361f-d199-4e98-b702-2d9afada239d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:52.616388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49b8361f-d199-4e98-b702-2d9afada239d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.618544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49b8361f-d199-4e98-b702-2d9afada239d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.619334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49b8361f-d199-4e98-b702-2d9afada239d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.620730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49b8361f-d199-4e98-b702-2d9afada239d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.621678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49b8361f-d199-4e98-b702-2d9afada239d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.622294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49b8361f-d199-4e98-b702-2d9afada239d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.723831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-49b8361f-d199-4e98-b702-2d9afada239d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:31:52.912757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4235864f-1768-4b27-8e9e-7076d5262712 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:52.975113 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4235864f-1768-4b27-8e9e-7076d5262712 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.940203 Oct 04 18:31:52.977104 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2941/5892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:52 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:52.984035 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-49b8361f-d199-4e98-b702-2d9afada239d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 204 len: 0 microversion: 2.20 time: 0.382683 Oct 04 18:31:52.984745 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2952/5893] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:31:52 2022] DELETE /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:31:53.004541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.005850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.018776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.019611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.024553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.025989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.026831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.027777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.342792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:53.354105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:53.356448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:53.358108 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5d0249c-44d9-47fa-8f82-1ce109ce15b9 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.368047 Oct 04 18:31:53.358867 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2942/5894] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:52 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:54.015243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-028dd0c2-53a3-4ea3-ab97-02af94e88dd4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.015843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-028dd0c2-53a3-4ea3-ab97-02af94e88dd4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:54.034071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028dd0c2-53a3-4ea3-ab97-02af94e88dd4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.035752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028dd0c2-53a3-4ea3-ab97-02af94e88dd4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.038907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028dd0c2-53a3-4ea3-ab97-02af94e88dd4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.046374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028dd0c2-53a3-4ea3-ab97-02af94e88dd4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.050813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028dd0c2-53a3-4ea3-ab97-02af94e88dd4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.052080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-028dd0c2-53a3-4ea3-ab97-02af94e88dd4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.083067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:54.392679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.393314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:54.413781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=26 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:54.424177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-028dd0c2-53a3-4ea3-ab97-02af94e88dd4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.436893 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-028dd0c2-53a3-4ea3-ab97-02af94e88dd4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.433838 Oct 04 18:31:54.453280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.454618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.458977 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2953/5895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:54.465396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.469146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.473450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.474634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.902170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.926071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.931362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.934387 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96984283-c664-4a99-853b-296327bf222b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.546219 Oct 04 18:31:54.953906 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2943/5896] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:31:55.475858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0459e98d-3b90-4a49-87cf-740ed7f0d412 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.477191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0459e98d-3b90-4a49-87cf-740ed7f0d412 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.493339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0459e98d-3b90-4a49-87cf-740ed7f0d412 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.496266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0459e98d-3b90-4a49-87cf-740ed7f0d412 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.496950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0459e98d-3b90-4a49-87cf-740ed7f0d412 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.497891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0459e98d-3b90-4a49-87cf-740ed7f0d412 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.500181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0459e98d-3b90-4a49-87cf-740ed7f0d412 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.502348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0459e98d-3b90-4a49-87cf-740ed7f0d412 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.904712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0459e98d-3b90-4a49-87cf-740ed7f0d412 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.923130 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0459e98d-3b90-4a49-87cf-740ed7f0d412 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.453315 Oct 04 18:31:55.942455 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2954/5897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.968652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.970466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.979293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.983538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.985737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.990838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.992700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.994924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.435075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a583de4b-24b6-4c26-82dd-144c7b80cf39 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.436396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a583de4b-24b6-4c26-82dd-144c7b80cf39 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.491512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a583de4b-24b6-4c26-82dd-144c7b80cf39 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.502710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a583de4b-24b6-4c26-82dd-144c7b80cf39 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.505295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a583de4b-24b6-4c26-82dd-144c7b80cf39 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.511125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a583de4b-24b6-4c26-82dd-144c7b80cf39 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.511686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a583de4b-24b6-4c26-82dd-144c7b80cf39 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.512145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a583de4b-24b6-4c26-82dd-144c7b80cf39 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.558083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:56.599523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:56.606518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:56.607977 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0fafbef7-90c5-40e0-be1c-02cbb170e6e0 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1724 microversion: 2.20 time: 0.643539 Oct 04 18:31:56.636068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a583de4b-24b6-4c26-82dd-144c7b80cf39 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:31:56.655542 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2955/5898] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1724 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:56.890751 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a583de4b-24b6-4c26-82dd-144c7b80cf39 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "DELETE /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 204 len: 0 microversion: 2.1 time: 1.113987 Oct 04 18:31:56.894587 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2944/5899] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:55 2022] DELETE /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 0 bytes in 1119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:31:56.908215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-82e5c9af-c058-4cff-b134-64a41203169a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.909345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-82e5c9af-c058-4cff-b134-64a41203169a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.950456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c9a7cb08-51c6-4877-8abe-22ed01517987 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.951467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c9a7cb08-51c6-4877-8abe-22ed01517987 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.956710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82e5c9af-c058-4cff-b134-64a41203169a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.957225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82e5c9af-c058-4cff-b134-64a41203169a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.974775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82e5c9af-c058-4cff-b134-64a41203169a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.975889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82e5c9af-c058-4cff-b134-64a41203169a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.976398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82e5c9af-c058-4cff-b134-64a41203169a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.976993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82e5c9af-c058-4cff-b134-64a41203169a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.980117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9a7cb08-51c6-4877-8abe-22ed01517987 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.980636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9a7cb08-51c6-4877-8abe-22ed01517987 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.981097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9a7cb08-51c6-4877-8abe-22ed01517987 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.991605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9a7cb08-51c6-4877-8abe-22ed01517987 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.992904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9a7cb08-51c6-4877-8abe-22ed01517987 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.993409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9a7cb08-51c6-4877-8abe-22ed01517987 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.636147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-82e5c9af-c058-4cff-b134-64a41203169a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.649038 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-82e5c9af-c058-4cff-b134-64a41203169a tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1732 microversion: 2.1 time: 0.748837 Oct 04 18:31:57.664108 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2956/5900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1732 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:57.681891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.683339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.691332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.692264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.693049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.694295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.695233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.695916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.967911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.984709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.998659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.003311 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dc50bc49-3a53-4df6-899a-ec3da6765fe8 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1657 microversion: 2.20 time: 0.330692 Oct 04 18:31:58.006776 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2957/5901] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:57 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1657 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:58.086165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c9a7cb08-51c6-4877-8abe-22ed01517987 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.097160 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c9a7cb08-51c6-4877-8abe-22ed01517987 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 1.150980 Oct 04 18:31:58.107792 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2945/5902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:58.679427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2699ee22-27b5-4001-8b80-08f185817bd4 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.680697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2699ee22-27b5-4001-8b80-08f185817bd4 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:58.697719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2699ee22-27b5-4001-8b80-08f185817bd4 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.707466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2699ee22-27b5-4001-8b80-08f185817bd4 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.709558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2699ee22-27b5-4001-8b80-08f185817bd4 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.712086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2699ee22-27b5-4001-8b80-08f185817bd4 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.712728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2699ee22-27b5-4001-8b80-08f185817bd4 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.715094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2699ee22-27b5-4001-8b80-08f185817bd4 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.778660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-da6cda0b-bb1c-4f3f-8f81-65da3144c2f9 req-4a219f5b-7600-4056-9454-72e440ea7acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9afae5-6ef4-4bd5-92f8-1d0ed466b280", "name": "network-vif-deleted", "tag": "2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:58.823082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-da6cda0b-bb1c-4f3f-8f81-65da3144c2f9 req-4a219f5b-7600-4056-9454-72e440ea7acf service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.826022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-da6cda0b-bb1c-4f3f-8f81-65da3144c2f9 req-4a219f5b-7600-4056-9454-72e440ea7acf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.834122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-da6cda0b-bb1c-4f3f-8f81-65da3144c2f9 req-4a219f5b-7600-4056-9454-72e440ea7acf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.894271 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-da6cda0b-bb1c-4f3f-8f81-65da3144c2f9 req-4a219f5b-7600-4056-9454-72e440ea7acf service nova] Creating event network-vif-deleted:2b48c48b-33ff-426a-9bbf-0ca05e2a8c9e for instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 on n-h1-850499-14 Oct 04 18:31:58.919761 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-da6cda0b-bb1c-4f3f-8f81-65da3144c2f9 req-4a219f5b-7600-4056-9454-72e440ea7acf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144501 Oct 04 18:31:58.920745 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2946/5903] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:59.055296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.055296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.080154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.081390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.083394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.087135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.088481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.089161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.152185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.154813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.155600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.158909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lazy-loading 'fault' on Instance uuid 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:59.288747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2699ee22-27b5-4001-8b80-08f185817bd4 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.347228 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2699ee22-27b5-4001-8b80-08f185817bd4 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1732 microversion: 2.1 time: 0.656165 Oct 04 18:31:59.348696 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2958/5904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1732 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:59.385591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3015860a-3bf1-4848-b231-a5a85becb6fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.387270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3015860a-3bf1-4848-b231-a5a85becb6fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.413509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.416411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:59.419991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3015860a-3bf1-4848-b231-a5a85becb6fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.426277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3015860a-3bf1-4848-b231-a5a85becb6fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.427710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3015860a-3bf1-4848-b231-a5a85becb6fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.429784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3015860a-3bf1-4848-b231-a5a85becb6fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.453507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3015860a-3bf1-4848-b231-a5a85becb6fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.454456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3015860a-3bf1-4848-b231-a5a85becb6fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.455800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.462982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5b5b2a021cb49279d695bdeed577655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880b25dfcd7c4a2ab247dd7855993dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.470982 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eef93c30-8f40-4a08-aefc-bfa7592d885b tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 200 len: 1371 microversion: 2.20 time: 0.424810 Oct 04 18:31:59.472097 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2947/5905] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 1371 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:31:59.872231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3015860a-3bf1-4848-b231-a5a85becb6fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.896522 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3015860a-3bf1-4848-b231-a5a85becb6fd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.531414 Oct 04 18:31:59.900076 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2959/5906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:00.389521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29b3dd09-0ab5-4e00-851c-b422831c4ba0 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.390477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-29b3dd09-0ab5-4e00-851c-b422831c4ba0 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.401983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29b3dd09-0ab5-4e00-851c-b422831c4ba0 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.407684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29b3dd09-0ab5-4e00-851c-b422831c4ba0 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.408265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29b3dd09-0ab5-4e00-851c-b422831c4ba0 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.409122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29b3dd09-0ab5-4e00-851c-b422831c4ba0 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.409852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29b3dd09-0ab5-4e00-851c-b422831c4ba0 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.410851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29b3dd09-0ab5-4e00-851c-b422831c4ba0 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.513127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.513776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.526367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.526924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.529683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.530665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.531812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.535056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.560717 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] HTTP exception thrown: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Request method failure captured: Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 HTTP/1.1 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHo6CoC1FSPIVrg-hxvx64Lvu37FgZi7a5eitfhfJwkBg9f-xM_F44eAQHOV-RRu6YKGbHKkXgJcSlA7K3HENS6G3T7JGlva_GcVMYqBPSeUA8BTCeKOSQkddS9n3WsTX_Hbg5BWBbHDphM_NL5H-NC4MU6MvAM9yHrYUHieUy34UhM Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}] Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: e5b5b2a021cb49279d695bdeed577655 Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '5d9afae5-6ef4-4bd5-92f8-1d0ed466b280'} Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:00.564798 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:00.570343 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:00.570343 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:00.570343 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:00.570343 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:00.570343 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:00.570343 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:00.570343 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:00.570343 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:00.571954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Returning 404 to user: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:00.573200 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45b7ae24-c9cf-454d-af5d-f5ac831aa25d tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 404 len: 111 microversion: 2.20 time: 0.065119 Oct 04 18:32:00.582513 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2960/5907] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:32:00.592050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eeb54c28-3259-456e-b1af-a0d1082550c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '.version_select at 0x7fd4d1eec790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.665243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eeb54c28-3259-456e-b1af-a0d1082550c6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751853134" status: 204 len: 0 microversion: 2.20 time: 0.078050 Oct 04 18:32:00.672953 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2961/5908] 10.222.0.18 () {60 vars in 1259 bytes} [Tue Oct 4 18:32:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751853134 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:32:00.718860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29b3dd09-0ab5-4e00-851c-b422831c4ba0 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.729776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29b3dd09-0ab5-4e00-851c-b422831c4ba0 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1732 microversion: 2.1 time: 0.344217 Oct 04 18:32:00.745069 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2948/5909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1732 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:00.931239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8b80aa7c-87b7-4d56-86f1-3177b59b437a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.933702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8b80aa7c-87b7-4d56-86f1-3177b59b437a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.951642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b80aa7c-87b7-4d56-86f1-3177b59b437a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.952878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b80aa7c-87b7-4d56-86f1-3177b59b437a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.954224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b80aa7c-87b7-4d56-86f1-3177b59b437a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.955696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b80aa7c-87b7-4d56-86f1-3177b59b437a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.956746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b80aa7c-87b7-4d56-86f1-3177b59b437a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.957679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b80aa7c-87b7-4d56-86f1-3177b59b437a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.367305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d77612a3-3314-40b9-aef6-50472740c04c req-154fa787-48b5-4758-bcef-c4713497ac97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be1b109-2224-492a-8031-f678a2916ad3", "name": "network-vif-unplugged", "status": "completed", "tag": "4b90923e-e5bc-4b99-b66d-0f5d4a5e2373"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:01.393429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d77612a3-3314-40b9-aef6-50472740c04c req-154fa787-48b5-4758-bcef-c4713497ac97 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.398082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d77612a3-3314-40b9-aef6-50472740c04c req-154fa787-48b5-4758-bcef-c4713497ac97 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.400051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d77612a3-3314-40b9-aef6-50472740c04c req-154fa787-48b5-4758-bcef-c4713497ac97 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.435376 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d77612a3-3314-40b9-aef6-50472740c04c req-154fa787-48b5-4758-bcef-c4713497ac97 service nova] Creating event network-vif-unplugged:4b90923e-e5bc-4b99-b66d-0f5d4a5e2373 for instance 2be1b109-2224-492a-8031-f678a2916ad3 on n-h2-850499-14 Oct 04 18:32:01.463603 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d77612a3-3314-40b9-aef6-50472740c04c req-154fa787-48b5-4758-bcef-c4713497ac97 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100083 Oct 04 18:32:01.464319 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2949/5910] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:01.468450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8b80aa7c-87b7-4d56-86f1-3177b59b437a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:01.482631 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8b80aa7c-87b7-4d56-86f1-3177b59b437a tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1505 microversion: 2.1 time: 0.560892 Oct 04 18:32:01.486586 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2962/5911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:01.779765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e068eafd-85d8-4182-ad9a-7a40edff8d54 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.781105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e068eafd-85d8-4182-ad9a-7a40edff8d54 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:01.806065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e068eafd-85d8-4182-ad9a-7a40edff8d54 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.807025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e068eafd-85d8-4182-ad9a-7a40edff8d54 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.809692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e068eafd-85d8-4182-ad9a-7a40edff8d54 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.814249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e068eafd-85d8-4182-ad9a-7a40edff8d54 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.815373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e068eafd-85d8-4182-ad9a-7a40edff8d54 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.816418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e068eafd-85d8-4182-ad9a-7a40edff8d54 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.423077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e068eafd-85d8-4182-ad9a-7a40edff8d54 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.431854 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e068eafd-85d8-4182-ad9a-7a40edff8d54 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1664 microversion: 2.1 time: 0.663625 Oct 04 18:32:02.437764 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2950/5912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1664 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:02.513326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4c92ba03-dbd1-4bdc-812f-251349a24610 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.514590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4c92ba03-dbd1-4bdc-812f-251349a24610 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:02.564809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c92ba03-dbd1-4bdc-812f-251349a24610 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.568445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c92ba03-dbd1-4bdc-812f-251349a24610 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.569982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c92ba03-dbd1-4bdc-812f-251349a24610 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.571083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c92ba03-dbd1-4bdc-812f-251349a24610 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.571994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c92ba03-dbd1-4bdc-812f-251349a24610 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.572798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4c92ba03-dbd1-4bdc-812f-251349a24610 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.987082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4c92ba03-dbd1-4bdc-812f-251349a24610 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.001844 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4c92ba03-dbd1-4bdc-812f-251349a24610 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1505 microversion: 2.1 time: 0.493238 Oct 04 18:32:03.006678 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2963/5913] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:02 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.462974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fed18ab6-5962-46ef-a741-0b8393d561af tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.463586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fed18ab6-5962-46ef-a741-0b8393d561af tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.476093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fed18ab6-5962-46ef-a741-0b8393d561af tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.476618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fed18ab6-5962-46ef-a741-0b8393d561af tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.477077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fed18ab6-5962-46ef-a741-0b8393d561af tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.477811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fed18ab6-5962-46ef-a741-0b8393d561af tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.478284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fed18ab6-5962-46ef-a741-0b8393d561af tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.478724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fed18ab6-5962-46ef-a741-0b8393d561af tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.591429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-40ee8391-1bca-46a1-9fab-83a4ac0beef4 req-dc786157-83e7-4769-a69f-1fe0a4c3fe86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df321891-81e0-43b2-8e9a-fdd610b9bad3", "name": "network-vif-unplugged", "status": "completed", "tag": "187c1114-4c06-41d8-be5d-26034d3929ce"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:03.615507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-40ee8391-1bca-46a1-9fab-83a4ac0beef4 req-dc786157-83e7-4769-a69f-1fe0a4c3fe86 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.616255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-40ee8391-1bca-46a1-9fab-83a4ac0beef4 req-dc786157-83e7-4769-a69f-1fe0a4c3fe86 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.616886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-40ee8391-1bca-46a1-9fab-83a4ac0beef4 req-dc786157-83e7-4769-a69f-1fe0a4c3fe86 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.645945 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-40ee8391-1bca-46a1-9fab-83a4ac0beef4 req-dc786157-83e7-4769-a69f-1fe0a4c3fe86 service nova] Creating event network-vif-unplugged:187c1114-4c06-41d8-be5d-26034d3929ce for instance df321891-81e0-43b2-8e9a-fdd610b9bad3 on n-h2-850499-14 Oct 04 18:32:03.652795 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-40ee8391-1bca-46a1-9fab-83a4ac0beef4 req-dc786157-83e7-4769-a69f-1fe0a4c3fe86 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065420 Oct 04 18:32:03.654881 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2964/5914] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:03.694677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-6ae24f5b-3579-4145-9a4c-0ad0a7c3bf4a req-9b574c0d-6263-44df-90ba-52318f0c8521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df321891-81e0-43b2-8e9a-fdd610b9bad3", "name": "network-vif-deleted", "tag": "187c1114-4c06-41d8-be5d-26034d3929ce"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:03.706760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fed18ab6-5962-46ef-a741-0b8393d561af tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.714639 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fed18ab6-5962-46ef-a741-0b8393d561af tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1664 microversion: 2.1 time: 0.255676 Oct 04 18:32:03.715996 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2951/5915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1664 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.736098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6ae24f5b-3579-4145-9a4c-0ad0a7c3bf4a req-9b574c0d-6263-44df-90ba-52318f0c8521 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.736601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6ae24f5b-3579-4145-9a4c-0ad0a7c3bf4a req-9b574c0d-6263-44df-90ba-52318f0c8521 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.737051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-6ae24f5b-3579-4145-9a4c-0ad0a7c3bf4a req-9b574c0d-6263-44df-90ba-52318f0c8521 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.758403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-6ae24f5b-3579-4145-9a4c-0ad0a7c3bf4a req-9b574c0d-6263-44df-90ba-52318f0c8521 service nova] Creating event network-vif-deleted:187c1114-4c06-41d8-be5d-26034d3929ce for instance df321891-81e0-43b2-8e9a-fdd610b9bad3 on n-h2-850499-14 Oct 04 18:32:03.772211 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-6ae24f5b-3579-4145-9a4c-0ad0a7c3bf4a req-9b574c0d-6263-44df-90ba-52318f0c8521 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081411 Oct 04 18:32:03.779402 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2965/5916] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:04.033449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-86fac32d-2e08-4888-8283-1cb645f01ddd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.034376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-86fac32d-2e08-4888-8283-1cb645f01ddd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.059651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86fac32d-2e08-4888-8283-1cb645f01ddd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.063943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86fac32d-2e08-4888-8283-1cb645f01ddd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.064638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86fac32d-2e08-4888-8283-1cb645f01ddd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.065970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86fac32d-2e08-4888-8283-1cb645f01ddd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.066610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86fac32d-2e08-4888-8283-1cb645f01ddd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.071671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86fac32d-2e08-4888-8283-1cb645f01ddd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.378009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86fac32d-2e08-4888-8283-1cb645f01ddd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:04.404777 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-86fac32d-2e08-4888-8283-1cb645f01ddd tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1505 microversion: 2.1 time: 0.358530 Oct 04 18:32:04.405497 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2952/5917] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:04.740299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cfaedaec-9ce8-48b8-be9a-f23511455ff2 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.741032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cfaedaec-9ce8-48b8-be9a-f23511455ff2 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.757158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfaedaec-9ce8-48b8-be9a-f23511455ff2 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.757678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfaedaec-9ce8-48b8-be9a-f23511455ff2 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.758127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfaedaec-9ce8-48b8-be9a-f23511455ff2 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.758867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfaedaec-9ce8-48b8-be9a-f23511455ff2 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.759442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfaedaec-9ce8-48b8-be9a-f23511455ff2 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.759924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfaedaec-9ce8-48b8-be9a-f23511455ff2 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.983872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cfaedaec-9ce8-48b8-be9a-f23511455ff2 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:05.014247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cfaedaec-9ce8-48b8-be9a-f23511455ff2 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1383 microversion: 2.1 time: 0.278614 Oct 04 18:32:05.019353 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2966/5918] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1383 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:05.432200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e279e722-8896-4d28-889d-5d487d9fe951 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.433276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e279e722-8896-4d28-889d-5d487d9fe951 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:05.461133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e279e722-8896-4d28-889d-5d487d9fe951 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.470239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e279e722-8896-4d28-889d-5d487d9fe951 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.476221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e279e722-8896-4d28-889d-5d487d9fe951 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.495539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e279e722-8896-4d28-889d-5d487d9fe951 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.496581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e279e722-8896-4d28-889d-5d487d9fe951 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.500332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e279e722-8896-4d28-889d-5d487d9fe951 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.932320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e279e722-8896-4d28-889d-5d487d9fe951 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:05.945367 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e279e722-8896-4d28-889d-5d487d9fe951 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 200 len: 1508 microversion: 2.1 time: 0.519186 Oct 04 18:32:05.958039 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2953/5919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:05 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:05.986270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13f54ecd-ab5b-4082-88db-73e2b5321dd1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.988207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-13f54ecd-ab5b-4082-88db-73e2b5321dd1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:06.016370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13f54ecd-ab5b-4082-88db-73e2b5321dd1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.018787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13f54ecd-ab5b-4082-88db-73e2b5321dd1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.019644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13f54ecd-ab5b-4082-88db-73e2b5321dd1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.023640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13f54ecd-ab5b-4082-88db-73e2b5321dd1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.025813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13f54ecd-ab5b-4082-88db-73e2b5321dd1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.026543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13f54ecd-ab5b-4082-88db-73e2b5321dd1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.044402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.045066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:06.062386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.063944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.069357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.072281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.074011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.075783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.190757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.191319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.193326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.193713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lazy-loading 'fault' on Instance uuid df321891-81e0-43b2-8e9a-fdd610b9bad3 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:06.572672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57555d380c604b848af04599aaeec6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a649636bf6484226940a46cff7514e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:06.587227 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-97f10d30-bd61-4399-ab95-d1950b4428f6 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 200 len: 1388 microversion: 2.1 time: 0.546756 Oct 04 18:32:06.603131 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2954/5920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 1388 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:06.980174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-13f54ecd-ab5b-4082-88db-73e2b5321dd1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:06.989972 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-13f54ecd-ab5b-4082-88db-73e2b5321dd1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 1.022936 Oct 04 18:32:06.993535 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2967/5921] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:05 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:07.038186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9612010-1e72-4d9d-b877-1c4d5d79a678 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.039043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9612010-1e72-4d9d-b877-1c4d5d79a678 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:07.056905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9612010-1e72-4d9d-b877-1c4d5d79a678 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.057636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9612010-1e72-4d9d-b877-1c4d5d79a678 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.061353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9612010-1e72-4d9d-b877-1c4d5d79a678 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.062279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9612010-1e72-4d9d-b877-1c4d5d79a678 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.064388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9612010-1e72-4d9d-b877-1c4d5d79a678 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.064968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9612010-1e72-4d9d-b877-1c4d5d79a678 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.617054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.618296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:07.635120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.636001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.639503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.640422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.641071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.641659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.673248 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] HTTP exception thrown: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Request method failure captured: Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 HTTP/1.1 Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHqEP9rtAv1FLa-03t4Yp3OyM4NccG2yQVfNaTsXmNnaQDeEEvBwkNwIgaamRn2lftivmVD7s_or5IKod50re_RiBjLEDGcayIuGoQ6Ttxs25ViowNwblHQLL9WWnTZcPnxTWCGgW2BNivhnXlEde_6DSb4J1-adpADQ5bBjVke3xW4 Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: a649636bf6484226940a46cff7514e4d Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestServerBasicOps-1538135591 Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a649636bf6484226940a46cff7514e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a649636bf6484226940a46cff7514e4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a649636bf6484226940a46cff7514e4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a649636bf6484226940a46cff7514e4d"}]}] Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestServerBasicOps-1538135591 Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: a649636bf6484226940a46cff7514e4d Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestServerBasicOps-1538135591 Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestServerBasicOps-1538135591-project Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 57555d380c604b848af04599aaeec6f5 Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestServerBasicOps-1538135591-project Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'df321891-81e0-43b2-8e9a-fdd610b9bad3'} Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:07.681643 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:07.686361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:07.686361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:07.686361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:07.686361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:07.686361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:07.686361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:07.686361 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:07.687353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Returning 404 to user: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:07.689370 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-81e99a38-7955-4716-a87e-efd6d8886aee tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 404 len: 111 microversion: 2.1 time: 0.077238 Oct 04 18:32:07.690334 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2968/5922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:32:08.240933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9612010-1e72-4d9d-b877-1c4d5d79a678 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:08.258990 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9612010-1e72-4d9d-b877-1c4d5d79a678 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 1.218490 Oct 04 18:32:08.261937 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2955/5923] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:08.310355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2bdb1533-61dd-4d49-a32c-553d5625aee9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.311066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2bdb1533-61dd-4d49-a32c-553d5625aee9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:08.332385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bdb1533-61dd-4d49-a32c-553d5625aee9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.333300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bdb1533-61dd-4d49-a32c-553d5625aee9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.335542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bdb1533-61dd-4d49-a32c-553d5625aee9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.335542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bdb1533-61dd-4d49-a32c-553d5625aee9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.336017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bdb1533-61dd-4d49-a32c-553d5625aee9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.342120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2bdb1533-61dd-4d49-a32c-553d5625aee9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.676743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.677369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:08.698497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.700426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.701125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.704650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.713258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.719286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.769857 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] HTTP exception thrown: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Request method failure captured: Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 HTTP/1.1 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHo6CoC1FSPIVrg-hxvx64Lvu37FgZi7a5eitfhfJwkBg9f-xM_F44eAQHOV-RRu6YKGbHKkXgJcSlA7K3HENS6G3T7JGlva_GcVMYqBPSeUA8BTCeKOSQkddS9n3WsTX_Hbg5BWBbHDphM_NL5H-NC4MU6MvAM9yHrYUHieUy34UhM Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}] Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e5b5b2a021cb49279d695bdeed577655 Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '5d9afae5-6ef4-4bd5-92f8-1d0ed466b280'} Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:08.772910 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:08.776729 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.782629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Returning 404 to user: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:08.785087 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e29a0529-2e24-43fd-b714-f94618538c6e tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 404 len: 111 microversion: 2.20 time: 0.116717 Oct 04 18:32:08.795546 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2956/5924] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:32:08 2022] DELETE /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:32:08.807728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.809665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:08.826894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.829129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.829818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.830808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.831558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.832378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.853837 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] HTTP exception thrown: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Request method failure captured: Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 HTTP/1.1 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHo6CoC1FSPIVrg-hxvx64Lvu37FgZi7a5eitfhfJwkBg9f-xM_F44eAQHOV-RRu6YKGbHKkXgJcSlA7K3HENS6G3T7JGlva_GcVMYqBPSeUA8BTCeKOSQkddS9n3WsTX_Hbg5BWBbHDphM_NL5H-NC4MU6MvAM9yHrYUHieUy34UhM Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}] Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e5b5b2a021cb49279d695bdeed577655 Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '5d9afae5-6ef4-4bd5-92f8-1d0ed466b280'} Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.855705 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:08.859634 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.859634 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:08.859634 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:08.859634 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:08.859634 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:08.859634 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:08.859634 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. Oct 04 18:32:08.859634 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.862305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Returning 404 to user: Instance 5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:08.864001 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cc0ba8f2-a595-41d8-8c56-9bf7f48ee176 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280" status: 404 len: 111 microversion: 2.20 time: 0.066975 Oct 04 18:32:08.868112 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2957/5925] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:08 2022] GET /compute/v2.1/servers/5d9afae5-6ef4-4bd5-92f8-1d0ed466b280 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:32:09.475504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.477657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.521862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.523329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.524227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.525149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.525785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.526386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.565595 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] HTTP exception thrown: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Request method failure captured: Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 HTTP/1.1 Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHqEP9rtAv1FLa-03t4Yp3OyM4NccG2yQVfNaTsXmNnaQDeEEvBwkNwIgaamRn2lftivmVD7s_or5IKod50re_RiBjLEDGcayIuGoQ6Ttxs25ViowNwblHQLL9WWnTZcPnxTWCGgW2BNivhnXlEde_6DSb4J1-adpADQ5bBjVke3xW4 Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: a649636bf6484226940a46cff7514e4d Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestServerBasicOps-1538135591 Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a649636bf6484226940a46cff7514e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a649636bf6484226940a46cff7514e4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a649636bf6484226940a46cff7514e4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a649636bf6484226940a46cff7514e4d"}]}] Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestServerBasicOps-1538135591 Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: a649636bf6484226940a46cff7514e4d Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestServerBasicOps-1538135591 Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestServerBasicOps-1538135591-project Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 57555d380c604b848af04599aaeec6f5 Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestServerBasicOps-1538135591-project Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'df321891-81e0-43b2-8e9a-fdd610b9bad3'} Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:09.567900 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:09.573040 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.579164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Returning 404 to user: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:09.581593 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed73198c-b87f-4f2c-8226-e6040d5944f1 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "DELETE /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 404 len: 111 microversion: 2.1 time: 0.123905 Oct 04 18:32:09.585171 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2958/5926] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:09 2022] DELETE /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:09.611015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.614471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] [instance: df321891-81e0-43b2-8e9a-fdd610b9bad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.646442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.649370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.650155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.652737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.656023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.656613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.728435 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] HTTP exception thrown: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Request method failure captured: Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 HTTP/1.1 Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHqEP9rtAv1FLa-03t4Yp3OyM4NccG2yQVfNaTsXmNnaQDeEEvBwkNwIgaamRn2lftivmVD7s_or5IKod50re_RiBjLEDGcayIuGoQ6Ttxs25ViowNwblHQLL9WWnTZcPnxTWCGgW2BNivhnXlEde_6DSb4J1-adpADQ5bBjVke3xW4 Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: a649636bf6484226940a46cff7514e4d Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestServerBasicOps-1538135591 Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a649636bf6484226940a46cff7514e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a649636bf6484226940a46cff7514e4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a649636bf6484226940a46cff7514e4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a649636bf6484226940a46cff7514e4d"}]}] Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestServerBasicOps-1538135591 Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: a649636bf6484226940a46cff7514e4d Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestServerBasicOps-1538135591 Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestServerBasicOps-1538135591-project Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 57555d380c604b848af04599aaeec6f5 Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestServerBasicOps-1538135591-project Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'df321891-81e0-43b2-8e9a-fdd610b9bad3'} Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:09.736321 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.740944 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:09.740944 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:09.740944 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:09.740944 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:09.740944 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:09.740944 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. Oct 04 18:32:09.740944 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:32:09.740944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Returning 404 to user: Instance df321891-81e0-43b2-8e9a-fdd610b9bad3 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:09.744421 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6b82c845-f03a-4c68-b35d-74d1d26afbce tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3" status: 404 len: 111 microversion: 2.1 time: 0.146343 Oct 04 18:32:09.747995 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2959/5927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:09 2022] GET /compute/v2.1/servers/df321891-81e0-43b2-8e9a-fdd610b9bad3 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:10.160268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2bdb1533-61dd-4d49-a32c-553d5625aee9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:10.186147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e946e575-093f-4eb6-93c7-0d63f9d3adf5 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] Calling method '.version_select at 0x7fd4d0b49940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.209211 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2bdb1533-61dd-4d49-a32c-553d5625aee9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 1.911341 Oct 04 18:32:10.241075 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2969/5928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:08 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:10.262920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0cdae118-8571-423f-95bc-c7872e6aeba9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.263578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0cdae118-8571-423f-95bc-c7872e6aeba9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.267731 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e946e575-093f-4eb6-93c7-0d63f9d3adf5 tempest-TestServerBasicOps-1538135591 tempest-TestServerBasicOps-1538135591-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-601380098" status: 202 len: 0 microversion: 2.1 time: 0.085972 Oct 04 18:32:10.273507 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2960/5929] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:32:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-601380098 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:32:10.284136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cdae118-8571-423f-95bc-c7872e6aeba9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.284668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cdae118-8571-423f-95bc-c7872e6aeba9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.285124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cdae118-8571-423f-95bc-c7872e6aeba9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.294079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cdae118-8571-423f-95bc-c7872e6aeba9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.294587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cdae118-8571-423f-95bc-c7872e6aeba9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.296169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0cdae118-8571-423f-95bc-c7872e6aeba9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.732292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0cdae118-8571-423f-95bc-c7872e6aeba9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:10.751968 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0cdae118-8571-423f-95bc-c7872e6aeba9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.507429 Oct 04 18:32:10.752782 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2970/5930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:10.782418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-34f4228c-e28c-44ea-b13c-6d8a4ab7494e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:10.804905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f4228c-e28c-44ea-b13c-6d8a4ab7494e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.805352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f4228c-e28c-44ea-b13c-6d8a4ab7494e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.805800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34f4228c-e28c-44ea-b13c-6d8a4ab7494e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.915723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-34f4228c-e28c-44ea-b13c-6d8a4ab7494e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Going to try to stop instance {{(pid=122332) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:32:11.141573 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-34f4228c-e28c-44ea-b13c-6d8a4ab7494e tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.352975 Oct 04 18:32:11.153558 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2961/5931] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:10 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:11.183209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8ff4e602-686f-4f2f-8009-22c65203e238 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:11.184799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8ff4e602-686f-4f2f-8009-22c65203e238 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.247044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff4e602-686f-4f2f-8009-22c65203e238 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.256632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff4e602-686f-4f2f-8009-22c65203e238 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.258611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff4e602-686f-4f2f-8009-22c65203e238 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.263264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff4e602-686f-4f2f-8009-22c65203e238 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.268327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff4e602-686f-4f2f-8009-22c65203e238 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.277046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff4e602-686f-4f2f-8009-22c65203e238 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.115521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8ff4e602-686f-4f2f-8009-22c65203e238 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.195094 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8ff4e602-686f-4f2f-8009-22c65203e238 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 1.028757 Oct 04 18:32:12.196746 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2971/5932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:11 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:13.244643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1bd2c108-51b9-495f-84b4-0b94ace7456c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:13.264956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1bd2c108-51b9-495f-84b4-0b94ace7456c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:13.334201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bd2c108-51b9-495f-84b4-0b94ace7456c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.334783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bd2c108-51b9-495f-84b4-0b94ace7456c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.337668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bd2c108-51b9-495f-84b4-0b94ace7456c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.338793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bd2c108-51b9-495f-84b4-0b94ace7456c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.347512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bd2c108-51b9-495f-84b4-0b94ace7456c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.348223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bd2c108-51b9-495f-84b4-0b94ace7456c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.002112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1bd2c108-51b9-495f-84b4-0b94ace7456c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:14.019375 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1bd2c108-51b9-495f-84b4-0b94ace7456c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.793281 Oct 04 18:32:14.027332 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2962/5933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:13 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:15.083770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-08a9ec00-83c4-41fc-81a0-820c633f32f4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:15.089420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08a9ec00-83c4-41fc-81a0-820c633f32f4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:15.145702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08a9ec00-83c4-41fc-81a0-820c633f32f4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.146501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08a9ec00-83c4-41fc-81a0-820c633f32f4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.150243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08a9ec00-83c4-41fc-81a0-820c633f32f4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.157853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08a9ec00-83c4-41fc-81a0-820c633f32f4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.160011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08a9ec00-83c4-41fc-81a0-820c633f32f4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.171599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08a9ec00-83c4-41fc-81a0-820c633f32f4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.836884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-08a9ec00-83c4-41fc-81a0-820c633f32f4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:15.858140 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-08a9ec00-83c4-41fc-81a0-820c633f32f4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 0.790223 Oct 04 18:32:15.870510 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2972/5934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:15 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:16.905534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-abd4cfcd-1e80-469c-81e5-c746a550eab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.906592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-abd4cfcd-1e80-469c-81e5-c746a550eab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.940532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abd4cfcd-1e80-469c-81e5-c746a550eab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.941249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abd4cfcd-1e80-469c-81e5-c746a550eab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.941893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abd4cfcd-1e80-469c-81e5-c746a550eab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.942858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abd4cfcd-1e80-469c-81e5-c746a550eab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.973735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abd4cfcd-1e80-469c-81e5-c746a550eab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.974209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abd4cfcd-1e80-469c-81e5-c746a550eab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.496683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.497268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.541279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.545489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.546903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.552150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.557424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.558445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.654545 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] HTTP exception thrown: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Request method failure captured: Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 HTTP/1.1 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHo6CoC1FSPIVrg-hxvx64Lvu37FgZi7a5eitfhfJwkBg9f-xM_F44eAQHOV-RRu6YKGbHKkXgJcSlA7K3HENS6G3T7JGlva_GcVMYqBPSeUA8BTCeKOSQkddS9n3WsTX_Hbg5BWBbHDphM_NL5H-NC4MU6MvAM9yHrYUHieUy34UhM Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}] Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: e5b5b2a021cb49279d695bdeed577655 Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '9d39c1d8-8eed-462d-af88-bd613d502347'} Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:17.677941 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:32:17.682622 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:17.687884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Returning 404 to user: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:17.697446 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-acf2504a-580b-495c-8eeb-bd4ae89d41f4 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 404 len: 111 microversion: 2.20 time: 0.207466 Oct 04 18:32:17.702288 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2973/5935] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 4 18:32:17 2022] DELETE /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:32:17.713327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.726999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] [instance: 9d39c1d8-8eed-462d-af88-bd613d502347] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.743663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.758304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.767262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.768129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.768622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.769065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.772355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:17.809949 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] HTTP exception thrown: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Request method failure captured: Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 HTTP/1.1 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHo6CoC1FSPIVrg-hxvx64Lvu37FgZi7a5eitfhfJwkBg9f-xM_F44eAQHOV-RRu6YKGbHKkXgJcSlA7K3HENS6G3T7JGlva_GcVMYqBPSeUA8BTCeKOSQkddS9n3WsTX_Hbg5BWBbHDphM_NL5H-NC4MU6MvAM9yHrYUHieUy34UhM Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/880b25dfcd7c4a2ab247dd7855993dc8"}]}] Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 880b25dfcd7c4a2ab247dd7855993dc8 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1087015782 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: e5b5b2a021cb49279d695bdeed577655 Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1087015782-project Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '9d39c1d8-8eed-462d-af88-bd613d502347'} Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:17.814846 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:17.819332 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:17.819332 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:17.819332 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:17.819332 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:17.819332 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:17.819332 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:17.819332 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. Oct 04 18:32:17.819332 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:17.823315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] Returning 404 to user: Instance 9d39c1d8-8eed-462d-af88-bd613d502347 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:17.825359 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c192b5b2-384f-495f-80e4-4231258f42b6 tempest-AttachVolumeShelveTestJSON-1087015782 tempest-AttachVolumeShelveTestJSON-1087015782-project] 10.222.0.18 "GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347" status: 404 len: 111 microversion: 2.20 time: 0.116008 Oct 04 18:32:17.828176 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2974/5936] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/9d39c1d8-8eed-462d-af88-bd613d502347 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:32:18.640471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-abd4cfcd-1e80-469c-81e5-c746a550eab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:18.677798 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-abd4cfcd-1e80-469c-81e5-c746a550eab4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 1.781348 Oct 04 18:32:18.682095 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2963/5937] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:19.706058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4526092e-93aa-409e-9378-aa578cf8f6b1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.706692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4526092e-93aa-409e-9378-aa578cf8f6b1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.725816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4526092e-93aa-409e-9378-aa578cf8f6b1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.726622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4526092e-93aa-409e-9378-aa578cf8f6b1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.729844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4526092e-93aa-409e-9378-aa578cf8f6b1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.732305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4526092e-93aa-409e-9378-aa578cf8f6b1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.739594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4526092e-93aa-409e-9378-aa578cf8f6b1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.742108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4526092e-93aa-409e-9378-aa578cf8f6b1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.313629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4526092e-93aa-409e-9378-aa578cf8f6b1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:21.350505 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4526092e-93aa-409e-9378-aa578cf8f6b1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1679 microversion: 2.1 time: 1.637278 Oct 04 18:32:21.351962 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2975/5938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1679 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:22.382007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1c425995-3698-4aaf-81a6-ee98622ee389 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.386788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1c425995-3698-4aaf-81a6-ee98622ee389 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:22.418502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c425995-3698-4aaf-81a6-ee98622ee389 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.420054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c425995-3698-4aaf-81a6-ee98622ee389 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.423182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c425995-3698-4aaf-81a6-ee98622ee389 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.423947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c425995-3698-4aaf-81a6-ee98622ee389 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.424357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c425995-3698-4aaf-81a6-ee98622ee389 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.431050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c425995-3698-4aaf-81a6-ee98622ee389 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.292140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1c425995-3698-4aaf-81a6-ee98622ee389 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.322072 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1c425995-3698-4aaf-81a6-ee98622ee389 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1656 microversion: 2.1 time: 0.947214 Oct 04 18:32:23.323560 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2964/5939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1656 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.371251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-607294bf-7ca0-4b64-a67d-5f52417268c2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:23.384010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:23.386627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-607294bf-7ca0-4b64-a67d-5f52417268c2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.390203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-607294bf-7ca0-4b64-a67d-5f52417268c2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.391227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-607294bf-7ca0-4b64-a67d-5f52417268c2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.497053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-607294bf-7ca0-4b64-a67d-5f52417268c2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Going to try to start instance {{(pid=122331) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:32:23.581677 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-607294bf-7ca0-4b64-a67d-5f52417268c2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.214661 Oct 04 18:32:23.587474 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2976/5940] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:23 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:23.594694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e34777aa-2cc2-4e0d-89fd-f5e439b00785 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.596953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e34777aa-2cc2-4e0d-89fd-f5e439b00785 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.654727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e34777aa-2cc2-4e0d-89fd-f5e439b00785 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.656372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e34777aa-2cc2-4e0d-89fd-f5e439b00785 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.658454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e34777aa-2cc2-4e0d-89fd-f5e439b00785 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.660606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e34777aa-2cc2-4e0d-89fd-f5e439b00785 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.662923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e34777aa-2cc2-4e0d-89fd-f5e439b00785 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.664178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e34777aa-2cc2-4e0d-89fd-f5e439b00785 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.721637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e34777aa-2cc2-4e0d-89fd-f5e439b00785 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.804769 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e34777aa-2cc2-4e0d-89fd-f5e439b00785 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1665 microversion: 2.1 time: 1.215530 Oct 04 18:32:24.808382 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2965/5941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1665 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:25.840932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-16c4cef1-27ae-4514-9776-97f595755684 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.842598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-16c4cef1-27ae-4514-9776-97f595755684 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.867629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16c4cef1-27ae-4514-9776-97f595755684 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.868942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16c4cef1-27ae-4514-9776-97f595755684 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.870657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16c4cef1-27ae-4514-9776-97f595755684 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.873976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16c4cef1-27ae-4514-9776-97f595755684 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.878189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16c4cef1-27ae-4514-9776-97f595755684 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.880210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-16c4cef1-27ae-4514-9776-97f595755684 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.395526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-16c4cef1-27ae-4514-9776-97f595755684 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.405898 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-16c4cef1-27ae-4514-9776-97f595755684 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1665 microversion: 2.1 time: 0.572492 Oct 04 18:32:26.413157 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2977/5942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:25 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1665 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:27.440786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b2c100ee-08a6-4d5a-aad8-22db20fc711d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.442125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b2c100ee-08a6-4d5a-aad8-22db20fc711d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:27.446196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:27.465899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2c100ee-08a6-4d5a-aad8-22db20fc711d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.466811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2c100ee-08a6-4d5a-aad8-22db20fc711d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.468069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2c100ee-08a6-4d5a-aad8-22db20fc711d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.470680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2c100ee-08a6-4d5a-aad8-22db20fc711d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.477296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2c100ee-08a6-4d5a-aad8-22db20fc711d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.478230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2c100ee-08a6-4d5a-aad8-22db20fc711d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.094846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b2c100ee-08a6-4d5a-aad8-22db20fc711d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:28.110647 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b2c100ee-08a6-4d5a-aad8-22db20fc711d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1665 microversion: 2.1 time: 0.671472 Oct 04 18:32:28.133249 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2966/5943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1665 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:29.146884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-91e1c061-a7b3-46f5-b2db-75f71ab07a51 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:29.148132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-91e1c061-a7b3-46f5-b2db-75f71ab07a51 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:29.171280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91e1c061-a7b3-46f5-b2db-75f71ab07a51 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.172255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91e1c061-a7b3-46f5-b2db-75f71ab07a51 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.175672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91e1c061-a7b3-46f5-b2db-75f71ab07a51 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.176917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91e1c061-a7b3-46f5-b2db-75f71ab07a51 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.177998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91e1c061-a7b3-46f5-b2db-75f71ab07a51 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.184640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91e1c061-a7b3-46f5-b2db-75f71ab07a51 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.436819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-91e1c061-a7b3-46f5-b2db-75f71ab07a51 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:30.473293 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-91e1c061-a7b3-46f5-b2db-75f71ab07a51 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1665 microversion: 2.1 time: 1.336916 Oct 04 18:32:30.475809 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2978/5944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:29 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1665 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:31.505818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5dda6891-073e-4f62-a603-4926c0b3466d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.508363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5dda6891-073e-4f62-a603-4926c0b3466d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:31.536478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dda6891-073e-4f62-a603-4926c0b3466d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.542521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dda6891-073e-4f62-a603-4926c0b3466d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.543534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dda6891-073e-4f62-a603-4926c0b3466d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.544595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dda6891-073e-4f62-a603-4926c0b3466d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.548810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dda6891-073e-4f62-a603-4926c0b3466d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.549609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5dda6891-073e-4f62-a603-4926c0b3466d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.565376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:32.199685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5dda6891-073e-4f62-a603-4926c0b3466d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:32.218529 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5dda6891-073e-4f62-a603-4926c0b3466d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.722162 Oct 04 18:32:32.228284 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2967/5945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:31 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:32.261505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-19648e41-7113-416f-a115-0a9bdb2dcc12 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:32.266549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-19648e41-7113-416f-a115-0a9bdb2dcc12 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:32.350083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19648e41-7113-416f-a115-0a9bdb2dcc12 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.350688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19648e41-7113-416f-a115-0a9bdb2dcc12 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.351194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19648e41-7113-416f-a115-0a9bdb2dcc12 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.354453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19648e41-7113-416f-a115-0a9bdb2dcc12 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.355679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19648e41-7113-416f-a115-0a9bdb2dcc12 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.357102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19648e41-7113-416f-a115-0a9bdb2dcc12 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.036151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-19648e41-7113-416f-a115-0a9bdb2dcc12 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:33.071506 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-19648e41-7113-416f-a115-0a9bdb2dcc12 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.816660 Oct 04 18:32:33.090653 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2979/5946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:32 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:33.117097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-113b2336-0ae9-4c3b-b930-cae2545b4ac6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.117859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-113b2336-0ae9-4c3b-b930-cae2545b4ac6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.141715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-113b2336-0ae9-4c3b-b930-cae2545b4ac6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.142091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-113b2336-0ae9-4c3b-b930-cae2545b4ac6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.142540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-113b2336-0ae9-4c3b-b930-cae2545b4ac6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.143291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-113b2336-0ae9-4c3b-b930-cae2545b4ac6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.143756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-113b2336-0ae9-4c3b-b930-cae2545b4ac6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.144188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-113b2336-0ae9-4c3b-b930-cae2545b4ac6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.730806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-113b2336-0ae9-4c3b-b930-cae2545b4ac6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:35.747473 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-113b2336-0ae9-4c3b-b930-cae2545b4ac6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 2.634570 Oct 04 18:32:35.747963 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2968/5947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:33 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 2636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:35.779518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d05395d-e3a8-4e57-9bf1-24a470021879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:35.781167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d05395d-e3a8-4e57-9bf1-24a470021879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:35.804670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05395d-e3a8-4e57-9bf1-24a470021879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.805971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05395d-e3a8-4e57-9bf1-24a470021879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.806870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05395d-e3a8-4e57-9bf1-24a470021879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.808372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05395d-e3a8-4e57-9bf1-24a470021879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.809096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05395d-e3a8-4e57-9bf1-24a470021879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.809887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3d05395d-e3a8-4e57-9bf1-24a470021879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.403200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d05395d-e3a8-4e57-9bf1-24a470021879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:36.432699 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3d05395d-e3a8-4e57-9bf1-24a470021879 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.657706 Oct 04 18:32:36.439660 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2980/5948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:35 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:36.472275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c6988ff4-efcb-4a50-a36a-d362312d84b2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:36.474280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c6988ff4-efcb-4a50-a36a-d362312d84b2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:36.495709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6988ff4-efcb-4a50-a36a-d362312d84b2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.496230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6988ff4-efcb-4a50-a36a-d362312d84b2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.513354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6988ff4-efcb-4a50-a36a-d362312d84b2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.514233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6988ff4-efcb-4a50-a36a-d362312d84b2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.523259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6988ff4-efcb-4a50-a36a-d362312d84b2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.525501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6988ff4-efcb-4a50-a36a-d362312d84b2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:37.930905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c6988ff4-efcb-4a50-a36a-d362312d84b2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:37.938117 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c6988ff4-efcb-4a50-a36a-d362312d84b2 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 1.471492 Oct 04 18:32:37.943778 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2969/5949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:36 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:37.971990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4267b012-e190-4981-9c85-08668b053b8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:37.973205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4267b012-e190-4981-9c85-08668b053b8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:37.985451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4267b012-e190-4981-9c85-08668b053b8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:37.997738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4267b012-e190-4981-9c85-08668b053b8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:37.998907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4267b012-e190-4981-9c85-08668b053b8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.001820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4267b012-e190-4981-9c85-08668b053b8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.002947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4267b012-e190-4981-9c85-08668b053b8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.003871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4267b012-e190-4981-9c85-08668b053b8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.120007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-4267b012-e190-4981-9c85-08668b053b8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lazy-loading 'flavor' on Instance uuid 7b1681ab-db4a-4528-99da-649ffa9a93a0 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:38.579429 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4267b012-e190-4981-9c85-08668b053b8d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.610841 Oct 04 18:32:38.610991 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2981/5950] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:37 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:38.614465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2b18f65-f451-4535-bd57-c9b9f470f326 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.615643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2b18f65-f451-4535-bd57-c9b9f470f326 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:38.639684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2b18f65-f451-4535-bd57-c9b9f470f326 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.641839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2b18f65-f451-4535-bd57-c9b9f470f326 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.642838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2b18f65-f451-4535-bd57-c9b9f470f326 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.647966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2b18f65-f451-4535-bd57-c9b9f470f326 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.648641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2b18f65-f451-4535-bd57-c9b9f470f326 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.649343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2b18f65-f451-4535-bd57-c9b9f470f326 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.488210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2b18f65-f451-4535-bd57-c9b9f470f326 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:39.510983 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2b18f65-f451-4535-bd57-c9b9f470f326 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1677 microversion: 2.1 time: 0.901999 Oct 04 18:32:39.519636 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2970/5951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:38 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1677 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:40.565410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ddefb227-e2ab-4221-91ba-1f5606765b56 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.566620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ddefb227-e2ab-4221-91ba-1f5606765b56 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:40.605067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ddefb227-e2ab-4221-91ba-1f5606765b56 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.610945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ddefb227-e2ab-4221-91ba-1f5606765b56 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.613593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ddefb227-e2ab-4221-91ba-1f5606765b56 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.617923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ddefb227-e2ab-4221-91ba-1f5606765b56 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.619398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ddefb227-e2ab-4221-91ba-1f5606765b56 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.620559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ddefb227-e2ab-4221-91ba-1f5606765b56 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.192007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ddefb227-e2ab-4221-91ba-1f5606765b56 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:41.214386 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ddefb227-e2ab-4221-91ba-1f5606765b56 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1660 microversion: 2.1 time: 0.656563 Oct 04 18:32:41.219195 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2982/5952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1660 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:41.269353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2e02521a-5c70-4b09-9872-837deecf36c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:41.275223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2e02521a-5c70-4b09-9872-837deecf36c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:41.378223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e02521a-5c70-4b09-9872-837deecf36c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.382162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e02521a-5c70-4b09-9872-837deecf36c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.383016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e02521a-5c70-4b09-9872-837deecf36c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.384347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e02521a-5c70-4b09-9872-837deecf36c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.398988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e02521a-5c70-4b09-9872-837deecf36c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.404589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2e02521a-5c70-4b09-9872-837deecf36c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.691168 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2e02521a-5c70-4b09-9872-837deecf36c1 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action" status: 202 len: 0 microversion: 2.1 time: 0.430509 Oct 04 18:32:41.694639 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2971/5953] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:41 2022] POST /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:32:41.705786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a232ed32-9616-452b-a363-ba5d223e305c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:41.706752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a232ed32-9616-452b-a363-ba5d223e305c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:41.727683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a232ed32-9616-452b-a363-ba5d223e305c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.728729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a232ed32-9616-452b-a363-ba5d223e305c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.729505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a232ed32-9616-452b-a363-ba5d223e305c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.731262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a232ed32-9616-452b-a363-ba5d223e305c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.731966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a232ed32-9616-452b-a363-ba5d223e305c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.732861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a232ed32-9616-452b-a363-ba5d223e305c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.798513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a232ed32-9616-452b-a363-ba5d223e305c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:42.823753 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a232ed32-9616-452b-a363-ba5d223e305c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1666 microversion: 2.1 time: 1.121502 Oct 04 18:32:42.824544 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2983/5954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:41 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1666 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:43.875785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-332da21b-bff8-44f1-b5c5-8c22149f46c0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.886705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-332da21b-bff8-44f1-b5c5-8c22149f46c0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:43.927709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-332da21b-bff8-44f1-b5c5-8c22149f46c0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.929133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-332da21b-bff8-44f1-b5c5-8c22149f46c0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.929822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-332da21b-bff8-44f1-b5c5-8c22149f46c0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:43.938746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-332da21b-bff8-44f1-b5c5-8c22149f46c0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.939916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-332da21b-bff8-44f1-b5c5-8c22149f46c0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.944020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-332da21b-bff8-44f1-b5c5-8c22149f46c0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.633528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-332da21b-bff8-44f1-b5c5-8c22149f46c0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:44.649762 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-332da21b-bff8-44f1-b5c5-8c22149f46c0 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1666 microversion: 2.1 time: 0.782209 Oct 04 18:32:44.650402 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2972/5955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:43 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1666 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:45.687110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f81d2e7-16a2-480f-80e4-80c6e7baeff4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:45.689616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f81d2e7-16a2-480f-80e4-80c6e7baeff4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:45.730922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f81d2e7-16a2-480f-80e4-80c6e7baeff4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.732251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f81d2e7-16a2-480f-80e4-80c6e7baeff4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.735583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f81d2e7-16a2-480f-80e4-80c6e7baeff4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.739993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f81d2e7-16a2-480f-80e4-80c6e7baeff4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.747072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f81d2e7-16a2-480f-80e4-80c6e7baeff4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.750245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f81d2e7-16a2-480f-80e4-80c6e7baeff4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:46.684069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f81d2e7-16a2-480f-80e4-80c6e7baeff4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:46.716788 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f81d2e7-16a2-480f-80e4-80c6e7baeff4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1666 microversion: 2.1 time: 1.035660 Oct 04 18:32:46.724344 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2984/5956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:45 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1666 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:47.753840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb04e7ef-28dc-48fc-aa7f-d0d67d12c3bb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.755007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb04e7ef-28dc-48fc-aa7f-d0d67d12c3bb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:47.799440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb04e7ef-28dc-48fc-aa7f-d0d67d12c3bb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.804390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb04e7ef-28dc-48fc-aa7f-d0d67d12c3bb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.808523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb04e7ef-28dc-48fc-aa7f-d0d67d12c3bb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.809930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb04e7ef-28dc-48fc-aa7f-d0d67d12c3bb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.813615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb04e7ef-28dc-48fc-aa7f-d0d67d12c3bb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.816363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb04e7ef-28dc-48fc-aa7f-d0d67d12c3bb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.522344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb04e7ef-28dc-48fc-aa7f-d0d67d12c3bb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:48.556675 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb04e7ef-28dc-48fc-aa7f-d0d67d12c3bb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 0.807292 Oct 04 18:32:48.561439 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2973/5957] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:47 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:48.586383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-adff2b2c-78ca-4c8c-b106-c14d833fe577 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.588035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-adff2b2c-78ca-4c8c-b106-c14d833fe577 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:48.615981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adff2b2c-78ca-4c8c-b106-c14d833fe577 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.616849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adff2b2c-78ca-4c8c-b106-c14d833fe577 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.617499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adff2b2c-78ca-4c8c-b106-c14d833fe577 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.618527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adff2b2c-78ca-4c8c-b106-c14d833fe577 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.619225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adff2b2c-78ca-4c8c-b106-c14d833fe577 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.620101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adff2b2c-78ca-4c8c-b106-c14d833fe577 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.628062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:49.612269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-adff2b2c-78ca-4c8c-b106-c14d833fe577 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.627139 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-adff2b2c-78ca-4c8c-b106-c14d833fe577 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1669 microversion: 2.1 time: 1.045775 Oct 04 18:32:49.638688 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2985/5958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:48 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1669 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:49.675275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.675962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:49.709646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.710450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.712190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.714063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.715618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.716436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.825096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:49.849957 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.compute.api [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Working on deleting snapshot c9eec296-f4a1-46d0-9665-4558060f9bb5 from shelved instance... Oct 04 18:32:51.650035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Doing local delete in cell c347de46-5030-4dd1-93a8-9ebc81c486f9(cell1) {{(pid=122332) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 18:32:51.652314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.652958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.653914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.654530 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.compute.api [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 18:32:51.660273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] deallocate_for_instance() {{(pid=122332) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 18:32:53.998439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Updating instance_info_cache with network_info: [] {{(pid=122332) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:32:54.033270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2085bde2-3933-4614-8d0b-28d2e3da027c req-76b36bda-8572-4040-ad24-195a3d4f5fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be1b109-2224-492a-8031-f678a2916ad3", "name": "network-vif-deleted", "tag": "4b90923e-e5bc-4b99-b66d-0f5d4a5e2373"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:54.064048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=20 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:54.066942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2085bde2-3933-4614-8d0b-28d2e3da027c req-76b36bda-8572-4040-ad24-195a3d4f5fb9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:54.067517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2085bde2-3933-4614-8d0b-28d2e3da027c req-76b36bda-8572-4040-ad24-195a3d4f5fb9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:54.068130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2085bde2-3933-4614-8d0b-28d2e3da027c req-76b36bda-8572-4040-ad24-195a3d4f5fb9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.127886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.server_external_events [req-2085bde2-3933-4614-8d0b-28d2e3da027c req-76b36bda-8572-4040-ad24-195a3d4f5fb9 service nova] Unable to find a host for instance 2be1b109-2224-492a-8031-f678a2916ad3. Dropping event network-vif-deleted {{(pid=122331) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:32:54.130767 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2085bde2-3933-4614-8d0b-28d2e3da027c req-76b36bda-8572-4040-ad24-195a3d4f5fb9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.101348 Oct 04 18:32:54.133543 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2986/5959] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 107 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 18:32:54.968348 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e57c402a-fd96-434e-b776-c118beaeb05f tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 204 len: 0 microversion: 2.1 time: 5.299303 Oct 04 18:32:54.972734 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2974/5960] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:49 2022] DELETE /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 0 bytes in 5305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:54.995400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:54.996367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 2be1b109-2224-492a-8031-f678a2916ad3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:55.066373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.067316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.067501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.071485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.072086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.072570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.138277 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] HTTP exception thrown: Instance 2be1b109-2224-492a-8031-f678a2916ad3 could not be found. Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Request method failure captured: Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 HTTP/1.1 Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHm7mFpV7kVpFAe322I0w-WcbToIm9PohY5osCk8OGaLf11RZj0UFUC9tV1q-xeF-UFk10scvNzuB-4ARKIb6Uk8_Dkn_Vutyk6sdZIoaEsZ68K2lUGbQxf2_jK4_bKAgJb8bAbto1H0F1qbEkbEcz9qN0dHaLyRYrtviitofT97XeE Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2ee0993b0954950949c8afffb90617c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}] Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-961264841 Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6591acf0ba4648abac6cc8ac8ddd560e Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 2be1b109-2224-492a-8031-f678a2916ad3 could not be found. Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '2be1b109-2224-492a-8031-f678a2916ad3'} Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be1b109-2224-492a-8031-f678a2916ad3 could not be found. Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be1b109-2224-492a-8031-f678a2916ad3 could not be found. Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:55.145485 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:55.154174 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:55.154174 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:55.154174 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:55.154174 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:55.154174 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:55.154174 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be1b109-2224-492a-8031-f678a2916ad3 could not be found. Oct 04 18:32:55.154174 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:32:55.154174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Returning 404 to user: Instance 2be1b109-2224-492a-8031-f678a2916ad3 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:55.154174 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba117a88-41ac-4d44-bdc8-629cb6aa6314 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3" status: 404 len: 111 microversion: 2.1 time: 0.173503 Oct 04 18:32:55.154174 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2987/5961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:54 2022] GET /compute/v2.1/servers/2be1b109-2224-492a-8031-f678a2916ad3 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:55.167788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0c62a001-fe18-4855-87d4-7cb841884799 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:55.172145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0c62a001-fe18-4855-87d4-7cb841884799 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:55.191553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c62a001-fe18-4855-87d4-7cb841884799 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.192581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c62a001-fe18-4855-87d4-7cb841884799 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.193166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c62a001-fe18-4855-87d4-7cb841884799 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.196393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c62a001-fe18-4855-87d4-7cb841884799 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.197122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c62a001-fe18-4855-87d4-7cb841884799 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.198866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c62a001-fe18-4855-87d4-7cb841884799 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.305048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0c62a001-fe18-4855-87d4-7cb841884799 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:55.384577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:55.588749 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0c62a001-fe18-4855-87d4-7cb841884799 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "DELETE /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 204 len: 0 microversion: 2.1 time: 0.430383 Oct 04 18:32:55.590162 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2975/5962] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:55 2022] DELETE /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:55.598675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-37997c80-41fa-4aff-a5dd-04940b2d787d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:55.599754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-37997c80-41fa-4aff-a5dd-04940b2d787d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:55.615099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37997c80-41fa-4aff-a5dd-04940b2d787d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.621905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37997c80-41fa-4aff-a5dd-04940b2d787d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.622544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37997c80-41fa-4aff-a5dd-04940b2d787d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.624496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37997c80-41fa-4aff-a5dd-04940b2d787d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.625067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37997c80-41fa-4aff-a5dd-04940b2d787d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.628634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-37997c80-41fa-4aff-a5dd-04940b2d787d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.946350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-37997c80-41fa-4aff-a5dd-04940b2d787d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:55.971687 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-37997c80-41fa-4aff-a5dd-04940b2d787d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1465 microversion: 2.1 time: 0.372818 Oct 04 18:32:55.974267 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2988/5963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:55 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1465 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:57.001072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f28c5f2-e85d-4aca-8ba5-dfb99821b3b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:57.003255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4f28c5f2-e85d-4aca-8ba5-dfb99821b3b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:57.011767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f28c5f2-e85d-4aca-8ba5-dfb99821b3b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.017080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f28c5f2-e85d-4aca-8ba5-dfb99821b3b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.017826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f28c5f2-e85d-4aca-8ba5-dfb99821b3b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.018781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f28c5f2-e85d-4aca-8ba5-dfb99821b3b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.020038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f28c5f2-e85d-4aca-8ba5-dfb99821b3b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.020711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f28c5f2-e85d-4aca-8ba5-dfb99821b3b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.764900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4f28c5f2-e85d-4aca-8ba5-dfb99821b3b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.797156 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f28c5f2-e85d-4aca-8ba5-dfb99821b3b9 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1465 microversion: 2.1 time: 0.802843 Oct 04 18:32:57.800287 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2976/5964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:56 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1465 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:58.832406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4e504691-7fa7-4cd3-a924-bc871e9398c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.833804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4e504691-7fa7-4cd3-a924-bc871e9398c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.871593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e504691-7fa7-4cd3-a924-bc871e9398c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.873849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e504691-7fa7-4cd3-a924-bc871e9398c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.879044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e504691-7fa7-4cd3-a924-bc871e9398c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.884872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e504691-7fa7-4cd3-a924-bc871e9398c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.886271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e504691-7fa7-4cd3-a924-bc871e9398c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.889529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e504691-7fa7-4cd3-a924-bc871e9398c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.994375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4e504691-7fa7-4cd3-a924-bc871e9398c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.048461 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4e504691-7fa7-4cd3-a924-bc871e9398c4 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1465 microversion: 2.1 time: 1.215513 Oct 04 18:33:00.050769 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2989/5965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1465 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:00.970895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-92b91ce1-6c00-46bd-9a6a-b14f5a422068 req-695f2053-41b1-44fd-a5dc-8c92fec8603e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71491fc8-2852-4791-b61a-ab099f09a37e", "name": "network-vif-deleted", "tag": "5be61e5e-946e-439c-b904-7bc08044ea77"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:01.054835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:01.086327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d1b1d090-2396-47b8-8192-a5952902515d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.087484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d1b1d090-2396-47b8-8192-a5952902515d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.097942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-92b91ce1-6c00-46bd-9a6a-b14f5a422068 req-695f2053-41b1-44fd-a5dc-8c92fec8603e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.116588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-92b91ce1-6c00-46bd-9a6a-b14f5a422068 req-695f2053-41b1-44fd-a5dc-8c92fec8603e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.118063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-92b91ce1-6c00-46bd-9a6a-b14f5a422068 req-695f2053-41b1-44fd-a5dc-8c92fec8603e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.145424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1b1d090-2396-47b8-8192-a5952902515d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.156916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1b1d090-2396-47b8-8192-a5952902515d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.160950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1b1d090-2396-47b8-8192-a5952902515d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.162203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1b1d090-2396-47b8-8192-a5952902515d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.175550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1b1d090-2396-47b8-8192-a5952902515d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.175550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1b1d090-2396-47b8-8192-a5952902515d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.216202 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-92b91ce1-6c00-46bd-9a6a-b14f5a422068 req-695f2053-41b1-44fd-a5dc-8c92fec8603e service nova] Creating event network-vif-deleted:5be61e5e-946e-439c-b904-7bc08044ea77 for instance 71491fc8-2852-4791-b61a-ab099f09a37e on n-h1-850499-14 Oct 04 18:33:01.245428 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-92b91ce1-6c00-46bd-9a6a-b14f5a422068 req-695f2053-41b1-44fd-a5dc-8c92fec8603e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.284444 Oct 04 18:33:01.254452 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2977/5966] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:01.551452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d1b1d090-2396-47b8-8192-a5952902515d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.590624 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d1b1d090-2396-47b8-8192-a5952902515d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 200 len: 1300 microversion: 2.1 time: 0.519500 Oct 04 18:33:01.597140 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2990/5967] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 1300 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.625684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.627207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 71491fc8-2852-4791-b61a-ab099f09a37e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.668943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.669825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.670602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.687495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.688560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.689360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.756916 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] HTTP exception thrown: Instance 71491fc8-2852-4791-b61a-ab099f09a37e could not be found. Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Request method failure captured: Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e HTTP/1.1 Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHm7mFpV7kVpFAe322I0w-WcbToIm9PohY5osCk8OGaLf11RZj0UFUC9tV1q-xeF-UFk10scvNzuB-4ARKIb6Uk8_Dkn_Vutyk6sdZIoaEsZ68K2lUGbQxf2_jK4_bKAgJb8bAbto1H0F1qbEkbEcz9qN0dHaLyRYrtviitofT97XeE Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2ee0993b0954950949c8afffb90617c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}] Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6591acf0ba4648abac6cc8ac8ddd560e Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 71491fc8-2852-4791-b61a-ab099f09a37e could not be found. Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '71491fc8-2852-4791-b61a-ab099f09a37e'} Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71491fc8-2852-4791-b61a-ab099f09a37e could not be found. Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71491fc8-2852-4791-b61a-ab099f09a37e could not be found. Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:02.770709 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.778441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.778441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:02.778441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:02.778441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:02.778441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:02.778441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71491fc8-2852-4791-b61a-ab099f09a37e could not be found. Oct 04 18:33:02.778441 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.790835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Returning 404 to user: Instance 71491fc8-2852-4791-b61a-ab099f09a37e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:02.792367 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-99dd1c2f-79de-4d3c-ad9a-1aae41d02b01 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e" status: 404 len: 111 microversion: 2.1 time: 0.178818 Oct 04 18:33:02.803617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-710b1a13-4fd1-40d4-82bf-3ba4c07c8263 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.804207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-710b1a13-4fd1-40d4-82bf-3ba4c07c8263 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.808767 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2978/5968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/71491fc8-2852-4791-b61a-ab099f09a37e => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:02.837896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-710b1a13-4fd1-40d4-82bf-3ba4c07c8263 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.845534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-710b1a13-4fd1-40d4-82bf-3ba4c07c8263 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.846194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-710b1a13-4fd1-40d4-82bf-3ba4c07c8263 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.847005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-710b1a13-4fd1-40d4-82bf-3ba4c07c8263 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.854328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-710b1a13-4fd1-40d4-82bf-3ba4c07c8263 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.855360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-710b1a13-4fd1-40d4-82bf-3ba4c07c8263 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.957019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-710b1a13-4fd1-40d4-82bf-3ba4c07c8263 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:03.331758 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-710b1a13-4fd1-40d4-82bf-3ba4c07c8263 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "DELETE /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 204 len: 0 microversion: 2.1 time: 0.532468 Oct 04 18:33:03.342067 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2991/5969] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:02 2022] DELETE /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:33:03.352579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-09e0708e-7ecd-4bf6-b6b6-ce2debd2da58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.353693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-09e0708e-7ecd-4bf6-b6b6-ce2debd2da58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.394317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09e0708e-7ecd-4bf6-b6b6-ce2debd2da58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.395216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09e0708e-7ecd-4bf6-b6b6-ce2debd2da58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.396030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09e0708e-7ecd-4bf6-b6b6-ce2debd2da58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.397315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09e0708e-7ecd-4bf6-b6b6-ce2debd2da58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.398140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09e0708e-7ecd-4bf6-b6b6-ce2debd2da58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.405341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09e0708e-7ecd-4bf6-b6b6-ce2debd2da58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.808151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-09e0708e-7ecd-4bf6-b6b6-ce2debd2da58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.840537 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-09e0708e-7ecd-4bf6-b6b6-ce2debd2da58 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1506 microversion: 2.1 time: 1.493334 Oct 04 18:33:04.849333 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2979/5970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1506 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:05.875269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-55056bcf-f717-4929-a9e7-d514b82937d6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.879151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-55056bcf-f717-4929-a9e7-d514b82937d6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:05.906995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55056bcf-f717-4929-a9e7-d514b82937d6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.922206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55056bcf-f717-4929-a9e7-d514b82937d6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.925857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55056bcf-f717-4929-a9e7-d514b82937d6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.938221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55056bcf-f717-4929-a9e7-d514b82937d6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.942606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55056bcf-f717-4929-a9e7-d514b82937d6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.943212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55056bcf-f717-4929-a9e7-d514b82937d6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.461996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cd0e4343-d915-4779-ba56-342b36a6fb51 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: .version_select at 0x7fd4d1c5b790>, body: {"keypair": {"name": "tempest-keypair-1637643343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcitVIpkmxB5v1M520BBdmcD6TATQ4TwPuBiS72RO7UR81bcTo2/NYbPgyznDP4i+k/hDhVq6jbmagYK6F4wf+hZvGLHMVcPnwM+oHaPhPv3YCr2c/lneauCEfwMailUg=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:06.481862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-55056bcf-f717-4929-a9e7-d514b82937d6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.507578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-cd0e4343-d915-4779-ba56-342b36a6fb51 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for project 6a9c2474d65845eb84b608f305203297. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:06.541461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-cd0e4343-d915-4779-ba56-342b36a6fb51 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for user 0937bdb543864ac4bb2c6f6ea1137525 and project 6a9c2474d65845eb84b608f305203297. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:06.550566 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-55056bcf-f717-4929-a9e7-d514b82937d6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1506 microversion: 2.1 time: 0.681987 Oct 04 18:33:06.565040 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2980/5971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:05 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:06.619327 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cd0e4343-d915-4779-ba56-342b36a6fb51 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.879694 Oct 04 18:33:06.620709 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2992/5972] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:33:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:07.593921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-373e6ab5-ce90-45ca-b770-5d66ebdd8e2c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.603037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-373e6ab5-ce90-45ca-b770-5d66ebdd8e2c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.641607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-373e6ab5-ce90-45ca-b770-5d66ebdd8e2c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.642462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-373e6ab5-ce90-45ca-b770-5d66ebdd8e2c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.649617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-373e6ab5-ce90-45ca-b770-5d66ebdd8e2c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.651408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-373e6ab5-ce90-45ca-b770-5d66ebdd8e2c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.660774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-373e6ab5-ce90-45ca-b770-5d66ebdd8e2c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.664305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-373e6ab5-ce90-45ca-b770-5d66ebdd8e2c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.151892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-373e6ab5-ce90-45ca-b770-5d66ebdd8e2c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.218718 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-373e6ab5-ce90-45ca-b770-5d66ebdd8e2c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1464 microversion: 2.1 time: 0.611561 Oct 04 18:33:08.227306 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2981/5973] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1464 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:08.769268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-65385503-2e73-471e-85cb-f36caa099f7f req-5b79cba0-c271-4dee-ba74-22104e8c41d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991828cf-e0c5-4fa4-8235-1ffcf017fac8", "name": "network-vif-deleted", "tag": "3678b817-c85d-449f-b74c-c69d2558aaf7"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:08.797496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-65385503-2e73-471e-85cb-f36caa099f7f req-5b79cba0-c271-4dee-ba74-22104e8c41d7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.817194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-65385503-2e73-471e-85cb-f36caa099f7f req-5b79cba0-c271-4dee-ba74-22104e8c41d7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.835371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-65385503-2e73-471e-85cb-f36caa099f7f req-5b79cba0-c271-4dee-ba74-22104e8c41d7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.859378 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-65385503-2e73-471e-85cb-f36caa099f7f req-5b79cba0-c271-4dee-ba74-22104e8c41d7 service nova] Creating event network-vif-deleted:3678b817-c85d-449f-b74c-c69d2558aaf7 for instance 991828cf-e0c5-4fa4-8235-1ffcf017fac8 on n-h2-850499-14 Oct 04 18:33:08.897054 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-65385503-2e73-471e-85cb-f36caa099f7f req-5b79cba0-c271-4dee-ba74-22104e8c41d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.474997 Oct 04 18:33:08.898146 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2993/5974] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:09.255437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:09.256246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:09.279033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.279762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.280490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.300642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.301653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.302466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.571280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.572036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.572636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.573263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lazy-loading 'fault' on Instance uuid 991828cf-e0c5-4fa4-8235-1ffcf017fac8 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:09.884922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.919453 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-71336f05-e886-4f67-8500-0f48ceda9430 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 200 len: 1304 microversion: 2.1 time: 0.672749 Oct 04 18:33:09.925024 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2982/5975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 1304 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:10.956708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.957585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 991828cf-e0c5-4fa4-8235-1ffcf017fac8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.978510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.979469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.981288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.984690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.985469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.986140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.028631 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] HTTP exception thrown: Instance 991828cf-e0c5-4fa4-8235-1ffcf017fac8 could not be found. Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Request method failure captured: Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 HTTP/1.1 Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHm7mFpV7kVpFAe322I0w-WcbToIm9PohY5osCk8OGaLf11RZj0UFUC9tV1q-xeF-UFk10scvNzuB-4ARKIb6Uk8_Dkn_Vutyk6sdZIoaEsZ68K2lUGbQxf2_jK4_bKAgJb8bAbto1H0F1qbEkbEcz9qN0dHaLyRYrtviitofT97XeE Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2ee0993b0954950949c8afffb90617c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}] Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6591acf0ba4648abac6cc8ac8ddd560e Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 991828cf-e0c5-4fa4-8235-1ffcf017fac8 could not be found. Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '991828cf-e0c5-4fa4-8235-1ffcf017fac8'} Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991828cf-e0c5-4fa4-8235-1ffcf017fac8 could not be found. Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991828cf-e0c5-4fa4-8235-1ffcf017fac8 could not be found. Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:11.034915 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:33:11.038869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:11.038869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:11.038869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:11.038869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:11.038869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:11.038869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991828cf-e0c5-4fa4-8235-1ffcf017fac8 could not be found. Oct 04 18:33:11.038869 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:33:11.048220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Returning 404 to user: Instance 991828cf-e0c5-4fa4-8235-1ffcf017fac8 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:11.051097 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65482272-83a9-47e2-81e2-8d08840ae809 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8" status: 404 len: 111 microversion: 2.1 time: 0.100461 Oct 04 18:33:11.056479 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2994/5976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/991828cf-e0c5-4fa4-8235-1ffcf017fac8 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:11.069131 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10327a7c-7e9d-480d-91fb-5e4a673b7f2d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:11.069752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10327a7c-7e9d-480d-91fb-5e4a673b7f2d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.127401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10327a7c-7e9d-480d-91fb-5e4a673b7f2d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.128669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10327a7c-7e9d-480d-91fb-5e4a673b7f2d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.129492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10327a7c-7e9d-480d-91fb-5e4a673b7f2d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.130803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10327a7c-7e9d-480d-91fb-5e4a673b7f2d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.131687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10327a7c-7e9d-480d-91fb-5e4a673b7f2d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.132749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10327a7c-7e9d-480d-91fb-5e4a673b7f2d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.201365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10327a7c-7e9d-480d-91fb-5e4a673b7f2d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:11.384531 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10327a7c-7e9d-480d-91fb-5e4a673b7f2d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "DELETE /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 204 len: 0 microversion: 2.1 time: 0.322361 Oct 04 18:33:11.385290 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2983/5977] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:11 2022] DELETE /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:11.394778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3fdee4cc-1698-4662-9d33-5a611972161c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:11.395845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3fdee4cc-1698-4662-9d33-5a611972161c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.411194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fdee4cc-1698-4662-9d33-5a611972161c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.412102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fdee4cc-1698-4662-9d33-5a611972161c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.413132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fdee4cc-1698-4662-9d33-5a611972161c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.414192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fdee4cc-1698-4662-9d33-5a611972161c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.414893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fdee4cc-1698-4662-9d33-5a611972161c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.415646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fdee4cc-1698-4662-9d33-5a611972161c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.275528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3fdee4cc-1698-4662-9d33-5a611972161c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.333472 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3fdee4cc-1698-4662-9d33-5a611972161c tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1495 microversion: 2.1 time: 0.938139 Oct 04 18:33:12.340105 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2995/5978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:11 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1495 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:13.338691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-85ee105f-e0e1-4100-bee9-4a56dc92cdf5 req-8d3d7f6c-2a3b-4234-a16e-efe3119550a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "085114e1-a9d6-41cb-9ac0-e45bf39fc5eb", "name": "network-vif-deleted", "tag": "878f61ba-8bad-4710-adbb-aebf79b2e022"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:13.370750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06cf8981-d647-41c0-83ee-abf5d0accde6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.376269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-06cf8981-d647-41c0-83ee-abf5d0accde6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.438686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-85ee105f-e0e1-4100-bee9-4a56dc92cdf5 req-8d3d7f6c-2a3b-4234-a16e-efe3119550a5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.439780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06cf8981-d647-41c0-83ee-abf5d0accde6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.450910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06cf8981-d647-41c0-83ee-abf5d0accde6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.451815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06cf8981-d647-41c0-83ee-abf5d0accde6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.453679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06cf8981-d647-41c0-83ee-abf5d0accde6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.454479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06cf8981-d647-41c0-83ee-abf5d0accde6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.456949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-85ee105f-e0e1-4100-bee9-4a56dc92cdf5 req-8d3d7f6c-2a3b-4234-a16e-efe3119550a5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.457745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-85ee105f-e0e1-4100-bee9-4a56dc92cdf5 req-8d3d7f6c-2a3b-4234-a16e-efe3119550a5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.462750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06cf8981-d647-41c0-83ee-abf5d0accde6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.520300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-85ee105f-e0e1-4100-bee9-4a56dc92cdf5 req-8d3d7f6c-2a3b-4234-a16e-efe3119550a5 service nova] Creating event network-vif-deleted:878f61ba-8bad-4710-adbb-aebf79b2e022 for instance 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb on n-h1-850499-14 Oct 04 18:33:13.545022 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-85ee105f-e0e1-4100-bee9-4a56dc92cdf5 req-8d3d7f6c-2a3b-4234-a16e-efe3119550a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215997 Oct 04 18:33:13.545646 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2984/5979] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:13.574203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1808292024", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d316594-9bd8-4981-8984-faf6f3eebe9b"}], "security_groups": [{"name": "tempest-securitygroup--1712528812"}], "key_name": "tempest-keypair-1637643343", "user_data": "}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:13.827890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-06cf8981-d647-41c0-83ee-abf5d0accde6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.873334 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-06cf8981-d647-41c0-83ee-abf5d0accde6 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 200 len: 1287 microversion: 2.1 time: 0.517561 Oct 04 18:33:13.887157 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2996/5980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 1287 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:14.096502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] validate_networks() for [('8d316594-9bd8-4981-8984-faf6f3eebe9b', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:14.905643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:14.907522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:14.963498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.977374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.983794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.989128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.989783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.996734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.092607 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] HTTP exception thrown: Instance 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb could not be found. Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Request method failure captured: Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb HTTP/1.1 Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHm7mFpV7kVpFAe322I0w-WcbToIm9PohY5osCk8OGaLf11RZj0UFUC9tV1q-xeF-UFk10scvNzuB-4ARKIb6Uk8_Dkn_Vutyk6sdZIoaEsZ68K2lUGbQxf2_jK4_bKAgJb8bAbto1H0F1qbEkbEcz9qN0dHaLyRYrtviitofT97XeE Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2ee0993b0954950949c8afffb90617c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}] Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6591acf0ba4648abac6cc8ac8ddd560e Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb could not be found. Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '085114e1-a9d6-41cb-9ac0-e45bf39fc5eb'} Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb could not be found. Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb could not be found. Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:15.106131 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:33:15.110670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:15.110670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:15.110670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:15.110670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:15.110670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:15.110670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb could not be found. Oct 04 18:33:15.110670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:33:15.110670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Returning 404 to user: Instance 085114e1-a9d6-41cb-9ac0-e45bf39fc5eb could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:15.111984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-629ad62b-5969-4b06-af8c-76b6d22eb427 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb" status: 404 len: 111 microversion: 2.1 time: 0.213622 Oct 04 18:33:15.120855 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2997/5981] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:14 2022] GET /compute/v2.1/servers/085114e1-a9d6-41cb-9ac0-e45bf39fc5eb => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:15.175308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c8f3098-0b0b-4ddd-a9b2-5ad4b207b852 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:15.176088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2c8f3098-0b0b-4ddd-a9b2-5ad4b207b852 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:15.266472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8f3098-0b0b-4ddd-a9b2-5ad4b207b852 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.272605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8f3098-0b0b-4ddd-a9b2-5ad4b207b852 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.273279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8f3098-0b0b-4ddd-a9b2-5ad4b207b852 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.274287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8f3098-0b0b-4ddd-a9b2-5ad4b207b852 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.274786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8f3098-0b0b-4ddd-a9b2-5ad4b207b852 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.275261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c8f3098-0b0b-4ddd-a9b2-5ad4b207b852 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.464923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2c8f3098-0b0b-4ddd-a9b2-5ad4b207b852 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:15.852782 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c8f3098-0b0b-4ddd-a9b2-5ad4b207b852 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 204 len: 0 microversion: 2.1 time: 0.719968 Oct 04 18:33:15.853385 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2998/5982] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:15 2022] DELETE /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:15.879711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-92df8dd4-074e-44fc-9a3a-55353e034826 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:15.880559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-92df8dd4-074e-44fc-9a3a-55353e034826 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:15.914092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92df8dd4-074e-44fc-9a3a-55353e034826 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.915210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92df8dd4-074e-44fc-9a3a-55353e034826 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.923986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92df8dd4-074e-44fc-9a3a-55353e034826 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.926142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92df8dd4-074e-44fc-9a3a-55353e034826 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.929196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92df8dd4-074e-44fc-9a3a-55353e034826 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.935186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92df8dd4-074e-44fc-9a3a-55353e034826 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.580457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:16.636018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:16.636528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:16.636928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:16.637551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:16.638151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:16.667827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.668597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.669235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.672676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.673422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.679031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.746935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for project 6a9c2474d65845eb84b608f305203297. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:16.768751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for user 0937bdb543864ac4bb2c6f6ea1137525 and project 6a9c2474d65845eb84b608f305203297. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:16.800069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:16.802998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:16.912050 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-793b563b-dac1-4972-a942-bd429f1dadcd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.355634 Oct 04 18:33:16.913466 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2985/5983] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 3358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:16.925991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cf13614f-11c6-40d2-8df2-4df7b31d80ee tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.926995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cf13614f-11c6-40d2-8df2-4df7b31d80ee tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:17.469049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-92df8dd4-074e-44fc-9a3a-55353e034826 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:17.483447 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-92df8dd4-074e-44fc-9a3a-55353e034826 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1675 microversion: 2.1 time: 1.623512 Oct 04 18:33:17.487893 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 2999/5984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:15 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1675 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:17.495508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cf13614f-11c6-40d2-8df2-4df7b31d80ee tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:17.509353 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cf13614f-11c6-40d2-8df2-4df7b31d80ee tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1242 microversion: 2.1 time: 0.582941 Oct 04 18:33:17.509987 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2986/5985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1242 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:18.539952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4489719e-1d17-470b-9a5d-7cb136b69344 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.540637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4489719e-1d17-470b-9a5d-7cb136b69344 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.542559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b053a870-03f0-4e59-ada1-3ae9758221eb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.543441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b053a870-03f0-4e59-ada1-3ae9758221eb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.589346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b053a870-03f0-4e59-ada1-3ae9758221eb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.590236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b053a870-03f0-4e59-ada1-3ae9758221eb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.600202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b053a870-03f0-4e59-ada1-3ae9758221eb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.601581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b053a870-03f0-4e59-ada1-3ae9758221eb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.603052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4489719e-1d17-470b-9a5d-7cb136b69344 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.603804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4489719e-1d17-470b-9a5d-7cb136b69344 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.604370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4489719e-1d17-470b-9a5d-7cb136b69344 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.605756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b053a870-03f0-4e59-ada1-3ae9758221eb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.606571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4489719e-1d17-470b-9a5d-7cb136b69344 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.607105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4489719e-1d17-470b-9a5d-7cb136b69344 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.607555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4489719e-1d17-470b-9a5d-7cb136b69344 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.608519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b053a870-03f0-4e59-ada1-3ae9758221eb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.747431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:20.178631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4489719e-1d17-470b-9a5d-7cb136b69344 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.187469 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4489719e-1d17-470b-9a5d-7cb136b69344 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1238 microversion: 2.1 time: 1.656440 Oct 04 18:33:20.208647 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2987/5986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:18 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1238 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:20.665357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b053a870-03f0-4e59-ada1-3ae9758221eb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.695893 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b053a870-03f0-4e59-ada1-3ae9758221eb tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1675 microversion: 2.1 time: 2.166866 Oct 04 18:33:20.701770 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3000/5987] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:18 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1675 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:21.216565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-133ae3bd-40a8-471c-80d1-637d80fc2c5e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.218913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-133ae3bd-40a8-471c-80d1-637d80fc2c5e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.261479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133ae3bd-40a8-471c-80d1-637d80fc2c5e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.261988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133ae3bd-40a8-471c-80d1-637d80fc2c5e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.262437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133ae3bd-40a8-471c-80d1-637d80fc2c5e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.263188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133ae3bd-40a8-471c-80d1-637d80fc2c5e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.263650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133ae3bd-40a8-471c-80d1-637d80fc2c5e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.264080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-133ae3bd-40a8-471c-80d1-637d80fc2c5e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.509070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-133ae3bd-40a8-471c-80d1-637d80fc2c5e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.520825 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-133ae3bd-40a8-471c-80d1-637d80fc2c5e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1300 microversion: 2.1 time: 0.308831 Oct 04 18:33:21.534983 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2988/5988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1300 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:21.678825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-cb54d67b-ce39-4366-8975-25b6d02b7e70 req-fa4167f3-b36c-4734-8253-36d36acb2bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1681ab-db4a-4528-99da-649ffa9a93a0", "name": "network-vif-deleted", "tag": "2d48ba84-42ef-46d1-b6ba-69e426d07f1c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:21.720446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cb54d67b-ce39-4366-8975-25b6d02b7e70 req-fa4167f3-b36c-4734-8253-36d36acb2bed service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.722265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cb54d67b-ce39-4366-8975-25b6d02b7e70 req-fa4167f3-b36c-4734-8253-36d36acb2bed service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.724592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cb54d67b-ce39-4366-8975-25b6d02b7e70 req-fa4167f3-b36c-4734-8253-36d36acb2bed service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.732172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4d69c1d7-ec01-4cf3-a035-81545d14d776 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.733107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4d69c1d7-ec01-4cf3-a035-81545d14d776 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.755487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d69c1d7-ec01-4cf3-a035-81545d14d776 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.756518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d69c1d7-ec01-4cf3-a035-81545d14d776 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.757857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d69c1d7-ec01-4cf3-a035-81545d14d776 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.759284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d69c1d7-ec01-4cf3-a035-81545d14d776 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.760418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d69c1d7-ec01-4cf3-a035-81545d14d776 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.761188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4d69c1d7-ec01-4cf3-a035-81545d14d776 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.910145 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-cb54d67b-ce39-4366-8975-25b6d02b7e70 req-fa4167f3-b36c-4734-8253-36d36acb2bed service nova] Creating event network-vif-deleted:2d48ba84-42ef-46d1-b6ba-69e426d07f1c for instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 on n-h2-850499-14 Oct 04 18:33:21.953728 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-cb54d67b-ce39-4366-8975-25b6d02b7e70 req-fa4167f3-b36c-4734-8253-36d36acb2bed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281552 Oct 04 18:33:21.958550 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3001/5989] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:22.149618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4d69c1d7-ec01-4cf3-a035-81545d14d776 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6591acf0ba4648abac6cc8ac8ddd560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ee0993b0954950949c8afffb90617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.172493 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4d69c1d7-ec01-4cf3-a035-81545d14d776 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 200 len: 1324 microversion: 2.1 time: 0.444479 Oct 04 18:33:22.174605 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2989/5990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:22.551071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a80d3524-162d-439a-a9ab-66596cc54495 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.551805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a80d3524-162d-439a-a9ab-66596cc54495 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.582367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a80d3524-162d-439a-a9ab-66596cc54495 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.582933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a80d3524-162d-439a-a9ab-66596cc54495 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.586666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a80d3524-162d-439a-a9ab-66596cc54495 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.589304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a80d3524-162d-439a-a9ab-66596cc54495 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.590180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a80d3524-162d-439a-a9ab-66596cc54495 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.595332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a80d3524-162d-439a-a9ab-66596cc54495 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.923323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a80d3524-162d-439a-a9ab-66596cc54495 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.956454 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a80d3524-162d-439a-a9ab-66596cc54495 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1300 microversion: 2.1 time: 0.410920 Oct 04 18:33:22.957294 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3002/5991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1300 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:23.221923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.224638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] [instance: 7b1681ab-db4a-4528-99da-649ffa9a93a0] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:23.248873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.251544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.253111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.257872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.259122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.259821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.279178 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] HTTP exception thrown: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 could not be found. Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Request method failure captured: Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 HTTP/1.1 Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHm7mFpV7kVpFAe322I0w-WcbToIm9PohY5osCk8OGaLf11RZj0UFUC9tV1q-xeF-UFk10scvNzuB-4ARKIb6Uk8_Dkn_Vutyk6sdZIoaEsZ68K2lUGbQxf2_jK4_bKAgJb8bAbto1H0F1qbEkbEcz9qN0dHaLyRYrtviitofT97XeE Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2ee0993b0954950949c8afffb90617c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2ee0993b0954950949c8afffb90617c"}]}] Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: e2ee0993b0954950949c8afffb90617c Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerActionsTestJSON-961264841 Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 6591acf0ba4648abac6cc8ac8ddd560e Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerActionsTestJSON-961264841-project Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 could not be found. Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '7b1681ab-db4a-4528-99da-649ffa9a93a0'} Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 could not be found. Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 could not be found. Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:23.281299 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:33:23.288102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:23.288102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:23.288102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:23.288102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:23.288102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:23.288102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 could not be found. Oct 04 18:33:23.288102 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:33:23.290178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Returning 404 to user: Instance 7b1681ab-db4a-4528-99da-649ffa9a93a0 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:23.291360 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fd4373a6-f60b-4bae-8a8a-1112832e352d tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0" status: 404 len: 111 microversion: 2.1 time: 0.089396 Oct 04 18:33:23.292503 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2990/5992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:23 2022] GET /compute/v2.1/servers/7b1681ab-db4a-4528-99da-649ffa9a93a0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:23.302728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c3aa3e9d-00c7-4977-b16e-4bd4370de813 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] Calling method '.version_select at 0x7fd4d1dd0ca0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.408358 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c3aa3e9d-00c7-4977-b16e-4bd4370de813 tempest-ServerActionsTestJSON-961264841 tempest-ServerActionsTestJSON-961264841-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489579588" status: 202 len: 0 microversion: 2.1 time: 0.104764 Oct 04 18:33:23.415338 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3003/5993] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:33:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489579588 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:23.999119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0a4747dd-085a-46e6-b1d6-d676e8d0be2a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.999975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0a4747dd-085a-46e6-b1d6-d676e8d0be2a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.020233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a4747dd-085a-46e6-b1d6-d676e8d0be2a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.021034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a4747dd-085a-46e6-b1d6-d676e8d0be2a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.022259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a4747dd-085a-46e6-b1d6-d676e8d0be2a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.023675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a4747dd-085a-46e6-b1d6-d676e8d0be2a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.027163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a4747dd-085a-46e6-b1d6-d676e8d0be2a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.028688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a4747dd-085a-46e6-b1d6-d676e8d0be2a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.426259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0a4747dd-085a-46e6-b1d6-d676e8d0be2a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.464891 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0a4747dd-085a-46e6-b1d6-d676e8d0be2a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1368 microversion: 2.1 time: 1.470213 Oct 04 18:33:25.466859 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2991/5994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:23 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1368 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:26.499619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d52a8984-afe8-4350-a356-040a15ab96f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.501031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d52a8984-afe8-4350-a356-040a15ab96f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.525651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:26.532645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d52a8984-afe8-4350-a356-040a15ab96f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.541995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d52a8984-afe8-4350-a356-040a15ab96f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.544205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d52a8984-afe8-4350-a356-040a15ab96f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.549669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d52a8984-afe8-4350-a356-040a15ab96f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.551108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d52a8984-afe8-4350-a356-040a15ab96f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.566004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d52a8984-afe8-4350-a356-040a15ab96f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.248231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d52a8984-afe8-4350-a356-040a15ab96f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.275333 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d52a8984-afe8-4350-a356-040a15ab96f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1368 microversion: 2.1 time: 0.785314 Oct 04 18:33:27.279301 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3004/5995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1368 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:28.316662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ba707b9d-0b6d-4862-a3aa-55e6d3ffccc1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.322279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ba707b9d-0b6d-4862-a3aa-55e6d3ffccc1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:28.333719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:28.341637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:28.378936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba707b9d-0b6d-4862-a3aa-55e6d3ffccc1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.380332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba707b9d-0b6d-4862-a3aa-55e6d3ffccc1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.384018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba707b9d-0b6d-4862-a3aa-55e6d3ffccc1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.386352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba707b9d-0b6d-4862-a3aa-55e6d3ffccc1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.391258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba707b9d-0b6d-4862-a3aa-55e6d3ffccc1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.393302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba707b9d-0b6d-4862-a3aa-55e6d3ffccc1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.464414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:30.040719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ba707b9d-0b6d-4862-a3aa-55e6d3ffccc1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.058631 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ba707b9d-0b6d-4862-a3aa-55e6d3ffccc1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1368 microversion: 2.1 time: 1.745245 Oct 04 18:33:30.062764 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2992/5996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1368 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:30.861638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b2c987b8-6975-4c9a-8bee-72b91ecdcd88 req-766958dd-fb90-4ea4-a24e-bbf70ff18c93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f9317b-677e-4d80-895f-61eede40d94a", "tag": "fe0ac933-f0ca-447f-abf0-26d1057d8443"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:30.938616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b2c987b8-6975-4c9a-8bee-72b91ecdcd88 req-766958dd-fb90-4ea4-a24e-bbf70ff18c93 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.939814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b2c987b8-6975-4c9a-8bee-72b91ecdcd88 req-766958dd-fb90-4ea4-a24e-bbf70ff18c93 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.943369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b2c987b8-6975-4c9a-8bee-72b91ecdcd88 req-766958dd-fb90-4ea4-a24e-bbf70ff18c93 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.006233 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b2c987b8-6975-4c9a-8bee-72b91ecdcd88 req-766958dd-fb90-4ea4-a24e-bbf70ff18c93 service nova] Creating event network-changed:fe0ac933-f0ca-447f-abf0-26d1057d8443 for instance 95f9317b-677e-4d80-895f-61eede40d94a on n-h1-850499-14 Oct 04 18:33:31.021796 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b2c987b8-6975-4c9a-8bee-72b91ecdcd88 req-766958dd-fb90-4ea4-a24e-bbf70ff18c93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172340 Oct 04 18:33:31.031608 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3005/5997] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:31.092501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7faf52e3-5532-415b-a0ae-dfaf858e09f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:31.094561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7faf52e3-5532-415b-a0ae-dfaf858e09f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:31.147469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7faf52e3-5532-415b-a0ae-dfaf858e09f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.147992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7faf52e3-5532-415b-a0ae-dfaf858e09f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.148454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7faf52e3-5532-415b-a0ae-dfaf858e09f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.149333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7faf52e3-5532-415b-a0ae-dfaf858e09f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.153450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7faf52e3-5532-415b-a0ae-dfaf858e09f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.155633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7faf52e3-5532-415b-a0ae-dfaf858e09f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.011283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7faf52e3-5532-415b-a0ae-dfaf858e09f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.036199 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7faf52e3-5532-415b-a0ae-dfaf858e09f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1368 microversion: 2.1 time: 0.941355 Oct 04 18:33:32.036900 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2993/5998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:31 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1368 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:33.099467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27e18109-9299-44df-8267-f80280b146f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.100556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27e18109-9299-44df-8267-f80280b146f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.150128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27e18109-9299-44df-8267-f80280b146f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.151147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27e18109-9299-44df-8267-f80280b146f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.152021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27e18109-9299-44df-8267-f80280b146f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.153196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27e18109-9299-44df-8267-f80280b146f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.156162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27e18109-9299-44df-8267-f80280b146f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.158175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27e18109-9299-44df-8267-f80280b146f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.768843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27e18109-9299-44df-8267-f80280b146f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:34.787242 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27e18109-9299-44df-8267-f80280b146f6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1368 microversion: 2.1 time: 1.699511 Oct 04 18:33:34.803532 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3006/5999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1368 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:35.820827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d5079326-0a87-4d5b-bbed-082eb5f04c84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.821759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d5079326-0a87-4d5b-bbed-082eb5f04c84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.840536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:35.842673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5079326-0a87-4d5b-bbed-082eb5f04c84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.849011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5079326-0a87-4d5b-bbed-082eb5f04c84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.849808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5079326-0a87-4d5b-bbed-082eb5f04c84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.854258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5079326-0a87-4d5b-bbed-082eb5f04c84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.863375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5079326-0a87-4d5b-bbed-082eb5f04c84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.864351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5079326-0a87-4d5b-bbed-082eb5f04c84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.602891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d5079326-0a87-4d5b-bbed-082eb5f04c84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.623422 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d5079326-0a87-4d5b-bbed-082eb5f04c84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1368 microversion: 2.1 time: 0.808454 Oct 04 18:33:36.640059 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2994/6000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1368 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:37.652406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7afaa884-1b50-4388-afae-9339562fe847 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.654429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7afaa884-1b50-4388-afae-9339562fe847 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.675849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7afaa884-1b50-4388-afae-9339562fe847 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.680312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7afaa884-1b50-4388-afae-9339562fe847 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.683324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7afaa884-1b50-4388-afae-9339562fe847 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.690081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7afaa884-1b50-4388-afae-9339562fe847 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.694785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7afaa884-1b50-4388-afae-9339562fe847 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.695341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7afaa884-1b50-4388-afae-9339562fe847 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.284559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7afaa884-1b50-4388-afae-9339562fe847 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.295002 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7afaa884-1b50-4388-afae-9339562fe847 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1368 microversion: 2.1 time: 0.646602 Oct 04 18:33:38.299056 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3007/6001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1368 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:39.322223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cb96b16a-7219-4d7f-a599-d7ed5c239fe2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.322765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cb96b16a-7219-4d7f-a599-d7ed5c239fe2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.342105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb96b16a-7219-4d7f-a599-d7ed5c239fe2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.348055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb96b16a-7219-4d7f-a599-d7ed5c239fe2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.348796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb96b16a-7219-4d7f-a599-d7ed5c239fe2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.354075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb96b16a-7219-4d7f-a599-d7ed5c239fe2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.356049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb96b16a-7219-4d7f-a599-d7ed5c239fe2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.367278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb96b16a-7219-4d7f-a599-d7ed5c239fe2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.983119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cb96b16a-7219-4d7f-a599-d7ed5c239fe2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.995247 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cb96b16a-7219-4d7f-a599-d7ed5c239fe2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1368 microversion: 2.1 time: 0.676847 Oct 04 18:33:40.001782 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2995/6002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1368 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:41.036507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.038409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.276155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.276155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.276155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.276155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.276155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.276155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.387670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-db1087af-fbfb-44ba-ac6f-dae209a39de9 req-9bff6644-9a58-4c50-b0ef-32202b6f6c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f9317b-677e-4d80-895f-61eede40d94a", "name": "network-vif-plugged", "status": "completed", "tag": "fe0ac933-f0ca-447f-abf0-26d1057d8443"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:41.407498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db1087af-fbfb-44ba-ac6f-dae209a39de9 req-9bff6644-9a58-4c50-b0ef-32202b6f6c1b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.408000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db1087af-fbfb-44ba-ac6f-dae209a39de9 req-9bff6644-9a58-4c50-b0ef-32202b6f6c1b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.411409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db1087af-fbfb-44ba-ac6f-dae209a39de9 req-9bff6644-9a58-4c50-b0ef-32202b6f6c1b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.442937 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-db1087af-fbfb-44ba-ac6f-dae209a39de9 req-9bff6644-9a58-4c50-b0ef-32202b6f6c1b service nova] Creating event network-vif-plugged:fe0ac933-f0ca-447f-abf0-26d1057d8443 for instance 95f9317b-677e-4d80-895f-61eede40d94a on n-h1-850499-14 Oct 04 18:33:41.459094 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-db1087af-fbfb-44ba-ac6f-dae209a39de9 req-9bff6644-9a58-4c50-b0ef-32202b6f6c1b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.602788 Oct 04 18:33:41.464585 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3008/6003] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:41.862935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.877738 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1368 microversion: 2.1 time: 0.850676 Oct 04 18:33:41.881596 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2996/6004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1368 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:42.917423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.918160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.941953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.942538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.944511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.945330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.945818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.953625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.363689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.378517 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1368 microversion: 2.1 time: 0.476467 Oct 04 18:33:43.380194 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3009/6005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1368 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:43.876478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.877480 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001350 Oct 04 18:33:43.878163 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2997/6006] 10.222.0.18 () {56 vars in 886 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 04 18:33:43.886027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.887420 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001915 Oct 04 18:33:43.888339 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3010/6007] 10.222.0.18 () {54 vars in 1035 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 04 18:33:43.897173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.898646 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1e93356-e905-4e27-b657-afcd615e041c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001951 Oct 04 18:33:43.899394 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2998/6008] 10.222.0.18 () {54 vars in 1041 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:43.908543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.910041 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-03c14a0c-ee1f-4bf8-b897-e9b06df09fe4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001543 Oct 04 18:33:43.915629 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3011/6009] 10.222.0.18 () {56 vars in 886 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:33:44.404492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-540a27e6-8f0a-4920-a9d3-dbac5eef14fd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.406345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-540a27e6-8f0a-4920-a9d3-dbac5eef14fd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.432014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-540a27e6-8f0a-4920-a9d3-dbac5eef14fd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.433684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-540a27e6-8f0a-4920-a9d3-dbac5eef14fd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.434229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-540a27e6-8f0a-4920-a9d3-dbac5eef14fd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.437028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-540a27e6-8f0a-4920-a9d3-dbac5eef14fd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.437827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-540a27e6-8f0a-4920-a9d3-dbac5eef14fd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.439043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-540a27e6-8f0a-4920-a9d3-dbac5eef14fd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.627213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-540a27e6-8f0a-4920-a9d3-dbac5eef14fd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.635376 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-540a27e6-8f0a-4920-a9d3-dbac5eef14fd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1557 microversion: 2.1 time: 1.235700 Oct 04 18:33:45.648167 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 2999/6010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1557 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:45.673862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75312287-78f8-4956-b3ea-f4b66ad47444 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.674504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75312287-78f8-4956-b3ea-f4b66ad47444 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.693927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75312287-78f8-4956-b3ea-f4b66ad47444 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.694470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75312287-78f8-4956-b3ea-f4b66ad47444 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.695042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75312287-78f8-4956-b3ea-f4b66ad47444 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.695878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75312287-78f8-4956-b3ea-f4b66ad47444 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.696874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75312287-78f8-4956-b3ea-f4b66ad47444 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.697448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75312287-78f8-4956-b3ea-f4b66ad47444 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.850771 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75312287-78f8-4956-b3ea-f4b66ad47444 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170437 Oct 04 18:33:45.850771 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3012/6011] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:49.030173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-966fca24-b339-4005-a120-62a568c40cfb req-5f18d9fd-ba20-4082-a3a6-2dee82af98d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f9317b-677e-4d80-895f-61eede40d94a", "tag": "fe0ac933-f0ca-447f-abf0-26d1057d8443"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:49.086496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-966fca24-b339-4005-a120-62a568c40cfb req-5f18d9fd-ba20-4082-a3a6-2dee82af98d0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.086496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-966fca24-b339-4005-a120-62a568c40cfb req-5f18d9fd-ba20-4082-a3a6-2dee82af98d0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.086496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-966fca24-b339-4005-a120-62a568c40cfb req-5f18d9fd-ba20-4082-a3a6-2dee82af98d0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.127092 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-966fca24-b339-4005-a120-62a568c40cfb req-5f18d9fd-ba20-4082-a3a6-2dee82af98d0 service nova] Creating event network-changed:fe0ac933-f0ca-447f-abf0-26d1057d8443 for instance 95f9317b-677e-4d80-895f-61eede40d94a on n-h1-850499-14 Oct 04 18:33:49.137188 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-966fca24-b339-4005-a120-62a568c40cfb req-5f18d9fd-ba20-4082-a3a6-2dee82af98d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110327 Oct 04 18:33:49.138591 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3000/6012] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:23.903686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=13 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:23.905678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=45 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:23.923527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-263b9c18-037d-488f-8e56-a92fca9752f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:23.929588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-263b9c18-037d-488f-8e56-a92fca9752f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:23.966607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-263b9c18-037d-488f-8e56-a92fca9752f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.967916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-263b9c18-037d-488f-8e56-a92fca9752f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.973595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-263b9c18-037d-488f-8e56-a92fca9752f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.975482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-263b9c18-037d-488f-8e56-a92fca9752f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.980546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-263b9c18-037d-488f-8e56-a92fca9752f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.981348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-263b9c18-037d-488f-8e56-a92fca9752f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.097900 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-263b9c18-037d-488f-8e56-a92fca9752f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/ips" status: 200 len: 148 microversion: 2.1 time: 0.197710 Oct 04 18:34:24.103223 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3013/6013] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:34:23 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/ips => generated 148 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:27.190447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2f7aab49-6e79-4004-bbca-302e5bed17e4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99ffab7a-1543-4048-a552-e26b7df8b795"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:27.194120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2f7aab49-6e79-4004-bbca-302e5bed17e4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.198324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=9 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:27.204053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=37 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:27.222222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7aab49-6e79-4004-bbca-302e5bed17e4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.223975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7aab49-6e79-4004-bbca-302e5bed17e4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.224451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7aab49-6e79-4004-bbca-302e5bed17e4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.225891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7aab49-6e79-4004-bbca-302e5bed17e4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.226593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7aab49-6e79-4004-bbca-302e5bed17e4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.228357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f7aab49-6e79-4004-bbca-302e5bed17e4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.874996 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2f7aab49-6e79-4004-bbca-302e5bed17e4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689685 Oct 04 18:34:27.877638 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3001/6014] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:34:27 2022] POST /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:45.507955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c98f8bc7-7427-4d8a-95d2-df97b69e4323 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: .version_select at 0x7fd4d13253a0>, body: {"keypair": {"name": "tempest-keypair-1651849455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBER26kuaUjIz1JtQ0B1BTu9LOoj4pmLGD5Qas6UOw20W9UjJ02cPlIgxuza2++DtJnOh0pa5BxAIEFMRzuAxUxI5qPmuv0DfFhMD/gXrK5TJuJ2x5PYFzi1l97aCZiS5pg=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:45.526260 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:34:45.526946 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 18:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.18) !!! Oct 04 18:34:45.530878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:45.533465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:45.634292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-c98f8bc7-7427-4d8a-95d2-df97b69e4323 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for project 6a9c2474d65845eb84b608f305203297. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:45.651528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-c98f8bc7-7427-4d8a-95d2-df97b69e4323 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for user 0937bdb543864ac4bb2c6f6ea1137525 and project 6a9c2474d65845eb84b608f305203297. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:45.729349 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c98f8bc7-7427-4d8a-95d2-df97b69e4323 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.227676 Oct 04 18:34:45.730747 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3014/6015] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:34:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:48.713033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:48.714561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:48.720111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-125901122", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d316594-9bd8-4981-8984-faf6f3eebe9b"}], "security_groups": [{"name": "tempest-securitygroup--903743655"}], "key_name": "tempest-keypair-1651849455", "user_data": "}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:48.973961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] validate_networks() for [('8d316594-9bd8-4981-8984-faf6f3eebe9b', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:49.828671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:49.829272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:49.829696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:49.830163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:49.830633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:49.855283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.858336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.859342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.864550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.866586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.868819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.933724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for project 6a9c2474d65845eb84b608f305203297. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:49.944807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for user 0937bdb543864ac4bb2c6f6ea1137525 and project 6a9c2474d65845eb84b608f305203297. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:49.961251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:49.964456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:50.053453 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f518ca6d-e00e-4bcf-865a-b48a69959f93 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.341905 Oct 04 18:34:50.055391 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3002/6016] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:50.071579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef219524-fe98-4ccb-9af0-8a4dcbd9bfd7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:50.073096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef219524-fe98-4ccb-9af0-8a4dcbd9bfd7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:50.224291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef219524-fe98-4ccb-9af0-8a4dcbd9bfd7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.231458 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef219524-fe98-4ccb-9af0-8a4dcbd9bfd7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1241 microversion: 2.1 time: 0.165604 Oct 04 18:34:50.232086 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3015/6017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1241 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:51.258679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52958634-06f2-4e8a-9604-54ffa3675d72 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.260151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-52958634-06f2-4e8a-9604-54ffa3675d72 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.269261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52958634-06f2-4e8a-9604-54ffa3675d72 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.269769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52958634-06f2-4e8a-9604-54ffa3675d72 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.270222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52958634-06f2-4e8a-9604-54ffa3675d72 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.270940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52958634-06f2-4e8a-9604-54ffa3675d72 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.271710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52958634-06f2-4e8a-9604-54ffa3675d72 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.272513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52958634-06f2-4e8a-9604-54ffa3675d72 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.377569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-52958634-06f2-4e8a-9604-54ffa3675d72 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.390488 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-52958634-06f2-4e8a-9604-54ffa3675d72 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1237 microversion: 2.1 time: 0.136222 Oct 04 18:34:51.391823 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3003/6018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1237 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:52.418417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d825141a-a101-44a5-a995-5144f7a26ca3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:52.419137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d825141a-a101-44a5-a995-5144f7a26ca3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:52.434197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d825141a-a101-44a5-a995-5144f7a26ca3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.434678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d825141a-a101-44a5-a995-5144f7a26ca3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.435180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d825141a-a101-44a5-a995-5144f7a26ca3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.435889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d825141a-a101-44a5-a995-5144f7a26ca3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.436884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d825141a-a101-44a5-a995-5144f7a26ca3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.439217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d825141a-a101-44a5-a995-5144f7a26ca3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.547102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d825141a-a101-44a5-a995-5144f7a26ca3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:52.556014 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d825141a-a101-44a5-a995-5144f7a26ca3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1299 microversion: 2.1 time: 0.142090 Oct 04 18:34:52.566007 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3016/6019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:52 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:53.582081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e326bb6f-8f50-45db-ba38-7879ab5a16b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:53.582716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e326bb6f-8f50-45db-ba38-7879ab5a16b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:53.595096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e326bb6f-8f50-45db-ba38-7879ab5a16b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.595626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e326bb6f-8f50-45db-ba38-7879ab5a16b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.596078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e326bb6f-8f50-45db-ba38-7879ab5a16b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.596819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e326bb6f-8f50-45db-ba38-7879ab5a16b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.597282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e326bb6f-8f50-45db-ba38-7879ab5a16b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.597715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e326bb6f-8f50-45db-ba38-7879ab5a16b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.760279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e326bb6f-8f50-45db-ba38-7879ab5a16b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.770057 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e326bb6f-8f50-45db-ba38-7879ab5a16b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1366 microversion: 2.1 time: 0.192264 Oct 04 18:34:53.787204 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3004/6020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:53 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:54.393420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c6081d9d-1e82-47f7-82fd-d0e03afff028 req-da15b44c-b74f-47a8-b617-83d176d731fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2c5fd6-c295-45b0-8050-678b4819c499", "tag": "b0b3802c-9982-41a0-959f-82f543a2ddd7"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:54.447367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c6081d9d-1e82-47f7-82fd-d0e03afff028 req-da15b44c-b74f-47a8-b617-83d176d731fc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.448533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c6081d9d-1e82-47f7-82fd-d0e03afff028 req-da15b44c-b74f-47a8-b617-83d176d731fc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.449196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c6081d9d-1e82-47f7-82fd-d0e03afff028 req-da15b44c-b74f-47a8-b617-83d176d731fc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.488481 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c6081d9d-1e82-47f7-82fd-d0e03afff028 req-da15b44c-b74f-47a8-b617-83d176d731fc service nova] Creating event network-changed:b0b3802c-9982-41a0-959f-82f543a2ddd7 for instance ca2c5fd6-c295-45b0-8050-678b4819c499 on n-h2-850499-14 Oct 04 18:34:54.502902 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c6081d9d-1e82-47f7-82fd-d0e03afff028 req-da15b44c-b74f-47a8-b617-83d176d731fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118197 Oct 04 18:34:54.504538 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3017/6021] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:54.797512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b4b86cbc-78ea-4a5f-a848-973f7c285b8b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.798874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4b86cbc-78ea-4a5f-a848-973f7c285b8b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.822775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b86cbc-78ea-4a5f-a848-973f7c285b8b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.823670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b86cbc-78ea-4a5f-a848-973f7c285b8b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.825333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b86cbc-78ea-4a5f-a848-973f7c285b8b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.829542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b86cbc-78ea-4a5f-a848-973f7c285b8b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.830382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b86cbc-78ea-4a5f-a848-973f7c285b8b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.832560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4b86cbc-78ea-4a5f-a848-973f7c285b8b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.494443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b4b86cbc-78ea-4a5f-a848-973f7c285b8b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:55.504589 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b4b86cbc-78ea-4a5f-a848-973f7c285b8b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1366 microversion: 2.1 time: 0.713598 Oct 04 18:34:55.510304 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3005/6022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1366 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:56.557313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0e28ffa5-6dc9-4726-8724-4da2a7dfcd87 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.562044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0e28ffa5-6dc9-4726-8724-4da2a7dfcd87 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:56.572634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e28ffa5-6dc9-4726-8724-4da2a7dfcd87 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.573372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e28ffa5-6dc9-4726-8724-4da2a7dfcd87 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.574544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e28ffa5-6dc9-4726-8724-4da2a7dfcd87 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.575533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e28ffa5-6dc9-4726-8724-4da2a7dfcd87 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.576189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e28ffa5-6dc9-4726-8724-4da2a7dfcd87 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.576846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e28ffa5-6dc9-4726-8724-4da2a7dfcd87 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.810672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0e28ffa5-6dc9-4726-8724-4da2a7dfcd87 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.823047 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0e28ffa5-6dc9-4726-8724-4da2a7dfcd87 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1366 microversion: 2.1 time: 0.287692 Oct 04 18:34:56.836245 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3018/6023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:57.850476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4fe58613-afce-4186-928f-26d263d6d328 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.851829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4fe58613-afce-4186-928f-26d263d6d328 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:57.864922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fe58613-afce-4186-928f-26d263d6d328 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.865718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fe58613-afce-4186-928f-26d263d6d328 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.869547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fe58613-afce-4186-928f-26d263d6d328 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.871577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fe58613-afce-4186-928f-26d263d6d328 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.873121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fe58613-afce-4186-928f-26d263d6d328 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.875507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fe58613-afce-4186-928f-26d263d6d328 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.516845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4fe58613-afce-4186-928f-26d263d6d328 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.556344 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4fe58613-afce-4186-928f-26d263d6d328 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1366 microversion: 2.1 time: 0.710103 Oct 04 18:34:58.560810 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3006/6024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1366 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:59.600751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a72e0d9b-377a-479b-9eec-928d2f7eec40 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:59.601379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a72e0d9b-377a-479b-9eec-928d2f7eec40 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:59.638187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a72e0d9b-377a-479b-9eec-928d2f7eec40 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.642291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a72e0d9b-377a-479b-9eec-928d2f7eec40 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.643478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a72e0d9b-377a-479b-9eec-928d2f7eec40 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.646814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a72e0d9b-377a-479b-9eec-928d2f7eec40 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.649961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a72e0d9b-377a-479b-9eec-928d2f7eec40 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.651920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a72e0d9b-377a-479b-9eec-928d2f7eec40 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.229422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:00.267818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a72e0d9b-377a-479b-9eec-928d2f7eec40 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:00.276791 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a72e0d9b-377a-479b-9eec-928d2f7eec40 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1366 microversion: 2.1 time: 0.682226 Oct 04 18:35:00.285477 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3019/6025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:59 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1366 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:01.276262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1f1c3ea3-e44a-44fd-aa0f-b1942f7e1fb1 req-5a3e09f5-c049-49eb-b738-4741217dff27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2c5fd6-c295-45b0-8050-678b4819c499", "name": "network-vif-plugged", "status": "completed", "tag": "b0b3802c-9982-41a0-959f-82f543a2ddd7"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:01.313893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d0fed0c-2462-4600-b9cf-7b16dc191280 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:01.315166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5d0fed0c-2462-4600-b9cf-7b16dc191280 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:01.320212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:01.324596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:01.328672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1f1c3ea3-e44a-44fd-aa0f-b1942f7e1fb1 req-5a3e09f5-c049-49eb-b738-4741217dff27 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.329647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d0fed0c-2462-4600-b9cf-7b16dc191280 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.330321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d0fed0c-2462-4600-b9cf-7b16dc191280 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.331043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1f1c3ea3-e44a-44fd-aa0f-b1942f7e1fb1 req-5a3e09f5-c049-49eb-b738-4741217dff27 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.331652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d0fed0c-2462-4600-b9cf-7b16dc191280 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.332254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1f1c3ea3-e44a-44fd-aa0f-b1942f7e1fb1 req-5a3e09f5-c049-49eb-b738-4741217dff27 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.333151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d0fed0c-2462-4600-b9cf-7b16dc191280 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.335543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d0fed0c-2462-4600-b9cf-7b16dc191280 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.336164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d0fed0c-2462-4600-b9cf-7b16dc191280 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.372015 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1f1c3ea3-e44a-44fd-aa0f-b1942f7e1fb1 req-5a3e09f5-c049-49eb-b738-4741217dff27 service nova] Creating event network-vif-plugged:b0b3802c-9982-41a0-959f-82f543a2ddd7 for instance ca2c5fd6-c295-45b0-8050-678b4819c499 on n-h2-850499-14 Oct 04 18:35:01.394704 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1f1c3ea3-e44a-44fd-aa0f-b1942f7e1fb1 req-5a3e09f5-c049-49eb-b738-4741217dff27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110436 Oct 04 18:35:01.396027 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3007/6026] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:01.618637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5d0fed0c-2462-4600-b9cf-7b16dc191280 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.648773 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d0fed0c-2462-4600-b9cf-7b16dc191280 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1366 microversion: 2.1 time: 0.336398 Oct 04 18:35:01.650360 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3020/6027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:01 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:02.688289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3bd02d9c-98cd-4fd3-a7df-d88ede44659f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:02.694050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3bd02d9c-98cd-4fd3-a7df-d88ede44659f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:02.719967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bd02d9c-98cd-4fd3-a7df-d88ede44659f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.720793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bd02d9c-98cd-4fd3-a7df-d88ede44659f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.722894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bd02d9c-98cd-4fd3-a7df-d88ede44659f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.725303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bd02d9c-98cd-4fd3-a7df-d88ede44659f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.727768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bd02d9c-98cd-4fd3-a7df-d88ede44659f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.728537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bd02d9c-98cd-4fd3-a7df-d88ede44659f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.422380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3bd02d9c-98cd-4fd3-a7df-d88ede44659f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.475980 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3bd02d9c-98cd-4fd3-a7df-d88ede44659f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1366 microversion: 2.1 time: 0.804048 Oct 04 18:35:03.481125 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3008/6028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1366 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:04.507061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7fce4b22-1419-4058-9727-239a3bd7654a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:04.508239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7fce4b22-1419-4058-9727-239a3bd7654a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:04.529735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7fce4b22-1419-4058-9727-239a3bd7654a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.530669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7fce4b22-1419-4058-9727-239a3bd7654a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.532834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7fce4b22-1419-4058-9727-239a3bd7654a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.540608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7fce4b22-1419-4058-9727-239a3bd7654a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.549224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7fce4b22-1419-4058-9727-239a3bd7654a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.550550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7fce4b22-1419-4058-9727-239a3bd7654a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.034871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7fce4b22-1419-4058-9727-239a3bd7654a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.046718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7fce4b22-1419-4058-9727-239a3bd7654a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1555 microversion: 2.1 time: 0.545803 Oct 04 18:35:05.060669 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3021/6029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:04 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1555 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:05.077887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-57dd6f9a-1440-4d47-bcc3-2a32b2fb36b1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:05.086175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57dd6f9a-1440-4d47-bcc3-2a32b2fb36b1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:05.109081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57dd6f9a-1440-4d47-bcc3-2a32b2fb36b1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.110564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57dd6f9a-1440-4d47-bcc3-2a32b2fb36b1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.114675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57dd6f9a-1440-4d47-bcc3-2a32b2fb36b1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.116214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57dd6f9a-1440-4d47-bcc3-2a32b2fb36b1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.116888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57dd6f9a-1440-4d47-bcc3-2a32b2fb36b1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.117504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57dd6f9a-1440-4d47-bcc3-2a32b2fb36b1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.307923 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-57dd6f9a-1440-4d47-bcc3-2a32b2fb36b1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238348 Oct 04 18:35:05.309351 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3009/6030] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:35:05 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:09.467111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-a422c87b-0c65-44fb-a6a6-dcbf57fe9b09 req-cd7796ac-8cbf-4723-90a6-03d7f0f985b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2c5fd6-c295-45b0-8050-678b4819c499", "tag": "b0b3802c-9982-41a0-959f-82f543a2ddd7"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:09.489248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a422c87b-0c65-44fb-a6a6-dcbf57fe9b09 req-cd7796ac-8cbf-4723-90a6-03d7f0f985b4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:09.490088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a422c87b-0c65-44fb-a6a6-dcbf57fe9b09 req-cd7796ac-8cbf-4723-90a6-03d7f0f985b4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:09.492858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a422c87b-0c65-44fb-a6a6-dcbf57fe9b09 req-cd7796ac-8cbf-4723-90a6-03d7f0f985b4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:09.531454 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-a422c87b-0c65-44fb-a6a6-dcbf57fe9b09 req-cd7796ac-8cbf-4723-90a6-03d7f0f985b4 service nova] Creating event network-changed:b0b3802c-9982-41a0-959f-82f543a2ddd7 for instance ca2c5fd6-c295-45b0-8050-678b4819c499 on n-h2-850499-14 Oct 04 18:35:09.555894 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-a422c87b-0c65-44fb-a6a6-dcbf57fe9b09 req-cd7796ac-8cbf-4723-90a6-03d7f0f985b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088871 Oct 04 18:35:09.559976 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3022/6031] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:24.004409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:24.008023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=38 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:24.201981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee88a95c-bc1b-454a-bf2e-45e7deff2595 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1731028322", "availability_zone": "foo_zone"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:24.206343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.aggregate [None req-ee88a95c-bc1b-454a-bf2e-45e7deff2595 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Generated uuid 88079270-8a1d-4726-bb23-5be91d19c8b5 for aggregate {{(pid=122332) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:35:24.283391 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee88a95c-bc1b-454a-bf2e-45e7deff2595 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.284753 Oct 04 18:35:24.288239 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3010/6032] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 4 18:35:23 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:24.301356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f1b49819-ce22-4651-847f-d8b996ef7b08 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:24.306881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:24.313833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=34 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:24.406580 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f1b49819-ce22-4651-847f-d8b996ef7b08 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.109726 Oct 04 18:35:24.413447 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3023/6033] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:35:24 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:24.419130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ba6a628a-48cc-43a6-ba3d-3380e46c1b46 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.423995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba6a628a-48cc-43a6-ba3d-3380e46c1b46 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.428190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba6a628a-48cc-43a6-ba3d-3380e46c1b46 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.428763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba6a628a-48cc-43a6-ba3d-3380e46c1b46 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.430896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba6a628a-48cc-43a6-ba3d-3380e46c1b46 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.437018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba6a628a-48cc-43a6-ba3d-3380e46c1b46 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.437597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba6a628a-48cc-43a6-ba3d-3380e46c1b46 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.508524 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ba6a628a-48cc-43a6-ba3d-3380e46c1b46 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.093023 Oct 04 18:35:24.520380 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3011/6034] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:24.521727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-995acce7-e466-4562-ba98-0885242313b7 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.540057 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-995acce7-e466-4562-ba98-0885242313b7 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.019292 Oct 04 18:35:24.541807 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3024/6035] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:24.553814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70c4be4a-0746-4dc0-9b59-1caf76297a16 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-14"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:24.577913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70c4be4a-0746-4dc0-9b59-1caf76297a16 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.580412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70c4be4a-0746-4dc0-9b59-1caf76297a16 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.581117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70c4be4a-0746-4dc0-9b59-1caf76297a16 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.884243 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70c4be4a-0746-4dc0-9b59-1caf76297a16 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.333866 Oct 04 18:35:24.887293 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3012/6036] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:35:24 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:24.898810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4e00eac5-4a1b-4d58-af33-5f88374b0a32 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.916855 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4e00eac5-4a1b-4d58-af33-5f88374b0a32 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.021682 Oct 04 18:35:24.917662 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3025/6037] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:24.934030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-89a5f78c-051c-4f73-9693-2294ff74da38 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-521603199", "availability_zone": "foo_zone"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:25.080058 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-89a5f78c-051c-4f73-9693-2294ff74da38 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.153576 Oct 04 18:35:25.087794 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3013/6038] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 4 18:35:24 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:25.102822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-adf5aa9c-cb82-476b-b64b-f9c50b7e5102 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:25.189177 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-adf5aa9c-cb82-476b-b64b-f9c50b7e5102 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.099271 Oct 04 18:35:25.189805 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3026/6039] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:35:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:25.202822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-feb0a6e5-aabe-4694-a518-95b7b01a02c1 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:25.234164 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-feb0a6e5-aabe-4694-a518-95b7b01a02c1 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.035905 Oct 04 18:35:25.241387 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3014/6040] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 4 18:35:25 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:25.247073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d70dc7a9-e889-4687-bd86-150e207df674 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-14"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:25.268022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d70dc7a9-e889-4687-bd86-150e207df674 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.268689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d70dc7a9-e889-4687-bd86-150e207df674 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.271476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d70dc7a9-e889-4687-bd86-150e207df674 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.829254 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d70dc7a9-e889-4687-bd86-150e207df674 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.586393 Oct 04 18:35:25.832299 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3027/6041] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 4 18:35:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:25.845017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9dc8d06b-41e3-4e20-9d77-766a2d62fe95 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:25.895449 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9dc8d06b-41e3-4e20-9d77-766a2d62fe95 tempest-TestAggregatesBasicOps-1093284971 tempest-TestAggregatesBasicOps-1093284971-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.054047 Oct 04 18:35:25.897361 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3015/6042] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:35:25 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:35:49.366220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:49.367305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:49.927551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b5541e0f-ab27-4917-a3d1-b2645611a01d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'create', calling method: .version_select at 0x7fd4d1bf4550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1601179524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ+SrwtKkCwKyfPPXjf+LUmWJdT23U67gmcm0ZK9oguR0jgl0i+q7rvC7XGL+lo5saCfZvc9zjQjiL0aCY/CV4M7cCE39qEYdCc7ZXWMZsXEaAqi520erU8bhBv/zcZ1w=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:49.981386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b5541e0f-ab27-4917-a3d1-b2645611a01d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for project bfebaa3ef67f42289fa824284a968c42. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:49.997833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b5541e0f-ab27-4917-a3d1-b2645611a01d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for user 87e519320e854ce480adcd9de2750bfb and project bfebaa3ef67f42289fa824284a968c42. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:50.050537 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b5541e0f-ab27-4917-a3d1-b2645611a01d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.686085 Oct 04 18:35:50.055555 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3028/6043] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:35:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:08.568305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-559133781", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "c6f59dd4-d89d-4e50-bd9d-7766e3784214"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1601179524", "security_groups": [{"name": "tempest-secgroup-smoke-80465387"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:08.608602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:08.610430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:08.614737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:09.441161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] validate_networks() for [('c6f59dd4-d89d-4e50-bd9d-7766e3784214', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:10.788681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:10.789545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:10.790821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:10.792160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:10.793413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:10.855429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.860890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.861819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.876714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.897555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.898580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.989009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for project bfebaa3ef67f42289fa824284a968c42. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:11.005407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for user 87e519320e854ce480adcd9de2750bfb and project bfebaa3ef67f42289fa824284a968c42. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:11.067502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:11.074154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:11.166435 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-293f9664-87a0-4d1b-8b8d-b007b0d4952e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.604985 Oct 04 18:36:11.182268 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3016/6044] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:08 2022] POST /compute/v2.1/servers => generated 404 bytes in 2621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:11.190635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:11.192368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:11.198022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3d5ea5a2-41bc-4b57-9728-783c8b04d667 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.199068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3d5ea5a2-41bc-4b57-9728-783c8b04d667 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.849482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3d5ea5a2-41bc-4b57-9728-783c8b04d667 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.869738 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3d5ea5a2-41bc-4b57-9728-783c8b04d667 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1266 microversion: 2.1 time: 0.680383 Oct 04 18:36:11.885071 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3029/6045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1266 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:12.913299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-653d7daf-d9da-47fc-828a-0286f24eb3bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.913912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-653d7daf-d9da-47fc-828a-0286f24eb3bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.935696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-653d7daf-d9da-47fc-828a-0286f24eb3bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.947858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-653d7daf-d9da-47fc-828a-0286f24eb3bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.956013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-653d7daf-d9da-47fc-828a-0286f24eb3bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.963354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-653d7daf-d9da-47fc-828a-0286f24eb3bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.964438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-653d7daf-d9da-47fc-828a-0286f24eb3bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.965165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-653d7daf-d9da-47fc-828a-0286f24eb3bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.182216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-653d7daf-d9da-47fc-828a-0286f24eb3bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.195565 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-653d7daf-d9da-47fc-828a-0286f24eb3bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1262 microversion: 2.1 time: 0.286904 Oct 04 18:36:13.196172 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3017/6046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1262 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:14.244481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d24b682-ce49-4378-9ba0-b5d1f9103963 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.245358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d24b682-ce49-4378-9ba0-b5d1f9103963 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.261756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d24b682-ce49-4378-9ba0-b5d1f9103963 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.262672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d24b682-ce49-4378-9ba0-b5d1f9103963 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.263542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d24b682-ce49-4378-9ba0-b5d1f9103963 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.264627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d24b682-ce49-4378-9ba0-b5d1f9103963 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.266413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d24b682-ce49-4378-9ba0-b5d1f9103963 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.267196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d24b682-ce49-4378-9ba0-b5d1f9103963 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.460283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d24b682-ce49-4378-9ba0-b5d1f9103963 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.470453 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d24b682-ce49-4378-9ba0-b5d1f9103963 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1326 microversion: 2.1 time: 0.230830 Oct 04 18:36:14.471074 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3030/6047] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1326 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:15.499642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fdce1872-bd30-4ce9-9da4-63a60f93bb39 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.500578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fdce1872-bd30-4ce9-9da4-63a60f93bb39 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.513326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdce1872-bd30-4ce9-9da4-63a60f93bb39 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.514339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdce1872-bd30-4ce9-9da4-63a60f93bb39 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.516320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdce1872-bd30-4ce9-9da4-63a60f93bb39 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.517298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdce1872-bd30-4ce9-9da4-63a60f93bb39 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.522767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdce1872-bd30-4ce9-9da4-63a60f93bb39 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.523668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fdce1872-bd30-4ce9-9da4-63a60f93bb39 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.708252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fdce1872-bd30-4ce9-9da4-63a60f93bb39 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.744825 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fdce1872-bd30-4ce9-9da4-63a60f93bb39 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1324 microversion: 2.1 time: 0.249583 Oct 04 18:36:15.751067 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3018/6048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:16.781010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eaa7f85a-e60c-4fc1-8c67-ca8fa99e73c4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.781670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eaa7f85a-e60c-4fc1-8c67-ca8fa99e73c4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.806255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaa7f85a-e60c-4fc1-8c67-ca8fa99e73c4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.813855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaa7f85a-e60c-4fc1-8c67-ca8fa99e73c4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.816203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaa7f85a-e60c-4fc1-8c67-ca8fa99e73c4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.817297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaa7f85a-e60c-4fc1-8c67-ca8fa99e73c4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.822315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaa7f85a-e60c-4fc1-8c67-ca8fa99e73c4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.823061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaa7f85a-e60c-4fc1-8c67-ca8fa99e73c4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.611407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ec038296-74ea-46a0-b7ea-cc6514405ee5 req-76baaa9e-eb66-4226-a9cb-5e438755a692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2e3963-4e10-431c-9853-8f8070f1e4a5", "tag": "11a780a3-dd1a-4548-94e0-60cf154cfc39"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:17.666703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ec038296-74ea-46a0-b7ea-cc6514405ee5 req-76baaa9e-eb66-4226-a9cb-5e438755a692 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.667828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ec038296-74ea-46a0-b7ea-cc6514405ee5 req-76baaa9e-eb66-4226-a9cb-5e438755a692 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.671848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ec038296-74ea-46a0-b7ea-cc6514405ee5 req-76baaa9e-eb66-4226-a9cb-5e438755a692 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.705152 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ec038296-74ea-46a0-b7ea-cc6514405ee5 req-76baaa9e-eb66-4226-a9cb-5e438755a692 service nova] Creating event network-changed:11a780a3-dd1a-4548-94e0-60cf154cfc39 for instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 on n-h2-850499-14 Oct 04 18:36:17.720618 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ec038296-74ea-46a0-b7ea-cc6514405ee5 req-76baaa9e-eb66-4226-a9cb-5e438755a692 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140177 Oct 04 18:36:17.722108 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3019/6049] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:17.806058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eaa7f85a-e60c-4fc1-8c67-ca8fa99e73c4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.821464 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eaa7f85a-e60c-4fc1-8c67-ca8fa99e73c4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1390 microversion: 2.1 time: 1.044985 Oct 04 18:36:17.823458 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3031/6050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1390 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:18.855267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c28a7da-3921-41e4-a4f1-4cbef7aecad9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.856854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c28a7da-3921-41e4-a4f1-4cbef7aecad9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.868052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c28a7da-3921-41e4-a4f1-4cbef7aecad9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.868572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c28a7da-3921-41e4-a4f1-4cbef7aecad9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.869022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c28a7da-3921-41e4-a4f1-4cbef7aecad9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.869759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c28a7da-3921-41e4-a4f1-4cbef7aecad9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.875545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c28a7da-3921-41e4-a4f1-4cbef7aecad9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.876388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c28a7da-3921-41e4-a4f1-4cbef7aecad9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.234833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c28a7da-3921-41e4-a4f1-4cbef7aecad9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.245941 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c28a7da-3921-41e4-a4f1-4cbef7aecad9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1390 microversion: 2.1 time: 0.394945 Oct 04 18:36:19.251759 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3020/6051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1390 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:20.272155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a294cddb-5b32-4f26-a8c7-b36c8097dc4a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.272780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a294cddb-5b32-4f26-a8c7-b36c8097dc4a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.286019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a294cddb-5b32-4f26-a8c7-b36c8097dc4a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.287955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a294cddb-5b32-4f26-a8c7-b36c8097dc4a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.288248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a294cddb-5b32-4f26-a8c7-b36c8097dc4a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.288997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a294cddb-5b32-4f26-a8c7-b36c8097dc4a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.289462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a294cddb-5b32-4f26-a8c7-b36c8097dc4a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.289889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a294cddb-5b32-4f26-a8c7-b36c8097dc4a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.538145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a294cddb-5b32-4f26-a8c7-b36c8097dc4a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:20.551613 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a294cddb-5b32-4f26-a8c7-b36c8097dc4a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1390 microversion: 2.1 time: 0.281751 Oct 04 18:36:20.569625 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3032/6052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1390 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:21.577486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-08767e64-615e-453e-8254-cff3e241cded tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.578187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-08767e64-615e-453e-8254-cff3e241cded tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:21.581128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:21.581814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:21.591085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08767e64-615e-453e-8254-cff3e241cded tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.593145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08767e64-615e-453e-8254-cff3e241cded tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.594589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08767e64-615e-453e-8254-cff3e241cded tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.596250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08767e64-615e-453e-8254-cff3e241cded tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.598284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08767e64-615e-453e-8254-cff3e241cded tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.599732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08767e64-615e-453e-8254-cff3e241cded tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.925587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08767e64-615e-453e-8254-cff3e241cded tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:21.935468 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-08767e64-615e-453e-8254-cff3e241cded tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1390 microversion: 2.1 time: 0.362175 Oct 04 18:36:21.938051 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3021/6053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:21 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1390 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:22.961233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4ec2676-af01-4a7c-92ba-6ef9bc4e10ff tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.962707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e4ec2676-af01-4a7c-92ba-6ef9bc4e10ff tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.969963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:22.987305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4ec2676-af01-4a7c-92ba-6ef9bc4e10ff tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.989460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4ec2676-af01-4a7c-92ba-6ef9bc4e10ff tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.999467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4ec2676-af01-4a7c-92ba-6ef9bc4e10ff tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.000764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4ec2676-af01-4a7c-92ba-6ef9bc4e10ff tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.005666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4ec2676-af01-4a7c-92ba-6ef9bc4e10ff tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.006682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4ec2676-af01-4a7c-92ba-6ef9bc4e10ff tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.694398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e4ec2676-af01-4a7c-92ba-6ef9bc4e10ff tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:23.701837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84db4d8b-30b6-4bc4-b438-9f6397bc6fc7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.703352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-84db4d8b-30b6-4bc4-b438-9f6397bc6fc7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.715685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84db4d8b-30b6-4bc4-b438-9f6397bc6fc7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.715945 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e4ec2676-af01-4a7c-92ba-6ef9bc4e10ff tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1390 microversion: 2.1 time: 0.759339 Oct 04 18:36:23.716770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84db4d8b-30b6-4bc4-b438-9f6397bc6fc7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.717471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84db4d8b-30b6-4bc4-b438-9f6397bc6fc7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.718577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84db4d8b-30b6-4bc4-b438-9f6397bc6fc7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.719276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84db4d8b-30b6-4bc4-b438-9f6397bc6fc7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.719842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84db4d8b-30b6-4bc4-b438-9f6397bc6fc7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.739679 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3033/6054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:22 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1390 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:23.772720 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84db4d8b-30b6-4bc4-b438-9f6397bc6fc7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499/ips" status: 200 len: 149 microversion: 2.1 time: 0.078984 Oct 04 18:36:23.777301 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3022/6055] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499/ips => generated 149 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:23.793961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99ffab7a-1543-4048-a552-e26b7df8b795"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:23.806018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.823228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.826099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.827316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.828871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.829693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.830444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.055643 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Invalid volume: volume 99ffab7a-1543-4048-a552-e26b7df8b795 is already attached to instances: 95f9317b-677e-4d80-895f-61eede40d94a Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499/os-volume_attachments HTTP/1.1 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 74 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: {"volumeAttachment": {"volumeId": "99ffab7a-1543-4048-a552-e26b7df8b795"}} Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid volume: volume 99ffab7a-1543-4048-a552-e26b7df8b795 is already attached to instances: 95f9317b-677e-4d80-895f-61eede40d94a Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'server_id': 'ca2c5fd6-c295-45b0-8050-678b4819c499', 'body': {'volumeAttachment': {'volumeId': '99ffab7a-1543-4048-a552-e26b7df8b795'}}} Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 99ffab7a-1543-4048-a552-e26b7df8b795 is already attached to instances: 95f9317b-677e-4d80-895f-61eede40d94a Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:36:24.061507 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 99ffab7a-1543-4048-a552-e26b7df8b795 is already attached to instances: 95f9317b-677e-4d80-895f-61eede40d94a Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 99ffab7a-1543-4048-a552-e26b7df8b795 is already attached to instances: 95f9317b-677e-4d80-895f-61eede40d94a Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:36:24.066399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 400 to user: Invalid volume: volume 99ffab7a-1543-4048-a552-e26b7df8b795 is already attached to instances: 95f9317b-677e-4d80-895f-61eede40d94a {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:24.070477 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-80c264b9-64bd-43c5-b001-3392f327a1a6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.278674 Oct 04 18:36:24.074566 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3034/6056] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:36:23 2022] POST /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499/os-volume_attachments => generated 174 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:36:24.083493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4908a7d1-8f3a-4742-8b5d-2a68913d6c98 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.084853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4908a7d1-8f3a-4742-8b5d-2a68913d6c98 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:24.103094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4908a7d1-8f3a-4742-8b5d-2a68913d6c98 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.104874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4908a7d1-8f3a-4742-8b5d-2a68913d6c98 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.106765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4908a7d1-8f3a-4742-8b5d-2a68913d6c98 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.110878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4908a7d1-8f3a-4742-8b5d-2a68913d6c98 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.112925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4908a7d1-8f3a-4742-8b5d-2a68913d6c98 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.114092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4908a7d1-8f3a-4742-8b5d-2a68913d6c98 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.163606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4908a7d1-8f3a-4742-8b5d-2a68913d6c98 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:24.328122 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4908a7d1-8f3a-4742-8b5d-2a68913d6c98 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 204 len: 0 microversion: 2.1 time: 0.251374 Oct 04 18:36:24.330888 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3023/6057] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:24 2022] DELETE /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:24.340892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f3a522dd-ae29-40a4-b307-91bc313aef3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.343277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f3a522dd-ae29-40a4-b307-91bc313aef3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:24.363540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a522dd-ae29-40a4-b307-91bc313aef3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.366007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a522dd-ae29-40a4-b307-91bc313aef3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.367620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a522dd-ae29-40a4-b307-91bc313aef3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.368706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a522dd-ae29-40a4-b307-91bc313aef3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.369401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a522dd-ae29-40a4-b307-91bc313aef3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.369960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3a522dd-ae29-40a4-b307-91bc313aef3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.595945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f3a522dd-ae29-40a4-b307-91bc313aef3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:24.608489 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f3a522dd-ae29-40a4-b307-91bc313aef3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1680 microversion: 2.1 time: 0.273060 Oct 04 18:36:24.609081 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3035/6058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:24 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1680 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:24.756490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2ac3427-5af5-48f0-8ea8-78b07f2ae1d6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.758777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2ac3427-5af5-48f0-8ea8-78b07f2ae1d6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:24.771824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ac3427-5af5-48f0-8ea8-78b07f2ae1d6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.772457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ac3427-5af5-48f0-8ea8-78b07f2ae1d6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.775629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ac3427-5af5-48f0-8ea8-78b07f2ae1d6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.776772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ac3427-5af5-48f0-8ea8-78b07f2ae1d6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.777253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ac3427-5af5-48f0-8ea8-78b07f2ae1d6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.778571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ac3427-5af5-48f0-8ea8-78b07f2ae1d6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.024238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2ac3427-5af5-48f0-8ea8-78b07f2ae1d6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:25.029210 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2ac3427-5af5-48f0-8ea8-78b07f2ae1d6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1390 microversion: 2.1 time: 0.279572 Oct 04 18:36:25.029810 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3024/6059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:24 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1390 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:25.595163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8ed4e194-f364-4d20-b29f-e75eb794322a req-8f9fb868-19f7-4886-a36d-cee167cfdbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2e3963-4e10-431c-9853-8f8070f1e4a5", "name": "network-vif-plugged", "status": "completed", "tag": "11a780a3-dd1a-4548-94e0-60cf154cfc39"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:25.618611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8ed4e194-f364-4d20-b29f-e75eb794322a req-8f9fb868-19f7-4886-a36d-cee167cfdbc7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.620687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8ed4e194-f364-4d20-b29f-e75eb794322a req-8f9fb868-19f7-4886-a36d-cee167cfdbc7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.623069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8ed4e194-f364-4d20-b29f-e75eb794322a req-8f9fb868-19f7-4886-a36d-cee167cfdbc7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.644294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1bf1f7e-07b7-48bf-904f-414fd4b0f1f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:25.648379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a1bf1f7e-07b7-48bf-904f-414fd4b0f1f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:25.660070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bf1f7e-07b7-48bf-904f-414fd4b0f1f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.661438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bf1f7e-07b7-48bf-904f-414fd4b0f1f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.662454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bf1f7e-07b7-48bf-904f-414fd4b0f1f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.663722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bf1f7e-07b7-48bf-904f-414fd4b0f1f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.664622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bf1f7e-07b7-48bf-904f-414fd4b0f1f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.665314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1bf1f7e-07b7-48bf-904f-414fd4b0f1f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.668247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8ed4e194-f364-4d20-b29f-e75eb794322a req-8f9fb868-19f7-4886-a36d-cee167cfdbc7 service nova] Creating event network-vif-plugged:11a780a3-dd1a-4548-94e0-60cf154cfc39 for instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 on n-h2-850499-14 Oct 04 18:36:25.681631 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8ed4e194-f364-4d20-b29f-e75eb794322a req-8f9fb868-19f7-4886-a36d-cee167cfdbc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087895 Oct 04 18:36:25.683449 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3036/6060] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:26.062692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42eb083b-f6c8-429c-834a-8b2b153ab701 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.063632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42eb083b-f6c8-429c-834a-8b2b153ab701 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:26.069911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a1bf1f7e-07b7-48bf-904f-414fd4b0f1f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:26.075472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42eb083b-f6c8-429c-834a-8b2b153ab701 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.090043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42eb083b-f6c8-429c-834a-8b2b153ab701 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.091303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42eb083b-f6c8-429c-834a-8b2b153ab701 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.092308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42eb083b-f6c8-429c-834a-8b2b153ab701 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.093564 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1bf1f7e-07b7-48bf-904f-414fd4b0f1f1 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1680 microversion: 2.1 time: 0.458378 Oct 04 18:36:26.093880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42eb083b-f6c8-429c-834a-8b2b153ab701 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.094728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42eb083b-f6c8-429c-834a-8b2b153ab701 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.095550 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3025/6061] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:25 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1680 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:26.376855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-42eb083b-f6c8-429c-834a-8b2b153ab701 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:26.393226 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42eb083b-f6c8-429c-834a-8b2b153ab701 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1390 microversion: 2.1 time: 0.341128 Oct 04 18:36:26.396227 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3037/6062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1390 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:27.124206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df93c404-46b2-4bf8-9fee-135bb871dc05 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.124894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-df93c404-46b2-4bf8-9fee-135bb871dc05 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.155275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df93c404-46b2-4bf8-9fee-135bb871dc05 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.162998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df93c404-46b2-4bf8-9fee-135bb871dc05 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.166907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df93c404-46b2-4bf8-9fee-135bb871dc05 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.170366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df93c404-46b2-4bf8-9fee-135bb871dc05 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.176358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df93c404-46b2-4bf8-9fee-135bb871dc05 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.179816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df93c404-46b2-4bf8-9fee-135bb871dc05 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.417472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a43b005b-154c-4b8a-a9be-21c18a7b2b06 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.418856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a43b005b-154c-4b8a-a9be-21c18a7b2b06 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.433215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a43b005b-154c-4b8a-a9be-21c18a7b2b06 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.434704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a43b005b-154c-4b8a-a9be-21c18a7b2b06 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.435427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a43b005b-154c-4b8a-a9be-21c18a7b2b06 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.436343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a43b005b-154c-4b8a-a9be-21c18a7b2b06 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.437147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a43b005b-154c-4b8a-a9be-21c18a7b2b06 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.437762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a43b005b-154c-4b8a-a9be-21c18a7b2b06 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.789358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a43b005b-154c-4b8a-a9be-21c18a7b2b06 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:27.805850 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a43b005b-154c-4b8a-a9be-21c18a7b2b06 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1390 microversion: 2.1 time: 0.392415 Oct 04 18:36:27.810049 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3038/6063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1390 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:27.829389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-df93c404-46b2-4bf8-9fee-135bb871dc05 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:27.840710 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-df93c404-46b2-4bf8-9fee-135bb871dc05 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1680 microversion: 2.1 time: 0.721022 Oct 04 18:36:27.858878 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3026/6064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1680 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:28.853507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d220a04-e4b4-4d6c-8b9d-6610acd12a8d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:28.859302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d220a04-e4b4-4d6c-8b9d-6610acd12a8d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:28.874664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b487679d-17cf-47c7-93ce-1a3d186e7984 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:28.875326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b487679d-17cf-47c7-93ce-1a3d186e7984 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:28.888918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b487679d-17cf-47c7-93ce-1a3d186e7984 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.889726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b487679d-17cf-47c7-93ce-1a3d186e7984 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.890438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b487679d-17cf-47c7-93ce-1a3d186e7984 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.894005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d220a04-e4b4-4d6c-8b9d-6610acd12a8d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.894823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d220a04-e4b4-4d6c-8b9d-6610acd12a8d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.895687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d220a04-e4b4-4d6c-8b9d-6610acd12a8d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.896666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b487679d-17cf-47c7-93ce-1a3d186e7984 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.897224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b487679d-17cf-47c7-93ce-1a3d186e7984 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.897913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b487679d-17cf-47c7-93ce-1a3d186e7984 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.905866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d220a04-e4b4-4d6c-8b9d-6610acd12a8d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.906912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d220a04-e4b4-4d6c-8b9d-6610acd12a8d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.908997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d220a04-e4b4-4d6c-8b9d-6610acd12a8d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.434191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d220a04-e4b4-4d6c-8b9d-6610acd12a8d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:29.454008 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d220a04-e4b4-4d6c-8b9d-6610acd12a8d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1563 microversion: 2.1 time: 0.613334 Oct 04 18:36:29.455034 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3039/6065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:28 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1563 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:29.494816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-770e0bfd-295d-41d8-a55c-d3e0c9e962aa tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:29.495483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-770e0bfd-295d-41d8-a55c-d3e0c9e962aa tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:29.503021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b487679d-17cf-47c7-93ce-1a3d186e7984 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:29.513773 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b487679d-17cf-47c7-93ce-1a3d186e7984 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1680 microversion: 2.1 time: 0.645204 Oct 04 18:36:29.514380 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3027/6066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:28 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1680 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:29.531858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-770e0bfd-295d-41d8-a55c-d3e0c9e962aa tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.536106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-770e0bfd-295d-41d8-a55c-d3e0c9e962aa tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.536787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-770e0bfd-295d-41d8-a55c-d3e0c9e962aa tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.537783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-770e0bfd-295d-41d8-a55c-d3e0c9e962aa tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.540307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-770e0bfd-295d-41d8-a55c-d3e0c9e962aa tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.540808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-770e0bfd-295d-41d8-a55c-d3e0c9e962aa tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.019071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-770e0bfd-295d-41d8-a55c-d3e0c9e962aa tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:30.061361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-770e0bfd-295d-41d8-a55c-d3e0c9e962aa tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1563 microversion: 2.1 time: 0.582440 Oct 04 18:36:30.087035 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3040/6067] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:29 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1563 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:30.544893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7f0b3f82-5df3-43ad-b603-7466848d1f83 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:30.547846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7f0b3f82-5df3-43ad-b603-7466848d1f83 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:30.563614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0b3f82-5df3-43ad-b603-7466848d1f83 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.564831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0b3f82-5df3-43ad-b603-7466848d1f83 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.566804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0b3f82-5df3-43ad-b603-7466848d1f83 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.569753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0b3f82-5df3-43ad-b603-7466848d1f83 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.572057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0b3f82-5df3-43ad-b603-7466848d1f83 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.573399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7f0b3f82-5df3-43ad-b603-7466848d1f83 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.921084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7f0b3f82-5df3-43ad-b603-7466848d1f83 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:30.943648 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7f0b3f82-5df3-43ad-b603-7466848d1f83 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1680 microversion: 2.1 time: 0.408317 Oct 04 18:36:30.945725 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3028/6068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:30 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1680 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:31.972320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-238c7951-2bf7-4aed-83de-5802e2ecf150 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:31.973052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-238c7951-2bf7-4aed-83de-5802e2ecf150 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:31.989418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-238c7951-2bf7-4aed-83de-5802e2ecf150 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.989930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-238c7951-2bf7-4aed-83de-5802e2ecf150 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.990387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-238c7951-2bf7-4aed-83de-5802e2ecf150 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.991211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-238c7951-2bf7-4aed-83de-5802e2ecf150 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.991657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-238c7951-2bf7-4aed-83de-5802e2ecf150 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.992096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-238c7951-2bf7-4aed-83de-5802e2ecf150 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.358304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-238c7951-2bf7-4aed-83de-5802e2ecf150 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:32.378496 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-238c7951-2bf7-4aed-83de-5802e2ecf150 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1613 microversion: 2.1 time: 0.409605 Oct 04 18:36:32.382121 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3041/6069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:31 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1613 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:32.638625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-4e9c93da-7e65-4f84-83df-13f8f87eef95 req-1960b4f9-4dcc-44e8-a4db-b4c7dbe1f5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2c5fd6-c295-45b0-8050-678b4819c499", "name": "network-vif-deleted", "tag": "b0b3802c-9982-41a0-959f-82f543a2ddd7"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:32.669778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4e9c93da-7e65-4f84-83df-13f8f87eef95 req-1960b4f9-4dcc-44e8-a4db-b4c7dbe1f5c1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.670620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4e9c93da-7e65-4f84-83df-13f8f87eef95 req-1960b4f9-4dcc-44e8-a4db-b4c7dbe1f5c1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.671657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4e9c93da-7e65-4f84-83df-13f8f87eef95 req-1960b4f9-4dcc-44e8-a4db-b4c7dbe1f5c1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.712309 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-4e9c93da-7e65-4f84-83df-13f8f87eef95 req-1960b4f9-4dcc-44e8-a4db-b4c7dbe1f5c1 service nova] Creating event network-vif-deleted:b0b3802c-9982-41a0-959f-82f543a2ddd7 for instance ca2c5fd6-c295-45b0-8050-678b4819c499 on n-h2-850499-14 Oct 04 18:36:32.731489 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-4e9c93da-7e65-4f84-83df-13f8f87eef95 req-1960b4f9-4dcc-44e8-a4db-b4c7dbe1f5c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102984 Oct 04 18:36:32.732932 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3029/6070] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:33.413350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.414639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:33.436384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.436887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.437328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.438065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.438526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.467977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.593012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.594285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.595865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.596564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lazy-loading 'fault' on Instance uuid ca2c5fd6-c295-45b0-8050-678b4819c499 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:33.802366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.821949 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6418199a-1f88-4e78-ba87-cbaf768a75c7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 200 len: 1331 microversion: 2.1 time: 0.409413 Oct 04 18:36:33.843407 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3042/6071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 1331 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:34.470311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2097204810", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:34.636053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:34.850001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:34.850641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:34.869284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:34.869832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:34.872505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.873526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:34.880140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:34.880140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.915944 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 HTTP/1.1 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'ca2c5fd6-c295-45b0-8050-678b4819c499'} Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:34.929063 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:36:34.940308 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:34.940308 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:34.940308 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:34.940308 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:34.940308 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:34.940308 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:36:34.940308 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:36:34.940308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:34.940308 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-999d1b58-cbf7-4a31-baa8-c758b763cb14 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 404 len: 111 microversion: 2.1 time: 0.087094 Oct 04 18:36:34.940308 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3043/6072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:34 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:34.948405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f70f34f4-390b-49e2-afa1-c2fbaf7759ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '.version_select at 0x7fd4d1dd9b80>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:35.003618 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f70f34f4-390b-49e2-afa1-c2fbaf7759ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1651849455" status: 202 len: 0 microversion: 2.1 time: 0.066208 Oct 04 18:36:35.016635 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3044/6073] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:36:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1651849455 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:36:35.482534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:35.483695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:35.484478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:35.485238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:35.485987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:35.515967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.516609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.528683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.529849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.530352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.530797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.562979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8ff629bf-a41c-4b63-b37d-18656cd9430a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:35.563899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8ff629bf-a41c-4b63-b37d-18656cd9430a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:35.619542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff629bf-a41c-4b63-b37d-18656cd9430a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.620334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff629bf-a41c-4b63-b37d-18656cd9430a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.620830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff629bf-a41c-4b63-b37d-18656cd9430a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.621684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff629bf-a41c-4b63-b37d-18656cd9430a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.622258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff629bf-a41c-4b63-b37d-18656cd9430a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.622800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ff629bf-a41c-4b63-b37d-18656cd9430a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.678505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Getting quotas for project fcf02f9b10ec43a7abbb57af50307835. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:35.717597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Getting quotas for user 6c3491502350491383a3dd2e7c33e777 and project fcf02f9b10ec43a7abbb57af50307835. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:35.762426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:35.765490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:35.882247 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9c96043d-a7a1-4674-9e80-e6ad829a6ac5 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426607 Oct 04 18:36:35.893794 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3030/6074] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:36.274138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-dd90869d-29d5-4fca-bd24-2d350038e09f req-d086190e-bc03-42e8-a1b5-30ee00c52095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2e3963-4e10-431c-9853-8f8070f1e4a5", "tag": "11a780a3-dd1a-4548-94e0-60cf154cfc39"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:36.297898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd90869d-29d5-4fca-bd24-2d350038e09f req-d086190e-bc03-42e8-a1b5-30ee00c52095 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.305970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd90869d-29d5-4fca-bd24-2d350038e09f req-d086190e-bc03-42e8-a1b5-30ee00c52095 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.306614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dd90869d-29d5-4fca-bd24-2d350038e09f req-d086190e-bc03-42e8-a1b5-30ee00c52095 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.332758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-dd90869d-29d5-4fca-bd24-2d350038e09f req-d086190e-bc03-42e8-a1b5-30ee00c52095 service nova] Creating event network-changed:11a780a3-dd1a-4548-94e0-60cf154cfc39 for instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 on n-h2-850499-14 Oct 04 18:36:36.345542 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-dd90869d-29d5-4fca-bd24-2d350038e09f req-d086190e-bc03-42e8-a1b5-30ee00c52095 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.445472 Oct 04 18:36:36.347216 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3031/6075] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:36.358388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ba5835b-1e97-44a8-9dfb-b196007aafc4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:36.359152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ba5835b-1e97-44a8-9dfb-b196007aafc4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:36.620435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ba5835b-1e97-44a8-9dfb-b196007aafc4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:36.629101 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ba5835b-1e97-44a8-9dfb-b196007aafc4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1214 microversion: 2.1 time: 0.278950 Oct 04 18:36:36.639158 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3032/6076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:36 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1214 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:37.158154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8ff629bf-a41c-4b63-b37d-18656cd9430a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:37.173280 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8ff629bf-a41c-4b63-b37d-18656cd9430a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1563 microversion: 2.1 time: 1.614791 Oct 04 18:36:37.174992 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3045/6077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:35 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1563 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:37.657893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-501626d6-8ffb-480f-8a67-478b2a5c6485 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.658653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-501626d6-8ffb-480f-8a67-478b2a5c6485 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.692869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-501626d6-8ffb-480f-8a67-478b2a5c6485 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.693408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-501626d6-8ffb-480f-8a67-478b2a5c6485 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.693869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-501626d6-8ffb-480f-8a67-478b2a5c6485 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.694881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-501626d6-8ffb-480f-8a67-478b2a5c6485 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.703286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-501626d6-8ffb-480f-8a67-478b2a5c6485 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.711187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-501626d6-8ffb-480f-8a67-478b2a5c6485 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.923637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-501626d6-8ffb-480f-8a67-478b2a5c6485 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:37.971483 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-501626d6-8ffb-480f-8a67-478b2a5c6485 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1210 microversion: 2.1 time: 0.315529 Oct 04 18:36:37.975885 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3033/6078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1210 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:38.479450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94afb49f-61c7-4318-a281-2bc64fa2ab31 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.482909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-94afb49f-61c7-4318-a281-2bc64fa2ab31 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:38.504531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94afb49f-61c7-4318-a281-2bc64fa2ab31 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.506068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94afb49f-61c7-4318-a281-2bc64fa2ab31 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.507781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94afb49f-61c7-4318-a281-2bc64fa2ab31 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.509781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94afb49f-61c7-4318-a281-2bc64fa2ab31 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.511515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94afb49f-61c7-4318-a281-2bc64fa2ab31 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.513336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94afb49f-61c7-4318-a281-2bc64fa2ab31 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.699802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-94afb49f-61c7-4318-a281-2bc64fa2ab31 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lazy-loading 'services' on Instance uuid 95f9317b-677e-4d80-895f-61eede40d94a {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:38.929403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-94afb49f-61c7-4318-a281-2bc64fa2ab31 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments/99ffab7a-1543-4048-a552-e26b7df8b795" status: 202 len: 0 microversion: 2.1 time: 0.468050 Oct 04 18:36:38.930613 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3046/6079] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:36:38 2022] DELETE /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments/99ffab7a-1543-4048-a552-e26b7df8b795 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:36:38.948269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-057eb099-3637-409a-ac6b-5f89195693a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.952378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-057eb099-3637-409a-ac6b-5f89195693a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:38.975742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:38.977742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-057eb099-3637-409a-ac6b-5f89195693a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.977910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-057eb099-3637-409a-ac6b-5f89195693a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.978336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-057eb099-3637-409a-ac6b-5f89195693a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.985040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-057eb099-3637-409a-ac6b-5f89195693a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.986050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-057eb099-3637-409a-ac6b-5f89195693a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.990593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-057eb099-3637-409a-ac6b-5f89195693a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.001675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c0f48c1-a140-468d-a2a0-bbc94316dec4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:39.002723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0c0f48c1-a140-468d-a2a0-bbc94316dec4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:39.012948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:39.015689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c0f48c1-a140-468d-a2a0-bbc94316dec4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.020500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c0f48c1-a140-468d-a2a0-bbc94316dec4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.021245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c0f48c1-a140-468d-a2a0-bbc94316dec4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.022288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c0f48c1-a140-468d-a2a0-bbc94316dec4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.023050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c0f48c1-a140-468d-a2a0-bbc94316dec4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.025748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c0f48c1-a140-468d-a2a0-bbc94316dec4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.100953 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-057eb099-3637-409a-ac6b-5f89195693a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166240 Oct 04 18:36:39.111357 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3034/6080] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:39.251185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0c0f48c1-a140-468d-a2a0-bbc94316dec4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:39.259093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:39.275121 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0c0f48c1-a140-468d-a2a0-bbc94316dec4 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1272 microversion: 2.1 time: 0.278012 Oct 04 18:36:39.276727 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3047/6081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:40.122554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9204ac5c-c744-4140-a36a-5188668dd5eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.140746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9204ac5c-c744-4140-a36a-5188668dd5eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:40.166337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9204ac5c-c744-4140-a36a-5188668dd5eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.167493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9204ac5c-c744-4140-a36a-5188668dd5eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.169013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9204ac5c-c744-4140-a36a-5188668dd5eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.170603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9204ac5c-c744-4140-a36a-5188668dd5eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.171849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9204ac5c-c744-4140-a36a-5188668dd5eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.177507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9204ac5c-c744-4140-a36a-5188668dd5eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.309458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ef8a202-9528-402c-8db5-70aef23a538d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.311952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9ef8a202-9528-402c-8db5-70aef23a538d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:40.315023 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9204ac5c-c744-4140-a36a-5188668dd5eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197907 Oct 04 18:36:40.315745 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3035/6082] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:40.398035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef8a202-9528-402c-8db5-70aef23a538d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.398841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef8a202-9528-402c-8db5-70aef23a538d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.399687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef8a202-9528-402c-8db5-70aef23a538d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.400564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef8a202-9528-402c-8db5-70aef23a538d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.401167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef8a202-9528-402c-8db5-70aef23a538d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.401707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ef8a202-9528-402c-8db5-70aef23a538d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.614222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9ef8a202-9528-402c-8db5-70aef23a538d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:40.626302 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ef8a202-9528-402c-8db5-70aef23a538d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1272 microversion: 2.1 time: 0.325530 Oct 04 18:36:40.628172 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3048/6083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1272 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:41.332859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e0515f7f-6581-4f2e-a694-a53d6709401d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:41.335834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e0515f7f-6581-4f2e-a694-a53d6709401d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.361270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0515f7f-6581-4f2e-a694-a53d6709401d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.361810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0515f7f-6581-4f2e-a694-a53d6709401d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.362256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0515f7f-6581-4f2e-a694-a53d6709401d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.363135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0515f7f-6581-4f2e-a694-a53d6709401d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.366077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0515f7f-6581-4f2e-a694-a53d6709401d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.366609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e0515f7f-6581-4f2e-a694-a53d6709401d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.429633 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e0515f7f-6581-4f2e-a694-a53d6709401d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105504 Oct 04 18:36:41.448581 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3036/6084] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:41 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:41.664668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-72a85d35-3580-46ff-bd8c-244c319aa10b tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:41.666126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-72a85d35-3580-46ff-bd8c-244c319aa10b tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.687585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:41.689597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72a85d35-3580-46ff-bd8c-244c319aa10b tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.694100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72a85d35-3580-46ff-bd8c-244c319aa10b tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.695145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72a85d35-3580-46ff-bd8c-244c319aa10b tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.697539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72a85d35-3580-46ff-bd8c-244c319aa10b tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.698344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72a85d35-3580-46ff-bd8c-244c319aa10b tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.701410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72a85d35-3580-46ff-bd8c-244c319aa10b tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.284816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-72a85d35-3580-46ff-bd8c-244c319aa10b tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:42.311977 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-72a85d35-3580-46ff-bd8c-244c319aa10b tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1314 microversion: 2.1 time: 0.643196 Oct 04 18:36:42.314774 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3049/6085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:41 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:42.455525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d1683c85-86f3-4c3c-b446-ee102a81f374 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:42.473897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d1683c85-86f3-4c3c-b446-ee102a81f374 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:42.494151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1683c85-86f3-4c3c-b446-ee102a81f374 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.495773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1683c85-86f3-4c3c-b446-ee102a81f374 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.497352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1683c85-86f3-4c3c-b446-ee102a81f374 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.499253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1683c85-86f3-4c3c-b446-ee102a81f374 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.500287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1683c85-86f3-4c3c-b446-ee102a81f374 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.503113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1683c85-86f3-4c3c-b446-ee102a81f374 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.559967 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d1683c85-86f3-4c3c-b446-ee102a81f374 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119670 Oct 04 18:36:42.561131 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3037/6086] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:42 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:43.357257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ca460f9-4d4c-4ae8-97ae-0dc50c25f8cd tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.358709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ca460f9-4d4c-4ae8-97ae-0dc50c25f8cd tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.361667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a1b38505-5ade-4098-a25b-657aa1321ad5 req-8a95ee5b-d8af-4b37-bf7a-dd87f6c1b16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5a1f6a2-edcf-4b97-82c8-c80a29098748", "tag": "7edd01a4-e67a-43d0-8bec-bf96188e2c8e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:43.374138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca460f9-4d4c-4ae8-97ae-0dc50c25f8cd tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.374990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca460f9-4d4c-4ae8-97ae-0dc50c25f8cd tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.377449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca460f9-4d4c-4ae8-97ae-0dc50c25f8cd tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.378832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca460f9-4d4c-4ae8-97ae-0dc50c25f8cd tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.380381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca460f9-4d4c-4ae8-97ae-0dc50c25f8cd tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.382171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ca460f9-4d4c-4ae8-97ae-0dc50c25f8cd tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.390374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1b38505-5ade-4098-a25b-657aa1321ad5 req-8a95ee5b-d8af-4b37-bf7a-dd87f6c1b16e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.390909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1b38505-5ade-4098-a25b-657aa1321ad5 req-8a95ee5b-d8af-4b37-bf7a-dd87f6c1b16e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.392068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1b38505-5ade-4098-a25b-657aa1321ad5 req-8a95ee5b-d8af-4b37-bf7a-dd87f6c1b16e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.406990 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a1b38505-5ade-4098-a25b-657aa1321ad5 req-8a95ee5b-d8af-4b37-bf7a-dd87f6c1b16e service nova] Creating event network-changed:7edd01a4-e67a-43d0-8bec-bf96188e2c8e for instance d5a1f6a2-edcf-4b97-82c8-c80a29098748 on n-h1-850499-14 Oct 04 18:36:43.416663 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a1b38505-5ade-4098-a25b-657aa1321ad5 req-8a95ee5b-d8af-4b37-bf7a-dd87f6c1b16e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059015 Oct 04 18:36:43.418619 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3038/6087] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:43.577701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b4073a5f-f056-4d14-90a9-ba5d254a0a58 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.581976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4073a5f-f056-4d14-90a9-ba5d254a0a58 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.602734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4073a5f-f056-4d14-90a9-ba5d254a0a58 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.607126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4073a5f-f056-4d14-90a9-ba5d254a0a58 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.608347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4073a5f-f056-4d14-90a9-ba5d254a0a58 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.609505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4073a5f-f056-4d14-90a9-ba5d254a0a58 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.611218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4073a5f-f056-4d14-90a9-ba5d254a0a58 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.612166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4073a5f-f056-4d14-90a9-ba5d254a0a58 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.689030 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b4073a5f-f056-4d14-90a9-ba5d254a0a58 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115520 Oct 04 18:36:43.695193 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3039/6088] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:43.955332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ca460f9-4d4c-4ae8-97ae-0dc50c25f8cd tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.971843 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ca460f9-4d4c-4ae8-97ae-0dc50c25f8cd tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1314 microversion: 2.1 time: 0.619852 Oct 04 18:36:43.973411 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3050/6089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:44.710521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-603bbe30-b346-4b88-b599-63f5ea9ad942 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.721866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-603bbe30-b346-4b88-b599-63f5ea9ad942 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:44.745043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-603bbe30-b346-4b88-b599-63f5ea9ad942 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.756003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-603bbe30-b346-4b88-b599-63f5ea9ad942 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.756882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-603bbe30-b346-4b88-b599-63f5ea9ad942 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.758184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-603bbe30-b346-4b88-b599-63f5ea9ad942 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.759083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-603bbe30-b346-4b88-b599-63f5ea9ad942 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.759899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-603bbe30-b346-4b88-b599-63f5ea9ad942 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.880590 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-603bbe30-b346-4b88-b599-63f5ea9ad942 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179392 Oct 04 18:36:44.882705 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3040/6090] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:45.003985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5c52dcee-7274-4a53-bad1-6c5464d9b730 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:45.004735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5c52dcee-7274-4a53-bad1-6c5464d9b730 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:45.027889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c52dcee-7274-4a53-bad1-6c5464d9b730 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.032591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c52dcee-7274-4a53-bad1-6c5464d9b730 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.038015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c52dcee-7274-4a53-bad1-6c5464d9b730 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.045011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c52dcee-7274-4a53-bad1-6c5464d9b730 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.048534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c52dcee-7274-4a53-bad1-6c5464d9b730 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.052538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5c52dcee-7274-4a53-bad1-6c5464d9b730 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.478209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5c52dcee-7274-4a53-bad1-6c5464d9b730 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:45.503332 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5c52dcee-7274-4a53-bad1-6c5464d9b730 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1314 microversion: 2.1 time: 0.503301 Oct 04 18:36:45.504353 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3051/6091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:45.908215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52ee50cc-feed-4566-9b68-b090da3e9e15 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:45.913100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-52ee50cc-feed-4566-9b68-b090da3e9e15 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:45.926249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:45.931980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52ee50cc-feed-4566-9b68-b090da3e9e15 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.935549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52ee50cc-feed-4566-9b68-b090da3e9e15 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.936717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52ee50cc-feed-4566-9b68-b090da3e9e15 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.938290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52ee50cc-feed-4566-9b68-b090da3e9e15 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.939420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52ee50cc-feed-4566-9b68-b090da3e9e15 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.940864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52ee50cc-feed-4566-9b68-b090da3e9e15 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.046528 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-52ee50cc-feed-4566-9b68-b090da3e9e15 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149243 Oct 04 18:36:46.047501 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3041/6092] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:45 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:46.537225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a9a83f10-e1e7-4ffd-9be2-66035ed5d4cc tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:46.538403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a9a83f10-e1e7-4ffd-9be2-66035ed5d4cc tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:46.545220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9a83f10-e1e7-4ffd-9be2-66035ed5d4cc tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.545726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9a83f10-e1e7-4ffd-9be2-66035ed5d4cc tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.546197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9a83f10-e1e7-4ffd-9be2-66035ed5d4cc tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.567451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9a83f10-e1e7-4ffd-9be2-66035ed5d4cc tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.568084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9a83f10-e1e7-4ffd-9be2-66035ed5d4cc tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.568626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9a83f10-e1e7-4ffd-9be2-66035ed5d4cc tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.062741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5f8f7f04-0485-4ddb-81a3-4ef4442ed44c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:47.065608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5f8f7f04-0485-4ddb-81a3-4ef4442ed44c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:47.067822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:47.085968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8f7f04-0485-4ddb-81a3-4ef4442ed44c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.086774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8f7f04-0485-4ddb-81a3-4ef4442ed44c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.087425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8f7f04-0485-4ddb-81a3-4ef4442ed44c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.088335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8f7f04-0485-4ddb-81a3-4ef4442ed44c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.091900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8f7f04-0485-4ddb-81a3-4ef4442ed44c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.092616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5f8f7f04-0485-4ddb-81a3-4ef4442ed44c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.163733 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5f8f7f04-0485-4ddb-81a3-4ef4442ed44c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104594 Oct 04 18:36:47.165600 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3042/6093] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:47 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:47.462993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a9a83f10-e1e7-4ffd-9be2-66035ed5d4cc tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:47.485003 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a9a83f10-e1e7-4ffd-9be2-66035ed5d4cc tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1314 microversion: 2.1 time: 0.952098 Oct 04 18:36:47.485677 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3052/6094] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:46 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:48.177999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1b6720e-1f7b-4d85-8454-2d1a99fcb9c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.182737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1b6720e-1f7b-4d85-8454-2d1a99fcb9c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.190308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1b6720e-1f7b-4d85-8454-2d1a99fcb9c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.191073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1b6720e-1f7b-4d85-8454-2d1a99fcb9c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.192197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1b6720e-1f7b-4d85-8454-2d1a99fcb9c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.193082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1b6720e-1f7b-4d85-8454-2d1a99fcb9c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.193715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1b6720e-1f7b-4d85-8454-2d1a99fcb9c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.194319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1b6720e-1f7b-4d85-8454-2d1a99fcb9c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.231887 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1b6720e-1f7b-4d85-8454-2d1a99fcb9c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058475 Oct 04 18:36:48.233180 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3043/6095] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:36:48.324267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d0ce1740-fa53-462a-9c7f-aad89b388c73 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.325416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d0ce1740-fa53-462a-9c7f-aad89b388c73 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.333104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0ce1740-fa53-462a-9c7f-aad89b388c73 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.334213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0ce1740-fa53-462a-9c7f-aad89b388c73 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.334835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0ce1740-fa53-462a-9c7f-aad89b388c73 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.335777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0ce1740-fa53-462a-9c7f-aad89b388c73 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.336409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0ce1740-fa53-462a-9c7f-aad89b388c73 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.337008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0ce1740-fa53-462a-9c7f-aad89b388c73 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.374221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d0ce1740-fa53-462a-9c7f-aad89b388c73 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:48.482678 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d0ce1740-fa53-462a-9c7f-aad89b388c73 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 204 len: 0 microversion: 2.1 time: 0.161616 Oct 04 18:36:48.484291 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3053/6096] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:48 2022] DELETE /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:36:48.494524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e493f454-f917-4a52-93f4-672337e039cd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.495568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e493f454-f917-4a52-93f4-672337e039cd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.503252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e493f454-f917-4a52-93f4-672337e039cd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.504891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e493f454-f917-4a52-93f4-672337e039cd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.505626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e493f454-f917-4a52-93f4-672337e039cd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.506536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e493f454-f917-4a52-93f4-672337e039cd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.507485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e493f454-f917-4a52-93f4-672337e039cd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.508090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e493f454-f917-4a52-93f4-672337e039cd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.541991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01ee59f7-af0a-44a3-8678-c440297aed5d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.545580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01ee59f7-af0a-44a3-8678-c440297aed5d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.588088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01ee59f7-af0a-44a3-8678-c440297aed5d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.588499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01ee59f7-af0a-44a3-8678-c440297aed5d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.592246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01ee59f7-af0a-44a3-8678-c440297aed5d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.593792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01ee59f7-af0a-44a3-8678-c440297aed5d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.597229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01ee59f7-af0a-44a3-8678-c440297aed5d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.597874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01ee59f7-af0a-44a3-8678-c440297aed5d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.875936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e493f454-f917-4a52-93f4-672337e039cd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:48.885918 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e493f454-f917-4a52-93f4-672337e039cd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1681 microversion: 2.1 time: 0.395878 Oct 04 18:36:48.890057 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3044/6097] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1681 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:49.008277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01ee59f7-af0a-44a3-8678-c440297aed5d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:49.018706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9d726b2c-d4d6-41b4-bb03-4d64541fdc73 req-02287166-518b-460e-9a1c-0de3b2148275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a1f6a2-edcf-4b97-82c8-c80a29098748", "name": "network-vif-plugged", "status": "completed", "tag": "7edd01a4-e67a-43d0-8bec-bf96188e2c8e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:49.036656 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01ee59f7-af0a-44a3-8678-c440297aed5d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1314 microversion: 2.1 time: 0.515301 Oct 04 18:36:49.038768 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3054/6098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:49.047305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9d726b2c-d4d6-41b4-bb03-4d64541fdc73 req-02287166-518b-460e-9a1c-0de3b2148275 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.048495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9d726b2c-d4d6-41b4-bb03-4d64541fdc73 req-02287166-518b-460e-9a1c-0de3b2148275 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.049447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9d726b2c-d4d6-41b4-bb03-4d64541fdc73 req-02287166-518b-460e-9a1c-0de3b2148275 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.083413 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9d726b2c-d4d6-41b4-bb03-4d64541fdc73 req-02287166-518b-460e-9a1c-0de3b2148275 service nova] Creating event network-vif-plugged:7edd01a4-e67a-43d0-8bec-bf96188e2c8e for instance d5a1f6a2-edcf-4b97-82c8-c80a29098748 on n-h1-850499-14 Oct 04 18:36:49.096270 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9d726b2c-d4d6-41b4-bb03-4d64541fdc73 req-02287166-518b-460e-9a1c-0de3b2148275 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080641 Oct 04 18:36:49.097941 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3045/6099] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:49.919262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-353ff445-7cde-4ad9-98f0-b3745dbf3698 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:49.919262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-353ff445-7cde-4ad9-98f0-b3745dbf3698 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:49.926282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353ff445-7cde-4ad9-98f0-b3745dbf3698 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.927132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353ff445-7cde-4ad9-98f0-b3745dbf3698 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.927939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353ff445-7cde-4ad9-98f0-b3745dbf3698 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.928984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353ff445-7cde-4ad9-98f0-b3745dbf3698 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.929450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353ff445-7cde-4ad9-98f0-b3745dbf3698 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.929896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-353ff445-7cde-4ad9-98f0-b3745dbf3698 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.077542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9e2b7650-2e50-47c8-8c69-56bf0f018c53 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:50.078914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9e2b7650-2e50-47c8-8c69-56bf0f018c53 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:50.086825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2b7650-2e50-47c8-8c69-56bf0f018c53 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.087690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2b7650-2e50-47c8-8c69-56bf0f018c53 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.088339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2b7650-2e50-47c8-8c69-56bf0f018c53 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.089299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2b7650-2e50-47c8-8c69-56bf0f018c53 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.090768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2b7650-2e50-47c8-8c69-56bf0f018c53 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.091843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e2b7650-2e50-47c8-8c69-56bf0f018c53 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.786091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-353ff445-7cde-4ad9-98f0-b3745dbf3698 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.802920 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-353ff445-7cde-4ad9-98f0-b3745dbf3698 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1681 microversion: 2.1 time: 0.889377 Oct 04 18:36:50.804838 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3055/6100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:49 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1681 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:50.944217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9e2b7650-2e50-47c8-8c69-56bf0f018c53 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.960004 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9e2b7650-2e50-47c8-8c69-56bf0f018c53 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1314 microversion: 2.1 time: 0.890592 Oct 04 18:36:50.960827 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3046/6101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:50 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:51.746146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-662a2d5d-b107-4d6c-bcfd-3a58d53c4c70 req-03d48f44-fe28-4b2f-b827-bf4fddef1e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f9317b-677e-4d80-895f-61eede40d94a", "name": "network-vif-deleted", "tag": "fe0ac933-f0ca-447f-abf0-26d1057d8443"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:51.786045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-662a2d5d-b107-4d6c-bcfd-3a58d53c4c70 req-03d48f44-fe28-4b2f-b827-bf4fddef1e78 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.786922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-662a2d5d-b107-4d6c-bcfd-3a58d53c4c70 req-03d48f44-fe28-4b2f-b827-bf4fddef1e78 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.787645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-662a2d5d-b107-4d6c-bcfd-3a58d53c4c70 req-03d48f44-fe28-4b2f-b827-bf4fddef1e78 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.812095 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-662a2d5d-b107-4d6c-bcfd-3a58d53c4c70 req-03d48f44-fe28-4b2f-b827-bf4fddef1e78 service nova] Creating event network-vif-deleted:fe0ac933-f0ca-447f-abf0-26d1057d8443 for instance 95f9317b-677e-4d80-895f-61eede40d94a on n-h1-850499-14 Oct 04 18:36:51.832710 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-662a2d5d-b107-4d6c-bcfd-3a58d53c4c70 req-03d48f44-fe28-4b2f-b827-bf4fddef1e78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089846 Oct 04 18:36:51.836901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a3093556-2ced-49b3-9fc6-a6d7d492f290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.838822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a3093556-2ced-49b3-9fc6-a6d7d492f290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:51.841818 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3056/6102] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:51.867580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3093556-2ced-49b3-9fc6-a6d7d492f290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.869221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3093556-2ced-49b3-9fc6-a6d7d492f290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.874076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3093556-2ced-49b3-9fc6-a6d7d492f290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.875278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3093556-2ced-49b3-9fc6-a6d7d492f290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.876117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3093556-2ced-49b3-9fc6-a6d7d492f290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.877208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a3093556-2ced-49b3-9fc6-a6d7d492f290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.003778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1edbca24-afd7-442f-9ea5-ce9fcfedb67f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.006129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1edbca24-afd7-442f-9ea5-ce9fcfedb67f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:52.076569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1edbca24-afd7-442f-9ea5-ce9fcfedb67f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.078048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1edbca24-afd7-442f-9ea5-ce9fcfedb67f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.083400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1edbca24-afd7-442f-9ea5-ce9fcfedb67f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.084768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1edbca24-afd7-442f-9ea5-ce9fcfedb67f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.086493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1edbca24-afd7-442f-9ea5-ce9fcfedb67f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.089390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1edbca24-afd7-442f-9ea5-ce9fcfedb67f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.113460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a3093556-2ced-49b3-9fc6-a6d7d492f290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.129796 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a3093556-2ced-49b3-9fc6-a6d7d492f290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 200 len: 1327 microversion: 2.1 time: 0.299543 Oct 04 18:36:52.132338 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3047/6103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 1327 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:52.458991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1edbca24-afd7-442f-9ea5-ce9fcfedb67f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.468217 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1edbca24-afd7-442f-9ea5-ce9fcfedb67f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1314 microversion: 2.1 time: 0.469471 Oct 04 18:36:52.473978 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3057/6104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:53.181675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.184871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.206159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.208218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.209498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.211233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.212414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.215782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.256803 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a HTTP/1.1 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '95f9317b-677e-4d80-895f-61eede40d94a'} Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.259034 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.274124 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.274124 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.274124 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.274124 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:53.274124 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:53.274124 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:36:53.274124 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.274124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:53.274124 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee69b43f-18e3-48ed-9b1a-6a801e4f2795 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 404 len: 111 microversion: 2.1 time: 0.099580 Oct 04 18:36:53.274124 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3048/6105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:53.279784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-84a2eccf-e693-43f2-94af-f4dd9097ea97 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '.version_select at 0x7fd4d1222ca0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.310378 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-84a2eccf-e693-43f2-94af-f4dd9097ea97 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637643343" status: 202 len: 0 microversion: 2.1 time: 0.043533 Oct 04 18:36:53.315871 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3058/6106] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:36:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637643343 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:36:53.499262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b49431bd-a9b6-4b4d-aec1-8e17561a8804 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.499907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b49431bd-a9b6-4b4d-aec1-8e17561a8804 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.510754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b49431bd-a9b6-4b4d-aec1-8e17561a8804 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.512384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b49431bd-a9b6-4b4d-aec1-8e17561a8804 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.514005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b49431bd-a9b6-4b4d-aec1-8e17561a8804 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.514774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b49431bd-a9b6-4b4d-aec1-8e17561a8804 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.515287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b49431bd-a9b6-4b4d-aec1-8e17561a8804 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.515732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b49431bd-a9b6-4b4d-aec1-8e17561a8804 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.858491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b49431bd-a9b6-4b4d-aec1-8e17561a8804 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.874768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b49431bd-a9b6-4b4d-aec1-8e17561a8804 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1464 microversion: 2.1 time: 0.374477 Oct 04 18:36:53.878229 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3049/6107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1464 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:53.909832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aa6f9910-8ba2-4f17-9862-7919978d8e3f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6a0f04e-08d5-4970-bfde-2c369f9f8992", "device": "/dev/sdb"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:53.912921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aa6f9910-8ba2-4f17-9862-7919978d8e3f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.921739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa6f9910-8ba2-4f17-9862-7919978d8e3f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.923087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa6f9910-8ba2-4f17-9862-7919978d8e3f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.924148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa6f9910-8ba2-4f17-9862-7919978d8e3f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.925572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa6f9910-8ba2-4f17-9862-7919978d8e3f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.926274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa6f9910-8ba2-4f17-9862-7919978d8e3f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.926919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa6f9910-8ba2-4f17-9862-7919978d8e3f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.602547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a41ffa65-958e-43e5-80c1-714d910809b6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: .version_select at 0x7fd4d1a7b040>, body: {"keypair": {"name": "tempest-keypair-1576182654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuLLfASG94Bn+GvNkKFRe36jOmLBRxnDR5XLO4Dzs3xoVnO0S9Ap8FD+T36yiNR81KwPKFYSBq+W2be2H/+0iFUrpT66vyXtGFRjBYN8an1k7Vf89B7xCrc+DDUCYLEbQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:54.682166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-a41ffa65-958e-43e5-80c1-714d910809b6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for project 6a9c2474d65845eb84b608f305203297. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:54.692990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-a41ffa65-958e-43e5-80c1-714d910809b6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for user 0937bdb543864ac4bb2c6f6ea1137525 and project 6a9c2474d65845eb84b608f305203297. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:54.693335 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aa6f9910-8ba2-4f17-9862-7919978d8e3f tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "POST /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791348 Oct 04 18:36:54.694447 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3059/6108] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:36:53 2022] POST /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748/os-volume_attachments => generated 194 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:54.749964 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a41ffa65-958e-43e5-80c1-714d910809b6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157215 Oct 04 18:36:54.752198 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3050/6109] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:36:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:57.905742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1338371949", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d316594-9bd8-4981-8984-faf6f3eebe9b"}], "security_groups": [{"name": "tempest-securitygroup--1513549788"}], "key_name": "tempest-keypair-1576182654", "user_data": "}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:58.136420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] validate_networks() for [('8d316594-9bd8-4981-8984-faf6f3eebe9b', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:59.770179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:59.770798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:59.771549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:59.772672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:59.773876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:59.787478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.788402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.788910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.789868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.790437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.791136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.815366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for project 6a9c2474d65845eb84b608f305203297. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:59.825130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for user 0937bdb543864ac4bb2c6f6ea1137525 and project 6a9c2474d65845eb84b608f305203297. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:59.841864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:59.850044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:59.954758 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04e599d7-093f-4ffe-b063-3ea1ce3cdc13 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.061963 Oct 04 18:36:59.955876 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3060/6110] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:59.968766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-180bc4ee-638c-4a48-8304-e8acd58ba0bc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:59.969513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-180bc4ee-638c-4a48-8304-e8acd58ba0bc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.159910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-180bc4ee-638c-4a48-8304-e8acd58ba0bc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:00.174474 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-180bc4ee-638c-4a48-8304-e8acd58ba0bc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1242 microversion: 2.1 time: 0.210891 Oct 04 18:37:00.188151 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3051/6111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:59 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1242 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:01.200868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9405197d-df26-407e-9c1a-ba0cac085376 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.202181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9405197d-df26-407e-9c1a-ba0cac085376 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:01.233656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9405197d-df26-407e-9c1a-ba0cac085376 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.234518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9405197d-df26-407e-9c1a-ba0cac085376 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.235102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9405197d-df26-407e-9c1a-ba0cac085376 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.237669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9405197d-df26-407e-9c1a-ba0cac085376 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.241607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9405197d-df26-407e-9c1a-ba0cac085376 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.243263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9405197d-df26-407e-9c1a-ba0cac085376 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.397343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9405197d-df26-407e-9c1a-ba0cac085376 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.410083 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9405197d-df26-407e-9c1a-ba0cac085376 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1238 microversion: 2.1 time: 0.214369 Oct 04 18:37:01.413445 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3061/6112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1238 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:02.440766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-870bd6a0-f05e-4d77-8000-74665ae74d6a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:02.442114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-870bd6a0-f05e-4d77-8000-74665ae74d6a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:02.453407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870bd6a0-f05e-4d77-8000-74665ae74d6a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.454721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870bd6a0-f05e-4d77-8000-74665ae74d6a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.457477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870bd6a0-f05e-4d77-8000-74665ae74d6a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.460528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870bd6a0-f05e-4d77-8000-74665ae74d6a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.463802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870bd6a0-f05e-4d77-8000-74665ae74d6a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.467532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870bd6a0-f05e-4d77-8000-74665ae74d6a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.609718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-870bd6a0-f05e-4d77-8000-74665ae74d6a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:02.628195 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-870bd6a0-f05e-4d77-8000-74665ae74d6a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1300 microversion: 2.1 time: 0.190617 Oct 04 18:37:02.630150 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3052/6113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:02 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1300 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:03.666745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-32c11937-1cea-41f9-b051-f0930cfc2577 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:03.667714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-32c11937-1cea-41f9-b051-f0930cfc2577 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:03.697784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32c11937-1cea-41f9-b051-f0930cfc2577 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.698640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32c11937-1cea-41f9-b051-f0930cfc2577 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.715060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32c11937-1cea-41f9-b051-f0930cfc2577 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.717023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32c11937-1cea-41f9-b051-f0930cfc2577 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.717764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32c11937-1cea-41f9-b051-f0930cfc2577 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.718449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32c11937-1cea-41f9-b051-f0930cfc2577 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.009010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-32c11937-1cea-41f9-b051-f0930cfc2577 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:04.026583 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-32c11937-1cea-41f9-b051-f0930cfc2577 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1368 microversion: 2.1 time: 0.368068 Oct 04 18:37:04.040692 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3062/6114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:03 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1368 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:05.056148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74999b05-fd47-4580-82f2-932dd82db11a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:05.057164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-74999b05-fd47-4580-82f2-932dd82db11a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:05.078997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74999b05-fd47-4580-82f2-932dd82db11a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.079923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74999b05-fd47-4580-82f2-932dd82db11a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.080988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74999b05-fd47-4580-82f2-932dd82db11a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.083210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74999b05-fd47-4580-82f2-932dd82db11a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.083924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74999b05-fd47-4580-82f2-932dd82db11a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.084588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74999b05-fd47-4580-82f2-932dd82db11a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.473000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-74999b05-fd47-4580-82f2-932dd82db11a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:05.489563 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74999b05-fd47-4580-82f2-932dd82db11a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1368 microversion: 2.1 time: 0.439815 Oct 04 18:37:05.492321 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3053/6115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:05 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1368 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:05.957897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ffd1ec93-8824-4048-88a6-d6cb996f340f req-185e5f1d-0c3d-487e-acd0-198d8311bc7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4359baf5-e205-4f98-be2c-6a33a2ea24f4", "tag": "02502de0-4aa1-4449-b5f8-6310f0f1548b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:06.024111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ffd1ec93-8824-4048-88a6-d6cb996f340f req-185e5f1d-0c3d-487e-acd0-198d8311bc7d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.025378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ffd1ec93-8824-4048-88a6-d6cb996f340f req-185e5f1d-0c3d-487e-acd0-198d8311bc7d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.026607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ffd1ec93-8824-4048-88a6-d6cb996f340f req-185e5f1d-0c3d-487e-acd0-198d8311bc7d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.071693 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ffd1ec93-8824-4048-88a6-d6cb996f340f req-185e5f1d-0c3d-487e-acd0-198d8311bc7d service nova] Creating event network-changed:02502de0-4aa1-4449-b5f8-6310f0f1548b for instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 on n-h2-850499-14 Oct 04 18:37:06.080903 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ffd1ec93-8824-4048-88a6-d6cb996f340f req-185e5f1d-0c3d-487e-acd0-198d8311bc7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131734 Oct 04 18:37:06.082237 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3063/6116] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:06.529214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f0ba4cc-a961-467c-a7fc-2491cc80923c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:06.530157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9f0ba4cc-a961-467c-a7fc-2491cc80923c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:06.546373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f0ba4cc-a961-467c-a7fc-2491cc80923c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.555636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f0ba4cc-a961-467c-a7fc-2491cc80923c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.557978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f0ba4cc-a961-467c-a7fc-2491cc80923c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.560387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f0ba4cc-a961-467c-a7fc-2491cc80923c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.561229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f0ba4cc-a961-467c-a7fc-2491cc80923c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.579575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f0ba4cc-a961-467c-a7fc-2491cc80923c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.633809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:06.707510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1223952175", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "c275458a-f54d-4c86-ab21-cdaa476685d0"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:06.791139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] validate_networks() for [('c275458a-f54d-4c86-ab21-cdaa476685d0', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:06.969282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f0ba4cc-a961-467c-a7fc-2491cc80923c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:06.983864 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9f0ba4cc-a961-467c-a7fc-2491cc80923c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1368 microversion: 2.1 time: 0.460639 Oct 04 18:37:06.985679 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3064/6117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:06 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1368 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:07.464595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:07.465260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:07.466861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:07.467769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:07.468566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:07.493746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.494557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.495228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.496959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.497438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.497873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.535695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Getting quotas for project fb50397d1e4240018f4101293ab36292. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:07.542288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Getting quotas for user e8a95397a55c4376b486745c88b730e9 and project fb50397d1e4240018f4101293ab36292. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:07.561733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:07.566532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:07.675652 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0a6812f0-1312-47d7-b20d-eb7bf5f3fff5 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305586 Oct 04 18:37:07.676745 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3054/6118] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:37:07.693302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ea066d7-eeee-4f3c-ad78-97a12ea1ffdc tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:07.693835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ea066d7-eeee-4f3c-ad78-97a12ea1ffdc tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:07.904710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ea066d7-eeee-4f3c-ad78-97a12ea1ffdc tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:07.931443 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ea066d7-eeee-4f3c-ad78-97a12ea1ffdc tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1215 microversion: 2.1 time: 0.231417 Oct 04 18:37:07.942991 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3065/6119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:07 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:08.010346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b733c907-7930-4d04-9d14-6f58e4b10dcf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.011176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b733c907-7930-4d04-9d14-6f58e4b10dcf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:08.019236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b733c907-7930-4d04-9d14-6f58e4b10dcf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.019786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b733c907-7930-4d04-9d14-6f58e4b10dcf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.020245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b733c907-7930-4d04-9d14-6f58e4b10dcf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.021831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b733c907-7930-4d04-9d14-6f58e4b10dcf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.022597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b733c907-7930-4d04-9d14-6f58e4b10dcf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.023645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b733c907-7930-4d04-9d14-6f58e4b10dcf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.050776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:08.253769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b733c907-7930-4d04-9d14-6f58e4b10dcf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:08.266251 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b733c907-7930-4d04-9d14-6f58e4b10dcf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1368 microversion: 2.1 time: 0.259842 Oct 04 18:37:08.283521 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3055/6120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:08.965048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-847c0e2b-0cde-495b-a9d2-346e113e5779 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.967101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-847c0e2b-0cde-495b-a9d2-346e113e5779 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:08.979321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-847c0e2b-0cde-495b-a9d2-346e113e5779 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.981179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-847c0e2b-0cde-495b-a9d2-346e113e5779 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.981922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-847c0e2b-0cde-495b-a9d2-346e113e5779 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.982823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-847c0e2b-0cde-495b-a9d2-346e113e5779 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.983793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-847c0e2b-0cde-495b-a9d2-346e113e5779 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.984878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-847c0e2b-0cde-495b-a9d2-346e113e5779 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.097933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-847c0e2b-0cde-495b-a9d2-346e113e5779 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:09.116530 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-847c0e2b-0cde-495b-a9d2-346e113e5779 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1211 microversion: 2.1 time: 0.156104 Oct 04 18:37:09.117674 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3066/6121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:09.307192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3da8355a-047e-4260-823e-ce22697c9fbf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:09.308761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3da8355a-047e-4260-823e-ce22697c9fbf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:09.312033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:09.318060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da8355a-047e-4260-823e-ce22697c9fbf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.318798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da8355a-047e-4260-823e-ce22697c9fbf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.319532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da8355a-047e-4260-823e-ce22697c9fbf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.320769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da8355a-047e-4260-823e-ce22697c9fbf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.321312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da8355a-047e-4260-823e-ce22697c9fbf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.321799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3da8355a-047e-4260-823e-ce22697c9fbf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.566345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3da8355a-047e-4260-823e-ce22697c9fbf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:09.585629 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3da8355a-047e-4260-823e-ce22697c9fbf tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1368 microversion: 2.1 time: 0.283553 Oct 04 18:37:09.587366 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3056/6122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:09 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:09.967586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cc614da4-2d10-4826-bee9-191174c67e00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:09.976028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cc614da4-2d10-4826-bee9-191174c67e00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:09.994287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:10.021972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc614da4-2d10-4826-bee9-191174c67e00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.023407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc614da4-2d10-4826-bee9-191174c67e00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.025532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc614da4-2d10-4826-bee9-191174c67e00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.027347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc614da4-2d10-4826-bee9-191174c67e00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.028633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc614da4-2d10-4826-bee9-191174c67e00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.029751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc614da4-2d10-4826-bee9-191174c67e00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.144554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0694311c-ddf9-486a-b630-5645994062b7 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:10.145064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0694311c-ddf9-486a-b630-5645994062b7 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:10.160531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0694311c-ddf9-486a-b630-5645994062b7 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.161055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0694311c-ddf9-486a-b630-5645994062b7 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.161543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0694311c-ddf9-486a-b630-5645994062b7 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.163824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0694311c-ddf9-486a-b630-5645994062b7 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.164299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0694311c-ddf9-486a-b630-5645994062b7 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.164743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0694311c-ddf9-486a-b630-5645994062b7 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.177112 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cc614da4-2d10-4826-bee9-191174c67e00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5/action" status: 200 len: 24564 microversion: 2.1 time: 0.216070 Oct 04 18:37:10.183740 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3067/6123] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:09 2022] POST /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5/action => generated 24564 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:10.278918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0694311c-ddf9-486a-b630-5645994062b7 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:10.290731 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0694311c-ddf9-486a-b630-5645994062b7 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1273 microversion: 2.1 time: 0.150820 Oct 04 18:37:10.291954 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3057/6124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:10 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:10.641259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a729b6c-85c2-49ed-82f0-319f32b859d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:10.641929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a729b6c-85c2-49ed-82f0-319f32b859d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:10.660647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a729b6c-85c2-49ed-82f0-319f32b859d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.662248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a729b6c-85c2-49ed-82f0-319f32b859d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.663532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a729b6c-85c2-49ed-82f0-319f32b859d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.665126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a729b6c-85c2-49ed-82f0-319f32b859d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.666309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a729b6c-85c2-49ed-82f0-319f32b859d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.668539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a729b6c-85c2-49ed-82f0-319f32b859d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.945122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9a729b6c-85c2-49ed-82f0-319f32b859d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:10.968245 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a729b6c-85c2-49ed-82f0-319f32b859d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1368 microversion: 2.1 time: 0.332787 Oct 04 18:37:10.991127 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3068/6125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:10 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:11.318103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7366b080-554c-4efc-a715-0ad3d03f47f2 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.319625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7366b080-554c-4efc-a715-0ad3d03f47f2 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.329606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7366b080-554c-4efc-a715-0ad3d03f47f2 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.330420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7366b080-554c-4efc-a715-0ad3d03f47f2 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.331291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7366b080-554c-4efc-a715-0ad3d03f47f2 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.332349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7366b080-554c-4efc-a715-0ad3d03f47f2 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.333217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7366b080-554c-4efc-a715-0ad3d03f47f2 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.333916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7366b080-554c-4efc-a715-0ad3d03f47f2 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.590566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7366b080-554c-4efc-a715-0ad3d03f47f2 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.603006 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7366b080-554c-4efc-a715-0ad3d03f47f2 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1273 microversion: 2.1 time: 0.288971 Oct 04 18:37:11.603966 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3058/6126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:12.026880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ffe3c1c-c466-47d2-99df-5cef6b60c1f9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:12.029165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ffe3c1c-c466-47d2-99df-5cef6b60c1f9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:12.045988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:12.050777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c1c-c466-47d2-99df-5cef6b60c1f9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.058004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c1c-c466-47d2-99df-5cef6b60c1f9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.059667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c1c-c466-47d2-99df-5cef6b60c1f9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.060702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c1c-c466-47d2-99df-5cef6b60c1f9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.064158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c1c-c466-47d2-99df-5cef6b60c1f9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.073305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c1c-c466-47d2-99df-5cef6b60c1f9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.421644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1ffe3c1c-c466-47d2-99df-5cef6b60c1f9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:12.473446 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ffe3c1c-c466-47d2-99df-5cef6b60c1f9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1368 microversion: 2.1 time: 0.453149 Oct 04 18:37:12.476323 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3069/6127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:12 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1368 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:12.631753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ea158fb-35f5-4da9-84c0-f1bf04093506 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:12.633733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ea158fb-35f5-4da9-84c0-f1bf04093506 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:12.668596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ea158fb-35f5-4da9-84c0-f1bf04093506 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.671709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ea158fb-35f5-4da9-84c0-f1bf04093506 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.672666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ea158fb-35f5-4da9-84c0-f1bf04093506 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.675316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ea158fb-35f5-4da9-84c0-f1bf04093506 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.676791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ea158fb-35f5-4da9-84c0-f1bf04093506 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.678118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ea158fb-35f5-4da9-84c0-f1bf04093506 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.026554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ea158fb-35f5-4da9-84c0-f1bf04093506 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:13.088669 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ea158fb-35f5-4da9-84c0-f1bf04093506 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1315 microversion: 2.1 time: 0.464636 Oct 04 18:37:13.089858 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3059/6128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:12 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.510652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4fe5895-4d0a-4eef-94de-5b91b0cae4a9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:13.511971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f4fe5895-4d0a-4eef-94de-5b91b0cae4a9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:13.530249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4fe5895-4d0a-4eef-94de-5b91b0cae4a9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.531084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4fe5895-4d0a-4eef-94de-5b91b0cae4a9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.531541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4fe5895-4d0a-4eef-94de-5b91b0cae4a9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.532325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4fe5895-4d0a-4eef-94de-5b91b0cae4a9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.532833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4fe5895-4d0a-4eef-94de-5b91b0cae4a9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.533737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4fe5895-4d0a-4eef-94de-5b91b0cae4a9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.767618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f4fe5895-4d0a-4eef-94de-5b91b0cae4a9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:13.783209 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f4fe5895-4d0a-4eef-94de-5b91b0cae4a9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1368 microversion: 2.1 time: 0.276716 Oct 04 18:37:13.784960 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3070/6129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.982146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a7dc6e8b-87f9-4d7c-8068-d457fade98c2 req-a4c17cd9-dc92-4d83-8f83-e7321b98ae6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4359baf5-e205-4f98-be2c-6a33a2ea24f4", "name": "network-vif-plugged", "status": "completed", "tag": "02502de0-4aa1-4449-b5f8-6310f0f1548b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:14.029591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a7dc6e8b-87f9-4d7c-8068-d457fade98c2 req-a4c17cd9-dc92-4d83-8f83-e7321b98ae6d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.037092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a7dc6e8b-87f9-4d7c-8068-d457fade98c2 req-a4c17cd9-dc92-4d83-8f83-e7321b98ae6d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.038270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a7dc6e8b-87f9-4d7c-8068-d457fade98c2 req-a4c17cd9-dc92-4d83-8f83-e7321b98ae6d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.090496 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a7dc6e8b-87f9-4d7c-8068-d457fade98c2 req-a4c17cd9-dc92-4d83-8f83-e7321b98ae6d service nova] Creating event network-vif-plugged:02502de0-4aa1-4449-b5f8-6310f0f1548b for instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 on n-h2-850499-14 Oct 04 18:37:14.121507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-acd75cc4-0965-4d20-9d5e-d41e922725c9 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.126753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-acd75cc4-0965-4d20-9d5e-d41e922725c9 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.131352 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a7dc6e8b-87f9-4d7c-8068-d457fade98c2 req-a4c17cd9-dc92-4d83-8f83-e7321b98ae6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152381 Oct 04 18:37:14.134880 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3060/6130] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:14.144149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd75cc4-0965-4d20-9d5e-d41e922725c9 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.145836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd75cc4-0965-4d20-9d5e-d41e922725c9 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.147062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd75cc4-0965-4d20-9d5e-d41e922725c9 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.148990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd75cc4-0965-4d20-9d5e-d41e922725c9 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.150164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd75cc4-0965-4d20-9d5e-d41e922725c9 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.151529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd75cc4-0965-4d20-9d5e-d41e922725c9 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.676061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c4ac8275-dbf4-46a5-ae24-c33a0def8d52 req-31dfd545-26bd-457b-add4-a8cdc141f9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbc815e-14de-418e-960b-621f11c1dfd9", "tag": "5ff5bf41-b362-4ae0-85a2-3f2584fb300e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:14.693789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c4ac8275-dbf4-46a5-ae24-c33a0def8d52 req-31dfd545-26bd-457b-add4-a8cdc141f9c7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.694296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c4ac8275-dbf4-46a5-ae24-c33a0def8d52 req-31dfd545-26bd-457b-add4-a8cdc141f9c7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.694743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c4ac8275-dbf4-46a5-ae24-c33a0def8d52 req-31dfd545-26bd-457b-add4-a8cdc141f9c7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.733876 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c4ac8275-dbf4-46a5-ae24-c33a0def8d52 req-31dfd545-26bd-457b-add4-a8cdc141f9c7 service nova] Creating event network-changed:5ff5bf41-b362-4ae0-85a2-3f2584fb300e for instance adbc815e-14de-418e-960b-621f11c1dfd9 on n-h1-850499-14 Oct 04 18:37:14.740722 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c4ac8275-dbf4-46a5-ae24-c33a0def8d52 req-31dfd545-26bd-457b-add4-a8cdc141f9c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068726 Oct 04 18:37:14.742456 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3061/6131] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:14.819191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-21cc128d-4aeb-4c72-a26c-76accaf6ae3f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.820542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-21cc128d-4aeb-4c72-a26c-76accaf6ae3f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.829235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21cc128d-4aeb-4c72-a26c-76accaf6ae3f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.830207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21cc128d-4aeb-4c72-a26c-76accaf6ae3f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.834896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21cc128d-4aeb-4c72-a26c-76accaf6ae3f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.835989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21cc128d-4aeb-4c72-a26c-76accaf6ae3f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.836932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21cc128d-4aeb-4c72-a26c-76accaf6ae3f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.837554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21cc128d-4aeb-4c72-a26c-76accaf6ae3f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.916937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-acd75cc4-0965-4d20-9d5e-d41e922725c9 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.927791 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-acd75cc4-0965-4d20-9d5e-d41e922725c9 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1315 microversion: 2.1 time: 0.814600 Oct 04 18:37:14.930492 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3071/6132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:14 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:15.135336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-21cc128d-4aeb-4c72-a26c-76accaf6ae3f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:15.146683 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-21cc128d-4aeb-4c72-a26c-76accaf6ae3f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1368 microversion: 2.1 time: 0.332066 Oct 04 18:37:15.163003 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3062/6133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:14 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:15.960093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0fa102ee-84b6-4d49-8533-355d877a4dd1 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:15.961061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0fa102ee-84b6-4d49-8533-355d877a4dd1 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:15.972172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fa102ee-84b6-4d49-8533-355d877a4dd1 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.973201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fa102ee-84b6-4d49-8533-355d877a4dd1 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.974007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fa102ee-84b6-4d49-8533-355d877a4dd1 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.975178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fa102ee-84b6-4d49-8533-355d877a4dd1 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.976363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fa102ee-84b6-4d49-8533-355d877a4dd1 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.977176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fa102ee-84b6-4d49-8533-355d877a4dd1 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.195946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16124da7-46b4-447b-a1a3-2e90dfa71acc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.197801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-16124da7-46b4-447b-a1a3-2e90dfa71acc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:16.206122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16124da7-46b4-447b-a1a3-2e90dfa71acc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.206626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16124da7-46b4-447b-a1a3-2e90dfa71acc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.207099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16124da7-46b4-447b-a1a3-2e90dfa71acc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.208050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16124da7-46b4-447b-a1a3-2e90dfa71acc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.209541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16124da7-46b4-447b-a1a3-2e90dfa71acc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.210360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16124da7-46b4-447b-a1a3-2e90dfa71acc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.438144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0fa102ee-84b6-4d49-8533-355d877a4dd1 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.455382 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0fa102ee-84b6-4d49-8533-355d877a4dd1 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1315 microversion: 2.1 time: 0.500792 Oct 04 18:37:16.468509 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3072/6134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:15 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:16.543008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-16124da7-46b4-447b-a1a3-2e90dfa71acc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.563035 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-16124da7-46b4-447b-a1a3-2e90dfa71acc tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1557 microversion: 2.1 time: 0.373719 Oct 04 18:37:16.572910 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3063/6135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1557 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:16.600104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c8649d9-0294-4399-81a6-b3b5ba45e3f2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.613405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1c8649d9-0294-4399-81a6-b3b5ba45e3f2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:16.644880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c8649d9-0294-4399-81a6-b3b5ba45e3f2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.645910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c8649d9-0294-4399-81a6-b3b5ba45e3f2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.646564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c8649d9-0294-4399-81a6-b3b5ba45e3f2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.648203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c8649d9-0294-4399-81a6-b3b5ba45e3f2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.649911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c8649d9-0294-4399-81a6-b3b5ba45e3f2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.651099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c8649d9-0294-4399-81a6-b3b5ba45e3f2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.804837 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c8649d9-0294-4399-81a6-b3b5ba45e3f2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209151 Oct 04 18:37:16.805864 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3073/6136] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:17.487042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b696f83-ceb6-488c-92a8-94fdaff7f35d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:17.487912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b696f83-ceb6-488c-92a8-94fdaff7f35d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:17.531769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:17.536411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b696f83-ceb6-488c-92a8-94fdaff7f35d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.537035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b696f83-ceb6-488c-92a8-94fdaff7f35d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.537492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b696f83-ceb6-488c-92a8-94fdaff7f35d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.538232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b696f83-ceb6-488c-92a8-94fdaff7f35d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.538754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b696f83-ceb6-488c-92a8-94fdaff7f35d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.539280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b696f83-ceb6-488c-92a8-94fdaff7f35d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.569660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=12 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:17.957599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7b696f83-ceb6-488c-92a8-94fdaff7f35d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.967382 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b696f83-ceb6-488c-92a8-94fdaff7f35d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1315 microversion: 2.1 time: 0.488602 Oct 04 18:37:17.975544 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3064/6137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:17 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:19.007058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:19.012834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1132e2ae-6175-4240-8f33-222a9df734fa tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.014311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1132e2ae-6175-4240-8f33-222a9df734fa tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.036325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1132e2ae-6175-4240-8f33-222a9df734fa tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.041677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1132e2ae-6175-4240-8f33-222a9df734fa tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.043660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1132e2ae-6175-4240-8f33-222a9df734fa tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.046472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1132e2ae-6175-4240-8f33-222a9df734fa tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.055336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1132e2ae-6175-4240-8f33-222a9df734fa tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.056215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1132e2ae-6175-4240-8f33-222a9df734fa tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.480081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1132e2ae-6175-4240-8f33-222a9df734fa tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:19.501534 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1132e2ae-6175-4240-8f33-222a9df734fa tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1315 microversion: 2.1 time: 0.488507 Oct 04 18:37:19.503066 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3074/6138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:18 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:20.256903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-adce2963-0bd0-4ed7-aa30-6845653c9401 req-08cd6041-89cb-4324-9526-61821e77253c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4359baf5-e205-4f98-be2c-6a33a2ea24f4", "tag": "02502de0-4aa1-4449-b5f8-6310f0f1548b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:20.288315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-adce2963-0bd0-4ed7-aa30-6845653c9401 req-08cd6041-89cb-4324-9526-61821e77253c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.289638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-adce2963-0bd0-4ed7-aa30-6845653c9401 req-08cd6041-89cb-4324-9526-61821e77253c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.290738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-adce2963-0bd0-4ed7-aa30-6845653c9401 req-08cd6041-89cb-4324-9526-61821e77253c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.305338 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-adce2963-0bd0-4ed7-aa30-6845653c9401 req-08cd6041-89cb-4324-9526-61821e77253c service nova] Creating event network-changed:02502de0-4aa1-4449-b5f8-6310f0f1548b for instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 on n-h2-850499-14 Oct 04 18:37:20.324539 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-adce2963-0bd0-4ed7-aa30-6845653c9401 req-08cd6041-89cb-4324-9526-61821e77253c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069059 Oct 04 18:37:20.327531 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3065/6139] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:20.553638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c1511bd5-bfec-4d6b-b2f6-1f26cfaa0364 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:20.554561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c1511bd5-bfec-4d6b-b2f6-1f26cfaa0364 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:20.568869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1511bd5-bfec-4d6b-b2f6-1f26cfaa0364 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.569380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1511bd5-bfec-4d6b-b2f6-1f26cfaa0364 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.573060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1511bd5-bfec-4d6b-b2f6-1f26cfaa0364 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.574252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1511bd5-bfec-4d6b-b2f6-1f26cfaa0364 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.578168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1511bd5-bfec-4d6b-b2f6-1f26cfaa0364 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.580331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c1511bd5-bfec-4d6b-b2f6-1f26cfaa0364 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.395421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7bd67737-a98b-416d-9173-55a94b191927 req-54d4ba06-a324-472d-b8a0-a62503ad7ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbc815e-14de-418e-960b-621f11c1dfd9", "name": "network-vif-plugged", "status": "completed", "tag": "5ff5bf41-b362-4ae0-85a2-3f2584fb300e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:21.491181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7bd67737-a98b-416d-9173-55a94b191927 req-54d4ba06-a324-472d-b8a0-a62503ad7ad1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.495838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7bd67737-a98b-416d-9173-55a94b191927 req-54d4ba06-a324-472d-b8a0-a62503ad7ad1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.501278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7bd67737-a98b-416d-9173-55a94b191927 req-54d4ba06-a324-472d-b8a0-a62503ad7ad1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.574062 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7bd67737-a98b-416d-9173-55a94b191927 req-54d4ba06-a324-472d-b8a0-a62503ad7ad1 service nova] Creating event network-vif-plugged:5ff5bf41-b362-4ae0-85a2-3f2584fb300e for instance adbc815e-14de-418e-960b-621f11c1dfd9 on n-h1-850499-14 Oct 04 18:37:21.628186 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7bd67737-a98b-416d-9173-55a94b191927 req-54d4ba06-a324-472d-b8a0-a62503ad7ad1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246452 Oct 04 18:37:21.629454 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3066/6140] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:21.838125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c1511bd5-bfec-4d6b-b2f6-1f26cfaa0364 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:21.881673 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c1511bd5-bfec-4d6b-b2f6-1f26cfaa0364 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1315 microversion: 2.1 time: 1.329178 Oct 04 18:37:21.887866 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3075/6141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:20 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1315 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:22.946481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3549497d-18dd-40be-8bdb-78f074f33b06 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:22.954231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3549497d-18dd-40be-8bdb-78f074f33b06 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:22.977338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3549497d-18dd-40be-8bdb-78f074f33b06 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.989238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3549497d-18dd-40be-8bdb-78f074f33b06 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.990275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3549497d-18dd-40be-8bdb-78f074f33b06 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.991812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3549497d-18dd-40be-8bdb-78f074f33b06 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.992832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3549497d-18dd-40be-8bdb-78f074f33b06 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.994119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3549497d-18dd-40be-8bdb-78f074f33b06 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.630244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3549497d-18dd-40be-8bdb-78f074f33b06 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:23.649610 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3549497d-18dd-40be-8bdb-78f074f33b06 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1315 microversion: 2.1 time: 0.711497 Oct 04 18:37:23.654346 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3067/6142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:22 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:24.707065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5bdc2ef3-1421-48ee-b42d-1407fa18fe26 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:24.717216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5bdc2ef3-1421-48ee-b42d-1407fa18fe26 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:24.750491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bdc2ef3-1421-48ee-b42d-1407fa18fe26 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.757881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bdc2ef3-1421-48ee-b42d-1407fa18fe26 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.758738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bdc2ef3-1421-48ee-b42d-1407fa18fe26 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.759792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bdc2ef3-1421-48ee-b42d-1407fa18fe26 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.760465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bdc2ef3-1421-48ee-b42d-1407fa18fe26 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.763440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bdc2ef3-1421-48ee-b42d-1407fa18fe26 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.237280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5bdc2ef3-1421-48ee-b42d-1407fa18fe26 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.248772 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5bdc2ef3-1421-48ee-b42d-1407fa18fe26 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1503 microversion: 2.1 time: 0.563108 Oct 04 18:37:25.249392 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3076/6143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:24 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1503 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:25.294055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-53b2f510-8791-4919-93a3-c94f7aa1675f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.295726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-53b2f510-8791-4919-93a3-c94f7aa1675f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.312964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53b2f510-8791-4919-93a3-c94f7aa1675f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.313621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53b2f510-8791-4919-93a3-c94f7aa1675f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.314083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53b2f510-8791-4919-93a3-c94f7aa1675f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.323474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53b2f510-8791-4919-93a3-c94f7aa1675f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.324656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53b2f510-8791-4919-93a3-c94f7aa1675f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.325129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53b2f510-8791-4919-93a3-c94f7aa1675f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.638751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-53b2f510-8791-4919-93a3-c94f7aa1675f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.654593 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-53b2f510-8791-4919-93a3-c94f7aa1675f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1503 microversion: 2.1 time: 0.365212 Oct 04 18:37:25.656399 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3068/6144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1503 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:25.678718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f47e0a55-493d-48a7-9e78-dadd5ece4a58 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:25.679307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f47e0a55-493d-48a7-9e78-dadd5ece4a58 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.686438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f47e0a55-493d-48a7-9e78-dadd5ece4a58 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.686937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f47e0a55-493d-48a7-9e78-dadd5ece4a58 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.687615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f47e0a55-493d-48a7-9e78-dadd5ece4a58 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.688818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f47e0a55-493d-48a7-9e78-dadd5ece4a58 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.689531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f47e0a55-493d-48a7-9e78-dadd5ece4a58 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.690231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f47e0a55-493d-48a7-9e78-dadd5ece4a58 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.719355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-f47e0a55-493d-48a7-9e78-dadd5ece4a58 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lazy-loading 'flavor' on Instance uuid adbc815e-14de-418e-960b-621f11c1dfd9 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:25.835888 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f47e0a55-493d-48a7-9e78-dadd5ece4a58 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "POST /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9/action" status: 202 len: 0 microversion: 2.1 time: 0.160430 Oct 04 18:37:25.838084 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3077/6145] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:25 2022] POST /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:25.868101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-987d0405-12af-44b2-b06c-aa87db2cac4d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.868754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-987d0405-12af-44b2-b06c-aa87db2cac4d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.904795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-987d0405-12af-44b2-b06c-aa87db2cac4d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.905564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-987d0405-12af-44b2-b06c-aa87db2cac4d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.906329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-987d0405-12af-44b2-b06c-aa87db2cac4d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.918079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-987d0405-12af-44b2-b06c-aa87db2cac4d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.926506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-987d0405-12af-44b2-b06c-aa87db2cac4d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.927080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-987d0405-12af-44b2-b06c-aa87db2cac4d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.202318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-987d0405-12af-44b2-b06c-aa87db2cac4d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:26.214653 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-987d0405-12af-44b2-b06c-aa87db2cac4d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1511 microversion: 2.1 time: 0.368560 Oct 04 18:37:26.215365 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3069/6146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:27.246415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d1c4bf7d-8532-408c-9972-3b5b959d410d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.247182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d1c4bf7d-8532-408c-9972-3b5b959d410d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.254436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf7d-8532-408c-9972-3b5b959d410d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.254866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf7d-8532-408c-9972-3b5b959d410d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.255705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf7d-8532-408c-9972-3b5b959d410d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.256822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf7d-8532-408c-9972-3b5b959d410d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.257505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf7d-8532-408c-9972-3b5b959d410d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.258223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf7d-8532-408c-9972-3b5b959d410d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.575883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d1c4bf7d-8532-408c-9972-3b5b959d410d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.586136 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d1c4bf7d-8532-408c-9972-3b5b959d410d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1494 microversion: 2.1 time: 0.345166 Oct 04 18:37:27.587933 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3078/6147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1494 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:27.613657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6102fb66-bc33-4b3a-bf42-d4c2fa519e89 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:27.614546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6102fb66-bc33-4b3a-bf42-d4c2fa519e89 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.622506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6102fb66-bc33-4b3a-bf42-d4c2fa519e89 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.623072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6102fb66-bc33-4b3a-bf42-d4c2fa519e89 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.623522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6102fb66-bc33-4b3a-bf42-d4c2fa519e89 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.624255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6102fb66-bc33-4b3a-bf42-d4c2fa519e89 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.624709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6102fb66-bc33-4b3a-bf42-d4c2fa519e89 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.625352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6102fb66-bc33-4b3a-bf42-d4c2fa519e89 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.810936 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6102fb66-bc33-4b3a-bf42-d4c2fa519e89 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "POST /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9/action" status: 202 len: 0 microversion: 2.1 time: 0.199971 Oct 04 18:37:27.816335 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3070/6148] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:27 2022] POST /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:27.824128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a75697f9-c48d-454c-ab6d-d29edb20086f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.825108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a75697f9-c48d-454c-ab6d-d29edb20086f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.854148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a75697f9-c48d-454c-ab6d-d29edb20086f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.854791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a75697f9-c48d-454c-ab6d-d29edb20086f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.855369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a75697f9-c48d-454c-ab6d-d29edb20086f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.856104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a75697f9-c48d-454c-ab6d-d29edb20086f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.856833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a75697f9-c48d-454c-ab6d-d29edb20086f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.857481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a75697f9-c48d-454c-ab6d-d29edb20086f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.130813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a75697f9-c48d-454c-ab6d-d29edb20086f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.142015 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a75697f9-c48d-454c-ab6d-d29edb20086f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1500 microversion: 2.1 time: 0.323928 Oct 04 18:37:28.143319 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3079/6149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1500 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:29.173738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-397f656b-55fb-426e-9d5d-8960cf2b095d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.175903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-397f656b-55fb-426e-9d5d-8960cf2b095d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:29.197005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397f656b-55fb-426e-9d5d-8960cf2b095d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.197524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397f656b-55fb-426e-9d5d-8960cf2b095d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.198157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397f656b-55fb-426e-9d5d-8960cf2b095d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.199625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397f656b-55fb-426e-9d5d-8960cf2b095d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.200095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397f656b-55fb-426e-9d5d-8960cf2b095d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.200537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-397f656b-55fb-426e-9d5d-8960cf2b095d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.636761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-397f656b-55fb-426e-9d5d-8960cf2b095d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:29.658303 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-397f656b-55fb-426e-9d5d-8960cf2b095d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1500 microversion: 2.1 time: 0.492183 Oct 04 18:37:29.659753 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3071/6150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1500 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:30.698067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d8b521c3-8593-45ef-a5a6-56cef1ae7c53 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.700438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d8b521c3-8593-45ef-a5a6-56cef1ae7c53 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.723623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b521c3-8593-45ef-a5a6-56cef1ae7c53 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.728337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b521c3-8593-45ef-a5a6-56cef1ae7c53 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.729330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b521c3-8593-45ef-a5a6-56cef1ae7c53 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.732126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b521c3-8593-45ef-a5a6-56cef1ae7c53 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.738911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b521c3-8593-45ef-a5a6-56cef1ae7c53 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.739623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d8b521c3-8593-45ef-a5a6-56cef1ae7c53 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.101776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d8b521c3-8593-45ef-a5a6-56cef1ae7c53 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.128028 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d8b521c3-8593-45ef-a5a6-56cef1ae7c53 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1503 microversion: 2.1 time: 0.431620 Oct 04 18:37:31.140144 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3080/6151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1503 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:31.162895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f35daea-eff8-42be-98df-039aee00795a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:31.164509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f35daea-eff8-42be-98df-039aee00795a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.173633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f35daea-eff8-42be-98df-039aee00795a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.174497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f35daea-eff8-42be-98df-039aee00795a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.175068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f35daea-eff8-42be-98df-039aee00795a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.176092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f35daea-eff8-42be-98df-039aee00795a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.183066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f35daea-eff8-42be-98df-039aee00795a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.187152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f35daea-eff8-42be-98df-039aee00795a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.271897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-1f35daea-eff8-42be-98df-039aee00795a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lazy-loading 'flavor' on Instance uuid adbc815e-14de-418e-960b-621f11c1dfd9 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:31.432057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:31.499242 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f35daea-eff8-42be-98df-039aee00795a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "POST /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9/action" status: 202 len: 0 microversion: 2.1 time: 0.340819 Oct 04 18:37:31.503215 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3072/6152] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:31 2022] POST /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:37:31.510428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-683c228a-54b2-4ce5-9f3c-cf5b03094693 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.511935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-683c228a-54b2-4ce5-9f3c-cf5b03094693 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.525646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683c228a-54b2-4ce5-9f3c-cf5b03094693 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.526159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683c228a-54b2-4ce5-9f3c-cf5b03094693 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.527402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683c228a-54b2-4ce5-9f3c-cf5b03094693 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.528145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683c228a-54b2-4ce5-9f3c-cf5b03094693 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.528613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683c228a-54b2-4ce5-9f3c-cf5b03094693 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.529054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-683c228a-54b2-4ce5-9f3c-cf5b03094693 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.549710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:32.174928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-683c228a-54b2-4ce5-9f3c-cf5b03094693 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.194460 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-683c228a-54b2-4ce5-9f3c-cf5b03094693 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1511 microversion: 2.1 time: 0.688114 Oct 04 18:37:32.197879 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3081/6153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1511 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.242629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0640209c-804c-4686-b703-e525aaeaac7f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.244000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0640209c-804c-4686-b703-e525aaeaac7f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.251984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0640209c-804c-4686-b703-e525aaeaac7f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.252771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0640209c-804c-4686-b703-e525aaeaac7f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.253397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0640209c-804c-4686-b703-e525aaeaac7f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.254353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0640209c-804c-4686-b703-e525aaeaac7f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.254862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0640209c-804c-4686-b703-e525aaeaac7f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.255483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0640209c-804c-4686-b703-e525aaeaac7f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.594157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0640209c-804c-4686-b703-e525aaeaac7f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.618187 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0640209c-804c-4686-b703-e525aaeaac7f tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1494 microversion: 2.1 time: 0.387087 Oct 04 18:37:33.619469 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3073/6154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1494 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.678576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ba000e9-01c7-4ddd-8150-4a7b7cd88018 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:33.679928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ba000e9-01c7-4ddd-8150-4a7b7cd88018 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.693157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ba000e9-01c7-4ddd-8150-4a7b7cd88018 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.699797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ba000e9-01c7-4ddd-8150-4a7b7cd88018 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.700620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ba000e9-01c7-4ddd-8150-4a7b7cd88018 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.701626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ba000e9-01c7-4ddd-8150-4a7b7cd88018 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.702358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ba000e9-01c7-4ddd-8150-4a7b7cd88018 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.702913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ba000e9-01c7-4ddd-8150-4a7b7cd88018 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.804219 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ba000e9-01c7-4ddd-8150-4a7b7cd88018 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "POST /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9/action" status: 202 len: 0 microversion: 2.1 time: 0.124767 Oct 04 18:37:33.807022 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3082/6155] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:33 2022] POST /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:33.822818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a7603b80-fce1-4a86-8ada-025f38ac907d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.842466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a7603b80-fce1-4a86-8ada-025f38ac907d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.856550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7603b80-fce1-4a86-8ada-025f38ac907d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.857373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7603b80-fce1-4a86-8ada-025f38ac907d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.858335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7603b80-fce1-4a86-8ada-025f38ac907d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.859678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7603b80-fce1-4a86-8ada-025f38ac907d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.860467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7603b80-fce1-4a86-8ada-025f38ac907d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.861244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7603b80-fce1-4a86-8ada-025f38ac907d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.172826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a7603b80-fce1-4a86-8ada-025f38ac907d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.191518 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a7603b80-fce1-4a86-8ada-025f38ac907d tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1500 microversion: 2.1 time: 0.372755 Oct 04 18:37:34.191518 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3074/6156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1500 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:35.226880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-108ff452-dea6-421f-aff9-f407bdf4a448 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.230134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-108ff452-dea6-421f-aff9-f407bdf4a448 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.259836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-108ff452-dea6-421f-aff9-f407bdf4a448 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.260609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-108ff452-dea6-421f-aff9-f407bdf4a448 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.261700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-108ff452-dea6-421f-aff9-f407bdf4a448 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.266457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-108ff452-dea6-421f-aff9-f407bdf4a448 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.267362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-108ff452-dea6-421f-aff9-f407bdf4a448 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.268001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-108ff452-dea6-421f-aff9-f407bdf4a448 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.561046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-108ff452-dea6-421f-aff9-f407bdf4a448 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.576812 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-108ff452-dea6-421f-aff9-f407bdf4a448 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1500 microversion: 2.1 time: 0.360051 Oct 04 18:37:35.578281 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3083/6157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1500 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:36.601516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-177a05a0-0e3c-4746-a680-5ef70096b859 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.602154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-177a05a0-0e3c-4746-a680-5ef70096b859 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.619898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-177a05a0-0e3c-4746-a680-5ef70096b859 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.620455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-177a05a0-0e3c-4746-a680-5ef70096b859 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.621034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-177a05a0-0e3c-4746-a680-5ef70096b859 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.621784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-177a05a0-0e3c-4746-a680-5ef70096b859 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.622253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-177a05a0-0e3c-4746-a680-5ef70096b859 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.622689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-177a05a0-0e3c-4746-a680-5ef70096b859 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.594443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-177a05a0-0e3c-4746-a680-5ef70096b859 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.605530 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-177a05a0-0e3c-4746-a680-5ef70096b859 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1503 microversion: 2.1 time: 1.007607 Oct 04 18:37:37.610093 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3075/6158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1503 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:37.633633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-640e323c-90e5-43b9-bbbb-1bdbd484ce13 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.634328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-640e323c-90e5-43b9-bbbb-1bdbd484ce13 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.652917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640e323c-90e5-43b9-bbbb-1bdbd484ce13 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.653978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640e323c-90e5-43b9-bbbb-1bdbd484ce13 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.654761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640e323c-90e5-43b9-bbbb-1bdbd484ce13 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.656285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640e323c-90e5-43b9-bbbb-1bdbd484ce13 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.656994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640e323c-90e5-43b9-bbbb-1bdbd484ce13 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.657605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640e323c-90e5-43b9-bbbb-1bdbd484ce13 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.702906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-640e323c-90e5-43b9-bbbb-1bdbd484ce13 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:37.806509 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-640e323c-90e5-43b9-bbbb-1bdbd484ce13 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "DELETE /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 204 len: 0 microversion: 2.1 time: 0.176639 Oct 04 18:37:37.807688 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3084/6159] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:37 2022] DELETE /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:37.817916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-56f33188-735b-42ef-9797-4146274adbf6 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.818570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-56f33188-735b-42ef-9797-4146274adbf6 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.826675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56f33188-735b-42ef-9797-4146274adbf6 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.827462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56f33188-735b-42ef-9797-4146274adbf6 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.828948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56f33188-735b-42ef-9797-4146274adbf6 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.829968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56f33188-735b-42ef-9797-4146274adbf6 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.830761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56f33188-735b-42ef-9797-4146274adbf6 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.831413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56f33188-735b-42ef-9797-4146274adbf6 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.095062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-56f33188-735b-42ef-9797-4146274adbf6 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:38.104493 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-56f33188-735b-42ef-9797-4146274adbf6 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1509 microversion: 2.1 time: 0.290191 Oct 04 18:37:38.105408 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3076/6160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:39.128539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-978cc67a-4f68-480b-bcc0-4583e1e2e093 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.129312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-978cc67a-4f68-480b-bcc0-4583e1e2e093 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.137124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-978cc67a-4f68-480b-bcc0-4583e1e2e093 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.137957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-978cc67a-4f68-480b-bcc0-4583e1e2e093 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.138596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-978cc67a-4f68-480b-bcc0-4583e1e2e093 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.139543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-978cc67a-4f68-480b-bcc0-4583e1e2e093 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.140260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-978cc67a-4f68-480b-bcc0-4583e1e2e093 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.140884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-978cc67a-4f68-480b-bcc0-4583e1e2e093 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.562092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-978cc67a-4f68-480b-bcc0-4583e1e2e093 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.591009 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-978cc67a-4f68-480b-bcc0-4583e1e2e093 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1509 microversion: 2.1 time: 0.466710 Oct 04 18:37:39.593630 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3085/6161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:40.615500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b0e680f1-5265-4693-93db-3550108bcb1a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.616645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b0e680f1-5265-4693-93db-3550108bcb1a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.643401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=42 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:40.645160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e680f1-5265-4693-93db-3550108bcb1a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.645809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e680f1-5265-4693-93db-3550108bcb1a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.646398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e680f1-5265-4693-93db-3550108bcb1a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.648572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e680f1-5265-4693-93db-3550108bcb1a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.659809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e680f1-5265-4693-93db-3550108bcb1a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.660654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0e680f1-5265-4693-93db-3550108bcb1a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.932077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b0e680f1-5265-4693-93db-3550108bcb1a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:40.967480 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b0e680f1-5265-4693-93db-3550108bcb1a tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1509 microversion: 2.1 time: 0.336382 Oct 04 18:37:40.983132 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3077/6162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:41.859061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b0527d72-f2c8-4a60-8d6d-06cc7f081962 req-5999e442-db61-4071-a94c-8666c3883ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbc815e-14de-418e-960b-621f11c1dfd9", "name": "network-vif-deleted", "tag": "5ff5bf41-b362-4ae0-85a2-3f2584fb300e"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:41.883520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b0527d72-f2c8-4a60-8d6d-06cc7f081962 req-5999e442-db61-4071-a94c-8666c3883ed8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.884095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b0527d72-f2c8-4a60-8d6d-06cc7f081962 req-5999e442-db61-4071-a94c-8666c3883ed8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.884535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b0527d72-f2c8-4a60-8d6d-06cc7f081962 req-5999e442-db61-4071-a94c-8666c3883ed8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.913920 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b0527d72-f2c8-4a60-8d6d-06cc7f081962 req-5999e442-db61-4071-a94c-8666c3883ed8 service nova] Creating event network-vif-deleted:5ff5bf41-b362-4ae0-85a2-3f2584fb300e for instance adbc815e-14de-418e-960b-621f11c1dfd9 on n-h1-850499-14 Oct 04 18:37:41.926049 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b0527d72-f2c8-4a60-8d6d-06cc7f081962 req-5999e442-db61-4071-a94c-8666c3883ed8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074047 Oct 04 18:37:41.939456 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3086/6163] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:41.998129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.999398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:42.020458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.021285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.023846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.024947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.025826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.026528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.085401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.088046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.088931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.090080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lazy-loading 'fault' on Instance uuid adbc815e-14de-418e-960b-621f11c1dfd9 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:42.188396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a95397a55c4376b486745c88b730e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb50397d1e4240018f4101293ab36292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.197767 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ddc0af03-9297-4f1f-82c5-37f944a749d3 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 200 len: 1305 microversion: 2.1 time: 0.205620 Oct 04 18:37:42.206209 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3078/6164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 1305 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:43.235326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.236305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] [instance: adbc815e-14de-418e-960b-621f11c1dfd9] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.247324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:43.261766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.263116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.264193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.265786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.266860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.268122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.306285 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] HTTP exception thrown: Instance adbc815e-14de-418e-960b-621f11c1dfd9 could not be found. Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Request method failure captured: Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 HTTP/1.1 Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH1P1zX7LzXqe5dWmIxWz9nKB9h6PXDIwczFG24HTlGEaiA36elSwtxiuSWgplFZU7w3hHf5YSC6JHimbVOXWLAxcLZfB_Qx9dCGOIk69GBLArl-2y5nYf-7tT9Xfr0d_mScbqNLMa7qnQzhYKulhbQk5pic4qgPkXWoqmvVAcz2CAw Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: fb50397d1e4240018f4101293ab36292 Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestServerAdvancedOps-2074051198 Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb50397d1e4240018f4101293ab36292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb50397d1e4240018f4101293ab36292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb50397d1e4240018f4101293ab36292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb50397d1e4240018f4101293ab36292"}]}] Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestServerAdvancedOps-2074051198 Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: fb50397d1e4240018f4101293ab36292 Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestServerAdvancedOps-2074051198 Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestServerAdvancedOps-2074051198-project Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: e8a95397a55c4376b486745c88b730e9 Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestServerAdvancedOps-2074051198-project Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance adbc815e-14de-418e-960b-621f11c1dfd9 could not be found. Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'adbc815e-14de-418e-960b-621f11c1dfd9'} Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adbc815e-14de-418e-960b-621f11c1dfd9 could not be found. Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adbc815e-14de-418e-960b-621f11c1dfd9 could not be found. Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:43.308946 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.312190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:43.312190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:43.312190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:43.312190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:43.312190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:43.312190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adbc815e-14de-418e-960b-621f11c1dfd9 could not be found. Oct 04 18:37:43.312190 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:37:43.312190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] Returning 404 to user: Instance adbc815e-14de-418e-960b-621f11c1dfd9 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:43.316118 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8d79af66-7cab-4a0a-b6ca-0df4cb21e961 tempest-TestServerAdvancedOps-2074051198 tempest-TestServerAdvancedOps-2074051198-project] 10.222.0.18 "GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9" status: 404 len: 111 microversion: 2.1 time: 0.081147 Oct 04 18:37:43.317347 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3087/6165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers/adbc815e-14de-418e-960b-621f11c1dfd9 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:48.943773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e94571f7-efeb-4cea-85c9-6e8b1730bf46 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.946383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e94571f7-efeb-4cea-85c9-6e8b1730bf46 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.966431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e94571f7-efeb-4cea-85c9-6e8b1730bf46 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.967206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e94571f7-efeb-4cea-85c9-6e8b1730bf46 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.967660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e94571f7-efeb-4cea-85c9-6e8b1730bf46 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.968399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e94571f7-efeb-4cea-85c9-6e8b1730bf46 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.968872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e94571f7-efeb-4cea-85c9-6e8b1730bf46 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.971694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e94571f7-efeb-4cea-85c9-6e8b1730bf46 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.792497 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e94571f7-efeb-4cea-85c9-6e8b1730bf46 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1835 microversion: 2.1 time: 0.826261 Oct 04 18:37:49.794908 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3079/6166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1835 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:49.828162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-83a0d222-f2c9-419f-b1df-dfb9089bcd42 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.829034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-83a0d222-f2c9-419f-b1df-dfb9089bcd42 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:49.856303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83a0d222-f2c9-419f-b1df-dfb9089bcd42 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.857262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83a0d222-f2c9-419f-b1df-dfb9089bcd42 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.857873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83a0d222-f2c9-419f-b1df-dfb9089bcd42 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.858768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83a0d222-f2c9-419f-b1df-dfb9089bcd42 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.859490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83a0d222-f2c9-419f-b1df-dfb9089bcd42 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.860145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83a0d222-f2c9-419f-b1df-dfb9089bcd42 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.156650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-83a0d222-f2c9-419f-b1df-dfb9089bcd42 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.169181 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-83a0d222-f2c9-419f-b1df-dfb9089bcd42 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1682 microversion: 2.1 time: 0.345216 Oct 04 18:37:50.170384 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3088/6167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1682 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:50.327247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67089508-7c24-4f0f-a5ad-24608cde4e3d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:50.331425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67089508-7c24-4f0f-a5ad-24608cde4e3d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.340206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67089508-7c24-4f0f-a5ad-24608cde4e3d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.340835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67089508-7c24-4f0f-a5ad-24608cde4e3d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.341356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67089508-7c24-4f0f-a5ad-24608cde4e3d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.342179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67089508-7c24-4f0f-a5ad-24608cde4e3d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.342717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67089508-7c24-4f0f-a5ad-24608cde4e3d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.343636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67089508-7c24-4f0f-a5ad-24608cde4e3d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.441548 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67089508-7c24-4f0f-a5ad-24608cde4e3d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5/action" status: 200 len: 32636 microversion: 2.1 time: 0.120140 Oct 04 18:37:50.444164 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3080/6168] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:50 2022] POST /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5/action => generated 32636 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:50.616574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:50.617183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.630076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.631598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.632583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.633651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.634644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.635389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.731512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '90a4d768f7d0440db5cb1fd38f03045b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd879004a480796c3e2346af2f3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.732595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] flavor_id is None. Assuming migration. {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:37:50.734595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:37:50.933486 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42a3e770-7a56-47d4-a18a-09e66d69a755 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5/action" status: 202 len: 0 microversion: 2.1 time: 0.321933 Oct 04 18:37:50.936843 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3089/6169] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:50 2022] POST /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:50.944569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-37205cc7-8556-4813-bcba-0510eb285560 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:50.945298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-37205cc7-8556-4813-bcba-0510eb285560 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.955389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37205cc7-8556-4813-bcba-0510eb285560 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.956146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37205cc7-8556-4813-bcba-0510eb285560 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.956791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37205cc7-8556-4813-bcba-0510eb285560 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.957694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37205cc7-8556-4813-bcba-0510eb285560 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.958321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37205cc7-8556-4813-bcba-0510eb285560 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.959144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-37205cc7-8556-4813-bcba-0510eb285560 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.660973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-37205cc7-8556-4813-bcba-0510eb285560 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:51.678380 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-37205cc7-8556-4813-bcba-0510eb285560 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1691 microversion: 2.1 time: 0.738329 Oct 04 18:37:51.679976 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3081/6170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:50 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1691 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:52.706551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04357afe-9acb-41e3-9b57-8bc1b8152206 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:52.707661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-04357afe-9acb-41e3-9b57-8bc1b8152206 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:52.718281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04357afe-9acb-41e3-9b57-8bc1b8152206 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.719328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04357afe-9acb-41e3-9b57-8bc1b8152206 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.721555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04357afe-9acb-41e3-9b57-8bc1b8152206 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.722529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04357afe-9acb-41e3-9b57-8bc1b8152206 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.723295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04357afe-9acb-41e3-9b57-8bc1b8152206 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.724198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04357afe-9acb-41e3-9b57-8bc1b8152206 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.980819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-04357afe-9acb-41e3-9b57-8bc1b8152206 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:53.020676 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04357afe-9acb-41e3-9b57-8bc1b8152206 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1691 microversion: 2.1 time: 0.316611 Oct 04 18:37:53.023999 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3090/6171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:52 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1691 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:54.050171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c95339ce-57ff-49ff-99c9-55f927a1933d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:54.050798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c95339ce-57ff-49ff-99c9-55f927a1933d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:54.064952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c95339ce-57ff-49ff-99c9-55f927a1933d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.065470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c95339ce-57ff-49ff-99c9-55f927a1933d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.065917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c95339ce-57ff-49ff-99c9-55f927a1933d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.066650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c95339ce-57ff-49ff-99c9-55f927a1933d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.067150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c95339ce-57ff-49ff-99c9-55f927a1933d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.067679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c95339ce-57ff-49ff-99c9-55f927a1933d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.484110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c95339ce-57ff-49ff-99c9-55f927a1933d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.499222 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c95339ce-57ff-49ff-99c9-55f927a1933d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1691 microversion: 2.1 time: 0.454498 Oct 04 18:37:54.502939 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3082/6172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:54 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1691 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:55.532486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f3fb9168-24bd-41e8-bdb9-7fd53349126b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.533121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f3fb9168-24bd-41e8-bdb9-7fd53349126b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:55.547144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb9168-24bd-41e8-bdb9-7fd53349126b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.547670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb9168-24bd-41e8-bdb9-7fd53349126b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.548121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb9168-24bd-41e8-bdb9-7fd53349126b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.548931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb9168-24bd-41e8-bdb9-7fd53349126b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.549434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb9168-24bd-41e8-bdb9-7fd53349126b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.549974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3fb9168-24bd-41e8-bdb9-7fd53349126b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.048943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f3fb9168-24bd-41e8-bdb9-7fd53349126b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.064590 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f3fb9168-24bd-41e8-bdb9-7fd53349126b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1696 microversion: 2.1 time: 0.538131 Oct 04 18:37:56.068860 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3091/6173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1696 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:57.092769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e010bc6d-18cc-4758-b903-57b7cc82e318 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.097249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e010bc6d-18cc-4758-b903-57b7cc82e318 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:57.110020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e010bc6d-18cc-4758-b903-57b7cc82e318 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.110742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e010bc6d-18cc-4758-b903-57b7cc82e318 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.111403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e010bc6d-18cc-4758-b903-57b7cc82e318 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.112452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e010bc6d-18cc-4758-b903-57b7cc82e318 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.113315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e010bc6d-18cc-4758-b903-57b7cc82e318 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.114538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e010bc6d-18cc-4758-b903-57b7cc82e318 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.524249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e010bc6d-18cc-4758-b903-57b7cc82e318 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.533864 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e010bc6d-18cc-4758-b903-57b7cc82e318 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1696 microversion: 2.1 time: 0.447916 Oct 04 18:37:57.547544 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3083/6174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:57 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1696 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:58.561646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ed7bbb5-981f-46e9-846e-cce898e7f3a2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:58.567157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6ed7bbb5-981f-46e9-846e-cce898e7f3a2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:58.610052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed7bbb5-981f-46e9-846e-cce898e7f3a2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.612211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed7bbb5-981f-46e9-846e-cce898e7f3a2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.615197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed7bbb5-981f-46e9-846e-cce898e7f3a2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.616690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed7bbb5-981f-46e9-846e-cce898e7f3a2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.619536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed7bbb5-981f-46e9-846e-cce898e7f3a2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.621277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed7bbb5-981f-46e9-846e-cce898e7f3a2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.824867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ed7bbb5-981f-46e9-846e-cce898e7f3a2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.836354 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ed7bbb5-981f-46e9-846e-cce898e7f3a2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1696 microversion: 2.1 time: 0.278638 Oct 04 18:37:58.851874 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3092/6175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:58 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1696 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:59.863730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9c09fcfe-12ab-4192-a2a1-a7d7ada5228c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:59.864999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9c09fcfe-12ab-4192-a2a1-a7d7ada5228c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:59.874854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c09fcfe-12ab-4192-a2a1-a7d7ada5228c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.875630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c09fcfe-12ab-4192-a2a1-a7d7ada5228c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.876428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c09fcfe-12ab-4192-a2a1-a7d7ada5228c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.877417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c09fcfe-12ab-4192-a2a1-a7d7ada5228c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.878294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c09fcfe-12ab-4192-a2a1-a7d7ada5228c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.878913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c09fcfe-12ab-4192-a2a1-a7d7ada5228c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.050375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9c09fcfe-12ab-4192-a2a1-a7d7ada5228c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.066495 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9c09fcfe-12ab-4192-a2a1-a7d7ada5228c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1696 microversion: 2.1 time: 0.206718 Oct 04 18:38:00.067905 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3084/6176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:59 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:01.094096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80fffcdd-2db2-4926-8256-f6ae1fe4d5bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.095358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80fffcdd-2db2-4926-8256-f6ae1fe4d5bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:01.102771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80fffcdd-2db2-4926-8256-f6ae1fe4d5bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.103733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80fffcdd-2db2-4926-8256-f6ae1fe4d5bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.104415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80fffcdd-2db2-4926-8256-f6ae1fe4d5bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.105541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80fffcdd-2db2-4926-8256-f6ae1fe4d5bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.106160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80fffcdd-2db2-4926-8256-f6ae1fe4d5bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.106744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80fffcdd-2db2-4926-8256-f6ae1fe4d5bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.396405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-80fffcdd-2db2-4926-8256-f6ae1fe4d5bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:01.407711 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-80fffcdd-2db2-4926-8256-f6ae1fe4d5bc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1696 microversion: 2.1 time: 0.318888 Oct 04 18:38:01.409024 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3093/6177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:01 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1696 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:02.432905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a0bc75cf-28df-4b1f-a104-7e5a6ad8f70c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:02.434098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a0bc75cf-28df-4b1f-a104-7e5a6ad8f70c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:02.449407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0bc75cf-28df-4b1f-a104-7e5a6ad8f70c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.450614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0bc75cf-28df-4b1f-a104-7e5a6ad8f70c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.451252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0bc75cf-28df-4b1f-a104-7e5a6ad8f70c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.452170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0bc75cf-28df-4b1f-a104-7e5a6ad8f70c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.452785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0bc75cf-28df-4b1f-a104-7e5a6ad8f70c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.453365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0bc75cf-28df-4b1f-a104-7e5a6ad8f70c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.457712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:02.706970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a0bc75cf-28df-4b1f-a104-7e5a6ad8f70c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:02.729476 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a0bc75cf-28df-4b1f-a104-7e5a6ad8f70c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1696 microversion: 2.1 time: 0.300316 Oct 04 18:38:02.745397 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3085/6178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:02 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1696 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:03.753943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2af88d2c-67b5-456b-bb3f-fd98c1720f00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.755089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2af88d2c-67b5-456b-bb3f-fd98c1720f00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.764129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af88d2c-67b5-456b-bb3f-fd98c1720f00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.764902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af88d2c-67b5-456b-bb3f-fd98c1720f00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.765559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af88d2c-67b5-456b-bb3f-fd98c1720f00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.766631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af88d2c-67b5-456b-bb3f-fd98c1720f00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.768265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af88d2c-67b5-456b-bb3f-fd98c1720f00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.768877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2af88d2c-67b5-456b-bb3f-fd98c1720f00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.774426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:04.112395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2af88d2c-67b5-456b-bb3f-fd98c1720f00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:04.146694 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2af88d2c-67b5-456b-bb3f-fd98c1720f00 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1696 microversion: 2.1 time: 0.397305 Oct 04 18:38:04.152202 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3094/6179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:03 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1696 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:05.202055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0489e4c1-4221-4459-97f0-62baabf8692f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.202728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0489e4c1-4221-4459-97f0-62baabf8692f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.210141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0489e4c1-4221-4459-97f0-62baabf8692f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.211184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0489e4c1-4221-4459-97f0-62baabf8692f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.211815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0489e4c1-4221-4459-97f0-62baabf8692f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.212732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0489e4c1-4221-4459-97f0-62baabf8692f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.213519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0489e4c1-4221-4459-97f0-62baabf8692f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.214520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0489e4c1-4221-4459-97f0-62baabf8692f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.508504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0489e4c1-4221-4459-97f0-62baabf8692f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.531277 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0489e4c1-4221-4459-97f0-62baabf8692f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1696 microversion: 2.1 time: 0.332774 Oct 04 18:38:05.532865 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3086/6180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:05 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1696 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:06.558871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f549abd2-6129-4f16-8e1d-a9c7484831c5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:06.560097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f549abd2-6129-4f16-8e1d-a9c7484831c5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:06.578342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f549abd2-6129-4f16-8e1d-a9c7484831c5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.581507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f549abd2-6129-4f16-8e1d-a9c7484831c5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.582671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f549abd2-6129-4f16-8e1d-a9c7484831c5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.584082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f549abd2-6129-4f16-8e1d-a9c7484831c5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.585526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f549abd2-6129-4f16-8e1d-a9c7484831c5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.587524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f549abd2-6129-4f16-8e1d-a9c7484831c5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.803551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f549abd2-6129-4f16-8e1d-a9c7484831c5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.816589 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f549abd2-6129-4f16-8e1d-a9c7484831c5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1696 microversion: 2.1 time: 0.261719 Oct 04 18:38:06.817387 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3095/6181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:06 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1696 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:07.855205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ebbe0478-fa67-4cac-befb-7473489df915 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:07.861634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ebbe0478-fa67-4cac-befb-7473489df915 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:07.892441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebbe0478-fa67-4cac-befb-7473489df915 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.893216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebbe0478-fa67-4cac-befb-7473489df915 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.893661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebbe0478-fa67-4cac-befb-7473489df915 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.899692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebbe0478-fa67-4cac-befb-7473489df915 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.900502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebbe0478-fa67-4cac-befb-7473489df915 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.901189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebbe0478-fa67-4cac-befb-7473489df915 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.422904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c87ce142-783e-4a38-9b86-984f3cbc908e req-f0d3046f-c81c-43b7-9f91-7bf5e0a39bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2e3963-4e10-431c-9853-8f8070f1e4a5", "name": "network-vif-unplugged", "status": "completed", "tag": "11a780a3-dd1a-4548-94e0-60cf154cfc39"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:08.449087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c87ce142-783e-4a38-9b86-984f3cbc908e req-f0d3046f-c81c-43b7-9f91-7bf5e0a39bbb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.449858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c87ce142-783e-4a38-9b86-984f3cbc908e req-f0d3046f-c81c-43b7-9f91-7bf5e0a39bbb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.450669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c87ce142-783e-4a38-9b86-984f3cbc908e req-f0d3046f-c81c-43b7-9f91-7bf5e0a39bbb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.479583 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c87ce142-783e-4a38-9b86-984f3cbc908e req-f0d3046f-c81c-43b7-9f91-7bf5e0a39bbb service nova] Creating event network-vif-unplugged:11a780a3-dd1a-4548-94e0-60cf154cfc39 for instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 on n-h1-850499-14 Oct 04 18:38:08.492332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-c87ce142-783e-4a38-9b86-984f3cbc908e req-f0d3046f-c81c-43b7-9f91-7bf5e0a39bbb service nova] Instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:08.525300 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c87ce142-783e-4a38-9b86-984f3cbc908e req-f0d3046f-c81c-43b7-9f91-7bf5e0a39bbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.362289 Oct 04 18:38:08.526398 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3096/6182] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:08.856510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ebbe0478-fa67-4cac-befb-7473489df915 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:08.867733 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ebbe0478-fa67-4cac-befb-7473489df915 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1695 microversion: 2.1 time: 1.022502 Oct 04 18:38:08.869605 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3087/6183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:07 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1695 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:09.909784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7445e4a-3812-427d-8766-2923a212d0bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:09.910815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a7445e4a-3812-427d-8766-2923a212d0bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:09.917837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7445e4a-3812-427d-8766-2923a212d0bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.918791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7445e4a-3812-427d-8766-2923a212d0bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.919541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7445e4a-3812-427d-8766-2923a212d0bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.920467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7445e4a-3812-427d-8766-2923a212d0bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.921130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7445e4a-3812-427d-8766-2923a212d0bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.921763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7445e4a-3812-427d-8766-2923a212d0bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.098174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a7445e4a-3812-427d-8766-2923a212d0bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:10.110592 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a7445e4a-3812-427d-8766-2923a212d0bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1695 microversion: 2.1 time: 0.210687 Oct 04 18:38:10.111351 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3097/6184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:09 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1695 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:10.565530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1408160e-862e-4d46-be40-8c9269ab907f req-61f281b1-9c97-4b31-8538-6b91ea6a517b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2e3963-4e10-431c-9853-8f8070f1e4a5", "tag": "11a780a3-dd1a-4548-94e0-60cf154cfc39"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:10.581505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1408160e-862e-4d46-be40-8c9269ab907f req-61f281b1-9c97-4b31-8538-6b91ea6a517b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.581981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1408160e-862e-4d46-be40-8c9269ab907f req-61f281b1-9c97-4b31-8538-6b91ea6a517b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.583591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1408160e-862e-4d46-be40-8c9269ab907f req-61f281b1-9c97-4b31-8538-6b91ea6a517b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.598924 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1408160e-862e-4d46-be40-8c9269ab907f req-61f281b1-9c97-4b31-8538-6b91ea6a517b service nova] Creating event network-changed:11a780a3-dd1a-4548-94e0-60cf154cfc39 for instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 on n-h1-850499-14 Oct 04 18:38:10.604958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-1408160e-862e-4d46-be40-8c9269ab907f req-61f281b1-9c97-4b31-8538-6b91ea6a517b service nova] Instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:10.618843 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1408160e-862e-4d46-be40-8c9269ab907f req-61f281b1-9c97-4b31-8538-6b91ea6a517b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057077 Oct 04 18:38:10.620488 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3088/6185] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:11.134721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ec4382a-a60e-4691-89b3-76556c6202a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.136322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ec4382a-a60e-4691-89b3-76556c6202a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.150038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec4382a-a60e-4691-89b3-76556c6202a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.150556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec4382a-a60e-4691-89b3-76556c6202a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.151057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec4382a-a60e-4691-89b3-76556c6202a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.155928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec4382a-a60e-4691-89b3-76556c6202a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.156577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec4382a-a60e-4691-89b3-76556c6202a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.157036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec4382a-a60e-4691-89b3-76556c6202a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.532503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ec4382a-a60e-4691-89b3-76556c6202a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.544407 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ec4382a-a60e-4691-89b3-76556c6202a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1693 microversion: 2.1 time: 0.414006 Oct 04 18:38:11.559092 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3098/6186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1693 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:12.576185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06f0b1bd-9afd-45e7-aeb7-8a6728e53c3b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:12.576948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-06f0b1bd-9afd-45e7-aeb7-8a6728e53c3b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:12.578941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=26 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:12.598770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06f0b1bd-9afd-45e7-aeb7-8a6728e53c3b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.599317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06f0b1bd-9afd-45e7-aeb7-8a6728e53c3b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.599766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06f0b1bd-9afd-45e7-aeb7-8a6728e53c3b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.600479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06f0b1bd-9afd-45e7-aeb7-8a6728e53c3b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.601103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06f0b1bd-9afd-45e7-aeb7-8a6728e53c3b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.601678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06f0b1bd-9afd-45e7-aeb7-8a6728e53c3b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.117722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-06f0b1bd-9afd-45e7-aeb7-8a6728e53c3b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:13.136026 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-06f0b1bd-9afd-45e7-aeb7-8a6728e53c3b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1690 microversion: 2.1 time: 0.567785 Oct 04 18:38:13.136742 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3089/6187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:12 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1690 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:13.163245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cc64fc77-708d-40a6-a8a9-c3ec230d3c0e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:13.164483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cc64fc77-708d-40a6-a8a9-c3ec230d3c0e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:13.185556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc64fc77-708d-40a6-a8a9-c3ec230d3c0e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.186462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc64fc77-708d-40a6-a8a9-c3ec230d3c0e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.187165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc64fc77-708d-40a6-a8a9-c3ec230d3c0e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.188179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc64fc77-708d-40a6-a8a9-c3ec230d3c0e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.188876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc64fc77-708d-40a6-a8a9-c3ec230d3c0e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.189507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc64fc77-708d-40a6-a8a9-c3ec230d3c0e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.287654 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cc64fc77-708d-40a6-a8a9-c3ec230d3c0e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5/action" status: 204 len: 0 microversion: 2.1 time: 0.128162 Oct 04 18:38:13.289180 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3099/6188] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:38:13 2022] POST /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5/action => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:13.309465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49d653af-8445-4f29-b9aa-8ec1bae3a99e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:13.310369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-49d653af-8445-4f29-b9aa-8ec1bae3a99e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:13.328820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d653af-8445-4f29-b9aa-8ec1bae3a99e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.329722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d653af-8445-4f29-b9aa-8ec1bae3a99e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.330365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d653af-8445-4f29-b9aa-8ec1bae3a99e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.331320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d653af-8445-4f29-b9aa-8ec1bae3a99e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.331794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d653af-8445-4f29-b9aa-8ec1bae3a99e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.332237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49d653af-8445-4f29-b9aa-8ec1bae3a99e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.553078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-49d653af-8445-4f29-b9aa-8ec1bae3a99e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:13.562059 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49d653af-8445-4f29-b9aa-8ec1bae3a99e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1690 microversion: 2.1 time: 0.268053 Oct 04 18:38:13.563459 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3090/6189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:13 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1690 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:14.591796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c3b7dc11-7462-4615-b325-444e29211923 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:14.592519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c3b7dc11-7462-4615-b325-444e29211923 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:14.609087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=28 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:14.613865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b7dc11-7462-4615-b325-444e29211923 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.614380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b7dc11-7462-4615-b325-444e29211923 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.614829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b7dc11-7462-4615-b325-444e29211923 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.615575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b7dc11-7462-4615-b325-444e29211923 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.616218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b7dc11-7462-4615-b325-444e29211923 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.616810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3b7dc11-7462-4615-b325-444e29211923 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.909098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c3b7dc11-7462-4615-b325-444e29211923 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.926193 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c3b7dc11-7462-4615-b325-444e29211923 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1690 microversion: 2.1 time: 0.338908 Oct 04 18:38:14.939086 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3100/6190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:14 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1690 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:15.105219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-8cbb7d0b-73e7-4a03-93d8-a6dafb074727 req-80190771-126a-495a-97a0-f0020e79c1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2e3963-4e10-431c-9853-8f8070f1e4a5", "name": "network-vif-plugged", "status": "completed", "tag": "11a780a3-dd1a-4548-94e0-60cf154cfc39"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:15.124324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8cbb7d0b-73e7-4a03-93d8-a6dafb074727 req-80190771-126a-495a-97a0-f0020e79c1f6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.125115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8cbb7d0b-73e7-4a03-93d8-a6dafb074727 req-80190771-126a-495a-97a0-f0020e79c1f6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.128257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8cbb7d0b-73e7-4a03-93d8-a6dafb074727 req-80190771-126a-495a-97a0-f0020e79c1f6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.154794 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-8cbb7d0b-73e7-4a03-93d8-a6dafb074727 req-80190771-126a-495a-97a0-f0020e79c1f6 service nova] Creating event network-vif-plugged:11a780a3-dd1a-4548-94e0-60cf154cfc39 for instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 on n-h1-850499-14 Oct 04 18:38:15.169525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-8cbb7d0b-73e7-4a03-93d8-a6dafb074727 req-80190771-126a-495a-97a0-f0020e79c1f6 service nova] Instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:15.216754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-8cbb7d0b-73e7-4a03-93d8-a6dafb074727 req-80190771-126a-495a-97a0-f0020e79c1f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115632 Oct 04 18:38:15.230120 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3091/6191] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:15.952518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d41c9a7a-854e-4be3-abfc-1559b52c4012 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:15.953243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d41c9a7a-854e-4be3-abfc-1559b52c4012 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:15.962350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d41c9a7a-854e-4be3-abfc-1559b52c4012 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.962858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d41c9a7a-854e-4be3-abfc-1559b52c4012 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.963383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d41c9a7a-854e-4be3-abfc-1559b52c4012 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.964613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d41c9a7a-854e-4be3-abfc-1559b52c4012 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.965083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d41c9a7a-854e-4be3-abfc-1559b52c4012 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.965521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d41c9a7a-854e-4be3-abfc-1559b52c4012 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.121681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d41c9a7a-854e-4be3-abfc-1559b52c4012 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:16.129969 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d41c9a7a-854e-4be3-abfc-1559b52c4012 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1682 microversion: 2.1 time: 0.181691 Oct 04 18:38:16.130571 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3101/6192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:15 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:28.125359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=5 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:28.126602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=37 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:28.145222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b976dc81-9228-4270-b473-8123b3466d85 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.146227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b976dc81-9228-4270-b473-8123b3466d85 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.156358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b976dc81-9228-4270-b473-8123b3466d85 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.156878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b976dc81-9228-4270-b473-8123b3466d85 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.157334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b976dc81-9228-4270-b473-8123b3466d85 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.158086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b976dc81-9228-4270-b473-8123b3466d85 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.158557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b976dc81-9228-4270-b473-8123b3466d85 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.159030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b976dc81-9228-4270-b473-8123b3466d85 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.268824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-b976dc81-9228-4270-b473-8123b3466d85 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lazy-loading 'services' on Instance uuid d5a1f6a2-edcf-4b97-82c8-c80a29098748 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:28.367107 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b976dc81-9228-4270-b473-8123b3466d85 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748/os-volume_attachments/b6a0f04e-08d5-4970-bfde-2c369f9f8992" status: 202 len: 0 microversion: 2.1 time: 0.244900 Oct 04 18:38:28.368474 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3092/6193] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:38:28 2022] DELETE /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748/os-volume_attachments/b6a0f04e-08d5-4970-bfde-2c369f9f8992 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:35.559472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:35.562216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:35.910896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34660085-0af3-43b2-8bdb-d9c1fb664b19 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:35.911688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34660085-0af3-43b2-8bdb-d9c1fb664b19 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:35.925263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34660085-0af3-43b2-8bdb-d9c1fb664b19 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.926590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34660085-0af3-43b2-8bdb-d9c1fb664b19 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.928389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34660085-0af3-43b2-8bdb-d9c1fb664b19 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.930106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34660085-0af3-43b2-8bdb-d9c1fb664b19 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.932065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34660085-0af3-43b2-8bdb-d9c1fb664b19 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.933008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34660085-0af3-43b2-8bdb-d9c1fb664b19 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.971983 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34660085-0af3-43b2-8bdb-d9c1fb664b19 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/ips" status: 200 len: 148 microversion: 2.1 time: 0.434201 Oct 04 18:38:35.987186 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3102/6194] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:38:35 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/ips => generated 148 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:36.590133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f32708cd-7e5f-40fc-a269-19e3dcc91c3e tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:36.596115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f32708cd-7e5f-40fc-a269-19e3dcc91c3e tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:36.615461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32708cd-7e5f-40fc-a269-19e3dcc91c3e tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.616376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32708cd-7e5f-40fc-a269-19e3dcc91c3e tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.627168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32708cd-7e5f-40fc-a269-19e3dcc91c3e tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.627168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32708cd-7e5f-40fc-a269-19e3dcc91c3e tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.627168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32708cd-7e5f-40fc-a269-19e3dcc91c3e tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.627168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f32708cd-7e5f-40fc-a269-19e3dcc91c3e tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.710278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f32708cd-7e5f-40fc-a269-19e3dcc91c3e tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:36.904478 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f32708cd-7e5f-40fc-a269-19e3dcc91c3e tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 204 len: 0 microversion: 2.1 time: 0.379934 Oct 04 18:38:36.906522 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3093/6195] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:36 2022] DELETE /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:36.922823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba9ab110-ce02-4364-80a3-1ab503e3988d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:36.924245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba9ab110-ce02-4364-80a3-1ab503e3988d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:36.936510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9ab110-ce02-4364-80a3-1ab503e3988d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.937382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9ab110-ce02-4364-80a3-1ab503e3988d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.938151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9ab110-ce02-4364-80a3-1ab503e3988d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.939743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9ab110-ce02-4364-80a3-1ab503e3988d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.940971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9ab110-ce02-4364-80a3-1ab503e3988d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.942010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9ab110-ce02-4364-80a3-1ab503e3988d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.255459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ba9ab110-ce02-4364-80a3-1ab503e3988d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:37.281705 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba9ab110-ce02-4364-80a3-1ab503e3988d tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1470 microversion: 2.1 time: 0.370244 Oct 04 18:38:37.282344 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3103/6196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:36 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:38.321234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3cb13d31-82cf-42b7-aaa2-ab46598dafdb tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:38.322114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3cb13d31-82cf-42b7-aaa2-ab46598dafdb tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:38.333955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cb13d31-82cf-42b7-aaa2-ab46598dafdb tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.334565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cb13d31-82cf-42b7-aaa2-ab46598dafdb tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.335348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cb13d31-82cf-42b7-aaa2-ab46598dafdb tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.336867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cb13d31-82cf-42b7-aaa2-ab46598dafdb tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.337790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cb13d31-82cf-42b7-aaa2-ab46598dafdb tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.339338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cb13d31-82cf-42b7-aaa2-ab46598dafdb tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.565614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3cb13d31-82cf-42b7-aaa2-ab46598dafdb tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:38.586558 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3cb13d31-82cf-42b7-aaa2-ab46598dafdb tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1470 microversion: 2.1 time: 0.280144 Oct 04 18:38:38.587543 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3094/6197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:38 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:38.753608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef66fb64-c029-485e-b8f5-285e5ffd5e1c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3905de5c-37de-46d3-871a-42f51fbe3ee7"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:38.756193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef66fb64-c029-485e-b8f5-285e5ffd5e1c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:38.763490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef66fb64-c029-485e-b8f5-285e5ffd5e1c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.763990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef66fb64-c029-485e-b8f5-285e5ffd5e1c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.764456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef66fb64-c029-485e-b8f5-285e5ffd5e1c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.765173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef66fb64-c029-485e-b8f5-285e5ffd5e1c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.765640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef66fb64-c029-485e-b8f5-285e5ffd5e1c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.766078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef66fb64-c029-485e-b8f5-285e5ffd5e1c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.239897 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef66fb64-c029-485e-b8f5-285e5ffd5e1c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490120 Oct 04 18:38:39.243493 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3104/6198] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:38:38 2022] POST /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:39.611375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b9ff5980-9ec6-40dd-81aa-4473f335832c tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:39.612489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b9ff5980-9ec6-40dd-81aa-4473f335832c tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:39.616470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e3263f14-9e28-4abd-a290-73da14621690 req-a9bdf92a-b06a-4ee8-971f-753c89b8c17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a1f6a2-edcf-4b97-82c8-c80a29098748", "name": "network-vif-deleted", "tag": "7edd01a4-e67a-43d0-8bec-bf96188e2c8e"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:39.637382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9ff5980-9ec6-40dd-81aa-4473f335832c tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.640820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e3263f14-9e28-4abd-a290-73da14621690 req-a9bdf92a-b06a-4ee8-971f-753c89b8c17a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.641822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e3263f14-9e28-4abd-a290-73da14621690 req-a9bdf92a-b06a-4ee8-971f-753c89b8c17a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.642021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9ff5980-9ec6-40dd-81aa-4473f335832c tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.642885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e3263f14-9e28-4abd-a290-73da14621690 req-a9bdf92a-b06a-4ee8-971f-753c89b8c17a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.650555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9ff5980-9ec6-40dd-81aa-4473f335832c tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.657156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9ff5980-9ec6-40dd-81aa-4473f335832c tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.657784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9ff5980-9ec6-40dd-81aa-4473f335832c tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.658245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b9ff5980-9ec6-40dd-81aa-4473f335832c tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.699721 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e3263f14-9e28-4abd-a290-73da14621690 req-a9bdf92a-b06a-4ee8-971f-753c89b8c17a service nova] Creating event network-vif-deleted:7edd01a4-e67a-43d0-8bec-bf96188e2c8e for instance d5a1f6a2-edcf-4b97-82c8-c80a29098748 on n-h1-850499-14 Oct 04 18:38:39.717147 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e3263f14-9e28-4abd-a290-73da14621690 req-a9bdf92a-b06a-4ee8-971f-753c89b8c17a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108546 Oct 04 18:38:39.717680 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3095/6199] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:39.819542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b9ff5980-9ec6-40dd-81aa-4473f335832c tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3491502350491383a3dd2e7c33e777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf02f9b10ec43a7abbb57af50307835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:39.832143 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b9ff5980-9ec6-40dd-81aa-4473f335832c tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 200 len: 1428 microversion: 2.1 time: 0.224959 Oct 04 18:38:39.833431 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3105/6200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:39 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 1428 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:40.398747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-27a6e37a-1428-4209-8a47-2fb982273631 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:40.404295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-27a6e37a-1428-4209-8a47-2fb982273631 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:40.423297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27a6e37a-1428-4209-8a47-2fb982273631 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.424514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27a6e37a-1428-4209-8a47-2fb982273631 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.425526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27a6e37a-1428-4209-8a47-2fb982273631 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.428968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27a6e37a-1428-4209-8a47-2fb982273631 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.430029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27a6e37a-1428-4209-8a47-2fb982273631 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.445368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27a6e37a-1428-4209-8a47-2fb982273631 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.587168 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-27a6e37a-1428-4209-8a47-2fb982273631 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5/action" status: 200 len: 24575 microversion: 2.1 time: 0.208757 Oct 04 18:38:40.588410 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3096/6201] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:38:40 2022] POST /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5/action => generated 24575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:38:40.882588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:40.884785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] [instance: d5a1f6a2-edcf-4b97-82c8-c80a29098748] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:40.897247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.898646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.901753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.903404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.904347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.905567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.952663 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] HTTP exception thrown: Instance d5a1f6a2-edcf-4b97-82c8-c80a29098748 could not be found. Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Request method failure captured: Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 HTTP/1.1 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH0uGgQyCP3hRwdk5-MioGUmh6ck1mQ7dOHsAr_rqhmHfhHlbpb7-psgo8hIBtkpjuplmb3KGEtBmqgcO-i5ZlFc5OTwDqRl0mcGvT6Z0KijFC5xFpvAxPNzowCKDK6AIkt0KDVXyThV3WkdxISWy9j5hTdVqUo_Z3y2cZPxPfdb8V4 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: fcf02f9b10ec43a7abbb57af50307835 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-VolumesBackupsTest-1738267360 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fcf02f9b10ec43a7abbb57af50307835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fcf02f9b10ec43a7abbb57af50307835"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf02f9b10ec43a7abbb57af50307835"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf02f9b10ec43a7abbb57af50307835"}]}] Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-VolumesBackupsTest-1738267360 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: fcf02f9b10ec43a7abbb57af50307835 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-VolumesBackupsTest-1738267360 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-VolumesBackupsTest-1738267360-project Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6c3491502350491383a3dd2e7c33e777 Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-VolumesBackupsTest-1738267360-project Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance d5a1f6a2-edcf-4b97-82c8-c80a29098748 could not be found. Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'd5a1f6a2-edcf-4b97-82c8-c80a29098748'} Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a1f6a2-edcf-4b97-82c8-c80a29098748 could not be found. Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a1f6a2-edcf-4b97-82c8-c80a29098748 could not be found. Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:40.958050 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:38:40.966817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:40.966817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:40.966817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:40.966817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:40.966817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:40.966817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a1f6a2-edcf-4b97-82c8-c80a29098748 could not be found. Oct 04 18:38:40.966817 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:38:40.977289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] Returning 404 to user: Instance d5a1f6a2-edcf-4b97-82c8-c80a29098748 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:40.981206 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4f182987-1cdd-4863-bfcf-d8eaf5b3efc1 tempest-VolumesBackupsTest-1738267360 tempest-VolumesBackupsTest-1738267360-project] 10.222.0.18 "GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748" status: 404 len: 111 microversion: 2.1 time: 0.107242 Oct 04 18:38:41.003134 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3106/6202] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:40 2022] GET /compute/v2.1/servers/d5a1f6a2-edcf-4b97-82c8-c80a29098748 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:46.807755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1c935b0e-f9d1-4471-b5df-4f20ac1a9488 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:46.808654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1c935b0e-f9d1-4471-b5df-4f20ac1a9488 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:46.830050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c935b0e-f9d1-4471-b5df-4f20ac1a9488 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.830471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c935b0e-f9d1-4471-b5df-4f20ac1a9488 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.831468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c935b0e-f9d1-4471-b5df-4f20ac1a9488 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.832357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c935b0e-f9d1-4471-b5df-4f20ac1a9488 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.832996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c935b0e-f9d1-4471-b5df-4f20ac1a9488 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.833442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c935b0e-f9d1-4471-b5df-4f20ac1a9488 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.061908 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1c935b0e-f9d1-4471-b5df-4f20ac1a9488 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1835 microversion: 2.1 time: 0.260031 Oct 04 18:38:47.063765 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3097/6203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:46 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1835 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:48.960498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-645765e1-72b6-470f-bfdb-621ef2b7b6f0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:48.960996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-645765e1-72b6-470f-bfdb-621ef2b7b6f0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:48.980917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-645765e1-72b6-470f-bfdb-621ef2b7b6f0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.985599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-645765e1-72b6-470f-bfdb-621ef2b7b6f0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.991688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-0af7983d-b082-4dfb-a7a5-03f135e190fa req-ecf615da-9336-46db-ac96-4a32ae6e0054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2e3963-4e10-431c-9853-8f8070f1e4a5", "tag": "11a780a3-dd1a-4548-94e0-60cf154cfc39"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:48.999569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-645765e1-72b6-470f-bfdb-621ef2b7b6f0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.003660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-645765e1-72b6-470f-bfdb-621ef2b7b6f0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.004999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-645765e1-72b6-470f-bfdb-621ef2b7b6f0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.014922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-645765e1-72b6-470f-bfdb-621ef2b7b6f0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.025799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0af7983d-b082-4dfb-a7a5-03f135e190fa req-ecf615da-9336-46db-ac96-4a32ae6e0054 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.034662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0af7983d-b082-4dfb-a7a5-03f135e190fa req-ecf615da-9336-46db-ac96-4a32ae6e0054 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.035660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-0af7983d-b082-4dfb-a7a5-03f135e190fa req-ecf615da-9336-46db-ac96-4a32ae6e0054 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.096891 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-0af7983d-b082-4dfb-a7a5-03f135e190fa req-ecf615da-9336-46db-ac96-4a32ae6e0054 service nova] Creating event network-changed:11a780a3-dd1a-4548-94e0-60cf154cfc39 for instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 on n-h1-850499-14 Oct 04 18:38:49.098309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-645765e1-72b6-470f-bfdb-621ef2b7b6f0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:49.117153 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-0af7983d-b082-4dfb-a7a5-03f135e190fa req-ecf615da-9336-46db-ac96-4a32ae6e0054 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125914 Oct 04 18:38:49.120249 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3098/6204] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:49.382813 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-645765e1-72b6-470f-bfdb-621ef2b7b6f0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 204 len: 0 microversion: 2.1 time: 0.415599 Oct 04 18:38:49.383978 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3107/6205] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:48 2022] DELETE /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:49.401693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3dfe07f6-1303-4616-b782-f862e10682da tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:49.402922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3dfe07f6-1303-4616-b782-f862e10682da tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:49.420991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfe07f6-1303-4616-b782-f862e10682da tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.422782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfe07f6-1303-4616-b782-f862e10682da tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.423232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfe07f6-1303-4616-b782-f862e10682da tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.423994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfe07f6-1303-4616-b782-f862e10682da tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.426610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfe07f6-1303-4616-b782-f862e10682da tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.427326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dfe07f6-1303-4616-b782-f862e10682da tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.855689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3dfe07f6-1303-4616-b782-f862e10682da tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.869603 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3dfe07f6-1303-4616-b782-f862e10682da tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1688 microversion: 2.1 time: 0.477216 Oct 04 18:38:49.870747 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3099/6206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:49 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1688 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:50.905098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cfe4b9bc-4110-4987-8c0f-fdc30c57178f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:50.907344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cfe4b9bc-4110-4987-8c0f-fdc30c57178f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.922312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfe4b9bc-4110-4987-8c0f-fdc30c57178f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.938449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfe4b9bc-4110-4987-8c0f-fdc30c57178f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.939171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfe4b9bc-4110-4987-8c0f-fdc30c57178f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.941273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfe4b9bc-4110-4987-8c0f-fdc30c57178f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.943810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfe4b9bc-4110-4987-8c0f-fdc30c57178f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.949819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfe4b9bc-4110-4987-8c0f-fdc30c57178f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.303332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cfe4b9bc-4110-4987-8c0f-fdc30c57178f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.313615 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cfe4b9bc-4110-4987-8c0f-fdc30c57178f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1688 microversion: 2.1 time: 1.416157 Oct 04 18:38:52.314894 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3108/6207] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:50 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1688 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:52.924985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-792c2dd7-9646-4021-9d80-c36833761954 req-5b1835ae-38b3-41ff-80c4-d43dcf6d3d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2e3963-4e10-431c-9853-8f8070f1e4a5", "name": "network-vif-deleted", "tag": "11a780a3-dd1a-4548-94e0-60cf154cfc39"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:52.943778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-792c2dd7-9646-4021-9d80-c36833761954 req-5b1835ae-38b3-41ff-80c4-d43dcf6d3d16 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.945346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-792c2dd7-9646-4021-9d80-c36833761954 req-5b1835ae-38b3-41ff-80c4-d43dcf6d3d16 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.946547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-792c2dd7-9646-4021-9d80-c36833761954 req-5b1835ae-38b3-41ff-80c4-d43dcf6d3d16 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.967293 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-792c2dd7-9646-4021-9d80-c36833761954 req-5b1835ae-38b3-41ff-80c4-d43dcf6d3d16 service nova] Creating event network-vif-deleted:11a780a3-dd1a-4548-94e0-60cf154cfc39 for instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 on n-h1-850499-14 Oct 04 18:38:52.975973 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-792c2dd7-9646-4021-9d80-c36833761954 req-5b1835ae-38b3-41ff-80c4-d43dcf6d3d16 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055948 Oct 04 18:38:52.976666 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3100/6208] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:53.357389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.358971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.377440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.379867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.381480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.384180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.386916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.387780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.530685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.531200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.531852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.532811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lazy-loading 'fault' on Instance uuid ec2e3963-4e10-431c-9853-8f8070f1e4a5 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:53.622591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.637712 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-132a3216-3dfa-4c91-82f3-a7240c05ce73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 200 len: 1356 microversion: 2.1 time: 0.284979 Oct 04 18:38:53.638604 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3109/6209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 1356 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:54.679315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:54.680635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: ec2e3963-4e10-431c-9853-8f8070f1e4a5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:54.699502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.701844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.702837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.708280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.710573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.712574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.766046 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] HTTP exception thrown: Instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 could not be found. Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Request method failure captured: Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 HTTP/1.1 Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH0DNQomkqqv-Qu84uLjAqPo6HMqiT1ULGhUmMALAk5Z9X3SuEK_qKUFSYc4VFmbF3awEhHAZ23FKbO0jEHJgn1JglTbqPqA4tXbETY-Pt-M6BRs2GinOvBXhlz9OU805haxcHHt-xDGagC9rXsMJ5AUy9kigxeIRWw5j9S_HaRlp1g Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bfebaa3ef67f42289fa824284a968c42 Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bfebaa3ef67f42289fa824284a968c42"}]}] Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bfebaa3ef67f42289fa824284a968c42 Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestNetworkAdvancedServerOps-145155639-project Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 87e519320e854ce480adcd9de2750bfb Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestNetworkAdvancedServerOps-145155639-project Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 could not be found. Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ec2e3963-4e10-431c-9853-8f8070f1e4a5'} Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 could not be found. Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 could not be found. Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:38:54.769150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:54.773329 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:38:54.773329 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:54.773329 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:54.773329 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:54.773329 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:54.773329 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:54.773329 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 could not be found. Oct 04 18:38:54.773329 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:38:54.773329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Returning 404 to user: Instance ec2e3963-4e10-431c-9853-8f8070f1e4a5 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:54.773329 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d6227b43-00ec-418e-a050-929414ef9ec7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5" status: 404 len: 111 microversion: 2.1 time: 0.109813 Oct 04 18:38:54.793315 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3101/6210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:54 2022] GET /compute/v2.1/servers/ec2e3963-4e10-431c-9853-8f8070f1e4a5 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:56.638932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3905de5c-37de-46d3-871a-42f51fbe3ee7"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:56.642419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:56.663205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.664243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.664935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.665894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.667248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.667957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.842907 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Invalid volume: volume 3905de5c-37de-46d3-871a-42f51fbe3ee7 is already attached to instances: 4359baf5-e205-4f98-be2c-6a33a2ea24f4 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments HTTP/1.1 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 74 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: {"volumeAttachment": {"volumeId": "3905de5c-37de-46d3-871a-42f51fbe3ee7"}} Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: exception: Invalid volume: volume 3905de5c-37de-46d3-871a-42f51fbe3ee7 is already attached to instances: 4359baf5-e205-4f98-be2c-6a33a2ea24f4 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'server_id': '4359baf5-e205-4f98-be2c-6a33a2ea24f4', 'body': {'volumeAttachment': {'volumeId': '3905de5c-37de-46d3-871a-42f51fbe3ee7'}}} Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3905de5c-37de-46d3-871a-42f51fbe3ee7 is already attached to instances: 4359baf5-e205-4f98-be2c-6a33a2ea24f4 Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:56.845384 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3905de5c-37de-46d3-871a-42f51fbe3ee7 is already attached to instances: 4359baf5-e205-4f98-be2c-6a33a2ea24f4 Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3905de5c-37de-46d3-871a-42f51fbe3ee7 is already attached to instances: 4359baf5-e205-4f98-be2c-6a33a2ea24f4 Oct 04 18:38:56.849523 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:38:56.853141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 400 to user: Invalid volume: volume 3905de5c-37de-46d3-871a-42f51fbe3ee7 is already attached to instances: 4359baf5-e205-4f98-be2c-6a33a2ea24f4 {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:56.855053 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ac38de93-b62c-4016-a995-a844623ad329 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.220934 Oct 04 18:38:56.856148 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3110/6211] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:38:56 2022] POST /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 174 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:38:57.005566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2f5c65d7-d7f9-432a-9757-af0c375778c2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:57.006388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2f5c65d7-d7f9-432a-9757-af0c375778c2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:57.030757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f5c65d7-d7f9-432a-9757-af0c375778c2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.031635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f5c65d7-d7f9-432a-9757-af0c375778c2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.032311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f5c65d7-d7f9-432a-9757-af0c375778c2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.033567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f5c65d7-d7f9-432a-9757-af0c375778c2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.037694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f5c65d7-d7f9-432a-9757-af0c375778c2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.038497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f5c65d7-d7f9-432a-9757-af0c375778c2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.258235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-2f5c65d7-d7f9-432a-9757-af0c375778c2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lazy-loading 'services' on Instance uuid 4359baf5-e205-4f98-be2c-6a33a2ea24f4 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:57.443305 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2f5c65d7-d7f9-432a-9757-af0c375778c2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments/3905de5c-37de-46d3-871a-42f51fbe3ee7" status: 202 len: 0 microversion: 2.1 time: 0.439692 Oct 04 18:38:57.446124 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3102/6212] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:38:56 2022] DELETE /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments/3905de5c-37de-46d3-871a-42f51fbe3ee7 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:57.459830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57d9a27e-e290-45fa-b37f-b08017c0d4ff tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:57.463622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-57d9a27e-e290-45fa-b37f-b08017c0d4ff tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:57.488512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d9a27e-e290-45fa-b37f-b08017c0d4ff tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.489788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d9a27e-e290-45fa-b37f-b08017c0d4ff tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.491272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d9a27e-e290-45fa-b37f-b08017c0d4ff tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.508116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d9a27e-e290-45fa-b37f-b08017c0d4ff tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.509009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d9a27e-e290-45fa-b37f-b08017c0d4ff tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.509827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57d9a27e-e290-45fa-b37f-b08017c0d4ff tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.623940 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-57d9a27e-e290-45fa-b37f-b08017c0d4ff tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171167 Oct 04 18:38:57.626290 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3111/6213] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:38:57 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:58.640796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bc099e98-8057-43b9-a164-6593e3254ab5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:58.647083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bc099e98-8057-43b9-a164-6593e3254ab5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:58.660471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:58.667721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc099e98-8057-43b9-a164-6593e3254ab5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.673030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc099e98-8057-43b9-a164-6593e3254ab5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.673815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc099e98-8057-43b9-a164-6593e3254ab5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.676987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc099e98-8057-43b9-a164-6593e3254ab5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.678020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc099e98-8057-43b9-a164-6593e3254ab5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.678634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc099e98-8057-43b9-a164-6593e3254ab5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.710716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:58.734501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bc099e98-8057-43b9-a164-6593e3254ab5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099989 Oct 04 18:38:58.737707 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3103/6214] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:38:58 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:59.759573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-70b33ab7-9292-4a5f-9df6-6d49d24acf35 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.763109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-70b33ab7-9292-4a5f-9df6-6d49d24acf35 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:59.776151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70b33ab7-9292-4a5f-9df6-6d49d24acf35 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.776922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70b33ab7-9292-4a5f-9df6-6d49d24acf35 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.779758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70b33ab7-9292-4a5f-9df6-6d49d24acf35 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.780746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70b33ab7-9292-4a5f-9df6-6d49d24acf35 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.781383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70b33ab7-9292-4a5f-9df6-6d49d24acf35 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.785197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70b33ab7-9292-4a5f-9df6-6d49d24acf35 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.888254 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-70b33ab7-9292-4a5f-9df6-6d49d24acf35 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131006 Oct 04 18:38:59.897614 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3112/6215] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:38:59 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:00.906279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f66bdc28-09c5-42c3-bf1e-6549e4aa97d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:00.913051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f66bdc28-09c5-42c3-bf1e-6549e4aa97d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:00.958230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f66bdc28-09c5-42c3-bf1e-6549e4aa97d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.960827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f66bdc28-09c5-42c3-bf1e-6549e4aa97d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.961846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f66bdc28-09c5-42c3-bf1e-6549e4aa97d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.966224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f66bdc28-09c5-42c3-bf1e-6549e4aa97d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.967532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f66bdc28-09c5-42c3-bf1e-6549e4aa97d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.968674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f66bdc28-09c5-42c3-bf1e-6549e4aa97d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.037607 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f66bdc28-09c5-42c3-bf1e-6549e4aa97d4 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138272 Oct 04 18:39:01.047750 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3104/6216] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:00 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:02.056754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-26445612-daa3-49d1-bedd-09e29bbeb4c8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:02.060344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-26445612-daa3-49d1-bedd-09e29bbeb4c8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:02.119520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26445612-daa3-49d1-bedd-09e29bbeb4c8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.123514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26445612-daa3-49d1-bedd-09e29bbeb4c8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.124128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26445612-daa3-49d1-bedd-09e29bbeb4c8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.127165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26445612-daa3-49d1-bedd-09e29bbeb4c8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.133258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26445612-daa3-49d1-bedd-09e29bbeb4c8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.136512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26445612-daa3-49d1-bedd-09e29bbeb4c8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.256965 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-26445612-daa3-49d1-bedd-09e29bbeb4c8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202590 Oct 04 18:39:02.264803 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3113/6217] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:02 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:03.283605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9093fa7b-a2c2-4277-b21c-34a976dd7e82 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.291868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9093fa7b-a2c2-4277-b21c-34a976dd7e82 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.329936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9093fa7b-a2c2-4277-b21c-34a976dd7e82 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.330461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9093fa7b-a2c2-4277-b21c-34a976dd7e82 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.339155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9093fa7b-a2c2-4277-b21c-34a976dd7e82 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.342705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9093fa7b-a2c2-4277-b21c-34a976dd7e82 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.343583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9093fa7b-a2c2-4277-b21c-34a976dd7e82 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.346016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9093fa7b-a2c2-4277-b21c-34a976dd7e82 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.534674 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9093fa7b-a2c2-4277-b21c-34a976dd7e82 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.259915 Oct 04 18:39:03.538234 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3105/6218] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:39:04.377560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12a51560-5a42-4346-9a28-47b0e5185024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '.version_select at 0x7fd4d109e040>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.430120 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [None req-12a51560-5a42-4346-9a28-47b0e5185024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [d9f288b1-1977-47eb-9b11-91ff29205328] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:39:04.552359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74309540-a662-4faf-acdd-c446116d57eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.555985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-74309540-a662-4faf-acdd-c446116d57eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:04.578240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74309540-a662-4faf-acdd-c446116d57eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.585339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74309540-a662-4faf-acdd-c446116d57eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.586311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74309540-a662-4faf-acdd-c446116d57eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.592769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74309540-a662-4faf-acdd-c446116d57eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.594036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74309540-a662-4faf-acdd-c446116d57eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.616892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74309540-a662-4faf-acdd-c446116d57eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.708758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74309540-a662-4faf-acdd-c446116d57eb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160038 Oct 04 18:39:04.719679 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3106/6219] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:04 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:05.442727 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [None req-12a51560-5a42-4346-9a28-47b0e5185024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [d9f288b1-1977-47eb-9b11-91ff29205328] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60362. Oct 04 18:39:05.488271 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12a51560-5a42-4346-9a28-47b0e5185024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1601179524" status: 202 len: 0 microversion: 2.1 time: 1.126656 Oct 04 18:39:05.489125 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3114/6220] 10.222.0.18 () {58 vars in 1284 bytes} [Tue Oct 4 18:39:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1601179524 => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:05.546236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d481b3d-2d86-4523-b57e-fb67dbd41e17 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'create', calling method: .version_select at 0x7fd4d12c8af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-174911269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYI0SRokViK8JVhW0Jt6DeLhElZHj1kCGT07vFVNXYjOzb/0hV5Z/fHF5syVbNNfvlYM9aOT+zlzqG1Ihg5SxCzlE8XWuXmYqwSo8+ehmhciLwy/yIn4eIhKhwek+QKFA=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:05.582431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1d481b3d-2d86-4523-b57e-fb67dbd41e17 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for project bfebaa3ef67f42289fa824284a968c42. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:05.596593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1d481b3d-2d86-4523-b57e-fb67dbd41e17 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for user 87e519320e854ce480adcd9de2750bfb and project bfebaa3ef67f42289fa824284a968c42. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:05.662804 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d481b3d-2d86-4523-b57e-fb67dbd41e17 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.120523 Oct 04 18:39:05.664704 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3107/6221] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:39:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:05.736625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cbd9df22-666b-4b72-9993-b6bf871bc81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.742280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cbd9df22-666b-4b72-9993-b6bf871bc81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.763465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:05.780792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cbd9df22-666b-4b72-9993-b6bf871bc81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.784172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cbd9df22-666b-4b72-9993-b6bf871bc81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.786672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cbd9df22-666b-4b72-9993-b6bf871bc81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.788537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cbd9df22-666b-4b72-9993-b6bf871bc81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.791370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cbd9df22-666b-4b72-9993-b6bf871bc81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.793763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cbd9df22-666b-4b72-9993-b6bf871bc81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.806230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:05.976344 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cbd9df22-666b-4b72-9993-b6bf871bc81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.245929 Oct 04 18:39:05.983316 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3115/6222] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:06.998729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c7741af1-07c1-40c9-aa19-f1792b58bd45 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:07.009747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c7741af1-07c1-40c9-aa19-f1792b58bd45 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:07.033265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7741af1-07c1-40c9-aa19-f1792b58bd45 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.048235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7741af1-07c1-40c9-aa19-f1792b58bd45 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.049364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7741af1-07c1-40c9-aa19-f1792b58bd45 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.051422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7741af1-07c1-40c9-aa19-f1792b58bd45 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.052541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7741af1-07c1-40c9-aa19-f1792b58bd45 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.053553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c7741af1-07c1-40c9-aa19-f1792b58bd45 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.179904 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c7741af1-07c1-40c9-aa19-f1792b58bd45 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188740 Oct 04 18:39:07.180680 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3108/6223] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:08.205345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27523fc1-ecf2-47d8-bbc4-b01b8f5dcde6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:08.217404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27523fc1-ecf2-47d8-bbc4-b01b8f5dcde6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:08.250799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27523fc1-ecf2-47d8-bbc4-b01b8f5dcde6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.254717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27523fc1-ecf2-47d8-bbc4-b01b8f5dcde6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.256235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27523fc1-ecf2-47d8-bbc4-b01b8f5dcde6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.260711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27523fc1-ecf2-47d8-bbc4-b01b8f5dcde6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.262636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27523fc1-ecf2-47d8-bbc4-b01b8f5dcde6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.265036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27523fc1-ecf2-47d8-bbc4-b01b8f5dcde6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.420305 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27523fc1-ecf2-47d8-bbc4-b01b8f5dcde6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.227213 Oct 04 18:39:08.420995 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3116/6224] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:08 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4/os-volume_attachments => generated 25 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:39:08.563796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dfcad82b-8ab8-498c-96de-770d96c41d92 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:08.564781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dfcad82b-8ab8-498c-96de-770d96c41d92 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:08.582922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfcad82b-8ab8-498c-96de-770d96c41d92 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.584195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfcad82b-8ab8-498c-96de-770d96c41d92 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.585226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfcad82b-8ab8-498c-96de-770d96c41d92 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.587305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfcad82b-8ab8-498c-96de-770d96c41d92 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.588919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfcad82b-8ab8-498c-96de-770d96c41d92 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.589956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfcad82b-8ab8-498c-96de-770d96c41d92 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.653153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dfcad82b-8ab8-498c-96de-770d96c41d92 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:08.819227 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dfcad82b-8ab8-498c-96de-770d96c41d92 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 204 len: 0 microversion: 2.1 time: 0.266023 Oct 04 18:39:08.821870 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3109/6225] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:08 2022] DELETE /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:08.834918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a0d5de9b-2a8b-47e3-9629-e1c7f40dac60 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:08.850409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a0d5de9b-2a8b-47e3-9629-e1c7f40dac60 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:08.870470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5de9b-2a8b-47e3-9629-e1c7f40dac60 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.879517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5de9b-2a8b-47e3-9629-e1c7f40dac60 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.880376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5de9b-2a8b-47e3-9629-e1c7f40dac60 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.881676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5de9b-2a8b-47e3-9629-e1c7f40dac60 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.882527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5de9b-2a8b-47e3-9629-e1c7f40dac60 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.888578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0d5de9b-2a8b-47e3-9629-e1c7f40dac60 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.085397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a0d5de9b-2a8b-47e3-9629-e1c7f40dac60 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.096478 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a0d5de9b-2a8b-47e3-9629-e1c7f40dac60 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1681 microversion: 2.1 time: 1.268949 Oct 04 18:39:10.097722 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3117/6226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:08 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1681 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:11.133171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6598b614-9f2b-4b8e-bb6e-1f5708b228c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:11.137375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6598b614-9f2b-4b8e-bb6e-1f5708b228c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:11.157329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6598b614-9f2b-4b8e-bb6e-1f5708b228c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.157846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6598b614-9f2b-4b8e-bb6e-1f5708b228c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.158293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6598b614-9f2b-4b8e-bb6e-1f5708b228c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.159157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6598b614-9f2b-4b8e-bb6e-1f5708b228c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.159648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6598b614-9f2b-4b8e-bb6e-1f5708b228c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.160084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6598b614-9f2b-4b8e-bb6e-1f5708b228c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.841491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6598b614-9f2b-4b8e-bb6e-1f5708b228c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:11.850694 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6598b614-9f2b-4b8e-bb6e-1f5708b228c5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1681 microversion: 2.1 time: 0.724274 Oct 04 18:39:11.851343 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3110/6227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:11 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1681 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:12.899752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4efd60cc-abcd-4545-b12d-a65936fa7869 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:12.900641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4efd60cc-abcd-4545-b12d-a65936fa7869 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:12.913694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4efd60cc-abcd-4545-b12d-a65936fa7869 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.914194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4efd60cc-abcd-4545-b12d-a65936fa7869 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.918158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4efd60cc-abcd-4545-b12d-a65936fa7869 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.919302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4efd60cc-abcd-4545-b12d-a65936fa7869 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.922142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4efd60cc-abcd-4545-b12d-a65936fa7869 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.922804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4efd60cc-abcd-4545-b12d-a65936fa7869 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.273179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4efd60cc-abcd-4545-b12d-a65936fa7869 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:13.297476 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4efd60cc-abcd-4545-b12d-a65936fa7869 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1613 microversion: 2.1 time: 0.401721 Oct 04 18:39:13.304473 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3118/6228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:12 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1613 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:14.368897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-682766d2-2358-455a-ab8d-c2c18c264b82 req-c9f22436-5561-4abd-8a5b-eaaf59d359c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4359baf5-e205-4f98-be2c-6a33a2ea24f4", "name": "network-vif-deleted", "tag": "02502de0-4aa1-4449-b5f8-6310f0f1548b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:14.372971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e51b5dd1-35a9-480a-91d7-37afa4242d84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:14.384645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e51b5dd1-35a9-480a-91d7-37afa4242d84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:14.419150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e51b5dd1-35a9-480a-91d7-37afa4242d84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.426941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-682766d2-2358-455a-ab8d-c2c18c264b82 req-c9f22436-5561-4abd-8a5b-eaaf59d359c2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.427849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-682766d2-2358-455a-ab8d-c2c18c264b82 req-c9f22436-5561-4abd-8a5b-eaaf59d359c2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.429199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e51b5dd1-35a9-480a-91d7-37afa4242d84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.430232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e51b5dd1-35a9-480a-91d7-37afa4242d84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.431945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e51b5dd1-35a9-480a-91d7-37afa4242d84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.433042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e51b5dd1-35a9-480a-91d7-37afa4242d84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.434032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e51b5dd1-35a9-480a-91d7-37afa4242d84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.442761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-682766d2-2358-455a-ab8d-c2c18c264b82 req-c9f22436-5561-4abd-8a5b-eaaf59d359c2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.487425 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-682766d2-2358-455a-ab8d-c2c18c264b82 req-c9f22436-5561-4abd-8a5b-eaaf59d359c2 service nova] Creating event network-vif-deleted:02502de0-4aa1-4449-b5f8-6310f0f1548b for instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 on n-h2-850499-14 Oct 04 18:39:14.506861 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-682766d2-2358-455a-ab8d-c2c18c264b82 req-c9f22436-5561-4abd-8a5b-eaaf59d359c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171212 Oct 04 18:39:14.521957 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3111/6229] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:14.702555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e51b5dd1-35a9-480a-91d7-37afa4242d84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:14.721809 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e51b5dd1-35a9-480a-91d7-37afa4242d84 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 200 len: 1327 microversion: 2.1 time: 0.380049 Oct 04 18:39:14.723244 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3119/6230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:14 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 1327 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:15.772968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.777632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:15.801214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:15.812390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.814440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.816876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.823805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.825873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.827439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.857590 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 HTTP/1.1 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4359baf5-e205-4f98-be2c-6a33a2ea24f4'} Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:15.859927 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:39:15.863908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:15.863908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:15.863908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:15.863908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:15.863908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:15.863908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:39:15.863908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:39:15.870378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:15.871753 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f23f5489-1740-43a4-93e9-6c0a3fbabafd tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 404 len: 111 microversion: 2.1 time: 0.107374 Oct 04 18:39:15.877297 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3112/6231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:15.884342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-32ac3d6c-2ee0-4f26-b1ac-176f1c9b4422 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '.version_select at 0x7fd4d1049a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.981034 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-32ac3d6c-2ee0-4f26-b1ac-176f1c9b4422 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576182654" status: 202 len: 0 microversion: 2.1 time: 0.095385 Oct 04 18:39:15.981034 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3120/6232] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:39:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576182654 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:19.620136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4e14f112-719f-4679-a6ff-bdda56415336 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: .version_select at 0x7fd4d1e4a790>, body: {"keypair": {"name": "tempest-keypair-1879502291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYfcDRnUcgZNAdlSH5lWrriMwtk4dBWBL9q+ZokAGyCvL7tPiOp1t/VqQKfPfLlyYqs38mM8Ah3FMaPZIf3lxdu54N+ns3Z0pEU2Vjgb9beb7iZkyeIMxjEKxUAg2p+XQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:19.710371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-4e14f112-719f-4679-a6ff-bdda56415336 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for project 6a9c2474d65845eb84b608f305203297. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:19.736945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-4e14f112-719f-4679-a6ff-bdda56415336 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for user 0937bdb543864ac4bb2c6f6ea1137525 and project 6a9c2474d65845eb84b608f305203297. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:19.850616 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4e14f112-719f-4679-a6ff-bdda56415336 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.234424 Oct 04 18:39:19.851698 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3113/6233] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:39:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:24.188546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1325837150", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "069d1090-6778-4b8e-a236-06f9472c7dcc"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:24.391650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] validate_networks() for [('069d1090-6778-4b8e-a236-06f9472c7dcc', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:24.714330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=29 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:25.224126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-892276953", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "233022be-f780-4b07-992f-0763812d4d7b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-174911269", "security_groups": [{"name": "tempest-secgroup-smoke-1465555938"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:25.505162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] validate_networks() for [('233022be-f780-4b07-992f-0763812d4d7b', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:25.854250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:26.147393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:26.148174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:26.148523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:26.149418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:26.150005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:26.184572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.186029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.196878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.198547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.227658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.229096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.302670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Getting quotas for project 53f5150f32c74426b300d4b1de6c0f59. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:26.320816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Getting quotas for user c9bc978004614940b09fa4fed432a192 and project 53f5150f32c74426b300d4b1de6c0f59. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:26.356651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:26.359373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:26.501063 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45785c75-60ef-4f5b-ac78-f6914bc02076 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.319096 Oct 04 18:39:26.519455 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3121/6234] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:39:26.530625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7edc3802-5814-4e14-9359-38a2cc11f836 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:26.532695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7edc3802-5814-4e14-9359-38a2cc11f836 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:26.683282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7edc3802-5814-4e14-9359-38a2cc11f836 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:26.694679 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7edc3802-5814-4e14-9359-38a2cc11f836 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1219 microversion: 2.1 time: 0.171726 Oct 04 18:39:26.698653 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3122/6235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:26 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1219 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:26.989564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:26.990685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:26.991545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:26.995155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:26.996279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:27.018245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.019242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.020056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.021632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.025394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.026472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.068482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for project bfebaa3ef67f42289fa824284a968c42. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:27.085057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for user 87e519320e854ce480adcd9de2750bfb and project bfebaa3ef67f42289fa824284a968c42. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:27.152527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:27.168420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:27.378938 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e383d2f-4460-45a9-acc9-33865de87203 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.163519 Oct 04 18:39:27.379660 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3114/6236] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:39:27.394846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-85730107-03db-4e86-8728-b53dd8217b12 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:27.395632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-85730107-03db-4e86-8728-b53dd8217b12 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:27.534579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-85730107-03db-4e86-8728-b53dd8217b12 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.551770 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-85730107-03db-4e86-8728-b53dd8217b12 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1265 microversion: 2.1 time: 0.161321 Oct 04 18:39:27.552754 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3123/6237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:27 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:27.740376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-787e0019-5f9d-4e96-8660-caceb28c1fa1 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:27.741486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-787e0019-5f9d-4e96-8660-caceb28c1fa1 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:27.950339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-787e0019-5f9d-4e96-8660-caceb28c1fa1 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.969570 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-787e0019-5f9d-4e96-8660-caceb28c1fa1 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1219 microversion: 2.1 time: 0.229951 Oct 04 18:39:27.971937 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3115/6238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:27 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1219 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:28.577374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-03cc110e-4d99-474c-a51e-a79eb6adfadc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:28.579541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-03cc110e-4d99-474c-a51e-a79eb6adfadc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:28.612297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03cc110e-4d99-474c-a51e-a79eb6adfadc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.616860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03cc110e-4d99-474c-a51e-a79eb6adfadc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.617339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03cc110e-4d99-474c-a51e-a79eb6adfadc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.620827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03cc110e-4d99-474c-a51e-a79eb6adfadc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.626422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03cc110e-4d99-474c-a51e-a79eb6adfadc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.627561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03cc110e-4d99-474c-a51e-a79eb6adfadc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.855237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-03cc110e-4d99-474c-a51e-a79eb6adfadc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:28.871792 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-03cc110e-4d99-474c-a51e-a79eb6adfadc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1269 microversion: 2.1 time: 0.297593 Oct 04 18:39:28.873550 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3124/6239] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:28 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1269 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:29.006269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1779066676", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d316594-9bd8-4981-8984-faf6f3eebe9b"}], "security_groups": [{"name": "tempest-securitygroup--350115891"}], "key_name": "tempest-keypair-1879502291", "user_data": "}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:29.006926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10b757a4-5982-4d76-8449-8e6a90390453 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:29.007861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10b757a4-5982-4d76-8449-8e6a90390453 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:29.012408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:29.051557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b757a4-5982-4d76-8449-8e6a90390453 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.052698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b757a4-5982-4d76-8449-8e6a90390453 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.053415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b757a4-5982-4d76-8449-8e6a90390453 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.054499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b757a4-5982-4d76-8449-8e6a90390453 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.055652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b757a4-5982-4d76-8449-8e6a90390453 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.057490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b757a4-5982-4d76-8449-8e6a90390453 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.231148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-10b757a4-5982-4d76-8449-8e6a90390453 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.266932 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10b757a4-5982-4d76-8449-8e6a90390453 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1271 microversion: 2.1 time: 0.265091 Oct 04 18:39:29.270657 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3116/6240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:28 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1271 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:29.416410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] validate_networks() for [('8d316594-9bd8-4981-8984-faf6f3eebe9b', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:29.925637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d3c3cd2-7a17-440f-9ab0-a0a0e2e986dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:29.926467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d3c3cd2-7a17-440f-9ab0-a0a0e2e986dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:29.940787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d3c3cd2-7a17-440f-9ab0-a0a0e2e986dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.941740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d3c3cd2-7a17-440f-9ab0-a0a0e2e986dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.942433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d3c3cd2-7a17-440f-9ab0-a0a0e2e986dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.943481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d3c3cd2-7a17-440f-9ab0-a0a0e2e986dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.948024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d3c3cd2-7a17-440f-9ab0-a0a0e2e986dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.949088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d3c3cd2-7a17-440f-9ab0-a0a0e2e986dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.853014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d3c3cd2-7a17-440f-9ab0-a0a0e2e986dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:30.864608 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d3c3cd2-7a17-440f-9ab0-a0a0e2e986dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1317 microversion: 2.1 time: 0.944137 Oct 04 18:39:30.871012 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3117/6241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:29 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1317 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:30.876207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cada0ae0-04c0-481b-89f2-b9154280570c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:30.886085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cada0ae0-04c0-481b-89f2-b9154280570c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:30.905311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cada0ae0-04c0-481b-89f2-b9154280570c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.906410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cada0ae0-04c0-481b-89f2-b9154280570c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.907457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cada0ae0-04c0-481b-89f2-b9154280570c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.909457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cada0ae0-04c0-481b-89f2-b9154280570c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.920222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cada0ae0-04c0-481b-89f2-b9154280570c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.921417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cada0ae0-04c0-481b-89f2-b9154280570c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.281423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cada0ae0-04c0-481b-89f2-b9154280570c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:31.304003 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cada0ae0-04c0-481b-89f2-b9154280570c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1277 microversion: 2.1 time: 0.431517 Oct 04 18:39:31.305320 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3118/6242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:30 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1277 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:31.898058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:31.898923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:31.898923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:31.899400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:31.900023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:31.904897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-25177ca4-8451-4ce1-bf1f-59536ccd1c86 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:31.908738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-25177ca4-8451-4ce1-bf1f-59536ccd1c86 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:31.928395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.930232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.931277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.934765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.935542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.938208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.939099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25177ca4-8451-4ce1-bf1f-59536ccd1c86 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.939987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25177ca4-8451-4ce1-bf1f-59536ccd1c86 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.946792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25177ca4-8451-4ce1-bf1f-59536ccd1c86 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.948538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25177ca4-8451-4ce1-bf1f-59536ccd1c86 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.949909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25177ca4-8451-4ce1-bf1f-59536ccd1c86 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.950715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25177ca4-8451-4ce1-bf1f-59536ccd1c86 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.024493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for project 6a9c2474d65845eb84b608f305203297. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:32.039478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Getting quotas for user 0937bdb543864ac4bb2c6f6ea1137525 and project 6a9c2474d65845eb84b608f305203297. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:32.086321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:32.099619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:32.266658 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fbe603f4-0d9b-4fa5-bc71-fdca94290ceb tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.265069 Oct 04 18:39:32.268000 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3125/6243] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 3267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:39:32.276830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-25177ca4-8451-4ce1-bf1f-59536ccd1c86 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.286317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7c651672-1fe2-494e-b446-d183263b2261 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.289259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7c651672-1fe2-494e-b446-d183263b2261 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.293815 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-25177ca4-8451-4ce1-bf1f-59536ccd1c86 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1323 microversion: 2.1 time: 0.399838 Oct 04 18:39:32.299635 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3119/6244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:31 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1323 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:32.339851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f1c25ec-463d-4646-834b-361094c53eb9 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.346543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f1c25ec-463d-4646-834b-361094c53eb9 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.385202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1c25ec-463d-4646-834b-361094c53eb9 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.387202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1c25ec-463d-4646-834b-361094c53eb9 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.388334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1c25ec-463d-4646-834b-361094c53eb9 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.392820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1c25ec-463d-4646-834b-361094c53eb9 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.393940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1c25ec-463d-4646-834b-361094c53eb9 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.395548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1c25ec-463d-4646-834b-361094c53eb9 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.778869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7c651672-1fe2-494e-b446-d183263b2261 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.826422 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7c651672-1fe2-494e-b446-d183263b2261 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1242 microversion: 2.1 time: 0.543787 Oct 04 18:39:32.869314 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3126/6245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1242 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:33.346851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e2425c10-305d-403f-ac75-da8d81db00bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.350344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e2425c10-305d-403f-ac75-da8d81db00bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.376627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2425c10-305d-403f-ac75-da8d81db00bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.379986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2425c10-305d-403f-ac75-da8d81db00bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.380914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2425c10-305d-403f-ac75-da8d81db00bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.393798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2425c10-305d-403f-ac75-da8d81db00bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.405862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2425c10-305d-403f-ac75-da8d81db00bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.406891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e2425c10-305d-403f-ac75-da8d81db00bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.689718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1f1c25ec-463d-4646-834b-361094c53eb9 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:33.719591 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f1c25ec-463d-4646-834b-361094c53eb9 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 1.387342 Oct 04 18:39:33.722348 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3120/6246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:33.886033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ae0ab0a0-138f-43c3-94fe-40668f9196c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.887184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ae0ab0a0-138f-43c3-94fe-40668f9196c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.929588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae0ab0a0-138f-43c3-94fe-40668f9196c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.939846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae0ab0a0-138f-43c3-94fe-40668f9196c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.941100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae0ab0a0-138f-43c3-94fe-40668f9196c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.944085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae0ab0a0-138f-43c3-94fe-40668f9196c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.944990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae0ab0a0-138f-43c3-94fe-40668f9196c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.946015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae0ab0a0-138f-43c3-94fe-40668f9196c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.350192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ae0ab0a0-138f-43c3-94fe-40668f9196c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.368252 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ae0ab0a0-138f-43c3-94fe-40668f9196c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1246 microversion: 2.1 time: 0.492682 Oct 04 18:39:34.381093 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3121/6247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1246 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:34.458973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e2425c10-305d-403f-ac75-da8d81db00bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.490173 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e2425c10-305d-403f-ac75-da8d81db00bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1391 microversion: 2.1 time: 1.149510 Oct 04 18:39:34.495319 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3127/6248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1391 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:34.768632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2703a49c-391b-48f9-b26c-0c9b61de3c2e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:34.769751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2703a49c-391b-48f9-b26c-0c9b61de3c2e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:34.814638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2703a49c-391b-48f9-b26c-0c9b61de3c2e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.815583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2703a49c-391b-48f9-b26c-0c9b61de3c2e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.816398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2703a49c-391b-48f9-b26c-0c9b61de3c2e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.817690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2703a49c-391b-48f9-b26c-0c9b61de3c2e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.818522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2703a49c-391b-48f9-b26c-0c9b61de3c2e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.841677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2703a49c-391b-48f9-b26c-0c9b61de3c2e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.420451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c83d4543-1810-4659-af36-3c05cb3325c0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.420451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c83d4543-1810-4659-af36-3c05cb3325c0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:35.441591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83d4543-1810-4659-af36-3c05cb3325c0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.445254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83d4543-1810-4659-af36-3c05cb3325c0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.446036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83d4543-1810-4659-af36-3c05cb3325c0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.450397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83d4543-1810-4659-af36-3c05cb3325c0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.451353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83d4543-1810-4659-af36-3c05cb3325c0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.451959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c83d4543-1810-4659-af36-3c05cb3325c0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.492991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2703a49c-391b-48f9-b26c-0c9b61de3c2e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:35.516594 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2703a49c-391b-48f9-b26c-0c9b61de3c2e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.755483 Oct 04 18:39:35.531082 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3122/6249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:34 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:35.552523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f9473f9-97cf-4965-9d0c-64cf7ab2f632 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.554856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4f9473f9-97cf-4965-9d0c-64cf7ab2f632 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:35.574665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f9473f9-97cf-4965-9d0c-64cf7ab2f632 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.576082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f9473f9-97cf-4965-9d0c-64cf7ab2f632 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.577211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f9473f9-97cf-4965-9d0c-64cf7ab2f632 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.578783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f9473f9-97cf-4965-9d0c-64cf7ab2f632 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.579934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f9473f9-97cf-4965-9d0c-64cf7ab2f632 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.580995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f9473f9-97cf-4965-9d0c-64cf7ab2f632 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.713275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c83d4543-1810-4659-af36-3c05cb3325c0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:35.737312 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c83d4543-1810-4659-af36-3c05cb3325c0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1302 microversion: 2.1 time: 0.321990 Oct 04 18:39:35.740108 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3128/6250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:35 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1302 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:36.181073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4f9473f9-97cf-4965-9d0c-64cf7ab2f632 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.195134 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f9473f9-97cf-4965-9d0c-64cf7ab2f632 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1391 microversion: 2.1 time: 0.650525 Oct 04 18:39:36.196337 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3123/6251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:35 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1391 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:36.367449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e3f3405d-80c3-4968-a7a0-983bacb36dba req-932838b3-1faf-4f97-984b-6fba3784e4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:36.389350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:36.410266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e3f3405d-80c3-4968-a7a0-983bacb36dba req-932838b3-1faf-4f97-984b-6fba3784e4e4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.412032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e3f3405d-80c3-4968-a7a0-983bacb36dba req-932838b3-1faf-4f97-984b-6fba3784e4e4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.412898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e3f3405d-80c3-4968-a7a0-983bacb36dba req-932838b3-1faf-4f97-984b-6fba3784e4e4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.437550 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e3f3405d-80c3-4968-a7a0-983bacb36dba req-932838b3-1faf-4f97-984b-6fba3784e4e4 service nova] Creating event network-changed:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h2-850499-14 Oct 04 18:39:36.448560 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e3f3405d-80c3-4968-a7a0-983bacb36dba req-932838b3-1faf-4f97-984b-6fba3784e4e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088810 Oct 04 18:39:36.450211 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3129/6252] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:39:36.596731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4cd9fe9e-a231-4c69-b77d-0092c656fc71 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.613588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4cd9fe9e-a231-4c69-b77d-0092c656fc71 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.661409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cd9fe9e-a231-4c69-b77d-0092c656fc71 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.672144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cd9fe9e-a231-4c69-b77d-0092c656fc71 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.673122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cd9fe9e-a231-4c69-b77d-0092c656fc71 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.676507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cd9fe9e-a231-4c69-b77d-0092c656fc71 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.677827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cd9fe9e-a231-4c69-b77d-0092c656fc71 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.678913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4cd9fe9e-a231-4c69-b77d-0092c656fc71 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.787015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8302e10c-0350-4664-97c6-b89966909ac8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.789689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8302e10c-0350-4664-97c6-b89966909ac8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.805048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8302e10c-0350-4664-97c6-b89966909ac8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.806467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8302e10c-0350-4664-97c6-b89966909ac8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.807809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8302e10c-0350-4664-97c6-b89966909ac8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.809406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8302e10c-0350-4664-97c6-b89966909ac8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.810272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8302e10c-0350-4664-97c6-b89966909ac8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.811279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8302e10c-0350-4664-97c6-b89966909ac8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.988630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8302e10c-0350-4664-97c6-b89966909ac8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:37.010419 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8302e10c-0350-4664-97c6-b89966909ac8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1300 microversion: 2.1 time: 0.238789 Oct 04 18:39:37.029922 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3130/6253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:36 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1300 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:37.049532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:37.159519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4cd9fe9e-a231-4c69-b77d-0092c656fc71 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:37.169504 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4cd9fe9e-a231-4c69-b77d-0092c656fc71 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.618533 Oct 04 18:39:37.170107 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3124/6254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:36 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:37.236972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5e571dd5-5d83-4ba2-a91f-8c7aee26987e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:37.238494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5e571dd5-5d83-4ba2-a91f-8c7aee26987e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:37.263555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e571dd5-5d83-4ba2-a91f-8c7aee26987e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.264827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e571dd5-5d83-4ba2-a91f-8c7aee26987e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.265986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e571dd5-5d83-4ba2-a91f-8c7aee26987e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.267750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e571dd5-5d83-4ba2-a91f-8c7aee26987e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.280220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e571dd5-5d83-4ba2-a91f-8c7aee26987e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.281382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e571dd5-5d83-4ba2-a91f-8c7aee26987e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.560997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5e571dd5-5d83-4ba2-a91f-8c7aee26987e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:37.579467 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5e571dd5-5d83-4ba2-a91f-8c7aee26987e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1391 microversion: 2.1 time: 0.347540 Oct 04 18:39:37.581545 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3131/6255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:37 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1391 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:38.049482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cc4199d7-2997-4e42-a6f3-1fde9f2af290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:38.050580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cc4199d7-2997-4e42-a6f3-1fde9f2af290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:38.070857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=12 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:38.075264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc4199d7-2997-4e42-a6f3-1fde9f2af290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.079234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc4199d7-2997-4e42-a6f3-1fde9f2af290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.080258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc4199d7-2997-4e42-a6f3-1fde9f2af290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.089668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc4199d7-2997-4e42-a6f3-1fde9f2af290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.090893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc4199d7-2997-4e42-a6f3-1fde9f2af290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.091975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc4199d7-2997-4e42-a6f3-1fde9f2af290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.210386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-006cac2a-acdb-47fd-833c-3ba25530a39d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:38.212151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-006cac2a-acdb-47fd-833c-3ba25530a39d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:38.226592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006cac2a-acdb-47fd-833c-3ba25530a39d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.227955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006cac2a-acdb-47fd-833c-3ba25530a39d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.229886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006cac2a-acdb-47fd-833c-3ba25530a39d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.232140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006cac2a-acdb-47fd-833c-3ba25530a39d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.232899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006cac2a-acdb-47fd-833c-3ba25530a39d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.233726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-006cac2a-acdb-47fd-833c-3ba25530a39d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.924875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cc4199d7-2997-4e42-a6f3-1fde9f2af290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.940498 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cc4199d7-2997-4e42-a6f3-1fde9f2af290 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1367 microversion: 2.1 time: 0.897349 Oct 04 18:39:38.944439 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3125/6256] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:38 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1367 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:38.954934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-685441b0-ac28-4049-a1c2-e0dc9ae23a03 req-4296e178-3b87-4178-ad95-c3c8db6a18b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69d2dd6-96aa-4c44-b185-7b4609015b82", "tag": "215c1580-df9e-41c5-a417-09c1eb2e13e3"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:38.972764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-685441b0-ac28-4049-a1c2-e0dc9ae23a03 req-4296e178-3b87-4178-ad95-c3c8db6a18b0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.973669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-685441b0-ac28-4049-a1c2-e0dc9ae23a03 req-4296e178-3b87-4178-ad95-c3c8db6a18b0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.974478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-685441b0-ac28-4049-a1c2-e0dc9ae23a03 req-4296e178-3b87-4178-ad95-c3c8db6a18b0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.989470 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-685441b0-ac28-4049-a1c2-e0dc9ae23a03 req-4296e178-3b87-4178-ad95-c3c8db6a18b0 service nova] Creating event network-changed:215c1580-df9e-41c5-a417-09c1eb2e13e3 for instance b69d2dd6-96aa-4c44-b185-7b4609015b82 on n-h2-850499-14 Oct 04 18:39:38.996471 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-685441b0-ac28-4049-a1c2-e0dc9ae23a03 req-4296e178-3b87-4178-ad95-c3c8db6a18b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052108 Oct 04 18:39:38.997447 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3126/6257] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:39.004019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-efa7b6d5-9330-4d0f-b135-8681f6e66446 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.004778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-efa7b6d5-9330-4d0f-b135-8681f6e66446 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:39.012249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa7b6d5-9330-4d0f-b135-8681f6e66446 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.013112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa7b6d5-9330-4d0f-b135-8681f6e66446 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.014519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa7b6d5-9330-4d0f-b135-8681f6e66446 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.015600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa7b6d5-9330-4d0f-b135-8681f6e66446 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.016222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa7b6d5-9330-4d0f-b135-8681f6e66446 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.016806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efa7b6d5-9330-4d0f-b135-8681f6e66446 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.074799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-006cac2a-acdb-47fd-833c-3ba25530a39d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.117030 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-006cac2a-acdb-47fd-833c-3ba25530a39d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.911117 Oct 04 18:39:39.133020 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3132/6258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:38 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:39.434138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-efa7b6d5-9330-4d0f-b135-8681f6e66446 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.449486 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-efa7b6d5-9330-4d0f-b135-8681f6e66446 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1391 microversion: 2.1 time: 0.450144 Oct 04 18:39:39.454981 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3127/6259] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:38 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1391 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:39.979251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-61959232-48fe-484b-b72f-d0ecfaaddff9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.980058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-61959232-48fe-484b-b72f-d0ecfaaddff9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.000820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61959232-48fe-484b-b72f-d0ecfaaddff9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.003378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61959232-48fe-484b-b72f-d0ecfaaddff9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.003972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61959232-48fe-484b-b72f-d0ecfaaddff9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.007621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61959232-48fe-484b-b72f-d0ecfaaddff9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.009033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61959232-48fe-484b-b72f-d0ecfaaddff9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.009818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-61959232-48fe-484b-b72f-d0ecfaaddff9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.115016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-31216992-2138-4682-b7dd-0ec16b243d69 req-4ae41618-5271-4318-9140-0a99018fdc05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4162df75-55ee-43e5-8672-424dc3bb690b", "tag": "b8f91a23-8447-40ee-a860-833611fb796f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:40.178135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-31216992-2138-4682-b7dd-0ec16b243d69 req-4ae41618-5271-4318-9140-0a99018fdc05 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.179025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-31216992-2138-4682-b7dd-0ec16b243d69 req-4ae41618-5271-4318-9140-0a99018fdc05 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.179931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-31216992-2138-4682-b7dd-0ec16b243d69 req-4ae41618-5271-4318-9140-0a99018fdc05 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.212309 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-31216992-2138-4682-b7dd-0ec16b243d69 req-4ae41618-5271-4318-9140-0a99018fdc05 service nova] Creating event network-changed:b8f91a23-8447-40ee-a860-833611fb796f for instance 4162df75-55ee-43e5-8672-424dc3bb690b on n-h1-850499-14 Oct 04 18:39:40.226192 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-31216992-2138-4682-b7dd-0ec16b243d69 req-4ae41618-5271-4318-9140-0a99018fdc05 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117560 Oct 04 18:39:40.229882 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3128/6260] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:40.242691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b3c5108-7ad7-40fa-a357-177ec454eb5c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:40.244261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b3c5108-7ad7-40fa-a357-177ec454eb5c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.257959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b3c5108-7ad7-40fa-a357-177ec454eb5c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.258912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b3c5108-7ad7-40fa-a357-177ec454eb5c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.259904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b3c5108-7ad7-40fa-a357-177ec454eb5c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.261723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b3c5108-7ad7-40fa-a357-177ec454eb5c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.262672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b3c5108-7ad7-40fa-a357-177ec454eb5c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.263803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b3c5108-7ad7-40fa-a357-177ec454eb5c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.457436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-61959232-48fe-484b-b72f-d0ecfaaddff9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.467475 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-61959232-48fe-484b-b72f-d0ecfaaddff9 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1367 microversion: 2.1 time: 0.493289 Oct 04 18:39:40.468804 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3133/6261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:39 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:40.488086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e28bb16e-3e3f-45be-ac06-191c7e69f1c3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:40.489156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e28bb16e-3e3f-45be-ac06-191c7e69f1c3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.501283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e28bb16e-3e3f-45be-ac06-191c7e69f1c3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.502062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e28bb16e-3e3f-45be-ac06-191c7e69f1c3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.502790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e28bb16e-3e3f-45be-ac06-191c7e69f1c3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.503768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e28bb16e-3e3f-45be-ac06-191c7e69f1c3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.504529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e28bb16e-3e3f-45be-ac06-191c7e69f1c3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.505373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e28bb16e-3e3f-45be-ac06-191c7e69f1c3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.735511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7b3c5108-7ad7-40fa-a357-177ec454eb5c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.752687 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b3c5108-7ad7-40fa-a357-177ec454eb5c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.519745 Oct 04 18:39:40.754049 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3129/6262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:40 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:40.958503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e28bb16e-3e3f-45be-ac06-191c7e69f1c3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.976164 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e28bb16e-3e3f-45be-ac06-191c7e69f1c3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1391 microversion: 2.1 time: 0.492907 Oct 04 18:39:40.982587 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3134/6263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:40 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1391 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:41.517829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c9f2bb20-ba32-4c48-806f-e29543c9d363 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:41.519958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c9f2bb20-ba32-4c48-806f-e29543c9d363 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:41.534373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9f2bb20-ba32-4c48-806f-e29543c9d363 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.535801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9f2bb20-ba32-4c48-806f-e29543c9d363 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.537161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9f2bb20-ba32-4c48-806f-e29543c9d363 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.538997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9f2bb20-ba32-4c48-806f-e29543c9d363 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.539997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9f2bb20-ba32-4c48-806f-e29543c9d363 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.541512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9f2bb20-ba32-4c48-806f-e29543c9d363 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.792092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b24441d7-9ac4-414f-b08b-74453a837037 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:41.792715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b24441d7-9ac4-414f-b08b-74453a837037 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:41.801593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24441d7-9ac4-414f-b08b-74453a837037 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.802296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24441d7-9ac4-414f-b08b-74453a837037 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.803081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24441d7-9ac4-414f-b08b-74453a837037 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.804040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24441d7-9ac4-414f-b08b-74453a837037 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.804818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24441d7-9ac4-414f-b08b-74453a837037 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.805734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b24441d7-9ac4-414f-b08b-74453a837037 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.992150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:42.033136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c9f2bb20-ba32-4c48-806f-e29543c9d363 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.042804 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c9f2bb20-ba32-4c48-806f-e29543c9d363 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1367 microversion: 2.1 time: 0.535049 Oct 04 18:39:42.055305 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3130/6264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:41 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1367 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:42.080153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-83987d99-971d-4414-b90e-d607813e6517 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:42.080996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-83987d99-971d-4414-b90e-d607813e6517 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:42.092598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83987d99-971d-4414-b90e-d607813e6517 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.093618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83987d99-971d-4414-b90e-d607813e6517 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.094266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83987d99-971d-4414-b90e-d607813e6517 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.095776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83987d99-971d-4414-b90e-d607813e6517 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.096510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83987d99-971d-4414-b90e-d607813e6517 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.097454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83987d99-971d-4414-b90e-d607813e6517 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.138470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b24441d7-9ac4-414f-b08b-74453a837037 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.174137 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b24441d7-9ac4-414f-b08b-74453a837037 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.379105 Oct 04 18:39:42.174137 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3135/6265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:41 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:42.651177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-83987d99-971d-4414-b90e-d607813e6517 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.675071 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-83987d99-971d-4414-b90e-d607813e6517 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1391 microversion: 2.1 time: 0.616278 Oct 04 18:39:42.676774 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3131/6266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:42 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1391 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:43.071620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-26dda209-964a-4178-b60f-3c80ce343a42 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:43.073032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-26dda209-964a-4178-b60f-3c80ce343a42 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:43.084010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=18 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:43.101049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dda209-964a-4178-b60f-3c80ce343a42 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.101620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dda209-964a-4178-b60f-3c80ce343a42 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.102330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dda209-964a-4178-b60f-3c80ce343a42 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.103488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dda209-964a-4178-b60f-3c80ce343a42 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.104225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dda209-964a-4178-b60f-3c80ce343a42 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.104874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-26dda209-964a-4178-b60f-3c80ce343a42 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.226544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-48aa9dc1-727d-4c38-a51d-d675bf31de9e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:43.228204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-48aa9dc1-727d-4c38-a51d-d675bf31de9e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:43.240686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48aa9dc1-727d-4c38-a51d-d675bf31de9e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.242064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48aa9dc1-727d-4c38-a51d-d675bf31de9e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.243266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48aa9dc1-727d-4c38-a51d-d675bf31de9e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.245332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48aa9dc1-727d-4c38-a51d-d675bf31de9e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.246404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48aa9dc1-727d-4c38-a51d-d675bf31de9e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.248004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48aa9dc1-727d-4c38-a51d-d675bf31de9e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.734072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-48aa9dc1-727d-4c38-a51d-d675bf31de9e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:43.752044 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-48aa9dc1-727d-4c38-a51d-d675bf31de9e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.527284 Oct 04 18:39:43.752983 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3132/6267] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:43 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:43.758277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d4d8d2e-acc1-4a0a-9de3-012069ad21d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:43.762677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d4d8d2e-acc1-4a0a-9de3-012069ad21d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:43.776888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d4d8d2e-acc1-4a0a-9de3-012069ad21d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.779622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d4d8d2e-acc1-4a0a-9de3-012069ad21d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.780306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d4d8d2e-acc1-4a0a-9de3-012069ad21d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.781115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d4d8d2e-acc1-4a0a-9de3-012069ad21d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.781590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d4d8d2e-acc1-4a0a-9de3-012069ad21d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.782028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d4d8d2e-acc1-4a0a-9de3-012069ad21d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.838914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:43.979491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-26dda209-964a-4178-b60f-3c80ce343a42 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.016714 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-26dda209-964a-4178-b60f-3c80ce343a42 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1367 microversion: 2.1 time: 0.943420 Oct 04 18:39:44.038822 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3136/6268] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:43 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1367 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:44.444183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2d4d8d2e-acc1-4a0a-9de3-012069ad21d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.476081 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2d4d8d2e-acc1-4a0a-9de3-012069ad21d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1391 microversion: 2.1 time: 0.721439 Oct 04 18:39:44.479876 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3133/6269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:43 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1391 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:44.795158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e75a3a98-d5aa-4fec-bd63-b1fa13b609ef tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:44.801250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e75a3a98-d5aa-4fec-bd63-b1fa13b609ef tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:44.839897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e75a3a98-d5aa-4fec-bd63-b1fa13b609ef tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.840957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e75a3a98-d5aa-4fec-bd63-b1fa13b609ef tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.841791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e75a3a98-d5aa-4fec-bd63-b1fa13b609ef tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.845423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e75a3a98-d5aa-4fec-bd63-b1fa13b609ef tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.846013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e75a3a98-d5aa-4fec-bd63-b1fa13b609ef tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.846605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e75a3a98-d5aa-4fec-bd63-b1fa13b609ef tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.066199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8bba91b0-ed65-473a-b4d1-0d2e66023137 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:45.067445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8bba91b0-ed65-473a-b4d1-0d2e66023137 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:45.080949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bba91b0-ed65-473a-b4d1-0d2e66023137 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.083108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bba91b0-ed65-473a-b4d1-0d2e66023137 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.084361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bba91b0-ed65-473a-b4d1-0d2e66023137 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.087507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bba91b0-ed65-473a-b4d1-0d2e66023137 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.089492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bba91b0-ed65-473a-b4d1-0d2e66023137 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.090694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bba91b0-ed65-473a-b4d1-0d2e66023137 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.317787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e75a3a98-d5aa-4fec-bd63-b1fa13b609ef tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.338210 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e75a3a98-d5aa-4fec-bd63-b1fa13b609ef tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.552456 Oct 04 18:39:45.339247 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3137/6270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:44 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:45.522881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ca5dd8c8-1707-42d8-93e5-30dc80742ffd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:45.524164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ca5dd8c8-1707-42d8-93e5-30dc80742ffd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:45.524522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8bba91b0-ed65-473a-b4d1-0d2e66023137 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.555541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca5dd8c8-1707-42d8-93e5-30dc80742ffd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.556658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca5dd8c8-1707-42d8-93e5-30dc80742ffd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.557714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca5dd8c8-1707-42d8-93e5-30dc80742ffd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.560556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca5dd8c8-1707-42d8-93e5-30dc80742ffd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.561162 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8bba91b0-ed65-473a-b4d1-0d2e66023137 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1367 microversion: 2.1 time: 0.501159 Oct 04 18:39:45.561848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca5dd8c8-1707-42d8-93e5-30dc80742ffd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.562789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ca5dd8c8-1707-42d8-93e5-30dc80742ffd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.562902 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3134/6271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:45 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1367 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:46.492543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ca5dd8c8-1707-42d8-93e5-30dc80742ffd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.507978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-22190085-e6a1-40ef-b51c-20f41f2fb1bd req-9703ebed-ddc0-4f4a-a23d-f6f3d016d022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "name": "network-vif-plugged", "status": "completed", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:46.520456 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ca5dd8c8-1707-42d8-93e5-30dc80742ffd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1391 microversion: 2.1 time: 1.003241 Oct 04 18:39:46.526799 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3138/6272] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:45 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1391 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:46.537357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-22190085-e6a1-40ef-b51c-20f41f2fb1bd req-9703ebed-ddc0-4f4a-a23d-f6f3d016d022 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.539713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aa79f1ac-c31d-49f3-ac72-d9f4647bdf02 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.540611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-22190085-e6a1-40ef-b51c-20f41f2fb1bd req-9703ebed-ddc0-4f4a-a23d-f6f3d016d022 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.541686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aa79f1ac-c31d-49f3-ac72-d9f4647bdf02 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.542588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-22190085-e6a1-40ef-b51c-20f41f2fb1bd req-9703ebed-ddc0-4f4a-a23d-f6f3d016d022 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.570544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa79f1ac-c31d-49f3-ac72-d9f4647bdf02 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.573272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa79f1ac-c31d-49f3-ac72-d9f4647bdf02 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.574240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa79f1ac-c31d-49f3-ac72-d9f4647bdf02 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.575901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa79f1ac-c31d-49f3-ac72-d9f4647bdf02 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.578841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa79f1ac-c31d-49f3-ac72-d9f4647bdf02 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.581756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa79f1ac-c31d-49f3-ac72-d9f4647bdf02 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.590411 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-22190085-e6a1-40ef-b51c-20f41f2fb1bd req-9703ebed-ddc0-4f4a-a23d-f6f3d016d022 service nova] Creating event network-vif-plugged:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h2-850499-14 Oct 04 18:39:46.605305 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-22190085-e6a1-40ef-b51c-20f41f2fb1bd req-9703ebed-ddc0-4f4a-a23d-f6f3d016d022 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309441 Oct 04 18:39:46.606993 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3135/6273] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:46.623611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-912d897d-a275-4835-809c-20262b3e4c9b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.625146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-912d897d-a275-4835-809c-20262b3e4c9b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.640442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-912d897d-a275-4835-809c-20262b3e4c9b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.649689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-912d897d-a275-4835-809c-20262b3e4c9b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.651295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-912d897d-a275-4835-809c-20262b3e4c9b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.652770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-912d897d-a275-4835-809c-20262b3e4c9b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.653608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-912d897d-a275-4835-809c-20262b3e4c9b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.654323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-912d897d-a275-4835-809c-20262b3e4c9b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.040272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-912d897d-a275-4835-809c-20262b3e4c9b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.054003 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-912d897d-a275-4835-809c-20262b3e4c9b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1367 microversion: 2.1 time: 0.442713 Oct 04 18:39:47.055554 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3136/6274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1367 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:47.134803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa79f1ac-c31d-49f3-ac72-d9f4647bdf02 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.175539 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aa79f1ac-c31d-49f3-ac72-d9f4647bdf02 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.644354 Oct 04 18:39:47.185186 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3139/6275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:47.565386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bfe6ac97-5bb6-46c6-b5ed-9dab9bee1ba4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.566474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bfe6ac97-5bb6-46c6-b5ed-9dab9bee1ba4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.575603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe6ac97-5bb6-46c6-b5ed-9dab9bee1ba4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.576372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe6ac97-5bb6-46c6-b5ed-9dab9bee1ba4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.577006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe6ac97-5bb6-46c6-b5ed-9dab9bee1ba4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.577907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe6ac97-5bb6-46c6-b5ed-9dab9bee1ba4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.579096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe6ac97-5bb6-46c6-b5ed-9dab9bee1ba4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.579703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bfe6ac97-5bb6-46c6-b5ed-9dab9bee1ba4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.798570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bfe6ac97-5bb6-46c6-b5ed-9dab9bee1ba4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.813350 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bfe6ac97-5bb6-46c6-b5ed-9dab9bee1ba4 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1391 microversion: 2.1 time: 0.255711 Oct 04 18:39:47.827904 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3137/6276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1391 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:48.096929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8a65647f-fbbc-46df-b2e5-1e15f26e3017 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.097973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8a65647f-fbbc-46df-b2e5-1e15f26e3017 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.106747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a65647f-fbbc-46df-b2e5-1e15f26e3017 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.107697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a65647f-fbbc-46df-b2e5-1e15f26e3017 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.108207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a65647f-fbbc-46df-b2e5-1e15f26e3017 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.109137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a65647f-fbbc-46df-b2e5-1e15f26e3017 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.110018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a65647f-fbbc-46df-b2e5-1e15f26e3017 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.110579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8a65647f-fbbc-46df-b2e5-1e15f26e3017 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.203304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cb7de1bc-88df-4ef8-b0f3-4169e10d1816 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.204386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cb7de1bc-88df-4ef8-b0f3-4169e10d1816 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.216593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb7de1bc-88df-4ef8-b0f3-4169e10d1816 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.218600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb7de1bc-88df-4ef8-b0f3-4169e10d1816 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.219381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb7de1bc-88df-4ef8-b0f3-4169e10d1816 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.220379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb7de1bc-88df-4ef8-b0f3-4169e10d1816 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.221087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb7de1bc-88df-4ef8-b0f3-4169e10d1816 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.221742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb7de1bc-88df-4ef8-b0f3-4169e10d1816 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.486629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cb7de1bc-88df-4ef8-b0f3-4169e10d1816 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:48.505558 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cb7de1bc-88df-4ef8-b0f3-4169e10d1816 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.305776 Oct 04 18:39:48.528355 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3138/6277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:48 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:48.553578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8a65647f-fbbc-46df-b2e5-1e15f26e3017 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:48.570083 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8a65647f-fbbc-46df-b2e5-1e15f26e3017 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1367 microversion: 2.1 time: 0.478853 Oct 04 18:39:48.580980 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3140/6278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:48 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:48.853370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0f7f5f43-5311-4a4f-97e0-10c4a020b543 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.854774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0f7f5f43-5311-4a4f-97e0-10c4a020b543 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.880044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7f5f43-5311-4a4f-97e0-10c4a020b543 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.889932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7f5f43-5311-4a4f-97e0-10c4a020b543 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.891483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7f5f43-5311-4a4f-97e0-10c4a020b543 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.896404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7f5f43-5311-4a4f-97e0-10c4a020b543 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.899092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7f5f43-5311-4a4f-97e0-10c4a020b543 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.900662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0f7f5f43-5311-4a4f-97e0-10c4a020b543 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.350575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0f7f5f43-5311-4a4f-97e0-10c4a020b543 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.360110 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0f7f5f43-5311-4a4f-97e0-10c4a020b543 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1563 microversion: 2.1 time: 0.511059 Oct 04 18:39:49.392089 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3139/6279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:48 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1563 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:49.392512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-792dcbf4-149b-4935-904b-bbb127fd64f7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:49.394574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-792dcbf4-149b-4935-904b-bbb127fd64f7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:49.406468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792dcbf4-149b-4935-904b-bbb127fd64f7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.407019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792dcbf4-149b-4935-904b-bbb127fd64f7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.407617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792dcbf4-149b-4935-904b-bbb127fd64f7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.408178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792dcbf4-149b-4935-904b-bbb127fd64f7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.408645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792dcbf4-149b-4935-904b-bbb127fd64f7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.409227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-792dcbf4-149b-4935-904b-bbb127fd64f7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.550165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c4f270c0-c465-458d-a9cd-43c6e68f8472 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:49.551573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c4f270c0-c465-458d-a9cd-43c6e68f8472 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:49.575330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4f270c0-c465-458d-a9cd-43c6e68f8472 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.576576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4f270c0-c465-458d-a9cd-43c6e68f8472 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.577562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4f270c0-c465-458d-a9cd-43c6e68f8472 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.579038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4f270c0-c465-458d-a9cd-43c6e68f8472 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.580189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4f270c0-c465-458d-a9cd-43c6e68f8472 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.581177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4f270c0-c465-458d-a9cd-43c6e68f8472 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.225952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-792dcbf4-149b-4935-904b-bbb127fd64f7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.235768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c4f270c0-c465-458d-a9cd-43c6e68f8472 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.256738 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c4f270c0-c465-458d-a9cd-43c6e68f8472 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.714164 Oct 04 18:39:50.257676 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3140/6280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:49 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:50.277602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9f38b87f-2258-4e33-ada5-c35d82cd85a4 req-b578c8f2-0680-4ade-9920-3bac1afd5f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69d2dd6-96aa-4c44-b185-7b4609015b82", "name": "network-vif-plugged", "status": "completed", "tag": "215c1580-df9e-41c5-a417-09c1eb2e13e3"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:50.303162 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-792dcbf4-149b-4935-904b-bbb127fd64f7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1563 microversion: 2.1 time: 0.919657 Oct 04 18:39:50.304748 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3141/6281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:49 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1563 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:50.308548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9f38b87f-2258-4e33-ada5-c35d82cd85a4 req-b578c8f2-0680-4ade-9920-3bac1afd5f07 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.309431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9f38b87f-2258-4e33-ada5-c35d82cd85a4 req-b578c8f2-0680-4ade-9920-3bac1afd5f07 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.316148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9f38b87f-2258-4e33-ada5-c35d82cd85a4 req-b578c8f2-0680-4ade-9920-3bac1afd5f07 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.316741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-32d84ef8-2373-4686-8784-a574d0044812 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.318084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-32d84ef8-2373-4686-8784-a574d0044812 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.337740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32d84ef8-2373-4686-8784-a574d0044812 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.339696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32d84ef8-2373-4686-8784-a574d0044812 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.340982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32d84ef8-2373-4686-8784-a574d0044812 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.365159 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9f38b87f-2258-4e33-ada5-c35d82cd85a4 req-b578c8f2-0680-4ade-9920-3bac1afd5f07 service nova] Creating event network-vif-plugged:215c1580-df9e-41c5-a417-09c1eb2e13e3 for instance b69d2dd6-96aa-4c44-b185-7b4609015b82 on n-h2-850499-14 Oct 04 18:39:50.374127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32d84ef8-2373-4686-8784-a574d0044812 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.377795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32d84ef8-2373-4686-8784-a574d0044812 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.380645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32d84ef8-2373-4686-8784-a574d0044812 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.411465 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9f38b87f-2258-4e33-ada5-c35d82cd85a4 req-b578c8f2-0680-4ade-9920-3bac1afd5f07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142582 Oct 04 18:39:50.412485 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3141/6282] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:50.473196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:50.781861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-32d84ef8-2373-4686-8784-a574d0044812 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.794872 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-32d84ef8-2373-4686-8784-a574d0044812 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1367 microversion: 2.1 time: 0.488121 Oct 04 18:39:50.796124 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3142/6283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:51.320363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a963fc4a-4c8f-4ec0-b62a-f64c8c9a2a42 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.323329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a963fc4a-4c8f-4ec0-b62a-f64c8c9a2a42 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:51.345672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a963fc4a-4c8f-4ec0-b62a-f64c8c9a2a42 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.352052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a963fc4a-4c8f-4ec0-b62a-f64c8c9a2a42 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.366489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a963fc4a-4c8f-4ec0-b62a-f64c8c9a2a42 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.368194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a963fc4a-4c8f-4ec0-b62a-f64c8c9a2a42 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.369321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a963fc4a-4c8f-4ec0-b62a-f64c8c9a2a42 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.370365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a963fc4a-4c8f-4ec0-b62a-f64c8c9a2a42 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.834376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-270a6465-226b-46c8-997f-9040c5f8bf2c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.836640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-270a6465-226b-46c8-997f-9040c5f8bf2c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:51.843284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a963fc4a-4c8f-4ec0-b62a-f64c8c9a2a42 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.849412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-270a6465-226b-46c8-997f-9040c5f8bf2c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.850569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-270a6465-226b-46c8-997f-9040c5f8bf2c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.851957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-270a6465-226b-46c8-997f-9040c5f8bf2c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.854041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-270a6465-226b-46c8-997f-9040c5f8bf2c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.855091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-270a6465-226b-46c8-997f-9040c5f8bf2c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.856099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-270a6465-226b-46c8-997f-9040c5f8bf2c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.871919 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a963fc4a-4c8f-4ec0-b62a-f64c8c9a2a42 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1319 microversion: 2.1 time: 0.564249 Oct 04 18:39:51.876621 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3142/6284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:52.218234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-270a6465-226b-46c8-997f-9040c5f8bf2c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.281946 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-270a6465-226b-46c8-997f-9040c5f8bf2c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1367 microversion: 2.1 time: 0.454672 Oct 04 18:39:52.288510 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3143/6285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:52.471476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ff06c16e-c88b-4502-ac16-3e74576e012e req-81ef3a59-955f-4420-ba91-6fd51efb2e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4162df75-55ee-43e5-8672-424dc3bb690b", "name": "network-vif-plugged", "status": "completed", "tag": "b8f91a23-8447-40ee-a860-833611fb796f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:52.516024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ff06c16e-c88b-4502-ac16-3e74576e012e req-81ef3a59-955f-4420-ba91-6fd51efb2e37 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.516890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ff06c16e-c88b-4502-ac16-3e74576e012e req-81ef3a59-955f-4420-ba91-6fd51efb2e37 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.517685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ff06c16e-c88b-4502-ac16-3e74576e012e req-81ef3a59-955f-4420-ba91-6fd51efb2e37 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.559777 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ff06c16e-c88b-4502-ac16-3e74576e012e req-81ef3a59-955f-4420-ba91-6fd51efb2e37 service nova] Creating event network-vif-plugged:b8f91a23-8447-40ee-a860-833611fb796f for instance 4162df75-55ee-43e5-8672-424dc3bb690b on n-h1-850499-14 Oct 04 18:39:52.565657 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ff06c16e-c88b-4502-ac16-3e74576e012e req-81ef3a59-955f-4420-ba91-6fd51efb2e37 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099461 Oct 04 18:39:52.566726 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3143/6286] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:52.917967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ed410a2a-7366-4354-b9ae-60559eda3e68 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.919950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ed410a2a-7366-4354-b9ae-60559eda3e68 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.932813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed410a2a-7366-4354-b9ae-60559eda3e68 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.933611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed410a2a-7366-4354-b9ae-60559eda3e68 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.934242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed410a2a-7366-4354-b9ae-60559eda3e68 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.935510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed410a2a-7366-4354-b9ae-60559eda3e68 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.936520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed410a2a-7366-4354-b9ae-60559eda3e68 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.937529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed410a2a-7366-4354-b9ae-60559eda3e68 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.327704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e0674a0-0fe3-4f32-8523-44a86c2ec05a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.329320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e0674a0-0fe3-4f32-8523-44a86c2ec05a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.349183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e0674a0-0fe3-4f32-8523-44a86c2ec05a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.350541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e0674a0-0fe3-4f32-8523-44a86c2ec05a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.352073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e0674a0-0fe3-4f32-8523-44a86c2ec05a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.354666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e0674a0-0fe3-4f32-8523-44a86c2ec05a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.355859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e0674a0-0fe3-4f32-8523-44a86c2ec05a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.356925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e0674a0-0fe3-4f32-8523-44a86c2ec05a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.399590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ed410a2a-7366-4354-b9ae-60559eda3e68 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.415355 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ed410a2a-7366-4354-b9ae-60559eda3e68 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1508 microversion: 2.1 time: 0.505695 Oct 04 18:39:53.416989 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3144/6287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1508 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:53.883728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7e0674a0-0fe3-4f32-8523-44a86c2ec05a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.913610 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e0674a0-0fe3-4f32-8523-44a86c2ec05a tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1367 microversion: 2.1 time: 0.591568 Oct 04 18:39:53.921172 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3144/6288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1367 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:54.759066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d2db022-1323-4c91-8fe4-4a7f62f6b9b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.760601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8d2db022-1323-4c91-8fe4-4a7f62f6b9b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.797650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ecdff6f8-7b12-4e9d-8a79-2f75b0099b92 req-75c7b3cb-ff2f-45e6-91df-7bd532a649db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:54.817557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d2db022-1323-4c91-8fe4-4a7f62f6b9b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.821082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d2db022-1323-4c91-8fe4-4a7f62f6b9b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.821761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d2db022-1323-4c91-8fe4-4a7f62f6b9b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.827747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d2db022-1323-4c91-8fe4-4a7f62f6b9b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.830208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d2db022-1323-4c91-8fe4-4a7f62f6b9b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.831812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d2db022-1323-4c91-8fe4-4a7f62f6b9b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.843207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ecdff6f8-7b12-4e9d-8a79-2f75b0099b92 req-75c7b3cb-ff2f-45e6-91df-7bd532a649db service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.844033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ecdff6f8-7b12-4e9d-8a79-2f75b0099b92 req-75c7b3cb-ff2f-45e6-91df-7bd532a649db service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.845630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ecdff6f8-7b12-4e9d-8a79-2f75b0099b92 req-75c7b3cb-ff2f-45e6-91df-7bd532a649db service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.882354 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ecdff6f8-7b12-4e9d-8a79-2f75b0099b92 req-75c7b3cb-ff2f-45e6-91df-7bd532a649db service nova] Creating event network-changed:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h2-850499-14 Oct 04 18:39:54.901120 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ecdff6f8-7b12-4e9d-8a79-2f75b0099b92 req-75c7b3cb-ff2f-45e6-91df-7bd532a649db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108442 Oct 04 18:39:54.902212 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3145/6289] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 18:39:54.962434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d12bc1b5-ed08-4a0f-9231-c93b8bc97944 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.963772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d12bc1b5-ed08-4a0f-9231-c93b8bc97944 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.987865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12bc1b5-ed08-4a0f-9231-c93b8bc97944 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.988390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12bc1b5-ed08-4a0f-9231-c93b8bc97944 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.989493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12bc1b5-ed08-4a0f-9231-c93b8bc97944 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.990248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12bc1b5-ed08-4a0f-9231-c93b8bc97944 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.990717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12bc1b5-ed08-4a0f-9231-c93b8bc97944 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.991171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d12bc1b5-ed08-4a0f-9231-c93b8bc97944 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.656578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d12bc1b5-ed08-4a0f-9231-c93b8bc97944 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.677421 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d12bc1b5-ed08-4a0f-9231-c93b8bc97944 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1557 microversion: 2.1 time: 0.721849 Oct 04 18:39:55.683824 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3146/6290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1557 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:55.685125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d2db022-1323-4c91-8fe4-4a7f62f6b9b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.705578 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8d2db022-1323-4c91-8fe4-4a7f62f6b9b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1563 microversion: 2.1 time: 0.953303 Oct 04 18:39:55.717978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0e1d9cfb-a4a8-4944-94c2-ffdd37a1c3d6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:55.718866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0e1d9cfb-a4a8-4944-94c2-ffdd37a1c3d6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.728156 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3145/6291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1563 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:55.731629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1d9cfb-a4a8-4944-94c2-ffdd37a1c3d6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.735874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1d9cfb-a4a8-4944-94c2-ffdd37a1c3d6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.738329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1d9cfb-a4a8-4944-94c2-ffdd37a1c3d6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.739392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1d9cfb-a4a8-4944-94c2-ffdd37a1c3d6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.742940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1d9cfb-a4a8-4944-94c2-ffdd37a1c3d6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.743781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1d9cfb-a4a8-4944-94c2-ffdd37a1c3d6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.976261 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0e1d9cfb-a4a8-4944-94c2-ffdd37a1c3d6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.263144 Oct 04 18:39:55.977212 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3147/6292] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 18:39:55 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-interface => generated 285 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:59.013512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-002c2a45-ffe3-4287-9338-643366b8b3b2 req-06eb53c3-3714-49fc-b103-3faeff1fd0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4162df75-55ee-43e5-8672-424dc3bb690b", "tag": "b8f91a23-8447-40ee-a860-833611fb796f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:59.033803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-002c2a45-ffe3-4287-9338-643366b8b3b2 req-06eb53c3-3714-49fc-b103-3faeff1fd0b5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.034676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-002c2a45-ffe3-4287-9338-643366b8b3b2 req-06eb53c3-3714-49fc-b103-3faeff1fd0b5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.035348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-002c2a45-ffe3-4287-9338-643366b8b3b2 req-06eb53c3-3714-49fc-b103-3faeff1fd0b5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.085666 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-002c2a45-ffe3-4287-9338-643366b8b3b2 req-06eb53c3-3714-49fc-b103-3faeff1fd0b5 service nova] Creating event network-changed:b8f91a23-8447-40ee-a860-833611fb796f for instance 4162df75-55ee-43e5-8672-424dc3bb690b on n-h1-850499-14 Oct 04 18:39:59.099883 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-002c2a45-ffe3-4287-9338-643366b8b3b2 req-06eb53c3-3714-49fc-b103-3faeff1fd0b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096997 Oct 04 18:39:59.100513 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3146/6293] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:40:23.598625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=63 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:23.600171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=68 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:23.607968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f95ac5e5-6739-4508-879d-356bf11d5b36 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7357022-e214-4903-8f68-1579f4882f31", "device": "/dev/sdb"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:23.613729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f95ac5e5-6739-4508-879d-356bf11d5b36 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.624623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f95ac5e5-6739-4508-879d-356bf11d5b36 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.625202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f95ac5e5-6739-4508-879d-356bf11d5b36 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.625988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f95ac5e5-6739-4508-879d-356bf11d5b36 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.627202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f95ac5e5-6739-4508-879d-356bf11d5b36 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.627896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f95ac5e5-6739-4508-879d-356bf11d5b36 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.628750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f95ac5e5-6739-4508-879d-356bf11d5b36 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.989247 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f95ac5e5-6739-4508-879d-356bf11d5b36 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "POST /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393686 Oct 04 18:40:23.990184 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3148/6294] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:40:23 2022] POST /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:33.689298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=35 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:33.691214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=22 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:33.698347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a9f3721a-d93f-48e9-9723-cf18008a77a8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.699623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a9f3721a-d93f-48e9-9723-cf18008a77a8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:33.708534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f3721a-d93f-48e9-9723-cf18008a77a8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.709353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f3721a-d93f-48e9-9723-cf18008a77a8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.710880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f3721a-d93f-48e9-9723-cf18008a77a8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.712089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f3721a-d93f-48e9-9723-cf18008a77a8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.713414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f3721a-d93f-48e9-9723-cf18008a77a8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.714083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f3721a-d93f-48e9-9723-cf18008a77a8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.746405 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a9f3721a-d93f-48e9-9723-cf18008a77a8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/ips" status: 200 len: 150 microversion: 2.1 time: 0.060506 Oct 04 18:40:33.747034 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3147/6295] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/ips => generated 150 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:40:35.414975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:35.417939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:35.426176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03f442e9-b501-4e52-963a-d36f9f36a2c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f679b0d0-a13c-446f-8534-d444ee02e98e"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:35.433202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-03f442e9-b501-4e52-963a-d36f9f36a2c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:35.445352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03f442e9-b501-4e52-963a-d36f9f36a2c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.446721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03f442e9-b501-4e52-963a-d36f9f36a2c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.447806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03f442e9-b501-4e52-963a-d36f9f36a2c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.449464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03f442e9-b501-4e52-963a-d36f9f36a2c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.451260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03f442e9-b501-4e52-963a-d36f9f36a2c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.452516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-03f442e9-b501-4e52-963a-d36f9f36a2c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.598829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf8c125f-8927-4d4e-845f-665065ac8a53 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:35.606977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf8c125f-8927-4d4e-845f-665065ac8a53 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:35.618006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf8c125f-8927-4d4e-845f-665065ac8a53 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.619255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf8c125f-8927-4d4e-845f-665065ac8a53 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.619963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf8c125f-8927-4d4e-845f-665065ac8a53 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.620912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf8c125f-8927-4d4e-845f-665065ac8a53 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.621609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf8c125f-8927-4d4e-845f-665065ac8a53 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.622259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf8c125f-8927-4d4e-845f-665065ac8a53 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.718624 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf8c125f-8927-4d4e-845f-665065ac8a53 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action" status: 200 len: 24569 microversion: 2.1 time: 0.121365 Oct 04 18:40:35.720316 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3148/6296] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:35 2022] POST /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action => generated 24569 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:40:35.873968 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-03f442e9-b501-4e52-963a-d36f9f36a2c3 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "POST /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461540 Oct 04 18:40:35.875872 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3149/6297] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:40:35 2022] POST /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:49.423922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ec62789-7e75-4ea3-8f3f-2b38caed4e38 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.424520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9ec62789-7e75-4ea3-8f3f-2b38caed4e38 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:49.434429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:49.436610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:49.438614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ec62789-7e75-4ea3-8f3f-2b38caed4e38 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.439473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ec62789-7e75-4ea3-8f3f-2b38caed4e38 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.440706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ec62789-7e75-4ea3-8f3f-2b38caed4e38 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.441601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ec62789-7e75-4ea3-8f3f-2b38caed4e38 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.442411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ec62789-7e75-4ea3-8f3f-2b38caed4e38 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.443028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9ec62789-7e75-4ea3-8f3f-2b38caed4e38 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.617070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-9ec62789-7e75-4ea3-8f3f-2b38caed4e38 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lazy-loading 'services' on Instance uuid 4162df75-55ee-43e5-8672-424dc3bb690b {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:49.714682 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ec62789-7e75-4ea3-8f3f-2b38caed4e38 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments/f679b0d0-a13c-446f-8534-d444ee02e98e" status: 202 len: 0 microversion: 2.1 time: 0.294466 Oct 04 18:40:49.716337 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3149/6298] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:40:49 2022] DELETE /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments/f679b0d0-a13c-446f-8534-d444ee02e98e => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:49.726243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cfbd5151-ddc6-4e19-89bb-903398ebdc8e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.728682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cfbd5151-ddc6-4e19-89bb-903398ebdc8e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:49.740890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:49.742423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:49.746783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbd5151-ddc6-4e19-89bb-903398ebdc8e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.748356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbd5151-ddc6-4e19-89bb-903398ebdc8e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.750059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbd5151-ddc6-4e19-89bb-903398ebdc8e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.751913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbd5151-ddc6-4e19-89bb-903398ebdc8e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.753917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbd5151-ddc6-4e19-89bb-903398ebdc8e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.755310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cfbd5151-ddc6-4e19-89bb-903398ebdc8e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.877440 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cfbd5151-ddc6-4e19-89bb-903398ebdc8e tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154264 Oct 04 18:40:49.878299 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3150/6299] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:40:49 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:40:50.895602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-59bccf3d-cd1f-4dd2-845b-0443c2fd2936 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:50.898726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-59bccf3d-cd1f-4dd2-845b-0443c2fd2936 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:50.908556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59bccf3d-cd1f-4dd2-845b-0443c2fd2936 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.909312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59bccf3d-cd1f-4dd2-845b-0443c2fd2936 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.909926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59bccf3d-cd1f-4dd2-845b-0443c2fd2936 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.910891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59bccf3d-cd1f-4dd2-845b-0443c2fd2936 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.912049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59bccf3d-cd1f-4dd2-845b-0443c2fd2936 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.912739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59bccf3d-cd1f-4dd2-845b-0443c2fd2936 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.960525 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-59bccf3d-cd1f-4dd2-845b-0443c2fd2936 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071373 Oct 04 18:40:50.961916 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3150/6300] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:40:50 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:51.991101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de674c55-6cc2-41e7-9d92-8e8f47dd87ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:51.995172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-de674c55-6cc2-41e7-9d92-8e8f47dd87ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.004026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de674c55-6cc2-41e7-9d92-8e8f47dd87ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.005036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de674c55-6cc2-41e7-9d92-8e8f47dd87ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.005718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de674c55-6cc2-41e7-9d92-8e8f47dd87ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.006841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de674c55-6cc2-41e7-9d92-8e8f47dd87ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.007769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de674c55-6cc2-41e7-9d92-8e8f47dd87ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.008475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de674c55-6cc2-41e7-9d92-8e8f47dd87ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.047596 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de674c55-6cc2-41e7-9d92-8e8f47dd87ba tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077809 Oct 04 18:40:52.048866 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3151/6301] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:40:51 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:52.777325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21c2da25-8e55-4cb1-b4d2-6e21ac2d668c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:52.778094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21c2da25-8e55-4cb1-b4d2-6e21ac2d668c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.786117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c2da25-8e55-4cb1-b4d2-6e21ac2d668c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.786836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c2da25-8e55-4cb1-b4d2-6e21ac2d668c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.787387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c2da25-8e55-4cb1-b4d2-6e21ac2d668c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.788573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c2da25-8e55-4cb1-b4d2-6e21ac2d668c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.789291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c2da25-8e55-4cb1-b4d2-6e21ac2d668c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.789990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c2da25-8e55-4cb1-b4d2-6e21ac2d668c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.937696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-21c2da25-8e55-4cb1-b4d2-6e21ac2d668c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lazy-loading 'services' on Instance uuid b69d2dd6-96aa-4c44-b185-7b4609015b82 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:53.063230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e966dda-8cf2-47a2-9b00-518d26a32ad7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:53.066108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7e966dda-8cf2-47a2-9b00-518d26a32ad7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:53.074271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e966dda-8cf2-47a2-9b00-518d26a32ad7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.075044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e966dda-8cf2-47a2-9b00-518d26a32ad7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.075809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e966dda-8cf2-47a2-9b00-518d26a32ad7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.077224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e966dda-8cf2-47a2-9b00-518d26a32ad7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.077889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e966dda-8cf2-47a2-9b00-518d26a32ad7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.078481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7e966dda-8cf2-47a2-9b00-518d26a32ad7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.079876 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21c2da25-8e55-4cb1-b4d2-6e21ac2d668c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82/os-volume_attachments/b7357022-e214-4903-8f68-1579f4882f31" status: 202 len: 0 microversion: 2.1 time: 0.309511 Oct 04 18:40:53.097036 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3151/6302] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:40:52 2022] DELETE /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82/os-volume_attachments/b7357022-e214-4903-8f68-1579f4882f31 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:53.160655 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e966dda-8cf2-47a2-9b00-518d26a32ad7 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101541 Oct 04 18:40:53.161998 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3152/6303] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:40:53 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:54.183095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17698b40-4e3a-42ff-a808-8a4bdb6488f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:54.188060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17698b40-4e3a-42ff-a808-8a4bdb6488f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:54.203146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17698b40-4e3a-42ff-a808-8a4bdb6488f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.206038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17698b40-4e3a-42ff-a808-8a4bdb6488f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.206549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17698b40-4e3a-42ff-a808-8a4bdb6488f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.207490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17698b40-4e3a-42ff-a808-8a4bdb6488f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.208120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17698b40-4e3a-42ff-a808-8a4bdb6488f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.208567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17698b40-4e3a-42ff-a808-8a4bdb6488f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.259603 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17698b40-4e3a-42ff-a808-8a4bdb6488f5 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085043 Oct 04 18:40:54.264763 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3152/6304] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:40:54 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:55.284878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bdfdc999-131d-41e7-8a8f-8ec83e6c11b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.287097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bdfdc999-131d-41e7-8a8f-8ec83e6c11b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:55.294545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bdfdc999-131d-41e7-8a8f-8ec83e6c11b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.295187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bdfdc999-131d-41e7-8a8f-8ec83e6c11b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.295646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bdfdc999-131d-41e7-8a8f-8ec83e6c11b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.296380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bdfdc999-131d-41e7-8a8f-8ec83e6c11b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.296866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bdfdc999-131d-41e7-8a8f-8ec83e6c11b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.297294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bdfdc999-131d-41e7-8a8f-8ec83e6c11b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.328934 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bdfdc999-131d-41e7-8a8f-8ec83e6c11b2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060124 Oct 04 18:40:55.329731 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3153/6305] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:56.341911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba29cb57-c8ed-491c-8008-754077b3340b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.345575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba29cb57-c8ed-491c-8008-754077b3340b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.354217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba29cb57-c8ed-491c-8008-754077b3340b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.354927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba29cb57-c8ed-491c-8008-754077b3340b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.355559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba29cb57-c8ed-491c-8008-754077b3340b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.356669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba29cb57-c8ed-491c-8008-754077b3340b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.357329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba29cb57-c8ed-491c-8008-754077b3340b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.357916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba29cb57-c8ed-491c-8008-754077b3340b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.393617 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba29cb57-c8ed-491c-8008-754077b3340b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055753 Oct 04 18:40:56.394894 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3153/6306] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 18:40:56 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:40:56.745218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e82755f9-d499-40d9-8672-e86f3fe1d1b0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.745737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e82755f9-d499-40d9-8672-e86f3fe1d1b0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.755832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e82755f9-d499-40d9-8672-e86f3fe1d1b0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.756336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e82755f9-d499-40d9-8672-e86f3fe1d1b0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.756845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e82755f9-d499-40d9-8672-e86f3fe1d1b0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.757653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e82755f9-d499-40d9-8672-e86f3fe1d1b0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.758264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e82755f9-d499-40d9-8672-e86f3fe1d1b0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.758716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e82755f9-d499-40d9-8672-e86f3fe1d1b0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.788728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e82755f9-d499-40d9-8672-e86f3fe1d1b0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:56.897223 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e82755f9-d499-40d9-8672-e86f3fe1d1b0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 204 len: 0 microversion: 2.1 time: 0.156186 Oct 04 18:40:56.900001 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3154/6307] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:56 2022] DELETE /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:56.912853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-56368663-c6e0-47ec-b887-c74daac722ec tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.914260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-56368663-c6e0-47ec-b887-c74daac722ec tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.924920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56368663-c6e0-47ec-b887-c74daac722ec tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.925443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56368663-c6e0-47ec-b887-c74daac722ec tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.926160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56368663-c6e0-47ec-b887-c74daac722ec tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.927116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56368663-c6e0-47ec-b887-c74daac722ec tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.927654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56368663-c6e0-47ec-b887-c74daac722ec tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.928204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56368663-c6e0-47ec-b887-c74daac722ec tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.123412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-56368663-c6e0-47ec-b887-c74daac722ec tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.133137 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-56368663-c6e0-47ec-b887-c74daac722ec tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1682 microversion: 2.1 time: 0.228026 Oct 04 18:40:57.135070 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3154/6308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:56 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:58.173339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70c2d1bd-2afe-4617-990c-78a3f60c9674 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:58.173991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-70c2d1bd-2afe-4617-990c-78a3f60c9674 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:58.182368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70c2d1bd-2afe-4617-990c-78a3f60c9674 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.183360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70c2d1bd-2afe-4617-990c-78a3f60c9674 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.184115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70c2d1bd-2afe-4617-990c-78a3f60c9674 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.185278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70c2d1bd-2afe-4617-990c-78a3f60c9674 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.186276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70c2d1bd-2afe-4617-990c-78a3f60c9674 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.186909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70c2d1bd-2afe-4617-990c-78a3f60c9674 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.361654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70c2d1bd-2afe-4617-990c-78a3f60c9674 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:58.371063 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70c2d1bd-2afe-4617-990c-78a3f60c9674 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1682 microversion: 2.1 time: 0.209989 Oct 04 18:40:58.372712 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3155/6309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:58 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:59.395247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f09b573b-d1e8-41d4-a352-20d5b769e1f8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:59.396058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f09b573b-d1e8-41d4-a352-20d5b769e1f8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:59.412054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09b573b-d1e8-41d4-a352-20d5b769e1f8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.412706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09b573b-d1e8-41d4-a352-20d5b769e1f8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.413273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09b573b-d1e8-41d4-a352-20d5b769e1f8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.414086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09b573b-d1e8-41d4-a352-20d5b769e1f8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.414669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09b573b-d1e8-41d4-a352-20d5b769e1f8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.415282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f09b573b-d1e8-41d4-a352-20d5b769e1f8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.596717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f09b573b-d1e8-41d4-a352-20d5b769e1f8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:59.607698 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f09b573b-d1e8-41d4-a352-20d5b769e1f8 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1615 microversion: 2.1 time: 0.216352 Oct 04 18:40:59.623381 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3155/6310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:59 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1615 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:59.940341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e42f380c-7ce4-4f34-8726-49eee665a514 req-6ec56702-a391-40bd-8986-05ef15a5d132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4162df75-55ee-43e5-8672-424dc3bb690b", "name": "network-vif-deleted", "tag": "b8f91a23-8447-40ee-a860-833611fb796f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:59.961560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e42f380c-7ce4-4f34-8726-49eee665a514 req-6ec56702-a391-40bd-8986-05ef15a5d132 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.963247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e42f380c-7ce4-4f34-8726-49eee665a514 req-6ec56702-a391-40bd-8986-05ef15a5d132 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.963934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e42f380c-7ce4-4f34-8726-49eee665a514 req-6ec56702-a391-40bd-8986-05ef15a5d132 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.985711 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e42f380c-7ce4-4f34-8726-49eee665a514 req-6ec56702-a391-40bd-8986-05ef15a5d132 service nova] Creating event network-vif-deleted:b8f91a23-8447-40ee-a860-833611fb796f for instance 4162df75-55ee-43e5-8672-424dc3bb690b on n-h1-850499-14 Oct 04 18:40:59.992199 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e42f380c-7ce4-4f34-8726-49eee665a514 req-6ec56702-a391-40bd-8986-05ef15a5d132 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055712 Oct 04 18:40:59.996911 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3156/6311] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:00.635363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:00.636029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:00.651196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.651717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.652177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.672550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.675307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.677428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.803453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.804373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.805057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.805797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lazy-loading 'fault' on Instance uuid 4162df75-55ee-43e5-8672-424dc3bb690b {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:00.880232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0937bdb543864ac4bb2c6f6ea1137525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9c2474d65845eb84b608f305203297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:00.888949 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-512ff18e-8d7f-41df-a958-c906e7ad8eb6 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 200 len: 1332 microversion: 2.1 time: 0.257731 Oct 04 18:41:00.900367 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3156/6312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:00 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 1332 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:01.417564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2fb4738d-5b2c-4f9c-9fa9-37f871e00e21 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.418728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2fb4738d-5b2c-4f9c-9fa9-37f871e00e21 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:01.425615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb4738d-5b2c-4f9c-9fa9-37f871e00e21 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.426310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb4738d-5b2c-4f9c-9fa9-37f871e00e21 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.426795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb4738d-5b2c-4f9c-9fa9-37f871e00e21 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.427686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb4738d-5b2c-4f9c-9fa9-37f871e00e21 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.428145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb4738d-5b2c-4f9c-9fa9-37f871e00e21 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.428569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2fb4738d-5b2c-4f9c-9fa9-37f871e00e21 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.491355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2fb4738d-5b2c-4f9c-9fa9-37f871e00e21 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:01.607505 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2fb4738d-5b2c-4f9c-9fa9-37f871e00e21 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 204 len: 0 microversion: 2.1 time: 0.188362 Oct 04 18:41:01.613345 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3157/6313] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:01 2022] DELETE /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:01.622440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-490c23ee-409c-4847-890a-69b975a81ccf tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.626622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-490c23ee-409c-4847-890a-69b975a81ccf tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:01.633201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490c23ee-409c-4847-890a-69b975a81ccf tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.634320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490c23ee-409c-4847-890a-69b975a81ccf tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.635188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490c23ee-409c-4847-890a-69b975a81ccf tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.636105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490c23ee-409c-4847-890a-69b975a81ccf tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.637169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490c23ee-409c-4847-890a-69b975a81ccf tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.637771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-490c23ee-409c-4847-890a-69b975a81ccf tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.837918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-490c23ee-409c-4847-890a-69b975a81ccf tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:01.848924 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-490c23ee-409c-4847-890a-69b975a81ccf tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1514 microversion: 2.1 time: 0.230744 Oct 04 18:41:01.850248 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3157/6314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:01 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:01.928274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.929382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:01.937266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.937766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.938212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.938933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.939420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.940002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.955563 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b HTTP/1.1 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4162df75-55ee-43e5-8672-424dc3bb690b'} Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:01.957212 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:01.962150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:01.962150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:01.962150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:01.962150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:01.962150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:01.962150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:01.962150 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:01.962150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:01.962150 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84d753ce-f9b5-4ae3-be5f-58a860341b7c tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 404 len: 111 microversion: 2.1 time: 0.035018 Oct 04 18:41:01.962150 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3158/6315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:01 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:01.968626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1da5afb2-0441-4071-bb9c-a6728e3d8bb2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '.version_select at 0x7fd4d1d1aaf0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.990895 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1da5afb2-0441-4071-bb9c-a6728e3d8bb2 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1879502291" status: 202 len: 0 microversion: 2.1 time: 0.026705 Oct 04 18:41:01.991527 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3158/6316] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 18:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1879502291 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:02.881844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b814a44d-3553-4c8e-893c-6dd3f01aaf9b tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:02.882512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b814a44d-3553-4c8e-893c-6dd3f01aaf9b tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:02.902126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b814a44d-3553-4c8e-893c-6dd3f01aaf9b tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:02.905343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b814a44d-3553-4c8e-893c-6dd3f01aaf9b tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:02.906366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b814a44d-3553-4c8e-893c-6dd3f01aaf9b tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:02.908539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b814a44d-3553-4c8e-893c-6dd3f01aaf9b tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:02.910633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b814a44d-3553-4c8e-893c-6dd3f01aaf9b tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:02.911961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b814a44d-3553-4c8e-893c-6dd3f01aaf9b tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:03.090666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b814a44d-3553-4c8e-893c-6dd3f01aaf9b tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:03.100328 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b814a44d-3553-4c8e-893c-6dd3f01aaf9b tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1514 microversion: 2.1 time: 0.228259 Oct 04 18:41:03.100928 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3159/6317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:02 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:04.125691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4dcd2fd5-a406-47db-88c6-da8c8708f5c3 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:04.126491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4dcd2fd5-a406-47db-88c6-da8c8708f5c3 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:04.139818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dcd2fd5-a406-47db-88c6-da8c8708f5c3 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.143499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dcd2fd5-a406-47db-88c6-da8c8708f5c3 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.144262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dcd2fd5-a406-47db-88c6-da8c8708f5c3 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.146063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dcd2fd5-a406-47db-88c6-da8c8708f5c3 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.147433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dcd2fd5-a406-47db-88c6-da8c8708f5c3 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.149220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4dcd2fd5-a406-47db-88c6-da8c8708f5c3 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.405381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4dcd2fd5-a406-47db-88c6-da8c8708f5c3 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:04.415187 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4dcd2fd5-a406-47db-88c6-da8c8708f5c3 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 200 len: 1514 microversion: 2.1 time: 0.293419 Oct 04 18:41:04.443319 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3159/6318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:04 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 1514 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:04.585605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1c7ee277-42da-4d65-95d0-213e108e2c21 req-4c59ce44-5974-4456-b75f-d73ec530ede7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69d2dd6-96aa-4c44-b185-7b4609015b82", "name": "network-vif-deleted", "tag": "215c1580-df9e-41c5-a417-09c1eb2e13e3"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:04.616471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1c7ee277-42da-4d65-95d0-213e108e2c21 req-4c59ce44-5974-4456-b75f-d73ec530ede7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.617408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1c7ee277-42da-4d65-95d0-213e108e2c21 req-4c59ce44-5974-4456-b75f-d73ec530ede7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.618147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1c7ee277-42da-4d65-95d0-213e108e2c21 req-4c59ce44-5974-4456-b75f-d73ec530ede7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.631581 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1c7ee277-42da-4d65-95d0-213e108e2c21 req-4c59ce44-5974-4456-b75f-d73ec530ede7 service nova] Creating event network-vif-deleted:215c1580-df9e-41c5-a417-09c1eb2e13e3 for instance b69d2dd6-96aa-4c44-b185-7b4609015b82 on n-h2-850499-14 Oct 04 18:41:04.639453 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1c7ee277-42da-4d65-95d0-213e108e2c21 req-4c59ce44-5974-4456-b75f-d73ec530ede7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057377 Oct 04 18:41:04.640432 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3160/6319] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:05.448142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:05.450184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: b69d2dd6-96aa-4c44-b185-7b4609015b82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:05.459378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.460257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.460994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.462613 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.463457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.464122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.485477 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] HTTP exception thrown: Instance b69d2dd6-96aa-4c44-b185-7b4609015b82 could not be found. Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Request method failure captured: Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 HTTP/1.1 Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH2ERp4FrqlIVo6Bkvaj6-PK3F8jzVIhrDV9acYBitF1Ar11ZddkjG-ZV-F_Sj-XzLz8U4M0RbHy0QC9f2QzXJPmATNHpgzXTbhzKXxIbKVq_axiTI4LJzUts9FPI794R5W3VlvwiImK9PwEi49ksqeAuW_Fd_PFsK2r0r2TJkkRvmQ Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 53f5150f32c74426b300d4b1de6c0f59 Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1179290907 Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53f5150f32c74426b300d4b1de6c0f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53f5150f32c74426b300d4b1de6c0f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53f5150f32c74426b300d4b1de6c0f59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53f5150f32c74426b300d4b1de6c0f59"}]}] Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-VolumesSnapshotTestJSON-1179290907 Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 53f5150f32c74426b300d4b1de6c0f59 Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1179290907 Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-VolumesSnapshotTestJSON-1179290907-project Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: c9bc978004614940b09fa4fed432a192 Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-VolumesSnapshotTestJSON-1179290907-project Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance b69d2dd6-96aa-4c44-b185-7b4609015b82 could not be found. Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'b69d2dd6-96aa-4c44-b185-7b4609015b82'} Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69d2dd6-96aa-4c44-b185-7b4609015b82 could not be found. Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69d2dd6-96aa-4c44-b185-7b4609015b82 could not be found. Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:05.487636 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:05.492417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:05.492417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:05.492417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:05.492417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:05.492417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:05.492417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69d2dd6-96aa-4c44-b185-7b4609015b82 could not be found. Oct 04 18:41:05.492417 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:05.505799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Returning 404 to user: Instance b69d2dd6-96aa-4c44-b185-7b4609015b82 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:05.508087 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ff98dc7b-b370-4ab8-baaf-64736cdc4ede tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82" status: 404 len: 111 microversion: 2.1 time: 0.066774 Oct 04 18:41:05.515696 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3160/6320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:05 2022] GET /compute/v2.1/servers/b69d2dd6-96aa-4c44-b185-7b4609015b82 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:07.215793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:07.216986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:07.235178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.235896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.236484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.237156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.237681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.238126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.345170 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b HTTP/1.1 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4162df75-55ee-43e5-8672-424dc3bb690b'} Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:07.351200 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:07.356868 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:07.360421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:07.361511 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-46280ae5-1451-472b-923d-c5ffaae25167 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 404 len: 111 microversion: 2.1 time: 0.152038 Oct 04 18:41:07.362643 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3161/6321] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:07 2022] DELETE /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:07.376174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:07.377478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4162df75-55ee-43e5-8672-424dc3bb690b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:07.392890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.400946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.401851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.402846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.403583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.407653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.441252 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b HTTP/1.1 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '4162df75-55ee-43e5-8672-424dc3bb690b'} Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:07.443912 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:07.449011 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:07.449011 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:07.449011 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:07.449011 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:07.449011 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:07.449011 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. Oct 04 18:41:07.449011 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:07.449011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance 4162df75-55ee-43e5-8672-424dc3bb690b could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:07.449011 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9911ad82-464a-4c0a-b2e8-d4e8866d422b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b" status: 404 len: 111 microversion: 2.1 time: 0.077857 Oct 04 18:41:07.455564 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3161/6322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:07 2022] GET /compute/v2.1/servers/4162df75-55ee-43e5-8672-424dc3bb690b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:11.950438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:11.951057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:11.970515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.971045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.971491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.972217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.972678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.973106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.001029 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 HTTP/1.1 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4359baf5-e205-4f98-be2c-6a33a2ea24f4'} Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:12.002541 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:41:12.006516 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.015395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:12.016436 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10012e68-05a3-47ef-966c-647e602d3d78 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 404 len: 111 microversion: 2.1 time: 0.069994 Oct 04 18:41:12.017438 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3162/6323] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:11 2022] DELETE /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:12.026021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:12.026759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 4359baf5-e205-4f98-be2c-6a33a2ea24f4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:12.053551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.054079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.054529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.055285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.064357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.065120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.100982 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 HTTP/1.1 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '4359baf5-e205-4f98-be2c-6a33a2ea24f4'} Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:12.105221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.109516 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.109516 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:12.109516 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:12.109516 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:12.109516 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:12.109516 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. Oct 04 18:41:12.109516 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.111316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance 4359baf5-e205-4f98-be2c-6a33a2ea24f4 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:12.112544 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-463ef000-45cf-4330-8d82-3d4596a0565f tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4" status: 404 len: 111 microversion: 2.1 time: 0.091124 Oct 04 18:41:12.122060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:12.122912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:12.126425 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3162/6324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:12 2022] GET /compute/v2.1/servers/4359baf5-e205-4f98-be2c-6a33a2ea24f4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:12.144245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.145078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.145721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.146758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.147444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.148070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.179483 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 HTTP/1.1 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ca2c5fd6-c295-45b0-8050-678b4819c499'} Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:12.183529 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:41:12.187167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.189912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:12.191016 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f152f76f-2c6a-4d8c-9578-7c190d8aa81d tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 404 len: 111 microversion: 2.1 time: 0.073101 Oct 04 18:41:12.192140 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3163/6325] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:12 2022] DELETE /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:12.200619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:12.201520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: ca2c5fd6-c295-45b0-8050-678b4819c499] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:12.208557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.209461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.210124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.211063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.211708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.213145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.229372 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 HTTP/1.1 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'ca2c5fd6-c295-45b0-8050-678b4819c499'} Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:12.231241 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.234891 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:12.234891 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:12.234891 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:12.234891 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:12.234891 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:12.234891 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. Oct 04 18:41:12.234891 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:12.236917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance ca2c5fd6-c295-45b0-8050-678b4819c499 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:12.237988 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ead0512-817e-416e-a32a-2addff0dfe3b tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499" status: 404 len: 111 microversion: 2.1 time: 0.041981 Oct 04 18:41:12.239137 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3163/6326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:12 2022] GET /compute/v2.1/servers/ca2c5fd6-c295-45b0-8050-678b4819c499 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:13.898546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-447284259", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "069d1090-6778-4b8e-a236-06f9472c7dcc"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:14.225615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] validate_networks() for [('069d1090-6778-4b8e-a236-06f9472c7dcc', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:15.024531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:15.025626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:15.025945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:15.026357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:15.026774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:15.038991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.039777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.040419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:15.041357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.042341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.042986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:15.064105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Getting quotas for project 53f5150f32c74426b300d4b1de6c0f59. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:15.070558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Getting quotas for user c9bc978004614940b09fa4fed432a192 and project 53f5150f32c74426b300d4b1de6c0f59. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:15.086502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:15.089786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:15.154997 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-720d7210-7cf4-40dc-8108-4f3b885e386f tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260234 Oct 04 18:41:15.166732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7fd23813-99bb-4d20-baca-7e8438ff59e1 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:15.167301 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3164/6327] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:41:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:41:15.167656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7fd23813-99bb-4d20-baca-7e8438ff59e1 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:15.374790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7fd23813-99bb-4d20-baca-7e8438ff59e1 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:15.383458 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7fd23813-99bb-4d20-baca-7e8438ff59e1 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1218 microversion: 2.1 time: 0.220714 Oct 04 18:41:15.388653 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3164/6328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:15 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:16.412950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8fb13317-e3d6-4822-b4fb-79f3c4b793cb tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:16.413602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8fb13317-e3d6-4822-b4fb-79f3c4b793cb tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:16.420217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8fb13317-e3d6-4822-b4fb-79f3c4b793cb tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.420956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8fb13317-e3d6-4822-b4fb-79f3c4b793cb tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.421409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8fb13317-e3d6-4822-b4fb-79f3c4b793cb tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.422123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8fb13317-e3d6-4822-b4fb-79f3c4b793cb tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.422903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8fb13317-e3d6-4822-b4fb-79f3c4b793cb tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.423357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8fb13317-e3d6-4822-b4fb-79f3c4b793cb tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.504282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8fb13317-e3d6-4822-b4fb-79f3c4b793cb tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:16.519076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8fb13317-e3d6-4822-b4fb-79f3c4b793cb tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1270 microversion: 2.1 time: 0.110593 Oct 04 18:41:16.519962 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3165/6329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:16 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:17.544741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-850e40d3-1350-4e9f-b4e2-6bb71346e01c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:17.545379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-850e40d3-1350-4e9f-b4e2-6bb71346e01c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:17.556207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-850e40d3-1350-4e9f-b4e2-6bb71346e01c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:17.567249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-850e40d3-1350-4e9f-b4e2-6bb71346e01c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:17.567714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-850e40d3-1350-4e9f-b4e2-6bb71346e01c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:17.568868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-850e40d3-1350-4e9f-b4e2-6bb71346e01c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:17.569506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-850e40d3-1350-4e9f-b4e2-6bb71346e01c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:17.570813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-850e40d3-1350-4e9f-b4e2-6bb71346e01c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:17.664892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-850e40d3-1350-4e9f-b4e2-6bb71346e01c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:17.675385 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-850e40d3-1350-4e9f-b4e2-6bb71346e01c tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1276 microversion: 2.1 time: 0.134593 Oct 04 18:41:17.676281 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3165/6330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:17 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:17.958232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:17.959332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:17.971491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:17.972277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:17.974092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:17.975132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:17.976684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:17.978157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.000040 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a HTTP/1.1 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '95f9317b-677e-4d80-895f-61eede40d94a'} Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:18.003611 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:41:18.008132 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:18.010484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:18.011985 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c8c28e2b-ba50-4b90-b67f-8261305eb6a0 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 404 len: 111 microversion: 2.1 time: 0.059748 Oct 04 18:41:18.014994 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3166/6331] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:17 2022] DELETE /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:18.020735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:18.021504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] [instance: 95f9317b-677e-4d80-895f-61eede40d94a] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:18.028189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.028834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.029432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.030252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.030817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.031400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.046634 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] HTTP exception thrown: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Request method failure captured: Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a HTTP/1.1 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPHxhm5qj0CWptQBI0qIvJN9jmuyTBmxc8ZF9UYrIv2THwKL5F8LliIqUhE8ZwBPwOi66NQIXfbQJMfkIA6-fxOe5-LIX1gxyHZ0rlWRRtRPi6sI1PyjVc8PJYWdMHm5NNLTjgmoRKkJOqbkdqjg8e6LVZi8_R099HZ1gItg5JATVFS0 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6a9c2474d65845eb84b608f305203297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6a9c2474d65845eb84b608f305203297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6a9c2474d65845eb84b608f305203297"}]}] Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6a9c2474d65845eb84b608f305203297 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102564648 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 0937bdb543864ac4bb2c6f6ea1137525 Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-AttachVolumeNegativeTest-1102564648-project Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '95f9317b-677e-4d80-895f-61eede40d94a'} Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:18.048374 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:18.052247 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:18.052247 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:18.052247 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:18.052247 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:18.052247 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:18.052247 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. Oct 04 18:41:18.052247 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:18.054008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] Returning 404 to user: Instance 95f9317b-677e-4d80-895f-61eede40d94a could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:18.055338 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7177be8d-8bef-408a-9a5d-4d5c8acbc163 tempest-AttachVolumeNegativeTest-1102564648 tempest-AttachVolumeNegativeTest-1102564648-project] 10.222.0.18 "GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a" status: 404 len: 111 microversion: 2.1 time: 0.038622 Oct 04 18:41:18.056205 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3166/6332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:18 2022] GET /compute/v2.1/servers/95f9317b-677e-4d80-895f-61eede40d94a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:18.704187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c03fe56c-cd55-485a-ad82-28f3601bf32a tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:18.704725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c03fe56c-cd55-485a-ad82-28f3601bf32a tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:18.719729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c03fe56c-cd55-485a-ad82-28f3601bf32a tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.720232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c03fe56c-cd55-485a-ad82-28f3601bf32a tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.720676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c03fe56c-cd55-485a-ad82-28f3601bf32a tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.721398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c03fe56c-cd55-485a-ad82-28f3601bf32a tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.721853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c03fe56c-cd55-485a-ad82-28f3601bf32a tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.722286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c03fe56c-cd55-485a-ad82-28f3601bf32a tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.035097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c03fe56c-cd55-485a-ad82-28f3601bf32a tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:19.044654 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c03fe56c-cd55-485a-ad82-28f3601bf32a tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1318 microversion: 2.1 time: 0.344458 Oct 04 18:41:19.048063 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3167/6333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:18 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:19.317659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3eb6c646-3ce0-4ca7-81b1-7d389ad28667 req-de97a20f-bd65-4a11-940b-43d6b3260148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "580fc9e2-01e2-4204-810b-4d145c9432a2", "tag": "47061f3c-b25a-481b-8f44-276de8280ee0"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:19.339763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3eb6c646-3ce0-4ca7-81b1-7d389ad28667 req-de97a20f-bd65-4a11-940b-43d6b3260148 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.340266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3eb6c646-3ce0-4ca7-81b1-7d389ad28667 req-de97a20f-bd65-4a11-940b-43d6b3260148 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.340716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3eb6c646-3ce0-4ca7-81b1-7d389ad28667 req-de97a20f-bd65-4a11-940b-43d6b3260148 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.370620 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3eb6c646-3ce0-4ca7-81b1-7d389ad28667 req-de97a20f-bd65-4a11-940b-43d6b3260148 service nova] Creating event network-changed:47061f3c-b25a-481b-8f44-276de8280ee0 for instance 580fc9e2-01e2-4204-810b-4d145c9432a2 on n-h1-850499-14 Oct 04 18:41:19.378112 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3eb6c646-3ce0-4ca7-81b1-7d389ad28667 req-de97a20f-bd65-4a11-940b-43d6b3260148 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064830 Oct 04 18:41:19.378759 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3167/6334] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:20.085214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ba35ea1e-a0b7-4cfa-a336-c6a842104880 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:20.088184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ba35ea1e-a0b7-4cfa-a336-c6a842104880 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:20.098525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:20.110554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba35ea1e-a0b7-4cfa-a336-c6a842104880 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.111086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba35ea1e-a0b7-4cfa-a336-c6a842104880 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.111856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba35ea1e-a0b7-4cfa-a336-c6a842104880 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.116558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba35ea1e-a0b7-4cfa-a336-c6a842104880 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.116558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba35ea1e-a0b7-4cfa-a336-c6a842104880 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.116558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba35ea1e-a0b7-4cfa-a336-c6a842104880 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.120358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:20.341163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ba35ea1e-a0b7-4cfa-a336-c6a842104880 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:20.352837 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ba35ea1e-a0b7-4cfa-a336-c6a842104880 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1318 microversion: 2.1 time: 0.286220 Oct 04 18:41:20.353446 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3168/6335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:20 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:21.379046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bdf21411-c8a6-4c77-a7c8-f2805c54bea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:21.380752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bdf21411-c8a6-4c77-a7c8-f2805c54bea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:21.388772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:21.398235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf21411-c8a6-4c77-a7c8-f2805c54bea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.399817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf21411-c8a6-4c77-a7c8-f2805c54bea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.401916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf21411-c8a6-4c77-a7c8-f2805c54bea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.409017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf21411-c8a6-4c77-a7c8-f2805c54bea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.409881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf21411-c8a6-4c77-a7c8-f2805c54bea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.410551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf21411-c8a6-4c77-a7c8-f2805c54bea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.435304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:22.072498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bdf21411-c8a6-4c77-a7c8-f2805c54bea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:22.102085 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bdf21411-c8a6-4c77-a7c8-f2805c54bea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1318 microversion: 2.1 time: 0.729017 Oct 04 18:41:22.114212 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3168/6336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:21 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:23.145928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-15396c16-3ab9-49fc-b6bc-6a22efc89428 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:23.147979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-15396c16-3ab9-49fc-b6bc-6a22efc89428 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:23.171835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15396c16-3ab9-49fc-b6bc-6a22efc89428 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:23.175926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15396c16-3ab9-49fc-b6bc-6a22efc89428 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:23.181399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15396c16-3ab9-49fc-b6bc-6a22efc89428 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:23.182469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15396c16-3ab9-49fc-b6bc-6a22efc89428 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:23.183193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15396c16-3ab9-49fc-b6bc-6a22efc89428 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:23.183657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15396c16-3ab9-49fc-b6bc-6a22efc89428 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:23.457722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-15396c16-3ab9-49fc-b6bc-6a22efc89428 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:23.471075 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-15396c16-3ab9-49fc-b6bc-6a22efc89428 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1318 microversion: 2.1 time: 0.332732 Oct 04 18:41:23.485033 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3169/6337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:23 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:24.498134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-56c81efe-07d7-45e6-8ee1-d6bdc5693f86 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:24.499651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-56c81efe-07d7-45e6-8ee1-d6bdc5693f86 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:24.510068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c81efe-07d7-45e6-8ee1-d6bdc5693f86 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.511036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c81efe-07d7-45e6-8ee1-d6bdc5693f86 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.512384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c81efe-07d7-45e6-8ee1-d6bdc5693f86 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.513645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c81efe-07d7-45e6-8ee1-d6bdc5693f86 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.514554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c81efe-07d7-45e6-8ee1-d6bdc5693f86 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.515215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-56c81efe-07d7-45e6-8ee1-d6bdc5693f86 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.753637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-56c81efe-07d7-45e6-8ee1-d6bdc5693f86 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:24.767170 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-56c81efe-07d7-45e6-8ee1-d6bdc5693f86 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1318 microversion: 2.1 time: 0.272767 Oct 04 18:41:24.778699 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3170/6338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:24 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:24.831165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5a3839ab-4342-4f63-a3c9-393bfa1d94fb tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:24.835241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5a3839ab-4342-4f63-a3c9-393bfa1d94fb tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:24.845683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a3839ab-4342-4f63-a3c9-393bfa1d94fb tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.846375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a3839ab-4342-4f63-a3c9-393bfa1d94fb tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.847774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a3839ab-4342-4f63-a3c9-393bfa1d94fb tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.849095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a3839ab-4342-4f63-a3c9-393bfa1d94fb tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.850106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a3839ab-4342-4f63-a3c9-393bfa1d94fb tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.850713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a3839ab-4342-4f63-a3c9-393bfa1d94fb tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.066993 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5a3839ab-4342-4f63-a3c9-393bfa1d94fb tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1834 microversion: 2.1 time: 0.649673 Oct 04 18:41:25.067597 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3169/6339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:24 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1834 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:25.092120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:25.094005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:25.313806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1cb63cd-166d-4c1c-828f-d722da5ffd13 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:25.317360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1cb63cd-166d-4c1c-828f-d722da5ffd13 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:25.330313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1cb63cd-166d-4c1c-828f-d722da5ffd13 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.330856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1cb63cd-166d-4c1c-828f-d722da5ffd13 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.332706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1cb63cd-166d-4c1c-828f-d722da5ffd13 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.333472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1cb63cd-166d-4c1c-828f-d722da5ffd13 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.334164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1cb63cd-166d-4c1c-828f-d722da5ffd13 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.334608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1cb63cd-166d-4c1c-828f-d722da5ffd13 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.510028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e1cb63cd-166d-4c1c-828f-d722da5ffd13 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:25.518852 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1cb63cd-166d-4c1c-828f-d722da5ffd13 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1681 microversion: 2.1 time: 0.432361 Oct 04 18:41:25.519778 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3171/6340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:25 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1681 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:25.528364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:25.634218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c10a77e5-7c6f-4352-b825-f84707e7f951 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:25.637222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c10a77e5-7c6f-4352-b825-f84707e7f951 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:25.650012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10a77e5-7c6f-4352-b825-f84707e7f951 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.650012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10a77e5-7c6f-4352-b825-f84707e7f951 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.650012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10a77e5-7c6f-4352-b825-f84707e7f951 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.650801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10a77e5-7c6f-4352-b825-f84707e7f951 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.651332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10a77e5-7c6f-4352-b825-f84707e7f951 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.651806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10a77e5-7c6f-4352-b825-f84707e7f951 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.730921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2b57d552-cee9-48d0-a379-0ac1605c9429 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Action: 'create', calling method: .version_select at 0x7fd4d0c080d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1072747123"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:25.741119 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c10a77e5-7c6f-4352-b825-f84707e7f951 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action" status: 200 len: 32642 microversion: 2.1 time: 0.113588 Oct 04 18:41:25.745838 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3172/6341] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:25 2022] POST /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action => generated 32642 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:41:25.792923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-43c642fb-60e4-44bd-a953-d448e5e9633e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:25.793680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-43c642fb-60e4-44bd-a953-d448e5e9633e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:25.801590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43c642fb-60e4-44bd-a953-d448e5e9633e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.802081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43c642fb-60e4-44bd-a953-d448e5e9633e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.814714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43c642fb-60e4-44bd-a953-d448e5e9633e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.815948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43c642fb-60e4-44bd-a953-d448e5e9633e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.816525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43c642fb-60e4-44bd-a953-d448e5e9633e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.830782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43c642fb-60e4-44bd-a953-d448e5e9633e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.038568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-43c642fb-60e4-44bd-a953-d448e5e9633e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:26.048233 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-43c642fb-60e4-44bd-a953-d448e5e9633e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1318 microversion: 2.1 time: 0.261364 Oct 04 18:41:26.052969 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3173/6342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:25 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:26.058264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:26.059142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:26.065954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.066754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.067454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.068438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.069061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.069945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.120402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '90a4d768f7d0440db5cb1fd38f03045b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183fd879004a480796c3e2346af2f3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:26.123943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] flavor_id is None. Assuming migration. {{(pid=122332) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:41:26.124670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122332) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:41:26.281791 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2b57d552-cee9-48d0-a379-0ac1605c9429 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.757728 Oct 04 18:41:26.282747 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3170/6343] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Oct 4 18:41:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 759 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 18:41:26.296398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1309629b-252d-4dc0-a89b-93a46471d7a9 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0c13ee0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:26.448803 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1309629b-252d-4dc0-a89b-93a46471d7a9 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d" status: 200 len: 345 microversion: 2.1 time: 0.156567 Oct 04 18:41:26.449395 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3171/6344] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:41:26 2022] GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d => generated 345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:41:26.454632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d41f6ffc-9c46-4e60-a975-01831406afef req-51c46714-1aaa-4f6a-a35d-58c2ce78a5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580fc9e2-01e2-4204-810b-4d145c9432a2", "name": "network-vif-plugged", "status": "completed", "tag": "47061f3c-b25a-481b-8f44-276de8280ee0"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:26.490640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d41f6ffc-9c46-4e60-a975-01831406afef req-51c46714-1aaa-4f6a-a35d-58c2ce78a5cf service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.491227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d41f6ffc-9c46-4e60-a975-01831406afef req-51c46714-1aaa-4f6a-a35d-58c2ce78a5cf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.492150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d41f6ffc-9c46-4e60-a975-01831406afef req-51c46714-1aaa-4f6a-a35d-58c2ce78a5cf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.506045 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d41f6ffc-9c46-4e60-a975-01831406afef req-51c46714-1aaa-4f6a-a35d-58c2ce78a5cf service nova] Creating event network-vif-plugged:47061f3c-b25a-481b-8f44-276de8280ee0 for instance 580fc9e2-01e2-4204-810b-4d145c9432a2 on n-h1-850499-14 Oct 04 18:41:26.512987 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d41f6ffc-9c46-4e60-a975-01831406afef req-51c46714-1aaa-4f6a-a35d-58c2ce78a5cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061958 Oct 04 18:41:26.514301 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3172/6345] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:26.804423 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9cf6a2e3-59d6-4a49-998f-1664bd2f4819 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action" status: 202 len: 0 microversion: 2.1 time: 0.750021 Oct 04 18:41:26.806373 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3174/6346] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:26 2022] POST /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:26.820067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb1f08fb-4c07-44cc-be36-335591f547f6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:26.821125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb1f08fb-4c07-44cc-be36-335591f547f6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:26.833300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb1f08fb-4c07-44cc-be36-335591f547f6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.834265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb1f08fb-4c07-44cc-be36-335591f547f6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.834914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb1f08fb-4c07-44cc-be36-335591f547f6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.836016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb1f08fb-4c07-44cc-be36-335591f547f6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.836955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb1f08fb-4c07-44cc-be36-335591f547f6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.838095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb1f08fb-4c07-44cc-be36-335591f547f6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.076692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a3b8f07-2737-42b6-94ab-edf33f56da41 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:27.077614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a3b8f07-2737-42b6-94ab-edf33f56da41 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:27.096350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3b8f07-2737-42b6-94ab-edf33f56da41 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.097244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3b8f07-2737-42b6-94ab-edf33f56da41 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.098460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3b8f07-2737-42b6-94ab-edf33f56da41 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.103325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3b8f07-2737-42b6-94ab-edf33f56da41 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.104480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3b8f07-2737-42b6-94ab-edf33f56da41 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.105351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3b8f07-2737-42b6-94ab-edf33f56da41 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.170767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cb1f08fb-4c07-44cc-be36-335591f547f6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:27.180473 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb1f08fb-4c07-44cc-be36-335591f547f6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1690 microversion: 2.1 time: 0.369570 Oct 04 18:41:27.187092 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3173/6347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:26 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1690 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:27.367708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a3b8f07-2737-42b6-94ab-edf33f56da41 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:27.385630 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a3b8f07-2737-42b6-94ab-edf33f56da41 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1318 microversion: 2.1 time: 0.309785 Oct 04 18:41:27.386292 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3175/6348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:27 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:27.463510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-69308d69-2631-47f9-a036-9051c69c431b tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0c130d0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:27.540315 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-69308d69-2631-47f9-a036-9051c69c431b tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d" status: 200 len: 345 microversion: 2.1 time: 0.080475 Oct 04 18:41:27.553237 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3174/6349] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:41:27 2022] GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d => generated 345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:28.212134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a41ecc02-ba55-4b0b-8fb7-5d1728429d03 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:28.221481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a41ecc02-ba55-4b0b-8fb7-5d1728429d03 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:28.239007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a41ecc02-ba55-4b0b-8fb7-5d1728429d03 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.239007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a41ecc02-ba55-4b0b-8fb7-5d1728429d03 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.239007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a41ecc02-ba55-4b0b-8fb7-5d1728429d03 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.239007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a41ecc02-ba55-4b0b-8fb7-5d1728429d03 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.239007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a41ecc02-ba55-4b0b-8fb7-5d1728429d03 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.239007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a41ecc02-ba55-4b0b-8fb7-5d1728429d03 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.411976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-789e9f75-a788-4d3e-9252-5087b438d9da tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:28.413194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-789e9f75-a788-4d3e-9252-5087b438d9da tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:28.421305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-789e9f75-a788-4d3e-9252-5087b438d9da tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.422222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-789e9f75-a788-4d3e-9252-5087b438d9da tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.423077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-789e9f75-a788-4d3e-9252-5087b438d9da tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.424540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-789e9f75-a788-4d3e-9252-5087b438d9da tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.425226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-789e9f75-a788-4d3e-9252-5087b438d9da tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.426286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-789e9f75-a788-4d3e-9252-5087b438d9da tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.480104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a41ecc02-ba55-4b0b-8fb7-5d1728429d03 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:28.488359 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a41ecc02-ba55-4b0b-8fb7-5d1728429d03 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1690 microversion: 2.1 time: 0.281379 Oct 04 18:41:28.489017 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3176/6350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:28 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1690 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:28.556493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5160d3e4-139c-4ef4-a79f-a98d5d75900f tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0d9a790>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:28.628949 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5160d3e4-139c-4ef4-a79f-a98d5d75900f tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d" status: 200 len: 346 microversion: 2.1 time: 0.076028 Oct 04 18:41:28.631319 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3177/6351] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:41:28 2022] GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:28.645870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1316760-f2b2-42f9-9b36-897bf428f06f tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Action: 'create', calling method: .version_select at 0x7fd4d0ce6ee0>, body: {"snapshot": {"volume_id": "124b9326-c9d8-427c-8c1f-6fcdc06c264d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1212201475"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:28.661378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-789e9f75-a788-4d3e-9252-5087b438d9da tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:28.671066 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-789e9f75-a788-4d3e-9252-5087b438d9da tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1507 microversion: 2.1 time: 0.264157 Oct 04 18:41:28.673086 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3175/6352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:28 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:28.697950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7cd05c56-0af8-4516-8ba1-cc82ecac5b19 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa4b3537-7a08-4ccd-9e7e-5fb191fe6ff4", "device": "/dev/sdb"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:28.701330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7cd05c56-0af8-4516-8ba1-cc82ecac5b19 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:28.707706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cd05c56-0af8-4516-8ba1-cc82ecac5b19 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.708206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cd05c56-0af8-4516-8ba1-cc82ecac5b19 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.708647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cd05c56-0af8-4516-8ba1-cc82ecac5b19 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.709355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cd05c56-0af8-4516-8ba1-cc82ecac5b19 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.709817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cd05c56-0af8-4516-8ba1-cc82ecac5b19 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.710245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7cd05c56-0af8-4516-8ba1-cc82ecac5b19 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.943829 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b1316760-f2b2-42f9-9b36-897bf428f06f tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.302608 Oct 04 18:41:28.944717 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3178/6353] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 4 18:41:28 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:41:28.958138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-171689b9-2440-4c7a-98cf-f9ccf4fede98 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d1acbc10>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.007077 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-171689b9-2440-4c7a-98cf-f9ccf4fede98 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5" status: 200 len: 287 microversion: 2.1 time: 0.054839 Oct 04 18:41:29.008089 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3179/6354] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:41:28 2022] GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:29.023497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b5edab5a-a4c8-4214-8823-a3c46ea8a30d tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0bd8310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.104806 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b5edab5a-a4c8-4214-8823-a3c46ea8a30d tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.088908 Oct 04 18:41:29.106454 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3180/6355] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Oct 4 18:41:29 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:29.117595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8eae0bd0-2f37-4e57-9735-601e33be7e1b tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d13a31f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.169283 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8eae0bd0-2f37-4e57-9735-601e33be7e1b tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5" status: 200 len: 287 microversion: 2.1 time: 0.055072 Oct 04 18:41:29.174031 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3181/6356] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:41:29 2022] GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:29.391073 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7cd05c56-0af8-4516-8ba1-cc82ecac5b19 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "POST /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696855 Oct 04 18:41:29.396600 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3176/6357] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 18:41:28 2022] POST /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:29.535357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9fed41d7-20cc-441d-8726-e23a7148c407 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.536105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9fed41d7-20cc-441d-8726-e23a7148c407 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:29.563724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed41d7-20cc-441d-8726-e23a7148c407 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.565020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed41d7-20cc-441d-8726-e23a7148c407 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.565643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed41d7-20cc-441d-8726-e23a7148c407 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.566713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed41d7-20cc-441d-8726-e23a7148c407 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.567491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed41d7-20cc-441d-8726-e23a7148c407 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.568531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9fed41d7-20cc-441d-8726-e23a7148c407 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.969943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9fed41d7-20cc-441d-8726-e23a7148c407 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:29.981071 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9fed41d7-20cc-441d-8726-e23a7148c407 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1690 microversion: 2.1 time: 0.471211 Oct 04 18:41:29.981673 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3182/6358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:29 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1690 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:30.206444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2d62064-100c-4bb0-8a36-6f107efd837b tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0a82700>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:30.298915 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a2d62064-100c-4bb0-8a36-6f107efd837b tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5" status: 200 len: 287 microversion: 2.1 time: 0.120502 Oct 04 18:41:30.299694 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3177/6359] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:41:30 2022] GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:31.011865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-529cf9d7-d548-4672-ab01-b2a98e180058 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.013506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-529cf9d7-d548-4672-ab01-b2a98e180058 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:31.022804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-529cf9d7-d548-4672-ab01-b2a98e180058 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.025196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-529cf9d7-d548-4672-ab01-b2a98e180058 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.026218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-529cf9d7-d548-4672-ab01-b2a98e180058 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.027532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-529cf9d7-d548-4672-ab01-b2a98e180058 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.028174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-529cf9d7-d548-4672-ab01-b2a98e180058 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.028807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-529cf9d7-d548-4672-ab01-b2a98e180058 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.334542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cc05b5db-9767-4ab4-a65f-4a62c3fb5b2b tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0a06a60>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.519165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-529cf9d7-d548-4672-ab01-b2a98e180058 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:31.529263 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-529cf9d7-d548-4672-ab01-b2a98e180058 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.522943 Oct 04 18:41:31.531053 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3183/6360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:31 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:31.802710 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cc05b5db-9767-4ab4-a65f-4a62c3fb5b2b tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5" status: 200 len: 288 microversion: 2.1 time: 0.491213 Oct 04 18:41:31.803462 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3178/6361] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:41:31 2022] GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 => generated 288 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:31.816039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c10eed16-7d95-4b29-aeeb-b70010649d9f tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0c571f0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.969615 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c10eed16-7d95-4b29-aeeb-b70010649d9f tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5" status: 202 len: 0 microversion: 2.1 time: 0.157595 Oct 04 18:41:31.971118 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3184/6362] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Oct 4 18:41:31 2022] DELETE /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:31.986051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-56fd9da4-169a-4b4f-9b43-4321e2e35efd tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0a235e0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:32.031648 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-56fd9da4-169a-4b4f-9b43-4321e2e35efd tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5" status: 200 len: 287 microversion: 2.1 time: 0.054788 Oct 04 18:41:32.033798 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3179/6363] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:41:31 2022] GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:32.573028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f0c5c37a-5d86-43c6-8253-504bdf294a6b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:32.578304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f0c5c37a-5d86-43c6-8253-504bdf294a6b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:32.587774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c5c37a-5d86-43c6-8253-504bdf294a6b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.588676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c5c37a-5d86-43c6-8253-504bdf294a6b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.589321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c5c37a-5d86-43c6-8253-504bdf294a6b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.590227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c5c37a-5d86-43c6-8253-504bdf294a6b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.590975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c5c37a-5d86-43c6-8253-504bdf294a6b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.591731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f0c5c37a-5d86-43c6-8253-504bdf294a6b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.871942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f0c5c37a-5d86-43c6-8253-504bdf294a6b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.880782 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f0c5c37a-5d86-43c6-8253-504bdf294a6b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.319641 Oct 04 18:41:32.884032 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3185/6364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:32 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:33.062541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b170e201-0a56-4c4e-9f8e-d3fa19153228 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d2554790>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:33.127335 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b170e201-0a56-4c4e-9f8e-d3fa19153228 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5" status: 200 len: 287 microversion: 2.1 time: 0.068385 Oct 04 18:41:33.128077 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3180/6365] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:41:33 2022] GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:33.910192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5e75ad74-864c-4c1a-aaf7-b1ee34d9f686 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:33.910825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5e75ad74-864c-4c1a-aaf7-b1ee34d9f686 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:33.949897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e75ad74-864c-4c1a-aaf7-b1ee34d9f686 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.950409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e75ad74-864c-4c1a-aaf7-b1ee34d9f686 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.951677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e75ad74-864c-4c1a-aaf7-b1ee34d9f686 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.953553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e75ad74-864c-4c1a-aaf7-b1ee34d9f686 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.954365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e75ad74-864c-4c1a-aaf7-b1ee34d9f686 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.956574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5e75ad74-864c-4c1a-aaf7-b1ee34d9f686 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.140482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4303f877-c960-44da-99ba-a8198ddb81da tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0bfa670>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:34.212531 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4303f877-c960-44da-99ba-a8198ddb81da tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5" status: 200 len: 287 microversion: 2.1 time: 0.075355 Oct 04 18:41:34.213467 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3181/6366] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:41:34 2022] GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:34.263788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5e75ad74-864c-4c1a-aaf7-b1ee34d9f686 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.272694 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5e75ad74-864c-4c1a-aaf7-b1ee34d9f686 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.366131 Oct 04 18:41:34.286642 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3186/6367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:33 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:34.518914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9ef20aa2-3a99-4093-af93-5640f7c7fffa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Action: 'create', calling method: .version_select at 0x7fd4d0a82700>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1544284861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGhmrdoPT5TQfBfAZCNX2gnG4iE72b9/6DkYNxpXXzyrc/1beEoX7Q/OQidU7yDOhZ38xCaPtRXOoCnxzq3+QmjpDPpS3rfUPniRUN4+OXophuUluA8rDUThO6ICumYhg=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:34.535605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-9ef20aa2-3a99-4093-af93-5640f7c7fffa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Getting quotas for project 6f8e2ca190554515a144729878a02162. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:34.541490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-9ef20aa2-3a99-4093-af93-5640f7c7fffa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Getting quotas for user b9e77370b5c14d509d1573ef5f6e92b9 and project 6f8e2ca190554515a144729878a02162. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:34.566471 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9ef20aa2-3a99-4093-af93-5640f7c7fffa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.316353 Oct 04 18:41:34.567353 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3182/6368] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:41:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:35.225707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca2723ee-1294-44da-8f8c-5439002563ae tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0d1ff70>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:35.269489 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ca2723ee-1294-44da-8f8c-5439002563ae tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] HTTP exception thrown: Snapshot 48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 could not be found. Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca2723ee-1294-44da-8f8c-5439002563ae tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Request method failure captured: Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 HTTP/1.1 Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH5V491OrOk0cqU-Jf8qkCalywOrpHm_7P4nFqUi9EM-nn5ONdX8dAzd7cfdJRhbhVD5tKcNdE-QbAStcJDso29eulf6tYHZXCNtIHKxjf-ybPh0-gxMP-eV-byGPkdkSyYobJZJaZqVYdRzHdTHKOEM98UZ8t3M5s0d32N7VDO--ZQ Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6aa786835d2b4948854a79b241ee5283 Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6aa786835d2b4948854a79b241ee5283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6aa786835d2b4948854a79b241ee5283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6aa786835d2b4948854a79b241ee5283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6aa786835d2b4948854a79b241ee5283"}]}] Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6aa786835d2b4948854a79b241ee5283 Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesSnapshotsTestJSON-2015582878-project Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e797503ea53a4fe3b4ce1f641276d6da Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2015582878-project Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: exception: Snapshot 48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 could not be found. Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '48545ed1-0aaf-48e7-af11-cce7e9ca1bc5'} Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 could not be found. (HTTP 404) (Request-ID: req-3cd00a55-1884-45c9-b55b-7a49a0eeb46c) Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:41:35.281861 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 could not be found. Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 could not be found. Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 could not be found. Oct 04 18:41:35.286643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:35.290798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ca2723ee-1294-44da-8f8c-5439002563ae tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Returning 404 to user: Snapshot 48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:35.292588 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ca2723ee-1294-44da-8f8c-5439002563ae tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5" status: 404 len: 111 microversion: 2.1 time: 0.069893 Oct 04 18:41:35.292803 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3187/6369] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 18:41:35 2022] GET /compute/v2.1/os-snapshots/48545ed1-0aaf-48e7-af11-cce7e9ca1bc5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:35.301520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b715af8-1691-4f3b-b646-81df97af4692 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0d7f550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:35.301763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dbe8fcfc-7b69-436c-8bf7-f7752be3e22a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:35.302426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dbe8fcfc-7b69-436c-8bf7-f7752be3e22a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:35.310402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe8fcfc-7b69-436c-8bf7-f7752be3e22a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.311171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe8fcfc-7b69-436c-8bf7-f7752be3e22a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.311662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe8fcfc-7b69-436c-8bf7-f7752be3e22a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.312361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe8fcfc-7b69-436c-8bf7-f7752be3e22a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.312836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe8fcfc-7b69-436c-8bf7-f7752be3e22a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.313278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe8fcfc-7b69-436c-8bf7-f7752be3e22a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.407271 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6b715af8-1691-4f3b-b646-81df97af4692 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d" status: 202 len: 0 microversion: 2.1 time: 0.110415 Oct 04 18:41:35.408248 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3188/6370] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:41:35 2022] DELETE /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:41:35.420377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b0adc37-7a3c-4df5-bbc3-511abcd47a98 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0d1f0d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:35.533111 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b0adc37-7a3c-4df5-bbc3-511abcd47a98 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d" status: 200 len: 345 microversion: 2.1 time: 0.120141 Oct 04 18:41:35.534464 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3189/6371] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:41:35 2022] GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:41:35.652721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dbe8fcfc-7b69-436c-8bf7-f7752be3e22a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:35.666855 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dbe8fcfc-7b69-436c-8bf7-f7752be3e22a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.369681 Oct 04 18:41:35.668803 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3183/6372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:35 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:36.549236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-69557955-ea42-4d82-a139-2f4c326caf8a tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0b429d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:36.663999 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-69557955-ea42-4d82-a139-2f4c326caf8a tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d" status: 200 len: 345 microversion: 2.1 time: 0.118968 Oct 04 18:41:36.665321 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3190/6373] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:41:36 2022] GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d => generated 345 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:36.695569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-468da65f-a0da-4410-91f3-58939753c58d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:36.696866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-468da65f-a0da-4410-91f3-58939753c58d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:36.712737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-468da65f-a0da-4410-91f3-58939753c58d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.713249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-468da65f-a0da-4410-91f3-58939753c58d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.713700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-468da65f-a0da-4410-91f3-58939753c58d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.714421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-468da65f-a0da-4410-91f3-58939753c58d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.714883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-468da65f-a0da-4410-91f3-58939753c58d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.715354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-468da65f-a0da-4410-91f3-58939753c58d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.948334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-468da65f-a0da-4410-91f3-58939753c58d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:36.958224 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-468da65f-a0da-4410-91f3-58939753c58d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.267919 Oct 04 18:41:36.960395 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3184/6374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:36 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:37.679709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8fdcda3-21cb-4892-9349-ff52a40ffe4b tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0d9a820>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:37.794445 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8fdcda3-21cb-4892-9349-ff52a40ffe4b tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d" status: 200 len: 345 microversion: 2.1 time: 0.119106 Oct 04 18:41:37.795426 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3191/6375] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:41:37 2022] GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d => generated 345 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:37.993190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f77c15da-6ea8-42ec-a73d-a7e54110ea37 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:37.994483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f77c15da-6ea8-42ec-a73d-a7e54110ea37 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:38.004664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f77c15da-6ea8-42ec-a73d-a7e54110ea37 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.005766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f77c15da-6ea8-42ec-a73d-a7e54110ea37 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.006502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f77c15da-6ea8-42ec-a73d-a7e54110ea37 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.007561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f77c15da-6ea8-42ec-a73d-a7e54110ea37 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.008436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f77c15da-6ea8-42ec-a73d-a7e54110ea37 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.009287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f77c15da-6ea8-42ec-a73d-a7e54110ea37 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.234020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f77c15da-6ea8-42ec-a73d-a7e54110ea37 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:38.244883 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f77c15da-6ea8-42ec-a73d-a7e54110ea37 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.262530 Oct 04 18:41:38.246813 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3185/6376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:37 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:38.809401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97172649-dfa5-4f5b-a8e6-b6dc4d8c036e tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0d1f940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:38.866588 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-97172649-dfa5-4f5b-a8e6-b6dc4d8c036e tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] HTTP exception thrown: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97172649-dfa5-4f5b-a8e6-b6dc4d8c036e tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Request method failure captured: Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d HTTP/1.1 Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH5V491OrOk0cqU-Jf8qkCalywOrpHm_7P4nFqUi9EM-nn5ONdX8dAzd7cfdJRhbhVD5tKcNdE-QbAStcJDso29eulf6tYHZXCNtIHKxjf-ybPh0-gxMP-eV-byGPkdkSyYobJZJaZqVYdRzHdTHKOEM98UZ8t3M5s0d32N7VDO--ZQ Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6aa786835d2b4948854a79b241ee5283 Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6aa786835d2b4948854a79b241ee5283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6aa786835d2b4948854a79b241ee5283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6aa786835d2b4948854a79b241ee5283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6aa786835d2b4948854a79b241ee5283"}]}] Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6aa786835d2b4948854a79b241ee5283 Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesSnapshotsTestJSON-2015582878-project Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e797503ea53a4fe3b4ce1f641276d6da Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2015582878-project Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: exception: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '124b9326-c9d8-427c-8c1f-6fcdc06c264d'} Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. (HTTP 404) (Request-ID: req-b7b68a7e-3f17-4b15-82a8-bd81aa89167c) Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:41:38.868652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97172649-dfa5-4f5b-a8e6-b6dc4d8c036e tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Returning 404 to user: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:38.872652 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-97172649-dfa5-4f5b-a8e6-b6dc4d8c036e tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d" status: 404 len: 109 microversion: 2.1 time: 0.064572 Oct 04 18:41:38.876288 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3192/6377] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:41:38 2022] GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:38.880292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7787f38b-0e6f-494a-a130-5b6a3a7f04cb tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d62453a0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:38.922682 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-7787f38b-0e6f-494a-a130-5b6a3a7f04cb tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] HTTP exception thrown: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7787f38b-0e6f-494a-a130-5b6a3a7f04cb tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Request method failure captured: Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d HTTP/1.1 Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH5V491OrOk0cqU-Jf8qkCalywOrpHm_7P4nFqUi9EM-nn5ONdX8dAzd7cfdJRhbhVD5tKcNdE-QbAStcJDso29eulf6tYHZXCNtIHKxjf-ybPh0-gxMP-eV-byGPkdkSyYobJZJaZqVYdRzHdTHKOEM98UZ8t3M5s0d32N7VDO--ZQ Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6aa786835d2b4948854a79b241ee5283 Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6aa786835d2b4948854a79b241ee5283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6aa786835d2b4948854a79b241ee5283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6aa786835d2b4948854a79b241ee5283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6aa786835d2b4948854a79b241ee5283"}]}] Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6aa786835d2b4948854a79b241ee5283 Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-VolumesSnapshotsTestJSON-2015582878-project Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: e797503ea53a4fe3b4ce1f641276d6da Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2015582878-project Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: method: Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: exception: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '124b9326-c9d8-427c-8c1f-6fcdc06c264d'} Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. (HTTP 404) (Request-ID: req-898dc599-28ba-4686-a150-b0636a9be22d) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:41:38.924799 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7787f38b-0e6f-494a-a130-5b6a3a7f04cb tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Returning 404 to user: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7787f38b-0e6f-494a-a130-5b6a3a7f04cb tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d" status: 404 len: 109 microversion: 2.1 time: 0.049989 Oct 04 18:41:38.928654 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3186/6378] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 4 18:41:38 2022] DELETE /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:38.936651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac6371bc-0a53-4361-952b-2424d961bb05 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Calling method '.version_select at 0x7fd4d0d7f9d0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:38.971359 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ac6371bc-0a53-4361-952b-2424d961bb05 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] HTTP exception thrown: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac6371bc-0a53-4361-952b-2424d961bb05 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Request method failure captured: Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d HTTP/1.1 Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH5V491OrOk0cqU-Jf8qkCalywOrpHm_7P4nFqUi9EM-nn5ONdX8dAzd7cfdJRhbhVD5tKcNdE-QbAStcJDso29eulf6tYHZXCNtIHKxjf-ybPh0-gxMP-eV-byGPkdkSyYobJZJaZqVYdRzHdTHKOEM98UZ8t3M5s0d32N7VDO--ZQ Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6aa786835d2b4948854a79b241ee5283 Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6aa786835d2b4948854a79b241ee5283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6aa786835d2b4948854a79b241ee5283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6aa786835d2b4948854a79b241ee5283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6aa786835d2b4948854a79b241ee5283"}]}] Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6aa786835d2b4948854a79b241ee5283 Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2015582878 Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesSnapshotsTestJSON-2015582878-project Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e797503ea53a4fe3b4ce1f641276d6da Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2015582878-project Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: method: Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: exception: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '124b9326-c9d8-427c-8c1f-6fcdc06c264d'} Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. (HTTP 404) (Request-ID: req-3b2f43a7-0075-4801-a184-6de91094e71e) Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:41:38.972834 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac6371bc-0a53-4361-952b-2424d961bb05 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] Returning 404 to user: Volume 124b9326-c9d8-427c-8c1f-6fcdc06c264d could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:38.976947 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac6371bc-0a53-4361-952b-2424d961bb05 tempest-VolumesSnapshotsTestJSON-2015582878 tempest-VolumesSnapshotsTestJSON-2015582878-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d" status: 404 len: 109 microversion: 2.1 time: 0.042646 Oct 04 18:41:38.984193 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3193/6379] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 4 18:41:38 2022] GET /compute/v2.1/os-volumes/124b9326-c9d8-427c-8c1f-6fcdc06c264d => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:39.276003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9fa267a1-bd45-447f-88bb-f19da54a3b50 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:39.277515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9fa267a1-bd45-447f-88bb-f19da54a3b50 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:39.285130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa267a1-bd45-447f-88bb-f19da54a3b50 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:39.285737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa267a1-bd45-447f-88bb-f19da54a3b50 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:39.286105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa267a1-bd45-447f-88bb-f19da54a3b50 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:39.287362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa267a1-bd45-447f-88bb-f19da54a3b50 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:39.288329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa267a1-bd45-447f-88bb-f19da54a3b50 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:39.288774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9fa267a1-bd45-447f-88bb-f19da54a3b50 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:39.660808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9fa267a1-bd45-447f-88bb-f19da54a3b50 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:39.679737 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9fa267a1-bd45-447f-88bb-f19da54a3b50 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.411490 Oct 04 18:41:39.680257 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3187/6380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:39 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:40.705357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a487867f-a33c-4073-8b62-104b53e40b91 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:40.705992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a487867f-a33c-4073-8b62-104b53e40b91 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:40.724382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a487867f-a33c-4073-8b62-104b53e40b91 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.724894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a487867f-a33c-4073-8b62-104b53e40b91 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.725345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a487867f-a33c-4073-8b62-104b53e40b91 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:40.726077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a487867f-a33c-4073-8b62-104b53e40b91 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.726554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a487867f-a33c-4073-8b62-104b53e40b91 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.737051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a487867f-a33c-4073-8b62-104b53e40b91 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.029645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a487867f-a33c-4073-8b62-104b53e40b91 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:41.039846 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a487867f-a33c-4073-8b62-104b53e40b91 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.338521 Oct 04 18:41:41.040441 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3194/6381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:40 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:42.081238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4795e61d-0e43-4d78-a7f8-fc8cd55ee36c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:42.082858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4795e61d-0e43-4d78-a7f8-fc8cd55ee36c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:42.099563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4795e61d-0e43-4d78-a7f8-fc8cd55ee36c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:42.105669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4795e61d-0e43-4d78-a7f8-fc8cd55ee36c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:42.106844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4795e61d-0e43-4d78-a7f8-fc8cd55ee36c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:42.107874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4795e61d-0e43-4d78-a7f8-fc8cd55ee36c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:42.108565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4795e61d-0e43-4d78-a7f8-fc8cd55ee36c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:42.111489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4795e61d-0e43-4d78-a7f8-fc8cd55ee36c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:42.516526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4795e61d-0e43-4d78-a7f8-fc8cd55ee36c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:42.530613 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4795e61d-0e43-4d78-a7f8-fc8cd55ee36c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.454509 Oct 04 18:41:42.531487 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3188/6382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:42 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:43.564090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d10e362-e6c1-4d22-baa8-b5a297fcdf78 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:43.564090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d10e362-e6c1-4d22-baa8-b5a297fcdf78 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:43.593324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d10e362-e6c1-4d22-baa8-b5a297fcdf78 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:43.594939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d10e362-e6c1-4d22-baa8-b5a297fcdf78 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:43.596152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d10e362-e6c1-4d22-baa8-b5a297fcdf78 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:43.598996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d10e362-e6c1-4d22-baa8-b5a297fcdf78 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:43.600559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d10e362-e6c1-4d22-baa8-b5a297fcdf78 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:43.601335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d10e362-e6c1-4d22-baa8-b5a297fcdf78 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:43.947668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d10e362-e6c1-4d22-baa8-b5a297fcdf78 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:43.959729 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d10e362-e6c1-4d22-baa8-b5a297fcdf78 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.404058 Oct 04 18:41:43.980282 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3195/6383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:43 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:44.275076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1344426176-access_point-732997602", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "06a30a9f-d528-499c-bcf2-f20419db33fb"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1544284861", "security_groups": [{"name": "tempest-secgroup_access--1882404220"}, {"name": "tempest-secgroup_general--995139779"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:44.548830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:44.585449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] validate_networks() for [('06a30a9f-d528-499c-bcf2-f20419db33fb', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:44.986577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-01c62654-9b86-4f2f-a187-3c1cb321f4f8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:44.988425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-01c62654-9b86-4f2f-a187-3c1cb321f4f8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:44.999209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01c62654-9b86-4f2f-a187-3c1cb321f4f8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:45.011776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01c62654-9b86-4f2f-a187-3c1cb321f4f8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:45.012559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01c62654-9b86-4f2f-a187-3c1cb321f4f8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:45.013595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01c62654-9b86-4f2f-a187-3c1cb321f4f8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:45.014219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01c62654-9b86-4f2f-a187-3c1cb321f4f8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:45.014833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01c62654-9b86-4f2f-a187-3c1cb321f4f8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:45.031614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:45.229194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:45.230001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:45.231411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:45.231873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:45.232453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:45.253953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:45.254487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:45.256909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:45.257816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:45.258313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:45.260210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:45.273296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-01c62654-9b86-4f2f-a187-3c1cb321f4f8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:45.282336 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-01c62654-9b86-4f2f-a187-3c1cb321f4f8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.300074 Oct 04 18:41:45.283430 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3196/6384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:44 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:45.321277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Getting quotas for project 6f8e2ca190554515a144729878a02162. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:45.329098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Getting quotas for user b9e77370b5c14d509d1573ef5f6e92b9 and project 6f8e2ca190554515a144729878a02162. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:45.346069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:45.348702 n-d-850499-14 devstack@n-api.service[122331]: WARNING nova.utils [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1344426176-access_point-732997602 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1344426176-ac Oct 04 18:41:45.349653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:45.438047 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-91eb0b9d-8e5f-4fbb-ba54-c8449c856298 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.169782 Oct 04 18:41:45.440831 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3189/6385] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:41:44 2022] POST /compute/v2.1/servers => generated 457 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:41:45.454948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-138ac12a-2a88-4378-a66c-d95be2e975fc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:45.455809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-138ac12a-2a88-4378-a66c-d95be2e975fc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:45.581719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-138ac12a-2a88-4378-a66c-d95be2e975fc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:45.598457 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-138ac12a-2a88-4378-a66c-d95be2e975fc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1294 microversion: 2.1 time: 0.149460 Oct 04 18:41:45.606257 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3197/6386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:45 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1294 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:46.313468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17ad23c9-9e42-49d0-b4f8-cf0c22760281 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:46.314445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17ad23c9-9e42-49d0-b4f8-cf0c22760281 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:46.323094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17ad23c9-9e42-49d0-b4f8-cf0c22760281 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.324552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17ad23c9-9e42-49d0-b4f8-cf0c22760281 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:46.325317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17ad23c9-9e42-49d0-b4f8-cf0c22760281 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:46.326267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17ad23c9-9e42-49d0-b4f8-cf0c22760281 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.327099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17ad23c9-9e42-49d0-b4f8-cf0c22760281 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:46.328130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17ad23c9-9e42-49d0-b4f8-cf0c22760281 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:46.578754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17ad23c9-9e42-49d0-b4f8-cf0c22760281 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:46.600400 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17ad23c9-9e42-49d0-b4f8-cf0c22760281 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.291578 Oct 04 18:41:46.613459 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3190/6387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:46 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:46.628858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-25fd328f-d9e3-472d-8a50-f7000fd124b2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:46.629411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-25fd328f-d9e3-472d-8a50-f7000fd124b2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:46.639752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25fd328f-d9e3-472d-8a50-f7000fd124b2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.640264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25fd328f-d9e3-472d-8a50-f7000fd124b2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:46.640719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25fd328f-d9e3-472d-8a50-f7000fd124b2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:46.647429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25fd328f-d9e3-472d-8a50-f7000fd124b2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.647940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25fd328f-d9e3-472d-8a50-f7000fd124b2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:46.648592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25fd328f-d9e3-472d-8a50-f7000fd124b2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:46.761400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-25fd328f-d9e3-472d-8a50-f7000fd124b2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:46.772813 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-25fd328f-d9e3-472d-8a50-f7000fd124b2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1290 microversion: 2.1 time: 0.147569 Oct 04 18:41:46.787435 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3198/6388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:46 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1290 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:47.630817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e718067c-c7a6-406a-82c0-48591a8d141f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:47.633490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e718067c-c7a6-406a-82c0-48591a8d141f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:47.644603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e718067c-c7a6-406a-82c0-48591a8d141f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:47.648428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e718067c-c7a6-406a-82c0-48591a8d141f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.650906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e718067c-c7a6-406a-82c0-48591a8d141f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:47.652522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e718067c-c7a6-406a-82c0-48591a8d141f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:47.657699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e718067c-c7a6-406a-82c0-48591a8d141f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.658485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e718067c-c7a6-406a-82c0-48591a8d141f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:47.805861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f518304-d67a-446e-83c1-483e5ae62caa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:47.809056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3f518304-d67a-446e-83c1-483e5ae62caa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:47.839904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f518304-d67a-446e-83c1-483e5ae62caa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:47.845070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f518304-d67a-446e-83c1-483e5ae62caa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.847859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f518304-d67a-446e-83c1-483e5ae62caa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:47.848639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f518304-d67a-446e-83c1-483e5ae62caa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:47.853833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f518304-d67a-446e-83c1-483e5ae62caa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.856751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f518304-d67a-446e-83c1-483e5ae62caa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:48.132449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e718067c-c7a6-406a-82c0-48591a8d141f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:48.145330 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e718067c-c7a6-406a-82c0-48591a8d141f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1695 microversion: 2.1 time: 0.520789 Oct 04 18:41:48.146093 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3191/6389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:47 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1695 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:48.155022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3f518304-d67a-446e-83c1-483e5ae62caa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:48.175683 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f518304-d67a-446e-83c1-483e5ae62caa tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1290 microversion: 2.1 time: 0.377938 Oct 04 18:41:48.177924 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3199/6390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:47 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1290 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:49.169802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a296d3e5-e6dc-4235-b2c7-26e4b2cf95b7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:49.171506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a296d3e5-e6dc-4235-b2c7-26e4b2cf95b7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:49.188985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a296d3e5-e6dc-4235-b2c7-26e4b2cf95b7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:49.189563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a296d3e5-e6dc-4235-b2c7-26e4b2cf95b7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:49.190190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a296d3e5-e6dc-4235-b2c7-26e4b2cf95b7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:49.191447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a296d3e5-e6dc-4235-b2c7-26e4b2cf95b7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:49.192182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a296d3e5-e6dc-4235-b2c7-26e4b2cf95b7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:49.192979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a296d3e5-e6dc-4235-b2c7-26e4b2cf95b7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:49.207152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4131ff14-0cc6-45b9-bd1a-ace4a10735d8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:49.208397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4131ff14-0cc6-45b9-bd1a-ace4a10735d8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:49.244442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4131ff14-0cc6-45b9-bd1a-ace4a10735d8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:49.246414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4131ff14-0cc6-45b9-bd1a-ace4a10735d8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:49.247569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4131ff14-0cc6-45b9-bd1a-ace4a10735d8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:49.252185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4131ff14-0cc6-45b9-bd1a-ace4a10735d8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:49.256905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4131ff14-0cc6-45b9-bd1a-ace4a10735d8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:49.257585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4131ff14-0cc6-45b9-bd1a-ace4a10735d8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:49.428334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4131ff14-0cc6-45b9-bd1a-ace4a10735d8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:49.444118 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4131ff14-0cc6-45b9-bd1a-ace4a10735d8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1352 microversion: 2.1 time: 0.242867 Oct 04 18:41:49.444708 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3200/6391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:49 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1352 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:49.544425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a296d3e5-e6dc-4235-b2c7-26e4b2cf95b7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:49.554436 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a296d3e5-e6dc-4235-b2c7-26e4b2cf95b7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1694 microversion: 2.1 time: 0.388809 Oct 04 18:41:49.562202 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3192/6392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:49 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1694 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:49.818734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e44576a8-d39a-43ee-91f5-540c1a4787d5 req-e62e49dc-cd53-4cbc-a405-f193746c4849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "name": "network-vif-unplugged", "status": "completed", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:49.829757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e44576a8-d39a-43ee-91f5-540c1a4787d5 req-e62e49dc-cd53-4cbc-a405-f193746c4849 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:49.830619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e44576a8-d39a-43ee-91f5-540c1a4787d5 req-e62e49dc-cd53-4cbc-a405-f193746c4849 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:49.831327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e44576a8-d39a-43ee-91f5-540c1a4787d5 req-e62e49dc-cd53-4cbc-a405-f193746c4849 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:49.846328 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e44576a8-d39a-43ee-91f5-540c1a4787d5 req-e62e49dc-cd53-4cbc-a405-f193746c4849 service nova] Creating event network-vif-unplugged:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h1-850499-14 Oct 04 18:41:49.853942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-e44576a8-d39a-43ee-91f5-540c1a4787d5 req-e62e49dc-cd53-4cbc-a405-f193746c4849 service nova] Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:41:49.868403 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e44576a8-d39a-43ee-91f5-540c1a4787d5 req-e62e49dc-cd53-4cbc-a405-f193746c4849 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.272119 Oct 04 18:41:49.869941 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3201/6393] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:50.474781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7dee0464-0a01-46cf-875f-e86b449f1d17 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:50.476404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7dee0464-0a01-46cf-875f-e86b449f1d17 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:50.504418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dee0464-0a01-46cf-875f-e86b449f1d17 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:50.504958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dee0464-0a01-46cf-875f-e86b449f1d17 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:50.505777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dee0464-0a01-46cf-875f-e86b449f1d17 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:50.506690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dee0464-0a01-46cf-875f-e86b449f1d17 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:50.507378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dee0464-0a01-46cf-875f-e86b449f1d17 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:50.508162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dee0464-0a01-46cf-875f-e86b449f1d17 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:50.586643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f80dcce6-e9a7-4c2d-ad51-a31bde40084a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:50.588633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f80dcce6-e9a7-4c2d-ad51-a31bde40084a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:50.590903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=46 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:50.609220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80dcce6-e9a7-4c2d-ad51-a31bde40084a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:50.610116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80dcce6-e9a7-4c2d-ad51-a31bde40084a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:50.610811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80dcce6-e9a7-4c2d-ad51-a31bde40084a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:50.611777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80dcce6-e9a7-4c2d-ad51-a31bde40084a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:50.612457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80dcce6-e9a7-4c2d-ad51-a31bde40084a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:50.613107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f80dcce6-e9a7-4c2d-ad51-a31bde40084a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:50.906621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7dee0464-0a01-46cf-875f-e86b449f1d17 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:50.923556 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7dee0464-0a01-46cf-875f-e86b449f1d17 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1471 microversion: 2.1 time: 0.454667 Oct 04 18:41:50.924646 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3193/6394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:50 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1471 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:50.990481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f80dcce6-e9a7-4c2d-ad51-a31bde40084a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:51.001366 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f80dcce6-e9a7-4c2d-ad51-a31bde40084a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1694 microversion: 2.1 time: 0.420061 Oct 04 18:41:51.002470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3202/6395] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:50 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1694 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:51.508086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c287fe88-3e75-4680-b13c-a10e3bdf7a49 req-d424a2cb-7932-45d5-80c5-657340c7f7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d936ebba-97f4-43eb-9ce6-74b4040c5a4c", "tag": "7dd9edfd-c0cf-4ec3-9e0e-1c98211ff2ba"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:51.553420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:51.559282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c287fe88-3e75-4680-b13c-a10e3bdf7a49 req-d424a2cb-7932-45d5-80c5-657340c7f7a1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.559811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c287fe88-3e75-4680-b13c-a10e3bdf7a49 req-d424a2cb-7932-45d5-80c5-657340c7f7a1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.560256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c287fe88-3e75-4680-b13c-a10e3bdf7a49 req-d424a2cb-7932-45d5-80c5-657340c7f7a1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.584660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:51.610975 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c287fe88-3e75-4680-b13c-a10e3bdf7a49 req-d424a2cb-7932-45d5-80c5-657340c7f7a1 service nova] Creating event network-changed:7dd9edfd-c0cf-4ec3-9e0e-1c98211ff2ba for instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c on n-h2-850499-14 Oct 04 18:41:51.624601 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c287fe88-3e75-4680-b13c-a10e3bdf7a49 req-d424a2cb-7932-45d5-80c5-657340c7f7a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127320 Oct 04 18:41:51.625230 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3194/6396] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:41:51.903992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-94920657-881a-47b0-88ba-6928699573f3 req-348f08ee-58ab-4c83-ad33-a09ed512b6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:51.916312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-94920657-881a-47b0-88ba-6928699573f3 req-348f08ee-58ab-4c83-ad33-a09ed512b6db service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.917759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-94920657-881a-47b0-88ba-6928699573f3 req-348f08ee-58ab-4c83-ad33-a09ed512b6db service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.918626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-94920657-881a-47b0-88ba-6928699573f3 req-348f08ee-58ab-4c83-ad33-a09ed512b6db service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.949085 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-94920657-881a-47b0-88ba-6928699573f3 req-348f08ee-58ab-4c83-ad33-a09ed512b6db service nova] Creating event network-changed:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h1-850499-14 Oct 04 18:41:51.951823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1598a18a-366d-4f5b-86e6-2092852919a3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:51.952273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1598a18a-366d-4f5b-86e6-2092852919a3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:51.958466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-94920657-881a-47b0-88ba-6928699573f3 req-348f08ee-58ab-4c83-ad33-a09ed512b6db service nova] Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:41:51.990347 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-94920657-881a-47b0-88ba-6928699573f3 req-348f08ee-58ab-4c83-ad33-a09ed512b6db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101003 Oct 04 18:41:51.990560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1598a18a-366d-4f5b-86e6-2092852919a3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.991194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1598a18a-366d-4f5b-86e6-2092852919a3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.991655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1598a18a-366d-4f5b-86e6-2092852919a3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.996949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1598a18a-366d-4f5b-86e6-2092852919a3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.997561 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3203/6397] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:41:51.997997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1598a18a-366d-4f5b-86e6-2092852919a3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.998661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1598a18a-366d-4f5b-86e6-2092852919a3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.043048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a506c39-a1b1-4810-8805-1659b0aa3971 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:52.047918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a506c39-a1b1-4810-8805-1659b0aa3971 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:52.079339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a506c39-a1b1-4810-8805-1659b0aa3971 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.079855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a506c39-a1b1-4810-8805-1659b0aa3971 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.084229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a506c39-a1b1-4810-8805-1659b0aa3971 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.086439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a506c39-a1b1-4810-8805-1659b0aa3971 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.091239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a506c39-a1b1-4810-8805-1659b0aa3971 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.091783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a506c39-a1b1-4810-8805-1659b0aa3971 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.796490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a506c39-a1b1-4810-8805-1659b0aa3971 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:52.815316 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a506c39-a1b1-4810-8805-1659b0aa3971 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1692 microversion: 2.1 time: 0.790052 Oct 04 18:41:52.826176 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3204/6398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:52 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1692 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:52.863614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1598a18a-366d-4f5b-86e6-2092852919a3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:52.886655 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1598a18a-366d-4f5b-86e6-2092852919a3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1471 microversion: 2.1 time: 0.942506 Oct 04 18:41:52.907004 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3195/6399] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:51 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1471 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:53.859994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6f84462f-534c-428b-babe-07ca45bad1c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:53.863323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6f84462f-534c-428b-babe-07ca45bad1c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:53.897186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f84462f-534c-428b-babe-07ca45bad1c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.901974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f84462f-534c-428b-babe-07ca45bad1c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.905281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f84462f-534c-428b-babe-07ca45bad1c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.907284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f84462f-534c-428b-babe-07ca45bad1c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.908210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f84462f-534c-428b-babe-07ca45bad1c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.908876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f84462f-534c-428b-babe-07ca45bad1c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.917204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b5e1090c-1bdf-4693-8bf8-ca6e7b028951 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:53.917832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b5e1090c-1bdf-4693-8bf8-ca6e7b028951 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:53.938364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5e1090c-1bdf-4693-8bf8-ca6e7b028951 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.938979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5e1090c-1bdf-4693-8bf8-ca6e7b028951 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.943672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5e1090c-1bdf-4693-8bf8-ca6e7b028951 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.946337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5e1090c-1bdf-4693-8bf8-ca6e7b028951 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.946839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5e1090c-1bdf-4693-8bf8-ca6e7b028951 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.947340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5e1090c-1bdf-4693-8bf8-ca6e7b028951 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.511635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6f84462f-534c-428b-babe-07ca45bad1c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:54.525896 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6f84462f-534c-428b-babe-07ca45bad1c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1692 microversion: 2.1 time: 0.677391 Oct 04 18:41:54.526509 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3205/6400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:53 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1692 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:54.539276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b5e1090c-1bdf-4693-8bf8-ca6e7b028951 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:54.544468 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b5e1090c-1bdf-4693-8bf8-ca6e7b028951 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1471 microversion: 2.1 time: 0.627755 Oct 04 18:41:54.545101 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3196/6401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:53 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1471 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:55.556550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ac1ef548-586e-466a-a44d-6b483bf224d7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:55.558809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ac1ef548-586e-466a-a44d-6b483bf224d7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:55.573054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5efd4de4-b841-471e-82f1-6feba350740a tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:55.574152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5efd4de4-b841-471e-82f1-6feba350740a tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:55.577195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:55.586531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:55.596730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac1ef548-586e-466a-a44d-6b483bf224d7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.601125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac1ef548-586e-466a-a44d-6b483bf224d7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.603823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac1ef548-586e-466a-a44d-6b483bf224d7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.605196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac1ef548-586e-466a-a44d-6b483bf224d7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.606817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac1ef548-586e-466a-a44d-6b483bf224d7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.610634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ac1ef548-586e-466a-a44d-6b483bf224d7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.611686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:55.613035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efd4de4-b841-471e-82f1-6feba350740a tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.616842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efd4de4-b841-471e-82f1-6feba350740a tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.620305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efd4de4-b841-471e-82f1-6feba350740a tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.621514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efd4de4-b841-471e-82f1-6feba350740a tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.622247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efd4de4-b841-471e-82f1-6feba350740a tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.626403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5efd4de4-b841-471e-82f1-6feba350740a tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.053361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5efd4de4-b841-471e-82f1-6feba350740a tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:56.070304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5efd4de4-b841-471e-82f1-6feba350740a tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1471 microversion: 2.1 time: 0.503409 Oct 04 18:41:56.071334 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3197/6402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:55 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1471 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:56.089753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ac1ef548-586e-466a-a44d-6b483bf224d7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:56.105659 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ac1ef548-586e-466a-a44d-6b483bf224d7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1689 microversion: 2.1 time: 0.557604 Oct 04 18:41:56.108286 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3206/6403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:55 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1689 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:56.143744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a3a3d185-9ae6-41e7-8f7d-ff4cadf9fbd1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:56.144975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a3a3d185-9ae6-41e7-8f7d-ff4cadf9fbd1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:56.174187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3a3d185-9ae6-41e7-8f7d-ff4cadf9fbd1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.180409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3a3d185-9ae6-41e7-8f7d-ff4cadf9fbd1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.181477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3a3d185-9ae6-41e7-8f7d-ff4cadf9fbd1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.184101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3a3d185-9ae6-41e7-8f7d-ff4cadf9fbd1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.190721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3a3d185-9ae6-41e7-8f7d-ff4cadf9fbd1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.191535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3a3d185-9ae6-41e7-8f7d-ff4cadf9fbd1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.490287 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a3a3d185-9ae6-41e7-8f7d-ff4cadf9fbd1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action" status: 202 len: 0 microversion: 2.1 time: 0.349098 Oct 04 18:41:56.491958 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3198/6404] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:56 2022] POST /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:56.504040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a4961973-7a19-499d-b101-773590cda01c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:56.504677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a4961973-7a19-499d-b101-773590cda01c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:56.522737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4961973-7a19-499d-b101-773590cda01c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.523460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4961973-7a19-499d-b101-773590cda01c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.527476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4961973-7a19-499d-b101-773590cda01c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.529117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4961973-7a19-499d-b101-773590cda01c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.529596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4961973-7a19-499d-b101-773590cda01c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.530049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4961973-7a19-499d-b101-773590cda01c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.931616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a4961973-7a19-499d-b101-773590cda01c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:56.954323 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a4961973-7a19-499d-b101-773590cda01c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1688 microversion: 2.1 time: 0.455911 Oct 04 18:41:56.964799 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3207/6405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:56 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1688 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:57.109984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99d20ca8-0452-45bb-888c-9961cb2843a8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:57.111542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99d20ca8-0452-45bb-888c-9961cb2843a8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:57.128132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99d20ca8-0452-45bb-888c-9961cb2843a8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.128989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99d20ca8-0452-45bb-888c-9961cb2843a8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.131352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99d20ca8-0452-45bb-888c-9961cb2843a8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.134763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99d20ca8-0452-45bb-888c-9961cb2843a8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.135316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99d20ca8-0452-45bb-888c-9961cb2843a8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.136506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99d20ca8-0452-45bb-888c-9961cb2843a8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.513650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-99d20ca8-0452-45bb-888c-9961cb2843a8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:57.525714 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99d20ca8-0452-45bb-888c-9961cb2843a8 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1471 microversion: 2.1 time: 0.422246 Oct 04 18:41:57.527532 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3199/6406] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:57 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:57.983120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-48744f6d-195e-4726-9eb8-fe9f201fd8a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:57.984685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-48744f6d-195e-4726-9eb8-fe9f201fd8a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:57.998152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48744f6d-195e-4726-9eb8-fe9f201fd8a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.998655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48744f6d-195e-4726-9eb8-fe9f201fd8a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.999450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48744f6d-195e-4726-9eb8-fe9f201fd8a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.002562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48744f6d-195e-4726-9eb8-fe9f201fd8a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.003729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48744f6d-195e-4726-9eb8-fe9f201fd8a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.004540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-48744f6d-195e-4726-9eb8-fe9f201fd8a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.146930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-66e54ecf-f151-473e-8856-47d3412e6e12 req-2d53ea5a-d1ad-4eba-88f4-bcf2e8b46e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "name": "network-vif-plugged", "status": "completed", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:58.173757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-66e54ecf-f151-473e-8856-47d3412e6e12 req-2d53ea5a-d1ad-4eba-88f4-bcf2e8b46e8f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.176745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-66e54ecf-f151-473e-8856-47d3412e6e12 req-2d53ea5a-d1ad-4eba-88f4-bcf2e8b46e8f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.176745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-66e54ecf-f151-473e-8856-47d3412e6e12 req-2d53ea5a-d1ad-4eba-88f4-bcf2e8b46e8f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.212898 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-66e54ecf-f151-473e-8856-47d3412e6e12 req-2d53ea5a-d1ad-4eba-88f4-bcf2e8b46e8f service nova] Creating event network-vif-plugged:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h1-850499-14 Oct 04 18:41:58.227166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-66e54ecf-f151-473e-8856-47d3412e6e12 req-2d53ea5a-d1ad-4eba-88f4-bcf2e8b46e8f service nova] Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:41:58.276855 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-66e54ecf-f151-473e-8856-47d3412e6e12 req-2d53ea5a-d1ad-4eba-88f4-bcf2e8b46e8f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136840 Oct 04 18:41:58.277479 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3200/6407] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:41:58.287634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-48744f6d-195e-4726-9eb8-fe9f201fd8a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:58.302919 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-48744f6d-195e-4726-9eb8-fe9f201fd8a3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1688 microversion: 2.1 time: 0.323895 Oct 04 18:41:58.306556 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3208/6408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:57 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1688 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:58.560221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab32ed3b-afa6-4545-a76f-1324916933b7 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:58.561215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ab32ed3b-afa6-4545-a76f-1324916933b7 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:58.578938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab32ed3b-afa6-4545-a76f-1324916933b7 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.579453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab32ed3b-afa6-4545-a76f-1324916933b7 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.579930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab32ed3b-afa6-4545-a76f-1324916933b7 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.580609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab32ed3b-afa6-4545-a76f-1324916933b7 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.581074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab32ed3b-afa6-4545-a76f-1324916933b7 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.581493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab32ed3b-afa6-4545-a76f-1324916933b7 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.735068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ab32ed3b-afa6-4545-a76f-1324916933b7 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:58.743460 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ab32ed3b-afa6-4545-a76f-1324916933b7 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1471 microversion: 2.1 time: 0.191152 Oct 04 18:41:58.744738 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3201/6409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:58 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:59.096556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d518d04d-5219-4c27-b69f-ada6e0c5585d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.097071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d518d04d-5219-4c27-b69f-ada6e0c5585d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:59.104591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d518d04d-5219-4c27-b69f-ada6e0c5585d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.105086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d518d04d-5219-4c27-b69f-ada6e0c5585d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.105533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d518d04d-5219-4c27-b69f-ada6e0c5585d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.106303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d518d04d-5219-4c27-b69f-ada6e0c5585d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.106686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d518d04d-5219-4c27-b69f-ada6e0c5585d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.107249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d518d04d-5219-4c27-b69f-ada6e0c5585d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.196389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-d518d04d-5219-4c27-b69f-ada6e0c5585d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lazy-loading 'services' on Instance uuid 580fc9e2-01e2-4204-810b-4d145c9432a2 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:59.280010 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d518d04d-5219-4c27-b69f-ada6e0c5585d tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "DELETE /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2/os-volume_attachments/aa4b3537-7a08-4ccd-9e7e-5fb191fe6ff4" status: 202 len: 0 microversion: 2.1 time: 0.186521 Oct 04 18:41:59.280992 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3209/6410] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 18:41:59 2022] DELETE /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2/os-volume_attachments/aa4b3537-7a08-4ccd-9e7e-5fb191fe6ff4 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:59.342560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e7ebc52-2110-4fbc-8767-a406bef33579 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.343349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e7ebc52-2110-4fbc-8767-a406bef33579 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:59.353825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e7ebc52-2110-4fbc-8767-a406bef33579 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.354753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e7ebc52-2110-4fbc-8767-a406bef33579 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.355430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e7ebc52-2110-4fbc-8767-a406bef33579 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.356355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e7ebc52-2110-4fbc-8767-a406bef33579 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.357333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e7ebc52-2110-4fbc-8767-a406bef33579 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.357832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e7ebc52-2110-4fbc-8767-a406bef33579 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.517437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7e7ebc52-2110-4fbc-8767-a406bef33579 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:59.528570 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e7ebc52-2110-4fbc-8767-a406bef33579 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1688 microversion: 2.1 time: 0.200784 Oct 04 18:41:59.529681 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3202/6411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:59 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:59.767623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2ba735f-d1c9-41e2-a42d-4a1ecc9e770b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.768487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2ba735f-d1c9-41e2-a42d-4a1ecc9e770b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:59.779741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ba735f-d1c9-41e2-a42d-4a1ecc9e770b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.780245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ba735f-d1c9-41e2-a42d-4a1ecc9e770b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.780680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ba735f-d1c9-41e2-a42d-4a1ecc9e770b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.784257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ba735f-d1c9-41e2-a42d-4a1ecc9e770b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.785098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ba735f-d1c9-41e2-a42d-4a1ecc9e770b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.791627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2ba735f-d1c9-41e2-a42d-4a1ecc9e770b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.982719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2ba735f-d1c9-41e2-a42d-4a1ecc9e770b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:59.994382 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2ba735f-d1c9-41e2-a42d-4a1ecc9e770b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1471 microversion: 2.1 time: 0.231435 Oct 04 18:41:59.995365 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3210/6412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:59 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:00.307650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-86ba37ae-e231-4b10-9a75-05f2fd91a835 req-9479e06d-83cf-48a6-89e3-3f9e47ef814b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d936ebba-97f4-43eb-9ce6-74b4040c5a4c", "name": "network-vif-plugged", "status": "completed", "tag": "7dd9edfd-c0cf-4ec3-9e0e-1c98211ff2ba"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:00.319701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-86ba37ae-e231-4b10-9a75-05f2fd91a835 req-9479e06d-83cf-48a6-89e3-3f9e47ef814b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.320557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-86ba37ae-e231-4b10-9a75-05f2fd91a835 req-9479e06d-83cf-48a6-89e3-3f9e47ef814b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.321269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-86ba37ae-e231-4b10-9a75-05f2fd91a835 req-9479e06d-83cf-48a6-89e3-3f9e47ef814b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.346824 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-86ba37ae-e231-4b10-9a75-05f2fd91a835 req-9479e06d-83cf-48a6-89e3-3f9e47ef814b service nova] Creating event network-vif-plugged:7dd9edfd-c0cf-4ec3-9e0e-1c98211ff2ba for instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c on n-h2-850499-14 Oct 04 18:42:00.356856 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-86ba37ae-e231-4b10-9a75-05f2fd91a835 req-9479e06d-83cf-48a6-89e3-3f9e47ef814b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060209 Oct 04 18:42:00.361597 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3203/6413] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:00.555170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-55a238fe-1b1b-41cf-a341-b1002df7ae0b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:00.555965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-55a238fe-1b1b-41cf-a341-b1002df7ae0b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:00.574777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55a238fe-1b1b-41cf-a341-b1002df7ae0b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.576741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55a238fe-1b1b-41cf-a341-b1002df7ae0b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.578789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55a238fe-1b1b-41cf-a341-b1002df7ae0b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.580042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55a238fe-1b1b-41cf-a341-b1002df7ae0b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.580239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55a238fe-1b1b-41cf-a341-b1002df7ae0b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.582154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55a238fe-1b1b-41cf-a341-b1002df7ae0b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.816528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-55a238fe-1b1b-41cf-a341-b1002df7ae0b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:00.827638 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-55a238fe-1b1b-41cf-a341-b1002df7ae0b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1688 microversion: 2.1 time: 0.277198 Oct 04 18:42:00.835284 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3211/6414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:00 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1688 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:01.010668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5aab1abd-b7f2-42f6-bb65-478f7487845d req-081ecb67-e24e-42c4-8d50-1a5d7f800417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "name": "network-vif-unplugged", "status": "completed", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:01.021951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5aab1abd-b7f2-42f6-bb65-478f7487845d req-081ecb67-e24e-42c4-8d50-1a5d7f800417 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.022890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5aab1abd-b7f2-42f6-bb65-478f7487845d req-081ecb67-e24e-42c4-8d50-1a5d7f800417 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.023561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5aab1abd-b7f2-42f6-bb65-478f7487845d req-081ecb67-e24e-42c4-8d50-1a5d7f800417 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.025677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bda420e2-c206-4764-8a13-01e4e47208de tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:01.026191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bda420e2-c206-4764-8a13-01e4e47208de tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:01.034894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda420e2-c206-4764-8a13-01e4e47208de tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.035827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda420e2-c206-4764-8a13-01e4e47208de tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.036442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda420e2-c206-4764-8a13-01e4e47208de tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.037835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda420e2-c206-4764-8a13-01e4e47208de tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.038500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda420e2-c206-4764-8a13-01e4e47208de tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.039626 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5aab1abd-b7f2-42f6-bb65-478f7487845d req-081ecb67-e24e-42c4-8d50-1a5d7f800417 service nova] Creating event network-vif-unplugged:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h2-850499-14 Oct 04 18:42:01.039780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bda420e2-c206-4764-8a13-01e4e47208de tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.048168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-5aab1abd-b7f2-42f6-bb65-478f7487845d req-081ecb67-e24e-42c4-8d50-1a5d7f800417 service nova] Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:42:01.062582 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5aab1abd-b7f2-42f6-bb65-478f7487845d req-081ecb67-e24e-42c4-8d50-1a5d7f800417 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057329 Oct 04 18:42:01.063838 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3204/6415] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:01.252380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bda420e2-c206-4764-8a13-01e4e47208de tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:01.262543 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bda420e2-c206-4764-8a13-01e4e47208de tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1471 microversion: 2.1 time: 0.242841 Oct 04 18:42:01.263580 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3212/6416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:01 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:01.854916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a1b871c8-8ddf-431c-8d30-dd6c1b4440cc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:01.855522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a1b871c8-8ddf-431c-8d30-dd6c1b4440cc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:01.863214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1b871c8-8ddf-431c-8d30-dd6c1b4440cc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.863720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1b871c8-8ddf-431c-8d30-dd6c1b4440cc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.864167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1b871c8-8ddf-431c-8d30-dd6c1b4440cc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.864878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1b871c8-8ddf-431c-8d30-dd6c1b4440cc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.865338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1b871c8-8ddf-431c-8d30-dd6c1b4440cc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.865768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1b871c8-8ddf-431c-8d30-dd6c1b4440cc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.056915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a1b871c8-8ddf-431c-8d30-dd6c1b4440cc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:02.074216 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a1b871c8-8ddf-431c-8d30-dd6c1b4440cc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1688 microversion: 2.1 time: 0.224868 Oct 04 18:42:02.089162 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3205/6417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:01 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1688 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:02.288044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-52495705-fb67-4f8e-adeb-f128b9841834 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:02.288593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-52495705-fb67-4f8e-adeb-f128b9841834 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:02.296831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52495705-fb67-4f8e-adeb-f128b9841834 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.297601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52495705-fb67-4f8e-adeb-f128b9841834 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.298200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52495705-fb67-4f8e-adeb-f128b9841834 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.299098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52495705-fb67-4f8e-adeb-f128b9841834 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.299561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52495705-fb67-4f8e-adeb-f128b9841834 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.299986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-52495705-fb67-4f8e-adeb-f128b9841834 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.483718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-52495705-fb67-4f8e-adeb-f128b9841834 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:02.511430 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-52495705-fb67-4f8e-adeb-f128b9841834 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1471 microversion: 2.1 time: 0.227230 Oct 04 18:42:02.511808 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3213/6418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:02 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:03.092361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-02d28be3-d47e-4daa-b1d7-3785357b5b4b req-3bcff143-0c04-4969-89fe-08332f79d631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:03.098820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9c89f58a-a181-440a-85aa-8c0bf4748ede tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:03.099478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9c89f58a-a181-440a-85aa-8c0bf4748ede tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:03.105504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-02d28be3-d47e-4daa-b1d7-3785357b5b4b req-3bcff143-0c04-4969-89fe-08332f79d631 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.106119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-02d28be3-d47e-4daa-b1d7-3785357b5b4b req-3bcff143-0c04-4969-89fe-08332f79d631 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.106238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c89f58a-a181-440a-85aa-8c0bf4748ede tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.106622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c89f58a-a181-440a-85aa-8c0bf4748ede tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.106842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-02d28be3-d47e-4daa-b1d7-3785357b5b4b req-3bcff143-0c04-4969-89fe-08332f79d631 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.107098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c89f58a-a181-440a-85aa-8c0bf4748ede tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.107806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c89f58a-a181-440a-85aa-8c0bf4748ede tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.108269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c89f58a-a181-440a-85aa-8c0bf4748ede tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.108701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c89f58a-a181-440a-85aa-8c0bf4748ede tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.111589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:03.120296 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-02d28be3-d47e-4daa-b1d7-3785357b5b4b req-3bcff143-0c04-4969-89fe-08332f79d631 service nova] Creating event network-changed:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h2-850499-14 Oct 04 18:42:03.127473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-02d28be3-d47e-4daa-b1d7-3785357b5b4b req-3bcff143-0c04-4969-89fe-08332f79d631 service nova] Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:42:03.146759 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-02d28be3-d47e-4daa-b1d7-3785357b5b4b req-3bcff143-0c04-4969-89fe-08332f79d631 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060477 Oct 04 18:42:03.155401 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3206/6419] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:03.393396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9c89f58a-a181-440a-85aa-8c0bf4748ede tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:03.407455 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9c89f58a-a181-440a-85aa-8c0bf4748ede tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1688 microversion: 2.1 time: 0.312317 Oct 04 18:42:03.408046 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3214/6420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:03 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1688 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:03.537535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ef17c072-d1be-4908-8f27-cc7e50442168 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:03.538427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ef17c072-d1be-4908-8f27-cc7e50442168 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:03.548113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef17c072-d1be-4908-8f27-cc7e50442168 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.549050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef17c072-d1be-4908-8f27-cc7e50442168 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.550101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef17c072-d1be-4908-8f27-cc7e50442168 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.551696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef17c072-d1be-4908-8f27-cc7e50442168 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.552333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef17c072-d1be-4908-8f27-cc7e50442168 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.552926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ef17c072-d1be-4908-8f27-cc7e50442168 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.867999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ef17c072-d1be-4908-8f27-cc7e50442168 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:03.878392 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ef17c072-d1be-4908-8f27-cc7e50442168 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1644 microversion: 2.1 time: 0.345336 Oct 04 18:42:03.879275 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3207/6421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:03 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1644 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:03.902934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8196dd4a-af93-4922-b71a-9a7329549591 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:03.904029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8196dd4a-af93-4922-b71a-9a7329549591 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:03.910515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8196dd4a-af93-4922-b71a-9a7329549591 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.911546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8196dd4a-af93-4922-b71a-9a7329549591 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.911993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8196dd4a-af93-4922-b71a-9a7329549591 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.912712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8196dd4a-af93-4922-b71a-9a7329549591 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.913169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8196dd4a-af93-4922-b71a-9a7329549591 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.913598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8196dd4a-af93-4922-b71a-9a7329549591 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.088603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8196dd4a-af93-4922-b71a-9a7329549591 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:04.105216 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8196dd4a-af93-4922-b71a-9a7329549591 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1644 microversion: 2.1 time: 0.206996 Oct 04 18:42:04.106333 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3215/6422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:03 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1644 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:04.137702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75a45eb9-282d-409c-869e-a36c2a944b1d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:04.138545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75a45eb9-282d-409c-869e-a36c2a944b1d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:04.148114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75a45eb9-282d-409c-869e-a36c2a944b1d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.148114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75a45eb9-282d-409c-869e-a36c2a944b1d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.148114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75a45eb9-282d-409c-869e-a36c2a944b1d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.149021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75a45eb9-282d-409c-869e-a36c2a944b1d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.149692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75a45eb9-282d-409c-869e-a36c2a944b1d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.150314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75a45eb9-282d-409c-869e-a36c2a944b1d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.434026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a950a8d-87f3-41d8-8681-5dc2da95b01f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:04.435397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a950a8d-87f3-41d8-8681-5dc2da95b01f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:04.467034 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75a45eb9-282d-409c-869e-a36c2a944b1d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1797 microversion: 2.1 time: 0.333606 Oct 04 18:42:04.467676 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3208/6423] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:04 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1797 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:04.474468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a950a8d-87f3-41d8-8681-5dc2da95b01f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.475175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a950a8d-87f3-41d8-8681-5dc2da95b01f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.475829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a950a8d-87f3-41d8-8681-5dc2da95b01f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.477634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a950a8d-87f3-41d8-8681-5dc2da95b01f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:04.478252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a950a8d-87f3-41d8-8681-5dc2da95b01f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:04.478844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a950a8d-87f3-41d8-8681-5dc2da95b01f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:04.655325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9a950a8d-87f3-41d8-8681-5dc2da95b01f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:04.668299 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a950a8d-87f3-41d8-8681-5dc2da95b01f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1688 microversion: 2.1 time: 0.239721 Oct 04 18:42:04.669114 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3216/6424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:04 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1688 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:05.696248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4432d8a-a0da-49e7-a34b-7c89fc6063dd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:05.698534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f4432d8a-a0da-49e7-a34b-7c89fc6063dd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:05.711037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4432d8a-a0da-49e7-a34b-7c89fc6063dd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.712020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4432d8a-a0da-49e7-a34b-7c89fc6063dd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.713508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4432d8a-a0da-49e7-a34b-7c89fc6063dd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.716986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4432d8a-a0da-49e7-a34b-7c89fc6063dd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.718475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4432d8a-a0da-49e7-a34b-7c89fc6063dd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.720194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4432d8a-a0da-49e7-a34b-7c89fc6063dd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.892641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-42bdbad2-ccb6-4c9f-9de2-3a11977ff10e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:05.893151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-42bdbad2-ccb6-4c9f-9de2-3a11977ff10e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:05.901678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42bdbad2-ccb6-4c9f-9de2-3a11977ff10e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.902183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42bdbad2-ccb6-4c9f-9de2-3a11977ff10e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.902634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42bdbad2-ccb6-4c9f-9de2-3a11977ff10e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.903434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42bdbad2-ccb6-4c9f-9de2-3a11977ff10e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.903902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42bdbad2-ccb6-4c9f-9de2-3a11977ff10e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.904333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-42bdbad2-ccb6-4c9f-9de2-3a11977ff10e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.935420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-42bdbad2-ccb6-4c9f-9de2-3a11977ff10e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:05.952343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f4432d8a-a0da-49e7-a34b-7c89fc6063dd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:05.976706 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f4432d8a-a0da-49e7-a34b-7c89fc6063dd tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1688 microversion: 2.1 time: 0.283893 Oct 04 18:42:05.978884 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3209/6425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:05 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1688 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:06.062709 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-42bdbad2-ccb6-4c9f-9de2-3a11977ff10e tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "DELETE /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 204 len: 0 microversion: 2.1 time: 0.173711 Oct 04 18:42:06.063845 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3217/6426] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:05 2022] DELETE /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:06.072905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b0a89f55-8da7-4054-808b-ee7fbdd2d913 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:06.073811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b0a89f55-8da7-4054-808b-ee7fbdd2d913 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:06.081390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0a89f55-8da7-4054-808b-ee7fbdd2d913 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.082020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0a89f55-8da7-4054-808b-ee7fbdd2d913 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.082564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0a89f55-8da7-4054-808b-ee7fbdd2d913 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.083535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0a89f55-8da7-4054-808b-ee7fbdd2d913 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.084372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0a89f55-8da7-4054-808b-ee7fbdd2d913 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.084866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b0a89f55-8da7-4054-808b-ee7fbdd2d913 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.363927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b0a89f55-8da7-4054-808b-ee7fbdd2d913 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:06.377666 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b0a89f55-8da7-4054-808b-ee7fbdd2d913 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1513 microversion: 2.1 time: 0.308697 Oct 04 18:42:06.380064 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3210/6427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:06 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:07.004170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c94c19f0-bcf3-407d-ac37-0fb5b04a6dc5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:07.005709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c94c19f0-bcf3-407d-ac37-0fb5b04a6dc5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:07.028500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c94c19f0-bcf3-407d-ac37-0fb5b04a6dc5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.029274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c94c19f0-bcf3-407d-ac37-0fb5b04a6dc5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.029888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c94c19f0-bcf3-407d-ac37-0fb5b04a6dc5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.030793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c94c19f0-bcf3-407d-ac37-0fb5b04a6dc5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.031901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c94c19f0-bcf3-407d-ac37-0fb5b04a6dc5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.032508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c94c19f0-bcf3-407d-ac37-0fb5b04a6dc5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.337194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c94c19f0-bcf3-407d-ac37-0fb5b04a6dc5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:07.349037 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c94c19f0-bcf3-407d-ac37-0fb5b04a6dc5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1681 microversion: 2.1 time: 0.350860 Oct 04 18:42:07.351630 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3218/6428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:06 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1681 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:07.408294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00ea2132-9108-47be-b3e8-e1ed639ad8ee tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:07.409953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00ea2132-9108-47be-b3e8-e1ed639ad8ee tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:07.423210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-9108-47be-b3e8-e1ed639ad8ee tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.424584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-9108-47be-b3e8-e1ed639ad8ee tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.425215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-9108-47be-b3e8-e1ed639ad8ee tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.426913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-9108-47be-b3e8-e1ed639ad8ee tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.427712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-9108-47be-b3e8-e1ed639ad8ee tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.428535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00ea2132-9108-47be-b3e8-e1ed639ad8ee tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.462493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:07.499859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-f64d6137-f88a-4d53-a29b-a5ae806530b8 req-cdfcb796-c15c-4389-bbf0-74b49f2405f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d936ebba-97f4-43eb-9ce6-74b4040c5a4c", "tag": "7dd9edfd-c0cf-4ec3-9e0e-1c98211ff2ba"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:07.542039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f64d6137-f88a-4d53-a29b-a5ae806530b8 req-cdfcb796-c15c-4389-bbf0-74b49f2405f8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.542530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f64d6137-f88a-4d53-a29b-a5ae806530b8 req-cdfcb796-c15c-4389-bbf0-74b49f2405f8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.546865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f64d6137-f88a-4d53-a29b-a5ae806530b8 req-cdfcb796-c15c-4389-bbf0-74b49f2405f8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.573216 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-f64d6137-f88a-4d53-a29b-a5ae806530b8 req-cdfcb796-c15c-4389-bbf0-74b49f2405f8 service nova] Creating event network-changed:7dd9edfd-c0cf-4ec3-9e0e-1c98211ff2ba for instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c on n-h2-850499-14 Oct 04 18:42:07.588547 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-f64d6137-f88a-4d53-a29b-a5ae806530b8 req-cdfcb796-c15c-4389-bbf0-74b49f2405f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101194 Oct 04 18:42:07.589971 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3219/6429] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:07.750399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-00ea2132-9108-47be-b3e8-e1ed639ad8ee tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:07.764873 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-00ea2132-9108-47be-b3e8-e1ed639ad8ee tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1513 microversion: 2.1 time: 0.366771 Oct 04 18:42:07.765474 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3211/6430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:07 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1513 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:08.246462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9959bfcc-6b82-435e-a345-2fa3b423da96 req-2c1b6a9a-65d6-4fd1-b23c-727bf1c176a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "name": "network-vif-plugged", "status": "completed", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:08.265996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9959bfcc-6b82-435e-a345-2fa3b423da96 req-2c1b6a9a-65d6-4fd1-b23c-727bf1c176a8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.266804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9959bfcc-6b82-435e-a345-2fa3b423da96 req-2c1b6a9a-65d6-4fd1-b23c-727bf1c176a8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.267282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9959bfcc-6b82-435e-a345-2fa3b423da96 req-2c1b6a9a-65d6-4fd1-b23c-727bf1c176a8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.307184 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9959bfcc-6b82-435e-a345-2fa3b423da96 req-2c1b6a9a-65d6-4fd1-b23c-727bf1c176a8 service nova] Creating event network-vif-plugged:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h2-850499-14 Oct 04 18:42:08.315059 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9959bfcc-6b82-435e-a345-2fa3b423da96 req-2c1b6a9a-65d6-4fd1-b23c-727bf1c176a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074442 Oct 04 18:42:08.316182 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3220/6431] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:08.740028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ac91f74d-c809-412d-9837-6d66e0bee6da req-d62e53b5-3015-4d77-8876-f37296d81843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580fc9e2-01e2-4204-810b-4d145c9432a2", "name": "network-vif-deleted", "tag": "47061f3c-b25a-481b-8f44-276de8280ee0"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:08.789901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-76a2b9cb-b54b-47c9-b790-537a91992ea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:08.790714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-76a2b9cb-b54b-47c9-b790-537a91992ea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:08.796660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ac91f74d-c809-412d-9837-6d66e0bee6da req-d62e53b5-3015-4d77-8876-f37296d81843 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.809159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ac91f74d-c809-412d-9837-6d66e0bee6da req-d62e53b5-3015-4d77-8876-f37296d81843 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.809802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ac91f74d-c809-412d-9837-6d66e0bee6da req-d62e53b5-3015-4d77-8876-f37296d81843 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.810471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a2b9cb-b54b-47c9-b790-537a91992ea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.813366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a2b9cb-b54b-47c9-b790-537a91992ea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.824077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a2b9cb-b54b-47c9-b790-537a91992ea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.827460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a2b9cb-b54b-47c9-b790-537a91992ea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.830546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a2b9cb-b54b-47c9-b790-537a91992ea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.833573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76a2b9cb-b54b-47c9-b790-537a91992ea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.837236 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ac91f74d-c809-412d-9837-6d66e0bee6da req-d62e53b5-3015-4d77-8876-f37296d81843 service nova] Creating event network-vif-deleted:47061f3c-b25a-481b-8f44-276de8280ee0 for instance 580fc9e2-01e2-4204-810b-4d145c9432a2 on n-h1-850499-14 Oct 04 18:42:08.853068 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ac91f74d-c809-412d-9837-6d66e0bee6da req-d62e53b5-3015-4d77-8876-f37296d81843 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129636 Oct 04 18:42:08.854914 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3212/6432] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:09.014783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-76a2b9cb-b54b-47c9-b790-537a91992ea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bc978004614940b09fa4fed432a192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5150f32c74426b300d4b1de6c0f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:09.027102 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-76a2b9cb-b54b-47c9-b790-537a91992ea0 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 200 len: 1303 microversion: 2.1 time: 0.241605 Oct 04 18:42:09.030240 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3221/6433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:08 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:10.056122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:10.057156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] [instance: 580fc9e2-01e2-4204-810b-4d145c9432a2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:10.073485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.074150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.074673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.075504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.079219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.079961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.115665 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] HTTP exception thrown: Instance 580fc9e2-01e2-4204-810b-4d145c9432a2 could not be found. Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Request method failure captured: Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 HTTP/1.1 Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH2ERp4FrqlIVo6Bkvaj6-PK3F8jzVIhrDV9acYBitF1Ar11ZddkjG-ZV-F_Sj-XzLz8U4M0RbHy0QC9f2QzXJPmATNHpgzXTbhzKXxIbKVq_axiTI4LJzUts9FPI794R5W3VlvwiImK9PwEi49ksqeAuW_Fd_PFsK2r0r2TJkkRvmQ Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 53f5150f32c74426b300d4b1de6c0f59 Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1179290907 Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53f5150f32c74426b300d4b1de6c0f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53f5150f32c74426b300d4b1de6c0f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53f5150f32c74426b300d4b1de6c0f59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53f5150f32c74426b300d4b1de6c0f59"}]}] Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-VolumesSnapshotTestJSON-1179290907 Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 53f5150f32c74426b300d4b1de6c0f59 Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1179290907 Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-VolumesSnapshotTestJSON-1179290907-project Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: c9bc978004614940b09fa4fed432a192 Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-VolumesSnapshotTestJSON-1179290907-project Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 580fc9e2-01e2-4204-810b-4d145c9432a2 could not be found. Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '580fc9e2-01e2-4204-810b-4d145c9432a2'} Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 580fc9e2-01e2-4204-810b-4d145c9432a2 could not be found. Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 580fc9e2-01e2-4204-810b-4d145c9432a2 could not be found. Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:10.118410 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:42:10.123149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:10.123149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:10.123149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:10.123149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:10.123149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:10.123149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 580fc9e2-01e2-4204-810b-4d145c9432a2 could not be found. Oct 04 18:42:10.123149 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:42:10.125446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] Returning 404 to user: Instance 580fc9e2-01e2-4204-810b-4d145c9432a2 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:10.126552 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ac115a0-9a68-445f-8113-ecd00c68be55 tempest-VolumesSnapshotTestJSON-1179290907 tempest-VolumesSnapshotTestJSON-1179290907-project] 10.222.0.18 "GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2" status: 404 len: 111 microversion: 2.1 time: 0.077172 Oct 04 18:42:10.127879 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3213/6434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:10 2022] GET /compute/v2.1/servers/580fc9e2-01e2-4204-810b-4d145c9432a2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:47.748531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1be50c03-3388-48c0-a498-521c8b915d90 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:47.754570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1be50c03-3388-48c0-a498-521c8b915d90 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:47.783507 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:42:47.784018 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 18:42:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action (ip 10.222.0.18) !!! Oct 04 18:42:47.786484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:47.787937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:47.790844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be50c03-3388-48c0-a498-521c8b915d90 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:47.792128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be50c03-3388-48c0-a498-521c8b915d90 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:47.793388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be50c03-3388-48c0-a498-521c8b915d90 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:47.794979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be50c03-3388-48c0-a498-521c8b915d90 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:47.796077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be50c03-3388-48c0-a498-521c8b915d90 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:47.797115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1be50c03-3388-48c0-a498-521c8b915d90 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:47.919164 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1be50c03-3388-48c0-a498-521c8b915d90 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action" status: 200 len: 62904 microversion: 2.1 time: 0.190629 Oct 04 18:42:47.919848 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3222/6435] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:47 2022] POST /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd/action => generated 62904 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:43:10.716516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=43 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:10.721141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:10.734904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2108974b-dc64-496c-b7e3-1f3f5eea6123 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:10.735667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2108974b-dc64-496c-b7e3-1f3f5eea6123 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:10.761875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2108974b-dc64-496c-b7e3-1f3f5eea6123 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.762384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2108974b-dc64-496c-b7e3-1f3f5eea6123 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.762832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2108974b-dc64-496c-b7e3-1f3f5eea6123 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.763602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2108974b-dc64-496c-b7e3-1f3f5eea6123 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.785022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2108974b-dc64-496c-b7e3-1f3f5eea6123 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.787706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2108974b-dc64-496c-b7e3-1f3f5eea6123 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:11.039635 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2108974b-dc64-496c-b7e3-1f3f5eea6123 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1834 microversion: 2.1 time: 0.328794 Oct 04 18:43:11.041696 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3214/6436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:10 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1834 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:13.318460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6965cdcf-48a6-4958-b09b-f847a48e9669 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:13.319363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6965cdcf-48a6-4958-b09b-f847a48e9669 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:13.350607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:13.352606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:13.355890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6965cdcf-48a6-4958-b09b-f847a48e9669 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.357037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6965cdcf-48a6-4958-b09b-f847a48e9669 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.358052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6965cdcf-48a6-4958-b09b-f847a48e9669 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.359215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6965cdcf-48a6-4958-b09b-f847a48e9669 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.360226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6965cdcf-48a6-4958-b09b-f847a48e9669 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.360863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6965cdcf-48a6-4958-b09b-f847a48e9669 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.469146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6965cdcf-48a6-4958-b09b-f847a48e9669 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:43:13.729755 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6965cdcf-48a6-4958-b09b-f847a48e9669 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 204 len: 0 microversion: 2.1 time: 0.416061 Oct 04 18:43:13.730475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5097b2ed-259c-4dae-9bd7-46ffb2e1ac07 req-8f5c987b-ce83-4dde-b3a4-4a96598a8527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:13.738247 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3223/6437] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:43:13 2022] DELETE /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:43:13.752506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-741003b3-1d48-4ff3-a349-ed7221d3b76d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:13.753043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5097b2ed-259c-4dae-9bd7-46ffb2e1ac07 req-8f5c987b-ce83-4dde-b3a4-4a96598a8527 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.753391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-741003b3-1d48-4ff3-a349-ed7221d3b76d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:13.753561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5097b2ed-259c-4dae-9bd7-46ffb2e1ac07 req-8f5c987b-ce83-4dde-b3a4-4a96598a8527 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.755265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5097b2ed-259c-4dae-9bd7-46ffb2e1ac07 req-8f5c987b-ce83-4dde-b3a4-4a96598a8527 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.760733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-741003b3-1d48-4ff3-a349-ed7221d3b76d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.761523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-741003b3-1d48-4ff3-a349-ed7221d3b76d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.762144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-741003b3-1d48-4ff3-a349-ed7221d3b76d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.763088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-741003b3-1d48-4ff3-a349-ed7221d3b76d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.763708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-741003b3-1d48-4ff3-a349-ed7221d3b76d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.764934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-741003b3-1d48-4ff3-a349-ed7221d3b76d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.792970 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5097b2ed-259c-4dae-9bd7-46ffb2e1ac07 req-8f5c987b-ce83-4dde-b3a4-4a96598a8527 service nova] Creating event network-changed:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h2-850499-14 Oct 04 18:43:13.810552 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5097b2ed-259c-4dae-9bd7-46ffb2e1ac07 req-8f5c987b-ce83-4dde-b3a4-4a96598a8527 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.472824 Oct 04 18:43:13.820496 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3215/6438] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:14.052055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-741003b3-1d48-4ff3-a349-ed7221d3b76d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:14.060230 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-741003b3-1d48-4ff3-a349-ed7221d3b76d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1687 microversion: 2.1 time: 0.311832 Oct 04 18:43:14.060825 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3224/6439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:13 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1687 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:15.100701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-91154246-9274-4df9-8f37-b75dc39c071d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:15.105801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-91154246-9274-4df9-8f37-b75dc39c071d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:15.127721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91154246-9274-4df9-8f37-b75dc39c071d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.128379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91154246-9274-4df9-8f37-b75dc39c071d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.128859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91154246-9274-4df9-8f37-b75dc39c071d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.132291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91154246-9274-4df9-8f37-b75dc39c071d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.137582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91154246-9274-4df9-8f37-b75dc39c071d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.138380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91154246-9274-4df9-8f37-b75dc39c071d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.072118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-91154246-9274-4df9-8f37-b75dc39c071d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:16.109905 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-91154246-9274-4df9-8f37-b75dc39c071d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1687 microversion: 2.1 time: 1.001111 Oct 04 18:43:16.111435 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3216/6440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:15 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1687 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:17.142134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1c1389ba-29be-431b-86da-302333875712 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:17.142933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1c1389ba-29be-431b-86da-302333875712 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:17.157885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1389ba-29be-431b-86da-302333875712 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.158404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1389ba-29be-431b-86da-302333875712 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.158865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1389ba-29be-431b-86da-302333875712 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:17.159647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1389ba-29be-431b-86da-302333875712 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.160116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1389ba-29be-431b-86da-302333875712 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.164179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c1389ba-29be-431b-86da-302333875712 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:17.668215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f601e87e-dc5e-45fb-8818-e05d9fc7fe89 req-c029b01e-ccf7-48a7-958d-c803021ccff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bfee65-6918-4e00-b928-42f24fb2d3cd", "name": "network-vif-deleted", "tag": "2b349ef9-27c4-4b88-b594-e6af61a66a3a"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:17.676913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1c1389ba-29be-431b-86da-302333875712 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:17.697861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f601e87e-dc5e-45fb-8818-e05d9fc7fe89 req-c029b01e-ccf7-48a7-958d-c803021ccff6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.699168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f601e87e-dc5e-45fb-8818-e05d9fc7fe89 req-c029b01e-ccf7-48a7-958d-c803021ccff6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.699868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f601e87e-dc5e-45fb-8818-e05d9fc7fe89 req-c029b01e-ccf7-48a7-958d-c803021ccff6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:17.706157 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1c1389ba-29be-431b-86da-302333875712 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 200 len: 1569 microversion: 2.1 time: 0.568260 Oct 04 18:43:17.722343 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f601e87e-dc5e-45fb-8818-e05d9fc7fe89 req-c029b01e-ccf7-48a7-958d-c803021ccff6 service nova] Creating event network-vif-deleted:2b349ef9-27c4-4b88-b594-e6af61a66a3a for instance f3bfee65-6918-4e00-b928-42f24fb2d3cd on n-h2-850499-14 Oct 04 18:43:17.723406 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3225/6441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:17 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 1569 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:17.736503 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f601e87e-dc5e-45fb-8818-e05d9fc7fe89 req-c029b01e-ccf7-48a7-958d-c803021ccff6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074790 Oct 04 18:43:17.737120 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3217/6442] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:18.736351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:18.737907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: f3bfee65-6918-4e00-b928-42f24fb2d3cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:18.749055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.750742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.751952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.753850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.767974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.780232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.876560 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] HTTP exception thrown: Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd could not be found. Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Request method failure captured: Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd HTTP/1.1 Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH0DNQomkqqv-Qu84uLjAqPo6HMqiT1ULGhUmMALAk5Z9X3SuEK_qKUFSYc4VFmbF3awEhHAZ23FKbO0jEHJgn1JglTbqPqA4tXbETY-Pt-M6BRs2GinOvBXhlz9OU805haxcHHt-xDGagC9rXsMJ5AUy9kigxeIRWw5j9S_HaRlp1g Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bfebaa3ef67f42289fa824284a968c42 Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bfebaa3ef67f42289fa824284a968c42"}]}] Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bfebaa3ef67f42289fa824284a968c42 Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestNetworkAdvancedServerOps-145155639-project Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 87e519320e854ce480adcd9de2750bfb Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestNetworkAdvancedServerOps-145155639-project Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd could not be found. Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'f3bfee65-6918-4e00-b928-42f24fb2d3cd'} Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd could not be found. Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd could not be found. Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:43:18.884714 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd could not be found. Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Returning 404 to user: Instance f3bfee65-6918-4e00-b928-42f24fb2d3cd could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ba9cea2-2f11-41de-b604-1c21a4638f83 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd" status: 404 len: 111 microversion: 2.1 time: 0.162410 Oct 04 18:43:18.894499 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3226/6443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:18 2022] GET /compute/v2.1/servers/f3bfee65-6918-4e00-b928-42f24fb2d3cd => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:26.179355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-26cb186d-0e9d-4412-b39f-13a9d12981de tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '.version_select at 0x7fd4d0bd75e0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:26.252671 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-26cb186d-0e9d-4412-b39f-13a9d12981de tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-174911269" status: 202 len: 0 microversion: 2.1 time: 0.079934 Oct 04 18:43:26.253723 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3218/6444] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 4 18:43:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-174911269 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:26.297667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5260ba21-d5e0-4b5a-af0a-b17fbb8cc085 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'create', calling method: .version_select at 0x7fd4d0b428b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1343374886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvbi2LHAvFOFIVQwF81c9JiCT0+YJwhUCmM3/Wi7yLZ6YyeCD4PLGbHVy7usj2iSmMm2tzTEpaNY+DiHiUgHEftgDNwDXADYvs7O1g9YbV7ctr9NvbKKKzqk92KKGE1iA=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:26.341422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-5260ba21-d5e0-4b5a-af0a-b17fbb8cc085 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for project bfebaa3ef67f42289fa824284a968c42. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:26.359634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-5260ba21-d5e0-4b5a-af0a-b17fbb8cc085 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for user 87e519320e854ce480adcd9de2750bfb and project bfebaa3ef67f42289fa824284a968c42. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:26.425534 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5260ba21-d5e0-4b5a-af0a-b17fbb8cc085 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.131769 Oct 04 18:43:26.426876 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3227/6445] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:43:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:41.572758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=16 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:41.574294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:41.600156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1006154111", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "dbe3780f-1476-4468-afb8-a4738dba5734"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1343374886", "security_groups": [{"name": "tempest-secgroup-smoke-562212062"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:42.071932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] validate_networks() for [('dbe3780f-1476-4468-afb8-a4738dba5734', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:43:43.893691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:43.902512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:43.903106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:43.903539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:43.903961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:43.933485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.933485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.933485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.934197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.934615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.935014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.970674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for project bfebaa3ef67f42289fa824284a968c42. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:43.987092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for user 87e519320e854ce480adcd9de2750bfb and project bfebaa3ef67f42289fa824284a968c42. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:44.012605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:44.019372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:44.151556 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9f6d314-2cb9-4639-8d59-f550a13b0694 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.580941 Oct 04 18:43:44.152617 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3219/6446] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:43:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 2583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:43:44.172621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-411ddd4c-46ac-46ed-a9d6-e5b893b70f54 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:44.174473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-411ddd4c-46ac-46ed-a9d6-e5b893b70f54 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:44.202846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:44.203983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:44.204941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:44.344740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-411ddd4c-46ac-46ed-a9d6-e5b893b70f54 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.352493 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-411ddd4c-46ac-46ed-a9d6-e5b893b70f54 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1267 microversion: 2.1 time: 0.191575 Oct 04 18:43:44.355307 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3228/6447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:44 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:45.381219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34257e08-a46c-49ba-98fb-7189cffb5dcb tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:45.383353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34257e08-a46c-49ba-98fb-7189cffb5dcb tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:45.397159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34257e08-a46c-49ba-98fb-7189cffb5dcb tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.400563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34257e08-a46c-49ba-98fb-7189cffb5dcb tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.401152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34257e08-a46c-49ba-98fb-7189cffb5dcb tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.402022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34257e08-a46c-49ba-98fb-7189cffb5dcb tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.404379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34257e08-a46c-49ba-98fb-7189cffb5dcb tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.405054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34257e08-a46c-49ba-98fb-7189cffb5dcb tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.551644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34257e08-a46c-49ba-98fb-7189cffb5dcb tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:45.560904 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34257e08-a46c-49ba-98fb-7189cffb5dcb tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1263 microversion: 2.1 time: 0.185147 Oct 04 18:43:45.584371 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3220/6448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:45 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:46.602216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df5139f8-743e-410a-8463-61b096cf0e4c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:46.603036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-df5139f8-743e-410a-8463-61b096cf0e4c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:46.632174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5139f8-743e-410a-8463-61b096cf0e4c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:46.633588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5139f8-743e-410a-8463-61b096cf0e4c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:46.636752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5139f8-743e-410a-8463-61b096cf0e4c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:46.637530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5139f8-743e-410a-8463-61b096cf0e4c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:46.639878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5139f8-743e-410a-8463-61b096cf0e4c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:46.643232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df5139f8-743e-410a-8463-61b096cf0e4c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.016254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-df5139f8-743e-410a-8463-61b096cf0e4c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.029687 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-df5139f8-743e-410a-8463-61b096cf0e4c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1325 microversion: 2.1 time: 0.431560 Oct 04 18:43:47.032304 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3229/6449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:46 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1325 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:48.059617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-912543d7-3759-4fff-bc60-8f18e05b0816 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:48.060264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-912543d7-3759-4fff-bc60-8f18e05b0816 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:48.081872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-912543d7-3759-4fff-bc60-8f18e05b0816 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.082388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-912543d7-3759-4fff-bc60-8f18e05b0816 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.082839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-912543d7-3759-4fff-bc60-8f18e05b0816 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.088498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-912543d7-3759-4fff-bc60-8f18e05b0816 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.091720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-912543d7-3759-4fff-bc60-8f18e05b0816 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.092400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-912543d7-3759-4fff-bc60-8f18e05b0816 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.500023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-912543d7-3759-4fff-bc60-8f18e05b0816 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:48.516120 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-912543d7-3759-4fff-bc60-8f18e05b0816 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1325 microversion: 2.1 time: 0.461704 Oct 04 18:43:48.522621 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3221/6450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:48 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1325 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:49.549229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3942d0c6-d61f-4c9d-9c13-c6951c30e925 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:49.550450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3942d0c6-d61f-4c9d-9c13-c6951c30e925 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:49.586822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3942d0c6-d61f-4c9d-9c13-c6951c30e925 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.587632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3942d0c6-d61f-4c9d-9c13-c6951c30e925 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.589246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3942d0c6-d61f-4c9d-9c13-c6951c30e925 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.591363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3942d0c6-d61f-4c9d-9c13-c6951c30e925 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.592738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3942d0c6-d61f-4c9d-9c13-c6951c30e925 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.593376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3942d0c6-d61f-4c9d-9c13-c6951c30e925 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.067690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3942d0c6-d61f-4c9d-9c13-c6951c30e925 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:50.082302 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3942d0c6-d61f-4c9d-9c13-c6951c30e925 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1392 microversion: 2.1 time: 0.537159 Oct 04 18:43:50.082716 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3230/6451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:49 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1392 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:51.115427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1b94bea9-78b2-4284-96c7-690ffaa5e245 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:51.116609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1b94bea9-78b2-4284-96c7-690ffaa5e245 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:51.135383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b94bea9-78b2-4284-96c7-690ffaa5e245 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.136064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b94bea9-78b2-4284-96c7-690ffaa5e245 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.136631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b94bea9-78b2-4284-96c7-690ffaa5e245 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.137490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b94bea9-78b2-4284-96c7-690ffaa5e245 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.140510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b94bea9-78b2-4284-96c7-690ffaa5e245 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.141121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b94bea9-78b2-4284-96c7-690ffaa5e245 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.710003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-53335398", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "1881fce9-6814-4454-b572-5bea2aa43984"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1544284861", "security_groups": []}, "os:scheduler_hints": {"different_host": ["d936ebba-97f4-43eb-9ce6-74b4040c5a4c"]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:51.877934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] validate_networks() for [('1881fce9-6814-4454-b572-5bea2aa43984', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:43:52.870668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1b94bea9-78b2-4284-96c7-690ffaa5e245 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:52.879883 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1b94bea9-78b2-4284-96c7-690ffaa5e245 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1392 microversion: 2.1 time: 1.772633 Oct 04 18:43:52.884379 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3222/6452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:51 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1392 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:53.778376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fc8326d8-61c2-4ef1-bd79-41959c60fe32 req-9cdd5b11-7ed3-4af0-a335-c7e7b4250e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41975968-b6e1-4975-861e-c5ba5655f1b5", "tag": "7438ffb1-ab55-4e42-b1da-aae53c113e89"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:53.812367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fc8326d8-61c2-4ef1-bd79-41959c60fe32 req-9cdd5b11-7ed3-4af0-a335-c7e7b4250e38 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.814721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fc8326d8-61c2-4ef1-bd79-41959c60fe32 req-9cdd5b11-7ed3-4af0-a335-c7e7b4250e38 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.815386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fc8326d8-61c2-4ef1-bd79-41959c60fe32 req-9cdd5b11-7ed3-4af0-a335-c7e7b4250e38 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.848832 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fc8326d8-61c2-4ef1-bd79-41959c60fe32 req-9cdd5b11-7ed3-4af0-a335-c7e7b4250e38 service nova] Creating event network-changed:7438ffb1-ab55-4e42-b1da-aae53c113e89 for instance 41975968-b6e1-4975-861e-c5ba5655f1b5 on n-h1-850499-14 Oct 04 18:43:53.864501 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fc8326d8-61c2-4ef1-bd79-41959c60fe32 req-9cdd5b11-7ed3-4af0-a335-c7e7b4250e38 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089525 Oct 04 18:43:53.865566 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3223/6453] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:53.913464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13a50a77-73d1-47c1-b72c-f34051d8c68f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:53.916331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-13a50a77-73d1-47c1-b72c-f34051d8c68f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:53.931567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a50a77-73d1-47c1-b72c-f34051d8c68f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.932429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a50a77-73d1-47c1-b72c-f34051d8c68f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.933919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a50a77-73d1-47c1-b72c-f34051d8c68f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.936409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a50a77-73d1-47c1-b72c-f34051d8c68f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.939665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a50a77-73d1-47c1-b72c-f34051d8c68f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.940371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a50a77-73d1-47c1-b72c-f34051d8c68f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.946999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:53.948416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:53.949459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:53.950331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:53.951098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:53.976418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.978222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.980859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.982913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.987643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.988544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.040088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:54.042408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:54.060058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Getting quotas for project 6f8e2ca190554515a144729878a02162. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:54.090150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Getting quotas for user b9e77370b5c14d509d1573ef5f6e92b9 and project 6f8e2ca190554515a144729878a02162. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:54.137691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:54.173248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:54.350313 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-28685999-221a-4c7e-9081-a237aad7db03 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.645432 Oct 04 18:43:54.350988 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3231/6454] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:43:51 2022] POST /compute/v2.1/servers => generated 361 bytes in 2647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:43:54.377368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7efb4485-2054-4a05-98d6-8cc95e74eaf2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:54.377999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7efb4485-2054-4a05-98d6-8cc95e74eaf2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:54.593561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-13a50a77-73d1-47c1-b72c-f34051d8c68f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:54.609540 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-13a50a77-73d1-47c1-b72c-f34051d8c68f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1392 microversion: 2.1 time: 0.700426 Oct 04 18:43:54.612629 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3224/6455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:53 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1392 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:54.712915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7efb4485-2054-4a05-98d6-8cc95e74eaf2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:54.723170 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7efb4485-2054-4a05-98d6-8cc95e74eaf2 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1240 microversion: 2.1 time: 0.359268 Oct 04 18:43:54.729586 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3232/6456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:54 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1240 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:55.634516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0166aa62-f94e-46fc-881a-853a291e1046 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:55.635772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0166aa62-f94e-46fc-881a-853a291e1046 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:55.649522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0166aa62-f94e-46fc-881a-853a291e1046 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.652705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0166aa62-f94e-46fc-881a-853a291e1046 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.653401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0166aa62-f94e-46fc-881a-853a291e1046 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.656837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0166aa62-f94e-46fc-881a-853a291e1046 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.657637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0166aa62-f94e-46fc-881a-853a291e1046 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.658262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0166aa62-f94e-46fc-881a-853a291e1046 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.751198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-afd42776-5021-4728-833b-7b9b96be37a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:55.752696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-afd42776-5021-4728-833b-7b9b96be37a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:55.768375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afd42776-5021-4728-833b-7b9b96be37a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.769320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afd42776-5021-4728-833b-7b9b96be37a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.771757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afd42776-5021-4728-833b-7b9b96be37a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.772913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afd42776-5021-4728-833b-7b9b96be37a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.775625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afd42776-5021-4728-833b-7b9b96be37a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.776073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afd42776-5021-4728-833b-7b9b96be37a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.963589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-afd42776-5021-4728-833b-7b9b96be37a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:55.979349 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-afd42776-5021-4728-833b-7b9b96be37a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1244 microversion: 2.1 time: 0.231647 Oct 04 18:43:55.981337 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3233/6457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:55 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1244 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:56.295274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0166aa62-f94e-46fc-881a-853a291e1046 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:56.306818 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0166aa62-f94e-46fc-881a-853a291e1046 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1392 microversion: 2.1 time: 0.676797 Oct 04 18:43:56.311782 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3225/6458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:55 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1392 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:57.005549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f5a13dc1-33ca-4949-8965-b040fe0b9e6e tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.006290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f5a13dc1-33ca-4949-8965-b040fe0b9e6e tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.015708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5a13dc1-33ca-4949-8965-b040fe0b9e6e tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.016466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5a13dc1-33ca-4949-8965-b040fe0b9e6e tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.017126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5a13dc1-33ca-4949-8965-b040fe0b9e6e tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.018057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5a13dc1-33ca-4949-8965-b040fe0b9e6e tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.028176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5a13dc1-33ca-4949-8965-b040fe0b9e6e tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.029086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5a13dc1-33ca-4949-8965-b040fe0b9e6e tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.136557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f5a13dc1-33ca-4949-8965-b040fe0b9e6e tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:57.153010 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f5a13dc1-33ca-4949-8965-b040fe0b9e6e tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1292 microversion: 2.1 time: 0.150343 Oct 04 18:43:57.166756 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3234/6459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:56 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1292 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:57.354429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-54111142-abe6-4c50-9327-49dfed5b2bc0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.355525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-54111142-abe6-4c50-9327-49dfed5b2bc0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.381497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54111142-abe6-4c50-9327-49dfed5b2bc0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.382358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54111142-abe6-4c50-9327-49dfed5b2bc0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.384041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54111142-abe6-4c50-9327-49dfed5b2bc0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.403393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54111142-abe6-4c50-9327-49dfed5b2bc0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.404538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54111142-abe6-4c50-9327-49dfed5b2bc0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.405346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-54111142-abe6-4c50-9327-49dfed5b2bc0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.954942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-54111142-abe6-4c50-9327-49dfed5b2bc0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:57.970861 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-54111142-abe6-4c50-9327-49dfed5b2bc0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1392 microversion: 2.1 time: 0.621758 Oct 04 18:43:57.971849 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3226/6460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:57 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1392 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:58.182506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ee87f48-32bc-47a8-83b5-ed2d11ac5eae tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:58.183275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ee87f48-32bc-47a8-83b5-ed2d11ac5eae tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:58.200323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ee87f48-32bc-47a8-83b5-ed2d11ac5eae tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.203434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ee87f48-32bc-47a8-83b5-ed2d11ac5eae tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.206072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ee87f48-32bc-47a8-83b5-ed2d11ac5eae tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.207284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ee87f48-32bc-47a8-83b5-ed2d11ac5eae tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.209138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ee87f48-32bc-47a8-83b5-ed2d11ac5eae tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.212134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ee87f48-32bc-47a8-83b5-ed2d11ac5eae tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.338218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ee87f48-32bc-47a8-83b5-ed2d11ac5eae tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:58.348157 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ee87f48-32bc-47a8-83b5-ed2d11ac5eae tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1298 microversion: 2.1 time: 0.170019 Oct 04 18:43:58.349829 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3235/6461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:58 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1298 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:59.000620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-50f1aeb3-4bfa-405b-8987-2897ba7b12ac tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:59.002044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-50f1aeb3-4bfa-405b-8987-2897ba7b12ac tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:59.026222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f1aeb3-4bfa-405b-8987-2897ba7b12ac tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.028738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f1aeb3-4bfa-405b-8987-2897ba7b12ac tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.029859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f1aeb3-4bfa-405b-8987-2897ba7b12ac tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.033836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f1aeb3-4bfa-405b-8987-2897ba7b12ac tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.034458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f1aeb3-4bfa-405b-8987-2897ba7b12ac tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.035899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50f1aeb3-4bfa-405b-8987-2897ba7b12ac tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.374214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e57b44fc-846a-4caa-8796-86e18fe1dcbc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:59.375076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e57b44fc-846a-4caa-8796-86e18fe1dcbc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:59.396038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57b44fc-846a-4caa-8796-86e18fe1dcbc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.404277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57b44fc-846a-4caa-8796-86e18fe1dcbc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.405113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57b44fc-846a-4caa-8796-86e18fe1dcbc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.406404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57b44fc-846a-4caa-8796-86e18fe1dcbc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.409010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57b44fc-846a-4caa-8796-86e18fe1dcbc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.411048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e57b44fc-846a-4caa-8796-86e18fe1dcbc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.530307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-50f1aeb3-4bfa-405b-8987-2897ba7b12ac tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:59.546695 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-50f1aeb3-4bfa-405b-8987-2897ba7b12ac tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1392 microversion: 2.1 time: 0.551874 Oct 04 18:43:59.549766 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3227/6462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:58 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1392 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:59.625094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e57b44fc-846a-4caa-8796-86e18fe1dcbc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:59.641256 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e57b44fc-846a-4caa-8796-86e18fe1dcbc tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1298 microversion: 2.1 time: 0.271220 Oct 04 18:43:59.651815 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3236/6463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:59 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1298 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:00.572065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21c70ec1-4d74-4e39-83b5-9043d4073006 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:00.572756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21c70ec1-4d74-4e39-83b5-9043d4073006 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:00.587507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c70ec1-4d74-4e39-83b5-9043d4073006 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.588298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c70ec1-4d74-4e39-83b5-9043d4073006 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.591723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c70ec1-4d74-4e39-83b5-9043d4073006 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.592680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c70ec1-4d74-4e39-83b5-9043d4073006 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.593321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c70ec1-4d74-4e39-83b5-9043d4073006 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.593912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21c70ec1-4d74-4e39-83b5-9043d4073006 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.669349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0e1c4d91-7285-4222-be39-c22d5112e474 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:00.670501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0e1c4d91-7285-4222-be39-c22d5112e474 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:00.684332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1c4d91-7285-4222-be39-c22d5112e474 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.684834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1c4d91-7285-4222-be39-c22d5112e474 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.685282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1c4d91-7285-4222-be39-c22d5112e474 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.690152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1c4d91-7285-4222-be39-c22d5112e474 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.690645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1c4d91-7285-4222-be39-c22d5112e474 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.691119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e1c4d91-7285-4222-be39-c22d5112e474 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.972187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-21c70ec1-4d74-4e39-83b5-9043d4073006 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:00.978866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0e1c4d91-7285-4222-be39-c22d5112e474 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:00.984805 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21c70ec1-4d74-4e39-83b5-9043d4073006 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1392 microversion: 2.1 time: 0.417524 Oct 04 18:44:00.992631 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0e1c4d91-7285-4222-be39-c22d5112e474 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1298 microversion: 2.1 time: 0.327572 Oct 04 18:44:00.993638 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3237/6464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:00 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1298 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:01.007113 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3228/6465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:00 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1392 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:01.622063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-433f9935-0ea8-4872-87c5-d5295a262c48 req-ff714878-d83b-42d0-8fa6-b6fbb804f226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa3c301-5a76-4fdc-a44c-ee5899000db2", "tag": "8ac964d7-9afb-4d8f-9c40-a1cd60566c28"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:01.649290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-433f9935-0ea8-4872-87c5-d5295a262c48 req-ff714878-d83b-42d0-8fa6-b6fbb804f226 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.658226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-433f9935-0ea8-4872-87c5-d5295a262c48 req-ff714878-d83b-42d0-8fa6-b6fbb804f226 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.658837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-433f9935-0ea8-4872-87c5-d5295a262c48 req-ff714878-d83b-42d0-8fa6-b6fbb804f226 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.680412 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-433f9935-0ea8-4872-87c5-d5295a262c48 req-ff714878-d83b-42d0-8fa6-b6fbb804f226 service nova] Creating event network-changed:8ac964d7-9afb-4d8f-9c40-a1cd60566c28 for instance 4aa3c301-5a76-4fdc-a44c-ee5899000db2 on n-h1-850499-14 Oct 04 18:44:01.694259 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-433f9935-0ea8-4872-87c5-d5295a262c48 req-ff714878-d83b-42d0-8fa6-b6fbb804f226 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076587 Oct 04 18:44:01.701381 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3238/6466] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:02.022128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ac60357-db4c-4b3e-ab97-8d731961e1b5 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:02.023929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2fdbd7a1-f043-401a-b7b0-ff6d915b81bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:02.025275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ac60357-db4c-4b3e-ab97-8d731961e1b5 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:02.026100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2fdbd7a1-f043-401a-b7b0-ff6d915b81bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:02.048901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fdbd7a1-f043-401a-b7b0-ff6d915b81bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.049677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac60357-db4c-4b3e-ab97-8d731961e1b5 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.056824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac60357-db4c-4b3e-ab97-8d731961e1b5 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.057558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac60357-db4c-4b3e-ab97-8d731961e1b5 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.058421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fdbd7a1-f043-401a-b7b0-ff6d915b81bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.059644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fdbd7a1-f043-401a-b7b0-ff6d915b81bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.060437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac60357-db4c-4b3e-ab97-8d731961e1b5 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.061355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fdbd7a1-f043-401a-b7b0-ff6d915b81bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.062003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac60357-db4c-4b3e-ab97-8d731961e1b5 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.062619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac60357-db4c-4b3e-ab97-8d731961e1b5 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.063289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fdbd7a1-f043-401a-b7b0-ff6d915b81bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.066200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2fdbd7a1-f043-401a-b7b0-ff6d915b81bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.338167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ac60357-db4c-4b3e-ab97-8d731961e1b5 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:02.368937 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ac60357-db4c-4b3e-ab97-8d731961e1b5 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1298 microversion: 2.1 time: 0.351727 Oct 04 18:44:02.369607 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3239/6467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:02 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1298 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:02.484953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2fdbd7a1-f043-401a-b7b0-ff6d915b81bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:02.494679 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2fdbd7a1-f043-401a-b7b0-ff6d915b81bf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1392 microversion: 2.1 time: 0.484200 Oct 04 18:44:02.496091 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3229/6468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:02 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1392 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:02.786545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d09261c5-049f-466d-886d-25dd4b2a58aa req-5969b70c-3883-4e26-8ffe-689b29a0bb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41975968-b6e1-4975-861e-c5ba5655f1b5", "name": "network-vif-plugged", "status": "completed", "tag": "7438ffb1-ab55-4e42-b1da-aae53c113e89"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:02.799144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d09261c5-049f-466d-886d-25dd4b2a58aa req-5969b70c-3883-4e26-8ffe-689b29a0bb6e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.799861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d09261c5-049f-466d-886d-25dd4b2a58aa req-5969b70c-3883-4e26-8ffe-689b29a0bb6e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.800464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d09261c5-049f-466d-886d-25dd4b2a58aa req-5969b70c-3883-4e26-8ffe-689b29a0bb6e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.815876 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d09261c5-049f-466d-886d-25dd4b2a58aa req-5969b70c-3883-4e26-8ffe-689b29a0bb6e service nova] Creating event network-vif-plugged:7438ffb1-ab55-4e42-b1da-aae53c113e89 for instance 41975968-b6e1-4975-861e-c5ba5655f1b5 on n-h1-850499-14 Oct 04 18:44:02.821509 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d09261c5-049f-466d-886d-25dd4b2a58aa req-5969b70c-3883-4e26-8ffe-689b29a0bb6e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039083 Oct 04 18:44:02.822369 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3240/6469] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:03.395879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-78430801-8241-4541-8080-a24b6c523f05 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:03.397623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-78430801-8241-4541-8080-a24b6c523f05 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:03.421836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78430801-8241-4541-8080-a24b6c523f05 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.424875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78430801-8241-4541-8080-a24b6c523f05 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.425553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78430801-8241-4541-8080-a24b6c523f05 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.426585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78430801-8241-4541-8080-a24b6c523f05 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.427242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78430801-8241-4541-8080-a24b6c523f05 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.428918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78430801-8241-4541-8080-a24b6c523f05 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.534926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f5344f92-2797-4b13-a81f-3353c7a3763d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:03.535925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f5344f92-2797-4b13-a81f-3353c7a3763d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:03.558223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5344f92-2797-4b13-a81f-3353c7a3763d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.558684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5344f92-2797-4b13-a81f-3353c7a3763d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.559361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5344f92-2797-4b13-a81f-3353c7a3763d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.560090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5344f92-2797-4b13-a81f-3353c7a3763d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.560544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5344f92-2797-4b13-a81f-3353c7a3763d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.560977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5344f92-2797-4b13-a81f-3353c7a3763d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.616360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-78430801-8241-4541-8080-a24b6c523f05 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:03.631540 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-78430801-8241-4541-8080-a24b6c523f05 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1298 microversion: 2.1 time: 0.240829 Oct 04 18:44:03.633839 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3230/6470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:03 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1298 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:04.035867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:04.197419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f5344f92-2797-4b13-a81f-3353c7a3763d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:04.212494 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f5344f92-2797-4b13-a81f-3353c7a3763d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1392 microversion: 2.1 time: 0.682320 Oct 04 18:44:04.213402 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3241/6471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:03 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1392 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:04.658237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d6718ff-3d0c-46ee-8766-0c30ebc5f122 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:04.659396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d6718ff-3d0c-46ee-8766-0c30ebc5f122 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:04.668678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6718ff-3d0c-46ee-8766-0c30ebc5f122 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:04.669177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6718ff-3d0c-46ee-8766-0c30ebc5f122 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:04.669813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6718ff-3d0c-46ee-8766-0c30ebc5f122 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.671642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6718ff-3d0c-46ee-8766-0c30ebc5f122 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:04.672126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6718ff-3d0c-46ee-8766-0c30ebc5f122 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:04.672552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d6718ff-3d0c-46ee-8766-0c30ebc5f122 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.775364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d6718ff-3d0c-46ee-8766-0c30ebc5f122 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:04.784595 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d6718ff-3d0c-46ee-8766-0c30ebc5f122 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1298 microversion: 2.1 time: 0.130449 Oct 04 18:44:04.785856 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3231/6472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:04 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:05.237598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-57916795-78c9-4ea9-b266-50cd61dce354 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:05.238336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57916795-78c9-4ea9-b266-50cd61dce354 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:05.246658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=10 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:05.260399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57916795-78c9-4ea9-b266-50cd61dce354 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.261300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57916795-78c9-4ea9-b266-50cd61dce354 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.261922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57916795-78c9-4ea9-b266-50cd61dce354 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.263035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57916795-78c9-4ea9-b266-50cd61dce354 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.263668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57916795-78c9-4ea9-b266-50cd61dce354 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.264276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57916795-78c9-4ea9-b266-50cd61dce354 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.438006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-57916795-78c9-4ea9-b266-50cd61dce354 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:05.447626 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-57916795-78c9-4ea9-b266-50cd61dce354 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1392 microversion: 2.1 time: 0.214129 Oct 04 18:44:05.448242 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3242/6473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:05 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:05.817832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b67ab033-20c1-4624-9806-8b40b2df490b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:05.819018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b67ab033-20c1-4624-9806-8b40b2df490b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:05.831056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b67ab033-20c1-4624-9806-8b40b2df490b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.837907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b67ab033-20c1-4624-9806-8b40b2df490b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.838379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b67ab033-20c1-4624-9806-8b40b2df490b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.839211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b67ab033-20c1-4624-9806-8b40b2df490b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.839691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b67ab033-20c1-4624-9806-8b40b2df490b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.840152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b67ab033-20c1-4624-9806-8b40b2df490b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.968024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b67ab033-20c1-4624-9806-8b40b2df490b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:05.980011 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b67ab033-20c1-4624-9806-8b40b2df490b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1298 microversion: 2.1 time: 0.168621 Oct 04 18:44:05.990239 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3232/6474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:05 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1298 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:06.475677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b02cbbaf-8668-47ad-91fd-6a31f6677433 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:06.477140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b02cbbaf-8668-47ad-91fd-6a31f6677433 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:06.485178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b02cbbaf-8668-47ad-91fd-6a31f6677433 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.486156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b02cbbaf-8668-47ad-91fd-6a31f6677433 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.486658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b02cbbaf-8668-47ad-91fd-6a31f6677433 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.487457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b02cbbaf-8668-47ad-91fd-6a31f6677433 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.488043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b02cbbaf-8668-47ad-91fd-6a31f6677433 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.488360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b02cbbaf-8668-47ad-91fd-6a31f6677433 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.627463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b02cbbaf-8668-47ad-91fd-6a31f6677433 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:06.638594 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b02cbbaf-8668-47ad-91fd-6a31f6677433 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1564 microversion: 2.1 time: 0.167938 Oct 04 18:44:06.639229 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3243/6475] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:06 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:06.661032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-14383d43-38b8-4819-a5bc-2ef59ed26e73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:06.661648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-14383d43-38b8-4819-a5bc-2ef59ed26e73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:06.669477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14383d43-38b8-4819-a5bc-2ef59ed26e73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.669980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14383d43-38b8-4819-a5bc-2ef59ed26e73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.670425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14383d43-38b8-4819-a5bc-2ef59ed26e73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.671276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14383d43-38b8-4819-a5bc-2ef59ed26e73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.671751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14383d43-38b8-4819-a5bc-2ef59ed26e73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.672185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-14383d43-38b8-4819-a5bc-2ef59ed26e73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.730414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-edb46688-450f-4857-b64a-2c099e82e9a0 req-f752433b-1957-4392-99c3-3aa224f89e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa3c301-5a76-4fdc-a44c-ee5899000db2", "name": "network-vif-plugged", "status": "completed", "tag": "8ac964d7-9afb-4d8f-9c40-a1cd60566c28"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:06.740219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-edb46688-450f-4857-b64a-2c099e82e9a0 req-f752433b-1957-4392-99c3-3aa224f89e9b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.740950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-edb46688-450f-4857-b64a-2c099e82e9a0 req-f752433b-1957-4392-99c3-3aa224f89e9b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.741556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-edb46688-450f-4857-b64a-2c099e82e9a0 req-f752433b-1957-4392-99c3-3aa224f89e9b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.756347 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-edb46688-450f-4857-b64a-2c099e82e9a0 req-f752433b-1957-4392-99c3-3aa224f89e9b service nova] Creating event network-vif-plugged:8ac964d7-9afb-4d8f-9c40-a1cd60566c28 for instance 4aa3c301-5a76-4fdc-a44c-ee5899000db2 on n-h1-850499-14 Oct 04 18:44:06.763711 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-edb46688-450f-4857-b64a-2c099e82e9a0 req-f752433b-1957-4392-99c3-3aa224f89e9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038129 Oct 04 18:44:06.764635 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3244/6476] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:06.780337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-357778122", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:06.850641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] validate_networks() for None {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:06.937035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-14383d43-38b8-4819-a5bc-2ef59ed26e73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:06.949503 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-14383d43-38b8-4819-a5bc-2ef59ed26e73 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1564 microversion: 2.1 time: 0.292161 Oct 04 18:44:06.950230 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3233/6477] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:06 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1564 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:07.000804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-278ecf8f-a68c-4ac0-b0b7-4fad3d2c59ec tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:07.001435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-278ecf8f-a68c-4ac0-b0b7-4fad3d2c59ec tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:07.008625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-278ecf8f-a68c-4ac0-b0b7-4fad3d2c59ec tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.009410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-278ecf8f-a68c-4ac0-b0b7-4fad3d2c59ec tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.010059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-278ecf8f-a68c-4ac0-b0b7-4fad3d2c59ec tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:07.011048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-278ecf8f-a68c-4ac0-b0b7-4fad3d2c59ec tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.011763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-278ecf8f-a68c-4ac0-b0b7-4fad3d2c59ec tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.012313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-278ecf8f-a68c-4ac0-b0b7-4fad3d2c59ec tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:07.230569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-278ecf8f-a68c-4ac0-b0b7-4fad3d2c59ec tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:07.240944 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-278ecf8f-a68c-4ac0-b0b7-4fad3d2c59ec tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1298 microversion: 2.1 time: 0.243799 Oct 04 18:44:07.241973 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3234/6478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:06 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1298 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:07.408011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:07.408918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:07.409963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:07.410614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:07.411557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:07.425478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.426098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.426798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:07.427802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.428478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.429079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:07.460403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Getting quotas for project 418659759ae546d981fd2b4885464d62. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:07.468243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Getting quotas for user 88dd5b553a684a9daffed5fa573b564c and project 418659759ae546d981fd2b4885464d62. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:07.490230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:07.494677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:07.551845 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-646940bc-17df-4b6a-8a4d-8de369417323 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776265 Oct 04 18:44:07.559235 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3245/6479] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:07.572479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-401613d4-12b9-4723-a9a0-46b40c685114 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:07.573189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-401613d4-12b9-4723-a9a0-46b40c685114 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:07.674654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-401613d4-12b9-4723-a9a0-46b40c685114 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:07.690359 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-401613d4-12b9-4723-a9a0-46b40c685114 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1214 microversion: 2.1 time: 0.120522 Oct 04 18:44:07.706781 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3235/6480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:07 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:08.267753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-004c754d-7d83-4e01-8fc9-3b77de511c06 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.268441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-004c754d-7d83-4e01-8fc9-3b77de511c06 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:08.280867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-004c754d-7d83-4e01-8fc9-3b77de511c06 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.281380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-004c754d-7d83-4e01-8fc9-3b77de511c06 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.281834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-004c754d-7d83-4e01-8fc9-3b77de511c06 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.284439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-004c754d-7d83-4e01-8fc9-3b77de511c06 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.287445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-004c754d-7d83-4e01-8fc9-3b77de511c06 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.288242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-004c754d-7d83-4e01-8fc9-3b77de511c06 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.464171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-004c754d-7d83-4e01-8fc9-3b77de511c06 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:08.483437 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-004c754d-7d83-4e01-8fc9-3b77de511c06 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1471 microversion: 2.1 time: 0.216766 Oct 04 18:44:08.500350 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3246/6481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:08 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:08.508977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d1d13f6-0bc4-48b9-b8f8-f338ee9d0560 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.510232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d1d13f6-0bc4-48b9-b8f8-f338ee9d0560 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:08.523681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1d13f6-0bc4-48b9-b8f8-f338ee9d0560 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.524907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1d13f6-0bc4-48b9-b8f8-f338ee9d0560 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.525438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1d13f6-0bc4-48b9-b8f8-f338ee9d0560 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.526466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1d13f6-0bc4-48b9-b8f8-f338ee9d0560 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.526860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1d13f6-0bc4-48b9-b8f8-f338ee9d0560 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.527385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d1d13f6-0bc4-48b9-b8f8-f338ee9d0560 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.667743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7d1d13f6-0bc4-48b9-b8f8-f338ee9d0560 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:08.690534 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d1d13f6-0bc4-48b9-b8f8-f338ee9d0560 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1471 microversion: 2.1 time: 0.182929 Oct 04 18:44:08.692148 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3236/6482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:08 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:08.715812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c6f0e9d2-2357-4176-9f1a-5bd4799b0d8a tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.716801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c6f0e9d2-2357-4176-9f1a-5bd4799b0d8a tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:08.722147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-538695db-6725-427a-bf30-ca0b24d35a6d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.723168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-538695db-6725-427a-bf30-ca0b24d35a6d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:08.726767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6f0e9d2-2357-4176-9f1a-5bd4799b0d8a tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.728166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6f0e9d2-2357-4176-9f1a-5bd4799b0d8a tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.729133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6f0e9d2-2357-4176-9f1a-5bd4799b0d8a tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.731178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6f0e9d2-2357-4176-9f1a-5bd4799b0d8a tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.732519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6f0e9d2-2357-4176-9f1a-5bd4799b0d8a tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.733186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6f0e9d2-2357-4176-9f1a-5bd4799b0d8a tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.753670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-538695db-6725-427a-bf30-ca0b24d35a6d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.759311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-538695db-6725-427a-bf30-ca0b24d35a6d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.762165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-538695db-6725-427a-bf30-ca0b24d35a6d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.762983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-538695db-6725-427a-bf30-ca0b24d35a6d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.763512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-538695db-6725-427a-bf30-ca0b24d35a6d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.763960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-538695db-6725-427a-bf30-ca0b24d35a6d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.864631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c6f0e9d2-2357-4176-9f1a-5bd4799b0d8a tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:08.880301 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c6f0e9d2-2357-4176-9f1a-5bd4799b0d8a tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1266 microversion: 2.1 time: 0.169545 Oct 04 18:44:08.882861 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3247/6483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:08 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:08.940688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:08.948732 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-538695db-6725-427a-bf30-ca0b24d35a6d tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1624 microversion: 2.1 time: 0.237709 Oct 04 18:44:08.950655 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3237/6484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:08 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1624 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:08.975292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-07e8d887-7a23-41db-bdb9-e86e38afb8af tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.977861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-07e8d887-7a23-41db-bdb9-e86e38afb8af tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:08.986667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07e8d887-7a23-41db-bdb9-e86e38afb8af tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.987439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07e8d887-7a23-41db-bdb9-e86e38afb8af tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.988059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07e8d887-7a23-41db-bdb9-e86e38afb8af tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.988982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07e8d887-7a23-41db-bdb9-e86e38afb8af tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.989620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07e8d887-7a23-41db-bdb9-e86e38afb8af tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.990222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07e8d887-7a23-41db-bdb9-e86e38afb8af tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.211977 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-07e8d887-7a23-41db-bdb9-e86e38afb8af tempest-TestSecurityGroupsBasicOps-268190997 tempest-TestSecurityGroupsBasicOps-268190997-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1916 microversion: 2.1 time: 0.234567 Oct 04 18:44:09.213493 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3248/6485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:08 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1916 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:09.288129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80455ef8-e99c-433f-8d92-5efde09cf013 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:09.289483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80455ef8-e99c-433f-8d92-5efde09cf013 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:09.295908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80455ef8-e99c-433f-8d92-5efde09cf013 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.296408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80455ef8-e99c-433f-8d92-5efde09cf013 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.296855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80455ef8-e99c-433f-8d92-5efde09cf013 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.297572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80455ef8-e99c-433f-8d92-5efde09cf013 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.298036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80455ef8-e99c-433f-8d92-5efde09cf013 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.298667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80455ef8-e99c-433f-8d92-5efde09cf013 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.330750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80455ef8-e99c-433f-8d92-5efde09cf013 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:09.448827 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-80455ef8-e99c-433f-8d92-5efde09cf013 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 204 len: 0 microversion: 2.1 time: 0.164530 Oct 04 18:44:09.449490 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3238/6486] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:09 2022] DELETE /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:09.458477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-71d8b11d-8f55-47f7-b74b-e68fc195b6a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:09.459254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-71d8b11d-8f55-47f7-b74b-e68fc195b6a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:09.466751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71d8b11d-8f55-47f7-b74b-e68fc195b6a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.467393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71d8b11d-8f55-47f7-b74b-e68fc195b6a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.468008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71d8b11d-8f55-47f7-b74b-e68fc195b6a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.469051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71d8b11d-8f55-47f7-b74b-e68fc195b6a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.469749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71d8b11d-8f55-47f7-b74b-e68fc195b6a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.470281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-71d8b11d-8f55-47f7-b74b-e68fc195b6a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.617893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-71d8b11d-8f55-47f7-b74b-e68fc195b6a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:09.621628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:09.626991 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-71d8b11d-8f55-47f7-b74b-e68fc195b6a1 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1477 microversion: 2.1 time: 0.173085 Oct 04 18:44:09.627663 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3249/6487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:09 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:09.904567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a3169b9-ad46-4f00-99f8-ce6fb60d28bf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:09.905812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a3169b9-ad46-4f00-99f8-ce6fb60d28bf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:09.913241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a3169b9-ad46-4f00-99f8-ce6fb60d28bf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.914238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a3169b9-ad46-4f00-99f8-ce6fb60d28bf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.914928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a3169b9-ad46-4f00-99f8-ce6fb60d28bf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.916143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a3169b9-ad46-4f00-99f8-ce6fb60d28bf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.916620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a3169b9-ad46-4f00-99f8-ce6fb60d28bf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.917062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a3169b9-ad46-4f00-99f8-ce6fb60d28bf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.005729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9a3169b9-ad46-4f00-99f8-ce6fb60d28bf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:10.014922 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a3169b9-ad46-4f00-99f8-ce6fb60d28bf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1272 microversion: 2.1 time: 0.114745 Oct 04 18:44:10.031381 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3239/6488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:09 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:10.381084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-62c41fe0-a629-4a46-b4cd-71b21a3f29c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:10.386880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-be538f33-4610-473f-ad96-f98ed3e7a73e req-e87a1db0-7834-47d3-927b-0888d97d5851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41975968-b6e1-4975-861e-c5ba5655f1b5", "tag": "7438ffb1-ab55-4e42-b1da-aae53c113e89"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:10.392732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-62c41fe0-a629-4a46-b4cd-71b21a3f29c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:10.404709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c41fe0-a629-4a46-b4cd-71b21a3f29c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.407803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-be538f33-4610-473f-ad96-f98ed3e7a73e req-e87a1db0-7834-47d3-927b-0888d97d5851 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.408763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c41fe0-a629-4a46-b4cd-71b21a3f29c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.409489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c41fe0-a629-4a46-b4cd-71b21a3f29c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.421003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c41fe0-a629-4a46-b4cd-71b21a3f29c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.421892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-be538f33-4610-473f-ad96-f98ed3e7a73e req-e87a1db0-7834-47d3-927b-0888d97d5851 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.422631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c41fe0-a629-4a46-b4cd-71b21a3f29c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.423281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-be538f33-4610-473f-ad96-f98ed3e7a73e req-e87a1db0-7834-47d3-927b-0888d97d5851 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.423915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62c41fe0-a629-4a46-b4cd-71b21a3f29c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.471530 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-be538f33-4610-473f-ad96-f98ed3e7a73e req-e87a1db0-7834-47d3-927b-0888d97d5851 service nova] Creating event network-changed:7438ffb1-ab55-4e42-b1da-aae53c113e89 for instance 41975968-b6e1-4975-861e-c5ba5655f1b5 on n-h1-850499-14 Oct 04 18:44:10.484338 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-be538f33-4610-473f-ad96-f98ed3e7a73e req-e87a1db0-7834-47d3-927b-0888d97d5851 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101626 Oct 04 18:44:10.485311 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3240/6489] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:10.637470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-62c41fe0-a629-4a46-b4cd-71b21a3f29c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:10.646555 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-62c41fe0-a629-4a46-b4cd-71b21a3f29c6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1564 microversion: 2.1 time: 0.272341 Oct 04 18:44:10.648975 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3250/6490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:10 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1564 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:10.650573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f5dc40d-ab1b-4657-b874-d7ae36334279 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:10.651970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f5dc40d-ab1b-4657-b874-d7ae36334279 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:10.671372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f5dc40d-ab1b-4657-b874-d7ae36334279 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.672825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f5dc40d-ab1b-4657-b874-d7ae36334279 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.674482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f5dc40d-ab1b-4657-b874-d7ae36334279 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.675449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f5dc40d-ab1b-4657-b874-d7ae36334279 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.676128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f5dc40d-ab1b-4657-b874-d7ae36334279 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.676754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f5dc40d-ab1b-4657-b874-d7ae36334279 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.824720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f5dc40d-ab1b-4657-b874-d7ae36334279 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:10.837509 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f5dc40d-ab1b-4657-b874-d7ae36334279 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1477 microversion: 2.1 time: 0.191356 Oct 04 18:44:10.839220 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3241/6491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:10 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1477 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:11.037746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-883b4789-aa82-4342-9ef2-01bdb8468caf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:11.039210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-883b4789-aa82-4342-9ef2-01bdb8468caf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:11.055466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883b4789-aa82-4342-9ef2-01bdb8468caf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.056215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883b4789-aa82-4342-9ef2-01bdb8468caf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.056833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883b4789-aa82-4342-9ef2-01bdb8468caf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.057744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883b4789-aa82-4342-9ef2-01bdb8468caf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.058381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883b4789-aa82-4342-9ef2-01bdb8468caf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.059040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-883b4789-aa82-4342-9ef2-01bdb8468caf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.220008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-883b4789-aa82-4342-9ef2-01bdb8468caf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:11.229704 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-883b4789-aa82-4342-9ef2-01bdb8468caf tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1272 microversion: 2.1 time: 0.195742 Oct 04 18:44:11.248911 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3251/6492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:11 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:11.687957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ba6428e0-ab23-4ba1-bf58-0991b07ef69f req-57e92ce5-7ebe-48d3-8902-392d12eb89b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa3c301-5a76-4fdc-a44c-ee5899000db2", "name": "network-vif-deleted", "tag": "8ac964d7-9afb-4d8f-9c40-a1cd60566c28"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:11.745712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:11.761669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ba6428e0-ab23-4ba1-bf58-0991b07ef69f req-57e92ce5-7ebe-48d3-8902-392d12eb89b0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.769870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ba6428e0-ab23-4ba1-bf58-0991b07ef69f req-57e92ce5-7ebe-48d3-8902-392d12eb89b0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.771799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ba6428e0-ab23-4ba1-bf58-0991b07ef69f req-57e92ce5-7ebe-48d3-8902-392d12eb89b0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.822195 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ba6428e0-ab23-4ba1-bf58-0991b07ef69f req-57e92ce5-7ebe-48d3-8902-392d12eb89b0 service nova] Creating event network-vif-deleted:8ac964d7-9afb-4d8f-9c40-a1cd60566c28 for instance 4aa3c301-5a76-4fdc-a44c-ee5899000db2 on n-h1-850499-14 Oct 04 18:44:11.835214 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ba6428e0-ab23-4ba1-bf58-0991b07ef69f req-57e92ce5-7ebe-48d3-8902-392d12eb89b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151150 Oct 04 18:44:11.836973 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3242/6493] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:11.877022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:11.877729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:11.897805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.899189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.899815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.900759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.901427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.902282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.956642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.957564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.958028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.958487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lazy-loading 'fault' on Instance uuid 4aa3c301-5a76-4fdc-a44c-ee5899000db2 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:12.053285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:12.063775 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-29cb11cb-494d-42da-bd34-554935808d81 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 200 len: 1330 microversion: 2.1 time: 0.205267 Oct 04 18:44:12.064986 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3252/6494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:11 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 1330 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:12.259873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c3e3b5a0-e884-41e9-be3a-53c6c1639f70 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:12.260581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c3e3b5a0-e884-41e9-be3a-53c6c1639f70 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:12.269695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3e3b5a0-e884-41e9-be3a-53c6c1639f70 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.270506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3e3b5a0-e884-41e9-be3a-53c6c1639f70 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.270992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3e3b5a0-e884-41e9-be3a-53c6c1639f70 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.271884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3e3b5a0-e884-41e9-be3a-53c6c1639f70 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.272346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3e3b5a0-e884-41e9-be3a-53c6c1639f70 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.272968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3e3b5a0-e884-41e9-be3a-53c6c1639f70 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.349774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c3e3b5a0-e884-41e9-be3a-53c6c1639f70 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:12.360342 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c3e3b5a0-e884-41e9-be3a-53c6c1639f70 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1272 microversion: 2.1 time: 0.107956 Oct 04 18:44:12.361321 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3243/6495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:12 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:13.089386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:13.090675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: 4aa3c301-5a76-4fdc-a44c-ee5899000db2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:13.103989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.105482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.106139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.107087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.107716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.108306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.142755 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] HTTP exception thrown: Instance 4aa3c301-5a76-4fdc-a44c-ee5899000db2 could not be found. Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Request method failure captured: Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 HTTP/1.1 Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH5cnbWo6F33LmUnMN03QA_2C1wuiMJDfRyYUpXfa7CyiCo7KCgVovdi_udJn50kWDEqo-VA1hWWy10C83_H4gS7BPoLYdQBXz_EfyxjouC9b0RAKT3kKghcjZv9W271GUMNMHgJQj_ChMyk5QlmoDpTvSvW_kB7GNQhEUL9lNB00vk Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 6f8e2ca190554515a144729878a02162 Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1344426176 Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f8e2ca190554515a144729878a02162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f8e2ca190554515a144729878a02162"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f8e2ca190554515a144729878a02162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f8e2ca190554515a144729878a02162"}]}] Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1344426176 Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 6f8e2ca190554515a144729878a02162 Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1344426176 Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestSecurityGroupsBasicOps-1344426176-project Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b9e77370b5c14d509d1573ef5f6e92b9 Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1344426176-project Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4aa3c301-5a76-4fdc-a44c-ee5899000db2 could not be found. Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4aa3c301-5a76-4fdc-a44c-ee5899000db2'} Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa3c301-5a76-4fdc-a44c-ee5899000db2 could not be found. Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa3c301-5a76-4fdc-a44c-ee5899000db2 could not be found. Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:44:13.144760 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:13.150307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:44:13.150307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:13.150307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:13.150307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:13.150307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:13.150307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:13.150307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa3c301-5a76-4fdc-a44c-ee5899000db2 could not be found. Oct 04 18:44:13.150307 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:44:13.151887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Returning 404 to user: Instance 4aa3c301-5a76-4fdc-a44c-ee5899000db2 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:13.152933 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed7fe848-89d0-436f-8485-1f875e7db01b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2" status: 404 len: 111 microversion: 2.1 time: 0.069041 Oct 04 18:44:13.154062 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3253/6496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:13 2022] GET /compute/v2.1/servers/4aa3c301-5a76-4fdc-a44c-ee5899000db2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:44:13.384727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-579782a9-f3bc-4530-8108-f29e0e55464f tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:13.385349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-579782a9-f3bc-4530-8108-f29e0e55464f tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:13.398787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579782a9-f3bc-4530-8108-f29e0e55464f tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.399595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579782a9-f3bc-4530-8108-f29e0e55464f tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.400225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579782a9-f3bc-4530-8108-f29e0e55464f tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.401144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579782a9-f3bc-4530-8108-f29e0e55464f tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.401782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579782a9-f3bc-4530-8108-f29e0e55464f tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.402383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-579782a9-f3bc-4530-8108-f29e0e55464f tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.843871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-579782a9-f3bc-4530-8108-f29e0e55464f tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:13.858516 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-579782a9-f3bc-4530-8108-f29e0e55464f tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1314 microversion: 2.1 time: 0.478088 Oct 04 18:44:13.861570 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3244/6497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:13 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:14.276270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-2afa11ca-ae7d-4ae0-a2c9-1f408e992906 req-f2302566-99d6-4596-9d65-b676f1a2579b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4e77f8-a1e5-4dff-ae75-095b5ef88969", "tag": "72eefae9-e092-409d-a34b-1960cf0754fe"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:14.295439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:14.299226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2afa11ca-ae7d-4ae0-a2c9-1f408e992906 req-f2302566-99d6-4596-9d65-b676f1a2579b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.299996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2afa11ca-ae7d-4ae0-a2c9-1f408e992906 req-f2302566-99d6-4596-9d65-b676f1a2579b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.300552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2afa11ca-ae7d-4ae0-a2c9-1f408e992906 req-f2302566-99d6-4596-9d65-b676f1a2579b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.314165 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-2afa11ca-ae7d-4ae0-a2c9-1f408e992906 req-f2302566-99d6-4596-9d65-b676f1a2579b service nova] Creating event network-changed:72eefae9-e092-409d-a34b-1960cf0754fe for instance ac4e77f8-a1e5-4dff-ae75-095b5ef88969 on n-h2-850499-14 Oct 04 18:44:14.321353 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-2afa11ca-ae7d-4ae0-a2c9-1f408e992906 req-f2302566-99d6-4596-9d65-b676f1a2579b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049263 Oct 04 18:44:14.322603 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3254/6498] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:14.886572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f18d506-2a12-4203-8912-0f266c333177 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:14.887938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f18d506-2a12-4203-8912-0f266c333177 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:14.895095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f18d506-2a12-4203-8912-0f266c333177 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.895602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f18d506-2a12-4203-8912-0f266c333177 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.896047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f18d506-2a12-4203-8912-0f266c333177 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.896983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f18d506-2a12-4203-8912-0f266c333177 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.897460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f18d506-2a12-4203-8912-0f266c333177 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.897896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f18d506-2a12-4203-8912-0f266c333177 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.097923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f18d506-2a12-4203-8912-0f266c333177 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:15.110060 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f18d506-2a12-4203-8912-0f266c333177 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1314 microversion: 2.1 time: 0.227863 Oct 04 18:44:15.133177 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3245/6499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:14 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:16.137099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c96687a4-0456-429b-9c07-caae59da8209 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:16.139051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c96687a4-0456-429b-9c07-caae59da8209 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:16.147538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c96687a4-0456-429b-9c07-caae59da8209 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:16.148367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c96687a4-0456-429b-9c07-caae59da8209 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:16.149097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c96687a4-0456-429b-9c07-caae59da8209 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:16.150039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c96687a4-0456-429b-9c07-caae59da8209 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:16.150753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c96687a4-0456-429b-9c07-caae59da8209 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:16.151428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c96687a4-0456-429b-9c07-caae59da8209 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:16.361382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c96687a4-0456-429b-9c07-caae59da8209 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:16.372389 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c96687a4-0456-429b-9c07-caae59da8209 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1314 microversion: 2.1 time: 0.242474 Oct 04 18:44:16.388747 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3255/6500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:16 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:17.401460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ca4fe63-ea39-444e-8679-85bb54cfba79 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:17.402680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6ca4fe63-ea39-444e-8679-85bb54cfba79 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:17.410181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ca4fe63-ea39-444e-8679-85bb54cfba79 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:17.411080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ca4fe63-ea39-444e-8679-85bb54cfba79 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:17.411790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ca4fe63-ea39-444e-8679-85bb54cfba79 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:17.412878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ca4fe63-ea39-444e-8679-85bb54cfba79 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:17.414624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ca4fe63-ea39-444e-8679-85bb54cfba79 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:17.415332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ca4fe63-ea39-444e-8679-85bb54cfba79 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:17.679734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ca4fe63-ea39-444e-8679-85bb54cfba79 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:17.698799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:17.713569 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ca4fe63-ea39-444e-8679-85bb54cfba79 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1314 microversion: 2.1 time: 0.316899 Oct 04 18:44:17.715302 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3246/6501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:17 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:18.739415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d68de91-6842-4b7a-bd42-fe93697ca719 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:18.740842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d68de91-6842-4b7a-bd42-fe93697ca719 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:18.745230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:18.745994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:18.750495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d68de91-6842-4b7a-bd42-fe93697ca719 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.751161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d68de91-6842-4b7a-bd42-fe93697ca719 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.751682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d68de91-6842-4b7a-bd42-fe93697ca719 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.752693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d68de91-6842-4b7a-bd42-fe93697ca719 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.753387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d68de91-6842-4b7a-bd42-fe93697ca719 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.754146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d68de91-6842-4b7a-bd42-fe93697ca719 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.043868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8d68de91-6842-4b7a-bd42-fe93697ca719 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:19.065886 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d68de91-6842-4b7a-bd42-fe93697ca719 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1314 microversion: 2.1 time: 0.330040 Oct 04 18:44:19.086668 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3256/6502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:18 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:20.090910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ed6d929-e6e7-4f91-95ce-04d8aee67029 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:20.091476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6ed6d929-e6e7-4f91-95ce-04d8aee67029 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:20.098761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed6d929-e6e7-4f91-95ce-04d8aee67029 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.099300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed6d929-e6e7-4f91-95ce-04d8aee67029 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.099748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed6d929-e6e7-4f91-95ce-04d8aee67029 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.100464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed6d929-e6e7-4f91-95ce-04d8aee67029 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.100932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed6d929-e6e7-4f91-95ce-04d8aee67029 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.101953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ed6d929-e6e7-4f91-95ce-04d8aee67029 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.246391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ed6d929-e6e7-4f91-95ce-04d8aee67029 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:20.254452 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ed6d929-e6e7-4f91-95ce-04d8aee67029 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1314 microversion: 2.1 time: 0.167447 Oct 04 18:44:20.255169 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3247/6503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:20 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:20.556861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e46262db-f644-49f5-a6d0-78bda65cfff6 req-a26e2fd2-19b8-438f-95a2-dbb71d165fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d936ebba-97f4-43eb-9ce6-74b4040c5a4c", "tag": "7dd9edfd-c0cf-4ec3-9e0e-1c98211ff2ba"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:20.559702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-492a1c3d-7e37-4df3-80d9-3861610988ea tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:20.564905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-492a1c3d-7e37-4df3-80d9-3861610988ea tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:20.575294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-492a1c3d-7e37-4df3-80d9-3861610988ea tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.575867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-492a1c3d-7e37-4df3-80d9-3861610988ea tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.576331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-492a1c3d-7e37-4df3-80d9-3861610988ea tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.576974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-492a1c3d-7e37-4df3-80d9-3861610988ea tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.577446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-492a1c3d-7e37-4df3-80d9-3861610988ea tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.577851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-492a1c3d-7e37-4df3-80d9-3861610988ea tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.589841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e46262db-f644-49f5-a6d0-78bda65cfff6 req-a26e2fd2-19b8-438f-95a2-dbb71d165fe6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.589841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e46262db-f644-49f5-a6d0-78bda65cfff6 req-a26e2fd2-19b8-438f-95a2-dbb71d165fe6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.589841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e46262db-f644-49f5-a6d0-78bda65cfff6 req-a26e2fd2-19b8-438f-95a2-dbb71d165fe6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.599641 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e46262db-f644-49f5-a6d0-78bda65cfff6 req-a26e2fd2-19b8-438f-95a2-dbb71d165fe6 service nova] Creating event network-changed:7dd9edfd-c0cf-4ec3-9e0e-1c98211ff2ba for instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c on n-h2-850499-14 Oct 04 18:44:20.608632 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e46262db-f644-49f5-a6d0-78bda65cfff6 req-a26e2fd2-19b8-438f-95a2-dbb71d165fe6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055219 Oct 04 18:44:20.609985 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3248/6504] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:20.623414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-492a1c3d-7e37-4df3-80d9-3861610988ea tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:20.728959 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-492a1c3d-7e37-4df3-80d9-3861610988ea tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 204 len: 0 microversion: 2.1 time: 0.178962 Oct 04 18:44:20.730386 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3257/6505] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:20 2022] DELETE /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:20.743299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-11c4a63a-c65b-45d8-8749-6a162758cef3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:20.744563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-11c4a63a-c65b-45d8-8749-6a162758cef3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:20.752411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11c4a63a-c65b-45d8-8749-6a162758cef3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.753313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11c4a63a-c65b-45d8-8749-6a162758cef3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.753978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11c4a63a-c65b-45d8-8749-6a162758cef3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.755124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11c4a63a-c65b-45d8-8749-6a162758cef3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.755830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11c4a63a-c65b-45d8-8749-6a162758cef3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.756475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11c4a63a-c65b-45d8-8749-6a162758cef3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.966608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-11c4a63a-c65b-45d8-8749-6a162758cef3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:20.979488 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-11c4a63a-c65b-45d8-8749-6a162758cef3 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1769 microversion: 2.1 time: 0.242594 Oct 04 18:44:20.986693 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3249/6506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:20 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1769 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:21.097656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-dcaed492-a14f-4cbd-a3a2-fdb0281a86e8 req-efcb06ab-c6a4-462a-8bc3-698512a47369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4e77f8-a1e5-4dff-ae75-095b5ef88969", "name": "network-vif-plugged", "status": "completed", "tag": "72eefae9-e092-409d-a34b-1960cf0754fe"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:21.109579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dcaed492-a14f-4cbd-a3a2-fdb0281a86e8 req-efcb06ab-c6a4-462a-8bc3-698512a47369 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.110346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dcaed492-a14f-4cbd-a3a2-fdb0281a86e8 req-efcb06ab-c6a4-462a-8bc3-698512a47369 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.110980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dcaed492-a14f-4cbd-a3a2-fdb0281a86e8 req-efcb06ab-c6a4-462a-8bc3-698512a47369 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:21.123849 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-dcaed492-a14f-4cbd-a3a2-fdb0281a86e8 req-efcb06ab-c6a4-462a-8bc3-698512a47369 service nova] Creating event network-vif-plugged:72eefae9-e092-409d-a34b-1960cf0754fe for instance ac4e77f8-a1e5-4dff-ae75-095b5ef88969 on n-h2-850499-14 Oct 04 18:44:21.128978 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-dcaed492-a14f-4cbd-a3a2-fdb0281a86e8 req-efcb06ab-c6a4-462a-8bc3-698512a47369 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035664 Oct 04 18:44:21.129589 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3258/6507] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:21.279339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db24792d-e4e0-43e8-858f-ab309940016e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:21.280644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-db24792d-e4e0-43e8-858f-ab309940016e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:21.301481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db24792d-e4e0-43e8-858f-ab309940016e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.302056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db24792d-e4e0-43e8-858f-ab309940016e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.302624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db24792d-e4e0-43e8-858f-ab309940016e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:21.303548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db24792d-e4e0-43e8-858f-ab309940016e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.304027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db24792d-e4e0-43e8-858f-ab309940016e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.305105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db24792d-e4e0-43e8-858f-ab309940016e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:21.501533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-db24792d-e4e0-43e8-858f-ab309940016e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:21.512027 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-db24792d-e4e0-43e8-858f-ab309940016e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1314 microversion: 2.1 time: 0.237690 Oct 04 18:44:21.514322 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3250/6508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:21 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:22.003915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5c830f6c-666d-4d12-8720-f5ccaff71888 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:22.004892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5c830f6c-666d-4d12-8720-f5ccaff71888 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:22.018854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c830f6c-666d-4d12-8720-f5ccaff71888 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:22.019481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c830f6c-666d-4d12-8720-f5ccaff71888 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:22.020050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c830f6c-666d-4d12-8720-f5ccaff71888 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.020827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c830f6c-666d-4d12-8720-f5ccaff71888 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:22.021339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c830f6c-666d-4d12-8720-f5ccaff71888 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:22.021887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c830f6c-666d-4d12-8720-f5ccaff71888 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.276536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5c830f6c-666d-4d12-8720-f5ccaff71888 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:22.286401 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5c830f6c-666d-4d12-8720-f5ccaff71888 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1769 microversion: 2.1 time: 0.287039 Oct 04 18:44:22.287038 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3259/6509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:21 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1769 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:22.536423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-252aaa21-58de-476f-a115-0111e821355e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:22.537531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-252aaa21-58de-476f-a115-0111e821355e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:22.546066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-252aaa21-58de-476f-a115-0111e821355e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:22.546576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-252aaa21-58de-476f-a115-0111e821355e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:22.547046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-252aaa21-58de-476f-a115-0111e821355e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.547774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-252aaa21-58de-476f-a115-0111e821355e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:22.548233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-252aaa21-58de-476f-a115-0111e821355e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:22.548716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-252aaa21-58de-476f-a115-0111e821355e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.777741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-252aaa21-58de-476f-a115-0111e821355e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:22.786661 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-252aaa21-58de-476f-a115-0111e821355e tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1314 microversion: 2.1 time: 0.255057 Oct 04 18:44:22.787383 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3251/6510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:22 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:23.312880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16ed89fc-6d14-4b17-8753-e08541fd699b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:23.313708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-16ed89fc-6d14-4b17-8753-e08541fd699b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:23.321214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ed89fc-6d14-4b17-8753-e08541fd699b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.321872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ed89fc-6d14-4b17-8753-e08541fd699b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.322316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ed89fc-6d14-4b17-8753-e08541fd699b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.323063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ed89fc-6d14-4b17-8753-e08541fd699b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.323523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ed89fc-6d14-4b17-8753-e08541fd699b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.324110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16ed89fc-6d14-4b17-8753-e08541fd699b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.606625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-16ed89fc-6d14-4b17-8753-e08541fd699b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:23.621199 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-16ed89fc-6d14-4b17-8753-e08541fd699b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1769 microversion: 2.1 time: 0.312253 Oct 04 18:44:23.622074 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3260/6511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:23 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1769 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:23.813658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-74afa5e2-50ab-4e2d-90d9-c8e2a5559133 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:23.815406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-74afa5e2-50ab-4e2d-90d9-c8e2a5559133 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:23.826309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74afa5e2-50ab-4e2d-90d9-c8e2a5559133 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.827255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74afa5e2-50ab-4e2d-90d9-c8e2a5559133 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.828189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74afa5e2-50ab-4e2d-90d9-c8e2a5559133 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.829471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74afa5e2-50ab-4e2d-90d9-c8e2a5559133 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.830388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74afa5e2-50ab-4e2d-90d9-c8e2a5559133 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.831421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74afa5e2-50ab-4e2d-90d9-c8e2a5559133 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.981024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-74afa5e2-50ab-4e2d-90d9-c8e2a5559133 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:23.989368 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-74afa5e2-50ab-4e2d-90d9-c8e2a5559133 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1314 microversion: 2.1 time: 0.181574 Oct 04 18:44:23.990060 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3252/6512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:23 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:24.246496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-cfb1ce60-2e50-4b8d-870a-c2416e663255 req-6c2e5a1d-57e8-449c-b5dd-85a5fab39274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d936ebba-97f4-43eb-9ce6-74b4040c5a4c", "name": "network-vif-deleted", "tag": "7dd9edfd-c0cf-4ec3-9e0e-1c98211ff2ba"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:24.259835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cfb1ce60-2e50-4b8d-870a-c2416e663255 req-6c2e5a1d-57e8-449c-b5dd-85a5fab39274 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.260358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cfb1ce60-2e50-4b8d-870a-c2416e663255 req-6c2e5a1d-57e8-449c-b5dd-85a5fab39274 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.260801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cfb1ce60-2e50-4b8d-870a-c2416e663255 req-6c2e5a1d-57e8-449c-b5dd-85a5fab39274 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.272631 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-cfb1ce60-2e50-4b8d-870a-c2416e663255 req-6c2e5a1d-57e8-449c-b5dd-85a5fab39274 service nova] Creating event network-vif-deleted:7dd9edfd-c0cf-4ec3-9e0e-1c98211ff2ba for instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c on n-h2-850499-14 Oct 04 18:44:24.277662 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-cfb1ce60-2e50-4b8d-870a-c2416e663255 req-6c2e5a1d-57e8-449c-b5dd-85a5fab39274 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037279 Oct 04 18:44:24.278322 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3261/6513] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:24.646159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:24.647652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:24.654225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.654865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.655775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.656848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.657350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.657873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.699499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.700775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.701649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.702487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lazy-loading 'fault' on Instance uuid d936ebba-97f4-43eb-9ce6-74b4040c5a4c {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:24.751596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e77370b5c14d509d1573ef5f6e92b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8e2ca190554515a144729878a02162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:24.760304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e10539de-1174-4e42-b23a-5bcc3c7b0194 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 200 len: 1384 microversion: 2.1 time: 0.118238 Oct 04 18:44:24.760808 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3253/6514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:24 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 1384 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:25.014680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f8a00fa-7757-41b1-bdae-ffd1e81db7aa tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.015449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3f8a00fa-7757-41b1-bdae-ffd1e81db7aa tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:25.030571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f8a00fa-7757-41b1-bdae-ffd1e81db7aa tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.030571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f8a00fa-7757-41b1-bdae-ffd1e81db7aa tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.030571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f8a00fa-7757-41b1-bdae-ffd1e81db7aa tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.032209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f8a00fa-7757-41b1-bdae-ffd1e81db7aa tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.032209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f8a00fa-7757-41b1-bdae-ffd1e81db7aa tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.032209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f8a00fa-7757-41b1-bdae-ffd1e81db7aa tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.209478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3f8a00fa-7757-41b1-bdae-ffd1e81db7aa tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:25.218470 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f8a00fa-7757-41b1-bdae-ffd1e81db7aa tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1464 microversion: 2.1 time: 0.208532 Oct 04 18:44:25.231647 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3262/6515] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1464 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:25.268105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94f6527a-7fea-42a7-912e-80657d30daf5 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.268879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-94f6527a-7fea-42a7-912e-80657d30daf5 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:25.276770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f6527a-7fea-42a7-912e-80657d30daf5 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.278126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f6527a-7fea-42a7-912e-80657d30daf5 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.278913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f6527a-7fea-42a7-912e-80657d30daf5 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.279728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f6527a-7fea-42a7-912e-80657d30daf5 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.280274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f6527a-7fea-42a7-912e-80657d30daf5 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.280790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94f6527a-7fea-42a7-912e-80657d30daf5 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.302906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:25.313696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-94f6527a-7fea-42a7-912e-80657d30daf5 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:25.405691 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-94f6527a-7fea-42a7-912e-80657d30daf5 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 204 len: 0 microversion: 2.1 time: 0.141182 Oct 04 18:44:25.406497 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3254/6516] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:25 2022] DELETE /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:25.415781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84bfdac5-bf30-4f65-9391-c4dc08c6b898 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.416416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-84bfdac5-bf30-4f65-9391-c4dc08c6b898 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:25.423067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84bfdac5-bf30-4f65-9391-c4dc08c6b898 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.423571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84bfdac5-bf30-4f65-9391-c4dc08c6b898 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.424375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84bfdac5-bf30-4f65-9391-c4dc08c6b898 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.424728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84bfdac5-bf30-4f65-9391-c4dc08c6b898 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.425225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84bfdac5-bf30-4f65-9391-c4dc08c6b898 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.425661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-84bfdac5-bf30-4f65-9391-c4dc08c6b898 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.788398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.789636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] [instance: d936ebba-97f4-43eb-9ce6-74b4040c5a4c] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:25.795967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.796472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.796920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.797629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.798090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.798520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] HTTP exception thrown: Instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c could not be found. Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Request method failure captured: Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c HTTP/1.1 Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH5cnbWo6F33LmUnMN03QA_2C1wuiMJDfRyYUpXfa7CyiCo7KCgVovdi_udJn50kWDEqo-VA1hWWy10C83_H4gS7BPoLYdQBXz_EfyxjouC9b0RAKT3kKghcjZv9W271GUMNMHgJQj_ChMyk5QlmoDpTvSvW_kB7GNQhEUL9lNB00vk Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 6f8e2ca190554515a144729878a02162 Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1344426176 Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f8e2ca190554515a144729878a02162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f8e2ca190554515a144729878a02162"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f8e2ca190554515a144729878a02162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f8e2ca190554515a144729878a02162"}]}] Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1344426176 Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 6f8e2ca190554515a144729878a02162 Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1344426176 Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestSecurityGroupsBasicOps-1344426176-project Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b9e77370b5c14d509d1573ef5f6e92b9 Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1344426176-project Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c could not be found. Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'd936ebba-97f4-43eb-9ce6-74b4040c5a4c'} Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c could not be found. Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:25.816469 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c could not be found. Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c could not be found. Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Returning 404 to user: Instance d936ebba-97f4-43eb-9ce6-74b4040c5a4c could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cdad4858-54ea-48c9-a05c-6ba2eba5b856 tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c" status: 404 len: 111 microversion: 2.1 time: 0.033237 Oct 04 18:44:25.826192 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3255/6517] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/servers/d936ebba-97f4-43eb-9ce6-74b4040c5a4c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:44:25.855681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-84bfdac5-bf30-4f65-9391-c4dc08c6b898 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:25.863925 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84bfdac5-bf30-4f65-9391-c4dc08c6b898 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1470 microversion: 2.1 time: 0.452557 Oct 04 18:44:25.864617 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3263/6518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1470 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:26.889081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-33bd7802-34e8-4b57-b05a-6cb0805b0387 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.889887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-33bd7802-34e8-4b57-b05a-6cb0805b0387 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:26.897829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33bd7802-34e8-4b57-b05a-6cb0805b0387 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:26.899447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33bd7802-34e8-4b57-b05a-6cb0805b0387 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:26.900095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33bd7802-34e8-4b57-b05a-6cb0805b0387 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:26.900897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33bd7802-34e8-4b57-b05a-6cb0805b0387 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:26.901399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33bd7802-34e8-4b57-b05a-6cb0805b0387 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:26.901998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33bd7802-34e8-4b57-b05a-6cb0805b0387 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:27.136210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-33bd7802-34e8-4b57-b05a-6cb0805b0387 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:27.145351 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-33bd7802-34e8-4b57-b05a-6cb0805b0387 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1470 microversion: 2.1 time: 0.261211 Oct 04 18:44:27.146073 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3256/6519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:27.848706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d22474a4-7e9f-4034-91d5-577abcc1e117 req-077f770f-d42d-4396-b847-cc18c3f606b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4e77f8-a1e5-4dff-ae75-095b5ef88969", "name": "network-vif-deleted", "tag": "72eefae9-e092-409d-a34b-1960cf0754fe"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:27.862029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d22474a4-7e9f-4034-91d5-577abcc1e117 req-077f770f-d42d-4396-b847-cc18c3f606b5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:27.863666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d22474a4-7e9f-4034-91d5-577abcc1e117 req-077f770f-d42d-4396-b847-cc18c3f606b5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:27.871236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d22474a4-7e9f-4034-91d5-577abcc1e117 req-077f770f-d42d-4396-b847-cc18c3f606b5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:27.888572 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d22474a4-7e9f-4034-91d5-577abcc1e117 req-077f770f-d42d-4396-b847-cc18c3f606b5 service nova] Creating event network-vif-deleted:72eefae9-e092-409d-a34b-1960cf0754fe for instance ac4e77f8-a1e5-4dff-ae75-095b5ef88969 on n-h2-850499-14 Oct 04 18:44:27.893945 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d22474a4-7e9f-4034-91d5-577abcc1e117 req-077f770f-d42d-4396-b847-cc18c3f606b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051019 Oct 04 18:44:27.894895 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3264/6520] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:28.171308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:28.172975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:28.182913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.183558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.184249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.185119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.185683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.186189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.228650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.229396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.230040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.230690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lazy-loading 'fault' on Instance uuid ac4e77f8-a1e5-4dff-ae75-095b5ef88969 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:28.313140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88dd5b553a684a9daffed5fa573b564c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418659759ae546d981fd2b4885464d62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:28.321492 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4faec677-89ed-4f4f-85ae-b4d8e2a4e355 tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 200 len: 1304 microversion: 2.1 time: 0.154942 Oct 04 18:44:28.322383 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3257/6521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:28 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 1304 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:29.349204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:29.349993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] [instance: ac4e77f8-a1e5-4dff-ae75-095b5ef88969] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:29.361287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:29.361882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:29.362386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:29.363547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:29.365136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:29.366351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:29.382921 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] HTTP exception thrown: Instance ac4e77f8-a1e5-4dff-ae75-095b5ef88969 could not be found. Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Request method failure captured: Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 HTTP/1.1 Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH7zBVql15BLzoUJKGYLvlNKYHran8dQApX-WcADaV9nA9EXVbkBeqxmGKfCWtQxqZTJmxXPntYjAG1fCTZKxjhk3CxYEhwrhs02pr59WDksxBd6iZHL8OtxNoFIzuj9E0rNg_YqqIzXcFTwHFXoBoM2O5FS0TaPyI9W4MzPa4V7iLY Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 418659759ae546d981fd2b4885464d62 Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-VolumesNegativeTest-2126352551 Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_418659759ae546d981fd2b4885464d62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/418659759ae546d981fd2b4885464d62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/418659759ae546d981fd2b4885464d62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/418659759ae546d981fd2b4885464d62"}]}] Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-VolumesNegativeTest-2126352551 Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 418659759ae546d981fd2b4885464d62 Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-VolumesNegativeTest-2126352551 Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-VolumesNegativeTest-2126352551-project Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 88dd5b553a684a9daffed5fa573b564c Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-VolumesNegativeTest-2126352551-project Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ac4e77f8-a1e5-4dff-ae75-095b5ef88969 could not be found. Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ac4e77f8-a1e5-4dff-ae75-095b5ef88969'} Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4e77f8-a1e5-4dff-ae75-095b5ef88969 could not be found. Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4e77f8-a1e5-4dff-ae75-095b5ef88969 could not be found. Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:29.384786 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:44:29.389819 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:29.389819 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:29.389819 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:29.389819 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:29.389819 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:29.389819 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4e77f8-a1e5-4dff-ae75-095b5ef88969 could not be found. Oct 04 18:44:29.389819 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:44:29.392048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] Returning 404 to user: Instance ac4e77f8-a1e5-4dff-ae75-095b5ef88969 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:29.393776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-06df48fc-bacb-48ee-a570-4510e9e09eca tempest-VolumesNegativeTest-2126352551 tempest-VolumesNegativeTest-2126352551-project] 10.222.0.18 "GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969" status: 404 len: 111 microversion: 2.1 time: 0.050402 Oct 04 18:44:29.395007 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3265/6522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:29 2022] GET /compute/v2.1/servers/ac4e77f8-a1e5-4dff-ae75-095b5ef88969 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:44:30.179799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5811c50c-f91a-4655-b9b9-205644dd7d4b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] Calling method '.version_select at 0x7fd4d0987af0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:30.222348 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5811c50c-f91a-4655-b9b9-205644dd7d4b tempest-TestSecurityGroupsBasicOps-1344426176 tempest-TestSecurityGroupsBasicOps-1344426176-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1544284861" status: 202 len: 0 microversion: 2.1 time: 0.046212 Oct 04 18:44:30.223773 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3258/6523] 10.222.0.18 () {58 vars in 1278 bytes} [Tue Oct 4 18:44:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1544284861 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:44:33.232038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5dc232f-3c23-43c6-91d0-19d4bfe0dda6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:33.255083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5dc232f-3c23-43c6-91d0-19d4bfe0dda6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:33.304422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5dc232f-3c23-43c6-91d0-19d4bfe0dda6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.305172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5dc232f-3c23-43c6-91d0-19d4bfe0dda6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.305484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5dc232f-3c23-43c6-91d0-19d4bfe0dda6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.306248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5dc232f-3c23-43c6-91d0-19d4bfe0dda6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.306710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5dc232f-3c23-43c6-91d0-19d4bfe0dda6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.307178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5dc232f-3c23-43c6-91d0-19d4bfe0dda6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.381961 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5dc232f-3c23-43c6-91d0-19d4bfe0dda6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5/action" status: 200 len: 24574 microversion: 2.1 time: 0.155839 Oct 04 18:44:33.387023 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3266/6524] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:33 2022] POST /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5/action => generated 24574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:44:44.510133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:44.511437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:44.517079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fb1581dc-646b-43f8-b172-2ea31e083eef tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:44.517764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fb1581dc-646b-43f8-b172-2ea31e083eef tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:44.537791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1581dc-646b-43f8-b172-2ea31e083eef tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.538327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1581dc-646b-43f8-b172-2ea31e083eef tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.539947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1581dc-646b-43f8-b172-2ea31e083eef tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.542621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1581dc-646b-43f8-b172-2ea31e083eef tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.543320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1581dc-646b-43f8-b172-2ea31e083eef tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.547706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fb1581dc-646b-43f8-b172-2ea31e083eef tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.145417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fb1581dc-646b-43f8-b172-2ea31e083eef tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:45.155753 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fb1581dc-646b-43f8-b172-2ea31e083eef tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1683 microversion: 2.1 time: 0.647618 Oct 04 18:44:45.174476 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3259/6525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:44 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1683 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:45.296670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:45.297418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:45.302361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4daecb6b-8fb4-4286-8e19-d28a82bdf024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:45.306140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4daecb6b-8fb4-4286-8e19-d28a82bdf024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.319137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4daecb6b-8fb4-4286-8e19-d28a82bdf024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.319997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4daecb6b-8fb4-4286-8e19-d28a82bdf024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.320622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4daecb6b-8fb4-4286-8e19-d28a82bdf024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.321574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4daecb6b-8fb4-4286-8e19-d28a82bdf024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.322399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4daecb6b-8fb4-4286-8e19-d28a82bdf024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.323070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4daecb6b-8fb4-4286-8e19-d28a82bdf024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.396969 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4daecb6b-8fb4-4286-8e19-d28a82bdf024 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5/action" status: 200 len: 32635 microversion: 2.1 time: 0.100504 Oct 04 18:44:45.405864 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3267/6526] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:45 2022] POST /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5/action => generated 32635 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:44:45.558322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cc283caf-6404-4752-abba-7b32ffa4e80a tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:45.558965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cc283caf-6404-4752-abba-7b32ffa4e80a tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.574398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc283caf-6404-4752-abba-7b32ffa4e80a tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.575659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc283caf-6404-4752-abba-7b32ffa4e80a tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.576057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc283caf-6404-4752-abba-7b32ffa4e80a tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.578679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc283caf-6404-4752-abba-7b32ffa4e80a tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.579238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc283caf-6404-4752-abba-7b32ffa4e80a tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.589266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc283caf-6404-4752-abba-7b32ffa4e80a tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.866453 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cc283caf-6404-4752-abba-7b32ffa4e80a tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1836 microversion: 2.1 time: 0.312001 Oct 04 18:44:45.868518 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3260/6527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:45 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1836 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:45.899353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:45.902157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.910627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.911432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.914406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.915411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.916056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.916670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.945928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lazy-loading 'flavor' on Instance uuid 41975968-b6e1-4975-861e-c5ba5655f1b5 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:45.962873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Going to try to live migrate instance to another host {{(pid=122332) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:44:49.301272 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-98c88656-324e-4895-9724-e7dfeeff2a2f tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5/action" status: 202 len: 0 microversion: 2.1 time: 3.405475 Oct 04 18:44:49.302465 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3268/6528] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:45 2022] POST /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5/action => generated 0 bytes in 3409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:44:49.314085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d2708fda-6049-4fbe-a8c6-8a59f5fc8b65 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:49.315228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d2708fda-6049-4fbe-a8c6-8a59f5fc8b65 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:49.330417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2708fda-6049-4fbe-a8c6-8a59f5fc8b65 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.332111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2708fda-6049-4fbe-a8c6-8a59f5fc8b65 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.332342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2708fda-6049-4fbe-a8c6-8a59f5fc8b65 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.333012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2708fda-6049-4fbe-a8c6-8a59f5fc8b65 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.336559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2708fda-6049-4fbe-a8c6-8a59f5fc8b65 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.337048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2708fda-6049-4fbe-a8c6-8a59f5fc8b65 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.902188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d2708fda-6049-4fbe-a8c6-8a59f5fc8b65 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:49.916575 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d2708fda-6049-4fbe-a8c6-8a59f5fc8b65 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.603332 Oct 04 18:44:49.917626 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3261/6529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:49 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:50.928652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-fbcf6c2a-8d8e-4adf-86ca-f7734cd99a98 req-414f9ab5-bc67-4868-9e18-e571b1a872c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41975968-b6e1-4975-861e-c5ba5655f1b5", "name": "network-vif-unplugged", "status": "completed", "tag": "7438ffb1-ab55-4e42-b1da-aae53c113e89"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:50.942637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-91ed4506-3545-406d-b2ad-517c8c9c2134 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:50.943527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-91ed4506-3545-406d-b2ad-517c8c9c2134 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:50.944645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fbcf6c2a-8d8e-4adf-86ca-f7734cd99a98 req-414f9ab5-bc67-4868-9e18-e571b1a872c8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.945971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fbcf6c2a-8d8e-4adf-86ca-f7734cd99a98 req-414f9ab5-bc67-4868-9e18-e571b1a872c8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.946637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fbcf6c2a-8d8e-4adf-86ca-f7734cd99a98 req-414f9ab5-bc67-4868-9e18-e571b1a872c8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.962806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91ed4506-3545-406d-b2ad-517c8c9c2134 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.963351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91ed4506-3545-406d-b2ad-517c8c9c2134 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.964092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91ed4506-3545-406d-b2ad-517c8c9c2134 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.964840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91ed4506-3545-406d-b2ad-517c8c9c2134 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.965306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91ed4506-3545-406d-b2ad-517c8c9c2134 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.965863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91ed4506-3545-406d-b2ad-517c8c9c2134 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.967504 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-fbcf6c2a-8d8e-4adf-86ca-f7734cd99a98 req-414f9ab5-bc67-4868-9e18-e571b1a872c8 service nova] Creating event network-vif-unplugged:7438ffb1-ab55-4e42-b1da-aae53c113e89 for instance 41975968-b6e1-4975-861e-c5ba5655f1b5 on n-h1-850499-14 Oct 04 18:44:51.002298 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-fbcf6c2a-8d8e-4adf-86ca-f7734cd99a98 req-414f9ab5-bc67-4868-9e18-e571b1a872c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073212 Oct 04 18:44:51.003239 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3269/6530] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:51.361558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-91ed4506-3545-406d-b2ad-517c8c9c2134 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:51.371658 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-91ed4506-3545-406d-b2ad-517c8c9c2134 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.433638 Oct 04 18:44:51.375024 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3262/6531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:50 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:52.399771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b8268b3d-4bda-41b0-a495-116764aa359c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:52.401159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b8268b3d-4bda-41b0-a495-116764aa359c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:52.448268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8268b3d-4bda-41b0-a495-116764aa359c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.450062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8268b3d-4bda-41b0-a495-116764aa359c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.450827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8268b3d-4bda-41b0-a495-116764aa359c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.456803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8268b3d-4bda-41b0-a495-116764aa359c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.457790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8268b3d-4bda-41b0-a495-116764aa359c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.458892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8268b3d-4bda-41b0-a495-116764aa359c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.790344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b8268b3d-4bda-41b0-a495-116764aa359c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:52.807041 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b8268b3d-4bda-41b0-a495-116764aa359c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.412983 Oct 04 18:44:52.808735 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3270/6532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:52 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:53.064719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-84977efe-0834-4394-a967-c8cea3f8207f req-bbb0b24b-01d7-4e3b-be16-5d350e276a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41975968-b6e1-4975-861e-c5ba5655f1b5", "tag": "7438ffb1-ab55-4e42-b1da-aae53c113e89"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:53.086272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-84977efe-0834-4394-a967-c8cea3f8207f req-bbb0b24b-01d7-4e3b-be16-5d350e276a44 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.087547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-84977efe-0834-4394-a967-c8cea3f8207f req-bbb0b24b-01d7-4e3b-be16-5d350e276a44 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.088437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-84977efe-0834-4394-a967-c8cea3f8207f req-bbb0b24b-01d7-4e3b-be16-5d350e276a44 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.105116 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-84977efe-0834-4394-a967-c8cea3f8207f req-bbb0b24b-01d7-4e3b-be16-5d350e276a44 service nova] Creating event network-changed:7438ffb1-ab55-4e42-b1da-aae53c113e89 for instance 41975968-b6e1-4975-861e-c5ba5655f1b5 on n-h1-850499-14 Oct 04 18:44:53.111455 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-84977efe-0834-4394-a967-c8cea3f8207f req-bbb0b24b-01d7-4e3b-be16-5d350e276a44 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052324 Oct 04 18:44:53.113391 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3263/6533] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:53.834645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b404f0e0-356e-4773-a60c-29876790614d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:53.836606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b404f0e0-356e-4773-a60c-29876790614d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:53.845817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b404f0e0-356e-4773-a60c-29876790614d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.846314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b404f0e0-356e-4773-a60c-29876790614d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.846765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b404f0e0-356e-4773-a60c-29876790614d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.847527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b404f0e0-356e-4773-a60c-29876790614d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.848194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b404f0e0-356e-4773-a60c-29876790614d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.849064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b404f0e0-356e-4773-a60c-29876790614d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.240373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b404f0e0-356e-4773-a60c-29876790614d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:54.254765 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b404f0e0-356e-4773-a60c-29876790614d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.427808 Oct 04 18:44:54.280980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3271/6534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:53 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:55.281695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f5955da4-16cf-47b4-8018-804518d86ba5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:55.282347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f5955da4-16cf-47b4-8018-804518d86ba5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:55.285424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc074ae7-8828-4612-9f38-b1044f66bd46 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:55.286885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc074ae7-8828-4612-9f38-b1044f66bd46 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.287424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc074ae7-8828-4612-9f38-b1044f66bd46 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.287983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc074ae7-8828-4612-9f38-b1044f66bd46 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.288827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc074ae7-8828-4612-9f38-b1044f66bd46 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.289577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc074ae7-8828-4612-9f38-b1044f66bd46 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.290187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5955da4-16cf-47b4-8018-804518d86ba5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.290631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc074ae7-8828-4612-9f38-b1044f66bd46 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.290892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5955da4-16cf-47b4-8018-804518d86ba5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.291366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5955da4-16cf-47b4-8018-804518d86ba5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.292243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5955da4-16cf-47b4-8018-804518d86ba5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.292706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5955da4-16cf-47b4-8018-804518d86ba5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.293332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5955da4-16cf-47b4-8018-804518d86ba5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.329284 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dc074ae7-8828-4612-9f38-b1044f66bd46 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.357712 Oct 04 18:44:55.330219 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3264/6535] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 4 18:44:54 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:55.500052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-555258842", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "availability_zone": "nova:n-h2-850499-14", "networks": [{"uuid": "0c54858d-1ed8-40db-8daa-952f7728b804"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:55.528812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f5955da4-16cf-47b4-8018-804518d86ba5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:55.537847 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f5955da4-16cf-47b4-8018-804518d86ba5 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.260139 Oct 04 18:44:55.538785 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3272/6536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:55 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:55.603763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] validate_networks() for [('0c54858d-1ed8-40db-8daa-952f7728b804', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:56.306262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:56.307779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:56.308546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:56.309025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:56.309511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:56.334315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.335317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.336028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.336860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.337398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.337930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.361251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Getting quotas for project 2102744ce3d64ae4bf1852f65d085141. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:56.367830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Getting quotas for user 599068ac49824652bc237fde15518bec and project 2102744ce3d64ae4bf1852f65d085141. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:56.382889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:56.385564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:56.440618 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-379dfbfc-a119-491d-92fe-37d9452385b4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943888 Oct 04 18:44:56.452671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e385d1ef-61a3-40f5-9cc0-ddab41d36d55 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:56.454029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e385d1ef-61a3-40f5-9cc0-ddab41d36d55 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:56.456368 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3265/6537] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:56.531161 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e385d1ef-61a3-40f5-9cc0-ddab41d36d55 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1328 microversion: 2.1 time: 0.081848 Oct 04 18:44:56.544084 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3273/6538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:56 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:56.562180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-640ac857-173d-467c-82b0-d19aed8078a6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:56.562812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-640ac857-173d-467c-82b0-d19aed8078a6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:56.577015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640ac857-173d-467c-82b0-d19aed8078a6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.577525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640ac857-173d-467c-82b0-d19aed8078a6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.577975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640ac857-173d-467c-82b0-d19aed8078a6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.578680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640ac857-173d-467c-82b0-d19aed8078a6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.579161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640ac857-173d-467c-82b0-d19aed8078a6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.579586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-640ac857-173d-467c-82b0-d19aed8078a6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.750826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-640ac857-173d-467c-82b0-d19aed8078a6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:56.763543 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-640ac857-173d-467c-82b0-d19aed8078a6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.205080 Oct 04 18:44:56.775015 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3266/6539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:56 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:57.562023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-957342df-8092-4926-b0aa-4162e317b884 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:57.562839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-957342df-8092-4926-b0aa-4162e317b884 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:57.578643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957342df-8092-4926-b0aa-4162e317b884 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.579418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957342df-8092-4926-b0aa-4162e317b884 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.580402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957342df-8092-4926-b0aa-4162e317b884 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.582239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957342df-8092-4926-b0aa-4162e317b884 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.582855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957342df-8092-4926-b0aa-4162e317b884 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.584228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-957342df-8092-4926-b0aa-4162e317b884 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.685947 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-957342df-8092-4926-b0aa-4162e317b884 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1417 microversion: 2.1 time: 0.131613 Oct 04 18:44:57.686595 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3274/6540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:57 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1417 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:57.801479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-002d53dc-81d6-4537-81af-3f1c4e308055 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:57.802109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-002d53dc-81d6-4537-81af-3f1c4e308055 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:57.811525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002d53dc-81d6-4537-81af-3f1c4e308055 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.812534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002d53dc-81d6-4537-81af-3f1c4e308055 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.812534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002d53dc-81d6-4537-81af-3f1c4e308055 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.813630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002d53dc-81d6-4537-81af-3f1c4e308055 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.813630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002d53dc-81d6-4537-81af-3f1c4e308055 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.814412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002d53dc-81d6-4537-81af-3f1c4e308055 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.009218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-002d53dc-81d6-4537-81af-3f1c4e308055 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:58.020010 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-002d53dc-81d6-4537-81af-3f1c4e308055 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.222468 Oct 04 18:44:58.021224 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3267/6541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:57 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:58.718118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-543f46df-1157-42dd-b281-3f271fc9e7e1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:58.720175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-543f46df-1157-42dd-b281-3f271fc9e7e1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:58.758840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-543f46df-1157-42dd-b281-3f271fc9e7e1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.760638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-543f46df-1157-42dd-b281-3f271fc9e7e1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.762369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-543f46df-1157-42dd-b281-3f271fc9e7e1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.763300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-543f46df-1157-42dd-b281-3f271fc9e7e1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.764427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-543f46df-1157-42dd-b281-3f271fc9e7e1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.766091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-543f46df-1157-42dd-b281-3f271fc9e7e1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.046988 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-543f46df-1157-42dd-b281-3f271fc9e7e1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1423 microversion: 2.1 time: 0.338280 Oct 04 18:44:59.047610 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3275/6542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:58 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1423 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.048459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39f5bec3-0750-4fec-9051-c20d726eb88d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.049731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39f5bec3-0750-4fec-9051-c20d726eb88d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.063169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f5bec3-0750-4fec-9051-c20d726eb88d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.064070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f5bec3-0750-4fec-9051-c20d726eb88d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.064777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f5bec3-0750-4fec-9051-c20d726eb88d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.068697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f5bec3-0750-4fec-9051-c20d726eb88d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.069461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f5bec3-0750-4fec-9051-c20d726eb88d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.070090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39f5bec3-0750-4fec-9051-c20d726eb88d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.352863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-39f5bec3-0750-4fec-9051-c20d726eb88d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.368023 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39f5bec3-0750-4fec-9051-c20d726eb88d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.323864 Oct 04 18:44:59.386874 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3268/6543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:00.076817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5b2d7ab1-8c42-4ea6-af26-d5d84a726351 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:00.077789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5b2d7ab1-8c42-4ea6-af26-d5d84a726351 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:00.097526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b2d7ab1-8c42-4ea6-af26-d5d84a726351 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.099817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b2d7ab1-8c42-4ea6-af26-d5d84a726351 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.103714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b2d7ab1-8c42-4ea6-af26-d5d84a726351 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.105522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b2d7ab1-8c42-4ea6-af26-d5d84a726351 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.108116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b2d7ab1-8c42-4ea6-af26-d5d84a726351 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.125446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b2d7ab1-8c42-4ea6-af26-d5d84a726351 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.393654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d314042-dd67-4317-9500-4822907f7f59 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:00.394890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8d314042-dd67-4317-9500-4822907f7f59 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:00.404348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d314042-dd67-4317-9500-4822907f7f59 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.405125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d314042-dd67-4317-9500-4822907f7f59 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.405943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d314042-dd67-4317-9500-4822907f7f59 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.406869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d314042-dd67-4317-9500-4822907f7f59 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.407552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d314042-dd67-4317-9500-4822907f7f59 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.408379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d314042-dd67-4317-9500-4822907f7f59 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.528275 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5b2d7ab1-8c42-4ea6-af26-d5d84a726351 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1465 microversion: 2.1 time: 0.455751 Oct 04 18:45:00.530359 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3276/6544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:00 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1465 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:00.681066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d314042-dd67-4317-9500-4822907f7f59 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:00.707005 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8d314042-dd67-4317-9500-4822907f7f59 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.314235 Oct 04 18:45:00.710549 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3269/6545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:00 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:00.994934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-990f9cad-8c22-408e-af8d-605f78b79cf2 req-b63f3ba4-ee23-4756-9e26-49dcfe66edb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a144e9d6-b07a-43d4-a229-c73733be4562", "tag": "efd4ca1b-312b-4d62-a4d9-b9169be3392c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:01.014584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-990f9cad-8c22-408e-af8d-605f78b79cf2 req-b63f3ba4-ee23-4756-9e26-49dcfe66edb3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.015470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-990f9cad-8c22-408e-af8d-605f78b79cf2 req-b63f3ba4-ee23-4756-9e26-49dcfe66edb3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.015938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-990f9cad-8c22-408e-af8d-605f78b79cf2 req-b63f3ba4-ee23-4756-9e26-49dcfe66edb3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.047469 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-990f9cad-8c22-408e-af8d-605f78b79cf2 req-b63f3ba4-ee23-4756-9e26-49dcfe66edb3 service nova] Creating event network-changed:efd4ca1b-312b-4d62-a4d9-b9169be3392c for instance a144e9d6-b07a-43d4-a229-c73733be4562 on n-h2-850499-14 Oct 04 18:45:01.059745 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-990f9cad-8c22-408e-af8d-605f78b79cf2 req-b63f3ba4-ee23-4756-9e26-49dcfe66edb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069529 Oct 04 18:45:01.064178 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3277/6546] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:45:01.553178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39371ebb-799e-4703-8559-7e58ac29b38e tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:01.555293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39371ebb-799e-4703-8559-7e58ac29b38e tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:01.571233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39371ebb-799e-4703-8559-7e58ac29b38e tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.575315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39371ebb-799e-4703-8559-7e58ac29b38e tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.576561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39371ebb-799e-4703-8559-7e58ac29b38e tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.580365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39371ebb-799e-4703-8559-7e58ac29b38e tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.582333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39371ebb-799e-4703-8559-7e58ac29b38e tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.584436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39371ebb-799e-4703-8559-7e58ac29b38e tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.735071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-89f059e1-d23e-4fb5-b228-619f828d5fd0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:01.736701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-89f059e1-d23e-4fb5-b228-619f828d5fd0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:01.753687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f059e1-d23e-4fb5-b228-619f828d5fd0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.757062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f059e1-d23e-4fb5-b228-619f828d5fd0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.758298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f059e1-d23e-4fb5-b228-619f828d5fd0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.759889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f059e1-d23e-4fb5-b228-619f828d5fd0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.762448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f059e1-d23e-4fb5-b228-619f828d5fd0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.763108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f059e1-d23e-4fb5-b228-619f828d5fd0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.526709 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39371ebb-799e-4703-8559-7e58ac29b38e tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1465 microversion: 2.1 time: 0.978158 Oct 04 18:45:02.527351 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3270/6547] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:01 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1465 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:02.537810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-89f059e1-d23e-4fb5-b228-619f828d5fd0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.556443 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-89f059e1-d23e-4fb5-b228-619f828d5fd0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.826789 Oct 04 18:45:02.559424 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3278/6548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:01 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:03.556746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17952710-db57-46e3-9e64-1cd5bd3fe4d4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.559216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17952710-db57-46e3-9e64-1cd5bd3fe4d4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:03.573356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17952710-db57-46e3-9e64-1cd5bd3fe4d4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.573850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17952710-db57-46e3-9e64-1cd5bd3fe4d4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.574467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17952710-db57-46e3-9e64-1cd5bd3fe4d4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.575589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17952710-db57-46e3-9e64-1cd5bd3fe4d4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.576630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17952710-db57-46e3-9e64-1cd5bd3fe4d4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.586773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-64533985-c214-45f7-9d32-5886ffdb13d0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.588114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17952710-db57-46e3-9e64-1cd5bd3fe4d4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.596092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-64533985-c214-45f7-9d32-5886ffdb13d0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:03.609355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64533985-c214-45f7-9d32-5886ffdb13d0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.610776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64533985-c214-45f7-9d32-5886ffdb13d0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.612931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64533985-c214-45f7-9d32-5886ffdb13d0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.614075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64533985-c214-45f7-9d32-5886ffdb13d0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.615318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64533985-c214-45f7-9d32-5886ffdb13d0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.615709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-64533985-c214-45f7-9d32-5886ffdb13d0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.064055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-64533985-c214-45f7-9d32-5886ffdb13d0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.081023 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17952710-db57-46e3-9e64-1cd5bd3fe4d4 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1465 microversion: 2.1 time: 0.534260 Oct 04 18:45:04.088875 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-64533985-c214-45f7-9d32-5886ffdb13d0 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.502072 Oct 04 18:45:04.089749 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3279/6549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:03 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:04.091859 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3271/6550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:03 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1465 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:05.133681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a909ee6c-3c3e-47a9-805c-9703c1794da2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:05.134691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a909ee6c-3c3e-47a9-805c-9703c1794da2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:05.143219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90023e69-b6ba-46e5-8e99-341a2a371a2c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:05.144007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a909ee6c-3c3e-47a9-805c-9703c1794da2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.144162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90023e69-b6ba-46e5-8e99-341a2a371a2c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:05.144819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a909ee6c-3c3e-47a9-805c-9703c1794da2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.145646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a909ee6c-3c3e-47a9-805c-9703c1794da2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.146884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a909ee6c-3c3e-47a9-805c-9703c1794da2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.147618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a909ee6c-3c3e-47a9-805c-9703c1794da2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.148422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a909ee6c-3c3e-47a9-805c-9703c1794da2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.152756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90023e69-b6ba-46e5-8e99-341a2a371a2c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.155017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90023e69-b6ba-46e5-8e99-341a2a371a2c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.155756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90023e69-b6ba-46e5-8e99-341a2a371a2c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.156692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90023e69-b6ba-46e5-8e99-341a2a371a2c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.157355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90023e69-b6ba-46e5-8e99-341a2a371a2c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.157979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90023e69-b6ba-46e5-8e99-341a2a371a2c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.410612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90023e69-b6ba-46e5-8e99-341a2a371a2c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:05.413197 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a909ee6c-3c3e-47a9-805c-9703c1794da2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1465 microversion: 2.1 time: 0.284425 Oct 04 18:45:05.414825 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3280/6551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:05 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1465 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:05.419457 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90023e69-b6ba-46e5-8e99-341a2a371a2c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.281136 Oct 04 18:45:05.433150 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3272/6552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:05 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:06.442567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-92a4920f-8b63-4a08-b94d-2183eb5c5731 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:06.445142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-92a4920f-8b63-4a08-b94d-2183eb5c5731 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:06.445835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65cabb50-adde-46d4-af0c-21f5cedca29b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:06.447258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65cabb50-adde-46d4-af0c-21f5cedca29b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:06.454588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:06.456333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:06.459253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a4920f-8b63-4a08-b94d-2183eb5c5731 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.459576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cabb50-adde-46d4-af0c-21f5cedca29b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.460786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a4920f-8b63-4a08-b94d-2183eb5c5731 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.461276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cabb50-adde-46d4-af0c-21f5cedca29b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.461767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cabb50-adde-46d4-af0c-21f5cedca29b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.461955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a4920f-8b63-4a08-b94d-2183eb5c5731 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.462867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cabb50-adde-46d4-af0c-21f5cedca29b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.463475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cabb50-adde-46d4-af0c-21f5cedca29b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.463662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a4920f-8b63-4a08-b94d-2183eb5c5731 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.463918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65cabb50-adde-46d4-af0c-21f5cedca29b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.465073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a4920f-8b63-4a08-b94d-2183eb5c5731 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.466045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-92a4920f-8b63-4a08-b94d-2183eb5c5731 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.534592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:06.812339 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-92a4920f-8b63-4a08-b94d-2183eb5c5731 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1465 microversion: 2.1 time: 0.376638 Oct 04 18:45:06.814083 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3281/6553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:06 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1465 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:06.819140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65cabb50-adde-46d4-af0c-21f5cedca29b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:06.857063 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65cabb50-adde-46d4-af0c-21f5cedca29b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1693 microversion: 2.1 time: 0.403732 Oct 04 18:45:06.858378 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3273/6554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:06 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1693 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:07.105191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-509bc474-2052-4afc-b329-d20a10719731 req-dc98b0d3-80d3-4d55-a345-5b23a24a63b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a144e9d6-b07a-43d4-a229-c73733be4562", "name": "network-vif-plugged", "status": "completed", "tag": "efd4ca1b-312b-4d62-a4d9-b9169be3392c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:07.117204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-509bc474-2052-4afc-b329-d20a10719731 req-dc98b0d3-80d3-4d55-a345-5b23a24a63b1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.117711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-509bc474-2052-4afc-b329-d20a10719731 req-dc98b0d3-80d3-4d55-a345-5b23a24a63b1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.118320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-509bc474-2052-4afc-b329-d20a10719731 req-dc98b0d3-80d3-4d55-a345-5b23a24a63b1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.134069 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-509bc474-2052-4afc-b329-d20a10719731 req-dc98b0d3-80d3-4d55-a345-5b23a24a63b1 service nova] Creating event network-vif-plugged:efd4ca1b-312b-4d62-a4d9-b9169be3392c for instance a144e9d6-b07a-43d4-a229-c73733be4562 on n-h2-850499-14 Oct 04 18:45:07.141191 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-509bc474-2052-4afc-b329-d20a10719731 req-dc98b0d3-80d3-4d55-a345-5b23a24a63b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324997 Oct 04 18:45:07.142043 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3282/6555] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:07.845095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6a580311-7b27-43e8-9613-0c661e64e13b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:07.846065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6a580311-7b27-43e8-9613-0c661e64e13b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:07.857954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a580311-7b27-43e8-9613-0c661e64e13b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.858179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a580311-7b27-43e8-9613-0c661e64e13b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.858585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a580311-7b27-43e8-9613-0c661e64e13b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.859354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a580311-7b27-43e8-9613-0c661e64e13b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.859818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a580311-7b27-43e8-9613-0c661e64e13b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.860248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a580311-7b27-43e8-9613-0c661e64e13b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.898605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ecba14ee-9563-4770-a167-ff78d8511934 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:07.900059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ecba14ee-9563-4770-a167-ff78d8511934 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:07.908586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecba14ee-9563-4770-a167-ff78d8511934 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.909086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecba14ee-9563-4770-a167-ff78d8511934 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.909739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecba14ee-9563-4770-a167-ff78d8511934 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.910743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecba14ee-9563-4770-a167-ff78d8511934 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.911176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecba14ee-9563-4770-a167-ff78d8511934 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.911926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ecba14ee-9563-4770-a167-ff78d8511934 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.406525 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6a580311-7b27-43e8-9613-0c661e64e13b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1465 microversion: 2.1 time: 0.567949 Oct 04 18:45:08.408021 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3274/6556] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:07 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1465 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.432267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ecba14ee-9563-4770-a167-ff78d8511934 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.451544 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ecba14ee-9563-4770-a167-ff78d8511934 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1683 microversion: 2.1 time: 0.549685 Oct 04 18:45:08.452191 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3283/6557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:07 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1683 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.477954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17b71a94-50de-492b-bc39-d8c9819a2fb5 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.478583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17b71a94-50de-492b-bc39-d8c9819a2fb5 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.485042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b71a94-50de-492b-bc39-d8c9819a2fb5 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.485482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b71a94-50de-492b-bc39-d8c9819a2fb5 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.485933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b71a94-50de-492b-bc39-d8c9819a2fb5 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.486652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b71a94-50de-492b-bc39-d8c9819a2fb5 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.487157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b71a94-50de-492b-bc39-d8c9819a2fb5 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.487595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17b71a94-50de-492b-bc39-d8c9819a2fb5 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.674807 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17b71a94-50de-492b-bc39-d8c9819a2fb5 tempest-TestNetworkAdvancedServerOps-2094985029 tempest-TestNetworkAdvancedServerOps-2094985029-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1836 microversion: 2.1 time: 0.200804 Oct 04 18:45:08.675983 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3275/6558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1836 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.699731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6321fea0-6ed0-4c2d-904c-e1bcf69fd8dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.700619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6321fea0-6ed0-4c2d-904c-e1bcf69fd8dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.707100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6321fea0-6ed0-4c2d-904c-e1bcf69fd8dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.707529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6321fea0-6ed0-4c2d-904c-e1bcf69fd8dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.707971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6321fea0-6ed0-4c2d-904c-e1bcf69fd8dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.709421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6321fea0-6ed0-4c2d-904c-e1bcf69fd8dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.709421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6321fea0-6ed0-4c2d-904c-e1bcf69fd8dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.709850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6321fea0-6ed0-4c2d-904c-e1bcf69fd8dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.867755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6321fea0-6ed0-4c2d-904c-e1bcf69fd8dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.876445 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6321fea0-6ed0-4c2d-904c-e1bcf69fd8dc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1683 microversion: 2.1 time: 0.180456 Oct 04 18:45:08.877046 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3284/6559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:09.015626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d720aab2-6a86-4f8a-aea6-5f34aa30c4b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:09.018316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d720aab2-6a86-4f8a-aea6-5f34aa30c4b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.026378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d720aab2-6a86-4f8a-aea6-5f34aa30c4b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.026874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d720aab2-6a86-4f8a-aea6-5f34aa30c4b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.027376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d720aab2-6a86-4f8a-aea6-5f34aa30c4b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.028079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d720aab2-6a86-4f8a-aea6-5f34aa30c4b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.028533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d720aab2-6a86-4f8a-aea6-5f34aa30c4b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.028962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d720aab2-6a86-4f8a-aea6-5f34aa30c4b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.115428 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d720aab2-6a86-4f8a-aea6-5f34aa30c4b9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5/action" status: 200 len: 38649 microversion: 2.1 time: 0.107725 Oct 04 18:45:09.123031 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3276/6560] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:45:09 2022] POST /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5/action => generated 38649 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:45:09.432904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e53e76f7-7e65-483e-a5c8-7e8bac3237b9 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.434303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e53e76f7-7e65-483e-a5c8-7e8bac3237b9 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.444065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e53e76f7-7e65-483e-a5c8-7e8bac3237b9 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.445294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e53e76f7-7e65-483e-a5c8-7e8bac3237b9 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.445943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e53e76f7-7e65-483e-a5c8-7e8bac3237b9 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.447664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e53e76f7-7e65-483e-a5c8-7e8bac3237b9 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.448187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e53e76f7-7e65-483e-a5c8-7e8bac3237b9 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.448633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e53e76f7-7e65-483e-a5c8-7e8bac3237b9 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.453353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:09.725182 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e53e76f7-7e65-483e-a5c8-7e8bac3237b9 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1650 microversion: 2.1 time: 0.296901 Oct 04 18:45:09.727516 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3285/6561] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:09 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1650 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:09.755958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-48bb04fb-5314-44a6-8d87-6bcd63e5a8ed tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.757144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-48bb04fb-5314-44a6-8d87-6bcd63e5a8ed tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.765396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48bb04fb-5314-44a6-8d87-6bcd63e5a8ed tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.766167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48bb04fb-5314-44a6-8d87-6bcd63e5a8ed tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.766850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48bb04fb-5314-44a6-8d87-6bcd63e5a8ed tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.767928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48bb04fb-5314-44a6-8d87-6bcd63e5a8ed tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.768602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48bb04fb-5314-44a6-8d87-6bcd63e5a8ed tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.769221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-48bb04fb-5314-44a6-8d87-6bcd63e5a8ed tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.042411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:10.045697 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-48bb04fb-5314-44a6-8d87-6bcd63e5a8ed tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1650 microversion: 2.1 time: 0.293867 Oct 04 18:45:10.046316 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3277/6562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:09 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1650 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:10.070139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-38e929d0-88a1-46fa-9c21-0890e5f2d161 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.071000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-38e929d0-88a1-46fa-9c21-0890e5f2d161 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.077699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38e929d0-88a1-46fa-9c21-0890e5f2d161 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.078596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38e929d0-88a1-46fa-9c21-0890e5f2d161 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.079201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38e929d0-88a1-46fa-9c21-0890e5f2d161 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.080022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38e929d0-88a1-46fa-9c21-0890e5f2d161 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.080657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38e929d0-88a1-46fa-9c21-0890e5f2d161 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.081240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-38e929d0-88a1-46fa-9c21-0890e5f2d161 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.366467 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-38e929d0-88a1-46fa-9c21-0890e5f2d161 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1650 microversion: 2.1 time: 0.300816 Oct 04 18:45:10.367289 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3286/6563] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:10 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1650 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:10.435620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1288099399", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "availability_zone": "nova:n-h1-850499-14", "networks": [{"uuid": "0c54858d-1ed8-40db-8daa-952f7728b804"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:10.515295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] validate_networks() for [('0c54858d-1ed8-40db-8daa-952f7728b804', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:45:10.673673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3e9c7d1a-d4d2-4e15-bb9a-18d9c618a00a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.674297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3e9c7d1a-d4d2-4e15-bb9a-18d9c618a00a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.688077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9c7d1a-d4d2-4e15-bb9a-18d9c618a00a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.688855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9c7d1a-d4d2-4e15-bb9a-18d9c618a00a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.690692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9c7d1a-d4d2-4e15-bb9a-18d9c618a00a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.691721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9c7d1a-d4d2-4e15-bb9a-18d9c618a00a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.692565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9c7d1a-d4d2-4e15-bb9a-18d9c618a00a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.693514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e9c7d1a-d4d2-4e15-bb9a-18d9c618a00a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.747814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3e9c7d1a-d4d2-4e15-bb9a-18d9c618a00a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:10.895359 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3e9c7d1a-d4d2-4e15-bb9a-18d9c618a00a tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 204 len: 0 microversion: 2.1 time: 0.225977 Oct 04 18:45:10.896667 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3287/6564] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:10 2022] DELETE /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:45:10.903309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-09554e26-13da-439c-91a3-dc85c3e12969 req-cc449f5a-6a89-4939-bb57-1ef1947ae7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41975968-b6e1-4975-861e-c5ba5655f1b5", "tag": "7438ffb1-ab55-4e42-b1da-aae53c113e89"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:10.919137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-09554e26-13da-439c-91a3-dc85c3e12969 req-cc449f5a-6a89-4939-bb57-1ef1947ae7f9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.920064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-09554e26-13da-439c-91a3-dc85c3e12969 req-cc449f5a-6a89-4939-bb57-1ef1947ae7f9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.920900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-09554e26-13da-439c-91a3-dc85c3e12969 req-cc449f5a-6a89-4939-bb57-1ef1947ae7f9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.938359 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-09554e26-13da-439c-91a3-dc85c3e12969 req-cc449f5a-6a89-4939-bb57-1ef1947ae7f9 service nova] Creating event network-changed:7438ffb1-ab55-4e42-b1da-aae53c113e89 for instance 41975968-b6e1-4975-861e-c5ba5655f1b5 on n-h2-850499-14 Oct 04 18:45:10.944858 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-09554e26-13da-439c-91a3-dc85c3e12969 req-cc449f5a-6a89-4939-bb57-1ef1947ae7f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046106 Oct 04 18:45:10.946133 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3288/6565] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:10.954244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5236ac4-3053-4e5b-a0db-45dc6902bff7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.955285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5236ac4-3053-4e5b-a0db-45dc6902bff7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.965926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5236ac4-3053-4e5b-a0db-45dc6902bff7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.966797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5236ac4-3053-4e5b-a0db-45dc6902bff7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.967474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5236ac4-3053-4e5b-a0db-45dc6902bff7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.969633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5236ac4-3053-4e5b-a0db-45dc6902bff7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.970315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5236ac4-3053-4e5b-a0db-45dc6902bff7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.971271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5236ac4-3053-4e5b-a0db-45dc6902bff7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.262188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5236ac4-3053-4e5b-a0db-45dc6902bff7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.275386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:45:11.275869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:45:11.276273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:45:11.276830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:45:11.277249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:45:11.289957 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5236ac4-3053-4e5b-a0db-45dc6902bff7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1689 microversion: 2.1 time: 0.341696 Oct 04 18:45:11.290566 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3289/6566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:10 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1689 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:11.298687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.299563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.300195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.306868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.307782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.308388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.651651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Getting quotas for project 2102744ce3d64ae4bf1852f65d085141. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:11.664615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Getting quotas for user 599068ac49824652bc237fde15518bec and project 2102744ce3d64ae4bf1852f65d085141. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:11.750299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:45:11.760971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:45:11.893917 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-51016fac-68a1-4d92-a463-97bd9ac9f7db tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463390 Oct 04 18:45:11.895210 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3278/6567] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:45:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:45:11.914719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-448ac9d3-95c7-4dc0-a2fa-56cbe1947694 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.916030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-448ac9d3-95c7-4dc0-a2fa-56cbe1947694 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.997672 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-448ac9d3-95c7-4dc0-a2fa-56cbe1947694 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1329 microversion: 2.1 time: 0.087454 Oct 04 18:45:11.999387 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3290/6568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1329 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:12.322227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-643bb0ab-84a9-4241-ad41-f3988c8810ba tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.323084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-643bb0ab-84a9-4241-ad41-f3988c8810ba tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:12.330590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643bb0ab-84a9-4241-ad41-f3988c8810ba tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.331126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643bb0ab-84a9-4241-ad41-f3988c8810ba tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.331586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643bb0ab-84a9-4241-ad41-f3988c8810ba tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.332510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643bb0ab-84a9-4241-ad41-f3988c8810ba tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.336378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643bb0ab-84a9-4241-ad41-f3988c8810ba tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.336378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-643bb0ab-84a9-4241-ad41-f3988c8810ba tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.715304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-643bb0ab-84a9-4241-ad41-f3988c8810ba tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.727621 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-643bb0ab-84a9-4241-ad41-f3988c8810ba tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 200 len: 1689 microversion: 2.1 time: 0.414208 Oct 04 18:45:12.728918 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3279/6569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:12 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 1689 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:13.012300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-186bd829-b638-4f19-b488-f1799af1c1fe req-5c710049-ab1e-4400-b547-0b4aee6a7f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41975968-b6e1-4975-861e-c5ba5655f1b5", "name": "network-vif-deleted", "tag": "7438ffb1-ab55-4e42-b1da-aae53c113e89"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:13.027003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f5e4722-f53c-4415-ab91-1a37ebc53349 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.027924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f5e4722-f53c-4415-ab91-1a37ebc53349 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.037474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f5e4722-f53c-4415-ab91-1a37ebc53349 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.042523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f5e4722-f53c-4415-ab91-1a37ebc53349 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.042679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f5e4722-f53c-4415-ab91-1a37ebc53349 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.043319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-186bd829-b638-4f19-b488-f1799af1c1fe req-5c710049-ab1e-4400-b547-0b4aee6a7f6b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.044045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f5e4722-f53c-4415-ab91-1a37ebc53349 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.045203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f5e4722-f53c-4415-ab91-1a37ebc53349 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.045777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-186bd829-b638-4f19-b488-f1799af1c1fe req-5c710049-ab1e-4400-b547-0b4aee6a7f6b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.046421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-186bd829-b638-4f19-b488-f1799af1c1fe req-5c710049-ab1e-4400-b547-0b4aee6a7f6b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.047155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f5e4722-f53c-4415-ab91-1a37ebc53349 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.064966 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-186bd829-b638-4f19-b488-f1799af1c1fe req-5c710049-ab1e-4400-b547-0b4aee6a7f6b service nova] Creating event network-vif-deleted:7438ffb1-ab55-4e42-b1da-aae53c113e89 for instance 41975968-b6e1-4975-861e-c5ba5655f1b5 on n-h2-850499-14 Oct 04 18:45:13.071780 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-186bd829-b638-4f19-b488-f1799af1c1fe req-5c710049-ab1e-4400-b547-0b4aee6a7f6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063162 Oct 04 18:45:13.077209 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3291/6570] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:13.162193 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f5e4722-f53c-4415-ab91-1a37ebc53349 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1418 microversion: 2.1 time: 0.140332 Oct 04 18:45:13.179288 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3280/6571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1418 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:13.754552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.755221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 41975968-b6e1-4975-861e-c5ba5655f1b5] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.762073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.762573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.763105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.764034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.764638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.765138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.781416 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] HTTP exception thrown: Instance 41975968-b6e1-4975-861e-c5ba5655f1b5 could not be found. Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Request method failure captured: Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 HTTP/1.1 Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH0DNQomkqqv-Qu84uLjAqPo6HMqiT1ULGhUmMALAk5Z9X3SuEK_qKUFSYc4VFmbF3awEhHAZ23FKbO0jEHJgn1JglTbqPqA4tXbETY-Pt-M6BRs2GinOvBXhlz9OU805haxcHHt-xDGagC9rXsMJ5AUy9kigxeIRWw5j9S_HaRlp1g Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bfebaa3ef67f42289fa824284a968c42 Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bfebaa3ef67f42289fa824284a968c42"}]}] Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bfebaa3ef67f42289fa824284a968c42 Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestNetworkAdvancedServerOps-145155639-project Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 87e519320e854ce480adcd9de2750bfb Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestNetworkAdvancedServerOps-145155639-project Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 41975968-b6e1-4975-861e-c5ba5655f1b5 could not be found. Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '41975968-b6e1-4975-861e-c5ba5655f1b5'} Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41975968-b6e1-4975-861e-c5ba5655f1b5 could not be found. Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41975968-b6e1-4975-861e-c5ba5655f1b5 could not be found. Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:13.783267 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41975968-b6e1-4975-861e-c5ba5655f1b5 could not be found. Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Returning 404 to user: Instance 41975968-b6e1-4975-861e-c5ba5655f1b5 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-009e1c9a-668d-475c-972a-afe74fbb15c9 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5" status: 404 len: 111 microversion: 2.1 time: 0.034669 Oct 04 18:45:13.790544 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3292/6572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/41975968-b6e1-4975-861e-c5ba5655f1b5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:14.200878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6715d48a-4fb3-4e4a-abe6-19106e603bc2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.202176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6715d48a-4fb3-4e4a-abe6-19106e603bc2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:14.211517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6715d48a-4fb3-4e4a-abe6-19106e603bc2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.212266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6715d48a-4fb3-4e4a-abe6-19106e603bc2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.213035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6715d48a-4fb3-4e4a-abe6-19106e603bc2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.214244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6715d48a-4fb3-4e4a-abe6-19106e603bc2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.214933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6715d48a-4fb3-4e4a-abe6-19106e603bc2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.215578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6715d48a-4fb3-4e4a-abe6-19106e603bc2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.331597 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6715d48a-4fb3-4e4a-abe6-19106e603bc2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1424 microversion: 2.1 time: 0.139231 Oct 04 18:45:14.345135 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3281/6573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1424 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:15.360550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99de9119-0c38-411e-a9d8-2783c965891c tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.362153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-99de9119-0c38-411e-a9d8-2783c965891c tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.369849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:15.371693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99de9119-0c38-411e-a9d8-2783c965891c tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.372423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99de9119-0c38-411e-a9d8-2783c965891c tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.373061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99de9119-0c38-411e-a9d8-2783c965891c tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.373981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99de9119-0c38-411e-a9d8-2783c965891c tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.374623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99de9119-0c38-411e-a9d8-2783c965891c tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.375260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99de9119-0c38-411e-a9d8-2783c965891c tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.842568 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-99de9119-0c38-411e-a9d8-2783c965891c tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1466 microversion: 2.1 time: 0.486250 Oct 04 18:45:15.859748 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3293/6574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:15 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1466 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:15.893543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ad7ddf7e-347c-40a3-b299-cc630d0c3c97 req-3bdc1176-33be-4e8b-b0d5-0472aa220249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5609b52b-9d57-4c03-9cce-ada16fa86776", "tag": "e25ac24f-8469-4716-8455-3c68ff9eb9bf"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:15.899667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:15.906001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ad7ddf7e-347c-40a3-b299-cc630d0c3c97 req-3bdc1176-33be-4e8b-b0d5-0472aa220249 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.906744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ad7ddf7e-347c-40a3-b299-cc630d0c3c97 req-3bdc1176-33be-4e8b-b0d5-0472aa220249 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.908024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ad7ddf7e-347c-40a3-b299-cc630d0c3c97 req-3bdc1176-33be-4e8b-b0d5-0472aa220249 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.921221 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ad7ddf7e-347c-40a3-b299-cc630d0c3c97 req-3bdc1176-33be-4e8b-b0d5-0472aa220249 service nova] Creating event network-changed:e25ac24f-8469-4716-8455-3c68ff9eb9bf for instance 5609b52b-9d57-4c03-9cce-ada16fa86776 on n-h1-850499-14 Oct 04 18:45:15.927099 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ad7ddf7e-347c-40a3-b299-cc630d0c3c97 req-3bdc1176-33be-4e8b-b0d5-0472aa220249 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037075 Oct 04 18:45:15.928067 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3282/6575] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:16.876442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a483a576-81b3-47fe-8e51-bdbfd5ebdcd7 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.876442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a483a576-81b3-47fe-8e51-bdbfd5ebdcd7 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.897407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a483a576-81b3-47fe-8e51-bdbfd5ebdcd7 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.898029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a483a576-81b3-47fe-8e51-bdbfd5ebdcd7 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.898510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a483a576-81b3-47fe-8e51-bdbfd5ebdcd7 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.903384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a483a576-81b3-47fe-8e51-bdbfd5ebdcd7 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.904029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a483a576-81b3-47fe-8e51-bdbfd5ebdcd7 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.904488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a483a576-81b3-47fe-8e51-bdbfd5ebdcd7 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.247448 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a483a576-81b3-47fe-8e51-bdbfd5ebdcd7 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1466 microversion: 2.1 time: 0.378833 Oct 04 18:45:17.267851 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3294/6576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1466 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:18.279333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-566938a6-327e-45f0-b70f-4d24d630ab16 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:18.279333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-566938a6-327e-45f0-b70f-4d24d630ab16 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:18.293867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-566938a6-327e-45f0-b70f-4d24d630ab16 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.295250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-566938a6-327e-45f0-b70f-4d24d630ab16 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.297283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-566938a6-327e-45f0-b70f-4d24d630ab16 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.298545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-566938a6-327e-45f0-b70f-4d24d630ab16 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.299489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-566938a6-327e-45f0-b70f-4d24d630ab16 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.300270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-566938a6-327e-45f0-b70f-4d24d630ab16 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.607323 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-566938a6-327e-45f0-b70f-4d24d630ab16 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1466 microversion: 2.1 time: 0.336605 Oct 04 18:45:18.608148 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3283/6577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:18 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1466 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:18.894309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7e0d2faa-d84b-446b-a761-b941d7769c9e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '.version_select at 0x7fd4d0ce68b0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:18.921661 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7e0d2faa-d84b-446b-a761-b941d7769c9e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1343374886" status: 202 len: 0 microversion: 2.1 time: 0.032336 Oct 04 18:45:18.922365 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3295/6578] 10.222.0.18 () {58 vars in 1284 bytes} [Tue Oct 4 18:45:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1343374886 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:18.971557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eec3f9bd-fdc8-4d57-b78d-5310025b582e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'create', calling method: .version_select at 0x7fd4d21a50d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-215249969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBITghYY81dPomrrIqPPsMSJolyEDahSrV/vT8M9xDaGmTjN6wjdfF8JUxf1qxGzs5Xi2WWUFVfxtdmTn+tfHoePhFIlDF+Cxr2kZtkdszk9AerWdud7z3ZZ3MS5f9Ka0g=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:18.988767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-eec3f9bd-fdc8-4d57-b78d-5310025b582e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for project bfebaa3ef67f42289fa824284a968c42. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:18.995027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-eec3f9bd-fdc8-4d57-b78d-5310025b582e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for user 87e519320e854ce480adcd9de2750bfb and project bfebaa3ef67f42289fa824284a968c42. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:19.037048 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eec3f9bd-fdc8-4d57-b78d-5310025b582e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.069906 Oct 04 18:45:19.037891 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3284/6579] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:45:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:19.630556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-62bd4c47-a551-4f0f-a6c4-23f1e84a4811 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:19.631257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-62bd4c47-a551-4f0f-a6c4-23f1e84a4811 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:19.643413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bd4c47-a551-4f0f-a6c4-23f1e84a4811 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.644401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bd4c47-a551-4f0f-a6c4-23f1e84a4811 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.645186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bd4c47-a551-4f0f-a6c4-23f1e84a4811 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.646536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bd4c47-a551-4f0f-a6c4-23f1e84a4811 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.647296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bd4c47-a551-4f0f-a6c4-23f1e84a4811 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.648148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-62bd4c47-a551-4f0f-a6c4-23f1e84a4811 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.848973 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-62bd4c47-a551-4f0f-a6c4-23f1e84a4811 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1466 microversion: 2.1 time: 0.222082 Oct 04 18:45:19.849678 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3296/6580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:19 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1466 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:20.867950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5d285b8f-7342-4b48-97c0-78b350b9a28e req-082284ca-7d0b-48df-ab08-3f078cb95add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5609b52b-9d57-4c03-9cce-ada16fa86776", "name": "network-vif-plugged", "status": "completed", "tag": "e25ac24f-8469-4716-8455-3c68ff9eb9bf"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:20.874510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2295c3b4-85fd-4609-b1e9-19091a9c1373 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:20.875279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2295c3b4-85fd-4609-b1e9-19091a9c1373 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:20.885842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2295c3b4-85fd-4609-b1e9-19091a9c1373 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.886536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2295c3b4-85fd-4609-b1e9-19091a9c1373 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.887179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2295c3b4-85fd-4609-b1e9-19091a9c1373 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.888506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2295c3b4-85fd-4609-b1e9-19091a9c1373 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.889501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2295c3b4-85fd-4609-b1e9-19091a9c1373 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.890342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2295c3b4-85fd-4609-b1e9-19091a9c1373 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.891733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5d285b8f-7342-4b48-97c0-78b350b9a28e req-082284ca-7d0b-48df-ab08-3f078cb95add service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.892546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5d285b8f-7342-4b48-97c0-78b350b9a28e req-082284ca-7d0b-48df-ab08-3f078cb95add service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.893279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5d285b8f-7342-4b48-97c0-78b350b9a28e req-082284ca-7d0b-48df-ab08-3f078cb95add service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.915982 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5d285b8f-7342-4b48-97c0-78b350b9a28e req-082284ca-7d0b-48df-ab08-3f078cb95add service nova] Creating event network-vif-plugged:e25ac24f-8469-4716-8455-3c68ff9eb9bf for instance 5609b52b-9d57-4c03-9cce-ada16fa86776 on n-h1-850499-14 Oct 04 18:45:20.924375 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5d285b8f-7342-4b48-97c0-78b350b9a28e req-082284ca-7d0b-48df-ab08-3f078cb95add service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065608 Oct 04 18:45:20.925428 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3285/6581] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:21.476915 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2295c3b4-85fd-4609-b1e9-19091a9c1373 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1466 microversion: 2.1 time: 0.606054 Oct 04 18:45:21.477592 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3297/6582] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:20 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1466 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:22.506428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20c58112-a204-427f-8c40-e44833c3c396 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:22.507341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20c58112-a204-427f-8c40-e44833c3c396 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:22.509846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:22.515967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c58112-a204-427f-8c40-e44833c3c396 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.516477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c58112-a204-427f-8c40-e44833c3c396 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.516922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c58112-a204-427f-8c40-e44833c3c396 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.517699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c58112-a204-427f-8c40-e44833c3c396 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.518159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c58112-a204-427f-8c40-e44833c3c396 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.518590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20c58112-a204-427f-8c40-e44833c3c396 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.795139 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20c58112-a204-427f-8c40-e44833c3c396 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1652 microversion: 2.1 time: 0.297429 Oct 04 18:45:22.795876 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3286/6583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:22 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1652 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:22.840655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a0c0ae6e-264e-4827-9147-dcf7930fff44 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:22.842559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a0c0ae6e-264e-4827-9147-dcf7930fff44 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:22.850136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:22.852243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0c0ae6e-264e-4827-9147-dcf7930fff44 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.852857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0c0ae6e-264e-4827-9147-dcf7930fff44 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.853553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0c0ae6e-264e-4827-9147-dcf7930fff44 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.854889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0c0ae6e-264e-4827-9147-dcf7930fff44 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.855399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0c0ae6e-264e-4827-9147-dcf7930fff44 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.855840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a0c0ae6e-264e-4827-9147-dcf7930fff44 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.086026 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a0c0ae6e-264e-4827-9147-dcf7930fff44 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1652 microversion: 2.1 time: 0.252609 Oct 04 18:45:23.086653 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3298/6584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:22 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1652 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:23.121953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a948b67f-cd83-41ab-8240-17d99b3de386 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:23.123156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a948b67f-cd83-41ab-8240-17d99b3de386 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.130042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a948b67f-cd83-41ab-8240-17d99b3de386 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.130890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a948b67f-cd83-41ab-8240-17d99b3de386 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.131659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a948b67f-cd83-41ab-8240-17d99b3de386 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.132855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a948b67f-cd83-41ab-8240-17d99b3de386 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.133632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a948b67f-cd83-41ab-8240-17d99b3de386 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.134247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a948b67f-cd83-41ab-8240-17d99b3de386 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.386520 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a948b67f-cd83-41ab-8240-17d99b3de386 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1652 microversion: 2.1 time: 0.270641 Oct 04 18:45:23.396198 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3287/6585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:23 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1652 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:23.418740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d6f62d6-7337-46fc-b22b-54461da2d1b2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:23.419463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d6f62d6-7337-46fc-b22b-54461da2d1b2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.427992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d6f62d6-7337-46fc-b22b-54461da2d1b2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.428515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d6f62d6-7337-46fc-b22b-54461da2d1b2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.429581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d6f62d6-7337-46fc-b22b-54461da2d1b2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.455838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d6f62d6-7337-46fc-b22b-54461da2d1b2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.457200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d6f62d6-7337-46fc-b22b-54461da2d1b2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.457881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d6f62d6-7337-46fc-b22b-54461da2d1b2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.511256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d6f62d6-7337-46fc-b22b-54461da2d1b2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:23.634305 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d6f62d6-7337-46fc-b22b-54461da2d1b2 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 204 len: 0 microversion: 2.1 time: 0.225506 Oct 04 18:45:23.638304 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3299/6586] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:23 2022] DELETE /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:23.649678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-adad9338-a5a9-4dd2-9c48-3a9518d0f767 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:23.650843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-adad9338-a5a9-4dd2-9c48-3a9518d0f767 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.672225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adad9338-a5a9-4dd2-9c48-3a9518d0f767 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.672811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adad9338-a5a9-4dd2-9c48-3a9518d0f767 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.673281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adad9338-a5a9-4dd2-9c48-3a9518d0f767 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.674175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adad9338-a5a9-4dd2-9c48-3a9518d0f767 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.674749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adad9338-a5a9-4dd2-9c48-3a9518d0f767 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.678375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adad9338-a5a9-4dd2-9c48-3a9518d0f767 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.951012 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-adad9338-a5a9-4dd2-9c48-3a9518d0f767 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1658 microversion: 2.1 time: 0.308132 Oct 04 18:45:23.952500 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3288/6587] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:23 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1658 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:24.979402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a3bee67-a15e-405b-9222-597cebeda178 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:24.980966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a3bee67-a15e-405b-9222-597cebeda178 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:24.992717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3bee67-a15e-405b-9222-597cebeda178 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.994409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3bee67-a15e-405b-9222-597cebeda178 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.995143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3bee67-a15e-405b-9222-597cebeda178 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.996734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3bee67-a15e-405b-9222-597cebeda178 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.997450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3bee67-a15e-405b-9222-597cebeda178 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.999370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a3bee67-a15e-405b-9222-597cebeda178 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.323125 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a3bee67-a15e-405b-9222-597cebeda178 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1658 microversion: 2.1 time: 0.351211 Oct 04 18:45:25.325610 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3300/6588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:24 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1658 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:26.372833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4567151e-63b6-4042-8638-5a5623dbe416 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:26.385700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4567151e-63b6-4042-8638-5a5623dbe416 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:26.435158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4567151e-63b6-4042-8638-5a5623dbe416 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.435932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4567151e-63b6-4042-8638-5a5623dbe416 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.436880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4567151e-63b6-4042-8638-5a5623dbe416 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.443634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4567151e-63b6-4042-8638-5a5623dbe416 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.444937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4567151e-63b6-4042-8638-5a5623dbe416 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.445623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4567151e-63b6-4042-8638-5a5623dbe416 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.454491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b6eb2ea6-fa91-42da-bb91-5de23a525a18 req-add429dc-b0dd-45c5-9bc9-7966b6ec8aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5609b52b-9d57-4c03-9cce-ada16fa86776", "name": "network-vif-deleted", "tag": "e25ac24f-8469-4716-8455-3c68ff9eb9bf"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:26.499586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b6eb2ea6-fa91-42da-bb91-5de23a525a18 req-add429dc-b0dd-45c5-9bc9-7966b6ec8aa4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.508610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b6eb2ea6-fa91-42da-bb91-5de23a525a18 req-add429dc-b0dd-45c5-9bc9-7966b6ec8aa4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.509376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b6eb2ea6-fa91-42da-bb91-5de23a525a18 req-add429dc-b0dd-45c5-9bc9-7966b6ec8aa4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.532490 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b6eb2ea6-fa91-42da-bb91-5de23a525a18 req-add429dc-b0dd-45c5-9bc9-7966b6ec8aa4 service nova] Creating event network-vif-deleted:e25ac24f-8469-4716-8455-3c68ff9eb9bf for instance 5609b52b-9d57-4c03-9cce-ada16fa86776 on n-h1-850499-14 Oct 04 18:45:26.545973 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b6eb2ea6-fa91-42da-bb91-5de23a525a18 req-add429dc-b0dd-45c5-9bc9-7966b6ec8aa4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095564 Oct 04 18:45:26.549588 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3301/6589] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:26.701203 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4567151e-63b6-4042-8638-5a5623dbe416 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 200 len: 1616 microversion: 2.1 time: 0.347072 Oct 04 18:45:26.722040 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3289/6590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:26 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 1616 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:27.734389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:27.736652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: 5609b52b-9d57-4c03-9cce-ada16fa86776] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:27.761256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.770379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.772051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.783601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.784715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.785695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.848417 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] HTTP exception thrown: Instance 5609b52b-9d57-4c03-9cce-ada16fa86776 could not be found. Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Request method failure captured: Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 HTTP/1.1 Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH8mKsHpC2FSA0Z1WTeJaKcoa0xP_MuKpXc_Kk1J2Q9lesUL4rQqJnNRhPO82XNv7VPGUL1l3BRt6n0LqApm6esyjXqhr1X8up1QFI-lN3SKNnqZgPTRDsd9R9UXPlAzn5JOfvbE5H0WziwPt56R3aVEMtdYsLeHpaC1x6iNWBHFf9s Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2102744ce3d64ae4bf1852f65d085141 Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestServerMultinode-843305465 Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2102744ce3d64ae4bf1852f65d085141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2102744ce3d64ae4bf1852f65d085141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2102744ce3d64ae4bf1852f65d085141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2102744ce3d64ae4bf1852f65d085141"}]}] Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestServerMultinode-843305465 Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2102744ce3d64ae4bf1852f65d085141 Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestServerMultinode-843305465 Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestServerMultinode-843305465-project-admin Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 599068ac49824652bc237fde15518bec Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestServerMultinode-843305465-project-admin Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 5609b52b-9d57-4c03-9cce-ada16fa86776 could not be found. Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '5609b52b-9d57-4c03-9cce-ada16fa86776'} Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5609b52b-9d57-4c03-9cce-ada16fa86776 could not be found. Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5609b52b-9d57-4c03-9cce-ada16fa86776 could not be found. Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:27.855068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:27.870243 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:27.870243 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:27.870243 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:27.870243 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:27.870243 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:27.870243 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5609b52b-9d57-4c03-9cce-ada16fa86776 could not be found. Oct 04 18:45:27.870243 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:27.870243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Returning 404 to user: Instance 5609b52b-9d57-4c03-9cce-ada16fa86776 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:27.870243 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d4e5c37-66ba-4534-bc8f-3cdc8d82036f tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776" status: 404 len: 111 microversion: 2.1 time: 0.144350 Oct 04 18:45:27.870243 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3302/6591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:27 2022] GET /compute/v2.1/servers/5609b52b-9d57-4c03-9cce-ada16fa86776 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:27.887012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-502af99d-7780-449a-92c0-42aa75d02ce1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:27.887717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-502af99d-7780-449a-92c0-42aa75d02ce1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:27.901091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-502af99d-7780-449a-92c0-42aa75d02ce1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.901746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-502af99d-7780-449a-92c0-42aa75d02ce1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.902212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-502af99d-7780-449a-92c0-42aa75d02ce1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.902998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-502af99d-7780-449a-92c0-42aa75d02ce1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.903469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-502af99d-7780-449a-92c0-42aa75d02ce1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.903928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-502af99d-7780-449a-92c0-42aa75d02ce1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.031320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-502af99d-7780-449a-92c0-42aa75d02ce1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:28.221976 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-502af99d-7780-449a-92c0-42aa75d02ce1 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 204 len: 0 microversion: 2.1 time: 0.345877 Oct 04 18:45:28.226606 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3290/6592] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:27 2022] DELETE /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:28.235652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-86a17892-b248-470b-961d-fa21754e9444 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:28.238022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-86a17892-b248-470b-961d-fa21754e9444 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:28.266732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86a17892-b248-470b-961d-fa21754e9444 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.277074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86a17892-b248-470b-961d-fa21754e9444 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.278861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86a17892-b248-470b-961d-fa21754e9444 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.293481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86a17892-b248-470b-961d-fa21754e9444 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.294660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86a17892-b248-470b-961d-fa21754e9444 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.295804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86a17892-b248-470b-961d-fa21754e9444 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.535043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1457646268", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "6209e8a9-01b3-4ab2-acca-8512ff61a143"}], "key_name": "tempest-TestNetworkAdvancedServerOps-215249969", "security_groups": [{"name": "tempest-secgroup-smoke-844474874"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:28.682139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:28.686422 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-86a17892-b248-470b-961d-fa21754e9444 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1656 microversion: 2.1 time: 0.457563 Oct 04 18:45:28.687502 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3303/6593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:28 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1656 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:28.785662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] validate_networks() for [('6209e8a9-01b3-4ab2-acca-8512ff61a143', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:45:29.003586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:29.546203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:45:29.546634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:45:29.547139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:45:29.547555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:45:29.547971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:45:29.560962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.561511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.561993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.562743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.563249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.563804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.583899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for project bfebaa3ef67f42289fa824284a968c42. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:29.589786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Getting quotas for user 87e519320e854ce480adcd9de2750bfb and project bfebaa3ef67f42289fa824284a968c42. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:29.604991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:45:29.607925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:45:29.660664 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5eaae237-fc4d-4eb7-95c1-4a305446570d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.129809 Oct 04 18:45:29.661818 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3291/6594] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:45:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:45:29.673580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2402da45-37f6-4da8-8561-4547e032b6c1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:29.674351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2402da45-37f6-4da8-8561-4547e032b6c1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:29.722583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3560786b-8601-444e-b962-625c63361cf5 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:29.722583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3560786b-8601-444e-b962-625c63361cf5 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:29.729031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3560786b-8601-444e-b962-625c63361cf5 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.731170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3560786b-8601-444e-b962-625c63361cf5 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.732634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3560786b-8601-444e-b962-625c63361cf5 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.733720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3560786b-8601-444e-b962-625c63361cf5 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.734602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3560786b-8601-444e-b962-625c63361cf5 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.735362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3560786b-8601-444e-b962-625c63361cf5 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.870897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2402da45-37f6-4da8-8561-4547e032b6c1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:29.879469 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2402da45-37f6-4da8-8561-4547e032b6c1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1266 microversion: 2.1 time: 0.210346 Oct 04 18:45:29.885720 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3304/6595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:29 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:29.980229 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3560786b-8601-444e-b962-625c63361cf5 tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1656 microversion: 2.1 time: 0.270875 Oct 04 18:45:29.984620 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3292/6596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:29 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1656 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:30.909622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f2c2eef5-511e-4183-ad3b-251206074c94 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:30.910243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f2c2eef5-511e-4183-ad3b-251206074c94 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:30.922998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2c2eef5-511e-4183-ad3b-251206074c94 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.923620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2c2eef5-511e-4183-ad3b-251206074c94 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.924133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2c2eef5-511e-4183-ad3b-251206074c94 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.925008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2c2eef5-511e-4183-ad3b-251206074c94 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.928163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2c2eef5-511e-4183-ad3b-251206074c94 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.929945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2c2eef5-511e-4183-ad3b-251206074c94 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.010451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21f6f356-1fa0-4049-9649-9b5e57a41a7b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:31.011093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21f6f356-1fa0-4049-9649-9b5e57a41a7b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:31.019317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21f6f356-1fa0-4049-9649-9b5e57a41a7b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.019830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21f6f356-1fa0-4049-9649-9b5e57a41a7b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.020282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21f6f356-1fa0-4049-9649-9b5e57a41a7b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.021218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21f6f356-1fa0-4049-9649-9b5e57a41a7b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.021693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21f6f356-1fa0-4049-9649-9b5e57a41a7b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.022134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21f6f356-1fa0-4049-9649-9b5e57a41a7b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.036397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f2c2eef5-511e-4183-ad3b-251206074c94 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:31.048595 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f2c2eef5-511e-4183-ad3b-251206074c94 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1318 microversion: 2.1 time: 0.142706 Oct 04 18:45:31.050099 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3305/6597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:30 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:31.187484 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21f6f356-1fa0-4049-9649-9b5e57a41a7b tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 200 len: 1656 microversion: 2.1 time: 0.182106 Oct 04 18:45:31.188102 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3293/6598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:31 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 1656 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:31.388542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ae686702-38df-4441-8181-f605591eb9ea req-06b26a67-6454-472d-8946-87be0b568f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a144e9d6-b07a-43d4-a229-c73733be4562", "name": "network-vif-deleted", "tag": "efd4ca1b-312b-4d62-a4d9-b9169be3392c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:31.413412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ae686702-38df-4441-8181-f605591eb9ea req-06b26a67-6454-472d-8946-87be0b568f79 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.414262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ae686702-38df-4441-8181-f605591eb9ea req-06b26a67-6454-472d-8946-87be0b568f79 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.418400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ae686702-38df-4441-8181-f605591eb9ea req-06b26a67-6454-472d-8946-87be0b568f79 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.456605 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ae686702-38df-4441-8181-f605591eb9ea req-06b26a67-6454-472d-8946-87be0b568f79 service nova] Creating event network-vif-deleted:efd4ca1b-312b-4d62-a4d9-b9169be3392c for instance a144e9d6-b07a-43d4-a229-c73733be4562 on n-h2-850499-14 Oct 04 18:45:31.472810 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ae686702-38df-4441-8181-f605591eb9ea req-06b26a67-6454-472d-8946-87be0b568f79 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088421 Oct 04 18:45:31.478256 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3306/6599] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:32.084373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eadd6bcd-b2e5-4598-9f97-467d528f758c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:32.088065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eadd6bcd-b2e5-4598-9f97-467d528f758c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:32.136418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eadd6bcd-b2e5-4598-9f97-467d528f758c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.137484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eadd6bcd-b2e5-4598-9f97-467d528f758c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.138067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eadd6bcd-b2e5-4598-9f97-467d528f758c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.138848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eadd6bcd-b2e5-4598-9f97-467d528f758c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.139338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eadd6bcd-b2e5-4598-9f97-467d528f758c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.139780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eadd6bcd-b2e5-4598-9f97-467d528f758c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.218041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:32.219215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] [instance: a144e9d6-b07a-43d4-a229-c73733be4562] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:32.252472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.252993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.253554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.254290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.254830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.261161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.271412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eadd6bcd-b2e5-4598-9f97-467d528f758c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:32.283954 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eadd6bcd-b2e5-4598-9f97-467d528f758c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1324 microversion: 2.1 time: 0.212931 Oct 04 18:45:32.285401 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3294/6600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:32 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1324 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:32.301432 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] HTTP exception thrown: Instance a144e9d6-b07a-43d4-a229-c73733be4562 could not be found. Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Request method failure captured: Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 HTTP/1.1 Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH8mKsHpC2FSA0Z1WTeJaKcoa0xP_MuKpXc_Kk1J2Q9lesUL4rQqJnNRhPO82XNv7VPGUL1l3BRt6n0LqApm6esyjXqhr1X8up1QFI-lN3SKNnqZgPTRDsd9R9UXPlAzn5JOfvbE5H0WziwPt56R3aVEMtdYsLeHpaC1x6iNWBHFf9s Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2102744ce3d64ae4bf1852f65d085141 Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestServerMultinode-843305465 Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2102744ce3d64ae4bf1852f65d085141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2102744ce3d64ae4bf1852f65d085141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2102744ce3d64ae4bf1852f65d085141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2102744ce3d64ae4bf1852f65d085141"}]}] Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestServerMultinode-843305465 Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2102744ce3d64ae4bf1852f65d085141 Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestServerMultinode-843305465 Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestServerMultinode-843305465-project-admin Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 599068ac49824652bc237fde15518bec Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestServerMultinode-843305465-project-admin Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance a144e9d6-b07a-43d4-a229-c73733be4562 could not be found. Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'a144e9d6-b07a-43d4-a229-c73733be4562'} Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a144e9d6-b07a-43d4-a229-c73733be4562 could not be found. Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a144e9d6-b07a-43d4-a229-c73733be4562 could not be found. Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:32.303604 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:32.310118 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:32.310118 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:32.310118 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:32.310118 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:32.310118 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:32.310118 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a144e9d6-b07a-43d4-a229-c73733be4562 could not be found. Oct 04 18:45:32.310118 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:45:32.310118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] Returning 404 to user: Instance a144e9d6-b07a-43d4-a229-c73733be4562 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:32.310118 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f6abe20-f5c7-4fea-b558-996e9fb61dcc tempest-TestServerMultinode-843305465 tempest-TestServerMultinode-843305465-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562" status: 404 len: 111 microversion: 2.1 time: 0.093642 Oct 04 18:45:32.310118 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3307/6601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:32 2022] GET /compute/v2.1/servers/a144e9d6-b07a-43d4-a229-c73733be4562 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:45:33.310321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-29a48fcc-9b4f-457e-8e75-c25abf59dc33 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:33.315336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-29a48fcc-9b4f-457e-8e75-c25abf59dc33 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:33.329161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a48fcc-9b4f-457e-8e75-c25abf59dc33 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.330021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a48fcc-9b4f-457e-8e75-c25abf59dc33 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.330693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a48fcc-9b4f-457e-8e75-c25abf59dc33 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.341084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a48fcc-9b4f-457e-8e75-c25abf59dc33 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.343410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a48fcc-9b4f-457e-8e75-c25abf59dc33 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.344728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-29a48fcc-9b4f-457e-8e75-c25abf59dc33 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.538521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-fd21d226-b59a-42e7-a1cb-edffe42a3be7 req-4500c34a-d268-4dab-b21b-f36f545d6e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989c7dd0-05ac-41e2-8f85-7ce1890877d4", "tag": "b2d6b81a-6219-4d9e-a9c1-696f67a1afbc"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:33.568180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fd21d226-b59a-42e7-a1cb-edffe42a3be7 req-4500c34a-d268-4dab-b21b-f36f545d6e0c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.570835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fd21d226-b59a-42e7-a1cb-edffe42a3be7 req-4500c34a-d268-4dab-b21b-f36f545d6e0c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.571611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fd21d226-b59a-42e7-a1cb-edffe42a3be7 req-4500c34a-d268-4dab-b21b-f36f545d6e0c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.588635 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-fd21d226-b59a-42e7-a1cb-edffe42a3be7 req-4500c34a-d268-4dab-b21b-f36f545d6e0c service nova] Creating event network-changed:b2d6b81a-6219-4d9e-a9c1-696f67a1afbc for instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 on n-h1-850499-14 Oct 04 18:45:33.594560 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-fd21d226-b59a-42e7-a1cb-edffe42a3be7 req-4500c34a-d268-4dab-b21b-f36f545d6e0c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062840 Oct 04 18:45:33.595906 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3308/6602] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:45:33.604938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-29a48fcc-9b4f-457e-8e75-c25abf59dc33 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:33.638169 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-29a48fcc-9b4f-457e-8e75-c25abf59dc33 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1391 microversion: 2.1 time: 0.333840 Oct 04 18:45:33.639625 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3295/6603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:33 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1391 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:34.670449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e998ea39-0117-4f68-8647-72902ce90c64 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:34.673113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e998ea39-0117-4f68-8647-72902ce90c64 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:34.683641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e998ea39-0117-4f68-8647-72902ce90c64 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:34.684434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e998ea39-0117-4f68-8647-72902ce90c64 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:34.685232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e998ea39-0117-4f68-8647-72902ce90c64 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:34.686126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e998ea39-0117-4f68-8647-72902ce90c64 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:34.687798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e998ea39-0117-4f68-8647-72902ce90c64 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:34.688549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e998ea39-0117-4f68-8647-72902ce90c64 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:34.955989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e998ea39-0117-4f68-8647-72902ce90c64 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:34.967727 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e998ea39-0117-4f68-8647-72902ce90c64 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1391 microversion: 2.1 time: 0.306466 Oct 04 18:45:34.968832 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3309/6604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:34 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:35.993148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a267656b-56ac-44f5-8342-11c75e5ca7b8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:35.994468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a267656b-56ac-44f5-8342-11c75e5ca7b8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:36.002400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a267656b-56ac-44f5-8342-11c75e5ca7b8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:36.003226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a267656b-56ac-44f5-8342-11c75e5ca7b8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:36.004134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a267656b-56ac-44f5-8342-11c75e5ca7b8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.005995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a267656b-56ac-44f5-8342-11c75e5ca7b8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:36.005995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a267656b-56ac-44f5-8342-11c75e5ca7b8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:36.005995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a267656b-56ac-44f5-8342-11c75e5ca7b8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.029776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:36.329586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a267656b-56ac-44f5-8342-11c75e5ca7b8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:36.339269 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a267656b-56ac-44f5-8342-11c75e5ca7b8 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1391 microversion: 2.1 time: 0.350522 Oct 04 18:45:36.354599 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3296/6605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:35 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1391 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:37.362451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8644a6f1-d15d-459d-9fb2-e813f2687557 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:37.363112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8644a6f1-d15d-459d-9fb2-e813f2687557 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:37.371210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8644a6f1-d15d-459d-9fb2-e813f2687557 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.371702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8644a6f1-d15d-459d-9fb2-e813f2687557 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.372144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8644a6f1-d15d-459d-9fb2-e813f2687557 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.372844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8644a6f1-d15d-459d-9fb2-e813f2687557 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.373300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8644a6f1-d15d-459d-9fb2-e813f2687557 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.373723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8644a6f1-d15d-459d-9fb2-e813f2687557 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.612448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8644a6f1-d15d-459d-9fb2-e813f2687557 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:37.625677 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8644a6f1-d15d-459d-9fb2-e813f2687557 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1391 microversion: 2.1 time: 0.267309 Oct 04 18:45:37.628441 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3310/6606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:37 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1391 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:38.649938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-202ff83c-382a-4c02-a778-3b84328835f2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:38.650574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-202ff83c-382a-4c02-a778-3b84328835f2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:38.662712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202ff83c-382a-4c02-a778-3b84328835f2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.663430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202ff83c-382a-4c02-a778-3b84328835f2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.663971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202ff83c-382a-4c02-a778-3b84328835f2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.665582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202ff83c-382a-4c02-a778-3b84328835f2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.665582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202ff83c-382a-4c02-a778-3b84328835f2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.666208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-202ff83c-382a-4c02-a778-3b84328835f2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.854660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-202ff83c-382a-4c02-a778-3b84328835f2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:38.864450 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-202ff83c-382a-4c02-a778-3b84328835f2 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1391 microversion: 2.1 time: 0.218376 Oct 04 18:45:38.866264 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3297/6607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:38 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:38.966404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-95f31ac9-d037-4e47-97b5-ce469088b6c9 req-ca7863e5-0b1c-4610-b27d-3a1553fcae40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989c7dd0-05ac-41e2-8f85-7ce1890877d4", "name": "network-vif-plugged", "status": "completed", "tag": "b2d6b81a-6219-4d9e-a9c1-696f67a1afbc"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:38.989381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-95f31ac9-d037-4e47-97b5-ce469088b6c9 req-ca7863e5-0b1c-4610-b27d-3a1553fcae40 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.990142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-95f31ac9-d037-4e47-97b5-ce469088b6c9 req-ca7863e5-0b1c-4610-b27d-3a1553fcae40 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.992928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-95f31ac9-d037-4e47-97b5-ce469088b6c9 req-ca7863e5-0b1c-4610-b27d-3a1553fcae40 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:39.008286 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-95f31ac9-d037-4e47-97b5-ce469088b6c9 req-ca7863e5-0b1c-4610-b27d-3a1553fcae40 service nova] Creating event network-vif-plugged:b2d6b81a-6219-4d9e-a9c1-696f67a1afbc for instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 on n-h1-850499-14 Oct 04 18:45:39.016952 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-95f31ac9-d037-4e47-97b5-ce469088b6c9 req-ca7863e5-0b1c-4610-b27d-3a1553fcae40 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055304 Oct 04 18:45:39.018780 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3311/6608] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:39.886628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:39.888597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:39.896396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb72357b-491f-4f5c-821c-d4b668fcbd77 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:39.897300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bb72357b-491f-4f5c-821c-d4b668fcbd77 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:39.906202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb72357b-491f-4f5c-821c-d4b668fcbd77 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:39.907021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb72357b-491f-4f5c-821c-d4b668fcbd77 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:39.907548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb72357b-491f-4f5c-821c-d4b668fcbd77 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:39.908250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb72357b-491f-4f5c-821c-d4b668fcbd77 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:39.908897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb72357b-491f-4f5c-821c-d4b668fcbd77 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:39.909506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb72357b-491f-4f5c-821c-d4b668fcbd77 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.141591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bb72357b-491f-4f5c-821c-d4b668fcbd77 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:40.156361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb72357b-491f-4f5c-821c-d4b668fcbd77 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1391 microversion: 2.1 time: 0.270854 Oct 04 18:45:40.157379 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3298/6609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:39 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1391 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:41.185732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:41.191167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-663bb81a-1366-41c3-9f24-ebcf4dcda50b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:41.192033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-663bb81a-1366-41c3-9f24-ebcf4dcda50b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:41.200127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-663bb81a-1366-41c3-9f24-ebcf4dcda50b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.200619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-663bb81a-1366-41c3-9f24-ebcf4dcda50b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.201536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-663bb81a-1366-41c3-9f24-ebcf4dcda50b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.201924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-663bb81a-1366-41c3-9f24-ebcf4dcda50b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.202593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-663bb81a-1366-41c3-9f24-ebcf4dcda50b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.203153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-663bb81a-1366-41c3-9f24-ebcf4dcda50b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.385035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-663bb81a-1366-41c3-9f24-ebcf4dcda50b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:41.393981 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-663bb81a-1366-41c3-9f24-ebcf4dcda50b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1563 microversion: 2.1 time: 0.209457 Oct 04 18:45:41.394643 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3312/6610] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:41 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1563 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:41.417376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e0d84232-459a-4eaf-9f1c-7ad04108612f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:41.418559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e0d84232-459a-4eaf-9f1c-7ad04108612f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:41.425259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d84232-459a-4eaf-9f1c-7ad04108612f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.425757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d84232-459a-4eaf-9f1c-7ad04108612f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.426206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d84232-459a-4eaf-9f1c-7ad04108612f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.426915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d84232-459a-4eaf-9f1c-7ad04108612f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.427399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d84232-459a-4eaf-9f1c-7ad04108612f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.427831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0d84232-459a-4eaf-9f1c-7ad04108612f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.575131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e0d84232-459a-4eaf-9f1c-7ad04108612f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:41.585409 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e0d84232-459a-4eaf-9f1c-7ad04108612f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1563 microversion: 2.1 time: 0.171803 Oct 04 18:45:41.599793 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3299/6611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:41 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:44.388762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-180ea7f3-8e23-4c0e-be10-ac1a2ec72de7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:44.389540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-180ea7f3-8e23-4c0e-be10-ac1a2ec72de7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:44.392947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-305c9c83-e420-4a8d-8f41-2f31ff859465 req-8f89db9e-cd82-4fbd-bd66-1f5b2d60f0be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989c7dd0-05ac-41e2-8f85-7ce1890877d4", "tag": "b2d6b81a-6219-4d9e-a9c1-696f67a1afbc"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:44.408975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-180ea7f3-8e23-4c0e-be10-ac1a2ec72de7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.413819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-180ea7f3-8e23-4c0e-be10-ac1a2ec72de7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.414536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-180ea7f3-8e23-4c0e-be10-ac1a2ec72de7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.414994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-305c9c83-e420-4a8d-8f41-2f31ff859465 req-8f89db9e-cd82-4fbd-bd66-1f5b2d60f0be service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.415939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-180ea7f3-8e23-4c0e-be10-ac1a2ec72de7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.416407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-180ea7f3-8e23-4c0e-be10-ac1a2ec72de7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.417164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-305c9c83-e420-4a8d-8f41-2f31ff859465 req-8f89db9e-cd82-4fbd-bd66-1f5b2d60f0be service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.417788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-305c9c83-e420-4a8d-8f41-2f31ff859465 req-8f89db9e-cd82-4fbd-bd66-1f5b2d60f0be service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.422604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-180ea7f3-8e23-4c0e-be10-ac1a2ec72de7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.474031 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-305c9c83-e420-4a8d-8f41-2f31ff859465 req-8f89db9e-cd82-4fbd-bd66-1f5b2d60f0be service nova] Creating event network-changed:b2d6b81a-6219-4d9e-a9c1-696f67a1afbc for instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 on n-h1-850499-14 Oct 04 18:45:44.485123 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-305c9c83-e420-4a8d-8f41-2f31ff859465 req-8f89db9e-cd82-4fbd-bd66-1f5b2d60f0be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096711 Oct 04 18:45:44.487376 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3300/6612] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:44.691730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-180ea7f3-8e23-4c0e-be10-ac1a2ec72de7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:44.707475 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-180ea7f3-8e23-4c0e-be10-ac1a2ec72de7 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1563 microversion: 2.1 time: 0.319869 Oct 04 18:45:44.708921 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3313/6613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:44 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1563 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:58.517410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:58.518040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=22 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:58.523935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1788534015", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3e48a722-2024-44b6-8874-3f5556259552", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7231cfd-11da-40a4-8d73-d5073342969a"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:58.603308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] validate_networks() for [('d7231cfd-11da-40a4-8d73-d5073342969a', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:45:59.050603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:45:59.051519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:45:59.052284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:45:59.052916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:45:59.053415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:45:59.063837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.064366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.064830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.065584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.066060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.066765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.095759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:59.105139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for user 594483c9afdc4f69a6d02f10e8fde137 and project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:59.177029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:45:59.179559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e48a722-2024-44b6-8874-3f5556259552',volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:45:59.329355 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7dc12143-f72a-4520-85b3-067c35639c5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814176 Oct 04 18:45:59.330768 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3301/6614] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:45:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:45:59.346231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-714678f7-e1fe-40ba-ba7e-188b8793215d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:59.348273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-714678f7-e1fe-40ba-ba7e-188b8793215d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:59.351062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:59.353208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=38 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:59.411232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-714678f7-e1fe-40ba-ba7e-188b8793215d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:59.419782 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-714678f7-e1fe-40ba-ba7e-188b8793215d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1057 microversion: 2.1 time: 0.080359 Oct 04 18:45:59.421124 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3314/6615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:59 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1057 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:00.444138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-03119683-273d-4506-bd9d-2b4516a73ee6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:00.446389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-03119683-273d-4506-bd9d-2b4516a73ee6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:00.454924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03119683-273d-4506-bd9d-2b4516a73ee6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:00.456022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03119683-273d-4506-bd9d-2b4516a73ee6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:00.457090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03119683-273d-4506-bd9d-2b4516a73ee6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:00.458513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03119683-273d-4506-bd9d-2b4516a73ee6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:00.459604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03119683-273d-4506-bd9d-2b4516a73ee6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:00.461161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03119683-273d-4506-bd9d-2b4516a73ee6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:00.537552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-03119683-273d-4506-bd9d-2b4516a73ee6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:00.547900 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-03119683-273d-4506-bd9d-2b4516a73ee6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1155 microversion: 2.1 time: 0.109809 Oct 04 18:46:00.548383 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3302/6616] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:00 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1155 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:01.574713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-30b7307d-1f60-42cb-b904-c61376bb4fab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:01.575307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-30b7307d-1f60-42cb-b904-c61376bb4fab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:01.583602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b7307d-1f60-42cb-b904-c61376bb4fab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.584509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b7307d-1f60-42cb-b904-c61376bb4fab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.586062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b7307d-1f60-42cb-b904-c61376bb4fab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.587172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b7307d-1f60-42cb-b904-c61376bb4fab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.595379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b7307d-1f60-42cb-b904-c61376bb4fab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.596473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30b7307d-1f60-42cb-b904-c61376bb4fab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.920813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-30b7307d-1f60-42cb-b904-c61376bb4fab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:01.932614 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-30b7307d-1f60-42cb-b904-c61376bb4fab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1215 microversion: 2.1 time: 0.361812 Oct 04 18:46:01.948541 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3315/6617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:01 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1215 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:02.795515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c3d0a37e-5112-4430-a29e-12e7857a7e8f req-382c1b4b-8be5-4424-ad7a-66b703b36bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0e985c-7612-4970-956b-42fbe672a0d8", "tag": "91ca5ac1-7acf-40ab-88ba-6af5ad54aa44"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:02.841133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c3d0a37e-5112-4430-a29e-12e7857a7e8f req-382c1b4b-8be5-4424-ad7a-66b703b36bdb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:02.842312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c3d0a37e-5112-4430-a29e-12e7857a7e8f req-382c1b4b-8be5-4424-ad7a-66b703b36bdb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:02.843729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c3d0a37e-5112-4430-a29e-12e7857a7e8f req-382c1b4b-8be5-4424-ad7a-66b703b36bdb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:02.869499 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c3d0a37e-5112-4430-a29e-12e7857a7e8f req-382c1b4b-8be5-4424-ad7a-66b703b36bdb service nova] Creating event network-changed:91ca5ac1-7acf-40ab-88ba-6af5ad54aa44 for instance 9a0e985c-7612-4970-956b-42fbe672a0d8 on n-h2-850499-14 Oct 04 18:46:02.879156 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c3d0a37e-5112-4430-a29e-12e7857a7e8f req-382c1b4b-8be5-4424-ad7a-66b703b36bdb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087737 Oct 04 18:46:02.880366 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3303/6618] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:02.974253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-31059fd1-6c2e-439d-8e30-a67df14a29fb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:02.975032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-31059fd1-6c2e-439d-8e30-a67df14a29fb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:02.985290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31059fd1-6c2e-439d-8e30-a67df14a29fb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:02.986129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31059fd1-6c2e-439d-8e30-a67df14a29fb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:02.986748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31059fd1-6c2e-439d-8e30-a67df14a29fb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:02.987991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31059fd1-6c2e-439d-8e30-a67df14a29fb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:02.988659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31059fd1-6c2e-439d-8e30-a67df14a29fb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:02.989316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-31059fd1-6c2e-439d-8e30-a67df14a29fb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.176250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-31059fd1-6c2e-439d-8e30-a67df14a29fb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:03.190186 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-31059fd1-6c2e-439d-8e30-a67df14a29fb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1215 microversion: 2.1 time: 0.224168 Oct 04 18:46:03.191532 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3316/6619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:02 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:04.216006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c6bee37e-c252-4f5b-b7b4-747ae0a89b86 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:04.216634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c6bee37e-c252-4f5b-b7b4-747ae0a89b86 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:04.226354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6bee37e-c252-4f5b-b7b4-747ae0a89b86 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.227885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6bee37e-c252-4f5b-b7b4-747ae0a89b86 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.228649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6bee37e-c252-4f5b-b7b4-747ae0a89b86 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.229659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6bee37e-c252-4f5b-b7b4-747ae0a89b86 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.230244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6bee37e-c252-4f5b-b7b4-747ae0a89b86 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.232808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c6bee37e-c252-4f5b-b7b4-747ae0a89b86 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.441242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c6bee37e-c252-4f5b-b7b4-747ae0a89b86 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:04.454437 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c6bee37e-c252-4f5b-b7b4-747ae0a89b86 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1215 microversion: 2.1 time: 0.244399 Oct 04 18:46:04.455137 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3304/6620] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:04 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:05.480632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6a361b6f-da02-4856-8328-bbe5e96f8e66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:05.481538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6a361b6f-da02-4856-8328-bbe5e96f8e66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:05.489288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a361b6f-da02-4856-8328-bbe5e96f8e66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:05.489935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a361b6f-da02-4856-8328-bbe5e96f8e66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:05.490757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a361b6f-da02-4856-8328-bbe5e96f8e66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.492293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a361b6f-da02-4856-8328-bbe5e96f8e66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:05.492980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a361b6f-da02-4856-8328-bbe5e96f8e66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:05.493514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6a361b6f-da02-4856-8328-bbe5e96f8e66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.697731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6a361b6f-da02-4856-8328-bbe5e96f8e66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:05.710563 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6a361b6f-da02-4856-8328-bbe5e96f8e66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1215 microversion: 2.1 time: 0.233282 Oct 04 18:46:05.711764 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3317/6621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:05 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1215 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:06.737231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1eb7966d-c0a2-48f4-a5e1-bf69566842f5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:06.739283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1eb7966d-c0a2-48f4-a5e1-bf69566842f5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:06.751761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1eb7966d-c0a2-48f4-a5e1-bf69566842f5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.752662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1eb7966d-c0a2-48f4-a5e1-bf69566842f5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.753742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1eb7966d-c0a2-48f4-a5e1-bf69566842f5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.754944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1eb7966d-c0a2-48f4-a5e1-bf69566842f5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.755844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1eb7966d-c0a2-48f4-a5e1-bf69566842f5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.756733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1eb7966d-c0a2-48f4-a5e1-bf69566842f5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.924047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1eb7966d-c0a2-48f4-a5e1-bf69566842f5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:06.933061 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1eb7966d-c0a2-48f4-a5e1-bf69566842f5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1215 microversion: 2.1 time: 0.202025 Oct 04 18:46:06.933655 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3305/6622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:06 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:07.215916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ae67efb-ac67-4b1f-8f17-3f4936874110 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:07.218350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ae67efb-ac67-4b1f-8f17-3f4936874110 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:07.225511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae67efb-ac67-4b1f-8f17-3f4936874110 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.226575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae67efb-ac67-4b1f-8f17-3f4936874110 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.227035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae67efb-ac67-4b1f-8f17-3f4936874110 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.227744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae67efb-ac67-4b1f-8f17-3f4936874110 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.228208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae67efb-ac67-4b1f-8f17-3f4936874110 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.231009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae67efb-ac67-4b1f-8f17-3f4936874110 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.283521 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ae67efb-ac67-4b1f-8f17-3f4936874110 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4/action" status: 200 len: 24569 microversion: 2.1 time: 0.071278 Oct 04 18:46:07.284183 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3318/6623] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:07 2022] POST /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4/action => generated 24569 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:46:07.955944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1faa65a9-c2b8-4d93-ad88-bd1524e90b19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:07.956611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1faa65a9-c2b8-4d93-ad88-bd1524e90b19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:07.965003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faa65a9-c2b8-4d93-ad88-bd1524e90b19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.965497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faa65a9-c2b8-4d93-ad88-bd1524e90b19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.965941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faa65a9-c2b8-4d93-ad88-bd1524e90b19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.966669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faa65a9-c2b8-4d93-ad88-bd1524e90b19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:07.967159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faa65a9-c2b8-4d93-ad88-bd1524e90b19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:07.967590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faa65a9-c2b8-4d93-ad88-bd1524e90b19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.111108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1faa65a9-c2b8-4d93-ad88-bd1524e90b19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:08.119165 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1faa65a9-c2b8-4d93-ad88-bd1524e90b19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.167224 Oct 04 18:46:08.119757 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3306/6624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:07 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:09.145381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-65457644-477b-4169-b19c-058594a8ba10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:09.147138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-65457644-477b-4169-b19c-058594a8ba10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:09.162433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65457644-477b-4169-b19c-058594a8ba10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.163927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65457644-477b-4169-b19c-058594a8ba10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.164723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65457644-477b-4169-b19c-058594a8ba10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:09.165998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65457644-477b-4169-b19c-058594a8ba10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.166835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65457644-477b-4169-b19c-058594a8ba10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.167657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65457644-477b-4169-b19c-058594a8ba10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:09.361377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-65457644-477b-4169-b19c-058594a8ba10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:09.379117 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-65457644-477b-4169-b19c-058594a8ba10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.238813 Oct 04 18:46:09.380588 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3319/6625] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:09 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:10.416038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d60f630-3bc5-4f51-85cf-564b475caef0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:10.417086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d60f630-3bc5-4f51-85cf-564b475caef0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:10.420912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:10.421848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:10.428935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d60f630-3bc5-4f51-85cf-564b475caef0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:10.429662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d60f630-3bc5-4f51-85cf-564b475caef0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:10.430226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d60f630-3bc5-4f51-85cf-564b475caef0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.431332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d60f630-3bc5-4f51-85cf-564b475caef0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:10.432288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d60f630-3bc5-4f51-85cf-564b475caef0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:10.433259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d60f630-3bc5-4f51-85cf-564b475caef0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.621247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d60f630-3bc5-4f51-85cf-564b475caef0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:10.629462 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d60f630-3bc5-4f51-85cf-564b475caef0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.218045 Oct 04 18:46:10.630057 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3307/6626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:10 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:11.655260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-604056fd-e22f-4afa-97c1-c234dc51e84c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:11.656336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-604056fd-e22f-4afa-97c1-c234dc51e84c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:11.658616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:11.666330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-604056fd-e22f-4afa-97c1-c234dc51e84c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.666828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-604056fd-e22f-4afa-97c1-c234dc51e84c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.667292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-604056fd-e22f-4afa-97c1-c234dc51e84c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.667993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-604056fd-e22f-4afa-97c1-c234dc51e84c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.668448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-604056fd-e22f-4afa-97c1-c234dc51e84c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.668872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-604056fd-e22f-4afa-97c1-c234dc51e84c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.818605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-604056fd-e22f-4afa-97c1-c234dc51e84c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:11.826890 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-604056fd-e22f-4afa-97c1-c234dc51e84c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.176050 Oct 04 18:46:11.827541 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3320/6627] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:11 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:12.850988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-25ca0cab-98bc-40a6-b3e2-ebb4a16bd83c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:12.851699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-25ca0cab-98bc-40a6-b3e2-ebb4a16bd83c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.858783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ca0cab-98bc-40a6-b3e2-ebb4a16bd83c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.859314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ca0cab-98bc-40a6-b3e2-ebb4a16bd83c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.859754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ca0cab-98bc-40a6-b3e2-ebb4a16bd83c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.860457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ca0cab-98bc-40a6-b3e2-ebb4a16bd83c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.860920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ca0cab-98bc-40a6-b3e2-ebb4a16bd83c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.861348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25ca0cab-98bc-40a6-b3e2-ebb4a16bd83c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.999347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-25ca0cab-98bc-40a6-b3e2-ebb4a16bd83c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:13.008142 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-25ca0cab-98bc-40a6-b3e2-ebb4a16bd83c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.162250 Oct 04 18:46:13.008729 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3308/6628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:12 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:14.032548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7eefc141-a813-4f36-b3cd-836ae9614dc5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:14.033165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7eefc141-a813-4f36-b3cd-836ae9614dc5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:14.040435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eefc141-a813-4f36-b3cd-836ae9614dc5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.041208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eefc141-a813-4f36-b3cd-836ae9614dc5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.041969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eefc141-a813-4f36-b3cd-836ae9614dc5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.043202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eefc141-a813-4f36-b3cd-836ae9614dc5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.044025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eefc141-a813-4f36-b3cd-836ae9614dc5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.044708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eefc141-a813-4f36-b3cd-836ae9614dc5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.430218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7eefc141-a813-4f36-b3cd-836ae9614dc5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:14.438991 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7eefc141-a813-4f36-b3cd-836ae9614dc5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.410854 Oct 04 18:46:14.440117 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3321/6629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:14 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:15.477117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-557361cf-ea80-4bbe-8368-a5c28fafc15f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:15.477818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-557361cf-ea80-4bbe-8368-a5c28fafc15f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:15.485329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557361cf-ea80-4bbe-8368-a5c28fafc15f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.485927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557361cf-ea80-4bbe-8368-a5c28fafc15f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.486446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557361cf-ea80-4bbe-8368-a5c28fafc15f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.487261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557361cf-ea80-4bbe-8368-a5c28fafc15f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.487869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557361cf-ea80-4bbe-8368-a5c28fafc15f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.488373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557361cf-ea80-4bbe-8368-a5c28fafc15f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.717237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-557361cf-ea80-4bbe-8368-a5c28fafc15f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:15.725939 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-557361cf-ea80-4bbe-8368-a5c28fafc15f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.253116 Oct 04 18:46:15.726844 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3309/6630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:15 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:16.761642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ee849f2-eaf5-4acb-90f0-319c54cdfb97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:16.763898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ee849f2-eaf5-4acb-90f0-319c54cdfb97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:16.778689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee849f2-eaf5-4acb-90f0-319c54cdfb97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.780229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee849f2-eaf5-4acb-90f0-319c54cdfb97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.781400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee849f2-eaf5-4acb-90f0-319c54cdfb97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.782993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee849f2-eaf5-4acb-90f0-319c54cdfb97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.784260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee849f2-eaf5-4acb-90f0-319c54cdfb97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.786301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ee849f2-eaf5-4acb-90f0-319c54cdfb97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.055722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ee849f2-eaf5-4acb-90f0-319c54cdfb97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:17.068149 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ee849f2-eaf5-4acb-90f0-319c54cdfb97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.315595 Oct 04 18:46:17.070460 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3322/6631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:16 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.124251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ad8778e7-aae3-4506-976f-7c63b29704af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:18.126529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ad8778e7-aae3-4506-976f-7c63b29704af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.139170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8778e7-aae3-4506-976f-7c63b29704af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.143599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8778e7-aae3-4506-976f-7c63b29704af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.144074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8778e7-aae3-4506-976f-7c63b29704af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.144827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8778e7-aae3-4506-976f-7c63b29704af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.145314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8778e7-aae3-4506-976f-7c63b29704af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.145757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad8778e7-aae3-4506-976f-7c63b29704af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.260381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acd24e6c-2248-4327-9505-66fea04436b8"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:18.263209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.269461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.269962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.270414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.271200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.271669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.272110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.296873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ad8778e7-aae3-4506-976f-7c63b29704af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:18.305876 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ad8778e7-aae3-4506-976f-7c63b29704af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.189960 Oct 04 18:46:18.306476 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3310/6632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:18 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.359609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:18.360036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:18.360512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:18.360923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:18.361330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:18.421195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.427398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.427899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.428353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.429078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.429544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.429982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.462479 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d60d8f00-ecc9-4514-b082-04c2723aa8e1 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4/action" status: 202 len: 1138 microversion: 2.1 time: 0.207035 Oct 04 18:46:18.466995 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3323/6633] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:18 2022] POST /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4/action => generated 1138 bytes in 208 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 04 18:46:18.485305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a3e3690f-16b6-4ef1-84ae-68416e648e6f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:18.486040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a3e3690f-16b6-4ef1-84ae-68416e648e6f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.492438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3e3690f-16b6-4ef1-84ae-68416e648e6f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.493024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3e3690f-16b6-4ef1-84ae-68416e648e6f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.493604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3e3690f-16b6-4ef1-84ae-68416e648e6f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.494395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3e3690f-16b6-4ef1-84ae-68416e648e6f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.494944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3e3690f-16b6-4ef1-84ae-68416e648e6f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.495477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3e3690f-16b6-4ef1-84ae-68416e648e6f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.650782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a3e3690f-16b6-4ef1-84ae-68416e648e6f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:18.658707 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a3e3690f-16b6-4ef1-84ae-68416e648e6f tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1691 microversion: 2.1 time: 0.177542 Oct 04 18:46:18.659316 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3311/6634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:18 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.966892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-91e56e9a-4156-4eca-a19e-67670f119ec6 req-864aa656-e98b-4f22-b229-eaddf88ceb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0e985c-7612-4970-956b-42fbe672a0d8", "name": "network-vif-plugged", "status": "completed", "tag": "91ca5ac1-7acf-40ab-88ba-6af5ad54aa44"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:18.979927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-91e56e9a-4156-4eca-a19e-67670f119ec6 req-864aa656-e98b-4f22-b229-eaddf88ceb8e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.980736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-91e56e9a-4156-4eca-a19e-67670f119ec6 req-864aa656-e98b-4f22-b229-eaddf88ceb8e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.981536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-91e56e9a-4156-4eca-a19e-67670f119ec6 req-864aa656-e98b-4f22-b229-eaddf88ceb8e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.001253 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-91e56e9a-4156-4eca-a19e-67670f119ec6 req-864aa656-e98b-4f22-b229-eaddf88ceb8e service nova] Creating event network-vif-plugged:91ca5ac1-7acf-40ab-88ba-6af5ad54aa44 for instance 9a0e985c-7612-4970-956b-42fbe672a0d8 on n-h2-850499-14 Oct 04 18:46:19.009219 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-91e56e9a-4156-4eca-a19e-67670f119ec6 req-864aa656-e98b-4f22-b229-eaddf88ceb8e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047471 Oct 04 18:46:19.009730 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3324/6635] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:19.328940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8ce89ba0-223a-4852-b2dd-efa8e42ce34e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:19.329641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8ce89ba0-223a-4852-b2dd-efa8e42ce34e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:19.337462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce89ba0-223a-4852-b2dd-efa8e42ce34e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.337984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce89ba0-223a-4852-b2dd-efa8e42ce34e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.338430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce89ba0-223a-4852-b2dd-efa8e42ce34e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.339179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce89ba0-223a-4852-b2dd-efa8e42ce34e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.339649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce89ba0-223a-4852-b2dd-efa8e42ce34e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.340084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce89ba0-223a-4852-b2dd-efa8e42ce34e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.536801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8ce89ba0-223a-4852-b2dd-efa8e42ce34e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:19.545116 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8ce89ba0-223a-4852-b2dd-efa8e42ce34e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.220119 Oct 04 18:46:19.545701 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3312/6636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:19 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:19.691189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60d792bf-83ed-4e45-b906-7e07de0cbc58 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:19.692942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-60d792bf-83ed-4e45-b906-7e07de0cbc58 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:19.703445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d792bf-83ed-4e45-b906-7e07de0cbc58 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.704370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d792bf-83ed-4e45-b906-7e07de0cbc58 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.705190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d792bf-83ed-4e45-b906-7e07de0cbc58 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.706446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d792bf-83ed-4e45-b906-7e07de0cbc58 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.707385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d792bf-83ed-4e45-b906-7e07de0cbc58 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.707810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60d792bf-83ed-4e45-b906-7e07de0cbc58 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.881092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-60d792bf-83ed-4e45-b906-7e07de0cbc58 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:19.896688 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-60d792bf-83ed-4e45-b906-7e07de0cbc58 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1691 microversion: 2.1 time: 0.213221 Oct 04 18:46:19.897647 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3325/6637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:19 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1691 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:20.572866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-70d50a83-6fdd-4d46-812b-284ba7ba3c70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:20.573508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-70d50a83-6fdd-4d46-812b-284ba7ba3c70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:20.581010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d50a83-6fdd-4d46-812b-284ba7ba3c70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.581518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d50a83-6fdd-4d46-812b-284ba7ba3c70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.581973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d50a83-6fdd-4d46-812b-284ba7ba3c70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.582694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d50a83-6fdd-4d46-812b-284ba7ba3c70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.583194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d50a83-6fdd-4d46-812b-284ba7ba3c70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.583632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d50a83-6fdd-4d46-812b-284ba7ba3c70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.783041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-70d50a83-6fdd-4d46-812b-284ba7ba3c70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:20.793085 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-70d50a83-6fdd-4d46-812b-284ba7ba3c70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1203 microversion: 2.1 time: 0.224566 Oct 04 18:46:20.794512 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3313/6638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:20 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1203 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:20.927778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8e8be76a-99e8-4db7-81a8-1fcb8a98c0d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:20.928944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8e8be76a-99e8-4db7-81a8-1fcb8a98c0d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:20.937380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e8be76a-99e8-4db7-81a8-1fcb8a98c0d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.938046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e8be76a-99e8-4db7-81a8-1fcb8a98c0d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.938604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e8be76a-99e8-4db7-81a8-1fcb8a98c0d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.939488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e8be76a-99e8-4db7-81a8-1fcb8a98c0d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.940067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e8be76a-99e8-4db7-81a8-1fcb8a98c0d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.940679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e8be76a-99e8-4db7-81a8-1fcb8a98c0d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.105279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8e8be76a-99e8-4db7-81a8-1fcb8a98c0d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.114075 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8e8be76a-99e8-4db7-81a8-1fcb8a98c0d3 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1691 microversion: 2.1 time: 0.191897 Oct 04 18:46:21.114654 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3326/6639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:20 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.822140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c096d1d-834d-48ef-92b3-9106866bcea3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.823351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0c096d1d-834d-48ef-92b3-9106866bcea3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.840487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c096d1d-834d-48ef-92b3-9106866bcea3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.841004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c096d1d-834d-48ef-92b3-9106866bcea3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.841766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c096d1d-834d-48ef-92b3-9106866bcea3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.843128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c096d1d-834d-48ef-92b3-9106866bcea3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.844054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c096d1d-834d-48ef-92b3-9106866bcea3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.844816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c096d1d-834d-48ef-92b3-9106866bcea3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.061017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0c096d1d-834d-48ef-92b3-9106866bcea3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.074229 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0c096d1d-834d-48ef-92b3-9106866bcea3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1391 microversion: 2.1 time: 0.259643 Oct 04 18:46:22.083021 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3314/6640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:21 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1391 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:22.106773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-98d861a3-82b3-4af0-ae9e-aaf9d09afc11 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.106773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-98d861a3-82b3-4af0-ae9e-aaf9d09afc11 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.117487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d861a3-82b3-4af0-ae9e-aaf9d09afc11 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.118527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d861a3-82b3-4af0-ae9e-aaf9d09afc11 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.119429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d861a3-82b3-4af0-ae9e-aaf9d09afc11 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.120777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d861a3-82b3-4af0-ae9e-aaf9d09afc11 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.121741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d861a3-82b3-4af0-ae9e-aaf9d09afc11 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.122694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d861a3-82b3-4af0-ae9e-aaf9d09afc11 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.151734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d904e5b-8b7b-4efc-81bb-983408c7f032 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.153988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d904e5b-8b7b-4efc-81bb-983408c7f032 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.177873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d904e5b-8b7b-4efc-81bb-983408c7f032 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.180172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d904e5b-8b7b-4efc-81bb-983408c7f032 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.181119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d904e5b-8b7b-4efc-81bb-983408c7f032 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.182619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d904e5b-8b7b-4efc-81bb-983408c7f032 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.184055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d904e5b-8b7b-4efc-81bb-983408c7f032 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.185215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d904e5b-8b7b-4efc-81bb-983408c7f032 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.383744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-98d861a3-82b3-4af0-ae9e-aaf9d09afc11 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.400213 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-98d861a3-82b3-4af0-ae9e-aaf9d09afc11 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1391 microversion: 2.1 time: 0.305442 Oct 04 18:46:22.401110 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3327/6641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:22 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:22.448250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d904e5b-8b7b-4efc-81bb-983408c7f032 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.462256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45c74449-e127-4649-8f02-cdec69bb9a71 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.462895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-45c74449-e127-4649-8f02-cdec69bb9a71 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.469883 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d904e5b-8b7b-4efc-81bb-983408c7f032 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1691 microversion: 2.1 time: 0.329477 Oct 04 18:46:22.470252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45c74449-e127-4649-8f02-cdec69bb9a71 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.470575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45c74449-e127-4649-8f02-cdec69bb9a71 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.471739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45c74449-e127-4649-8f02-cdec69bb9a71 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.472666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45c74449-e127-4649-8f02-cdec69bb9a71 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.473334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45c74449-e127-4649-8f02-cdec69bb9a71 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.474225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45c74449-e127-4649-8f02-cdec69bb9a71 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.476104 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3315/6642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:22 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1691 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:22.639591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-45c74449-e127-4649-8f02-cdec69bb9a71 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.652188 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-45c74449-e127-4649-8f02-cdec69bb9a71 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1391 microversion: 2.1 time: 0.202428 Oct 04 18:46:22.654024 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3328/6643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:22 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:22.677239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a2040f61-c53c-462a-a5f5-6a9959bc0998 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.678051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a2040f61-c53c-462a-a5f5-6a9959bc0998 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.686207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2040f61-c53c-462a-a5f5-6a9959bc0998 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.687030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2040f61-c53c-462a-a5f5-6a9959bc0998 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.687849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2040f61-c53c-462a-a5f5-6a9959bc0998 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.688638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2040f61-c53c-462a-a5f5-6a9959bc0998 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.689116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2040f61-c53c-462a-a5f5-6a9959bc0998 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.689556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a2040f61-c53c-462a-a5f5-6a9959bc0998 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.722484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a2040f61-c53c-462a-a5f5-6a9959bc0998 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:46:22.823815 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a2040f61-c53c-462a-a5f5-6a9959bc0998 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 204 len: 0 microversion: 2.1 time: 0.150944 Oct 04 18:46:22.825763 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3316/6644] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:46:22 2022] DELETE /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:46:22.839615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7918528-d7a9-46c7-8749-ef9c0f60bbc1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.841084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b7918528-d7a9-46c7-8749-ef9c0f60bbc1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.852512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7918528-d7a9-46c7-8749-ef9c0f60bbc1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.854063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7918528-d7a9-46c7-8749-ef9c0f60bbc1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.854893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7918528-d7a9-46c7-8749-ef9c0f60bbc1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.856167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7918528-d7a9-46c7-8749-ef9c0f60bbc1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.857453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7918528-d7a9-46c7-8749-ef9c0f60bbc1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.858407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7918528-d7a9-46c7-8749-ef9c0f60bbc1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.094615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b7918528-d7a9-46c7-8749-ef9c0f60bbc1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:23.108923 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b7918528-d7a9-46c7-8749-ef9c0f60bbc1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1397 microversion: 2.1 time: 0.278038 Oct 04 18:46:23.109966 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3329/6645] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:22 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1397 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:23.516073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8913fcb7-a496-4587-8b98-dc9104bed16d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:23.516819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8913fcb7-a496-4587-8b98-dc9104bed16d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:23.525175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8913fcb7-a496-4587-8b98-dc9104bed16d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.525755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8913fcb7-a496-4587-8b98-dc9104bed16d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.526217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8913fcb7-a496-4587-8b98-dc9104bed16d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.526942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8913fcb7-a496-4587-8b98-dc9104bed16d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.527446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8913fcb7-a496-4587-8b98-dc9104bed16d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.527885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8913fcb7-a496-4587-8b98-dc9104bed16d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.533161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:23.721833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8913fcb7-a496-4587-8b98-dc9104bed16d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:23.731721 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8913fcb7-a496-4587-8b98-dc9104bed16d tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1691 microversion: 2.1 time: 0.219916 Oct 04 18:46:23.732477 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3317/6646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:23 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1691 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:24.146126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-756d26a0-a567-42d1-9587-839edd4bcaa9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:24.146772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-756d26a0-a567-42d1-9587-839edd4bcaa9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:24.154117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-756d26a0-a567-42d1-9587-839edd4bcaa9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.155066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-756d26a0-a567-42d1-9587-839edd4bcaa9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.155242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-756d26a0-a567-42d1-9587-839edd4bcaa9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.156074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-756d26a0-a567-42d1-9587-839edd4bcaa9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.156625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-756d26a0-a567-42d1-9587-839edd4bcaa9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.157130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-756d26a0-a567-42d1-9587-839edd4bcaa9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.178625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:24.315515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-756d26a0-a567-42d1-9587-839edd4bcaa9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.324191 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-756d26a0-a567-42d1-9587-839edd4bcaa9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1397 microversion: 2.1 time: 0.182198 Oct 04 18:46:24.324777 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3330/6647] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:24 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1397 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:24.759247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-586f356e-5e82-4f3e-b96e-f88cf715d7ec tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:24.759910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-586f356e-5e82-4f3e-b96e-f88cf715d7ec tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:24.766937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-586f356e-5e82-4f3e-b96e-f88cf715d7ec tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.767469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-586f356e-5e82-4f3e-b96e-f88cf715d7ec tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.768020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-586f356e-5e82-4f3e-b96e-f88cf715d7ec tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.768635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-586f356e-5e82-4f3e-b96e-f88cf715d7ec tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.769193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-586f356e-5e82-4f3e-b96e-f88cf715d7ec tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.769544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-586f356e-5e82-4f3e-b96e-f88cf715d7ec tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.943698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-586f356e-5e82-4f3e-b96e-f88cf715d7ec tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.952967 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-586f356e-5e82-4f3e-b96e-f88cf715d7ec tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1691 microversion: 2.1 time: 0.197627 Oct 04 18:46:24.953575 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3318/6648] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:24 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:25.354158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9f8b57b8-c0ef-4724-b470-ae97b5627433 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:25.355424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9f8b57b8-c0ef-4724-b470-ae97b5627433 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:25.363634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f8b57b8-c0ef-4724-b470-ae97b5627433 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.364361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f8b57b8-c0ef-4724-b470-ae97b5627433 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.364975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f8b57b8-c0ef-4724-b470-ae97b5627433 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.365866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f8b57b8-c0ef-4724-b470-ae97b5627433 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.366524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f8b57b8-c0ef-4724-b470-ae97b5627433 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.367073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9f8b57b8-c0ef-4724-b470-ae97b5627433 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.597538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9f8b57b8-c0ef-4724-b470-ae97b5627433 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:25.620155 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9f8b57b8-c0ef-4724-b470-ae97b5627433 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1397 microversion: 2.1 time: 0.270036 Oct 04 18:46:25.622322 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3331/6649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1397 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:25.663069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-451508d5-54ed-4389-b54d-60fb5980d99f req-cb98f145-6ce5-4319-a38e-98a95fbf0631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0e985c-7612-4970-956b-42fbe672a0d8", "name": "network-vif-deleted", "tag": "91ca5ac1-7acf-40ab-88ba-6af5ad54aa44"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:25.675924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-451508d5-54ed-4389-b54d-60fb5980d99f req-cb98f145-6ce5-4319-a38e-98a95fbf0631 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.677266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-451508d5-54ed-4389-b54d-60fb5980d99f req-cb98f145-6ce5-4319-a38e-98a95fbf0631 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.677879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-451508d5-54ed-4389-b54d-60fb5980d99f req-cb98f145-6ce5-4319-a38e-98a95fbf0631 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.695282 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-451508d5-54ed-4389-b54d-60fb5980d99f req-cb98f145-6ce5-4319-a38e-98a95fbf0631 service nova] Creating event network-vif-deleted:91ca5ac1-7acf-40ab-88ba-6af5ad54aa44 for instance 9a0e985c-7612-4970-956b-42fbe672a0d8 on n-h2-850499-14 Oct 04 18:46:25.701061 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-451508d5-54ed-4389-b54d-60fb5980d99f req-cb98f145-6ce5-4319-a38e-98a95fbf0631 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043867 Oct 04 18:46:25.701691 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3319/6650] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:26.252814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0e3d8cb1-d6d6-4e5f-956b-c2de3999c6b6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:26.253825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0e3d8cb1-d6d6-4e5f-956b-c2de3999c6b6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:26.266417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e3d8cb1-d6d6-4e5f-956b-c2de3999c6b6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.267572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e3d8cb1-d6d6-4e5f-956b-c2de3999c6b6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.268090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e3d8cb1-d6d6-4e5f-956b-c2de3999c6b6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.268833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e3d8cb1-d6d6-4e5f-956b-c2de3999c6b6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.269304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e3d8cb1-d6d6-4e5f-956b-c2de3999c6b6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.269745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e3d8cb1-d6d6-4e5f-956b-c2de3999c6b6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.447677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0e3d8cb1-d6d6-4e5f-956b-c2de3999c6b6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:26.464684 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0e3d8cb1-d6d6-4e5f-956b-c2de3999c6b6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1691 microversion: 2.1 time: 0.489296 Oct 04 18:46:26.465309 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3332/6651] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1691 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:26.662515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-745e7041-a9be-4311-88de-57950d06f309 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:26.663548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-745e7041-a9be-4311-88de-57950d06f309 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:26.670686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-745e7041-a9be-4311-88de-57950d06f309 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.671517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-745e7041-a9be-4311-88de-57950d06f309 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.672167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-745e7041-a9be-4311-88de-57950d06f309 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.673125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-745e7041-a9be-4311-88de-57950d06f309 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.673629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-745e7041-a9be-4311-88de-57950d06f309 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.674041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-745e7041-a9be-4311-88de-57950d06f309 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.761811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-745e7041-a9be-4311-88de-57950d06f309 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:26.781391 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-745e7041-a9be-4311-88de-57950d06f309 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1188 microversion: 2.1 time: 0.134829 Oct 04 18:46:26.782159 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3320/6652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:26 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1188 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:27.503153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e6c22e59-3de8-4b10-b4c0-be109c9a5bca tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:27.504145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e6c22e59-3de8-4b10-b4c0-be109c9a5bca tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:27.512055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6c22e59-3de8-4b10-b4c0-be109c9a5bca tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.512703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6c22e59-3de8-4b10-b4c0-be109c9a5bca tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.513289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6c22e59-3de8-4b10-b4c0-be109c9a5bca tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.514139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6c22e59-3de8-4b10-b4c0-be109c9a5bca tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.514562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6c22e59-3de8-4b10-b4c0-be109c9a5bca tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.515235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6c22e59-3de8-4b10-b4c0-be109c9a5bca tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.696794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e6c22e59-3de8-4b10-b4c0-be109c9a5bca tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:27.705301 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e6c22e59-3de8-4b10-b4c0-be109c9a5bca tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1691 microversion: 2.1 time: 0.219414 Oct 04 18:46:27.706208 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3333/6653] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:27 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1691 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:27.806207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f653ce74-daea-41a8-a624-a1fb363b9359 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:27.807564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f653ce74-daea-41a8-a624-a1fb363b9359 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:27.816923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f653ce74-daea-41a8-a624-a1fb363b9359 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.817788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f653ce74-daea-41a8-a624-a1fb363b9359 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.818572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f653ce74-daea-41a8-a624-a1fb363b9359 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.820041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f653ce74-daea-41a8-a624-a1fb363b9359 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.820514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f653ce74-daea-41a8-a624-a1fb363b9359 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.820936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f653ce74-daea-41a8-a624-a1fb363b9359 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.915608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f653ce74-daea-41a8-a624-a1fb363b9359 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:27.925182 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f653ce74-daea-41a8-a624-a1fb363b9359 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1188 microversion: 2.1 time: 0.124030 Oct 04 18:46:27.926263 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3321/6654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:27 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1188 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:28.730548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f1e715c-5823-4644-9c05-1db06e5aff85 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:28.731196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f1e715c-5823-4644-9c05-1db06e5aff85 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:28.738718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1e715c-5823-4644-9c05-1db06e5aff85 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.739367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1e715c-5823-4644-9c05-1db06e5aff85 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.739858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1e715c-5823-4644-9c05-1db06e5aff85 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.740594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1e715c-5823-4644-9c05-1db06e5aff85 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.741707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1e715c-5823-4644-9c05-1db06e5aff85 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.742360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f1e715c-5823-4644-9c05-1db06e5aff85 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.901736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1f1e715c-5823-4644-9c05-1db06e5aff85 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:28.912590 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f1e715c-5823-4644-9c05-1db06e5aff85 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1691 microversion: 2.1 time: 0.185783 Oct 04 18:46:28.915023 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3334/6655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:28 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:28.955350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-727f8e3c-e10b-4e9b-a60b-b5a16f26f072 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:28.956341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-727f8e3c-e10b-4e9b-a60b-b5a16f26f072 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:28.964673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:28.967327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-727f8e3c-e10b-4e9b-a60b-b5a16f26f072 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.968089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-727f8e3c-e10b-4e9b-a60b-b5a16f26f072 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.969034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-727f8e3c-e10b-4e9b-a60b-b5a16f26f072 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.970022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-727f8e3c-e10b-4e9b-a60b-b5a16f26f072 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.970789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-727f8e3c-e10b-4e9b-a60b-b5a16f26f072 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.971663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-727f8e3c-e10b-4e9b-a60b-b5a16f26f072 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.049081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-727f8e3c-e10b-4e9b-a60b-b5a16f26f072 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:29.057854 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-727f8e3c-e10b-4e9b-a60b-b5a16f26f072 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1188 microversion: 2.1 time: 0.109091 Oct 04 18:46:29.058792 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3322/6656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:28 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1188 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:29.945372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-775cfe65-7706-46b8-bc35-e106d8836ecf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:29.946006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-775cfe65-7706-46b8-bc35-e106d8836ecf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:29.949307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=49 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:29.956584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-775cfe65-7706-46b8-bc35-e106d8836ecf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.956963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-775cfe65-7706-46b8-bc35-e106d8836ecf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.957809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-775cfe65-7706-46b8-bc35-e106d8836ecf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.959853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-775cfe65-7706-46b8-bc35-e106d8836ecf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.959853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-775cfe65-7706-46b8-bc35-e106d8836ecf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.959853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-775cfe65-7706-46b8-bc35-e106d8836ecf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.083803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b3a9e618-d41c-4b69-9b70-8fc6747a7225 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:30.086125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b3a9e618-d41c-4b69-9b70-8fc6747a7225 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:30.099892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a9e618-d41c-4b69-9b70-8fc6747a7225 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.101562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a9e618-d41c-4b69-9b70-8fc6747a7225 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.102484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a9e618-d41c-4b69-9b70-8fc6747a7225 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.103936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a9e618-d41c-4b69-9b70-8fc6747a7225 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.105212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a9e618-d41c-4b69-9b70-8fc6747a7225 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.106541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b3a9e618-d41c-4b69-9b70-8fc6747a7225 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.216026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b3a9e618-d41c-4b69-9b70-8fc6747a7225 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:30.230612 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b3a9e618-d41c-4b69-9b70-8fc6747a7225 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 200 len: 1188 microversion: 2.1 time: 0.151650 Oct 04 18:46:30.231472 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3323/6657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:30 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 1188 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:30.244730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-775cfe65-7706-46b8-bc35-e106d8836ecf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:30.258108 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-775cfe65-7706-46b8-bc35-e106d8836ecf tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1691 microversion: 2.1 time: 0.317652 Oct 04 18:46:30.259095 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3335/6658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:29 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1691 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:31.264923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:31.265528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9a0e985c-7612-4970-956b-42fbe672a0d8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:31.273814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.274303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.274761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.275586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.276062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.276554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.285042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a6d84963-48cf-464e-b747-f9af841a5e9c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:31.286078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a6d84963-48cf-464e-b747-f9af841a5e9c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:31.293358 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance 9a0e985c-7612-4970-956b-42fbe672a0d8 could not be found. Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 HTTP/1.1 Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 9a0e985c-7612-4970-956b-42fbe672a0d8 could not be found. Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '9a0e985c-7612-4970-956b-42fbe672a0d8'} Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0e985c-7612-4970-956b-42fbe672a0d8 could not be found. Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0e985c-7612-4970-956b-42fbe672a0d8 could not be found. Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:31.295136 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:46:31.305061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:31.305061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:31.305061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:31.305061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:31.305061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:31.305061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0e985c-7612-4970-956b-42fbe672a0d8 could not be found. Oct 04 18:46:31.305061 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:46:31.305061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance 9a0e985c-7612-4970-956b-42fbe672a0d8 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:31.305061 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-535af2fa-88be-4d8b-b17f-ac31b8230014 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8" status: 404 len: 111 microversion: 2.1 time: 0.035948 Oct 04 18:46:31.305061 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3324/6659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:31 2022] GET /compute/v2.1/servers/9a0e985c-7612-4970-956b-42fbe672a0d8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:46:31.324031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6d84963-48cf-464e-b747-f9af841a5e9c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.325093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6d84963-48cf-464e-b747-f9af841a5e9c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.328262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6d84963-48cf-464e-b747-f9af841a5e9c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.331718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6d84963-48cf-464e-b747-f9af841a5e9c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.332570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6d84963-48cf-464e-b747-f9af841a5e9c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.333086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a6d84963-48cf-464e-b747-f9af841a5e9c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.558550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a6d84963-48cf-464e-b747-f9af841a5e9c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.565860 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a6d84963-48cf-464e-b747-f9af841a5e9c tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1697 microversion: 2.1 time: 0.286723 Oct 04 18:46:31.566788 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3336/6660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:31 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1697 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:32.604938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-771e2392-76dc-43fe-a017-2c36557c4e52 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:32.605671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-771e2392-76dc-43fe-a017-2c36557c4e52 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:32.613085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771e2392-76dc-43fe-a017-2c36557c4e52 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.613673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771e2392-76dc-43fe-a017-2c36557c4e52 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.614327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771e2392-76dc-43fe-a017-2c36557c4e52 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.615307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771e2392-76dc-43fe-a017-2c36557c4e52 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.615843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771e2392-76dc-43fe-a017-2c36557c4e52 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.616538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-771e2392-76dc-43fe-a017-2c36557c4e52 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.877185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-771e2392-76dc-43fe-a017-2c36557c4e52 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:32.886932 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-771e2392-76dc-43fe-a017-2c36557c4e52 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1697 microversion: 2.1 time: 0.287770 Oct 04 18:46:32.888175 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3325/6661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:32 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1697 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:33.910831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb84c442-319b-40a8-9a94-0abdae009642 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:33.912228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb84c442-319b-40a8-9a94-0abdae009642 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:33.920896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb84c442-319b-40a8-9a94-0abdae009642 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.921742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb84c442-319b-40a8-9a94-0abdae009642 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.922390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb84c442-319b-40a8-9a94-0abdae009642 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.923657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb84c442-319b-40a8-9a94-0abdae009642 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.924482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb84c442-319b-40a8-9a94-0abdae009642 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.925133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb84c442-319b-40a8-9a94-0abdae009642 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.121053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb84c442-319b-40a8-9a94-0abdae009642 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:34.137894 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb84c442-319b-40a8-9a94-0abdae009642 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1682 microversion: 2.1 time: 0.230590 Oct 04 18:46:34.139362 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3337/6662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:33 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1682 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:35.332556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-af88045c-7315-42d4-b793-a84deecb7baf req-af486276-6331-4798-8f14-b5c05e1c44ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989c7dd0-05ac-41e2-8f85-7ce1890877d4", "name": "network-vif-plugged", "status": "completed", "tag": "b2d6b81a-6219-4d9e-a9c1-696f67a1afbc"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:35.364608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af88045c-7315-42d4-b793-a84deecb7baf req-af486276-6331-4798-8f14-b5c05e1c44ca service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.365099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af88045c-7315-42d4-b793-a84deecb7baf req-af486276-6331-4798-8f14-b5c05e1c44ca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.365539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-af88045c-7315-42d4-b793-a84deecb7baf req-af486276-6331-4798-8f14-b5c05e1c44ca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.412240 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-af88045c-7315-42d4-b793-a84deecb7baf req-af486276-6331-4798-8f14-b5c05e1c44ca service nova] Creating event network-vif-plugged:b2d6b81a-6219-4d9e-a9c1-696f67a1afbc for instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 on n-h1-850499-14 Oct 04 18:46:35.424748 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-af88045c-7315-42d4-b793-a84deecb7baf req-af486276-6331-4798-8f14-b5c05e1c44ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101834 Oct 04 18:46:35.426696 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3326/6663] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:38.341792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1514931067", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f64ea217-e4f7-4546-9807-44c8d1dfee0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7231cfd-11da-40a4-8d73-d5073342969a"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:38.424064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] validate_networks() for [('d7231cfd-11da-40a4-8d73-d5073342969a', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:39.083939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:39.084400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:39.084837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:39.085450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:39.086056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:39.099425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.100808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.101469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.102365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.103318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.103693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.123297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:39.130884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for user 594483c9afdc4f69a6d02f10e8fde137 and project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:39.208567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:39.210732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f64ea217-e4f7-4546-9807-44c8d1dfee0c',volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:39.380285 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ed8e7a36-b97e-400c-90b5-73c7eda0e0c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045345 Oct 04 18:46:39.381335 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3338/6664] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:39.395730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d3a9ba2b-c850-47db-a99a-20479df7acb3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.396441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d3a9ba2b-c850-47db-a99a-20479df7acb3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:39.470145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d3a9ba2b-c850-47db-a99a-20479df7acb3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:39.483309 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d3a9ba2b-c850-47db-a99a-20479df7acb3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1057 microversion: 2.1 time: 0.092623 Oct 04 18:46:39.484345 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3327/6665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1057 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:40.512835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f34e35d6-d6c4-4e33-b087-808a08051ad4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.513797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f34e35d6-d6c4-4e33-b087-808a08051ad4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.523658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f34e35d6-d6c4-4e33-b087-808a08051ad4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.524473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f34e35d6-d6c4-4e33-b087-808a08051ad4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.525132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f34e35d6-d6c4-4e33-b087-808a08051ad4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.525998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f34e35d6-d6c4-4e33-b087-808a08051ad4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.526491 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f34e35d6-d6c4-4e33-b087-808a08051ad4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.527012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f34e35d6-d6c4-4e33-b087-808a08051ad4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.610546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f34e35d6-d6c4-4e33-b087-808a08051ad4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.619774 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f34e35d6-d6c4-4e33-b087-808a08051ad4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1155 microversion: 2.1 time: 0.111637 Oct 04 18:46:40.620688 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3339/6666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1155 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:41.649897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1fc5fc16-70be-4401-80fe-0013e4b47d49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.651883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1fc5fc16-70be-4401-80fe-0013e4b47d49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:41.661098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc5fc16-70be-4401-80fe-0013e4b47d49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.662236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc5fc16-70be-4401-80fe-0013e4b47d49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.663174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc5fc16-70be-4401-80fe-0013e4b47d49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.664893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc5fc16-70be-4401-80fe-0013e4b47d49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.665485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc5fc16-70be-4401-80fe-0013e4b47d49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.666035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fc5fc16-70be-4401-80fe-0013e4b47d49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.907316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1fc5fc16-70be-4401-80fe-0013e4b47d49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.924810 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1fc5fc16-70be-4401-80fe-0013e4b47d49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1215 microversion: 2.1 time: 0.281825 Oct 04 18:46:41.926065 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3328/6667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:41 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:42.951587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce6b3b4b-de6b-44d6-ad59-17e4d3392efa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.953013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ce6b3b4b-de6b-44d6-ad59-17e4d3392efa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.963124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-81048dfd-2f5f-4aed-8fe6-68c7b3afea76 req-d9ad9f62-5b64-4c85-a84f-6d3ed73aa3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd4b0374-fb6a-4646-a44c-640c0e7db4ba", "tag": "3f23b6fe-3830-4cdc-b652-9debeef79a17"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:42.965961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce6b3b4b-de6b-44d6-ad59-17e4d3392efa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.966811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce6b3b4b-de6b-44d6-ad59-17e4d3392efa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.967366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce6b3b4b-de6b-44d6-ad59-17e4d3392efa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.985419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce6b3b4b-de6b-44d6-ad59-17e4d3392efa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.987031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-81048dfd-2f5f-4aed-8fe6-68c7b3afea76 req-d9ad9f62-5b64-4c85-a84f-6d3ed73aa3c5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.987786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-81048dfd-2f5f-4aed-8fe6-68c7b3afea76 req-d9ad9f62-5b64-4c85-a84f-6d3ed73aa3c5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.988412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-81048dfd-2f5f-4aed-8fe6-68c7b3afea76 req-d9ad9f62-5b64-4c85-a84f-6d3ed73aa3c5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.989975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce6b3b4b-de6b-44d6-ad59-17e4d3392efa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.992097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce6b3b4b-de6b-44d6-ad59-17e4d3392efa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.009243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-81048dfd-2f5f-4aed-8fe6-68c7b3afea76 req-d9ad9f62-5b64-4c85-a84f-6d3ed73aa3c5 service nova] Creating event network-changed:3f23b6fe-3830-4cdc-b652-9debeef79a17 for instance bd4b0374-fb6a-4646-a44c-640c0e7db4ba on n-h2-850499-14 Oct 04 18:46:43.032934 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-81048dfd-2f5f-4aed-8fe6-68c7b3afea76 req-d9ad9f62-5b64-4c85-a84f-6d3ed73aa3c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074279 Oct 04 18:46:43.034421 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3329/6668] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:43.209950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ce6b3b4b-de6b-44d6-ad59-17e4d3392efa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.228087 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ce6b3b4b-de6b-44d6-ad59-17e4d3392efa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1215 microversion: 2.1 time: 0.280831 Oct 04 18:46:43.229565 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3340/6669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1215 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:44.258684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-72b0513c-5386-4285-9072-0533330ed2d5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:44.259527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-72b0513c-5386-4285-9072-0533330ed2d5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.273519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72b0513c-5386-4285-9072-0533330ed2d5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.274334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72b0513c-5386-4285-9072-0533330ed2d5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.275020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72b0513c-5386-4285-9072-0533330ed2d5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.275957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72b0513c-5386-4285-9072-0533330ed2d5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.276610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72b0513c-5386-4285-9072-0533330ed2d5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.277219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72b0513c-5386-4285-9072-0533330ed2d5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.487180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-72b0513c-5386-4285-9072-0533330ed2d5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.497333 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-72b0513c-5386-4285-9072-0533330ed2d5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1215 microversion: 2.1 time: 0.243963 Oct 04 18:46:44.503106 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3330/6670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:44 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:45.532378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e38fd39e-4bf3-495c-8aa7-77c14e0208af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:45.533524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e38fd39e-4bf3-495c-8aa7-77c14e0208af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.544967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e38fd39e-4bf3-495c-8aa7-77c14e0208af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.546158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e38fd39e-4bf3-495c-8aa7-77c14e0208af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.547187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e38fd39e-4bf3-495c-8aa7-77c14e0208af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.548719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e38fd39e-4bf3-495c-8aa7-77c14e0208af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.549805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e38fd39e-4bf3-495c-8aa7-77c14e0208af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.550801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e38fd39e-4bf3-495c-8aa7-77c14e0208af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.745150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e38fd39e-4bf3-495c-8aa7-77c14e0208af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.754592 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e38fd39e-4bf3-495c-8aa7-77c14e0208af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1215 microversion: 2.1 time: 0.230095 Oct 04 18:46:45.755514 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3341/6671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:45 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:46.786058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-60b568b6-10fc-4a45-b203-4952cde21ed3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:46.788457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-60b568b6-10fc-4a45-b203-4952cde21ed3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.798210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b568b6-10fc-4a45-b203-4952cde21ed3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.799121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b568b6-10fc-4a45-b203-4952cde21ed3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.799767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b568b6-10fc-4a45-b203-4952cde21ed3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.800639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b568b6-10fc-4a45-b203-4952cde21ed3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.801002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b568b6-10fc-4a45-b203-4952cde21ed3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.801448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-60b568b6-10fc-4a45-b203-4952cde21ed3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.028079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-60b568b6-10fc-4a45-b203-4952cde21ed3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:47.039006 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-60b568b6-10fc-4a45-b203-4952cde21ed3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1215 microversion: 2.1 time: 0.256799 Oct 04 18:46:47.039548 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3331/6672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:46 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1215 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:48.064475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-81f32bc4-5dcf-41b0-a08c-e66cfd336d41 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:48.065096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-81f32bc4-5dcf-41b0-a08c-e66cfd336d41 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:48.074410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81f32bc4-5dcf-41b0-a08c-e66cfd336d41 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.074410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81f32bc4-5dcf-41b0-a08c-e66cfd336d41 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.074780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81f32bc4-5dcf-41b0-a08c-e66cfd336d41 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.075320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81f32bc4-5dcf-41b0-a08c-e66cfd336d41 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.075804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81f32bc4-5dcf-41b0-a08c-e66cfd336d41 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.076238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81f32bc4-5dcf-41b0-a08c-e66cfd336d41 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.239251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-81f32bc4-5dcf-41b0-a08c-e66cfd336d41 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.248399 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-81f32bc4-5dcf-41b0-a08c-e66cfd336d41 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1203 microversion: 2.1 time: 0.187796 Oct 04 18:46:48.249228 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3342/6673] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:48 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1203 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:49.273754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df2db2a3-277a-49b3-b038-1f901f27daf6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.274459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df2db2a3-277a-49b3-b038-1f901f27daf6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.281409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df2db2a3-277a-49b3-b038-1f901f27daf6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.281974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df2db2a3-277a-49b3-b038-1f901f27daf6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.282542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df2db2a3-277a-49b3-b038-1f901f27daf6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.283660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df2db2a3-277a-49b3-b038-1f901f27daf6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.284132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df2db2a3-277a-49b3-b038-1f901f27daf6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.284853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df2db2a3-277a-49b3-b038-1f901f27daf6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.448840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df2db2a3-277a-49b3-b038-1f901f27daf6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:49.457286 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df2db2a3-277a-49b3-b038-1f901f27daf6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1203 microversion: 2.1 time: 0.188502 Oct 04 18:46:49.457875 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3332/6674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:49 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:50.485253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-95260e47-01eb-4538-9cb0-04195532c522 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.486372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-95260e47-01eb-4538-9cb0-04195532c522 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.491539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:50.492714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:50.502374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95260e47-01eb-4538-9cb0-04195532c522 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.503188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95260e47-01eb-4538-9cb0-04195532c522 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.503950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95260e47-01eb-4538-9cb0-04195532c522 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.505077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95260e47-01eb-4538-9cb0-04195532c522 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.505813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95260e47-01eb-4538-9cb0-04195532c522 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.506496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95260e47-01eb-4538-9cb0-04195532c522 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.719864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95260e47-01eb-4538-9cb0-04195532c522 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.735294 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-95260e47-01eb-4538-9cb0-04195532c522 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1203 microversion: 2.1 time: 0.256660 Oct 04 18:46:50.736041 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3343/6675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1203 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:51.764548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98cb2d1d-8446-47f7-aa8d-19f7a72f0530 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:51.765026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-98cb2d1d-8446-47f7-aa8d-19f7a72f0530 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:51.767138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:51.774461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98cb2d1d-8446-47f7-aa8d-19f7a72f0530 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.774991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98cb2d1d-8446-47f7-aa8d-19f7a72f0530 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.775535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98cb2d1d-8446-47f7-aa8d-19f7a72f0530 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.776298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98cb2d1d-8446-47f7-aa8d-19f7a72f0530 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.776768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98cb2d1d-8446-47f7-aa8d-19f7a72f0530 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.777236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98cb2d1d-8446-47f7-aa8d-19f7a72f0530 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.988969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-98cb2d1d-8446-47f7-aa8d-19f7a72f0530 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:51.998172 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-98cb2d1d-8446-47f7-aa8d-19f7a72f0530 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1203 microversion: 2.1 time: 0.238278 Oct 04 18:46:51.999073 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3333/6676] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:51 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1203 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:53.023492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a732bd6a-408a-4a5b-9de4-4739fb9810f3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:53.024376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a732bd6a-408a-4a5b-9de4-4739fb9810f3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:53.033990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a732bd6a-408a-4a5b-9de4-4739fb9810f3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.034658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a732bd6a-408a-4a5b-9de4-4739fb9810f3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.035336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a732bd6a-408a-4a5b-9de4-4739fb9810f3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.036225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a732bd6a-408a-4a5b-9de4-4739fb9810f3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.036820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a732bd6a-408a-4a5b-9de4-4739fb9810f3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.037369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a732bd6a-408a-4a5b-9de4-4739fb9810f3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.213551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a732bd6a-408a-4a5b-9de4-4739fb9810f3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:53.223470 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a732bd6a-408a-4a5b-9de4-4739fb9810f3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1203 microversion: 2.1 time: 0.205322 Oct 04 18:46:53.224742 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3344/6677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:53 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1203 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:54.251581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3f20fe78-aad3-42e4-bf67-84475304060b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:54.253493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3f20fe78-aad3-42e4-bf67-84475304060b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:54.264631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f20fe78-aad3-42e4-bf67-84475304060b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.265669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f20fe78-aad3-42e4-bf67-84475304060b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.266531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f20fe78-aad3-42e4-bf67-84475304060b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.268159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f20fe78-aad3-42e4-bf67-84475304060b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.268980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f20fe78-aad3-42e4-bf67-84475304060b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.269745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3f20fe78-aad3-42e4-bf67-84475304060b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.278280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=79 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:54.514273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3f20fe78-aad3-42e4-bf67-84475304060b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:54.530040 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3f20fe78-aad3-42e4-bf67-84475304060b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1203 microversion: 2.1 time: 0.283689 Oct 04 18:46:54.530750 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3334/6678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:54 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1203 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:55.562169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3e7ef36f-d71f-4369-982f-2ac2d01f5e70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:55.562810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3e7ef36f-d71f-4369-982f-2ac2d01f5e70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:55.571574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e7ef36f-d71f-4369-982f-2ac2d01f5e70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.572726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e7ef36f-d71f-4369-982f-2ac2d01f5e70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.573463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e7ef36f-d71f-4369-982f-2ac2d01f5e70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.574576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e7ef36f-d71f-4369-982f-2ac2d01f5e70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.575311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e7ef36f-d71f-4369-982f-2ac2d01f5e70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.576114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3e7ef36f-d71f-4369-982f-2ac2d01f5e70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.579854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=83 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:55.787346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3e7ef36f-d71f-4369-982f-2ac2d01f5e70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:55.798018 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3e7ef36f-d71f-4369-982f-2ac2d01f5e70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1203 microversion: 2.1 time: 0.239724 Oct 04 18:46:55.798644 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3345/6679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:55 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1203 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:56.822312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dafa89b7-d391-4982-9eac-efe3f07446c8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:56.823065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dafa89b7-d391-4982-9eac-efe3f07446c8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:56.830868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dafa89b7-d391-4982-9eac-efe3f07446c8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.831413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dafa89b7-d391-4982-9eac-efe3f07446c8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.831859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dafa89b7-d391-4982-9eac-efe3f07446c8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.832577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dafa89b7-d391-4982-9eac-efe3f07446c8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.833045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dafa89b7-d391-4982-9eac-efe3f07446c8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.833472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dafa89b7-d391-4982-9eac-efe3f07446c8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.994392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dafa89b7-d391-4982-9eac-efe3f07446c8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:57.009244 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dafa89b7-d391-4982-9eac-efe3f07446c8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1203 microversion: 2.1 time: 0.190741 Oct 04 18:46:57.012196 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3335/6680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:56 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1203 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:58.049258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f7d114e7-7840-4d85-ad5c-050ed71562a9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:58.049884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f7d114e7-7840-4d85-ad5c-050ed71562a9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:58.056861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7d114e7-7840-4d85-ad5c-050ed71562a9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.057296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7d114e7-7840-4d85-ad5c-050ed71562a9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.057746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7d114e7-7840-4d85-ad5c-050ed71562a9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.058458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7d114e7-7840-4d85-ad5c-050ed71562a9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.058926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7d114e7-7840-4d85-ad5c-050ed71562a9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.059384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7d114e7-7840-4d85-ad5c-050ed71562a9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.752844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f7d114e7-7840-4d85-ad5c-050ed71562a9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:58.765078 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f7d114e7-7840-4d85-ad5c-050ed71562a9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1203 microversion: 2.1 time: 0.719446 Oct 04 18:46:58.766105 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3346/6681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:58 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1203 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:59.164898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4d688b65-ee71-4754-a518-7db7f8171c6d req-fc67c096-1270-4864-bc37-dc4d90e0e083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd4b0374-fb6a-4646-a44c-640c0e7db4ba", "name": "network-vif-plugged", "status": "completed", "tag": "3f23b6fe-3830-4cdc-b652-9debeef79a17"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:59.177179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=30 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:59.185894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4d688b65-ee71-4754-a518-7db7f8171c6d req-fc67c096-1270-4864-bc37-dc4d90e0e083 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.186738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4d688b65-ee71-4754-a518-7db7f8171c6d req-fc67c096-1270-4864-bc37-dc4d90e0e083 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.187535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4d688b65-ee71-4754-a518-7db7f8171c6d req-fc67c096-1270-4864-bc37-dc4d90e0e083 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.214190 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4d688b65-ee71-4754-a518-7db7f8171c6d req-fc67c096-1270-4864-bc37-dc4d90e0e083 service nova] Creating event network-vif-plugged:3f23b6fe-3830-4cdc-b652-9debeef79a17 for instance bd4b0374-fb6a-4646-a44c-640c0e7db4ba on n-h2-850499-14 Oct 04 18:46:59.222796 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4d688b65-ee71-4754-a518-7db7f8171c6d req-fc67c096-1270-4864-bc37-dc4d90e0e083 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064628 Oct 04 18:46:59.223900 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3336/6682] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:59.799568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ea16b9f8-b4cf-4ae3-8d1c-c92c13682bc8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:59.800780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ea16b9f8-b4cf-4ae3-8d1c-c92c13682bc8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:59.815347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16b9f8-b4cf-4ae3-8d1c-c92c13682bc8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.816573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16b9f8-b4cf-4ae3-8d1c-c92c13682bc8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.817457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16b9f8-b4cf-4ae3-8d1c-c92c13682bc8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.818932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16b9f8-b4cf-4ae3-8d1c-c92c13682bc8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.829978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16b9f8-b4cf-4ae3-8d1c-c92c13682bc8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.830906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ea16b9f8-b4cf-4ae3-8d1c-c92c13682bc8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.115822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ea16b9f8-b4cf-4ae3-8d1c-c92c13682bc8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:00.132438 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ea16b9f8-b4cf-4ae3-8d1c-c92c13682bc8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1203 microversion: 2.1 time: 0.339849 Oct 04 18:47:00.148002 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3347/6683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:59 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1203 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:00.431118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-18238c8d-c4d4-41de-ab37-b906f0e97ffc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:00.434585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-18238c8d-c4d4-41de-ab37-b906f0e97ffc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:00.452164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18238c8d-c4d4-41de-ab37-b906f0e97ffc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.452870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18238c8d-c4d4-41de-ab37-b906f0e97ffc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.454075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18238c8d-c4d4-41de-ab37-b906f0e97ffc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.455359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18238c8d-c4d4-41de-ab37-b906f0e97ffc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.456054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18238c8d-c4d4-41de-ab37-b906f0e97ffc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.457157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18238c8d-c4d4-41de-ab37-b906f0e97ffc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.521304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-18238c8d-c4d4-41de-ab37-b906f0e97ffc tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "POST /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4/action" status: 200 len: 24563 microversion: 2.1 time: 0.096397 Oct 04 18:47:00.523117 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3337/6684] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:00 2022] POST /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4/action => generated 24563 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:47:01.182944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-525c5fe8-7d6b-4562-a1f1-61261502900f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.185566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-525c5fe8-7d6b-4562-a1f1-61261502900f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.203407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:01.209136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525c5fe8-7d6b-4562-a1f1-61261502900f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.212274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525c5fe8-7d6b-4562-a1f1-61261502900f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.214013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525c5fe8-7d6b-4562-a1f1-61261502900f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.215924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525c5fe8-7d6b-4562-a1f1-61261502900f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.222832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525c5fe8-7d6b-4562-a1f1-61261502900f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.224458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-525c5fe8-7d6b-4562-a1f1-61261502900f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.484072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-525c5fe8-7d6b-4562-a1f1-61261502900f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.495284 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-525c5fe8-7d6b-4562-a1f1-61261502900f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1391 microversion: 2.1 time: 0.326421 Oct 04 18:47:01.496238 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3348/6685] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1391 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:01.528911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1fb4c342-865d-4f6c-85b8-024e9e024d03 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.530314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1fb4c342-865d-4f6c-85b8-024e9e024d03 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.541268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4c342-865d-4f6c-85b8-024e9e024d03 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.542086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4c342-865d-4f6c-85b8-024e9e024d03 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.542723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4c342-865d-4f6c-85b8-024e9e024d03 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.543674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4c342-865d-4f6c-85b8-024e9e024d03 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.544308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4c342-865d-4f6c-85b8-024e9e024d03 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.544925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1fb4c342-865d-4f6c-85b8-024e9e024d03 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.956120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1fb4c342-865d-4f6c-85b8-024e9e024d03 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.976350 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1fb4c342-865d-4f6c-85b8-024e9e024d03 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1391 microversion: 2.1 time: 0.455410 Oct 04 18:47:01.977586 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3338/6686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1391 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:02.023599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-82a544fd-ecf7-4dde-ab6b-69edee7b502b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:02.024556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-82a544fd-ecf7-4dde-ab6b-69edee7b502b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.031518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82a544fd-ecf7-4dde-ab6b-69edee7b502b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.032335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82a544fd-ecf7-4dde-ab6b-69edee7b502b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.032976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82a544fd-ecf7-4dde-ab6b-69edee7b502b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.034279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82a544fd-ecf7-4dde-ab6b-69edee7b502b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.035585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82a544fd-ecf7-4dde-ab6b-69edee7b502b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.036262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82a544fd-ecf7-4dde-ab6b-69edee7b502b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.472478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-82a544fd-ecf7-4dde-ab6b-69edee7b502b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:02.490556 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-82a544fd-ecf7-4dde-ab6b-69edee7b502b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1391 microversion: 2.1 time: 0.471291 Oct 04 18:47:02.491252 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3349/6687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:02 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1391 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:02.531658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a7e55e37-b529-46f0-ac9f-1a8d48ef6967 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:02.533462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a7e55e37-b529-46f0-ac9f-1a8d48ef6967 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.548691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e55e37-b529-46f0-ac9f-1a8d48ef6967 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.549991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e55e37-b529-46f0-ac9f-1a8d48ef6967 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.551079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e55e37-b529-46f0-ac9f-1a8d48ef6967 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.555072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e55e37-b529-46f0-ac9f-1a8d48ef6967 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.556212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e55e37-b529-46f0-ac9f-1a8d48ef6967 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.557514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a7e55e37-b529-46f0-ac9f-1a8d48ef6967 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.604876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a7e55e37-b529-46f0-ac9f-1a8d48ef6967 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:02.739002 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a7e55e37-b529-46f0-ac9f-1a8d48ef6967 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 204 len: 0 microversion: 2.1 time: 0.220560 Oct 04 18:47:02.739613 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3339/6688] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:02 2022] DELETE /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:02.749735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05769110-c8de-4e86-a713-66b15c20597d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:02.750369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-05769110-c8de-4e86-a713-66b15c20597d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.757099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05769110-c8de-4e86-a713-66b15c20597d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.757606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05769110-c8de-4e86-a713-66b15c20597d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.758050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05769110-c8de-4e86-a713-66b15c20597d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.758768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05769110-c8de-4e86-a713-66b15c20597d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.759269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05769110-c8de-4e86-a713-66b15c20597d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.759708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05769110-c8de-4e86-a713-66b15c20597d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.022667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-05769110-c8de-4e86-a713-66b15c20597d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:03.033422 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-05769110-c8de-4e86-a713-66b15c20597d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1397 microversion: 2.1 time: 0.288250 Oct 04 18:47:03.043979 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3350/6689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:02 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1397 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:04.063997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dba57173-65e1-4d29-8c62-865cadd95683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:04.065236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dba57173-65e1-4d29-8c62-865cadd95683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:04.079138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dba57173-65e1-4d29-8c62-865cadd95683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.080373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dba57173-65e1-4d29-8c62-865cadd95683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.082108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dba57173-65e1-4d29-8c62-865cadd95683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.083725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dba57173-65e1-4d29-8c62-865cadd95683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.085384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dba57173-65e1-4d29-8c62-865cadd95683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.086465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dba57173-65e1-4d29-8c62-865cadd95683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.910602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9d48cdb-0a02-49f4-a112-b41f8bb21181 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Action: 'create', calling method: .version_select at 0x7fd4d0a70040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1267662590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOevqT9Cae8fQp6ydRzxqVwIQvOq2jNE9CCIanC6UKnAYd2ls237cwcKtEJjOtvrmITVcu7ieoBEQmHfpnV38eXMOXbkJVNqGI0r+hCv0p69r5XcBOW+k89NQoqudOtTGQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:04.930678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dba57173-65e1-4d29-8c62-865cadd95683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:04.940630 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dba57173-65e1-4d29-8c62-865cadd95683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1397 microversion: 2.1 time: 0.885693 Oct 04 18:47:04.942051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b9d48cdb-0a02-49f4-a112-b41f8bb21181 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for project 3401093d6669442a95295abfeb2bdbb1. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:04.951426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b9d48cdb-0a02-49f4-a112-b41f8bb21181 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for user b87951bf1b5c400197e7346e8bf66e1e and project 3401093d6669442a95295abfeb2bdbb1. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:04.954012 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3340/6690] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:04 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1397 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:04.993360 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9d48cdb-0a02-49f4-a112-b41f8bb21181 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.089877 Oct 04 18:47:05.000216 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3351/6691] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:47:04 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:05.584256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ffd7c7cf-a3d8-4177-8482-0c31674af052 req-e05cf6f5-d5e5-4545-92c7-488a49e85c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd4b0374-fb6a-4646-a44c-640c0e7db4ba", "name": "network-vif-deleted", "tag": "3f23b6fe-3830-4cdc-b652-9debeef79a17"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:05.604908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ffd7c7cf-a3d8-4177-8482-0c31674af052 req-e05cf6f5-d5e5-4545-92c7-488a49e85c33 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.605845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ffd7c7cf-a3d8-4177-8482-0c31674af052 req-e05cf6f5-d5e5-4545-92c7-488a49e85c33 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.606520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ffd7c7cf-a3d8-4177-8482-0c31674af052 req-e05cf6f5-d5e5-4545-92c7-488a49e85c33 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.625231 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ffd7c7cf-a3d8-4177-8482-0c31674af052 req-e05cf6f5-d5e5-4545-92c7-488a49e85c33 service nova] Creating event network-vif-deleted:3f23b6fe-3830-4cdc-b652-9debeef79a17 for instance bd4b0374-fb6a-4646-a44c-640c0e7db4ba on n-h2-850499-14 Oct 04 18:47:05.633131 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ffd7c7cf-a3d8-4177-8482-0c31674af052 req-e05cf6f5-d5e5-4545-92c7-488a49e85c33 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053027 Oct 04 18:47:05.639174 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3341/6692] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:05.967111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06021e27-c446-4eac-8f26-e5271a9e509a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:05.967748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-06021e27-c446-4eac-8f26-e5271a9e509a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:05.978377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06021e27-c446-4eac-8f26-e5271a9e509a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.979524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06021e27-c446-4eac-8f26-e5271a9e509a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.980095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06021e27-c446-4eac-8f26-e5271a9e509a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.981517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06021e27-c446-4eac-8f26-e5271a9e509a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.982757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06021e27-c446-4eac-8f26-e5271a9e509a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.984218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06021e27-c446-4eac-8f26-e5271a9e509a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.065862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-06021e27-c446-4eac-8f26-e5271a9e509a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:06.087170 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-06021e27-c446-4eac-8f26-e5271a9e509a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1188 microversion: 2.1 time: 0.124971 Oct 04 18:47:06.088610 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3352/6693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:05 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1188 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:06.587039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-673946502", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "5df3ba9c-0f06-4a3a-8661-675ab732db7c"}], "key_name": "tempest-TestNetworkBasicOps-1267662590", "security_groups": [{"name": "tempest-secgroup-smoke-259388664"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:06.743710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] validate_networks() for [('5df3ba9c-0f06-4a3a-8661-675ab732db7c', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:47:07.115420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-82769088-228d-4d81-9781-5f43b29edfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:07.115990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-82769088-228d-4d81-9781-5f43b29edfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:07.125651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82769088-228d-4d81-9781-5f43b29edfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.126151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82769088-228d-4d81-9781-5f43b29edfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.126825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82769088-228d-4d81-9781-5f43b29edfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.127773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82769088-228d-4d81-9781-5f43b29edfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.128239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82769088-228d-4d81-9781-5f43b29edfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.128659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-82769088-228d-4d81-9781-5f43b29edfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.252450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-82769088-228d-4d81-9781-5f43b29edfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.271187 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-82769088-228d-4d81-9781-5f43b29edfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1188 microversion: 2.1 time: 0.163620 Oct 04 18:47:07.273531 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3353/6694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:07 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1188 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:07.316993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:07.318287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:07.319923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:07.320576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:07.321560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:07.338360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.338884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.339362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.340128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.340600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.341043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.362276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for project 3401093d6669442a95295abfeb2bdbb1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:07.368860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for user b87951bf1b5c400197e7346e8bf66e1e and project 3401093d6669442a95295abfeb2bdbb1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:07.385342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:47:07.387890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:47:07.466750 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-121e4801-dff7-4a96-afda-d7e8a5f395b2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.884495 Oct 04 18:47:07.468189 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3342/6695] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:47:07.484786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-03ce4186-7343-4fb4-b2ba-eb1b897e38ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:07.485859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-03ce4186-7343-4fb4-b2ba-eb1b897e38ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:07.566140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-03ce4186-7343-4fb4-b2ba-eb1b897e38ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.569594 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-03ce4186-7343-4fb4-b2ba-eb1b897e38ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1248 microversion: 2.1 time: 0.090944 Oct 04 18:47:07.570383 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3354/6696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:07 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1248 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:08.302801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fe037542-1d57-433f-b9c0-c6b97cd444f7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:08.305193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fe037542-1d57-433f-b9c0-c6b97cd444f7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.316280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe037542-1d57-433f-b9c0-c6b97cd444f7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.317113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe037542-1d57-433f-b9c0-c6b97cd444f7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.318248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe037542-1d57-433f-b9c0-c6b97cd444f7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.319893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe037542-1d57-433f-b9c0-c6b97cd444f7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.320925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe037542-1d57-433f-b9c0-c6b97cd444f7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.321981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe037542-1d57-433f-b9c0-c6b97cd444f7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.405959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fe037542-1d57-433f-b9c0-c6b97cd444f7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:08.418786 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fe037542-1d57-433f-b9c0-c6b97cd444f7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1188 microversion: 2.1 time: 0.120816 Oct 04 18:47:08.419454 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3343/6697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:08 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1188 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:08.601810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7b62b68f-964a-4dae-ab47-dc8df4b3c254 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:08.603030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7b62b68f-964a-4dae-ab47-dc8df4b3c254 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.613504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b62b68f-964a-4dae-ab47-dc8df4b3c254 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.615018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b62b68f-964a-4dae-ab47-dc8df4b3c254 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.615843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b62b68f-964a-4dae-ab47-dc8df4b3c254 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.620065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b62b68f-964a-4dae-ab47-dc8df4b3c254 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.620824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b62b68f-964a-4dae-ab47-dc8df4b3c254 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.621461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7b62b68f-964a-4dae-ab47-dc8df4b3c254 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.713139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7b62b68f-964a-4dae-ab47-dc8df4b3c254 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:08.723383 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7b62b68f-964a-4dae-ab47-dc8df4b3c254 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1300 microversion: 2.1 time: 0.127355 Oct 04 18:47:08.723987 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3355/6698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:08 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:09.449221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c9873f48-f764-485b-8df6-b2120ae34ca0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.454723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c9873f48-f764-485b-8df6-b2120ae34ca0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.465099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9873f48-f764-485b-8df6-b2120ae34ca0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.466451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9873f48-f764-485b-8df6-b2120ae34ca0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.467357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9873f48-f764-485b-8df6-b2120ae34ca0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.468719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9873f48-f764-485b-8df6-b2120ae34ca0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.469200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9873f48-f764-485b-8df6-b2120ae34ca0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.469714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9873f48-f764-485b-8df6-b2120ae34ca0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.554274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c9873f48-f764-485b-8df6-b2120ae34ca0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.564527 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c9873f48-f764-485b-8df6-b2120ae34ca0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1188 microversion: 2.1 time: 0.124936 Oct 04 18:47:09.567033 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3344/6699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1188 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:09.749077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-72c459fc-09d6-4218-8975-39fe3d14916f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.749876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-72c459fc-09d6-4218-8975-39fe3d14916f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.757490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72c459fc-09d6-4218-8975-39fe3d14916f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.757994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72c459fc-09d6-4218-8975-39fe3d14916f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.758468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72c459fc-09d6-4218-8975-39fe3d14916f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.759362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72c459fc-09d6-4218-8975-39fe3d14916f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.759841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72c459fc-09d6-4218-8975-39fe3d14916f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.760283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72c459fc-09d6-4218-8975-39fe3d14916f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.855677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-72c459fc-09d6-4218-8975-39fe3d14916f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.868452 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-72c459fc-09d6-4218-8975-39fe3d14916f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1306 microversion: 2.1 time: 0.123858 Oct 04 18:47:09.869420 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3356/6700] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1306 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:10.596692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.597819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.610798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.611738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.612545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.613806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.614588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.615329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.658174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.658863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.659670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.660338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lazy-loading 'fault' on Instance uuid bd4b0374-fb6a-4646-a44c-640c0e7db4ba {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:47:10.709186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.718582 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a3930b24-2691-46bd-b31d-9f47b34f92d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 200 len: 1193 microversion: 2.1 time: 0.128324 Oct 04 18:47:10.719475 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3345/6701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 1193 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:10.894939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f617454d-383c-4125-ac30-3b2ddd402bb6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.895697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f617454d-383c-4125-ac30-3b2ddd402bb6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.904185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f617454d-383c-4125-ac30-3b2ddd402bb6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.904689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f617454d-383c-4125-ac30-3b2ddd402bb6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.905128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f617454d-383c-4125-ac30-3b2ddd402bb6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.905845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f617454d-383c-4125-ac30-3b2ddd402bb6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.906312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f617454d-383c-4125-ac30-3b2ddd402bb6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.906741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f617454d-383c-4125-ac30-3b2ddd402bb6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.974870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-53462123-868b-4ada-959d-ae8bcc118d35 req-e73743d4-ee2f-45eb-b723-3d3fc124c681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32be5a67-1463-4840-aad0-06dbae4abce2", "tag": "99c28972-ff02-4216-9883-efa7139ee035"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:10.987136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-53462123-868b-4ada-959d-ae8bcc118d35 req-e73743d4-ee2f-45eb-b723-3d3fc124c681 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.988910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-53462123-868b-4ada-959d-ae8bcc118d35 req-e73743d4-ee2f-45eb-b723-3d3fc124c681 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.988910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-53462123-868b-4ada-959d-ae8bcc118d35 req-e73743d4-ee2f-45eb-b723-3d3fc124c681 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.002314 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-53462123-868b-4ada-959d-ae8bcc118d35 req-e73743d4-ee2f-45eb-b723-3d3fc124c681 service nova] Creating event network-changed:99c28972-ff02-4216-9883-efa7139ee035 for instance 32be5a67-1463-4840-aad0-06dbae4abce2 on n-h2-850499-14 Oct 04 18:47:11.008376 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-53462123-868b-4ada-959d-ae8bcc118d35 req-e73743d4-ee2f-45eb-b723-3d3fc124c681 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037593 Oct 04 18:47:11.009463 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3346/6702] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:47:11.090733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f617454d-383c-4125-ac30-3b2ddd402bb6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:11.098900 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f617454d-383c-4125-ac30-3b2ddd402bb6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1373 microversion: 2.1 time: 0.209667 Oct 04 18:47:11.099715 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3357/6703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1373 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:11.749004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:11.750442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: bd4b0374-fb6a-4646-a44c-640c0e7db4ba] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:11.761733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.762543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.763314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.764806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.765596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.766329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.791726 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance bd4b0374-fb6a-4646-a44c-640c0e7db4ba could not be found. Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba HTTP/1.1 Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance bd4b0374-fb6a-4646-a44c-640c0e7db4ba could not be found. Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'bd4b0374-fb6a-4646-a44c-640c0e7db4ba'} Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd4b0374-fb6a-4646-a44c-640c0e7db4ba could not be found. Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd4b0374-fb6a-4646-a44c-640c0e7db4ba could not be found. Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:11.795115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:47:11.803840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:11.803840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:11.803840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:11.803840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:11.803840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:11.803840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd4b0374-fb6a-4646-a44c-640c0e7db4ba could not be found. Oct 04 18:47:11.803840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:47:11.803840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance bd4b0374-fb6a-4646-a44c-640c0e7db4ba could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:11.803840 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c4736c67-d5ee-42e3-9071-855b254ac86f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba" status: 404 len: 111 microversion: 2.1 time: 0.055331 Oct 04 18:47:11.803840 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3347/6704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:11 2022] GET /compute/v2.1/servers/bd4b0374-fb6a-4646-a44c-640c0e7db4ba => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:47:12.123364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-15fbcac3-3fa1-4c51-8b43-60cadcb9f40b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.124887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-15fbcac3-3fa1-4c51-8b43-60cadcb9f40b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:12.133966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15fbcac3-3fa1-4c51-8b43-60cadcb9f40b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.134612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15fbcac3-3fa1-4c51-8b43-60cadcb9f40b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.135361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15fbcac3-3fa1-4c51-8b43-60cadcb9f40b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.136327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15fbcac3-3fa1-4c51-8b43-60cadcb9f40b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.136870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15fbcac3-3fa1-4c51-8b43-60cadcb9f40b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.137381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15fbcac3-3fa1-4c51-8b43-60cadcb9f40b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.416494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-15fbcac3-3fa1-4c51-8b43-60cadcb9f40b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:12.426478 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-15fbcac3-3fa1-4c51-8b43-60cadcb9f40b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1373 microversion: 2.1 time: 0.307346 Oct 04 18:47:12.439990 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3358/6705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:12 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1373 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:12.823724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db80f83d-718f-4953-9463-65d4c527cbc6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.830998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-db80f83d-718f-4953-9463-65d4c527cbc6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:12.839495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db80f83d-718f-4953-9463-65d4c527cbc6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.840323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db80f83d-718f-4953-9463-65d4c527cbc6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.840985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db80f83d-718f-4953-9463-65d4c527cbc6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.841924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db80f83d-718f-4953-9463-65d4c527cbc6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.842583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db80f83d-718f-4953-9463-65d4c527cbc6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.843240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db80f83d-718f-4953-9463-65d4c527cbc6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.900195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-db80f83d-718f-4953-9463-65d4c527cbc6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:13.078440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-8465dad2-348d-413f-b853-4030e4ef9b5f req-0dae3a55-b3d7-49ad-a902-26c1e2ee1edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989c7dd0-05ac-41e2-8f85-7ce1890877d4", "tag": "b2d6b81a-6219-4d9e-a9c1-696f67a1afbc"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:13.090135 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-db80f83d-718f-4953-9463-65d4c527cbc6 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "DELETE /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 204 len: 0 microversion: 2.1 time: 0.268620 Oct 04 18:47:13.095271 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3348/6706] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:12 2022] DELETE /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:13.102874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8465dad2-348d-413f-b853-4030e4ef9b5f req-0dae3a55-b3d7-49ad-a902-26c1e2ee1edb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.103519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8465dad2-348d-413f-b853-4030e4ef9b5f req-0dae3a55-b3d7-49ad-a902-26c1e2ee1edb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.104256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8465dad2-348d-413f-b853-4030e4ef9b5f req-0dae3a55-b3d7-49ad-a902-26c1e2ee1edb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.104587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5a410a51-2f5f-46fe-a444-970f2376681e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.105078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5a410a51-2f5f-46fe-a444-970f2376681e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.124501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a410a51-2f5f-46fe-a444-970f2376681e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.125053 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-8465dad2-348d-413f-b853-4030e4ef9b5f req-0dae3a55-b3d7-49ad-a902-26c1e2ee1edb service nova] Creating event network-changed:b2d6b81a-6219-4d9e-a9c1-696f67a1afbc for instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 on n-h1-850499-14 Oct 04 18:47:13.125956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a410a51-2f5f-46fe-a444-970f2376681e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.126777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a410a51-2f5f-46fe-a444-970f2376681e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.129338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a410a51-2f5f-46fe-a444-970f2376681e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.130581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a410a51-2f5f-46fe-a444-970f2376681e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.130841 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-8465dad2-348d-413f-b853-4030e4ef9b5f req-0dae3a55-b3d7-49ad-a902-26c1e2ee1edb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304660 Oct 04 18:47:13.132513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a410a51-2f5f-46fe-a444-970f2376681e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.135247 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3359/6707] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:13.334520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5a410a51-2f5f-46fe-a444-970f2376681e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:13.345443 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5a410a51-2f5f-46fe-a444-970f2376681e tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1688 microversion: 2.1 time: 0.245305 Oct 04 18:47:13.354848 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3349/6708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1688 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:13.463366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0bc96eea-a232-4c2b-9bce-3a82c8118eda tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.464939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0bc96eea-a232-4c2b-9bce-3a82c8118eda tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.474341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0bc96eea-a232-4c2b-9bce-3a82c8118eda tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.474943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0bc96eea-a232-4c2b-9bce-3a82c8118eda tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.475597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0bc96eea-a232-4c2b-9bce-3a82c8118eda tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.476426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0bc96eea-a232-4c2b-9bce-3a82c8118eda tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.477599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0bc96eea-a232-4c2b-9bce-3a82c8118eda tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.478052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0bc96eea-a232-4c2b-9bce-3a82c8118eda tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.665043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0bc96eea-a232-4c2b-9bce-3a82c8118eda tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:13.674477 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0bc96eea-a232-4c2b-9bce-3a82c8118eda tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1373 microversion: 2.1 time: 0.224811 Oct 04 18:47:13.675505 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3360/6709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:14.371539 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-50bd328d-1624-4e5d-8a58-cc9cffebd28b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:14.373043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-50bd328d-1624-4e5d-8a58-cc9cffebd28b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:14.384679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50bd328d-1624-4e5d-8a58-cc9cffebd28b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.385190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50bd328d-1624-4e5d-8a58-cc9cffebd28b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.386319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50bd328d-1624-4e5d-8a58-cc9cffebd28b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.386602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50bd328d-1624-4e5d-8a58-cc9cffebd28b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.387330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50bd328d-1624-4e5d-8a58-cc9cffebd28b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.387658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50bd328d-1624-4e5d-8a58-cc9cffebd28b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.567012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-50bd328d-1624-4e5d-8a58-cc9cffebd28b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:14.569532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:14.578066 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-50bd328d-1624-4e5d-8a58-cc9cffebd28b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1688 microversion: 2.1 time: 0.210432 Oct 04 18:47:14.578650 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3350/6710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:14 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:14.708935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b13f0806-740b-455e-8286-d5362e06df0b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:14.710285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b13f0806-740b-455e-8286-d5362e06df0b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:14.719044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b13f0806-740b-455e-8286-d5362e06df0b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.719609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b13f0806-740b-455e-8286-d5362e06df0b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.720303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b13f0806-740b-455e-8286-d5362e06df0b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.721091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b13f0806-740b-455e-8286-d5362e06df0b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.721622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b13f0806-740b-455e-8286-d5362e06df0b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.722280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b13f0806-740b-455e-8286-d5362e06df0b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.994286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b13f0806-740b-455e-8286-d5362e06df0b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:15.002632 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b13f0806-740b-455e-8286-d5362e06df0b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1373 microversion: 2.1 time: 0.298566 Oct 04 18:47:15.020183 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3361/6711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:14 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1373 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:15.394499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7ab162c6-ad2c-4f64-99c8-30c4d53c11d7 req-faeda903-05c7-4143-9be9-a023e92d5b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989c7dd0-05ac-41e2-8f85-7ce1890877d4", "name": "network-vif-deleted", "tag": "b2d6b81a-6219-4d9e-a9c1-696f67a1afbc"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:15.411376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ab162c6-ad2c-4f64-99c8-30c4d53c11d7 req-faeda903-05c7-4143-9be9-a023e92d5b30 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.411883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ab162c6-ad2c-4f64-99c8-30c4d53c11d7 req-faeda903-05c7-4143-9be9-a023e92d5b30 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.412418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ab162c6-ad2c-4f64-99c8-30c4d53c11d7 req-faeda903-05c7-4143-9be9-a023e92d5b30 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.431103 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7ab162c6-ad2c-4f64-99c8-30c4d53c11d7 req-faeda903-05c7-4143-9be9-a023e92d5b30 service nova] Creating event network-vif-deleted:b2d6b81a-6219-4d9e-a9c1-696f67a1afbc for instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 on n-h1-850499-14 Oct 04 18:47:15.448662 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7ab162c6-ad2c-4f64-99c8-30c4d53c11d7 req-faeda903-05c7-4143-9be9-a023e92d5b30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058464 Oct 04 18:47:15.449246 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3351/6712] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:15.614239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:15.614865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:15.624623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.625819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.627711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.628876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.630562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.632747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.676418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.677382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.678681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.679566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lazy-loading 'fault' on Instance uuid 989c7dd0-05ac-41e2-8f85-7ce1890877d4 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:47:15.744893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e519320e854ce480adcd9de2750bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebaa3ef67f42289fa824284a968c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:15.754297 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59ae493c-9946-4e71-a73c-51d5ccceffee tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 200 len: 1356 microversion: 2.1 time: 0.151960 Oct 04 18:47:15.755078 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3362/6713] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:15 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:16.027581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cfb89eb4-e544-477b-9d4e-7c0752b5e65f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.028476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cfb89eb4-e544-477b-9d4e-7c0752b5e65f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:16.036255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfb89eb4-e544-477b-9d4e-7c0752b5e65f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.036870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfb89eb4-e544-477b-9d4e-7c0752b5e65f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.037433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfb89eb4-e544-477b-9d4e-7c0752b5e65f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.038353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfb89eb4-e544-477b-9d4e-7c0752b5e65f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.039189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfb89eb4-e544-477b-9d4e-7c0752b5e65f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.039786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfb89eb4-e544-477b-9d4e-7c0752b5e65f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.198406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cfb89eb4-e544-477b-9d4e-7c0752b5e65f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.206262 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cfb89eb4-e544-477b-9d4e-7c0752b5e65f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1373 microversion: 2.1 time: 0.183011 Oct 04 18:47:16.206980 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3352/6714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:16.792329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.793251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] [instance: 989c7dd0-05ac-41e2-8f85-7ce1890877d4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:16.801600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.802355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.802888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.803675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.804145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.804580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.831635 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] HTTP exception thrown: Instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 could not be found. Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Request method failure captured: Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 HTTP/1.1 Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH0DNQomkqqv-Qu84uLjAqPo6HMqiT1ULGhUmMALAk5Z9X3SuEK_qKUFSYc4VFmbF3awEhHAZ23FKbO0jEHJgn1JglTbqPqA4tXbETY-Pt-M6BRs2GinOvBXhlz9OU805haxcHHt-xDGagC9rXsMJ5AUy9kigxeIRWw5j9S_HaRlp1g Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: bfebaa3ef67f42289fa824284a968c42 Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bfebaa3ef67f42289fa824284a968c42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bfebaa3ef67f42289fa824284a968c42"}]}] Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: bfebaa3ef67f42289fa824284a968c42 Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-145155639 Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestNetworkAdvancedServerOps-145155639-project Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 87e519320e854ce480adcd9de2750bfb Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestNetworkAdvancedServerOps-145155639-project Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 could not be found. Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '989c7dd0-05ac-41e2-8f85-7ce1890877d4'} Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 could not be found. Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 could not be found. Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:47:16.833809 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 could not be found. Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Returning 404 to user: Instance 989c7dd0-05ac-41e2-8f85-7ce1890877d4 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3643fe16-f405-40d2-9eb5-80c5dffd8d08 tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4" status: 404 len: 111 microversion: 2.1 time: 0.048169 Oct 04 18:47:16.841429 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3363/6715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/servers/989c7dd0-05ac-41e2-8f85-7ce1890877d4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:17.230562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6980f794-1d2e-4871-acff-9c2b330fd506 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.231470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6980f794-1d2e-4871-acff-9c2b330fd506 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:17.240245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6980f794-1d2e-4871-acff-9c2b330fd506 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.241383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6980f794-1d2e-4871-acff-9c2b330fd506 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.241831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6980f794-1d2e-4871-acff-9c2b330fd506 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.242563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6980f794-1d2e-4871-acff-9c2b330fd506 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.243087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6980f794-1d2e-4871-acff-9c2b330fd506 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.243775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6980f794-1d2e-4871-acff-9c2b330fd506 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.350887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:17.377823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:17.530451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6980f794-1d2e-4871-acff-9c2b330fd506 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:17.540924 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6980f794-1d2e-4871-acff-9c2b330fd506 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1373 microversion: 2.1 time: 0.314750 Oct 04 18:47:17.541846 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3353/6716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1373 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:18.577456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c16f06ad-3760-4c50-a19e-ad75eea67af0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:18.579157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c16f06ad-3760-4c50-a19e-ad75eea67af0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:18.581745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:18.590263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16f06ad-3760-4c50-a19e-ad75eea67af0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:18.591112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16f06ad-3760-4c50-a19e-ad75eea67af0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:18.591760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16f06ad-3760-4c50-a19e-ad75eea67af0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:18.592690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16f06ad-3760-4c50-a19e-ad75eea67af0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:18.593604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16f06ad-3760-4c50-a19e-ad75eea67af0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:18.594430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c16f06ad-3760-4c50-a19e-ad75eea67af0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.055894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c16f06ad-3760-4c50-a19e-ad75eea67af0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:19.060206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:19.067206 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c16f06ad-3760-4c50-a19e-ad75eea67af0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1373 microversion: 2.1 time: 0.494253 Oct 04 18:47:19.068140 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3364/6717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:18 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1373 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:19.444442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-45a43e7b-d60b-4fbb-aa75-0da9e998049c req-b00b0d43-ccd6-42f1-822e-9396a5d72810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32be5a67-1463-4840-aad0-06dbae4abce2", "name": "network-vif-plugged", "status": "completed", "tag": "99c28972-ff02-4216-9883-efa7139ee035"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:19.460783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45a43e7b-d60b-4fbb-aa75-0da9e998049c req-b00b0d43-ccd6-42f1-822e-9396a5d72810 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.461261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45a43e7b-d60b-4fbb-aa75-0da9e998049c req-b00b0d43-ccd6-42f1-822e-9396a5d72810 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.461710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-45a43e7b-d60b-4fbb-aa75-0da9e998049c req-b00b0d43-ccd6-42f1-822e-9396a5d72810 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.486060 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-45a43e7b-d60b-4fbb-aa75-0da9e998049c req-b00b0d43-ccd6-42f1-822e-9396a5d72810 service nova] Creating event network-vif-plugged:99c28972-ff02-4216-9883-efa7139ee035 for instance 32be5a67-1463-4840-aad0-06dbae4abce2 on n-h2-850499-14 Oct 04 18:47:19.502903 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-45a43e7b-d60b-4fbb-aa75-0da9e998049c req-b00b0d43-ccd6-42f1-822e-9396a5d72810 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065490 Oct 04 18:47:19.503826 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3354/6718] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:20.119631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1d2e4fb-b5a3-4d6d-bafc-e6b6bcae2d21 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.122800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b1d2e4fb-b5a3-4d6d-bafc-e6b6bcae2d21 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:20.156169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d2e4fb-b5a3-4d6d-bafc-e6b6bcae2d21 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.158230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d2e4fb-b5a3-4d6d-bafc-e6b6bcae2d21 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.158983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d2e4fb-b5a3-4d6d-bafc-e6b6bcae2d21 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.159919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d2e4fb-b5a3-4d6d-bafc-e6b6bcae2d21 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.160569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d2e4fb-b5a3-4d6d-bafc-e6b6bcae2d21 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.161291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1d2e4fb-b5a3-4d6d-bafc-e6b6bcae2d21 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.518498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b1d2e4fb-b5a3-4d6d-bafc-e6b6bcae2d21 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.538659 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b1d2e4fb-b5a3-4d6d-bafc-e6b6bcae2d21 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1373 microversion: 2.1 time: 0.446211 Oct 04 18:47:20.551890 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3365/6719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1373 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:21.496333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f2397e1-ddd5-4959-9526-ec552ab2f10b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] Calling method '.version_select at 0x7fd4d12e8d30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.532716 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2f2397e1-ddd5-4959-9526-ec552ab2f10b tempest-TestNetworkAdvancedServerOps-145155639 tempest-TestNetworkAdvancedServerOps-145155639-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-215249969" status: 202 len: 0 microversion: 2.1 time: 0.045003 Oct 04 18:47:21.539215 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3355/6720] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 4 18:47:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-215249969 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:21.580815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c5f791f-23f6-4c40-a32b-853f0b5d686f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.581609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c5f791f-23f6-4c40-a32b-853f0b5d686f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:21.598587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c5f791f-23f6-4c40-a32b-853f0b5d686f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.599012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c5f791f-23f6-4c40-a32b-853f0b5d686f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.599472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c5f791f-23f6-4c40-a32b-853f0b5d686f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.602036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c5f791f-23f6-4c40-a32b-853f0b5d686f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.602595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c5f791f-23f6-4c40-a32b-853f0b5d686f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.603083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c5f791f-23f6-4c40-a32b-853f0b5d686f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.065555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c5f791f-23f6-4c40-a32b-853f0b5d686f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.077533 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c5f791f-23f6-4c40-a32b-853f0b5d686f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1545 microversion: 2.1 time: 0.503961 Oct 04 18:47:22.078406 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3366/6721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:21 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1545 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.103284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e7a8aa03-6f40-4cf9-a55c-1d20b595aa00 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.104832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e7a8aa03-6f40-4cf9-a55c-1d20b595aa00 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.114170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a8aa03-6f40-4cf9-a55c-1d20b595aa00 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.114724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a8aa03-6f40-4cf9-a55c-1d20b595aa00 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.115190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a8aa03-6f40-4cf9-a55c-1d20b595aa00 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.115964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a8aa03-6f40-4cf9-a55c-1d20b595aa00 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.116433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a8aa03-6f40-4cf9-a55c-1d20b595aa00 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.117074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7a8aa03-6f40-4cf9-a55c-1d20b595aa00 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.303892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7a8aa03-6f40-4cf9-a55c-1d20b595aa00 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.312575 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e7a8aa03-6f40-4cf9-a55c-1d20b595aa00 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1545 microversion: 2.1 time: 0.214388 Oct 04 18:47:22.313447 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3356/6722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:22 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1545 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:25.625788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-bcb9b86a-bcad-460e-95b8-1c96a13c15f2 req-d9fc332a-f961-49a0-8e7f-9cf07d3b4b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32be5a67-1463-4840-aad0-06dbae4abce2", "tag": "99c28972-ff02-4216-9883-efa7139ee035"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:25.644759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bcb9b86a-bcad-460e-95b8-1c96a13c15f2 req-d9fc332a-f961-49a0-8e7f-9cf07d3b4b74 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:25.645256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bcb9b86a-bcad-460e-95b8-1c96a13c15f2 req-d9fc332a-f961-49a0-8e7f-9cf07d3b4b74 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:25.646045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bcb9b86a-bcad-460e-95b8-1c96a13c15f2 req-d9fc332a-f961-49a0-8e7f-9cf07d3b4b74 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.665665 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-bcb9b86a-bcad-460e-95b8-1c96a13c15f2 req-d9fc332a-f961-49a0-8e7f-9cf07d3b4b74 service nova] Creating event network-changed:99c28972-ff02-4216-9883-efa7139ee035 for instance 32be5a67-1463-4840-aad0-06dbae4abce2 on n-h2-850499-14 Oct 04 18:47:25.674688 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-bcb9b86a-bcad-460e-95b8-1c96a13c15f2 req-d9fc332a-f961-49a0-8e7f-9cf07d3b4b74 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056582 Oct 04 18:47:25.679050 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3367/6723] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:47:38.893100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1569946788", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "92f112aa-a846-40d8-acf9-9be2ff99547c", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d7231cfd-11da-40a4-8d73-d5073342969a"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:38.905472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:38.906143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=23 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:38.995383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] validate_networks() for [('d7231cfd-11da-40a4-8d73-d5073342969a', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:47:39.406925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:39.407394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:39.407874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:39.408301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:39.408723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:39.419569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.420062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.420504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.421270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.421734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.422167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.440803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:39.446543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for user 594483c9afdc4f69a6d02f10e8fde137 and project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:39.459794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:47:39.461881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='92f112aa-a846-40d8-acf9-9be2ff99547c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:47:39.541439 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d5abf4f-8738-42b9-834b-446d605f71c4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652797 Oct 04 18:47:39.545124 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3357/6724] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:47:39.555040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45e9d4ea-38a2-4477-bcaa-5a86c1353816 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:39.555774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-45e9d4ea-38a2-4477-bcaa-5a86c1353816 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:39.560184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:39.560844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=15 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:39.630002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-45e9d4ea-38a2-4477-bcaa-5a86c1353816 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:39.637758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-45e9d4ea-38a2-4477-bcaa-5a86c1353816 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1057 microversion: 2.1 time: 0.088243 Oct 04 18:47:39.638438 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3368/6725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:39 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1057 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:40.665274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-013d8f2e-1c7a-4e17-910a-bd78efb0936a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.666018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-013d8f2e-1c7a-4e17-910a-bd78efb0936a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.672714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-013d8f2e-1c7a-4e17-910a-bd78efb0936a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.673216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-013d8f2e-1c7a-4e17-910a-bd78efb0936a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.673687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-013d8f2e-1c7a-4e17-910a-bd78efb0936a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.674556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-013d8f2e-1c7a-4e17-910a-bd78efb0936a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.675203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-013d8f2e-1c7a-4e17-910a-bd78efb0936a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.675644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-013d8f2e-1c7a-4e17-910a-bd78efb0936a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.801333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-013d8f2e-1c7a-4e17-910a-bd78efb0936a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:40.807204 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-013d8f2e-1c7a-4e17-910a-bd78efb0936a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1117 microversion: 2.1 time: 0.148516 Oct 04 18:47:40.807806 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3358/6726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:40 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1117 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:41.842207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3aba4ff5-28ba-486b-a90c-429df2751e3e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:41.842798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3aba4ff5-28ba-486b-a90c-429df2751e3e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:41.852118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aba4ff5-28ba-486b-a90c-429df2751e3e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.852978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aba4ff5-28ba-486b-a90c-429df2751e3e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.853712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aba4ff5-28ba-486b-a90c-429df2751e3e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.854652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aba4ff5-28ba-486b-a90c-429df2751e3e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.855159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aba4ff5-28ba-486b-a90c-429df2751e3e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.855602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aba4ff5-28ba-486b-a90c-429df2751e3e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.105295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3aba4ff5-28ba-486b-a90c-429df2751e3e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:42.127962 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3aba4ff5-28ba-486b-a90c-429df2751e3e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.290018 Oct 04 18:47:42.129319 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3369/6727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:41 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:42.479864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-472ef940-8c3c-481b-961e-58ff616f672a req-84d5dd56-5576-4ab4-9602-c21348621248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eddb779-266b-4f38-ab55-cc5175e7a453", "tag": "bf800163-19e4-4b9c-b91e-80612bd979fe"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:42.495841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-472ef940-8c3c-481b-961e-58ff616f672a req-84d5dd56-5576-4ab4-9602-c21348621248 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:42.498715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-472ef940-8c3c-481b-961e-58ff616f672a req-84d5dd56-5576-4ab4-9602-c21348621248 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:42.499629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-472ef940-8c3c-481b-961e-58ff616f672a req-84d5dd56-5576-4ab4-9602-c21348621248 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.515579 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-472ef940-8c3c-481b-961e-58ff616f672a req-84d5dd56-5576-4ab4-9602-c21348621248 service nova] Creating event network-changed:bf800163-19e4-4b9c-b91e-80612bd979fe for instance 4eddb779-266b-4f38-ab55-cc5175e7a453 on n-h1-850499-14 Oct 04 18:47:42.521267 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-472ef940-8c3c-481b-961e-58ff616f672a req-84d5dd56-5576-4ab4-9602-c21348621248 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046165 Oct 04 18:47:42.523310 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3359/6728] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:43.152822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a7b9a296-8bf0-4358-a997-44b660e50782 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.153534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a7b9a296-8bf0-4358-a997-44b660e50782 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.160598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b9a296-8bf0-4358-a997-44b660e50782 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.161532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b9a296-8bf0-4358-a997-44b660e50782 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.162116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b9a296-8bf0-4358-a997-44b660e50782 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.163506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b9a296-8bf0-4358-a997-44b660e50782 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.164076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b9a296-8bf0-4358-a997-44b660e50782 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.164577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7b9a296-8bf0-4358-a997-44b660e50782 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.416565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a7b9a296-8bf0-4358-a997-44b660e50782 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:43.425617 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a7b9a296-8bf0-4358-a997-44b660e50782 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.277205 Oct 04 18:47:43.426194 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3370/6729] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:44.451757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fa1544e9-da09-45b2-8593-79cebcdbec66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:44.452985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fa1544e9-da09-45b2-8593-79cebcdbec66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:44.462908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa1544e9-da09-45b2-8593-79cebcdbec66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:44.463554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa1544e9-da09-45b2-8593-79cebcdbec66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:44.464374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa1544e9-da09-45b2-8593-79cebcdbec66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.465304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa1544e9-da09-45b2-8593-79cebcdbec66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:44.465806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa1544e9-da09-45b2-8593-79cebcdbec66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:44.466556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa1544e9-da09-45b2-8593-79cebcdbec66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.659023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fa1544e9-da09-45b2-8593-79cebcdbec66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:44.668081 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fa1544e9-da09-45b2-8593-79cebcdbec66 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.221757 Oct 04 18:47:44.668960 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3360/6730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:44 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:45.694074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d5e0ea84-a215-4b06-b4e7-d834e15c9dc2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:45.696209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d5e0ea84-a215-4b06-b4e7-d834e15c9dc2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:45.708256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5e0ea84-a215-4b06-b4e7-d834e15c9dc2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.709890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5e0ea84-a215-4b06-b4e7-d834e15c9dc2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.709890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5e0ea84-a215-4b06-b4e7-d834e15c9dc2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.711662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5e0ea84-a215-4b06-b4e7-d834e15c9dc2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.711778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5e0ea84-a215-4b06-b4e7-d834e15c9dc2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.712317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5e0ea84-a215-4b06-b4e7-d834e15c9dc2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.906677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d5e0ea84-a215-4b06-b4e7-d834e15c9dc2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:45.915671 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d5e0ea84-a215-4b06-b4e7-d834e15c9dc2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.226334 Oct 04 18:47:45.916249 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3371/6731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:45 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:46.940929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c00e50df-4925-4341-a8be-ee9b40d1cc62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.941662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c00e50df-4925-4341-a8be-ee9b40d1cc62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.949092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c00e50df-4925-4341-a8be-ee9b40d1cc62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.950212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c00e50df-4925-4341-a8be-ee9b40d1cc62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.950934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c00e50df-4925-4341-a8be-ee9b40d1cc62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.952174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c00e50df-4925-4341-a8be-ee9b40d1cc62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.953184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c00e50df-4925-4341-a8be-ee9b40d1cc62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.953874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c00e50df-4925-4341-a8be-ee9b40d1cc62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.137448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c00e50df-4925-4341-a8be-ee9b40d1cc62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:47.150321 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c00e50df-4925-4341-a8be-ee9b40d1cc62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.214504 Oct 04 18:47:47.156270 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3361/6732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:46 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:48.173858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d7504738-d667-46cd-bcdb-7113cc927cef tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:48.175140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d7504738-d667-46cd-bcdb-7113cc927cef tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:48.184031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7504738-d667-46cd-bcdb-7113cc927cef tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.184676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7504738-d667-46cd-bcdb-7113cc927cef tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.185126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7504738-d667-46cd-bcdb-7113cc927cef tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.186062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7504738-d667-46cd-bcdb-7113cc927cef tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.186659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7504738-d667-46cd-bcdb-7113cc927cef tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.187333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d7504738-d667-46cd-bcdb-7113cc927cef tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.359286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d7504738-d667-46cd-bcdb-7113cc927cef tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:48.372302 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d7504738-d667-46cd-bcdb-7113cc927cef tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.202410 Oct 04 18:47:48.372819 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3372/6733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:48 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:49.397991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01fcf42e-ec9a-4393-9477-d0d1f4ec1ccf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:49.398686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01fcf42e-ec9a-4393-9477-d0d1f4ec1ccf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:49.405814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fcf42e-ec9a-4393-9477-d0d1f4ec1ccf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.406388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fcf42e-ec9a-4393-9477-d0d1f4ec1ccf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.406854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fcf42e-ec9a-4393-9477-d0d1f4ec1ccf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.407600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fcf42e-ec9a-4393-9477-d0d1f4ec1ccf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.408068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fcf42e-ec9a-4393-9477-d0d1f4ec1ccf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.408518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01fcf42e-ec9a-4393-9477-d0d1f4ec1ccf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.429092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:49.453706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:49.569315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01fcf42e-ec9a-4393-9477-d0d1f4ec1ccf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:49.577292 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01fcf42e-ec9a-4393-9477-d0d1f4ec1ccf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.183824 Oct 04 18:47:49.577904 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3362/6734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:49 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:50.603127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b04a3eff-c11f-4ad7-9ee2-e82a90a3eb1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:50.604170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b04a3eff-c11f-4ad7-9ee2-e82a90a3eb1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:50.607191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:50.612451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04a3eff-c11f-4ad7-9ee2-e82a90a3eb1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:50.612955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04a3eff-c11f-4ad7-9ee2-e82a90a3eb1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:50.613401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04a3eff-c11f-4ad7-9ee2-e82a90a3eb1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:50.614237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04a3eff-c11f-4ad7-9ee2-e82a90a3eb1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:50.614700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04a3eff-c11f-4ad7-9ee2-e82a90a3eb1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:50.615162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b04a3eff-c11f-4ad7-9ee2-e82a90a3eb1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:50.762256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b04a3eff-c11f-4ad7-9ee2-e82a90a3eb1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:50.771105 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b04a3eff-c11f-4ad7-9ee2-e82a90a3eb1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.174504 Oct 04 18:47:50.772525 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3373/6735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:50 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:51.795840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b08d7bd-a480-421d-bec9-11383419441c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:51.796406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3b08d7bd-a480-421d-bec9-11383419441c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:51.803934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b08d7bd-a480-421d-bec9-11383419441c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.804428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b08d7bd-a480-421d-bec9-11383419441c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.804870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b08d7bd-a480-421d-bec9-11383419441c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.805605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b08d7bd-a480-421d-bec9-11383419441c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.806066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b08d7bd-a480-421d-bec9-11383419441c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.806500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b08d7bd-a480-421d-bec9-11383419441c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.955222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b08d7bd-a480-421d-bec9-11383419441c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:51.963105 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b08d7bd-a480-421d-bec9-11383419441c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.171272 Oct 04 18:47:51.963694 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3363/6736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:51 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:52.986035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0eb5fbe2-1666-47c2-9183-85bf95de3fae tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:52.986752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0eb5fbe2-1666-47c2-9183-85bf95de3fae tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:52.994591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb5fbe2-1666-47c2-9183-85bf95de3fae tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.995148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb5fbe2-1666-47c2-9183-85bf95de3fae tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.995578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb5fbe2-1666-47c2-9183-85bf95de3fae tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.996300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb5fbe2-1666-47c2-9183-85bf95de3fae tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.996759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb5fbe2-1666-47c2-9183-85bf95de3fae tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.997293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0eb5fbe2-1666-47c2-9183-85bf95de3fae tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.134044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0eb5fbe2-1666-47c2-9183-85bf95de3fae tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:53.142154 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0eb5fbe2-1666-47c2-9183-85bf95de3fae tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.160172 Oct 04 18:47:53.142822 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3374/6737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:52 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:54.166772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e293dba3-1b53-4e23-a894-cd57a382194c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:54.167469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e293dba3-1b53-4e23-a894-cd57a382194c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:54.175043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e293dba3-1b53-4e23-a894-cd57a382194c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:54.175554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e293dba3-1b53-4e23-a894-cd57a382194c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:54.176001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e293dba3-1b53-4e23-a894-cd57a382194c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:54.176723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e293dba3-1b53-4e23-a894-cd57a382194c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:54.177194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e293dba3-1b53-4e23-a894-cd57a382194c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:54.177651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e293dba3-1b53-4e23-a894-cd57a382194c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:54.327705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e293dba3-1b53-4e23-a894-cd57a382194c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:54.336964 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e293dba3-1b53-4e23-a894-cd57a382194c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.174759 Oct 04 18:47:54.337576 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3364/6738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:54 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:55.360316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0c704c8a-7edc-4f39-9011-4739bf11a768 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:55.360869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0c704c8a-7edc-4f39-9011-4739bf11a768 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:55.368148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c704c8a-7edc-4f39-9011-4739bf11a768 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.368651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c704c8a-7edc-4f39-9011-4739bf11a768 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.369102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c704c8a-7edc-4f39-9011-4739bf11a768 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.369826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c704c8a-7edc-4f39-9011-4739bf11a768 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.370286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c704c8a-7edc-4f39-9011-4739bf11a768 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.370716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0c704c8a-7edc-4f39-9011-4739bf11a768 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.517363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0c704c8a-7edc-4f39-9011-4739bf11a768 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:55.526317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0c704c8a-7edc-4f39-9011-4739bf11a768 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1169 microversion: 2.1 time: 0.170058 Oct 04 18:47:55.526817 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3375/6739] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:55 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:56.549526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-185a89f4-b283-4e41-9474-76269f650dbc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:56.550181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-185a89f4-b283-4e41-9474-76269f650dbc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:56.558393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-185a89f4-b283-4e41-9474-76269f650dbc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.558896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-185a89f4-b283-4e41-9474-76269f650dbc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.559385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-185a89f4-b283-4e41-9474-76269f650dbc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.560108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-185a89f4-b283-4e41-9474-76269f650dbc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.560578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-185a89f4-b283-4e41-9474-76269f650dbc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.561011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-185a89f4-b283-4e41-9474-76269f650dbc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.694992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-185a89f4-b283-4e41-9474-76269f650dbc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:56.702659 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-185a89f4-b283-4e41-9474-76269f650dbc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1203 microversion: 2.1 time: 0.157109 Oct 04 18:47:56.703261 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3365/6740] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:56 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:57.726825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5b112dda-2f97-4461-9d0d-452d8917db78 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:57.727515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5b112dda-2f97-4461-9d0d-452d8917db78 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:57.734705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b112dda-2f97-4461-9d0d-452d8917db78 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.735233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b112dda-2f97-4461-9d0d-452d8917db78 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.736056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b112dda-2f97-4461-9d0d-452d8917db78 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.736766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b112dda-2f97-4461-9d0d-452d8917db78 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.737223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b112dda-2f97-4461-9d0d-452d8917db78 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.737649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b112dda-2f97-4461-9d0d-452d8917db78 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.881216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5b112dda-2f97-4461-9d0d-452d8917db78 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:57.891853 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5b112dda-2f97-4461-9d0d-452d8917db78 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1203 microversion: 2.1 time: 0.169273 Oct 04 18:47:57.894285 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3376/6741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:57 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:58.917194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-db652917-709c-4d22-ac95-897182e3b8bf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:58.918058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-db652917-709c-4d22-ac95-897182e3b8bf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:58.925639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db652917-709c-4d22-ac95-897182e3b8bf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.926225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db652917-709c-4d22-ac95-897182e3b8bf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.926691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db652917-709c-4d22-ac95-897182e3b8bf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:58.927445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db652917-709c-4d22-ac95-897182e3b8bf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.927915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db652917-709c-4d22-ac95-897182e3b8bf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.928864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-db652917-709c-4d22-ac95-897182e3b8bf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.063652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-db652917-709c-4d22-ac95-897182e3b8bf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:59.072361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-db652917-709c-4d22-ac95-897182e3b8bf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1203 microversion: 2.1 time: 0.159339 Oct 04 18:47:59.072962 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3366/6742] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:58 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:00.096273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2c40cb68-8206-4432-8ea1-32bafee85163 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:00.097052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2c40cb68-8206-4432-8ea1-32bafee85163 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:00.105343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c40cb68-8206-4432-8ea1-32bafee85163 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.106280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c40cb68-8206-4432-8ea1-32bafee85163 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.106886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c40cb68-8206-4432-8ea1-32bafee85163 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.107719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c40cb68-8206-4432-8ea1-32bafee85163 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.108240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c40cb68-8206-4432-8ea1-32bafee85163 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.108718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2c40cb68-8206-4432-8ea1-32bafee85163 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.254147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2c40cb68-8206-4432-8ea1-32bafee85163 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.264373 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2c40cb68-8206-4432-8ea1-32bafee85163 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1203 microversion: 2.1 time: 0.172675 Oct 04 18:48:00.264964 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3377/6743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:00 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:01.286899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-72ab8c60-a658-4c39-8211-6c0a654108db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.287601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-72ab8c60-a658-4c39-8211-6c0a654108db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:01.294679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72ab8c60-a658-4c39-8211-6c0a654108db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.295211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72ab8c60-a658-4c39-8211-6c0a654108db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.295659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72ab8c60-a658-4c39-8211-6c0a654108db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.296371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72ab8c60-a658-4c39-8211-6c0a654108db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.296836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72ab8c60-a658-4c39-8211-6c0a654108db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.297267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72ab8c60-a658-4c39-8211-6c0a654108db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.438653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-72ab8c60-a658-4c39-8211-6c0a654108db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:01.446703 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-72ab8c60-a658-4c39-8211-6c0a654108db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1203 microversion: 2.1 time: 0.163792 Oct 04 18:48:01.447291 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3367/6744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:01 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:02.470158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6f700991-eae0-4010-8c83-112283d93c40 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:02.470780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6f700991-eae0-4010-8c83-112283d93c40 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:02.478718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f700991-eae0-4010-8c83-112283d93c40 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.479247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f700991-eae0-4010-8c83-112283d93c40 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.479695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f700991-eae0-4010-8c83-112283d93c40 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.480403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f700991-eae0-4010-8c83-112283d93c40 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.481146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f700991-eae0-4010-8c83-112283d93c40 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.481584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f700991-eae0-4010-8c83-112283d93c40 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.616317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6f700991-eae0-4010-8c83-112283d93c40 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:02.624984 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6f700991-eae0-4010-8c83-112283d93c40 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1203 microversion: 2.1 time: 0.158693 Oct 04 18:48:02.625569 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3378/6745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:02 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:03.651286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f765914f-837f-4d0c-abb2-3a7b8b526f1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:03.651961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f765914f-837f-4d0c-abb2-3a7b8b526f1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:03.658455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f765914f-837f-4d0c-abb2-3a7b8b526f1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.658979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f765914f-837f-4d0c-abb2-3a7b8b526f1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.659434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f765914f-837f-4d0c-abb2-3a7b8b526f1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.660156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f765914f-837f-4d0c-abb2-3a7b8b526f1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.660626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f765914f-837f-4d0c-abb2-3a7b8b526f1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.661068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f765914f-837f-4d0c-abb2-3a7b8b526f1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.808898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f765914f-837f-4d0c-abb2-3a7b8b526f1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:03.818264 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f765914f-837f-4d0c-abb2-3a7b8b526f1f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1203 microversion: 2.1 time: 0.173011 Oct 04 18:48:03.819063 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3368/6746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:03 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:04.076431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9d9f72a6-95e7-4baf-8a19-295f9ab57f57 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:04.078658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9d9f72a6-95e7-4baf-8a19-295f9ab57f57 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:04.086219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d9f72a6-95e7-4baf-8a19-295f9ab57f57 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.086738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d9f72a6-95e7-4baf-8a19-295f9ab57f57 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.087217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d9f72a6-95e7-4baf-8a19-295f9ab57f57 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.087936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d9f72a6-95e7-4baf-8a19-295f9ab57f57 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.088402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d9f72a6-95e7-4baf-8a19-295f9ab57f57 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.088831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d9f72a6-95e7-4baf-8a19-295f9ab57f57 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.176064 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9d9f72a6-95e7-4baf-8a19-295f9ab57f57 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "POST /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2/action" status: 200 len: 24565 microversion: 2.1 time: 0.103320 Oct 04 18:48:04.176825 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3379/6747] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:04 2022] POST /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2/action => generated 24565 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:48:04.843773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-74718495-0b52-4ff3-895d-5d3d73d5269c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:04.844351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-74718495-0b52-4ff3-895d-5d3d73d5269c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:04.852497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74718495-0b52-4ff3-895d-5d3d73d5269c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.852997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74718495-0b52-4ff3-895d-5d3d73d5269c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.853443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74718495-0b52-4ff3-895d-5d3d73d5269c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.854186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74718495-0b52-4ff3-895d-5d3d73d5269c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.854645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74718495-0b52-4ff3-895d-5d3d73d5269c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.855110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74718495-0b52-4ff3-895d-5d3d73d5269c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.989856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-74718495-0b52-4ff3-895d-5d3d73d5269c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:04.998117 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-74718495-0b52-4ff3-895d-5d3d73d5269c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1203 microversion: 2.1 time: 0.158584 Oct 04 18:48:04.998919 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3369/6748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:04 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:05.615136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-853216bf-9845-471b-8f29-476a36df8c98 req-689e68af-3e61-47ae-808a-4a6acd3d5262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eddb779-266b-4f38-ab55-cc5175e7a453", "name": "network-vif-plugged", "status": "completed", "tag": "bf800163-19e4-4b9c-b91e-80612bd979fe"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:05.626759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-853216bf-9845-471b-8f29-476a36df8c98 req-689e68af-3e61-47ae-808a-4a6acd3d5262 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.627318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-853216bf-9845-471b-8f29-476a36df8c98 req-689e68af-3e61-47ae-808a-4a6acd3d5262 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.627744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-853216bf-9845-471b-8f29-476a36df8c98 req-689e68af-3e61-47ae-808a-4a6acd3d5262 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.639200 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-853216bf-9845-471b-8f29-476a36df8c98 req-689e68af-3e61-47ae-808a-4a6acd3d5262 service nova] Creating event network-vif-plugged:bf800163-19e4-4b9c-b91e-80612bd979fe for instance 4eddb779-266b-4f38-ab55-cc5175e7a453 on n-h1-850499-14 Oct 04 18:48:05.644441 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-853216bf-9845-471b-8f29-476a36df8c98 req-689e68af-3e61-47ae-808a-4a6acd3d5262 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033434 Oct 04 18:48:05.645026 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3380/6749] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:06.023169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dd28110d-c7b2-46bc-b67a-12d65f9ecceb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:06.023789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dd28110d-c7b2-46bc-b67a-12d65f9ecceb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:06.030793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd28110d-c7b2-46bc-b67a-12d65f9ecceb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.031338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd28110d-c7b2-46bc-b67a-12d65f9ecceb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.031793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd28110d-c7b2-46bc-b67a-12d65f9ecceb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.032512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd28110d-c7b2-46bc-b67a-12d65f9ecceb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.032981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd28110d-c7b2-46bc-b67a-12d65f9ecceb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.033426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd28110d-c7b2-46bc-b67a-12d65f9ecceb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.164087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dd28110d-c7b2-46bc-b67a-12d65f9ecceb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:06.172507 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dd28110d-c7b2-46bc-b67a-12d65f9ecceb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1203 microversion: 2.1 time: 0.154453 Oct 04 18:48:06.173119 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3370/6750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:06 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:07.197654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dccc6172-bfc9-48d7-94b0-9f53ff3dafd5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.198363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dccc6172-bfc9-48d7-94b0-9f53ff3dafd5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:07.205151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dccc6172-bfc9-48d7-94b0-9f53ff3dafd5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.205654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dccc6172-bfc9-48d7-94b0-9f53ff3dafd5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.206109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dccc6172-bfc9-48d7-94b0-9f53ff3dafd5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.206835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dccc6172-bfc9-48d7-94b0-9f53ff3dafd5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.207328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dccc6172-bfc9-48d7-94b0-9f53ff3dafd5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.207765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dccc6172-bfc9-48d7-94b0-9f53ff3dafd5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.366055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dccc6172-bfc9-48d7-94b0-9f53ff3dafd5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.374372 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dccc6172-bfc9-48d7-94b0-9f53ff3dafd5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1391 microversion: 2.1 time: 0.182519 Oct 04 18:48:07.374993 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3381/6751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:07.398826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17da6e2b-d6b8-4957-9ba3-6479df32867d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.399493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17da6e2b-d6b8-4957-9ba3-6479df32867d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:07.406858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17da6e2b-d6b8-4957-9ba3-6479df32867d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.407392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17da6e2b-d6b8-4957-9ba3-6479df32867d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.407841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17da6e2b-d6b8-4957-9ba3-6479df32867d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.408559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17da6e2b-d6b8-4957-9ba3-6479df32867d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.409024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17da6e2b-d6b8-4957-9ba3-6479df32867d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.409455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17da6e2b-d6b8-4957-9ba3-6479df32867d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.565939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17da6e2b-d6b8-4957-9ba3-6479df32867d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.574637 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17da6e2b-d6b8-4957-9ba3-6479df32867d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1391 microversion: 2.1 time: 0.180040 Oct 04 18:48:07.575271 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3371/6752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:07.599114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f5227c16-b180-4e4a-b3d9-20a2895679de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.599747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f5227c16-b180-4e4a-b3d9-20a2895679de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:07.608755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5227c16-b180-4e4a-b3d9-20a2895679de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.609339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5227c16-b180-4e4a-b3d9-20a2895679de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.609908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5227c16-b180-4e4a-b3d9-20a2895679de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.610636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5227c16-b180-4e4a-b3d9-20a2895679de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.611261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5227c16-b180-4e4a-b3d9-20a2895679de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.611835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5227c16-b180-4e4a-b3d9-20a2895679de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.756735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f5227c16-b180-4e4a-b3d9-20a2895679de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.765307 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f5227c16-b180-4e4a-b3d9-20a2895679de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1391 microversion: 2.1 time: 0.170744 Oct 04 18:48:07.765911 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3382/6753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:07.860636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4f7c7799-0366-4546-9eb9-c6cc2034eade tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.861160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4f7c7799-0366-4546-9eb9-c6cc2034eade tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:07.870480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f7c7799-0366-4546-9eb9-c6cc2034eade tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.871020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f7c7799-0366-4546-9eb9-c6cc2034eade tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.871506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f7c7799-0366-4546-9eb9-c6cc2034eade tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.872239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f7c7799-0366-4546-9eb9-c6cc2034eade tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.872711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f7c7799-0366-4546-9eb9-c6cc2034eade tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.873155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f7c7799-0366-4546-9eb9-c6cc2034eade tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.900248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4f7c7799-0366-4546-9eb9-c6cc2034eade tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:48:07.985679 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4f7c7799-0366-4546-9eb9-c6cc2034eade tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 204 len: 0 microversion: 2.1 time: 0.128836 Oct 04 18:48:07.987626 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3372/6754] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:07 2022] DELETE /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:48:07.995931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7c361870-b2e7-41be-a01b-fa7eb5252c7b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.996528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7c361870-b2e7-41be-a01b-fa7eb5252c7b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.003307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c361870-b2e7-41be-a01b-fa7eb5252c7b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.003811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c361870-b2e7-41be-a01b-fa7eb5252c7b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.004262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c361870-b2e7-41be-a01b-fa7eb5252c7b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.005013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c361870-b2e7-41be-a01b-fa7eb5252c7b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.005454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c361870-b2e7-41be-a01b-fa7eb5252c7b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.005884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c361870-b2e7-41be-a01b-fa7eb5252c7b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.153587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7c361870-b2e7-41be-a01b-fa7eb5252c7b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:08.162214 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7c361870-b2e7-41be-a01b-fa7eb5252c7b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1397 microversion: 2.1 time: 0.170143 Oct 04 18:48:08.163462 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3383/6755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1397 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:09.186214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f3093d4e-f0eb-45f5-927b-a2a48b982b39 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:09.186940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f3093d4e-f0eb-45f5-927b-a2a48b982b39 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:09.189885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:09.195883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3093d4e-f0eb-45f5-927b-a2a48b982b39 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.196395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3093d4e-f0eb-45f5-927b-a2a48b982b39 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.196858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3093d4e-f0eb-45f5-927b-a2a48b982b39 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.197595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3093d4e-f0eb-45f5-927b-a2a48b982b39 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.198076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3093d4e-f0eb-45f5-927b-a2a48b982b39 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.198524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3093d4e-f0eb-45f5-927b-a2a48b982b39 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.203625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:09.342719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f3093d4e-f0eb-45f5-927b-a2a48b982b39 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:09.351070 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f3093d4e-f0eb-45f5-927b-a2a48b982b39 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1397 microversion: 2.1 time: 0.169147 Oct 04 18:48:09.352037 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3373/6756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:09 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1397 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:10.375158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6cadc97e-f6fc-4283-9164-fe30d0b28c44 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:10.375738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6cadc97e-f6fc-4283-9164-fe30d0b28c44 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:10.378740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=35 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:10.384636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cadc97e-f6fc-4283-9164-fe30d0b28c44 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.385147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cadc97e-f6fc-4283-9164-fe30d0b28c44 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.385604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cadc97e-f6fc-4283-9164-fe30d0b28c44 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.386332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cadc97e-f6fc-4283-9164-fe30d0b28c44 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.386845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cadc97e-f6fc-4283-9164-fe30d0b28c44 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.387388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6cadc97e-f6fc-4283-9164-fe30d0b28c44 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.390375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=85 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:10.513573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6cadc97e-f6fc-4283-9164-fe30d0b28c44 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:10.515395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ff41d3c3-e660-4965-b6e6-9d53e4de512b req-883f764b-2b3c-4d6b-b6f9-44cbbf1bb69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eddb779-266b-4f38-ab55-cc5175e7a453", "name": "network-vif-deleted", "tag": "bf800163-19e4-4b9c-b91e-80612bd979fe"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:10.527622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ff41d3c3-e660-4965-b6e6-9d53e4de512b req-883f764b-2b3c-4d6b-b6f9-44cbbf1bb69c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.528032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ff41d3c3-e660-4965-b6e6-9d53e4de512b req-883f764b-2b3c-4d6b-b6f9-44cbbf1bb69c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.528266 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6cadc97e-f6fc-4283-9164-fe30d0b28c44 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1355 microversion: 2.1 time: 0.156865 Oct 04 18:48:10.528478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ff41d3c3-e660-4965-b6e6-9d53e4de512b req-883f764b-2b3c-4d6b-b6f9-44cbbf1bb69c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.529160 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3384/6757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:10 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1355 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:10.552113 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ff41d3c3-e660-4965-b6e6-9d53e4de512b req-883f764b-2b3c-4d6b-b6f9-44cbbf1bb69c service nova] Creating event network-vif-deleted:bf800163-19e4-4b9c-b91e-80612bd979fe for instance 4eddb779-266b-4f38-ab55-cc5175e7a453 on n-h1-850499-14 Oct 04 18:48:10.557363 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ff41d3c3-e660-4965-b6e6-9d53e4de512b req-883f764b-2b3c-4d6b-b6f9-44cbbf1bb69c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047564 Oct 04 18:48:10.558005 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3374/6758] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:11.561388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8e35fbe9-14ee-414e-ad8e-81a931b94a49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:11.562121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8e35fbe9-14ee-414e-ad8e-81a931b94a49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:11.569284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e35fbe9-14ee-414e-ad8e-81a931b94a49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.569776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e35fbe9-14ee-414e-ad8e-81a931b94a49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.570246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e35fbe9-14ee-414e-ad8e-81a931b94a49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.570982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e35fbe9-14ee-414e-ad8e-81a931b94a49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.571571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e35fbe9-14ee-414e-ad8e-81a931b94a49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.572011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8e35fbe9-14ee-414e-ad8e-81a931b94a49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.639064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8e35fbe9-14ee-414e-ad8e-81a931b94a49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:11.648015 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8e35fbe9-14ee-414e-ad8e-81a931b94a49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1188 microversion: 2.1 time: 0.092551 Oct 04 18:48:11.648758 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3385/6759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:11 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:12.675578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8e8d5fd-eb8c-4f70-a9b5-575034b14142 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.676287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e8e8d5fd-eb8c-4f70-a9b5-575034b14142 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:12.683107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8e8d5fd-eb8c-4f70-a9b5-575034b14142 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.683604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8e8d5fd-eb8c-4f70-a9b5-575034b14142 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.684045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8e8d5fd-eb8c-4f70-a9b5-575034b14142 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.684750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8e8d5fd-eb8c-4f70-a9b5-575034b14142 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.685212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8e8d5fd-eb8c-4f70-a9b5-575034b14142 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.685643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8e8d5fd-eb8c-4f70-a9b5-575034b14142 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.752658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8e8d5fd-eb8c-4f70-a9b5-575034b14142 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.761645 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e8e8d5fd-eb8c-4f70-a9b5-575034b14142 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1188 microversion: 2.1 time: 0.091997 Oct 04 18:48:12.762276 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3375/6760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:12 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:13.786247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-83bf7f14-880e-44a8-bc32-eb2ee78acbe9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:13.787002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-83bf7f14-880e-44a8-bc32-eb2ee78acbe9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:13.794381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83bf7f14-880e-44a8-bc32-eb2ee78acbe9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.794879 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83bf7f14-880e-44a8-bc32-eb2ee78acbe9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.795375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83bf7f14-880e-44a8-bc32-eb2ee78acbe9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.796184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83bf7f14-880e-44a8-bc32-eb2ee78acbe9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.796708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83bf7f14-880e-44a8-bc32-eb2ee78acbe9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.797212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83bf7f14-880e-44a8-bc32-eb2ee78acbe9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.871684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-83bf7f14-880e-44a8-bc32-eb2ee78acbe9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:13.880397 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-83bf7f14-880e-44a8-bc32-eb2ee78acbe9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1188 microversion: 2.1 time: 0.098531 Oct 04 18:48:13.881027 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3386/6761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:13 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:14.904012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:14.904736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:14.912140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:14.913244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:14.913758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:14.914560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:14.915054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:14.915490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:14.949177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:14.949598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:14.950169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:14.950720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lazy-loading 'fault' on Instance uuid 4eddb779-266b-4f38-ab55-cc5175e7a453 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:48:14.993950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:15.002048 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1a173fcd-e295-4f5d-b975-54ccfc9ac76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 200 len: 1193 microversion: 2.1 time: 0.101989 Oct 04 18:48:15.002630 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3376/6762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:14 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 1193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:16.026474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:16.027128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:16.034536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:16.035072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:16.035532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:16.036260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:16.036730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:16.037171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:16.051405 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 HTTP/1.1 Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4eddb779-266b-4f38-ab55-cc5175e7a453'} Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:16.053594 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:48:16.058501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:16.058501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:16.058501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:16.058501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:16.058501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:16.058501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:16.058501 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:48:16.058501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:16.058501 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4776f696-2575-406d-ad66-2c3a8082132a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 404 len: 111 microversion: 2.1 time: 0.033618 Oct 04 18:48:16.058501 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3387/6763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:16 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:48:18.212339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:18.213552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:18.221255 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:18.221753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:18.222201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:18.222921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:18.223892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:18.224332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:18.241117 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 HTTP/1.1 Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '4eddb779-266b-4f38-ab55-cc5175e7a453'} Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:18.243419 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:18.247954 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:48:18.249864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:18.251021 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-47ebea4e-2652-4536-9905-00090470280f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 404 len: 111 microversion: 2.1 time: 0.042873 Oct 04 18:48:18.252165 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3377/6764] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:18 2022] DELETE /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:18.262411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:18.263783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 4eddb779-266b-4f38-ab55-cc5175e7a453] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:18.271446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:18.272240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:18.272862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:18.273770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:18.274408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:18.275032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:18.295313 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 HTTP/1.1 Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4eddb779-266b-4f38-ab55-cc5175e7a453'} Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:18.297340 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:48:18.304790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:18.304790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:18.304790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:18.304790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:18.304790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:18.304790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. Oct 04 18:48:18.304790 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:48:18.304790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance 4eddb779-266b-4f38-ab55-cc5175e7a453 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:18.304790 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-16d7943e-7389-46b9-bf22-bbaa1b623dd8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453" status: 404 len: 111 microversion: 2.1 time: 0.043715 Oct 04 18:48:18.304790 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3388/6765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:18 2022] GET /compute/v2.1/servers/4eddb779-266b-4f38-ab55-cc5175e7a453 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:48:38.014341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1345246899", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cb3693ca-d010-4fab-99b1-70553e19a3b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d7231cfd-11da-40a4-8d73-d5073342969a"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:38.025747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=11 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:38.026409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=23 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:38.090205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] validate_networks() for [('d7231cfd-11da-40a4-8d73-d5073342969a', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:48:38.482610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:38.483072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:38.483556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:38.484402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:38.484402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:38.494467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.494987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.495437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.496179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.496643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.497078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.515324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:38.520664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for user 594483c9afdc4f69a6d02f10e8fde137 and project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:38.584753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:38.587041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb3693ca-d010-4fab-99b1-70553e19a3b3',volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:38.728200 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-08db9efa-1970-4b29-952e-47af5244320e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718139 Oct 04 18:48:38.728778 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3378/6766] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:48:38.740121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b3cdd012-8b92-4062-bcad-ba7edecf2949 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:38.740739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b3cdd012-8b92-4062-bcad-ba7edecf2949 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:38.744996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=9 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:38.745922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=21 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:38.799699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b3cdd012-8b92-4062-bcad-ba7edecf2949 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:38.807503 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b3cdd012-8b92-4062-bcad-ba7edecf2949 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1071 microversion: 2.1 time: 0.071468 Oct 04 18:48:38.808076 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3389/6767] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:38 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1071 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:39.830673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e0b7c72-ffc6-4295-bc06-cc9083f35bbf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:39.831319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e0b7c72-ffc6-4295-bc06-cc9083f35bbf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:39.839944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e0b7c72-ffc6-4295-bc06-cc9083f35bbf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:39.840444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e0b7c72-ffc6-4295-bc06-cc9083f35bbf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:39.841363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e0b7c72-ffc6-4295-bc06-cc9083f35bbf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:39.842254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e0b7c72-ffc6-4295-bc06-cc9083f35bbf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:39.842899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e0b7c72-ffc6-4295-bc06-cc9083f35bbf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:39.843355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e0b7c72-ffc6-4295-bc06-cc9083f35bbf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:39.916246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7e0b7c72-ffc6-4295-bc06-cc9083f35bbf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:39.924147 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e0b7c72-ffc6-4295-bc06-cc9083f35bbf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1177 microversion: 2.1 time: 0.098283 Oct 04 18:48:39.924965 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3379/6768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:39 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1177 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:40.948161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0b5698f9-2661-4fd0-919c-43b8f095c2e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:40.948865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0b5698f9-2661-4fd0-919c-43b8f095c2e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:40.957057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b5698f9-2661-4fd0-919c-43b8f095c2e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:40.957558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b5698f9-2661-4fd0-919c-43b8f095c2e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:40.958009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b5698f9-2661-4fd0-919c-43b8f095c2e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:40.958724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b5698f9-2661-4fd0-919c-43b8f095c2e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:40.959449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b5698f9-2661-4fd0-919c-43b8f095c2e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:40.960204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b5698f9-2661-4fd0-919c-43b8f095c2e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:41.192148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0b5698f9-2661-4fd0-919c-43b8f095c2e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:41.200422 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0b5698f9-2661-4fd0-919c-43b8f095c2e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1229 microversion: 2.1 time: 0.257217 Oct 04 18:48:41.200994 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3390/6769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:40 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1229 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:41.336441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-973697f2-45e0-47b9-a9c8-c172e05cce20 req-77168686-3514-4804-95b1-14f155119240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57fcaa5-8079-4e68-b4e5-b7d92bdd6525", "tag": "4aec5492-d085-447e-b914-88f4d59734e6"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:41.356052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-973697f2-45e0-47b9-a9c8-c172e05cce20 req-77168686-3514-4804-95b1-14f155119240 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:41.357064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-973697f2-45e0-47b9-a9c8-c172e05cce20 req-77168686-3514-4804-95b1-14f155119240 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:41.357755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-973697f2-45e0-47b9-a9c8-c172e05cce20 req-77168686-3514-4804-95b1-14f155119240 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:41.373595 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-973697f2-45e0-47b9-a9c8-c172e05cce20 req-77168686-3514-4804-95b1-14f155119240 service nova] Creating event network-changed:4aec5492-d085-447e-b914-88f4d59734e6 for instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 on n-h1-850499-14 Oct 04 18:48:41.378971 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-973697f2-45e0-47b9-a9c8-c172e05cce20 req-77168686-3514-4804-95b1-14f155119240 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050208 Oct 04 18:48:41.379714 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3380/6770] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:42.225156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c480c0df-f760-4a39-b3d8-11d13be5b8d3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:42.225822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c480c0df-f760-4a39-b3d8-11d13be5b8d3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:42.233041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c480c0df-f760-4a39-b3d8-11d13be5b8d3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:42.233689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c480c0df-f760-4a39-b3d8-11d13be5b8d3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:42.234137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c480c0df-f760-4a39-b3d8-11d13be5b8d3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:42.234863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c480c0df-f760-4a39-b3d8-11d13be5b8d3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:42.235391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c480c0df-f760-4a39-b3d8-11d13be5b8d3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:42.235818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c480c0df-f760-4a39-b3d8-11d13be5b8d3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:42.420004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c480c0df-f760-4a39-b3d8-11d13be5b8d3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:42.428091 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c480c0df-f760-4a39-b3d8-11d13be5b8d3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1229 microversion: 2.1 time: 0.206954 Oct 04 18:48:42.429124 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3391/6771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:42 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1229 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:43.453007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-02cec901-8b41-461f-8af0-6e7c3c412b98 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:43.453731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-02cec901-8b41-461f-8af0-6e7c3c412b98 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:43.460628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02cec901-8b41-461f-8af0-6e7c3c412b98 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:43.461212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02cec901-8b41-461f-8af0-6e7c3c412b98 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:43.461594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02cec901-8b41-461f-8af0-6e7c3c412b98 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:43.462308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02cec901-8b41-461f-8af0-6e7c3c412b98 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:43.462788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02cec901-8b41-461f-8af0-6e7c3c412b98 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:43.463252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-02cec901-8b41-461f-8af0-6e7c3c412b98 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:43.603415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-02cec901-8b41-461f-8af0-6e7c3c412b98 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:43.611328 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-02cec901-8b41-461f-8af0-6e7c3c412b98 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1229 microversion: 2.1 time: 0.163537 Oct 04 18:48:43.611919 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3381/6772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:43 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1229 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:44.633697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1649a4b-b702-4db1-a4fa-485f2ea38c9c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:44.634325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1649a4b-b702-4db1-a4fa-485f2ea38c9c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:44.641469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1649a4b-b702-4db1-a4fa-485f2ea38c9c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:44.641983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1649a4b-b702-4db1-a4fa-485f2ea38c9c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:44.642438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1649a4b-b702-4db1-a4fa-485f2ea38c9c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:44.643201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1649a4b-b702-4db1-a4fa-485f2ea38c9c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:44.643675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1649a4b-b702-4db1-a4fa-485f2ea38c9c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:44.644117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1649a4b-b702-4db1-a4fa-485f2ea38c9c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:44.785968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1649a4b-b702-4db1-a4fa-485f2ea38c9c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:44.794775 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1649a4b-b702-4db1-a4fa-485f2ea38c9c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1229 microversion: 2.1 time: 0.164984 Oct 04 18:48:44.795704 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3392/6773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:44 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1229 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:45.819414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-250fa94a-3f7f-4f06-81c4-47db49c47d23 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:45.820128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-250fa94a-3f7f-4f06-81c4-47db49c47d23 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:45.826819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-250fa94a-3f7f-4f06-81c4-47db49c47d23 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:45.827349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-250fa94a-3f7f-4f06-81c4-47db49c47d23 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:45.827789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-250fa94a-3f7f-4f06-81c4-47db49c47d23 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:45.828484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-250fa94a-3f7f-4f06-81c4-47db49c47d23 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:45.828944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-250fa94a-3f7f-4f06-81c4-47db49c47d23 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:45.829371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-250fa94a-3f7f-4f06-81c4-47db49c47d23 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:45.968203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-250fa94a-3f7f-4f06-81c4-47db49c47d23 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:45.977346 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-250fa94a-3f7f-4f06-81c4-47db49c47d23 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1217 microversion: 2.1 time: 0.162269 Oct 04 18:48:45.977957 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3382/6774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:45 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:47.000509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ebce1efa-77a6-45eb-9ae7-38b7ac36d10d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:47.001201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ebce1efa-77a6-45eb-9ae7-38b7ac36d10d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:47.008091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebce1efa-77a6-45eb-9ae7-38b7ac36d10d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.008575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebce1efa-77a6-45eb-9ae7-38b7ac36d10d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.009015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebce1efa-77a6-45eb-9ae7-38b7ac36d10d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.009709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebce1efa-77a6-45eb-9ae7-38b7ac36d10d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.010170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebce1efa-77a6-45eb-9ae7-38b7ac36d10d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.010602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebce1efa-77a6-45eb-9ae7-38b7ac36d10d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.143211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ebce1efa-77a6-45eb-9ae7-38b7ac36d10d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:47.152712 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ebce1efa-77a6-45eb-9ae7-38b7ac36d10d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1217 microversion: 2.1 time: 0.156078 Oct 04 18:48:47.153284 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3393/6775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:46 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:48.175830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bad4ee7f-b5a0-489c-98f2-97e2d1656d60 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:48.176501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bad4ee7f-b5a0-489c-98f2-97e2d1656d60 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:48.184274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad4ee7f-b5a0-489c-98f2-97e2d1656d60 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.184784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad4ee7f-b5a0-489c-98f2-97e2d1656d60 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.185237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad4ee7f-b5a0-489c-98f2-97e2d1656d60 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.185971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad4ee7f-b5a0-489c-98f2-97e2d1656d60 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.186441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad4ee7f-b5a0-489c-98f2-97e2d1656d60 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.187100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bad4ee7f-b5a0-489c-98f2-97e2d1656d60 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.280151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-54f303a9-fea1-46f2-888c-c4d9285ce4e1 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Action: 'create', calling method: .version_select at 0x7fd4d09c5550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-704819664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMALRmnNiRQ/oZQeUK3RgQb8LL20u6MShjBK3u3v5Cir0/JcXwzV0X97q/0x9D/ai1OXMB63CtwPzS7R2QUi5SbcnnSD8Ch6HaxXG5bbvw02BOBtTh2p8eG1Q9nzUGEdmA=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:48.300599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-54f303a9-fea1-46f2-888c-c4d9285ce4e1 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for project 3401093d6669442a95295abfeb2bdbb1. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:48.310378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-54f303a9-fea1-46f2-888c-c4d9285ce4e1 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for user b87951bf1b5c400197e7346e8bf66e1e and project 3401093d6669442a95295abfeb2bdbb1. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:48.344658 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-54f303a9-fea1-46f2-888c-c4d9285ce4e1 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.068354 Oct 04 18:48:48.345499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bad4ee7f-b5a0-489c-98f2-97e2d1656d60 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:48.345774 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3394/6776] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:48:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:48.357089 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bad4ee7f-b5a0-489c-98f2-97e2d1656d60 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1217 microversion: 2.1 time: 0.185146 Oct 04 18:48:48.357675 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3383/6777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:48 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:49.381146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7bd755b7-81c5-4f6f-a1f4-629e47ed4104 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:49.382453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7bd755b7-81c5-4f6f-a1f4-629e47ed4104 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:49.389561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd755b7-81c5-4f6f-a1f4-629e47ed4104 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.390068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd755b7-81c5-4f6f-a1f4-629e47ed4104 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.390578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd755b7-81c5-4f6f-a1f4-629e47ed4104 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.391608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd755b7-81c5-4f6f-a1f4-629e47ed4104 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.392859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd755b7-81c5-4f6f-a1f4-629e47ed4104 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.393613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7bd755b7-81c5-4f6f-a1f4-629e47ed4104 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.516362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1600748713", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "3a7dbb9e-bfff-4c86-9ead-74d3a23ea360"}], "key_name": "tempest-TestNetworkBasicOps-704819664", "security_groups": [{"name": "tempest-secgroup-smoke-1666574044"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:49.525358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:49.526050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:49.558942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7bd755b7-81c5-4f6f-a1f4-629e47ed4104 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.567635 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7bd755b7-81c5-4f6f-a1f4-629e47ed4104 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1217 microversion: 2.1 time: 0.190341 Oct 04 18:48:49.568089 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3395/6778] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:49 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:49.641881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] validate_networks() for [('3a7dbb9e-bfff-4c86-9ead-74d3a23ea360', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:48:50.162851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:50.163813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:50.169035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:50.169447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:50.172743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:50.193840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.195353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.195875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.196701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.197345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.197855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.220298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for project 3401093d6669442a95295abfeb2bdbb1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:50.227594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for user b87951bf1b5c400197e7346e8bf66e1e and project 3401093d6669442a95295abfeb2bdbb1. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:50.244671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:50.247251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:50.310473 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-621ac5f0-0380-40d1-96e6-4e87116b28ee tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.797338 Oct 04 18:48:50.325834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ed406b1-00e6-491e-87e1-b05e728cf6c9 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:50.326471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ed406b1-00e6-491e-87e1-b05e728cf6c9 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:50.327197 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3384/6779] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:48:50.408308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ed406b1-00e6-491e-87e1-b05e728cf6c9 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:50.416565 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ed406b1-00e6-491e-87e1-b05e728cf6c9 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1248 microversion: 2.1 time: 0.094769 Oct 04 18:48:50.417471 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3396/6780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:50 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1248 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:50.591708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-71949f48-a66b-4b3b-bf57-7c1765bc1a70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:50.592657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-71949f48-a66b-4b3b-bf57-7c1765bc1a70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:50.601342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71949f48-a66b-4b3b-bf57-7c1765bc1a70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.601885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71949f48-a66b-4b3b-bf57-7c1765bc1a70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.602329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71949f48-a66b-4b3b-bf57-7c1765bc1a70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.603432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71949f48-a66b-4b3b-bf57-7c1765bc1a70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.604138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71949f48-a66b-4b3b-bf57-7c1765bc1a70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.604745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71949f48-a66b-4b3b-bf57-7c1765bc1a70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.751325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-71949f48-a66b-4b3b-bf57-7c1765bc1a70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:50.762128 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-71949f48-a66b-4b3b-bf57-7c1765bc1a70 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1217 microversion: 2.1 time: 0.174811 Oct 04 18:48:50.762811 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3385/6781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:50 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:51.443328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-34ef937b-c130-4529-98d2-1cbab4e69e58 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:51.444003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-34ef937b-c130-4529-98d2-1cbab4e69e58 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:51.452387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34ef937b-c130-4529-98d2-1cbab4e69e58 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.452874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34ef937b-c130-4529-98d2-1cbab4e69e58 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.453320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34ef937b-c130-4529-98d2-1cbab4e69e58 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.454021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34ef937b-c130-4529-98d2-1cbab4e69e58 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.454478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34ef937b-c130-4529-98d2-1cbab4e69e58 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.454908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-34ef937b-c130-4529-98d2-1cbab4e69e58 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.517882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-34ef937b-c130-4529-98d2-1cbab4e69e58 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:51.527867 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-34ef937b-c130-4529-98d2-1cbab4e69e58 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1300 microversion: 2.1 time: 0.090245 Oct 04 18:48:51.528460 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3397/6782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:51 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:51.789828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ad04acf-d7d0-41f6-878e-8c0b57f6b67c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:51.791417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ad04acf-d7d0-41f6-878e-8c0b57f6b67c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:51.803275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ad04acf-d7d0-41f6-878e-8c0b57f6b67c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.804454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ad04acf-d7d0-41f6-878e-8c0b57f6b67c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.804789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ad04acf-d7d0-41f6-878e-8c0b57f6b67c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.805528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ad04acf-d7d0-41f6-878e-8c0b57f6b67c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.806027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ad04acf-d7d0-41f6-878e-8c0b57f6b67c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.806846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ad04acf-d7d0-41f6-878e-8c0b57f6b67c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.972881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1ad04acf-d7d0-41f6-878e-8c0b57f6b67c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:51.983895 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ad04acf-d7d0-41f6-878e-8c0b57f6b67c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1217 microversion: 2.1 time: 0.198231 Oct 04 18:48:51.984603 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3386/6783] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:51 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:52.552346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c5779d11-3726-4efd-8ed5-9021a9e7a0d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:52.554245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c5779d11-3726-4efd-8ed5-9021a9e7a0d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:52.561797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5779d11-3726-4efd-8ed5-9021a9e7a0d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.562329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5779d11-3726-4efd-8ed5-9021a9e7a0d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.562776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5779d11-3726-4efd-8ed5-9021a9e7a0d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.563528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5779d11-3726-4efd-8ed5-9021a9e7a0d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.563994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5779d11-3726-4efd-8ed5-9021a9e7a0d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.565086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c5779d11-3726-4efd-8ed5-9021a9e7a0d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.709167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c5779d11-3726-4efd-8ed5-9021a9e7a0d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:52.717312 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c5779d11-3726-4efd-8ed5-9021a9e7a0d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1374 microversion: 2.1 time: 0.168834 Oct 04 18:48:52.717892 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3398/6784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:52 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:53.007953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbe77e90-c941-4b64-85c2-910b0b96ad97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:53.008531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bbe77e90-c941-4b64-85c2-910b0b96ad97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:53.015506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe77e90-c941-4b64-85c2-910b0b96ad97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.015943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe77e90-c941-4b64-85c2-910b0b96ad97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.016395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe77e90-c941-4b64-85c2-910b0b96ad97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.017183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe77e90-c941-4b64-85c2-910b0b96ad97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.017652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe77e90-c941-4b64-85c2-910b0b96ad97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.018087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbe77e90-c941-4b64-85c2-910b0b96ad97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.165691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bbe77e90-c941-4b64-85c2-910b0b96ad97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:53.173805 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bbe77e90-c941-4b64-85c2-910b0b96ad97 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1217 microversion: 2.1 time: 0.169952 Oct 04 18:48:53.174388 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3387/6785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:53 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:53.358574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d10edf3e-b7f1-41fd-9542-707fc06fbae0 req-e20e847e-d58d-4516-805a-1b46a82ac5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33790005-f41e-4fa8-b70c-294c1b2f93a8", "tag": "c6837215-fc83-41ca-bce0-0c1f0e5a8f13"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:53.368604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d10edf3e-b7f1-41fd-9542-707fc06fbae0 req-e20e847e-d58d-4516-805a-1b46a82ac5a3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.369085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d10edf3e-b7f1-41fd-9542-707fc06fbae0 req-e20e847e-d58d-4516-805a-1b46a82ac5a3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.369520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d10edf3e-b7f1-41fd-9542-707fc06fbae0 req-e20e847e-d58d-4516-805a-1b46a82ac5a3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.380601 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d10edf3e-b7f1-41fd-9542-707fc06fbae0 req-e20e847e-d58d-4516-805a-1b46a82ac5a3 service nova] Creating event network-changed:c6837215-fc83-41ca-bce0-0c1f0e5a8f13 for instance 33790005-f41e-4fa8-b70c-294c1b2f93a8 on n-h2-850499-14 Oct 04 18:48:53.386169 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d10edf3e-b7f1-41fd-9542-707fc06fbae0 req-e20e847e-d58d-4516-805a-1b46a82ac5a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178176 Oct 04 18:48:53.386518 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3399/6786] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:53.744872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f2841ae-4010-49c3-bc20-93c16dcb917b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:53.745506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f2841ae-4010-49c3-bc20-93c16dcb917b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:53.752847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2841ae-4010-49c3-bc20-93c16dcb917b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.753625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2841ae-4010-49c3-bc20-93c16dcb917b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.754260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2841ae-4010-49c3-bc20-93c16dcb917b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.755246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2841ae-4010-49c3-bc20-93c16dcb917b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.756192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2841ae-4010-49c3-bc20-93c16dcb917b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.757318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f2841ae-4010-49c3-bc20-93c16dcb917b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.904156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-f552e306-dc37-4808-9dd0-6878aa28780c req-d2199ca2-3a91-417d-8dc3-eb66e09c1161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57fcaa5-8079-4e68-b4e5-b7d92bdd6525", "name": "network-vif-plugged", "status": "completed", "tag": "4aec5492-d085-447e-b914-88f4d59734e6"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:53.914394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f2841ae-4010-49c3-bc20-93c16dcb917b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:53.920768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f552e306-dc37-4808-9dd0-6878aa28780c req-d2199ca2-3a91-417d-8dc3-eb66e09c1161 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.921609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f552e306-dc37-4808-9dd0-6878aa28780c req-d2199ca2-3a91-417d-8dc3-eb66e09c1161 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.922274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-f552e306-dc37-4808-9dd0-6878aa28780c req-d2199ca2-3a91-417d-8dc3-eb66e09c1161 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.924304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f2841ae-4010-49c3-bc20-93c16dcb917b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1374 microversion: 2.1 time: 0.183111 Oct 04 18:48:53.935217 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-f552e306-dc37-4808-9dd0-6878aa28780c req-d2199ca2-3a91-417d-8dc3-eb66e09c1161 service nova] Creating event network-vif-plugged:4aec5492-d085-447e-b914-88f4d59734e6 for instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 on n-h1-850499-14 Oct 04 18:48:53.940566 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3388/6787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:53 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1374 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:53.943843 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-f552e306-dc37-4808-9dd0-6878aa28780c req-d2199ca2-3a91-417d-8dc3-eb66e09c1161 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047861 Oct 04 18:48:53.946347 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3400/6788] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:54.198359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-70d70152-dd1a-4f47-a8b3-14e3d2171d63 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:54.198996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-70d70152-dd1a-4f47-a8b3-14e3d2171d63 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:54.205874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d70152-dd1a-4f47-a8b3-14e3d2171d63 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.206359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d70152-dd1a-4f47-a8b3-14e3d2171d63 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.206802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d70152-dd1a-4f47-a8b3-14e3d2171d63 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.207680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d70152-dd1a-4f47-a8b3-14e3d2171d63 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.208144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d70152-dd1a-4f47-a8b3-14e3d2171d63 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.208570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-70d70152-dd1a-4f47-a8b3-14e3d2171d63 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.353794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-70d70152-dd1a-4f47-a8b3-14e3d2171d63 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:54.361747 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-70d70152-dd1a-4f47-a8b3-14e3d2171d63 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1217 microversion: 2.1 time: 0.167764 Oct 04 18:48:54.362327 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3389/6789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:54 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:54.949064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80839b75-dfd9-4924-95bf-f3e8b57a2106 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:54.949769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-80839b75-dfd9-4924-95bf-f3e8b57a2106 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:54.956069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80839b75-dfd9-4924-95bf-f3e8b57a2106 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.956568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80839b75-dfd9-4924-95bf-f3e8b57a2106 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.957016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80839b75-dfd9-4924-95bf-f3e8b57a2106 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.957717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80839b75-dfd9-4924-95bf-f3e8b57a2106 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.958182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80839b75-dfd9-4924-95bf-f3e8b57a2106 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.958614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80839b75-dfd9-4924-95bf-f3e8b57a2106 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.101356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-80839b75-dfd9-4924-95bf-f3e8b57a2106 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:55.109207 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80839b75-dfd9-4924-95bf-f3e8b57a2106 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1374 microversion: 2.1 time: 0.166039 Oct 04 18:48:55.109790 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3401/6790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:54 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:55.385537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ee0c622-72d6-4a90-b272-735647125b27 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:55.386299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ee0c622-72d6-4a90-b272-735647125b27 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:55.396008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee0c622-72d6-4a90-b272-735647125b27 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.397097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee0c622-72d6-4a90-b272-735647125b27 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.397262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee0c622-72d6-4a90-b272-735647125b27 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.398658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee0c622-72d6-4a90-b272-735647125b27 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.399155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee0c622-72d6-4a90-b272-735647125b27 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.399594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ee0c622-72d6-4a90-b272-735647125b27 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.541843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ee0c622-72d6-4a90-b272-735647125b27 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:55.549963 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ee0c622-72d6-4a90-b272-735647125b27 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1217 microversion: 2.1 time: 0.169743 Oct 04 18:48:55.550550 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3390/6791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:55 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:56.132663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-da11ecd1-11d3-42ef-9800-c1f87660d565 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:56.133280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-da11ecd1-11d3-42ef-9800-c1f87660d565 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:56.140311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da11ecd1-11d3-42ef-9800-c1f87660d565 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.140806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da11ecd1-11d3-42ef-9800-c1f87660d565 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.141260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da11ecd1-11d3-42ef-9800-c1f87660d565 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.142009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da11ecd1-11d3-42ef-9800-c1f87660d565 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.142467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da11ecd1-11d3-42ef-9800-c1f87660d565 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.142900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da11ecd1-11d3-42ef-9800-c1f87660d565 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.287717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-da11ecd1-11d3-42ef-9800-c1f87660d565 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:56.296464 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-da11ecd1-11d3-42ef-9800-c1f87660d565 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1374 microversion: 2.1 time: 0.167866 Oct 04 18:48:56.297061 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3402/6792] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:56 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:56.574174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c45047d1-f869-477a-98a5-bfe95e66cc49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:56.574825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c45047d1-f869-477a-98a5-bfe95e66cc49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:56.582045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45047d1-f869-477a-98a5-bfe95e66cc49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.582542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45047d1-f869-477a-98a5-bfe95e66cc49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.583010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45047d1-f869-477a-98a5-bfe95e66cc49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.583831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45047d1-f869-477a-98a5-bfe95e66cc49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.584435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45047d1-f869-477a-98a5-bfe95e66cc49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.585479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c45047d1-f869-477a-98a5-bfe95e66cc49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.718211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c45047d1-f869-477a-98a5-bfe95e66cc49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:56.726597 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c45047d1-f869-477a-98a5-bfe95e66cc49 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1404 microversion: 2.1 time: 0.157205 Oct 04 18:48:56.727228 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3391/6793] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:56 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:56.748843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f3718b2f-3eab-4590-96d8-3f851c80efe8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:56.749460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f3718b2f-3eab-4590-96d8-3f851c80efe8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:56.755716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3718b2f-3eab-4590-96d8-3f851c80efe8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.756239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3718b2f-3eab-4590-96d8-3f851c80efe8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.757162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3718b2f-3eab-4590-96d8-3f851c80efe8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.757960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3718b2f-3eab-4590-96d8-3f851c80efe8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.758654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3718b2f-3eab-4590-96d8-3f851c80efe8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.759120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f3718b2f-3eab-4590-96d8-3f851c80efe8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.899717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f3718b2f-3eab-4590-96d8-3f851c80efe8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:56.907750 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f3718b2f-3eab-4590-96d8-3f851c80efe8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1404 microversion: 2.1 time: 0.162751 Oct 04 18:48:56.908342 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3403/6794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:56 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:56.931313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-675656552"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:56.933815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:56.939886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.940389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.940840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.941563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.942105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.942542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.039686 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.compute.api [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Attempting to quiesce instance before volume snapshot. Oct 04 18:48:57.093860 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.compute.api [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 18:48:57.168044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Creating snapshot from volume cb3693ca-d010-4fab-99b1-70553e19a3b3. {{(pid=122331) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 18:48:57.321617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9ebc9d7-78a6-4672-853b-c2c1a8929e3f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:57.322405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9ebc9d7-78a6-4672-853b-c2c1a8929e3f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:57.329575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ebc9d7-78a6-4672-853b-c2c1a8929e3f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.330098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ebc9d7-78a6-4672-853b-c2c1a8929e3f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.330505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ebc9d7-78a6-4672-853b-c2c1a8929e3f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.331241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ebc9d7-78a6-4672-853b-c2c1a8929e3f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.331698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ebc9d7-78a6-4672-853b-c2c1a8929e3f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.332125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9ebc9d7-78a6-4672-853b-c2c1a8929e3f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.493679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9ebc9d7-78a6-4672-853b-c2c1a8929e3f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:57.502652 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9ebc9d7-78a6-4672-853b-c2c1a8929e3f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1374 microversion: 2.1 time: 0.185909 Oct 04 18:48:57.503269 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3404/6795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:57 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:58.034010 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4e87a28a-bc7d-45f3-9d44-f2bb3dbb93f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "POST /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525/action" status: 202 len: 0 microversion: 2.1 time: 1.107224 Oct 04 18:48:58.037615 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3392/6796] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:56 2022] POST /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525/action => generated 0 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:48:58.526772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a11610f9-2b9d-47a1-9b2d-0de3bf9fb13b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:58.527731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a11610f9-2b9d-47a1-9b2d-0de3bf9fb13b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:58.535407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a11610f9-2b9d-47a1-9b2d-0de3bf9fb13b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.535720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a11610f9-2b9d-47a1-9b2d-0de3bf9fb13b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.536144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a11610f9-2b9d-47a1-9b2d-0de3bf9fb13b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.536876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a11610f9-2b9d-47a1-9b2d-0de3bf9fb13b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.537391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a11610f9-2b9d-47a1-9b2d-0de3bf9fb13b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.537838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a11610f9-2b9d-47a1-9b2d-0de3bf9fb13b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.740237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a11610f9-2b9d-47a1-9b2d-0de3bf9fb13b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:58.750839 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a11610f9-2b9d-47a1-9b2d-0de3bf9fb13b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1374 microversion: 2.1 time: 0.228649 Oct 04 18:48:58.752020 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3405/6797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:58 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1374 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:59.202075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1691149513", "imageRef": "34aba468-95fb-4f8d-b181-f557afa13ff3", "flavorRef": "452", "networks": [{"uuid": "d7231cfd-11da-40a4-8d73-d5073342969a"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:59.262543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] validate_networks() for [('d7231cfd-11da-40a4-8d73-d5073342969a', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:48:59.637440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:59.637938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:59.638411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:59.638839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:59.639292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:59.649568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.650394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.650852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.651781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.652258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.652702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.671660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:59.677293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for user 594483c9afdc4f69a6d02f10e8fde137 and project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:59.690235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:59.693887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='899a7aec-e12f-444d-8d59-bd16dcb4d761',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:59.776906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f16f3b3-58e4-4848-a512-c8012406d9be tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:59.777702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3f16f3b3-58e4-4848-a512-c8012406d9be tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:59.777849 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-754dbcb4-388a-4d87-b1eb-6a00b2a4c80b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580844 Oct 04 18:48:59.778678 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3393/6798] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:48:59.785133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f16f3b3-58e4-4848-a512-c8012406d9be tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.785751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f16f3b3-58e4-4848-a512-c8012406d9be tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.786196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f16f3b3-58e4-4848-a512-c8012406d9be tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.786911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f16f3b3-58e4-4848-a512-c8012406d9be tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.787397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f16f3b3-58e4-4848-a512-c8012406d9be tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.788445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f16f3b3-58e4-4848-a512-c8012406d9be tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.790254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3115d2d3-7088-47fe-92f6-4b75fd33a0c3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:59.790904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3115d2d3-7088-47fe-92f6-4b75fd33a0c3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:59.874390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3115d2d3-7088-47fe-92f6-4b75fd33a0c3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:59.881985 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3115d2d3-7088-47fe-92f6-4b75fd33a0c3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1230 microversion: 2.1 time: 0.096107 Oct 04 18:48:59.882583 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3394/6799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:59 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:59.951670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3f16f3b3-58e4-4848-a512-c8012406d9be tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:59.959220 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f16f3b3-58e4-4848-a512-c8012406d9be tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1374 microversion: 2.1 time: 0.186930 Oct 04 18:48:59.974700 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3406/6800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:59 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:00.904711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-32b35a7c-bf3f-4f67-8244-8e8449e5e21c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:00.905358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-32b35a7c-bf3f-4f67-8244-8e8449e5e21c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:00.914266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b35a7c-bf3f-4f67-8244-8e8449e5e21c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.914947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b35a7c-bf3f-4f67-8244-8e8449e5e21c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.915808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b35a7c-bf3f-4f67-8244-8e8449e5e21c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.916724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b35a7c-bf3f-4f67-8244-8e8449e5e21c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.917594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b35a7c-bf3f-4f67-8244-8e8449e5e21c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.918204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b35a7c-bf3f-4f67-8244-8e8449e5e21c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.985169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb0f60cd-24cc-4aeb-a6d3-f88cb635801e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:00.985772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb0f60cd-24cc-4aeb-a6d3-f88cb635801e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:00.988016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=8 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:00.995725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb0f60cd-24cc-4aeb-a6d3-f88cb635801e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.996275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb0f60cd-24cc-4aeb-a6d3-f88cb635801e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.996669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb0f60cd-24cc-4aeb-a6d3-f88cb635801e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.997377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb0f60cd-24cc-4aeb-a6d3-f88cb635801e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.998057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb0f60cd-24cc-4aeb-a6d3-f88cb635801e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.998684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb0f60cd-24cc-4aeb-a6d3-f88cb635801e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.002549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-32b35a7c-bf3f-4f67-8244-8e8449e5e21c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:01.016135 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-32b35a7c-bf3f-4f67-8244-8e8449e5e21c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1300 microversion: 2.1 time: 0.115317 Oct 04 18:49:01.016746 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3395/6801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:00 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:01.234194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb0f60cd-24cc-4aeb-a6d3-f88cb635801e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:01.247469 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb0f60cd-24cc-4aeb-a6d3-f88cb635801e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1374 microversion: 2.1 time: 0.265821 Oct 04 18:49:01.248697 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3407/6802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:00 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1374 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:01.744984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2c60de56-0784-401b-aa3a-9c57d2864dac req-f80310bc-d378-4176-9f61-ec7d82719ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33790005-f41e-4fa8-b70c-294c1b2f93a8", "name": "network-vif-plugged", "status": "completed", "tag": "c6837215-fc83-41ca-bce0-0c1f0e5a8f13"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:01.757138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2c60de56-0784-401b-aa3a-9c57d2864dac req-f80310bc-d378-4176-9f61-ec7d82719ced service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.758064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2c60de56-0784-401b-aa3a-9c57d2864dac req-f80310bc-d378-4176-9f61-ec7d82719ced service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.758770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2c60de56-0784-401b-aa3a-9c57d2864dac req-f80310bc-d378-4176-9f61-ec7d82719ced service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.764800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:01.776688 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2c60de56-0784-401b-aa3a-9c57d2864dac req-f80310bc-d378-4176-9f61-ec7d82719ced service nova] Creating event network-vif-plugged:c6837215-fc83-41ca-bce0-0c1f0e5a8f13 for instance 33790005-f41e-4fa8-b70c-294c1b2f93a8 on n-h2-850499-14 Oct 04 18:49:01.783930 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2c60de56-0784-401b-aa3a-9c57d2864dac req-f80310bc-d378-4176-9f61-ec7d82719ced service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042671 Oct 04 18:49:01.785357 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3396/6803] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:02.041396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5edef713-0eb6-4828-9741-0ddbdcdc772c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:02.042450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5edef713-0eb6-4828-9741-0ddbdcdc772c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:02.059756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5edef713-0eb6-4828-9741-0ddbdcdc772c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.060715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5edef713-0eb6-4828-9741-0ddbdcdc772c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.061242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5edef713-0eb6-4828-9741-0ddbdcdc772c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.062260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5edef713-0eb6-4828-9741-0ddbdcdc772c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.062490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5edef713-0eb6-4828-9741-0ddbdcdc772c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.063110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5edef713-0eb6-4828-9741-0ddbdcdc772c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.278622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a73953d0-05cb-41fc-8df0-4e4441f38a53 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:02.281059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a73953d0-05cb-41fc-8df0-4e4441f38a53 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:02.291052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a73953d0-05cb-41fc-8df0-4e4441f38a53 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.291643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a73953d0-05cb-41fc-8df0-4e4441f38a53 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.292109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a73953d0-05cb-41fc-8df0-4e4441f38a53 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.294263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a73953d0-05cb-41fc-8df0-4e4441f38a53 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.295036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a73953d0-05cb-41fc-8df0-4e4441f38a53 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.295684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a73953d0-05cb-41fc-8df0-4e4441f38a53 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.328214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5edef713-0eb6-4828-9741-0ddbdcdc772c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:02.339990 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5edef713-0eb6-4828-9741-0ddbdcdc772c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.301920 Oct 04 18:49:02.341868 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3408/6804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:02 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:02.575261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a73953d0-05cb-41fc-8df0-4e4441f38a53 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:02.583365 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a73953d0-05cb-41fc-8df0-4e4441f38a53 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1374 microversion: 2.1 time: 0.312222 Oct 04 18:49:02.584227 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3397/6805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:02 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1374 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:02.996623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b3017c4b-3076-4587-9d9b-be79855c4f24 req-a8c1a57a-67f6-47a4-8c1e-ad3e1bfc444b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94311d84-1f8a-4e84-8bba-1289a84a73cd", "tag": "5f1b93a0-8f63-47f5-8ff7-529a7eea7f59"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:03.009168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b3017c4b-3076-4587-9d9b-be79855c4f24 req-a8c1a57a-67f6-47a4-8c1e-ad3e1bfc444b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.009844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b3017c4b-3076-4587-9d9b-be79855c4f24 req-a8c1a57a-67f6-47a4-8c1e-ad3e1bfc444b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.010566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b3017c4b-3076-4587-9d9b-be79855c4f24 req-a8c1a57a-67f6-47a4-8c1e-ad3e1bfc444b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.027665 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b3017c4b-3076-4587-9d9b-be79855c4f24 req-a8c1a57a-67f6-47a4-8c1e-ad3e1bfc444b service nova] Creating event network-changed:5f1b93a0-8f63-47f5-8ff7-529a7eea7f59 for instance 94311d84-1f8a-4e84-8bba-1289a84a73cd on n-h1-850499-14 Oct 04 18:49:03.033945 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b3017c4b-3076-4587-9d9b-be79855c4f24 req-a8c1a57a-67f6-47a4-8c1e-ad3e1bfc444b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042328 Oct 04 18:49:03.034790 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3409/6806] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:03.364816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-840cd64e-58db-4399-9a71-c1fd8854df62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:03.365879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-840cd64e-58db-4399-9a71-c1fd8854df62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:03.373294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-840cd64e-58db-4399-9a71-c1fd8854df62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.373818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-840cd64e-58db-4399-9a71-c1fd8854df62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.374288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-840cd64e-58db-4399-9a71-c1fd8854df62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.375074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-840cd64e-58db-4399-9a71-c1fd8854df62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.375874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-840cd64e-58db-4399-9a71-c1fd8854df62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.376335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-840cd64e-58db-4399-9a71-c1fd8854df62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.575306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-840cd64e-58db-4399-9a71-c1fd8854df62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.588700 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-840cd64e-58db-4399-9a71-c1fd8854df62 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.227424 Oct 04 18:49:03.590254 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3398/6807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:03 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:03.610629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a5ddd810-966d-40dd-b838-dcead94098fd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:03.611373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a5ddd810-966d-40dd-b838-dcead94098fd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:03.624338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5ddd810-966d-40dd-b838-dcead94098fd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.624892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5ddd810-966d-40dd-b838-dcead94098fd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.625349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5ddd810-966d-40dd-b838-dcead94098fd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.627246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5ddd810-966d-40dd-b838-dcead94098fd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.627718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5ddd810-966d-40dd-b838-dcead94098fd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.628160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5ddd810-966d-40dd-b838-dcead94098fd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.648479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=100 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:03.864932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a5ddd810-966d-40dd-b838-dcead94098fd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.875008 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a5ddd810-966d-40dd-b838-dcead94098fd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1547 microversion: 2.1 time: 0.268396 Oct 04 18:49:03.875636 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3410/6808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:03 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1547 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:03.898047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-30e24973-73cf-4199-8662-eefc66bccab5 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:03.898680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-30e24973-73cf-4199-8662-eefc66bccab5 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:03.905454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30e24973-73cf-4199-8662-eefc66bccab5 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.906286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30e24973-73cf-4199-8662-eefc66bccab5 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.906751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30e24973-73cf-4199-8662-eefc66bccab5 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.907517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30e24973-73cf-4199-8662-eefc66bccab5 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.907995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30e24973-73cf-4199-8662-eefc66bccab5 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.908494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-30e24973-73cf-4199-8662-eefc66bccab5 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.159648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-30e24973-73cf-4199-8662-eefc66bccab5 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:04.172206 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-30e24973-73cf-4199-8662-eefc66bccab5 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1547 microversion: 2.1 time: 0.278005 Oct 04 18:49:04.176669 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3399/6809] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:03 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1547 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:04.616721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-662bc022-405f-42c8-ad53-66b62d0b27ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:04.617813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-662bc022-405f-42c8-ad53-66b62d0b27ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:04.625656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-662bc022-405f-42c8-ad53-66b62d0b27ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.626220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-662bc022-405f-42c8-ad53-66b62d0b27ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.626840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-662bc022-405f-42c8-ad53-66b62d0b27ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.627679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-662bc022-405f-42c8-ad53-66b62d0b27ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.628434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-662bc022-405f-42c8-ad53-66b62d0b27ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.628960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-662bc022-405f-42c8-ad53-66b62d0b27ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.793833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-662bc022-405f-42c8-ad53-66b62d0b27ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:04.805533 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-662bc022-405f-42c8-ad53-66b62d0b27ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.192939 Oct 04 18:49:04.809986 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3411/6810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:04 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:05.841378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-92475a60-17f6-4bb9-8db6-6d78c810b453 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:05.842814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-92475a60-17f6-4bb9-8db6-6d78c810b453 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:05.851729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92475a60-17f6-4bb9-8db6-6d78c810b453 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.851729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92475a60-17f6-4bb9-8db6-6d78c810b453 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.852529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92475a60-17f6-4bb9-8db6-6d78c810b453 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.853265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92475a60-17f6-4bb9-8db6-6d78c810b453 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.853762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92475a60-17f6-4bb9-8db6-6d78c810b453 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.854510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92475a60-17f6-4bb9-8db6-6d78c810b453 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.160995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-92475a60-17f6-4bb9-8db6-6d78c810b453 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:06.183628 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-92475a60-17f6-4bb9-8db6-6d78c810b453 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.348448 Oct 04 18:49:06.198505 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3400/6811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:05 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:07.232994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-30572cda-e0b1-446e-a4f2-c04baebf6734 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:07.234035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-30572cda-e0b1-446e-a4f2-c04baebf6734 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:07.244033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30572cda-e0b1-446e-a4f2-c04baebf6734 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.245515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30572cda-e0b1-446e-a4f2-c04baebf6734 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.246232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30572cda-e0b1-446e-a4f2-c04baebf6734 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.247285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30572cda-e0b1-446e-a4f2-c04baebf6734 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.248023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30572cda-e0b1-446e-a4f2-c04baebf6734 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.248711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-30572cda-e0b1-446e-a4f2-c04baebf6734 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.573766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-30572cda-e0b1-446e-a4f2-c04baebf6734 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:07.583031 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-30572cda-e0b1-446e-a4f2-c04baebf6734 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.355194 Oct 04 18:49:07.585574 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3412/6812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:07 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:08.618375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-caf62a5d-513e-4b84-b3b0-783681a93bd0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:08.619123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-caf62a5d-513e-4b84-b3b0-783681a93bd0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.626498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:08.628925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caf62a5d-513e-4b84-b3b0-783681a93bd0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.629422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caf62a5d-513e-4b84-b3b0-783681a93bd0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.629887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caf62a5d-513e-4b84-b3b0-783681a93bd0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.630625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caf62a5d-513e-4b84-b3b0-783681a93bd0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.631137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caf62a5d-513e-4b84-b3b0-783681a93bd0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.631809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-caf62a5d-513e-4b84-b3b0-783681a93bd0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.817744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-caf62a5d-513e-4b84-b3b0-783681a93bd0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:08.826678 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-caf62a5d-513e-4b84-b3b0-783681a93bd0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.216362 Oct 04 18:49:08.827497 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3401/6813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:08 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:09.850338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9aa14554-1604-454b-a966-451cb6c8b198 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:09.851014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9aa14554-1604-454b-a966-451cb6c8b198 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:09.855115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:09.859262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa14554-1604-454b-a966-451cb6c8b198 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.859765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa14554-1604-454b-a966-451cb6c8b198 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.860212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa14554-1604-454b-a966-451cb6c8b198 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.860929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa14554-1604-454b-a966-451cb6c8b198 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.861399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa14554-1604-454b-a966-451cb6c8b198 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.861835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa14554-1604-454b-a966-451cb6c8b198 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.006095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9aa14554-1604-454b-a966-451cb6c8b198 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:10.019523 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9aa14554-1604-454b-a966-451cb6c8b198 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.172976 Oct 04 18:49:10.020444 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3413/6814] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:09 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:11.043743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5783d684-4862-4244-bccc-ed95f978ae14 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:11.044393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5783d684-4862-4244-bccc-ed95f978ae14 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:11.047147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:11.048039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=14 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:11.054521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5783d684-4862-4244-bccc-ed95f978ae14 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.055071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5783d684-4862-4244-bccc-ed95f978ae14 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.055540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5783d684-4862-4244-bccc-ed95f978ae14 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.056281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5783d684-4862-4244-bccc-ed95f978ae14 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.056769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5783d684-4862-4244-bccc-ed95f978ae14 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.057222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5783d684-4862-4244-bccc-ed95f978ae14 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.191980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5783d684-4862-4244-bccc-ed95f978ae14 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:11.200351 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5783d684-4862-4244-bccc-ed95f978ae14 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.160722 Oct 04 18:49:11.200932 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3402/6815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:11 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:12.223498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e2852ab0-43dc-4c8d-983e-5070b18badf7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:12.224924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e2852ab0-43dc-4c8d-983e-5070b18badf7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:12.236191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2852ab0-43dc-4c8d-983e-5070b18badf7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.236964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2852ab0-43dc-4c8d-983e-5070b18badf7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.237517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2852ab0-43dc-4c8d-983e-5070b18badf7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.238507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2852ab0-43dc-4c8d-983e-5070b18badf7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.239129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2852ab0-43dc-4c8d-983e-5070b18badf7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.239666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2852ab0-43dc-4c8d-983e-5070b18badf7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.403318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e2852ab0-43dc-4c8d-983e-5070b18badf7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:12.411142 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e2852ab0-43dc-4c8d-983e-5070b18badf7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.191787 Oct 04 18:49:12.411997 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3414/6816] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:12 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:13.434015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-303602c4-49cc-4e6c-b0b1-8523233f40f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:13.435462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-303602c4-49cc-4e6c-b0b1-8523233f40f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:13.443004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-303602c4-49cc-4e6c-b0b1-8523233f40f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.443521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-303602c4-49cc-4e6c-b0b1-8523233f40f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.444186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-303602c4-49cc-4e6c-b0b1-8523233f40f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.445521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-303602c4-49cc-4e6c-b0b1-8523233f40f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.445917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-303602c4-49cc-4e6c-b0b1-8523233f40f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.446069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-303602c4-49cc-4e6c-b0b1-8523233f40f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.593507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-303602c4-49cc-4e6c-b0b1-8523233f40f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:13.602933 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-303602c4-49cc-4e6c-b0b1-8523233f40f0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.172925 Oct 04 18:49:13.603674 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3403/6817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:13 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:14.628301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e4a2aab-1093-49ab-ad12-d34153b78603 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:14.628922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6e4a2aab-1093-49ab-ad12-d34153b78603 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:14.640081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e4a2aab-1093-49ab-ad12-d34153b78603 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.640835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e4a2aab-1093-49ab-ad12-d34153b78603 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.641292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e4a2aab-1093-49ab-ad12-d34153b78603 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.642050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e4a2aab-1093-49ab-ad12-d34153b78603 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.642503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e4a2aab-1093-49ab-ad12-d34153b78603 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.642933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e4a2aab-1093-49ab-ad12-d34153b78603 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.785067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6e4a2aab-1093-49ab-ad12-d34153b78603 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:14.793681 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e4a2aab-1093-49ab-ad12-d34153b78603 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1342 microversion: 2.1 time: 0.169617 Oct 04 18:49:14.794281 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3415/6818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:14 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:15.818070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5fed75b-0991-4bc1-ab37-0a89ef044683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.818657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a5fed75b-0991-4bc1-ab37-0a89ef044683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:15.826320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5fed75b-0991-4bc1-ab37-0a89ef044683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.826833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5fed75b-0991-4bc1-ab37-0a89ef044683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.827329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5fed75b-0991-4bc1-ab37-0a89ef044683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.828052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5fed75b-0991-4bc1-ab37-0a89ef044683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.828534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5fed75b-0991-4bc1-ab37-0a89ef044683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.828982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5fed75b-0991-4bc1-ab37-0a89ef044683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.962334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a5fed75b-0991-4bc1-ab37-0a89ef044683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:15.970681 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a5fed75b-0991-4bc1-ab37-0a89ef044683 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1376 microversion: 2.1 time: 0.156768 Oct 04 18:49:15.971293 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3404/6819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:15 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:16.993292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c27f621-5d78-4379-8738-5988ceea5483 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:16.993886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c27f621-5d78-4379-8738-5988ceea5483 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:17.000857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c27f621-5d78-4379-8738-5988ceea5483 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:17.001345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c27f621-5d78-4379-8738-5988ceea5483 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:17.001789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c27f621-5d78-4379-8738-5988ceea5483 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.002489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c27f621-5d78-4379-8738-5988ceea5483 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:17.002941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c27f621-5d78-4379-8738-5988ceea5483 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:17.003400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c27f621-5d78-4379-8738-5988ceea5483 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.137325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c27f621-5d78-4379-8738-5988ceea5483 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:17.145101 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c27f621-5d78-4379-8738-5988ceea5483 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1376 microversion: 2.1 time: 0.156280 Oct 04 18:49:17.145673 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3416/6820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:16 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:18.169510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d22b1778-e5af-4ac2-bf0b-18d8d965432f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:18.170036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d22b1778-e5af-4ac2-bf0b-18d8d965432f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:18.177100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d22b1778-e5af-4ac2-bf0b-18d8d965432f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.177602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d22b1778-e5af-4ac2-bf0b-18d8d965432f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.178063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d22b1778-e5af-4ac2-bf0b-18d8d965432f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.178882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d22b1778-e5af-4ac2-bf0b-18d8d965432f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.179400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d22b1778-e5af-4ac2-bf0b-18d8d965432f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.179839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d22b1778-e5af-4ac2-bf0b-18d8d965432f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.326746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d22b1778-e5af-4ac2-bf0b-18d8d965432f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:18.336198 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d22b1778-e5af-4ac2-bf0b-18d8d965432f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1376 microversion: 2.1 time: 0.170854 Oct 04 18:49:18.336978 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3405/6821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:18 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:19.359990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-959dd735-a65b-4cbe-9082-66591ae02971 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:19.360636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-959dd735-a65b-4cbe-9082-66591ae02971 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:19.367971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-959dd735-a65b-4cbe-9082-66591ae02971 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.368464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-959dd735-a65b-4cbe-9082-66591ae02971 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.368907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-959dd735-a65b-4cbe-9082-66591ae02971 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.369606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-959dd735-a65b-4cbe-9082-66591ae02971 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.370066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-959dd735-a65b-4cbe-9082-66591ae02971 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.370526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-959dd735-a65b-4cbe-9082-66591ae02971 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.506486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-959dd735-a65b-4cbe-9082-66591ae02971 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:19.515130 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-959dd735-a65b-4cbe-9082-66591ae02971 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1376 microversion: 2.1 time: 0.158959 Oct 04 18:49:19.515706 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3417/6822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:19 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:20.538685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90c55486-8a85-40f5-ab94-9449280f901c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:20.539583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90c55486-8a85-40f5-ab94-9449280f901c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:20.547437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c55486-8a85-40f5-ab94-9449280f901c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.547949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c55486-8a85-40f5-ab94-9449280f901c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.548410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c55486-8a85-40f5-ab94-9449280f901c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.549142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c55486-8a85-40f5-ab94-9449280f901c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.549617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c55486-8a85-40f5-ab94-9449280f901c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.550064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90c55486-8a85-40f5-ab94-9449280f901c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.696358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90c55486-8a85-40f5-ab94-9449280f901c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:20.705763 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90c55486-8a85-40f5-ab94-9449280f901c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1376 microversion: 2.1 time: 0.171530 Oct 04 18:49:20.706446 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3406/6823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:20 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:21.731070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-650a5996-8772-46ac-bb14-f57137c7d5d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:21.731642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-650a5996-8772-46ac-bb14-f57137c7d5d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:21.739102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-650a5996-8772-46ac-bb14-f57137c7d5d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.739645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-650a5996-8772-46ac-bb14-f57137c7d5d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.740095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-650a5996-8772-46ac-bb14-f57137c7d5d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.741587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-650a5996-8772-46ac-bb14-f57137c7d5d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.741587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-650a5996-8772-46ac-bb14-f57137c7d5d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.741921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-650a5996-8772-46ac-bb14-f57137c7d5d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.889780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-650a5996-8772-46ac-bb14-f57137c7d5d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:21.899175 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-650a5996-8772-46ac-bb14-f57137c7d5d4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1376 microversion: 2.1 time: 0.172046 Oct 04 18:49:21.899857 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3418/6824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:21 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1376 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:22.927484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-22c1478a-25a0-4084-95de-7957082517bb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:22.928602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-22c1478a-25a0-4084-95de-7957082517bb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:22.936182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c1478a-25a0-4084-95de-7957082517bb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.936699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c1478a-25a0-4084-95de-7957082517bb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.937162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c1478a-25a0-4084-95de-7957082517bb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.937902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c1478a-25a0-4084-95de-7957082517bb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.938380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c1478a-25a0-4084-95de-7957082517bb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.939199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c1478a-25a0-4084-95de-7957082517bb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.086443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-22c1478a-25a0-4084-95de-7957082517bb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:23.101313 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-22c1478a-25a0-4084-95de-7957082517bb tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1376 microversion: 2.1 time: 0.180039 Oct 04 18:49:23.102242 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3407/6825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:22 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1376 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:24.125139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-407eb0f0-6166-46d2-a9c0-6bbfef3d4982 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:24.125849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-407eb0f0-6166-46d2-a9c0-6bbfef3d4982 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:24.133544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-407eb0f0-6166-46d2-a9c0-6bbfef3d4982 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.134215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-407eb0f0-6166-46d2-a9c0-6bbfef3d4982 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.134789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-407eb0f0-6166-46d2-a9c0-6bbfef3d4982 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.135615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-407eb0f0-6166-46d2-a9c0-6bbfef3d4982 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.136087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-407eb0f0-6166-46d2-a9c0-6bbfef3d4982 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.136527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-407eb0f0-6166-46d2-a9c0-6bbfef3d4982 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.279389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-407eb0f0-6166-46d2-a9c0-6bbfef3d4982 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:24.287047 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-407eb0f0-6166-46d2-a9c0-6bbfef3d4982 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1376 microversion: 2.1 time: 0.165809 Oct 04 18:49:24.287669 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3419/6826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:24 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:25.310207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5352c330-b17f-427d-b47a-772d7d9ce26c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:25.310897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5352c330-b17f-427d-b47a-772d7d9ce26c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:25.317935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5352c330-b17f-427d-b47a-772d7d9ce26c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.318730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5352c330-b17f-427d-b47a-772d7d9ce26c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.319244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5352c330-b17f-427d-b47a-772d7d9ce26c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.319959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5352c330-b17f-427d-b47a-772d7d9ce26c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.320439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5352c330-b17f-427d-b47a-772d7d9ce26c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.320882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5352c330-b17f-427d-b47a-772d7d9ce26c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.470144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5352c330-b17f-427d-b47a-772d7d9ce26c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:25.478790 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5352c330-b17f-427d-b47a-772d7d9ce26c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1376 microversion: 2.1 time: 0.172785 Oct 04 18:49:25.479416 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3408/6827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:25 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1376 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:26.104135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-efb77cdc-9fbe-413c-a56d-d99e289fa167 req-eba0e7fc-6c80-44c8-94a5-a94b484bde68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94311d84-1f8a-4e84-8bba-1289a84a73cd", "name": "network-vif-plugged", "status": "completed", "tag": "5f1b93a0-8f63-47f5-8ff7-529a7eea7f59"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:26.114641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-efb77cdc-9fbe-413c-a56d-d99e289fa167 req-eba0e7fc-6c80-44c8-94a5-a94b484bde68 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.115207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-efb77cdc-9fbe-413c-a56d-d99e289fa167 req-eba0e7fc-6c80-44c8-94a5-a94b484bde68 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.115704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-efb77cdc-9fbe-413c-a56d-d99e289fa167 req-eba0e7fc-6c80-44c8-94a5-a94b484bde68 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.128445 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-efb77cdc-9fbe-413c-a56d-d99e289fa167 req-eba0e7fc-6c80-44c8-94a5-a94b484bde68 service nova] Creating event network-vif-plugged:5f1b93a0-8f63-47f5-8ff7-529a7eea7f59 for instance 94311d84-1f8a-4e84-8bba-1289a84a73cd on n-h1-850499-14 Oct 04 18:49:26.134733 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-efb77cdc-9fbe-413c-a56d-d99e289fa167 req-eba0e7fc-6c80-44c8-94a5-a94b484bde68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035975 Oct 04 18:49:26.135704 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3420/6828] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:26.503190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a1af5050-8e3f-4c89-90f0-03c01ac2c643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:26.503786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a1af5050-8e3f-4c89-90f0-03c01ac2c643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:26.512950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1af5050-8e3f-4c89-90f0-03c01ac2c643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.513635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1af5050-8e3f-4c89-90f0-03c01ac2c643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.514143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1af5050-8e3f-4c89-90f0-03c01ac2c643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.515220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1af5050-8e3f-4c89-90f0-03c01ac2c643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.515878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1af5050-8e3f-4c89-90f0-03c01ac2c643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.516528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a1af5050-8e3f-4c89-90f0-03c01ac2c643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.671927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a1af5050-8e3f-4c89-90f0-03c01ac2c643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:26.681434 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a1af5050-8e3f-4c89-90f0-03c01ac2c643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1376 microversion: 2.1 time: 0.183349 Oct 04 18:49:26.682038 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3409/6829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:26 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:27.708167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-07fd5cf0-1b83-46d3-97e2-41219d0cfda5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:27.709260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-07fd5cf0-1b83-46d3-97e2-41219d0cfda5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:27.718165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07fd5cf0-1b83-46d3-97e2-41219d0cfda5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.719068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07fd5cf0-1b83-46d3-97e2-41219d0cfda5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.719680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07fd5cf0-1b83-46d3-97e2-41219d0cfda5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.720662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07fd5cf0-1b83-46d3-97e2-41219d0cfda5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.721376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07fd5cf0-1b83-46d3-97e2-41219d0cfda5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.722101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07fd5cf0-1b83-46d3-97e2-41219d0cfda5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.869714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-07fd5cf0-1b83-46d3-97e2-41219d0cfda5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:27.879903 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-07fd5cf0-1b83-46d3-97e2-41219d0cfda5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1564 microversion: 2.1 time: 0.177455 Oct 04 18:49:27.880656 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3421/6830] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:27 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:27.905447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ed78403-69f9-444d-9b5f-b7194c80350e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:27.906205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ed78403-69f9-444d-9b5f-b7194c80350e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:27.914352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed78403-69f9-444d-9b5f-b7194c80350e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.914864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed78403-69f9-444d-9b5f-b7194c80350e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.915404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed78403-69f9-444d-9b5f-b7194c80350e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.916132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed78403-69f9-444d-9b5f-b7194c80350e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.916655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed78403-69f9-444d-9b5f-b7194c80350e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.917102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed78403-69f9-444d-9b5f-b7194c80350e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.100091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ed78403-69f9-444d-9b5f-b7194c80350e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:28.109319 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ed78403-69f9-444d-9b5f-b7194c80350e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1564 microversion: 2.1 time: 0.207909 Oct 04 18:49:28.109924 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3410/6831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:27 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1564 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:28.209147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e30749c7-5e38-49af-a875-9d56b0d8d58a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:28.209852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e30749c7-5e38-49af-a875-9d56b0d8d58a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:28.217487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e30749c7-5e38-49af-a875-9d56b0d8d58a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.218123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e30749c7-5e38-49af-a875-9d56b0d8d58a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.218727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e30749c7-5e38-49af-a875-9d56b0d8d58a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.219460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e30749c7-5e38-49af-a875-9d56b0d8d58a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.219920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e30749c7-5e38-49af-a875-9d56b0d8d58a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.220353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e30749c7-5e38-49af-a875-9d56b0d8d58a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.253995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e30749c7-5e38-49af-a875-9d56b0d8d58a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:28.368938 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e30749c7-5e38-49af-a875-9d56b0d8d58a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 204 len: 0 microversion: 2.1 time: 0.163147 Oct 04 18:49:28.370070 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3422/6832] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:28 2022] DELETE /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:28.380219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8b4ca7cd-ea69-493f-ab08-553ed6b0affa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:28.381021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8b4ca7cd-ea69-493f-ab08-553ed6b0affa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:28.390601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b4ca7cd-ea69-493f-ab08-553ed6b0affa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.392375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b4ca7cd-ea69-493f-ab08-553ed6b0affa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.392375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b4ca7cd-ea69-493f-ab08-553ed6b0affa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.392949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b4ca7cd-ea69-493f-ab08-553ed6b0affa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.393437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b4ca7cd-ea69-493f-ab08-553ed6b0affa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.393951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b4ca7cd-ea69-493f-ab08-553ed6b0affa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.546423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8b4ca7cd-ea69-493f-ab08-553ed6b0affa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:28.561291 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8b4ca7cd-ea69-493f-ab08-553ed6b0affa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1570 microversion: 2.1 time: 0.185047 Oct 04 18:49:28.562173 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3411/6833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:28 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:29.586805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-647ff858-88bd-4510-a3d1-5917405fdfa6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:29.587553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-647ff858-88bd-4510-a3d1-5917405fdfa6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:29.594704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-647ff858-88bd-4510-a3d1-5917405fdfa6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.595233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-647ff858-88bd-4510-a3d1-5917405fdfa6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.595676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-647ff858-88bd-4510-a3d1-5917405fdfa6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.596405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-647ff858-88bd-4510-a3d1-5917405fdfa6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.596862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-647ff858-88bd-4510-a3d1-5917405fdfa6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.597292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-647ff858-88bd-4510-a3d1-5917405fdfa6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.739034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-647ff858-88bd-4510-a3d1-5917405fdfa6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:29.750136 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-647ff858-88bd-4510-a3d1-5917405fdfa6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1570 microversion: 2.1 time: 0.167547 Oct 04 18:49:29.751057 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3423/6834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:29 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:30.778295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f74ae09d-7f6f-4b0c-9693-be303fafc4ab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:30.779398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f74ae09d-7f6f-4b0c-9693-be303fafc4ab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:30.787852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f74ae09d-7f6f-4b0c-9693-be303fafc4ab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:30.788400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f74ae09d-7f6f-4b0c-9693-be303fafc4ab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:30.788896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f74ae09d-7f6f-4b0c-9693-be303fafc4ab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:30.789614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f74ae09d-7f6f-4b0c-9693-be303fafc4ab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:30.790119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f74ae09d-7f6f-4b0c-9693-be303fafc4ab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:30.790558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f74ae09d-7f6f-4b0c-9693-be303fafc4ab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.033584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f74ae09d-7f6f-4b0c-9693-be303fafc4ab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:31.054387 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f74ae09d-7f6f-4b0c-9693-be303fafc4ab tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1570 microversion: 2.1 time: 0.281479 Oct 04 18:49:31.072030 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3412/6835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:30 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1570 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:31.147872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-cb1f1282-a80b-4c80-b0f8-bf6e95351e3f req-f13b8ed4-806a-4249-addd-733cda079806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94311d84-1f8a-4e84-8bba-1289a84a73cd", "name": "network-vif-deleted", "tag": "5f1b93a0-8f63-47f5-8ff7-529a7eea7f59"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:31.170448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cb1f1282-a80b-4c80-b0f8-bf6e95351e3f req-f13b8ed4-806a-4249-addd-733cda079806 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.171515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cb1f1282-a80b-4c80-b0f8-bf6e95351e3f req-f13b8ed4-806a-4249-addd-733cda079806 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.173641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-cb1f1282-a80b-4c80-b0f8-bf6e95351e3f req-f13b8ed4-806a-4249-addd-733cda079806 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.204592 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-cb1f1282-a80b-4c80-b0f8-bf6e95351e3f req-f13b8ed4-806a-4249-addd-733cda079806 service nova] Creating event network-vif-deleted:5f1b93a0-8f63-47f5-8ff7-529a7eea7f59 for instance 94311d84-1f8a-4e84-8bba-1289a84a73cd on n-h1-850499-14 Oct 04 18:49:31.211981 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-cb1f1282-a80b-4c80-b0f8-bf6e95351e3f req-f13b8ed4-806a-4249-addd-733cda079806 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073493 Oct 04 18:49:31.213484 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3424/6836] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:32.098508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f9d6d1f-af4d-4f0d-b870-6186bc7d8f28 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:32.099946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f9d6d1f-af4d-4f0d-b870-6186bc7d8f28 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:32.107882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f9d6d1f-af4d-4f0d-b870-6186bc7d8f28 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.108863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f9d6d1f-af4d-4f0d-b870-6186bc7d8f28 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.109298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f9d6d1f-af4d-4f0d-b870-6186bc7d8f28 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.110373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f9d6d1f-af4d-4f0d-b870-6186bc7d8f28 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.110929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f9d6d1f-af4d-4f0d-b870-6186bc7d8f28 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.111814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f9d6d1f-af4d-4f0d-b870-6186bc7d8f28 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.136809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:32.190179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8f9d6d1f-af4d-4f0d-b870-6186bc7d8f28 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:32.200835 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f9d6d1f-af4d-4f0d-b870-6186bc7d8f28 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1361 microversion: 2.1 time: 0.106988 Oct 04 18:49:32.201432 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3413/6837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:32 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1361 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:33.227971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49b40d0b-8279-4284-a03c-2cfd372167b7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:33.228689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-49b40d0b-8279-4284-a03c-2cfd372167b7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:33.236078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49b40d0b-8279-4284-a03c-2cfd372167b7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:33.236580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49b40d0b-8279-4284-a03c-2cfd372167b7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:33.237112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49b40d0b-8279-4284-a03c-2cfd372167b7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:33.237823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49b40d0b-8279-4284-a03c-2cfd372167b7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:33.238283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49b40d0b-8279-4284-a03c-2cfd372167b7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:33.238715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49b40d0b-8279-4284-a03c-2cfd372167b7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:33.309638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-49b40d0b-8279-4284-a03c-2cfd372167b7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:33.318336 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49b40d0b-8279-4284-a03c-2cfd372167b7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1361 microversion: 2.1 time: 0.096355 Oct 04 18:49:33.318925 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3425/6838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:33 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1361 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:34.345871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbd14dea-3db6-4402-af5d-41a8a90f3197 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:34.346853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bbd14dea-3db6-4402-af5d-41a8a90f3197 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:34.355002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd14dea-3db6-4402-af5d-41a8a90f3197 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:34.355794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd14dea-3db6-4402-af5d-41a8a90f3197 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:34.356510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd14dea-3db6-4402-af5d-41a8a90f3197 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:34.357759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd14dea-3db6-4402-af5d-41a8a90f3197 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:34.358637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd14dea-3db6-4402-af5d-41a8a90f3197 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:34.359461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbd14dea-3db6-4402-af5d-41a8a90f3197 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:34.436585 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bbd14dea-3db6-4402-af5d-41a8a90f3197 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:34.452000 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bbd14dea-3db6-4402-af5d-41a8a90f3197 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1361 microversion: 2.1 time: 0.110346 Oct 04 18:49:34.452874 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3414/6839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:34 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1361 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:35.477034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6f01ae91-8f16-422d-995d-d529b97f9917 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:35.477814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6f01ae91-8f16-422d-995d-d529b97f9917 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:35.487368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f01ae91-8f16-422d-995d-d529b97f9917 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.488254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f01ae91-8f16-422d-995d-d529b97f9917 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.488938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f01ae91-8f16-422d-995d-d529b97f9917 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.489718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f01ae91-8f16-422d-995d-d529b97f9917 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.490182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f01ae91-8f16-422d-995d-d529b97f9917 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.490620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f01ae91-8f16-422d-995d-d529b97f9917 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.495176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:35.581114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6f01ae91-8f16-422d-995d-d529b97f9917 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:35.589627 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6f01ae91-8f16-422d-995d-d529b97f9917 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 200 len: 1361 microversion: 2.1 time: 0.116494 Oct 04 18:49:35.590237 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3426/6840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:35 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 1361 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:36.613874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:36.615087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:36.622346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.622862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.623350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.624082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.624558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.625320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.641582 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd HTTP/1.1 Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '94311d84-1f8a-4e84-8bba-1289a84a73cd'} Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:36.643313 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:36.650390 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:36.650390 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:36.650390 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:36.650390 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:36.650390 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:36.650390 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:36.650390 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:36.650390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:36.650390 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d47bca2a-5929-43b9-8f90-cb30b809cd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 404 len: 111 microversion: 2.1 time: 0.034984 Oct 04 18:49:36.650390 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3415/6841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:36 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:40.990431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4b43dee-3f66-449c-ae22-0de8fb8a3017 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:40.991393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4b43dee-3f66-449c-ae22-0de8fb8a3017 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:40.995462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:41.002393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b43dee-3f66-449c-ae22-0de8fb8a3017 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.002915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b43dee-3f66-449c-ae22-0de8fb8a3017 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.003466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b43dee-3f66-449c-ae22-0de8fb8a3017 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.004227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b43dee-3f66-449c-ae22-0de8fb8a3017 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.004702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b43dee-3f66-449c-ae22-0de8fb8a3017 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.005306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4b43dee-3f66-449c-ae22-0de8fb8a3017 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.035076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4b43dee-3f66-449c-ae22-0de8fb8a3017 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:41.122776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d4b43dee-3f66-449c-ae22-0de8fb8a3017 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 204 len: 0 microversion: 2.1 time: 0.137292 Oct 04 18:49:41.123777 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3427/6842] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:40 2022] DELETE /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:41.133190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ccd09150-0d48-465c-b5c0-6984f0fd03af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:41.133954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ccd09150-0d48-465c-b5c0-6984f0fd03af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:41.136952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=30 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:41.143528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccd09150-0d48-465c-b5c0-6984f0fd03af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.144110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccd09150-0d48-465c-b5c0-6984f0fd03af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.144643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccd09150-0d48-465c-b5c0-6984f0fd03af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.145460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccd09150-0d48-465c-b5c0-6984f0fd03af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.146036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccd09150-0d48-465c-b5c0-6984f0fd03af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.146462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ccd09150-0d48-465c-b5c0-6984f0fd03af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.306474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ccd09150-0d48-465c-b5c0-6984f0fd03af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:41.314759 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ccd09150-0d48-465c-b5c0-6984f0fd03af tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1410 microversion: 2.1 time: 0.186131 Oct 04 18:49:41.315395 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3416/6843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:41 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1410 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:42.340437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-25527c90-b24c-4c62-b958-53f59d760909 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:42.341150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-25527c90-b24c-4c62-b958-53f59d760909 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:42.349052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25527c90-b24c-4c62-b958-53f59d760909 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:42.349709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25527c90-b24c-4c62-b958-53f59d760909 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:42.350827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25527c90-b24c-4c62-b958-53f59d760909 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:42.351792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25527c90-b24c-4c62-b958-53f59d760909 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:42.352415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25527c90-b24c-4c62-b958-53f59d760909 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:42.352990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25527c90-b24c-4c62-b958-53f59d760909 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:42.523629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-25527c90-b24c-4c62-b958-53f59d760909 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:42.532157 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-25527c90-b24c-4c62-b958-53f59d760909 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1410 microversion: 2.1 time: 0.196117 Oct 04 18:49:42.532749 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3428/6844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:42 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1410 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:43.503844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-876535f0-6ecb-4c3d-87d8-79484deed492 req-9f923ed4-f0bd-4d63-b3b7-14a55c03959d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57fcaa5-8079-4e68-b4e5-b7d92bdd6525", "name": "network-vif-deleted", "tag": "4aec5492-d085-447e-b914-88f4d59734e6"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:43.516064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-876535f0-6ecb-4c3d-87d8-79484deed492 req-9f923ed4-f0bd-4d63-b3b7-14a55c03959d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.516737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-876535f0-6ecb-4c3d-87d8-79484deed492 req-9f923ed4-f0bd-4d63-b3b7-14a55c03959d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.517440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-876535f0-6ecb-4c3d-87d8-79484deed492 req-9f923ed4-f0bd-4d63-b3b7-14a55c03959d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.532034 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-876535f0-6ecb-4c3d-87d8-79484deed492 req-9f923ed4-f0bd-4d63-b3b7-14a55c03959d service nova] Creating event network-vif-deleted:4aec5492-d085-447e-b914-88f4d59734e6 for instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 on n-h1-850499-14 Oct 04 18:49:43.538026 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-876535f0-6ecb-4c3d-87d8-79484deed492 req-9f923ed4-f0bd-4d63-b3b7-14a55c03959d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037930 Oct 04 18:49:43.538836 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3417/6845] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:43.557866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c10ff3e4-0f5a-4d7f-b0f9-591b518cdec2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:43.558632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c10ff3e4-0f5a-4d7f-b0f9-591b518cdec2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:43.568628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10ff3e4-0f5a-4d7f-b0f9-591b518cdec2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.569725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10ff3e4-0f5a-4d7f-b0f9-591b518cdec2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.570178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10ff3e4-0f5a-4d7f-b0f9-591b518cdec2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.570908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10ff3e4-0f5a-4d7f-b0f9-591b518cdec2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.571480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10ff3e4-0f5a-4d7f-b0f9-591b518cdec2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.572117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c10ff3e4-0f5a-4d7f-b0f9-591b518cdec2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.641752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c10ff3e4-0f5a-4d7f-b0f9-591b518cdec2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:43.651366 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c10ff3e4-0f5a-4d7f-b0f9-591b518cdec2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1202 microversion: 2.1 time: 0.098503 Oct 04 18:49:43.651846 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3429/6846] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:43 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1202 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:44.678776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-700127c6-3a78-47b0-999f-c61ff67e4440 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:44.679650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-700127c6-3a78-47b0-999f-c61ff67e4440 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:44.690444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-700127c6-3a78-47b0-999f-c61ff67e4440 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:44.691154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-700127c6-3a78-47b0-999f-c61ff67e4440 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:44.691767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-700127c6-3a78-47b0-999f-c61ff67e4440 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:44.692791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-700127c6-3a78-47b0-999f-c61ff67e4440 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:44.693674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-700127c6-3a78-47b0-999f-c61ff67e4440 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:44.695114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-700127c6-3a78-47b0-999f-c61ff67e4440 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:44.767208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-700127c6-3a78-47b0-999f-c61ff67e4440 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:44.776844 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-700127c6-3a78-47b0-999f-c61ff67e4440 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1202 microversion: 2.1 time: 0.104487 Oct 04 18:49:44.777431 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3418/6847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:44 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:45.800021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a7781d4-167b-4d75-9f28-8f8d5f6ef1b2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:45.800648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a7781d4-167b-4d75-9f28-8f8d5f6ef1b2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:45.808201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7781d4-167b-4d75-9f28-8f8d5f6ef1b2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:45.808792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7781d4-167b-4d75-9f28-8f8d5f6ef1b2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:45.809237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7781d4-167b-4d75-9f28-8f8d5f6ef1b2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:45.809944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7781d4-167b-4d75-9f28-8f8d5f6ef1b2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:45.810403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7781d4-167b-4d75-9f28-8f8d5f6ef1b2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:45.810831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a7781d4-167b-4d75-9f28-8f8d5f6ef1b2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:45.878332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a7781d4-167b-4d75-9f28-8f8d5f6ef1b2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:45.888124 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a7781d4-167b-4d75-9f28-8f8d5f6ef1b2 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1202 microversion: 2.1 time: 0.092381 Oct 04 18:49:45.888698 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3430/6848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:45 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:46.912587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bf6c5af1-4d73-4a7d-b269-54887a3368be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:46.913320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bf6c5af1-4d73-4a7d-b269-54887a3368be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:46.920519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf6c5af1-4d73-4a7d-b269-54887a3368be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.921023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf6c5af1-4d73-4a7d-b269-54887a3368be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.921478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf6c5af1-4d73-4a7d-b269-54887a3368be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.922204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf6c5af1-4d73-4a7d-b269-54887a3368be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.922681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf6c5af1-4d73-4a7d-b269-54887a3368be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.923165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf6c5af1-4d73-4a7d-b269-54887a3368be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.988002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bf6c5af1-4d73-4a7d-b269-54887a3368be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:46.996274 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bf6c5af1-4d73-4a7d-b269-54887a3368be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1202 microversion: 2.1 time: 0.087806 Oct 04 18:49:46.996857 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3419/6849] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:46 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:48.020394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:48.022550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:48.034919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.035709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.036169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.036894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.037360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.038334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.072810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.073313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.073764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.074229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lazy-loading 'fault' on Instance uuid d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:49:48.125659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:48.138481 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3a257c7d-5ca0-4a61-9d8c-facc7ed5ac77 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 200 len: 1207 microversion: 2.1 time: 0.122755 Oct 04 18:49:48.139523 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3431/6850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:48 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 1207 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:49.024882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4f1f9f5a-ee39-4d28-8f50-3c481db18f64 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:49.025307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4f1f9f5a-ee39-4d28-8f50-3c481db18f64 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:49.032498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1f9f5a-ee39-4d28-8f50-3c481db18f64 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.033263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1f9f5a-ee39-4d28-8f50-3c481db18f64 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.033989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1f9f5a-ee39-4d28-8f50-3c481db18f64 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.034798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1f9f5a-ee39-4d28-8f50-3c481db18f64 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.035385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1f9f5a-ee39-4d28-8f50-3c481db18f64 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.035901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f1f9f5a-ee39-4d28-8f50-3c481db18f64 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.070566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4f1f9f5a-ee39-4d28-8f50-3c481db18f64 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:49.162651 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4f1f9f5a-ee39-4d28-8f50-3c481db18f64 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 204 len: 0 microversion: 2.1 time: 0.143365 Oct 04 18:49:49.163922 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3420/6851] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:49 2022] DELETE /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:49.168100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:49.168793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:49.173886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-12c080f6-b490-4de5-aead-e3daf57ee4a4 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:49.174732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-12c080f6-b490-4de5-aead-e3daf57ee4a4 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:49.177682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.179487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.180180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.181484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.182303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.182855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c080f6-b490-4de5-aead-e3daf57ee4a4 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.183157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.183469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c080f6-b490-4de5-aead-e3daf57ee4a4 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.183933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c080f6-b490-4de5-aead-e3daf57ee4a4 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.184691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c080f6-b490-4de5-aead-e3daf57ee4a4 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.185362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c080f6-b490-4de5-aead-e3daf57ee4a4 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.186045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-12c080f6-b490-4de5-aead-e3daf57ee4a4 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.200827 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 HTTP/1.1 Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'd57fcaa5-8079-4e68-b4e5-b7d92bdd6525'} Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:49.203192 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:49.209161 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:49.209161 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:49.209161 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:49.209161 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:49.209161 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:49.209161 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:49.209161 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:49.209161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:49.209161 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d9926bc3-0cc1-458e-a62d-29eb84f597f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 404 len: 111 microversion: 2.1 time: 0.041380 Oct 04 18:49:49.209161 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3432/6852] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:49 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:49.367411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-12c080f6-b490-4de5-aead-e3daf57ee4a4 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:49.377851 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-12c080f6-b490-4de5-aead-e3daf57ee4a4 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1553 microversion: 2.1 time: 0.209557 Oct 04 18:49:49.378470 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3421/6853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:49 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:50.418359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2befb694-633c-465a-a4a5-f60c2270e2d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:50.419932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2befb694-633c-465a-a4a5-f60c2270e2d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:50.427175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2befb694-633c-465a-a4a5-f60c2270e2d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.427670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2befb694-633c-465a-a4a5-f60c2270e2d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.428414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2befb694-633c-465a-a4a5-f60c2270e2d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.429661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2befb694-633c-465a-a4a5-f60c2270e2d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.431128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2befb694-633c-465a-a4a5-f60c2270e2d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.431128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2befb694-633c-465a-a4a5-f60c2270e2d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.606362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2befb694-633c-465a-a4a5-f60c2270e2d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:50.620728 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2befb694-633c-465a-a4a5-f60c2270e2d2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1553 microversion: 2.1 time: 0.206191 Oct 04 18:49:50.621345 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3433/6854] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:50 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:51.369457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.370038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.376537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.377049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.377567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.378649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.379225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.379801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.396397 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd HTTP/1.1 Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '94311d84-1f8a-4e84-8bba-1289a84a73cd'} Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:51.398162 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c0056d00-fe1e-4314-b076-4968dd4d7dac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 404 len: 111 microversion: 2.1 time: 0.036019 Oct 04 18:49:51.404221 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3422/6855] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:51 2022] DELETE /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:51.408849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.409693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 94311d84-1f8a-4e84-8bba-1289a84a73cd] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.416048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.416537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.416981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.417712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.418180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.418588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd HTTP/1.1 Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '94311d84-1f8a-4e84-8bba-1289a84a73cd'} Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:51.435002 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance 94311d84-1f8a-4e84-8bba-1289a84a73cd could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-df0593db-1fb4-4d68-83de-78f82acbedfc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd" status: 404 len: 111 microversion: 2.1 time: 0.031459 Oct 04 18:49:51.440317 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3434/6856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:51 2022] GET /compute/v2.1/servers/94311d84-1f8a-4e84-8bba-1289a84a73cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:51.646234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65ba4474-f72e-4475-bd01-9caf0e43d39d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.647652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65ba4474-f72e-4475-bd01-9caf0e43d39d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.655211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65ba4474-f72e-4475-bd01-9caf0e43d39d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.656009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65ba4474-f72e-4475-bd01-9caf0e43d39d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.656668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65ba4474-f72e-4475-bd01-9caf0e43d39d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.657657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65ba4474-f72e-4475-bd01-9caf0e43d39d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.659105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65ba4474-f72e-4475-bd01-9caf0e43d39d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.660809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65ba4474-f72e-4475-bd01-9caf0e43d39d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.865575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65ba4474-f72e-4475-bd01-9caf0e43d39d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:51.876242 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65ba4474-f72e-4475-bd01-9caf0e43d39d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 200 len: 1553 microversion: 2.1 time: 0.235610 Oct 04 18:49:51.876830 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3423/6857] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:51 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:51.936542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.937326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.945637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.946132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.946574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.947322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.947785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.948227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.966374 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 HTTP/1.1 Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'd57fcaa5-8079-4e68-b4e5-b7d92bdd6525'} Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:51.968449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d975819-97a9-48df-afd1-994f0098d1c9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 404 len: 111 microversion: 2.1 time: 0.040624 Oct 04 18:49:51.976708 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3435/6858] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:51 2022] DELETE /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:51.981420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.982404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: d57fcaa5-8079-4e68-b4e5-b7d92bdd6525] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.988782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.989242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.989722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.990529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.991379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.991862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.008089 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 HTTP/1.1 Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'd57fcaa5-8079-4e68-b4e5-b7d92bdd6525'} Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:52.009774 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.016148 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:52.016148 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:52.016148 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:52.016148 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:52.016148 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:52.016148 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. Oct 04 18:49:52.016148 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.016148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:52.016148 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d33560d-b4f1-492d-aa67-c0ff64f5eacc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525" status: 404 len: 111 microversion: 2.1 time: 0.034566 Oct 04 18:49:52.016148 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3424/6859] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:51 2022] GET /compute/v2.1/servers/d57fcaa5-8079-4e68-b4e5-b7d92bdd6525 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:52.097273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a0ac0644-f23c-4e6e-9a0e-d9445768a47c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Action: 'create', calling method: .version_select at 0x7fd4d0cde8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1101435800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgvl7hgLNYZvnzKOKuEdxxn3cSoliPSC0V+5BzTpaif8MWoziDO3kzOGwC7utlouS7kqld3RXFyKETwIn2yJU/yZzblDeswCJ1EDubS22s7p490XANLt+MpXs7//4rQ/w=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:52.116192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-a0ac0644-f23c-4e6e-9a0e-d9445768a47c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:52.121955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-a0ac0644-f23c-4e6e-9a0e-d9445768a47c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for user 594483c9afdc4f69a6d02f10e8fde137 and project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:52.153730 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a0ac0644-f23c-4e6e-9a0e-d9445768a47c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.060267 Oct 04 18:49:52.154077 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3436/6860] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:49:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:49:52.199274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-347fafd4-4dce-47b9-9821-37af425c271f req-b522f5b9-0787-40c2-8c9a-a8bd003cbcdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33790005-f41e-4fa8-b70c-294c1b2f93a8", "name": "network-vif-deleted", "tag": "c6837215-fc83-41ca-bce0-0c1f0e5a8f13"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:52.210508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-347fafd4-4dce-47b9-9821-37af425c271f req-b522f5b9-0787-40c2-8c9a-a8bd003cbcdd service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.211034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-347fafd4-4dce-47b9-9821-37af425c271f req-b522f5b9-0787-40c2-8c9a-a8bd003cbcdd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.211730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-347fafd4-4dce-47b9-9821-37af425c271f req-b522f5b9-0787-40c2-8c9a-a8bd003cbcdd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.228703 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-347fafd4-4dce-47b9-9821-37af425c271f req-b522f5b9-0787-40c2-8c9a-a8bd003cbcdd service nova] Creating event network-vif-deleted:c6837215-fc83-41ca-bce0-0c1f0e5a8f13 for instance 33790005-f41e-4fa8-b70c-294c1b2f93a8 on n-h2-850499-14 Oct 04 18:49:52.233839 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-347fafd4-4dce-47b9-9821-37af425c271f req-b522f5b9-0787-40c2-8c9a-a8bd003cbcdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038707 Oct 04 18:49:52.234649 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3425/6861] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:52.915631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:52.916404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 33790005-f41e-4fa8-b70c-294c1b2f93a8] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:52.927920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.927920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.927920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.927920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.934829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.935446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.951558 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] HTTP exception thrown: Instance 33790005-f41e-4fa8-b70c-294c1b2f93a8 could not be found. Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Request method failure captured: Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 HTTP/1.1 Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH-fl5IUiQMzEAiTBiaCzXRDaebXigj3woVaBvs6PDYxlSjDWC0rdYipxwYiXZ4MNLyTW0rmvCM6AjLlOJT2dB-MsCmXeDFrvrIc5RgorMaGX13TLqbjw3EshEeX2rqBgz8Osx0NJ2nEsrajNY8ekl5Gp_sObKkacf1luKH3AqVkDew Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 3401093d6669442a95295abfeb2bdbb1 Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestNetworkBasicOps-1603754951 Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3401093d6669442a95295abfeb2bdbb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3401093d6669442a95295abfeb2bdbb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3401093d6669442a95295abfeb2bdbb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3401093d6669442a95295abfeb2bdbb1"}]}] Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestNetworkBasicOps-1603754951 Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 3401093d6669442a95295abfeb2bdbb1 Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestNetworkBasicOps-1603754951 Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestNetworkBasicOps-1603754951-project Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b87951bf1b5c400197e7346e8bf66e1e Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestNetworkBasicOps-1603754951-project Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 33790005-f41e-4fa8-b70c-294c1b2f93a8 could not be found. Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '33790005-f41e-4fa8-b70c-294c1b2f93a8'} Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33790005-f41e-4fa8-b70c-294c1b2f93a8 could not be found. Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33790005-f41e-4fa8-b70c-294c1b2f93a8 could not be found. Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:52.953313 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.958653 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:52.958653 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:52.958653 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:52.958653 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:52.958653 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:52.958653 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33790005-f41e-4fa8-b70c-294c1b2f93a8 could not be found. Oct 04 18:49:52.958653 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.958653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Returning 404 to user: Instance 33790005-f41e-4fa8-b70c-294c1b2f93a8 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:52.958653 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-efefd81a-7fac-46b9-927c-73522f24fcd0 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8" status: 404 len: 111 microversion: 2.1 time: 0.047411 Oct 04 18:49:52.958653 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3437/6862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:52 2022] GET /compute/v2.1/servers/33790005-f41e-4fa8-b70c-294c1b2f93a8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:53.208271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-713ae0ea-daaa-475b-a32d-3d6402444764 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '.version_select at 0x7fd4d1c20280>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:53.233474 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-713ae0ea-daaa-475b-a32d-3d6402444764 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-704819664" status: 202 len: 0 microversion: 2.1 time: 0.032016 Oct 04 18:49:53.234501 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3426/6863] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Oct 4 18:49:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-704819664 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:49:55.524857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-291f53b0-a687-49df-9c28-a4467cffd92f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:55.525532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-291f53b0-a687-49df-9c28-a4467cffd92f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.526682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2d7c7a69-757d-4b74-96e9-674824dd2379 req-a47cc749-e617-430a-a95f-0bb0fbd83cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32be5a67-1463-4840-aad0-06dbae4abce2", "tag": "99c28972-ff02-4216-9883-efa7139ee035"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:55.532860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-291f53b0-a687-49df-9c28-a4467cffd92f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.533423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-291f53b0-a687-49df-9c28-a4467cffd92f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.533977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-291f53b0-a687-49df-9c28-a4467cffd92f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.534749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-291f53b0-a687-49df-9c28-a4467cffd92f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.535329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-291f53b0-a687-49df-9c28-a4467cffd92f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.535981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-291f53b0-a687-49df-9c28-a4467cffd92f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.551656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2d7c7a69-757d-4b74-96e9-674824dd2379 req-a47cc749-e617-430a-a95f-0bb0fbd83cba service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.552207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2d7c7a69-757d-4b74-96e9-674824dd2379 req-a47cc749-e617-430a-a95f-0bb0fbd83cba service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.553022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2d7c7a69-757d-4b74-96e9-674824dd2379 req-a47cc749-e617-430a-a95f-0bb0fbd83cba service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.566913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-291f53b0-a687-49df-9c28-a4467cffd92f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:55.571137 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2d7c7a69-757d-4b74-96e9-674824dd2379 req-a47cc749-e617-430a-a95f-0bb0fbd83cba service nova] Creating event network-changed:99c28972-ff02-4216-9883-efa7139ee035 for instance 32be5a67-1463-4840-aad0-06dbae4abce2 on n-h2-850499-14 Oct 04 18:49:55.578582 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2d7c7a69-757d-4b74-96e9-674824dd2379 req-a47cc749-e617-430a-a95f-0bb0fbd83cba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056119 Oct 04 18:49:55.580419 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3427/6864] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:55.658134 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-291f53b0-a687-49df-9c28-a4467cffd92f tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 204 len: 0 microversion: 2.1 time: 0.137876 Oct 04 18:49:55.659172 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3438/6865] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:55 2022] DELETE /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:49:55.670912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f71df4a3-26b8-4564-ba42-9b65d71d54d3 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:55.671919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f71df4a3-26b8-4564-ba42-9b65d71d54d3 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.680742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71df4a3-26b8-4564-ba42-9b65d71d54d3 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.681684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71df4a3-26b8-4564-ba42-9b65d71d54d3 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.682309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71df4a3-26b8-4564-ba42-9b65d71d54d3 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.686078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71df4a3-26b8-4564-ba42-9b65d71d54d3 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.687140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71df4a3-26b8-4564-ba42-9b65d71d54d3 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.688010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f71df4a3-26b8-4564-ba42-9b65d71d54d3 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.848773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f71df4a3-26b8-4564-ba42-9b65d71d54d3 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:55.858201 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f71df4a3-26b8-4564-ba42-9b65d71d54d3 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1670 microversion: 2.1 time: 0.192364 Oct 04 18:49:55.872756 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3428/6866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:55 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1670 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:56.880643 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:49:56.881173 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 18:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 (ip 10.222.0.18) !!! Oct 04 18:49:56.887252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06d2d4c7-dfeb-4b80-a76d-58693c1ee02e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:56.887963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-06d2d4c7-dfeb-4b80-a76d-58693c1ee02e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:56.895786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06d2d4c7-dfeb-4b80-a76d-58693c1ee02e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.896282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06d2d4c7-dfeb-4b80-a76d-58693c1ee02e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.896732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06d2d4c7-dfeb-4b80-a76d-58693c1ee02e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.897469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06d2d4c7-dfeb-4b80-a76d-58693c1ee02e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.897933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06d2d4c7-dfeb-4b80-a76d-58693c1ee02e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.898367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06d2d4c7-dfeb-4b80-a76d-58693c1ee02e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:57.042851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-06d2d4c7-dfeb-4b80-a76d-58693c1ee02e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:57.051775 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-06d2d4c7-dfeb-4b80-a76d-58693c1ee02e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1670 microversion: 2.1 time: 0.172099 Oct 04 18:49:57.052366 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3439/6867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:56 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:58.076177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1042b888-eec3-4e31-924b-16cff5184578 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:58.077026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1042b888-eec3-4e31-924b-16cff5184578 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:58.085184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1042b888-eec3-4e31-924b-16cff5184578 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.086038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1042b888-eec3-4e31-924b-16cff5184578 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.086745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1042b888-eec3-4e31-924b-16cff5184578 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.087957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1042b888-eec3-4e31-924b-16cff5184578 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.088989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1042b888-eec3-4e31-924b-16cff5184578 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.089598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1042b888-eec3-4e31-924b-16cff5184578 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.239442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1042b888-eec3-4e31-924b-16cff5184578 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:58.250890 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1042b888-eec3-4e31-924b-16cff5184578 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 200 len: 1551 microversion: 2.1 time: 0.178957 Oct 04 18:49:58.252052 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3429/6868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:58 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 1551 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:58.345801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-373d532d-b9bb-424e-aff3-b9617026a9c3 req-d5b010d8-ef45-44d0-8474-49f66ce9d372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32be5a67-1463-4840-aad0-06dbae4abce2", "name": "network-vif-deleted", "tag": "99c28972-ff02-4216-9883-efa7139ee035"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:58.362409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-373d532d-b9bb-424e-aff3-b9617026a9c3 req-d5b010d8-ef45-44d0-8474-49f66ce9d372 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.362891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-373d532d-b9bb-424e-aff3-b9617026a9c3 req-d5b010d8-ef45-44d0-8474-49f66ce9d372 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.363351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-373d532d-b9bb-424e-aff3-b9617026a9c3 req-d5b010d8-ef45-44d0-8474-49f66ce9d372 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.375210 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-373d532d-b9bb-424e-aff3-b9617026a9c3 req-d5b010d8-ef45-44d0-8474-49f66ce9d372 service nova] Creating event network-vif-deleted:99c28972-ff02-4216-9883-efa7139ee035 for instance 32be5a67-1463-4840-aad0-06dbae4abce2 on n-h2-850499-14 Oct 04 18:49:58.380137 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-373d532d-b9bb-424e-aff3-b9617026a9c3 req-d5b010d8-ef45-44d0-8474-49f66ce9d372 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038573 Oct 04 18:49:58.380741 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3440/6869] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:59.275639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:59.276276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 32be5a67-1463-4840-aad0-06dbae4abce2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:59.283302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.283816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.284282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.285006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.285494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.285949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.300995 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] HTTP exception thrown: Instance 32be5a67-1463-4840-aad0-06dbae4abce2 could not be found. Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Request method failure captured: Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 HTTP/1.1 Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH-fl5IUiQMzEAiTBiaCzXRDaebXigj3woVaBvs6PDYxlSjDWC0rdYipxwYiXZ4MNLyTW0rmvCM6AjLlOJT2dB-MsCmXeDFrvrIc5RgorMaGX13TLqbjw3EshEeX2rqBgz8Osx0NJ2nEsrajNY8ekl5Gp_sObKkacf1luKH3AqVkDew Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 3401093d6669442a95295abfeb2bdbb1 Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestNetworkBasicOps-1603754951 Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3401093d6669442a95295abfeb2bdbb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3401093d6669442a95295abfeb2bdbb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3401093d6669442a95295abfeb2bdbb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3401093d6669442a95295abfeb2bdbb1"}]}] Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestNetworkBasicOps-1603754951 Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 3401093d6669442a95295abfeb2bdbb1 Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestNetworkBasicOps-1603754951 Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestNetworkBasicOps-1603754951-project Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b87951bf1b5c400197e7346e8bf66e1e Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestNetworkBasicOps-1603754951-project Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 32be5a67-1463-4840-aad0-06dbae4abce2 could not be found. Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '32be5a67-1463-4840-aad0-06dbae4abce2'} Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32be5a67-1463-4840-aad0-06dbae4abce2 could not be found. Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32be5a67-1463-4840-aad0-06dbae4abce2 could not be found. Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:59.302797 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:59.310351 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:59.310351 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:59.310351 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:59.310351 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:59.310351 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:59.310351 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32be5a67-1463-4840-aad0-06dbae4abce2 could not be found. Oct 04 18:49:59.310351 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:49:59.310351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Returning 404 to user: Instance 32be5a67-1463-4840-aad0-06dbae4abce2 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:59.310351 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c27262a-1c81-43b9-9f2b-5c633d4d50ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2" status: 404 len: 111 microversion: 2.1 time: 0.033361 Oct 04 18:49:59.310351 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3430/6870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:59 2022] GET /compute/v2.1/servers/32be5a67-1463-4840-aad0-06dbae4abce2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:59.482656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05aad102-5a7f-456f-af76-101c3ac09484 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '.version_select at 0x7fd4d0bd8310>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:59.505239 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-05aad102-5a7f-456f-af76-101c3ac09484 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1267662590" status: 202 len: 0 microversion: 2.1 time: 0.027565 Oct 04 18:49:59.505948 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3441/6871] 10.222.0.18 () {58 vars in 1257 bytes} [Tue Oct 4 18:49:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1267662590 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:08.176500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d7546bad-d4b1-4d1c-9f9b-8491dc95e174 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Action: 'create', calling method: .version_select at 0x7fd4d1d0b160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1180906720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLAv1LIBMMos6e3XDqZVFxoyCgHkrrN4/oB/VC+d2JjQ4iXa8ZQBR6lbAFFhpO753KKGgK1b0tVwi1fjwB4BW68JiJtaSjkowyVLW4QG/V+nj2iqcGhWRLoOQCoGNTHmg=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:08.202917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-d7546bad-d4b1-4d1c-9f9b-8491dc95e174 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for project 3401093d6669442a95295abfeb2bdbb1. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:08.210776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-d7546bad-d4b1-4d1c-9f9b-8491dc95e174 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for user b87951bf1b5c400197e7346e8bf66e1e and project 3401093d6669442a95295abfeb2bdbb1. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:08.259281 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d7546bad-d4b1-4d1c-9f9b-8491dc95e174 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.087660 Oct 04 18:50:08.259873 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3431/6872] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:50:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:09.837465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1392841771", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "785fea9a-46fe-4a9c-935a-c28ce9b942bb"}], "key_name": "tempest-TestNetworkBasicOps-1180906720", "security_groups": [{"name": "tempest-secgroup-smoke-1051710078"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:09.850762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:09.853342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:09.854142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:10.030865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] validate_networks() for [('785fea9a-46fe-4a9c-935a-c28ce9b942bb', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:10.952089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:10.952790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:10.953309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:10.953729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:10.954461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:10.964017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.964630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.965078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.965820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.966288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.966723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.988495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for project 3401093d6669442a95295abfeb2bdbb1. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:10.994707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Getting quotas for user b87951bf1b5c400197e7346e8bf66e1e and project 3401093d6669442a95295abfeb2bdbb1. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:11.009076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:11.011626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:11.074705 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59698cf5-5dd1-4796-8130-cad75aee87eb tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.242371 Oct 04 18:50:11.075409 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3442/6873] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:50:11.087486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-66dbf229-a7fc-4f73-8fcd-51f81a82518e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:11.088223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-66dbf229-a7fc-4f73-8fcd-51f81a82518e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:11.092046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:11.190143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-66dbf229-a7fc-4f73-8fcd-51f81a82518e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:11.199176 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-66dbf229-a7fc-4f73-8fcd-51f81a82518e tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1249 microversion: 2.1 time: 0.116096 Oct 04 18:50:11.200366 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3432/6874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:11 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1249 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:12.228635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9ac549a-1c96-41b3-b38f-2e0c7fcd63ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:12.229317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9ac549a-1c96-41b3-b38f-2e0c7fcd63ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:12.235230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-224452816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1101435800", "security_groups": [{"name": "tempest-secgroup-smoke-1629660030"}], "block_device_mapping_v2": [{"uuid": "08ab7fc4-5efb-4345-9daa-212be60f45d6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7231cfd-11da-40a4-8d73-d5073342969a"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:12.242106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ac549a-1c96-41b3-b38f-2e0c7fcd63ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.242693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ac549a-1c96-41b3-b38f-2e0c7fcd63ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.243230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ac549a-1c96-41b3-b38f-2e0c7fcd63ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.244005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ac549a-1c96-41b3-b38f-2e0c7fcd63ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.244537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ac549a-1c96-41b3-b38f-2e0c7fcd63ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.245050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9ac549a-1c96-41b3-b38f-2e0c7fcd63ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.258223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:12.323873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9ac549a-1c96-41b3-b38f-2e0c7fcd63ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:12.332294 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9ac549a-1c96-41b3-b38f-2e0c7fcd63ae tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1301 microversion: 2.1 time: 0.110029 Oct 04 18:50:12.333650 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3443/6875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:12 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:12.480713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] validate_networks() for [('d7231cfd-11da-40a4-8d73-d5073342969a', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:13.125054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:13.126816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:13.127471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:13.128011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:13.128518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:13.139325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.139850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.140316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.141082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.141563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.142196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.161506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:13.168344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for user 594483c9afdc4f69a6d02f10e8fde137 and project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:13.231036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:13.233187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08ab7fc4-5efb-4345-9daa-212be60f45d6',volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:13.357910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e10edc57-2a93-4fd5-9ac6-5faf0f0c58e2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:13.358551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e10edc57-2a93-4fd5-9ac6-5faf0f0c58e2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:13.366450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10edc57-2a93-4fd5-9ac6-5faf0f0c58e2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.366973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10edc57-2a93-4fd5-9ac6-5faf0f0c58e2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.367424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10edc57-2a93-4fd5-9ac6-5faf0f0c58e2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.368568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10edc57-2a93-4fd5-9ac6-5faf0f0c58e2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.369034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10edc57-2a93-4fd5-9ac6-5faf0f0c58e2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.369626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e10edc57-2a93-4fd5-9ac6-5faf0f0c58e2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.375234 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dc3f7120-6d66-4a68-b2fb-9c9d9460aca1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.143856 Oct 04 18:50:13.376116 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3433/6876] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:50:13.388570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-100d292c-11e5-4c9a-99cf-2cdecdbf13d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:13.389311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-100d292c-11e5-4c9a-99cf-2cdecdbf13d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:13.531792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-100d292c-11e5-4c9a-99cf-2cdecdbf13d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:13.542771 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-100d292c-11e5-4c9a-99cf-2cdecdbf13d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1094 microversion: 2.1 time: 0.155913 Oct 04 18:50:13.543303 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3434/6877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:13 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1094 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:13.667020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e10edc57-2a93-4fd5-9ac6-5faf0f0c58e2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:13.678728 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e10edc57-2a93-4fd5-9ac6-5faf0f0c58e2 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1375 microversion: 2.1 time: 0.324557 Oct 04 18:50:13.679555 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3444/6878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:13 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1375 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:14.381620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-368ad115-b3dd-4ef2-8955-65b9f9c033f8 req-7533bc71-b4f2-4966-ab50-c93269e61837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120a8f92-c443-44c7-a40a-aa3fb7129a51", "tag": "8cdc4b68-e0da-4d3c-a164-bfc458d6540f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:14.403034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-368ad115-b3dd-4ef2-8955-65b9f9c033f8 req-7533bc71-b4f2-4966-ab50-c93269e61837 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.403693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-368ad115-b3dd-4ef2-8955-65b9f9c033f8 req-7533bc71-b4f2-4966-ab50-c93269e61837 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.404387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-368ad115-b3dd-4ef2-8955-65b9f9c033f8 req-7533bc71-b4f2-4966-ab50-c93269e61837 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.418653 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-368ad115-b3dd-4ef2-8955-65b9f9c033f8 req-7533bc71-b4f2-4966-ab50-c93269e61837 service nova] Creating event network-changed:8cdc4b68-e0da-4d3c-a164-bfc458d6540f for instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 on n-h1-850499-14 Oct 04 18:50:14.424536 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-368ad115-b3dd-4ef2-8955-65b9f9c033f8 req-7533bc71-b4f2-4966-ab50-c93269e61837 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049082 Oct 04 18:50:14.425276 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3435/6879] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:14.565570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c8d04b08-21f8-453f-a7f8-65f155ecc316 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:14.566200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c8d04b08-21f8-453f-a7f8-65f155ecc316 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:14.576329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8d04b08-21f8-453f-a7f8-65f155ecc316 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.576835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8d04b08-21f8-453f-a7f8-65f155ecc316 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.577293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8d04b08-21f8-453f-a7f8-65f155ecc316 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.578017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8d04b08-21f8-453f-a7f8-65f155ecc316 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.578476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8d04b08-21f8-453f-a7f8-65f155ecc316 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.578913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c8d04b08-21f8-453f-a7f8-65f155ecc316 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.664770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c8d04b08-21f8-453f-a7f8-65f155ecc316 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:14.672516 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c8d04b08-21f8-453f-a7f8-65f155ecc316 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1192 microversion: 2.1 time: 0.110786 Oct 04 18:50:14.673096 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3445/6880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:14 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:14.708265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f6250a4-3fdb-4dad-abc4-0616395388ca tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:14.709005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f6250a4-3fdb-4dad-abc4-0616395388ca tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:14.715992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f6250a4-3fdb-4dad-abc4-0616395388ca tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.716704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f6250a4-3fdb-4dad-abc4-0616395388ca tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.717167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f6250a4-3fdb-4dad-abc4-0616395388ca tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.717902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f6250a4-3fdb-4dad-abc4-0616395388ca tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.718385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f6250a4-3fdb-4dad-abc4-0616395388ca tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.719138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f6250a4-3fdb-4dad-abc4-0616395388ca tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.930036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f6250a4-3fdb-4dad-abc4-0616395388ca tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:14.938132 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f6250a4-3fdb-4dad-abc4-0616395388ca tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1375 microversion: 2.1 time: 0.235363 Oct 04 18:50:14.938794 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3436/6881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:14 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1375 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:15.697481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-68512e6b-e263-43fd-b0bf-68131919a46b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:15.697481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-68512e6b-e263-43fd-b0bf-68131919a46b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:15.704599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68512e6b-e263-43fd-b0bf-68131919a46b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.705170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68512e6b-e263-43fd-b0bf-68131919a46b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.705614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68512e6b-e263-43fd-b0bf-68131919a46b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.706605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68512e6b-e263-43fd-b0bf-68131919a46b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.707710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68512e6b-e263-43fd-b0bf-68131919a46b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.708154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-68512e6b-e263-43fd-b0bf-68131919a46b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.782604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-68512e6b-e263-43fd-b0bf-68131919a46b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:15.793589 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-68512e6b-e263-43fd-b0bf-68131919a46b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1210 microversion: 2.1 time: 0.101856 Oct 04 18:50:15.794456 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3446/6882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:15 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:15.962224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce7858a0-6d08-4d52-a623-7b2d6adba28b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:15.963501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ce7858a0-6d08-4d52-a623-7b2d6adba28b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:15.977421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce7858a0-6d08-4d52-a623-7b2d6adba28b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.977946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce7858a0-6d08-4d52-a623-7b2d6adba28b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.978413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce7858a0-6d08-4d52-a623-7b2d6adba28b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.983805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce7858a0-6d08-4d52-a623-7b2d6adba28b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.984334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce7858a0-6d08-4d52-a623-7b2d6adba28b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.984819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce7858a0-6d08-4d52-a623-7b2d6adba28b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.267021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce7858a0-6d08-4d52-a623-7b2d6adba28b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:16.280440 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce7858a0-6d08-4d52-a623-7b2d6adba28b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1375 microversion: 2.1 time: 0.322111 Oct 04 18:50:16.285237 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3437/6883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:15 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1375 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:16.805496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-97698ef0-bdfd-42e2-9c5b-40e56d319fe8 req-6e5a4fec-4f6b-4ed6-9677-5f2442429ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aceeed29-e978-4760-afa0-03659eaf5c6e", "tag": "8047d4ba-7784-4708-8baa-81d91eaac697"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:16.821059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-375a401b-5be3-4b71-808e-27cd59703016 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:16.822302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-375a401b-5be3-4b71-808e-27cd59703016 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.836430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-375a401b-5be3-4b71-808e-27cd59703016 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.838524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-375a401b-5be3-4b71-808e-27cd59703016 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.840141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-375a401b-5be3-4b71-808e-27cd59703016 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.841400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-375a401b-5be3-4b71-808e-27cd59703016 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.843984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-97698ef0-bdfd-42e2-9c5b-40e56d319fe8 req-6e5a4fec-4f6b-4ed6-9677-5f2442429ac5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.844744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-375a401b-5be3-4b71-808e-27cd59703016 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.845842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-375a401b-5be3-4b71-808e-27cd59703016 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.847545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-97698ef0-bdfd-42e2-9c5b-40e56d319fe8 req-6e5a4fec-4f6b-4ed6-9677-5f2442429ac5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.850413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-97698ef0-bdfd-42e2-9c5b-40e56d319fe8 req-6e5a4fec-4f6b-4ed6-9677-5f2442429ac5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.889975 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-97698ef0-bdfd-42e2-9c5b-40e56d319fe8 req-6e5a4fec-4f6b-4ed6-9677-5f2442429ac5 service nova] Creating event network-changed:8047d4ba-7784-4708-8baa-81d91eaac697 for instance aceeed29-e978-4760-afa0-03659eaf5c6e on n-h2-850499-14 Oct 04 18:50:16.904958 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-97698ef0-bdfd-42e2-9c5b-40e56d319fe8 req-6e5a4fec-4f6b-4ed6-9677-5f2442429ac5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106482 Oct 04 18:50:16.905810 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3447/6884] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:17.051081 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-375a401b-5be3-4b71-808e-27cd59703016 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.061660 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-375a401b-5be3-4b71-808e-27cd59703016 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1278 microversion: 2.1 time: 0.247977 Oct 04 18:50:17.062268 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3438/6885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:16 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:17.307075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6f6da634-bb40-444b-a6b7-db0c62123b6c tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:17.307779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6f6da634-bb40-444b-a6b7-db0c62123b6c tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:17.314104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f6da634-bb40-444b-a6b7-db0c62123b6c tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.315542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f6da634-bb40-444b-a6b7-db0c62123b6c tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.316371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f6da634-bb40-444b-a6b7-db0c62123b6c tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.317162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f6da634-bb40-444b-a6b7-db0c62123b6c tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.317628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f6da634-bb40-444b-a6b7-db0c62123b6c tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.318057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f6da634-bb40-444b-a6b7-db0c62123b6c tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.467792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6f6da634-bb40-444b-a6b7-db0c62123b6c tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.476841 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6f6da634-bb40-444b-a6b7-db0c62123b6c tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1375 microversion: 2.1 time: 0.174700 Oct 04 18:50:17.477478 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3448/6886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:17 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:18.087279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d7b266d5-b794-4df8-bd06-4531885014e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:18.087933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d7b266d5-b794-4df8-bd06-4531885014e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:18.102043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b266d5-b794-4df8-bd06-4531885014e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.102776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b266d5-b794-4df8-bd06-4531885014e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.103340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b266d5-b794-4df8-bd06-4531885014e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.104136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b266d5-b794-4df8-bd06-4531885014e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.104682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b266d5-b794-4df8-bd06-4531885014e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.105193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b266d5-b794-4df8-bd06-4531885014e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.249800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d7b266d5-b794-4df8-bd06-4531885014e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:18.258476 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d7b266d5-b794-4df8-bd06-4531885014e8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1278 microversion: 2.1 time: 0.176204 Oct 04 18:50:18.259526 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3439/6887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:18 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:18.422975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-28c3a306-e857-460d-b77f-046b12008b9d req-03e39f84-d04a-4888-a304-8d809c28ef71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120a8f92-c443-44c7-a40a-aa3fb7129a51", "name": "network-vif-plugged", "status": "completed", "tag": "8cdc4b68-e0da-4d3c-a164-bfc458d6540f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:18.434250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-28c3a306-e857-460d-b77f-046b12008b9d req-03e39f84-d04a-4888-a304-8d809c28ef71 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.434736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-28c3a306-e857-460d-b77f-046b12008b9d req-03e39f84-d04a-4888-a304-8d809c28ef71 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.435620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-28c3a306-e857-460d-b77f-046b12008b9d req-03e39f84-d04a-4888-a304-8d809c28ef71 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.447629 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-28c3a306-e857-460d-b77f-046b12008b9d req-03e39f84-d04a-4888-a304-8d809c28ef71 service nova] Creating event network-vif-plugged:8cdc4b68-e0da-4d3c-a164-bfc458d6540f for instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 on n-h1-850499-14 Oct 04 18:50:18.452488 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-28c3a306-e857-460d-b77f-046b12008b9d req-03e39f84-d04a-4888-a304-8d809c28ef71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104068 Oct 04 18:50:18.453386 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3449/6888] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:18.500417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3950729a-f7cc-4919-9c45-c79f4274a157 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:18.501245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3950729a-f7cc-4919-9c45-c79f4274a157 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:18.507811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3950729a-f7cc-4919-9c45-c79f4274a157 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.508431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3950729a-f7cc-4919-9c45-c79f4274a157 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.508964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3950729a-f7cc-4919-9c45-c79f4274a157 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.509911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3950729a-f7cc-4919-9c45-c79f4274a157 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.510472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3950729a-f7cc-4919-9c45-c79f4274a157 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.510935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3950729a-f7cc-4919-9c45-c79f4274a157 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.690174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3950729a-f7cc-4919-9c45-c79f4274a157 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:18.698687 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3950729a-f7cc-4919-9c45-c79f4274a157 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1375 microversion: 2.1 time: 0.202346 Oct 04 18:50:18.699299 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3440/6889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:18 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1375 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:19.283882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1c815dac-9378-4e34-84b7-3057a5cc21c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:19.284587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1c815dac-9378-4e34-84b7-3057a5cc21c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:19.291061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c815dac-9378-4e34-84b7-3057a5cc21c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.291551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c815dac-9378-4e34-84b7-3057a5cc21c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.291993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c815dac-9378-4e34-84b7-3057a5cc21c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.292701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c815dac-9378-4e34-84b7-3057a5cc21c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.293166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c815dac-9378-4e34-84b7-3057a5cc21c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.293600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c815dac-9378-4e34-84b7-3057a5cc21c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.445850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1c815dac-9378-4e34-84b7-3057a5cc21c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:19.453884 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1c815dac-9378-4e34-84b7-3057a5cc21c7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1278 microversion: 2.1 time: 0.174546 Oct 04 18:50:19.454467 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3450/6890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:19 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:19.722144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f30d8a0a-fd3a-4746-8cd1-b89d104fbfc6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:19.722807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f30d8a0a-fd3a-4746-8cd1-b89d104fbfc6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:19.731506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f30d8a0a-fd3a-4746-8cd1-b89d104fbfc6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.732074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f30d8a0a-fd3a-4746-8cd1-b89d104fbfc6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.732547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f30d8a0a-fd3a-4746-8cd1-b89d104fbfc6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.733275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f30d8a0a-fd3a-4746-8cd1-b89d104fbfc6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.733757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f30d8a0a-fd3a-4746-8cd1-b89d104fbfc6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.734205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f30d8a0a-fd3a-4746-8cd1-b89d104fbfc6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.890483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f30d8a0a-fd3a-4746-8cd1-b89d104fbfc6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:19.899372 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f30d8a0a-fd3a-4746-8cd1-b89d104fbfc6 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1375 microversion: 2.1 time: 0.181376 Oct 04 18:50:19.899963 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3441/6891] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:19 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:20.477807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ba8e53c1-6aa2-4f88-9b89-1150d1500d76 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.478416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ba8e53c1-6aa2-4f88-9b89-1150d1500d76 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.485297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8e53c1-6aa2-4f88-9b89-1150d1500d76 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.485785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8e53c1-6aa2-4f88-9b89-1150d1500d76 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.486224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8e53c1-6aa2-4f88-9b89-1150d1500d76 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.486924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8e53c1-6aa2-4f88-9b89-1150d1500d76 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.487404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8e53c1-6aa2-4f88-9b89-1150d1500d76 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.487836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba8e53c1-6aa2-4f88-9b89-1150d1500d76 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.623351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ba8e53c1-6aa2-4f88-9b89-1150d1500d76 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:20.631752 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ba8e53c1-6aa2-4f88-9b89-1150d1500d76 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.158307 Oct 04 18:50:20.632337 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3451/6892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:20 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:20.923598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93fc2715-4f40-4526-ac5a-84096a231975 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.924248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-93fc2715-4f40-4526-ac5a-84096a231975 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.931210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93fc2715-4f40-4526-ac5a-84096a231975 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.931726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93fc2715-4f40-4526-ac5a-84096a231975 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.932194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93fc2715-4f40-4526-ac5a-84096a231975 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.932943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93fc2715-4f40-4526-ac5a-84096a231975 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.933424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93fc2715-4f40-4526-ac5a-84096a231975 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.933874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93fc2715-4f40-4526-ac5a-84096a231975 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.064034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93fc2715-4f40-4526-ac5a-84096a231975 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.072484 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-93fc2715-4f40-4526-ac5a-84096a231975 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1547 microversion: 2.1 time: 0.152860 Oct 04 18:50:21.073064 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3442/6893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:20 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:21.095669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ef1a4c6d-dc36-42b7-bdd9-fe70b2ab3b20 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:21.096295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ef1a4c6d-dc36-42b7-bdd9-fe70b2ab3b20 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.098290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:21.099167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:21.105469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1a4c6d-dc36-42b7-bdd9-fe70b2ab3b20 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.105964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1a4c6d-dc36-42b7-bdd9-fe70b2ab3b20 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.106419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1a4c6d-dc36-42b7-bdd9-fe70b2ab3b20 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.107155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1a4c6d-dc36-42b7-bdd9-fe70b2ab3b20 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.107623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1a4c6d-dc36-42b7-bdd9-fe70b2ab3b20 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.108062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ef1a4c6d-dc36-42b7-bdd9-fe70b2ab3b20 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.240787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ef1a4c6d-dc36-42b7-bdd9-fe70b2ab3b20 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.249231 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ef1a4c6d-dc36-42b7-bdd9-fe70b2ab3b20 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1547 microversion: 2.1 time: 0.157834 Oct 04 18:50:21.250044 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3452/6894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:21 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:21.653945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cce30f50-d13b-4307-9a6b-95f4b513a3a5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:21.654586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cce30f50-d13b-4307-9a6b-95f4b513a3a5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.660658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cce30f50-d13b-4307-9a6b-95f4b513a3a5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.661168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cce30f50-d13b-4307-9a6b-95f4b513a3a5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.661630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cce30f50-d13b-4307-9a6b-95f4b513a3a5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.662357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cce30f50-d13b-4307-9a6b-95f4b513a3a5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.662843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cce30f50-d13b-4307-9a6b-95f4b513a3a5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.663841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cce30f50-d13b-4307-9a6b-95f4b513a3a5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.810872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cce30f50-d13b-4307-9a6b-95f4b513a3a5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.820662 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cce30f50-d13b-4307-9a6b-95f4b513a3a5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.170623 Oct 04 18:50:21.821261 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3443/6895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:21 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:22.842700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-08720a58-7743-4530-865a-783b575e14a1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:22.844328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-08720a58-7743-4530-865a-783b575e14a1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:22.852207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08720a58-7743-4530-865a-783b575e14a1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.853012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08720a58-7743-4530-865a-783b575e14a1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.853761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08720a58-7743-4530-865a-783b575e14a1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.854570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08720a58-7743-4530-865a-783b575e14a1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.855142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08720a58-7743-4530-865a-783b575e14a1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.855858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-08720a58-7743-4530-865a-783b575e14a1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.874223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-322419fa-3d0b-426a-82b5-4d2382af73e0 req-7fe4a049-6ff9-4385-949f-ca78c4e949b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120a8f92-c443-44c7-a40a-aa3fb7129a51", "tag": "8cdc4b68-e0da-4d3c-a164-bfc458d6540f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:22.888289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-322419fa-3d0b-426a-82b5-4d2382af73e0 req-7fe4a049-6ff9-4385-949f-ca78c4e949b3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.888814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-322419fa-3d0b-426a-82b5-4d2382af73e0 req-7fe4a049-6ff9-4385-949f-ca78c4e949b3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.889268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-322419fa-3d0b-426a-82b5-4d2382af73e0 req-7fe4a049-6ff9-4385-949f-ca78c4e949b3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.905010 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-322419fa-3d0b-426a-82b5-4d2382af73e0 req-7fe4a049-6ff9-4385-949f-ca78c4e949b3 service nova] Creating event network-changed:8cdc4b68-e0da-4d3c-a164-bfc458d6540f for instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 on n-h1-850499-14 Oct 04 18:50:22.910664 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-322419fa-3d0b-426a-82b5-4d2382af73e0 req-7fe4a049-6ff9-4385-949f-ca78c4e949b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040254 Oct 04 18:50:22.912116 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3444/6896] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:23.119386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-08720a58-7743-4530-865a-783b575e14a1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:23.128045 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-08720a58-7743-4530-865a-783b575e14a1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.289329 Oct 04 18:50:23.128628 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3453/6897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:22 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:24.153523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f2628ee-5e6a-4772-9351-62d682b05a72 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:24.154278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0f2628ee-5e6a-4772-9351-62d682b05a72 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:24.156522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:24.158839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=14 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:24.165172 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f2628ee-5e6a-4772-9351-62d682b05a72 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.165684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f2628ee-5e6a-4772-9351-62d682b05a72 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.166145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f2628ee-5e6a-4772-9351-62d682b05a72 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.166870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f2628ee-5e6a-4772-9351-62d682b05a72 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.167388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f2628ee-5e6a-4772-9351-62d682b05a72 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.167832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f2628ee-5e6a-4772-9351-62d682b05a72 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.305393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0f2628ee-5e6a-4772-9351-62d682b05a72 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.313236 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0f2628ee-5e6a-4772-9351-62d682b05a72 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.164777 Oct 04 18:50:24.313816 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3445/6898] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:24 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:25.336703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b8287c3-6c55-468e-ac0f-20f8320ce975 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:25.337346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2b8287c3-6c55-468e-ac0f-20f8320ce975 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.344365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b8287c3-6c55-468e-ac0f-20f8320ce975 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.344859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b8287c3-6c55-468e-ac0f-20f8320ce975 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.345298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b8287c3-6c55-468e-ac0f-20f8320ce975 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.345994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b8287c3-6c55-468e-ac0f-20f8320ce975 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.346758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b8287c3-6c55-468e-ac0f-20f8320ce975 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.347252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b8287c3-6c55-468e-ac0f-20f8320ce975 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.486321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b8287c3-6c55-468e-ac0f-20f8320ce975 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:25.494245 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2b8287c3-6c55-468e-ac0f-20f8320ce975 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.161955 Oct 04 18:50:25.494811 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3454/6899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:25 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:26.517744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b51d9eff-e7df-41ca-84e4-31119b458348 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:26.518463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b51d9eff-e7df-41ca-84e4-31119b458348 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:26.525881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b51d9eff-e7df-41ca-84e4-31119b458348 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.526395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b51d9eff-e7df-41ca-84e4-31119b458348 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.526861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b51d9eff-e7df-41ca-84e4-31119b458348 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.527609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b51d9eff-e7df-41ca-84e4-31119b458348 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.528095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b51d9eff-e7df-41ca-84e4-31119b458348 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.528548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b51d9eff-e7df-41ca-84e4-31119b458348 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.666250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b51d9eff-e7df-41ca-84e4-31119b458348 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.674784 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b51d9eff-e7df-41ca-84e4-31119b458348 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.160989 Oct 04 18:50:26.675405 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3446/6900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:26 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:27.697589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0564c2e3-5518-445a-a90c-bdf1333a444d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:27.698215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0564c2e3-5518-445a-a90c-bdf1333a444d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:27.705521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0564c2e3-5518-445a-a90c-bdf1333a444d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.706009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0564c2e3-5518-445a-a90c-bdf1333a444d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.706452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0564c2e3-5518-445a-a90c-bdf1333a444d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.707245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0564c2e3-5518-445a-a90c-bdf1333a444d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.707651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0564c2e3-5518-445a-a90c-bdf1333a444d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.708081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0564c2e3-5518-445a-a90c-bdf1333a444d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.836191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0564c2e3-5518-445a-a90c-bdf1333a444d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:27.844678 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0564c2e3-5518-445a-a90c-bdf1333a444d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.150976 Oct 04 18:50:27.845223 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3455/6901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:27 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:28.868052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f453e83e-759f-4989-a362-6c49495baa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:28.868677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f453e83e-759f-4989-a362-6c49495baa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:28.876133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f453e83e-759f-4989-a362-6c49495baa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.876643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f453e83e-759f-4989-a362-6c49495baa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.877097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f453e83e-759f-4989-a362-6c49495baa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.877808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f453e83e-759f-4989-a362-6c49495baa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.878284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f453e83e-759f-4989-a362-6c49495baa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.878728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f453e83e-759f-4989-a362-6c49495baa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.010211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f453e83e-759f-4989-a362-6c49495baa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:29.017871 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f453e83e-759f-4989-a362-6c49495baa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.153786 Oct 04 18:50:29.018445 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3447/6902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:28 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:30.040778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8887e525-08fe-40b2-88bd-03420d7451e4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:30.041396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8887e525-08fe-40b2-88bd-03420d7451e4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:30.048120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8887e525-08fe-40b2-88bd-03420d7451e4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.048609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8887e525-08fe-40b2-88bd-03420d7451e4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.049053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8887e525-08fe-40b2-88bd-03420d7451e4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.049760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8887e525-08fe-40b2-88bd-03420d7451e4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.050212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8887e525-08fe-40b2-88bd-03420d7451e4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.050638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8887e525-08fe-40b2-88bd-03420d7451e4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.189666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8887e525-08fe-40b2-88bd-03420d7451e4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:30.200306 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8887e525-08fe-40b2-88bd-03420d7451e4 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.163319 Oct 04 18:50:30.201099 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3456/6903] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:30 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:31.223188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2b284a0b-a8fd-493e-93fe-d68a831f7925 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:31.223894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2b284a0b-a8fd-493e-93fe-d68a831f7925 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:31.231486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b284a0b-a8fd-493e-93fe-d68a831f7925 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.231995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b284a0b-a8fd-493e-93fe-d68a831f7925 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.232451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b284a0b-a8fd-493e-93fe-d68a831f7925 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:31.233165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b284a0b-a8fd-493e-93fe-d68a831f7925 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.233642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b284a0b-a8fd-493e-93fe-d68a831f7925 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.234109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b284a0b-a8fd-493e-93fe-d68a831f7925 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:31.366182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b284a0b-a8fd-493e-93fe-d68a831f7925 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:31.373983 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2b284a0b-a8fd-493e-93fe-d68a831f7925 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.155141 Oct 04 18:50:31.374555 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3448/6904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:31 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:32.149453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-32ef1c21-b0aa-4c7d-880c-b43b2fd82573 req-151ebd7b-6e1d-4a12-9579-cec19838cab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aceeed29-e978-4760-afa0-03659eaf5c6e", "name": "network-vif-plugged", "status": "completed", "tag": "8047d4ba-7784-4708-8baa-81d91eaac697"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:32.163390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-32ef1c21-b0aa-4c7d-880c-b43b2fd82573 req-151ebd7b-6e1d-4a12-9579-cec19838cab7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.163924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-32ef1c21-b0aa-4c7d-880c-b43b2fd82573 req-151ebd7b-6e1d-4a12-9579-cec19838cab7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.164377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-32ef1c21-b0aa-4c7d-880c-b43b2fd82573 req-151ebd7b-6e1d-4a12-9579-cec19838cab7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.189211 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-32ef1c21-b0aa-4c7d-880c-b43b2fd82573 req-151ebd7b-6e1d-4a12-9579-cec19838cab7 service nova] Creating event network-vif-plugged:8047d4ba-7784-4708-8baa-81d91eaac697 for instance aceeed29-e978-4760-afa0-03659eaf5c6e on n-h2-850499-14 Oct 04 18:50:32.194341 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-32ef1c21-b0aa-4c7d-880c-b43b2fd82573 req-151ebd7b-6e1d-4a12-9579-cec19838cab7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048671 Oct 04 18:50:32.195201 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3457/6905] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:32.396946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2333493d-4b84-487a-ad8f-9992941ee538 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:32.397577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2333493d-4b84-487a-ad8f-9992941ee538 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:32.404733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2333493d-4b84-487a-ad8f-9992941ee538 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.405222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2333493d-4b84-487a-ad8f-9992941ee538 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.405679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2333493d-4b84-487a-ad8f-9992941ee538 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.406401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2333493d-4b84-487a-ad8f-9992941ee538 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.406874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2333493d-4b84-487a-ad8f-9992941ee538 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.407342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2333493d-4b84-487a-ad8f-9992941ee538 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.544298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2333493d-4b84-487a-ad8f-9992941ee538 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.553276 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2333493d-4b84-487a-ad8f-9992941ee538 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.160275 Oct 04 18:50:32.553850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3449/6906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:32 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:33.576936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-90e3e7f3-50b4-45eb-8b99-13ca1e57de17 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:33.577647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-90e3e7f3-50b4-45eb-8b99-13ca1e57de17 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:33.590258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e3e7f3-50b4-45eb-8b99-13ca1e57de17 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.590765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e3e7f3-50b4-45eb-8b99-13ca1e57de17 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.591237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e3e7f3-50b4-45eb-8b99-13ca1e57de17 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.591956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e3e7f3-50b4-45eb-8b99-13ca1e57de17 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.592416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e3e7f3-50b4-45eb-8b99-13ca1e57de17 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.592846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e3e7f3-50b4-45eb-8b99-13ca1e57de17 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.724663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90e3e7f3-50b4-45eb-8b99-13ca1e57de17 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:33.732880 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-90e3e7f3-50b4-45eb-8b99-13ca1e57de17 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1266 microversion: 2.1 time: 0.160897 Oct 04 18:50:33.733458 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3458/6907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:33 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:34.756297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f874fd19-a941-46b5-83db-7ffac5edc8aa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:34.756876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f874fd19-a941-46b5-83db-7ffac5edc8aa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:34.765386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f874fd19-a941-46b5-83db-7ffac5edc8aa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:34.765919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f874fd19-a941-46b5-83db-7ffac5edc8aa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:34.766467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f874fd19-a941-46b5-83db-7ffac5edc8aa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:34.767301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f874fd19-a941-46b5-83db-7ffac5edc8aa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:34.767793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f874fd19-a941-46b5-83db-7ffac5edc8aa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:34.768250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f874fd19-a941-46b5-83db-7ffac5edc8aa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.280763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f874fd19-a941-46b5-83db-7ffac5edc8aa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:35.288712 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f874fd19-a941-46b5-83db-7ffac5edc8aa tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1453 microversion: 2.1 time: 0.536494 Oct 04 18:50:35.289315 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3450/6908] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:34 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1453 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:35.311934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c9df0068-6294-42bf-affc-684bc32b9f5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:35.312547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c9df0068-6294-42bf-affc-684bc32b9f5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:35.319398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9df0068-6294-42bf-affc-684bc32b9f5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.319889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9df0068-6294-42bf-affc-684bc32b9f5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.320327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9df0068-6294-42bf-affc-684bc32b9f5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.321355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9df0068-6294-42bf-affc-684bc32b9f5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.321466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9df0068-6294-42bf-affc-684bc32b9f5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.322271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c9df0068-6294-42bf-affc-684bc32b9f5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.469134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c9df0068-6294-42bf-affc-684bc32b9f5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:35.477787 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c9df0068-6294-42bf-affc-684bc32b9f5f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1453 microversion: 2.1 time: 0.170215 Oct 04 18:50:35.478360 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3459/6909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:35 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:37.460936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c8235abf-b573-4700-97d0-d53ce99b91b2 req-0ae3473a-1a95-4e04-bff9-5fec967d9995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aceeed29-e978-4760-afa0-03659eaf5c6e", "tag": "8047d4ba-7784-4708-8baa-81d91eaac697"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:37.472916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c8235abf-b573-4700-97d0-d53ce99b91b2 req-0ae3473a-1a95-4e04-bff9-5fec967d9995 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.473760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c8235abf-b573-4700-97d0-d53ce99b91b2 req-0ae3473a-1a95-4e04-bff9-5fec967d9995 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.474213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c8235abf-b573-4700-97d0-d53ce99b91b2 req-0ae3473a-1a95-4e04-bff9-5fec967d9995 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.487015 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c8235abf-b573-4700-97d0-d53ce99b91b2 req-0ae3473a-1a95-4e04-bff9-5fec967d9995 service nova] Creating event network-changed:8047d4ba-7784-4708-8baa-81d91eaac697 for instance aceeed29-e978-4760-afa0-03659eaf5c6e on n-h2-850499-14 Oct 04 18:50:37.492301 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c8235abf-b573-4700-97d0-d53ce99b91b2 req-0ae3473a-1a95-4e04-bff9-5fec967d9995 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036405 Oct 04 18:50:37.493449 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3451/6910] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:48.185419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eb8e3412-31a1-4065-af73-a8a1af5ae49a tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:48.187663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eb8e3412-31a1-4065-af73-a8a1af5ae49a tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:48.190686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:48.191415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=92 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:48.197768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8e3412-31a1-4065-af73-a8a1af5ae49a tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.198265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8e3412-31a1-4065-af73-a8a1af5ae49a tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.199240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8e3412-31a1-4065-af73-a8a1af5ae49a tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.199953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8e3412-31a1-4065-af73-a8a1af5ae49a tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.200576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8e3412-31a1-4065-af73-a8a1af5ae49a tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.201222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eb8e3412-31a1-4065-af73-a8a1af5ae49a tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.255898 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eb8e3412-31a1-4065-af73-a8a1af5ae49a tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "POST /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51/action" status: 200 len: 24558 microversion: 2.1 time: 0.074282 Oct 04 18:50:48.256852 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3460/6911] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:48 2022] POST /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51/action => generated 24558 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:50:59.322715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:59.323506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=92 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:59.327900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99cfac9b-a2e9-49b0-bab6-0985e71af226 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:59.330557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99cfac9b-a2e9-49b0-bab6-0985e71af226 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:59.338477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99cfac9b-a2e9-49b0-bab6-0985e71af226 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.339009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99cfac9b-a2e9-49b0-bab6-0985e71af226 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.339478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99cfac9b-a2e9-49b0-bab6-0985e71af226 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.340242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99cfac9b-a2e9-49b0-bab6-0985e71af226 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.340722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99cfac9b-a2e9-49b0-bab6-0985e71af226 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.341168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99cfac9b-a2e9-49b0-bab6-0985e71af226 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.396472 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99cfac9b-a2e9-49b0-bab6-0985e71af226 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "POST /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51/action" status: 200 len: 32632 microversion: 2.1 time: 0.075673 Oct 04 18:50:59.397511 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3452/6912] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:59 2022] POST /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51/action => generated 32632 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:51:00.503762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d6753bcc-f6fb-495d-b2b4-cc4717a6c804 req-9eaea161-90ac-465a-bb7e-66acd74af14c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120a8f92-c443-44c7-a40a-aa3fb7129a51", "tag": "8cdc4b68-e0da-4d3c-a164-bfc458d6540f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:00.504387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-980f805a-8a47-4a4d-b487-3c4c5ecbed3b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:00.504734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-980f805a-8a47-4a4d-b487-3c4c5ecbed3b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:00.508373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:00.509028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:00.515907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980f805a-8a47-4a4d-b487-3c4c5ecbed3b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.516695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980f805a-8a47-4a4d-b487-3c4c5ecbed3b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.516988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d6753bcc-f6fb-495d-b2b4-cc4717a6c804 req-9eaea161-90ac-465a-bb7e-66acd74af14c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.517144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980f805a-8a47-4a4d-b487-3c4c5ecbed3b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.517808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d6753bcc-f6fb-495d-b2b4-cc4717a6c804 req-9eaea161-90ac-465a-bb7e-66acd74af14c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.518086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980f805a-8a47-4a4d-b487-3c4c5ecbed3b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.518276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d6753bcc-f6fb-495d-b2b4-cc4717a6c804 req-9eaea161-90ac-465a-bb7e-66acd74af14c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.518555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980f805a-8a47-4a4d-b487-3c4c5ecbed3b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.519019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-980f805a-8a47-4a4d-b487-3c4c5ecbed3b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.532333 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d6753bcc-f6fb-495d-b2b4-cc4717a6c804 req-9eaea161-90ac-465a-bb7e-66acd74af14c service nova] Creating event network-changed:8cdc4b68-e0da-4d3c-a164-bfc458d6540f for instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 on n-h1-850499-14 Oct 04 18:51:00.537468 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d6753bcc-f6fb-495d-b2b4-cc4717a6c804 req-9eaea161-90ac-465a-bb7e-66acd74af14c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037751 Oct 04 18:51:00.538722 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3453/6913] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:51:00.546500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-980f805a-8a47-4a4d-b487-3c4c5ecbed3b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:51:00.633767 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-980f805a-8a47-4a4d-b487-3c4c5ecbed3b tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 204 len: 0 microversion: 2.1 time: 0.136861 Oct 04 18:51:00.634618 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3461/6914] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:00 2022] DELETE /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:51:00.645223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0addff88-cf34-48ac-9c60-d418beb3b136 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:00.646219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0addff88-cf34-48ac-9c60-d418beb3b136 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:00.653277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0addff88-cf34-48ac-9c60-d418beb3b136 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.654123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0addff88-cf34-48ac-9c60-d418beb3b136 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.654723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0addff88-cf34-48ac-9c60-d418beb3b136 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.655954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0addff88-cf34-48ac-9c60-d418beb3b136 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.656487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0addff88-cf34-48ac-9c60-d418beb3b136 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.656938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0addff88-cf34-48ac-9c60-d418beb3b136 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.819575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0addff88-cf34-48ac-9c60-d418beb3b136 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:00.827357 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0addff88-cf34-48ac-9c60-d418beb3b136 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1672 microversion: 2.1 time: 0.187558 Oct 04 18:51:00.827937 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3454/6915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:00 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:01.852340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4086f193-1ab6-4844-b0a8-e98e6e8135dd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:01.853040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4086f193-1ab6-4844-b0a8-e98e6e8135dd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:01.860920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4086f193-1ab6-4844-b0a8-e98e6e8135dd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.861414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4086f193-1ab6-4844-b0a8-e98e6e8135dd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.861829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4086f193-1ab6-4844-b0a8-e98e6e8135dd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.862719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4086f193-1ab6-4844-b0a8-e98e6e8135dd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.863205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4086f193-1ab6-4844-b0a8-e98e6e8135dd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.863643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4086f193-1ab6-4844-b0a8-e98e6e8135dd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.069033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4086f193-1ab6-4844-b0a8-e98e6e8135dd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:02.078204 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4086f193-1ab6-4844-b0a8-e98e6e8135dd tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1672 microversion: 2.1 time: 0.230106 Oct 04 18:51:02.078783 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3462/6916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:01 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1672 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:02.690856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c64cbeae-f292-4320-95cd-58d45a5a9474 req-5486d9b3-48ca-4068-9705-eac5b1a940f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120a8f92-c443-44c7-a40a-aa3fb7129a51", "name": "network-vif-deleted", "tag": "8cdc4b68-e0da-4d3c-a164-bfc458d6540f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:02.702994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c64cbeae-f292-4320-95cd-58d45a5a9474 req-5486d9b3-48ca-4068-9705-eac5b1a940f2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.703529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c64cbeae-f292-4320-95cd-58d45a5a9474 req-5486d9b3-48ca-4068-9705-eac5b1a940f2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.703945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c64cbeae-f292-4320-95cd-58d45a5a9474 req-5486d9b3-48ca-4068-9705-eac5b1a940f2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.717329 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c64cbeae-f292-4320-95cd-58d45a5a9474 req-5486d9b3-48ca-4068-9705-eac5b1a940f2 service nova] Creating event network-vif-deleted:8cdc4b68-e0da-4d3c-a164-bfc458d6540f for instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 on n-h1-850499-14 Oct 04 18:51:02.723123 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c64cbeae-f292-4320-95cd-58d45a5a9474 req-5486d9b3-48ca-4068-9705-eac5b1a940f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036314 Oct 04 18:51:02.723775 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3455/6917] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:03.102155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:03.102707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:03.109784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.110319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.110775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.111536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.112003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.112494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.161064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.162271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.162746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.163393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lazy-loading 'fault' on Instance uuid 120a8f92-c443-44c7-a40a-aa3fb7129a51 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:03.212867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87951bf1b5c400197e7346e8bf66e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3401093d6669442a95295abfeb2bdbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:03.221636 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1b53b66f-ba87-4533-b4d5-0eba08de5c88 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 200 len: 1339 microversion: 2.1 time: 0.123615 Oct 04 18:51:03.222208 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3463/6918] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:03 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 1339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:04.255425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:04.256153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] [instance: 120a8f92-c443-44c7-a40a-aa3fb7129a51] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:04.262564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.263149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.263534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.264256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.264745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.265194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.279504 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] HTTP exception thrown: Instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 could not be found. Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Request method failure captured: Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 HTTP/1.1 Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH-fl5IUiQMzEAiTBiaCzXRDaebXigj3woVaBvs6PDYxlSjDWC0rdYipxwYiXZ4MNLyTW0rmvCM6AjLlOJT2dB-MsCmXeDFrvrIc5RgorMaGX13TLqbjw3EshEeX2rqBgz8Osx0NJ2nEsrajNY8ekl5Gp_sObKkacf1luKH3AqVkDew Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 3401093d6669442a95295abfeb2bdbb1 Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestNetworkBasicOps-1603754951 Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3401093d6669442a95295abfeb2bdbb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3401093d6669442a95295abfeb2bdbb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3401093d6669442a95295abfeb2bdbb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3401093d6669442a95295abfeb2bdbb1"}]}] Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestNetworkBasicOps-1603754951 Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 3401093d6669442a95295abfeb2bdbb1 Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestNetworkBasicOps-1603754951 Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestNetworkBasicOps-1603754951-project Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b87951bf1b5c400197e7346e8bf66e1e Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestNetworkBasicOps-1603754951-project Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 could not be found. Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '120a8f92-c443-44c7-a40a-aa3fb7129a51'} Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 could not be found. Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 could not be found. Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:04.281188 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:51:04.285492 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:04.285492 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:04.285492 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:04.285492 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:04.285492 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:04.285492 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 could not be found. Oct 04 18:51:04.285492 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:51:04.285492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Returning 404 to user: Instance 120a8f92-c443-44c7-a40a-aa3fb7129a51 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:04.285492 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9d4c1a89-2a23-490b-a275-b58859adb54d tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51" status: 404 len: 111 microversion: 2.1 time: 0.032485 Oct 04 18:51:04.285492 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3456/6919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:04 2022] GET /compute/v2.1/servers/120a8f92-c443-44c7-a40a-aa3fb7129a51 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:04.467975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a3246f35-9ca2-491d-a4a0-0d9cde5c5309 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] Calling method '.version_select at 0x7fd4d615fc10>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:04.488577 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a3246f35-9ca2-491d-a4a0-0d9cde5c5309 tempest-TestNetworkBasicOps-1603754951 tempest-TestNetworkBasicOps-1603754951-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1180906720" status: 202 len: 0 microversion: 2.1 time: 0.025365 Oct 04 18:51:04.489212 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3464/6920] 10.222.0.18 () {58 vars in 1257 bytes} [Tue Oct 4 18:51:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1180906720 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:52:35.506818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=10 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:35.507615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=16 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:35.728648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8b99ed65-55dc-457c-b339-ecec6f136578 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:35.729178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8b99ed65-55dc-457c-b339-ecec6f136578 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:35.736116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b99ed65-55dc-457c-b339-ecec6f136578 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:35.736739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b99ed65-55dc-457c-b339-ecec6f136578 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:35.738216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b99ed65-55dc-457c-b339-ecec6f136578 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:35.739130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b99ed65-55dc-457c-b339-ecec6f136578 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:35.739800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b99ed65-55dc-457c-b339-ecec6f136578 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:35.740487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8b99ed65-55dc-457c-b339-ecec6f136578 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:35.770372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8b99ed65-55dc-457c-b339-ecec6f136578 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:52:35.862344 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8b99ed65-55dc-457c-b339-ecec6f136578 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 204 len: 0 microversion: 2.1 time: 0.361325 Oct 04 18:52:35.864312 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3457/6921] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:35 2022] DELETE /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:52:35.871420 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:52:35.874040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:35.875081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:35.882011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3df6d578-e5c6-47a4-83aa-c9385f68a8b0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:35.882633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3df6d578-e5c6-47a4-83aa-c9385f68a8b0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:35.893204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3df6d578-e5c6-47a4-83aa-c9385f68a8b0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:35.893753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3df6d578-e5c6-47a4-83aa-c9385f68a8b0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:35.894208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3df6d578-e5c6-47a4-83aa-c9385f68a8b0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:35.894921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3df6d578-e5c6-47a4-83aa-c9385f68a8b0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:35.895421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3df6d578-e5c6-47a4-83aa-c9385f68a8b0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:35.895862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3df6d578-e5c6-47a4-83aa-c9385f68a8b0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:36.195718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3df6d578-e5c6-47a4-83aa-c9385f68a8b0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:36.210132 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3df6d578-e5c6-47a4-83aa-c9385f68a8b0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1577 microversion: 2.1 time: 0.342002 Oct 04 18:52:36.211078 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3465/6922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:35 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1577 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:37.238390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-90d1ea36-b802-4c45-8803-8ec61996c76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:37.239153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-90d1ea36-b802-4c45-8803-8ec61996c76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:37.246443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90d1ea36-b802-4c45-8803-8ec61996c76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:37.246990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90d1ea36-b802-4c45-8803-8ec61996c76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:37.247448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90d1ea36-b802-4c45-8803-8ec61996c76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:37.248203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90d1ea36-b802-4c45-8803-8ec61996c76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:37.248672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90d1ea36-b802-4c45-8803-8ec61996c76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:37.249114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-90d1ea36-b802-4c45-8803-8ec61996c76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:37.450438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-90d1ea36-b802-4c45-8803-8ec61996c76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:37.459322 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-90d1ea36-b802-4c45-8803-8ec61996c76b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1577 microversion: 2.1 time: 0.225101 Oct 04 18:52:37.460008 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3458/6923] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:37 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:38.484218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-18d49799-9aa2-4d81-a4b1-dbf41a814c02 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:38.485380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-18d49799-9aa2-4d81-a4b1-dbf41a814c02 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:38.494943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18d49799-9aa2-4d81-a4b1-dbf41a814c02 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:38.495468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18d49799-9aa2-4d81-a4b1-dbf41a814c02 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:38.495912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18d49799-9aa2-4d81-a4b1-dbf41a814c02 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:38.496620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18d49799-9aa2-4d81-a4b1-dbf41a814c02 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:38.497078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18d49799-9aa2-4d81-a4b1-dbf41a814c02 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:38.497503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18d49799-9aa2-4d81-a4b1-dbf41a814c02 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:38.503536 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44424. Oct 04 18:52:38.643393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-18d49799-9aa2-4d81-a4b1-dbf41a814c02 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:38.652183 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-18d49799-9aa2-4d81-a4b1-dbf41a814c02 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1577 microversion: 2.1 time: 0.172998 Oct 04 18:52:38.653150 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3466/6924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:38 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:38.957317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b93fd3d6-8006-49cd-b0d9-824564e6f4b3 req-e838e081-f433-47be-9cb6-cb0982d59ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aceeed29-e978-4760-afa0-03659eaf5c6e", "name": "network-vif-deleted", "tag": "8047d4ba-7784-4708-8baa-81d91eaac697"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:38.984438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b93fd3d6-8006-49cd-b0d9-824564e6f4b3 req-e838e081-f433-47be-9cb6-cb0982d59ed7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:38.985126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b93fd3d6-8006-49cd-b0d9-824564e6f4b3 req-e838e081-f433-47be-9cb6-cb0982d59ed7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:38.985739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b93fd3d6-8006-49cd-b0d9-824564e6f4b3 req-e838e081-f433-47be-9cb6-cb0982d59ed7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:39.016052 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b93fd3d6-8006-49cd-b0d9-824564e6f4b3 req-e838e081-f433-47be-9cb6-cb0982d59ed7 service nova] Creating event network-vif-deleted:8047d4ba-7784-4708-8baa-81d91eaac697 for instance aceeed29-e978-4760-afa0-03659eaf5c6e on n-h2-850499-14 Oct 04 18:52:39.023669 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b93fd3d6-8006-49cd-b0d9-824564e6f4b3 req-e838e081-f433-47be-9cb6-cb0982d59ed7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069773 Oct 04 18:52:39.024532 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3459/6925] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:39.692848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dd7991c0-17e5-4d7a-852e-1342502bf2a8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:39.693738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dd7991c0-17e5-4d7a-852e-1342502bf2a8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:39.701966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd7991c0-17e5-4d7a-852e-1342502bf2a8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:39.702773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd7991c0-17e5-4d7a-852e-1342502bf2a8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:39.703433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd7991c0-17e5-4d7a-852e-1342502bf2a8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:39.704499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd7991c0-17e5-4d7a-852e-1342502bf2a8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:39.705147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd7991c0-17e5-4d7a-852e-1342502bf2a8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:39.705869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd7991c0-17e5-4d7a-852e-1342502bf2a8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:39.788434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd7991c0-17e5-4d7a-852e-1342502bf2a8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:39.796922 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dd7991c0-17e5-4d7a-852e-1342502bf2a8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1225 microversion: 2.1 time: 0.107997 Oct 04 18:52:39.797577 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3467/6926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:39 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:40.821736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c7a5f0e7-551f-4c9f-a014-197d949a9972 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:40.822465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c7a5f0e7-551f-4c9f-a014-197d949a9972 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:40.829253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7a5f0e7-551f-4c9f-a014-197d949a9972 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:40.829763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7a5f0e7-551f-4c9f-a014-197d949a9972 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:40.830227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7a5f0e7-551f-4c9f-a014-197d949a9972 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:40.830948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7a5f0e7-551f-4c9f-a014-197d949a9972 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:40.831479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7a5f0e7-551f-4c9f-a014-197d949a9972 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:40.831898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c7a5f0e7-551f-4c9f-a014-197d949a9972 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:40.896566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c7a5f0e7-551f-4c9f-a014-197d949a9972 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:40.905196 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c7a5f0e7-551f-4c9f-a014-197d949a9972 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1225 microversion: 2.1 time: 0.088633 Oct 04 18:52:40.905773 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3460/6927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:40 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:41.928153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a90015c0-0d70-4c5f-93ee-65b45c77b1de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:41.928768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a90015c0-0d70-4c5f-93ee-65b45c77b1de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:41.936778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a90015c0-0d70-4c5f-93ee-65b45c77b1de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:41.937350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a90015c0-0d70-4c5f-93ee-65b45c77b1de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:41.938005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a90015c0-0d70-4c5f-93ee-65b45c77b1de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:41.938917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a90015c0-0d70-4c5f-93ee-65b45c77b1de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:41.939600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a90015c0-0d70-4c5f-93ee-65b45c77b1de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:41.940273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a90015c0-0d70-4c5f-93ee-65b45c77b1de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:42.002779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a90015c0-0d70-4c5f-93ee-65b45c77b1de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:42.010688 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a90015c0-0d70-4c5f-93ee-65b45c77b1de tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1225 microversion: 2.1 time: 0.086545 Oct 04 18:52:42.011288 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3468/6928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:41 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:43.033242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-47bf96cc-7034-4da4-88c7-c7340a892524 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:43.033872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-47bf96cc-7034-4da4-88c7-c7340a892524 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:43.041122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47bf96cc-7034-4da4-88c7-c7340a892524 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:43.041554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47bf96cc-7034-4da4-88c7-c7340a892524 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:43.042012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47bf96cc-7034-4da4-88c7-c7340a892524 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:43.042733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47bf96cc-7034-4da4-88c7-c7340a892524 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:43.043233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47bf96cc-7034-4da4-88c7-c7340a892524 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:43.044008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47bf96cc-7034-4da4-88c7-c7340a892524 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:43.109307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-47bf96cc-7034-4da4-88c7-c7340a892524 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:43.118209 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-47bf96cc-7034-4da4-88c7-c7340a892524 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 200 len: 1225 microversion: 2.1 time: 0.088880 Oct 04 18:52:43.118879 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3461/6929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:43 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:44.141846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:44.142455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:44.149871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:44.150360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:44.150797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:44.151771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:44.152299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:44.152797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:44.167026 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e HTTP/1.1 Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'aceeed29-e978-4760-afa0-03659eaf5c6e'} Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:44.168684 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:52:44.172643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:44.172643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:44.172643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:44.172643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:44.172643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:44.172643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:52:44.172643 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:52:44.172643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:44.172643 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-05ded58c-8ba2-4e11-b52f-03673ce3c84e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 404 len: 111 microversion: 2.1 time: 0.032737 Oct 04 18:52:44.178562 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3469/6930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:44 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:44.219567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1220252586", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1101435800", "security_groups": [{"name": "tempest-secgroup-smoke-1629660030"}], "block_device_mapping_v2": [{"uuid": "08ab7fc4-5efb-4345-9daa-212be60f45d6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7231cfd-11da-40a4-8d73-d5073342969a"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:44.337181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] validate_networks() for [('d7231cfd-11da-40a4-8d73-d5073342969a', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:52:44.719311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:52:44.719758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:52:44.720275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:52:44.720709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:52:44.721141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:52:44.731409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:44.731409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:44.731859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:44.733135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:44.733590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:44.734037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:44.752126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:52:44.758028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for user 594483c9afdc4f69a6d02f10e8fde137 and project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:52:44.817381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:52:44.819556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08ab7fc4-5efb-4345-9daa-212be60f45d6',volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:52:44.951775 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d76cb15-31f5-423c-b91a-350ec512bee7 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.736021 Oct 04 18:52:44.952931 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3462/6931] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:52:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:52:44.964251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7cc17a9e-9528-47f7-9868-f7c94c697949 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:44.965010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7cc17a9e-9528-47f7-9868-f7c94c697949 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:45.028286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7cc17a9e-9528-47f7-9868-f7c94c697949 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:45.036115 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7cc17a9e-9528-47f7-9868-f7c94c697949 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1095 microversion: 2.1 time: 0.075895 Oct 04 18:52:45.036950 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3470/6932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:44 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:46.059964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1bb9096-f5e5-423a-883c-85dfb0b44e82 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:46.060597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e1bb9096-f5e5-423a-883c-85dfb0b44e82 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:46.126463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1bb9096-f5e5-423a-883c-85dfb0b44e82 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:46.133643 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1bb9096-f5e5-423a-883c-85dfb0b44e82 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1095 microversion: 2.1 time: 0.078532 Oct 04 18:52:46.137457 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3463/6933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:46 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:47.157435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b639ec01-be70-4486-8723-358dbdae9996 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:47.158184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b639ec01-be70-4486-8723-358dbdae9996 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:47.213187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b639ec01-be70-4486-8723-358dbdae9996 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:47.220568 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b639ec01-be70-4486-8723-358dbdae9996 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1095 microversion: 2.1 time: 0.067557 Oct 04 18:52:47.221133 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3471/6934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:47 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:48.245670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bd828076-9fda-410c-b630-aeb6ce8fe20a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:48.245670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bd828076-9fda-410c-b630-aeb6ce8fe20a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:48.256467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd828076-9fda-410c-b630-aeb6ce8fe20a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.256992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd828076-9fda-410c-b630-aeb6ce8fe20a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.257459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd828076-9fda-410c-b630-aeb6ce8fe20a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.258549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd828076-9fda-410c-b630-aeb6ce8fe20a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.259094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd828076-9fda-410c-b630-aeb6ce8fe20a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.259553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd828076-9fda-410c-b630-aeb6ce8fe20a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.330492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bd828076-9fda-410c-b630-aeb6ce8fe20a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:48.339171 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bd828076-9fda-410c-b630-aeb6ce8fe20a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1211 microversion: 2.1 time: 0.098649 Oct 04 18:52:48.340591 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3464/6935] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:48 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:49.363387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bc1c84af-c733-4a1d-8dc2-b99491525f10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:49.364667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bc1c84af-c733-4a1d-8dc2-b99491525f10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:49.372037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc1c84af-c733-4a1d-8dc2-b99491525f10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:49.373323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc1c84af-c733-4a1d-8dc2-b99491525f10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:49.373947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc1c84af-c733-4a1d-8dc2-b99491525f10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.374831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc1c84af-c733-4a1d-8dc2-b99491525f10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:49.375483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc1c84af-c733-4a1d-8dc2-b99491525f10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:49.376071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc1c84af-c733-4a1d-8dc2-b99491525f10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.527945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bc1c84af-c733-4a1d-8dc2-b99491525f10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:49.537242 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bc1c84af-c733-4a1d-8dc2-b99491525f10 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1279 microversion: 2.1 time: 0.177652 Oct 04 18:52:49.538643 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3472/6936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:49 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:49.809354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4a2d1146-bea6-4f08-be72-59b395d2e296 req-402eb197-dc8b-43a5-83a6-aa57c5b4c4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f37e68-2867-4e14-b6b8-fe84d8ccf484", "tag": "79825cf1-34ad-40be-89d7-ad9f9fb45b96"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:49.820562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4a2d1146-bea6-4f08-be72-59b395d2e296 req-402eb197-dc8b-43a5-83a6-aa57c5b4c4cd service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:49.821142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4a2d1146-bea6-4f08-be72-59b395d2e296 req-402eb197-dc8b-43a5-83a6-aa57c5b4c4cd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:49.821593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4a2d1146-bea6-4f08-be72-59b395d2e296 req-402eb197-dc8b-43a5-83a6-aa57c5b4c4cd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.834189 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4a2d1146-bea6-4f08-be72-59b395d2e296 req-402eb197-dc8b-43a5-83a6-aa57c5b4c4cd service nova] Creating event network-changed:79825cf1-34ad-40be-89d7-ad9f9fb45b96 for instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 on n-h2-850499-14 Oct 04 18:52:49.839818 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4a2d1146-bea6-4f08-be72-59b395d2e296 req-402eb197-dc8b-43a5-83a6-aa57c5b4c4cd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034033 Oct 04 18:52:49.840437 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3465/6937] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:50.562690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ed4cce5-4226-4718-83f4-3246260003cd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:50.563595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ed4cce5-4226-4718-83f4-3246260003cd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:50.570599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ed4cce5-4226-4718-83f4-3246260003cd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.571310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ed4cce5-4226-4718-83f4-3246260003cd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.571851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ed4cce5-4226-4718-83f4-3246260003cd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.572628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ed4cce5-4226-4718-83f4-3246260003cd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.573165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ed4cce5-4226-4718-83f4-3246260003cd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.573788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ed4cce5-4226-4718-83f4-3246260003cd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.711824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ed4cce5-4226-4718-83f4-3246260003cd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:50.720343 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ed4cce5-4226-4718-83f4-3246260003cd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1279 microversion: 2.1 time: 0.162366 Oct 04 18:52:50.721110 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3473/6938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:50 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:51.746191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27b62acf-2191-4edc-962c-69b48587ed20 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:51.746903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27b62acf-2191-4edc-962c-69b48587ed20 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:51.754538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b62acf-2191-4edc-962c-69b48587ed20 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:51.755044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b62acf-2191-4edc-962c-69b48587ed20 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:51.755498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b62acf-2191-4edc-962c-69b48587ed20 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:51.756217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b62acf-2191-4edc-962c-69b48587ed20 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:51.756691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b62acf-2191-4edc-962c-69b48587ed20 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:51.757130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27b62acf-2191-4edc-962c-69b48587ed20 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:51.901533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27b62acf-2191-4edc-962c-69b48587ed20 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:51.910196 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27b62acf-2191-4edc-962c-69b48587ed20 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1279 microversion: 2.1 time: 0.168643 Oct 04 18:52:51.910786 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3466/6939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:51 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:52.933038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a37861aa-78bf-497a-95a7-02e47641f9c5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:52.933727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a37861aa-78bf-497a-95a7-02e47641f9c5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:52.941279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37861aa-78bf-497a-95a7-02e47641f9c5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:52.941765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37861aa-78bf-497a-95a7-02e47641f9c5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:52.942204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37861aa-78bf-497a-95a7-02e47641f9c5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:52.942899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37861aa-78bf-497a-95a7-02e47641f9c5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:52.943381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37861aa-78bf-497a-95a7-02e47641f9c5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:52.943804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a37861aa-78bf-497a-95a7-02e47641f9c5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.082830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a37861aa-78bf-497a-95a7-02e47641f9c5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:53.091148 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a37861aa-78bf-497a-95a7-02e47641f9c5 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1279 microversion: 2.1 time: 0.161968 Oct 04 18:52:53.091744 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3474/6940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:52 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:54.113589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-19c21bd4-9701-4ce3-84a0-833b7ff0cfac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:54.114245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-19c21bd4-9701-4ce3-84a0-833b7ff0cfac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:54.121195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19c21bd4-9701-4ce3-84a0-833b7ff0cfac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.121706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19c21bd4-9701-4ce3-84a0-833b7ff0cfac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.122171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19c21bd4-9701-4ce3-84a0-833b7ff0cfac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.123519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19c21bd4-9701-4ce3-84a0-833b7ff0cfac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.123999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19c21bd4-9701-4ce3-84a0-833b7ff0cfac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.124447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-19c21bd4-9701-4ce3-84a0-833b7ff0cfac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.257083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-19c21bd4-9701-4ce3-84a0-833b7ff0cfac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:54.267098 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-19c21bd4-9701-4ce3-84a0-833b7ff0cfac tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1279 microversion: 2.1 time: 0.157306 Oct 04 18:52:54.267917 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3467/6941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:54 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:55.291248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d1e2d80e-1312-4f59-a401-3de047cfb7be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:55.292011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d1e2d80e-1312-4f59-a401-3de047cfb7be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:55.299001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e2d80e-1312-4f59-a401-3de047cfb7be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:55.299500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e2d80e-1312-4f59-a401-3de047cfb7be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:55.299948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e2d80e-1312-4f59-a401-3de047cfb7be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:55.300658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e2d80e-1312-4f59-a401-3de047cfb7be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:55.301117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e2d80e-1312-4f59-a401-3de047cfb7be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:55.301551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e2d80e-1312-4f59-a401-3de047cfb7be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:55.441712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d1e2d80e-1312-4f59-a401-3de047cfb7be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:55.448795 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d1e2d80e-1312-4f59-a401-3de047cfb7be tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1279 microversion: 2.1 time: 0.161321 Oct 04 18:52:55.449395 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3475/6942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:55 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:56.472855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-674e0693-a74b-4fdb-a386-37a352dd67db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:56.473494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-674e0693-a74b-4fdb-a386-37a352dd67db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:56.475801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:56.477514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:56.484300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674e0693-a74b-4fdb-a386-37a352dd67db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.484815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674e0693-a74b-4fdb-a386-37a352dd67db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.485290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674e0693-a74b-4fdb-a386-37a352dd67db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.486023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674e0693-a74b-4fdb-a386-37a352dd67db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.486510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674e0693-a74b-4fdb-a386-37a352dd67db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.487010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-674e0693-a74b-4fdb-a386-37a352dd67db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.618551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-674e0693-a74b-4fdb-a386-37a352dd67db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:56.626891 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-674e0693-a74b-4fdb-a386-37a352dd67db tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.157956 Oct 04 18:52:56.627596 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3468/6943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:56 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:57.649729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8adc596-dfa2-4ddd-b999-df02bf677baf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:57.650276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f8adc596-dfa2-4ddd-b999-df02bf677baf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:57.653050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:57.658519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8adc596-dfa2-4ddd-b999-df02bf677baf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.659035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8adc596-dfa2-4ddd-b999-df02bf677baf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.659489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8adc596-dfa2-4ddd-b999-df02bf677baf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.660197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8adc596-dfa2-4ddd-b999-df02bf677baf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.660666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8adc596-dfa2-4ddd-b999-df02bf677baf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.661104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8adc596-dfa2-4ddd-b999-df02bf677baf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.794268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f8adc596-dfa2-4ddd-b999-df02bf677baf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:57.802718 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8adc596-dfa2-4ddd-b999-df02bf677baf tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.156930 Oct 04 18:52:57.803316 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3476/6944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:57 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:58.909942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9a8a6638-4fa1-4785-8b3d-fccfa98f0f83 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:58.909942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9a8a6638-4fa1-4785-8b3d-fccfa98f0f83 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:58.909942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8a6638-4fa1-4785-8b3d-fccfa98f0f83 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.909942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8a6638-4fa1-4785-8b3d-fccfa98f0f83 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.909942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8a6638-4fa1-4785-8b3d-fccfa98f0f83 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.909942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8a6638-4fa1-4785-8b3d-fccfa98f0f83 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.909942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8a6638-4fa1-4785-8b3d-fccfa98f0f83 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.909942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9a8a6638-4fa1-4785-8b3d-fccfa98f0f83 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.981236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9a8a6638-4fa1-4785-8b3d-fccfa98f0f83 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:58.989671 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9a8a6638-4fa1-4785-8b3d-fccfa98f0f83 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.167662 Oct 04 18:52:58.990254 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3469/6945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:58 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:00.012726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c5a9b6b-ee02-4da7-83b1-d1c571b98704 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:00.013511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c5a9b6b-ee02-4da7-83b1-d1c571b98704 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:00.020211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c5a9b6b-ee02-4da7-83b1-d1c571b98704 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.020705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c5a9b6b-ee02-4da7-83b1-d1c571b98704 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.021151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c5a9b6b-ee02-4da7-83b1-d1c571b98704 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.021857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c5a9b6b-ee02-4da7-83b1-d1c571b98704 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.022319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c5a9b6b-ee02-4da7-83b1-d1c571b98704 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.022761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c5a9b6b-ee02-4da7-83b1-d1c571b98704 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.160759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4c5a9b6b-ee02-4da7-83b1-d1c571b98704 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:00.169321 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c5a9b6b-ee02-4da7-83b1-d1c571b98704 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.160596 Oct 04 18:53:00.170491 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3477/6946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:00 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:01.193831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-201bf752-7fc2-4517-a590-527f0f9a8d05 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:01.194470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-201bf752-7fc2-4517-a590-527f0f9a8d05 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:01.201526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201bf752-7fc2-4517-a590-527f0f9a8d05 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.202028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201bf752-7fc2-4517-a590-527f0f9a8d05 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.202487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201bf752-7fc2-4517-a590-527f0f9a8d05 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.203259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201bf752-7fc2-4517-a590-527f0f9a8d05 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.203735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201bf752-7fc2-4517-a590-527f0f9a8d05 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.204179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-201bf752-7fc2-4517-a590-527f0f9a8d05 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.347844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-201bf752-7fc2-4517-a590-527f0f9a8d05 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:01.358511 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-201bf752-7fc2-4517-a590-527f0f9a8d05 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.169396 Oct 04 18:53:01.359147 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3470/6947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:01 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:02.382010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ccc6b726-65ec-4472-b446-f77af1632cfe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:02.382752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ccc6b726-65ec-4472-b446-f77af1632cfe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:02.390315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccc6b726-65ec-4472-b446-f77af1632cfe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:02.390901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccc6b726-65ec-4472-b446-f77af1632cfe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:02.391291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccc6b726-65ec-4472-b446-f77af1632cfe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:02.392016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccc6b726-65ec-4472-b446-f77af1632cfe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:02.392480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccc6b726-65ec-4472-b446-f77af1632cfe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:02.392913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ccc6b726-65ec-4472-b446-f77af1632cfe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:02.541043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ccc6b726-65ec-4472-b446-f77af1632cfe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:02.550020 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ccc6b726-65ec-4472-b446-f77af1632cfe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.171962 Oct 04 18:53:02.550621 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3478/6948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:02 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:03.574337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13a8b816-fd88-48a3-99fa-7806766e5ffe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:03.575077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-13a8b816-fd88-48a3-99fa-7806766e5ffe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:03.583729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a8b816-fd88-48a3-99fa-7806766e5ffe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.584250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a8b816-fd88-48a3-99fa-7806766e5ffe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.584724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a8b816-fd88-48a3-99fa-7806766e5ffe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.585779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a8b816-fd88-48a3-99fa-7806766e5ffe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.586270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a8b816-fd88-48a3-99fa-7806766e5ffe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.586723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13a8b816-fd88-48a3-99fa-7806766e5ffe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.086736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-13a8b816-fd88-48a3-99fa-7806766e5ffe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:04.094864 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-13a8b816-fd88-48a3-99fa-7806766e5ffe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.524695 Oct 04 18:53:04.095807 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3471/6949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:03 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:05.117711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-be4d8921-f78a-4251-a529-dfa5a1d0fa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:05.118323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-be4d8921-f78a-4251-a529-dfa5a1d0fa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:05.125730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4d8921-f78a-4251-a529-dfa5a1d0fa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.126221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4d8921-f78a-4251-a529-dfa5a1d0fa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.126662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4d8921-f78a-4251-a529-dfa5a1d0fa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.127386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4d8921-f78a-4251-a529-dfa5a1d0fa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.127964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4d8921-f78a-4251-a529-dfa5a1d0fa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.128364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be4d8921-f78a-4251-a529-dfa5a1d0fa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.269353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be4d8921-f78a-4251-a529-dfa5a1d0fa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:05.277180 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-be4d8921-f78a-4251-a529-dfa5a1d0fa24 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.163373 Oct 04 18:53:05.277760 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3479/6950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:05 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:06.300983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2e34a5a9-f05c-4dbf-914a-af54cfa25720 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:06.302456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2e34a5a9-f05c-4dbf-914a-af54cfa25720 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:06.304702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:06.310154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e34a5a9-f05c-4dbf-914a-af54cfa25720 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:06.310709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e34a5a9-f05c-4dbf-914a-af54cfa25720 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:06.311181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e34a5a9-f05c-4dbf-914a-af54cfa25720 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.311921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e34a5a9-f05c-4dbf-914a-af54cfa25720 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:06.312397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e34a5a9-f05c-4dbf-914a-af54cfa25720 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:06.312845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e34a5a9-f05c-4dbf-914a-af54cfa25720 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.316338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:06.468727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2e34a5a9-f05c-4dbf-914a-af54cfa25720 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:06.477317 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2e34a5a9-f05c-4dbf-914a-af54cfa25720 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.180780 Oct 04 18:53:06.477920 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3472/6951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:06 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:06.964447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-20e17be8-c088-4bf0-8c3c-dc6556af821c req-7235b6e6-d5f0-4e0c-bf8b-eefbac396b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f37e68-2867-4e14-b6b8-fe84d8ccf484", "name": "network-vif-plugged", "status": "completed", "tag": "79825cf1-34ad-40be-89d7-ad9f9fb45b96"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:06.973041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=35 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:06.977221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-20e17be8-c088-4bf0-8c3c-dc6556af821c req-7235b6e6-d5f0-4e0c-bf8b-eefbac396b89 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:06.977710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-20e17be8-c088-4bf0-8c3c-dc6556af821c req-7235b6e6-d5f0-4e0c-bf8b-eefbac396b89 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:06.978322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-20e17be8-c088-4bf0-8c3c-dc6556af821c req-7235b6e6-d5f0-4e0c-bf8b-eefbac396b89 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.982584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=75 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:06.990791 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-20e17be8-c088-4bf0-8c3c-dc6556af821c req-7235b6e6-d5f0-4e0c-bf8b-eefbac396b89 service nova] Creating event network-vif-plugged:79825cf1-34ad-40be-89d7-ad9f9fb45b96 for instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 on n-h2-850499-14 Oct 04 18:53:06.996287 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-20e17be8-c088-4bf0-8c3c-dc6556af821c req-7235b6e6-d5f0-4e0c-bf8b-eefbac396b89 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035653 Oct 04 18:53:06.997556 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3480/6952] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:07.507072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d779c9d-8b66-4b7f-8704-b5bdfdb80374 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:07.507072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d779c9d-8b66-4b7f-8704-b5bdfdb80374 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:07.509417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d779c9d-8b66-4b7f-8704-b5bdfdb80374 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.509929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d779c9d-8b66-4b7f-8704-b5bdfdb80374 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.510390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d779c9d-8b66-4b7f-8704-b5bdfdb80374 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.511181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d779c9d-8b66-4b7f-8704-b5bdfdb80374 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.511657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d779c9d-8b66-4b7f-8704-b5bdfdb80374 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.512105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d779c9d-8b66-4b7f-8704-b5bdfdb80374 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.654139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d779c9d-8b66-4b7f-8704-b5bdfdb80374 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:07.662163 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d779c9d-8b66-4b7f-8704-b5bdfdb80374 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.165130 Oct 04 18:53:07.662750 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3473/6953] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:07 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:08.687285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cef6f476-b663-4aab-8b70-a7bd1f1ebfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:08.688005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cef6f476-b663-4aab-8b70-a7bd1f1ebfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:08.694896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef6f476-b663-4aab-8b70-a7bd1f1ebfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.695432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef6f476-b663-4aab-8b70-a7bd1f1ebfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.695883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef6f476-b663-4aab-8b70-a7bd1f1ebfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.696670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef6f476-b663-4aab-8b70-a7bd1f1ebfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.697117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef6f476-b663-4aab-8b70-a7bd1f1ebfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.697540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef6f476-b663-4aab-8b70-a7bd1f1ebfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.879876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cef6f476-b663-4aab-8b70-a7bd1f1ebfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.888018 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cef6f476-b663-4aab-8b70-a7bd1f1ebfad tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1267 microversion: 2.1 time: 0.207151 Oct 04 18:53:08.888603 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3481/6954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:08 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:09.912216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb909a56-80fa-49d2-9fde-307a3bc9b28b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.912860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb909a56-80fa-49d2-9fde-307a3bc9b28b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:09.919878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb909a56-80fa-49d2-9fde-307a3bc9b28b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.920395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb909a56-80fa-49d2-9fde-307a3bc9b28b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.921362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb909a56-80fa-49d2-9fde-307a3bc9b28b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.922096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb909a56-80fa-49d2-9fde-307a3bc9b28b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.922583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb909a56-80fa-49d2-9fde-307a3bc9b28b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.923066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb909a56-80fa-49d2-9fde-307a3bc9b28b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.067751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cb909a56-80fa-49d2-9fde-307a3bc9b28b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:10.077082 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb909a56-80fa-49d2-9fde-307a3bc9b28b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1455 microversion: 2.1 time: 0.168740 Oct 04 18:53:10.077704 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3474/6955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:10.103371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59afb709-dae6-4b7f-8a16-eb394505e56e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.104061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59afb709-dae6-4b7f-8a16-eb394505e56e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:10.114064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59afb709-dae6-4b7f-8a16-eb394505e56e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.114650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59afb709-dae6-4b7f-8a16-eb394505e56e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.115278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59afb709-dae6-4b7f-8a16-eb394505e56e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.116012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59afb709-dae6-4b7f-8a16-eb394505e56e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.116537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59afb709-dae6-4b7f-8a16-eb394505e56e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.117028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59afb709-dae6-4b7f-8a16-eb394505e56e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.278654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-59afb709-dae6-4b7f-8a16-eb394505e56e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:10.288949 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59afb709-dae6-4b7f-8a16-eb394505e56e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1455 microversion: 2.1 time: 0.192345 Oct 04 18:53:10.289694 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3482/6956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:10 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1455 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:12.192119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-9169cc46-e9c0-4619-bf1d-17e2080a8f69 req-4d6b3733-ffeb-4bd0-84ae-df10427d1ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f37e68-2867-4e14-b6b8-fe84d8ccf484", "tag": "79825cf1-34ad-40be-89d7-ad9f9fb45b96"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:12.203830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9169cc46-e9c0-4619-bf1d-17e2080a8f69 req-4d6b3733-ffeb-4bd0-84ae-df10427d1ceb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.204582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9169cc46-e9c0-4619-bf1d-17e2080a8f69 req-4d6b3733-ffeb-4bd0-84ae-df10427d1ceb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.205220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9169cc46-e9c0-4619-bf1d-17e2080a8f69 req-4d6b3733-ffeb-4bd0-84ae-df10427d1ceb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.216993 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9169cc46-e9c0-4619-bf1d-17e2080a8f69 req-4d6b3733-ffeb-4bd0-84ae-df10427d1ceb service nova] Creating event network-changed:79825cf1-34ad-40be-89d7-ad9f9fb45b96 for instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 on n-h2-850499-14 Oct 04 18:53:12.223669 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-9169cc46-e9c0-4619-bf1d-17e2080a8f69 req-4d6b3733-ffeb-4bd0-84ae-df10427d1ceb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109600 Oct 04 18:53:12.224455 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3475/6957] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:16.912718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d417df6c-c7da-4ea9-9f7c-7a4edf0a301c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Action: 'create', calling method: .version_select at 0x7fd4d09c5700>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2086382090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQh8zW2hYdtYVuJWEOKDpWl7BPjCd6eFUGefxrXXsqmDBu8niHB67z1mYc2CUjVjFiXb05dfb1lqWHaS3eArhpZQXiiIP9xM5hT982PbP65O37pGMwSHHuOxANoBYQGTA=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:16.928804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d417df6c-c7da-4ea9-9f7c-7a4edf0a301c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Getting quotas for project 5b4330e555204db1867d4ad0294b271e. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:16.934909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d417df6c-c7da-4ea9-9f7c-7a4edf0a301c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Getting quotas for user 6fb7f8891e434db98e43483baac84784 and project 5b4330e555204db1867d4ad0294b271e. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:16.960601 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d417df6c-c7da-4ea9-9f7c-7a4edf0a301c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052087 Oct 04 18:53:16.961216 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3483/6958] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:53:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:17.904271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1544722337", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "59fefa02-0039-4aba-91ca-49055db9d7f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2086382090", "security_groups": [{"name": "tempest-secgroup-smoke-1384132178"}], "networks": [{"uuid": "1d002c34-b248-4aa3-a97f-792c6b389346"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:18.023121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] validate_networks() for [('1d002c34-b248-4aa3-a97f-792c6b389346', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:53:18.412056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:53:18.412734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:53:18.413246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:53:18.413682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:53:18.414117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:53:18.423007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.423519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.423983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:18.424742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.425231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.425678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:18.443661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Getting quotas for project 5b4330e555204db1867d4ad0294b271e. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:18.449134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Getting quotas for user 6fb7f8891e434db98e43483baac84784 and project 5b4330e555204db1867d4ad0294b271e. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:18.510767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:53:18.513049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59fefa02-0039-4aba-91ca-49055db9d7f6',volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:53:18.640154 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ad394ea-aa40-496d-a87d-bc1fa77ac268 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741154 Oct 04 18:53:18.640739 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3476/6959] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:53:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:53:18.652718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8fde730-4803-4201-9a52-479389f89acf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:18.653450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e8fde730-4803-4201-9a52-479389f89acf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:18.707302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8fde730-4803-4201-9a52-479389f89acf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:18.714227 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e8fde730-4803-4201-9a52-479389f89acf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1099 microversion: 2.1 time: 0.066205 Oct 04 18:53:18.714796 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3484/6960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:18 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1099 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:19.747279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-124e91ca-b79f-42e4-9a4c-aa693da55a3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:19.749908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-124e91ca-b79f-42e4-9a4c-aa693da55a3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:19.784247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-124e91ca-b79f-42e4-9a4c-aa693da55a3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.791999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-124e91ca-b79f-42e4-9a4c-aa693da55a3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.792830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-124e91ca-b79f-42e4-9a4c-aa693da55a3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.794100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-124e91ca-b79f-42e4-9a4c-aa693da55a3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.794898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-124e91ca-b79f-42e4-9a4c-aa693da55a3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.795556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-124e91ca-b79f-42e4-9a4c-aa693da55a3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.903528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-124e91ca-b79f-42e4-9a4c-aa693da55a3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:19.914703 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-124e91ca-b79f-42e4-9a4c-aa693da55a3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1215 microversion: 2.1 time: 0.179507 Oct 04 18:53:19.927076 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3477/6961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:19 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:20.939812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85eb462c-e83b-4d87-9dee-4248a8881b0c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:20.940467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-85eb462c-e83b-4d87-9dee-4248a8881b0c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:20.944579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=13 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:20.950609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85eb462c-e83b-4d87-9dee-4248a8881b0c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:20.951132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85eb462c-e83b-4d87-9dee-4248a8881b0c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:20.951846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85eb462c-e83b-4d87-9dee-4248a8881b0c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:20.952560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85eb462c-e83b-4d87-9dee-4248a8881b0c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:20.953017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85eb462c-e83b-4d87-9dee-4248a8881b0c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:20.953436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85eb462c-e83b-4d87-9dee-4248a8881b0c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.100539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-85eb462c-e83b-4d87-9dee-4248a8881b0c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:21.110412 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-85eb462c-e83b-4d87-9dee-4248a8881b0c tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1283 microversion: 2.1 time: 0.175069 Oct 04 18:53:21.123466 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3485/6962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:20 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:21.406005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5929d25a-90f4-4692-8088-d3e848c1a507 req-0459faa2-3f78-4177-b701-7c939cf17f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ec2b13-2a2a-48a3-b93d-1986ac0add8d", "tag": "68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:21.423688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5929d25a-90f4-4692-8088-d3e848c1a507 req-0459faa2-3f78-4177-b701-7c939cf17f31 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.424203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5929d25a-90f4-4692-8088-d3e848c1a507 req-0459faa2-3f78-4177-b701-7c939cf17f31 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.424663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5929d25a-90f4-4692-8088-d3e848c1a507 req-0459faa2-3f78-4177-b701-7c939cf17f31 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.437176 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5929d25a-90f4-4692-8088-d3e848c1a507 req-0459faa2-3f78-4177-b701-7c939cf17f31 service nova] Creating event network-changed:68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c for instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d on n-h1-850499-14 Oct 04 18:53:21.442220 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5929d25a-90f4-4692-8088-d3e848c1a507 req-0459faa2-3f78-4177-b701-7c939cf17f31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041801 Oct 04 18:53:21.442844 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3478/6963] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:22.134886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-107e5e9a-ea50-48e9-a02e-785fb207f443 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:22.135483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-107e5e9a-ea50-48e9-a02e-785fb207f443 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:22.143173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-107e5e9a-ea50-48e9-a02e-785fb207f443 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.143897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-107e5e9a-ea50-48e9-a02e-785fb207f443 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.144400 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-107e5e9a-ea50-48e9-a02e-785fb207f443 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.145292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-107e5e9a-ea50-48e9-a02e-785fb207f443 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.145915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-107e5e9a-ea50-48e9-a02e-785fb207f443 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.146343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-107e5e9a-ea50-48e9-a02e-785fb207f443 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.295897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-107e5e9a-ea50-48e9-a02e-785fb207f443 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:22.313581 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-107e5e9a-ea50-48e9-a02e-785fb207f443 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1283 microversion: 2.1 time: 0.182523 Oct 04 18:53:22.314204 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3486/6964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:22 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:23.338055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ea4d4de0-0b25-4cfb-94e6-067ba7c29c3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:23.338936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ea4d4de0-0b25-4cfb-94e6-067ba7c29c3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:23.345907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea4d4de0-0b25-4cfb-94e6-067ba7c29c3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.346420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea4d4de0-0b25-4cfb-94e6-067ba7c29c3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.346875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea4d4de0-0b25-4cfb-94e6-067ba7c29c3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.347628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea4d4de0-0b25-4cfb-94e6-067ba7c29c3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.348098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea4d4de0-0b25-4cfb-94e6-067ba7c29c3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.348543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea4d4de0-0b25-4cfb-94e6-067ba7c29c3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.497637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ea4d4de0-0b25-4cfb-94e6-067ba7c29c3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:23.509129 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ea4d4de0-0b25-4cfb-94e6-067ba7c29c3f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1283 microversion: 2.1 time: 0.176084 Oct 04 18:53:23.509927 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3479/6965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:23 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1283 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:24.534311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-27306e3d-eb73-4c3b-bc1b-d6499cd8dfcc tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:24.535049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-27306e3d-eb73-4c3b-bc1b-d6499cd8dfcc tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:24.542056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27306e3d-eb73-4c3b-bc1b-d6499cd8dfcc tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.542545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27306e3d-eb73-4c3b-bc1b-d6499cd8dfcc tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.543005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27306e3d-eb73-4c3b-bc1b-d6499cd8dfcc tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.543750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27306e3d-eb73-4c3b-bc1b-d6499cd8dfcc tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.544167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27306e3d-eb73-4c3b-bc1b-d6499cd8dfcc tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.544594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-27306e3d-eb73-4c3b-bc1b-d6499cd8dfcc tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.687486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-27306e3d-eb73-4c3b-bc1b-d6499cd8dfcc tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:24.696440 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-27306e3d-eb73-4c3b-bc1b-d6499cd8dfcc tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1283 microversion: 2.1 time: 0.165982 Oct 04 18:53:24.697101 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3487/6966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:24 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:25.721944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb7de93c-0401-4259-9514-226fbeece43d tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:25.722622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb7de93c-0401-4259-9514-226fbeece43d tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:25.729804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb7de93c-0401-4259-9514-226fbeece43d tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.730309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb7de93c-0401-4259-9514-226fbeece43d tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.730762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb7de93c-0401-4259-9514-226fbeece43d tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.731517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb7de93c-0401-4259-9514-226fbeece43d tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.731989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb7de93c-0401-4259-9514-226fbeece43d tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.732431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb7de93c-0401-4259-9514-226fbeece43d tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.867408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cb7de93c-0401-4259-9514-226fbeece43d tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:25.875103 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb7de93c-0401-4259-9514-226fbeece43d tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1271 microversion: 2.1 time: 0.157208 Oct 04 18:53:25.875675 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3480/6967] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:25 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:26.900287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c48c1627-e8a0-4e76-90f3-81a9be484a31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:26.901338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c48c1627-e8a0-4e76-90f3-81a9be484a31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:26.908387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c1627-e8a0-4e76-90f3-81a9be484a31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.908875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c1627-e8a0-4e76-90f3-81a9be484a31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.909316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c1627-e8a0-4e76-90f3-81a9be484a31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:26.910008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c1627-e8a0-4e76-90f3-81a9be484a31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.910552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c1627-e8a0-4e76-90f3-81a9be484a31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.911021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c48c1627-e8a0-4e76-90f3-81a9be484a31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.046799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c48c1627-e8a0-4e76-90f3-81a9be484a31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:27.054897 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c48c1627-e8a0-4e76-90f3-81a9be484a31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1271 microversion: 2.1 time: 0.160547 Oct 04 18:53:27.055510 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3488/6968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:26 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:28.078389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f301a4e1-9662-4cb1-9cad-e37ef4b2efb2 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:28.079047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f301a4e1-9662-4cb1-9cad-e37ef4b2efb2 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:28.086079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f301a4e1-9662-4cb1-9cad-e37ef4b2efb2 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.086595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f301a4e1-9662-4cb1-9cad-e37ef4b2efb2 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.087075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f301a4e1-9662-4cb1-9cad-e37ef4b2efb2 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.087795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f301a4e1-9662-4cb1-9cad-e37ef4b2efb2 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.088268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f301a4e1-9662-4cb1-9cad-e37ef4b2efb2 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.088707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f301a4e1-9662-4cb1-9cad-e37ef4b2efb2 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.240675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f301a4e1-9662-4cb1-9cad-e37ef4b2efb2 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:28.249323 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f301a4e1-9662-4cb1-9cad-e37ef4b2efb2 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1271 microversion: 2.1 time: 0.174900 Oct 04 18:53:28.250146 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3481/6969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:28 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:29.275278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cf4bfbb9-40ac-4154-9b91-7ade18524687 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:29.275919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cf4bfbb9-40ac-4154-9b91-7ade18524687 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:29.278416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:29.283934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf4bfbb9-40ac-4154-9b91-7ade18524687 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.284358 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf4bfbb9-40ac-4154-9b91-7ade18524687 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.284796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf4bfbb9-40ac-4154-9b91-7ade18524687 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.285486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf4bfbb9-40ac-4154-9b91-7ade18524687 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.285941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf4bfbb9-40ac-4154-9b91-7ade18524687 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.286368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf4bfbb9-40ac-4154-9b91-7ade18524687 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.421198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cf4bfbb9-40ac-4154-9b91-7ade18524687 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:29.429154 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cf4bfbb9-40ac-4154-9b91-7ade18524687 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1271 microversion: 2.1 time: 0.157806 Oct 04 18:53:29.429720 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3489/6970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:29 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:30.451914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-79db739a-9428-4196-a7b4-3e26a8fb5cdf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:30.452551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-79db739a-9428-4196-a7b4-3e26a8fb5cdf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:30.454529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:30.455803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:30.463254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79db739a-9428-4196-a7b4-3e26a8fb5cdf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:30.463767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79db739a-9428-4196-a7b4-3e26a8fb5cdf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:30.464230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79db739a-9428-4196-a7b4-3e26a8fb5cdf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:30.464950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79db739a-9428-4196-a7b4-3e26a8fb5cdf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:30.465429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79db739a-9428-4196-a7b4-3e26a8fb5cdf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:30.465877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79db739a-9428-4196-a7b4-3e26a8fb5cdf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:30.605147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-79db739a-9428-4196-a7b4-3e26a8fb5cdf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:30.613414 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-79db739a-9428-4196-a7b4-3e26a8fb5cdf tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1271 microversion: 2.1 time: 0.165436 Oct 04 18:53:30.613981 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3482/6971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:30 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:31.638413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d588266d-bb46-4532-a542-4c6d00bcfb05 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:31.639593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d588266d-bb46-4532-a542-4c6d00bcfb05 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:31.646758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d588266d-bb46-4532-a542-4c6d00bcfb05 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.647296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d588266d-bb46-4532-a542-4c6d00bcfb05 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.647746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d588266d-bb46-4532-a542-4c6d00bcfb05 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.648660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d588266d-bb46-4532-a542-4c6d00bcfb05 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.648913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d588266d-bb46-4532-a542-4c6d00bcfb05 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.649344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d588266d-bb46-4532-a542-4c6d00bcfb05 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.791566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d588266d-bb46-4532-a542-4c6d00bcfb05 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:31.800361 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d588266d-bb46-4532-a542-4c6d00bcfb05 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1271 microversion: 2.1 time: 0.166039 Oct 04 18:53:31.800921 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3490/6972] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:31 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:32.832169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d822a7b3-4b73-4ea2-8fb9-27511bd5ac8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:32.833627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d822a7b3-4b73-4ea2-8fb9-27511bd5ac8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:32.839957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d822a7b3-4b73-4ea2-8fb9-27511bd5ac8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:32.840515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d822a7b3-4b73-4ea2-8fb9-27511bd5ac8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:32.840974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d822a7b3-4b73-4ea2-8fb9-27511bd5ac8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:32.841725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d822a7b3-4b73-4ea2-8fb9-27511bd5ac8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:32.842224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d822a7b3-4b73-4ea2-8fb9-27511bd5ac8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:32.842748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d822a7b3-4b73-4ea2-8fb9-27511bd5ac8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:32.999893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d822a7b3-4b73-4ea2-8fb9-27511bd5ac8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:33.008492 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d822a7b3-4b73-4ea2-8fb9-27511bd5ac8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1271 microversion: 2.1 time: 0.181589 Oct 04 18:53:33.009504 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3483/6973] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:32 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:34.032311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-17536449-cd8c-4378-a801-9f0405d92f7a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:34.032974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-17536449-cd8c-4378-a801-9f0405d92f7a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:34.040021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17536449-cd8c-4378-a801-9f0405d92f7a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.040512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17536449-cd8c-4378-a801-9f0405d92f7a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.040960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17536449-cd8c-4378-a801-9f0405d92f7a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.041662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17536449-cd8c-4378-a801-9f0405d92f7a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.042203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17536449-cd8c-4378-a801-9f0405d92f7a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.042637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-17536449-cd8c-4378-a801-9f0405d92f7a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.182125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-17536449-cd8c-4378-a801-9f0405d92f7a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:34.191244 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-17536449-cd8c-4378-a801-9f0405d92f7a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1271 microversion: 2.1 time: 0.162906 Oct 04 18:53:34.191834 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3491/6974] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:34 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:35.066145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8a79740e-9f9c-4d91-9465-be4ca6e1b83e req-64a326cb-380c-4659-8351-d1e01068a271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ec2b13-2a2a-48a3-b93d-1986ac0add8d", "name": "network-vif-plugged", "status": "completed", "tag": "68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:35.077415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8a79740e-9f9c-4d91-9465-be4ca6e1b83e req-64a326cb-380c-4659-8351-d1e01068a271 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.077925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8a79740e-9f9c-4d91-9465-be4ca6e1b83e req-64a326cb-380c-4659-8351-d1e01068a271 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.078514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8a79740e-9f9c-4d91-9465-be4ca6e1b83e req-64a326cb-380c-4659-8351-d1e01068a271 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.098343 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8a79740e-9f9c-4d91-9465-be4ca6e1b83e req-64a326cb-380c-4659-8351-d1e01068a271 service nova] Creating event network-vif-plugged:68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c for instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d on n-h1-850499-14 Oct 04 18:53:35.105159 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8a79740e-9f9c-4d91-9465-be4ca6e1b83e req-64a326cb-380c-4659-8351-d1e01068a271 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043408 Oct 04 18:53:35.106086 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3484/6975] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:35.218689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e749950b-ebc8-49fc-aa99-acd046138560 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:35.220044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e749950b-ebc8-49fc-aa99-acd046138560 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:35.229911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e749950b-ebc8-49fc-aa99-acd046138560 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.230514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e749950b-ebc8-49fc-aa99-acd046138560 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.231177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e749950b-ebc8-49fc-aa99-acd046138560 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.231998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e749950b-ebc8-49fc-aa99-acd046138560 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.232609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e749950b-ebc8-49fc-aa99-acd046138560 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.233179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e749950b-ebc8-49fc-aa99-acd046138560 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.385672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e749950b-ebc8-49fc-aa99-acd046138560 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:35.394919 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e749950b-ebc8-49fc-aa99-acd046138560 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1271 microversion: 2.1 time: 0.182726 Oct 04 18:53:35.395785 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3492/6976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:35 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:36.424280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba44c8b6-a6b6-4430-b12b-ab53becf9940 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:36.426847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba44c8b6-a6b6-4430-b12b-ab53becf9940 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:36.429038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:36.435217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44c8b6-a6b6-4430-b12b-ab53becf9940 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.435868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44c8b6-a6b6-4430-b12b-ab53becf9940 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.436439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44c8b6-a6b6-4430-b12b-ab53becf9940 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.437380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44c8b6-a6b6-4430-b12b-ab53becf9940 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.437860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44c8b6-a6b6-4430-b12b-ab53becf9940 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.438384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba44c8b6-a6b6-4430-b12b-ab53becf9940 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.444123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=62 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:36.638376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ba44c8b6-a6b6-4430-b12b-ab53becf9940 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:36.651171 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba44c8b6-a6b6-4430-b12b-ab53becf9940 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1271 microversion: 2.1 time: 0.232970 Oct 04 18:53:36.651779 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3485/6977] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:36 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:37.674604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00ce4471-fed7-4215-a0df-014556f8ef89 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:37.675269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00ce4471-fed7-4215-a0df-014556f8ef89 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:37.678013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:37.683367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ce4471-fed7-4215-a0df-014556f8ef89 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.683867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ce4471-fed7-4215-a0df-014556f8ef89 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.684315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ce4471-fed7-4215-a0df-014556f8ef89 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.685026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ce4471-fed7-4215-a0df-014556f8ef89 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.685485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ce4471-fed7-4215-a0df-014556f8ef89 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.685921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00ce4471-fed7-4215-a0df-014556f8ef89 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.835729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00ce4471-fed7-4215-a0df-014556f8ef89 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:37.843562 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00ce4471-fed7-4215-a0df-014556f8ef89 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1460 microversion: 2.1 time: 0.172923 Oct 04 18:53:37.844394 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3493/6978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:37 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1460 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:37.867056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2e7f3b05-d547-4f4d-8ccf-a253b6b5de0e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:37.867699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2e7f3b05-d547-4f4d-8ccf-a253b6b5de0e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:37.875444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e7f3b05-d547-4f4d-8ccf-a253b6b5de0e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.875956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e7f3b05-d547-4f4d-8ccf-a253b6b5de0e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.876429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e7f3b05-d547-4f4d-8ccf-a253b6b5de0e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.877164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e7f3b05-d547-4f4d-8ccf-a253b6b5de0e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.877646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e7f3b05-d547-4f4d-8ccf-a253b6b5de0e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.878099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e7f3b05-d547-4f4d-8ccf-a253b6b5de0e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:38.024366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2e7f3b05-d547-4f4d-8ccf-a253b6b5de0e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:38.032995 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2e7f3b05-d547-4f4d-8ccf-a253b6b5de0e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1460 microversion: 2.1 time: 0.169819 Oct 04 18:53:38.033520 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3486/6979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:37 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1460 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:39.774096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-991290a8-4997-4600-a789-fb8cd7641258 req-3afa4182-996f-4a67-a00f-47bb30761fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ec2b13-2a2a-48a3-b93d-1986ac0add8d", "tag": "68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:39.787116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-991290a8-4997-4600-a789-fb8cd7641258 req-3afa4182-996f-4a67-a00f-47bb30761fb0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:39.787728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-991290a8-4997-4600-a789-fb8cd7641258 req-3afa4182-996f-4a67-a00f-47bb30761fb0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:39.788283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-991290a8-4997-4600-a789-fb8cd7641258 req-3afa4182-996f-4a67-a00f-47bb30761fb0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:39.801606 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-991290a8-4997-4600-a789-fb8cd7641258 req-3afa4182-996f-4a67-a00f-47bb30761fb0 service nova] Creating event network-changed:68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c for instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d on n-h1-850499-14 Oct 04 18:53:39.806862 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-991290a8-4997-4600-a789-fb8cd7641258 req-3afa4182-996f-4a67-a00f-47bb30761fb0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036659 Oct 04 18:53:39.807642 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3494/6980] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:41.823455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-847509da-da83-4759-b05b-8a6984122d63 req-61ed79cd-c972-434e-be9b-3165239761fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ec2b13-2a2a-48a3-b93d-1986ac0add8d", "tag": "68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c"}, {"name": "network-changed", "server_uuid": "91ec2b13-2a2a-48a3-b93d-1986ac0add8d", "tag": "68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:41.835612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-847509da-da83-4759-b05b-8a6984122d63 req-61ed79cd-c972-434e-be9b-3165239761fa service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.836123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-847509da-da83-4759-b05b-8a6984122d63 req-61ed79cd-c972-434e-be9b-3165239761fa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.836589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-847509da-da83-4759-b05b-8a6984122d63 req-61ed79cd-c972-434e-be9b-3165239761fa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.851163 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-847509da-da83-4759-b05b-8a6984122d63 req-61ed79cd-c972-434e-be9b-3165239761fa service nova] Creating event network-changed:68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c for instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d on n-h1-850499-14 Oct 04 18:53:41.851738 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-847509da-da83-4759-b05b-8a6984122d63 req-61ed79cd-c972-434e-be9b-3165239761fa service nova] Creating event network-changed:68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c for instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d on n-h1-850499-14 Oct 04 18:53:41.857308 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-847509da-da83-4759-b05b-8a6984122d63 req-61ed79cd-c972-434e-be9b-3165239761fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038091 Oct 04 18:53:41.858855 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3487/6981] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:15.889104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-335405e9-c73b-4817-a6cc-30a0779211ac tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.889954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-335405e9-c73b-4817-a6cc-30a0779211ac tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.896327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=5 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:15.896854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:15.897762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=56 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:15.897929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=13 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:15.899656 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:54:15.899802 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:54:15.899878 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 18:54:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 04 18:54:15.900203 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 18:54:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d (ip 10.222.0.18) !!! Oct 04 18:54:15.914494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-335405e9-c73b-4817-a6cc-30a0779211ac tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.915344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-335405e9-c73b-4817-a6cc-30a0779211ac tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.916393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-335405e9-c73b-4817-a6cc-30a0779211ac tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.917119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-335405e9-c73b-4817-a6cc-30a0779211ac tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.917585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-335405e9-c73b-4817-a6cc-30a0779211ac tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.918022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-335405e9-c73b-4817-a6cc-30a0779211ac tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.957133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-335405e9-c73b-4817-a6cc-30a0779211ac tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:15.993949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8698f5bb-a332-4644-9c7e-5e01f52ef9d9 req-f81efeda-de02-423a-b9f8-ec4816277b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ec2b13-2a2a-48a3-b93d-1986ac0add8d", "tag": "68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:16.008382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8698f5bb-a332-4644-9c7e-5e01f52ef9d9 req-f81efeda-de02-423a-b9f8-ec4816277b29 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.009280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8698f5bb-a332-4644-9c7e-5e01f52ef9d9 req-f81efeda-de02-423a-b9f8-ec4816277b29 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.009698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8698f5bb-a332-4644-9c7e-5e01f52ef9d9 req-f81efeda-de02-423a-b9f8-ec4816277b29 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.025624 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8698f5bb-a332-4644-9c7e-5e01f52ef9d9 req-f81efeda-de02-423a-b9f8-ec4816277b29 service nova] Creating event network-changed:68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c for instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d on n-h1-850499-14 Oct 04 18:54:16.032419 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8698f5bb-a332-4644-9c7e-5e01f52ef9d9 req-f81efeda-de02-423a-b9f8-ec4816277b29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144592 Oct 04 18:54:16.033755 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3488/6982] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:16.084897 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-335405e9-c73b-4817-a6cc-30a0779211ac tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "DELETE /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 204 len: 0 microversion: 2.1 time: 0.192043 Oct 04 18:54:16.086551 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3495/6983] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:15 2022] DELETE /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:54:16.104082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21a53830-a602-4ab1-a34c-3b4027620571 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:16.107453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21a53830-a602-4ab1-a34c-3b4027620571 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:16.117111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a53830-a602-4ab1-a34c-3b4027620571 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.117872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a53830-a602-4ab1-a34c-3b4027620571 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.118358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a53830-a602-4ab1-a34c-3b4027620571 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.119185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a53830-a602-4ab1-a34c-3b4027620571 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.119679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a53830-a602-4ab1-a34c-3b4027620571 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.120474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21a53830-a602-4ab1-a34c-3b4027620571 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.305673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-21a53830-a602-4ab1-a34c-3b4027620571 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:16.316815 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21a53830-a602-4ab1-a34c-3b4027620571 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1584 microversion: 2.1 time: 0.225094 Oct 04 18:54:16.317461 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3489/6984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:16 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1584 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:17.343440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bc56b2ac-6e43-44a7-94d7-a84d601cf98a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.345046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bc56b2ac-6e43-44a7-94d7-a84d601cf98a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:17.352995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc56b2ac-6e43-44a7-94d7-a84d601cf98a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.353165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc56b2ac-6e43-44a7-94d7-a84d601cf98a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.353753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc56b2ac-6e43-44a7-94d7-a84d601cf98a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.354739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc56b2ac-6e43-44a7-94d7-a84d601cf98a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.355225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc56b2ac-6e43-44a7-94d7-a84d601cf98a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.355660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bc56b2ac-6e43-44a7-94d7-a84d601cf98a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.499837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bc56b2ac-6e43-44a7-94d7-a84d601cf98a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:17.512842 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bc56b2ac-6e43-44a7-94d7-a84d601cf98a tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1584 microversion: 2.1 time: 0.174351 Oct 04 18:54:17.513542 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3496/6985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:17 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1584 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:18.406411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e330df46-9933-44f4-bab2-0a98509fd273 req-13e2c7a6-e0b9-439c-bccd-bfe773542b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ec2b13-2a2a-48a3-b93d-1986ac0add8d", "name": "network-vif-deleted", "tag": "68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:18.418549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e330df46-9933-44f4-bab2-0a98509fd273 req-13e2c7a6-e0b9-439c-bccd-bfe773542b12 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.419095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e330df46-9933-44f4-bab2-0a98509fd273 req-13e2c7a6-e0b9-439c-bccd-bfe773542b12 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.419605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e330df46-9933-44f4-bab2-0a98509fd273 req-13e2c7a6-e0b9-439c-bccd-bfe773542b12 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:18.431983 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e330df46-9933-44f4-bab2-0a98509fd273 req-13e2c7a6-e0b9-439c-bccd-bfe773542b12 service nova] Creating event network-vif-deleted:68f39e69-4a7c-4ec7-bbca-07e9c7b4d86c for instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d on n-h1-850499-14 Oct 04 18:54:18.437354 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e330df46-9933-44f4-bab2-0a98509fd273 req-13e2c7a6-e0b9-439c-bccd-bfe773542b12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034506 Oct 04 18:54:18.439326 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3490/6986] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:18.541940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-591fd679-dc6c-41c4-99cd-3ebbf6c16e31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:18.542618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-591fd679-dc6c-41c4-99cd-3ebbf6c16e31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:18.550429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-591fd679-dc6c-41c4-99cd-3ebbf6c16e31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.550922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-591fd679-dc6c-41c4-99cd-3ebbf6c16e31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.551387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-591fd679-dc6c-41c4-99cd-3ebbf6c16e31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:18.552078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-591fd679-dc6c-41c4-99cd-3ebbf6c16e31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.552543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-591fd679-dc6c-41c4-99cd-3ebbf6c16e31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.552963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-591fd679-dc6c-41c4-99cd-3ebbf6c16e31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:18.615994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-591fd679-dc6c-41c4-99cd-3ebbf6c16e31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:18.623776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-591fd679-dc6c-41c4-99cd-3ebbf6c16e31 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1230 microversion: 2.1 time: 0.085744 Oct 04 18:54:18.624347 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3497/6987] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:18 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:19.647493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f3068eec-96ca-479d-8b25-6ded06274d8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:19.648375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f3068eec-96ca-479d-8b25-6ded06274d8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:19.654734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3068eec-96ca-479d-8b25-6ded06274d8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:19.655274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3068eec-96ca-479d-8b25-6ded06274d8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:19.655732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3068eec-96ca-479d-8b25-6ded06274d8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.656443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3068eec-96ca-479d-8b25-6ded06274d8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:19.656922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3068eec-96ca-479d-8b25-6ded06274d8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:19.657895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3068eec-96ca-479d-8b25-6ded06274d8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.721805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f3068eec-96ca-479d-8b25-6ded06274d8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:19.729902 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f3068eec-96ca-479d-8b25-6ded06274d8f tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1230 microversion: 2.1 time: 0.087819 Oct 04 18:54:19.730477 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3491/6988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:19 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:20.754070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7ae0e02a-534e-465c-9329-e41dd5264057 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:20.754678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7ae0e02a-534e-465c-9329-e41dd5264057 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:20.761850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ae0e02a-534e-465c-9329-e41dd5264057 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:20.762345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ae0e02a-534e-465c-9329-e41dd5264057 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:20.762790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ae0e02a-534e-465c-9329-e41dd5264057 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:20.763532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ae0e02a-534e-465c-9329-e41dd5264057 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:20.763998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ae0e02a-534e-465c-9329-e41dd5264057 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:20.764429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ae0e02a-534e-465c-9329-e41dd5264057 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:20.838752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7ae0e02a-534e-465c-9329-e41dd5264057 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:20.846740 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7ae0e02a-534e-465c-9329-e41dd5264057 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1230 microversion: 2.1 time: 0.097216 Oct 04 18:54:20.847417 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3498/6989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:20 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:21.871581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6cbb47f-5823-4afa-b786-e6fb0ddcba3e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.872137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f6cbb47f-5823-4afa-b786-e6fb0ddcba3e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.879085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cbb47f-5823-4afa-b786-e6fb0ddcba3e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.879602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cbb47f-5823-4afa-b786-e6fb0ddcba3e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.880125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cbb47f-5823-4afa-b786-e6fb0ddcba3e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.880868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cbb47f-5823-4afa-b786-e6fb0ddcba3e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.881349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cbb47f-5823-4afa-b786-e6fb0ddcba3e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.881797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6cbb47f-5823-4afa-b786-e6fb0ddcba3e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.945291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f6cbb47f-5823-4afa-b786-e6fb0ddcba3e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:21.955358 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6cbb47f-5823-4afa-b786-e6fb0ddcba3e tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1230 microversion: 2.1 time: 0.087806 Oct 04 18:54:21.955958 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3492/6990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:21 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:22.979264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.980070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.987185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.987680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.988112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.988831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.989288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.989713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:23.027506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:23.028063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:23.028493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:23.028953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lazy-loading 'fault' on Instance uuid 91ec2b13-2a2a-48a3-b93d-1986ac0add8d {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:54:23.073393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb7f8891e434db98e43483baac84784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4330e555204db1867d4ad0294b271e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:23.080565 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f275a39a-dabd-424d-a16c-aca8b4000f43 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 200 len: 1189 microversion: 2.1 time: 0.105532 Oct 04 18:54:23.081276 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3499/6991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 1189 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:24.104336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:24.104970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] [instance: 91ec2b13-2a2a-48a3-b93d-1986ac0add8d] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:24.111982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.112487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.112947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.113660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.114138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.114583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.129886 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] HTTP exception thrown: Instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d could not be found. Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Request method failure captured: Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d HTTP/1.1 Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIChP2E_C7vLfstcRGnwva24TkRocmRtMVVBLDDxyR3O4lVNqZBmA36XyVG-Hof5W29m68b1WIscS9mdXRkLytoSH-u2JncsKBqHB6wKCl4omYNxZb_B5tbstorNhT7VlFaRRlEDi1WDZtWLkjuS5UzQbKFILwLYEhvHx6iyShzfbJA Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 5b4330e555204db1867d4ad0294b271e Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestVolumeBackupRestore-883537862 Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5b4330e555204db1867d4ad0294b271e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5b4330e555204db1867d4ad0294b271e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b4330e555204db1867d4ad0294b271e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b4330e555204db1867d4ad0294b271e"}]}] Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestVolumeBackupRestore-883537862 Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 5b4330e555204db1867d4ad0294b271e Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestVolumeBackupRestore-883537862 Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestVolumeBackupRestore-883537862-project Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 6fb7f8891e434db98e43483baac84784 Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestVolumeBackupRestore-883537862-project Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d could not be found. Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '91ec2b13-2a2a-48a3-b93d-1986ac0add8d'} Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d could not be found. Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d could not be found. Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:24.131575 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:54:24.136236 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:24.136236 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:24.136236 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:24.136236 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:24.136236 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:24.136236 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d could not be found. Oct 04 18:54:24.136236 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:54:24.136236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Returning 404 to user: Instance 91ec2b13-2a2a-48a3-b93d-1986ac0add8d could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:24.136236 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4835f78a-0bea-4104-a9da-cf2a9fcd5edb tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d" status: 404 len: 111 microversion: 2.1 time: 0.032896 Oct 04 18:54:24.136236 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3493/6992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:24 2022] GET /compute/v2.1/servers/91ec2b13-2a2a-48a3-b93d-1986ac0add8d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:24.299559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-62353adb-9a9e-4dfd-a0ac-d00a04d87327 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] Calling method '.version_select at 0x7fd4d1b228b0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:24.321105 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-62353adb-9a9e-4dfd-a0ac-d00a04d87327 tempest-TestVolumeBackupRestore-883537862 tempest-TestVolumeBackupRestore-883537862-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2086382090" status: 202 len: 0 microversion: 2.1 time: 0.026115 Oct 04 18:54:24.325166 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3500/6993] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 4 18:54:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2086382090 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:54:52.248429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2116211013", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1101435800", "security_groups": [{"name": "tempest-secgroup-smoke-1629660030"}], "block_device_mapping_v2": [{"uuid": "e5179b1e-1a34-4f6d-af7b-b2d2ffc6fc1a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7231cfd-11da-40a4-8d73-d5073342969a"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:52.258926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=12 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:52.259618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=24 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:52.367952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] validate_networks() for [('d7231cfd-11da-40a4-8d73-d5073342969a', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:52.850236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:52.850689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:52.851261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:52.853561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:52.854019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:52.863278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:52.863789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:52.864254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:52.865012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:52.865491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:52.865940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:52.884105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:52.890034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Getting quotas for user 594483c9afdc4f69a6d02f10e8fde137 and project 8b6ed98d85624269a2ed9da7d352e2dc. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:52.956335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:52.958527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5179b1e-1a34-4f6d-af7b-b2d2ffc6fc1a',volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:53.087605 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6a7daf8d-e2d6-49ee-8e8a-b3fedc45235b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.843175 Oct 04 18:54:53.088204 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3494/6994] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:54:53.097687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:53.098437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:53.102833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1e7f1cf-fca5-46e0-a341-adddca4bbb6e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:53.103474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b1e7f1cf-fca5-46e0-a341-adddca4bbb6e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:53.163852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b1e7f1cf-fca5-46e0-a341-adddca4bbb6e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:53.172452 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b1e7f1cf-fca5-46e0-a341-adddca4bbb6e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1095 microversion: 2.1 time: 0.076918 Oct 04 18:54:53.173045 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3501/6995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:53 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:54.197022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a19b28f1-07d0-41c4-a17c-df1429f2585d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:54.197742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a19b28f1-07d0-41c4-a17c-df1429f2585d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:54.205696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a19b28f1-07d0-41c4-a17c-df1429f2585d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:54.206204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a19b28f1-07d0-41c4-a17c-df1429f2585d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:54.206689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a19b28f1-07d0-41c4-a17c-df1429f2585d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:54.207453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a19b28f1-07d0-41c4-a17c-df1429f2585d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:54.207937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a19b28f1-07d0-41c4-a17c-df1429f2585d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:54.208386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a19b28f1-07d0-41c4-a17c-df1429f2585d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:54.290127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a19b28f1-07d0-41c4-a17c-df1429f2585d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:54.298789 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a19b28f1-07d0-41c4-a17c-df1429f2585d tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1201 microversion: 2.1 time: 0.106800 Oct 04 18:54:54.299661 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3495/6996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:54 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1201 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:55.323290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-091623de-ccba-4d05-8ec3-0ef22c0e760f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:55.323813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-091623de-ccba-4d05-8ec3-0ef22c0e760f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:55.332244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-091623de-ccba-4d05-8ec3-0ef22c0e760f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:55.333025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-091623de-ccba-4d05-8ec3-0ef22c0e760f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:55.333475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-091623de-ccba-4d05-8ec3-0ef22c0e760f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:55.334248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-091623de-ccba-4d05-8ec3-0ef22c0e760f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:55.334703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-091623de-ccba-4d05-8ec3-0ef22c0e760f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:55.335373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-091623de-ccba-4d05-8ec3-0ef22c0e760f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:55.549236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-091623de-ccba-4d05-8ec3-0ef22c0e760f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:55.558214 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-091623de-ccba-4d05-8ec3-0ef22c0e760f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1279 microversion: 2.1 time: 0.239301 Oct 04 18:54:55.558982 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3502/6997] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:55 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:55.956625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-09c8d9de-b823-4f7a-a498-a7779778e83e req-4b5bdcb1-1223-4651-aa6e-c0eb110a87a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0dc695-3d9c-4838-b3af-539936c2f20b", "tag": "6dab3d71-20ac-42f7-b9e0-0365d401c119"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:55.970100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-09c8d9de-b823-4f7a-a498-a7779778e83e req-4b5bdcb1-1223-4651-aa6e-c0eb110a87a4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:55.971055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-09c8d9de-b823-4f7a-a498-a7779778e83e req-4b5bdcb1-1223-4651-aa6e-c0eb110a87a4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:55.972099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-09c8d9de-b823-4f7a-a498-a7779778e83e req-4b5bdcb1-1223-4651-aa6e-c0eb110a87a4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:55.987701 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-09c8d9de-b823-4f7a-a498-a7779778e83e req-4b5bdcb1-1223-4651-aa6e-c0eb110a87a4 service nova] Creating event network-changed:6dab3d71-20ac-42f7-b9e0-0365d401c119 for instance 9b0dc695-3d9c-4838-b3af-539936c2f20b on n-h1-850499-14 Oct 04 18:54:55.994477 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-09c8d9de-b823-4f7a-a498-a7779778e83e req-4b5bdcb1-1223-4651-aa6e-c0eb110a87a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043427 Oct 04 18:54:55.995589 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3496/6998] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:56.581832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ad153fb-0664-4bcf-90f8-56e1c76853b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:56.583222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ad153fb-0664-4bcf-90f8-56e1c76853b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:56.592303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ad153fb-0664-4bcf-90f8-56e1c76853b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.593036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ad153fb-0664-4bcf-90f8-56e1c76853b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.593765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ad153fb-0664-4bcf-90f8-56e1c76853b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.594128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ad153fb-0664-4bcf-90f8-56e1c76853b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.594600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ad153fb-0664-4bcf-90f8-56e1c76853b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.595068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ad153fb-0664-4bcf-90f8-56e1c76853b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.819841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ad153fb-0664-4bcf-90f8-56e1c76853b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:56.828500 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ad153fb-0664-4bcf-90f8-56e1c76853b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1279 microversion: 2.1 time: 0.250528 Oct 04 18:54:56.829107 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3503/6999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:56 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:57.852558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-767f915a-d13b-40c7-8296-ac38893c2085 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:57.853226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-767f915a-d13b-40c7-8296-ac38893c2085 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:57.860111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-767f915a-d13b-40c7-8296-ac38893c2085 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:57.860634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-767f915a-d13b-40c7-8296-ac38893c2085 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:57.861099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-767f915a-d13b-40c7-8296-ac38893c2085 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:57.861823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-767f915a-d13b-40c7-8296-ac38893c2085 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:57.862307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-767f915a-d13b-40c7-8296-ac38893c2085 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:57.862759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-767f915a-d13b-40c7-8296-ac38893c2085 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:57.995227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-767f915a-d13b-40c7-8296-ac38893c2085 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:58.003095 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-767f915a-d13b-40c7-8296-ac38893c2085 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1279 microversion: 2.1 time: 0.155749 Oct 04 18:54:58.003679 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3497/7000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:57 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:59.025683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-063e527c-cc69-4b11-b1fe-2d02cd30f0a6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:59.026302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-063e527c-cc69-4b11-b1fe-2d02cd30f0a6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:59.033178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-063e527c-cc69-4b11-b1fe-2d02cd30f0a6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.033708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-063e527c-cc69-4b11-b1fe-2d02cd30f0a6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.034155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-063e527c-cc69-4b11-b1fe-2d02cd30f0a6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.034864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-063e527c-cc69-4b11-b1fe-2d02cd30f0a6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.035360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-063e527c-cc69-4b11-b1fe-2d02cd30f0a6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.035798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-063e527c-cc69-4b11-b1fe-2d02cd30f0a6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.183269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-063e527c-cc69-4b11-b1fe-2d02cd30f0a6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:59.194213 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-063e527c-cc69-4b11-b1fe-2d02cd30f0a6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1279 microversion: 2.1 time: 0.172253 Oct 04 18:54:59.195152 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3504/7001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:59 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:00.220693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a125245b-5516-4459-af01-eab27dc5ee31 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:00.221573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a125245b-5516-4459-af01-eab27dc5ee31 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:00.228909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a125245b-5516-4459-af01-eab27dc5ee31 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:00.229414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a125245b-5516-4459-af01-eab27dc5ee31 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:00.230628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a125245b-5516-4459-af01-eab27dc5ee31 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:00.231380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a125245b-5516-4459-af01-eab27dc5ee31 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:00.231864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a125245b-5516-4459-af01-eab27dc5ee31 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:00.232307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a125245b-5516-4459-af01-eab27dc5ee31 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:00.370846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a125245b-5516-4459-af01-eab27dc5ee31 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:00.378710 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a125245b-5516-4459-af01-eab27dc5ee31 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1267 microversion: 2.1 time: 0.162043 Oct 04 18:55:00.379323 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3498/7002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:00 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:01.400420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1dddf96e-475f-47f2-b907-277a4f55497f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:01.401074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1dddf96e-475f-47f2-b907-277a4f55497f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:01.408024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dddf96e-475f-47f2-b907-277a4f55497f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.408515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dddf96e-475f-47f2-b907-277a4f55497f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.408960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dddf96e-475f-47f2-b907-277a4f55497f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.409709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dddf96e-475f-47f2-b907-277a4f55497f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.410173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dddf96e-475f-47f2-b907-277a4f55497f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.410600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1dddf96e-475f-47f2-b907-277a4f55497f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.546065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1dddf96e-475f-47f2-b907-277a4f55497f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:01.553764 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1dddf96e-475f-47f2-b907-277a4f55497f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1267 microversion: 2.1 time: 0.157218 Oct 04 18:55:01.554337 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3505/7003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:01 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:02.577385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a4fe9340-e08e-46ca-b029-a90dccca6255 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:02.578091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a4fe9340-e08e-46ca-b029-a90dccca6255 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:02.586502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fe9340-e08e-46ca-b029-a90dccca6255 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.587196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fe9340-e08e-46ca-b029-a90dccca6255 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.587812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fe9340-e08e-46ca-b029-a90dccca6255 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.589149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fe9340-e08e-46ca-b029-a90dccca6255 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.589786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fe9340-e08e-46ca-b029-a90dccca6255 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.590241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4fe9340-e08e-46ca-b029-a90dccca6255 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.740293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a4fe9340-e08e-46ca-b029-a90dccca6255 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:02.748298 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a4fe9340-e08e-46ca-b029-a90dccca6255 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1267 microversion: 2.1 time: 0.175943 Oct 04 18:55:02.748872 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3499/7004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:02 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:03.772748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-12320a0f-764a-4651-98ad-ed9b79460d55 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:03.773314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-12320a0f-764a-4651-98ad-ed9b79460d55 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:03.776219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:03.781885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12320a0f-764a-4651-98ad-ed9b79460d55 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.782395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12320a0f-764a-4651-98ad-ed9b79460d55 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.785864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12320a0f-764a-4651-98ad-ed9b79460d55 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.785864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12320a0f-764a-4651-98ad-ed9b79460d55 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.785864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12320a0f-764a-4651-98ad-ed9b79460d55 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.785864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12320a0f-764a-4651-98ad-ed9b79460d55 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.947275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-12320a0f-764a-4651-98ad-ed9b79460d55 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:03.956244 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-12320a0f-764a-4651-98ad-ed9b79460d55 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1267 microversion: 2.1 time: 0.187395 Oct 04 18:55:03.956908 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3506/7005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:03 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:04.983134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b888d889-a2b6-43e8-ba0f-aaf573d587d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:04.983869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b888d889-a2b6-43e8-ba0f-aaf573d587d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:04.986312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:04.987019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:04.995551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b888d889-a2b6-43e8-ba0f-aaf573d587d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.996189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b888d889-a2b6-43e8-ba0f-aaf573d587d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.996836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b888d889-a2b6-43e8-ba0f-aaf573d587d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.997721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b888d889-a2b6-43e8-ba0f-aaf573d587d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.998345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b888d889-a2b6-43e8-ba0f-aaf573d587d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.998802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b888d889-a2b6-43e8-ba0f-aaf573d587d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.133839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b888d889-a2b6-43e8-ba0f-aaf573d587d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:05.142112 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b888d889-a2b6-43e8-ba0f-aaf573d587d0 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1267 microversion: 2.1 time: 0.165078 Oct 04 18:55:05.142692 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3500/7006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:04 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:06.164528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6d2176f7-9bf9-43bc-80d6-2d0ac3e5455b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:06.165140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6d2176f7-9bf9-43bc-80d6-2d0ac3e5455b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:06.172676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d2176f7-9bf9-43bc-80d6-2d0ac3e5455b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:06.173163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d2176f7-9bf9-43bc-80d6-2d0ac3e5455b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:06.173603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d2176f7-9bf9-43bc-80d6-2d0ac3e5455b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:06.174296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d2176f7-9bf9-43bc-80d6-2d0ac3e5455b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:06.174753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d2176f7-9bf9-43bc-80d6-2d0ac3e5455b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:06.175201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6d2176f7-9bf9-43bc-80d6-2d0ac3e5455b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:06.305111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6d2176f7-9bf9-43bc-80d6-2d0ac3e5455b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:06.312802 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6d2176f7-9bf9-43bc-80d6-2d0ac3e5455b tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1267 microversion: 2.1 time: 0.152149 Oct 04 18:55:06.313369 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3507/7007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:06 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:07.336004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc3e8047-2573-4a77-a2e8-83bd6f54084e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:07.336740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc3e8047-2573-4a77-a2e8-83bd6f54084e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:07.344840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc3e8047-2573-4a77-a2e8-83bd6f54084e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:07.345650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc3e8047-2573-4a77-a2e8-83bd6f54084e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:07.346122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc3e8047-2573-4a77-a2e8-83bd6f54084e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:07.346841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc3e8047-2573-4a77-a2e8-83bd6f54084e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:07.348276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc3e8047-2573-4a77-a2e8-83bd6f54084e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:07.349048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc3e8047-2573-4a77-a2e8-83bd6f54084e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:07.488344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bc3e8047-2573-4a77-a2e8-83bd6f54084e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:07.502248 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc3e8047-2573-4a77-a2e8-83bd6f54084e tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1267 microversion: 2.1 time: 0.170076 Oct 04 18:55:07.502862 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3501/7008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:07 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:08.526049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3dc92c26-1a01-4369-b1e8-543f9fa92efe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:08.526665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3dc92c26-1a01-4369-b1e8-543f9fa92efe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:08.533178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dc92c26-1a01-4369-b1e8-543f9fa92efe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.533699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dc92c26-1a01-4369-b1e8-543f9fa92efe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.534145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dc92c26-1a01-4369-b1e8-543f9fa92efe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.534866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dc92c26-1a01-4369-b1e8-543f9fa92efe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.535354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dc92c26-1a01-4369-b1e8-543f9fa92efe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.535787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dc92c26-1a01-4369-b1e8-543f9fa92efe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.673056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3dc92c26-1a01-4369-b1e8-543f9fa92efe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:08.680885 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3dc92c26-1a01-4369-b1e8-543f9fa92efe tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1267 microversion: 2.1 time: 0.159379 Oct 04 18:55:08.682003 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3508/7009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:08 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:09.537651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-093e5ce5-de8f-4477-8f88-ff7bf899d2a6 req-fdceef49-517c-4229-896b-f61ddbaa170e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0dc695-3d9c-4838-b3af-539936c2f20b", "name": "network-vif-plugged", "status": "completed", "tag": "6dab3d71-20ac-42f7-b9e0-0365d401c119"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:09.553250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-093e5ce5-de8f-4477-8f88-ff7bf899d2a6 req-fdceef49-517c-4229-896b-f61ddbaa170e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.553982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-093e5ce5-de8f-4477-8f88-ff7bf899d2a6 req-fdceef49-517c-4229-896b-f61ddbaa170e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.554563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-093e5ce5-de8f-4477-8f88-ff7bf899d2a6 req-fdceef49-517c-4229-896b-f61ddbaa170e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.565900 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-093e5ce5-de8f-4477-8f88-ff7bf899d2a6 req-fdceef49-517c-4229-896b-f61ddbaa170e service nova] Creating event network-vif-plugged:6dab3d71-20ac-42f7-b9e0-0365d401c119 for instance 9b0dc695-3d9c-4838-b3af-539936c2f20b on n-h1-850499-14 Oct 04 18:55:09.571084 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-093e5ce5-de8f-4477-8f88-ff7bf899d2a6 req-fdceef49-517c-4229-896b-f61ddbaa170e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038159 Oct 04 18:55:09.571728 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3502/7010] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:09.704328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aba326e7-c7d9-4a58-ac4b-2448565d47c6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:09.705671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aba326e7-c7d9-4a58-ac4b-2448565d47c6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:09.712525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aba326e7-c7d9-4a58-ac4b-2448565d47c6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.713610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aba326e7-c7d9-4a58-ac4b-2448565d47c6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.714054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aba326e7-c7d9-4a58-ac4b-2448565d47c6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.714752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aba326e7-c7d9-4a58-ac4b-2448565d47c6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.715230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aba326e7-c7d9-4a58-ac4b-2448565d47c6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.715663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aba326e7-c7d9-4a58-ac4b-2448565d47c6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.852868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aba326e7-c7d9-4a58-ac4b-2448565d47c6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:09.861197 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aba326e7-c7d9-4a58-ac4b-2448565d47c6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1267 microversion: 2.1 time: 0.160851 Oct 04 18:55:09.861768 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3509/7011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:09 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:10.889800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba58a236-a4a8-4187-bafb-a0696de603f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:10.890883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba58a236-a4a8-4187-bafb-a0696de603f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:10.900015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba58a236-a4a8-4187-bafb-a0696de603f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:10.900610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba58a236-a4a8-4187-bafb-a0696de603f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:10.901361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba58a236-a4a8-4187-bafb-a0696de603f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:10.902355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba58a236-a4a8-4187-bafb-a0696de603f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:10.903269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba58a236-a4a8-4187-bafb-a0696de603f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:10.903725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba58a236-a4a8-4187-bafb-a0696de603f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.053528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ba58a236-a4a8-4187-bafb-a0696de603f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:11.062206 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba58a236-a4a8-4187-bafb-a0696de603f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1454 microversion: 2.1 time: 0.180975 Oct 04 18:55:11.062837 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3503/7012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:10 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:11.085812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9f7c0cf-c8af-47a3-b2c4-96f7149e0643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:11.086501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9f7c0cf-c8af-47a3-b2c4-96f7149e0643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:11.092554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9f7c0cf-c8af-47a3-b2c4-96f7149e0643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.093049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9f7c0cf-c8af-47a3-b2c4-96f7149e0643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.093493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9f7c0cf-c8af-47a3-b2c4-96f7149e0643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.094192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9f7c0cf-c8af-47a3-b2c4-96f7149e0643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.094653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9f7c0cf-c8af-47a3-b2c4-96f7149e0643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.095364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9f7c0cf-c8af-47a3-b2c4-96f7149e0643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.230463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9f7c0cf-c8af-47a3-b2c4-96f7149e0643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:11.238390 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9f7c0cf-c8af-47a3-b2c4-96f7149e0643 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1454 microversion: 2.1 time: 0.157296 Oct 04 18:55:11.239048 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3510/7013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:11 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:13.224722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f6b01b44-74f9-4f7e-9fcb-95c4b08a3d79 req-1bb610cf-1ef9-45a8-9ce5-f6ab20615057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0dc695-3d9c-4838-b3af-539936c2f20b", "tag": "6dab3d71-20ac-42f7-b9e0-0365d401c119"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:13.235708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f6b01b44-74f9-4f7e-9fcb-95c4b08a3d79 req-1bb610cf-1ef9-45a8-9ce5-f6ab20615057 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.236215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f6b01b44-74f9-4f7e-9fcb-95c4b08a3d79 req-1bb610cf-1ef9-45a8-9ce5-f6ab20615057 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.236667 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f6b01b44-74f9-4f7e-9fcb-95c4b08a3d79 req-1bb610cf-1ef9-45a8-9ce5-f6ab20615057 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.248872 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f6b01b44-74f9-4f7e-9fcb-95c4b08a3d79 req-1bb610cf-1ef9-45a8-9ce5-f6ab20615057 service nova] Creating event network-changed:6dab3d71-20ac-42f7-b9e0-0365d401c119 for instance 9b0dc695-3d9c-4838-b3af-539936c2f20b on n-h1-850499-14 Oct 04 18:55:13.254167 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f6b01b44-74f9-4f7e-9fcb-95c4b08a3d79 req-1bb610cf-1ef9-45a8-9ce5-f6ab20615057 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033286 Oct 04 18:55:13.255338 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3504/7014] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:53.020819 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10ce8cfd-1d4b-4064-b672-e66ecfbcf18f] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 18:56:53.022130 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 18:56:53.023205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=22 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:53.023923 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 18:56:53.024518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=54 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:53.025342 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 18:56:53.025586 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 18:56:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b (ip 10.222.0.18) !!! Oct 04 18:56:53.026824 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 18:56:53.027141 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 18:56:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b (ip 10.222.0.18) !!! Oct 04 18:56:53.029999 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 18:56:53.030808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:53.031828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=50 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:53.033636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-523a5e62-2f6d-4dd5-8051-1ee093ab367f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:53.034397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-523a5e62-2f6d-4dd5-8051-1ee093ab367f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:53.037865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-95a288bb-3eff-4746-bf44-6f096d308953 req-e42f19fa-84de-4634-a654-e5352a0f77b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0dc695-3d9c-4838-b3af-539936c2f20b", "tag": "6dab3d71-20ac-42f7-b9e0-0365d401c119"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:53.044774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a5e62-2f6d-4dd5-8051-1ee093ab367f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.045250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a5e62-2f6d-4dd5-8051-1ee093ab367f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.045747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a5e62-2f6d-4dd5-8051-1ee093ab367f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.046475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a5e62-2f6d-4dd5-8051-1ee093ab367f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.046945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a5e62-2f6d-4dd5-8051-1ee093ab367f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.047406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a5e62-2f6d-4dd5-8051-1ee093ab367f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.056427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-95a288bb-3eff-4746-bf44-6f096d308953 req-e42f19fa-84de-4634-a654-e5352a0f77b5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.056998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-95a288bb-3eff-4746-bf44-6f096d308953 req-e42f19fa-84de-4634-a654-e5352a0f77b5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.057497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-95a288bb-3eff-4746-bf44-6f096d308953 req-e42f19fa-84de-4634-a654-e5352a0f77b5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.070520 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-95a288bb-3eff-4746-bf44-6f096d308953 req-e42f19fa-84de-4634-a654-e5352a0f77b5 service nova] Creating event network-changed:6dab3d71-20ac-42f7-b9e0-0365d401c119 for instance 9b0dc695-3d9c-4838-b3af-539936c2f20b on n-h1-850499-14 Oct 04 18:56:53.076365 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-95a288bb-3eff-4746-bf44-6f096d308953 req-e42f19fa-84de-4634-a654-e5352a0f77b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054661 Oct 04 18:56:53.077194 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3505/7015] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:53.080732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-523a5e62-2f6d-4dd5-8051-1ee093ab367f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:53.172090 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-523a5e62-2f6d-4dd5-8051-1ee093ab367f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 204 len: 0 microversion: 2.1 time: 0.152916 Oct 04 18:56:53.173140 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3511/7016] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:53 2022] DELETE /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:53.184345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d742fcd5-a105-4031-a785-6a3a575a808a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:53.185921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d742fcd5-a105-4031-a785-6a3a575a808a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:53.194605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d742fcd5-a105-4031-a785-6a3a575a808a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.195336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d742fcd5-a105-4031-a785-6a3a575a808a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.195805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d742fcd5-a105-4031-a785-6a3a575a808a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.196547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d742fcd5-a105-4031-a785-6a3a575a808a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.197083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d742fcd5-a105-4031-a785-6a3a575a808a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.197536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d742fcd5-a105-4031-a785-6a3a575a808a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.359598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d742fcd5-a105-4031-a785-6a3a575a808a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:53.368149 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d742fcd5-a105-4031-a785-6a3a575a808a tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1577 microversion: 2.1 time: 0.189520 Oct 04 18:56:53.368776 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3506/7017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:53 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:54.392301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b1303607-bea7-4570-86fb-099cb1bdcd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:54.392931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b1303607-bea7-4570-86fb-099cb1bdcd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:54.403887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1303607-bea7-4570-86fb-099cb1bdcd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:54.404387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1303607-bea7-4570-86fb-099cb1bdcd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:54.404848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1303607-bea7-4570-86fb-099cb1bdcd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:54.405577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1303607-bea7-4570-86fb-099cb1bdcd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:54.406689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1303607-bea7-4570-86fb-099cb1bdcd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:54.407185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b1303607-bea7-4570-86fb-099cb1bdcd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:54.412563 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [10ce8cfd-1d4b-4064-b672-e66ecfbcf18f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45660. Oct 04 18:56:54.415872 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45662. Oct 04 18:56:54.608397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b1303607-bea7-4570-86fb-099cb1bdcd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:54.616672 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b1303607-bea7-4570-86fb-099cb1bdcd64 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1577 microversion: 2.1 time: 0.229106 Oct 04 18:56:54.617301 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3512/7018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:54 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1577 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:55.540091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-a58ff0d4-afb4-44a8-b3c5-0e9ed6202957 req-1d65f574-3988-4e7d-ab50-c8f938847883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0dc695-3d9c-4838-b3af-539936c2f20b", "name": "network-vif-deleted", "tag": "6dab3d71-20ac-42f7-b9e0-0365d401c119"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:55.554708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a58ff0d4-afb4-44a8-b3c5-0e9ed6202957 req-1d65f574-3988-4e7d-ab50-c8f938847883 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:55.555243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a58ff0d4-afb4-44a8-b3c5-0e9ed6202957 req-1d65f574-3988-4e7d-ab50-c8f938847883 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:55.555690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a58ff0d4-afb4-44a8-b3c5-0e9ed6202957 req-1d65f574-3988-4e7d-ab50-c8f938847883 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:55.567931 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45668. Oct 04 18:56:55.570769 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-a58ff0d4-afb4-44a8-b3c5-0e9ed6202957 req-1d65f574-3988-4e7d-ab50-c8f938847883 service nova] Creating event network-vif-deleted:6dab3d71-20ac-42f7-b9e0-0365d401c119 for instance 9b0dc695-3d9c-4838-b3af-539936c2f20b on n-h1-850499-14 Oct 04 18:56:55.574524 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45666. Oct 04 18:56:55.576320 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-a58ff0d4-afb4-44a8-b3c5-0e9ed6202957 req-1d65f574-3988-4e7d-ab50-c8f938847883 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040212 Oct 04 18:56:55.577025 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3507/7019] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:55.641308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d9db9e7-e53b-4d34-8c40-c8dd4dc75f56 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:55.642180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d9db9e7-e53b-4d34-8c40-c8dd4dc75f56 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:55.649197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d9db9e7-e53b-4d34-8c40-c8dd4dc75f56 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:55.649706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d9db9e7-e53b-4d34-8c40-c8dd4dc75f56 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:55.650260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d9db9e7-e53b-4d34-8c40-c8dd4dc75f56 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:55.651270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d9db9e7-e53b-4d34-8c40-c8dd4dc75f56 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:55.651857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d9db9e7-e53b-4d34-8c40-c8dd4dc75f56 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:55.652519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d9db9e7-e53b-4d34-8c40-c8dd4dc75f56 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:55.720752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d9db9e7-e53b-4d34-8c40-c8dd4dc75f56 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:55.741258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d9db9e7-e53b-4d34-8c40-c8dd4dc75f56 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1226 microversion: 2.1 time: 0.104272 Oct 04 18:56:55.741895 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3513/7020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:55 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:56.768136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a10c46a0-28bd-4018-a8c0-4ec9e1c922ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:56.769030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a10c46a0-28bd-4018-a8c0-4ec9e1c922ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:56.776745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10c46a0-28bd-4018-a8c0-4ec9e1c922ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:56.777380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10c46a0-28bd-4018-a8c0-4ec9e1c922ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:56.777861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10c46a0-28bd-4018-a8c0-4ec9e1c922ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:56.778612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10c46a0-28bd-4018-a8c0-4ec9e1c922ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:56.779135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10c46a0-28bd-4018-a8c0-4ec9e1c922ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:56.779590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a10c46a0-28bd-4018-a8c0-4ec9e1c922ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:56.849441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a10c46a0-28bd-4018-a8c0-4ec9e1c922ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:56.857565 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a10c46a0-28bd-4018-a8c0-4ec9e1c922ca tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1226 microversion: 2.1 time: 0.097123 Oct 04 18:56:56.858151 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3508/7021] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:56 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:57.883348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f2eda6ab-daa6-4ce0-a968-04c84ba4e3fd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:57.883976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f2eda6ab-daa6-4ce0-a968-04c84ba4e3fd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:57.891486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2eda6ab-daa6-4ce0-a968-04c84ba4e3fd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.892061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2eda6ab-daa6-4ce0-a968-04c84ba4e3fd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.892597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2eda6ab-daa6-4ce0-a968-04c84ba4e3fd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.893433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2eda6ab-daa6-4ce0-a968-04c84ba4e3fd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.893947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2eda6ab-daa6-4ce0-a968-04c84ba4e3fd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.894513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2eda6ab-daa6-4ce0-a968-04c84ba4e3fd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.960342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f2eda6ab-daa6-4ce0-a968-04c84ba4e3fd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:57.968771 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f2eda6ab-daa6-4ce0-a968-04c84ba4e3fd tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1226 microversion: 2.1 time: 0.089328 Oct 04 18:56:57.969386 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3514/7022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:57 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:58.995845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b32e6e45-d4de-41bb-ae4e-3c5e3555b50f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:58.996495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b32e6e45-d4de-41bb-ae4e-3c5e3555b50f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:59.003521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b32e6e45-d4de-41bb-ae4e-3c5e3555b50f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:59.004027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b32e6e45-d4de-41bb-ae4e-3c5e3555b50f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:59.004488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b32e6e45-d4de-41bb-ae4e-3c5e3555b50f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:59.005211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b32e6e45-d4de-41bb-ae4e-3c5e3555b50f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:59.005690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b32e6e45-d4de-41bb-ae4e-3c5e3555b50f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:59.006134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b32e6e45-d4de-41bb-ae4e-3c5e3555b50f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:59.076937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b32e6e45-d4de-41bb-ae4e-3c5e3555b50f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:59.085245 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b32e6e45-d4de-41bb-ae4e-3c5e3555b50f tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1226 microversion: 2.1 time: 0.093249 Oct 04 18:56:59.085942 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3509/7023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:58 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:00.109922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:00.110471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:00.117639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:00.118145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:00.118602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:00.119344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:00.119810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:00.120250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:00.153440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:00.153939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:00.154387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:00.154848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lazy-loading 'fault' on Instance uuid 9b0dc695-3d9c-4838-b3af-539936c2f20b {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:57:00.203366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:00.211943 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9a4b392-8b89-402e-882c-99e64e03c322 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 200 len: 1231 microversion: 2.1 time: 0.106815 Oct 04 18:57:00.212529 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3515/7024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:00 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:01.236215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:01.236862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 9b0dc695-3d9c-4838-b3af-539936c2f20b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:01.243897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:01.244413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:01.244878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:01.245601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:01.246086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:01.246798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:01.260600 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance 9b0dc695-3d9c-4838-b3af-539936c2f20b could not be found. Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b HTTP/1.1 Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 9b0dc695-3d9c-4838-b3af-539936c2f20b could not be found. Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '9b0dc695-3d9c-4838-b3af-539936c2f20b'} Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b0dc695-3d9c-4838-b3af-539936c2f20b could not be found. Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b0dc695-3d9c-4838-b3af-539936c2f20b could not be found. Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:01.262297 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:01.267235 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:01.267235 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:01.267235 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:01.267235 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:01.267235 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:01.267235 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b0dc695-3d9c-4838-b3af-539936c2f20b could not be found. Oct 04 18:57:01.267235 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:01.267235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance 9b0dc695-3d9c-4838-b3af-539936c2f20b could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:01.267235 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8dd8116d-442e-4ed0-951a-fe29594f3e96 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b" status: 404 len: 111 microversion: 2.1 time: 0.032188 Oct 04 18:57:01.267235 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3510/7025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:01 2022] GET /compute/v2.1/servers/9b0dc695-3d9c-4838-b3af-539936c2f20b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:57:07.931717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e942bb4a-dfd0-4327-a802-f316d3bd98e6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:07.932292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e942bb4a-dfd0-4327-a802-f316d3bd98e6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:07.932850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5e20e950-6d6e-435f-a675-3fe0b17cc12f req-2f93133a-7dc0-45a7-ad8c-26c3b7ce9432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f37e68-2867-4e14-b6b8-fe84d8ccf484", "tag": "79825cf1-34ad-40be-89d7-ad9f9fb45b96"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:07.940671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e942bb4a-dfd0-4327-a802-f316d3bd98e6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:07.941296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e942bb4a-dfd0-4327-a802-f316d3bd98e6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:07.941835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e942bb4a-dfd0-4327-a802-f316d3bd98e6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:07.942625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e942bb4a-dfd0-4327-a802-f316d3bd98e6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:07.943325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e942bb4a-dfd0-4327-a802-f316d3bd98e6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:07.943845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e942bb4a-dfd0-4327-a802-f316d3bd98e6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:07.945499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5e20e950-6d6e-435f-a675-3fe0b17cc12f req-2f93133a-7dc0-45a7-ad8c-26c3b7ce9432 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:07.946004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5e20e950-6d6e-435f-a675-3fe0b17cc12f req-2f93133a-7dc0-45a7-ad8c-26c3b7ce9432 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:07.946455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5e20e950-6d6e-435f-a675-3fe0b17cc12f req-2f93133a-7dc0-45a7-ad8c-26c3b7ce9432 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:07.968620 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5e20e950-6d6e-435f-a675-3fe0b17cc12f req-2f93133a-7dc0-45a7-ad8c-26c3b7ce9432 service nova] Creating event network-changed:79825cf1-34ad-40be-89d7-ad9f9fb45b96 for instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 on n-h2-850499-14 Oct 04 18:57:07.973042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e942bb4a-dfd0-4327-a802-f316d3bd98e6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:57:07.974398 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5e20e950-6d6e-435f-a675-3fe0b17cc12f req-2f93133a-7dc0-45a7-ad8c-26c3b7ce9432 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045353 Oct 04 18:57:07.975477 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3511/7026] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:57:08.062158 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e942bb4a-dfd0-4327-a802-f316d3bd98e6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 204 len: 0 microversion: 2.1 time: 0.134532 Oct 04 18:57:08.066579 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3516/7027] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:57:07 2022] DELETE /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:57:08.074523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e1bffb3e-b70d-4c38-8842-44ed9c1480f8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:08.075611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e1bffb3e-b70d-4c38-8842-44ed9c1480f8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:08.084280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1bffb3e-b70d-4c38-8842-44ed9c1480f8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:08.084966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1bffb3e-b70d-4c38-8842-44ed9c1480f8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:08.085569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1bffb3e-b70d-4c38-8842-44ed9c1480f8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:08.086487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1bffb3e-b70d-4c38-8842-44ed9c1480f8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:08.087105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1bffb3e-b70d-4c38-8842-44ed9c1480f8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:08.087657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e1bffb3e-b70d-4c38-8842-44ed9c1480f8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:08.245895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e1bffb3e-b70d-4c38-8842-44ed9c1480f8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:08.255362 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e1bffb3e-b70d-4c38-8842-44ed9c1480f8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1580 microversion: 2.1 time: 0.186838 Oct 04 18:57:08.255961 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3512/7028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:08 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1580 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:09.281942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-90e94e4e-1d66-4e34-9ef7-880d5c6be55c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:09.282568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-90e94e4e-1d66-4e34-9ef7-880d5c6be55c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:09.293322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e94e4e-1d66-4e34-9ef7-880d5c6be55c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:09.293816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e94e4e-1d66-4e34-9ef7-880d5c6be55c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:09.294266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e94e4e-1d66-4e34-9ef7-880d5c6be55c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:09.295030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e94e4e-1d66-4e34-9ef7-880d5c6be55c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:09.295500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e94e4e-1d66-4e34-9ef7-880d5c6be55c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:09.295933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90e94e4e-1d66-4e34-9ef7-880d5c6be55c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:09.437065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90e94e4e-1d66-4e34-9ef7-880d5c6be55c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:09.447317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-90e94e4e-1d66-4e34-9ef7-880d5c6be55c tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1580 microversion: 2.1 time: 0.170218 Oct 04 18:57:09.447911 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3517/7029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:09 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1580 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:10.472243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-84ad17cf-b910-4cbd-8608-0b65c467a5f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:10.472896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-84ad17cf-b910-4cbd-8608-0b65c467a5f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:10.480571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84ad17cf-b910-4cbd-8608-0b65c467a5f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:10.481100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84ad17cf-b910-4cbd-8608-0b65c467a5f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:10.481568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84ad17cf-b910-4cbd-8608-0b65c467a5f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:10.482915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84ad17cf-b910-4cbd-8608-0b65c467a5f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:10.483432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84ad17cf-b910-4cbd-8608-0b65c467a5f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:10.483885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-84ad17cf-b910-4cbd-8608-0b65c467a5f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:10.627360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-84ad17cf-b910-4cbd-8608-0b65c467a5f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:10.636893 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-84ad17cf-b910-4cbd-8608-0b65c467a5f6 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1461 microversion: 2.1 time: 0.168470 Oct 04 18:57:10.638393 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3513/7030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:10 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1461 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:10.706676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a92e12e9-36ea-4735-afe6-70d38272a54f req-d7be0551-ebef-45ca-89e4-07d3f57a3cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f37e68-2867-4e14-b6b8-fe84d8ccf484", "name": "network-vif-deleted", "tag": "79825cf1-34ad-40be-89d7-ad9f9fb45b96"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:10.718601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a92e12e9-36ea-4735-afe6-70d38272a54f req-d7be0551-ebef-45ca-89e4-07d3f57a3cbb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:10.719110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a92e12e9-36ea-4735-afe6-70d38272a54f req-d7be0551-ebef-45ca-89e4-07d3f57a3cbb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:10.719557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a92e12e9-36ea-4735-afe6-70d38272a54f req-d7be0551-ebef-45ca-89e4-07d3f57a3cbb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:10.731352 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a92e12e9-36ea-4735-afe6-70d38272a54f req-d7be0551-ebef-45ca-89e4-07d3f57a3cbb service nova] Creating event network-vif-deleted:79825cf1-34ad-40be-89d7-ad9f9fb45b96 for instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 on n-h2-850499-14 Oct 04 18:57:10.736809 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a92e12e9-36ea-4735-afe6-70d38272a54f req-d7be0551-ebef-45ca-89e4-07d3f57a3cbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033940 Oct 04 18:57:10.737443 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3518/7031] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:11.660765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f805a63-81d0-4e17-b6e5-99d76d10d2f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:11.661395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f805a63-81d0-4e17-b6e5-99d76d10d2f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:11.670137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f805a63-81d0-4e17-b6e5-99d76d10d2f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:11.670658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f805a63-81d0-4e17-b6e5-99d76d10d2f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:11.671320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f805a63-81d0-4e17-b6e5-99d76d10d2f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:11.671987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f805a63-81d0-4e17-b6e5-99d76d10d2f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:11.672470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f805a63-81d0-4e17-b6e5-99d76d10d2f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:11.672918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f805a63-81d0-4e17-b6e5-99d76d10d2f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:11.748248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6f805a63-81d0-4e17-b6e5-99d76d10d2f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:11.759224 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f805a63-81d0-4e17-b6e5-99d76d10d2f9 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1226 microversion: 2.1 time: 0.102286 Oct 04 18:57:11.759950 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3514/7032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:11 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:12.785021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d1be76af-7be8-4a6c-a2b7-bea4a44bc821 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:12.785620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d1be76af-7be8-4a6c-a2b7-bea4a44bc821 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:12.792110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1be76af-7be8-4a6c-a2b7-bea4a44bc821 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:12.792617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1be76af-7be8-4a6c-a2b7-bea4a44bc821 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:12.793063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1be76af-7be8-4a6c-a2b7-bea4a44bc821 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:12.793768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1be76af-7be8-4a6c-a2b7-bea4a44bc821 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:12.794801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1be76af-7be8-4a6c-a2b7-bea4a44bc821 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:12.795317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1be76af-7be8-4a6c-a2b7-bea4a44bc821 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:12.860739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d1be76af-7be8-4a6c-a2b7-bea4a44bc821 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:12.870099 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d1be76af-7be8-4a6c-a2b7-bea4a44bc821 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1226 microversion: 2.1 time: 0.090393 Oct 04 18:57:12.870980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3519/7033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:12 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:13.894703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e73e6dbe-e861-4b45-a71e-ca32dc7a22b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:13.895721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e73e6dbe-e861-4b45-a71e-ca32dc7a22b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:13.902791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e73e6dbe-e861-4b45-a71e-ca32dc7a22b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:13.903878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e73e6dbe-e861-4b45-a71e-ca32dc7a22b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:13.904333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e73e6dbe-e861-4b45-a71e-ca32dc7a22b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:13.905061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e73e6dbe-e861-4b45-a71e-ca32dc7a22b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:13.905541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e73e6dbe-e861-4b45-a71e-ca32dc7a22b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:13.905983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e73e6dbe-e861-4b45-a71e-ca32dc7a22b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:13.975871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e73e6dbe-e861-4b45-a71e-ca32dc7a22b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:13.985127 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e73e6dbe-e861-4b45-a71e-ca32dc7a22b3 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1226 microversion: 2.1 time: 0.094748 Oct 04 18:57:13.985725 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3515/7034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:13 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:15.008937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:15.009557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:15.017596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:15.018097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:15.018629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:15.019385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:15.019856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:15.020303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:15.057438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:15.057629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:15.058153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:15.058834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lazy-loading 'fault' on Instance uuid 98f37e68-2867-4e14-b6b8-fe84d8ccf484 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:57:15.104886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594483c9afdc4f69a6d02f10e8fde137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6ed98d85624269a2ed9da7d352e2dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:15.113967 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a5a908cb-dee8-406e-8cdf-dfe278af06b1 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 200 len: 1231 microversion: 2.1 time: 0.108904 Oct 04 18:57:15.114553 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3520/7035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:15 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:16.141164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:16.142004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: 98f37e68-2867-4e14-b6b8-fe84d8ccf484] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:16.148903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:16.149409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:16.149870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:16.150599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:16.151106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:16.151558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:16.169901 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 could not be found. Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 HTTP/1.1 Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 could not be found. Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '98f37e68-2867-4e14-b6b8-fe84d8ccf484'} Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 could not be found. Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 could not be found. Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:16.171738 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.175434 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:16.175434 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:16.175434 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:16.175434 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:16.175434 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:16.175434 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 could not be found. Oct 04 18:57:16.175434 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.175434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance 98f37e68-2867-4e14-b6b8-fe84d8ccf484 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:16.175434 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be9a4aaf-029a-4a69-8b13-92d3b8de47b8 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484" status: 404 len: 111 microversion: 2.1 time: 0.038595 Oct 04 18:57:16.175434 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3516/7036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:16 2022] GET /compute/v2.1/servers/98f37e68-2867-4e14-b6b8-fe84d8ccf484 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:57:16.673372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:16.673372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:16.680260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:16.680762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:16.681211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:16.681952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:16.682414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:16.682846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:16.697794 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e HTTP/1.1 Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'aceeed29-e978-4760-afa0-03659eaf5c6e'} Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:57:16.699547 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d51ed20f-c9fd-4fe0-b9f0-fe3a3dcdf876 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 404 len: 111 microversion: 2.1 time: 0.032999 Oct 04 18:57:16.703142 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3521/7037] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:57:16 2022] DELETE /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:57:16.710437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:16.711676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] [instance: aceeed29-e978-4760-afa0-03659eaf5c6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:16.720320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:16.720838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:16.721293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:16.722235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:16.723155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:16.724015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:16.745768 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] HTTP exception thrown: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Request method failure captured: Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e HTTP/1.1 Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPH9dYH73bGw8DuNqD_Sj7vXXsZbbdql-QbkxndQr4tiUh84f63BqX0LV9HGx-xqibux0OPD9ieLvyABGgVkNUN0NpOZ4E_Wp5qDbxpTa0mNYsqmR-FUOA2Ha6b8TCpoXB-nqEjXM6SKYy9Nc-Kn5nquevw3yxeNXWB5Nhob6FFDO6R8 Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8b6ed98d85624269a2ed9da7d352e2dc"}]}] Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 8b6ed98d85624269a2ed9da7d352e2dc Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestVolumeBootPattern-251774951 Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 594483c9afdc4f69a6d02f10e8fde137 Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestVolumeBootPattern-251774951-project Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'aceeed29-e978-4760-afa0-03659eaf5c6e'} Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:16.748745 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.754503 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:16.754503 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:16.754503 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:16.754503 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:16.754503 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:16.754503 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. Oct 04 18:57:16.754503 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:16.754503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Returning 404 to user: Instance aceeed29-e978-4760-afa0-03659eaf5c6e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:16.754503 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5d2fd4b9-72e8-439d-b900-92622890ea19 tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e" status: 404 len: 111 microversion: 2.1 time: 0.044687 Oct 04 18:57:16.754503 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3517/7038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:16 2022] GET /compute/v2.1/servers/aceeed29-e978-4760-afa0-03659eaf5c6e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:57:20.192803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3b66963c-baf0-4b91-8e0b-9a79b84f53dc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] Calling method '.version_select at 0x7fd4d1555280>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:20.241238 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3b66963c-baf0-4b91-8e0b-9a79b84f53dc tempest-TestVolumeBootPattern-251774951 tempest-TestVolumeBootPattern-251774951-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1101435800" status: 202 len: 0 microversion: 2.1 time: 0.052314 Oct 04 18:57:20.241841 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3522/7039] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 4 18:57:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1101435800 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:57:39.121355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=26 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:39.122097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=54 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:39.243451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1747551064", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:39.422262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] validate_networks() for None {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:57:39.634443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:57:39.635180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:57:39.636486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:57:39.637080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:57:39.637689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:57:39.649716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.650410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.651121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:39.652237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.652863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.653477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:39.676298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Getting quotas for project ad1c90ce284c45b89aec274786d69b34. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:39.681894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Getting quotas for user 53e060b13c6642288c0862baff4144a3 and project ad1c90ce284c45b89aec274786d69b34. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:39.695545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:57:39.698520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:57:39.744013 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-08b3318a-915f-4581-b825-006f780051a8 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628359 Oct 04 18:57:39.745259 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3518/7040] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:57:39.757446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:39.759295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:39.764483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1456e106-ad1b-4259-a015-c1f37c1887d2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:39.765160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1456e106-ad1b-4259-a015-c1f37c1887d2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:39.955801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1456e106-ad1b-4259-a015-c1f37c1887d2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:39.963637 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1456e106-ad1b-4259-a015-c1f37c1887d2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1222 microversion: 2.1 time: 0.207868 Oct 04 18:57:39.964277 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3523/7041] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:39 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1222 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:40.988722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9b4f8069-f577-451c-89c1-85b8588b390d tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:40.989586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9b4f8069-f577-451c-89c1-85b8588b390d tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:40.996368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b4f8069-f577-451c-89c1-85b8588b390d tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.996877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b4f8069-f577-451c-89c1-85b8588b390d tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.997337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b4f8069-f577-451c-89c1-85b8588b390d tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.998074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b4f8069-f577-451c-89c1-85b8588b390d tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.998529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b4f8069-f577-451c-89c1-85b8588b390d tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.999000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9b4f8069-f577-451c-89c1-85b8588b390d tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:41.066970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9b4f8069-f577-451c-89c1-85b8588b390d tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:41.075659 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9b4f8069-f577-451c-89c1-85b8588b390d tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1282 microversion: 2.1 time: 0.092185 Oct 04 18:57:41.079316 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3519/7042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:40 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:42.101214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ebd7a50a-e894-4b7d-b9fa-70084a3b41f2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:42.101942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ebd7a50a-e894-4b7d-b9fa-70084a3b41f2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:42.110240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebd7a50a-e894-4b7d-b9fa-70084a3b41f2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:42.110824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebd7a50a-e894-4b7d-b9fa-70084a3b41f2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:42.111366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebd7a50a-e894-4b7d-b9fa-70084a3b41f2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:42.112235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebd7a50a-e894-4b7d-b9fa-70084a3b41f2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:42.112709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebd7a50a-e894-4b7d-b9fa-70084a3b41f2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:42.113177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ebd7a50a-e894-4b7d-b9fa-70084a3b41f2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:42.185731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ebd7a50a-e894-4b7d-b9fa-70084a3b41f2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:42.196014 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ebd7a50a-e894-4b7d-b9fa-70084a3b41f2 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1280 microversion: 2.1 time: 0.098527 Oct 04 18:57:42.196688 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3524/7043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:42 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1280 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:43.002502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e35ec77b-2a50-44f0-8948-76ad1c9162c8 req-1a6f6d25-5ecf-43c7-8fe9-888723e18d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5f2a634-4132-4cad-8a63-78cf1e5a1406", "tag": "279bc8cc-a01a-4b4e-a20c-969938a5a9f9"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:43.015669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e35ec77b-2a50-44f0-8948-76ad1c9162c8 req-1a6f6d25-5ecf-43c7-8fe9-888723e18d01 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.016183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e35ec77b-2a50-44f0-8948-76ad1c9162c8 req-1a6f6d25-5ecf-43c7-8fe9-888723e18d01 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.016640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e35ec77b-2a50-44f0-8948-76ad1c9162c8 req-1a6f6d25-5ecf-43c7-8fe9-888723e18d01 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.030808 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e35ec77b-2a50-44f0-8948-76ad1c9162c8 req-1a6f6d25-5ecf-43c7-8fe9-888723e18d01 service nova] Creating event network-changed:279bc8cc-a01a-4b4e-a20c-969938a5a9f9 for instance b5f2a634-4132-4cad-8a63-78cf1e5a1406 on n-h2-850499-14 Oct 04 18:57:43.035759 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e35ec77b-2a50-44f0-8948-76ad1c9162c8 req-1a6f6d25-5ecf-43c7-8fe9-888723e18d01 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037319 Oct 04 18:57:43.036750 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3520/7044] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:43.219501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a12906b-6a76-4ff2-96a7-36d60c5a062b tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:43.220120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3a12906b-6a76-4ff2-96a7-36d60c5a062b tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:43.230590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a12906b-6a76-4ff2-96a7-36d60c5a062b tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.231401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a12906b-6a76-4ff2-96a7-36d60c5a062b tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.232223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a12906b-6a76-4ff2-96a7-36d60c5a062b tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.233505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a12906b-6a76-4ff2-96a7-36d60c5a062b tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.234369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a12906b-6a76-4ff2-96a7-36d60c5a062b tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.235036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a12906b-6a76-4ff2-96a7-36d60c5a062b tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.374466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3a12906b-6a76-4ff2-96a7-36d60c5a062b tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:43.382284 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3a12906b-6a76-4ff2-96a7-36d60c5a062b tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1322 microversion: 2.1 time: 0.166729 Oct 04 18:57:43.382873 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3525/7045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:43 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:44.407807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c3606f49-4061-4d15-9ffb-25e98bd8f612 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:44.408545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c3606f49-4061-4d15-9ffb-25e98bd8f612 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:44.414779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3606f49-4061-4d15-9ffb-25e98bd8f612 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:44.415329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3606f49-4061-4d15-9ffb-25e98bd8f612 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:44.415798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3606f49-4061-4d15-9ffb-25e98bd8f612 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.416549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3606f49-4061-4d15-9ffb-25e98bd8f612 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:44.417032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3606f49-4061-4d15-9ffb-25e98bd8f612 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:44.417485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c3606f49-4061-4d15-9ffb-25e98bd8f612 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.548616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c3606f49-4061-4d15-9ffb-25e98bd8f612 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:44.556563 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c3606f49-4061-4d15-9ffb-25e98bd8f612 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1322 microversion: 2.1 time: 0.153934 Oct 04 18:57:44.557142 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3521/7046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:44 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:45.579861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-114ae9eb-4799-4663-8a7b-b6e73bd7a12f tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:45.580470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-114ae9eb-4799-4663-8a7b-b6e73bd7a12f tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:45.588322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-114ae9eb-4799-4663-8a7b-b6e73bd7a12f tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:45.589020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-114ae9eb-4799-4663-8a7b-b6e73bd7a12f tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:45.589651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-114ae9eb-4799-4663-8a7b-b6e73bd7a12f tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:45.590482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-114ae9eb-4799-4663-8a7b-b6e73bd7a12f tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:45.591198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-114ae9eb-4799-4663-8a7b-b6e73bd7a12f tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:45.591634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-114ae9eb-4799-4663-8a7b-b6e73bd7a12f tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:45.723178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-114ae9eb-4799-4663-8a7b-b6e73bd7a12f tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:45.730899 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-114ae9eb-4799-4663-8a7b-b6e73bd7a12f tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1322 microversion: 2.1 time: 0.155299 Oct 04 18:57:45.731499 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3526/7047] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:45 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:46.755334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-308b56a1-0fcc-4218-a33f-48acb0d366d9 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:46.755957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-308b56a1-0fcc-4218-a33f-48acb0d366d9 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:46.763524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-308b56a1-0fcc-4218-a33f-48acb0d366d9 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:46.764024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-308b56a1-0fcc-4218-a33f-48acb0d366d9 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:46.764481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-308b56a1-0fcc-4218-a33f-48acb0d366d9 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:46.765187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-308b56a1-0fcc-4218-a33f-48acb0d366d9 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:46.765656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-308b56a1-0fcc-4218-a33f-48acb0d366d9 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:46.766096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-308b56a1-0fcc-4218-a33f-48acb0d366d9 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:46.896873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-308b56a1-0fcc-4218-a33f-48acb0d366d9 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:46.905460 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-308b56a1-0fcc-4218-a33f-48acb0d366d9 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1322 microversion: 2.1 time: 0.154059 Oct 04 18:57:46.906036 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3522/7048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:46 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:47.928319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-72ffd7e3-d80f-4d93-9bcb-c34761c71af3 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:47.928930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-72ffd7e3-d80f-4d93-9bcb-c34761c71af3 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:47.935756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ffd7e3-d80f-4d93-9bcb-c34761c71af3 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.936245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ffd7e3-d80f-4d93-9bcb-c34761c71af3 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.936686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ffd7e3-d80f-4d93-9bcb-c34761c71af3 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.937374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ffd7e3-d80f-4d93-9bcb-c34761c71af3 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.937827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ffd7e3-d80f-4d93-9bcb-c34761c71af3 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.938256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-72ffd7e3-d80f-4d93-9bcb-c34761c71af3 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.070974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-72ffd7e3-d80f-4d93-9bcb-c34761c71af3 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:48.080461 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-72ffd7e3-d80f-4d93-9bcb-c34761c71af3 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1322 microversion: 2.1 time: 0.156028 Oct 04 18:57:48.081053 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3527/7049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:47 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:49.104996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-713b8055-31a5-4004-a3f8-409f76a32c39 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:49.105626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-713b8055-31a5-4004-a3f8-409f76a32c39 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:49.112945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713b8055-31a5-4004-a3f8-409f76a32c39 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:49.113459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713b8055-31a5-4004-a3f8-409f76a32c39 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:49.113916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713b8055-31a5-4004-a3f8-409f76a32c39 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:49.114637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713b8055-31a5-4004-a3f8-409f76a32c39 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:49.115143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713b8055-31a5-4004-a3f8-409f76a32c39 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:49.115584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-713b8055-31a5-4004-a3f8-409f76a32c39 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:49.251781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-713b8055-31a5-4004-a3f8-409f76a32c39 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:49.259693 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-713b8055-31a5-4004-a3f8-409f76a32c39 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1322 microversion: 2.1 time: 0.159173 Oct 04 18:57:49.260277 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3523/7050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:49 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:50.235420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:50.284676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b4b3f44e-3769-42d2-9377-17e8daf640fe tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:50.285410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b4b3f44e-3769-42d2-9377-17e8daf640fe tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:50.287438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:50.288125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:50.298076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b3f44e-3769-42d2-9377-17e8daf640fe tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:50.298599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b3f44e-3769-42d2-9377-17e8daf640fe tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:50.299377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b3f44e-3769-42d2-9377-17e8daf640fe tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:50.300181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b3f44e-3769-42d2-9377-17e8daf640fe tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:50.300664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b3f44e-3769-42d2-9377-17e8daf640fe tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:50.301391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b4b3f44e-3769-42d2-9377-17e8daf640fe tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:50.326602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-86def21b-9cb3-4d50-8389-0430672089f1 req-93b87036-870a-4aed-99c2-a34dfeedd8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f2a634-4132-4cad-8a63-78cf1e5a1406", "name": "network-vif-plugged", "status": "completed", "tag": "279bc8cc-a01a-4b4e-a20c-969938a5a9f9"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:50.336911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-86def21b-9cb3-4d50-8389-0430672089f1 req-93b87036-870a-4aed-99c2-a34dfeedd8b0 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:50.337454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-86def21b-9cb3-4d50-8389-0430672089f1 req-93b87036-870a-4aed-99c2-a34dfeedd8b0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:50.337891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-86def21b-9cb3-4d50-8389-0430672089f1 req-93b87036-870a-4aed-99c2-a34dfeedd8b0 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:50.349706 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-86def21b-9cb3-4d50-8389-0430672089f1 req-93b87036-870a-4aed-99c2-a34dfeedd8b0 service nova] Creating event network-vif-plugged:279bc8cc-a01a-4b4e-a20c-969938a5a9f9 for instance b5f2a634-4132-4cad-8a63-78cf1e5a1406 on n-h2-850499-14 Oct 04 18:57:50.355699 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-86def21b-9cb3-4d50-8389-0430672089f1 req-93b87036-870a-4aed-99c2-a34dfeedd8b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125565 Oct 04 18:57:50.356368 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3528/7051] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:50.438199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b4b3f44e-3769-42d2-9377-17e8daf640fe tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:50.446654 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b4b3f44e-3769-42d2-9377-17e8daf640fe tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1322 microversion: 2.1 time: 0.165703 Oct 04 18:57:50.447269 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3524/7052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:50 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:51.470289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b37702a-c637-425c-83a1-3b150196cacf tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:51.471029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8b37702a-c637-425c-83a1-3b150196cacf tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:51.478132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b37702a-c637-425c-83a1-3b150196cacf tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.478626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b37702a-c637-425c-83a1-3b150196cacf tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.479127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b37702a-c637-425c-83a1-3b150196cacf tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.479831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b37702a-c637-425c-83a1-3b150196cacf tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:51.480301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b37702a-c637-425c-83a1-3b150196cacf tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:51.480740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b37702a-c637-425c-83a1-3b150196cacf tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:51.613298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8b37702a-c637-425c-83a1-3b150196cacf tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:51.622453 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b37702a-c637-425c-83a1-3b150196cacf tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1322 microversion: 2.1 time: 0.156338 Oct 04 18:57:51.623067 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3529/7053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:51 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:52.646714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c58c9ebf-f4a4-4066-8cbf-c16c492abc32 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:52.647472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c58c9ebf-f4a4-4066-8cbf-c16c492abc32 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:52.655446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58c9ebf-f4a4-4066-8cbf-c16c492abc32 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.655950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58c9ebf-f4a4-4066-8cbf-c16c492abc32 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.656439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58c9ebf-f4a4-4066-8cbf-c16c492abc32 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:52.657176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58c9ebf-f4a4-4066-8cbf-c16c492abc32 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.657652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58c9ebf-f4a4-4066-8cbf-c16c492abc32 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.658091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58c9ebf-f4a4-4066-8cbf-c16c492abc32 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:52.789177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c58c9ebf-f4a4-4066-8cbf-c16c492abc32 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:52.796989 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c58c9ebf-f4a4-4066-8cbf-c16c492abc32 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1471 microversion: 2.1 time: 0.154495 Oct 04 18:57:52.797563 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3525/7054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:52 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:52.873284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-87be3a6a-e617-4b59-bb01-f45a1ca87505 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Calling method '.version_select at 0x7fd4d1a7b790>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:52.942590 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-87be3a6a-e617-4b59-bb01-f45a1ca87505 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/93b076b6f8f24dae9488d7d9c3bd4d2d" status: 200 len: 371 microversion: 2.1 time: 0.124529 Oct 04 18:57:52.943194 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3530/7055] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 4 18:57:52 2022] GET /compute/v2.1/os-quota-sets/93b076b6f8f24dae9488d7d9c3bd4d2d => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:52.956001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-285540b0-ac9c-43fa-a764-761da2a8a811 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2120145213", "id": 1826904075, "os-flavor-access:is_public": "True"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:52.973338 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-285540b0-ac9c-43fa-a764-761da2a8a811 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021290 Oct 04 18:57:52.973940 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3526/7056] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:57:52 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:52.986503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1826904075"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:52.989260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:52.995881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.996370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.996816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:52.997517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.997974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.998407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.136232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e6ad9fda3a0f4f498eb7c6282d0cc6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b076b6f8f24dae9488d7d9c3bd4d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:53.142345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2120145213 {{(pid=122332) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:57:53.148962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.149448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.149892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.150624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.151115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.151582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.171466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Getting quotas for project ad1c90ce284c45b89aec274786d69b34. Resources: {'cores', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:53.176510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Getting quotas for user 53e060b13c6642288c0862baff4144a3 and project ad1c90ce284c45b89aec274786d69b34. Resources: {'cores', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:53.188874 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.compute.api [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] ram quota exceeded for 93b076b6f8f24dae9488d7d9c3bd4d2d, tried to resize instance. Oct 04 18:57:53.189416 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Request method failure captured: Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406/action HTTP/1.1 Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 39 Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIIi4PZ-puGyjBXuKwr1qi_RqWPXoYA9seRaS98qFkR8vd2V9yndDq5M9GmpPMMksMCi0yxxtEEBMBXF9nc728jsSumiZrupJrmJKHrO2olFt1lwpX57uAyy8py9GPr3xQDn4WpqpUOXlFrzJR5AODrxtsrHAqqlZYUC1BoAP9Y_roc Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 93b076b6f8f24dae9488d7d9c3bd4d2d Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1256397519 Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member,admin Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member,admin Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_93b076b6f8f24dae9488d7d9c3bd4d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/93b076b6f8f24dae9488d7d9c3bd4d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/93b076b6f8f24dae9488d7d9c3bd4d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/93b076b6f8f24dae9488d7d9c3bd4d2d"}]}] Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1256397519 Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 93b076b6f8f24dae9488d7d9c3bd4d2d Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1256397519 Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersAdminNegativeTestJSON-1256397519-project-admin Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: e6ad9fda3a0f4f498eb7c6282d0cc6ce Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1256397519-project-admin Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: {"resize": {"flavorRef": "1826904075"}} Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'b5f2a634-4132-4cad-8a63-78cf1e5a1406', 'body': {'resize': {'flavorRef': '1826904075'}}} Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:57:53.191497 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f9d926e-b57d-42fb-b79d-ea52b0fe39c2 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406/action" status: 403 len: 118 microversion: 2.1 time: 0.210392 Oct 04 18:57:53.196000 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3531/7057] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:52 2022] POST /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406/action => generated 118 bytes in 212 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:57:53.202710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a98c6ec7-a1e3-4ecc-ac5f-4f0a7c823e54 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:53.220691 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a98c6ec7-a1e3-4ecc-ac5f-4f0a7c823e54 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1826904075" status: 202 len: 0 microversion: 2.1 time: 0.021770 Oct 04 18:57:53.221275 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3527/7058] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 4 18:57:53 2022] DELETE /compute/v2.1/flavors/1826904075 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:57:53.229318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b0197420-a2fc-4a8c-b116-e18e6d7f434e tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:53.250801 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b0197420-a2fc-4a8c-b116-e18e6d7f434e tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025029 Oct 04 18:57:53.251403 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3532/7059] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:57:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:53.272724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c8a1614a-dc8d-4a91-915c-793173ec671d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Calling method '.version_select at 0x7fd4d129f040>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:53.344612 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c8a1614a-dc8d-4a91-915c-793173ec671d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/93b076b6f8f24dae9488d7d9c3bd4d2d" status: 200 len: 371 microversion: 2.1 time: 0.075567 Oct 04 18:57:53.345196 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3528/7060] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 4 18:57:53 2022] GET /compute/v2.1/os-quota-sets/93b076b6f8f24dae9488d7d9c3bd4d2d => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:53.357680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a45bb9e1-9528-4165-9486-e0cb3a622608 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-145082280", "id": 86662617, "os-flavor-access:is_public": "True"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:53.381940 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a45bb9e1-9528-4165-9486-e0cb3a622608 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.027894 Oct 04 18:57:53.382540 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3533/7061] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:57:53 2022] POST /compute/v2.1/flavors => generated 430 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:53.396302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "86662617"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:53.398723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:53.405169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.405835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.406307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.407064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.407544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.407988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.493468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e6ad9fda3a0f4f498eb7c6282d0cc6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b076b6f8f24dae9488d7d9c3bd4d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:53.499468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-145082280 {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:57:53.506096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.506538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.507033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.507788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.508265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.508715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.528601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Getting quotas for project ad1c90ce284c45b89aec274786d69b34. Resources: {'cores', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:53.533610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Getting quotas for user 53e060b13c6642288c0862baff4144a3 and project ad1c90ce284c45b89aec274786d69b34. Resources: {'cores', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:53.545984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.compute.api [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] cores quota exceeded for 93b076b6f8f24dae9488d7d9c3bd4d2d, tried to resize instance. Oct 04 18:57:53.546542 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Request method failure captured: Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406/action HTTP/1.1 Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 37 Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIIi4PZ-puGyjBXuKwr1qi_RqWPXoYA9seRaS98qFkR8vd2V9yndDq5M9GmpPMMksMCi0yxxtEEBMBXF9nc728jsSumiZrupJrmJKHrO2olFt1lwpX57uAyy8py9GPr3xQDn4WpqpUOXlFrzJR5AODrxtsrHAqqlZYUC1BoAP9Y_roc Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 93b076b6f8f24dae9488d7d9c3bd4d2d Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1256397519 Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member,admin Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member,admin Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_93b076b6f8f24dae9488d7d9c3bd4d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/93b076b6f8f24dae9488d7d9c3bd4d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/93b076b6f8f24dae9488d7d9c3bd4d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/93b076b6f8f24dae9488d7d9c3bd4d2d"}]}] Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1256397519 Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 93b076b6f8f24dae9488d7d9c3bd4d2d Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1256397519 Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersAdminNegativeTestJSON-1256397519-project-admin Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: e6ad9fda3a0f4f498eb7c6282d0cc6ce Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1256397519-project-admin Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: {"resize": {"flavorRef": "86662617"}} Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'b5f2a634-4132-4cad-8a63-78cf1e5a1406', 'body': {'resize': {'flavorRef': '86662617'}}} Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:57:53.548648 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b6a9911-0f9a-4aa3-bad3-741e5f4de85d tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406/action" status: 403 len: 113 microversion: 2.1 time: 0.158020 Oct 04 18:57:53.552756 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3529/7062] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:53 2022] POST /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406/action => generated 113 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:57:53.560014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-84800ea4-472c-458f-ab6c-0835f8213258 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:53.576954 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-84800ea4-472c-458f-ab6c-0835f8213258 tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/86662617" status: 202 len: 0 microversion: 2.1 time: 0.021281 Oct 04 18:57:53.577511 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3534/7063] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 4 18:57:53 2022] DELETE /compute/v2.1/flavors/86662617 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:57:53.585894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dcb6ac6a-9d03-4590-a70b-00a03a8c4efe tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:53.607193 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dcb6ac6a-9d03-4590-a70b-00a03a8c4efe tempest-ServersAdminNegativeTestJSON-1256397519 tempest-ServersAdminNegativeTestJSON-1256397519-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024920 Oct 04 18:57:53.607777 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3530/7064] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 4 18:57:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:53.628651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c6185bb-2bb3-4643-8241-c7dfb8902587 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:53.629173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c6185bb-2bb3-4643-8241-c7dfb8902587 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:53.635167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c6185bb-2bb3-4643-8241-c7dfb8902587 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.635726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c6185bb-2bb3-4643-8241-c7dfb8902587 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.636095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c6185bb-2bb3-4643-8241-c7dfb8902587 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.636803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c6185bb-2bb3-4643-8241-c7dfb8902587 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.637257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c6185bb-2bb3-4643-8241-c7dfb8902587 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.637757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c6185bb-2bb3-4643-8241-c7dfb8902587 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.663306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c6185bb-2bb3-4643-8241-c7dfb8902587 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:57:53.739020 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c6185bb-2bb3-4643-8241-c7dfb8902587 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 204 len: 0 microversion: 2.1 time: 0.113920 Oct 04 18:57:53.740965 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3535/7065] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:57:53 2022] DELETE /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:57:53.749809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d5b28585-40be-4aeb-ae28-9355a0889802 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:53.750452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d5b28585-40be-4aeb-ae28-9355a0889802 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:53.757580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5b28585-40be-4aeb-ae28-9355a0889802 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.758077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5b28585-40be-4aeb-ae28-9355a0889802 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.758850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5b28585-40be-4aeb-ae28-9355a0889802 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.759629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5b28585-40be-4aeb-ae28-9355a0889802 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:53.760117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5b28585-40be-4aeb-ae28-9355a0889802 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:53.760572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5b28585-40be-4aeb-ae28-9355a0889802 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.911520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d5b28585-40be-4aeb-ae28-9355a0889802 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:53.920049 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d5b28585-40be-4aeb-ae28-9355a0889802 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1477 microversion: 2.1 time: 0.175557 Oct 04 18:57:53.920633 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3531/7066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:53 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1477 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:54.944549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-35e6789b-9d23-41c6-9d86-f2510b89be51 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:54.945258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-35e6789b-9d23-41c6-9d86-f2510b89be51 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:54.951477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35e6789b-9d23-41c6-9d86-f2510b89be51 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:54.951968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35e6789b-9d23-41c6-9d86-f2510b89be51 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:54.952414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35e6789b-9d23-41c6-9d86-f2510b89be51 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:54.953107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35e6789b-9d23-41c6-9d86-f2510b89be51 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:54.953828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35e6789b-9d23-41c6-9d86-f2510b89be51 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:54.954259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-35e6789b-9d23-41c6-9d86-f2510b89be51 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.095039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-35e6789b-9d23-41c6-9d86-f2510b89be51 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:55.104803 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-35e6789b-9d23-41c6-9d86-f2510b89be51 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1477 microversion: 2.1 time: 0.164579 Oct 04 18:57:55.105389 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3536/7067] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:54 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1477 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:56.044622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-e3b58b22-f574-4f7d-886d-d9caa7a47e7b req-08da8144-fe58-48db-b7a2-41e5a5db953b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f2a634-4132-4cad-8a63-78cf1e5a1406", "name": "network-vif-deleted", "tag": "279bc8cc-a01a-4b4e-a20c-969938a5a9f9"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:56.057576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e3b58b22-f574-4f7d-886d-d9caa7a47e7b req-08da8144-fe58-48db-b7a2-41e5a5db953b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.059966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e3b58b22-f574-4f7d-886d-d9caa7a47e7b req-08da8144-fe58-48db-b7a2-41e5a5db953b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.059966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-e3b58b22-f574-4f7d-886d-d9caa7a47e7b req-08da8144-fe58-48db-b7a2-41e5a5db953b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.084336 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-e3b58b22-f574-4f7d-886d-d9caa7a47e7b req-08da8144-fe58-48db-b7a2-41e5a5db953b service nova] Creating event network-vif-deleted:279bc8cc-a01a-4b4e-a20c-969938a5a9f9 for instance b5f2a634-4132-4cad-8a63-78cf1e5a1406 on n-h2-850499-14 Oct 04 18:57:56.091627 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-e3b58b22-f574-4f7d-886d-d9caa7a47e7b req-08da8144-fe58-48db-b7a2-41e5a5db953b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051065 Oct 04 18:57:56.092228 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3532/7068] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:56.129892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4f42e760-dd6f-4186-9ba5-1ab608879eff tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:56.130800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4f42e760-dd6f-4186-9ba5-1ab608879eff tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:56.139194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f42e760-dd6f-4186-9ba5-1ab608879eff tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.139789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f42e760-dd6f-4186-9ba5-1ab608879eff tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.140442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f42e760-dd6f-4186-9ba5-1ab608879eff tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.141176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f42e760-dd6f-4186-9ba5-1ab608879eff tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.141809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f42e760-dd6f-4186-9ba5-1ab608879eff tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.142253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4f42e760-dd6f-4186-9ba5-1ab608879eff tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.212711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4f42e760-dd6f-4186-9ba5-1ab608879eff tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53e060b13c6642288c0862baff4144a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1c90ce284c45b89aec274786d69b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:56.220776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4f42e760-dd6f-4186-9ba5-1ab608879eff tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 200 len: 1307 microversion: 2.1 time: 0.095018 Oct 04 18:57:56.221419 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3537/7069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:56 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:57.244553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:57.245184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] [instance: b5f2a634-4132-4cad-8a63-78cf1e5a1406] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:57.252705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:57.253206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:57.253662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:57.254373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:57.254848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:57.255668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:57.270127 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] HTTP exception thrown: Instance b5f2a634-4132-4cad-8a63-78cf1e5a1406 could not be found. Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Request method failure captured: Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 HTTP/1.1 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIIiv49dViUCSCMd1o5NcQ3IIRmeu6DBew6vad6wSEJf8vjgtg0ZpNIpUtXD9NK38ioQB3MwKREX07XYYkFi0b_720BbZguC4c9y31ZgWYTmLbDEydRf99Nx5QoPwmDWaYUTQxoc4-jsw59bYT56aOI6KdSkkvdIjIz67J5ggWpjkQ4 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: ad1c90ce284c45b89aec274786d69b34 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1928426890 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ad1c90ce284c45b89aec274786d69b34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ad1c90ce284c45b89aec274786d69b34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ad1c90ce284c45b89aec274786d69b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ad1c90ce284c45b89aec274786d69b34"}]}] Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1928426890 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: ad1c90ce284c45b89aec274786d69b34 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1928426890 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersAdminNegativeTestJSON-1928426890-project Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 53e060b13c6642288c0862baff4144a3 Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1928426890-project Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance b5f2a634-4132-4cad-8a63-78cf1e5a1406 could not be found. Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'b5f2a634-4132-4cad-8a63-78cf1e5a1406'} Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f2a634-4132-4cad-8a63-78cf1e5a1406 could not be found. Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f2a634-4132-4cad-8a63-78cf1e5a1406 could not be found. Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:57.271835 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f2a634-4132-4cad-8a63-78cf1e5a1406 could not be found. Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] Returning 404 to user: Instance b5f2a634-4132-4cad-8a63-78cf1e5a1406 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-daa65faa-e9c6-4e02-871c-8cd393edaef7 tempest-ServersAdminNegativeTestJSON-1928426890 tempest-ServersAdminNegativeTestJSON-1928426890-project] 10.222.0.18 "GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406" status: 404 len: 111 microversion: 2.1 time: 0.033159 Oct 04 18:57:57.280444 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3533/7070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:57 2022] GET /compute/v2.1/servers/b5f2a634-4132-4cad-8a63-78cf1e5a1406 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:58:03.880940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:03.881825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:04.014670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-288789572", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "0ddd35f2-9dbd-4f71-a618-1584d4f7f301"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:04.085117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] validate_networks() for [('0ddd35f2-9dbd-4f71-a618-1584d4f7f301', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:58:04.524311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:58:04.524935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:58:04.525322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:58:04.525931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:58:04.526448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:58:04.536478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:04.537071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:04.537592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:04.538435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:04.539092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:04.539527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:04.559662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Getting quotas for project 61a2d600c2b6438e85a998d55de7d099. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:58:04.565757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Getting quotas for user 3ada01b0c4a74fabbc3e74b94d1585a5 and project 61a2d600c2b6438e85a998d55de7d099. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:58:04.579949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:58:04.582301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:58:04.628771 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [341c30fe-1904-4db6-9d54-58a18f82dfd3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:58:05.636342 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [341c30fe-1904-4db6-9d54-58a18f82dfd3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 46012. Oct 04 18:58:05.640715 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e03357c9-a3bc-4d8a-9fbe-0b85351acd78 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.765450 Oct 04 18:58:05.641766 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3538/7071] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:58:05.653056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1bf53020-46ac-4be1-9962-7aad49da3cdd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:05.653856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1bf53020-46ac-4be1-9962-7aad49da3cdd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:05.657403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:05.658222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:05.716727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1bf53020-46ac-4be1-9962-7aad49da3cdd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:05.724557 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1bf53020-46ac-4be1-9962-7aad49da3cdd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1214 microversion: 2.1 time: 0.075340 Oct 04 18:58:05.725238 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3534/7072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:05 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:06.749935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e8cdc06c-8e4c-423f-b887-a658487bf66f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:06.750542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e8cdc06c-8e4c-423f-b887-a658487bf66f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:06.756849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8cdc06c-8e4c-423f-b887-a658487bf66f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:06.757997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8cdc06c-8e4c-423f-b887-a658487bf66f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:06.758793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8cdc06c-8e4c-423f-b887-a658487bf66f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:06.759556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8cdc06c-8e4c-423f-b887-a658487bf66f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:06.760019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8cdc06c-8e4c-423f-b887-a658487bf66f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:06.760450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e8cdc06c-8e4c-423f-b887-a658487bf66f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:06.834142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e8cdc06c-8e4c-423f-b887-a658487bf66f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:06.842182 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e8cdc06c-8e4c-423f-b887-a658487bf66f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1266 microversion: 2.1 time: 0.097486 Oct 04 18:58:06.842758 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3539/7073] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:06 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:07.865872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c9abe0bb-8cf2-45bd-b705-c26d2f7f11a5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:07.870771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c9abe0bb-8cf2-45bd-b705-c26d2f7f11a5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:07.874917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=63 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:07.884467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9abe0bb-8cf2-45bd-b705-c26d2f7f11a5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:07.885710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9abe0bb-8cf2-45bd-b705-c26d2f7f11a5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:07.885710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9abe0bb-8cf2-45bd-b705-c26d2f7f11a5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:07.886201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9abe0bb-8cf2-45bd-b705-c26d2f7f11a5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:07.887336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9abe0bb-8cf2-45bd-b705-c26d2f7f11a5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:07.887789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c9abe0bb-8cf2-45bd-b705-c26d2f7f11a5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:08.040469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c9abe0bb-8cf2-45bd-b705-c26d2f7f11a5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:08.049857 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c9abe0bb-8cf2-45bd-b705-c26d2f7f11a5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1314 microversion: 2.1 time: 0.187843 Oct 04 18:58:08.050875 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3535/7074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:07 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:08.662868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c6adf3f3-6678-4afd-96b4-ddf0cd356475 req-22361cf1-cfef-4198-8e98-45396511b2fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3444a5-3a07-4f76-a75c-6921e951ad6e", "tag": "73c1a2fe-abf0-4b29-b644-c348157493d5"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:08.676734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c6adf3f3-6678-4afd-96b4-ddf0cd356475 req-22361cf1-cfef-4198-8e98-45396511b2fe service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:08.677840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c6adf3f3-6678-4afd-96b4-ddf0cd356475 req-22361cf1-cfef-4198-8e98-45396511b2fe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:08.680170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c6adf3f3-6678-4afd-96b4-ddf0cd356475 req-22361cf1-cfef-4198-8e98-45396511b2fe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:08.699333 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c6adf3f3-6678-4afd-96b4-ddf0cd356475 req-22361cf1-cfef-4198-8e98-45396511b2fe service nova] Creating event network-changed:73c1a2fe-abf0-4b29-b644-c348157493d5 for instance bc3444a5-3a07-4f76-a75c-6921e951ad6e on n-h2-850499-14 Oct 04 18:58:08.705239 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c6adf3f3-6678-4afd-96b4-ddf0cd356475 req-22361cf1-cfef-4198-8e98-45396511b2fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046745 Oct 04 18:58:08.706407 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3540/7075] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:09.074244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d73946c9-a71b-4083-b034-a8781cb5af22 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:09.074878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d73946c9-a71b-4083-b034-a8781cb5af22 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:09.082771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73946c9-a71b-4083-b034-a8781cb5af22 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:09.083326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73946c9-a71b-4083-b034-a8781cb5af22 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:09.083791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73946c9-a71b-4083-b034-a8781cb5af22 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:09.084760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73946c9-a71b-4083-b034-a8781cb5af22 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:09.085281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73946c9-a71b-4083-b034-a8781cb5af22 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:09.085788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73946c9-a71b-4083-b034-a8781cb5af22 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:09.237661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d73946c9-a71b-4083-b034-a8781cb5af22 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:09.245863 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d73946c9-a71b-4083-b034-a8781cb5af22 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1314 microversion: 2.1 time: 0.175798 Oct 04 18:58:09.246457 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3536/7076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:09 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:10.271638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4316cbe7-0ed9-46f4-876a-0daff449c5ba tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:10.272249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4316cbe7-0ed9-46f4-876a-0daff449c5ba tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:10.274315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:10.282285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4316cbe7-0ed9-46f4-876a-0daff449c5ba tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:10.283130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4316cbe7-0ed9-46f4-876a-0daff449c5ba tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:10.283775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4316cbe7-0ed9-46f4-876a-0daff449c5ba tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:10.284875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4316cbe7-0ed9-46f4-876a-0daff449c5ba tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:10.285548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4316cbe7-0ed9-46f4-876a-0daff449c5ba tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:10.286023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4316cbe7-0ed9-46f4-876a-0daff449c5ba tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:10.289966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:10.430258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4316cbe7-0ed9-46f4-876a-0daff449c5ba tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:10.438274 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4316cbe7-0ed9-46f4-876a-0daff449c5ba tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1314 microversion: 2.1 time: 0.172174 Oct 04 18:58:10.439198 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3541/7077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:10 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:11.471642 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c640ad3d-426f-4782-83df-1dd1639aca3d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:11.472281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c640ad3d-426f-4782-83df-1dd1639aca3d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:11.474994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:11.480388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c640ad3d-426f-4782-83df-1dd1639aca3d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:11.480899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c640ad3d-426f-4782-83df-1dd1639aca3d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:11.481359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c640ad3d-426f-4782-83df-1dd1639aca3d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:11.482084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c640ad3d-426f-4782-83df-1dd1639aca3d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:11.482565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c640ad3d-426f-4782-83df-1dd1639aca3d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:11.483037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c640ad3d-426f-4782-83df-1dd1639aca3d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:11.638283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c640ad3d-426f-4782-83df-1dd1639aca3d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:11.648936 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c640ad3d-426f-4782-83df-1dd1639aca3d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1314 microversion: 2.1 time: 0.180833 Oct 04 18:58:11.650153 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3537/7078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:11 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:12.675110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5d6f4ba1-8832-4328-ae4f-3d54b7331af9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:12.675725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5d6f4ba1-8832-4328-ae4f-3d54b7331af9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:12.682588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d6f4ba1-8832-4328-ae4f-3d54b7331af9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:12.683114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d6f4ba1-8832-4328-ae4f-3d54b7331af9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:12.683558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d6f4ba1-8832-4328-ae4f-3d54b7331af9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:12.684330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d6f4ba1-8832-4328-ae4f-3d54b7331af9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:12.684786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d6f4ba1-8832-4328-ae4f-3d54b7331af9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:12.685212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d6f4ba1-8832-4328-ae4f-3d54b7331af9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:12.829003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5d6f4ba1-8832-4328-ae4f-3d54b7331af9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:12.836853 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5d6f4ba1-8832-4328-ae4f-3d54b7331af9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1314 microversion: 2.1 time: 0.165833 Oct 04 18:58:12.837439 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3542/7079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:12 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:13.860347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d664148-cf67-4b09-8867-371de85c7892 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:13.860966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d664148-cf67-4b09-8867-371de85c7892 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:13.867906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d664148-cf67-4b09-8867-371de85c7892 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:13.868411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d664148-cf67-4b09-8867-371de85c7892 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:13.868871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d664148-cf67-4b09-8867-371de85c7892 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:13.869597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d664148-cf67-4b09-8867-371de85c7892 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:13.870073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d664148-cf67-4b09-8867-371de85c7892 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:13.870514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d664148-cf67-4b09-8867-371de85c7892 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:14.005272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d664148-cf67-4b09-8867-371de85c7892 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:14.013110 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d664148-cf67-4b09-8867-371de85c7892 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1314 microversion: 2.1 time: 0.156749 Oct 04 18:58:14.013683 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3538/7080] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:13 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:14.380045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-dae4c980-121b-436f-9bb0-6bfbb71b0582 req-44d51784-5434-4325-ba65-d36a6a2784a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3444a5-3a07-4f76-a75c-6921e951ad6e", "name": "network-vif-plugged", "status": "completed", "tag": "73c1a2fe-abf0-4b29-b644-c348157493d5"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:14.394188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dae4c980-121b-436f-9bb0-6bfbb71b0582 req-44d51784-5434-4325-ba65-d36a6a2784a2 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:14.394690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dae4c980-121b-436f-9bb0-6bfbb71b0582 req-44d51784-5434-4325-ba65-d36a6a2784a2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:14.395186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dae4c980-121b-436f-9bb0-6bfbb71b0582 req-44d51784-5434-4325-ba65-d36a6a2784a2 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:14.409836 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-dae4c980-121b-436f-9bb0-6bfbb71b0582 req-44d51784-5434-4325-ba65-d36a6a2784a2 service nova] Creating event network-vif-plugged:73c1a2fe-abf0-4b29-b644-c348157493d5 for instance bc3444a5-3a07-4f76-a75c-6921e951ad6e on n-h2-850499-14 Oct 04 18:58:14.415946 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-dae4c980-121b-436f-9bb0-6bfbb71b0582 req-44d51784-5434-4325-ba65-d36a6a2784a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041669 Oct 04 18:58:14.416489 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3543/7081] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:58:15.037817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62906ce7-a254-43db-b16f-3c86bb2e8cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:15.038449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-62906ce7-a254-43db-b16f-3c86bb2e8cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:15.046242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62906ce7-a254-43db-b16f-3c86bb2e8cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:15.046768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62906ce7-a254-43db-b16f-3c86bb2e8cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:15.047252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62906ce7-a254-43db-b16f-3c86bb2e8cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:15.047975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62906ce7-a254-43db-b16f-3c86bb2e8cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:15.048475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62906ce7-a254-43db-b16f-3c86bb2e8cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:15.048993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62906ce7-a254-43db-b16f-3c86bb2e8cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:15.187897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62906ce7-a254-43db-b16f-3c86bb2e8cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:15.196519 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-62906ce7-a254-43db-b16f-3c86bb2e8cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1314 microversion: 2.1 time: 0.162709 Oct 04 18:58:15.197105 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3539/7082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:15 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:16.217428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:16.218769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:16.229055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1544ed8-7523-492c-b161-bcc8c3231cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:16.230168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a1544ed8-7523-492c-b161-bcc8c3231cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:16.241081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1544ed8-7523-492c-b161-bcc8c3231cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:16.241594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1544ed8-7523-492c-b161-bcc8c3231cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:16.242038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1544ed8-7523-492c-b161-bcc8c3231cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:16.242756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1544ed8-7523-492c-b161-bcc8c3231cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:16.243219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1544ed8-7523-492c-b161-bcc8c3231cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:16.243646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1544ed8-7523-492c-b161-bcc8c3231cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:16.374085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a1544ed8-7523-492c-b161-bcc8c3231cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:16.382167 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1544ed8-7523-492c-b161-bcc8c3231cfd tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1500 microversion: 2.1 time: 0.166210 Oct 04 18:58:16.382839 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3544/7083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:16 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:16.406400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:16.409219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:16.410688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:16.417780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:16.418288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:16.418746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:16.419494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:16.419971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:16.420415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:16.452515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:16.458640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:58:16.466347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:58:16.466786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:58:16.467391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:58:16.467731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:58:16.468155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:58:16.537278 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2b3ce6bf-e336-43c9-b5e4-4ccea3b8b86f tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "POST /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e/action" status: 202 len: 0 microversion: 2.1 time: 0.135139 Oct 04 18:58:16.538265 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3540/7084] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:58:16 2022] POST /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:58:16.546292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cc6583d1-a375-49a0-ad3d-2e32336ae43c tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:16.546907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cc6583d1-a375-49a0-ad3d-2e32336ae43c tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:16.553763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc6583d1-a375-49a0-ad3d-2e32336ae43c tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:16.553857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc6583d1-a375-49a0-ad3d-2e32336ae43c tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:16.554296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc6583d1-a375-49a0-ad3d-2e32336ae43c tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:16.555153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc6583d1-a375-49a0-ad3d-2e32336ae43c tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:16.555852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc6583d1-a375-49a0-ad3d-2e32336ae43c tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:16.556287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc6583d1-a375-49a0-ad3d-2e32336ae43c tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:16.739740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cc6583d1-a375-49a0-ad3d-2e32336ae43c tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:16.752103 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cc6583d1-a375-49a0-ad3d-2e32336ae43c tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1509 microversion: 2.1 time: 0.209196 Oct 04 18:58:16.753159 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3545/7085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:16 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:17.778001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0716734f-65ba-4887-9938-ea816d2236e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:17.778773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0716734f-65ba-4887-9938-ea816d2236e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:17.786025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0716734f-65ba-4887-9938-ea816d2236e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:17.786470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0716734f-65ba-4887-9938-ea816d2236e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:17.786927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0716734f-65ba-4887-9938-ea816d2236e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:17.787673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0716734f-65ba-4887-9938-ea816d2236e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:17.788150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0716734f-65ba-4887-9938-ea816d2236e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:17.788603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0716734f-65ba-4887-9938-ea816d2236e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:17.925045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0716734f-65ba-4887-9938-ea816d2236e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:17.933647 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0716734f-65ba-4887-9938-ea816d2236e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1509 microversion: 2.1 time: 0.160827 Oct 04 18:58:17.934277 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3541/7086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:17 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:18.958451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eec7c709-906a-4978-9347-ef02000241c5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:18.959217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eec7c709-906a-4978-9347-ef02000241c5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:18.967203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eec7c709-906a-4978-9347-ef02000241c5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:18.967718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eec7c709-906a-4978-9347-ef02000241c5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:18.968143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eec7c709-906a-4978-9347-ef02000241c5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:18.968851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eec7c709-906a-4978-9347-ef02000241c5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:18.969312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eec7c709-906a-4978-9347-ef02000241c5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:18.969781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eec7c709-906a-4978-9347-ef02000241c5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:19.113816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eec7c709-906a-4978-9347-ef02000241c5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:19.122446 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eec7c709-906a-4978-9347-ef02000241c5 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.168217 Oct 04 18:58:19.123079 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3546/7087] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:18 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:20.149489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9dbc13f2-5248-4758-87c2-a225320b065e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:20.150139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9dbc13f2-5248-4758-87c2-a225320b065e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:20.160503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dbc13f2-5248-4758-87c2-a225320b065e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:20.161031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dbc13f2-5248-4758-87c2-a225320b065e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:20.161495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dbc13f2-5248-4758-87c2-a225320b065e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:20.162232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dbc13f2-5248-4758-87c2-a225320b065e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:20.162703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dbc13f2-5248-4758-87c2-a225320b065e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:20.163168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9dbc13f2-5248-4758-87c2-a225320b065e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:20.309752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9dbc13f2-5248-4758-87c2-a225320b065e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:20.317993 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9dbc13f2-5248-4758-87c2-a225320b065e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.173872 Oct 04 18:58:20.318780 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3542/7088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:20 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:21.344864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a343202-ae14-4706-a6ca-3452ddf90090 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:21.345518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4a343202-ae14-4706-a6ca-3452ddf90090 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:21.356181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a343202-ae14-4706-a6ca-3452ddf90090 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:21.356813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a343202-ae14-4706-a6ca-3452ddf90090 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:21.357991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a343202-ae14-4706-a6ca-3452ddf90090 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:21.358658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a343202-ae14-4706-a6ca-3452ddf90090 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:21.359444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a343202-ae14-4706-a6ca-3452ddf90090 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:21.360200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a343202-ae14-4706-a6ca-3452ddf90090 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:21.510422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4a343202-ae14-4706-a6ca-3452ddf90090 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:21.518318 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4a343202-ae14-4706-a6ca-3452ddf90090 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.177947 Oct 04 18:58:21.518902 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3547/7089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:21 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:22.541634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75fd86fc-7e44-455c-818e-64fdd8246561 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:22.542270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75fd86fc-7e44-455c-818e-64fdd8246561 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:22.549227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75fd86fc-7e44-455c-818e-64fdd8246561 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:22.549738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75fd86fc-7e44-455c-818e-64fdd8246561 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:22.550242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75fd86fc-7e44-455c-818e-64fdd8246561 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:22.550973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75fd86fc-7e44-455c-818e-64fdd8246561 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:22.551453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75fd86fc-7e44-455c-818e-64fdd8246561 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:22.551898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75fd86fc-7e44-455c-818e-64fdd8246561 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:22.679244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75fd86fc-7e44-455c-818e-64fdd8246561 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:22.687822 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75fd86fc-7e44-455c-818e-64fdd8246561 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.150015 Oct 04 18:58:22.688330 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3543/7090] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:22 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:23.711861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d5605e4f-8ffd-45f8-855d-2eca7fed4ab1 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:23.713198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d5605e4f-8ffd-45f8-855d-2eca7fed4ab1 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:23.720825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5605e4f-8ffd-45f8-855d-2eca7fed4ab1 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:23.721316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5605e4f-8ffd-45f8-855d-2eca7fed4ab1 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:23.721755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5605e4f-8ffd-45f8-855d-2eca7fed4ab1 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:23.722450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5605e4f-8ffd-45f8-855d-2eca7fed4ab1 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:23.722912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5605e4f-8ffd-45f8-855d-2eca7fed4ab1 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:23.723383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5605e4f-8ffd-45f8-855d-2eca7fed4ab1 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:23.856127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d5605e4f-8ffd-45f8-855d-2eca7fed4ab1 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:23.863893 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d5605e4f-8ffd-45f8-855d-2eca7fed4ab1 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.156059 Oct 04 18:58:23.864471 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3548/7091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:23 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:24.887644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73fb111d-c2f0-415f-842d-a374924e86f2 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:24.888183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73fb111d-c2f0-415f-842d-a374924e86f2 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:24.895157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73fb111d-c2f0-415f-842d-a374924e86f2 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:24.895664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73fb111d-c2f0-415f-842d-a374924e86f2 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:24.896118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73fb111d-c2f0-415f-842d-a374924e86f2 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:24.896870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73fb111d-c2f0-415f-842d-a374924e86f2 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:24.897345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73fb111d-c2f0-415f-842d-a374924e86f2 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:24.897788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73fb111d-c2f0-415f-842d-a374924e86f2 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:25.026322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-73fb111d-c2f0-415f-842d-a374924e86f2 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:25.034259 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-73fb111d-c2f0-415f-842d-a374924e86f2 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.150606 Oct 04 18:58:25.034839 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3544/7092] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:24 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:26.058828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6247c97e-52ef-4f07-9548-4a5be70c8866 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:26.059462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6247c97e-52ef-4f07-9548-4a5be70c8866 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:26.065447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6247c97e-52ef-4f07-9548-4a5be70c8866 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:26.065928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6247c97e-52ef-4f07-9548-4a5be70c8866 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:26.066365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6247c97e-52ef-4f07-9548-4a5be70c8866 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:26.067093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6247c97e-52ef-4f07-9548-4a5be70c8866 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:26.067537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6247c97e-52ef-4f07-9548-4a5be70c8866 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:26.067963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6247c97e-52ef-4f07-9548-4a5be70c8866 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:26.203948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6247c97e-52ef-4f07-9548-4a5be70c8866 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:26.211801 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6247c97e-52ef-4f07-9548-4a5be70c8866 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.157982 Oct 04 18:58:26.212887 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3549/7093] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:26 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:27.235750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b8fdafbd-467d-4911-a8de-8b8d1e9c91a6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:27.236385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b8fdafbd-467d-4911-a8de-8b8d1e9c91a6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:27.243268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdafbd-467d-4911-a8de-8b8d1e9c91a6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:27.244288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdafbd-467d-4911-a8de-8b8d1e9c91a6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:27.244752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdafbd-467d-4911-a8de-8b8d1e9c91a6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:27.245481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdafbd-467d-4911-a8de-8b8d1e9c91a6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:27.246069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdafbd-467d-4911-a8de-8b8d1e9c91a6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:27.246408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b8fdafbd-467d-4911-a8de-8b8d1e9c91a6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:27.382307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b8fdafbd-467d-4911-a8de-8b8d1e9c91a6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:27.390040 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b8fdafbd-467d-4911-a8de-8b8d1e9c91a6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.158291 Oct 04 18:58:27.390625 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3545/7094] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:27 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:28.413145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b2bec9b-17b7-4747-a06b-0cf8461ca71a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:28.413801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8b2bec9b-17b7-4747-a06b-0cf8461ca71a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:28.420869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b2bec9b-17b7-4747-a06b-0cf8461ca71a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:28.421365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b2bec9b-17b7-4747-a06b-0cf8461ca71a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:28.421810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b2bec9b-17b7-4747-a06b-0cf8461ca71a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:28.422510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b2bec9b-17b7-4747-a06b-0cf8461ca71a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:28.422988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b2bec9b-17b7-4747-a06b-0cf8461ca71a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:28.423425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b2bec9b-17b7-4747-a06b-0cf8461ca71a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:28.553808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8b2bec9b-17b7-4747-a06b-0cf8461ca71a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:28.562150 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b2bec9b-17b7-4747-a06b-0cf8461ca71a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.152869 Oct 04 18:58:28.562721 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3550/7095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:28 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:29.586640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04331f99-4646-4fc4-aa87-84612c664569 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:29.587935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-04331f99-4646-4fc4-aa87-84612c664569 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:29.594938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04331f99-4646-4fc4-aa87-84612c664569 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:29.595478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04331f99-4646-4fc4-aa87-84612c664569 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:29.595930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04331f99-4646-4fc4-aa87-84612c664569 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:29.596684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04331f99-4646-4fc4-aa87-84612c664569 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:29.597158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04331f99-4646-4fc4-aa87-84612c664569 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:29.597607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04331f99-4646-4fc4-aa87-84612c664569 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:29.734152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-04331f99-4646-4fc4-aa87-84612c664569 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:29.746972 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04331f99-4646-4fc4-aa87-84612c664569 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.163991 Oct 04 18:58:29.748074 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3546/7096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:29 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:30.771494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1ae180b2-4790-4d6d-8507-2309e5cc5990 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:30.772030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1ae180b2-4790-4d6d-8507-2309e5cc5990 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:30.779393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ae180b2-4790-4d6d-8507-2309e5cc5990 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:30.779885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ae180b2-4790-4d6d-8507-2309e5cc5990 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:30.780326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ae180b2-4790-4d6d-8507-2309e5cc5990 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:30.781006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ae180b2-4790-4d6d-8507-2309e5cc5990 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:30.781465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ae180b2-4790-4d6d-8507-2309e5cc5990 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:30.781887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1ae180b2-4790-4d6d-8507-2309e5cc5990 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:30.910693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1ae180b2-4790-4d6d-8507-2309e5cc5990 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:30.919039 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1ae180b2-4790-4d6d-8507-2309e5cc5990 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.151533 Oct 04 18:58:30.919614 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3551/7097] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:30 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:31.941770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d3d0bfb8-3dc2-4e25-b14a-6b5312ea7a2d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:31.942402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d3d0bfb8-3dc2-4e25-b14a-6b5312ea7a2d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:31.949318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3d0bfb8-3dc2-4e25-b14a-6b5312ea7a2d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:31.949824 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3d0bfb8-3dc2-4e25-b14a-6b5312ea7a2d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:31.950286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3d0bfb8-3dc2-4e25-b14a-6b5312ea7a2d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:31.951296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3d0bfb8-3dc2-4e25-b14a-6b5312ea7a2d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:31.951895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3d0bfb8-3dc2-4e25-b14a-6b5312ea7a2d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:31.952223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d3d0bfb8-3dc2-4e25-b14a-6b5312ea7a2d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:32.088392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d3d0bfb8-3dc2-4e25-b14a-6b5312ea7a2d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:32.096319 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d3d0bfb8-3dc2-4e25-b14a-6b5312ea7a2d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.158453 Oct 04 18:58:32.096898 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3547/7098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:31 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:33.120090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-edcc3850-a25f-4bc1-baeb-deef33d6b68d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:33.120813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-edcc3850-a25f-4bc1-baeb-deef33d6b68d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:33.128189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edcc3850-a25f-4bc1-baeb-deef33d6b68d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:33.128705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edcc3850-a25f-4bc1-baeb-deef33d6b68d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:33.129147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edcc3850-a25f-4bc1-baeb-deef33d6b68d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:33.129848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edcc3850-a25f-4bc1-baeb-deef33d6b68d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:33.130310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edcc3850-a25f-4bc1-baeb-deef33d6b68d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:33.130742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edcc3850-a25f-4bc1-baeb-deef33d6b68d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:33.264801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-edcc3850-a25f-4bc1-baeb-deef33d6b68d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:33.272655 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-edcc3850-a25f-4bc1-baeb-deef33d6b68d tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.156506 Oct 04 18:58:33.273229 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3552/7099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:33 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:34.297287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-69ee3b77-ee63-49d7-a56d-f6d15d21db99 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:34.297931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-69ee3b77-ee63-49d7-a56d-f6d15d21db99 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:34.301136 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:58:34.301283 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 18:58:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e (ip 10.222.0.18) !!! Oct 04 18:58:34.308498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee3b77-ee63-49d7-a56d-f6d15d21db99 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:34.309019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee3b77-ee63-49d7-a56d-f6d15d21db99 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:34.309482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee3b77-ee63-49d7-a56d-f6d15d21db99 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:34.310213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee3b77-ee63-49d7-a56d-f6d15d21db99 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:34.310713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee3b77-ee63-49d7-a56d-f6d15d21db99 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:34.311173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-69ee3b77-ee63-49d7-a56d-f6d15d21db99 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:34.444114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-69ee3b77-ee63-49d7-a56d-f6d15d21db99 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:34.452286 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-69ee3b77-ee63-49d7-a56d-f6d15d21db99 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.158947 Oct 04 18:58:34.452866 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3548/7100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:34 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:35.476010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-53e24fad-c4f9-4e05-8f46-ef2d7ed9f639 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:35.476761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-53e24fad-c4f9-4e05-8f46-ef2d7ed9f639 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:35.484368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53e24fad-c4f9-4e05-8f46-ef2d7ed9f639 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:35.484861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53e24fad-c4f9-4e05-8f46-ef2d7ed9f639 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:35.485305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53e24fad-c4f9-4e05-8f46-ef2d7ed9f639 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:35.486010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53e24fad-c4f9-4e05-8f46-ef2d7ed9f639 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:35.486474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53e24fad-c4f9-4e05-8f46-ef2d7ed9f639 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:35.486912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53e24fad-c4f9-4e05-8f46-ef2d7ed9f639 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:35.619386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-53e24fad-c4f9-4e05-8f46-ef2d7ed9f639 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:35.627896 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-53e24fad-c4f9-4e05-8f46-ef2d7ed9f639 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.155742 Oct 04 18:58:35.628610 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3553/7101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:35 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:36.652407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-68d74b8b-c835-467f-8116-db52052d0d8e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:36.653041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-68d74b8b-c835-467f-8116-db52052d0d8e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:36.660030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d74b8b-c835-467f-8116-db52052d0d8e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:36.660535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d74b8b-c835-467f-8116-db52052d0d8e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:36.660987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d74b8b-c835-467f-8116-db52052d0d8e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:36.661859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d74b8b-c835-467f-8116-db52052d0d8e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:36.662991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d74b8b-c835-467f-8116-db52052d0d8e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:36.663441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-68d74b8b-c835-467f-8116-db52052d0d8e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:36.793875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-68d74b8b-c835-467f-8116-db52052d0d8e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:36.802115 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-68d74b8b-c835-467f-8116-db52052d0d8e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.154045 Oct 04 18:58:36.802828 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3549/7102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:36 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:37.827542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-825cba5c-94e5-445e-b8e1-b9e3d708a769 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:37.828087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-825cba5c-94e5-445e-b8e1-b9e3d708a769 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:37.834837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-825cba5c-94e5-445e-b8e1-b9e3d708a769 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:37.835350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-825cba5c-94e5-445e-b8e1-b9e3d708a769 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:37.835790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-825cba5c-94e5-445e-b8e1-b9e3d708a769 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:37.836473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-825cba5c-94e5-445e-b8e1-b9e3d708a769 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:37.836929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-825cba5c-94e5-445e-b8e1-b9e3d708a769 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:37.837354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-825cba5c-94e5-445e-b8e1-b9e3d708a769 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:37.967995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-825cba5c-94e5-445e-b8e1-b9e3d708a769 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:37.975660 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-825cba5c-94e5-445e-b8e1-b9e3d708a769 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.152370 Oct 04 18:58:37.976223 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3554/7103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:37 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:38.999748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-35171fd9-b885-4b6f-b2f6-edbc4061ad67 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:39.000382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-35171fd9-b885-4b6f-b2f6-edbc4061ad67 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:39.007440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35171fd9-b885-4b6f-b2f6-edbc4061ad67 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:39.007951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35171fd9-b885-4b6f-b2f6-edbc4061ad67 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:39.008407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35171fd9-b885-4b6f-b2f6-edbc4061ad67 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:39.009749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35171fd9-b885-4b6f-b2f6-edbc4061ad67 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:39.010228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35171fd9-b885-4b6f-b2f6-edbc4061ad67 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:39.010675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35171fd9-b885-4b6f-b2f6-edbc4061ad67 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:39.013349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:39.144808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-35171fd9-b885-4b6f-b2f6-edbc4061ad67 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:39.153464 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-35171fd9-b885-4b6f-b2f6-edbc4061ad67 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.157609 Oct 04 18:58:39.154058 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3550/7104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:38 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:40.177728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d5afb1f4-00d8-4079-9f53-eea33e6204e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:40.178350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d5afb1f4-00d8-4079-9f53-eea33e6204e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:40.186009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5afb1f4-00d8-4079-9f53-eea33e6204e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:40.186498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5afb1f4-00d8-4079-9f53-eea33e6204e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:40.186941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5afb1f4-00d8-4079-9f53-eea33e6204e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:40.187660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5afb1f4-00d8-4079-9f53-eea33e6204e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:40.188121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5afb1f4-00d8-4079-9f53-eea33e6204e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:40.188556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d5afb1f4-00d8-4079-9f53-eea33e6204e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:40.321607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d5afb1f4-00d8-4079-9f53-eea33e6204e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:40.323829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=84 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:40.331142 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d5afb1f4-00d8-4079-9f53-eea33e6204e6 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.157318 Oct 04 18:58:40.331714 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3555/7105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:40 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:41.354726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5eec30c9-2e0b-439d-b7db-3e21e7a48363 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:41.355431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5eec30c9-2e0b-439d-b7db-3e21e7a48363 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:41.362531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec30c9-2e0b-439d-b7db-3e21e7a48363 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:41.363075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec30c9-2e0b-439d-b7db-3e21e7a48363 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:41.363643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec30c9-2e0b-439d-b7db-3e21e7a48363 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:41.364364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec30c9-2e0b-439d-b7db-3e21e7a48363 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:41.364848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec30c9-2e0b-439d-b7db-3e21e7a48363 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:41.365271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5eec30c9-2e0b-439d-b7db-3e21e7a48363 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:41.505170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5eec30c9-2e0b-439d-b7db-3e21e7a48363 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:41.513373 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5eec30c9-2e0b-439d-b7db-3e21e7a48363 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.162743 Oct 04 18:58:41.513951 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3551/7106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:41 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:42.536355 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e5e0497e-90d5-4bd2-addf-319d0d52d08e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:42.536972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e5e0497e-90d5-4bd2-addf-319d0d52d08e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:42.539674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=30 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:42.545292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5e0497e-90d5-4bd2-addf-319d0d52d08e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:42.545777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5e0497e-90d5-4bd2-addf-319d0d52d08e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:42.546222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5e0497e-90d5-4bd2-addf-319d0d52d08e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:42.546908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5e0497e-90d5-4bd2-addf-319d0d52d08e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:42.547386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5e0497e-90d5-4bd2-addf-319d0d52d08e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:42.547813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5e0497e-90d5-4bd2-addf-319d0d52d08e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:42.686265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e5e0497e-90d5-4bd2-addf-319d0d52d08e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:42.694386 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e5e0497e-90d5-4bd2-addf-319d0d52d08e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.161818 Oct 04 18:58:42.694884 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3556/7107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:42 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:43.720549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-51ba5220-db99-4edc-a096-fd5641bcbf35 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:43.721107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-51ba5220-db99-4edc-a096-fd5641bcbf35 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:43.723797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=34 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:43.730142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ba5220-db99-4edc-a096-fd5641bcbf35 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:43.731785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ba5220-db99-4edc-a096-fd5641bcbf35 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:43.731785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ba5220-db99-4edc-a096-fd5641bcbf35 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:43.732636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ba5220-db99-4edc-a096-fd5641bcbf35 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:43.732636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ba5220-db99-4edc-a096-fd5641bcbf35 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:43.732808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51ba5220-db99-4edc-a096-fd5641bcbf35 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:43.885889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-51ba5220-db99-4edc-a096-fd5641bcbf35 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:43.893867 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-51ba5220-db99-4edc-a096-fd5641bcbf35 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.177598 Oct 04 18:58:43.894461 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3552/7108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:43 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:44.918588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9e3cddf5-9d97-484c-96b1-f0fe1fb6a922 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:44.919230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9e3cddf5-9d97-484c-96b1-f0fe1fb6a922 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:44.926294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e3cddf5-9d97-484c-96b1-f0fe1fb6a922 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:44.926784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e3cddf5-9d97-484c-96b1-f0fe1fb6a922 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:44.927341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e3cddf5-9d97-484c-96b1-f0fe1fb6a922 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:44.928039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e3cddf5-9d97-484c-96b1-f0fe1fb6a922 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:44.928496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e3cddf5-9d97-484c-96b1-f0fe1fb6a922 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:44.928923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9e3cddf5-9d97-484c-96b1-f0fe1fb6a922 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:45.057284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9e3cddf5-9d97-484c-96b1-f0fe1fb6a922 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:45.064995 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9e3cddf5-9d97-484c-96b1-f0fe1fb6a922 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.150898 Oct 04 18:58:45.065568 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3557/7109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:44 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:46.088325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d0e6d052-0caa-468c-959d-eec3426389d0 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:46.088954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d0e6d052-0caa-468c-959d-eec3426389d0 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:46.095794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0e6d052-0caa-468c-959d-eec3426389d0 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:46.096296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0e6d052-0caa-468c-959d-eec3426389d0 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:46.096754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0e6d052-0caa-468c-959d-eec3426389d0 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:46.097466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0e6d052-0caa-468c-959d-eec3426389d0 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:46.097940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0e6d052-0caa-468c-959d-eec3426389d0 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:46.098381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0e6d052-0caa-468c-959d-eec3426389d0 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:46.233802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d0e6d052-0caa-468c-959d-eec3426389d0 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:46.241569 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d0e6d052-0caa-468c-959d-eec3426389d0 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.157163 Oct 04 18:58:46.242151 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3553/7110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:46 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:47.266119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-523a4e3d-1077-4886-b56e-37e8dad3d2cf tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:47.266734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-523a4e3d-1077-4886-b56e-37e8dad3d2cf tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:47.273670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a4e3d-1077-4886-b56e-37e8dad3d2cf tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.274159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a4e3d-1077-4886-b56e-37e8dad3d2cf tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.274599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a4e3d-1077-4886-b56e-37e8dad3d2cf tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:47.275336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a4e3d-1077-4886-b56e-37e8dad3d2cf tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.275793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a4e3d-1077-4886-b56e-37e8dad3d2cf tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.276220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-523a4e3d-1077-4886-b56e-37e8dad3d2cf tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:47.413310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-523a4e3d-1077-4886-b56e-37e8dad3d2cf tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:47.424847 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-523a4e3d-1077-4886-b56e-37e8dad3d2cf tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.162292 Oct 04 18:58:47.425681 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3558/7111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:47 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:48.450804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f37486fc-7e76-4947-8e61-0b3ea0dddf06 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:48.451463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f37486fc-7e76-4947-8e61-0b3ea0dddf06 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:48.458481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f37486fc-7e76-4947-8e61-0b3ea0dddf06 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:48.459020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f37486fc-7e76-4947-8e61-0b3ea0dddf06 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:48.459487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f37486fc-7e76-4947-8e61-0b3ea0dddf06 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:48.460214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f37486fc-7e76-4947-8e61-0b3ea0dddf06 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:48.460697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f37486fc-7e76-4947-8e61-0b3ea0dddf06 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:48.461140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f37486fc-7e76-4947-8e61-0b3ea0dddf06 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:48.631992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f37486fc-7e76-4947-8e61-0b3ea0dddf06 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:48.643220 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f37486fc-7e76-4947-8e61-0b3ea0dddf06 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.197059 Oct 04 18:58:48.643823 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3554/7112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:48 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:49.667384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-18acd618-6ebd-4860-82fe-5af21320ff00 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:49.668049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-18acd618-6ebd-4860-82fe-5af21320ff00 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:49.674907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18acd618-6ebd-4860-82fe-5af21320ff00 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.675419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18acd618-6ebd-4860-82fe-5af21320ff00 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.675859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18acd618-6ebd-4860-82fe-5af21320ff00 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:49.676547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18acd618-6ebd-4860-82fe-5af21320ff00 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.677006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18acd618-6ebd-4860-82fe-5af21320ff00 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.677429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18acd618-6ebd-4860-82fe-5af21320ff00 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:49.807602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-18acd618-6ebd-4860-82fe-5af21320ff00 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:49.815253 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-18acd618-6ebd-4860-82fe-5af21320ff00 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.152451 Oct 04 18:58:49.815832 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3559/7113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:49 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:50.839859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21d5493b-a53f-4688-9109-f38ec60a0a04 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:50.840399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21d5493b-a53f-4688-9109-f38ec60a0a04 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:50.847449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d5493b-a53f-4688-9109-f38ec60a0a04 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:50.847955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d5493b-a53f-4688-9109-f38ec60a0a04 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:50.848411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d5493b-a53f-4688-9109-f38ec60a0a04 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:50.849124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d5493b-a53f-4688-9109-f38ec60a0a04 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:50.849601 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d5493b-a53f-4688-9109-f38ec60a0a04 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:50.850050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21d5493b-a53f-4688-9109-f38ec60a0a04 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:50.978409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-21d5493b-a53f-4688-9109-f38ec60a0a04 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:50.986628 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21d5493b-a53f-4688-9109-f38ec60a0a04 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1514 microversion: 2.1 time: 0.151254 Oct 04 18:58:50.987259 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3555/7114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:50 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:51.550655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-77812f65-68de-465f-975c-c42d0a514701 req-ced52289-5d34-4ee9-bc3f-911c271fe682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3444a5-3a07-4f76-a75c-6921e951ad6e", "name": "network-vif-unplugged", "status": "completed", "tag": "73c1a2fe-abf0-4b29-b644-c348157493d5"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:51.561273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-77812f65-68de-465f-975c-c42d0a514701 req-ced52289-5d34-4ee9-bc3f-911c271fe682 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:51.561757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-77812f65-68de-465f-975c-c42d0a514701 req-ced52289-5d34-4ee9-bc3f-911c271fe682 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:51.562194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-77812f65-68de-465f-975c-c42d0a514701 req-ced52289-5d34-4ee9-bc3f-911c271fe682 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:51.574321 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-77812f65-68de-465f-975c-c42d0a514701 req-ced52289-5d34-4ee9-bc3f-911c271fe682 service nova] Creating event network-vif-unplugged:73c1a2fe-abf0-4b29-b644-c348157493d5 for instance bc3444a5-3a07-4f76-a75c-6921e951ad6e on n-h1-850499-14 Oct 04 18:58:51.579853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-77812f65-68de-465f-975c-c42d0a514701 req-ced52289-5d34-4ee9-bc3f-911c271fe682 service nova] Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:58:51.590802 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-77812f65-68de-465f-975c-c42d0a514701 req-ced52289-5d34-4ee9-bc3f-911c271fe682 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043832 Oct 04 18:58:51.591460 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3560/7115] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:58:52.011871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6a9e7014-87f0-4271-838c-18fada18b981 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:52.012515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6a9e7014-87f0-4271-838c-18fada18b981 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:52.019467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a9e7014-87f0-4271-838c-18fada18b981 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.019979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a9e7014-87f0-4271-838c-18fada18b981 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.020439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a9e7014-87f0-4271-838c-18fada18b981 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.021160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a9e7014-87f0-4271-838c-18fada18b981 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.021633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a9e7014-87f0-4271-838c-18fada18b981 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.022077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6a9e7014-87f0-4271-838c-18fada18b981 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.157400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6a9e7014-87f0-4271-838c-18fada18b981 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:52.165155 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6a9e7014-87f0-4271-838c-18fada18b981 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1513 microversion: 2.1 time: 0.157815 Oct 04 18:58:52.165787 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3556/7116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:52 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:53.189653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e603d9f-2061-4443-99d0-ac6284ea1260 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:53.190375 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6e603d9f-2061-4443-99d0-ac6284ea1260 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:53.196554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e603d9f-2061-4443-99d0-ac6284ea1260 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:53.197045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e603d9f-2061-4443-99d0-ac6284ea1260 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:53.197487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e603d9f-2061-4443-99d0-ac6284ea1260 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:53.198181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e603d9f-2061-4443-99d0-ac6284ea1260 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:53.198640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e603d9f-2061-4443-99d0-ac6284ea1260 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:53.199359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e603d9f-2061-4443-99d0-ac6284ea1260 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:53.329485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6e603d9f-2061-4443-99d0-ac6284ea1260 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:53.337847 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e603d9f-2061-4443-99d0-ac6284ea1260 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1511 microversion: 2.1 time: 0.152795 Oct 04 18:58:53.338423 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3561/7117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:53 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:53.606675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-74de974d-e355-4d47-8113-3f2be1967167 req-65658b0e-e60c-45c6-8baa-838c3cc4647f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3444a5-3a07-4f76-a75c-6921e951ad6e", "tag": "73c1a2fe-abf0-4b29-b644-c348157493d5"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:53.616725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-74de974d-e355-4d47-8113-3f2be1967167 req-65658b0e-e60c-45c6-8baa-838c3cc4647f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:53.617346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-74de974d-e355-4d47-8113-3f2be1967167 req-65658b0e-e60c-45c6-8baa-838c3cc4647f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:53.617794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-74de974d-e355-4d47-8113-3f2be1967167 req-65658b0e-e60c-45c6-8baa-838c3cc4647f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:53.629243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-74de974d-e355-4d47-8113-3f2be1967167 req-65658b0e-e60c-45c6-8baa-838c3cc4647f service nova] Creating event network-changed:73c1a2fe-abf0-4b29-b644-c348157493d5 for instance bc3444a5-3a07-4f76-a75c-6921e951ad6e on n-h1-850499-14 Oct 04 18:58:53.635078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-74de974d-e355-4d47-8113-3f2be1967167 req-65658b0e-e60c-45c6-8baa-838c3cc4647f service nova] Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:58:53.646556 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-74de974d-e355-4d47-8113-3f2be1967167 req-65658b0e-e60c-45c6-8baa-838c3cc4647f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043633 Oct 04 18:58:53.647199 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3557/7118] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:54.361767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fc1020e4-a75f-42fe-bc1c-568e2bf6f05a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:54.362387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fc1020e4-a75f-42fe-bc1c-568e2bf6f05a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:54.369912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1020e4-a75f-42fe-bc1c-568e2bf6f05a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:54.370407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1020e4-a75f-42fe-bc1c-568e2bf6f05a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:54.370855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1020e4-a75f-42fe-bc1c-568e2bf6f05a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:54.371750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1020e4-a75f-42fe-bc1c-568e2bf6f05a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:54.372128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1020e4-a75f-42fe-bc1c-568e2bf6f05a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:54.372557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc1020e4-a75f-42fe-bc1c-568e2bf6f05a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:54.534117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fc1020e4-a75f-42fe-bc1c-568e2bf6f05a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:54.543923 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fc1020e4-a75f-42fe-bc1c-568e2bf6f05a tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1508 microversion: 2.1 time: 0.185908 Oct 04 18:58:54.544837 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3562/7119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:54 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:54.568353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:54.568969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:54.576558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:54.577080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:54.577537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:54.578275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:54.578750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:54.579229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:54.611878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:58:54.673898 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.compute.api [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Found an unconfirmed migration during delete, id: 16, status: finished Oct 04 18:58:56.363236 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-08c47d02-0f27-4772-bb3d-8847a15aa849 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 204 len: 0 microversion: 2.1 time: 1.798828 Oct 04 18:58:56.364296 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3558/7120] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:58:54 2022] DELETE /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 0 bytes in 1801 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:58:56.373083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cb0ce976-048e-4ad9-bfa6-453e9a12dfb3 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:56.373747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cb0ce976-048e-4ad9-bfa6-453e9a12dfb3 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:56.380862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb0ce976-048e-4ad9-bfa6-453e9a12dfb3 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:56.381359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb0ce976-048e-4ad9-bfa6-453e9a12dfb3 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:56.381812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb0ce976-048e-4ad9-bfa6-453e9a12dfb3 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:56.382525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb0ce976-048e-4ad9-bfa6-453e9a12dfb3 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:56.383021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb0ce976-048e-4ad9-bfa6-453e9a12dfb3 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:56.383473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cb0ce976-048e-4ad9-bfa6-453e9a12dfb3 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:56.578621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-0c0e6300-d64d-465f-aa8f-6a6c209dd7f9 req-169211d4-a6ef-4847-bcc8-b29ffaf68595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3444a5-3a07-4f76-a75c-6921e951ad6e", "name": "network-vif-plugged", "status": "completed", "tag": "73c1a2fe-abf0-4b29-b644-c348157493d5"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:56.579566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cb0ce976-048e-4ad9-bfa6-453e9a12dfb3 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:56.589868 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cb0ce976-048e-4ad9-bfa6-453e9a12dfb3 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1500 microversion: 2.1 time: 0.220675 Oct 04 18:58:56.590790 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3563/7121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:56 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:56.609054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0c0e6300-d64d-465f-aa8f-6a6c209dd7f9 req-169211d4-a6ef-4847-bcc8-b29ffaf68595 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:56.609584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0c0e6300-d64d-465f-aa8f-6a6c209dd7f9 req-169211d4-a6ef-4847-bcc8-b29ffaf68595 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:56.610046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0c0e6300-d64d-465f-aa8f-6a6c209dd7f9 req-169211d4-a6ef-4847-bcc8-b29ffaf68595 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:56.622364 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-0c0e6300-d64d-465f-aa8f-6a6c209dd7f9 req-169211d4-a6ef-4847-bcc8-b29ffaf68595 service nova] Creating event network-vif-plugged:73c1a2fe-abf0-4b29-b644-c348157493d5 for instance bc3444a5-3a07-4f76-a75c-6921e951ad6e on n-h1-850499-14 Oct 04 18:58:56.627355 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-0c0e6300-d64d-465f-aa8f-6a6c209dd7f9 req-169211d4-a6ef-4847-bcc8-b29ffaf68595 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054225 Oct 04 18:58:56.627996 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3559/7122] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:58:57.616345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dd08c508-fec8-45bb-b4a2-2b35a2435e3e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:57.616965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dd08c508-fec8-45bb-b4a2-2b35a2435e3e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:57.624345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd08c508-fec8-45bb-b4a2-2b35a2435e3e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:57.624838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd08c508-fec8-45bb-b4a2-2b35a2435e3e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:57.625287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd08c508-fec8-45bb-b4a2-2b35a2435e3e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:57.625996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd08c508-fec8-45bb-b4a2-2b35a2435e3e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:57.626463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd08c508-fec8-45bb-b4a2-2b35a2435e3e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:57.626902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dd08c508-fec8-45bb-b4a2-2b35a2435e3e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:57.757857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dd08c508-fec8-45bb-b4a2-2b35a2435e3e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada01b0c4a74fabbc3e74b94d1585a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a2d600c2b6438e85a998d55de7d099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:57.766281 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dd08c508-fec8-45bb-b4a2-2b35a2435e3e tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 200 len: 1500 microversion: 2.1 time: 0.153831 Oct 04 18:58:57.766867 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3564/7123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:57 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:58.344652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c5dd9ff4-e338-4ff2-8674-4ea1b7ec479b req-37e00e2e-9f3e-4275-bb24-e6009b8f7aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3444a5-3a07-4f76-a75c-6921e951ad6e", "name": "network-vif-deleted", "tag": "73c1a2fe-abf0-4b29-b644-c348157493d5"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:58.367071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c5dd9ff4-e338-4ff2-8674-4ea1b7ec479b req-37e00e2e-9f3e-4275-bb24-e6009b8f7aac service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.367687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c5dd9ff4-e338-4ff2-8674-4ea1b7ec479b req-37e00e2e-9f3e-4275-bb24-e6009b8f7aac service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.368267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c5dd9ff4-e338-4ff2-8674-4ea1b7ec479b req-37e00e2e-9f3e-4275-bb24-e6009b8f7aac service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.382034 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c5dd9ff4-e338-4ff2-8674-4ea1b7ec479b req-37e00e2e-9f3e-4275-bb24-e6009b8f7aac service nova] Creating event network-vif-deleted:73c1a2fe-abf0-4b29-b644-c348157493d5 for instance bc3444a5-3a07-4f76-a75c-6921e951ad6e on n-h1-850499-14 Oct 04 18:58:58.388074 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c5dd9ff4-e338-4ff2-8674-4ea1b7ec479b req-37e00e2e-9f3e-4275-bb24-e6009b8f7aac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047526 Oct 04 18:58:58.391249 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3560/7124] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:58.789240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:58.789852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:58.796866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.797353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.797792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.798488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.798944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.799402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.812928 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] HTTP exception thrown: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Request method failure captured: Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e HTTP/1.1 Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPII7OyVr0PBYqzxVQOX42WRNXy3EkgdOq2Fbda-ck2tk1LzDYpt9hqfsgFzM0FqrPAcK6DJD2k5gpwJFiBjBnOGteZ049OqCFeKMZFS39mVIJGrpdKNsEAqLYTclQvV3WVE99keIPzqeQ5QfyJaZlqZYlrhGdm6I_JX2HHqeGEaXrnE Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 61a2d600c2b6438e85a998d55de7d099 Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-1220710729 Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61a2d600c2b6438e85a998d55de7d099"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61a2d600c2b6438e85a998d55de7d099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61a2d600c2b6438e85a998d55de7d099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61a2d600c2b6438e85a998d55de7d099"}]}] Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-1220710729 Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 61a2d600c2b6438e85a998d55de7d099 Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-1220710729 Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-1220710729-project Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 3ada01b0c4a74fabbc3e74b94d1585a5 Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-1220710729-project Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'bc3444a5-3a07-4f76-a75c-6921e951ad6e'} Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:58.814580 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.819242 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:58.819242 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:58.819242 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:58.819242 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:58.819242 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:58.819242 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.819242 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.819242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Returning 404 to user: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:58.819242 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb27d667-bbd1-4826-a485-3ede67efda37 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 404 len: 111 microversion: 2.1 time: 0.030761 Oct 04 18:58:58.819242 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3565/7125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:58 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:58:58.830552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:58.831195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:58.838538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.839062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.839510 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.840272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.840687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.841125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.854887 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] HTTP exception thrown: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Request method failure captured: Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e HTTP/1.1 Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPII7OyVr0PBYqzxVQOX42WRNXy3EkgdOq2Fbda-ck2tk1LzDYpt9hqfsgFzM0FqrPAcK6DJD2k5gpwJFiBjBnOGteZ049OqCFeKMZFS39mVIJGrpdKNsEAqLYTclQvV3WVE99keIPzqeQ5QfyJaZlqZYlrhGdm6I_JX2HHqeGEaXrnE Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 61a2d600c2b6438e85a998d55de7d099 Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-DeleteServersTestJSON-1220710729 Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61a2d600c2b6438e85a998d55de7d099"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61a2d600c2b6438e85a998d55de7d099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61a2d600c2b6438e85a998d55de7d099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61a2d600c2b6438e85a998d55de7d099"}]}] Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-DeleteServersTestJSON-1220710729 Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 61a2d600c2b6438e85a998d55de7d099 Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-DeleteServersTestJSON-1220710729 Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-DeleteServersTestJSON-1220710729-project Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 3ada01b0c4a74fabbc3e74b94d1585a5 Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-DeleteServersTestJSON-1220710729-project Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'bc3444a5-3a07-4f76-a75c-6921e951ad6e'} Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:58:58.856564 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Returning 404 to user: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1b2933a2-0e58-4291-97d7-ab203b7aa760 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 404 len: 111 microversion: 2.1 time: 0.031679 Oct 04 18:58:58.860741 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3561/7126] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 18:58:58 2022] DELETE /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:58:58.866969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:58.867604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] [instance: bc3444a5-3a07-4f76-a75c-6921e951ad6e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:58.873575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.874065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.874506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.875267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.875731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.876162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.893011 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] HTTP exception thrown: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Request method failure captured: Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e HTTP/1.1 Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPII7OyVr0PBYqzxVQOX42WRNXy3EkgdOq2Fbda-ck2tk1LzDYpt9hqfsgFzM0FqrPAcK6DJD2k5gpwJFiBjBnOGteZ049OqCFeKMZFS39mVIJGrpdKNsEAqLYTclQvV3WVE99keIPzqeQ5QfyJaZlqZYlrhGdm6I_JX2HHqeGEaXrnE Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 61a2d600c2b6438e85a998d55de7d099 Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-DeleteServersTestJSON-1220710729 Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61a2d600c2b6438e85a998d55de7d099"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61a2d600c2b6438e85a998d55de7d099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61a2d600c2b6438e85a998d55de7d099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61a2d600c2b6438e85a998d55de7d099"}]}] Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-DeleteServersTestJSON-1220710729 Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 61a2d600c2b6438e85a998d55de7d099 Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-DeleteServersTestJSON-1220710729 Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-DeleteServersTestJSON-1220710729-project Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 3ada01b0c4a74fabbc3e74b94d1585a5 Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-DeleteServersTestJSON-1220710729-project Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'bc3444a5-3a07-4f76-a75c-6921e951ad6e'} Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:58:58.894539 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.899167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:58:58.899167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:58:58.899167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:58:58.899167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:58:58.899167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:58:58.899167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. Oct 04 18:58:58.899167 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 18:58:58.899167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] Returning 404 to user: Instance bc3444a5-3a07-4f76-a75c-6921e951ad6e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:58:58.899167 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2495a169-2bd8-434f-91af-6c92e19e01a9 tempest-DeleteServersTestJSON-1220710729 tempest-DeleteServersTestJSON-1220710729-project] 10.222.0.18 "GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e" status: 404 len: 111 microversion: 2.1 time: 0.033189 Oct 04 18:58:58.899167 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3566/7127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:58 2022] GET /compute/v2.1/servers/bc3444a5-3a07-4f76-a75c-6921e951ad6e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:59:07.934173 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-781864078", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "1d04c3e9-67a8-465e-8439-c72d95e63573"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:08.137136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] validate_networks() for [('1d04c3e9-67a8-465e-8439-c72d95e63573', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:59:08.554119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:59:08.554765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:59:08.556280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:59:08.556525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:59:08.557094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:59:08.567019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:08.567680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:08.568264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:08.569149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:08.569699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:08.570228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:08.589207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Getting quotas for project 82efffb87700428bb359d0145e1640a2. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:08.594745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Getting quotas for user deb2a3dfa0f04eeaab3fdcfeea6b64b4 and project 82efffb87700428bb359d0145e1640a2. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:08.608273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:59:08.610735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:59:08.659452 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-204dda3d-c179-44f6-ab80-8cf0f5405991 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877111 Oct 04 18:59:08.660299 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3562/7128] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 18:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:59:08.672383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45be95b1-811e-4165-9b6d-c57c43760807 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:08.673011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-45be95b1-811e-4165-9b6d-c57c43760807 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:08.844932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-45be95b1-811e-4165-9b6d-c57c43760807 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:08.853887 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-45be95b1-811e-4165-9b6d-c57c43760807 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1217 microversion: 2.1 time: 0.185248 Oct 04 18:59:08.854749 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3567/7129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:08 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:09.878429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a9dcf0f-83d6-413b-8059-6136969ff833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:09.880450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3a9dcf0f-83d6-413b-8059-6136969ff833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:09.889867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a9dcf0f-83d6-413b-8059-6136969ff833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:09.890394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a9dcf0f-83d6-413b-8059-6136969ff833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:09.890850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a9dcf0f-83d6-413b-8059-6136969ff833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:09.891735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a9dcf0f-83d6-413b-8059-6136969ff833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:09.892211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a9dcf0f-83d6-413b-8059-6136969ff833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:09.892654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a9dcf0f-83d6-413b-8059-6136969ff833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:09.896436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:10.013353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3a9dcf0f-83d6-413b-8059-6136969ff833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:10.026757 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a9dcf0f-83d6-413b-8059-6136969ff833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1277 microversion: 2.1 time: 0.153484 Oct 04 18:59:10.028969 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3563/7130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:09 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:11.056100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f81eff09-29db-4e73-923e-bd6bd917e063 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:11.057464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f81eff09-29db-4e73-923e-bd6bd917e063 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:11.060953 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=57 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:11.068710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f81eff09-29db-4e73-923e-bd6bd917e063 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:11.069316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f81eff09-29db-4e73-923e-bd6bd917e063 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:11.070132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f81eff09-29db-4e73-923e-bd6bd917e063 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:11.071431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f81eff09-29db-4e73-923e-bd6bd917e063 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:11.072168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f81eff09-29db-4e73-923e-bd6bd917e063 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:11.073095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f81eff09-29db-4e73-923e-bd6bd917e063 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:11.252620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f81eff09-29db-4e73-923e-bd6bd917e063 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:11.261240 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f81eff09-29db-4e73-923e-bd6bd917e063 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.210423 Oct 04 18:59:11.262356 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3568/7131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:11 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:11.500942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-eee33a54-9225-4e38-b7e2-7ba4577e8981 req-594c442d-7c08-49fc-a30e-2fef04181d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "681fe84d-f07c-483d-b6d0-d012e456c3ad", "tag": "4c6125b2-18e7-43c2-ae9f-28da52c6c88c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:11.521145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eee33a54-9225-4e38-b7e2-7ba4577e8981 req-594c442d-7c08-49fc-a30e-2fef04181d90 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:11.521744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eee33a54-9225-4e38-b7e2-7ba4577e8981 req-594c442d-7c08-49fc-a30e-2fef04181d90 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:11.522254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eee33a54-9225-4e38-b7e2-7ba4577e8981 req-594c442d-7c08-49fc-a30e-2fef04181d90 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:11.538460 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-eee33a54-9225-4e38-b7e2-7ba4577e8981 req-594c442d-7c08-49fc-a30e-2fef04181d90 service nova] Creating event network-changed:4c6125b2-18e7-43c2-ae9f-28da52c6c88c for instance 681fe84d-f07c-483d-b6d0-d012e456c3ad on n-h2-850499-14 Oct 04 18:59:11.545097 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-eee33a54-9225-4e38-b7e2-7ba4577e8981 req-594c442d-7c08-49fc-a30e-2fef04181d90 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054780 Oct 04 18:59:11.546386 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3564/7132] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:12.285820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6899a185-d592-4f98-9877-fa9388397b2d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:12.286425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6899a185-d592-4f98-9877-fa9388397b2d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:12.293666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6899a185-d592-4f98-9877-fa9388397b2d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:12.294155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6899a185-d592-4f98-9877-fa9388397b2d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:12.294597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6899a185-d592-4f98-9877-fa9388397b2d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:12.295475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6899a185-d592-4f98-9877-fa9388397b2d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:12.295939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6899a185-d592-4f98-9877-fa9388397b2d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:12.296372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6899a185-d592-4f98-9877-fa9388397b2d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:12.430180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6899a185-d592-4f98-9877-fa9388397b2d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:12.439796 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6899a185-d592-4f98-9877-fa9388397b2d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.157652 Oct 04 18:59:12.440401 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3569/7133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:12 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:13.465042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ee5c797-36d4-4dac-8e50-96db21c4a7c6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:13.465773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6ee5c797-36d4-4dac-8e50-96db21c4a7c6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:13.473177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee5c797-36d4-4dac-8e50-96db21c4a7c6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:13.473682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee5c797-36d4-4dac-8e50-96db21c4a7c6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:13.474163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee5c797-36d4-4dac-8e50-96db21c4a7c6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:13.474882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee5c797-36d4-4dac-8e50-96db21c4a7c6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:13.475380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee5c797-36d4-4dac-8e50-96db21c4a7c6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:13.475850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ee5c797-36d4-4dac-8e50-96db21c4a7c6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:13.613941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ee5c797-36d4-4dac-8e50-96db21c4a7c6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:13.622539 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ee5c797-36d4-4dac-8e50-96db21c4a7c6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.162455 Oct 04 18:59:13.623198 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3565/7134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:13 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:14.645962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67cae6a4-c6cf-4dfa-8335-d98591e897ac tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:14.646530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67cae6a4-c6cf-4dfa-8335-d98591e897ac tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:14.649294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=30 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:14.655189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67cae6a4-c6cf-4dfa-8335-d98591e897ac tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:14.655706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67cae6a4-c6cf-4dfa-8335-d98591e897ac tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:14.656134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67cae6a4-c6cf-4dfa-8335-d98591e897ac tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:14.656900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67cae6a4-c6cf-4dfa-8335-d98591e897ac tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:14.657340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67cae6a4-c6cf-4dfa-8335-d98591e897ac tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:14.657771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67cae6a4-c6cf-4dfa-8335-d98591e897ac tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:14.801714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-67cae6a4-c6cf-4dfa-8335-d98591e897ac tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:14.809915 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67cae6a4-c6cf-4dfa-8335-d98591e897ac tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.168100 Oct 04 18:59:14.810530 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3570/7135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:14 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:15.834897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-11764a61-7dff-4946-9f78-e378e94eaae9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:15.835508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-11764a61-7dff-4946-9f78-e378e94eaae9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:15.838328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:15.843835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11764a61-7dff-4946-9f78-e378e94eaae9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:15.844340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11764a61-7dff-4946-9f78-e378e94eaae9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:15.844798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11764a61-7dff-4946-9f78-e378e94eaae9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:15.845523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11764a61-7dff-4946-9f78-e378e94eaae9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:15.845996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11764a61-7dff-4946-9f78-e378e94eaae9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:15.846548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11764a61-7dff-4946-9f78-e378e94eaae9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:15.994924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-11764a61-7dff-4946-9f78-e378e94eaae9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:16.003868 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-11764a61-7dff-4946-9f78-e378e94eaae9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.172799 Oct 04 18:59:16.004460 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3566/7136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:15 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:17.028983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5bf9124b-824f-47d4-ad1e-207bf755fe80 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:17.029527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5bf9124b-824f-47d4-ad1e-207bf755fe80 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:17.036568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bf9124b-824f-47d4-ad1e-207bf755fe80 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:17.037069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bf9124b-824f-47d4-ad1e-207bf755fe80 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:17.037552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bf9124b-824f-47d4-ad1e-207bf755fe80 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:17.038263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bf9124b-824f-47d4-ad1e-207bf755fe80 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:17.038728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bf9124b-824f-47d4-ad1e-207bf755fe80 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:17.039200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5bf9124b-824f-47d4-ad1e-207bf755fe80 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:17.178659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5bf9124b-824f-47d4-ad1e-207bf755fe80 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:17.187255 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5bf9124b-824f-47d4-ad1e-207bf755fe80 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.162193 Oct 04 18:59:17.187835 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3571/7137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:17 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:18.211019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ba0b3e1-9c7c-4271-a7ae-009316982c36 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:18.211654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3ba0b3e1-9c7c-4271-a7ae-009316982c36 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:18.218741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ba0b3e1-9c7c-4271-a7ae-009316982c36 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:18.219284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ba0b3e1-9c7c-4271-a7ae-009316982c36 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:18.219742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ba0b3e1-9c7c-4271-a7ae-009316982c36 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:18.220462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ba0b3e1-9c7c-4271-a7ae-009316982c36 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:18.220938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ba0b3e1-9c7c-4271-a7ae-009316982c36 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:18.221386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ba0b3e1-9c7c-4271-a7ae-009316982c36 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:18.353338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3ba0b3e1-9c7c-4271-a7ae-009316982c36 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:18.361082 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ba0b3e1-9c7c-4271-a7ae-009316982c36 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.154056 Oct 04 18:59:18.361652 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3567/7138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:18 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:18.649229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-60d48e24-85ea-4f83-aa64-b9088684815d req-3deb2e9e-a7fc-4cb2-95b3-619d68746ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "681fe84d-f07c-483d-b6d0-d012e456c3ad", "name": "network-vif-plugged", "status": "completed", "tag": "4c6125b2-18e7-43c2-ae9f-28da52c6c88c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:18.660759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-60d48e24-85ea-4f83-aa64-b9088684815d req-3deb2e9e-a7fc-4cb2-95b3-619d68746ee9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:18.660759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-60d48e24-85ea-4f83-aa64-b9088684815d req-3deb2e9e-a7fc-4cb2-95b3-619d68746ee9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:18.661155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-60d48e24-85ea-4f83-aa64-b9088684815d req-3deb2e9e-a7fc-4cb2-95b3-619d68746ee9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:18.673194 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-60d48e24-85ea-4f83-aa64-b9088684815d req-3deb2e9e-a7fc-4cb2-95b3-619d68746ee9 service nova] Creating event network-vif-plugged:4c6125b2-18e7-43c2-ae9f-28da52c6c88c for instance 681fe84d-f07c-483d-b6d0-d012e456c3ad on n-h2-850499-14 Oct 04 18:59:18.678337 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-60d48e24-85ea-4f83-aa64-b9088684815d req-3deb2e9e-a7fc-4cb2-95b3-619d68746ee9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 Oct 04 18:59:18.679135 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3572/7139] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:19.383823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5bffe9bf-528f-4460-b025-ecc77df29f42 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:19.384366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5bffe9bf-528f-4460-b025-ecc77df29f42 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:19.386210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:19.387326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:19.400168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bffe9bf-528f-4460-b025-ecc77df29f42 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:19.400683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bffe9bf-528f-4460-b025-ecc77df29f42 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:19.401135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bffe9bf-528f-4460-b025-ecc77df29f42 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:19.401858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bffe9bf-528f-4460-b025-ecc77df29f42 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:19.402334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bffe9bf-528f-4460-b025-ecc77df29f42 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:19.402776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5bffe9bf-528f-4460-b025-ecc77df29f42 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:19.546022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5bffe9bf-528f-4460-b025-ecc77df29f42 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:19.553824 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5bffe9bf-528f-4460-b025-ecc77df29f42 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.173988 Oct 04 18:59:19.554419 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3568/7140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:19 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:20.575643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:20.581753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-53f01d80-1e3f-4f5a-9853-99bb55e84b54 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:20.582469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-53f01d80-1e3f-4f5a-9853-99bb55e84b54 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:20.589099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53f01d80-1e3f-4f5a-9853-99bb55e84b54 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:20.589590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53f01d80-1e3f-4f5a-9853-99bb55e84b54 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:20.590036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53f01d80-1e3f-4f5a-9853-99bb55e84b54 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:20.590741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53f01d80-1e3f-4f5a-9853-99bb55e84b54 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:20.591237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53f01d80-1e3f-4f5a-9853-99bb55e84b54 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:20.591668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-53f01d80-1e3f-4f5a-9853-99bb55e84b54 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:20.728374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-53f01d80-1e3f-4f5a-9853-99bb55e84b54 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:20.739856 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-53f01d80-1e3f-4f5a-9853-99bb55e84b54 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1507 microversion: 2.1 time: 0.164920 Oct 04 18:59:20.740668 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3573/7141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:20 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:20.771478 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ed6d1d9-0d1f-4184-9985-80b8a657467f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:20.772112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ed6d1d9-0d1f-4184-9985-80b8a657467f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:20.779093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed6d1d9-0d1f-4184-9985-80b8a657467f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:20.779599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed6d1d9-0d1f-4184-9985-80b8a657467f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:20.780057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed6d1d9-0d1f-4184-9985-80b8a657467f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:20.780780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed6d1d9-0d1f-4184-9985-80b8a657467f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:20.781253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed6d1d9-0d1f-4184-9985-80b8a657467f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:20.781696 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ed6d1d9-0d1f-4184-9985-80b8a657467f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:20.922331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ed6d1d9-0d1f-4184-9985-80b8a657467f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:20.930241 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ed6d1d9-0d1f-4184-9985-80b8a657467f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1507 microversion: 2.1 time: 0.162652 Oct 04 18:59:20.930816 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3569/7142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:20 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:20.952514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cd30fe9e-f28f-4539-8520-eb0519a12947 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:20.954893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cd30fe9e-f28f-4539-8520-eb0519a12947 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:20.961950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd30fe9e-f28f-4539-8520-eb0519a12947 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:20.962439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd30fe9e-f28f-4539-8520-eb0519a12947 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:20.962881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd30fe9e-f28f-4539-8520-eb0519a12947 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:20.963627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd30fe9e-f28f-4539-8520-eb0519a12947 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:20.964085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd30fe9e-f28f-4539-8520-eb0519a12947 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:20.964517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cd30fe9e-f28f-4539-8520-eb0519a12947 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.032234 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cd30fe9e-f28f-4539-8520-eb0519a12947 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "PUT /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1079 microversion: 2.1 time: 0.083506 Oct 04 18:59:21.033049 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3574/7143] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 4 18:59:20 2022] PUT /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1079 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:21.052707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7128596e-6a31-4ba4-8c06-a150e8b908df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:21.053352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7128596e-6a31-4ba4-8c06-a150e8b908df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:21.060654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7128596e-6a31-4ba4-8c06-a150e8b908df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:21.061163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7128596e-6a31-4ba4-8c06-a150e8b908df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:21.061618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7128596e-6a31-4ba4-8c06-a150e8b908df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.062333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7128596e-6a31-4ba4-8c06-a150e8b908df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:21.062804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7128596e-6a31-4ba4-8c06-a150e8b908df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:21.063276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7128596e-6a31-4ba4-8c06-a150e8b908df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.196586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7128596e-6a31-4ba4-8c06-a150e8b908df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:21.205110 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7128596e-6a31-4ba4-8c06-a150e8b908df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1505 microversion: 2.1 time: 0.156454 Oct 04 18:59:21.205701 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3570/7144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:21 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:21.227523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b41343b-0426-4444-a18f-e65f0f350cc0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:21.228146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6b41343b-0426-4444-a18f-e65f0f350cc0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:21.234168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b41343b-0426-4444-a18f-e65f0f350cc0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:21.234670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b41343b-0426-4444-a18f-e65f0f350cc0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:21.235151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b41343b-0426-4444-a18f-e65f0f350cc0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.235860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b41343b-0426-4444-a18f-e65f0f350cc0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:21.236329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b41343b-0426-4444-a18f-e65f0f350cc0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:21.236781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b41343b-0426-4444-a18f-e65f0f350cc0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.373327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6b41343b-0426-4444-a18f-e65f0f350cc0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:21.381117 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6b41343b-0426-4444-a18f-e65f0f350cc0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1505 microversion: 2.1 time: 0.157511 Oct 04 18:59:21.381700 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3575/7145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:21 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:21.404121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:21.406455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:21.413480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:21.415160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:21.416520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.418243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:21.419151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:21.419952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.455596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:21.463150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Old instance type m1.heat2, new instance type m1.heat {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:59:21.470095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:59:21.470595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:59:21.471149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:59:21.471561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:59:21.472104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:59:21.539438 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f99f09c2-90e5-4e6a-82c2-fe84cf0d0c6a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "POST /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad/action" status: 202 len: 0 microversion: 2.1 time: 0.139123 Oct 04 18:59:21.540263 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3571/7146] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:59:21 2022] POST /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:59:21.552223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-969b07a8-740e-48d3-a91a-6f51307bad32 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:21.552839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-969b07a8-740e-48d3-a91a-6f51307bad32 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:21.559806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969b07a8-740e-48d3-a91a-6f51307bad32 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:21.560351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969b07a8-740e-48d3-a91a-6f51307bad32 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:21.561242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969b07a8-740e-48d3-a91a-6f51307bad32 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.561670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969b07a8-740e-48d3-a91a-6f51307bad32 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:21.562204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969b07a8-740e-48d3-a91a-6f51307bad32 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:21.562727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-969b07a8-740e-48d3-a91a-6f51307bad32 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:21.731866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-969b07a8-740e-48d3-a91a-6f51307bad32 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:21.739702 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-969b07a8-740e-48d3-a91a-6f51307bad32 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1516 microversion: 2.1 time: 0.191577 Oct 04 18:59:21.740282 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3576/7147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:21 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:22.766069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e13c485c-323a-444e-ac07-0335b8aa4a6c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:22.766866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e13c485c-323a-444e-ac07-0335b8aa4a6c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:22.774395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e13c485c-323a-444e-ac07-0335b8aa4a6c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:22.774905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e13c485c-323a-444e-ac07-0335b8aa4a6c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:22.775389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e13c485c-323a-444e-ac07-0335b8aa4a6c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:22.776108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e13c485c-323a-444e-ac07-0335b8aa4a6c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:22.776586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e13c485c-323a-444e-ac07-0335b8aa4a6c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:22.777034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e13c485c-323a-444e-ac07-0335b8aa4a6c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:22.917738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e13c485c-323a-444e-ac07-0335b8aa4a6c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:22.925707 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e13c485c-323a-444e-ac07-0335b8aa4a6c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1516 microversion: 2.1 time: 0.165598 Oct 04 18:59:22.926297 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3572/7148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:22 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:23.949280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0825f876-ba6e-42aa-92b8-2d2da19bd2da tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:23.949965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0825f876-ba6e-42aa-92b8-2d2da19bd2da tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:23.957065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0825f876-ba6e-42aa-92b8-2d2da19bd2da tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:23.957553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0825f876-ba6e-42aa-92b8-2d2da19bd2da tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:23.958027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0825f876-ba6e-42aa-92b8-2d2da19bd2da tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:23.958698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0825f876-ba6e-42aa-92b8-2d2da19bd2da tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:23.959184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0825f876-ba6e-42aa-92b8-2d2da19bd2da tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:23.959615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0825f876-ba6e-42aa-92b8-2d2da19bd2da tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:24.094301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0825f876-ba6e-42aa-92b8-2d2da19bd2da tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:24.102156 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0825f876-ba6e-42aa-92b8-2d2da19bd2da tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.157637 Oct 04 18:59:24.102704 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3577/7149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:23 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:25.128858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eebcd5e5-6e30-472d-b49c-f731fc37b89d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:25.129819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eebcd5e5-6e30-472d-b49c-f731fc37b89d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:25.137328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eebcd5e5-6e30-472d-b49c-f731fc37b89d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:25.137843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eebcd5e5-6e30-472d-b49c-f731fc37b89d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:25.138329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eebcd5e5-6e30-472d-b49c-f731fc37b89d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:25.139151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eebcd5e5-6e30-472d-b49c-f731fc37b89d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:25.139633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eebcd5e5-6e30-472d-b49c-f731fc37b89d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:25.140108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eebcd5e5-6e30-472d-b49c-f731fc37b89d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:25.286512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eebcd5e5-6e30-472d-b49c-f731fc37b89d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:25.295475 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eebcd5e5-6e30-472d-b49c-f731fc37b89d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.172939 Oct 04 18:59:25.296057 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3573/7150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:25 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:26.321346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-81cb72c2-4112-49e6-b2b9-6240c712b0ae tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:26.322887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-81cb72c2-4112-49e6-b2b9-6240c712b0ae tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:26.329186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81cb72c2-4112-49e6-b2b9-6240c712b0ae tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:26.329667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81cb72c2-4112-49e6-b2b9-6240c712b0ae tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:26.330139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81cb72c2-4112-49e6-b2b9-6240c712b0ae tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:26.330846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81cb72c2-4112-49e6-b2b9-6240c712b0ae tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:26.331333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81cb72c2-4112-49e6-b2b9-6240c712b0ae tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:26.331771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81cb72c2-4112-49e6-b2b9-6240c712b0ae tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:26.468306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-81cb72c2-4112-49e6-b2b9-6240c712b0ae tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:26.476188 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-81cb72c2-4112-49e6-b2b9-6240c712b0ae tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.159222 Oct 04 18:59:26.476767 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3578/7151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:26 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:27.501442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-49211783-df99-446e-a532-8b4a0d4ae8f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:27.502127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-49211783-df99-446e-a532-8b4a0d4ae8f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:27.508773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49211783-df99-446e-a532-8b4a0d4ae8f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:27.509275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49211783-df99-446e-a532-8b4a0d4ae8f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:27.509731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49211783-df99-446e-a532-8b4a0d4ae8f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:27.510438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49211783-df99-446e-a532-8b4a0d4ae8f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:27.510915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49211783-df99-446e-a532-8b4a0d4ae8f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:27.511377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-49211783-df99-446e-a532-8b4a0d4ae8f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:27.643092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-49211783-df99-446e-a532-8b4a0d4ae8f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:27.651237 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-49211783-df99-446e-a532-8b4a0d4ae8f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.153857 Oct 04 18:59:27.651816 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3574/7152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:27 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:28.673969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7aca1535-a70d-44d8-8b94-45858a50c75c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:28.674571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7aca1535-a70d-44d8-8b94-45858a50c75c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:28.681405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aca1535-a70d-44d8-8b94-45858a50c75c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:28.681894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aca1535-a70d-44d8-8b94-45858a50c75c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:28.682331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aca1535-a70d-44d8-8b94-45858a50c75c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:28.683047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aca1535-a70d-44d8-8b94-45858a50c75c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:28.683506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aca1535-a70d-44d8-8b94-45858a50c75c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:28.683930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7aca1535-a70d-44d8-8b94-45858a50c75c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:28.816772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7aca1535-a70d-44d8-8b94-45858a50c75c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:28.825225 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7aca1535-a70d-44d8-8b94-45858a50c75c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.155235 Oct 04 18:59:28.825790 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3579/7153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:28 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:29.848968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d2dbd24-8601-45ec-9250-134584ab94d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:29.849616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d2dbd24-8601-45ec-9250-134584ab94d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:29.857382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2dbd24-8601-45ec-9250-134584ab94d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:29.857894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2dbd24-8601-45ec-9250-134584ab94d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:29.858357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2dbd24-8601-45ec-9250-134584ab94d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:29.859123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2dbd24-8601-45ec-9250-134584ab94d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:29.859604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2dbd24-8601-45ec-9250-134584ab94d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:29.860053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d2dbd24-8601-45ec-9250-134584ab94d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:29.990323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d2dbd24-8601-45ec-9250-134584ab94d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:29.998068 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d2dbd24-8601-45ec-9250-134584ab94d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.153167 Oct 04 18:59:29.998636 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3575/7154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:29 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:31.020489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-757c2341-f47a-4bb5-93ec-320a1f086d3d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:31.021101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-757c2341-f47a-4bb5-93ec-320a1f086d3d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:31.028835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-757c2341-f47a-4bb5-93ec-320a1f086d3d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:31.029322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-757c2341-f47a-4bb5-93ec-320a1f086d3d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:31.029761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-757c2341-f47a-4bb5-93ec-320a1f086d3d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:31.030452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-757c2341-f47a-4bb5-93ec-320a1f086d3d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:31.030907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-757c2341-f47a-4bb5-93ec-320a1f086d3d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:31.031360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-757c2341-f47a-4bb5-93ec-320a1f086d3d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:31.164278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-757c2341-f47a-4bb5-93ec-320a1f086d3d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:31.172066 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-757c2341-f47a-4bb5-93ec-320a1f086d3d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.155519 Oct 04 18:59:31.172640 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3580/7155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:31 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:32.195163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6ce3b0a4-d546-49cc-9ef3-4d94c7a719b1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:32.195805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6ce3b0a4-d546-49cc-9ef3-4d94c7a719b1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:32.203635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ce3b0a4-d546-49cc-9ef3-4d94c7a719b1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:32.204137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ce3b0a4-d546-49cc-9ef3-4d94c7a719b1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:32.204593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ce3b0a4-d546-49cc-9ef3-4d94c7a719b1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:32.205326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ce3b0a4-d546-49cc-9ef3-4d94c7a719b1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:32.205840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ce3b0a4-d546-49cc-9ef3-4d94c7a719b1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:32.206282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6ce3b0a4-d546-49cc-9ef3-4d94c7a719b1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:32.345077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6ce3b0a4-d546-49cc-9ef3-4d94c7a719b1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:32.352927 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6ce3b0a4-d546-49cc-9ef3-4d94c7a719b1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.161789 Oct 04 18:59:32.354027 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3576/7156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:32 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:33.377452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f2b1915f-6c3c-42ba-8c63-701409a3618e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:33.378072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f2b1915f-6c3c-42ba-8c63-701409a3618e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:33.385724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2b1915f-6c3c-42ba-8c63-701409a3618e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:33.386222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2b1915f-6c3c-42ba-8c63-701409a3618e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:33.386669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2b1915f-6c3c-42ba-8c63-701409a3618e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:33.387416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2b1915f-6c3c-42ba-8c63-701409a3618e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:33.387882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2b1915f-6c3c-42ba-8c63-701409a3618e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:33.388347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f2b1915f-6c3c-42ba-8c63-701409a3618e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:33.526559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f2b1915f-6c3c-42ba-8c63-701409a3618e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:33.534645 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f2b1915f-6c3c-42ba-8c63-701409a3618e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.161058 Oct 04 18:59:33.535281 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3581/7157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:33 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:34.558348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f06d66ae-a6ef-4e88-99ef-f0faff55f596 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:34.559065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f06d66ae-a6ef-4e88-99ef-f0faff55f596 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:34.566033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06d66ae-a6ef-4e88-99ef-f0faff55f596 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:34.566533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06d66ae-a6ef-4e88-99ef-f0faff55f596 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:34.567010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06d66ae-a6ef-4e88-99ef-f0faff55f596 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:34.567724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06d66ae-a6ef-4e88-99ef-f0faff55f596 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:34.568191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06d66ae-a6ef-4e88-99ef-f0faff55f596 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:34.568625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f06d66ae-a6ef-4e88-99ef-f0faff55f596 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:34.700604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f06d66ae-a6ef-4e88-99ef-f0faff55f596 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:34.708400 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f06d66ae-a6ef-4e88-99ef-f0faff55f596 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.154499 Oct 04 18:59:34.708982 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3577/7158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:34 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:35.732106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9ab56ba4-bbd9-44cb-8338-689db2f2971b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:35.732826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9ab56ba4-bbd9-44cb-8338-689db2f2971b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:35.739891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ab56ba4-bbd9-44cb-8338-689db2f2971b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:35.740390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ab56ba4-bbd9-44cb-8338-689db2f2971b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:35.740839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ab56ba4-bbd9-44cb-8338-689db2f2971b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:35.741545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ab56ba4-bbd9-44cb-8338-689db2f2971b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:35.742010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ab56ba4-bbd9-44cb-8338-689db2f2971b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:35.742444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ab56ba4-bbd9-44cb-8338-689db2f2971b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:35.879185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9ab56ba4-bbd9-44cb-8338-689db2f2971b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:35.887878 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9ab56ba4-bbd9-44cb-8338-689db2f2971b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.159683 Oct 04 18:59:35.888461 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3582/7159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:35 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:36.912020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17d564f4-2fd8-4fc2-8d56-fb67128e1371 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:36.912684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17d564f4-2fd8-4fc2-8d56-fb67128e1371 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:36.919864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17d564f4-2fd8-4fc2-8d56-fb67128e1371 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:36.920418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17d564f4-2fd8-4fc2-8d56-fb67128e1371 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:36.920937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17d564f4-2fd8-4fc2-8d56-fb67128e1371 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:36.921692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17d564f4-2fd8-4fc2-8d56-fb67128e1371 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:36.922163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17d564f4-2fd8-4fc2-8d56-fb67128e1371 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:36.922602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17d564f4-2fd8-4fc2-8d56-fb67128e1371 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:37.056951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17d564f4-2fd8-4fc2-8d56-fb67128e1371 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:37.065272 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17d564f4-2fd8-4fc2-8d56-fb67128e1371 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.157268 Oct 04 18:59:37.065904 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3578/7160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:36 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:38.090584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4abf6354-dad9-4a5a-9ea5-145c1526d08e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:38.091233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4abf6354-dad9-4a5a-9ea5-145c1526d08e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:38.097446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4abf6354-dad9-4a5a-9ea5-145c1526d08e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:38.097936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4abf6354-dad9-4a5a-9ea5-145c1526d08e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:38.098381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4abf6354-dad9-4a5a-9ea5-145c1526d08e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:38.099117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4abf6354-dad9-4a5a-9ea5-145c1526d08e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:38.099584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4abf6354-dad9-4a5a-9ea5-145c1526d08e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:38.100015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4abf6354-dad9-4a5a-9ea5-145c1526d08e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:38.227971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4abf6354-dad9-4a5a-9ea5-145c1526d08e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:38.236515 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4abf6354-dad9-4a5a-9ea5-145c1526d08e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.151262 Oct 04 18:59:38.237092 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3583/7161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:38 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:39.260493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1a6def13-4778-4778-86e4-f1c28b8b3344 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:39.261116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1a6def13-4778-4778-86e4-f1c28b8b3344 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:39.268022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a6def13-4778-4778-86e4-f1c28b8b3344 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:39.268521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a6def13-4778-4778-86e4-f1c28b8b3344 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:39.268972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a6def13-4778-4778-86e4-f1c28b8b3344 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:39.269673 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a6def13-4778-4778-86e4-f1c28b8b3344 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:39.270143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a6def13-4778-4778-86e4-f1c28b8b3344 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:39.270580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a6def13-4778-4778-86e4-f1c28b8b3344 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:39.273177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:39.409757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1a6def13-4778-4778-86e4-f1c28b8b3344 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:39.418065 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1a6def13-4778-4778-86e4-f1c28b8b3344 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.161602 Oct 04 18:59:39.418650 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3579/7162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:39 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:40.443607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-04296abd-7b12-4028-bc51-9eab06e3936d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:40.444247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-04296abd-7b12-4028-bc51-9eab06e3936d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:40.452221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04296abd-7b12-4028-bc51-9eab06e3936d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:40.452703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04296abd-7b12-4028-bc51-9eab06e3936d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:40.453690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04296abd-7b12-4028-bc51-9eab06e3936d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:40.453833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04296abd-7b12-4028-bc51-9eab06e3936d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:40.454282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04296abd-7b12-4028-bc51-9eab06e3936d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:40.454706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-04296abd-7b12-4028-bc51-9eab06e3936d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:40.474021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:40.593046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-04296abd-7b12-4028-bc51-9eab06e3936d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:40.601076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-04296abd-7b12-4028-bc51-9eab06e3936d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.161601 Oct 04 18:59:40.601651 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3584/7163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:40 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:41.624339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-77d66da2-f36f-44cd-9f77-ceb25a8a1477 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:41.624968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-77d66da2-f36f-44cd-9f77-ceb25a8a1477 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:41.631998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77d66da2-f36f-44cd-9f77-ceb25a8a1477 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:41.632494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77d66da2-f36f-44cd-9f77-ceb25a8a1477 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:41.632947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77d66da2-f36f-44cd-9f77-ceb25a8a1477 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:41.633651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77d66da2-f36f-44cd-9f77-ceb25a8a1477 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:41.634120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77d66da2-f36f-44cd-9f77-ceb25a8a1477 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:41.634559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-77d66da2-f36f-44cd-9f77-ceb25a8a1477 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:41.767247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-77d66da2-f36f-44cd-9f77-ceb25a8a1477 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:41.775043 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-77d66da2-f36f-44cd-9f77-ceb25a8a1477 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.155100 Oct 04 18:59:41.775619 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3580/7164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:41 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:42.798100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-32c52ff0-3ec9-414f-8791-41504cb5b833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:42.798643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-32c52ff0-3ec9-414f-8791-41504cb5b833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:42.805790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c52ff0-3ec9-414f-8791-41504cb5b833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:42.806286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c52ff0-3ec9-414f-8791-41504cb5b833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:42.806794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c52ff0-3ec9-414f-8791-41504cb5b833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.807488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c52ff0-3ec9-414f-8791-41504cb5b833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:42.807929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c52ff0-3ec9-414f-8791-41504cb5b833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:42.808364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-32c52ff0-3ec9-414f-8791-41504cb5b833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.936106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-32c52ff0-3ec9-414f-8791-41504cb5b833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:42.943776 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-32c52ff0-3ec9-414f-8791-41504cb5b833 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.149641 Oct 04 18:59:42.944365 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3585/7165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:42 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:43.968515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e4550734-0672-42d7-850d-1158b10ae2c5 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:43.969249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e4550734-0672-42d7-850d-1158b10ae2c5 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:43.976907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4550734-0672-42d7-850d-1158b10ae2c5 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:43.977421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4550734-0672-42d7-850d-1158b10ae2c5 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:43.977887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4550734-0672-42d7-850d-1158b10ae2c5 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:43.978630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4550734-0672-42d7-850d-1158b10ae2c5 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:43.979151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4550734-0672-42d7-850d-1158b10ae2c5 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:43.980370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e4550734-0672-42d7-850d-1158b10ae2c5 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.116678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e4550734-0672-42d7-850d-1158b10ae2c5 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:44.124801 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e4550734-0672-42d7-850d-1158b10ae2c5 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.160754 Oct 04 18:59:44.125356 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3581/7166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:43 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:45.149005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c0cd524f-7f22-411f-9bfd-ae3e2052f167 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:45.149661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c0cd524f-7f22-411f-9bfd-ae3e2052f167 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:45.152429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=32 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:45.157710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0cd524f-7f22-411f-9bfd-ae3e2052f167 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:45.158193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0cd524f-7f22-411f-9bfd-ae3e2052f167 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:45.158637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0cd524f-7f22-411f-9bfd-ae3e2052f167 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:45.159352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0cd524f-7f22-411f-9bfd-ae3e2052f167 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:45.159809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0cd524f-7f22-411f-9bfd-ae3e2052f167 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:45.160232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0cd524f-7f22-411f-9bfd-ae3e2052f167 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:45.299596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c0cd524f-7f22-411f-9bfd-ae3e2052f167 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:45.307509 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c0cd524f-7f22-411f-9bfd-ae3e2052f167 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.162506 Oct 04 18:59:45.308645 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3586/7167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:45 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:46.332609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1a689b71-b047-4637-b8bc-ff4e45dadab2 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:46.333256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1a689b71-b047-4637-b8bc-ff4e45dadab2 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:46.336062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=36 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:46.342128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a689b71-b047-4637-b8bc-ff4e45dadab2 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.342646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a689b71-b047-4637-b8bc-ff4e45dadab2 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.343160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a689b71-b047-4637-b8bc-ff4e45dadab2 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.343902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a689b71-b047-4637-b8bc-ff4e45dadab2 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.344386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a689b71-b047-4637-b8bc-ff4e45dadab2 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.344833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a689b71-b047-4637-b8bc-ff4e45dadab2 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.487307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1a689b71-b047-4637-b8bc-ff4e45dadab2 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:46.495607 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1a689b71-b047-4637-b8bc-ff4e45dadab2 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.166849 Oct 04 18:59:46.496188 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3582/7168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:46 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:47.519467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-665e6b8b-ebaf-4e53-9a86-1517b5c85f48 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:47.520120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-665e6b8b-ebaf-4e53-9a86-1517b5c85f48 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:47.527644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-665e6b8b-ebaf-4e53-9a86-1517b5c85f48 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:47.528140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-665e6b8b-ebaf-4e53-9a86-1517b5c85f48 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.528590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-665e6b8b-ebaf-4e53-9a86-1517b5c85f48 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:47.529296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-665e6b8b-ebaf-4e53-9a86-1517b5c85f48 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:47.529760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-665e6b8b-ebaf-4e53-9a86-1517b5c85f48 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.530198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-665e6b8b-ebaf-4e53-9a86-1517b5c85f48 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:47.665459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-665e6b8b-ebaf-4e53-9a86-1517b5c85f48 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:47.674048 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-665e6b8b-ebaf-4e53-9a86-1517b5c85f48 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.158459 Oct 04 18:59:47.674618 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3587/7169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:47 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:48.697921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c816104a-0422-49bf-bb06-42f8492c79d0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:48.698493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c816104a-0422-49bf-bb06-42f8492c79d0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:48.705408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c816104a-0422-49bf-bb06-42f8492c79d0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.705922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c816104a-0422-49bf-bb06-42f8492c79d0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.706383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c816104a-0422-49bf-bb06-42f8492c79d0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.707134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c816104a-0422-49bf-bb06-42f8492c79d0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.707608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c816104a-0422-49bf-bb06-42f8492c79d0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.708051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c816104a-0422-49bf-bb06-42f8492c79d0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.844482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c816104a-0422-49bf-bb06-42f8492c79d0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:48.852328 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c816104a-0422-49bf-bb06-42f8492c79d0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.158852 Oct 04 18:59:48.852921 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3583/7170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:48 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:49.876540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f58afd1c-eab6-48fa-a960-6c1e051f5400 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:49.877159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f58afd1c-eab6-48fa-a960-6c1e051f5400 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:49.884037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f58afd1c-eab6-48fa-a960-6c1e051f5400 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.884531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f58afd1c-eab6-48fa-a960-6c1e051f5400 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.884974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f58afd1c-eab6-48fa-a960-6c1e051f5400 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.886317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f58afd1c-eab6-48fa-a960-6c1e051f5400 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.886779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f58afd1c-eab6-48fa-a960-6c1e051f5400 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.887237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f58afd1c-eab6-48fa-a960-6c1e051f5400 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:50.017461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f58afd1c-eab6-48fa-a960-6c1e051f5400 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:50.025440 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f58afd1c-eab6-48fa-a960-6c1e051f5400 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.152761 Oct 04 18:59:50.026044 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3588/7171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:49 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:51.050214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7283768f-ca87-4fc5-aff9-31627579d123 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:51.050878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7283768f-ca87-4fc5-aff9-31627579d123 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:51.057040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7283768f-ca87-4fc5-aff9-31627579d123 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:51.062460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7283768f-ca87-4fc5-aff9-31627579d123 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:51.063009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7283768f-ca87-4fc5-aff9-31627579d123 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:51.063771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7283768f-ca87-4fc5-aff9-31627579d123 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:51.064307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7283768f-ca87-4fc5-aff9-31627579d123 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:51.064733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7283768f-ca87-4fc5-aff9-31627579d123 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:51.210224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7283768f-ca87-4fc5-aff9-31627579d123 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:51.219923 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7283768f-ca87-4fc5-aff9-31627579d123 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1521 microversion: 2.1 time: 0.174693 Oct 04 18:59:51.220509 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3584/7172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:51 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:52.007533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-dc3b0df4-8f1b-42b4-84fe-05564bb5d407 req-0f1570df-2479-4d61-9881-012b22cef329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "681fe84d-f07c-483d-b6d0-d012e456c3ad", "name": "network-vif-unplugged", "status": "completed", "tag": "4c6125b2-18e7-43c2-ae9f-28da52c6c88c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:52.018409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dc3b0df4-8f1b-42b4-84fe-05564bb5d407 req-0f1570df-2479-4d61-9881-012b22cef329 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.019165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dc3b0df4-8f1b-42b4-84fe-05564bb5d407 req-0f1570df-2479-4d61-9881-012b22cef329 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.019748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dc3b0df4-8f1b-42b4-84fe-05564bb5d407 req-0f1570df-2479-4d61-9881-012b22cef329 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.032445 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-dc3b0df4-8f1b-42b4-84fe-05564bb5d407 req-0f1570df-2479-4d61-9881-012b22cef329 service nova] Creating event network-vif-unplugged:4c6125b2-18e7-43c2-ae9f-28da52c6c88c for instance 681fe84d-f07c-483d-b6d0-d012e456c3ad on n-h1-850499-14 Oct 04 18:59:52.038052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-dc3b0df4-8f1b-42b4-84fe-05564bb5d407 req-0f1570df-2479-4d61-9881-012b22cef329 service nova] Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:59:52.050369 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-dc3b0df4-8f1b-42b4-84fe-05564bb5d407 req-0f1570df-2479-4d61-9881-012b22cef329 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108302 Oct 04 18:59:52.050890 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3589/7173] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:52.244393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40aa064e-5827-4c03-9012-03f70823b8fc tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:52.245297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-40aa064e-5827-4c03-9012-03f70823b8fc tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:52.252578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa064e-5827-4c03-9012-03f70823b8fc tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.253090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa064e-5827-4c03-9012-03f70823b8fc tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.253577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa064e-5827-4c03-9012-03f70823b8fc tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.254298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa064e-5827-4c03-9012-03f70823b8fc tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.254767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa064e-5827-4c03-9012-03f70823b8fc tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.255238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa064e-5827-4c03-9012-03f70823b8fc tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.399392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-40aa064e-5827-4c03-9012-03f70823b8fc tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:52.408386 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40aa064e-5827-4c03-9012-03f70823b8fc tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1520 microversion: 2.1 time: 0.168475 Oct 04 18:59:52.409005 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3585/7174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:52 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:53.434874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d6271cbd-f609-494e-9700-e060bb0d1284 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:53.435614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d6271cbd-f609-494e-9700-e060bb0d1284 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:53.442012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6271cbd-f609-494e-9700-e060bb0d1284 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.442501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6271cbd-f609-494e-9700-e060bb0d1284 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.442935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6271cbd-f609-494e-9700-e060bb0d1284 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.443649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6271cbd-f609-494e-9700-e060bb0d1284 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.444100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6271cbd-f609-494e-9700-e060bb0d1284 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.444525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d6271cbd-f609-494e-9700-e060bb0d1284 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.580492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d6271cbd-f609-494e-9700-e060bb0d1284 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:53.588510 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d6271cbd-f609-494e-9700-e060bb0d1284 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1518 microversion: 2.1 time: 0.159570 Oct 04 18:59:53.589074 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3590/7175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:53 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:54.070867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-db1a43e0-1efc-4199-b1b3-8435857bf9f4 req-87025670-4d06-4dc6-bb7d-1992a1c5b655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "681fe84d-f07c-483d-b6d0-d012e456c3ad", "tag": "4c6125b2-18e7-43c2-ae9f-28da52c6c88c"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:54.081169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db1a43e0-1efc-4199-b1b3-8435857bf9f4 req-87025670-4d06-4dc6-bb7d-1992a1c5b655 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.081670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db1a43e0-1efc-4199-b1b3-8435857bf9f4 req-87025670-4d06-4dc6-bb7d-1992a1c5b655 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.082129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-db1a43e0-1efc-4199-b1b3-8435857bf9f4 req-87025670-4d06-4dc6-bb7d-1992a1c5b655 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.094132 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-db1a43e0-1efc-4199-b1b3-8435857bf9f4 req-87025670-4d06-4dc6-bb7d-1992a1c5b655 service nova] Creating event network-changed:4c6125b2-18e7-43c2-ae9f-28da52c6c88c for instance 681fe84d-f07c-483d-b6d0-d012e456c3ad on n-h1-850499-14 Oct 04 18:59:54.099445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-db1a43e0-1efc-4199-b1b3-8435857bf9f4 req-87025670-4d06-4dc6-bb7d-1992a1c5b655 service nova] Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:59:54.111007 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-db1a43e0-1efc-4199-b1b3-8435857bf9f4 req-87025670-4d06-4dc6-bb7d-1992a1c5b655 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044002 Oct 04 18:59:54.111628 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3586/7176] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:54.612227 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-76098c98-fa10-42ce-8c2c-c1fc6b98255c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:54.613204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-76098c98-fa10-42ce-8c2c-c1fc6b98255c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:54.620039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76098c98-fa10-42ce-8c2c-c1fc6b98255c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.620853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76098c98-fa10-42ce-8c2c-c1fc6b98255c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.621253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76098c98-fa10-42ce-8c2c-c1fc6b98255c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.621650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76098c98-fa10-42ce-8c2c-c1fc6b98255c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.622106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76098c98-fa10-42ce-8c2c-c1fc6b98255c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.622533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-76098c98-fa10-42ce-8c2c-c1fc6b98255c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.788882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-76098c98-fa10-42ce-8c2c-c1fc6b98255c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:54.797487 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-76098c98-fa10-42ce-8c2c-c1fc6b98255c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1518 microversion: 2.1 time: 0.189333 Oct 04 18:59:54.798079 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3591/7177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:54 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:55.823689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-03acdfb7-0fa3-4b93-b20d-d6f0426393df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:55.824338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-03acdfb7-0fa3-4b93-b20d-d6f0426393df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:55.830543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03acdfb7-0fa3-4b93-b20d-d6f0426393df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.831097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03acdfb7-0fa3-4b93-b20d-d6f0426393df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.831547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03acdfb7-0fa3-4b93-b20d-d6f0426393df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.832260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03acdfb7-0fa3-4b93-b20d-d6f0426393df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.832742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03acdfb7-0fa3-4b93-b20d-d6f0426393df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.833197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-03acdfb7-0fa3-4b93-b20d-d6f0426393df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.969271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-03acdfb7-0fa3-4b93-b20d-d6f0426393df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:55.977173 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-03acdfb7-0fa3-4b93-b20d-d6f0426393df tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1515 microversion: 2.1 time: 0.159616 Oct 04 18:59:55.977759 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3587/7178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:55 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:56.000501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3adcc2f6-bc4e-40cc-ba2a-92eaaab99861 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:56.001032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3adcc2f6-bc4e-40cc-ba2a-92eaaab99861 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:56.007900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3adcc2f6-bc4e-40cc-ba2a-92eaaab99861 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.008395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3adcc2f6-bc4e-40cc-ba2a-92eaaab99861 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.008843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3adcc2f6-bc4e-40cc-ba2a-92eaaab99861 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.009550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3adcc2f6-bc4e-40cc-ba2a-92eaaab99861 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.010017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3adcc2f6-bc4e-40cc-ba2a-92eaaab99861 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.010453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3adcc2f6-bc4e-40cc-ba2a-92eaaab99861 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.069835 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3adcc2f6-bc4e-40cc-ba2a-92eaaab99861 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "POST /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad/action" status: 204 len: 0 microversion: 2.1 time: 0.072793 Oct 04 18:59:56.070491 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3592/7179] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 18:59:55 2022] POST /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:59:56.078835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f5234393-e0d2-4aaf-81e0-34eef432474e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:56.079465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f5234393-e0d2-4aaf-81e0-34eef432474e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:56.085658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5234393-e0d2-4aaf-81e0-34eef432474e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.086248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5234393-e0d2-4aaf-81e0-34eef432474e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.086782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5234393-e0d2-4aaf-81e0-34eef432474e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.087603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5234393-e0d2-4aaf-81e0-34eef432474e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.088088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5234393-e0d2-4aaf-81e0-34eef432474e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.088645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f5234393-e0d2-4aaf-81e0-34eef432474e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.235416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f5234393-e0d2-4aaf-81e0-34eef432474e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:56.244866 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f5234393-e0d2-4aaf-81e0-34eef432474e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1515 microversion: 2.1 time: 0.169223 Oct 04 18:59:56.247627 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3588/7180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:56 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:57.052356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-45e9473c-8b8c-4e46-b658-cc9918c768bf req-01179a86-2330-463e-8a96-e94910de730c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "681fe84d-f07c-483d-b6d0-d012e456c3ad", "name": "network-vif-plugged", "status": "completed", "tag": "4c6125b2-18e7-43c2-ae9f-28da52c6c88c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:57.064065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-45e9473c-8b8c-4e46-b658-cc9918c768bf req-01179a86-2330-463e-8a96-e94910de730c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:57.064548 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-45e9473c-8b8c-4e46-b658-cc9918c768bf req-01179a86-2330-463e-8a96-e94910de730c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:57.064976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-45e9473c-8b8c-4e46-b658-cc9918c768bf req-01179a86-2330-463e-8a96-e94910de730c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:57.079508 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-45e9473c-8b8c-4e46-b658-cc9918c768bf req-01179a86-2330-463e-8a96-e94910de730c service nova] Creating event network-vif-plugged:4c6125b2-18e7-43c2-ae9f-28da52c6c88c for instance 681fe84d-f07c-483d-b6d0-d012e456c3ad on n-h1-850499-14 Oct 04 18:59:57.085433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-45e9473c-8b8c-4e46-b658-cc9918c768bf req-01179a86-2330-463e-8a96-e94910de730c service nova] Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:59:57.097200 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-45e9473c-8b8c-4e46-b658-cc9918c768bf req-01179a86-2330-463e-8a96-e94910de730c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110903 Oct 04 18:59:57.097885 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3593/7181] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:57.270324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-83fc17cd-7948-45c4-b9b0-26297c016abd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:57.270890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-83fc17cd-7948-45c4-b9b0-26297c016abd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:57.278327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fc17cd-7948-45c4-b9b0-26297c016abd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:57.278833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fc17cd-7948-45c4-b9b0-26297c016abd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:57.279310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fc17cd-7948-45c4-b9b0-26297c016abd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:57.280034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fc17cd-7948-45c4-b9b0-26297c016abd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:57.280501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fc17cd-7948-45c4-b9b0-26297c016abd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:57.280937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-83fc17cd-7948-45c4-b9b0-26297c016abd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:57.443485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-83fc17cd-7948-45c4-b9b0-26297c016abd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.452385 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-83fc17cd-7948-45c4-b9b0-26297c016abd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1515 microversion: 2.1 time: 0.186419 Oct 04 18:59:57.452987 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3589/7182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:57 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:58.482077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4a9cd57-4d6b-4824-964f-b6a0c9c7e001 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:58.483318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f4a9cd57-4d6b-4824-964f-b6a0c9c7e001 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:58.493710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a9cd57-4d6b-4824-964f-b6a0c9c7e001 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.494609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a9cd57-4d6b-4824-964f-b6a0c9c7e001 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.495392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a9cd57-4d6b-4824-964f-b6a0c9c7e001 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.496991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a9cd57-4d6b-4824-964f-b6a0c9c7e001 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.497785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a9cd57-4d6b-4824-964f-b6a0c9c7e001 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.498535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a9cd57-4d6b-4824-964f-b6a0c9c7e001 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.640737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f4a9cd57-4d6b-4824-964f-b6a0c9c7e001 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.648735 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f4a9cd57-4d6b-4824-964f-b6a0c9c7e001 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1507 microversion: 2.1 time: 0.175657 Oct 04 18:59:58.649304 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3594/7183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:58 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:58.670887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af10fac5-ed8d-4e68-8321-146aa1a4e2c8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:58.671557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-af10fac5-ed8d-4e68-8321-146aa1a4e2c8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:58.678358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af10fac5-ed8d-4e68-8321-146aa1a4e2c8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.678965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af10fac5-ed8d-4e68-8321-146aa1a4e2c8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.679376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af10fac5-ed8d-4e68-8321-146aa1a4e2c8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.680098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af10fac5-ed8d-4e68-8321-146aa1a4e2c8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.680576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af10fac5-ed8d-4e68-8321-146aa1a4e2c8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.681023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af10fac5-ed8d-4e68-8321-146aa1a4e2c8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.810687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af10fac5-ed8d-4e68-8321-146aa1a4e2c8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.818670 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-af10fac5-ed8d-4e68-8321-146aa1a4e2c8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1507 microversion: 2.1 time: 0.151625 Oct 04 18:59:58.819734 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3590/7184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:58 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:58.845027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f11bab44-07c0-4aad-b9c5-24ebc6c7c585 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Action: 'create', calling method: .version_select at 0x7fd4d60fa310>, body: {"keypair": {"name": "tempest-keypair-1273119235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnTGUysah6Pa7yfZZBWqeb86340SzNveIdge/DsDgA5UkFtbrwZAkXQp/YwBxig2gtFErxUYuISxpl6aQZCKKtp2c+5nXSLTstncPgPpgH+luirKMh6UCFe7pzvqo5JQw=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:58.861488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f11bab44-07c0-4aad-b9c5-24ebc6c7c585 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Getting quotas for project 82efffb87700428bb359d0145e1640a2. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:58.866567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-f11bab44-07c0-4aad-b9c5-24ebc6c7c585 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Getting quotas for user deb2a3dfa0f04eeaab3fdcfeea6b64b4 and project 82efffb87700428bb359d0145e1640a2. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:58.882046 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f11bab44-07c0-4aad-b9c5-24ebc6c7c585 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [fa0e5bf0-5cda-4994-9de5-118eac07f3bf] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:59:59.890598 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [None req-f11bab44-07c0-4aad-b9c5-24ebc6c7c585 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [fa0e5bf0-5cda-4994-9de5-118eac07f3bf] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 46398. Oct 04 18:59:59.906830 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f11bab44-07c0-4aad-b9c5-24ebc6c7c585 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.065696 Oct 04 18:59:59.907488 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3595/7185] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 18:59:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:01.132406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb736ce4-43fd-4314-bbc7-2070a211c881 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:01.133033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bb736ce4-43fd-4314-bbc7-2070a211c881 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:01.140031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb736ce4-43fd-4314-bbc7-2070a211c881 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.140527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb736ce4-43fd-4314-bbc7-2070a211c881 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.140979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb736ce4-43fd-4314-bbc7-2070a211c881 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.141689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb736ce4-43fd-4314-bbc7-2070a211c881 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.142159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb736ce4-43fd-4314-bbc7-2070a211c881 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.142600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb736ce4-43fd-4314-bbc7-2070a211c881 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.279715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bb736ce4-43fd-4314-bbc7-2070a211c881 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.289172 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb736ce4-43fd-4314-bbc7-2070a211c881 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 200 len: 1507 microversion: 2.1 time: 0.160685 Oct 04 19:00:01.289764 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3591/7186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:01 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:01.313642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-41af859c-0e30-4e99-a9cd-84ddd5b0e54b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:01.314211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-41af859c-0e30-4e99-a9cd-84ddd5b0e54b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:01.320492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41af859c-0e30-4e99-a9cd-84ddd5b0e54b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.320983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41af859c-0e30-4e99-a9cd-84ddd5b0e54b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.321478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41af859c-0e30-4e99-a9cd-84ddd5b0e54b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.322847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41af859c-0e30-4e99-a9cd-84ddd5b0e54b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.323348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41af859c-0e30-4e99-a9cd-84ddd5b0e54b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.323792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-41af859c-0e30-4e99-a9cd-84ddd5b0e54b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.350890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-41af859c-0e30-4e99-a9cd-84ddd5b0e54b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:00:01.439180 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-41af859c-0e30-4e99-a9cd-84ddd5b0e54b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "DELETE /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 204 len: 0 microversion: 2.1 time: 0.130366 Oct 04 19:00:01.439811 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3596/7187] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:01 2022] DELETE /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:00:01.496295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-92650527", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "1d04c3e9-67a8-465e-8439-c72d95e63573"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:01.557094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] validate_networks() for [('1d04c3e9-67a8-465e-8439-c72d95e63573', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:00:01.989360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:00:01.989847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:00:01.990799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:00:01.990799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:00:01.991214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:00:02.001326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.001935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.002399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.003186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.003672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.004122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.021555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Getting quotas for project 82efffb87700428bb359d0145e1640a2. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:00:02.028602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Getting quotas for user deb2a3dfa0f04eeaab3fdcfeea6b64b4 and project 82efffb87700428bb359d0145e1640a2. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:00:02.046844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:00:02.049124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:00:02.095109 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8cc01205-9e3b-4e0c-b4c6-b3ec6ac9b957 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602862 Oct 04 19:00:02.095782 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3592/7188] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:00:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:00:02.108153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10ce2ffa-6774-4808-8497-1129753cf91f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:02.108863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10ce2ffa-6774-4808-8497-1129753cf91f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:02.167732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-10ce2ffa-6774-4808-8497-1129753cf91f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:02.174809 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10ce2ffa-6774-4808-8497-1129753cf91f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1216 microversion: 2.1 time: 0.071510 Oct 04 19:00:02.175447 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3597/7189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:02 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:03.199416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f0e5518-2282-4a30-b913-b30348ae6ac0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:03.200060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f0e5518-2282-4a30-b913-b30348ae6ac0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:03.218464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e5518-2282-4a30-b913-b30348ae6ac0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.219314 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e5518-2282-4a30-b913-b30348ae6ac0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.219958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e5518-2282-4a30-b913-b30348ae6ac0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.220777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e5518-2282-4a30-b913-b30348ae6ac0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.221423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e5518-2282-4a30-b913-b30348ae6ac0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.222048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f0e5518-2282-4a30-b913-b30348ae6ac0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.325340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f0e5518-2282-4a30-b913-b30348ae6ac0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:03.345538 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f0e5518-2282-4a30-b913-b30348ae6ac0 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1276 microversion: 2.1 time: 0.151236 Oct 04 19:00:03.355421 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3593/7190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:03 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:03.466303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6b2796df-efb9-4aa1-a61b-a81abf3d279d req-9a76b4ef-80b4-4cd3-9576-ba1f3a1a6bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "681fe84d-f07c-483d-b6d0-d012e456c3ad", "name": "network-vif-deleted", "tag": "4c6125b2-18e7-43c2-ae9f-28da52c6c88c"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:03.479511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6b2796df-efb9-4aa1-a61b-a81abf3d279d req-9a76b4ef-80b4-4cd3-9576-ba1f3a1a6bdb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.479997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6b2796df-efb9-4aa1-a61b-a81abf3d279d req-9a76b4ef-80b4-4cd3-9576-ba1f3a1a6bdb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.480467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6b2796df-efb9-4aa1-a61b-a81abf3d279d req-9a76b4ef-80b4-4cd3-9576-ba1f3a1a6bdb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.492845 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6b2796df-efb9-4aa1-a61b-a81abf3d279d req-9a76b4ef-80b4-4cd3-9576-ba1f3a1a6bdb service nova] Creating event network-vif-deleted:4c6125b2-18e7-43c2-ae9f-28da52c6c88c for instance 681fe84d-f07c-483d-b6d0-d012e456c3ad on n-h1-850499-14 Oct 04 19:00:03.499104 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6b2796df-efb9-4aa1-a61b-a81abf3d279d req-9a76b4ef-80b4-4cd3-9576-ba1f3a1a6bdb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036812 Oct 04 19:00:03.499788 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3598/7191] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:04.375874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7999a23a-5c84-4567-a60d-e07f9c77021a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:04.379947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7999a23a-5c84-4567-a60d-e07f9c77021a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:04.389143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7999a23a-5c84-4567-a60d-e07f9c77021a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:04.389772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7999a23a-5c84-4567-a60d-e07f9c77021a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:04.390307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7999a23a-5c84-4567-a60d-e07f9c77021a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:04.391303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7999a23a-5c84-4567-a60d-e07f9c77021a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:04.391768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7999a23a-5c84-4567-a60d-e07f9c77021a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:04.392410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7999a23a-5c84-4567-a60d-e07f9c77021a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:04.542101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7999a23a-5c84-4567-a60d-e07f9c77021a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:04.552969 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7999a23a-5c84-4567-a60d-e07f9c77021a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1316 microversion: 2.1 time: 0.184570 Oct 04 19:00:04.558832 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3594/7192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:04 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:05.515668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-058aaa67-713f-46f3-9b43-4f714f6ea13f req-7ba6759f-8be3-4ce0-849a-bfa784bc085a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9bf74f-590a-4c7e-ba5d-204e28fc869e", "tag": "ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:05.526086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-058aaa67-713f-46f3-9b43-4f714f6ea13f req-7ba6759f-8be3-4ce0-849a-bfa784bc085a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.526563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-058aaa67-713f-46f3-9b43-4f714f6ea13f req-7ba6759f-8be3-4ce0-849a-bfa784bc085a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.527015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-058aaa67-713f-46f3-9b43-4f714f6ea13f req-7ba6759f-8be3-4ce0-849a-bfa784bc085a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.537844 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-058aaa67-713f-46f3-9b43-4f714f6ea13f req-7ba6759f-8be3-4ce0-849a-bfa784bc085a service nova] Creating event network-changed:ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f for instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e on n-h2-850499-14 Oct 04 19:00:05.543570 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-058aaa67-713f-46f3-9b43-4f714f6ea13f req-7ba6759f-8be3-4ce0-849a-bfa784bc085a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032871 Oct 04 19:00:05.544158 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3599/7193] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:05.576697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-033fc18f-6ff0-4f85-b924-b6721bf63694 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:05.577349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-033fc18f-6ff0-4f85-b924-b6721bf63694 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:05.584345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-033fc18f-6ff0-4f85-b924-b6721bf63694 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.584847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-033fc18f-6ff0-4f85-b924-b6721bf63694 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.585318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-033fc18f-6ff0-4f85-b924-b6721bf63694 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.586031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-033fc18f-6ff0-4f85-b924-b6721bf63694 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.586497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-033fc18f-6ff0-4f85-b924-b6721bf63694 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.587477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-033fc18f-6ff0-4f85-b924-b6721bf63694 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.729481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-033fc18f-6ff0-4f85-b924-b6721bf63694 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:05.737552 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-033fc18f-6ff0-4f85-b924-b6721bf63694 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1316 microversion: 2.1 time: 0.164782 Oct 04 19:00:05.738193 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3595/7194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:05 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:06.762052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ced1b894-776f-4ac2-8583-80ef077406e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:06.763359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ced1b894-776f-4ac2-8583-80ef077406e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:06.770178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ced1b894-776f-4ac2-8583-80ef077406e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:06.770681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ced1b894-776f-4ac2-8583-80ef077406e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:06.771164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ced1b894-776f-4ac2-8583-80ef077406e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:06.771912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ced1b894-776f-4ac2-8583-80ef077406e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:06.772379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ced1b894-776f-4ac2-8583-80ef077406e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:06.772814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ced1b894-776f-4ac2-8583-80ef077406e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:06.909003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ced1b894-776f-4ac2-8583-80ef077406e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:06.917404 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ced1b894-776f-4ac2-8583-80ef077406e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1316 microversion: 2.1 time: 0.160421 Oct 04 19:00:06.917994 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3600/7195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:06 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:07.940330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dbe4073c-152d-47e3-80a4-9c678afea298 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:07.940963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dbe4073c-152d-47e3-80a4-9c678afea298 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:07.948923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe4073c-152d-47e3-80a4-9c678afea298 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:07.949428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe4073c-152d-47e3-80a4-9c678afea298 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:07.949883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe4073c-152d-47e3-80a4-9c678afea298 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:07.950598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe4073c-152d-47e3-80a4-9c678afea298 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:07.951103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe4073c-152d-47e3-80a4-9c678afea298 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:07.951549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe4073c-152d-47e3-80a4-9c678afea298 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:08.087076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dbe4073c-152d-47e3-80a4-9c678afea298 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:08.089467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:08.096648 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dbe4073c-152d-47e3-80a4-9c678afea298 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1316 microversion: 2.1 time: 0.160094 Oct 04 19:00:08.097267 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3596/7196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:07 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:09.121478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc836635-d34a-4446-8d44-6936be1b0155 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:09.122005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc836635-d34a-4446-8d44-6936be1b0155 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:09.129898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc836635-d34a-4446-8d44-6936be1b0155 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:09.130399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc836635-d34a-4446-8d44-6936be1b0155 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:09.130850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc836635-d34a-4446-8d44-6936be1b0155 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:09.131594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc836635-d34a-4446-8d44-6936be1b0155 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:09.132058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc836635-d34a-4446-8d44-6936be1b0155 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:09.132590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc836635-d34a-4446-8d44-6936be1b0155 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:09.269345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dc836635-d34a-4446-8d44-6936be1b0155 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:09.277229 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc836635-d34a-4446-8d44-6936be1b0155 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1316 microversion: 2.1 time: 0.160571 Oct 04 19:00:09.277796 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3601/7197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:09 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:10.300194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1f34316e-cfa1-42dc-bb48-0ebd19f86692 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:10.300904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1f34316e-cfa1-42dc-bb48-0ebd19f86692 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:10.308013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f34316e-cfa1-42dc-bb48-0ebd19f86692 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:10.308519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f34316e-cfa1-42dc-bb48-0ebd19f86692 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:10.308981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f34316e-cfa1-42dc-bb48-0ebd19f86692 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:10.309689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f34316e-cfa1-42dc-bb48-0ebd19f86692 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:10.310166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f34316e-cfa1-42dc-bb48-0ebd19f86692 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:10.310608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f34316e-cfa1-42dc-bb48-0ebd19f86692 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:10.451034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1f34316e-cfa1-42dc-bb48-0ebd19f86692 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:10.459036 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1f34316e-cfa1-42dc-bb48-0ebd19f86692 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1316 microversion: 2.1 time: 0.162656 Oct 04 19:00:10.459635 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3597/7198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:10 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:10.870717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-b302ad12-af0d-4892-9e49-66820abcdba3 req-bf4cf1c5-bc43-4bae-a50d-f059fcced24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9bf74f-590a-4c7e-ba5d-204e28fc869e", "name": "network-vif-plugged", "status": "completed", "tag": "ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:10.882555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b302ad12-af0d-4892-9e49-66820abcdba3 req-bf4cf1c5-bc43-4bae-a50d-f059fcced24c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:10.882856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b302ad12-af0d-4892-9e49-66820abcdba3 req-bf4cf1c5-bc43-4bae-a50d-f059fcced24c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:10.883916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-b302ad12-af0d-4892-9e49-66820abcdba3 req-bf4cf1c5-bc43-4bae-a50d-f059fcced24c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:10.887090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:10.897761 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-b302ad12-af0d-4892-9e49-66820abcdba3 req-bf4cf1c5-bc43-4bae-a50d-f059fcced24c service nova] Creating event network-vif-plugged:ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f for instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e on n-h2-850499-14 Oct 04 19:00:10.903597 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-b302ad12-af0d-4892-9e49-66820abcdba3 req-bf4cf1c5-bc43-4bae-a50d-f059fcced24c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036889 Oct 04 19:00:10.904219 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3602/7199] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:11.484797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-369ebdbc-33da-4c0f-becd-b6ff85576bf9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:11.485555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-369ebdbc-33da-4c0f-becd-b6ff85576bf9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:11.493786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-369ebdbc-33da-4c0f-becd-b6ff85576bf9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:11.494312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-369ebdbc-33da-4c0f-becd-b6ff85576bf9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:11.494752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-369ebdbc-33da-4c0f-becd-b6ff85576bf9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:11.495554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-369ebdbc-33da-4c0f-becd-b6ff85576bf9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:11.496022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-369ebdbc-33da-4c0f-becd-b6ff85576bf9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:11.496473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-369ebdbc-33da-4c0f-becd-b6ff85576bf9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:11.638887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-369ebdbc-33da-4c0f-becd-b6ff85576bf9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:11.650718 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-369ebdbc-33da-4c0f-becd-b6ff85576bf9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1316 microversion: 2.1 time: 0.170610 Oct 04 19:00:11.651423 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3598/7200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:11 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:12.672610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:12.677232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a969d7cd-93c5-4f16-a2e9-7a1c08186c74 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:12.678004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a969d7cd-93c5-4f16-a2e9-7a1c08186c74 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:12.687521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a969d7cd-93c5-4f16-a2e9-7a1c08186c74 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.688020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a969d7cd-93c5-4f16-a2e9-7a1c08186c74 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.688462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a969d7cd-93c5-4f16-a2e9-7a1c08186c74 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.689196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a969d7cd-93c5-4f16-a2e9-7a1c08186c74 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.689661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a969d7cd-93c5-4f16-a2e9-7a1c08186c74 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.690091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a969d7cd-93c5-4f16-a2e9-7a1c08186c74 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.837507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a969d7cd-93c5-4f16-a2e9-7a1c08186c74 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:12.847252 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a969d7cd-93c5-4f16-a2e9-7a1c08186c74 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1505 microversion: 2.1 time: 0.176842 Oct 04 19:00:12.848258 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3603/7201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:12 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:12.874909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c083d756-df07-4819-863b-cf0deb6d95ce tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:12.875583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c083d756-df07-4819-863b-cf0deb6d95ce tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:12.877519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:12.878196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:12.885483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c083d756-df07-4819-863b-cf0deb6d95ce tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.885992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c083d756-df07-4819-863b-cf0deb6d95ce tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.886448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c083d756-df07-4819-863b-cf0deb6d95ce tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.887198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c083d756-df07-4819-863b-cf0deb6d95ce tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.887666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c083d756-df07-4819-863b-cf0deb6d95ce tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.888107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c083d756-df07-4819-863b-cf0deb6d95ce tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.022378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c083d756-df07-4819-863b-cf0deb6d95ce tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.030433 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c083d756-df07-4819-863b-cf0deb6d95ce tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1505 microversion: 2.1 time: 0.159409 Oct 04 19:00:13.030943 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3599/7202] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:12 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:13.053364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:13.056219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:13.062305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:13.062791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:13.063264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.063962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:13.064419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:13.064841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.093709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.102152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122332) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:00:13.108758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:00:13.109180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:00:13.109987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:00:13.110402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:00:13.110813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:00:13.181382 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e742344c-27a1-49a9-a4d1-2032a814ba78 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "POST /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e/action" status: 202 len: 0 microversion: 2.1 time: 0.132071 Oct 04 19:00:13.182111 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3604/7203] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:00:13 2022] POST /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:00:13.190734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aa83138c-b1ec-4033-9b1d-1ca225e8d74c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:13.191761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aa83138c-b1ec-4033-9b1d-1ca225e8d74c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:13.199476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa83138c-b1ec-4033-9b1d-1ca225e8d74c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:13.200070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa83138c-b1ec-4033-9b1d-1ca225e8d74c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:13.200593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa83138c-b1ec-4033-9b1d-1ca225e8d74c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.201403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa83138c-b1ec-4033-9b1d-1ca225e8d74c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:13.201944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa83138c-b1ec-4033-9b1d-1ca225e8d74c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:13.202462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aa83138c-b1ec-4033-9b1d-1ca225e8d74c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.372356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aa83138c-b1ec-4033-9b1d-1ca225e8d74c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.382444 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aa83138c-b1ec-4033-9b1d-1ca225e8d74c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1512 microversion: 2.1 time: 0.195718 Oct 04 19:00:13.390089 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3600/7204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:13 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:14.410283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3dd32193-a758-48eb-9577-d3f41f7cbed8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:14.410982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3dd32193-a758-48eb-9577-d3f41f7cbed8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:14.419654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd32193-a758-48eb-9577-d3f41f7cbed8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.420206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd32193-a758-48eb-9577-d3f41f7cbed8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.420718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd32193-a758-48eb-9577-d3f41f7cbed8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.421430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd32193-a758-48eb-9577-d3f41f7cbed8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.421895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd32193-a758-48eb-9577-d3f41f7cbed8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.422345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dd32193-a758-48eb-9577-d3f41f7cbed8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.578330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3dd32193-a758-48eb-9577-d3f41f7cbed8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:14.587593 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3dd32193-a758-48eb-9577-d3f41f7cbed8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1512 microversion: 2.1 time: 0.181041 Oct 04 19:00:14.588430 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3605/7205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:14 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:15.616878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-71fb2111-8425-4933-9d79-fd90c93fe234 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:15.617565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-71fb2111-8425-4933-9d79-fd90c93fe234 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:15.627076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fb2111-8425-4933-9d79-fd90c93fe234 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:15.627582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fb2111-8425-4933-9d79-fd90c93fe234 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:15.628152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fb2111-8425-4933-9d79-fd90c93fe234 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:15.628883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fb2111-8425-4933-9d79-fd90c93fe234 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:15.629441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fb2111-8425-4933-9d79-fd90c93fe234 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:15.629883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71fb2111-8425-4933-9d79-fd90c93fe234 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:15.782231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-71fb2111-8425-4933-9d79-fd90c93fe234 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:15.791118 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-71fb2111-8425-4933-9d79-fd90c93fe234 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1512 microversion: 2.1 time: 0.179793 Oct 04 19:00:15.791765 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3601/7206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:15 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:16.815780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a71c4dda-aaee-4aba-b5f9-7ab74afe81be tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:16.816361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a71c4dda-aaee-4aba-b5f9-7ab74afe81be tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:16.819749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:16.826120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71c4dda-aaee-4aba-b5f9-7ab74afe81be tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.826618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71c4dda-aaee-4aba-b5f9-7ab74afe81be tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.827093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71c4dda-aaee-4aba-b5f9-7ab74afe81be tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.827955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71c4dda-aaee-4aba-b5f9-7ab74afe81be tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.828403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71c4dda-aaee-4aba-b5f9-7ab74afe81be tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.828838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a71c4dda-aaee-4aba-b5f9-7ab74afe81be tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.319888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a71c4dda-aaee-4aba-b5f9-7ab74afe81be tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:17.328492 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a71c4dda-aaee-4aba-b5f9-7ab74afe81be tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.517581 Oct 04 19:00:17.329066 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3606/7207] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:16 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:18.354472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b874e682-1374-4137-90c9-9f5a509b9619 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:18.355279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b874e682-1374-4137-90c9-9f5a509b9619 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:18.357970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:18.364513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b874e682-1374-4137-90c9-9f5a509b9619 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:18.364513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b874e682-1374-4137-90c9-9f5a509b9619 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:18.364513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b874e682-1374-4137-90c9-9f5a509b9619 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:18.365495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b874e682-1374-4137-90c9-9f5a509b9619 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:18.365654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b874e682-1374-4137-90c9-9f5a509b9619 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:18.366108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b874e682-1374-4137-90c9-9f5a509b9619 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:18.508538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b874e682-1374-4137-90c9-9f5a509b9619 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:18.516650 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b874e682-1374-4137-90c9-9f5a509b9619 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.166722 Oct 04 19:00:18.517241 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3602/7208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:18 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:19.540979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ae91105f-9880-4cc8-8e69-3d15c528423d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:19.541602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ae91105f-9880-4cc8-8e69-3d15c528423d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:19.548443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae91105f-9880-4cc8-8e69-3d15c528423d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:19.548934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae91105f-9880-4cc8-8e69-3d15c528423d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:19.549579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae91105f-9880-4cc8-8e69-3d15c528423d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:19.550090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae91105f-9880-4cc8-8e69-3d15c528423d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:19.550577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae91105f-9880-4cc8-8e69-3d15c528423d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:19.551019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ae91105f-9880-4cc8-8e69-3d15c528423d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:19.681244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ae91105f-9880-4cc8-8e69-3d15c528423d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:19.688980 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ae91105f-9880-4cc8-8e69-3d15c528423d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.152378 Oct 04 19:00:19.689490 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3607/7209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:19 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:20.712863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57261c60-23ea-4993-9943-1870a76f2af9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:20.713408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-57261c60-23ea-4993-9943-1870a76f2af9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:20.720885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57261c60-23ea-4993-9943-1870a76f2af9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.724233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57261c60-23ea-4993-9943-1870a76f2af9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.724717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57261c60-23ea-4993-9943-1870a76f2af9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.725450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57261c60-23ea-4993-9943-1870a76f2af9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.725928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57261c60-23ea-4993-9943-1870a76f2af9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.726868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-57261c60-23ea-4993-9943-1870a76f2af9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.871784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-57261c60-23ea-4993-9943-1870a76f2af9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:20.880917 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-57261c60-23ea-4993-9943-1870a76f2af9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.171997 Oct 04 19:00:20.881875 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3603/7210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:20 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:21.905486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb14a753-58af-46d9-b9f5-1c98e5daf933 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:21.906225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb14a753-58af-46d9-b9f5-1c98e5daf933 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:21.913841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb14a753-58af-46d9-b9f5-1c98e5daf933 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:21.914339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb14a753-58af-46d9-b9f5-1c98e5daf933 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:21.914790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb14a753-58af-46d9-b9f5-1c98e5daf933 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:21.915529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb14a753-58af-46d9-b9f5-1c98e5daf933 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:21.915998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb14a753-58af-46d9-b9f5-1c98e5daf933 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:21.916437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb14a753-58af-46d9-b9f5-1c98e5daf933 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:22.053697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb14a753-58af-46d9-b9f5-1c98e5daf933 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:22.062298 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb14a753-58af-46d9-b9f5-1c98e5daf933 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.160892 Oct 04 19:00:22.062861 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3608/7211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:21 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:23.088037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d85752ef-e430-44e5-9a67-9ae1b675811c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:23.088699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d85752ef-e430-44e5-9a67-9ae1b675811c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:23.097181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d85752ef-e430-44e5-9a67-9ae1b675811c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.097733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d85752ef-e430-44e5-9a67-9ae1b675811c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.098226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d85752ef-e430-44e5-9a67-9ae1b675811c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:23.099023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d85752ef-e430-44e5-9a67-9ae1b675811c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.099553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d85752ef-e430-44e5-9a67-9ae1b675811c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.100098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d85752ef-e430-44e5-9a67-9ae1b675811c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:23.230135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d85752ef-e430-44e5-9a67-9ae1b675811c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:23.238014 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d85752ef-e430-44e5-9a67-9ae1b675811c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.155168 Oct 04 19:00:23.238594 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3604/7212] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:23 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:24.260598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4e44741d-8ffa-4e6d-b438-52ed3d2c7646 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:24.261232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4e44741d-8ffa-4e6d-b438-52ed3d2c7646 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:24.268142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e44741d-8ffa-4e6d-b438-52ed3d2c7646 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:24.268626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e44741d-8ffa-4e6d-b438-52ed3d2c7646 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:24.269064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e44741d-8ffa-4e6d-b438-52ed3d2c7646 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:24.269751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e44741d-8ffa-4e6d-b438-52ed3d2c7646 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:24.270203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e44741d-8ffa-4e6d-b438-52ed3d2c7646 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:24.270627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e44741d-8ffa-4e6d-b438-52ed3d2c7646 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:24.402843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4e44741d-8ffa-4e6d-b438-52ed3d2c7646 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:24.410967 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4e44741d-8ffa-4e6d-b438-52ed3d2c7646 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.154322 Oct 04 19:00:24.411546 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3609/7213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:24 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:25.435198 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ff4e286d-3406-430b-8fc2-5379e3ba90ee tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:25.435955 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ff4e286d-3406-430b-8fc2-5379e3ba90ee tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:25.442550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff4e286d-3406-430b-8fc2-5379e3ba90ee tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:25.443361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff4e286d-3406-430b-8fc2-5379e3ba90ee tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:25.443820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff4e286d-3406-430b-8fc2-5379e3ba90ee tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:25.444592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff4e286d-3406-430b-8fc2-5379e3ba90ee tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:25.445078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff4e286d-3406-430b-8fc2-5379e3ba90ee tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:25.445520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff4e286d-3406-430b-8fc2-5379e3ba90ee tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:25.577782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ff4e286d-3406-430b-8fc2-5379e3ba90ee tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:25.586157 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ff4e286d-3406-430b-8fc2-5379e3ba90ee tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.154868 Oct 04 19:00:25.586737 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3605/7214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:25 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:26.609777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9d5e053-bae5-4215-b195-77d93d46b488 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:26.610395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9d5e053-bae5-4215-b195-77d93d46b488 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:26.617947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d5e053-bae5-4215-b195-77d93d46b488 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:26.618446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d5e053-bae5-4215-b195-77d93d46b488 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:26.618895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d5e053-bae5-4215-b195-77d93d46b488 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:26.619637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d5e053-bae5-4215-b195-77d93d46b488 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:26.620094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d5e053-bae5-4215-b195-77d93d46b488 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:26.620529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d5e053-bae5-4215-b195-77d93d46b488 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:26.748272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9d5e053-bae5-4215-b195-77d93d46b488 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:26.756317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9d5e053-bae5-4215-b195-77d93d46b488 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.150448 Oct 04 19:00:26.760703 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3610/7215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:26 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:27.781000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f343ce38-82a5-4e12-a325-1204fe7fab86 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:27.781548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f343ce38-82a5-4e12-a325-1204fe7fab86 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:27.788481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f343ce38-82a5-4e12-a325-1204fe7fab86 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:27.788994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f343ce38-82a5-4e12-a325-1204fe7fab86 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:27.789451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f343ce38-82a5-4e12-a325-1204fe7fab86 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:27.790162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f343ce38-82a5-4e12-a325-1204fe7fab86 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:27.790636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f343ce38-82a5-4e12-a325-1204fe7fab86 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:27.791119 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f343ce38-82a5-4e12-a325-1204fe7fab86 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:27.923582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f343ce38-82a5-4e12-a325-1204fe7fab86 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:27.931744 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f343ce38-82a5-4e12-a325-1204fe7fab86 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.154887 Oct 04 19:00:27.932317 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3606/7216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:27 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:28.955339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9bdb42cc-6739-42ac-a4e6-7a8b481b0232 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:28.955956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9bdb42cc-6739-42ac-a4e6-7a8b481b0232 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:28.963520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bdb42cc-6739-42ac-a4e6-7a8b481b0232 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:28.964013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bdb42cc-6739-42ac-a4e6-7a8b481b0232 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:28.964457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bdb42cc-6739-42ac-a4e6-7a8b481b0232 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:28.965158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bdb42cc-6739-42ac-a4e6-7a8b481b0232 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:28.965614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bdb42cc-6739-42ac-a4e6-7a8b481b0232 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:28.966042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9bdb42cc-6739-42ac-a4e6-7a8b481b0232 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:29.098380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9bdb42cc-6739-42ac-a4e6-7a8b481b0232 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:29.106224 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9bdb42cc-6739-42ac-a4e6-7a8b481b0232 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.154719 Oct 04 19:00:29.106839 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3611/7217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:28 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:30.128783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-13255a23-bff2-4be7-879f-a8ae0b5d909f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:30.129422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-13255a23-bff2-4be7-879f-a8ae0b5d909f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:30.136443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13255a23-bff2-4be7-879f-a8ae0b5d909f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.136948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13255a23-bff2-4be7-879f-a8ae0b5d909f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.137409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13255a23-bff2-4be7-879f-a8ae0b5d909f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.138130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13255a23-bff2-4be7-879f-a8ae0b5d909f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:30.138605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13255a23-bff2-4be7-879f-a8ae0b5d909f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:30.139095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-13255a23-bff2-4be7-879f-a8ae0b5d909f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.268047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-13255a23-bff2-4be7-879f-a8ae0b5d909f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:30.276433 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-13255a23-bff2-4be7-879f-a8ae0b5d909f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.151556 Oct 04 19:00:30.277013 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3607/7218] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:30 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:31.300580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-81342314-db0c-44fb-a0d0-804852270903 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:31.301224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-81342314-db0c-44fb-a0d0-804852270903 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:31.309443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81342314-db0c-44fb-a0d0-804852270903 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:31.309930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81342314-db0c-44fb-a0d0-804852270903 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:31.310367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81342314-db0c-44fb-a0d0-804852270903 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:31.311102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81342314-db0c-44fb-a0d0-804852270903 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:31.311555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81342314-db0c-44fb-a0d0-804852270903 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:31.312054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81342314-db0c-44fb-a0d0-804852270903 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:31.446455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-81342314-db0c-44fb-a0d0-804852270903 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:31.454325 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-81342314-db0c-44fb-a0d0-804852270903 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.157887 Oct 04 19:00:31.455159 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3612/7219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:31 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:32.477970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf5012ee-2f93-411e-b4a9-f0a7e4ce81fa tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:32.478640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf5012ee-2f93-411e-b4a9-f0a7e4ce81fa tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:32.486302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf5012ee-2f93-411e-b4a9-f0a7e4ce81fa tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:32.486816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf5012ee-2f93-411e-b4a9-f0a7e4ce81fa tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:32.487308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf5012ee-2f93-411e-b4a9-f0a7e4ce81fa tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:32.488045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf5012ee-2f93-411e-b4a9-f0a7e4ce81fa tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:32.488554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf5012ee-2f93-411e-b4a9-f0a7e4ce81fa tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:32.489006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf5012ee-2f93-411e-b4a9-f0a7e4ce81fa tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:32.627403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cf5012ee-2f93-411e-b4a9-f0a7e4ce81fa tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:32.636247 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf5012ee-2f93-411e-b4a9-f0a7e4ce81fa tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.162250 Oct 04 19:00:32.636843 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3608/7220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:32 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:33.660862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b35854b-5caf-43dc-a782-0a1da0cfa641 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:33.661537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2b35854b-5caf-43dc-a782-0a1da0cfa641 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:33.668720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b35854b-5caf-43dc-a782-0a1da0cfa641 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:33.669244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b35854b-5caf-43dc-a782-0a1da0cfa641 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:33.669689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b35854b-5caf-43dc-a782-0a1da0cfa641 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:33.670418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b35854b-5caf-43dc-a782-0a1da0cfa641 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:33.670882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b35854b-5caf-43dc-a782-0a1da0cfa641 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:33.671340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b35854b-5caf-43dc-a782-0a1da0cfa641 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:33.804478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b35854b-5caf-43dc-a782-0a1da0cfa641 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:33.813016 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2b35854b-5caf-43dc-a782-0a1da0cfa641 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.157108 Oct 04 19:00:33.813698 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3613/7221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:33 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:34.837743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-56ac6dec-93fa-451c-be86-42c313eb1057 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:34.838304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-56ac6dec-93fa-451c-be86-42c313eb1057 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:34.845396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac6dec-93fa-451c-be86-42c313eb1057 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:34.845900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac6dec-93fa-451c-be86-42c313eb1057 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:34.846355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac6dec-93fa-451c-be86-42c313eb1057 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:34.847084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac6dec-93fa-451c-be86-42c313eb1057 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:34.847559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac6dec-93fa-451c-be86-42c313eb1057 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:34.847995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56ac6dec-93fa-451c-be86-42c313eb1057 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:34.977981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-56ac6dec-93fa-451c-be86-42c313eb1057 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:34.985759 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-56ac6dec-93fa-451c-be86-42c313eb1057 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.152775 Oct 04 19:00:34.986344 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3609/7222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:34 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:36.008800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9d57b78-27a7-46a6-9ef4-83b5cbad2aca tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:36.009490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9d57b78-27a7-46a6-9ef4-83b5cbad2aca tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:36.016382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d57b78-27a7-46a6-9ef4-83b5cbad2aca tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:36.016917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d57b78-27a7-46a6-9ef4-83b5cbad2aca tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:36.017362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d57b78-27a7-46a6-9ef4-83b5cbad2aca tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:36.018066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d57b78-27a7-46a6-9ef4-83b5cbad2aca tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:36.018528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d57b78-27a7-46a6-9ef4-83b5cbad2aca tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:36.018978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9d57b78-27a7-46a6-9ef4-83b5cbad2aca tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:36.157824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9d57b78-27a7-46a6-9ef4-83b5cbad2aca tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:36.165672 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9d57b78-27a7-46a6-9ef4-83b5cbad2aca tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.160733 Oct 04 19:00:36.167169 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3614/7223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:36 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:37.189700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-78e897d6-160e-4a89-a1c4-3834918e4128 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:37.190331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-78e897d6-160e-4a89-a1c4-3834918e4128 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:37.197569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78e897d6-160e-4a89-a1c4-3834918e4128 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:37.198073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78e897d6-160e-4a89-a1c4-3834918e4128 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:37.198532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78e897d6-160e-4a89-a1c4-3834918e4128 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:37.199269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78e897d6-160e-4a89-a1c4-3834918e4128 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:37.199744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78e897d6-160e-4a89-a1c4-3834918e4128 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:37.200188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-78e897d6-160e-4a89-a1c4-3834918e4128 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:37.330533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-78e897d6-160e-4a89-a1c4-3834918e4128 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:37.338260 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-78e897d6-160e-4a89-a1c4-3834918e4128 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.152482 Oct 04 19:00:37.338841 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3610/7224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:37 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:38.361751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f7565c3c-0c4f-4078-ac04-5107d70b68d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:38.362369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f7565c3c-0c4f-4078-ac04-5107d70b68d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:38.369866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7565c3c-0c4f-4078-ac04-5107d70b68d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:38.370367 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7565c3c-0c4f-4078-ac04-5107d70b68d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:38.370817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7565c3c-0c4f-4078-ac04-5107d70b68d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:38.371578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7565c3c-0c4f-4078-ac04-5107d70b68d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:38.372043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7565c3c-0c4f-4078-ac04-5107d70b68d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:38.372478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7565c3c-0c4f-4078-ac04-5107d70b68d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:38.503790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f7565c3c-0c4f-4078-ac04-5107d70b68d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:38.512093 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f7565c3c-0c4f-4078-ac04-5107d70b68d6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.154274 Oct 04 19:00:38.512666 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3615/7225] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:38 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:39.534769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20e877fa-035b-4413-a9eb-cda82f90fc2e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:39.535429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20e877fa-035b-4413-a9eb-cda82f90fc2e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:39.542399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20e877fa-035b-4413-a9eb-cda82f90fc2e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.542904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20e877fa-035b-4413-a9eb-cda82f90fc2e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.543390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20e877fa-035b-4413-a9eb-cda82f90fc2e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.544106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20e877fa-035b-4413-a9eb-cda82f90fc2e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.544577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20e877fa-035b-4413-a9eb-cda82f90fc2e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.545069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20e877fa-035b-4413-a9eb-cda82f90fc2e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.677818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-20e877fa-035b-4413-a9eb-cda82f90fc2e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:39.685606 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20e877fa-035b-4413-a9eb-cda82f90fc2e tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.154813 Oct 04 19:00:39.686184 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3611/7226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:39 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:40.709454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-795e0189-d0d8-48ff-8fd5-4d1318bdc931 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:40.709992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-795e0189-d0d8-48ff-8fd5-4d1318bdc931 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:40.717334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795e0189-d0d8-48ff-8fd5-4d1318bdc931 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:40.717821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795e0189-d0d8-48ff-8fd5-4d1318bdc931 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:40.718263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795e0189-d0d8-48ff-8fd5-4d1318bdc931 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:40.718976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795e0189-d0d8-48ff-8fd5-4d1318bdc931 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:40.719454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795e0189-d0d8-48ff-8fd5-4d1318bdc931 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:40.719886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-795e0189-d0d8-48ff-8fd5-4d1318bdc931 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:40.862004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-795e0189-d0d8-48ff-8fd5-4d1318bdc931 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:40.869682 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-795e0189-d0d8-48ff-8fd5-4d1318bdc931 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.164274 Oct 04 19:00:40.870246 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3616/7227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:40 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:41.893429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1194c6c1-b27d-4624-bcdb-61c877f7cda3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:41.893997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1194c6c1-b27d-4624-bcdb-61c877f7cda3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:41.900829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1194c6c1-b27d-4624-bcdb-61c877f7cda3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:41.901329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1194c6c1-b27d-4624-bcdb-61c877f7cda3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:41.901781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1194c6c1-b27d-4624-bcdb-61c877f7cda3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:41.902487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1194c6c1-b27d-4624-bcdb-61c877f7cda3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:41.902982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1194c6c1-b27d-4624-bcdb-61c877f7cda3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:41.903418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1194c6c1-b27d-4624-bcdb-61c877f7cda3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:41.905964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=92 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:42.039351 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1194c6c1-b27d-4624-bcdb-61c877f7cda3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:42.047737 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1194c6c1-b27d-4624-bcdb-61c877f7cda3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1517 microversion: 2.1 time: 0.158311 Oct 04 19:00:42.048319 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3612/7228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:41 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:43.073776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fc5b4a80-40b5-49b6-93fa-20bcf296c04a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:43.074395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fc5b4a80-40b5-49b6-93fa-20bcf296c04a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:43.082244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc5b4a80-40b5-49b6-93fa-20bcf296c04a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:43.082741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc5b4a80-40b5-49b6-93fa-20bcf296c04a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:43.083218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc5b4a80-40b5-49b6-93fa-20bcf296c04a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:43.083934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc5b4a80-40b5-49b6-93fa-20bcf296c04a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:43.084394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc5b4a80-40b5-49b6-93fa-20bcf296c04a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:43.084966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc5b4a80-40b5-49b6-93fa-20bcf296c04a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:43.088472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:43.221757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fc5b4a80-40b5-49b6-93fa-20bcf296c04a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:43.229742 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fc5b4a80-40b5-49b6-93fa-20bcf296c04a tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1516 microversion: 2.1 time: 0.159858 Oct 04 19:00:43.231188 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3617/7229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:43 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:43.520676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-08514a5f-7a19-4dec-8968-37d92764bffd req-b6300b0a-7981-42f3-9989-f6e3c657f4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9bf74f-590a-4c7e-ba5d-204e28fc869e", "name": "network-vif-unplugged", "status": "completed", "tag": "ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:43.531481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-08514a5f-7a19-4dec-8968-37d92764bffd req-b6300b0a-7981-42f3-9989-f6e3c657f4e3 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:43.531980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-08514a5f-7a19-4dec-8968-37d92764bffd req-b6300b0a-7981-42f3-9989-f6e3c657f4e3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:43.532431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-08514a5f-7a19-4dec-8968-37d92764bffd req-b6300b0a-7981-42f3-9989-f6e3c657f4e3 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:43.544495 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-08514a5f-7a19-4dec-8968-37d92764bffd req-b6300b0a-7981-42f3-9989-f6e3c657f4e3 service nova] Creating event network-vif-unplugged:ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f for instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e on n-h1-850499-14 Oct 04 19:00:43.550077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-08514a5f-7a19-4dec-8968-37d92764bffd req-b6300b0a-7981-42f3-9989-f6e3c657f4e3 service nova] Instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:00:43.561488 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-08514a5f-7a19-4dec-8968-37d92764bffd req-b6300b0a-7981-42f3-9989-f6e3c657f4e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044647 Oct 04 19:00:43.562206 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3613/7230] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:44.253738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ce8b7d17-2d0a-458a-bf32-50b000201024 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:44.254304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ce8b7d17-2d0a-458a-bf32-50b000201024 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:44.261369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b7d17-2d0a-458a-bf32-50b000201024 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:44.261854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b7d17-2d0a-458a-bf32-50b000201024 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:44.262300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b7d17-2d0a-458a-bf32-50b000201024 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:44.263019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b7d17-2d0a-458a-bf32-50b000201024 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:44.263480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b7d17-2d0a-458a-bf32-50b000201024 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:44.263906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ce8b7d17-2d0a-458a-bf32-50b000201024 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:44.394138 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ce8b7d17-2d0a-458a-bf32-50b000201024 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:44.402563 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ce8b7d17-2d0a-458a-bf32-50b000201024 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1516 microversion: 2.1 time: 0.152798 Oct 04 19:00:44.403256 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3618/7231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:44 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:45.427409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e03ede2c-009e-47e9-96c8-e13bdd644ecd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:45.428130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e03ede2c-009e-47e9-96c8-e13bdd644ecd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:45.434689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e03ede2c-009e-47e9-96c8-e13bdd644ecd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:45.435218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e03ede2c-009e-47e9-96c8-e13bdd644ecd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:45.435678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e03ede2c-009e-47e9-96c8-e13bdd644ecd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:45.436396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e03ede2c-009e-47e9-96c8-e13bdd644ecd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:45.436872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e03ede2c-009e-47e9-96c8-e13bdd644ecd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:45.437312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e03ede2c-009e-47e9-96c8-e13bdd644ecd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:45.571944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e03ede2c-009e-47e9-96c8-e13bdd644ecd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:45.579674 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e03ede2c-009e-47e9-96c8-e13bdd644ecd tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1514 microversion: 2.1 time: 0.157562 Oct 04 19:00:45.580247 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3614/7232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:45 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:45.587627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-682aba62-2f57-4fac-9fe1-dbe34d8d3479 req-67bd4c2a-f242-4393-9fb0-99af9eda135c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9bf74f-590a-4c7e-ba5d-204e28fc869e", "tag": "ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:45.597969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-682aba62-2f57-4fac-9fe1-dbe34d8d3479 req-67bd4c2a-f242-4393-9fb0-99af9eda135c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:45.598448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-682aba62-2f57-4fac-9fe1-dbe34d8d3479 req-67bd4c2a-f242-4393-9fb0-99af9eda135c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:45.598882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-682aba62-2f57-4fac-9fe1-dbe34d8d3479 req-67bd4c2a-f242-4393-9fb0-99af9eda135c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:45.610402 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-682aba62-2f57-4fac-9fe1-dbe34d8d3479 req-67bd4c2a-f242-4393-9fb0-99af9eda135c service nova] Creating event network-changed:ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f for instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e on n-h1-850499-14 Oct 04 19:00:45.615646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-682aba62-2f57-4fac-9fe1-dbe34d8d3479 req-67bd4c2a-f242-4393-9fb0-99af9eda135c service nova] Instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:00:45.626786 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-682aba62-2f57-4fac-9fe1-dbe34d8d3479 req-67bd4c2a-f242-4393-9fb0-99af9eda135c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043396 Oct 04 19:00:45.627431 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3619/7233] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:46.604237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3cdb757c-0c1c-48e8-b5fd-9b997a8cb2f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:46.604779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3cdb757c-0c1c-48e8-b5fd-9b997a8cb2f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:46.611631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cdb757c-0c1c-48e8-b5fd-9b997a8cb2f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:46.612082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cdb757c-0c1c-48e8-b5fd-9b997a8cb2f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:46.612537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cdb757c-0c1c-48e8-b5fd-9b997a8cb2f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:46.613239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cdb757c-0c1c-48e8-b5fd-9b997a8cb2f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:46.613712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cdb757c-0c1c-48e8-b5fd-9b997a8cb2f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:46.614148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3cdb757c-0c1c-48e8-b5fd-9b997a8cb2f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:46.744960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3cdb757c-0c1c-48e8-b5fd-9b997a8cb2f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:46.752715 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3cdb757c-0c1c-48e8-b5fd-9b997a8cb2f4 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1511 microversion: 2.1 time: 0.153049 Oct 04 19:00:46.753305 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3615/7234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:46 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:46.778498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-12c498e2-6966-4a0d-ac4c-ccae482a1187 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:46.779164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-12c498e2-6966-4a0d-ac4c-ccae482a1187 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:46.785325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12c498e2-6966-4a0d-ac4c-ccae482a1187 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:46.785835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12c498e2-6966-4a0d-ac4c-ccae482a1187 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:46.786270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12c498e2-6966-4a0d-ac4c-ccae482a1187 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:46.786988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12c498e2-6966-4a0d-ac4c-ccae482a1187 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:46.787457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12c498e2-6966-4a0d-ac4c-ccae482a1187 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:46.787892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12c498e2-6966-4a0d-ac4c-ccae482a1187 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:46.844748 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-12c498e2-6966-4a0d-ac4c-ccae482a1187 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "POST /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e/action" status: 204 len: 0 microversion: 2.1 time: 0.071950 Oct 04 19:00:46.845411 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3620/7235] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:00:46 2022] POST /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:00:46.854859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ad237cd8-b658-40ca-aca4-df3460e0ac0f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:46.855741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ad237cd8-b658-40ca-aca4-df3460e0ac0f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:46.862689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad237cd8-b658-40ca-aca4-df3460e0ac0f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:46.863356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad237cd8-b658-40ca-aca4-df3460e0ac0f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:46.863839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad237cd8-b658-40ca-aca4-df3460e0ac0f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:46.864671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad237cd8-b658-40ca-aca4-df3460e0ac0f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:46.865158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad237cd8-b658-40ca-aca4-df3460e0ac0f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:46.865607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ad237cd8-b658-40ca-aca4-df3460e0ac0f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:47.007715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ad237cd8-b658-40ca-aca4-df3460e0ac0f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:47.016520 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ad237cd8-b658-40ca-aca4-df3460e0ac0f tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1511 microversion: 2.1 time: 0.166763 Oct 04 19:00:47.017118 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3616/7236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:46 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:48.042357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-be20e627-6e1a-4190-860d-4b6bf833edc6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:48.043047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-be20e627-6e1a-4190-860d-4b6bf833edc6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:48.045431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=30 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:48.050939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be20e627-6e1a-4190-860d-4b6bf833edc6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:48.051469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be20e627-6e1a-4190-860d-4b6bf833edc6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:48.051914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be20e627-6e1a-4190-860d-4b6bf833edc6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:48.052625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be20e627-6e1a-4190-860d-4b6bf833edc6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:48.053082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be20e627-6e1a-4190-860d-4b6bf833edc6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:48.053518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-be20e627-6e1a-4190-860d-4b6bf833edc6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:48.194708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-be20e627-6e1a-4190-860d-4b6bf833edc6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:48.202596 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-be20e627-6e1a-4190-860d-4b6bf833edc6 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1511 microversion: 2.1 time: 0.166061 Oct 04 19:00:48.203208 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3621/7237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:48 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:49.204790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4a840362-5eb2-492c-99a9-a7ca2658bc8a req-8b23685b-f6b4-45b4-878c-71e9cf2b16b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9bf74f-590a-4c7e-ba5d-204e28fc869e", "name": "network-vif-plugged", "status": "completed", "tag": "ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:49.211376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=30 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:49.218365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4a840362-5eb2-492c-99a9-a7ca2658bc8a req-8b23685b-f6b4-45b4-878c-71e9cf2b16b1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.218883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4a840362-5eb2-492c-99a9-a7ca2658bc8a req-8b23685b-f6b4-45b4-878c-71e9cf2b16b1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.219360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4a840362-5eb2-492c-99a9-a7ca2658bc8a req-8b23685b-f6b4-45b4-878c-71e9cf2b16b1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.228540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0b7cde42-e4d1-4b21-b1e6-63de3aa7d0e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:49.229240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0b7cde42-e4d1-4b21-b1e6-63de3aa7d0e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:49.232451 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4a840362-5eb2-492c-99a9-a7ca2658bc8a req-8b23685b-f6b4-45b4-878c-71e9cf2b16b1 service nova] Creating event network-vif-plugged:ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f for instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e on n-h1-850499-14 Oct 04 19:00:49.237708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7cde42-e4d1-4b21-b1e6-63de3aa7d0e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.238581 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4a840362-5eb2-492c-99a9-a7ca2658bc8a req-8b23685b-f6b4-45b4-878c-71e9cf2b16b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037025 Oct 04 19:00:49.238705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7cde42-e4d1-4b21-b1e6-63de3aa7d0e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.238705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7cde42-e4d1-4b21-b1e6-63de3aa7d0e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.239174 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3617/7238] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:49.239522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7cde42-e4d1-4b21-b1e6-63de3aa7d0e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.240155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7cde42-e4d1-4b21-b1e6-63de3aa7d0e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.240590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b7cde42-e4d1-4b21-b1e6-63de3aa7d0e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.380184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0b7cde42-e4d1-4b21-b1e6-63de3aa7d0e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:49.388016 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0b7cde42-e4d1-4b21-b1e6-63de3aa7d0e7 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1503 microversion: 2.1 time: 0.164958 Oct 04 19:00:49.388675 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3622/7239] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:49 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:49.410905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d86ef27d-8a5b-4654-a0e7-ee3678e66902 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:49.411775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d86ef27d-8a5b-4654-a0e7-ee3678e66902 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:49.418487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d86ef27d-8a5b-4654-a0e7-ee3678e66902 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.419020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d86ef27d-8a5b-4654-a0e7-ee3678e66902 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.419481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d86ef27d-8a5b-4654-a0e7-ee3678e66902 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.420195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d86ef27d-8a5b-4654-a0e7-ee3678e66902 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.420675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d86ef27d-8a5b-4654-a0e7-ee3678e66902 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.421123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d86ef27d-8a5b-4654-a0e7-ee3678e66902 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.558448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d86ef27d-8a5b-4654-a0e7-ee3678e66902 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:49.566217 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d86ef27d-8a5b-4654-a0e7-ee3678e66902 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1503 microversion: 2.1 time: 0.159460 Oct 04 19:00:49.567075 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3618/7240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:49 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:49.589164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-026de4f1-163d-4822-a1a4-3ba2971f5f1d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:49.589719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-026de4f1-163d-4822-a1a4-3ba2971f5f1d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:49.595780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026de4f1-163d-4822-a1a4-3ba2971f5f1d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.596281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026de4f1-163d-4822-a1a4-3ba2971f5f1d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.596723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026de4f1-163d-4822-a1a4-3ba2971f5f1d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.597427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026de4f1-163d-4822-a1a4-3ba2971f5f1d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.597891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026de4f1-163d-4822-a1a4-3ba2971f5f1d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.598326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-026de4f1-163d-4822-a1a4-3ba2971f5f1d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.727012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-026de4f1-163d-4822-a1a4-3ba2971f5f1d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:49.735388 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-026de4f1-163d-4822-a1a4-3ba2971f5f1d tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1503 microversion: 2.1 time: 0.150563 Oct 04 19:00:49.735966 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3623/7241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:49 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:49.757245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94af35d2-182f-40d5-9cbd-bee249974041 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:49.757769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-94af35d2-182f-40d5-9cbd-bee249974041 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:49.763946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94af35d2-182f-40d5-9cbd-bee249974041 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.764457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94af35d2-182f-40d5-9cbd-bee249974041 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.764916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94af35d2-182f-40d5-9cbd-bee249974041 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.765633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94af35d2-182f-40d5-9cbd-bee249974041 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.766138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94af35d2-182f-40d5-9cbd-bee249974041 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.766588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94af35d2-182f-40d5-9cbd-bee249974041 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.792719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-94af35d2-182f-40d5-9cbd-bee249974041 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:00:49.869766 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-94af35d2-182f-40d5-9cbd-bee249974041 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 204 len: 0 microversion: 2.1 time: 0.116074 Oct 04 19:00:49.870871 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3619/7242] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:49 2022] DELETE /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:00:49.884822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:49.885324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:49.891600 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.892092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.892538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.893240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.893698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.894128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.919798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:00:49.964391 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.compute.api [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Instance is already in deleting state, ignoring this request Oct 04 19:00:49.965221 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-94e78818-fffa-48b4-b04f-007bc4824dc9 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 204 len: 0 microversion: 2.1 time: 0.084925 Oct 04 19:00:49.965786 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3624/7243] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:49 2022] DELETE /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:00:49.974303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d0c7129d-7e6b-407f-ae81-956834fdcd92 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:49.975057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d0c7129d-7e6b-407f-ae81-956834fdcd92 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:49.981093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0c7129d-7e6b-407f-ae81-956834fdcd92 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.981593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0c7129d-7e6b-407f-ae81-956834fdcd92 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.982047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0c7129d-7e6b-407f-ae81-956834fdcd92 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.982758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0c7129d-7e6b-407f-ae81-956834fdcd92 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.983252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0c7129d-7e6b-407f-ae81-956834fdcd92 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.983697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d0c7129d-7e6b-407f-ae81-956834fdcd92 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:50.117454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d0c7129d-7e6b-407f-ae81-956834fdcd92 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:50.125385 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d0c7129d-7e6b-407f-ae81-956834fdcd92 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1509 microversion: 2.1 time: 0.155199 Oct 04 19:00:50.125886 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3620/7244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:49 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:51.159007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4e7fc467-76ea-4587-aff3-3810a6cb43a1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:51.159641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4e7fc467-76ea-4587-aff3-3810a6cb43a1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:51.167097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e7fc467-76ea-4587-aff3-3810a6cb43a1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:51.167594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e7fc467-76ea-4587-aff3-3810a6cb43a1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:51.168034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e7fc467-76ea-4587-aff3-3810a6cb43a1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:51.168743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e7fc467-76ea-4587-aff3-3810a6cb43a1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:51.169229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e7fc467-76ea-4587-aff3-3810a6cb43a1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:51.169657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e7fc467-76ea-4587-aff3-3810a6cb43a1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:51.300470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4e7fc467-76ea-4587-aff3-3810a6cb43a1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:51.308392 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4e7fc467-76ea-4587-aff3-3810a6cb43a1 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1509 microversion: 2.1 time: 0.157292 Oct 04 19:00:51.308969 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3625/7245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:51 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:51.868121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2030a94a-fc72-4aa3-85c8-f3163ebb4311 req-3b2b2742-0b75-487d-915e-893250589247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9bf74f-590a-4c7e-ba5d-204e28fc869e", "name": "network-vif-deleted", "tag": "ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:51.880783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2030a94a-fc72-4aa3-85c8-f3163ebb4311 req-3b2b2742-0b75-487d-915e-893250589247 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:51.881291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2030a94a-fc72-4aa3-85c8-f3163ebb4311 req-3b2b2742-0b75-487d-915e-893250589247 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:51.881746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2030a94a-fc72-4aa3-85c8-f3163ebb4311 req-3b2b2742-0b75-487d-915e-893250589247 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:51.894158 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2030a94a-fc72-4aa3-85c8-f3163ebb4311 req-3b2b2742-0b75-487d-915e-893250589247 service nova] Creating event network-vif-deleted:ec17ffe5-7aca-49d5-bbfc-8f236bf0a03f for instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e on n-h1-850499-14 Oct 04 19:00:51.899854 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2030a94a-fc72-4aa3-85c8-f3163ebb4311 req-3b2b2742-0b75-487d-915e-893250589247 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034869 Oct 04 19:00:51.900830 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3621/7246] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:52.332294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:52.332824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:52.340423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:52.340914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:52.341353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:52.342067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:52.342518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:52.342945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:52.375307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:52.375798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:52.376235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:52.376689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lazy-loading 'fault' on Instance uuid 2c9bf74f-590a-4c7e-ba5d-204e28fc869e {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:00:52.427238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb2a3dfa0f04eeaab3fdcfeea6b64b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82efffb87700428bb359d0145e1640a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:52.439564 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f27f49e1-dfcf-456a-babb-82458234120b tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 200 len: 1304 microversion: 2.1 time: 0.111030 Oct 04 19:00:52.448213 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3626/7247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:52 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:53.472947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:53.473665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 2c9bf74f-590a-4c7e-ba5d-204e28fc869e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:53.480817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:53.481347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:53.481800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:53.482506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:53.483005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:53.483446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:53.499259 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] HTTP exception thrown: Instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e could not be found. Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Request method failure captured: Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e HTTP/1.1 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIJ7vwpi5ldJrWUtOh2JsY7EL84DWnr6jkKBjeeR3hVWoLxQBkDgfp5Lul3CKnMcQREnPbzOxixRbgyWLA-4U1p9LcJw90dn0kzT3IYsqx6U7bhfWjtR7jWNw6MkR3YIJEa4i3611Ja1_J-MQc5weMX143I-bOmRFEKsXEAvnDXthL4 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 82efffb87700428bb359d0145e1640a2 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1136728100 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82efffb87700428bb359d0145e1640a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82efffb87700428bb359d0145e1640a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82efffb87700428bb359d0145e1640a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82efffb87700428bb359d0145e1640a2"}]}] Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerDiskConfigTestJSON-1136728100 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 82efffb87700428bb359d0145e1640a2 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1136728100 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerDiskConfigTestJSON-1136728100-project Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: deb2a3dfa0f04eeaab3fdcfeea6b64b4 Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerDiskConfigTestJSON-1136728100-project Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e could not be found. Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '2c9bf74f-590a-4c7e-ba5d-204e28fc869e'} Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e could not be found. Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e could not be found. Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:53.500926 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:00:53.506062 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:53.506062 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:53.506062 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:53.506062 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:53.506062 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:53.506062 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e could not be found. Oct 04 19:00:53.506062 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:00:53.506062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Returning 404 to user: Instance 2c9bf74f-590a-4c7e-ba5d-204e28fc869e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:53.506062 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1faffaa9-8aec-4936-a9a8-b795475bb01c tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e" status: 404 len: 111 microversion: 2.1 time: 0.034590 Oct 04 19:00:53.506062 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3622/7248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:53 2022] GET /compute/v2.1/servers/2c9bf74f-590a-4c7e-ba5d-204e28fc869e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:53.512407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59640c96-bd1d-4ac1-b1ef-80bc8631c7c3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '.version_select at 0x7fd4d128bdc0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:53.534932 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59640c96-bd1d-4ac1-b1ef-80bc8631c7c3 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273119235" status: 202 len: 0 microversion: 2.1 time: 0.026294 Oct 04 19:00:53.535556 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3627/7249] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 19:00:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273119235 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:00:54.167271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:54.167788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:54.174023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:54.174521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:54.174990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:54.176893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:54.176893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:54.176893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:54.190611 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] HTTP exception thrown: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Request method failure captured: Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad HTTP/1.1 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIJ7vwpi5ldJrWUtOh2JsY7EL84DWnr6jkKBjeeR3hVWoLxQBkDgfp5Lul3CKnMcQREnPbzOxixRbgyWLA-4U1p9LcJw90dn0kzT3IYsqx6U7bhfWjtR7jWNw6MkR3YIJEa4i3611Ja1_J-MQc5weMX143I-bOmRFEKsXEAvnDXthL4 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 82efffb87700428bb359d0145e1640a2 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1136728100 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82efffb87700428bb359d0145e1640a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82efffb87700428bb359d0145e1640a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82efffb87700428bb359d0145e1640a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82efffb87700428bb359d0145e1640a2"}]}] Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerDiskConfigTestJSON-1136728100 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 82efffb87700428bb359d0145e1640a2 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1136728100 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerDiskConfigTestJSON-1136728100-project Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: deb2a3dfa0f04eeaab3fdcfeea6b64b4 Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerDiskConfigTestJSON-1136728100-project Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '681fe84d-f07c-483d-b6d0-d012e456c3ad'} Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:54.192439 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Returning 404 to user: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0c31a840-7ab1-4765-9ffc-ba406a9f27ad tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "DELETE /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 404 len: 111 microversion: 2.1 time: 0.030726 Oct 04 19:00:54.197911 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3623/7250] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:54 2022] DELETE /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:54.203540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:54.204161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] [instance: 681fe84d-f07c-483d-b6d0-d012e456c3ad] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:54.211028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:54.211552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:54.212025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:54.212753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:54.213217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:54.213647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:54.229516 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] HTTP exception thrown: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Request method failure captured: Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad HTTP/1.1 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIJ7vwpi5ldJrWUtOh2JsY7EL84DWnr6jkKBjeeR3hVWoLxQBkDgfp5Lul3CKnMcQREnPbzOxixRbgyWLA-4U1p9LcJw90dn0kzT3IYsqx6U7bhfWjtR7jWNw6MkR3YIJEa4i3611Ja1_J-MQc5weMX143I-bOmRFEKsXEAvnDXthL4 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 82efffb87700428bb359d0145e1640a2 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1136728100 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82efffb87700428bb359d0145e1640a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82efffb87700428bb359d0145e1640a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82efffb87700428bb359d0145e1640a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82efffb87700428bb359d0145e1640a2"}]}] Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerDiskConfigTestJSON-1136728100 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 82efffb87700428bb359d0145e1640a2 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1136728100 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerDiskConfigTestJSON-1136728100-project Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: deb2a3dfa0f04eeaab3fdcfeea6b64b4 Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerDiskConfigTestJSON-1136728100-project Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '681fe84d-f07c-483d-b6d0-d012e456c3ad'} Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:54.231221 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:00:54.235983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:54.235983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:54.235983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:54.235983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:54.235983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:54.235983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. Oct 04 19:00:54.235983 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:00:54.235983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] Returning 404 to user: Instance 681fe84d-f07c-483d-b6d0-d012e456c3ad could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:54.235983 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa6d3401-0f0c-4133-9100-1c3ab031b3d8 tempest-ServerDiskConfigTestJSON-1136728100 tempest-ServerDiskConfigTestJSON-1136728100-project] 10.222.0.18 "GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad" status: 404 len: 111 microversion: 2.1 time: 0.033051 Oct 04 19:00:54.235983 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3628/7251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:54 2022] GET /compute/v2.1/servers/681fe84d-f07c-483d-b6d0-d012e456c3ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:01:03.321177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-426c1ea4-7189-4544-987e-514088f60044 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'create', calling method: .version_select at 0x7fd4d09fa3a0>, body: {"keypair": {"name": "tempest-keypair-1790208000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGdu//2GzlOQidiUnIWkCfqxuy9bAhBXw2haqle9ZBy8q2TbN2H++ZNDnS1prRaDykkyD9OiSguvqQ5PWJ1zYEf0N5qEqH/q78g8XieHUSQb+s7N0c5KJh3yKzF0VJD8A=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:03.343924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-426c1ea4-7189-4544-987e-514088f60044 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for project f7092234754e459aa3fbabdf6ca10561. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:03.349378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-426c1ea4-7189-4544-987e-514088f60044 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for user b54bee64da524366a871ff5dac9bcc9e and project f7092234754e459aa3fbabdf6ca10561. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:03.380991 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-426c1ea4-7189-4544-987e-514088f60044 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.204519 Oct 04 19:01:03.381641 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3624/7252] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:01:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:04.744715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-977175165", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdbe1b23-6ed6-4348-8c83-9788a5980966"}], "security_groups": [{"name": "tempest-securitygroup--2043427521"}], "key_name": "tempest-keypair-1790208000", "user_data": "}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:04.754247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:04.754986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:04.871761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] validate_networks() for [('bdbe1b23-6ed6-4348-8c83-9788a5980966', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:01:05.365144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:01:05.365572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:01:05.366045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:01:05.366970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:01:05.367435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:01:05.381185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:05.381715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:05.382784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.383604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:05.384074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:05.384539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.409608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:05.415061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for user b54bee64da524366a871ff5dac9bcc9e and project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:05.428585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:01:05.431604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:01:05.482336 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-861805a3-f1e8-4b98-8064-1808cec982e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.741902 Oct 04 19:01:05.483045 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3629/7253] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:01:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:01:05.495448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ed65f4d-0bad-4ca6-8577-b0ca4f100fc1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:05.496078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ed65f4d-0bad-4ca6-8577-b0ca4f100fc1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:05.498857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:05.563621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ed65f4d-0bad-4ca6-8577-b0ca4f100fc1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:05.574561 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ed65f4d-0bad-4ca6-8577-b0ca4f100fc1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1238 microversion: 2.1 time: 0.083323 Oct 04 19:01:05.575351 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3625/7254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:05 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:06.598591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-88bdea3f-5f95-4c51-94d3-12197887705d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:06.599468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-88bdea3f-5f95-4c51-94d3-12197887705d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:06.606762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88bdea3f-5f95-4c51-94d3-12197887705d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:06.607325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88bdea3f-5f95-4c51-94d3-12197887705d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:06.608016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88bdea3f-5f95-4c51-94d3-12197887705d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:06.608844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88bdea3f-5f95-4c51-94d3-12197887705d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:06.609316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88bdea3f-5f95-4c51-94d3-12197887705d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:06.609753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88bdea3f-5f95-4c51-94d3-12197887705d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:06.686789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-88bdea3f-5f95-4c51-94d3-12197887705d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:06.697138 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-88bdea3f-5f95-4c51-94d3-12197887705d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1290 microversion: 2.1 time: 0.103159 Oct 04 19:01:06.697930 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3630/7255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:06 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:07.723144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-419b2c0d-dcb8-45e3-b61e-ba758491b4dd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:07.723932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-419b2c0d-dcb8-45e3-b61e-ba758491b4dd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:07.731714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-419b2c0d-dcb8-45e3-b61e-ba758491b4dd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:07.732298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-419b2c0d-dcb8-45e3-b61e-ba758491b4dd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:07.732822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-419b2c0d-dcb8-45e3-b61e-ba758491b4dd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:07.733550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-419b2c0d-dcb8-45e3-b61e-ba758491b4dd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:07.734025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-419b2c0d-dcb8-45e3-b61e-ba758491b4dd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:07.734473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-419b2c0d-dcb8-45e3-b61e-ba758491b4dd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:07.875072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-419b2c0d-dcb8-45e3-b61e-ba758491b4dd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:07.883562 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-419b2c0d-dcb8-45e3-b61e-ba758491b4dd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1364 microversion: 2.1 time: 0.165352 Oct 04 19:01:07.884153 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3626/7256] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:07 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:08.318508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-83ac6387-f6b8-413c-8ad7-116dcb0b37b5 req-828c2ef4-e4c6-45b9-9107-b28e66ac9671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdb1819-f055-4bf4-abaa-e49fa25af8ff", "tag": "cc6cb095-1cc9-42b6-98f9-053e8d56faad"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:08.331576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-83ac6387-f6b8-413c-8ad7-116dcb0b37b5 req-828c2ef4-e4c6-45b9-9107-b28e66ac9671 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:08.332276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-83ac6387-f6b8-413c-8ad7-116dcb0b37b5 req-828c2ef4-e4c6-45b9-9107-b28e66ac9671 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:08.332818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-83ac6387-f6b8-413c-8ad7-116dcb0b37b5 req-828c2ef4-e4c6-45b9-9107-b28e66ac9671 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:08.345583 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-83ac6387-f6b8-413c-8ad7-116dcb0b37b5 req-828c2ef4-e4c6-45b9-9107-b28e66ac9671 service nova] Creating event network-changed:cc6cb095-1cc9-42b6-98f9-053e8d56faad for instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff on n-h2-850499-14 Oct 04 19:01:08.350581 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-83ac6387-f6b8-413c-8ad7-116dcb0b37b5 req-828c2ef4-e4c6-45b9-9107-b28e66ac9671 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036363 Oct 04 19:01:08.351256 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3631/7257] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:08.908681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d1068fea-9e5f-4a72-9d66-186e9595d50b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:08.909324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d1068fea-9e5f-4a72-9d66-186e9595d50b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:08.917298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1068fea-9e5f-4a72-9d66-186e9595d50b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:08.917811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1068fea-9e5f-4a72-9d66-186e9595d50b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:08.918283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1068fea-9e5f-4a72-9d66-186e9595d50b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:08.919037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1068fea-9e5f-4a72-9d66-186e9595d50b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:08.919520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1068fea-9e5f-4a72-9d66-186e9595d50b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:08.919966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d1068fea-9e5f-4a72-9d66-186e9595d50b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.054897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d1068fea-9e5f-4a72-9d66-186e9595d50b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:09.062830 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d1068fea-9e5f-4a72-9d66-186e9595d50b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1364 microversion: 2.1 time: 0.158195 Oct 04 19:01:09.063366 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3627/7258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:08 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:10.086531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6696120f-6e5f-4a0c-a8ae-55ca87bd5edd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:10.087381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6696120f-6e5f-4a0c-a8ae-55ca87bd5edd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:10.093960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6696120f-6e5f-4a0c-a8ae-55ca87bd5edd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:10.094453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6696120f-6e5f-4a0c-a8ae-55ca87bd5edd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:10.094899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6696120f-6e5f-4a0c-a8ae-55ca87bd5edd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:10.095640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6696120f-6e5f-4a0c-a8ae-55ca87bd5edd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:10.096101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6696120f-6e5f-4a0c-a8ae-55ca87bd5edd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:10.096537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6696120f-6e5f-4a0c-a8ae-55ca87bd5edd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:10.234979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6696120f-6e5f-4a0c-a8ae-55ca87bd5edd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:10.242853 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6696120f-6e5f-4a0c-a8ae-55ca87bd5edd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1364 microversion: 2.1 time: 0.161357 Oct 04 19:01:10.243467 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3632/7259] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:10 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:11.266592 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-de0fa4b5-d323-4c73-bb32-3b08f76592a7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:11.267535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-de0fa4b5-d323-4c73-bb32-3b08f76592a7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:11.274858 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0fa4b5-d323-4c73-bb32-3b08f76592a7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.275403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0fa4b5-d323-4c73-bb32-3b08f76592a7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.275864 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0fa4b5-d323-4c73-bb32-3b08f76592a7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.276590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0fa4b5-d323-4c73-bb32-3b08f76592a7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.277070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0fa4b5-d323-4c73-bb32-3b08f76592a7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.277519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-de0fa4b5-d323-4c73-bb32-3b08f76592a7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.415723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-de0fa4b5-d323-4c73-bb32-3b08f76592a7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:11.423694 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-de0fa4b5-d323-4c73-bb32-3b08f76592a7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1364 microversion: 2.1 time: 0.160889 Oct 04 19:01:11.427548 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3628/7260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:11 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:12.447830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00e6ca37-2edf-4383-8206-0c915898c50c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:12.448457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00e6ca37-2edf-4383-8206-0c915898c50c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:12.455472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e6ca37-2edf-4383-8206-0c915898c50c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:12.455904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e6ca37-2edf-4383-8206-0c915898c50c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:12.456352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e6ca37-2edf-4383-8206-0c915898c50c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:12.457050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e6ca37-2edf-4383-8206-0c915898c50c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:12.457511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e6ca37-2edf-4383-8206-0c915898c50c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:12.458128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00e6ca37-2edf-4383-8206-0c915898c50c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:12.595518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00e6ca37-2edf-4383-8206-0c915898c50c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:12.604426 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00e6ca37-2edf-4383-8206-0c915898c50c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1364 microversion: 2.1 time: 0.160544 Oct 04 19:01:12.605015 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3633/7261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:12 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:13.629127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a58e22f3-0dda-4a09-af9b-8e7dcff2997a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:13.629759 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a58e22f3-0dda-4a09-af9b-8e7dcff2997a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:13.638166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a58e22f3-0dda-4a09-af9b-8e7dcff2997a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:13.638674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a58e22f3-0dda-4a09-af9b-8e7dcff2997a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:13.639163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a58e22f3-0dda-4a09-af9b-8e7dcff2997a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:13.639931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a58e22f3-0dda-4a09-af9b-8e7dcff2997a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:13.640409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a58e22f3-0dda-4a09-af9b-8e7dcff2997a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:13.641167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a58e22f3-0dda-4a09-af9b-8e7dcff2997a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:13.778489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a58e22f3-0dda-4a09-af9b-8e7dcff2997a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:13.786462 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a58e22f3-0dda-4a09-af9b-8e7dcff2997a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1364 microversion: 2.1 time: 0.161381 Oct 04 19:01:13.787053 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3629/7262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:13 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:14.809839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-43b19f70-ad65-4cfc-82b5-f84a93b0f71c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:14.810507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-43b19f70-ad65-4cfc-82b5-f84a93b0f71c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:14.819028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43b19f70-ad65-4cfc-82b5-f84a93b0f71c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:14.819522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43b19f70-ad65-4cfc-82b5-f84a93b0f71c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:14.819962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43b19f70-ad65-4cfc-82b5-f84a93b0f71c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:14.820670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43b19f70-ad65-4cfc-82b5-f84a93b0f71c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:14.821132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43b19f70-ad65-4cfc-82b5-f84a93b0f71c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:14.821560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-43b19f70-ad65-4cfc-82b5-f84a93b0f71c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:14.953780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-43b19f70-ad65-4cfc-82b5-f84a93b0f71c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:14.962203 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-43b19f70-ad65-4cfc-82b5-f84a93b0f71c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1364 microversion: 2.1 time: 0.156297 Oct 04 19:01:14.962778 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3634/7263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:14 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:15.310830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-1c3f9f2c-3604-4170-99b4-e017f319849a req-227a9120-d18b-49c5-abef-9308258c3b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdb1819-f055-4bf4-abaa-e49fa25af8ff", "name": "network-vif-plugged", "status": "completed", "tag": "cc6cb095-1cc9-42b6-98f9-053e8d56faad"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:15.322388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1c3f9f2c-3604-4170-99b4-e017f319849a req-227a9120-d18b-49c5-abef-9308258c3b68 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:15.323029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1c3f9f2c-3604-4170-99b4-e017f319849a req-227a9120-d18b-49c5-abef-9308258c3b68 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:15.323495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1c3f9f2c-3604-4170-99b4-e017f319849a req-227a9120-d18b-49c5-abef-9308258c3b68 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:15.337222 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1c3f9f2c-3604-4170-99b4-e017f319849a req-227a9120-d18b-49c5-abef-9308258c3b68 service nova] Creating event network-vif-plugged:cc6cb095-1cc9-42b6-98f9-053e8d56faad for instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff on n-h2-850499-14 Oct 04 19:01:15.343146 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-1c3f9f2c-3604-4170-99b4-e017f319849a req-227a9120-d18b-49c5-abef-9308258c3b68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036228 Oct 04 19:01:15.344428 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3630/7264] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:15.984515 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7d20d116-0dae-427c-a529-c1839d14a72f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:15.985178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7d20d116-0dae-427c-a529-c1839d14a72f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:15.987265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:15.987939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:15.995190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d20d116-0dae-427c-a529-c1839d14a72f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:15.995700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d20d116-0dae-427c-a529-c1839d14a72f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:15.996144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d20d116-0dae-427c-a529-c1839d14a72f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:15.996861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d20d116-0dae-427c-a529-c1839d14a72f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:15.997326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d20d116-0dae-427c-a529-c1839d14a72f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:15.997773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7d20d116-0dae-427c-a529-c1839d14a72f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:16.147389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7d20d116-0dae-427c-a529-c1839d14a72f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:16.157286 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7d20d116-0dae-427c-a529-c1839d14a72f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1364 microversion: 2.1 time: 0.176683 Oct 04 19:01:16.158317 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3635/7265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:15 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:17.180911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c75c8959-ac43-4001-b737-4fe0837eb15a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:17.181672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c75c8959-ac43-4001-b737-4fe0837eb15a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:17.183839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:17.190418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c75c8959-ac43-4001-b737-4fe0837eb15a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.190929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c75c8959-ac43-4001-b737-4fe0837eb15a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.191426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c75c8959-ac43-4001-b737-4fe0837eb15a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.192189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c75c8959-ac43-4001-b737-4fe0837eb15a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.192671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c75c8959-ac43-4001-b737-4fe0837eb15a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.193121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c75c8959-ac43-4001-b737-4fe0837eb15a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.337284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c75c8959-ac43-4001-b737-4fe0837eb15a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:17.345127 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c75c8959-ac43-4001-b737-4fe0837eb15a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1551 microversion: 2.1 time: 0.168528 Oct 04 19:01:17.345711 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3631/7266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:17 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:17.368238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-079c9aea-bb5f-41b8-bd1a-770bccbb6442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:17.368728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-079c9aea-bb5f-41b8-bd1a-770bccbb6442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:17.375640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-079c9aea-bb5f-41b8-bd1a-770bccbb6442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.376113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-079c9aea-bb5f-41b8-bd1a-770bccbb6442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.376547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-079c9aea-bb5f-41b8-bd1a-770bccbb6442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.377235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-079c9aea-bb5f-41b8-bd1a-770bccbb6442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.377693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-079c9aea-bb5f-41b8-bd1a-770bccbb6442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.378119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-079c9aea-bb5f-41b8-bd1a-770bccbb6442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.459790 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-079c9aea-bb5f-41b8-bd1a-770bccbb6442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095298 Oct 04 19:01:17.460394 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3636/7267] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 19:01:17 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:18.497469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-1ec0dd83-47fb-43d8-a9d0-446215032ce5 req-cc83230e-48fb-4c9b-a129-1b58440b9231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdb1819-f055-4bf4-abaa-e49fa25af8ff", "tag": "cc6cb095-1cc9-42b6-98f9-053e8d56faad"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:18.507369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1ec0dd83-47fb-43d8-a9d0-446215032ce5 req-cc83230e-48fb-4c9b-a129-1b58440b9231 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:18.507939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1ec0dd83-47fb-43d8-a9d0-446215032ce5 req-cc83230e-48fb-4c9b-a129-1b58440b9231 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:18.508452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1ec0dd83-47fb-43d8-a9d0-446215032ce5 req-cc83230e-48fb-4c9b-a129-1b58440b9231 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:18.519606 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1ec0dd83-47fb-43d8-a9d0-446215032ce5 req-cc83230e-48fb-4c9b-a129-1b58440b9231 service nova] Creating event network-changed:cc6cb095-1cc9-42b6-98f9-053e8d56faad for instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff on n-h2-850499-14 Oct 04 19:01:18.524911 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-1ec0dd83-47fb-43d8-a9d0-446215032ce5 req-cc83230e-48fb-4c9b-a129-1b58440b9231 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082662 Oct 04 19:01:18.525635 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3632/7268] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:34.671994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:34.672747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=38 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:34.677966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b4306181-80e8-4abf-80b9-7dfdd23e0e76 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:34.678579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b4306181-80e8-4abf-80b9-7dfdd23e0e76 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:34.688587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4306181-80e8-4abf-80b9-7dfdd23e0e76 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.689074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4306181-80e8-4abf-80b9-7dfdd23e0e76 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.689519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4306181-80e8-4abf-80b9-7dfdd23e0e76 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.690212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4306181-80e8-4abf-80b9-7dfdd23e0e76 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.690670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4306181-80e8-4abf-80b9-7dfdd23e0e76 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.691193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b4306181-80e8-4abf-80b9-7dfdd23e0e76 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.826521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b4306181-80e8-4abf-80b9-7dfdd23e0e76 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:34.835031 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b4306181-80e8-4abf-80b9-7dfdd23e0e76 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1669 microversion: 2.1 time: 0.165709 Oct 04 19:02:34.835597 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3637/7269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:34 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:34.855516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:34.856209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=34 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:34.857350 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 19:02:34.862233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-568a71ce-0841-402b-8c11-1c755cd676a1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:34.863008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-568a71ce-0841-402b-8c11-1c755cd676a1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:34.871396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-568a71ce-0841-402b-8c11-1c755cd676a1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.871901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-568a71ce-0841-402b-8c11-1c755cd676a1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.872350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-568a71ce-0841-402b-8c11-1c755cd676a1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.873060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-568a71ce-0841-402b-8c11-1c755cd676a1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.873549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-568a71ce-0841-402b-8c11-1c755cd676a1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.873991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-568a71ce-0841-402b-8c11-1c755cd676a1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.005199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-568a71ce-0841-402b-8c11-1c755cd676a1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:35.013022 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-568a71ce-0841-402b-8c11-1c755cd676a1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1669 microversion: 2.1 time: 0.159785 Oct 04 19:02:35.013592 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3633/7270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:34 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:35.036071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a253d133-4123-413e-957d-e39b0695762b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:35.036684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a253d133-4123-413e-957d-e39b0695762b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:35.042693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a253d133-4123-413e-957d-e39b0695762b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.043209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a253d133-4123-413e-957d-e39b0695762b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.043650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a253d133-4123-413e-957d-e39b0695762b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.044336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a253d133-4123-413e-957d-e39b0695762b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.044788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a253d133-4123-413e-957d-e39b0695762b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.045211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a253d133-4123-413e-957d-e39b0695762b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.175320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a253d133-4123-413e-957d-e39b0695762b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:35.183559 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a253d133-4123-413e-957d-e39b0695762b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1669 microversion: 2.1 time: 0.151405 Oct 04 19:02:35.184113 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3638/7271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:35 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:35.206652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:35.209037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:35.215090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.215600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.216059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.216772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.217252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.217699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.245726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:35.251140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Old instance type m1.heat2, new instance type m1.heat {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:02:35.258146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:02:35.258584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:02:35.259105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:02:35.259535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:02:35.259963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:02:35.323703 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e9854ecf-557e-430e-b22e-69a59541fe11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff/action" status: 202 len: 0 microversion: 2.1 time: 0.120920 Oct 04 19:02:35.324367 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3634/7272] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:35 2022] POST /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:35.332730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-83497ff4-e72b-493f-9302-904a1af9d54f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:35.333980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-83497ff4-e72b-493f-9302-904a1af9d54f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:35.340384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83497ff4-e72b-493f-9302-904a1af9d54f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.341448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83497ff4-e72b-493f-9302-904a1af9d54f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.341448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83497ff4-e72b-493f-9302-904a1af9d54f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.342257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83497ff4-e72b-493f-9302-904a1af9d54f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.342601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83497ff4-e72b-493f-9302-904a1af9d54f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.343046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-83497ff4-e72b-493f-9302-904a1af9d54f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.496527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-83497ff4-e72b-493f-9302-904a1af9d54f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:35.505040 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-83497ff4-e72b-493f-9302-904a1af9d54f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1678 microversion: 2.1 time: 0.176443 Oct 04 19:02:35.505890 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3639/7273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:35 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:36.529353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f304cb4-9c08-48c9-b2aa-c0e994470752 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:36.529991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f304cb4-9c08-48c9-b2aa-c0e994470752 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:36.537841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f304cb4-9c08-48c9-b2aa-c0e994470752 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:36.538353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f304cb4-9c08-48c9-b2aa-c0e994470752 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:36.538818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f304cb4-9c08-48c9-b2aa-c0e994470752 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:36.539580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f304cb4-9c08-48c9-b2aa-c0e994470752 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:36.540059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f304cb4-9c08-48c9-b2aa-c0e994470752 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:36.540505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f304cb4-9c08-48c9-b2aa-c0e994470752 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:36.678130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f304cb4-9c08-48c9-b2aa-c0e994470752 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:36.687139 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f304cb4-9c08-48c9-b2aa-c0e994470752 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1678 microversion: 2.1 time: 0.162178 Oct 04 19:02:36.687739 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3635/7274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:36 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:37.710807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e7c32a5d-dd69-4a6c-b17a-36a7a9ee61cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:37.711389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e7c32a5d-dd69-4a6c-b17a-36a7a9ee61cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:37.718497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7c32a5d-dd69-4a6c-b17a-36a7a9ee61cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:37.719020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7c32a5d-dd69-4a6c-b17a-36a7a9ee61cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:37.719473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7c32a5d-dd69-4a6c-b17a-36a7a9ee61cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:37.720186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7c32a5d-dd69-4a6c-b17a-36a7a9ee61cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:37.720650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7c32a5d-dd69-4a6c-b17a-36a7a9ee61cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:37.721083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e7c32a5d-dd69-4a6c-b17a-36a7a9ee61cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:37.858550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e7c32a5d-dd69-4a6c-b17a-36a7a9ee61cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:37.866980 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e7c32a5d-dd69-4a6c-b17a-36a7a9ee61cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1678 microversion: 2.1 time: 0.160137 Oct 04 19:02:37.867555 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3640/7275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:37 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:38.890886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-400184fb-4ad2-4db0-93e6-9174fd7c0f2e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:38.891593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-400184fb-4ad2-4db0-93e6-9174fd7c0f2e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:38.899179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-400184fb-4ad2-4db0-93e6-9174fd7c0f2e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:38.899694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-400184fb-4ad2-4db0-93e6-9174fd7c0f2e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:38.900157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-400184fb-4ad2-4db0-93e6-9174fd7c0f2e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:38.900874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-400184fb-4ad2-4db0-93e6-9174fd7c0f2e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:38.901357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-400184fb-4ad2-4db0-93e6-9174fd7c0f2e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:38.901808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-400184fb-4ad2-4db0-93e6-9174fd7c0f2e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:39.033620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-400184fb-4ad2-4db0-93e6-9174fd7c0f2e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:39.041382 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-400184fb-4ad2-4db0-93e6-9174fd7c0f2e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1683 microversion: 2.1 time: 0.154469 Oct 04 19:02:39.041957 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3636/7276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:38 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:40.065181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e867b910-9ae1-448e-9735-084ba29df432 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:40.066304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e867b910-9ae1-448e-9735-084ba29df432 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:40.073465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e867b910-9ae1-448e-9735-084ba29df432 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:40.073967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e867b910-9ae1-448e-9735-084ba29df432 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:40.074416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e867b910-9ae1-448e-9735-084ba29df432 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:40.075160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e867b910-9ae1-448e-9735-084ba29df432 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:40.075633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e867b910-9ae1-448e-9735-084ba29df432 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:40.076078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e867b910-9ae1-448e-9735-084ba29df432 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:40.207051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e867b910-9ae1-448e-9735-084ba29df432 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:40.215141 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e867b910-9ae1-448e-9735-084ba29df432 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1683 microversion: 2.1 time: 0.154203 Oct 04 19:02:40.215718 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3641/7277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:40 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:41.239844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d4602de6-1376-4c54-a801-1e4761c24159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:41.240580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d4602de6-1376-4c54-a801-1e4761c24159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:41.247534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4602de6-1376-4c54-a801-1e4761c24159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:41.248051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4602de6-1376-4c54-a801-1e4761c24159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:41.248515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4602de6-1376-4c54-a801-1e4761c24159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:41.249238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4602de6-1376-4c54-a801-1e4761c24159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:41.249717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4602de6-1376-4c54-a801-1e4761c24159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:41.250167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d4602de6-1376-4c54-a801-1e4761c24159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:41.391548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d4602de6-1376-4c54-a801-1e4761c24159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:41.400309 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d4602de6-1376-4c54-a801-1e4761c24159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1683 microversion: 2.1 time: 0.165026 Oct 04 19:02:41.400894 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3637/7278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:41 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:42.422877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0fddc7c1-5ceb-4ccf-8e28-fffd9da403a0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:42.423516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0fddc7c1-5ceb-4ccf-8e28-fffd9da403a0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:42.430943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fddc7c1-5ceb-4ccf-8e28-fffd9da403a0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:42.431453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fddc7c1-5ceb-4ccf-8e28-fffd9da403a0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:42.431898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fddc7c1-5ceb-4ccf-8e28-fffd9da403a0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:42.432595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fddc7c1-5ceb-4ccf-8e28-fffd9da403a0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:42.433055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fddc7c1-5ceb-4ccf-8e28-fffd9da403a0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:42.433540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0fddc7c1-5ceb-4ccf-8e28-fffd9da403a0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:42.575315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0fddc7c1-5ceb-4ccf-8e28-fffd9da403a0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:42.585738 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0fddc7c1-5ceb-4ccf-8e28-fffd9da403a0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1683 microversion: 2.1 time: 0.166885 Oct 04 19:02:42.586322 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3642/7279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:42 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:43.609287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-45ebe7f6-46b9-48b0-81a5-7bdf7ce936ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:43.609869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-45ebe7f6-46b9-48b0-81a5-7bdf7ce936ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:43.617521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ebe7f6-46b9-48b0-81a5-7bdf7ce936ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:43.618037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ebe7f6-46b9-48b0-81a5-7bdf7ce936ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:43.618492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ebe7f6-46b9-48b0-81a5-7bdf7ce936ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:43.619224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ebe7f6-46b9-48b0-81a5-7bdf7ce936ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:43.619701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ebe7f6-46b9-48b0-81a5-7bdf7ce936ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:43.620138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-45ebe7f6-46b9-48b0-81a5-7bdf7ce936ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:43.750704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-45ebe7f6-46b9-48b0-81a5-7bdf7ce936ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:43.759012 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-45ebe7f6-46b9-48b0-81a5-7bdf7ce936ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1683 microversion: 2.1 time: 0.153705 Oct 04 19:02:43.759585 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3638/7280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:43 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:44.781789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ebb3083-df29-4b83-bb85-60d358c776e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:44.782349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ebb3083-df29-4b83-bb85-60d358c776e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:44.789298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ebb3083-df29-4b83-bb85-60d358c776e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:44.789787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ebb3083-df29-4b83-bb85-60d358c776e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:44.790229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ebb3083-df29-4b83-bb85-60d358c776e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:44.790922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ebb3083-df29-4b83-bb85-60d358c776e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:44.791402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ebb3083-df29-4b83-bb85-60d358c776e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:44.791827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ebb3083-df29-4b83-bb85-60d358c776e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:44.924256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ebb3083-df29-4b83-bb85-60d358c776e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:44.932562 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ebb3083-df29-4b83-bb85-60d358c776e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1683 microversion: 2.1 time: 0.154783 Oct 04 19:02:44.933144 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3643/7281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:44 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:45.957699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ed4f9fe-2040-4fcd-8e92-eb2f8649b6d0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:45.958345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7ed4f9fe-2040-4fcd-8e92-eb2f8649b6d0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:45.965542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed4f9fe-2040-4fcd-8e92-eb2f8649b6d0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.966054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed4f9fe-2040-4fcd-8e92-eb2f8649b6d0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.966511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed4f9fe-2040-4fcd-8e92-eb2f8649b6d0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.967279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed4f9fe-2040-4fcd-8e92-eb2f8649b6d0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.967764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed4f9fe-2040-4fcd-8e92-eb2f8649b6d0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.968217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ed4f9fe-2040-4fcd-8e92-eb2f8649b6d0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.104811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7ed4f9fe-2040-4fcd-8e92-eb2f8649b6d0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:46.112898 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ed4f9fe-2040-4fcd-8e92-eb2f8649b6d0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1683 microversion: 2.1 time: 0.159914 Oct 04 19:02:46.113522 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3639/7282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:45 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:47.145195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0911fade-e0a7-4b6a-a028-d08f2d1d78be tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:47.145195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0911fade-e0a7-4b6a-a028-d08f2d1d78be tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:47.149943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0911fade-e0a7-4b6a-a028-d08f2d1d78be tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:47.150440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0911fade-e0a7-4b6a-a028-d08f2d1d78be tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:47.150888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0911fade-e0a7-4b6a-a028-d08f2d1d78be tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:47.151629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0911fade-e0a7-4b6a-a028-d08f2d1d78be tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:47.152092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0911fade-e0a7-4b6a-a028-d08f2d1d78be tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:47.152524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0911fade-e0a7-4b6a-a028-d08f2d1d78be tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:47.288586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0911fade-e0a7-4b6a-a028-d08f2d1d78be tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:47.296490 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0911fade-e0a7-4b6a-a028-d08f2d1d78be tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1683 microversion: 2.1 time: 0.158152 Oct 04 19:02:47.297074 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3644/7283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:47 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:48.320390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ceda02ac-b712-4020-bdc0-8c1faa738d65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:48.321019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ceda02ac-b712-4020-bdc0-8c1faa738d65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:48.327851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceda02ac-b712-4020-bdc0-8c1faa738d65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.328353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceda02ac-b712-4020-bdc0-8c1faa738d65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.328801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceda02ac-b712-4020-bdc0-8c1faa738d65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.329505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceda02ac-b712-4020-bdc0-8c1faa738d65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.329976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceda02ac-b712-4020-bdc0-8c1faa738d65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.330412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ceda02ac-b712-4020-bdc0-8c1faa738d65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.461374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ceda02ac-b712-4020-bdc0-8c1faa738d65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:48.469108 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ceda02ac-b712-4020-bdc0-8c1faa738d65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1683 microversion: 2.1 time: 0.153150 Oct 04 19:02:48.469682 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3640/7284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:48 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:49.492570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-246c13a0-c613-4ee3-83d1-0fe45411f14e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:49.493206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-246c13a0-c613-4ee3-83d1-0fe45411f14e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:49.500871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246c13a0-c613-4ee3-83d1-0fe45411f14e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.501381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246c13a0-c613-4ee3-83d1-0fe45411f14e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.501836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246c13a0-c613-4ee3-83d1-0fe45411f14e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.502568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246c13a0-c613-4ee3-83d1-0fe45411f14e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.503066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246c13a0-c613-4ee3-83d1-0fe45411f14e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.503509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-246c13a0-c613-4ee3-83d1-0fe45411f14e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.641419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-246c13a0-c613-4ee3-83d1-0fe45411f14e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:49.649960 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-246c13a0-c613-4ee3-83d1-0fe45411f14e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1683 microversion: 2.1 time: 0.161436 Oct 04 19:02:49.650537 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3645/7285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:49 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:50.519315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-86bd85f5-e38f-4fdf-8228-9371e1890182 req-0b7cde4a-6951-401e-bada-ec946d9a401a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdb1819-f055-4bf4-abaa-e49fa25af8ff", "name": "network-vif-unplugged", "status": "completed", "tag": "cc6cb095-1cc9-42b6-98f9-053e8d56faad"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:50.531766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-86bd85f5-e38f-4fdf-8228-9371e1890182 req-0b7cde4a-6951-401e-bada-ec946d9a401a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.532268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-86bd85f5-e38f-4fdf-8228-9371e1890182 req-0b7cde4a-6951-401e-bada-ec946d9a401a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.532717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-86bd85f5-e38f-4fdf-8228-9371e1890182 req-0b7cde4a-6951-401e-bada-ec946d9a401a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.545321 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-86bd85f5-e38f-4fdf-8228-9371e1890182 req-0b7cde4a-6951-401e-bada-ec946d9a401a service nova] Creating event network-vif-unplugged:cc6cb095-1cc9-42b6-98f9-053e8d56faad for instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff on n-h1-850499-14 Oct 04 19:02:50.551675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-86bd85f5-e38f-4fdf-8228-9371e1890182 req-0b7cde4a-6951-401e-bada-ec946d9a401a service nova] Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:02:50.563243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-86bd85f5-e38f-4fdf-8228-9371e1890182 req-0b7cde4a-6951-401e-bada-ec946d9a401a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047774 Oct 04 19:02:50.563870 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3641/7286] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:50.673770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b39bfba2-0108-4bc0-853d-05e681966395 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:50.674383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b39bfba2-0108-4bc0-853d-05e681966395 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:50.682105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39bfba2-0108-4bc0-853d-05e681966395 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.682590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39bfba2-0108-4bc0-853d-05e681966395 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.683061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39bfba2-0108-4bc0-853d-05e681966395 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.683810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39bfba2-0108-4bc0-853d-05e681966395 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.684209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39bfba2-0108-4bc0-853d-05e681966395 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.684633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b39bfba2-0108-4bc0-853d-05e681966395 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.816934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b39bfba2-0108-4bc0-853d-05e681966395 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:50.825555 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b39bfba2-0108-4bc0-853d-05e681966395 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1682 microversion: 2.1 time: 0.155610 Oct 04 19:02:50.826144 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3646/7287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:50 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:51.851121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c0379212-3adf-4062-b956-490f06732be9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:51.851774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c0379212-3adf-4062-b956-490f06732be9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:51.858029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0379212-3adf-4062-b956-490f06732be9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.858542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0379212-3adf-4062-b956-490f06732be9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.859159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0379212-3adf-4062-b956-490f06732be9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.859882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0379212-3adf-4062-b956-490f06732be9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.860361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0379212-3adf-4062-b956-490f06732be9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.860828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c0379212-3adf-4062-b956-490f06732be9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.989841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c0379212-3adf-4062-b956-490f06732be9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:51.997703 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c0379212-3adf-4062-b956-490f06732be9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1680 microversion: 2.1 time: 0.151823 Oct 04 19:02:51.998290 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3642/7288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:51 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:52.599499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c6bb932d-a4aa-415a-826f-5e4f60b9d3f1 req-7c62cac1-4743-426b-a18d-b2cbbcc6f454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdb1819-f055-4bf4-abaa-e49fa25af8ff", "tag": "cc6cb095-1cc9-42b6-98f9-053e8d56faad"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:52.610402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c6bb932d-a4aa-415a-826f-5e4f60b9d3f1 req-7c62cac1-4743-426b-a18d-b2cbbcc6f454 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.610783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c6bb932d-a4aa-415a-826f-5e4f60b9d3f1 req-7c62cac1-4743-426b-a18d-b2cbbcc6f454 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.611300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c6bb932d-a4aa-415a-826f-5e4f60b9d3f1 req-7c62cac1-4743-426b-a18d-b2cbbcc6f454 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.623039 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c6bb932d-a4aa-415a-826f-5e4f60b9d3f1 req-7c62cac1-4743-426b-a18d-b2cbbcc6f454 service nova] Creating event network-changed:cc6cb095-1cc9-42b6-98f9-053e8d56faad for instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff on n-h1-850499-14 Oct 04 19:02:52.628371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-c6bb932d-a4aa-415a-826f-5e4f60b9d3f1 req-7c62cac1-4743-426b-a18d-b2cbbcc6f454 service nova] Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:02:52.639341 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c6bb932d-a4aa-415a-826f-5e4f60b9d3f1 req-7c62cac1-4743-426b-a18d-b2cbbcc6f454 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043921 Oct 04 19:02:52.639918 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3647/7289] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:53.022252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d6fabc39-e945-4dea-98b9-71d2d7f90769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:53.022774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d6fabc39-e945-4dea-98b9-71d2d7f90769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:53.029652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6fabc39-e945-4dea-98b9-71d2d7f90769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.030156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6fabc39-e945-4dea-98b9-71d2d7f90769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.030615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6fabc39-e945-4dea-98b9-71d2d7f90769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.031369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6fabc39-e945-4dea-98b9-71d2d7f90769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.031906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6fabc39-e945-4dea-98b9-71d2d7f90769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.032310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d6fabc39-e945-4dea-98b9-71d2d7f90769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.198439 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d6fabc39-e945-4dea-98b9-71d2d7f90769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:53.207506 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d6fabc39-e945-4dea-98b9-71d2d7f90769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1680 microversion: 2.1 time: 0.190026 Oct 04 19:02:53.208437 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3643/7290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:53 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:54.231685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b9c6563a-d281-48c5-ba94-b8ccef297269 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:54.232448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b9c6563a-d281-48c5-ba94-b8ccef297269 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:54.238622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9c6563a-d281-48c5-ba94-b8ccef297269 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.239212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9c6563a-d281-48c5-ba94-b8ccef297269 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.239657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9c6563a-d281-48c5-ba94-b8ccef297269 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.240354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9c6563a-d281-48c5-ba94-b8ccef297269 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.240809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9c6563a-d281-48c5-ba94-b8ccef297269 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.241237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b9c6563a-d281-48c5-ba94-b8ccef297269 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.372538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b9c6563a-d281-48c5-ba94-b8ccef297269 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:54.380770 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b9c6563a-d281-48c5-ba94-b8ccef297269 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1677 microversion: 2.1 time: 0.154336 Oct 04 19:02:54.381339 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3648/7291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:54 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:54.403845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eacd8030-e094-4e3e-b1fa-4c8e9ea3d57c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:54.404404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eacd8030-e094-4e3e-b1fa-4c8e9ea3d57c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:54.411364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eacd8030-e094-4e3e-b1fa-4c8e9ea3d57c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.412310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eacd8030-e094-4e3e-b1fa-4c8e9ea3d57c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.412310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eacd8030-e094-4e3e-b1fa-4c8e9ea3d57c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.413059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eacd8030-e094-4e3e-b1fa-4c8e9ea3d57c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.413902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eacd8030-e094-4e3e-b1fa-4c8e9ea3d57c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.414527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eacd8030-e094-4e3e-b1fa-4c8e9ea3d57c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.476993 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eacd8030-e094-4e3e-b1fa-4c8e9ea3d57c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff/action" status: 204 len: 0 microversion: 2.1 time: 0.076828 Oct 04 19:02:54.477570 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3644/7292] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:54 2022] POST /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:02:54.486380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-86365539-61a1-428b-8ab4-6d23e6482319 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:54.487023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-86365539-61a1-428b-8ab4-6d23e6482319 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:54.493497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86365539-61a1-428b-8ab4-6d23e6482319 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.494089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86365539-61a1-428b-8ab4-6d23e6482319 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.494614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86365539-61a1-428b-8ab4-6d23e6482319 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.495437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86365539-61a1-428b-8ab4-6d23e6482319 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.495966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86365539-61a1-428b-8ab4-6d23e6482319 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.496508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-86365539-61a1-428b-8ab4-6d23e6482319 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.637462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-86365539-61a1-428b-8ab4-6d23e6482319 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:54.645284 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-86365539-61a1-428b-8ab4-6d23e6482319 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1677 microversion: 2.1 time: 0.163471 Oct 04 19:02:54.645863 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3649/7293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:54 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:55.671275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1a3a3760-9aed-423b-b065-1977b1871637 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:55.671994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1a3a3760-9aed-423b-b065-1977b1871637 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:55.678188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a3a3760-9aed-423b-b065-1977b1871637 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.678685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a3a3760-9aed-423b-b065-1977b1871637 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.679170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a3a3760-9aed-423b-b065-1977b1871637 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.679881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a3a3760-9aed-423b-b065-1977b1871637 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.680380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a3a3760-9aed-423b-b065-1977b1871637 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.680821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1a3a3760-9aed-423b-b065-1977b1871637 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.821444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1a3a3760-9aed-423b-b065-1977b1871637 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:55.830441 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1a3a3760-9aed-423b-b065-1977b1871637 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1677 microversion: 2.1 time: 0.164360 Oct 04 19:02:55.831081 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3645/7294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:55 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:56.102214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-32ba5352-c0c2-4773-9825-c9671394bd90 req-52375b3c-736e-4d47-860f-43fad99dd70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdb1819-f055-4bf4-abaa-e49fa25af8ff", "name": "network-vif-plugged", "status": "completed", "tag": "cc6cb095-1cc9-42b6-98f9-053e8d56faad"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:56.112587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-32ba5352-c0c2-4773-9825-c9671394bd90 req-52375b3c-736e-4d47-860f-43fad99dd70b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:56.113082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-32ba5352-c0c2-4773-9825-c9671394bd90 req-52375b3c-736e-4d47-860f-43fad99dd70b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:56.113525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-32ba5352-c0c2-4773-9825-c9671394bd90 req-52375b3c-736e-4d47-860f-43fad99dd70b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:56.125247 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-32ba5352-c0c2-4773-9825-c9671394bd90 req-52375b3c-736e-4d47-860f-43fad99dd70b service nova] Creating event network-vif-plugged:cc6cb095-1cc9-42b6-98f9-053e8d56faad for instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff on n-h1-850499-14 Oct 04 19:02:56.130637 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-32ba5352-c0c2-4773-9825-c9671394bd90 req-52375b3c-736e-4d47-860f-43fad99dd70b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031579 Oct 04 19:02:56.131294 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3650/7295] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:56.855301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9c68dd9e-68f5-4126-a2ce-618c744f891d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:56.855997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9c68dd9e-68f5-4126-a2ce-618c744f891d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:56.863054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c68dd9e-68f5-4126-a2ce-618c744f891d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:56.863618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c68dd9e-68f5-4126-a2ce-618c744f891d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:56.864545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c68dd9e-68f5-4126-a2ce-618c744f891d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:56.865267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c68dd9e-68f5-4126-a2ce-618c744f891d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:56.865745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c68dd9e-68f5-4126-a2ce-618c744f891d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:56.866190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c68dd9e-68f5-4126-a2ce-618c744f891d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:56.995265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9c68dd9e-68f5-4126-a2ce-618c744f891d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:57.003037 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9c68dd9e-68f5-4126-a2ce-618c744f891d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1669 microversion: 2.1 time: 0.151756 Oct 04 19:02:57.003616 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3646/7296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:56 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:57.027612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-44ad352e-42aa-450b-88e1-4fb0d29cb717 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.028243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-44ad352e-42aa-450b-88e1-4fb0d29cb717 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.034324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44ad352e-42aa-450b-88e1-4fb0d29cb717 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.034809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44ad352e-42aa-450b-88e1-4fb0d29cb717 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.035312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44ad352e-42aa-450b-88e1-4fb0d29cb717 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.036057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44ad352e-42aa-450b-88e1-4fb0d29cb717 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.036514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44ad352e-42aa-450b-88e1-4fb0d29cb717 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.036945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44ad352e-42aa-450b-88e1-4fb0d29cb717 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.172773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-44ad352e-42aa-450b-88e1-4fb0d29cb717 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:57.181338 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-44ad352e-42aa-450b-88e1-4fb0d29cb717 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1669 microversion: 2.1 time: 0.157933 Oct 04 19:02:57.181923 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3651/7297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:57 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:57.204664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-72c18358-fed8-4e8d-b466-11db2ff9ce8f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.205293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-72c18358-fed8-4e8d-b466-11db2ff9ce8f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.211553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72c18358-fed8-4e8d-b466-11db2ff9ce8f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.212059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72c18358-fed8-4e8d-b466-11db2ff9ce8f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.212512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72c18358-fed8-4e8d-b466-11db2ff9ce8f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.213231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72c18358-fed8-4e8d-b466-11db2ff9ce8f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.213698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72c18358-fed8-4e8d-b466-11db2ff9ce8f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.214135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-72c18358-fed8-4e8d-b466-11db2ff9ce8f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.230125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:57.347741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-72c18358-fed8-4e8d-b466-11db2ff9ce8f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:57.356171 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-72c18358-fed8-4e8d-b466-11db2ff9ce8f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1669 microversion: 2.1 time: 0.155368 Oct 04 19:02:57.356753 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3647/7298] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:57 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:57.379044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a9918ad-d07a-4c9a-bd89-195ab14284e9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.379540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a9918ad-d07a-4c9a-bd89-195ab14284e9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.385588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a9918ad-d07a-4c9a-bd89-195ab14284e9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.386081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a9918ad-d07a-4c9a-bd89-195ab14284e9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.386523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a9918ad-d07a-4c9a-bd89-195ab14284e9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.387253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a9918ad-d07a-4c9a-bd89-195ab14284e9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.387720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a9918ad-d07a-4c9a-bd89-195ab14284e9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.388150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a9918ad-d07a-4c9a-bd89-195ab14284e9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.413682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a9918ad-d07a-4c9a-bd89-195ab14284e9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:02:57.463825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:57.493455 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a9918ad-d07a-4c9a-bd89-195ab14284e9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 204 len: 0 microversion: 2.1 time: 0.118044 Oct 04 19:02:57.494076 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3652/7299] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:02:57 2022] DELETE /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:02:57.503853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d50f8284-5a50-4ad1-b46a-500a31496c9a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.504567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d50f8284-5a50-4ad1-b46a-500a31496c9a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.510599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50f8284-5a50-4ad1-b46a-500a31496c9a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.511189 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50f8284-5a50-4ad1-b46a-500a31496c9a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.511654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50f8284-5a50-4ad1-b46a-500a31496c9a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.512361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50f8284-5a50-4ad1-b46a-500a31496c9a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.512834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50f8284-5a50-4ad1-b46a-500a31496c9a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.513278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d50f8284-5a50-4ad1-b46a-500a31496c9a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.644470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d50f8284-5a50-4ad1-b46a-500a31496c9a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:57.652861 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d50f8284-5a50-4ad1-b46a-500a31496c9a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1675 microversion: 2.1 time: 0.153255 Oct 04 19:02:57.653605 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3648/7300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:57 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:58.678511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-15452fba-8b71-4ae1-a119-3a3ea7ea762a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:58.679246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-15452fba-8b71-4ae1-a119-3a3ea7ea762a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:58.688800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15452fba-8b71-4ae1-a119-3a3ea7ea762a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.689616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15452fba-8b71-4ae1-a119-3a3ea7ea762a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.690426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15452fba-8b71-4ae1-a119-3a3ea7ea762a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.691819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15452fba-8b71-4ae1-a119-3a3ea7ea762a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.693337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15452fba-8b71-4ae1-a119-3a3ea7ea762a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.694135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-15452fba-8b71-4ae1-a119-3a3ea7ea762a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.827308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-15452fba-8b71-4ae1-a119-3a3ea7ea762a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:58.835080 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-15452fba-8b71-4ae1-a119-3a3ea7ea762a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1675 microversion: 2.1 time: 0.161391 Oct 04 19:02:58.835660 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3653/7301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:58 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:59.859302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1deea1fd-40ab-4070-9ab2-6420300c5e33 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:59.860519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1deea1fd-40ab-4070-9ab2-6420300c5e33 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:59.867803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1deea1fd-40ab-4070-9ab2-6420300c5e33 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.868323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1deea1fd-40ab-4070-9ab2-6420300c5e33 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.868778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1deea1fd-40ab-4070-9ab2-6420300c5e33 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.869505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1deea1fd-40ab-4070-9ab2-6420300c5e33 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.869980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1deea1fd-40ab-4070-9ab2-6420300c5e33 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.870426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1deea1fd-40ab-4070-9ab2-6420300c5e33 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.902458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1398b3c8-8864-417b-b6c7-3e63a513a6f2 req-13c187b3-ef64-43e9-beb4-7aef8dccb1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdb1819-f055-4bf4-abaa-e49fa25af8ff", "name": "network-vif-deleted", "tag": "cc6cb095-1cc9-42b6-98f9-053e8d56faad"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:59.918836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1398b3c8-8864-417b-b6c7-3e63a513a6f2 req-13c187b3-ef64-43e9-beb4-7aef8dccb1f9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.919471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1398b3c8-8864-417b-b6c7-3e63a513a6f2 req-13c187b3-ef64-43e9-beb4-7aef8dccb1f9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.920165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1398b3c8-8864-417b-b6c7-3e63a513a6f2 req-13c187b3-ef64-43e9-beb4-7aef8dccb1f9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.933715 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1398b3c8-8864-417b-b6c7-3e63a513a6f2 req-13c187b3-ef64-43e9-beb4-7aef8dccb1f9 service nova] Creating event network-vif-deleted:cc6cb095-1cc9-42b6-98f9-053e8d56faad for instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff on n-h1-850499-14 Oct 04 19:02:59.940466 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1398b3c8-8864-417b-b6c7-3e63a513a6f2 req-13c187b3-ef64-43e9-beb4-7aef8dccb1f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041050 Oct 04 19:02:59.941666 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3654/7302] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:02:59.943236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1deea1fd-40ab-4070-9ab2-6420300c5e33 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:59.957641 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1deea1fd-40ab-4070-9ab2-6420300c5e33 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 200 len: 1607 microversion: 2.1 time: 0.101995 Oct 04 19:02:59.958173 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3649/7303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:59 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 1607 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:00.982837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:00.983583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:00.989806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.990305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.990772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:00.991485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.991951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.992389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.006360 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff HTTP/1.1 Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '0fdb1819-f055-4bf4-abaa-e49fa25af8ff'} Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:01.008020 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.012449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:01.012449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:01.012449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:01.012449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:01.012449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:01.012449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:03:01.012449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.012449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:01.012449 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d4dd9f1a-0993-48d6-b645-77a47d04812f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 404 len: 111 microversion: 2.1 time: 0.031734 Oct 04 19:03:01.012449 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3655/7304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:00 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:01.022995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:01.023577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:01.030374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.030875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.031357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.032059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.032527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.032966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.046192 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff HTTP/1.1 Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '0fdb1819-f055-4bf4-abaa-e49fa25af8ff'} Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:01.047850 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.052787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:01.052787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:01.052787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:01.052787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:01.052787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:01.052787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:03:01.052787 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:03:01.052787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:01.052787 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-06ce8ca6-4862-4e4a-8798-894f2b1fe727 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 404 len: 111 microversion: 2.1 time: 0.030890 Oct 04 19:03:01.052787 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3650/7305] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:01 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:01.098641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-903464360", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "bdbe1b23-6ed6-4348-8c83-9788a5980966"}], "security_groups": [{"name": "tempest-securitygroup--2043427521"}], "key_name": "tempest-keypair-1790208000", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:01.203621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] validate_networks() for [('bdbe1b23-6ed6-4348-8c83-9788a5980966', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:03:01.911106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:03:01.911543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:03:01.912025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:03:01.912522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:03:01.912947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:03:01.921927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.922436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.922868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.924234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.924703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.925140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.942613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:01.947899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for user b54bee64da524366a871ff5dac9bcc9e and project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:01.960436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:03:01.962735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:03:02.012656 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3226f275-f249-4a6b-a1dc-1d59bf24e184 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.917806 Oct 04 19:03:02.013593 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3656/7306] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:03:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:03:02.025133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-909ed3a1-1a5a-44b3-876e-6a106de56a60 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:02.026328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-909ed3a1-1a5a-44b3-876e-6a106de56a60 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:02.083356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-909ed3a1-1a5a-44b3-876e-6a106de56a60 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:02.092064 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-909ed3a1-1a5a-44b3-876e-6a106de56a60 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1238 microversion: 2.1 time: 0.071131 Oct 04 19:03:02.092622 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3651/7307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:02 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:03.118309 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c34a37c2-54c3-4b8c-ad39-eed2fe1530e4 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:03.119196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c34a37c2-54c3-4b8c-ad39-eed2fe1530e4 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:03.125398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c34a37c2-54c3-4b8c-ad39-eed2fe1530e4 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:03.125899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c34a37c2-54c3-4b8c-ad39-eed2fe1530e4 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:03.126342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c34a37c2-54c3-4b8c-ad39-eed2fe1530e4 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:03.127073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c34a37c2-54c3-4b8c-ad39-eed2fe1530e4 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:03.127831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c34a37c2-54c3-4b8c-ad39-eed2fe1530e4 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:03.127961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c34a37c2-54c3-4b8c-ad39-eed2fe1530e4 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:03.197207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c34a37c2-54c3-4b8c-ad39-eed2fe1530e4 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:03.205454 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c34a37c2-54c3-4b8c-ad39-eed2fe1530e4 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1298 microversion: 2.1 time: 0.093873 Oct 04 19:03:03.206291 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3657/7308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:03 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:04.230083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d942a37-25cd-4b0b-8c42-c8ca246619d9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:04.230718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d942a37-25cd-4b0b-8c42-c8ca246619d9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:04.237628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d942a37-25cd-4b0b-8c42-c8ca246619d9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.238196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d942a37-25cd-4b0b-8c42-c8ca246619d9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.239247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d942a37-25cd-4b0b-8c42-c8ca246619d9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.239976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d942a37-25cd-4b0b-8c42-c8ca246619d9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.240458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d942a37-25cd-4b0b-8c42-c8ca246619d9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.240903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d942a37-25cd-4b0b-8c42-c8ca246619d9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.379830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6d942a37-25cd-4b0b-8c42-c8ca246619d9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:04.387749 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d942a37-25cd-4b0b-8c42-c8ca246619d9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1364 microversion: 2.1 time: 0.161611 Oct 04 19:03:04.388321 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3652/7309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:04 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:04.557641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c5f7e013-acf1-49bb-b86e-72f1d8d64ab9 req-d51ebb93-dbd8-408e-9d88-05f1e8a7a58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f49671-5243-45a4-9ce5-80e401bf5c7e", "tag": "ef76a1fd-7e89-4a59-925e-eff405f998e2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:04.568894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c5f7e013-acf1-49bb-b86e-72f1d8d64ab9 req-d51ebb93-dbd8-408e-9d88-05f1e8a7a58e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.569394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c5f7e013-acf1-49bb-b86e-72f1d8d64ab9 req-d51ebb93-dbd8-408e-9d88-05f1e8a7a58e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.570519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c5f7e013-acf1-49bb-b86e-72f1d8d64ab9 req-d51ebb93-dbd8-408e-9d88-05f1e8a7a58e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.583977 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c5f7e013-acf1-49bb-b86e-72f1d8d64ab9 req-d51ebb93-dbd8-408e-9d88-05f1e8a7a58e service nova] Creating event network-changed:ef76a1fd-7e89-4a59-925e-eff405f998e2 for instance 98f49671-5243-45a4-9ce5-80e401bf5c7e on n-h2-850499-14 Oct 04 19:03:04.589171 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c5f7e013-acf1-49bb-b86e-72f1d8d64ab9 req-d51ebb93-dbd8-408e-9d88-05f1e8a7a58e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040895 Oct 04 19:03:04.589776 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3658/7310] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:05.411809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-068ac8bc-cebc-4150-a475-473892bf4f98 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:05.412445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-068ac8bc-cebc-4150-a475-473892bf4f98 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:05.415260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=47 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:05.420697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-068ac8bc-cebc-4150-a475-473892bf4f98 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:05.421200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-068ac8bc-cebc-4150-a475-473892bf4f98 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:05.421651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-068ac8bc-cebc-4150-a475-473892bf4f98 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:05.422358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-068ac8bc-cebc-4150-a475-473892bf4f98 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:05.422833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-068ac8bc-cebc-4150-a475-473892bf4f98 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:05.423301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-068ac8bc-cebc-4150-a475-473892bf4f98 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:05.553357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-068ac8bc-cebc-4150-a475-473892bf4f98 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:05.561377 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-068ac8bc-cebc-4150-a475-473892bf4f98 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1364 microversion: 2.1 time: 0.153624 Oct 04 19:03:05.561947 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3653/7311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:05 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:06.586844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6f13c4ef-7cf8-443f-9ca4-bccd5cf034e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:06.587573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6f13c4ef-7cf8-443f-9ca4-bccd5cf034e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:06.589502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:06.595519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f13c4ef-7cf8-443f-9ca4-bccd5cf034e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.596004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f13c4ef-7cf8-443f-9ca4-bccd5cf034e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.596442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f13c4ef-7cf8-443f-9ca4-bccd5cf034e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.597128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f13c4ef-7cf8-443f-9ca4-bccd5cf034e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.597582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f13c4ef-7cf8-443f-9ca4-bccd5cf034e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.598009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f13c4ef-7cf8-443f-9ca4-bccd5cf034e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.728701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6f13c4ef-7cf8-443f-9ca4-bccd5cf034e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:06.736393 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6f13c4ef-7cf8-443f-9ca4-bccd5cf034e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1364 microversion: 2.1 time: 0.154692 Oct 04 19:03:06.736960 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3659/7312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:06 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:07.760312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-aac2512f-d89f-4f0f-9c27-d03c8353fd58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:07.760965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-aac2512f-d89f-4f0f-9c27-d03c8353fd58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:07.768397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aac2512f-d89f-4f0f-9c27-d03c8353fd58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.768902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aac2512f-d89f-4f0f-9c27-d03c8353fd58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.769349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aac2512f-d89f-4f0f-9c27-d03c8353fd58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:07.770100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aac2512f-d89f-4f0f-9c27-d03c8353fd58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.770575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aac2512f-d89f-4f0f-9c27-d03c8353fd58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.771044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-aac2512f-d89f-4f0f-9c27-d03c8353fd58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:07.918496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-aac2512f-d89f-4f0f-9c27-d03c8353fd58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:07.927261 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-aac2512f-d89f-4f0f-9c27-d03c8353fd58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1364 microversion: 2.1 time: 0.170642 Oct 04 19:03:07.927846 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3654/7313] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:07 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:08.951545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d34bc72-22d6-4ddf-b4cf-fd9096539b7f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:08.952164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1d34bc72-22d6-4ddf-b4cf-fd9096539b7f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:08.959253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d34bc72-22d6-4ddf-b4cf-fd9096539b7f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.959740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d34bc72-22d6-4ddf-b4cf-fd9096539b7f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.960180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d34bc72-22d6-4ddf-b4cf-fd9096539b7f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.960868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d34bc72-22d6-4ddf-b4cf-fd9096539b7f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.961323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d34bc72-22d6-4ddf-b4cf-fd9096539b7f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.961748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d34bc72-22d6-4ddf-b4cf-fd9096539b7f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:09.089983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d34bc72-22d6-4ddf-b4cf-fd9096539b7f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:09.097689 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d34bc72-22d6-4ddf-b4cf-fd9096539b7f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1364 microversion: 2.1 time: 0.150166 Oct 04 19:03:09.098306 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3660/7314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:08 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:09.879612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c78aa08b-e8b7-4dec-b1fb-818b45503b4b req-f20138d2-3a6d-433c-9dad-83c390a4d581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f49671-5243-45a4-9ce5-80e401bf5c7e", "name": "network-vif-plugged", "status": "completed", "tag": "ef76a1fd-7e89-4a59-925e-eff405f998e2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:09.890084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c78aa08b-e8b7-4dec-b1fb-818b45503b4b req-f20138d2-3a6d-433c-9dad-83c390a4d581 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:09.890764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c78aa08b-e8b7-4dec-b1fb-818b45503b4b req-f20138d2-3a6d-433c-9dad-83c390a4d581 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:09.891330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c78aa08b-e8b7-4dec-b1fb-818b45503b4b req-f20138d2-3a6d-433c-9dad-83c390a4d581 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:09.902567 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c78aa08b-e8b7-4dec-b1fb-818b45503b4b req-f20138d2-3a6d-433c-9dad-83c390a4d581 service nova] Creating event network-vif-plugged:ef76a1fd-7e89-4a59-925e-eff405f998e2 for instance 98f49671-5243-45a4-9ce5-80e401bf5c7e on n-h2-850499-14 Oct 04 19:03:09.907508 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c78aa08b-e8b7-4dec-b1fb-818b45503b4b req-f20138d2-3a6d-433c-9dad-83c390a4d581 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032199 Oct 04 19:03:09.908099 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3655/7315] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:10.120860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6161455a-e3fc-468e-9c5f-a3c2c38d5a03 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:10.121479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6161455a-e3fc-468e-9c5f-a3c2c38d5a03 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:10.128304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6161455a-e3fc-468e-9c5f-a3c2c38d5a03 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:10.128797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6161455a-e3fc-468e-9c5f-a3c2c38d5a03 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:10.129242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6161455a-e3fc-468e-9c5f-a3c2c38d5a03 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:10.129939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6161455a-e3fc-468e-9c5f-a3c2c38d5a03 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:10.130402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6161455a-e3fc-468e-9c5f-a3c2c38d5a03 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:10.130832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6161455a-e3fc-468e-9c5f-a3c2c38d5a03 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:10.264225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6161455a-e3fc-468e-9c5f-a3c2c38d5a03 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:10.272172 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6161455a-e3fc-468e-9c5f-a3c2c38d5a03 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1364 microversion: 2.1 time: 0.155254 Oct 04 19:03:10.272746 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3661/7316] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:10 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:11.297319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-571dc1ce-e35a-4701-b9e1-5a257ff5fe28 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:11.298044 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-571dc1ce-e35a-4701-b9e1-5a257ff5fe28 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:11.304812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-571dc1ce-e35a-4701-b9e1-5a257ff5fe28 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:11.305316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-571dc1ce-e35a-4701-b9e1-5a257ff5fe28 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:11.305772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-571dc1ce-e35a-4701-b9e1-5a257ff5fe28 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:11.306483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-571dc1ce-e35a-4701-b9e1-5a257ff5fe28 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:11.306976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-571dc1ce-e35a-4701-b9e1-5a257ff5fe28 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:11.307418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-571dc1ce-e35a-4701-b9e1-5a257ff5fe28 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:11.437519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-571dc1ce-e35a-4701-b9e1-5a257ff5fe28 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:11.446675 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-571dc1ce-e35a-4701-b9e1-5a257ff5fe28 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1364 microversion: 2.1 time: 0.154397 Oct 04 19:03:11.447287 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3656/7317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:11 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:12.470518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-78db4458-d314-4a61-b300-2cf04f2c2a81 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:12.471165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-78db4458-d314-4a61-b300-2cf04f2c2a81 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:12.474350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:12.475032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:12.480746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78db4458-d314-4a61-b300-2cf04f2c2a81 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:12.481234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78db4458-d314-4a61-b300-2cf04f2c2a81 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:12.481673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78db4458-d314-4a61-b300-2cf04f2c2a81 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:12.482370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78db4458-d314-4a61-b300-2cf04f2c2a81 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:12.482826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78db4458-d314-4a61-b300-2cf04f2c2a81 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:12.483359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-78db4458-d314-4a61-b300-2cf04f2c2a81 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:12.611522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-78db4458-d314-4a61-b300-2cf04f2c2a81 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:12.619250 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-78db4458-d314-4a61-b300-2cf04f2c2a81 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1551 microversion: 2.1 time: 0.152595 Oct 04 19:03:12.619825 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3662/7318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:12 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:12.641985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3aa01911-cbfb-4351-98f1-bfc14f89ae3e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:12.642486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3aa01911-cbfb-4351-98f1-bfc14f89ae3e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:12.645061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:12.651124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa01911-cbfb-4351-98f1-bfc14f89ae3e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:12.651664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa01911-cbfb-4351-98f1-bfc14f89ae3e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:12.652128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa01911-cbfb-4351-98f1-bfc14f89ae3e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:12.652848 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa01911-cbfb-4351-98f1-bfc14f89ae3e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:12.653329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa01911-cbfb-4351-98f1-bfc14f89ae3e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:12.653780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3aa01911-cbfb-4351-98f1-bfc14f89ae3e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:12.737923 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3aa01911-cbfb-4351-98f1-bfc14f89ae3e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099802 Oct 04 19:03:12.738539 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3657/7319] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 19:03:12 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:13.671587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ea78bbcc-acea-48f8-af63-9abd38f27cbb req-f498d7b6-011a-4785-88e7-c976a92b8f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f49671-5243-45a4-9ce5-80e401bf5c7e", "tag": "ef76a1fd-7e89-4a59-925e-eff405f998e2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:13.684963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ea78bbcc-acea-48f8-af63-9abd38f27cbb req-f498d7b6-011a-4785-88e7-c976a92b8f88 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:13.685544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ea78bbcc-acea-48f8-af63-9abd38f27cbb req-f498d7b6-011a-4785-88e7-c976a92b8f88 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:13.686101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ea78bbcc-acea-48f8-af63-9abd38f27cbb req-f498d7b6-011a-4785-88e7-c976a92b8f88 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:13.702112 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ea78bbcc-acea-48f8-af63-9abd38f27cbb req-f498d7b6-011a-4785-88e7-c976a92b8f88 service nova] Creating event network-changed:ef76a1fd-7e89-4a59-925e-eff405f998e2 for instance 98f49671-5243-45a4-9ce5-80e401bf5c7e on n-h2-850499-14 Oct 04 19:03:13.707150 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ea78bbcc-acea-48f8-af63-9abd38f27cbb req-f498d7b6-011a-4785-88e7-c976a92b8f88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039231 Oct 04 19:03:13.707804 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3663/7320] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:27.651179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=9 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:27.652006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=47 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:27.653220 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:04:27.653399 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:04:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/action (ip 10.222.0.18) !!! Oct 04 19:04:27.661887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d9845ff2-dbf9-49dd-8016-3a15bdebd822 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:27.669112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9845ff2-dbf9-49dd-8016-3a15bdebd822 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.669616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9845ff2-dbf9-49dd-8016-3a15bdebd822 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.670075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d9845ff2-dbf9-49dd-8016-3a15bdebd822 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:27.694281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d9845ff2-dbf9-49dd-8016-3a15bdebd822 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Going to try to stop instance {{(pid=122331) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:04:27.735709 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d9845ff2-dbf9-49dd-8016-3a15bdebd822 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/action" status: 202 len: 0 microversion: 2.1 time: 0.087053 Oct 04 19:04:27.736323 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3658/7321] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:27 2022] POST /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:04:27.743917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=9 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:27.744673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=46 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:27.745992 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:04:27.746320 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:04:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e (ip 10.222.0.18) !!! Oct 04 19:04:27.752010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-202131b3-8713-4017-a548-b3776be7c37a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:27.752822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-202131b3-8713-4017-a548-b3776be7c37a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:27.761971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-202131b3-8713-4017-a548-b3776be7c37a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.762467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-202131b3-8713-4017-a548-b3776be7c37a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.762916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-202131b3-8713-4017-a548-b3776be7c37a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:27.763666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-202131b3-8713-4017-a548-b3776be7c37a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.764128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-202131b3-8713-4017-a548-b3776be7c37a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.764566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-202131b3-8713-4017-a548-b3776be7c37a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:27.968708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-202131b3-8713-4017-a548-b3776be7c37a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:27.977025 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-202131b3-8713-4017-a548-b3776be7c37a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.235441 Oct 04 19:04:27.977598 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3664/7322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:27 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:29.002919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-628732dc-427d-4420-bce5-743097958f23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:29.003663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-628732dc-427d-4420-bce5-743097958f23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:29.010494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-628732dc-427d-4420-bce5-743097958f23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.011034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-628732dc-427d-4420-bce5-743097958f23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.011502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-628732dc-427d-4420-bce5-743097958f23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.012225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-628732dc-427d-4420-bce5-743097958f23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.012710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-628732dc-427d-4420-bce5-743097958f23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.013161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-628732dc-427d-4420-bce5-743097958f23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.192266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-628732dc-427d-4420-bce5-743097958f23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:29.200182 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-628732dc-427d-4420-bce5-743097958f23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.202444 Oct 04 19:04:29.200769 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3659/7323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:28 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:30.222581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-25483adc-7b97-4845-b891-8d77facde885 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:30.223220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-25483adc-7b97-4845-b891-8d77facde885 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:30.231571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25483adc-7b97-4845-b891-8d77facde885 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.232069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25483adc-7b97-4845-b891-8d77facde885 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.232510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25483adc-7b97-4845-b891-8d77facde885 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:30.233221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25483adc-7b97-4845-b891-8d77facde885 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.233674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25483adc-7b97-4845-b891-8d77facde885 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.234105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25483adc-7b97-4845-b891-8d77facde885 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:30.370519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-25483adc-7b97-4845-b891-8d77facde885 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:30.378389 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-25483adc-7b97-4845-b891-8d77facde885 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.159561 Oct 04 19:04:30.378976 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3665/7324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:30 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:31.404740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f05c2155-521f-4838-af2a-2defec394448 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:31.405395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f05c2155-521f-4838-af2a-2defec394448 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:31.413117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05c2155-521f-4838-af2a-2defec394448 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.413622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05c2155-521f-4838-af2a-2defec394448 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.414078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05c2155-521f-4838-af2a-2defec394448 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.414788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05c2155-521f-4838-af2a-2defec394448 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.415294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05c2155-521f-4838-af2a-2defec394448 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.415734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f05c2155-521f-4838-af2a-2defec394448 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.552013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f05c2155-521f-4838-af2a-2defec394448 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:31.560318 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f05c2155-521f-4838-af2a-2defec394448 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.159746 Oct 04 19:04:31.561136 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3660/7325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:31 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:32.584187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ff256c21-7796-46a3-b00f-bd4a6c1894ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:32.584789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ff256c21-7796-46a3-b00f-bd4a6c1894ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:32.592146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff256c21-7796-46a3-b00f-bd4a6c1894ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.592646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff256c21-7796-46a3-b00f-bd4a6c1894ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.593096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff256c21-7796-46a3-b00f-bd4a6c1894ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.593810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff256c21-7796-46a3-b00f-bd4a6c1894ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.594478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff256c21-7796-46a3-b00f-bd4a6c1894ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.594915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ff256c21-7796-46a3-b00f-bd4a6c1894ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.733304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ff256c21-7796-46a3-b00f-bd4a6c1894ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:32.741907 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ff256c21-7796-46a3-b00f-bd4a6c1894ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.161330 Oct 04 19:04:32.742434 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3666/7326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:32 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:33.765820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-147ba0bf-0714-4ce5-8478-4159cb64fa82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:33.766450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-147ba0bf-0714-4ce5-8478-4159cb64fa82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:33.774058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-147ba0bf-0714-4ce5-8478-4159cb64fa82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.774566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-147ba0bf-0714-4ce5-8478-4159cb64fa82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.775053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-147ba0bf-0714-4ce5-8478-4159cb64fa82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.775783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-147ba0bf-0714-4ce5-8478-4159cb64fa82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.776264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-147ba0bf-0714-4ce5-8478-4159cb64fa82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.776713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-147ba0bf-0714-4ce5-8478-4159cb64fa82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.909460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-147ba0bf-0714-4ce5-8478-4159cb64fa82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:33.917832 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-147ba0bf-0714-4ce5-8478-4159cb64fa82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.155890 Oct 04 19:04:33.918429 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3661/7327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:33 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:34.941474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e2d6577f-8239-4da0-93d9-d92ae43b64c6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:34.942052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e2d6577f-8239-4da0-93d9-d92ae43b64c6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:34.949335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2d6577f-8239-4da0-93d9-d92ae43b64c6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.949830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2d6577f-8239-4da0-93d9-d92ae43b64c6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.950273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2d6577f-8239-4da0-93d9-d92ae43b64c6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.951003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2d6577f-8239-4da0-93d9-d92ae43b64c6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.951467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2d6577f-8239-4da0-93d9-d92ae43b64c6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.951919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2d6577f-8239-4da0-93d9-d92ae43b64c6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.087225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e2d6577f-8239-4da0-93d9-d92ae43b64c6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:35.095068 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e2d6577f-8239-4da0-93d9-d92ae43b64c6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.157724 Oct 04 19:04:35.095645 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3667/7328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:34 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:36.120334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c2100163-2b41-42df-814e-1533f55d8a47 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:36.121002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c2100163-2b41-42df-814e-1533f55d8a47 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:36.128372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2100163-2b41-42df-814e-1533f55d8a47 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.128879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2100163-2b41-42df-814e-1533f55d8a47 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.129352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2100163-2b41-42df-814e-1533f55d8a47 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:36.130073 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2100163-2b41-42df-814e-1533f55d8a47 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.130546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2100163-2b41-42df-814e-1533f55d8a47 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.131069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2100163-2b41-42df-814e-1533f55d8a47 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:36.277535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c2100163-2b41-42df-814e-1533f55d8a47 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:36.286407 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c2100163-2b41-42df-814e-1533f55d8a47 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.169446 Oct 04 19:04:36.287085 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3662/7329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:36 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:37.312624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b08e53b0-f5e4-4081-8cf9-8fad9dd037cc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:37.313241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b08e53b0-f5e4-4081-8cf9-8fad9dd037cc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:37.320972 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08e53b0-f5e4-4081-8cf9-8fad9dd037cc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.321484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08e53b0-f5e4-4081-8cf9-8fad9dd037cc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.321906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08e53b0-f5e4-4081-8cf9-8fad9dd037cc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.322609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08e53b0-f5e4-4081-8cf9-8fad9dd037cc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.323091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08e53b0-f5e4-4081-8cf9-8fad9dd037cc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.323522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b08e53b0-f5e4-4081-8cf9-8fad9dd037cc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.459222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b08e53b0-f5e4-4081-8cf9-8fad9dd037cc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:37.467389 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b08e53b0-f5e4-4081-8cf9-8fad9dd037cc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.158755 Oct 04 19:04:37.467973 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3668/7330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:37 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:38.491464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-91817e49-e618-4373-a232-04741f325cdb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:38.492235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-91817e49-e618-4373-a232-04741f325cdb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:38.499362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91817e49-e618-4373-a232-04741f325cdb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.499874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91817e49-e618-4373-a232-04741f325cdb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.500324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91817e49-e618-4373-a232-04741f325cdb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.501056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91817e49-e618-4373-a232-04741f325cdb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.501531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91817e49-e618-4373-a232-04741f325cdb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.502113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-91817e49-e618-4373-a232-04741f325cdb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.639607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-91817e49-e618-4373-a232-04741f325cdb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:38.648033 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-91817e49-e618-4373-a232-04741f325cdb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1656 microversion: 2.1 time: 0.161015 Oct 04 19:04:38.648781 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3663/7331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:38 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:38.671759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:38.674001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:38.681181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.681928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.682368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.683092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.683550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.684055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.715914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:38.721900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122332) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:04:38.729267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:04:38.729721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:04:38.730195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:04:38.730606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:04:38.731081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:04:38.798464 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2127621-22cc-48a8-b34d-51ffed3e54e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/action" status: 202 len: 0 microversion: 2.1 time: 0.130527 Oct 04 19:04:38.802175 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3669/7332] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:38 2022] POST /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:04:38.808058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-85ed0400-6389-49eb-89de-02482239ce7e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:38.808744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-85ed0400-6389-49eb-89de-02482239ce7e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:38.815064 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ed0400-6389-49eb-89de-02482239ce7e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.815640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ed0400-6389-49eb-89de-02482239ce7e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.816079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ed0400-6389-49eb-89de-02482239ce7e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.816886 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ed0400-6389-49eb-89de-02482239ce7e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.817349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ed0400-6389-49eb-89de-02482239ce7e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.817801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-85ed0400-6389-49eb-89de-02482239ce7e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.983157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-85ed0400-6389-49eb-89de-02482239ce7e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:38.991736 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-85ed0400-6389-49eb-89de-02482239ce7e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.187995 Oct 04 19:04:38.992512 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3664/7333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:38 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:40.018232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02c36a3a-1ab6-4a4e-b2a9-304e9b0031b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:40.018855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-02c36a3a-1ab6-4a4e-b2a9-304e9b0031b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:40.025529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c36a3a-1ab6-4a4e-b2a9-304e9b0031b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.026051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c36a3a-1ab6-4a4e-b2a9-304e9b0031b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.026500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c36a3a-1ab6-4a4e-b2a9-304e9b0031b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.027260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c36a3a-1ab6-4a4e-b2a9-304e9b0031b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.027725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c36a3a-1ab6-4a4e-b2a9-304e9b0031b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.028190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02c36a3a-1ab6-4a4e-b2a9-304e9b0031b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.162350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-02c36a3a-1ab6-4a4e-b2a9-304e9b0031b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:40.170460 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-02c36a3a-1ab6-4a4e-b2a9-304e9b0031b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1679 microversion: 2.1 time: 0.156976 Oct 04 19:04:40.171057 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3670/7334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:40 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:41.194758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e59d2eeb-5c58-4f1b-bf6a-bc1a8b2c2a3b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.195425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e59d2eeb-5c58-4f1b-bf6a-bc1a8b2c2a3b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.202380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e59d2eeb-5c58-4f1b-bf6a-bc1a8b2c2a3b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.202882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e59d2eeb-5c58-4f1b-bf6a-bc1a8b2c2a3b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.203359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e59d2eeb-5c58-4f1b-bf6a-bc1a8b2c2a3b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.204061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e59d2eeb-5c58-4f1b-bf6a-bc1a8b2c2a3b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.204530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e59d2eeb-5c58-4f1b-bf6a-bc1a8b2c2a3b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.204968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e59d2eeb-5c58-4f1b-bf6a-bc1a8b2c2a3b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.338482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e59d2eeb-5c58-4f1b-bf6a-bc1a8b2c2a3b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:41.346696 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e59d2eeb-5c58-4f1b-bf6a-bc1a8b2c2a3b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1684 microversion: 2.1 time: 0.155853 Oct 04 19:04:41.347306 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3665/7335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:41 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:42.370450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-119f3bd2-2fdc-4b6b-a7a4-c1c047915dbd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:42.371033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-119f3bd2-2fdc-4b6b-a7a4-c1c047915dbd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:42.377992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-119f3bd2-2fdc-4b6b-a7a4-c1c047915dbd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:42.378480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-119f3bd2-2fdc-4b6b-a7a4-c1c047915dbd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:42.378924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-119f3bd2-2fdc-4b6b-a7a4-c1c047915dbd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:42.379646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-119f3bd2-2fdc-4b6b-a7a4-c1c047915dbd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:42.380108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-119f3bd2-2fdc-4b6b-a7a4-c1c047915dbd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:42.380537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-119f3bd2-2fdc-4b6b-a7a4-c1c047915dbd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:42.511043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-119f3bd2-2fdc-4b6b-a7a4-c1c047915dbd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:42.519101 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-119f3bd2-2fdc-4b6b-a7a4-c1c047915dbd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1684 microversion: 2.1 time: 0.152552 Oct 04 19:04:42.520184 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3671/7336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:42 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:43.543760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-da58c9c5-e301-41f3-99b0-934189240e66 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:43.544394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-da58c9c5-e301-41f3-99b0-934189240e66 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:43.552164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da58c9c5-e301-41f3-99b0-934189240e66 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:43.552705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da58c9c5-e301-41f3-99b0-934189240e66 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:43.553176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da58c9c5-e301-41f3-99b0-934189240e66 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:43.554026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da58c9c5-e301-41f3-99b0-934189240e66 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:43.554559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da58c9c5-e301-41f3-99b0-934189240e66 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:43.555037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-da58c9c5-e301-41f3-99b0-934189240e66 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:43.698876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-da58c9c5-e301-41f3-99b0-934189240e66 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:43.707613 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-da58c9c5-e301-41f3-99b0-934189240e66 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1683 microversion: 2.1 time: 0.167688 Oct 04 19:04:43.708390 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3666/7337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:43 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:43.724540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c3979fa8-27d1-4fd5-a2d9-1ed4a8ffaf47 req-9e825725-b7b1-40f3-bb09-7d9e8c30bcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f49671-5243-45a4-9ce5-80e401bf5c7e", "name": "network-vif-unplugged", "status": "completed", "tag": "ef76a1fd-7e89-4a59-925e-eff405f998e2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:43.735476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c3979fa8-27d1-4fd5-a2d9-1ed4a8ffaf47 req-9e825725-b7b1-40f3-bb09-7d9e8c30bcb5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:43.735973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c3979fa8-27d1-4fd5-a2d9-1ed4a8ffaf47 req-9e825725-b7b1-40f3-bb09-7d9e8c30bcb5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:43.736506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c3979fa8-27d1-4fd5-a2d9-1ed4a8ffaf47 req-9e825725-b7b1-40f3-bb09-7d9e8c30bcb5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:43.750880 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c3979fa8-27d1-4fd5-a2d9-1ed4a8ffaf47 req-9e825725-b7b1-40f3-bb09-7d9e8c30bcb5 service nova] Creating event network-vif-unplugged:ef76a1fd-7e89-4a59-925e-eff405f998e2 for instance 98f49671-5243-45a4-9ce5-80e401bf5c7e on n-h1-850499-14 Oct 04 19:04:43.757963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-c3979fa8-27d1-4fd5-a2d9-1ed4a8ffaf47 req-9e825725-b7b1-40f3-bb09-7d9e8c30bcb5 service nova] Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:04:43.772632 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c3979fa8-27d1-4fd5-a2d9-1ed4a8ffaf47 req-9e825725-b7b1-40f3-bb09-7d9e8c30bcb5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052503 Oct 04 19:04:43.774140 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3672/7338] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:44.736129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-018446d1-5595-4667-86ef-c099eba767d3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:44.736873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-018446d1-5595-4667-86ef-c099eba767d3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:44.745132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-018446d1-5595-4667-86ef-c099eba767d3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:44.745652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-018446d1-5595-4667-86ef-c099eba767d3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:44.746115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-018446d1-5595-4667-86ef-c099eba767d3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:44.746854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-018446d1-5595-4667-86ef-c099eba767d3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:44.747365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-018446d1-5595-4667-86ef-c099eba767d3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:44.747815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-018446d1-5595-4667-86ef-c099eba767d3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:44.908061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-018446d1-5595-4667-86ef-c099eba767d3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:44.919577 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-018446d1-5595-4667-86ef-c099eba767d3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1683 microversion: 2.1 time: 0.188077 Oct 04 19:04:44.920615 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3667/7339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:44 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:45.788702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7c0d84bf-5174-42bc-81d2-695cb20f9fdb req-018aaa32-24f4-4906-8eca-0283f43168a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f49671-5243-45a4-9ce5-80e401bf5c7e", "tag": "ef76a1fd-7e89-4a59-925e-eff405f998e2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:45.800234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7c0d84bf-5174-42bc-81d2-695cb20f9fdb req-018aaa32-24f4-4906-8eca-0283f43168a9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.800749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7c0d84bf-5174-42bc-81d2-695cb20f9fdb req-018aaa32-24f4-4906-8eca-0283f43168a9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.801172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7c0d84bf-5174-42bc-81d2-695cb20f9fdb req-018aaa32-24f4-4906-8eca-0283f43168a9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:45.813594 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7c0d84bf-5174-42bc-81d2-695cb20f9fdb req-018aaa32-24f4-4906-8eca-0283f43168a9 service nova] Creating event network-changed:ef76a1fd-7e89-4a59-925e-eff405f998e2 for instance 98f49671-5243-45a4-9ce5-80e401bf5c7e on n-h1-850499-14 Oct 04 19:04:45.819711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-7c0d84bf-5174-42bc-81d2-695cb20f9fdb req-018aaa32-24f4-4906-8eca-0283f43168a9 service nova] Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:04:45.832289 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7c0d84bf-5174-42bc-81d2-695cb20f9fdb req-018aaa32-24f4-4906-8eca-0283f43168a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046776 Oct 04 19:04:45.832938 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3673/7340] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:45.944367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c5eb87af-16ce-4be3-9ed2-46a4d6f4ea16 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:45.945033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c5eb87af-16ce-4be3-9ed2-46a4d6f4ea16 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:45.951954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5eb87af-16ce-4be3-9ed2-46a4d6f4ea16 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.952476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5eb87af-16ce-4be3-9ed2-46a4d6f4ea16 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.952971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5eb87af-16ce-4be3-9ed2-46a4d6f4ea16 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:45.953684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5eb87af-16ce-4be3-9ed2-46a4d6f4ea16 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.954159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5eb87af-16ce-4be3-9ed2-46a4d6f4ea16 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.954607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5eb87af-16ce-4be3-9ed2-46a4d6f4ea16 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.093368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c5eb87af-16ce-4be3-9ed2-46a4d6f4ea16 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:46.101493 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c5eb87af-16ce-4be3-9ed2-46a4d6f4ea16 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1681 microversion: 2.1 time: 0.161544 Oct 04 19:04:46.102081 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3668/7341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:45 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:47.126608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a09af94-a5cc-4a33-b416-f6db2b8fc371 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.127359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a09af94-a5cc-4a33-b416-f6db2b8fc371 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.135411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a09af94-a5cc-4a33-b416-f6db2b8fc371 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.135903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a09af94-a5cc-4a33-b416-f6db2b8fc371 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.136343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a09af94-a5cc-4a33-b416-f6db2b8fc371 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.137381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a09af94-a5cc-4a33-b416-f6db2b8fc371 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.137692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a09af94-a5cc-4a33-b416-f6db2b8fc371 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.138123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a09af94-a5cc-4a33-b416-f6db2b8fc371 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.293540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a09af94-a5cc-4a33-b416-f6db2b8fc371 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:47.305237 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a09af94-a5cc-4a33-b416-f6db2b8fc371 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1677 microversion: 2.1 time: 0.182707 Oct 04 19:04:47.306421 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3674/7342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:47 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:47.337359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e118bb16-2211-4a6a-93a3-fc1f68d87e2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:47.338099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e118bb16-2211-4a6a-93a3-fc1f68d87e2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.347580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e118bb16-2211-4a6a-93a3-fc1f68d87e2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.348092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e118bb16-2211-4a6a-93a3-fc1f68d87e2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.348554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e118bb16-2211-4a6a-93a3-fc1f68d87e2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.349293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e118bb16-2211-4a6a-93a3-fc1f68d87e2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.349898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e118bb16-2211-4a6a-93a3-fc1f68d87e2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.350516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e118bb16-2211-4a6a-93a3-fc1f68d87e2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.417751 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e118bb16-2211-4a6a-93a3-fc1f68d87e2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/action" status: 204 len: 0 microversion: 2.1 time: 0.086484 Oct 04 19:04:47.418406 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3669/7343] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:47 2022] POST /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:04:47.428233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ba33fc0d-d040-4075-b574-d067ff3bc0e6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.428858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ba33fc0d-d040-4075-b574-d067ff3bc0e6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.435598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba33fc0d-d040-4075-b574-d067ff3bc0e6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.436884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba33fc0d-d040-4075-b574-d067ff3bc0e6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.437311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba33fc0d-d040-4075-b574-d067ff3bc0e6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.438251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba33fc0d-d040-4075-b574-d067ff3bc0e6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.438725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba33fc0d-d040-4075-b574-d067ff3bc0e6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.439194 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ba33fc0d-d040-4075-b574-d067ff3bc0e6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.588646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ba33fc0d-d040-4075-b574-d067ff3bc0e6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:47.596837 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ba33fc0d-d040-4075-b574-d067ff3bc0e6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1677 microversion: 2.1 time: 0.173576 Oct 04 19:04:47.598024 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3675/7344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:47 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:48.501098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-cbda8f93-637a-45b5-aeae-202715b49ec2 req-25b8f6e7-16f5-4419-845d-b84a0323d88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f49671-5243-45a4-9ce5-80e401bf5c7e", "name": "network-vif-plugged", "status": "completed", "tag": "ef76a1fd-7e89-4a59-925e-eff405f998e2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:48.522631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cbda8f93-637a-45b5-aeae-202715b49ec2 req-25b8f6e7-16f5-4419-845d-b84a0323d88b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.523356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cbda8f93-637a-45b5-aeae-202715b49ec2 req-25b8f6e7-16f5-4419-845d-b84a0323d88b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.523925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-cbda8f93-637a-45b5-aeae-202715b49ec2 req-25b8f6e7-16f5-4419-845d-b84a0323d88b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.541304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-cbda8f93-637a-45b5-aeae-202715b49ec2 req-25b8f6e7-16f5-4419-845d-b84a0323d88b service nova] Creating event network-vif-plugged:ef76a1fd-7e89-4a59-925e-eff405f998e2 for instance 98f49671-5243-45a4-9ce5-80e401bf5c7e on n-h1-850499-14 Oct 04 19:04:48.552019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-cbda8f93-637a-45b5-aeae-202715b49ec2 req-25b8f6e7-16f5-4419-845d-b84a0323d88b service nova] Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:04:48.567853 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-cbda8f93-637a-45b5-aeae-202715b49ec2 req-25b8f6e7-16f5-4419-845d-b84a0323d88b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072083 Oct 04 19:04:48.568675 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3670/7345] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:04:48.621749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00cdcc91-db21-4b42-9164-77f528209b5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:48.622371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00cdcc91-db21-4b42-9164-77f528209b5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:48.629993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00cdcc91-db21-4b42-9164-77f528209b5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.630494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00cdcc91-db21-4b42-9164-77f528209b5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.630939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00cdcc91-db21-4b42-9164-77f528209b5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.631665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00cdcc91-db21-4b42-9164-77f528209b5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.632134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00cdcc91-db21-4b42-9164-77f528209b5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.632568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00cdcc91-db21-4b42-9164-77f528209b5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.767798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00cdcc91-db21-4b42-9164-77f528209b5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:48.775957 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00cdcc91-db21-4b42-9164-77f528209b5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1677 microversion: 2.1 time: 0.158118 Oct 04 19:04:48.776538 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3676/7346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:48 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:49.800966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-71cc29e7-e146-4bac-8c7b-440da593bd9e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:49.801691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-71cc29e7-e146-4bac-8c7b-440da593bd9e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:49.808239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71cc29e7-e146-4bac-8c7b-440da593bd9e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.808750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71cc29e7-e146-4bac-8c7b-440da593bd9e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.809206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71cc29e7-e146-4bac-8c7b-440da593bd9e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.809921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71cc29e7-e146-4bac-8c7b-440da593bd9e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.810393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71cc29e7-e146-4bac-8c7b-440da593bd9e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.810837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-71cc29e7-e146-4bac-8c7b-440da593bd9e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.955414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-71cc29e7-e146-4bac-8c7b-440da593bd9e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:49.963419 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-71cc29e7-e146-4bac-8c7b-440da593bd9e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1656 microversion: 2.1 time: 0.167479 Oct 04 19:04:49.964005 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3671/7347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:49 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1656 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:49.986038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c126d0a-0f9c-4c6c-aa8b-a7d82ee9fddd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:49.986795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c126d0a-0f9c-4c6c-aa8b-a7d82ee9fddd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:49.994302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c126d0a-0f9c-4c6c-aa8b-a7d82ee9fddd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.994800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c126d0a-0f9c-4c6c-aa8b-a7d82ee9fddd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.995289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c126d0a-0f9c-4c6c-aa8b-a7d82ee9fddd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.996023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c126d0a-0f9c-4c6c-aa8b-a7d82ee9fddd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.996490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c126d0a-0f9c-4c6c-aa8b-a7d82ee9fddd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.996926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c126d0a-0f9c-4c6c-aa8b-a7d82ee9fddd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.132177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4c126d0a-0f9c-4c6c-aa8b-a7d82ee9fddd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:50.140224 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c126d0a-0f9c-4c6c-aa8b-a7d82ee9fddd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1656 microversion: 2.1 time: 0.158122 Oct 04 19:04:50.140817 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3677/7348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:49 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:50.162465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e903359-7195-4081-9c08-cc6beb125088 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:50.168691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e903359-7195-4081-9c08-cc6beb125088 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.169212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e903359-7195-4081-9c08-cc6beb125088 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.169656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e903359-7195-4081-9c08-cc6beb125088 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.193115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e903359-7195-4081-9c08-cc6beb125088 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Going to try to start instance {{(pid=122331) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:04:50.197619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:50.235095 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e903359-7195-4081-9c08-cc6beb125088 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/action" status: 202 len: 0 microversion: 2.1 time: 0.076387 Oct 04 19:04:50.235934 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3672/7349] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:50 2022] POST /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:04:50.244706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9d036585-3672-46dc-8922-3a9e1209c1f5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:50.245329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9d036585-3672-46dc-8922-3a9e1209c1f5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:50.251614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d036585-3672-46dc-8922-3a9e1209c1f5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.252113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d036585-3672-46dc-8922-3a9e1209c1f5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.252761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d036585-3672-46dc-8922-3a9e1209c1f5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.254091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d036585-3672-46dc-8922-3a9e1209c1f5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.254552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d036585-3672-46dc-8922-3a9e1209c1f5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.255183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9d036585-3672-46dc-8922-3a9e1209c1f5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.404743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9d036585-3672-46dc-8922-3a9e1209c1f5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:50.413693 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9d036585-3672-46dc-8922-3a9e1209c1f5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1665 microversion: 2.1 time: 0.172875 Oct 04 19:04:50.414193 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3678/7350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:50 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1665 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:51.441573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd0b81db-a711-40cc-8fde-c6e56718a9b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:51.442520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd0b81db-a711-40cc-8fde-c6e56718a9b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:51.450326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b81db-a711-40cc-8fde-c6e56718a9b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.450989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b81db-a711-40cc-8fde-c6e56718a9b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.451594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b81db-a711-40cc-8fde-c6e56718a9b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.452550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b81db-a711-40cc-8fde-c6e56718a9b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.453342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b81db-a711-40cc-8fde-c6e56718a9b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.454114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd0b81db-a711-40cc-8fde-c6e56718a9b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.591775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fd0b81db-a711-40cc-8fde-c6e56718a9b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:51.599683 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd0b81db-a711-40cc-8fde-c6e56718a9b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1665 microversion: 2.1 time: 0.163026 Oct 04 19:04:51.600263 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3673/7351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:51 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:52.623165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-51341a61-7da2-4ae4-a7d7-78b64216dccb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:52.623777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-51341a61-7da2-4ae4-a7d7-78b64216dccb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:52.631164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51341a61-7da2-4ae4-a7d7-78b64216dccb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.631655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51341a61-7da2-4ae4-a7d7-78b64216dccb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.632098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51341a61-7da2-4ae4-a7d7-78b64216dccb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.632792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51341a61-7da2-4ae4-a7d7-78b64216dccb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.633249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51341a61-7da2-4ae4-a7d7-78b64216dccb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.633676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-51341a61-7da2-4ae4-a7d7-78b64216dccb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.763812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-51341a61-7da2-4ae4-a7d7-78b64216dccb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:52.767350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:52.772929 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-51341a61-7da2-4ae4-a7d7-78b64216dccb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1669 microversion: 2.1 time: 0.153689 Oct 04 19:04:52.773504 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3679/7352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:52 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:52.795343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-706464c6-658e-4df0-b03c-4056da500111 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:52.795861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-706464c6-658e-4df0-b03c-4056da500111 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:52.802789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-706464c6-658e-4df0-b03c-4056da500111 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.803329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-706464c6-658e-4df0-b03c-4056da500111 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.803785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-706464c6-658e-4df0-b03c-4056da500111 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.804506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-706464c6-658e-4df0-b03c-4056da500111 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.804984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-706464c6-658e-4df0-b03c-4056da500111 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.805427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-706464c6-658e-4df0-b03c-4056da500111 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.833757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-706464c6-658e-4df0-b03c-4056da500111 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:04:52.908858 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-706464c6-658e-4df0-b03c-4056da500111 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "DELETE /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 204 len: 0 microversion: 2.1 time: 0.117325 Oct 04 19:04:52.909512 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3674/7353] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:52 2022] DELETE /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:04:52.918453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-100672c7-bb61-4eca-bf8c-b1cbeeb7745a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:52.919097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-100672c7-bb61-4eca-bf8c-b1cbeeb7745a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:52.927030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-100672c7-bb61-4eca-bf8c-b1cbeeb7745a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.927487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-100672c7-bb61-4eca-bf8c-b1cbeeb7745a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.927930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-100672c7-bb61-4eca-bf8c-b1cbeeb7745a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.928632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-100672c7-bb61-4eca-bf8c-b1cbeeb7745a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.929098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-100672c7-bb61-4eca-bf8c-b1cbeeb7745a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.929527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-100672c7-bb61-4eca-bf8c-b1cbeeb7745a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:53.059628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-100672c7-bb61-4eca-bf8c-b1cbeeb7745a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:53.068110 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-100672c7-bb61-4eca-bf8c-b1cbeeb7745a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1675 microversion: 2.1 time: 0.153690 Oct 04 19:04:53.068689 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3680/7354] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:52 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:54.092319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-67325208-2b4a-4b80-9752-76ac4fb04139 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:54.093048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-67325208-2b4a-4b80-9752-76ac4fb04139 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:54.100051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67325208-2b4a-4b80-9752-76ac4fb04139 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.100563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67325208-2b4a-4b80-9752-76ac4fb04139 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.101026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67325208-2b4a-4b80-9752-76ac4fb04139 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.101749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67325208-2b4a-4b80-9752-76ac4fb04139 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.102234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67325208-2b4a-4b80-9752-76ac4fb04139 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.102681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67325208-2b4a-4b80-9752-76ac4fb04139 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.232450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-67325208-2b4a-4b80-9752-76ac4fb04139 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:54.240422 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-67325208-2b4a-4b80-9752-76ac4fb04139 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1675 microversion: 2.1 time: 0.152385 Oct 04 19:04:54.241002 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3675/7355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:54 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:55.268765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-178d9414-93d3-4efa-adf3-d542987e26c1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:55.270134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-178d9414-93d3-4efa-adf3-d542987e26c1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:55.279660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-178d9414-93d3-4efa-adf3-d542987e26c1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.280334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-178d9414-93d3-4efa-adf3-d542987e26c1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.280951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-178d9414-93d3-4efa-adf3-d542987e26c1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.281889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-178d9414-93d3-4efa-adf3-d542987e26c1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.282527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-178d9414-93d3-4efa-adf3-d542987e26c1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.283159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-178d9414-93d3-4efa-adf3-d542987e26c1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.311357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-39e76987-f524-4df7-9b2c-4ccc10905523 req-3c1bcb6c-32ee-4dfe-ba73-dc698c2d2de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f49671-5243-45a4-9ce5-80e401bf5c7e", "name": "network-vif-deleted", "tag": "ef76a1fd-7e89-4a59-925e-eff405f998e2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:55.329759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-39e76987-f524-4df7-9b2c-4ccc10905523 req-3c1bcb6c-32ee-4dfe-ba73-dc698c2d2de5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.330330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-39e76987-f524-4df7-9b2c-4ccc10905523 req-3c1bcb6c-32ee-4dfe-ba73-dc698c2d2de5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.330835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-39e76987-f524-4df7-9b2c-4ccc10905523 req-3c1bcb6c-32ee-4dfe-ba73-dc698c2d2de5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.345616 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-39e76987-f524-4df7-9b2c-4ccc10905523 req-3c1bcb6c-32ee-4dfe-ba73-dc698c2d2de5 service nova] Creating event network-vif-deleted:ef76a1fd-7e89-4a59-925e-eff405f998e2 for instance 98f49671-5243-45a4-9ce5-80e401bf5c7e on n-h1-850499-14 Oct 04 19:04:55.350460 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-39e76987-f524-4df7-9b2c-4ccc10905523 req-3c1bcb6c-32ee-4dfe-ba73-dc698c2d2de5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115247 Oct 04 19:04:55.351489 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3681/7356] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:55.365153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-178d9414-93d3-4efa-adf3-d542987e26c1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:55.373361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-178d9414-93d3-4efa-adf3-d542987e26c1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 200 len: 1323 microversion: 2.1 time: 0.111664 Oct 04 19:04:55.374055 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3676/7357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:55 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 1323 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:56.399014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:56.399716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:56.405855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:56.406342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:56.406781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:56.407509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:56.407964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:56.408394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:56.421494 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e HTTP/1.1 Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '98f49671-5243-45a4-9ce5-80e401bf5c7e'} Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:56.423133 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:04:56.428072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:56.428072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:56.428072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:56.428072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:56.428072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:56.428072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:04:56.428072 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:04:56.428072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:56.428072 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b8e01a77-776b-4adf-b2ae-4e1d24836f1a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 404 len: 111 microversion: 2.1 time: 0.031319 Oct 04 19:04:56.428072 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3682/7358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:56 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:56.444113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:56.444747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:56.451056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:56.451571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:56.452032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:56.452751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:56.453234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:56.453684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:56.467816 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e HTTP/1.1 Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '98f49671-5243-45a4-9ce5-80e401bf5c7e'} Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:56.469473 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:04:56.474091 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:56.474091 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:56.474091 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:56.474091 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:56.474091 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:56.474091 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:04:56.474091 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:04:56.474091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:56.474091 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c524cf75-eeb0-4d50-9713-d9f43f637159 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 404 len: 111 microversion: 2.1 time: 0.031316 Oct 04 19:04:56.474091 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3677/7359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:56 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:56.519958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-853634562", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "bdbe1b23-6ed6-4348-8c83-9788a5980966"}], "security_groups": [{"name": "tempest-securitygroup--2043427521"}], "key_name": "tempest-keypair-1790208000", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:56.622963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] validate_networks() for [('bdbe1b23-6ed6-4348-8c83-9788a5980966', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:04:56.997892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:04:56.998339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:04:56.998822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:04:56.999264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:04:56.999688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:04:57.009637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:57.010127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:57.010567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:57.011340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:57.011805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:57.012239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:57.029387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:04:57.035206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for user b54bee64da524366a871ff5dac9bcc9e and project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:04:57.047557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:04:57.050497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:04:57.098619 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59e05672-0ea4-47d3-9a47-8c59ee053308 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.583242 Oct 04 19:04:57.099318 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3683/7360] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:04:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:04:57.110508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-03b60164-1949-47a0-a0a9-095c0c1b150a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:57.111174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-03b60164-1949-47a0-a0a9-095c0c1b150a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:57.167822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-03b60164-1949-47a0-a0a9-095c0c1b150a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:57.172208 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-03b60164-1949-47a0-a0a9-095c0c1b150a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1238 microversion: 2.1 time: 0.065517 Oct 04 19:04:57.172783 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3678/7361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:57 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:58.197327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-edf30cad-3f16-4fe3-b5f4-fccc3ce7b51c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:58.198021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-edf30cad-3f16-4fe3-b5f4-fccc3ce7b51c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:58.200388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:58.208280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edf30cad-3f16-4fe3-b5f4-fccc3ce7b51c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:58.208816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edf30cad-3f16-4fe3-b5f4-fccc3ce7b51c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:58.209266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edf30cad-3f16-4fe3-b5f4-fccc3ce7b51c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:58.209981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edf30cad-3f16-4fe3-b5f4-fccc3ce7b51c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:58.210446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edf30cad-3f16-4fe3-b5f4-fccc3ce7b51c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:58.210882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-edf30cad-3f16-4fe3-b5f4-fccc3ce7b51c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:58.283297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-edf30cad-3f16-4fe3-b5f4-fccc3ce7b51c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:58.291876 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-edf30cad-3f16-4fe3-b5f4-fccc3ce7b51c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1298 microversion: 2.1 time: 0.099762 Oct 04 19:04:58.307266 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3684/7362] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:58 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:59.316558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2eab2ab8-00eb-4bee-bd42-9294da540208 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:59.317229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2eab2ab8-00eb-4bee-bd42-9294da540208 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:59.320192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:59.326679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eab2ab8-00eb-4bee-bd42-9294da540208 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:59.327243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eab2ab8-00eb-4bee-bd42-9294da540208 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:59.327698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eab2ab8-00eb-4bee-bd42-9294da540208 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:59.328429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eab2ab8-00eb-4bee-bd42-9294da540208 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:59.328912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eab2ab8-00eb-4bee-bd42-9294da540208 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:59.329363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2eab2ab8-00eb-4bee-bd42-9294da540208 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:59.477319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2eab2ab8-00eb-4bee-bd42-9294da540208 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:59.485508 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2eab2ab8-00eb-4bee-bd42-9294da540208 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1364 microversion: 2.1 time: 0.172972 Oct 04 19:04:59.486308 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3679/7363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:59 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:59.765190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-10f6b858-535a-4d9f-9555-4a2a7ff7fc07 req-3e1d3366-6984-42d7-bac1-00e2d08b8cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b4cece-8119-4552-9c26-a7a531595a41", "tag": "f78de6cb-c4ae-4271-8766-07d6f414eae2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:59.776384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-10f6b858-535a-4d9f-9555-4a2a7ff7fc07 req-3e1d3366-6984-42d7-bac1-00e2d08b8cfe service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:59.776965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-10f6b858-535a-4d9f-9555-4a2a7ff7fc07 req-3e1d3366-6984-42d7-bac1-00e2d08b8cfe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:59.777607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-10f6b858-535a-4d9f-9555-4a2a7ff7fc07 req-3e1d3366-6984-42d7-bac1-00e2d08b8cfe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:59.789034 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-10f6b858-535a-4d9f-9555-4a2a7ff7fc07 req-3e1d3366-6984-42d7-bac1-00e2d08b8cfe service nova] Creating event network-changed:f78de6cb-c4ae-4271-8766-07d6f414eae2 for instance 58b4cece-8119-4552-9c26-a7a531595a41 on n-h2-850499-14 Oct 04 19:04:59.793771 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-10f6b858-535a-4d9f-9555-4a2a7ff7fc07 req-3e1d3366-6984-42d7-bac1-00e2d08b8cfe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032587 Oct 04 19:04:59.794371 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3685/7364] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:00.509222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99ef4463-d890-43e1-a6fd-a7c2f33289fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:00.509849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99ef4463-d890-43e1-a6fd-a7c2f33289fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:00.516730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99ef4463-d890-43e1-a6fd-a7c2f33289fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:00.517230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99ef4463-d890-43e1-a6fd-a7c2f33289fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:00.517680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99ef4463-d890-43e1-a6fd-a7c2f33289fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.518895 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99ef4463-d890-43e1-a6fd-a7c2f33289fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:00.519382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99ef4463-d890-43e1-a6fd-a7c2f33289fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:00.519821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99ef4463-d890-43e1-a6fd-a7c2f33289fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.650608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-99ef4463-d890-43e1-a6fd-a7c2f33289fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:00.658304 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99ef4463-d890-43e1-a6fd-a7c2f33289fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1364 microversion: 2.1 time: 0.153077 Oct 04 19:05:00.659430 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3680/7365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:00 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:01.683226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3dcc8514-a93d-46ae-b183-03b55d3edfcc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:01.683961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3dcc8514-a93d-46ae-b183-03b55d3edfcc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:01.690143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc8514-a93d-46ae-b183-03b55d3edfcc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:01.690570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc8514-a93d-46ae-b183-03b55d3edfcc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:01.691042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc8514-a93d-46ae-b183-03b55d3edfcc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:01.691733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc8514-a93d-46ae-b183-03b55d3edfcc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:01.692188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc8514-a93d-46ae-b183-03b55d3edfcc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:01.692614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3dcc8514-a93d-46ae-b183-03b55d3edfcc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:01.823291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3dcc8514-a93d-46ae-b183-03b55d3edfcc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:01.831669 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3dcc8514-a93d-46ae-b183-03b55d3edfcc tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1364 microversion: 2.1 time: 0.153770 Oct 04 19:05:01.832247 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3686/7366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:01 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:02.855659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9c92fee1-a581-4c54-b6c5-a2e471f634f3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:02.856305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9c92fee1-a581-4c54-b6c5-a2e471f634f3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:02.863243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c92fee1-a581-4c54-b6c5-a2e471f634f3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:02.863757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c92fee1-a581-4c54-b6c5-a2e471f634f3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:02.864220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c92fee1-a581-4c54-b6c5-a2e471f634f3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:02.864990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c92fee1-a581-4c54-b6c5-a2e471f634f3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:02.865476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c92fee1-a581-4c54-b6c5-a2e471f634f3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:02.865926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c92fee1-a581-4c54-b6c5-a2e471f634f3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:03.001002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9c92fee1-a581-4c54-b6c5-a2e471f634f3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:03.010046 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9c92fee1-a581-4c54-b6c5-a2e471f634f3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1364 microversion: 2.1 time: 0.158175 Oct 04 19:05:03.011053 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3681/7367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:02 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:04.035407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96390310-f2b1-424f-8b0e-34ed388c0ae0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:04.036111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96390310-f2b1-424f-8b0e-34ed388c0ae0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:04.043056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96390310-f2b1-424f-8b0e-34ed388c0ae0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.043545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96390310-f2b1-424f-8b0e-34ed388c0ae0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.043991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96390310-f2b1-424f-8b0e-34ed388c0ae0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.044698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96390310-f2b1-424f-8b0e-34ed388c0ae0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.045163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96390310-f2b1-424f-8b0e-34ed388c0ae0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.045595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96390310-f2b1-424f-8b0e-34ed388c0ae0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.174014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96390310-f2b1-424f-8b0e-34ed388c0ae0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:04.182218 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96390310-f2b1-424f-8b0e-34ed388c0ae0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1364 microversion: 2.1 time: 0.151647 Oct 04 19:05:04.182785 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3687/7368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:04 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:04.541742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-36157db2-f8bc-4c7d-ac84-b567fb5977f3 req-96642210-8bbb-45ed-bbf8-ca4d44d4d521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b4cece-8119-4552-9c26-a7a531595a41", "name": "network-vif-plugged", "status": "completed", "tag": "f78de6cb-c4ae-4271-8766-07d6f414eae2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:04.551618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-36157db2-f8bc-4c7d-ac84-b567fb5977f3 req-96642210-8bbb-45ed-bbf8-ca4d44d4d521 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.552117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-36157db2-f8bc-4c7d-ac84-b567fb5977f3 req-96642210-8bbb-45ed-bbf8-ca4d44d4d521 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.552558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-36157db2-f8bc-4c7d-ac84-b567fb5977f3 req-96642210-8bbb-45ed-bbf8-ca4d44d4d521 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.564213 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-36157db2-f8bc-4c7d-ac84-b567fb5977f3 req-96642210-8bbb-45ed-bbf8-ca4d44d4d521 service nova] Creating event network-vif-plugged:f78de6cb-c4ae-4271-8766-07d6f414eae2 for instance 58b4cece-8119-4552-9c26-a7a531595a41 on n-h2-850499-14 Oct 04 19:05:04.569874 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-36157db2-f8bc-4c7d-ac84-b567fb5977f3 req-96642210-8bbb-45ed-bbf8-ca4d44d4d521 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089467 Oct 04 19:05:04.570706 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3682/7369] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:05.205501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a92c612-7505-42fb-91d3-48f275f26b92 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:05.206143 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1a92c612-7505-42fb-91d3-48f275f26b92 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:05.213009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a92c612-7505-42fb-91d3-48f275f26b92 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:05.213501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a92c612-7505-42fb-91d3-48f275f26b92 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:05.213945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a92c612-7505-42fb-91d3-48f275f26b92 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:05.214644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a92c612-7505-42fb-91d3-48f275f26b92 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:05.215141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a92c612-7505-42fb-91d3-48f275f26b92 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:05.215580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a92c612-7505-42fb-91d3-48f275f26b92 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:05.346910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1a92c612-7505-42fb-91d3-48f275f26b92 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:05.354783 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1a92c612-7505-42fb-91d3-48f275f26b92 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1364 microversion: 2.1 time: 0.153182 Oct 04 19:05:05.355387 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3688/7370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:05 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:06.380631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42224734-0548-4517-86c7-3857e680cda7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:06.381364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42224734-0548-4517-86c7-3857e680cda7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:06.387661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42224734-0548-4517-86c7-3857e680cda7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.388176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42224734-0548-4517-86c7-3857e680cda7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.388638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42224734-0548-4517-86c7-3857e680cda7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.389353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42224734-0548-4517-86c7-3857e680cda7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.389891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42224734-0548-4517-86c7-3857e680cda7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.390339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42224734-0548-4517-86c7-3857e680cda7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.518882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-42224734-0548-4517-86c7-3857e680cda7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:06.526608 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42224734-0548-4517-86c7-3857e680cda7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1550 microversion: 2.1 time: 0.151681 Oct 04 19:05:06.527224 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3683/7371] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:06 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:06.550182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a889efb1-220c-4eb8-918a-f21d747a153e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:06.550721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a889efb1-220c-4eb8-918a-f21d747a153e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:06.558271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a889efb1-220c-4eb8-918a-f21d747a153e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.558758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a889efb1-220c-4eb8-918a-f21d747a153e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.559230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a889efb1-220c-4eb8-918a-f21d747a153e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.559925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a889efb1-220c-4eb8-918a-f21d747a153e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.560402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a889efb1-220c-4eb8-918a-f21d747a153e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.560830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a889efb1-220c-4eb8-918a-f21d747a153e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.636533 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a889efb1-220c-4eb8-918a-f21d747a153e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090673 Oct 04 19:05:06.637144 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3689/7372] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 19:05:06 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:07.948569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fdb8a0da-0382-482b-a866-01ea0dacc255 req-761990e8-92c9-4ba3-8e83-4b4b6092fb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b4cece-8119-4552-9c26-a7a531595a41", "tag": "f78de6cb-c4ae-4271-8766-07d6f414eae2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:07.953597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:07.961051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fdb8a0da-0382-482b-a866-01ea0dacc255 req-761990e8-92c9-4ba3-8e83-4b4b6092fb4c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:07.961564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fdb8a0da-0382-482b-a866-01ea0dacc255 req-761990e8-92c9-4ba3-8e83-4b4b6092fb4c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:07.962017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fdb8a0da-0382-482b-a866-01ea0dacc255 req-761990e8-92c9-4ba3-8e83-4b4b6092fb4c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:07.977160 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fdb8a0da-0382-482b-a866-01ea0dacc255 req-761990e8-92c9-4ba3-8e83-4b4b6092fb4c service nova] Creating event network-changed:f78de6cb-c4ae-4271-8766-07d6f414eae2 for instance 58b4cece-8119-4552-9c26-a7a531595a41 on n-h2-850499-14 Oct 04 19:05:07.982398 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fdb8a0da-0382-482b-a866-01ea0dacc255 req-761990e8-92c9-4ba3-8e83-4b4b6092fb4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037442 Oct 04 19:05:07.983239 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3684/7373] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:22.031104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:22.032111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:22.034116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=11 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:22.034745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=42 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:22.090930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:22.093425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:22.101685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.102207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.102647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.103386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.103856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.104276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.133962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:22.140409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Old instance type m1.heat2, new instance type m1.heat {{(pid=122332) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:06:22.147331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:06:22.147756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:06:22.148234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:06:22.148650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:06:22.149107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:06:22.214183 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-295e9c10-998f-43c5-8d4b-87c2b761ec8c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41/action" status: 202 len: 0 microversion: 2.1 time: 0.184337 Oct 04 19:06:22.214802 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3690/7374] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:06:22 2022] POST /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:06:22.223341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=11 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:22.225007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:22.226154 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:06:22.226343 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:06:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 (ip 10.222.0.18) !!! Oct 04 19:06:22.240484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee40c9ef-e47a-46aa-ba11-f994eabf38aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:22.241297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ee40c9ef-e47a-46aa-ba11-f994eabf38aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:22.253224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee40c9ef-e47a-46aa-ba11-f994eabf38aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.253744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee40c9ef-e47a-46aa-ba11-f994eabf38aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.254201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee40c9ef-e47a-46aa-ba11-f994eabf38aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.254920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee40c9ef-e47a-46aa-ba11-f994eabf38aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.255662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee40c9ef-e47a-46aa-ba11-f994eabf38aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.255960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee40c9ef-e47a-46aa-ba11-f994eabf38aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.409514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee40c9ef-e47a-46aa-ba11-f994eabf38aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:22.417757 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ee40c9ef-e47a-46aa-ba11-f994eabf38aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1677 microversion: 2.1 time: 0.197633 Oct 04 19:06:22.418344 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3685/7375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:22 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:23.443637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-afe4adbc-0d05-4cb2-b770-fb7a97d9ca90 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:23.444260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-afe4adbc-0d05-4cb2-b770-fb7a97d9ca90 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:23.451325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afe4adbc-0d05-4cb2-b770-fb7a97d9ca90 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.451840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afe4adbc-0d05-4cb2-b770-fb7a97d9ca90 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.452291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afe4adbc-0d05-4cb2-b770-fb7a97d9ca90 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.453010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afe4adbc-0d05-4cb2-b770-fb7a97d9ca90 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.453478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afe4adbc-0d05-4cb2-b770-fb7a97d9ca90 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.453919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afe4adbc-0d05-4cb2-b770-fb7a97d9ca90 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.604112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-afe4adbc-0d05-4cb2-b770-fb7a97d9ca90 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:23.613202 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-afe4adbc-0d05-4cb2-b770-fb7a97d9ca90 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1677 microversion: 2.1 time: 0.174512 Oct 04 19:06:23.613874 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3691/7376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:23 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:24.637200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d5626a31-5183-4b3c-b015-9f6489c32f7a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:24.637889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d5626a31-5183-4b3c-b015-9f6489c32f7a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:24.645530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5626a31-5183-4b3c-b015-9f6489c32f7a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.646047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5626a31-5183-4b3c-b015-9f6489c32f7a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.646515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5626a31-5183-4b3c-b015-9f6489c32f7a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.647270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5626a31-5183-4b3c-b015-9f6489c32f7a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.647801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5626a31-5183-4b3c-b015-9f6489c32f7a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.648207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5626a31-5183-4b3c-b015-9f6489c32f7a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.784104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d5626a31-5183-4b3c-b015-9f6489c32f7a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:24.791929 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d5626a31-5183-4b3c-b015-9f6489c32f7a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.158686 Oct 04 19:06:24.792505 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3686/7377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:24 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:25.817273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-032f9112-a308-4e94-b076-b6d70924bcaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:25.817802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-032f9112-a308-4e94-b076-b6d70924bcaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:25.824517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-032f9112-a308-4e94-b076-b6d70924bcaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.825050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-032f9112-a308-4e94-b076-b6d70924bcaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.825529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-032f9112-a308-4e94-b076-b6d70924bcaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.826237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-032f9112-a308-4e94-b076-b6d70924bcaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.827221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-032f9112-a308-4e94-b076-b6d70924bcaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.827660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-032f9112-a308-4e94-b076-b6d70924bcaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.975797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-032f9112-a308-4e94-b076-b6d70924bcaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:25.983676 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-032f9112-a308-4e94-b076-b6d70924bcaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.170576 Oct 04 19:06:25.984252 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3692/7378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:25 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:27.007883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cfbe7a86-f2a4-47cb-a0fd-7e6ff270e101 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:27.008459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cfbe7a86-f2a4-47cb-a0fd-7e6ff270e101 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:27.015459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbe7a86-f2a4-47cb-a0fd-7e6ff270e101 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:27.016023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbe7a86-f2a4-47cb-a0fd-7e6ff270e101 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:27.016458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbe7a86-f2a4-47cb-a0fd-7e6ff270e101 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:27.017180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbe7a86-f2a4-47cb-a0fd-7e6ff270e101 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:27.017666 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbe7a86-f2a4-47cb-a0fd-7e6ff270e101 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:27.018114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cfbe7a86-f2a4-47cb-a0fd-7e6ff270e101 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:27.149669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cfbe7a86-f2a4-47cb-a0fd-7e6ff270e101 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:27.158224 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cfbe7a86-f2a4-47cb-a0fd-7e6ff270e101 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.154362 Oct 04 19:06:27.158812 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3687/7379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:27 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:28.181904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f13d7d9d-3c8b-4d22-8409-ae40f7d598e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:28.182513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f13d7d9d-3c8b-4d22-8409-ae40f7d598e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:28.190063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f13d7d9d-3c8b-4d22-8409-ae40f7d598e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:28.190547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f13d7d9d-3c8b-4d22-8409-ae40f7d598e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:28.191009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f13d7d9d-3c8b-4d22-8409-ae40f7d598e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:28.191696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f13d7d9d-3c8b-4d22-8409-ae40f7d598e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:28.192150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f13d7d9d-3c8b-4d22-8409-ae40f7d598e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:28.192698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f13d7d9d-3c8b-4d22-8409-ae40f7d598e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:28.324324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f13d7d9d-3c8b-4d22-8409-ae40f7d598e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:28.332174 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f13d7d9d-3c8b-4d22-8409-ae40f7d598e5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.154387 Oct 04 19:06:28.332751 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3693/7380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:28 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:29.355834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-94bf21c9-a175-4173-b7cc-ef8ba3c0325b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:29.356497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-94bf21c9-a175-4173-b7cc-ef8ba3c0325b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:29.363987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94bf21c9-a175-4173-b7cc-ef8ba3c0325b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:29.364499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94bf21c9-a175-4173-b7cc-ef8ba3c0325b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:29.364958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94bf21c9-a175-4173-b7cc-ef8ba3c0325b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:29.365676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94bf21c9-a175-4173-b7cc-ef8ba3c0325b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:29.366155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94bf21c9-a175-4173-b7cc-ef8ba3c0325b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:29.366603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-94bf21c9-a175-4173-b7cc-ef8ba3c0325b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:29.498242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-94bf21c9-a175-4173-b7cc-ef8ba3c0325b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:29.506567 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-94bf21c9-a175-4173-b7cc-ef8ba3c0325b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.154655 Oct 04 19:06:29.507169 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3688/7381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:29 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:30.529731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb8b94ce-258b-4ee6-b16e-4548c36eb886 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:30.530348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb8b94ce-258b-4ee6-b16e-4548c36eb886 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:30.538085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb8b94ce-258b-4ee6-b16e-4548c36eb886 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:30.538583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb8b94ce-258b-4ee6-b16e-4548c36eb886 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:30.539065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb8b94ce-258b-4ee6-b16e-4548c36eb886 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:30.539771 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb8b94ce-258b-4ee6-b16e-4548c36eb886 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:30.540238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb8b94ce-258b-4ee6-b16e-4548c36eb886 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:30.540674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb8b94ce-258b-4ee6-b16e-4548c36eb886 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:30.667269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb8b94ce-258b-4ee6-b16e-4548c36eb886 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:30.675458 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb8b94ce-258b-4ee6-b16e-4548c36eb886 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.149601 Oct 04 19:06:30.676031 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3694/7382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:30 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:31.699042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2e1f25f3-945e-43ac-9e31-b94a3a33b459 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:31.699587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2e1f25f3-945e-43ac-9e31-b94a3a33b459 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:31.706361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e1f25f3-945e-43ac-9e31-b94a3a33b459 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:31.706861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e1f25f3-945e-43ac-9e31-b94a3a33b459 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:31.707343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e1f25f3-945e-43ac-9e31-b94a3a33b459 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:31.708046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e1f25f3-945e-43ac-9e31-b94a3a33b459 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:31.708520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e1f25f3-945e-43ac-9e31-b94a3a33b459 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:31.708959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2e1f25f3-945e-43ac-9e31-b94a3a33b459 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:31.843614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2e1f25f3-945e-43ac-9e31-b94a3a33b459 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:31.851961 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2e1f25f3-945e-43ac-9e31-b94a3a33b459 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.156861 Oct 04 19:06:31.852534 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3689/7383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:31 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:32.876284 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-70564ce1-188e-4030-bb71-8e1445243b04 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:32.876937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-70564ce1-188e-4030-bb71-8e1445243b04 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:32.883639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70564ce1-188e-4030-bb71-8e1445243b04 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:32.884122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70564ce1-188e-4030-bb71-8e1445243b04 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:32.884561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70564ce1-188e-4030-bb71-8e1445243b04 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:32.885250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70564ce1-188e-4030-bb71-8e1445243b04 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:32.885706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70564ce1-188e-4030-bb71-8e1445243b04 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:32.886127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-70564ce1-188e-4030-bb71-8e1445243b04 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:33.025454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-70564ce1-188e-4030-bb71-8e1445243b04 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:33.033760 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-70564ce1-188e-4030-bb71-8e1445243b04 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.161826 Oct 04 19:06:33.034333 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3695/7384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:32 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:34.058089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab575eb9-6913-442e-aa80-2ce1c9a2b243 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:34.058698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ab575eb9-6913-442e-aa80-2ce1c9a2b243 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:34.065659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab575eb9-6913-442e-aa80-2ce1c9a2b243 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.066159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab575eb9-6913-442e-aa80-2ce1c9a2b243 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.066612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab575eb9-6913-442e-aa80-2ce1c9a2b243 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.067370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab575eb9-6913-442e-aa80-2ce1c9a2b243 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.067839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab575eb9-6913-442e-aa80-2ce1c9a2b243 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.068275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab575eb9-6913-442e-aa80-2ce1c9a2b243 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.200421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ab575eb9-6913-442e-aa80-2ce1c9a2b243 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:34.208231 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ab575eb9-6913-442e-aa80-2ce1c9a2b243 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.154113 Oct 04 19:06:34.208810 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3690/7385] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:34 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:35.232637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a18a1f6b-808c-4f2c-8233-5454d5a81571 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:35.233287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a18a1f6b-808c-4f2c-8233-5454d5a81571 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:35.240724 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a18a1f6b-808c-4f2c-8233-5454d5a81571 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:35.241221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a18a1f6b-808c-4f2c-8233-5454d5a81571 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:35.242206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a18a1f6b-808c-4f2c-8233-5454d5a81571 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:35.242921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a18a1f6b-808c-4f2c-8233-5454d5a81571 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:35.243422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a18a1f6b-808c-4f2c-8233-5454d5a81571 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:35.243863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a18a1f6b-808c-4f2c-8233-5454d5a81571 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:35.381621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a18a1f6b-808c-4f2c-8233-5454d5a81571 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:35.395062 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a18a1f6b-808c-4f2c-8233-5454d5a81571 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.166062 Oct 04 19:06:35.395874 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3696/7386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:35 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:36.418113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6aab8b43-5c0e-4ed5-b915-67a85b49a262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:36.418874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6aab8b43-5c0e-4ed5-b915-67a85b49a262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:36.426027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aab8b43-5c0e-4ed5-b915-67a85b49a262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:36.426537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aab8b43-5c0e-4ed5-b915-67a85b49a262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:36.427035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aab8b43-5c0e-4ed5-b915-67a85b49a262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:36.427769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aab8b43-5c0e-4ed5-b915-67a85b49a262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:36.428532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aab8b43-5c0e-4ed5-b915-67a85b49a262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:36.428985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6aab8b43-5c0e-4ed5-b915-67a85b49a262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:36.566965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6aab8b43-5c0e-4ed5-b915-67a85b49a262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:36.579510 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6aab8b43-5c0e-4ed5-b915-67a85b49a262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.164599 Oct 04 19:06:36.580136 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3691/7387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:36 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:37.602896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74781dc1-89aa-4941-949a-a7fbba3056cd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:37.603528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-74781dc1-89aa-4941-949a-a7fbba3056cd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:37.610932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74781dc1-89aa-4941-949a-a7fbba3056cd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.611424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74781dc1-89aa-4941-949a-a7fbba3056cd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.611860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74781dc1-89aa-4941-949a-a7fbba3056cd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.612547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74781dc1-89aa-4941-949a-a7fbba3056cd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.613003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74781dc1-89aa-4941-949a-a7fbba3056cd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.613426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74781dc1-89aa-4941-949a-a7fbba3056cd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.745399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-74781dc1-89aa-4941-949a-a7fbba3056cd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:37.753667 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74781dc1-89aa-4941-949a-a7fbba3056cd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.154650 Oct 04 19:06:37.754246 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3697/7388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:37 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:38.776971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8662868a-f61d-414f-8128-d6814dcbcf6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:38.777623 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8662868a-f61d-414f-8128-d6814dcbcf6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:38.784446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8662868a-f61d-414f-8128-d6814dcbcf6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:38.784943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8662868a-f61d-414f-8128-d6814dcbcf6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:38.785398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8662868a-f61d-414f-8128-d6814dcbcf6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:38.786099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8662868a-f61d-414f-8128-d6814dcbcf6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:38.786731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8662868a-f61d-414f-8128-d6814dcbcf6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:38.787188 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8662868a-f61d-414f-8128-d6814dcbcf6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:38.922896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8662868a-f61d-414f-8128-d6814dcbcf6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:38.931052 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8662868a-f61d-414f-8128-d6814dcbcf6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.157939 Oct 04 19:06:38.931630 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3692/7389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:38 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:39.954682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-57fb8889-57cd-45ee-b7bd-345e795bddaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:39.955329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-57fb8889-57cd-45ee-b7bd-345e795bddaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:39.962150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57fb8889-57cd-45ee-b7bd-345e795bddaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:39.962638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57fb8889-57cd-45ee-b7bd-345e795bddaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:39.963113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57fb8889-57cd-45ee-b7bd-345e795bddaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:39.963815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57fb8889-57cd-45ee-b7bd-345e795bddaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:39.964277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57fb8889-57cd-45ee-b7bd-345e795bddaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:39.964711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-57fb8889-57cd-45ee-b7bd-345e795bddaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:40.100099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-57fb8889-57cd-45ee-b7bd-345e795bddaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:40.107896 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-57fb8889-57cd-45ee-b7bd-345e795bddaf tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.157043 Oct 04 19:06:40.108483 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3698/7390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:39 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:41.132130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-73135313-2cfb-42b4-a216-512f9a51d442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:41.132718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-73135313-2cfb-42b4-a216-512f9a51d442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:41.139774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73135313-2cfb-42b4-a216-512f9a51d442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:41.140286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73135313-2cfb-42b4-a216-512f9a51d442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:41.140748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73135313-2cfb-42b4-a216-512f9a51d442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:41.141487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73135313-2cfb-42b4-a216-512f9a51d442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:41.141961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73135313-2cfb-42b4-a216-512f9a51d442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:41.142410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-73135313-2cfb-42b4-a216-512f9a51d442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:41.286344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-73135313-2cfb-42b4-a216-512f9a51d442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:41.294457 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-73135313-2cfb-42b4-a216-512f9a51d442 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1682 microversion: 2.1 time: 0.166285 Oct 04 19:06:41.295072 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3693/7391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:41 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:42.001517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-3df70b51-7023-4b03-8772-8d679d961656 req-b8b0257e-023c-4680-addc-e8713da61c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b4cece-8119-4552-9c26-a7a531595a41", "name": "network-vif-unplugged", "status": "completed", "tag": "f78de6cb-c4ae-4271-8766-07d6f414eae2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:42.022822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3df70b51-7023-4b03-8772-8d679d961656 req-b8b0257e-023c-4680-addc-e8713da61c42 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:42.023843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3df70b51-7023-4b03-8772-8d679d961656 req-b8b0257e-023c-4680-addc-e8713da61c42 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:42.024743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3df70b51-7023-4b03-8772-8d679d961656 req-b8b0257e-023c-4680-addc-e8713da61c42 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.039227 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-3df70b51-7023-4b03-8772-8d679d961656 req-b8b0257e-023c-4680-addc-e8713da61c42 service nova] Creating event network-vif-unplugged:f78de6cb-c4ae-4271-8766-07d6f414eae2 for instance 58b4cece-8119-4552-9c26-a7a531595a41 on n-h1-850499-14 Oct 04 19:06:42.045721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-3df70b51-7023-4b03-8772-8d679d961656 req-b8b0257e-023c-4680-addc-e8713da61c42 service nova] Instance 58b4cece-8119-4552-9c26-a7a531595a41 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:06:42.060737 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-3df70b51-7023-4b03-8772-8d679d961656 req-b8b0257e-023c-4680-addc-e8713da61c42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063523 Oct 04 19:06:42.061564 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3699/7392] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:42.319228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27965132-555b-4116-98a4-daf3716879d2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:42.319880 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27965132-555b-4116-98a4-daf3716879d2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:42.329076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27965132-555b-4116-98a4-daf3716879d2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:42.329757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27965132-555b-4116-98a4-daf3716879d2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:42.330216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27965132-555b-4116-98a4-daf3716879d2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.330980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27965132-555b-4116-98a4-daf3716879d2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:42.331453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27965132-555b-4116-98a4-daf3716879d2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:42.331891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27965132-555b-4116-98a4-daf3716879d2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.485299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27965132-555b-4116-98a4-daf3716879d2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:42.496941 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27965132-555b-4116-98a4-daf3716879d2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1681 microversion: 2.1 time: 0.182586 Oct 04 19:06:42.497568 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3694/7393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:42 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:43.524999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-afc31922-df0e-4fb0-bf0e-a8c379a08a65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:43.525710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-afc31922-df0e-4fb0-bf0e-a8c379a08a65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:43.532214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc31922-df0e-4fb0-bf0e-a8c379a08a65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.532709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc31922-df0e-4fb0-bf0e-a8c379a08a65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.533158 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc31922-df0e-4fb0-bf0e-a8c379a08a65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.533926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc31922-df0e-4fb0-bf0e-a8c379a08a65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.534391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc31922-df0e-4fb0-bf0e-a8c379a08a65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.534822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afc31922-df0e-4fb0-bf0e-a8c379a08a65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.673633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-afc31922-df0e-4fb0-bf0e-a8c379a08a65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:43.681647 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-afc31922-df0e-4fb0-bf0e-a8c379a08a65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1679 microversion: 2.1 time: 0.161946 Oct 04 19:06:43.682225 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3700/7394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:43 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:44.084418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-287767b1-5702-487b-80bd-aa7c3171eef6 req-32fa9bef-ea63-438c-b864-5039141cc486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b4cece-8119-4552-9c26-a7a531595a41", "tag": "f78de6cb-c4ae-4271-8766-07d6f414eae2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:44.094636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-287767b1-5702-487b-80bd-aa7c3171eef6 req-32fa9bef-ea63-438c-b864-5039141cc486 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.095177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-287767b1-5702-487b-80bd-aa7c3171eef6 req-32fa9bef-ea63-438c-b864-5039141cc486 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.095631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-287767b1-5702-487b-80bd-aa7c3171eef6 req-32fa9bef-ea63-438c-b864-5039141cc486 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.108192 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-287767b1-5702-487b-80bd-aa7c3171eef6 req-32fa9bef-ea63-438c-b864-5039141cc486 service nova] Creating event network-changed:f78de6cb-c4ae-4271-8766-07d6f414eae2 for instance 58b4cece-8119-4552-9c26-a7a531595a41 on n-h1-850499-14 Oct 04 19:06:44.113525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-287767b1-5702-487b-80bd-aa7c3171eef6 req-32fa9bef-ea63-438c-b864-5039141cc486 service nova] Instance 58b4cece-8119-4552-9c26-a7a531595a41 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:06:44.124600 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-287767b1-5702-487b-80bd-aa7c3171eef6 req-32fa9bef-ea63-438c-b864-5039141cc486 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043898 Oct 04 19:06:44.125701 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3695/7395] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:44.707003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-13d2b5bd-22b5-4e54-91ac-d21cd8d23628 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:44.707631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-13d2b5bd-22b5-4e54-91ac-d21cd8d23628 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:44.714433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d2b5bd-22b5-4e54-91ac-d21cd8d23628 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.714923 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d2b5bd-22b5-4e54-91ac-d21cd8d23628 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.715396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d2b5bd-22b5-4e54-91ac-d21cd8d23628 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.716088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d2b5bd-22b5-4e54-91ac-d21cd8d23628 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.716544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d2b5bd-22b5-4e54-91ac-d21cd8d23628 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.716973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-13d2b5bd-22b5-4e54-91ac-d21cd8d23628 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.846640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-13d2b5bd-22b5-4e54-91ac-d21cd8d23628 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:44.854404 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-13d2b5bd-22b5-4e54-91ac-d21cd8d23628 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1679 microversion: 2.1 time: 0.151979 Oct 04 19:06:44.854990 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3701/7396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:44 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:45.879405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1252410a-d832-4d6a-b78e-6a80782046f0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:45.880047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1252410a-d832-4d6a-b78e-6a80782046f0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:45.886263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1252410a-d832-4d6a-b78e-6a80782046f0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.886780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1252410a-d832-4d6a-b78e-6a80782046f0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.887274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1252410a-d832-4d6a-b78e-6a80782046f0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.887992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1252410a-d832-4d6a-b78e-6a80782046f0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.888474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1252410a-d832-4d6a-b78e-6a80782046f0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.888922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1252410a-d832-4d6a-b78e-6a80782046f0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.027762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1252410a-d832-4d6a-b78e-6a80782046f0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:46.036078 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1252410a-d832-4d6a-b78e-6a80782046f0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1676 microversion: 2.1 time: 0.161975 Oct 04 19:06:46.036653 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3696/7397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:45 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:46.061004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:46.061853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:46.070099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:46.070990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:46.071652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.072692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:46.073214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:46.073729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.113275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:46.113755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:46.114191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.114910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:46.115391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:46.115818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.136977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:46.142659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for user b54bee64da524366a871ff5dac9bcc9e and project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:46.222718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:46.245045 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-01d3b728-30f3-4487-9698-3cf63925ab6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41/action" status: 202 len: 0 microversion: 2.1 time: 0.189338 Oct 04 19:06:46.245664 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3702/7398] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:06:46 2022] POST /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:06:46.254378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-51e29dc1-3384-4f17-94ee-504a899bb2e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:46.255036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-51e29dc1-3384-4f17-94ee-504a899bb2e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:46.261433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51e29dc1-3384-4f17-94ee-504a899bb2e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:46.261945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51e29dc1-3384-4f17-94ee-504a899bb2e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:46.262406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51e29dc1-3384-4f17-94ee-504a899bb2e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.263195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51e29dc1-3384-4f17-94ee-504a899bb2e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:46.263675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51e29dc1-3384-4f17-94ee-504a899bb2e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:46.264122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-51e29dc1-3384-4f17-94ee-504a899bb2e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.399208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-51e29dc1-3384-4f17-94ee-504a899bb2e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:46.407163 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-51e29dc1-3384-4f17-94ee-504a899bb2e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1675 microversion: 2.1 time: 0.157127 Oct 04 19:06:46.407753 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3697/7399] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:46 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:47.432908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a8766a6f-7ab5-42ee-82bd-3acb9d012318 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:47.433623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a8766a6f-7ab5-42ee-82bd-3acb9d012318 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:47.441477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8766a6f-7ab5-42ee-82bd-3acb9d012318 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.441983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8766a6f-7ab5-42ee-82bd-3acb9d012318 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.442431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8766a6f-7ab5-42ee-82bd-3acb9d012318 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.443186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8766a6f-7ab5-42ee-82bd-3acb9d012318 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.443654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8766a6f-7ab5-42ee-82bd-3acb9d012318 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.444089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a8766a6f-7ab5-42ee-82bd-3acb9d012318 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.574397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a8766a6f-7ab5-42ee-82bd-3acb9d012318 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:47.582160 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a8766a6f-7ab5-42ee-82bd-3acb9d012318 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1675 microversion: 2.1 time: 0.154680 Oct 04 19:06:47.583121 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3703/7400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:47 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:48.607598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62d1976a-b9a7-4f40-b96a-ea2b38cff38e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:48.608233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-62d1976a-b9a7-4f40-b96a-ea2b38cff38e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:48.615641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62d1976a-b9a7-4f40-b96a-ea2b38cff38e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:48.616160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62d1976a-b9a7-4f40-b96a-ea2b38cff38e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:48.616619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62d1976a-b9a7-4f40-b96a-ea2b38cff38e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:48.617447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62d1976a-b9a7-4f40-b96a-ea2b38cff38e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:48.617929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62d1976a-b9a7-4f40-b96a-ea2b38cff38e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:48.618371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62d1976a-b9a7-4f40-b96a-ea2b38cff38e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:48.763922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62d1976a-b9a7-4f40-b96a-ea2b38cff38e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:48.771650 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-62d1976a-b9a7-4f40-b96a-ea2b38cff38e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1675 microversion: 2.1 time: 0.168306 Oct 04 19:06:48.772228 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3698/7401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:48 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:49.176985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-21750408-4895-4e50-924b-5c57c711b91a req-17399e1f-83da-42ac-86a9-bcddee741ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b4cece-8119-4552-9c26-a7a531595a41", "name": "network-vif-plugged", "status": "completed", "tag": "f78de6cb-c4ae-4271-8766-07d6f414eae2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:49.188236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-21750408-4895-4e50-924b-5c57c711b91a req-17399e1f-83da-42ac-86a9-bcddee741ecb service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.188728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-21750408-4895-4e50-924b-5c57c711b91a req-17399e1f-83da-42ac-86a9-bcddee741ecb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.189163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-21750408-4895-4e50-924b-5c57c711b91a req-17399e1f-83da-42ac-86a9-bcddee741ecb service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.201445 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-21750408-4895-4e50-924b-5c57c711b91a req-17399e1f-83da-42ac-86a9-bcddee741ecb service nova] Creating event network-vif-plugged:f78de6cb-c4ae-4271-8766-07d6f414eae2 for instance 58b4cece-8119-4552-9c26-a7a531595a41 on n-h1-850499-14 Oct 04 19:06:49.206810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-21750408-4895-4e50-924b-5c57c711b91a req-17399e1f-83da-42ac-86a9-bcddee741ecb service nova] Instance 58b4cece-8119-4552-9c26-a7a531595a41 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:06:49.220413 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-21750408-4895-4e50-924b-5c57c711b91a req-17399e1f-83da-42ac-86a9-bcddee741ecb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048282 Oct 04 19:06:49.221140 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3704/7402] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:49.794797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8ce25b16-164e-4fa0-a2e3-302499ca52ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:49.795455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8ce25b16-164e-4fa0-a2e3-302499ca52ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:49.803619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce25b16-164e-4fa0-a2e3-302499ca52ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.804138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce25b16-164e-4fa0-a2e3-302499ca52ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.804608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce25b16-164e-4fa0-a2e3-302499ca52ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.805325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce25b16-164e-4fa0-a2e3-302499ca52ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.805807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce25b16-164e-4fa0-a2e3-302499ca52ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.806249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ce25b16-164e-4fa0-a2e3-302499ca52ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.937641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8ce25b16-164e-4fa0-a2e3-302499ca52ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:49.946595 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8ce25b16-164e-4fa0-a2e3-302499ca52ef tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1675 microversion: 2.1 time: 0.155602 Oct 04 19:06:49.947230 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3699/7403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:49 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:50.170896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-3701ab39-1b48-4be0-9a46-e471cfdcbdb4 req-f6d732bd-f1cf-4a3b-ae98-7b3d881bdbea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b4cece-8119-4552-9c26-a7a531595a41", "name": "network-vif-unplugged", "status": "completed", "tag": "f78de6cb-c4ae-4271-8766-07d6f414eae2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:50.183239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3701ab39-1b48-4be0-9a46-e471cfdcbdb4 req-f6d732bd-f1cf-4a3b-ae98-7b3d881bdbea service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.183832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3701ab39-1b48-4be0-9a46-e471cfdcbdb4 req-f6d732bd-f1cf-4a3b-ae98-7b3d881bdbea service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.184167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3701ab39-1b48-4be0-9a46-e471cfdcbdb4 req-f6d732bd-f1cf-4a3b-ae98-7b3d881bdbea service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.200064 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-3701ab39-1b48-4be0-9a46-e471cfdcbdb4 req-f6d732bd-f1cf-4a3b-ae98-7b3d881bdbea service nova] Creating event network-vif-unplugged:f78de6cb-c4ae-4271-8766-07d6f414eae2 for instance 58b4cece-8119-4552-9c26-a7a531595a41 on n-h2-850499-14 Oct 04 19:06:50.205732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-3701ab39-1b48-4be0-9a46-e471cfdcbdb4 req-f6d732bd-f1cf-4a3b-ae98-7b3d881bdbea service nova] Instance 58b4cece-8119-4552-9c26-a7a531595a41 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:06:50.216682 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-3701ab39-1b48-4be0-9a46-e471cfdcbdb4 req-f6d732bd-f1cf-4a3b-ae98-7b3d881bdbea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050169 Oct 04 19:06:50.217313 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3705/7404] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:50.972715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36b7d2fc-1129-4e7e-86a0-3e3f4dbf78e2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:50.973406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-36b7d2fc-1129-4e7e-86a0-3e3f4dbf78e2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:50.980301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36b7d2fc-1129-4e7e-86a0-3e3f4dbf78e2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.980807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36b7d2fc-1129-4e7e-86a0-3e3f4dbf78e2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.981271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36b7d2fc-1129-4e7e-86a0-3e3f4dbf78e2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.981994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36b7d2fc-1129-4e7e-86a0-3e3f4dbf78e2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.982468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36b7d2fc-1129-4e7e-86a0-3e3f4dbf78e2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.982912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36b7d2fc-1129-4e7e-86a0-3e3f4dbf78e2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:51.119436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-36b7d2fc-1129-4e7e-86a0-3e3f4dbf78e2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:51.127343 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-36b7d2fc-1129-4e7e-86a0-3e3f4dbf78e2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1675 microversion: 2.1 time: 0.159207 Oct 04 19:06:51.127919 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3700/7405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:50 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:52.152983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c326a5f-489a-4983-853e-d874428b0fe2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:52.153683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c326a5f-489a-4983-853e-d874428b0fe2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:52.155689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:52.162107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c326a5f-489a-4983-853e-d874428b0fe2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:52.162597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c326a5f-489a-4983-853e-d874428b0fe2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:52.163074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c326a5f-489a-4983-853e-d874428b0fe2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:52.163793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c326a5f-489a-4983-853e-d874428b0fe2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:52.164251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c326a5f-489a-4983-853e-d874428b0fe2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:52.164693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c326a5f-489a-4983-853e-d874428b0fe2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:52.255807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-36842caf-de50-43de-99c6-3de3ae67b6a1 req-35c3feb7-6308-43e6-a79d-168819ac56f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b4cece-8119-4552-9c26-a7a531595a41", "tag": "f78de6cb-c4ae-4271-8766-07d6f414eae2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:52.262069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=33 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:52.268207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-36842caf-de50-43de-99c6-3de3ae67b6a1 req-35c3feb7-6308-43e6-a79d-168819ac56f6 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:52.268836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-36842caf-de50-43de-99c6-3de3ae67b6a1 req-35c3feb7-6308-43e6-a79d-168819ac56f6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:52.269397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-36842caf-de50-43de-99c6-3de3ae67b6a1 req-35c3feb7-6308-43e6-a79d-168819ac56f6 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:52.272627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=95 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:52.284534 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-36842caf-de50-43de-99c6-3de3ae67b6a1 req-35c3feb7-6308-43e6-a79d-168819ac56f6 service nova] Creating event network-changed:f78de6cb-c4ae-4271-8766-07d6f414eae2 for instance 58b4cece-8119-4552-9c26-a7a531595a41 on n-h2-850499-14 Oct 04 19:06:52.290828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-36842caf-de50-43de-99c6-3de3ae67b6a1 req-35c3feb7-6308-43e6-a79d-168819ac56f6 service nova] Instance 58b4cece-8119-4552-9c26-a7a531595a41 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:06:52.303487 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-36842caf-de50-43de-99c6-3de3ae67b6a1 req-35c3feb7-6308-43e6-a79d-168819ac56f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051203 Oct 04 19:06:52.304363 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3701/7406] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:52.310340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4c326a5f-489a-4983-853e-d874428b0fe2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:52.320979 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c326a5f-489a-4983-853e-d874428b0fe2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1675 microversion: 2.1 time: 0.172465 Oct 04 19:06:52.320979 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3706/7407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:52 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:53.347065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65985f8b-d665-4af8-a3b9-00da35d72bec tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:53.347728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65985f8b-d665-4af8-a3b9-00da35d72bec tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:53.355052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65985f8b-d665-4af8-a3b9-00da35d72bec tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.355553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65985f8b-d665-4af8-a3b9-00da35d72bec tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.356006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65985f8b-d665-4af8-a3b9-00da35d72bec tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.356707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65985f8b-d665-4af8-a3b9-00da35d72bec tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.357183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65985f8b-d665-4af8-a3b9-00da35d72bec tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.357616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65985f8b-d665-4af8-a3b9-00da35d72bec tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.494380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65985f8b-d665-4af8-a3b9-00da35d72bec tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:53.502702 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65985f8b-d665-4af8-a3b9-00da35d72bec tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1675 microversion: 2.1 time: 0.160045 Oct 04 19:06:53.503306 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3702/7408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:53 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:54.526987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8f15fa0c-650c-40c1-984e-78e77cb9acf0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:54.527754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8f15fa0c-650c-40c1-984e-78e77cb9acf0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:54.535232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f15fa0c-650c-40c1-984e-78e77cb9acf0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.535725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f15fa0c-650c-40c1-984e-78e77cb9acf0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.536170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f15fa0c-650c-40c1-984e-78e77cb9acf0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.536871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f15fa0c-650c-40c1-984e-78e77cb9acf0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.537326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f15fa0c-650c-40c1-984e-78e77cb9acf0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.537754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8f15fa0c-650c-40c1-984e-78e77cb9acf0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.669791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8f15fa0c-650c-40c1-984e-78e77cb9acf0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:54.677916 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8f15fa0c-650c-40c1-984e-78e77cb9acf0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1668 microversion: 2.1 time: 0.154783 Oct 04 19:06:54.678491 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3707/7409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:54 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:54.701416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99a3e3a6-65d2-440d-b8b3-1920aca79566 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:54.702109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99a3e3a6-65d2-440d-b8b3-1920aca79566 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:54.709608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99a3e3a6-65d2-440d-b8b3-1920aca79566 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.710115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99a3e3a6-65d2-440d-b8b3-1920aca79566 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.710638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99a3e3a6-65d2-440d-b8b3-1920aca79566 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.711378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99a3e3a6-65d2-440d-b8b3-1920aca79566 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.711856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99a3e3a6-65d2-440d-b8b3-1920aca79566 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.712303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99a3e3a6-65d2-440d-b8b3-1920aca79566 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.840609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-99a3e3a6-65d2-440d-b8b3-1920aca79566 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:54.849479 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99a3e3a6-65d2-440d-b8b3-1920aca79566 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1668 microversion: 2.1 time: 0.151948 Oct 04 19:06:54.850045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3703/7410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:54 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:54.872179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3cf0a920-4cf6-4276-95f2-87193938ac0a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:54.872731 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3cf0a920-4cf6-4276-95f2-87193938ac0a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:54.878677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf0a920-4cf6-4276-95f2-87193938ac0a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.879217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf0a920-4cf6-4276-95f2-87193938ac0a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.879674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf0a920-4cf6-4276-95f2-87193938ac0a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.880381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf0a920-4cf6-4276-95f2-87193938ac0a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.880851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf0a920-4cf6-4276-95f2-87193938ac0a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.881294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cf0a920-4cf6-4276-95f2-87193938ac0a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.014707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3cf0a920-4cf6-4276-95f2-87193938ac0a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:55.023256 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3cf0a920-4cf6-4276-95f2-87193938ac0a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1668 microversion: 2.1 time: 0.155019 Oct 04 19:06:55.023833 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3708/7411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:54 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:55.046048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fa079a2f-3310-4b0b-afe0-310d0d8b9dfb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:55.046563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fa079a2f-3310-4b0b-afe0-310d0d8b9dfb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:55.052941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa079a2f-3310-4b0b-afe0-310d0d8b9dfb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.053456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa079a2f-3310-4b0b-afe0-310d0d8b9dfb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.053914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa079a2f-3310-4b0b-afe0-310d0d8b9dfb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.054715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa079a2f-3310-4b0b-afe0-310d0d8b9dfb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.055132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa079a2f-3310-4b0b-afe0-310d0d8b9dfb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.055582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa079a2f-3310-4b0b-afe0-310d0d8b9dfb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.084964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fa079a2f-3310-4b0b-afe0-310d0d8b9dfb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:06:55.166750 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fa079a2f-3310-4b0b-afe0-310d0d8b9dfb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "DELETE /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 204 len: 0 microversion: 2.1 time: 0.124006 Oct 04 19:06:55.167857 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3704/7412] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:06:55 2022] DELETE /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:06:55.176564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d4b4151-2e52-4fd8-ae89-b1cbecf6cf06 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:55.177212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1d4b4151-2e52-4fd8-ae89-b1cbecf6cf06 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:55.183664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4b4151-2e52-4fd8-ae89-b1cbecf6cf06 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.184164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4b4151-2e52-4fd8-ae89-b1cbecf6cf06 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.184604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4b4151-2e52-4fd8-ae89-b1cbecf6cf06 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.185307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4b4151-2e52-4fd8-ae89-b1cbecf6cf06 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.185763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4b4151-2e52-4fd8-ae89-b1cbecf6cf06 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.186192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d4b4151-2e52-4fd8-ae89-b1cbecf6cf06 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.318324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d4b4151-2e52-4fd8-ae89-b1cbecf6cf06 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:55.326100 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d4b4151-2e52-4fd8-ae89-b1cbecf6cf06 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1674 microversion: 2.1 time: 0.153730 Oct 04 19:06:55.326676 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3709/7413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:55 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:56.352132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2de8e021-824d-4e67-b60c-38356f88da5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:56.352879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2de8e021-824d-4e67-b60c-38356f88da5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:56.359095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2de8e021-824d-4e67-b60c-38356f88da5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:56.360995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2de8e021-824d-4e67-b60c-38356f88da5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:56.360995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2de8e021-824d-4e67-b60c-38356f88da5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:56.361578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2de8e021-824d-4e67-b60c-38356f88da5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:56.362103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2de8e021-824d-4e67-b60c-38356f88da5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:56.362499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2de8e021-824d-4e67-b60c-38356f88da5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:56.496634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2de8e021-824d-4e67-b60c-38356f88da5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:56.504457 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2de8e021-824d-4e67-b60c-38356f88da5f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1674 microversion: 2.1 time: 0.156950 Oct 04 19:06:56.505031 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3705/7414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:56 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:57.528303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9a6f6e0-5f38-4677-a586-80487bea9cb0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:57.529005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d9a6f6e0-5f38-4677-a586-80487bea9cb0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:57.532568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:57.538575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9a6f6e0-5f38-4677-a586-80487bea9cb0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:57.539177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9a6f6e0-5f38-4677-a586-80487bea9cb0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:57.539626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9a6f6e0-5f38-4677-a586-80487bea9cb0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:57.540341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9a6f6e0-5f38-4677-a586-80487bea9cb0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:57.540802 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9a6f6e0-5f38-4677-a586-80487bea9cb0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:57.541231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9a6f6e0-5f38-4677-a586-80487bea9cb0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:57.689977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d9a6f6e0-5f38-4677-a586-80487bea9cb0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:57.701036 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d9a6f6e0-5f38-4677-a586-80487bea9cb0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 200 len: 1674 microversion: 2.1 time: 0.176594 Oct 04 19:06:57.701625 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3710/7415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:57 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:58.132571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-c5aed26c-6416-4fbd-b795-69f6940a7b95 req-60b2633b-8a3f-4f61-8b92-15e2089a9ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b4cece-8119-4552-9c26-a7a531595a41", "name": "network-vif-deleted", "tag": "f78de6cb-c4ae-4271-8766-07d6f414eae2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:58.146432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c5aed26c-6416-4fbd-b795-69f6940a7b95 req-60b2633b-8a3f-4f61-8b92-15e2089a9ca9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.146942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c5aed26c-6416-4fbd-b795-69f6940a7b95 req-60b2633b-8a3f-4f61-8b92-15e2089a9ca9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.147426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-c5aed26c-6416-4fbd-b795-69f6940a7b95 req-60b2633b-8a3f-4f61-8b92-15e2089a9ca9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.159576 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-c5aed26c-6416-4fbd-b795-69f6940a7b95 req-60b2633b-8a3f-4f61-8b92-15e2089a9ca9 service nova] Creating event network-vif-deleted:f78de6cb-c4ae-4271-8766-07d6f414eae2 for instance 58b4cece-8119-4552-9c26-a7a531595a41 on n-h2-850499-14 Oct 04 19:06:58.165617 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-c5aed26c-6416-4fbd-b795-69f6940a7b95 req-60b2633b-8a3f-4f61-8b92-15e2089a9ca9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036705 Oct 04 19:06:58.166436 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3706/7416] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:58.730189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:58.730825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:58.746430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.746939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.747443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.748291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.748650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.749048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.765029 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 HTTP/1.1 Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '58b4cece-8119-4552-9c26-a7a531595a41'} Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:58.766781 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:06:58.771811 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:58.771811 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:58.771811 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:58.771811 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:58.771811 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:58.771811 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:06:58.771811 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:06:58.771811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:58.771811 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-798db835-c646-4a48-9d10-c660dab2b8d7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 404 len: 111 microversion: 2.1 time: 0.042318 Oct 04 19:06:58.771811 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3711/7417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:58 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:06:58.784447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:58.785180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:58.792394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.792916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.793373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.794099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.794578 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.795056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.810017 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 HTTP/1.1 Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '58b4cece-8119-4552-9c26-a7a531595a41'} Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:58.811791 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:06:58.815646 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:58.815646 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:58.815646 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:58.815646 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:58.815646 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:58.815646 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:06:58.815646 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:06:58.815646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:58.815646 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fd36a084-44ec-4d8e-9894-b3c37014f947 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 404 len: 111 microversion: 2.1 time: 0.033623 Oct 04 19:06:58.815646 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3707/7418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:58 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:58.863999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-837438877", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "bdbe1b23-6ed6-4348-8c83-9788a5980966"}], "security_groups": [{"name": "tempest-securitygroup--2043427521"}], "key_name": "tempest-keypair-1790208000", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:58.972767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] validate_networks() for [('bdbe1b23-6ed6-4348-8c83-9788a5980966', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:06:59.408021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:06:59.408467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:06:59.408990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:06:59.409385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:06:59.409807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:06:59.419021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.419517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.419964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.420697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:59.421159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:59.421947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.442163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:59.447556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for user b54bee64da524366a871ff5dac9bcc9e and project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:59.460791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:06:59.463166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:06:59.510772 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b750f15a-fae0-457e-9140-2e809e84df55 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.651201 Oct 04 19:06:59.511456 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3712/7419] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:06:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:06:59.523509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-89cf5b42-a1fd-4c81-990c-9a1ff31a1a2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:59.524327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-89cf5b42-a1fd-4c81-990c-9a1ff31a1a2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:59.581303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-89cf5b42-a1fd-4c81-990c-9a1ff31a1a2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:59.589389 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-89cf5b42-a1fd-4c81-990c-9a1ff31a1a2c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1238 microversion: 2.1 time: 0.069736 Oct 04 19:06:59.589970 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3708/7420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:59 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:00.613152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-adadd9e2-6bd9-43d8-9305-276fd11ef918 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:00.613911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-adadd9e2-6bd9-43d8-9305-276fd11ef918 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:00.621886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adadd9e2-6bd9-43d8-9305-276fd11ef918 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:00.622390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adadd9e2-6bd9-43d8-9305-276fd11ef918 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:00.622839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adadd9e2-6bd9-43d8-9305-276fd11ef918 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:00.623595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adadd9e2-6bd9-43d8-9305-276fd11ef918 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:00.624086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adadd9e2-6bd9-43d8-9305-276fd11ef918 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:00.624640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-adadd9e2-6bd9-43d8-9305-276fd11ef918 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:00.705865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-adadd9e2-6bd9-43d8-9305-276fd11ef918 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:00.713692 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-adadd9e2-6bd9-43d8-9305-276fd11ef918 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1298 microversion: 2.1 time: 0.104717 Oct 04 19:07:00.714713 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3713/7421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:00 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:01.738902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ab084c8-62b1-46e3-b0f3-b924ab7cd281 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:01.739942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3ab084c8-62b1-46e3-b0f3-b924ab7cd281 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:01.746844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab084c8-62b1-46e3-b0f3-b924ab7cd281 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.747474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab084c8-62b1-46e3-b0f3-b924ab7cd281 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.748007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab084c8-62b1-46e3-b0f3-b924ab7cd281 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.748738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab084c8-62b1-46e3-b0f3-b924ab7cd281 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.749212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab084c8-62b1-46e3-b0f3-b924ab7cd281 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.749679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ab084c8-62b1-46e3-b0f3-b924ab7cd281 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.886092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3ab084c8-62b1-46e3-b0f3-b924ab7cd281 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:01.894887 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ab084c8-62b1-46e3-b0f3-b924ab7cd281 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1364 microversion: 2.1 time: 0.159858 Oct 04 19:07:01.895501 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3709/7422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:01 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:02.194196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-1bf6d1ae-3aad-4a14-aeac-88b55cae6674 req-6435e57f-78d5-408d-8beb-166b77299848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bbd67e8-943b-424b-bbed-e6a8e7e50271", "tag": "39c4f3fb-4860-4c14-be1b-b68cf7750745"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:02.205760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1bf6d1ae-3aad-4a14-aeac-88b55cae6674 req-6435e57f-78d5-408d-8beb-166b77299848 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.206352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1bf6d1ae-3aad-4a14-aeac-88b55cae6674 req-6435e57f-78d5-408d-8beb-166b77299848 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.206867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-1bf6d1ae-3aad-4a14-aeac-88b55cae6674 req-6435e57f-78d5-408d-8beb-166b77299848 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.221277 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-1bf6d1ae-3aad-4a14-aeac-88b55cae6674 req-6435e57f-78d5-408d-8beb-166b77299848 service nova] Creating event network-changed:39c4f3fb-4860-4c14-be1b-b68cf7750745 for instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 on n-h2-850499-14 Oct 04 19:07:02.226322 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-1bf6d1ae-3aad-4a14-aeac-88b55cae6674 req-6435e57f-78d5-408d-8beb-166b77299848 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036079 Oct 04 19:07:02.227317 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3714/7423] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:07:02.919651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-145f36aa-65a4-4838-ac12-12e21e295725 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:02.920284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-145f36aa-65a4-4838-ac12-12e21e295725 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:02.927205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-145f36aa-65a4-4838-ac12-12e21e295725 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.927977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-145f36aa-65a4-4838-ac12-12e21e295725 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.928430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-145f36aa-65a4-4838-ac12-12e21e295725 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.929142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-145f36aa-65a4-4838-ac12-12e21e295725 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.929612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-145f36aa-65a4-4838-ac12-12e21e295725 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.930050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-145f36aa-65a4-4838-ac12-12e21e295725 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:03.071802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-145f36aa-65a4-4838-ac12-12e21e295725 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:03.080267 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-145f36aa-65a4-4838-ac12-12e21e295725 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1364 microversion: 2.1 time: 0.164601 Oct 04 19:07:03.080964 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3710/7424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:02 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:04.107501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0486869c-ddd3-489c-9b3a-61666bee6957 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.108282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0486869c-ddd3-489c-9b3a-61666bee6957 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.115132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0486869c-ddd3-489c-9b3a-61666bee6957 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.115720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0486869c-ddd3-489c-9b3a-61666bee6957 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.116166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0486869c-ddd3-489c-9b3a-61666bee6957 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.116865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0486869c-ddd3-489c-9b3a-61666bee6957 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.117321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0486869c-ddd3-489c-9b3a-61666bee6957 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.117744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0486869c-ddd3-489c-9b3a-61666bee6957 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.250743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0486869c-ddd3-489c-9b3a-61666bee6957 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.258588 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0486869c-ddd3-489c-9b3a-61666bee6957 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1364 microversion: 2.1 time: 0.156263 Oct 04 19:07:04.259207 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3715/7425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:04 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:05.282424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-25fedd35-5320-47c7-92fe-4ba87728ba96 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.283738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-25fedd35-5320-47c7-92fe-4ba87728ba96 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.290788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25fedd35-5320-47c7-92fe-4ba87728ba96 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.291404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25fedd35-5320-47c7-92fe-4ba87728ba96 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.291934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25fedd35-5320-47c7-92fe-4ba87728ba96 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.292809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25fedd35-5320-47c7-92fe-4ba87728ba96 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.293331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25fedd35-5320-47c7-92fe-4ba87728ba96 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.293835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-25fedd35-5320-47c7-92fe-4ba87728ba96 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.448918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-25fedd35-5320-47c7-92fe-4ba87728ba96 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:05.457736 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-25fedd35-5320-47c7-92fe-4ba87728ba96 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1364 microversion: 2.1 time: 0.179230 Oct 04 19:07:05.458327 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3711/7426] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:05 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:06.481621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7776a86d-8f73-4624-9579-a94a994a489f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:06.482251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7776a86d-8f73-4624-9579-a94a994a489f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:06.489330 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7776a86d-8f73-4624-9579-a94a994a489f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:06.489826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7776a86d-8f73-4624-9579-a94a994a489f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:06.490269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7776a86d-8f73-4624-9579-a94a994a489f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:06.490990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7776a86d-8f73-4624-9579-a94a994a489f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:06.491451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7776a86d-8f73-4624-9579-a94a994a489f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:06.491875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7776a86d-8f73-4624-9579-a94a994a489f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:06.630432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7776a86d-8f73-4624-9579-a94a994a489f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:06.638274 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7776a86d-8f73-4624-9579-a94a994a489f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1364 microversion: 2.1 time: 0.160517 Oct 04 19:07:06.638843 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3716/7427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:06 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:07.161056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7ebc8a4c-4334-4c11-a5e8-093a2a1b6226 req-7632d8a9-81b9-4fe8-8e33-4355b13d7912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbd67e8-943b-424b-bbed-e6a8e7e50271", "name": "network-vif-plugged", "status": "completed", "tag": "39c4f3fb-4860-4c14-be1b-b68cf7750745"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:07.172976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ebc8a4c-4334-4c11-a5e8-093a2a1b6226 req-7632d8a9-81b9-4fe8-8e33-4355b13d7912 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.173479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ebc8a4c-4334-4c11-a5e8-093a2a1b6226 req-7632d8a9-81b9-4fe8-8e33-4355b13d7912 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.173927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7ebc8a4c-4334-4c11-a5e8-093a2a1b6226 req-7632d8a9-81b9-4fe8-8e33-4355b13d7912 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.189116 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7ebc8a4c-4334-4c11-a5e8-093a2a1b6226 req-7632d8a9-81b9-4fe8-8e33-4355b13d7912 service nova] Creating event network-vif-plugged:39c4f3fb-4860-4c14-be1b-b68cf7750745 for instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 on n-h2-850499-14 Oct 04 19:07:07.194872 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7ebc8a4c-4334-4c11-a5e8-093a2a1b6226 req-7632d8a9-81b9-4fe8-8e33-4355b13d7912 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037472 Oct 04 19:07:07.195754 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3712/7428] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:07.663112 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-300c0941-6247-46b7-a24f-f387d713e262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:07.663728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-300c0941-6247-46b7-a24f-f387d713e262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:07.670689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300c0941-6247-46b7-a24f-f387d713e262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.671270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300c0941-6247-46b7-a24f-f387d713e262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.671729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300c0941-6247-46b7-a24f-f387d713e262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.672430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300c0941-6247-46b7-a24f-f387d713e262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.672889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300c0941-6247-46b7-a24f-f387d713e262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.673320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-300c0941-6247-46b7-a24f-f387d713e262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.806061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-300c0941-6247-46b7-a24f-f387d713e262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.814477 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-300c0941-6247-46b7-a24f-f387d713e262 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1364 microversion: 2.1 time: 0.155429 Oct 04 19:07:07.815089 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3717/7429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:07 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:08.839994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dd8c4d53-d263-4861-b229-149005a2c106 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:08.840501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dd8c4d53-d263-4861-b229-149005a2c106 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:08.849381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd8c4d53-d263-4861-b229-149005a2c106 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.849898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd8c4d53-d263-4861-b229-149005a2c106 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.850541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd8c4d53-d263-4861-b229-149005a2c106 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.851264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd8c4d53-d263-4861-b229-149005a2c106 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.851738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd8c4d53-d263-4861-b229-149005a2c106 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.852181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd8c4d53-d263-4861-b229-149005a2c106 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.994819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dd8c4d53-d263-4861-b229-149005a2c106 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:09.002768 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dd8c4d53-d263-4861-b229-149005a2c106 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1364 microversion: 2.1 time: 0.168567 Oct 04 19:07:09.003295 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3713/7430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:08 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:10.026942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-569a0a56-234c-4eba-8047-411a8cb14002 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:10.027589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-569a0a56-234c-4eba-8047-411a8cb14002 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:10.030901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:10.031591 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:10.037452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569a0a56-234c-4eba-8047-411a8cb14002 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:10.037946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569a0a56-234c-4eba-8047-411a8cb14002 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:10.038387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569a0a56-234c-4eba-8047-411a8cb14002 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:10.039108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569a0a56-234c-4eba-8047-411a8cb14002 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:10.039568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569a0a56-234c-4eba-8047-411a8cb14002 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:10.039999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-569a0a56-234c-4eba-8047-411a8cb14002 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:10.169818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-569a0a56-234c-4eba-8047-411a8cb14002 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:10.178569 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-569a0a56-234c-4eba-8047-411a8cb14002 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1550 microversion: 2.1 time: 0.155475 Oct 04 19:07:10.179182 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3718/7431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:10 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:10.201280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1860e921-bafe-417d-83cf-4e6aa12542b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:10.201787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1860e921-bafe-417d-83cf-4e6aa12542b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:10.203987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:10.210830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1860e921-bafe-417d-83cf-4e6aa12542b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:10.211424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1860e921-bafe-417d-83cf-4e6aa12542b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:10.211878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1860e921-bafe-417d-83cf-4e6aa12542b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:10.212594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1860e921-bafe-417d-83cf-4e6aa12542b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:10.213207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1860e921-bafe-417d-83cf-4e6aa12542b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:10.213722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1860e921-bafe-417d-83cf-4e6aa12542b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:10.293381 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1860e921-bafe-417d-83cf-4e6aa12542b3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095903 Oct 04 19:07:10.293997 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3714/7432] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 19:07:10 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:11.270989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-61c0247a-3f71-46bc-8b8d-33e82c94e06a req-140e7e2a-f421-47f5-a00d-61a9748c38ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bbd67e8-943b-424b-bbed-e6a8e7e50271", "tag": "39c4f3fb-4860-4c14-be1b-b68cf7750745"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:11.280887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-61c0247a-3f71-46bc-8b8d-33e82c94e06a req-140e7e2a-f421-47f5-a00d-61a9748c38ab service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:11.281379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-61c0247a-3f71-46bc-8b8d-33e82c94e06a req-140e7e2a-f421-47f5-a00d-61a9748c38ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:11.281818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-61c0247a-3f71-46bc-8b8d-33e82c94e06a req-140e7e2a-f421-47f5-a00d-61a9748c38ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:11.293059 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-61c0247a-3f71-46bc-8b8d-33e82c94e06a req-140e7e2a-f421-47f5-a00d-61a9748c38ab service nova] Creating event network-changed:39c4f3fb-4860-4c14-be1b-b68cf7750745 for instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 on n-h2-850499-14 Oct 04 19:07:11.298599 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-61c0247a-3f71-46bc-8b8d-33e82c94e06a req-140e7e2a-f421-47f5-a00d-61a9748c38ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082331 Oct 04 19:07:11.299854 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3719/7433] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:24.648125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:24.648935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:24.650269 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:08:24.650410 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:08:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 (ip 10.222.0.18) !!! Oct 04 19:08:24.657710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d57275b6-4724-4362-b1cd-389f9f49d887 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:24.658333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d57275b6-4724-4362-b1cd-389f9f49d887 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:24.669002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d57275b6-4724-4362-b1cd-389f9f49d887 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:24.669509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d57275b6-4724-4362-b1cd-389f9f49d887 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:24.669960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d57275b6-4724-4362-b1cd-389f9f49d887 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:24.670677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d57275b6-4724-4362-b1cd-389f9f49d887 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:24.671190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d57275b6-4724-4362-b1cd-389f9f49d887 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:24.671628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d57275b6-4724-4362-b1cd-389f9f49d887 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:24.812865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d57275b6-4724-4362-b1cd-389f9f49d887 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:24.820780 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d57275b6-4724-4362-b1cd-389f9f49d887 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1668 microversion: 2.1 time: 0.175041 Oct 04 19:08:24.821358 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3715/7434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:24 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:24.843867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:24.844841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:24.846112 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:08:24.846257 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:08:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/os-volume_attachments (ip 10.222.0.18) !!! Oct 04 19:08:24.852615 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a98785f-e1bd-4ba9-b69d-4ad22c5f7166 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd04ed3c-295d-4d07-84a7-4b5c712da344"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:24.855574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a98785f-e1bd-4ba9-b69d-4ad22c5f7166 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:24.864754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a98785f-e1bd-4ba9-b69d-4ad22c5f7166 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:24.865251 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a98785f-e1bd-4ba9-b69d-4ad22c5f7166 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:24.865691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a98785f-e1bd-4ba9-b69d-4ad22c5f7166 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:24.866394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a98785f-e1bd-4ba9-b69d-4ad22c5f7166 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:24.866848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a98785f-e1bd-4ba9-b69d-4ad22c5f7166 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:24.867308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a98785f-e1bd-4ba9-b69d-4ad22c5f7166 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:25.147697 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a98785f-e1bd-4ba9-b69d-4ad22c5f7166 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306197 Oct 04 19:08:25.151429 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3720/7435] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 19:08:24 2022] POST /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:36.961305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:36.964012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:36.965902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:36.967452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:36.975789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:36.976303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:36.976758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:36.977485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:36.977958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:36.978396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.108122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:37.114633 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Old instance type m1.heat2, new instance type m1.heat {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:08:37.126769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:08:37.127226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:08:37.128239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:08:37.128680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:08:37.129107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:08:37.197005 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-527c5e1f-27c2-41e5-a9ef-daf409639a11 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/action" status: 202 len: 0 microversion: 2.1 time: 0.239414 Oct 04 19:08:37.197647 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3716/7436] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:08:36 2022] POST /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:08:37.203885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:37.204666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:37.209927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-12e54ebb-885e-437e-aa2b-2cca52608742 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:37.210741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-12e54ebb-885e-437e-aa2b-2cca52608742 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:37.218844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e54ebb-885e-437e-aa2b-2cca52608742 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:37.219552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e54ebb-885e-437e-aa2b-2cca52608742 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:37.220082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e54ebb-885e-437e-aa2b-2cca52608742 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.220905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e54ebb-885e-437e-aa2b-2cca52608742 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:37.221443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e54ebb-885e-437e-aa2b-2cca52608742 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:37.221918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-12e54ebb-885e-437e-aa2b-2cca52608742 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.395346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-12e54ebb-885e-437e-aa2b-2cca52608742 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:37.404133 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-12e54ebb-885e-437e-aa2b-2cca52608742 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1723 microversion: 2.1 time: 0.202086 Oct 04 19:08:37.404710 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3721/7437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:37 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:38.427847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b5a27d40-ab3e-4341-b8fc-d6f95828613d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:38.428491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b5a27d40-ab3e-4341-b8fc-d6f95828613d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:38.436712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a27d40-ab3e-4341-b8fc-d6f95828613d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:38.437472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a27d40-ab3e-4341-b8fc-d6f95828613d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:38.437684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a27d40-ab3e-4341-b8fc-d6f95828613d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:38.438410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a27d40-ab3e-4341-b8fc-d6f95828613d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:38.438898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a27d40-ab3e-4341-b8fc-d6f95828613d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:38.439374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b5a27d40-ab3e-4341-b8fc-d6f95828613d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:38.578207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b5a27d40-ab3e-4341-b8fc-d6f95828613d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:38.587323 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b5a27d40-ab3e-4341-b8fc-d6f95828613d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1723 microversion: 2.1 time: 0.164349 Oct 04 19:08:38.587905 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3717/7438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:38 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:39.611191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a8c9483-6c45-4ba1-983d-9a4a56debe15 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:39.611807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a8c9483-6c45-4ba1-983d-9a4a56debe15 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:39.619197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8c9483-6c45-4ba1-983d-9a4a56debe15 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.619688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8c9483-6c45-4ba1-983d-9a4a56debe15 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.620132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8c9483-6c45-4ba1-983d-9a4a56debe15 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.620829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8c9483-6c45-4ba1-983d-9a4a56debe15 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.621288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8c9483-6c45-4ba1-983d-9a4a56debe15 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.621718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a8c9483-6c45-4ba1-983d-9a4a56debe15 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.749871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7a8c9483-6c45-4ba1-983d-9a4a56debe15 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:39.758032 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a8c9483-6c45-4ba1-983d-9a4a56debe15 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.150789 Oct 04 19:08:39.758608 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3722/7439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:39 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:40.781160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ca96d14-34fa-49da-95e1-dbee774626e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:40.781819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4ca96d14-34fa-49da-95e1-dbee774626e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:40.788703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ca96d14-34fa-49da-95e1-dbee774626e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.789201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ca96d14-34fa-49da-95e1-dbee774626e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.789652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ca96d14-34fa-49da-95e1-dbee774626e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.790358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ca96d14-34fa-49da-95e1-dbee774626e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.790827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ca96d14-34fa-49da-95e1-dbee774626e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.791288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ca96d14-34fa-49da-95e1-dbee774626e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.929564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ca96d14-34fa-49da-95e1-dbee774626e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:40.937794 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4ca96d14-34fa-49da-95e1-dbee774626e1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.160546 Oct 04 19:08:40.938360 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3718/7440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:40 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:41.962068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f5e9d823-a077-4496-bda0-b9466098c433 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:41.962684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f5e9d823-a077-4496-bda0-b9466098c433 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:41.969640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5e9d823-a077-4496-bda0-b9466098c433 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.970128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5e9d823-a077-4496-bda0-b9466098c433 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.970576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5e9d823-a077-4496-bda0-b9466098c433 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.971313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5e9d823-a077-4496-bda0-b9466098c433 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.971777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5e9d823-a077-4496-bda0-b9466098c433 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.972209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5e9d823-a077-4496-bda0-b9466098c433 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:42.108436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f5e9d823-a077-4496-bda0-b9466098c433 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:42.116926 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f5e9d823-a077-4496-bda0-b9466098c433 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.159250 Oct 04 19:08:42.117712 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3723/7441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:41 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:43.141444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4b4b4101-bef3-4ca9-b2bf-efffb44b6948 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:43.141985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4b4b4101-bef3-4ca9-b2bf-efffb44b6948 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:43.148797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b4b4101-bef3-4ca9-b2bf-efffb44b6948 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.149294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b4b4101-bef3-4ca9-b2bf-efffb44b6948 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.149745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b4b4101-bef3-4ca9-b2bf-efffb44b6948 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.150444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b4b4101-bef3-4ca9-b2bf-efffb44b6948 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.150912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b4b4101-bef3-4ca9-b2bf-efffb44b6948 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.151372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4b4b4101-bef3-4ca9-b2bf-efffb44b6948 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.278630 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4b4b4101-bef3-4ca9-b2bf-efffb44b6948 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:43.287224 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4b4b4101-bef3-4ca9-b2bf-efffb44b6948 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.149703 Oct 04 19:08:43.287812 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3719/7442] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:43 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:44.315511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-89f1b1fc-2e05-4d5b-8c76-073ddf81bdd3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:44.316152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-89f1b1fc-2e05-4d5b-8c76-073ddf81bdd3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:44.323575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f1b1fc-2e05-4d5b-8c76-073ddf81bdd3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.324060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f1b1fc-2e05-4d5b-8c76-073ddf81bdd3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.324502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f1b1fc-2e05-4d5b-8c76-073ddf81bdd3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.325356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f1b1fc-2e05-4d5b-8c76-073ddf81bdd3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.325818 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f1b1fc-2e05-4d5b-8c76-073ddf81bdd3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.326247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-89f1b1fc-2e05-4d5b-8c76-073ddf81bdd3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.459533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-89f1b1fc-2e05-4d5b-8c76-073ddf81bdd3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:44.467824 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-89f1b1fc-2e05-4d5b-8c76-073ddf81bdd3 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.156318 Oct 04 19:08:44.468401 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3724/7443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:44 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:45.491292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2f5fd3c2-6a44-4849-a021-b26f2e7b3cae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:45.491834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2f5fd3c2-6a44-4849-a021-b26f2e7b3cae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:45.498757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f5fd3c2-6a44-4849-a021-b26f2e7b3cae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.499288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f5fd3c2-6a44-4849-a021-b26f2e7b3cae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.499744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f5fd3c2-6a44-4849-a021-b26f2e7b3cae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.500451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f5fd3c2-6a44-4849-a021-b26f2e7b3cae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.501436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f5fd3c2-6a44-4849-a021-b26f2e7b3cae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.501436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2f5fd3c2-6a44-4849-a021-b26f2e7b3cae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.630275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2f5fd3c2-6a44-4849-a021-b26f2e7b3cae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:45.638668 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2f5fd3c2-6a44-4849-a021-b26f2e7b3cae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.151358 Oct 04 19:08:45.639274 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3720/7444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:45 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:46.663652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0204c8e4-7e4b-44a1-9a85-5a496d51633f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:46.664301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0204c8e4-7e4b-44a1-9a85-5a496d51633f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:46.671099 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0204c8e4-7e4b-44a1-9a85-5a496d51633f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:46.671613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0204c8e4-7e4b-44a1-9a85-5a496d51633f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:46.672095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0204c8e4-7e4b-44a1-9a85-5a496d51633f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:46.672788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0204c8e4-7e4b-44a1-9a85-5a496d51633f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:46.673246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0204c8e4-7e4b-44a1-9a85-5a496d51633f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:46.673676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0204c8e4-7e4b-44a1-9a85-5a496d51633f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:46.805495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0204c8e4-7e4b-44a1-9a85-5a496d51633f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:46.813950 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0204c8e4-7e4b-44a1-9a85-5a496d51633f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.154699 Oct 04 19:08:46.816493 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3725/7445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:46 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:47.839369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-46683be0-a2fd-4067-bd69-5b65bad3eac0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:47.840008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-46683be0-a2fd-4067-bd69-5b65bad3eac0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:47.847097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46683be0-a2fd-4067-bd69-5b65bad3eac0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:47.847547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46683be0-a2fd-4067-bd69-5b65bad3eac0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:47.848603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46683be0-a2fd-4067-bd69-5b65bad3eac0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:47.849318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46683be0-a2fd-4067-bd69-5b65bad3eac0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:47.849793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46683be0-a2fd-4067-bd69-5b65bad3eac0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:47.850239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-46683be0-a2fd-4067-bd69-5b65bad3eac0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:47.981126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-46683be0-a2fd-4067-bd69-5b65bad3eac0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:47.989779 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-46683be0-a2fd-4067-bd69-5b65bad3eac0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.154380 Oct 04 19:08:47.990353 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3721/7446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:47 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:49.013608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-930b7140-9999-4c14-a546-60c38392e4cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:49.014256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-930b7140-9999-4c14-a546-60c38392e4cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:49.021725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b7140-9999-4c14-a546-60c38392e4cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:49.022213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b7140-9999-4c14-a546-60c38392e4cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:49.022657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b7140-9999-4c14-a546-60c38392e4cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:49.023383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b7140-9999-4c14-a546-60c38392e4cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:49.023843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b7140-9999-4c14-a546-60c38392e4cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:49.024274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-930b7140-9999-4c14-a546-60c38392e4cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:49.160946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-930b7140-9999-4c14-a546-60c38392e4cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:49.169254 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-930b7140-9999-4c14-a546-60c38392e4cb tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.159551 Oct 04 19:08:49.169837 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3726/7447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:49 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:50.193502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ccc34c8-d30d-4f3f-995b-4c7fbf22cd6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:50.194156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ccc34c8-d30d-4f3f-995b-4c7fbf22cd6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:50.201016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ccc34c8-d30d-4f3f-995b-4c7fbf22cd6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:50.201517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ccc34c8-d30d-4f3f-995b-4c7fbf22cd6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:50.201971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ccc34c8-d30d-4f3f-995b-4c7fbf22cd6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:50.202809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ccc34c8-d30d-4f3f-995b-4c7fbf22cd6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:50.203320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ccc34c8-d30d-4f3f-995b-4c7fbf22cd6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:50.203781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ccc34c8-d30d-4f3f-995b-4c7fbf22cd6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:50.330562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1ccc34c8-d30d-4f3f-995b-4c7fbf22cd6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:50.339630 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ccc34c8-d30d-4f3f-995b-4c7fbf22cd6e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.150703 Oct 04 19:08:50.340209 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3722/7448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:50 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:51.363647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7865a31e-0af5-4705-890c-9929cbe8690c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:51.364268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7865a31e-0af5-4705-890c-9929cbe8690c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:51.371271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7865a31e-0af5-4705-890c-9929cbe8690c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:51.371770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7865a31e-0af5-4705-890c-9929cbe8690c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:51.372221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7865a31e-0af5-4705-890c-9929cbe8690c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:51.372930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7865a31e-0af5-4705-890c-9929cbe8690c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:51.373393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7865a31e-0af5-4705-890c-9929cbe8690c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:51.373828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7865a31e-0af5-4705-890c-9929cbe8690c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:51.513688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7865a31e-0af5-4705-890c-9929cbe8690c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:51.522404 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7865a31e-0af5-4705-890c-9929cbe8690c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.162700 Oct 04 19:08:51.522994 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3727/7449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:51 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:52.546472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fdea613a-4b2f-455c-84bb-591ea72b485e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:52.547215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fdea613a-4b2f-455c-84bb-591ea72b485e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:52.554346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fdea613a-4b2f-455c-84bb-591ea72b485e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:52.554857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fdea613a-4b2f-455c-84bb-591ea72b485e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:52.555346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fdea613a-4b2f-455c-84bb-591ea72b485e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:52.556058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fdea613a-4b2f-455c-84bb-591ea72b485e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:52.556536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fdea613a-4b2f-455c-84bb-591ea72b485e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:52.556980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fdea613a-4b2f-455c-84bb-591ea72b485e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:52.691191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fdea613a-4b2f-455c-84bb-591ea72b485e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:52.700022 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fdea613a-4b2f-455c-84bb-591ea72b485e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.157414 Oct 04 19:08:52.700601 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3723/7450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:52 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:53.725012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d9ac163f-7db5-416c-90bf-a4a78ce9e0b9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:53.725550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d9ac163f-7db5-416c-90bf-a4a78ce9e0b9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:53.732483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9ac163f-7db5-416c-90bf-a4a78ce9e0b9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:53.732974 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9ac163f-7db5-416c-90bf-a4a78ce9e0b9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:53.733419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9ac163f-7db5-416c-90bf-a4a78ce9e0b9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:53.734120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9ac163f-7db5-416c-90bf-a4a78ce9e0b9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:53.734579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9ac163f-7db5-416c-90bf-a4a78ce9e0b9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:53.735042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d9ac163f-7db5-416c-90bf-a4a78ce9e0b9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:53.864528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d9ac163f-7db5-416c-90bf-a4a78ce9e0b9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:53.873059 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d9ac163f-7db5-416c-90bf-a4a78ce9e0b9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.152661 Oct 04 19:08:53.873640 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3728/7451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:53 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:54.897771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fc143c4f-0425-405f-86e8-c199c3602059 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:54.898387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fc143c4f-0425-405f-86e8-c199c3602059 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:54.905295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc143c4f-0425-405f-86e8-c199c3602059 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:54.905793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc143c4f-0425-405f-86e8-c199c3602059 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:54.906458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc143c4f-0425-405f-86e8-c199c3602059 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:54.907195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc143c4f-0425-405f-86e8-c199c3602059 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:54.907668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc143c4f-0425-405f-86e8-c199c3602059 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:54.908108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fc143c4f-0425-405f-86e8-c199c3602059 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:55.043843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fc143c4f-0425-405f-86e8-c199c3602059 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:55.053109 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fc143c4f-0425-405f-86e8-c199c3602059 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.159822 Oct 04 19:08:55.053694 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3724/7452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:54 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:56.077429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cef28204-dbcb-470c-9447-30eb48f62c09 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:56.078056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cef28204-dbcb-470c-9447-30eb48f62c09 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:56.085077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef28204-dbcb-470c-9447-30eb48f62c09 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:56.085572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef28204-dbcb-470c-9447-30eb48f62c09 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:56.086020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef28204-dbcb-470c-9447-30eb48f62c09 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:56.086717 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef28204-dbcb-470c-9447-30eb48f62c09 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:56.087214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef28204-dbcb-470c-9447-30eb48f62c09 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:56.087647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cef28204-dbcb-470c-9447-30eb48f62c09 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:56.216098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cef28204-dbcb-470c-9447-30eb48f62c09 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:56.224425 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cef28204-dbcb-470c-9447-30eb48f62c09 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.151119 Oct 04 19:08:56.225002 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3729/7453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:56 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:57.248226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9e966615-83fa-425a-ab3b-911002045bd6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:57.249151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9e966615-83fa-425a-ab3b-911002045bd6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:57.256049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e966615-83fa-425a-ab3b-911002045bd6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:57.256552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e966615-83fa-425a-ab3b-911002045bd6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:57.257020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e966615-83fa-425a-ab3b-911002045bd6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:57.257729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e966615-83fa-425a-ab3b-911002045bd6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:57.258203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e966615-83fa-425a-ab3b-911002045bd6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:57.258640 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9e966615-83fa-425a-ab3b-911002045bd6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:57.393874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9e966615-83fa-425a-ab3b-911002045bd6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:57.402559 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9e966615-83fa-425a-ab3b-911002045bd6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.158241 Oct 04 19:08:57.403486 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3725/7454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:57 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:58.426259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e50ac295-7657-4ef0-9b11-2711d53fe695 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:58.426888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e50ac295-7657-4ef0-9b11-2711d53fe695 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:58.435129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e50ac295-7657-4ef0-9b11-2711d53fe695 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:58.435917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e50ac295-7657-4ef0-9b11-2711d53fe695 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:58.436750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e50ac295-7657-4ef0-9b11-2711d53fe695 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:58.437690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e50ac295-7657-4ef0-9b11-2711d53fe695 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:58.438452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e50ac295-7657-4ef0-9b11-2711d53fe695 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:58.439176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e50ac295-7657-4ef0-9b11-2711d53fe695 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:58.581884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e50ac295-7657-4ef0-9b11-2711d53fe695 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:58.591022 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e50ac295-7657-4ef0-9b11-2711d53fe695 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1728 microversion: 2.1 time: 0.169150 Oct 04 19:08:58.591605 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3730/7455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:58 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:59.494208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-03ad3fd4-40f1-4992-99ab-3c321082fe86 req-32081e93-3dec-4749-8ce9-6be9517fcb0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbd67e8-943b-424b-bbed-e6a8e7e50271", "name": "network-vif-unplugged", "status": "completed", "tag": "39c4f3fb-4860-4c14-be1b-b68cf7750745"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:59.506185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-03ad3fd4-40f1-4992-99ab-3c321082fe86 req-32081e93-3dec-4749-8ce9-6be9517fcb0d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:59.506828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-03ad3fd4-40f1-4992-99ab-3c321082fe86 req-32081e93-3dec-4749-8ce9-6be9517fcb0d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:59.507303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-03ad3fd4-40f1-4992-99ab-3c321082fe86 req-32081e93-3dec-4749-8ce9-6be9517fcb0d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:59.520123 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-03ad3fd4-40f1-4992-99ab-3c321082fe86 req-32081e93-3dec-4749-8ce9-6be9517fcb0d service nova] Creating event network-vif-unplugged:39c4f3fb-4860-4c14-be1b-b68cf7750745 for instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 on n-h1-850499-14 Oct 04 19:08:59.525574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-03ad3fd4-40f1-4992-99ab-3c321082fe86 req-32081e93-3dec-4749-8ce9-6be9517fcb0d service nova] Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:08:59.538481 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-03ad3fd4-40f1-4992-99ab-3c321082fe86 req-32081e93-3dec-4749-8ce9-6be9517fcb0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048350 Oct 04 19:08:59.539307 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3726/7456] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:59.616622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-da78fde6-122a-4390-8743-daf88cc9e6f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:59.617333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-da78fde6-122a-4390-8743-daf88cc9e6f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:59.624670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da78fde6-122a-4390-8743-daf88cc9e6f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:59.625256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da78fde6-122a-4390-8743-daf88cc9e6f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:59.625777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da78fde6-122a-4390-8743-daf88cc9e6f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:59.626564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da78fde6-122a-4390-8743-daf88cc9e6f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:59.627134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da78fde6-122a-4390-8743-daf88cc9e6f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:59.627641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-da78fde6-122a-4390-8743-daf88cc9e6f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:59.768226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-da78fde6-122a-4390-8743-daf88cc9e6f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:59.777213 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-da78fde6-122a-4390-8743-daf88cc9e6f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1727 microversion: 2.1 time: 0.166303 Oct 04 19:08:59.777806 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3731/7457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:59 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:00.803112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c2b43ae-9fb4-44b9-900c-abd27b55e804 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:00.803830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1c2b43ae-9fb4-44b9-900c-abd27b55e804 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:00.810176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c2b43ae-9fb4-44b9-900c-abd27b55e804 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:00.810693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c2b43ae-9fb4-44b9-900c-abd27b55e804 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:00.811175 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c2b43ae-9fb4-44b9-900c-abd27b55e804 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:00.811995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c2b43ae-9fb4-44b9-900c-abd27b55e804 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:00.812345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c2b43ae-9fb4-44b9-900c-abd27b55e804 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:00.812787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c2b43ae-9fb4-44b9-900c-abd27b55e804 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:00.960292 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1c2b43ae-9fb4-44b9-900c-abd27b55e804 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:00.972507 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c2b43ae-9fb4-44b9-900c-abd27b55e804 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.174827 Oct 04 19:09:00.973095 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3727/7458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:00 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:01.557404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-775b4fe4-4365-44bb-bdb9-2abab47ed3b6 req-3bb20e82-135d-4e5f-911b-4987cca55a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bbd67e8-943b-424b-bbed-e6a8e7e50271", "tag": "39c4f3fb-4860-4c14-be1b-b68cf7750745"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:01.568608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-775b4fe4-4365-44bb-bdb9-2abab47ed3b6 req-3bb20e82-135d-4e5f-911b-4987cca55a0c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:01.569043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-775b4fe4-4365-44bb-bdb9-2abab47ed3b6 req-3bb20e82-135d-4e5f-911b-4987cca55a0c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:01.569563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-775b4fe4-4365-44bb-bdb9-2abab47ed3b6 req-3bb20e82-135d-4e5f-911b-4987cca55a0c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:01.582588 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-775b4fe4-4365-44bb-bdb9-2abab47ed3b6 req-3bb20e82-135d-4e5f-911b-4987cca55a0c service nova] Creating event network-changed:39c4f3fb-4860-4c14-be1b-b68cf7750745 for instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 on n-h1-850499-14 Oct 04 19:09:01.588602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-775b4fe4-4365-44bb-bdb9-2abab47ed3b6 req-3bb20e82-135d-4e5f-911b-4987cca55a0c service nova] Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:09:01.600234 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-775b4fe4-4365-44bb-bdb9-2abab47ed3b6 req-3bb20e82-135d-4e5f-911b-4987cca55a0c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048903 Oct 04 19:09:01.600876 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3732/7459] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:01.997130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9bcb019d-51d9-4ae2-bad4-fba10891d7aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:01.998530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9bcb019d-51d9-4ae2-bad4-fba10891d7aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:02.006021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb019d-51d9-4ae2-bad4-fba10891d7aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:02.006538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb019d-51d9-4ae2-bad4-fba10891d7aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:02.007015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb019d-51d9-4ae2-bad4-fba10891d7aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:02.007982 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb019d-51d9-4ae2-bad4-fba10891d7aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:02.008467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb019d-51d9-4ae2-bad4-fba10891d7aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:02.009016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb019d-51d9-4ae2-bad4-fba10891d7aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:02.187843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9bcb019d-51d9-4ae2-bad4-fba10891d7aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:02.198084 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9bcb019d-51d9-4ae2-bad4-fba10891d7aa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.204977 Oct 04 19:09:02.198687 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3728/7460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:01 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:03.224016 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-870aaa8b-3c82-45b6-ae6c-4374ba09e7c0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:03.224736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-870aaa8b-3c82-45b6-ae6c-4374ba09e7c0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:03.231408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870aaa8b-3c82-45b6-ae6c-4374ba09e7c0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:03.231911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870aaa8b-3c82-45b6-ae6c-4374ba09e7c0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:03.232364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870aaa8b-3c82-45b6-ae6c-4374ba09e7c0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:03.233085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870aaa8b-3c82-45b6-ae6c-4374ba09e7c0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:03.233551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870aaa8b-3c82-45b6-ae6c-4374ba09e7c0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:03.234161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-870aaa8b-3c82-45b6-ae6c-4374ba09e7c0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:03.383041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-870aaa8b-3c82-45b6-ae6c-4374ba09e7c0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:03.391997 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-870aaa8b-3c82-45b6-ae6c-4374ba09e7c0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.173946 Oct 04 19:09:03.392608 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3733/7461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:03 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:04.417559 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e72e97ee-152e-440d-bb0b-3f64076bfb82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:04.418247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e72e97ee-152e-440d-bb0b-3f64076bfb82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:04.425688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e72e97ee-152e-440d-bb0b-3f64076bfb82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:04.426844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e72e97ee-152e-440d-bb0b-3f64076bfb82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:04.427327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e72e97ee-152e-440d-bb0b-3f64076bfb82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:04.428047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e72e97ee-152e-440d-bb0b-3f64076bfb82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:04.428518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e72e97ee-152e-440d-bb0b-3f64076bfb82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:04.429024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e72e97ee-152e-440d-bb0b-3f64076bfb82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:04.566369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e72e97ee-152e-440d-bb0b-3f64076bfb82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:04.575874 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e72e97ee-152e-440d-bb0b-3f64076bfb82 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.162288 Oct 04 19:09:04.576465 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3729/7462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:04 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:05.603364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b409b65b-06da-4d07-9a41-9ceaad12f97e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:05.604123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b409b65b-06da-4d07-9a41-9ceaad12f97e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:05.611161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b409b65b-06da-4d07-9a41-9ceaad12f97e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:05.611674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b409b65b-06da-4d07-9a41-9ceaad12f97e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:05.612115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b409b65b-06da-4d07-9a41-9ceaad12f97e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:05.612808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b409b65b-06da-4d07-9a41-9ceaad12f97e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:05.613784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b409b65b-06da-4d07-9a41-9ceaad12f97e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:05.614205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b409b65b-06da-4d07-9a41-9ceaad12f97e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:05.749015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b409b65b-06da-4d07-9a41-9ceaad12f97e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:05.758295 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b409b65b-06da-4d07-9a41-9ceaad12f97e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.159014 Oct 04 19:09:05.758878 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3734/7463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:05 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:06.786106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6119c936-4be0-48c7-a8ad-e7007f0aa4db tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:06.786829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6119c936-4be0-48c7-a8ad-e7007f0aa4db tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:06.793812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6119c936-4be0-48c7-a8ad-e7007f0aa4db tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:06.794324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6119c936-4be0-48c7-a8ad-e7007f0aa4db tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:06.794786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6119c936-4be0-48c7-a8ad-e7007f0aa4db tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:06.795551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6119c936-4be0-48c7-a8ad-e7007f0aa4db tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:06.796035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6119c936-4be0-48c7-a8ad-e7007f0aa4db tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:06.796483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6119c936-4be0-48c7-a8ad-e7007f0aa4db tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:06.932998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6119c936-4be0-48c7-a8ad-e7007f0aa4db tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:06.942125 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6119c936-4be0-48c7-a8ad-e7007f0aa4db tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.159396 Oct 04 19:09:06.942716 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3730/7464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:06 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:07.965697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f7e5af05-46e5-45ff-8468-39517cb63ef5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:07.966312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f7e5af05-46e5-45ff-8468-39517cb63ef5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:07.969215 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=29 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:07.974449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7e5af05-46e5-45ff-8468-39517cb63ef5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:07.974931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7e5af05-46e5-45ff-8468-39517cb63ef5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:07.975393 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7e5af05-46e5-45ff-8468-39517cb63ef5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:07.976084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7e5af05-46e5-45ff-8468-39517cb63ef5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:07.976539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7e5af05-46e5-45ff-8468-39517cb63ef5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:07.976963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7e5af05-46e5-45ff-8468-39517cb63ef5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:07.979773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=83 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:08.110708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f7e5af05-46e5-45ff-8468-39517cb63ef5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:08.119682 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f7e5af05-46e5-45ff-8468-39517cb63ef5 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.157851 Oct 04 19:09:08.120260 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3735/7465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:07 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:09.145432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a29993db-0d71-4606-b033-0eeceaf4d07d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:09.146011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a29993db-0d71-4606-b033-0eeceaf4d07d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:09.148984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=35 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:09.154584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a29993db-0d71-4606-b033-0eeceaf4d07d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:09.155137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a29993db-0d71-4606-b033-0eeceaf4d07d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:09.155598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a29993db-0d71-4606-b033-0eeceaf4d07d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:09.156350 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a29993db-0d71-4606-b033-0eeceaf4d07d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:09.156829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a29993db-0d71-4606-b033-0eeceaf4d07d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:09.157278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a29993db-0d71-4606-b033-0eeceaf4d07d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:09.160115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:09.298050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a29993db-0d71-4606-b033-0eeceaf4d07d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:09.307496 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a29993db-0d71-4606-b033-0eeceaf4d07d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.167096 Oct 04 19:09:09.308617 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3731/7466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:09 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:10.331517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4afe04aa-0176-4a04-a4ee-0bc04fea6cb9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:10.332163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4afe04aa-0176-4a04-a4ee-0bc04fea6cb9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:10.339236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4afe04aa-0176-4a04-a4ee-0bc04fea6cb9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:10.339727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4afe04aa-0176-4a04-a4ee-0bc04fea6cb9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:10.340206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4afe04aa-0176-4a04-a4ee-0bc04fea6cb9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:10.340912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4afe04aa-0176-4a04-a4ee-0bc04fea6cb9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:10.341373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4afe04aa-0176-4a04-a4ee-0bc04fea6cb9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:10.341806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4afe04aa-0176-4a04-a4ee-0bc04fea6cb9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:10.476934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4afe04aa-0176-4a04-a4ee-0bc04fea6cb9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:10.485999 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4afe04aa-0176-4a04-a4ee-0bc04fea6cb9 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.158369 Oct 04 19:09:10.486590 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3736/7467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:10 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:11.511773 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3797c904-4ca6-4a6a-9eac-f91473571e1d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:11.512558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3797c904-4ca6-4a6a-9eac-f91473571e1d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:11.519626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3797c904-4ca6-4a6a-9eac-f91473571e1d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:11.520128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3797c904-4ca6-4a6a-9eac-f91473571e1d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:11.520587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3797c904-4ca6-4a6a-9eac-f91473571e1d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:11.521298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3797c904-4ca6-4a6a-9eac-f91473571e1d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:11.521771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3797c904-4ca6-4a6a-9eac-f91473571e1d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:11.522213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3797c904-4ca6-4a6a-9eac-f91473571e1d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:11.650463 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3797c904-4ca6-4a6a-9eac-f91473571e1d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:11.658854 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3797c904-4ca6-4a6a-9eac-f91473571e1d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.151155 Oct 04 19:09:11.659460 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3732/7468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:11 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:12.683290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7925421a-0aee-4e9b-bc02-f1ca22f54177 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:12.683929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7925421a-0aee-4e9b-bc02-f1ca22f54177 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:12.690659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7925421a-0aee-4e9b-bc02-f1ca22f54177 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:12.691620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7925421a-0aee-4e9b-bc02-f1ca22f54177 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:12.692072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7925421a-0aee-4e9b-bc02-f1ca22f54177 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:12.692786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7925421a-0aee-4e9b-bc02-f1ca22f54177 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:12.694039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7925421a-0aee-4e9b-bc02-f1ca22f54177 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:12.694486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7925421a-0aee-4e9b-bc02-f1ca22f54177 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:12.840075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7925421a-0aee-4e9b-bc02-f1ca22f54177 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:12.849094 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7925421a-0aee-4e9b-bc02-f1ca22f54177 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1725 microversion: 2.1 time: 0.169941 Oct 04 19:09:12.849684 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3737/7469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:12 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:13.874012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bccd0827-f1b8-46e9-8f54-3cb20d494c91 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:13.874992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bccd0827-f1b8-46e9-8f54-3cb20d494c91 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:13.882516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bccd0827-f1b8-46e9-8f54-3cb20d494c91 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:13.883062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bccd0827-f1b8-46e9-8f54-3cb20d494c91 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:13.883525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bccd0827-f1b8-46e9-8f54-3cb20d494c91 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:13.884257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bccd0827-f1b8-46e9-8f54-3cb20d494c91 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:13.884734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bccd0827-f1b8-46e9-8f54-3cb20d494c91 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:13.885183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bccd0827-f1b8-46e9-8f54-3cb20d494c91 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:14.022884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bccd0827-f1b8-46e9-8f54-3cb20d494c91 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:14.031272 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bccd0827-f1b8-46e9-8f54-3cb20d494c91 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1722 microversion: 2.1 time: 0.161412 Oct 04 19:09:14.031850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3733/7470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:13 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:14.056198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:14.056765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:14.063713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:14.064201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:14.064654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:14.065335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:14.065794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:14.066756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:14.104519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:14.105090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:14.105439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:14.106157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:14.106614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:14.107062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:14.127299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:09:14.132874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Getting quotas for user b54bee64da524366a871ff5dac9bcc9e and project f7092234754e459aa3fbabdf6ca10561. Resources: {'cores', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:09:14.241641 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9aa3480e-2068-450d-ab57-93bf6ae91ac7 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "POST /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/action" status: 202 len: 0 microversion: 2.1 time: 0.189068 Oct 04 19:09:14.242407 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3738/7471] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:14 2022] POST /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:09:14.250318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8fdbc3af-348b-4228-8c09-748c2f283b23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:14.250978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8fdbc3af-348b-4228-8c09-748c2f283b23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:14.257989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fdbc3af-348b-4228-8c09-748c2f283b23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:14.258484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fdbc3af-348b-4228-8c09-748c2f283b23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:14.258978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fdbc3af-348b-4228-8c09-748c2f283b23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:14.259714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fdbc3af-348b-4228-8c09-748c2f283b23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:14.260204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fdbc3af-348b-4228-8c09-748c2f283b23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:14.260657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8fdbc3af-348b-4228-8c09-748c2f283b23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:14.403268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8fdbc3af-348b-4228-8c09-748c2f283b23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:14.411687 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8fdbc3af-348b-4228-8c09-748c2f283b23 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.165189 Oct 04 19:09:14.412281 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3734/7472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:14 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:15.437887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-97dbf75c-3d24-4132-8cc3-3daef320e133 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:15.438283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-97dbf75c-3d24-4132-8cc3-3daef320e133 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:15.444813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97dbf75c-3d24-4132-8cc3-3daef320e133 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:15.445311 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97dbf75c-3d24-4132-8cc3-3daef320e133 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:15.445754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97dbf75c-3d24-4132-8cc3-3daef320e133 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:15.446462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97dbf75c-3d24-4132-8cc3-3daef320e133 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:15.447039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97dbf75c-3d24-4132-8cc3-3daef320e133 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:15.447474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-97dbf75c-3d24-4132-8cc3-3daef320e133 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:15.583282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-97dbf75c-3d24-4132-8cc3-3daef320e133 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:15.592107 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-97dbf75c-3d24-4132-8cc3-3daef320e133 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.159914 Oct 04 19:09:15.592678 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3739/7473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:15 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:15.884897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-86b7eec9-4ad9-44ee-9f0a-f21db3b01b47 req-2ecd1ae9-4d72-4eb8-b126-f66340cf7069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbd67e8-943b-424b-bbed-e6a8e7e50271", "name": "network-vif-plugged", "status": "completed", "tag": "39c4f3fb-4860-4c14-be1b-b68cf7750745"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:15.897369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-86b7eec9-4ad9-44ee-9f0a-f21db3b01b47 req-2ecd1ae9-4d72-4eb8-b126-f66340cf7069 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:15.897912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-86b7eec9-4ad9-44ee-9f0a-f21db3b01b47 req-2ecd1ae9-4d72-4eb8-b126-f66340cf7069 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:15.898530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-86b7eec9-4ad9-44ee-9f0a-f21db3b01b47 req-2ecd1ae9-4d72-4eb8-b126-f66340cf7069 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:15.910517 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-86b7eec9-4ad9-44ee-9f0a-f21db3b01b47 req-2ecd1ae9-4d72-4eb8-b126-f66340cf7069 service nova] Creating event network-vif-plugged:39c4f3fb-4860-4c14-be1b-b68cf7750745 for instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 on n-h1-850499-14 Oct 04 19:09:15.916027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-86b7eec9-4ad9-44ee-9f0a-f21db3b01b47 req-2ecd1ae9-4d72-4eb8-b126-f66340cf7069 service nova] Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:09:15.927818 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-86b7eec9-4ad9-44ee-9f0a-f21db3b01b47 req-2ecd1ae9-4d72-4eb8-b126-f66340cf7069 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046505 Oct 04 19:09:15.928429 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3735/7474] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:16.614918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2055e0e0-ddd2-42d1-a6dd-f1bf8bceae65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:16.615553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2055e0e0-ddd2-42d1-a6dd-f1bf8bceae65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:16.622495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2055e0e0-ddd2-42d1-a6dd-f1bf8bceae65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:16.623022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2055e0e0-ddd2-42d1-a6dd-f1bf8bceae65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:16.623470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2055e0e0-ddd2-42d1-a6dd-f1bf8bceae65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:16.624168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2055e0e0-ddd2-42d1-a6dd-f1bf8bceae65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:16.624629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2055e0e0-ddd2-42d1-a6dd-f1bf8bceae65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:16.625059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2055e0e0-ddd2-42d1-a6dd-f1bf8bceae65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:16.760849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2055e0e0-ddd2-42d1-a6dd-f1bf8bceae65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:16.769630 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2055e0e0-ddd2-42d1-a6dd-f1bf8bceae65 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.158041 Oct 04 19:09:16.770184 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3740/7475] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:16 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:17.795341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7392557e-ee27-47ca-86a5-59cb0c5c0531 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:17.796071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7392557e-ee27-47ca-86a5-59cb0c5c0531 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:17.802624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7392557e-ee27-47ca-86a5-59cb0c5c0531 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:17.803164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7392557e-ee27-47ca-86a5-59cb0c5c0531 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:17.803621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7392557e-ee27-47ca-86a5-59cb0c5c0531 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:17.804338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7392557e-ee27-47ca-86a5-59cb0c5c0531 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:17.804818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7392557e-ee27-47ca-86a5-59cb0c5c0531 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:17.805268 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7392557e-ee27-47ca-86a5-59cb0c5c0531 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:17.944978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7392557e-ee27-47ca-86a5-59cb0c5c0531 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:17.954563 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7392557e-ee27-47ca-86a5-59cb0c5c0531 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.164271 Oct 04 19:09:17.955206 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3736/7476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:17 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:18.979691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b5b167c8-8239-4a35-b2ef-2447644ccc3f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:18.980244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b5b167c8-8239-4a35-b2ef-2447644ccc3f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:18.987005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b167c8-8239-4a35-b2ef-2447644ccc3f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:18.987497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b167c8-8239-4a35-b2ef-2447644ccc3f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:18.987937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b167c8-8239-4a35-b2ef-2447644ccc3f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:18.988628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b167c8-8239-4a35-b2ef-2447644ccc3f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:18.989082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b167c8-8239-4a35-b2ef-2447644ccc3f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:18.989523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b5b167c8-8239-4a35-b2ef-2447644ccc3f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:19.129323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b5b167c8-8239-4a35-b2ef-2447644ccc3f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:19.137588 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b5b167c8-8239-4a35-b2ef-2447644ccc3f tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.161866 Oct 04 19:09:19.138156 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3741/7477] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:18 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:19.686587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7b21f071-0ae6-4dda-97ce-40250e3a1be6 req-50d60a96-4ca2-4ac6-b6db-92556199eb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbd67e8-943b-424b-bbed-e6a8e7e50271", "name": "network-vif-unplugged", "status": "completed", "tag": "39c4f3fb-4860-4c14-be1b-b68cf7750745"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:19.697911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7b21f071-0ae6-4dda-97ce-40250e3a1be6 req-50d60a96-4ca2-4ac6-b6db-92556199eb6f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:19.698409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7b21f071-0ae6-4dda-97ce-40250e3a1be6 req-50d60a96-4ca2-4ac6-b6db-92556199eb6f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:19.699058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7b21f071-0ae6-4dda-97ce-40250e3a1be6 req-50d60a96-4ca2-4ac6-b6db-92556199eb6f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:19.711057 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7b21f071-0ae6-4dda-97ce-40250e3a1be6 req-50d60a96-4ca2-4ac6-b6db-92556199eb6f service nova] Creating event network-vif-unplugged:39c4f3fb-4860-4c14-be1b-b68cf7750745 for instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 on n-h2-850499-14 Oct 04 19:09:19.716684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-7b21f071-0ae6-4dda-97ce-40250e3a1be6 req-50d60a96-4ca2-4ac6-b6db-92556199eb6f service nova] Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:09:19.727906 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7b21f071-0ae6-4dda-97ce-40250e3a1be6 req-50d60a96-4ca2-4ac6-b6db-92556199eb6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045234 Oct 04 19:09:19.728554 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3737/7478] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:20.161141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-533311dd-09d8-49bf-b697-894925511a5a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:20.161866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-533311dd-09d8-49bf-b697-894925511a5a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:20.168920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533311dd-09d8-49bf-b697-894925511a5a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:20.169794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533311dd-09d8-49bf-b697-894925511a5a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:20.170320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533311dd-09d8-49bf-b697-894925511a5a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:20.171075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533311dd-09d8-49bf-b697-894925511a5a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:20.171626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533311dd-09d8-49bf-b697-894925511a5a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:20.172068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-533311dd-09d8-49bf-b697-894925511a5a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:20.312259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-533311dd-09d8-49bf-b697-894925511a5a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:20.321797 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-533311dd-09d8-49bf-b697-894925511a5a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.164714 Oct 04 19:09:20.322448 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3742/7479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:20 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:21.351157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0167adab-5944-473c-bff7-829eb80db778 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:21.351901 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0167adab-5944-473c-bff7-829eb80db778 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:21.359233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0167adab-5944-473c-bff7-829eb80db778 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.359933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0167adab-5944-473c-bff7-829eb80db778 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.360385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0167adab-5944-473c-bff7-829eb80db778 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.361118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0167adab-5944-473c-bff7-829eb80db778 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.361588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0167adab-5944-473c-bff7-829eb80db778 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.362032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0167adab-5944-473c-bff7-829eb80db778 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.501485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0167adab-5944-473c-bff7-829eb80db778 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:21.512917 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0167adab-5944-473c-bff7-829eb80db778 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.167610 Oct 04 19:09:21.513511 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3738/7480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:21 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:21.744935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a9750b5f-92a1-460b-ab4d-ece35d233741 req-6c52d674-efa2-4443-ad92-36307b6e285d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bbd67e8-943b-424b-bbed-e6a8e7e50271", "tag": "39c4f3fb-4860-4c14-be1b-b68cf7750745"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:21.755306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a9750b5f-92a1-460b-ab4d-ece35d233741 req-6c52d674-efa2-4443-ad92-36307b6e285d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.755797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a9750b5f-92a1-460b-ab4d-ece35d233741 req-6c52d674-efa2-4443-ad92-36307b6e285d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.756235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a9750b5f-92a1-460b-ab4d-ece35d233741 req-6c52d674-efa2-4443-ad92-36307b6e285d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.768481 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a9750b5f-92a1-460b-ab4d-ece35d233741 req-6c52d674-efa2-4443-ad92-36307b6e285d service nova] Creating event network-changed:39c4f3fb-4860-4c14-be1b-b68cf7750745 for instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 on n-h2-850499-14 Oct 04 19:09:21.774186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-a9750b5f-92a1-460b-ab4d-ece35d233741 req-6c52d674-efa2-4443-ad92-36307b6e285d service nova] Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:09:21.785296 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a9750b5f-92a1-460b-ab4d-ece35d233741 req-6c52d674-efa2-4443-ad92-36307b6e285d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043562 Oct 04 19:09:21.785947 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3743/7481] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:22.537404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-99bad327-37fc-4f8c-ab03-4bf522917a58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:22.538330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-99bad327-37fc-4f8c-ab03-4bf522917a58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:22.545841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99bad327-37fc-4f8c-ab03-4bf522917a58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:22.546360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99bad327-37fc-4f8c-ab03-4bf522917a58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:22.546820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99bad327-37fc-4f8c-ab03-4bf522917a58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:22.547975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99bad327-37fc-4f8c-ab03-4bf522917a58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:22.548472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99bad327-37fc-4f8c-ab03-4bf522917a58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:22.549022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-99bad327-37fc-4f8c-ab03-4bf522917a58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:23.064473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-99bad327-37fc-4f8c-ab03-4bf522917a58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:23.084479 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-99bad327-37fc-4f8c-ab03-4bf522917a58 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.549863 Oct 04 19:09:23.085121 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3739/7482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:22 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:24.164497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:24.168711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-65aa7bfa-4953-4938-9835-03855840ed49 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:24.169458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-65aa7bfa-4953-4938-9835-03855840ed49 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:24.176791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65aa7bfa-4953-4938-9835-03855840ed49 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:24.177280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65aa7bfa-4953-4938-9835-03855840ed49 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:24.177726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65aa7bfa-4953-4938-9835-03855840ed49 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:24.178432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65aa7bfa-4953-4938-9835-03855840ed49 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:24.178889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65aa7bfa-4953-4938-9835-03855840ed49 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:24.179371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65aa7bfa-4953-4938-9835-03855840ed49 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:24.311383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-65aa7bfa-4953-4938-9835-03855840ed49 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:24.319889 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-65aa7bfa-4953-4938-9835-03855840ed49 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.157294 Oct 04 19:09:24.320474 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3744/7483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:24 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:25.345840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e3e30c1f-6e14-4d9e-96fa-72fc4a387769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:25.346473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e3e30c1f-6e14-4d9e-96fa-72fc4a387769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:25.353936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e30c1f-6e14-4d9e-96fa-72fc4a387769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.354621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e30c1f-6e14-4d9e-96fa-72fc4a387769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.355107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e30c1f-6e14-4d9e-96fa-72fc4a387769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.355856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e30c1f-6e14-4d9e-96fa-72fc4a387769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.356326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e30c1f-6e14-4d9e-96fa-72fc4a387769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.356768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e3e30c1f-6e14-4d9e-96fa-72fc4a387769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.498888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e3e30c1f-6e14-4d9e-96fa-72fc4a387769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:25.507419 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e3e30c1f-6e14-4d9e-96fa-72fc4a387769 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.166222 Oct 04 19:09:25.508016 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3740/7484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:25 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:26.530168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-94a8944f-a9ef-416b-89da-c11d6bee926e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:26.530784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-94a8944f-a9ef-416b-89da-c11d6bee926e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:26.537060 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94a8944f-a9ef-416b-89da-c11d6bee926e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:26.537556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94a8944f-a9ef-416b-89da-c11d6bee926e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:26.537999 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94a8944f-a9ef-416b-89da-c11d6bee926e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:26.538697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94a8944f-a9ef-416b-89da-c11d6bee926e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:26.539181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94a8944f-a9ef-416b-89da-c11d6bee926e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:26.539612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94a8944f-a9ef-416b-89da-c11d6bee926e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:26.669320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-94a8944f-a9ef-416b-89da-c11d6bee926e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:26.678222 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-94a8944f-a9ef-416b-89da-c11d6bee926e tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.152066 Oct 04 19:09:26.678806 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3745/7485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:26 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:27.702600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1ce55014-d459-45b4-80a0-c7be69a6af44 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:27.703170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1ce55014-d459-45b4-80a0-c7be69a6af44 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:27.709317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce55014-d459-45b4-80a0-c7be69a6af44 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:27.709821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce55014-d459-45b4-80a0-c7be69a6af44 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:27.710276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce55014-d459-45b4-80a0-c7be69a6af44 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:27.710998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce55014-d459-45b4-80a0-c7be69a6af44 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:27.711472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce55014-d459-45b4-80a0-c7be69a6af44 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:27.712043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1ce55014-d459-45b4-80a0-c7be69a6af44 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:27.841749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1ce55014-d459-45b4-80a0-c7be69a6af44 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:27.850977 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1ce55014-d459-45b4-80a0-c7be69a6af44 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.152648 Oct 04 19:09:27.851576 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3741/7486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:27 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:28.875901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-882ec3a5-827a-4c0a-9544-e2bc2135b5fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:28.876523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-882ec3a5-827a-4c0a-9544-e2bc2135b5fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:28.884878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-882ec3a5-827a-4c0a-9544-e2bc2135b5fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:28.885368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-882ec3a5-827a-4c0a-9544-e2bc2135b5fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:28.885808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-882ec3a5-827a-4c0a-9544-e2bc2135b5fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:28.886530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-882ec3a5-827a-4c0a-9544-e2bc2135b5fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:28.887008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-882ec3a5-827a-4c0a-9544-e2bc2135b5fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:28.887473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-882ec3a5-827a-4c0a-9544-e2bc2135b5fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:29.072575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-882ec3a5-827a-4c0a-9544-e2bc2135b5fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:29.081257 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-882ec3a5-827a-4c0a-9544-e2bc2135b5fd tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.209139 Oct 04 19:09:29.081769 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3746/7487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:28 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:30.104914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0fd1deae-f08c-4d0b-9779-3fbc7472f494 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:30.105548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0fd1deae-f08c-4d0b-9779-3fbc7472f494 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:30.112817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fd1deae-f08c-4d0b-9779-3fbc7472f494 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.113328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fd1deae-f08c-4d0b-9779-3fbc7472f494 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.113790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fd1deae-f08c-4d0b-9779-3fbc7472f494 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.114519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fd1deae-f08c-4d0b-9779-3fbc7472f494 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.115086 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fd1deae-f08c-4d0b-9779-3fbc7472f494 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.115538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0fd1deae-f08c-4d0b-9779-3fbc7472f494 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.316336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0fd1deae-f08c-4d0b-9779-3fbc7472f494 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:30.324745 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0fd1deae-f08c-4d0b-9779-3fbc7472f494 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.223776 Oct 04 19:09:30.325322 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3742/7488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:30 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:31.348910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3884f1a5-49ac-40a6-ad77-d2a2a314ddf6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:31.349518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3884f1a5-49ac-40a6-ad77-d2a2a314ddf6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:31.356369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3884f1a5-49ac-40a6-ad77-d2a2a314ddf6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:31.356855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3884f1a5-49ac-40a6-ad77-d2a2a314ddf6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:31.357318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3884f1a5-49ac-40a6-ad77-d2a2a314ddf6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.358020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3884f1a5-49ac-40a6-ad77-d2a2a314ddf6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:31.358471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3884f1a5-49ac-40a6-ad77-d2a2a314ddf6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:31.358897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3884f1a5-49ac-40a6-ad77-d2a2a314ddf6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.493184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3884f1a5-49ac-40a6-ad77-d2a2a314ddf6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:31.502291 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3884f1a5-49ac-40a6-ad77-d2a2a314ddf6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.157785 Oct 04 19:09:31.502881 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3747/7489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:31 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:32.526139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-55836cbe-cfb0-40eb-926c-913ebf2ea6d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:32.526796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-55836cbe-cfb0-40eb-926c-913ebf2ea6d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:32.533739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55836cbe-cfb0-40eb-926c-913ebf2ea6d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:32.534251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55836cbe-cfb0-40eb-926c-913ebf2ea6d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:32.534713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55836cbe-cfb0-40eb-926c-913ebf2ea6d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:32.535496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55836cbe-cfb0-40eb-926c-913ebf2ea6d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:32.535976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55836cbe-cfb0-40eb-926c-913ebf2ea6d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:32.536424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55836cbe-cfb0-40eb-926c-913ebf2ea6d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:32.664990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-55836cbe-cfb0-40eb-926c-913ebf2ea6d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:32.673336 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-55836cbe-cfb0-40eb-926c-913ebf2ea6d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.151189 Oct 04 19:09:32.673916 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3743/7490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:32 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:33.698072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-348c596f-47dd-4ef9-b893-e54f2f1214ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:33.698841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-348c596f-47dd-4ef9-b893-e54f2f1214ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:33.705674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-348c596f-47dd-4ef9-b893-e54f2f1214ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.706164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-348c596f-47dd-4ef9-b893-e54f2f1214ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.706602 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-348c596f-47dd-4ef9-b893-e54f2f1214ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.707921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-348c596f-47dd-4ef9-b893-e54f2f1214ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.708378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-348c596f-47dd-4ef9-b893-e54f2f1214ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.708807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-348c596f-47dd-4ef9-b893-e54f2f1214ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.838368 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-348c596f-47dd-4ef9-b893-e54f2f1214ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:33.846880 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-348c596f-47dd-4ef9-b893-e54f2f1214ed tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1721 microversion: 2.1 time: 0.152816 Oct 04 19:09:33.847507 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3748/7491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:33 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:34.870791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bd22d1ae-dbb8-4777-9a82-65f196cb9faa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:34.871458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bd22d1ae-dbb8-4777-9a82-65f196cb9faa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:34.878329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd22d1ae-dbb8-4777-9a82-65f196cb9faa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:34.878835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd22d1ae-dbb8-4777-9a82-65f196cb9faa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:34.879327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd22d1ae-dbb8-4777-9a82-65f196cb9faa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:34.880039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd22d1ae-dbb8-4777-9a82-65f196cb9faa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:34.880520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd22d1ae-dbb8-4777-9a82-65f196cb9faa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:34.880963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd22d1ae-dbb8-4777-9a82-65f196cb9faa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.010976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bd22d1ae-dbb8-4777-9a82-65f196cb9faa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:35.019274 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bd22d1ae-dbb8-4777-9a82-65f196cb9faa tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1714 microversion: 2.1 time: 0.152450 Oct 04 19:09:35.020362 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3744/7492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:34 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:35.042590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-85e30df0-dec1-46d1-a6ea-f9d4e79dc6ae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:35.043257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-85e30df0-dec1-46d1-a6ea-f9d4e79dc6ae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:35.050297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85e30df0-dec1-46d1-a6ea-f9d4e79dc6ae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.050782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85e30df0-dec1-46d1-a6ea-f9d4e79dc6ae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.051266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85e30df0-dec1-46d1-a6ea-f9d4e79dc6ae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.051956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85e30df0-dec1-46d1-a6ea-f9d4e79dc6ae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.052413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85e30df0-dec1-46d1-a6ea-f9d4e79dc6ae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.052839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-85e30df0-dec1-46d1-a6ea-f9d4e79dc6ae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.055366 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:35.191988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-85e30df0-dec1-46d1-a6ea-f9d4e79dc6ae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:35.200215 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-85e30df0-dec1-46d1-a6ea-f9d4e79dc6ae tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1714 microversion: 2.1 time: 0.161418 Oct 04 19:09:35.200786 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3749/7493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:35 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:35.222878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-23dd9516-e119-4efa-828a-91f4b652b23c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:35.223564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-23dd9516-e119-4efa-828a-91f4b652b23c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:35.229945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dd9516-e119-4efa-828a-91f4b652b23c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.230450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dd9516-e119-4efa-828a-91f4b652b23c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.230911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dd9516-e119-4efa-828a-91f4b652b23c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.231641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dd9516-e119-4efa-828a-91f4b652b23c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.232118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dd9516-e119-4efa-828a-91f4b652b23c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.232563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23dd9516-e119-4efa-828a-91f4b652b23c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.366874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23dd9516-e119-4efa-828a-91f4b652b23c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:35.375672 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-23dd9516-e119-4efa-828a-91f4b652b23c tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1714 microversion: 2.1 time: 0.156570 Oct 04 19:09:35.376273 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3745/7494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:35 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:35.399360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4e1a46d1-8a82-447b-b25a-86f68f2fc719 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:35.399867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4e1a46d1-8a82-447b-b25a-86f68f2fc719 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:35.405783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e1a46d1-8a82-447b-b25a-86f68f2fc719 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.406270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e1a46d1-8a82-447b-b25a-86f68f2fc719 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.406762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e1a46d1-8a82-447b-b25a-86f68f2fc719 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.407481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e1a46d1-8a82-447b-b25a-86f68f2fc719 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.407935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e1a46d1-8a82-447b-b25a-86f68f2fc719 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.408364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4e1a46d1-8a82-447b-b25a-86f68f2fc719 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.434866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4e1a46d1-8a82-447b-b25a-86f68f2fc719 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:09:35.517251 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4e1a46d1-8a82-447b-b25a-86f68f2fc719 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 204 len: 0 microversion: 2.1 time: 0.122036 Oct 04 19:09:35.517962 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3750/7495] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:09:35 2022] DELETE /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:09:35.526238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fe707942-b9dd-4e8e-9760-0b1e990a486b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:35.526979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fe707942-b9dd-4e8e-9760-0b1e990a486b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:35.533422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe707942-b9dd-4e8e-9760-0b1e990a486b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.534079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe707942-b9dd-4e8e-9760-0b1e990a486b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.534572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe707942-b9dd-4e8e-9760-0b1e990a486b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.535353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe707942-b9dd-4e8e-9760-0b1e990a486b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.535884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe707942-b9dd-4e8e-9760-0b1e990a486b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.536791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe707942-b9dd-4e8e-9760-0b1e990a486b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.668757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fe707942-b9dd-4e8e-9760-0b1e990a486b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:35.677948 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fe707942-b9dd-4e8e-9760-0b1e990a486b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1720 microversion: 2.1 time: 0.155592 Oct 04 19:09:35.678527 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3746/7496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:35 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:35.911379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6b94bd1b-973b-432a-ac5a-3c65184419be req-b9f5d04a-1b39-4482-95c5-099f353ffe10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbd67e8-943b-424b-bbed-e6a8e7e50271", "name": "network-vif-plugged", "status": "completed", "tag": "39c4f3fb-4860-4c14-be1b-b68cf7750745"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:35.923653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6b94bd1b-973b-432a-ac5a-3c65184419be req-b9f5d04a-1b39-4482-95c5-099f353ffe10 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.924425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6b94bd1b-973b-432a-ac5a-3c65184419be req-b9f5d04a-1b39-4482-95c5-099f353ffe10 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.926411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6b94bd1b-973b-432a-ac5a-3c65184419be req-b9f5d04a-1b39-4482-95c5-099f353ffe10 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.942134 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6b94bd1b-973b-432a-ac5a-3c65184419be req-b9f5d04a-1b39-4482-95c5-099f353ffe10 service nova] Creating event network-vif-plugged:39c4f3fb-4860-4c14-be1b-b68cf7750745 for instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 on n-h2-850499-14 Oct 04 19:09:35.947450 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6b94bd1b-973b-432a-ac5a-3c65184419be req-b9f5d04a-1b39-4482-95c5-099f353ffe10 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040215 Oct 04 19:09:35.948072 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3751/7497] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:36.703007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cf81ca8e-191b-498a-a207-fca7d34e7b07 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:36.703562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cf81ca8e-191b-498a-a207-fca7d34e7b07 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:36.710893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf81ca8e-191b-498a-a207-fca7d34e7b07 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.711420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf81ca8e-191b-498a-a207-fca7d34e7b07 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.711877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf81ca8e-191b-498a-a207-fca7d34e7b07 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.712588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf81ca8e-191b-498a-a207-fca7d34e7b07 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.713061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf81ca8e-191b-498a-a207-fca7d34e7b07 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.713499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cf81ca8e-191b-498a-a207-fca7d34e7b07 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.847364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cf81ca8e-191b-498a-a207-fca7d34e7b07 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:36.856109 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cf81ca8e-191b-498a-a207-fca7d34e7b07 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1720 microversion: 2.1 time: 0.156895 Oct 04 19:09:36.856700 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3747/7498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:36 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:37.883013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-47445685-0883-496e-86c3-d41407deaee6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:37.883858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-47445685-0883-496e-86c3-d41407deaee6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:37.891756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47445685-0883-496e-86c3-d41407deaee6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.892266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47445685-0883-496e-86c3-d41407deaee6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.892716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47445685-0883-496e-86c3-d41407deaee6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.893454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47445685-0883-496e-86c3-d41407deaee6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.893948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47445685-0883-496e-86c3-d41407deaee6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.894384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-47445685-0883-496e-86c3-d41407deaee6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.053696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-47445685-0883-496e-86c3-d41407deaee6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:38.060876 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-47445685-0883-496e-86c3-d41407deaee6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1720 microversion: 2.1 time: 0.184229 Oct 04 19:09:38.061539 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3752/7499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:37 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:38.407363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-1e19b0c9-9b06-4216-888d-223de0b86923 req-1749c4a3-49bd-4a4c-8a16-535a53f76911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bbd67e8-943b-424b-bbed-e6a8e7e50271", "name": "network-vif-deleted", "tag": "39c4f3fb-4860-4c14-be1b-b68cf7750745"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:38.420020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1e19b0c9-9b06-4216-888d-223de0b86923 req-1749c4a3-49bd-4a4c-8a16-535a53f76911 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.420533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1e19b0c9-9b06-4216-888d-223de0b86923 req-1749c4a3-49bd-4a4c-8a16-535a53f76911 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.420989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-1e19b0c9-9b06-4216-888d-223de0b86923 req-1749c4a3-49bd-4a4c-8a16-535a53f76911 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.435159 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-1e19b0c9-9b06-4216-888d-223de0b86923 req-1749c4a3-49bd-4a4c-8a16-535a53f76911 service nova] Creating event network-vif-deleted:39c4f3fb-4860-4c14-be1b-b68cf7750745 for instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 on n-h2-850499-14 Oct 04 19:09:38.443543 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-1e19b0c9-9b06-4216-888d-223de0b86923 req-1749c4a3-49bd-4a4c-8a16-535a53f76911 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039952 Oct 04 19:09:38.444401 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3748/7500] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:39.085954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80886789-61fa-4b88-8f5a-832089b0d2f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:39.086471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-80886789-61fa-4b88-8f5a-832089b0d2f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:39.090503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:39.098104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80886789-61fa-4b88-8f5a-832089b0d2f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.098630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80886789-61fa-4b88-8f5a-832089b0d2f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.099245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80886789-61fa-4b88-8f5a-832089b0d2f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.100170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80886789-61fa-4b88-8f5a-832089b0d2f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.100700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80886789-61fa-4b88-8f5a-832089b0d2f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.101201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80886789-61fa-4b88-8f5a-832089b0d2f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.193737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-80886789-61fa-4b88-8f5a-832089b0d2f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:39.203185 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80886789-61fa-4b88-8f5a-832089b0d2f2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1369 microversion: 2.1 time: 0.121866 Oct 04 19:09:39.203792 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3753/7501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:39 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1369 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:40.227579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-18928355-53f1-49ae-86f9-f37de8728954 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:40.228448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-18928355-53f1-49ae-86f9-f37de8728954 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:40.230485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=36 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:40.236496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18928355-53f1-49ae-86f9-f37de8728954 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.237034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18928355-53f1-49ae-86f9-f37de8728954 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.237501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18928355-53f1-49ae-86f9-f37de8728954 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.238234 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18928355-53f1-49ae-86f9-f37de8728954 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.239243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18928355-53f1-49ae-86f9-f37de8728954 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.239695 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-18928355-53f1-49ae-86f9-f37de8728954 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.242556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=100 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:40.305792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-18928355-53f1-49ae-86f9-f37de8728954 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:40.314224 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-18928355-53f1-49ae-86f9-f37de8728954 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1369 microversion: 2.1 time: 0.092118 Oct 04 19:09:40.314813 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3749/7502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:40 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:41.337917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-06306bb5-5aa8-4faf-862e-515fc654b761 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:41.340257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-06306bb5-5aa8-4faf-862e-515fc654b761 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:41.349243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06306bb5-5aa8-4faf-862e-515fc654b761 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.349747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06306bb5-5aa8-4faf-862e-515fc654b761 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.350195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06306bb5-5aa8-4faf-862e-515fc654b761 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.350909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06306bb5-5aa8-4faf-862e-515fc654b761 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.351395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06306bb5-5aa8-4faf-862e-515fc654b761 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.351823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-06306bb5-5aa8-4faf-862e-515fc654b761 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.419402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-06306bb5-5aa8-4faf-862e-515fc654b761 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:41.428024 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-06306bb5-5aa8-4faf-862e-515fc654b761 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1369 microversion: 2.1 time: 0.094129 Oct 04 19:09:41.428604 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3754/7503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:41 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:42.451333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f8d7260b-af9e-4208-ba1b-c90b4e248b8b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:42.451964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f8d7260b-af9e-4208-ba1b-c90b4e248b8b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:42.458889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8d7260b-af9e-4208-ba1b-c90b4e248b8b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:42.459431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8d7260b-af9e-4208-ba1b-c90b4e248b8b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:42.459899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8d7260b-af9e-4208-ba1b-c90b4e248b8b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:42.460621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8d7260b-af9e-4208-ba1b-c90b4e248b8b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:42.461098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8d7260b-af9e-4208-ba1b-c90b4e248b8b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:42.461542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f8d7260b-af9e-4208-ba1b-c90b4e248b8b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:42.527608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f8d7260b-af9e-4208-ba1b-c90b4e248b8b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54bee64da524366a871ff5dac9bcc9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7092234754e459aa3fbabdf6ca10561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:42.536853 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f8d7260b-af9e-4208-ba1b-c90b4e248b8b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 200 len: 1369 microversion: 2.1 time: 0.089278 Oct 04 19:09:42.537455 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3750/7504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:42 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:43.561022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:43.561630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:43.569040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.569528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.569966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.570663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.571181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.571610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.585705 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 HTTP/1.1 Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '3bbd67e8-943b-424b-bbed-e6a8e7e50271'} Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:43.587371 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:43.592532 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:43.592532 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:43.592532 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:43.592532 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:43.592532 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:43.592532 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:43.592532 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:43.592532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:43.592532 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-624a6209-4450-4963-90c7-e4e8c22c6c13 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 404 len: 111 microversion: 2.1 time: 0.031880 Oct 04 19:09:43.592532 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3755/7505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:43 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:43.653105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:43.655371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:43.662432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.662973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.663454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.664171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.664651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.665108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.678440 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/os-volume_attachments HTTP/1.1 Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'server_id': '3bbd67e8-943b-424b-bbed-e6a8e7e50271'} Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:43.680153 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6df05764-c723-423b-b8f5-7d00dda163d1 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032517 Oct 04 19:09:43.685875 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3751/7506] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:09:43 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:47.007827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.008336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:47.015530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.016027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.016472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.017175 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.017651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.018082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.031690 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 HTTP/1.1 Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '3bbd67e8-943b-424b-bbed-e6a8e7e50271'} Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:47.033236 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ae4b431-3768-416e-bfa4-0127bc1e9d97 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 404 len: 111 microversion: 2.1 time: 0.031301 Oct 04 19:09:47.037853 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3756/7507] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:09:47 2022] DELETE /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:47.044237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.044879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 3bbd67e8-943b-424b-bbed-e6a8e7e50271] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:47.052528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.053024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.053472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.054174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.054645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.055113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.068344 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 HTTP/1.1 Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '3bbd67e8-943b-424b-bbed-e6a8e7e50271'} Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.069861 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.074571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.074571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.074571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.074571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:47.074571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:47.074571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. Oct 04 19:09:47.074571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.074571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 3bbd67e8-943b-424b-bbed-e6a8e7e50271 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:47.074571 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5387c3dc-d677-4e36-92e0-6a833777623b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271" status: 404 len: 111 microversion: 2.1 time: 0.030936 Oct 04 19:09:47.074571 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3752/7508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:47 2022] GET /compute/v2.1/servers/3bbd67e8-943b-424b-bbed-e6a8e7e50271 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:47.080262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.080769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:47.086800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.087258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.087710 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.088415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.088881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.089316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.103861 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 HTTP/1.1 Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '58b4cece-8119-4552-9c26-a7a531595a41'} Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:47.105449 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-344c71ca-0c80-4197-b968-fb27ad5d02b6 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "DELETE /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 404 len: 111 microversion: 2.1 time: 0.030488 Oct 04 19:09:47.109988 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3757/7509] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:09:47 2022] DELETE /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:47.116311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.116993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 58b4cece-8119-4552-9c26-a7a531595a41] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:47.123594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.124110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.124573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.125315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.125797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.126246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.141494 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 HTTP/1.1 Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '58b4cece-8119-4552-9c26-a7a531595a41'} Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.143208 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.147571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.147571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.147571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.147571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:47.147571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:47.147571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. Oct 04 19:09:47.147571 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.147571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 58b4cece-8119-4552-9c26-a7a531595a41 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:47.147571 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17076044-945a-479b-bfc6-cd15b7476b0d tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41" status: 404 len: 111 microversion: 2.1 time: 0.032915 Oct 04 19:09:47.147571 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3753/7510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:47 2022] GET /compute/v2.1/servers/58b4cece-8119-4552-9c26-a7a531595a41 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:47.153351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.153858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:47.160150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.161183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.161629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.162343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.162803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.163257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.179632 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e HTTP/1.1 Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '98f49671-5243-45a4-9ce5-80e401bf5c7e'} Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:47.181206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d3d6b93-d775-4081-a459-ff2d5bdcae6a tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "DELETE /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 404 len: 111 microversion: 2.1 time: 0.033190 Oct 04 19:09:47.185108 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3758/7511] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:09:47 2022] DELETE /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:47.191359 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.192046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 98f49671-5243-45a4-9ce5-80e401bf5c7e] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:47.198253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.199116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.199210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.199916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.200396 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.200844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.218360 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e HTTP/1.1 Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '98f49671-5243-45a4-9ce5-80e401bf5c7e'} Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.219974 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.227968 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.227968 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.227968 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.227968 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:47.227968 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:47.227968 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. Oct 04 19:09:47.227968 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.227968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 98f49671-5243-45a4-9ce5-80e401bf5c7e could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:47.227968 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-021bb668-d968-4d54-9f49-71b4aafed6e0 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e" status: 404 len: 111 microversion: 2.1 time: 0.033988 Oct 04 19:09:47.227968 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3754/7512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:47 2022] GET /compute/v2.1/servers/98f49671-5243-45a4-9ce5-80e401bf5c7e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:47.232167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.232673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:47.239314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.239804 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.240250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.240945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.241409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.241842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.255968 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff HTTP/1.1 Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '0fdb1819-f055-4bf4-abaa-e49fa25af8ff'} Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:47.257531 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-abb85fe6-eed9-4a70-afb1-8bcd14d3d8a2 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 404 len: 111 microversion: 2.1 time: 0.031711 Oct 04 19:09:47.262380 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3759/7513] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:09:47 2022] DELETE /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:47.268110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.268751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] [instance: 0fdb1819-f055-4bf4-abaa-e49fa25af8ff] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:47.275107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.275617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.276082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.276803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:47.277286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:47.277737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.293654 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] HTTP exception thrown: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Request method failure captured: Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff HTTP/1.1 Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPILvTETrq7qClfzlqCgQXqSM1K9re2X2F0Es3d4KaI9GVC7t4tGWZXe1ITEZqAcCaUVJVn21INLAOrpDIYcBd540uqW1QUTVA1rwNXLn_trGsRnS_x2RVVoxh5GCzNbt9Q-dOlh8ErnfeEYf_T799xTCSM07HIJ-uZFz3jVqn_gL7UQ Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7092234754e459aa3fbabdf6ca10561"}]}] Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: f7092234754e459aa3fbabdf6ca10561 Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServerActionsTestJSON-1089058785 Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: b54bee64da524366a871ff5dac9bcc9e Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServerActionsTestJSON-1089058785-project Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '0fdb1819-f055-4bf4-abaa-e49fa25af8ff'} Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:47.295272 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.299949 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:47.299949 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:47.299949 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:47.299949 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:47.299949 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:47.299949 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. Oct 04 19:09:47.299949 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:09:47.299949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Returning 404 to user: Instance 0fdb1819-f055-4bf4-abaa-e49fa25af8ff could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:47.299949 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e45bb520-259c-4260-9bec-b8d7ed92b87b tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff" status: 404 len: 111 microversion: 2.1 time: 0.032530 Oct 04 19:09:47.299949 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3755/7514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:47 2022] GET /compute/v2.1/servers/0fdb1819-f055-4bf4-abaa-e49fa25af8ff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:47.306574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9278c96e-9022-4fab-a16f-155d65b2a1e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] Calling method '.version_select at 0x7fd4d0bc9670>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:47.330504 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9278c96e-9022-4fab-a16f-155d65b2a1e8 tempest-ServerActionsTestJSON-1089058785 tempest-ServerActionsTestJSON-1089058785-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790208000" status: 202 len: 0 microversion: 2.1 time: 0.027426 Oct 04 19:09:47.331326 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3760/7515] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 4 19:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790208000 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:09:56.389344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1298340115", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "5d6cc95c-5543-4abd-919f-462897cc0fd8"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:56.460553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] validate_networks() for [('5d6cc95c-5543-4abd-919f-462897cc0fd8', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:09:56.880131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:09:56.880907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:09:56.881922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:09:56.882825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:09:56.883579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:09:56.895330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:56.895967 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:56.896262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:56.897412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:56.898316 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:56.898942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:56.921834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Getting quotas for project d7dc316478664fb396a4c5e2c4663d31. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:09:56.928989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Getting quotas for user 8a22f951de57496ca2d7ea8974111584 and project d7dc316478664fb396a4c5e2c4663d31. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:09:56.945061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:09:56.947727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:09:56.996941 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f63b482f-d6a3-40d6-ad61-47a97a879f78 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728951 Oct 04 19:09:56.998221 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3756/7516] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:09:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:09:57.009322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3dd87d54-e8bd-497d-8682-3b56f3aa4896 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:57.010512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3dd87d54-e8bd-497d-8682-3b56f3aa4896 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:57.088558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3dd87d54-e8bd-497d-8682-3b56f3aa4896 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:57.097125 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3dd87d54-e8bd-497d-8682-3b56f3aa4896 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1217 microversion: 2.1 time: 0.091639 Oct 04 19:09:57.098311 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3761/7517] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:57 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:58.126074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c328a4fa-a466-4500-b85f-aa5839cd4d79 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:58.126941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c328a4fa-a466-4500-b85f-aa5839cd4d79 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:58.133872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c328a4fa-a466-4500-b85f-aa5839cd4d79 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:58.134479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c328a4fa-a466-4500-b85f-aa5839cd4d79 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:58.134948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c328a4fa-a466-4500-b85f-aa5839cd4d79 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:58.135701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c328a4fa-a466-4500-b85f-aa5839cd4d79 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:58.136183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c328a4fa-a466-4500-b85f-aa5839cd4d79 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:58.136664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c328a4fa-a466-4500-b85f-aa5839cd4d79 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:58.213946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c328a4fa-a466-4500-b85f-aa5839cd4d79 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:58.221738 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c328a4fa-a466-4500-b85f-aa5839cd4d79 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1269 microversion: 2.1 time: 0.100639 Oct 04 19:09:58.222982 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3757/7518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:58 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:59.245810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-aa498891-cd2a-466b-a377-94c454667a77 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:59.246354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-aa498891-cd2a-466b-a377-94c454667a77 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:59.249137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:59.256329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa498891-cd2a-466b-a377-94c454667a77 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:59.256830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa498891-cd2a-466b-a377-94c454667a77 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:59.257280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa498891-cd2a-466b-a377-94c454667a77 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:59.257996 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa498891-cd2a-466b-a377-94c454667a77 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:59.258459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa498891-cd2a-466b-a377-94c454667a77 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:59.259107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-aa498891-cd2a-466b-a377-94c454667a77 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:59.432369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-aa498891-cd2a-466b-a377-94c454667a77 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:59.445236 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-aa498891-cd2a-466b-a377-94c454667a77 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1317 microversion: 2.1 time: 0.203805 Oct 04 19:09:59.447770 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3762/7519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:59 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:00.260279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-44e13945-4e9a-44ad-a3e1-c39586ecae07 req-8076f5a2-15b8-44af-9882-c016d0ad400f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "853bc6b7-2c23-4df0-ba1e-5cb632688ea2", "tag": "28a4efe6-5aea-48ce-8f29-f50a2aa2bdb8"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:00.271493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-44e13945-4e9a-44ad-a3e1-c39586ecae07 req-8076f5a2-15b8-44af-9882-c016d0ad400f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:00.272001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-44e13945-4e9a-44ad-a3e1-c39586ecae07 req-8076f5a2-15b8-44af-9882-c016d0ad400f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:00.272471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-44e13945-4e9a-44ad-a3e1-c39586ecae07 req-8076f5a2-15b8-44af-9882-c016d0ad400f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:00.285211 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-44e13945-4e9a-44ad-a3e1-c39586ecae07 req-8076f5a2-15b8-44af-9882-c016d0ad400f service nova] Creating event network-changed:28a4efe6-5aea-48ce-8f29-f50a2aa2bdb8 for instance 853bc6b7-2c23-4df0-ba1e-5cb632688ea2 on n-h1-850499-14 Oct 04 19:10:00.290598 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-44e13945-4e9a-44ad-a3e1-c39586ecae07 req-8076f5a2-15b8-44af-9882-c016d0ad400f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114342 Oct 04 19:10:00.291283 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3758/7520] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:00.469271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-887e6ba6-4b21-4737-8249-5e857640a1da tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:00.470291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-887e6ba6-4b21-4737-8249-5e857640a1da tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:00.478854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-887e6ba6-4b21-4737-8249-5e857640a1da tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:00.479488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-887e6ba6-4b21-4737-8249-5e857640a1da tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:00.479838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-887e6ba6-4b21-4737-8249-5e857640a1da tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:00.480580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-887e6ba6-4b21-4737-8249-5e857640a1da tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:00.481045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-887e6ba6-4b21-4737-8249-5e857640a1da tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:00.481682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-887e6ba6-4b21-4737-8249-5e857640a1da tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:00.619522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-887e6ba6-4b21-4737-8249-5e857640a1da tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:00.631752 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-887e6ba6-4b21-4737-8249-5e857640a1da tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1317 microversion: 2.1 time: 0.165961 Oct 04 19:10:00.632372 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3763/7521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:00 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:01.659288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7c002232-4eaa-41ae-af90-b3901d9c1bdf tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:01.660590 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7c002232-4eaa-41ae-af90-b3901d9c1bdf tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:01.667133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c002232-4eaa-41ae-af90-b3901d9c1bdf tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:01.667654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c002232-4eaa-41ae-af90-b3901d9c1bdf tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:01.668120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c002232-4eaa-41ae-af90-b3901d9c1bdf tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:01.668850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c002232-4eaa-41ae-af90-b3901d9c1bdf tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:01.669552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c002232-4eaa-41ae-af90-b3901d9c1bdf tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:01.670009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c002232-4eaa-41ae-af90-b3901d9c1bdf tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:01.802701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7c002232-4eaa-41ae-af90-b3901d9c1bdf tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:01.812340 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7c002232-4eaa-41ae-af90-b3901d9c1bdf tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1317 microversion: 2.1 time: 0.158426 Oct 04 19:10:01.813266 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3759/7522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:01 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:02.835646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4761563e-ff21-4806-af3d-89e7803f8cc2 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:02.836179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4761563e-ff21-4806-af3d-89e7803f8cc2 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:02.843259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4761563e-ff21-4806-af3d-89e7803f8cc2 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:02.843774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4761563e-ff21-4806-af3d-89e7803f8cc2 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:02.845659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4761563e-ff21-4806-af3d-89e7803f8cc2 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:02.846534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4761563e-ff21-4806-af3d-89e7803f8cc2 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:02.847661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4761563e-ff21-4806-af3d-89e7803f8cc2 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:02.848240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4761563e-ff21-4806-af3d-89e7803f8cc2 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:02.989782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4761563e-ff21-4806-af3d-89e7803f8cc2 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:02.996862 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4761563e-ff21-4806-af3d-89e7803f8cc2 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1317 microversion: 2.1 time: 0.165085 Oct 04 19:10:02.997470 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3764/7523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:02 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:04.020777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-74ad0590-ffc9-4256-b5ce-1898b95707d7 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:04.021416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-74ad0590-ffc9-4256-b5ce-1898b95707d7 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:04.028280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74ad0590-ffc9-4256-b5ce-1898b95707d7 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:04.028781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74ad0590-ffc9-4256-b5ce-1898b95707d7 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:04.029239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74ad0590-ffc9-4256-b5ce-1898b95707d7 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:04.029950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74ad0590-ffc9-4256-b5ce-1898b95707d7 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:04.030421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74ad0590-ffc9-4256-b5ce-1898b95707d7 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:04.031199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-74ad0590-ffc9-4256-b5ce-1898b95707d7 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:04.169066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-74ad0590-ffc9-4256-b5ce-1898b95707d7 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:04.177673 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-74ad0590-ffc9-4256-b5ce-1898b95707d7 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1317 microversion: 2.1 time: 0.160958 Oct 04 19:10:04.178566 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3760/7524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:04 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:05.201446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-23611f9a-1da7-4550-8e2a-77aab1bd46cc tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:05.202069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-23611f9a-1da7-4550-8e2a-77aab1bd46cc tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:05.204891 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:10:05.205020 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:10:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 (ip 10.222.0.18) !!! Oct 04 19:10:05.212422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23611f9a-1da7-4550-8e2a-77aab1bd46cc tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:05.212922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23611f9a-1da7-4550-8e2a-77aab1bd46cc tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:05.213369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23611f9a-1da7-4550-8e2a-77aab1bd46cc tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:05.214077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23611f9a-1da7-4550-8e2a-77aab1bd46cc tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:05.214542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23611f9a-1da7-4550-8e2a-77aab1bd46cc tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:05.214994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-23611f9a-1da7-4550-8e2a-77aab1bd46cc tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:05.344742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-23611f9a-1da7-4550-8e2a-77aab1bd46cc tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:05.352482 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-23611f9a-1da7-4550-8e2a-77aab1bd46cc tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1317 microversion: 2.1 time: 0.154979 Oct 04 19:10:05.353056 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3765/7525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:05 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:06.241914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5e2b4946-43cb-444a-ab38-96f106d0aeda req-8ec29359-4b45-4749-872b-61c88a511458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "853bc6b7-2c23-4df0-ba1e-5cb632688ea2", "name": "network-vif-plugged", "status": "completed", "tag": "28a4efe6-5aea-48ce-8f29-f50a2aa2bdb8"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:06.252517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5e2b4946-43cb-444a-ab38-96f106d0aeda req-8ec29359-4b45-4749-872b-61c88a511458 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.253079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5e2b4946-43cb-444a-ab38-96f106d0aeda req-8ec29359-4b45-4749-872b-61c88a511458 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.253525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5e2b4946-43cb-444a-ab38-96f106d0aeda req-8ec29359-4b45-4749-872b-61c88a511458 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.264165 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5e2b4946-43cb-444a-ab38-96f106d0aeda req-8ec29359-4b45-4749-872b-61c88a511458 service nova] Creating event network-vif-plugged:28a4efe6-5aea-48ce-8f29-f50a2aa2bdb8 for instance 853bc6b7-2c23-4df0-ba1e-5cb632688ea2 on n-h1-850499-14 Oct 04 19:10:06.269701 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5e2b4946-43cb-444a-ab38-96f106d0aeda req-8ec29359-4b45-4749-872b-61c88a511458 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094285 Oct 04 19:10:06.270312 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3761/7526] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:06.374629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d3a7bdc5-1428-44b8-8d24-bee218c516fe tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:06.375265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d3a7bdc5-1428-44b8-8d24-bee218c516fe tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:06.382670 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3a7bdc5-1428-44b8-8d24-bee218c516fe tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.383190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3a7bdc5-1428-44b8-8d24-bee218c516fe tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.383640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3a7bdc5-1428-44b8-8d24-bee218c516fe tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.384338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3a7bdc5-1428-44b8-8d24-bee218c516fe tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.384830 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3a7bdc5-1428-44b8-8d24-bee218c516fe tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.385259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d3a7bdc5-1428-44b8-8d24-bee218c516fe tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.857608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d3a7bdc5-1428-44b8-8d24-bee218c516fe tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:06.866528 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d3a7bdc5-1428-44b8-8d24-bee218c516fe tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1317 microversion: 2.1 time: 0.495895 Oct 04 19:10:06.867138 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3766/7527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:06 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:07.887226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:07.888063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:07.893662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b52d821e-d06a-496c-82ad-6cdc3f990d8c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:07.894390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b52d821e-d06a-496c-82ad-6cdc3f990d8c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:07.901186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b52d821e-d06a-496c-82ad-6cdc3f990d8c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:07.901691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b52d821e-d06a-496c-82ad-6cdc3f990d8c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:07.902149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b52d821e-d06a-496c-82ad-6cdc3f990d8c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:07.902861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b52d821e-d06a-496c-82ad-6cdc3f990d8c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:07.903364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b52d821e-d06a-496c-82ad-6cdc3f990d8c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:07.903839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b52d821e-d06a-496c-82ad-6cdc3f990d8c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:08.036059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b52d821e-d06a-496c-82ad-6cdc3f990d8c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:08.043816 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b52d821e-d06a-496c-82ad-6cdc3f990d8c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1506 microversion: 2.1 time: 0.157663 Oct 04 19:10:08.044394 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3762/7528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:07 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:08.106831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1052929097", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "5d6cc95c-5543-4abd-919f-462897cc0fd8"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:08.115952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:08.161008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] validate_networks() for [('5d6cc95c-5543-4abd-919f-462897cc0fd8', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:10:08.541412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:10:08.541835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:10:08.542369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:10:08.542780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:10:08.543220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:10:08.552281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:08.552766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:08.553204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:08.553930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:08.554391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:08.554819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:08.571164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Getting quotas for project d7dc316478664fb396a4c5e2c4663d31. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:08.576398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Getting quotas for user 8a22f951de57496ca2d7ea8974111584 and project d7dc316478664fb396a4c5e2c4663d31. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:08.590233 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:10:08.592682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:10:08.641363 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-625ba9d3-9cd9-49f9-80ba-6b4503501008 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538287 Oct 04 19:10:08.642015 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3767/7529] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:10:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:10:08.654126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d52fc6da-5430-4113-94f9-56e83d26eda6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:08.655006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d52fc6da-5430-4113-94f9-56e83d26eda6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:08.718849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d52fc6da-5430-4113-94f9-56e83d26eda6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:08.727121 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d52fc6da-5430-4113-94f9-56e83d26eda6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1217 microversion: 2.1 time: 0.077271 Oct 04 19:10:08.727758 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3763/7530] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:08 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:09.750605 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a2ef3f45-c6ae-4e19-b8cc-984644cab1d6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:09.751265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a2ef3f45-c6ae-4e19-b8cc-984644cab1d6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:09.753822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:09.759558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2ef3f45-c6ae-4e19-b8cc-984644cab1d6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:09.760058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2ef3f45-c6ae-4e19-b8cc-984644cab1d6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:09.760505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2ef3f45-c6ae-4e19-b8cc-984644cab1d6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:09.761209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2ef3f45-c6ae-4e19-b8cc-984644cab1d6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:09.761672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2ef3f45-c6ae-4e19-b8cc-984644cab1d6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:09.762110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a2ef3f45-c6ae-4e19-b8cc-984644cab1d6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:09.830501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a2ef3f45-c6ae-4e19-b8cc-984644cab1d6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:09.839208 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a2ef3f45-c6ae-4e19-b8cc-984644cab1d6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1277 microversion: 2.1 time: 0.093034 Oct 04 19:10:09.839791 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3768/7531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:09 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:10.864872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b46fa390-912f-43fa-84bd-6802ad9b5d06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:10.865508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b46fa390-912f-43fa-84bd-6802ad9b5d06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:10.867589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:11.156765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b46fa390-912f-43fa-84bd-6802ad9b5d06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:11.157295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b46fa390-912f-43fa-84bd-6802ad9b5d06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:11.157758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b46fa390-912f-43fa-84bd-6802ad9b5d06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:11.158503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b46fa390-912f-43fa-84bd-6802ad9b5d06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:11.159042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b46fa390-912f-43fa-84bd-6802ad9b5d06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:11.159540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b46fa390-912f-43fa-84bd-6802ad9b5d06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:11.164323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=52 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:11.225204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d23f59a2-d851-4dd3-91dc-4e72089dfd50 req-873a1216-8519-4414-b066-9f190f89ff02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2e5a68-29e5-4ac8-b43a-79043f430d82", "tag": "1047879d-6d7a-4b8f-a069-c54068c7c659"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:11.236031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d23f59a2-d851-4dd3-91dc-4e72089dfd50 req-873a1216-8519-4414-b066-9f190f89ff02 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:11.236823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d23f59a2-d851-4dd3-91dc-4e72089dfd50 req-873a1216-8519-4414-b066-9f190f89ff02 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:11.237434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d23f59a2-d851-4dd3-91dc-4e72089dfd50 req-873a1216-8519-4414-b066-9f190f89ff02 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:11.250175 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d23f59a2-d851-4dd3-91dc-4e72089dfd50 req-873a1216-8519-4414-b066-9f190f89ff02 service nova] Creating event network-changed:1047879d-6d7a-4b8f-a069-c54068c7c659 for instance de2e5a68-29e5-4ac8-b43a-79043f430d82 on n-h2-850499-14 Oct 04 19:10:11.256640 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d23f59a2-d851-4dd3-91dc-4e72089dfd50 req-873a1216-8519-4414-b066-9f190f89ff02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035193 Oct 04 19:10:11.257493 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3769/7532] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:10:11.327958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b46fa390-912f-43fa-84bd-6802ad9b5d06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:11.337141 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b46fa390-912f-43fa-84bd-6802ad9b5d06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1317 microversion: 2.1 time: 0.476795 Oct 04 19:10:11.338234 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3764/7533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:10 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:12.363104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e995aba0-9030-431d-aafd-208177b5551c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:12.363773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e995aba0-9030-431d-aafd-208177b5551c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:12.370114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e995aba0-9030-431d-aafd-208177b5551c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:12.370613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e995aba0-9030-431d-aafd-208177b5551c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:12.371094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e995aba0-9030-431d-aafd-208177b5551c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:12.371812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e995aba0-9030-431d-aafd-208177b5551c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:12.372279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e995aba0-9030-431d-aafd-208177b5551c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:12.372723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e995aba0-9030-431d-aafd-208177b5551c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:12.506835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e995aba0-9030-431d-aafd-208177b5551c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:12.515430 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e995aba0-9030-431d-aafd-208177b5551c tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1317 microversion: 2.1 time: 0.157637 Oct 04 19:10:12.516003 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3770/7534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:12 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:13.540545 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fba9ef9e-2ccf-4b65-9e2f-763a66fad339 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:13.541184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fba9ef9e-2ccf-4b65-9e2f-763a66fad339 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:13.548068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fba9ef9e-2ccf-4b65-9e2f-763a66fad339 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:13.548581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fba9ef9e-2ccf-4b65-9e2f-763a66fad339 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:13.549052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fba9ef9e-2ccf-4b65-9e2f-763a66fad339 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:13.550693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fba9ef9e-2ccf-4b65-9e2f-763a66fad339 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:13.551241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fba9ef9e-2ccf-4b65-9e2f-763a66fad339 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:13.551698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fba9ef9e-2ccf-4b65-9e2f-763a66fad339 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:13.679441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fba9ef9e-2ccf-4b65-9e2f-763a66fad339 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:13.687204 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fba9ef9e-2ccf-4b65-9e2f-763a66fad339 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1317 microversion: 2.1 time: 0.150529 Oct 04 19:10:13.687709 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3765/7535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:13 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:14.710150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a2e9882-3114-47d9-a7de-ad393a4d1165 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:14.710796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4a2e9882-3114-47d9-a7de-ad393a4d1165 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:14.717720 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a2e9882-3114-47d9-a7de-ad393a4d1165 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:14.718205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a2e9882-3114-47d9-a7de-ad393a4d1165 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:14.718644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a2e9882-3114-47d9-a7de-ad393a4d1165 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:14.719365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a2e9882-3114-47d9-a7de-ad393a4d1165 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:14.719821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a2e9882-3114-47d9-a7de-ad393a4d1165 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:14.720246 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a2e9882-3114-47d9-a7de-ad393a4d1165 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:14.853007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4a2e9882-3114-47d9-a7de-ad393a4d1165 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:14.861657 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4a2e9882-3114-47d9-a7de-ad393a4d1165 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1317 microversion: 2.1 time: 0.155837 Oct 04 19:10:14.862237 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3771/7536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:14 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:15.884903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ca6f0df-7259-413f-ad08-3d276fcea683 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:15.885441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3ca6f0df-7259-413f-ad08-3d276fcea683 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:15.895148 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ca6f0df-7259-413f-ad08-3d276fcea683 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:15.895658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ca6f0df-7259-413f-ad08-3d276fcea683 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:15.896128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ca6f0df-7259-413f-ad08-3d276fcea683 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:15.896846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ca6f0df-7259-413f-ad08-3d276fcea683 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:15.897322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ca6f0df-7259-413f-ad08-3d276fcea683 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:15.897869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ca6f0df-7259-413f-ad08-3d276fcea683 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:16.028284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3ca6f0df-7259-413f-ad08-3d276fcea683 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:16.036664 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ca6f0df-7259-413f-ad08-3d276fcea683 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1317 microversion: 2.1 time: 0.155880 Oct 04 19:10:16.037437 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3766/7537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:15 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:16.059328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a1c044ae-7fa9-4b8e-adac-709c1d7a6930 req-f5bf8571-353d-4b6a-9c40-f1850b04fd7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2e5a68-29e5-4ac8-b43a-79043f430d82", "name": "network-vif-plugged", "status": "completed", "tag": "1047879d-6d7a-4b8f-a069-c54068c7c659"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:16.072927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1c044ae-7fa9-4b8e-adac-709c1d7a6930 req-f5bf8571-353d-4b6a-9c40-f1850b04fd7e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:16.073426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1c044ae-7fa9-4b8e-adac-709c1d7a6930 req-f5bf8571-353d-4b6a-9c40-f1850b04fd7e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:16.073866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a1c044ae-7fa9-4b8e-adac-709c1d7a6930 req-f5bf8571-353d-4b6a-9c40-f1850b04fd7e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:16.085962 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a1c044ae-7fa9-4b8e-adac-709c1d7a6930 req-f5bf8571-353d-4b6a-9c40-f1850b04fd7e service nova] Creating event network-vif-plugged:1047879d-6d7a-4b8f-a069-c54068c7c659 for instance de2e5a68-29e5-4ac8-b43a-79043f430d82 on n-h2-850499-14 Oct 04 19:10:16.091549 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a1c044ae-7fa9-4b8e-adac-709c1d7a6930 req-f5bf8571-353d-4b6a-9c40-f1850b04fd7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036020 Oct 04 19:10:16.092163 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3772/7538] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:17.060150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-209b62c4-e582-46ea-aef5-e1cb51ac063a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:17.060776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-209b62c4-e582-46ea-aef5-e1cb51ac063a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:17.067614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-209b62c4-e582-46ea-aef5-e1cb51ac063a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:17.068114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-209b62c4-e582-46ea-aef5-e1cb51ac063a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:17.068565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-209b62c4-e582-46ea-aef5-e1cb51ac063a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:17.069278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-209b62c4-e582-46ea-aef5-e1cb51ac063a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:17.069756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-209b62c4-e582-46ea-aef5-e1cb51ac063a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:17.070204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-209b62c4-e582-46ea-aef5-e1cb51ac063a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:17.200725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-209b62c4-e582-46ea-aef5-e1cb51ac063a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:17.208995 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-209b62c4-e582-46ea-aef5-e1cb51ac063a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1317 microversion: 2.1 time: 0.152767 Oct 04 19:10:17.209577 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3767/7539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:17 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:18.232856 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ace0737-c49b-4596-b6b3-b959809675f3 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:18.233558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8ace0737-c49b-4596-b6b3-b959809675f3 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:18.240538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ace0737-c49b-4596-b6b3-b959809675f3 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.241020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ace0737-c49b-4596-b6b3-b959809675f3 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.241454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ace0737-c49b-4596-b6b3-b959809675f3 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.242140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ace0737-c49b-4596-b6b3-b959809675f3 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.242791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ace0737-c49b-4596-b6b3-b959809675f3 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.243120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ace0737-c49b-4596-b6b3-b959809675f3 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.374930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8ace0737-c49b-4596-b6b3-b959809675f3 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:18.382532 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8ace0737-c49b-4596-b6b3-b959809675f3 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1507 microversion: 2.1 time: 0.153883 Oct 04 19:10:18.383130 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3773/7540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:18 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:18.405369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-168a0480-bc2c-4f06-9d5e-3d8d7e6f03d8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:18.405865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-168a0480-bc2c-4f06-9d5e-3d8d7e6f03d8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:18.413418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-168a0480-bc2c-4f06-9d5e-3d8d7e6f03d8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.413926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-168a0480-bc2c-4f06-9d5e-3d8d7e6f03d8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.414402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-168a0480-bc2c-4f06-9d5e-3d8d7e6f03d8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.415137 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-168a0480-bc2c-4f06-9d5e-3d8d7e6f03d8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.415618 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-168a0480-bc2c-4f06-9d5e-3d8d7e6f03d8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.416063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-168a0480-bc2c-4f06-9d5e-3d8d7e6f03d8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.441385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-168a0480-bc2c-4f06-9d5e-3d8d7e6f03d8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:10:18.517710 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-168a0480-bc2c-4f06-9d5e-3d8d7e6f03d8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 204 len: 0 microversion: 2.1 time: 0.115756 Oct 04 19:10:18.519407 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3768/7541] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:10:18 2022] DELETE /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:10:18.527255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b6cec1db-dc67-4675-8c50-3cdbc88bed26 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:18.527877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b6cec1db-dc67-4675-8c50-3cdbc88bed26 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:18.533917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6cec1db-dc67-4675-8c50-3cdbc88bed26 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.534405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6cec1db-dc67-4675-8c50-3cdbc88bed26 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.534850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6cec1db-dc67-4675-8c50-3cdbc88bed26 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.535572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6cec1db-dc67-4675-8c50-3cdbc88bed26 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.536039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6cec1db-dc67-4675-8c50-3cdbc88bed26 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.536474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b6cec1db-dc67-4675-8c50-3cdbc88bed26 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.566018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:18.584502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:18.666510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b6cec1db-dc67-4675-8c50-3cdbc88bed26 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:18.674499 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b6cec1db-dc67-4675-8c50-3cdbc88bed26 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1513 microversion: 2.1 time: 0.150934 Oct 04 19:10:18.675670 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3774/7542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:18 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:19.699561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-33f4e1da-0718-4321-9087-d15164dd0474 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:19.700302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-33f4e1da-0718-4321-9087-d15164dd0474 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:19.702308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:19.711841 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33f4e1da-0718-4321-9087-d15164dd0474 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:19.712368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33f4e1da-0718-4321-9087-d15164dd0474 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:19.712900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33f4e1da-0718-4321-9087-d15164dd0474 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:19.713629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33f4e1da-0718-4321-9087-d15164dd0474 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:19.714112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33f4e1da-0718-4321-9087-d15164dd0474 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:19.714565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33f4e1da-0718-4321-9087-d15164dd0474 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:19.848066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-33f4e1da-0718-4321-9087-d15164dd0474 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:19.855989 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-33f4e1da-0718-4321-9087-d15164dd0474 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1513 microversion: 2.1 time: 0.160787 Oct 04 19:10:19.856566 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3769/7543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:19 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:20.657139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-23b6e221-b32f-4e6d-a622-97d6dd78245a req-d0767d21-1d53-4277-b3a1-0ac2b7732391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2e5a68-29e5-4ac8-b43a-79043f430d82", "name": "network-vif-deleted", "tag": "1047879d-6d7a-4b8f-a069-c54068c7c659"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:20.677348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-23b6e221-b32f-4e6d-a622-97d6dd78245a req-d0767d21-1d53-4277-b3a1-0ac2b7732391 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.678295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-23b6e221-b32f-4e6d-a622-97d6dd78245a req-d0767d21-1d53-4277-b3a1-0ac2b7732391 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.679001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-23b6e221-b32f-4e6d-a622-97d6dd78245a req-d0767d21-1d53-4277-b3a1-0ac2b7732391 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.697691 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-23b6e221-b32f-4e6d-a622-97d6dd78245a req-d0767d21-1d53-4277-b3a1-0ac2b7732391 service nova] Creating event network-vif-deleted:1047879d-6d7a-4b8f-a069-c54068c7c659 for instance de2e5a68-29e5-4ac8-b43a-79043f430d82 on n-h2-850499-14 Oct 04 19:10:20.704137 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-23b6e221-b32f-4e6d-a622-97d6dd78245a req-d0767d21-1d53-4277-b3a1-0ac2b7732391 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056818 Oct 04 19:10:20.705716 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3775/7544] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:20.879799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:20.880435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:20.887401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.887916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.888382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.889107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.889605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.890037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.921627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.922136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.922593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.923091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lazy-loading 'fault' on Instance uuid de2e5a68-29e5-4ac8-b43a-79043f430d82 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:20.963457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:20.971243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-76cf21a3-f618-42a8-8504-8acd7a0e4696 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 200 len: 1307 microversion: 2.1 time: 0.095627 Oct 04 19:10:20.972342 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3770/7545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:20 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:21.995351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:21.996058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.003152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.003649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.004092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.004787 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.005245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.005673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.019371 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] HTTP exception thrown: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Request method failure captured: Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 HTTP/1.1 Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIUEdgumc0rL6-x7flS_-w4b5oeoTMGtAKAMWzOE8WQyIplockQcHQaqnVvNkelSoRFc1LkRwspO9hxhfRyXMy-XcOiV4HvXxOXZTSxB-z1lupC7WBo_ReGKGNgl17Ko5ooFQEvHZRpZwlSeykyApA-S1Z1dSfOCWi643CxCs_uDfrQ Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}] Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 8a22f951de57496ca2d7ea8974111584 Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'de2e5a68-29e5-4ac8-b43a-79043f430d82'} Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:22.020976 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.026865 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.026865 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:22.026865 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:22.026865 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:22.026865 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:22.026865 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:22.026865 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.026865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Returning 404 to user: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:22.026865 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-455da071-2205-41e7-95dd-d94c96506a06 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 404 len: 111 microversion: 2.1 time: 0.031335 Oct 04 19:10:22.026865 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3776/7546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:21 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:22.031549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9167c274-19a8-47fe-9dbb-efd92157f089 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:22.032183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9167c274-19a8-47fe-9dbb-efd92157f089 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.039940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9167c274-19a8-47fe-9dbb-efd92157f089 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.040438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9167c274-19a8-47fe-9dbb-efd92157f089 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.040892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9167c274-19a8-47fe-9dbb-efd92157f089 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.041603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9167c274-19a8-47fe-9dbb-efd92157f089 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.042075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9167c274-19a8-47fe-9dbb-efd92157f089 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.042514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9167c274-19a8-47fe-9dbb-efd92157f089 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.171741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9167c274-19a8-47fe-9dbb-efd92157f089 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:22.179795 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9167c274-19a8-47fe-9dbb-efd92157f089 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1506 microversion: 2.1 time: 0.152191 Oct 04 19:10:22.180370 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3771/7547] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:22 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:22.202132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7754b3de-0090-4b86-90cd-c088d982f899 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:22.204432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7754b3de-0090-4b86-90cd-c088d982f899 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.210344 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-7754b3de-0090-4b86-90cd-c088d982f899 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] HTTP exception thrown: Instance ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79 could not be found. Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7754b3de-0090-4b86-90cd-c088d982f899 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Request method failure captured: Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79/action HTTP/1.1 Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 32 Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIUEdgumc0rL6-x7flS_-w4b5oeoTMGtAKAMWzOE8WQyIplockQcHQaqnVvNkelSoRFc1LkRwspO9hxhfRyXMy-XcOiV4HvXxOXZTSxB-z1lupC7WBo_ReGKGNgl17Ko5ooFQEvHZRpZwlSeykyApA-S1Z1dSfOCWi643CxCs_uDfrQ Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}] Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 8a22f951de57496ca2d7ea8974111584 Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: {"resize": {"flavorRef": "452"}} Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79 could not be found. Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79 could not be found. Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:22.211908 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79 could not be found. Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79 could not be found. Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7754b3de-0090-4b86-90cd-c088d982f899 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Returning 404 to user: Instance ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7754b3de-0090-4b86-90cd-c088d982f899 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "POST /compute/v2.1/servers/ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79/action" status: 404 len: 111 microversion: 2.1 time: 0.015585 Oct 04 19:10:22.216859 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3777/7548] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:10:22 2022] POST /compute/v2.1/servers/ea4cb8a6-1eb4-4ad4-af2c-02b00b519a79/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:22.222983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7ebe321a-a1b3-4853-a8b7-596727e62d45 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:22.223710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7ebe321a-a1b3-4853-a8b7-596727e62d45 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.229840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ebe321a-a1b3-4853-a8b7-596727e62d45 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.230339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ebe321a-a1b3-4853-a8b7-596727e62d45 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.230792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ebe321a-a1b3-4853-a8b7-596727e62d45 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.231527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ebe321a-a1b3-4853-a8b7-596727e62d45 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.232001 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ebe321a-a1b3-4853-a8b7-596727e62d45 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.232442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7ebe321a-a1b3-4853-a8b7-596727e62d45 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.362834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7ebe321a-a1b3-4853-a8b7-596727e62d45 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:22.370729 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7ebe321a-a1b3-4853-a8b7-596727e62d45 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1506 microversion: 2.1 time: 0.152127 Oct 04 19:10:22.371376 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3772/7549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:22 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:22.394574 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d20aa174-4fc5-41c5-ade7-b97ac15eecd9 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:22.395234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d20aa174-4fc5-41c5-ade7-b97ac15eecd9 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.402066 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d20aa174-4fc5-41c5-ade7-b97ac15eecd9 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.402557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d20aa174-4fc5-41c5-ade7-b97ac15eecd9 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.403023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d20aa174-4fc5-41c5-ade7-b97ac15eecd9 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.403728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d20aa174-4fc5-41c5-ade7-b97ac15eecd9 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.404193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d20aa174-4fc5-41c5-ade7-b97ac15eecd9 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.404631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d20aa174-4fc5-41c5-ade7-b97ac15eecd9 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.532512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d20aa174-4fc5-41c5-ade7-b97ac15eecd9 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:22.540587 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d20aa174-4fc5-41c5-ade7-b97ac15eecd9 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1506 microversion: 2.1 time: 0.150379 Oct 04 19:10:22.541154 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3778/7550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:22 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:22.563246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "b3b9a7c5-7309-442a-b222-ed2238e24b5b"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:22.566088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.572098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.572614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.573077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.573797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.574276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.574722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.603790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:22.608574 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] HTTP exception thrown: Flavor b3b9a7c5-7309-442a-b222-ed2238e24b5b could not be found. Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Request method failure captured: Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: request: POST /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2/action HTTP/1.1 Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 65 Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIUEdgumc0rL6-x7flS_-w4b5oeoTMGtAKAMWzOE8WQyIplockQcHQaqnVvNkelSoRFc1LkRwspO9hxhfRyXMy-XcOiV4HvXxOXZTSxB-z1lupC7WBo_ReGKGNgl17Ko5ooFQEvHZRpZwlSeykyApA-S1Z1dSfOCWi643CxCs_uDfrQ Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}] Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 8a22f951de57496ca2d7ea8974111584 Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: {"resize": {"flavorRef": "b3b9a7c5-7309-442a-b222-ed2238e24b5b"}} Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: exception: Flavor b3b9a7c5-7309-442a-b222-ed2238e24b5b could not be found. Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '853bc6b7-2c23-4df0-ba1e-5cb632688ea2', 'body': {'resize': {'flavorRef': 'b3b9a7c5-7309-442a-b222-ed2238e24b5b'}}} Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:22.610511 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b3b9a7c5-7309-442a-b222-ed2238e24b5b could not be found. Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor b3b9a7c5-7309-442a-b222-ed2238e24b5b could not be found. Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b3b9a7c5-7309-442a-b222-ed2238e24b5b could not be found. Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Returning 400 to user: Flavor b3b9a7c5-7309-442a-b222-ed2238e24b5b could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c104fa4d-bfe0-4e59-976f-747653d5e5c8 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "POST /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2/action" status: 400 len: 107 microversion: 2.1 time: 0.052871 Oct 04 19:10:22.615412 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3773/7551] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:10:22 2022] POST /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:10:22.621475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ae21948-9fd5-4761-8118-e0a5acc3217d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:22.622084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6ae21948-9fd5-4761-8118-e0a5acc3217d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.628871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae21948-9fd5-4761-8118-e0a5acc3217d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.629356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae21948-9fd5-4761-8118-e0a5acc3217d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.629791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae21948-9fd5-4761-8118-e0a5acc3217d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.630480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae21948-9fd5-4761-8118-e0a5acc3217d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.630939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae21948-9fd5-4761-8118-e0a5acc3217d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.631386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae21948-9fd5-4761-8118-e0a5acc3217d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.763136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6ae21948-9fd5-4761-8118-e0a5acc3217d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:22.771523 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6ae21948-9fd5-4761-8118-e0a5acc3217d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1506 microversion: 2.1 time: 0.153838 Oct 04 19:10:22.772092 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3779/7552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:22 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:22.795669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b15eb43-8291-4ec9-9318-c37e36f885c6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:22.796303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3b15eb43-8291-4ec9-9318-c37e36f885c6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.802523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b15eb43-8291-4ec9-9318-c37e36f885c6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.803070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b15eb43-8291-4ec9-9318-c37e36f885c6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.803525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b15eb43-8291-4ec9-9318-c37e36f885c6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.804263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b15eb43-8291-4ec9-9318-c37e36f885c6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.804750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b15eb43-8291-4ec9-9318-c37e36f885c6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.805190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3b15eb43-8291-4ec9-9318-c37e36f885c6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.936431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3b15eb43-8291-4ec9-9318-c37e36f885c6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:22.944240 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b15eb43-8291-4ec9-9318-c37e36f885c6 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1506 microversion: 2.1 time: 0.152472 Oct 04 19:10:22.944809 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3774/7553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:22 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:22.967262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c86dd56-863e-407b-9939-d4303d2a8864 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c86dd56-863e-407b-9939-d4303d2a8864 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Request method failure captured: Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: request: POST /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2/action HTTP/1.1 Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 29 Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIUEdgumc0rL6-x7flS_-w4b5oeoTMGtAKAMWzOE8WQyIplockQcHQaqnVvNkelSoRFc1LkRwspO9hxhfRyXMy-XcOiV4HvXxOXZTSxB-z1lupC7WBo_ReGKGNgl17Ko5ooFQEvHZRpZwlSeykyApA-S1Z1dSfOCWi643CxCs_uDfrQ Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}] Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 8a22f951de57496ca2d7ea8974111584 Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: {"resize": {"flavorRef": ""}} Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '853bc6b7-2c23-4df0-ba1e-5cb632688ea2', 'body': {'resize': {'flavorRef': ''}}} Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi '' Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.974837 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c86dd56-863e-407b-9939-d4303d2a8864 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c86dd56-863e-407b-9939-d4303d2a8864 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "POST /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2/action" status: 400 len: 113 microversion: 2.1 time: 0.013133 Oct 04 19:10:22.980295 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3780/7554] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:10:22 2022] POST /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2/action => generated 113 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:10:22.984748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-32b084e3-9f0c-4928-bce3-30895f1e8107 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:22.985390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-32b084e3-9f0c-4928-bce3-30895f1e8107 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.992007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b084e3-9f0c-4928-bce3-30895f1e8107 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.992516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b084e3-9f0c-4928-bce3-30895f1e8107 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.992975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b084e3-9f0c-4928-bce3-30895f1e8107 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.993693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b084e3-9f0c-4928-bce3-30895f1e8107 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.994171 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b084e3-9f0c-4928-bce3-30895f1e8107 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.994620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-32b084e3-9f0c-4928-bce3-30895f1e8107 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.126446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-32b084e3-9f0c-4928-bce3-30895f1e8107 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:23.134634 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-32b084e3-9f0c-4928-bce3-30895f1e8107 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1506 microversion: 2.1 time: 0.153748 Oct 04 19:10:23.135247 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3775/7555] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:22 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:23.162862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:23.163475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:23.170543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.171080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.171616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.172329 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.172797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.173231 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.187768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] HTTP exception thrown: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Request method failure captured: Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 HTTP/1.1 Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIUEdgumc0rL6-x7flS_-w4b5oeoTMGtAKAMWzOE8WQyIplockQcHQaqnVvNkelSoRFc1LkRwspO9hxhfRyXMy-XcOiV4HvXxOXZTSxB-z1lupC7WBo_ReGKGNgl17Ko5ooFQEvHZRpZwlSeykyApA-S1Z1dSfOCWi643CxCs_uDfrQ Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}] Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 8a22f951de57496ca2d7ea8974111584 Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'de2e5a68-29e5-4ac8-b43a-79043f430d82'} Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:23.189374 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Returning 404 to user: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-98d2bdf6-bc29-44a4-8883-3f743bf97ab1 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 404 len: 111 microversion: 2.1 time: 0.034081 Oct 04 19:10:23.194477 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3781/7556] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:10:23 2022] DELETE /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:23.200866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:23.201551 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: de2e5a68-29e5-4ac8-b43a-79043f430d82] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:23.208569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.209080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.209532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.210252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.210727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.212050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.226831 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] HTTP exception thrown: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Request method failure captured: Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 HTTP/1.1 Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIUEdgumc0rL6-x7flS_-w4b5oeoTMGtAKAMWzOE8WQyIplockQcHQaqnVvNkelSoRFc1LkRwspO9hxhfRyXMy-XcOiV4HvXxOXZTSxB-z1lupC7WBo_ReGKGNgl17Ko5ooFQEvHZRpZwlSeykyApA-S1Z1dSfOCWi643CxCs_uDfrQ Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}] Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 8a22f951de57496ca2d7ea8974111584 Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': 'de2e5a68-29e5-4ac8-b43a-79043f430d82'} Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:23.229010 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:23.233960 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:23.233960 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:23.233960 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:23.233960 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:23.233960 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:23.233960 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. Oct 04 19:10:23.233960 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:23.233960 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Returning 404 to user: Instance de2e5a68-29e5-4ac8-b43a-79043f430d82 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:23.233960 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ab50fc9a-8aa5-4437-8ddd-b053c234e21a tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82" status: 404 len: 111 microversion: 2.1 time: 0.033584 Oct 04 19:10:23.233960 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3776/7557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:23 2022] GET /compute/v2.1/servers/de2e5a68-29e5-4ac8-b43a-79043f430d82 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:23.239644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-996c0b91-b64d-4804-84d3-59d554c0a50d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:23.240147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-996c0b91-b64d-4804-84d3-59d554c0a50d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:23.246236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-996c0b91-b64d-4804-84d3-59d554c0a50d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.246728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-996c0b91-b64d-4804-84d3-59d554c0a50d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.247199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-996c0b91-b64d-4804-84d3-59d554c0a50d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.247902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-996c0b91-b64d-4804-84d3-59d554c0a50d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.248365 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-996c0b91-b64d-4804-84d3-59d554c0a50d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.248900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-996c0b91-b64d-4804-84d3-59d554c0a50d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.275564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-996c0b91-b64d-4804-84d3-59d554c0a50d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:10:23.327586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:23.370157 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-996c0b91-b64d-4804-84d3-59d554c0a50d tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "DELETE /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 204 len: 0 microversion: 2.1 time: 0.132355 Oct 04 19:10:23.370157 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3782/7558] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:10:23 2022] DELETE /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:10:23.378749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cc32985b-fd00-42d9-81a7-b6cac66956a5 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:23.379367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cc32985b-fd00-42d9-81a7-b6cac66956a5 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:23.385760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc32985b-fd00-42d9-81a7-b6cac66956a5 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.386358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc32985b-fd00-42d9-81a7-b6cac66956a5 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.386854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc32985b-fd00-42d9-81a7-b6cac66956a5 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.387496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc32985b-fd00-42d9-81a7-b6cac66956a5 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.388112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc32985b-fd00-42d9-81a7-b6cac66956a5 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.388420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cc32985b-fd00-42d9-81a7-b6cac66956a5 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.528118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cc32985b-fd00-42d9-81a7-b6cac66956a5 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:23.537076 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cc32985b-fd00-42d9-81a7-b6cac66956a5 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1512 microversion: 2.1 time: 0.162666 Oct 04 19:10:23.537954 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3777/7559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:23 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:24.562045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6388a5e0-adc0-423f-8f56-311f70bab4cb tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:24.562776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6388a5e0-adc0-423f-8f56-311f70bab4cb tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:24.568737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6388a5e0-adc0-423f-8f56-311f70bab4cb tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.569308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6388a5e0-adc0-423f-8f56-311f70bab4cb tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.569664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6388a5e0-adc0-423f-8f56-311f70bab4cb tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.570360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6388a5e0-adc0-423f-8f56-311f70bab4cb tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.570815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6388a5e0-adc0-423f-8f56-311f70bab4cb tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.571267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6388a5e0-adc0-423f-8f56-311f70bab4cb tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.701128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6388a5e0-adc0-423f-8f56-311f70bab4cb tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:24.708858 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6388a5e0-adc0-423f-8f56-311f70bab4cb tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1512 microversion: 2.1 time: 0.151401 Oct 04 19:10:24.709415 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3783/7560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:24 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:25.332306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5bde8548-8bc0-4d8a-bf8c-d09af6f2f79b req-7604f061-514b-4c8a-be90-82380f9ddc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "853bc6b7-2c23-4df0-ba1e-5cb632688ea2", "name": "network-vif-deleted", "tag": "28a4efe6-5aea-48ce-8f29-f50a2aa2bdb8"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:25.343233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5bde8548-8bc0-4d8a-bf8c-d09af6f2f79b req-7604f061-514b-4c8a-be90-82380f9ddc0e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.343748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5bde8548-8bc0-4d8a-bf8c-d09af6f2f79b req-7604f061-514b-4c8a-be90-82380f9ddc0e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.344201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5bde8548-8bc0-4d8a-bf8c-d09af6f2f79b req-7604f061-514b-4c8a-be90-82380f9ddc0e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.356073 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5bde8548-8bc0-4d8a-bf8c-d09af6f2f79b req-7604f061-514b-4c8a-be90-82380f9ddc0e service nova] Creating event network-vif-deleted:28a4efe6-5aea-48ce-8f29-f50a2aa2bdb8 for instance 853bc6b7-2c23-4df0-ba1e-5cb632688ea2 on n-h1-850499-14 Oct 04 19:10:25.361653 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5bde8548-8bc0-4d8a-bf8c-d09af6f2f79b req-7604f061-514b-4c8a-be90-82380f9ddc0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033630 Oct 04 19:10:25.362315 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3778/7561] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:25.732477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:25.733092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:25.740511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.740995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.741435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.742162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.742618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.743076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.775701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.776109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.776547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.776994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lazy-loading 'fault' on Instance uuid 853bc6b7-2c23-4df0-ba1e-5cb632688ea2 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:25.824925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a22f951de57496ca2d7ea8974111584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dc316478664fb396a4c5e2c4663d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:25.833509 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-95807fc2-ab0f-41d4-9201-70916dbe5c09 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 200 len: 1307 microversion: 2.1 time: 0.104602 Oct 04 19:10:25.834084 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3784/7562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:25 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:26.859160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:26.859560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] [instance: 853bc6b7-2c23-4df0-ba1e-5cb632688ea2] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:26.865469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.865992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.866466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.867217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.867827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.868379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.883864 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] HTTP exception thrown: Instance 853bc6b7-2c23-4df0-ba1e-5cb632688ea2 could not be found. Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Request method failure captured: Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 HTTP/1.1 Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIUEdgumc0rL6-x7flS_-w4b5oeoTMGtAKAMWzOE8WQyIplockQcHQaqnVvNkelSoRFc1LkRwspO9hxhfRyXMy-XcOiV4HvXxOXZTSxB-z1lupC7WBo_ReGKGNgl17Ko5ooFQEvHZRpZwlSeykyApA-S1Z1dSfOCWi643CxCs_uDfrQ Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7dc316478664fb396a4c5e2c4663d31"}]}] Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: d7dc316478664fb396a4c5e2c4663d31 Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-ServersNegativeTestJSON-374367357 Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 8a22f951de57496ca2d7ea8974111584 Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-ServersNegativeTestJSON-374367357-project Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 853bc6b7-2c23-4df0-ba1e-5cb632688ea2 could not be found. Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '853bc6b7-2c23-4df0-ba1e-5cb632688ea2'} Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 853bc6b7-2c23-4df0-ba1e-5cb632688ea2 could not be found. Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 853bc6b7-2c23-4df0-ba1e-5cb632688ea2 could not be found. Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:26.885527 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:26.890269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:26.890269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:26.890269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:26.890269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:26.890269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:26.890269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 853bc6b7-2c23-4df0-ba1e-5cb632688ea2 could not be found. Oct 04 19:10:26.890269 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:10:26.890269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] Returning 404 to user: Instance 853bc6b7-2c23-4df0-ba1e-5cb632688ea2 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:26.890269 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dca1e592-fc49-40f7-bea9-6935402cb328 tempest-ServersNegativeTestJSON-374367357 tempest-ServersNegativeTestJSON-374367357-project] 10.222.0.18 "GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2" status: 404 len: 111 microversion: 2.1 time: 0.033785 Oct 04 19:10:26.890269 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3779/7563] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:26 2022] GET /compute/v2.1/servers/853bc6b7-2c23-4df0-ba1e-5cb632688ea2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:58.679664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:58.680623 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=14 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:58.872994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74bebb5d-63b3-4ef7-81e5-b2b95e866e80 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Action: 'create', calling method: .version_select at 0x7fd4d0a1cc10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-426297636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlm3JpTwbKTumss8d6U7E3sqZ+1DlpdIegnD4qcY10Ody8pSQNDlVCMEQwHDPMr/SYhxqQLJG02VSZW/Y/FZ5LhsS693sjKzGpGRJtQi5AGNoMX+fM1ApV4HbLXdcUjXQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:58.890327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-74bebb5d-63b3-4ef7-81e5-b2b95e866e80 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:58.895869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-74bebb5d-63b3-4ef7-81e5-b2b95e866e80 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for user f06df58bf04f41ab945925996c54cd47 and project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:58.923217 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74bebb5d-63b3-4ef7-81e5-b2b95e866e80 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.248946 Oct 04 19:10:58.924341 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3785/7564] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:10:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:10:58.978881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-826946179", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-426297636", "networks": [{"uuid": "b7f97b6b-54a4-449d-93cc-9364398fc55a"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:58.989247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:58.990131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:59.046075 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] validate_networks() for [('b7f97b6b-54a4-449d-93cc-9364398fc55a', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:10:59.485957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:10:59.486416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:10:59.486921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:10:59.487437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:10:59.488108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:10:59.498431 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:59.498943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:59.499441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:59.500193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:59.500671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:59.501174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:59.520409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:59.528032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for user f06df58bf04f41ab945925996c54cd47 and project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:59.543981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:10:59.546428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:10:59.597520 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-35391813-7d68-497d-b777-c5cf8b65eba3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623065 Oct 04 19:10:59.599103 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3780/7565] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:10:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:10:59.614391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-896cc63c-2962-4554-995b-ee9059e7574f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:59.615841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-896cc63c-2962-4554-995b-ee9059e7574f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:59.675961 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-896cc63c-2962-4554-995b-ee9059e7574f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:59.685470 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-896cc63c-2962-4554-995b-ee9059e7574f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1261 microversion: 2.1 time: 0.076899 Oct 04 19:10:59.686421 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3786/7566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:59 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1261 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:00.716170 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17892aac-78ae-457b-8ae1-db1668c81f32 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:00.716887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17892aac-78ae-457b-8ae1-db1668c81f32 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:00.724210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17892aac-78ae-457b-8ae1-db1668c81f32 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.724712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17892aac-78ae-457b-8ae1-db1668c81f32 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.725164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17892aac-78ae-457b-8ae1-db1668c81f32 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.725890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17892aac-78ae-457b-8ae1-db1668c81f32 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.726356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17892aac-78ae-457b-8ae1-db1668c81f32 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.726815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17892aac-78ae-457b-8ae1-db1668c81f32 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.792269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-17892aac-78ae-457b-8ae1-db1668c81f32 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:00.800979 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17892aac-78ae-457b-8ae1-db1668c81f32 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1313 microversion: 2.1 time: 0.090063 Oct 04 19:11:00.801580 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3781/7567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:00 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1313 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:01.825167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ae135f5-d11b-4f14-a7bc-bead774d6606 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:01.826391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6ae135f5-d11b-4f14-a7bc-bead774d6606 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:01.834281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae135f5-d11b-4f14-a7bc-bead774d6606 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.834773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae135f5-d11b-4f14-a7bc-bead774d6606 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.835244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae135f5-d11b-4f14-a7bc-bead774d6606 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.836283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae135f5-d11b-4f14-a7bc-bead774d6606 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.836806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae135f5-d11b-4f14-a7bc-bead774d6606 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.837250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ae135f5-d11b-4f14-a7bc-bead774d6606 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.073969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6ae135f5-d11b-4f14-a7bc-bead774d6606 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:02.087681 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6ae135f5-d11b-4f14-a7bc-bead774d6606 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1361 microversion: 2.1 time: 0.266211 Oct 04 19:11:02.089085 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3787/7568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:01 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:02.816213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-7d7027d0-5cbb-426c-b71d-74f8cb1f58c8 req-6433af5e-105e-4573-ba3d-311a0a6fca13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3d2fb0-5175-45ef-90a8-976a7168b5e3", "tag": "8d5d6656-6e8b-4c3c-9a71-4f03bc981433"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:02.841259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7d7027d0-5cbb-426c-b71d-74f8cb1f58c8 req-6433af5e-105e-4573-ba3d-311a0a6fca13 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.841991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7d7027d0-5cbb-426c-b71d-74f8cb1f58c8 req-6433af5e-105e-4573-ba3d-311a0a6fca13 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.842266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-7d7027d0-5cbb-426c-b71d-74f8cb1f58c8 req-6433af5e-105e-4573-ba3d-311a0a6fca13 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.864705 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-7d7027d0-5cbb-426c-b71d-74f8cb1f58c8 req-6433af5e-105e-4573-ba3d-311a0a6fca13 service nova] Creating event network-changed:8d5d6656-6e8b-4c3c-9a71-4f03bc981433 for instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 on n-h2-850499-14 Oct 04 19:11:02.874656 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-7d7027d0-5cbb-426c-b71d-74f8cb1f58c8 req-6433af5e-105e-4573-ba3d-311a0a6fca13 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069571 Oct 04 19:11:02.875310 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3782/7569] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:03.117835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7188bdb4-eb7c-4581-a2df-aa6f5dcfbb94 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:03.121508 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7188bdb4-eb7c-4581-a2df-aa6f5dcfbb94 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:03.137232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7188bdb4-eb7c-4581-a2df-aa6f5dcfbb94 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:03.137959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7188bdb4-eb7c-4581-a2df-aa6f5dcfbb94 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:03.138471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7188bdb4-eb7c-4581-a2df-aa6f5dcfbb94 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:03.139629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7188bdb4-eb7c-4581-a2df-aa6f5dcfbb94 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:03.140141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7188bdb4-eb7c-4581-a2df-aa6f5dcfbb94 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:03.140792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7188bdb4-eb7c-4581-a2df-aa6f5dcfbb94 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:03.303266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7188bdb4-eb7c-4581-a2df-aa6f5dcfbb94 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:03.325641 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7188bdb4-eb7c-4581-a2df-aa6f5dcfbb94 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1361 microversion: 2.1 time: 0.211479 Oct 04 19:11:03.327475 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3788/7570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:03 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:04.350647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00176e5b-4c0f-4ae7-9d7c-9c75b1e4429f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:04.351339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00176e5b-4c0f-4ae7-9d7c-9c75b1e4429f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:04.358766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00176e5b-4c0f-4ae7-9d7c-9c75b1e4429f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:04.359322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00176e5b-4c0f-4ae7-9d7c-9c75b1e4429f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:04.359781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00176e5b-4c0f-4ae7-9d7c-9c75b1e4429f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:04.360533 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00176e5b-4c0f-4ae7-9d7c-9c75b1e4429f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:04.361010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00176e5b-4c0f-4ae7-9d7c-9c75b1e4429f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:04.361454 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00176e5b-4c0f-4ae7-9d7c-9c75b1e4429f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:04.496819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-00176e5b-4c0f-4ae7-9d7c-9c75b1e4429f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:04.505132 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-00176e5b-4c0f-4ae7-9d7c-9c75b1e4429f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1361 microversion: 2.1 time: 0.158882 Oct 04 19:11:04.505715 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3783/7571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:04 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:05.529002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cc21e291-deb7-4d59-b63e-017138e1bde4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:05.529619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cc21e291-deb7-4d59-b63e-017138e1bde4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:05.537240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc21e291-deb7-4d59-b63e-017138e1bde4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.537692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc21e291-deb7-4d59-b63e-017138e1bde4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.538137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc21e291-deb7-4d59-b63e-017138e1bde4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.538841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc21e291-deb7-4d59-b63e-017138e1bde4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.539337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc21e291-deb7-4d59-b63e-017138e1bde4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.539778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cc21e291-deb7-4d59-b63e-017138e1bde4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.688200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cc21e291-deb7-4d59-b63e-017138e1bde4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:05.696534 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cc21e291-deb7-4d59-b63e-017138e1bde4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1361 microversion: 2.1 time: 0.171302 Oct 04 19:11:05.697515 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3789/7572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:05 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:06.720951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36d278ca-3762-4078-a72f-ac22c358aad7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:06.721596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-36d278ca-3762-4078-a72f-ac22c358aad7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:06.728768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d278ca-3762-4078-a72f-ac22c358aad7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:06.729297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d278ca-3762-4078-a72f-ac22c358aad7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:06.729762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d278ca-3762-4078-a72f-ac22c358aad7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:06.730498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d278ca-3762-4078-a72f-ac22c358aad7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:06.730996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d278ca-3762-4078-a72f-ac22c358aad7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:06.731450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d278ca-3762-4078-a72f-ac22c358aad7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:06.873160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-36d278ca-3762-4078-a72f-ac22c358aad7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:06.883181 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-36d278ca-3762-4078-a72f-ac22c358aad7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1361 microversion: 2.1 time: 0.166590 Oct 04 19:11:06.883809 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3784/7573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:06 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:07.908263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-498c3113-89a7-4f7d-867d-3f2bf93204f4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:07.908952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-498c3113-89a7-4f7d-867d-3f2bf93204f4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:07.916875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-498c3113-89a7-4f7d-867d-3f2bf93204f4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.917533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-498c3113-89a7-4f7d-867d-3f2bf93204f4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.917987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-498c3113-89a7-4f7d-867d-3f2bf93204f4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.918860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-498c3113-89a7-4f7d-867d-3f2bf93204f4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.919455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-498c3113-89a7-4f7d-867d-3f2bf93204f4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.919930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-498c3113-89a7-4f7d-867d-3f2bf93204f4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:08.077269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-498c3113-89a7-4f7d-867d-3f2bf93204f4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:08.085508 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-498c3113-89a7-4f7d-867d-3f2bf93204f4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1361 microversion: 2.1 time: 0.181202 Oct 04 19:11:08.086095 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3790/7574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:07 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:08.319102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-9f021353-ea10-4eb8-b406-e39b4cad58b4 req-c927f679-fb02-4818-b786-79d1c5d1c6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3d2fb0-5175-45ef-90a8-976a7168b5e3", "name": "network-vif-plugged", "status": "completed", "tag": "8d5d6656-6e8b-4c3c-9a71-4f03bc981433"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:08.330586 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9f021353-ea10-4eb8-b406-e39b4cad58b4 req-c927f679-fb02-4818-b786-79d1c5d1c6f1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:08.331136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9f021353-ea10-4eb8-b406-e39b4cad58b4 req-c927f679-fb02-4818-b786-79d1c5d1c6f1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:08.331594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-9f021353-ea10-4eb8-b406-e39b4cad58b4 req-c927f679-fb02-4818-b786-79d1c5d1c6f1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:08.343132 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-9f021353-ea10-4eb8-b406-e39b4cad58b4 req-c927f679-fb02-4818-b786-79d1c5d1c6f1 service nova] Creating event network-vif-plugged:8d5d6656-6e8b-4c3c-9a71-4f03bc981433 for instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 on n-h2-850499-14 Oct 04 19:11:08.349465 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-9f021353-ea10-4eb8-b406-e39b4cad58b4 req-c927f679-fb02-4818-b786-79d1c5d1c6f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033740 Oct 04 19:11:08.350263 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3785/7575] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:09.109127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-55dcdf5a-4416-4bcd-86f4-6694dffc0f19 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:09.110371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-55dcdf5a-4416-4bcd-86f4-6694dffc0f19 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:09.118486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55dcdf5a-4416-4bcd-86f4-6694dffc0f19 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.118989 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55dcdf5a-4416-4bcd-86f4-6694dffc0f19 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.119446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55dcdf5a-4416-4bcd-86f4-6694dffc0f19 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.120149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55dcdf5a-4416-4bcd-86f4-6694dffc0f19 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.120608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55dcdf5a-4416-4bcd-86f4-6694dffc0f19 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.121036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-55dcdf5a-4416-4bcd-86f4-6694dffc0f19 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.253323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-55dcdf5a-4416-4bcd-86f4-6694dffc0f19 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:09.261394 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-55dcdf5a-4416-4bcd-86f4-6694dffc0f19 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1361 microversion: 2.1 time: 0.156175 Oct 04 19:11:09.261983 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3791/7576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:09 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:10.282536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:10.283389 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:10.287877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f20456dc-ca87-4d35-8ab1-4f3e301d6d3f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:10.288610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f20456dc-ca87-4d35-8ab1-4f3e301d6d3f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:10.295720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20456dc-ca87-4d35-8ab1-4f3e301d6d3f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.296227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20456dc-ca87-4d35-8ab1-4f3e301d6d3f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.296687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20456dc-ca87-4d35-8ab1-4f3e301d6d3f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.297430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20456dc-ca87-4d35-8ab1-4f3e301d6d3f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.297911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20456dc-ca87-4d35-8ab1-4f3e301d6d3f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.298354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20456dc-ca87-4d35-8ab1-4f3e301d6d3f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.434726 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f20456dc-ca87-4d35-8ab1-4f3e301d6d3f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:10.443423 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f20456dc-ca87-4d35-8ab1-4f3e301d6d3f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1553 microversion: 2.1 time: 0.162749 Oct 04 19:11:10.444010 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3786/7577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:10 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:10.466792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a1083bfc-3221-46d6-8482-dcec6fc6e997 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:10.467560 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a1083bfc-3221-46d6-8482-dcec6fc6e997 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:10.469430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:10.475790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1083bfc-3221-46d6-8482-dcec6fc6e997 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.476283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1083bfc-3221-46d6-8482-dcec6fc6e997 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.476726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1083bfc-3221-46d6-8482-dcec6fc6e997 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.477456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1083bfc-3221-46d6-8482-dcec6fc6e997 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.477921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1083bfc-3221-46d6-8482-dcec6fc6e997 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.478349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a1083bfc-3221-46d6-8482-dcec6fc6e997 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.612851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a1083bfc-3221-46d6-8482-dcec6fc6e997 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:10.621662 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a1083bfc-3221-46d6-8482-dcec6fc6e997 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1553 microversion: 2.1 time: 0.159203 Oct 04 19:11:10.622285 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3792/7578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:10 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:12.369378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb3c6b6a-e67f-4fee-a701-d5634ef300c1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42d093c0-c1bf-4db3-957b-9cdd09437f39"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:12.371833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb3c6b6a-e67f-4fee-a701-d5634ef300c1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:12.378942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb3c6b6a-e67f-4fee-a701-d5634ef300c1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:12.379483 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb3c6b6a-e67f-4fee-a701-d5634ef300c1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:12.379934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb3c6b6a-e67f-4fee-a701-d5634ef300c1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:12.380651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb3c6b6a-e67f-4fee-a701-d5634ef300c1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:12.381120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb3c6b6a-e67f-4fee-a701-d5634ef300c1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:12.381561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb3c6b6a-e67f-4fee-a701-d5634ef300c1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:12.655586 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb3c6b6a-e67f-4fee-a701-d5634ef300c1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "POST /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290033 Oct 04 19:11:12.656752 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3787/7579] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 19:11:12 2022] POST /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:23.429323 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f8011a8c-741a-4e4b-8cd6-32fb39630a64 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:23.429962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f8011a8c-741a-4e4b-8cd6-32fb39630a64 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:23.433084 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:23.433913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=36 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:23.441239 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8011a8c-741a-4e4b-8cd6-32fb39630a64 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:23.441743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8011a8c-741a-4e4b-8cd6-32fb39630a64 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:23.442195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8011a8c-741a-4e4b-8cd6-32fb39630a64 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:23.442913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8011a8c-741a-4e4b-8cd6-32fb39630a64 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:23.443414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8011a8c-741a-4e4b-8cd6-32fb39630a64 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:23.443850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f8011a8c-741a-4e4b-8cd6-32fb39630a64 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:23.525024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-f8011a8c-741a-4e4b-8cd6-32fb39630a64 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lazy-loading 'services' on Instance uuid 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:11:23.602751 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f8011a8c-741a-4e4b-8cd6-32fb39630a64 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments/42d093c0-c1bf-4db3-957b-9cdd09437f39" status: 202 len: 0 microversion: 2.1 time: 0.177271 Oct 04 19:11:23.603391 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3793/7580] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 19:11:23 2022] DELETE /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments/42d093c0-c1bf-4db3-957b-9cdd09437f39 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:11:23.612749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b64845ef-a487-4e4f-9fe3-d0b9c7f1b379 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:23.615203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b64845ef-a487-4e4f-9fe3-d0b9c7f1b379 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:23.618240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:23.619158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:23.626546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64845ef-a487-4e4f-9fe3-d0b9c7f1b379 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:23.627099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64845ef-a487-4e4f-9fe3-d0b9c7f1b379 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:23.627556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64845ef-a487-4e4f-9fe3-d0b9c7f1b379 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:23.628311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64845ef-a487-4e4f-9fe3-d0b9c7f1b379 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:23.628782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64845ef-a487-4e4f-9fe3-d0b9c7f1b379 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:23.629223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b64845ef-a487-4e4f-9fe3-d0b9c7f1b379 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:23.662079 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b64845ef-a487-4e4f-9fe3-d0b9c7f1b379 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053703 Oct 04 19:11:23.662648 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3788/7581] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:11:23 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:24.676702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fc6fd95d-628c-4c16-a55f-ef61cdc0d488 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:24.679480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fc6fd95d-628c-4c16-a55f-ef61cdc0d488 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:24.686191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc6fd95d-628c-4c16-a55f-ef61cdc0d488 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:24.686727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc6fd95d-628c-4c16-a55f-ef61cdc0d488 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:24.687247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc6fd95d-628c-4c16-a55f-ef61cdc0d488 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:24.688111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc6fd95d-628c-4c16-a55f-ef61cdc0d488 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:24.688498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc6fd95d-628c-4c16-a55f-ef61cdc0d488 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:24.688933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fc6fd95d-628c-4c16-a55f-ef61cdc0d488 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:24.721708 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fc6fd95d-628c-4c16-a55f-ef61cdc0d488 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051198 Oct 04 19:11:24.722286 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3794/7582] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:11:24 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:25.734296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-abcf4c87-59d2-4765-83ed-c03efc553e37 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:25.736438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-abcf4c87-59d2-4765-83ed-c03efc553e37 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:25.743079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf4c87-59d2-4765-83ed-c03efc553e37 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:25.743589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf4c87-59d2-4765-83ed-c03efc553e37 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:25.744046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf4c87-59d2-4765-83ed-c03efc553e37 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:25.744763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf4c87-59d2-4765-83ed-c03efc553e37 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:25.745232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf4c87-59d2-4765-83ed-c03efc553e37 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:25.745672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-abcf4c87-59d2-4765-83ed-c03efc553e37 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:25.777906 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-abcf4c87-59d2-4765-83ed-c03efc553e37 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047876 Oct 04 19:11:25.778486 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3789/7583] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:11:25 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:26.795178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8542a2de-00a3-430c-a601-1017b16a3c71 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:26.799796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8542a2de-00a3-430c-a601-1017b16a3c71 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:26.811110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542a2de-00a3-430c-a601-1017b16a3c71 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:26.811942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542a2de-00a3-430c-a601-1017b16a3c71 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:26.812695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542a2de-00a3-430c-a601-1017b16a3c71 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:26.813894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542a2de-00a3-430c-a601-1017b16a3c71 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:26.814699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542a2de-00a3-430c-a601-1017b16a3c71 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:26.815460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8542a2de-00a3-430c-a601-1017b16a3c71 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:26.866350 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8542a2de-00a3-430c-a601-1017b16a3c71 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078470 Oct 04 19:11:26.867375 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3795/7584] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:11:26 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:27.878414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8f4bb31f-0ac2-44c0-a20e-e44537bfe734 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:27.880683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8f4bb31f-0ac2-44c0-a20e-e44537bfe734 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:27.887906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f4bb31f-0ac2-44c0-a20e-e44537bfe734 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:27.888414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f4bb31f-0ac2-44c0-a20e-e44537bfe734 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:27.888871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f4bb31f-0ac2-44c0-a20e-e44537bfe734 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:27.889597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f4bb31f-0ac2-44c0-a20e-e44537bfe734 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:27.890571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f4bb31f-0ac2-44c0-a20e-e44537bfe734 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:27.891054 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8f4bb31f-0ac2-44c0-a20e-e44537bfe734 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:27.924153 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8f4bb31f-0ac2-44c0-a20e-e44537bfe734 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049484 Oct 04 19:11:27.924815 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3790/7585] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:11:27 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:28.935744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49fff740-185b-4cd9-9562-bfc32beefbb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:28.937908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-49fff740-185b-4cd9-9562-bfc32beefbb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:28.945519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49fff740-185b-4cd9-9562-bfc32beefbb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:28.946009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49fff740-185b-4cd9-9562-bfc32beefbb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:28.946443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49fff740-185b-4cd9-9562-bfc32beefbb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:28.947192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49fff740-185b-4cd9-9562-bfc32beefbb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:28.947634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49fff740-185b-4cd9-9562-bfc32beefbb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:28.948061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49fff740-185b-4cd9-9562-bfc32beefbb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:28.977715 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49fff740-185b-4cd9-9562-bfc32beefbb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045838 Oct 04 19:11:28.978291 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3796/7586] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:11:28 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:11:28.990120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:28.990698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:28.997670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:28.998192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:28.998660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:29.000109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:29.000616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:29.001104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:29.088329 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] HTTP exception thrown: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 is not attached to volume 42d093c0-c1bf-4db3-957b-9cdd09437f39 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Request method failure captured: Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments/42d093c0-c1bf-4db3-957b-9cdd09437f39 HTTP/1.1 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIU9V1cZZqliH-NRpUd7tu7-0t7uboY2uCAFTly3X1by9sIk2I5Ek7v14tK4p-r1iaBF5fHBNmnnnCi_aNC3ExUKnK04-ImeTM50_dHVF_sEgv_gE1F6keV2mPkbYi2hZW08OcTu9dyDXR_0F5gqwl9k_az5enUi0WgkqUVYF0boA4E Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}] Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: f06df58bf04f41ab945925996c54cd47 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 is not attached to volume 42d093c0-c1bf-4db3-957b-9cdd09437f39 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'server_id': '1d3d2fb0-5175-45ef-90a8-976a7168b5e3', 'id': '42d093c0-c1bf-4db3-957b-9cdd09437f39'} Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 42d093c0-c1bf-4db3-957b-9cdd09437f39. Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 is not attached to volume 42d093c0-c1bf-4db3-957b-9cdd09437f39 Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:29.102400 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:29.107115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:29.107115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:29.107115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 is not attached to volume 42d093c0-c1bf-4db3-957b-9cdd09437f39 Oct 04 19:11:29.107115 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:11:29.107115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Returning 404 to user: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 is not attached to volume 42d093c0-c1bf-4db3-957b-9cdd09437f39 {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:29.107115 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ee462f61-0f04-4071-ab13-f2008ea0e434 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments/42d093c0-c1bf-4db3-957b-9cdd09437f39" status: 404 len: 154 microversion: 2.1 time: 0.117706 Oct 04 19:11:29.107115 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3791/7587] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 19:11:28 2022] DELETE /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3/os-volume_attachments/42d093c0-c1bf-4db3-957b-9cdd09437f39 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:11:32.483199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-19f75cf0-b70a-4ec2-9830-cadc6121c3f1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:32.485552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-19f75cf0-b70a-4ec2-9830-cadc6121c3f1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:32.493662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f75cf0-b70a-4ec2-9830-cadc6121c3f1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:32.494153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f75cf0-b70a-4ec2-9830-cadc6121c3f1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:32.494603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f75cf0-b70a-4ec2-9830-cadc6121c3f1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:32.498691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f75cf0-b70a-4ec2-9830-cadc6121c3f1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:32.498691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f75cf0-b70a-4ec2-9830-cadc6121c3f1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:32.498691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f75cf0-b70a-4ec2-9830-cadc6121c3f1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:32.525759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-19f75cf0-b70a-4ec2-9830-cadc6121c3f1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:11:32.632300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-19f75cf0-b70a-4ec2-9830-cadc6121c3f1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 204 len: 0 microversion: 2.1 time: 0.153747 Oct 04 19:11:32.632913 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3797/7588] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:11:32 2022] DELETE /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:11:32.644230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39cc3bd8-b45f-448a-acff-c6aee63d3ae8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:32.645132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39cc3bd8-b45f-448a-acff-c6aee63d3ae8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:32.660501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39cc3bd8-b45f-448a-acff-c6aee63d3ae8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:32.661366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39cc3bd8-b45f-448a-acff-c6aee63d3ae8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:32.662135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39cc3bd8-b45f-448a-acff-c6aee63d3ae8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:32.662873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39cc3bd8-b45f-448a-acff-c6aee63d3ae8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:32.663388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39cc3bd8-b45f-448a-acff-c6aee63d3ae8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:32.663845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39cc3bd8-b45f-448a-acff-c6aee63d3ae8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:32.821284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-39cc3bd8-b45f-448a-acff-c6aee63d3ae8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:32.830484 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39cc3bd8-b45f-448a-acff-c6aee63d3ae8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1559 microversion: 2.1 time: 0.191379 Oct 04 19:11:32.831107 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3792/7589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:32 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:33.854341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a5223cf7-2673-423e-b554-b8efc8a92f34 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:33.855176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a5223cf7-2673-423e-b554-b8efc8a92f34 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:33.862758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5223cf7-2673-423e-b554-b8efc8a92f34 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:33.863283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5223cf7-2673-423e-b554-b8efc8a92f34 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:33.863725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5223cf7-2673-423e-b554-b8efc8a92f34 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:33.864428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5223cf7-2673-423e-b554-b8efc8a92f34 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:33.864880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5223cf7-2673-423e-b554-b8efc8a92f34 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:33.865303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a5223cf7-2673-423e-b554-b8efc8a92f34 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:34.004725 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a5223cf7-2673-423e-b554-b8efc8a92f34 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:34.012718 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a5223cf7-2673-423e-b554-b8efc8a92f34 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1559 microversion: 2.1 time: 0.162733 Oct 04 19:11:34.013306 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3798/7590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:33 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:35.036323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c714126-e4b6-4e13-96cd-79bf8892b296 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:35.036991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2c714126-e4b6-4e13-96cd-79bf8892b296 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:35.044213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c714126-e4b6-4e13-96cd-79bf8892b296 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:35.044732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c714126-e4b6-4e13-96cd-79bf8892b296 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:35.045203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c714126-e4b6-4e13-96cd-79bf8892b296 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:35.045938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c714126-e4b6-4e13-96cd-79bf8892b296 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:35.046430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c714126-e4b6-4e13-96cd-79bf8892b296 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:35.046888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c714126-e4b6-4e13-96cd-79bf8892b296 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:35.189491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2c714126-e4b6-4e13-96cd-79bf8892b296 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:35.198301 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c714126-e4b6-4e13-96cd-79bf8892b296 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 200 len: 1559 microversion: 2.1 time: 0.166048 Oct 04 19:11:35.198886 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3793/7591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:35 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:11:35.285643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-48c6c706-ebd1-459a-a474-925a478e405d req-5b96193e-8660-4147-9e42-965532d7810d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3d2fb0-5175-45ef-90a8-976a7168b5e3", "name": "network-vif-deleted", "tag": "8d5d6656-6e8b-4c3c-9a71-4f03bc981433"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:35.299234 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-48c6c706-ebd1-459a-a474-925a478e405d req-5b96193e-8660-4147-9e42-965532d7810d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:35.299721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-48c6c706-ebd1-459a-a474-925a478e405d req-5b96193e-8660-4147-9e42-965532d7810d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:35.300152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-48c6c706-ebd1-459a-a474-925a478e405d req-5b96193e-8660-4147-9e42-965532d7810d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:35.316570 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-48c6c706-ebd1-459a-a474-925a478e405d req-5b96193e-8660-4147-9e42-965532d7810d service nova] Creating event network-vif-deleted:8d5d6656-6e8b-4c3c-9a71-4f03bc981433 for instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 on n-h2-850499-14 Oct 04 19:11:35.322017 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-48c6c706-ebd1-459a-a474-925a478e405d req-5b96193e-8660-4147-9e42-965532d7810d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043573 Oct 04 19:11:35.322626 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3799/7592] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:36.225028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:36.225892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 1d3d2fb0-5175-45ef-90a8-976a7168b5e3] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:36.233186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:36.233681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:36.234143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:36.234872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:36.235379 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:36.235831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:36.249951 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] HTTP exception thrown: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 could not be found. Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Request method failure captured: Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 HTTP/1.1 Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIU9V1cZZqliH-NRpUd7tu7-0t7uboY2uCAFTly3X1by9sIk2I5Ek7v14tK4p-r1iaBF5fHBNmnnnCi_aNC3ExUKnK04-ImeTM50_dHVF_sEgv_gE1F6keV2mPkbYi2hZW08OcTu9dyDXR_0F5gqwl9k_az5enUi0WgkqUVYF0boA4E Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}] Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: f06df58bf04f41ab945925996c54cd47 Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 could not be found. Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '1d3d2fb0-5175-45ef-90a8-976a7168b5e3'} Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 could not be found. Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 could not be found. Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:11:36.251750 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 could not be found. Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Returning 404 to user: Instance 1d3d2fb0-5175-45ef-90a8-976a7168b5e3 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-854185db-57a7-4753-a3a8-203be6dcbda8 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3" status: 404 len: 111 microversion: 2.1 time: 0.032284 Oct 04 19:11:36.256465 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3794/7593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:36 2022] GET /compute/v2.1/servers/1d3d2fb0-5175-45ef-90a8-976a7168b5e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:11:36.262931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6951d836-ed1f-4712-af19-a89315a13b55 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '.version_select at 0x7fd4d0a13160>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:36.283719 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6951d836-ed1f-4712-af19-a89315a13b55 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-426297636" status: 202 len: 0 microversion: 2.1 time: 0.025043 Oct 04 19:11:36.284295 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3800/7594] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 19:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-426297636 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:11:36.300401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-866d976b-91f8-45f3-a392-f2c5aff70543 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Action: 'create', calling method: .version_select at 0x7fd4d013ab80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2145411459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLBBQTNKj4CYyEBd/OW22WzXdeV2XUD2E68qHqTVGpKXH2YR0DY0wGzsEaQU6lkewTVdqGkVL/pI5De5hv0NNmPGloKg56svWwFHKBq6hFhKsoKCCBN/YO221O/mK8TPg=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:36.316076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-866d976b-91f8-45f3-a392-f2c5aff70543 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:11:36.321558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-866d976b-91f8-45f3-a392-f2c5aff70543 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for user f06df58bf04f41ab945925996c54cd47 and project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:11:36.336001 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [None req-866d976b-91f8-45f3-a392-f2c5aff70543 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [d9f288b1-1977-47eb-9b11-91ff29205328] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:11:37.343736 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [None req-866d976b-91f8-45f3-a392-f2c5aff70543 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [d9f288b1-1977-47eb-9b11-91ff29205328] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48268. Oct 04 19:11:37.360334 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-866d976b-91f8-45f3-a392-f2c5aff70543 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.064030 Oct 04 19:11:37.361149 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3795/7595] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:11:36 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:37.412876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1336848198", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2145411459", "networks": [{"uuid": "b7f97b6b-54a4-449d-93cc-9364398fc55a"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:37.466310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] validate_networks() for [('b7f97b6b-54a4-449d-93cc-9364398fc55a', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:11:37.840727 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:11:37.841156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:11:37.841642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:11:37.842058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:11:37.842475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:11:37.852000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:37.852427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:37.852868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:37.853607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:37.854064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:37.854496 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:37.873695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:11:37.879102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for user f06df58bf04f41ab945925996c54cd47 and project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:11:37.895958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:11:37.902067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:11:37.947989 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5fe22b1c-0f51-4d50-a7b3-c091f6c165cb tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539896 Oct 04 19:11:37.948640 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3801/7596] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:11:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:11:37.960724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b7645811-2280-40e2-894d-4475e88f8ad5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:37.961368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b7645811-2280-40e2-894d-4475e88f8ad5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:38.018797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b7645811-2280-40e2-894d-4475e88f8ad5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:38.025762 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b7645811-2280-40e2-894d-4475e88f8ad5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1263 microversion: 2.1 time: 0.069004 Oct 04 19:11:38.026328 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3796/7597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:37 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:39.050220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ce468a5-003f-43a0-aa30-3500bab21e65 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:39.050837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ce468a5-003f-43a0-aa30-3500bab21e65 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:39.059735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ce468a5-003f-43a0-aa30-3500bab21e65 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:39.060350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ce468a5-003f-43a0-aa30-3500bab21e65 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:39.061122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ce468a5-003f-43a0-aa30-3500bab21e65 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:39.061922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ce468a5-003f-43a0-aa30-3500bab21e65 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:39.062601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ce468a5-003f-43a0-aa30-3500bab21e65 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:39.063244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ce468a5-003f-43a0-aa30-3500bab21e65 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:39.130783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ce468a5-003f-43a0-aa30-3500bab21e65 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:39.140294 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ce468a5-003f-43a0-aa30-3500bab21e65 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1323 microversion: 2.1 time: 0.094998 Oct 04 19:11:39.140879 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3802/7598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:39 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1323 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:40.170532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-be33783a-f2eb-43ad-8980-51df6c8f95c4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:40.172506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-be33783a-f2eb-43ad-8980-51df6c8f95c4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:40.185321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be33783a-f2eb-43ad-8980-51df6c8f95c4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:40.186238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be33783a-f2eb-43ad-8980-51df6c8f95c4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:40.187669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be33783a-f2eb-43ad-8980-51df6c8f95c4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:40.188927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be33783a-f2eb-43ad-8980-51df6c8f95c4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:40.189870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be33783a-f2eb-43ad-8980-51df6c8f95c4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:40.190664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-be33783a-f2eb-43ad-8980-51df6c8f95c4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:40.362664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-be33783a-f2eb-43ad-8980-51df6c8f95c4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:40.371156 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-be33783a-f2eb-43ad-8980-51df6c8f95c4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1363 microversion: 2.1 time: 0.207999 Oct 04 19:11:40.372003 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3797/7599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:40 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:40.502776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-4e61ee36-6577-41ef-97fb-341ee733f628 req-500ad895-2cf4-47ae-bb4b-f753e9d1c6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a75191d-a644-4094-8001-1229931b8b33", "tag": "1bcc065b-7440-4130-9009-1eb84bb8797f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:40.513542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4e61ee36-6577-41ef-97fb-341ee733f628 req-500ad895-2cf4-47ae-bb4b-f753e9d1c6ff service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:40.514032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4e61ee36-6577-41ef-97fb-341ee733f628 req-500ad895-2cf4-47ae-bb4b-f753e9d1c6ff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:40.514542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4e61ee36-6577-41ef-97fb-341ee733f628 req-500ad895-2cf4-47ae-bb4b-f753e9d1c6ff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:40.526218 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-4e61ee36-6577-41ef-97fb-341ee733f628 req-500ad895-2cf4-47ae-bb4b-f753e9d1c6ff service nova] Creating event network-changed:1bcc065b-7440-4130-9009-1eb84bb8797f for instance 5a75191d-a644-4094-8001-1229931b8b33 on n-h2-850499-14 Oct 04 19:11:40.531448 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-4e61ee36-6577-41ef-97fb-341ee733f628 req-500ad895-2cf4-47ae-bb4b-f753e9d1c6ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032424 Oct 04 19:11:40.532235 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3803/7600] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:41.394024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-01065251-b646-48a2-bc24-5c7533e36907 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:41.394757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-01065251-b646-48a2-bc24-5c7533e36907 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:41.402007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01065251-b646-48a2-bc24-5c7533e36907 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:41.402531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01065251-b646-48a2-bc24-5c7533e36907 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:41.403023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01065251-b646-48a2-bc24-5c7533e36907 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:41.403783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01065251-b646-48a2-bc24-5c7533e36907 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:41.404267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01065251-b646-48a2-bc24-5c7533e36907 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:41.404730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-01065251-b646-48a2-bc24-5c7533e36907 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:41.544155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-01065251-b646-48a2-bc24-5c7533e36907 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:41.552762 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-01065251-b646-48a2-bc24-5c7533e36907 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1363 microversion: 2.1 time: 0.162770 Oct 04 19:11:41.553373 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3798/7601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:41 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:42.578398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1df2a44-4a28-4d97-ba50-7a9e8e0619c5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:42.579126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1df2a44-4a28-4d97-ba50-7a9e8e0619c5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:42.585304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1df2a44-4a28-4d97-ba50-7a9e8e0619c5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:42.585797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1df2a44-4a28-4d97-ba50-7a9e8e0619c5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:42.586238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1df2a44-4a28-4d97-ba50-7a9e8e0619c5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:42.586933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1df2a44-4a28-4d97-ba50-7a9e8e0619c5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:42.587417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1df2a44-4a28-4d97-ba50-7a9e8e0619c5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:42.587850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1df2a44-4a28-4d97-ba50-7a9e8e0619c5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:42.718352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1df2a44-4a28-4d97-ba50-7a9e8e0619c5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:42.725935 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1df2a44-4a28-4d97-ba50-7a9e8e0619c5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1363 microversion: 2.1 time: 0.153150 Oct 04 19:11:42.726507 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3804/7602] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:42 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:43.750761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f574c7cd-acfb-46f1-809a-c56efc3b380a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:43.752133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f574c7cd-acfb-46f1-809a-c56efc3b380a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:43.759055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f574c7cd-acfb-46f1-809a-c56efc3b380a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:43.759574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f574c7cd-acfb-46f1-809a-c56efc3b380a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:43.760042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f574c7cd-acfb-46f1-809a-c56efc3b380a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:43.760765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f574c7cd-acfb-46f1-809a-c56efc3b380a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:43.761249 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f574c7cd-acfb-46f1-809a-c56efc3b380a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:43.761702 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f574c7cd-acfb-46f1-809a-c56efc3b380a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:43.897996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f574c7cd-acfb-46f1-809a-c56efc3b380a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:43.905820 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f574c7cd-acfb-46f1-809a-c56efc3b380a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1363 microversion: 2.1 time: 0.160045 Oct 04 19:11:43.906409 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3799/7603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:43 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:44.929737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-967cf1b1-cf3e-4640-ad3f-14029c59ffa3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:44.930347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-967cf1b1-cf3e-4640-ad3f-14029c59ffa3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:44.937253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-967cf1b1-cf3e-4640-ad3f-14029c59ffa3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:44.937733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-967cf1b1-cf3e-4640-ad3f-14029c59ffa3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:44.938170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-967cf1b1-cf3e-4640-ad3f-14029c59ffa3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:44.938858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-967cf1b1-cf3e-4640-ad3f-14029c59ffa3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:44.939340 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-967cf1b1-cf3e-4640-ad3f-14029c59ffa3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:44.939764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-967cf1b1-cf3e-4640-ad3f-14029c59ffa3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:45.070513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-967cf1b1-cf3e-4640-ad3f-14029c59ffa3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:45.078144 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-967cf1b1-cf3e-4640-ad3f-14029c59ffa3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1363 microversion: 2.1 time: 0.152297 Oct 04 19:11:45.078719 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3805/7604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:44 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:46.101840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ee3f538c-dc74-4886-8bd1-299b0fc97c6e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:46.102476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ee3f538c-dc74-4886-8bd1-299b0fc97c6e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:46.109974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee3f538c-dc74-4886-8bd1-299b0fc97c6e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:46.110481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee3f538c-dc74-4886-8bd1-299b0fc97c6e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:46.110940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee3f538c-dc74-4886-8bd1-299b0fc97c6e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:46.111830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee3f538c-dc74-4886-8bd1-299b0fc97c6e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:46.112334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee3f538c-dc74-4886-8bd1-299b0fc97c6e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:46.112783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ee3f538c-dc74-4886-8bd1-299b0fc97c6e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:46.240269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ee3f538c-dc74-4886-8bd1-299b0fc97c6e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:46.247984 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ee3f538c-dc74-4886-8bd1-299b0fc97c6e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1363 microversion: 2.1 time: 0.150113 Oct 04 19:11:46.248586 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3800/7605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:46 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:47.272071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3d3f2ba6-fe96-4072-ae37-84295703e035 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:47.272715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3d3f2ba6-fe96-4072-ae37-84295703e035 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:47.279954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3f2ba6-fe96-4072-ae37-84295703e035 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:47.280449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3f2ba6-fe96-4072-ae37-84295703e035 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:47.280895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3f2ba6-fe96-4072-ae37-84295703e035 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:47.281596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3f2ba6-fe96-4072-ae37-84295703e035 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:47.282062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3f2ba6-fe96-4072-ae37-84295703e035 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:47.282500 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3d3f2ba6-fe96-4072-ae37-84295703e035 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:47.419346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3d3f2ba6-fe96-4072-ae37-84295703e035 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:47.429591 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3d3f2ba6-fe96-4072-ae37-84295703e035 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1363 microversion: 2.1 time: 0.161406 Oct 04 19:11:47.430381 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3806/7606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:47 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:48.448301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-863da76c-9703-4a24-ac10-65f5ba856915 req-be22c2b0-8c5e-4ba9-b61c-91996dca4e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a75191d-a644-4094-8001-1229931b8b33", "name": "network-vif-plugged", "status": "completed", "tag": "1bcc065b-7440-4130-9009-1eb84bb8797f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:48.454212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4038ff12-be16-40db-a556-00090418cf30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:48.455200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4038ff12-be16-40db-a556-00090418cf30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:48.455331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:48.457322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:48.458001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:48.464587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-863da76c-9703-4a24-ac10-65f5ba856915 req-be22c2b0-8c5e-4ba9-b61c-91996dca4e35 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:48.465141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-863da76c-9703-4a24-ac10-65f5ba856915 req-be22c2b0-8c5e-4ba9-b61c-91996dca4e35 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:48.465706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-863da76c-9703-4a24-ac10-65f5ba856915 req-be22c2b0-8c5e-4ba9-b61c-91996dca4e35 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:48.465825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4038ff12-be16-40db-a556-00090418cf30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:48.466401 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4038ff12-be16-40db-a556-00090418cf30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:48.466844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4038ff12-be16-40db-a556-00090418cf30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:48.468171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4038ff12-be16-40db-a556-00090418cf30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:48.468630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4038ff12-be16-40db-a556-00090418cf30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:48.469057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4038ff12-be16-40db-a556-00090418cf30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:48.478858 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-863da76c-9703-4a24-ac10-65f5ba856915 req-be22c2b0-8c5e-4ba9-b61c-91996dca4e35 service nova] Creating event network-vif-plugged:1bcc065b-7440-4130-9009-1eb84bb8797f for instance 5a75191d-a644-4094-8001-1229931b8b33 on n-h2-850499-14 Oct 04 19:11:48.485437 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-863da76c-9703-4a24-ac10-65f5ba856915 req-be22c2b0-8c5e-4ba9-b61c-91996dca4e35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040339 Oct 04 19:11:48.486066 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3801/7607] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:11:48.606327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4038ff12-be16-40db-a556-00090418cf30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:48.614375 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4038ff12-be16-40db-a556-00090418cf30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1363 microversion: 2.1 time: 0.164793 Oct 04 19:11:48.614981 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3807/7608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:48 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:11:49.638269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d5b3d8a-ea8f-4729-b020-47599aba840a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:49.639870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d5b3d8a-ea8f-4729-b020-47599aba840a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:49.646868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5b3d8a-ea8f-4729-b020-47599aba840a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:49.647401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5b3d8a-ea8f-4729-b020-47599aba840a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:49.647855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5b3d8a-ea8f-4729-b020-47599aba840a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:49.648558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5b3d8a-ea8f-4729-b020-47599aba840a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:49.649029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5b3d8a-ea8f-4729-b020-47599aba840a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:49.649472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5b3d8a-ea8f-4729-b020-47599aba840a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:49.783729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1d5b3d8a-ea8f-4729-b020-47599aba840a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:49.791531 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d5b3d8a-ea8f-4729-b020-47599aba840a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1363 microversion: 2.1 time: 0.157569 Oct 04 19:11:49.792104 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3802/7609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:49 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:50.814904 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f05941a-d673-4f6a-9245-954c6bc7126a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:50.815542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f05941a-d673-4f6a-9245-954c6bc7126a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:50.822381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f05941a-d673-4f6a-9245-954c6bc7126a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:50.822871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f05941a-d673-4f6a-9245-954c6bc7126a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:50.823342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f05941a-d673-4f6a-9245-954c6bc7126a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:50.824035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f05941a-d673-4f6a-9245-954c6bc7126a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:50.824494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f05941a-d673-4f6a-9245-954c6bc7126a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:50.824924 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f05941a-d673-4f6a-9245-954c6bc7126a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:50.954237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1f05941a-d673-4f6a-9245-954c6bc7126a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:50.961979 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f05941a-d673-4f6a-9245-954c6bc7126a tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1555 microversion: 2.1 time: 0.151067 Oct 04 19:11:50.962545 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3808/7610] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:50 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:50.985457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4089ecc6-e9af-4e6f-8d52-0f4219a1eef7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:50.986092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4089ecc6-e9af-4e6f-8d52-0f4219a1eef7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:50.992959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4089ecc6-e9af-4e6f-8d52-0f4219a1eef7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:50.993472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4089ecc6-e9af-4e6f-8d52-0f4219a1eef7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:50.993939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4089ecc6-e9af-4e6f-8d52-0f4219a1eef7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:50.994661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4089ecc6-e9af-4e6f-8d52-0f4219a1eef7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:50.995181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4089ecc6-e9af-4e6f-8d52-0f4219a1eef7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:50.995632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4089ecc6-e9af-4e6f-8d52-0f4219a1eef7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:51.125246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4089ecc6-e9af-4e6f-8d52-0f4219a1eef7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:51.133143 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4089ecc6-e9af-4e6f-8d52-0f4219a1eef7 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1555 microversion: 2.1 time: 0.152191 Oct 04 19:11:51.133710 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3803/7611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:50 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:52.651607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2959a390-9dcb-449e-9d73-7ef77a418bbc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29261c48-2528-470b-b55b-394201187d2a"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:52.654050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2959a390-9dcb-449e-9d73-7ef77a418bbc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:52.661685 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2959a390-9dcb-449e-9d73-7ef77a418bbc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:52.662174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2959a390-9dcb-449e-9d73-7ef77a418bbc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:52.663130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2959a390-9dcb-449e-9d73-7ef77a418bbc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:52.663975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2959a390-9dcb-449e-9d73-7ef77a418bbc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:52.664441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2959a390-9dcb-449e-9d73-7ef77a418bbc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:52.664888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2959a390-9dcb-449e-9d73-7ef77a418bbc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:52.815169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:52.937136 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2959a390-9dcb-449e-9d73-7ef77a418bbc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "POST /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289270 Oct 04 19:11:52.937811 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3809/7612] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 19:11:52 2022] POST /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:03.668401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3256aa0b-6d4a-4e27-b037-c73c35334e38 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:03.668922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3256aa0b-6d4a-4e27-b037-c73c35334e38 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:03.671142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:03.671840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=76 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:03.678196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3256aa0b-6d4a-4e27-b037-c73c35334e38 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:03.678714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3256aa0b-6d4a-4e27-b037-c73c35334e38 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:03.679201 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3256aa0b-6d4a-4e27-b037-c73c35334e38 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:03.679928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3256aa0b-6d4a-4e27-b037-c73c35334e38 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:03.680412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3256aa0b-6d4a-4e27-b037-c73c35334e38 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:03.680856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3256aa0b-6d4a-4e27-b037-c73c35334e38 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:03.762472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-3256aa0b-6d4a-4e27-b037-c73c35334e38 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lazy-loading 'services' on Instance uuid 5a75191d-a644-4094-8001-1229931b8b33 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:12:03.833136 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3256aa0b-6d4a-4e27-b037-c73c35334e38 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments/29261c48-2528-470b-b55b-394201187d2a" status: 202 len: 0 microversion: 2.1 time: 0.168865 Oct 04 19:12:03.833754 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3804/7613] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 19:12:03 2022] DELETE /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments/29261c48-2528-470b-b55b-394201187d2a => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:12:03.840483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:03.841263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:03.845886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a16f7601-a02c-4c7a-871b-e893826e9666 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:03.848361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a16f7601-a02c-4c7a-871b-e893826e9666 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:03.856995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a16f7601-a02c-4c7a-871b-e893826e9666 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:03.857494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a16f7601-a02c-4c7a-871b-e893826e9666 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:03.857936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a16f7601-a02c-4c7a-871b-e893826e9666 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:03.858644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a16f7601-a02c-4c7a-871b-e893826e9666 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:03.859135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a16f7601-a02c-4c7a-871b-e893826e9666 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:03.859567 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a16f7601-a02c-4c7a-871b-e893826e9666 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:03.893981 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a16f7601-a02c-4c7a-871b-e893826e9666 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055504 Oct 04 19:12:03.894464 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3810/7614] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:03 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:04.908965 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a4709c12-7a00-4c1d-a8e0-d2bad20ee858 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:04.911267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a4709c12-7a00-4c1d-a8e0-d2bad20ee858 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:04.917650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4709c12-7a00-4c1d-a8e0-d2bad20ee858 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:04.918155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4709c12-7a00-4c1d-a8e0-d2bad20ee858 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:04.918612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4709c12-7a00-4c1d-a8e0-d2bad20ee858 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:04.919352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4709c12-7a00-4c1d-a8e0-d2bad20ee858 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:04.919823 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4709c12-7a00-4c1d-a8e0-d2bad20ee858 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:04.920294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4709c12-7a00-4c1d-a8e0-d2bad20ee858 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:04.955049 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a4709c12-7a00-4c1d-a8e0-d2bad20ee858 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052024 Oct 04 19:12:04.955633 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3805/7615] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:04 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:05.968122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a411ce23-9ca2-45d6-ae0f-8554bd46c134 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:05.970264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a411ce23-9ca2-45d6-ae0f-8554bd46c134 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:05.977046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a411ce23-9ca2-45d6-ae0f-8554bd46c134 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:05.977536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a411ce23-9ca2-45d6-ae0f-8554bd46c134 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:05.977975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a411ce23-9ca2-45d6-ae0f-8554bd46c134 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:05.978772 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a411ce23-9ca2-45d6-ae0f-8554bd46c134 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:05.979247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a411ce23-9ca2-45d6-ae0f-8554bd46c134 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:05.979671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a411ce23-9ca2-45d6-ae0f-8554bd46c134 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:06.013105 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a411ce23-9ca2-45d6-ae0f-8554bd46c134 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049046 Oct 04 19:12:06.013765 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3811/7616] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:05 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:07.026941 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c5729f00-a6f1-402c-bd43-c82f242fcfae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:07.029209 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c5729f00-a6f1-402c-bd43-c82f242fcfae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:07.037040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5729f00-a6f1-402c-bd43-c82f242fcfae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:07.037552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5729f00-a6f1-402c-bd43-c82f242fcfae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:07.038016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5729f00-a6f1-402c-bd43-c82f242fcfae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:07.038749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5729f00-a6f1-402c-bd43-c82f242fcfae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:07.039267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5729f00-a6f1-402c-bd43-c82f242fcfae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:07.039722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c5729f00-a6f1-402c-bd43-c82f242fcfae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:07.070039 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c5729f00-a6f1-402c-bd43-c82f242fcfae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Oct 04 19:12:07.071018 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3806/7617] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:07 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:08.082039 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79e8fceb-1379-40d6-bb80-e3a03e480055 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:08.084248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-79e8fceb-1379-40d6-bb80-e3a03e480055 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:08.091081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e8fceb-1379-40d6-bb80-e3a03e480055 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:08.091573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e8fceb-1379-40d6-bb80-e3a03e480055 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:08.092015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e8fceb-1379-40d6-bb80-e3a03e480055 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:08.092714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e8fceb-1379-40d6-bb80-e3a03e480055 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:08.093170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e8fceb-1379-40d6-bb80-e3a03e480055 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:08.093599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79e8fceb-1379-40d6-bb80-e3a03e480055 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:08.124381 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-79e8fceb-1379-40d6-bb80-e3a03e480055 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046468 Oct 04 19:12:08.124955 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3812/7618] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:08 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:09.137416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-67b57ff9-d0be-4811-8006-fda08225ddb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:09.139686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-67b57ff9-d0be-4811-8006-fda08225ddb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:09.146660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67b57ff9-d0be-4811-8006-fda08225ddb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:09.147212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67b57ff9-d0be-4811-8006-fda08225ddb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:09.147679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67b57ff9-d0be-4811-8006-fda08225ddb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:09.148407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67b57ff9-d0be-4811-8006-fda08225ddb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:09.148889 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67b57ff9-d0be-4811-8006-fda08225ddb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:09.149342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-67b57ff9-d0be-4811-8006-fda08225ddb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:09.180474 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-67b57ff9-d0be-4811-8006-fda08225ddb2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047076 Oct 04 19:12:09.181066 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3807/7619] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:09 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:12:09.192669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:09.193191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:09.200091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:09.200587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:09.201032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:09.201736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:09.202200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:09.202633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:09.278765 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] HTTP exception thrown: Instance 5a75191d-a644-4094-8001-1229931b8b33 is not attached to volume 29261c48-2528-470b-b55b-394201187d2a Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Request method failure captured: Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments/29261c48-2528-470b-b55b-394201187d2a HTTP/1.1 Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIU9V1cZZqliH-NRpUd7tu7-0t7uboY2uCAFTly3X1by9sIk2I5Ek7v14tK4p-r1iaBF5fHBNmnnnCi_aNC3ExUKnK04-ImeTM50_dHVF_sEgv_gE1F6keV2mPkbYi2hZW08OcTu9dyDXR_0F5gqwl9k_az5enUi0WgkqUVYF0boA4E Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}] Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: f06df58bf04f41ab945925996c54cd47 Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 5a75191d-a644-4094-8001-1229931b8b33 is not attached to volume 29261c48-2528-470b-b55b-394201187d2a Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'server_id': '5a75191d-a644-4094-8001-1229931b8b33', 'id': '29261c48-2528-470b-b55b-394201187d2a'} Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 29261c48-2528-470b-b55b-394201187d2a. Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a75191d-a644-4094-8001-1229931b8b33 is not attached to volume 29261c48-2528-470b-b55b-394201187d2a Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:09.280726 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:09.285838 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:12:09.285838 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:12:09.285838 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a75191d-a644-4094-8001-1229931b8b33 is not attached to volume 29261c48-2528-470b-b55b-394201187d2a Oct 04 19:12:09.285838 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:09.285838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Returning 404 to user: Instance 5a75191d-a644-4094-8001-1229931b8b33 is not attached to volume 29261c48-2528-470b-b55b-394201187d2a {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:12:09.285838 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1a76173d-60a9-4e8a-ae97-0cd1dd1e0bfc tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments/29261c48-2528-470b-b55b-394201187d2a" status: 404 len: 154 microversion: 2.1 time: 0.094207 Oct 04 19:12:09.285838 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3813/7620] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 19:12:09 2022] DELETE /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33/os-volume_attachments/29261c48-2528-470b-b55b-394201187d2a => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:12:12.633279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6f0e721a-02c3-44eb-8f11-eabd265f3ce2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:12.633804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f0e721a-02c3-44eb-8f11-eabd265f3ce2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:12.641126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f0e721a-02c3-44eb-8f11-eabd265f3ce2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:12.641641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f0e721a-02c3-44eb-8f11-eabd265f3ce2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:12.642102 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f0e721a-02c3-44eb-8f11-eabd265f3ce2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:12.642834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f0e721a-02c3-44eb-8f11-eabd265f3ce2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:12.643435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f0e721a-02c3-44eb-8f11-eabd265f3ce2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:12.643906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6f0e721a-02c3-44eb-8f11-eabd265f3ce2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:12.672136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6f0e721a-02c3-44eb-8f11-eabd265f3ce2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:12:12.757869 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6f0e721a-02c3-44eb-8f11-eabd265f3ce2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 204 len: 0 microversion: 2.1 time: 0.127781 Oct 04 19:12:12.759373 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3808/7621] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:12:12 2022] DELETE /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:12:12.767397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fef3b9f7-2d98-422e-b2d4-b490286ebf16 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:12.768103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fef3b9f7-2d98-422e-b2d4-b490286ebf16 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:12.775690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fef3b9f7-2d98-422e-b2d4-b490286ebf16 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:12.776260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fef3b9f7-2d98-422e-b2d4-b490286ebf16 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:12.776791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fef3b9f7-2d98-422e-b2d4-b490286ebf16 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:12.777556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fef3b9f7-2d98-422e-b2d4-b490286ebf16 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:12.778089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fef3b9f7-2d98-422e-b2d4-b490286ebf16 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:12.778590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fef3b9f7-2d98-422e-b2d4-b490286ebf16 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:12.919483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fef3b9f7-2d98-422e-b2d4-b490286ebf16 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:12.927684 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fef3b9f7-2d98-422e-b2d4-b490286ebf16 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1561 microversion: 2.1 time: 0.164129 Oct 04 19:12:12.928257 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3814/7622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:12 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:12:13.951303 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65558880-0e8c-4e40-b419-1370c9c5a5d5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:13.952053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65558880-0e8c-4e40-b419-1370c9c5a5d5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:13.958927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65558880-0e8c-4e40-b419-1370c9c5a5d5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:13.959599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65558880-0e8c-4e40-b419-1370c9c5a5d5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:13.960055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65558880-0e8c-4e40-b419-1370c9c5a5d5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:13.960761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65558880-0e8c-4e40-b419-1370c9c5a5d5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:13.961267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65558880-0e8c-4e40-b419-1370c9c5a5d5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:13.961712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65558880-0e8c-4e40-b419-1370c9c5a5d5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:14.090335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65558880-0e8c-4e40-b419-1370c9c5a5d5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:14.099112 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65558880-0e8c-4e40-b419-1370c9c5a5d5 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1561 microversion: 2.1 time: 0.152185 Oct 04 19:12:14.099689 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3809/7623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:13 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:15.066714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a4970c07-ae92-46bf-bae1-7be7df681cb3 req-92a00db1-0418-4a13-b47d-e807fa9d718f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a75191d-a644-4094-8001-1229931b8b33", "name": "network-vif-deleted", "tag": "1bcc065b-7440-4130-9009-1eb84bb8797f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:15.078061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a4970c07-ae92-46bf-bae1-7be7df681cb3 req-92a00db1-0418-4a13-b47d-e807fa9d718f service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:15.078552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a4970c07-ae92-46bf-bae1-7be7df681cb3 req-92a00db1-0418-4a13-b47d-e807fa9d718f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:15.079043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a4970c07-ae92-46bf-bae1-7be7df681cb3 req-92a00db1-0418-4a13-b47d-e807fa9d718f service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:15.092379 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a4970c07-ae92-46bf-bae1-7be7df681cb3 req-92a00db1-0418-4a13-b47d-e807fa9d718f service nova] Creating event network-vif-deleted:1bcc065b-7440-4130-9009-1eb84bb8797f for instance 5a75191d-a644-4094-8001-1229931b8b33 on n-h2-850499-14 Oct 04 19:12:15.098210 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a4970c07-ae92-46bf-bae1-7be7df681cb3 req-92a00db1-0418-4a13-b47d-e807fa9d718f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035611 Oct 04 19:12:15.099391 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3815/7624] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:15.123888 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a823bc9f-5f9a-4b5f-ac7a-c5f1b3c2c025 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:15.125140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a823bc9f-5f9a-4b5f-ac7a-c5f1b3c2c025 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:15.132816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a823bc9f-5f9a-4b5f-ac7a-c5f1b3c2c025 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:15.133611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a823bc9f-5f9a-4b5f-ac7a-c5f1b3c2c025 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:15.134104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a823bc9f-5f9a-4b5f-ac7a-c5f1b3c2c025 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:15.134917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a823bc9f-5f9a-4b5f-ac7a-c5f1b3c2c025 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:15.135537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a823bc9f-5f9a-4b5f-ac7a-c5f1b3c2c025 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:15.136375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a823bc9f-5f9a-4b5f-ac7a-c5f1b3c2c025 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:15.213557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a823bc9f-5f9a-4b5f-ac7a-c5f1b3c2c025 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:15.222440 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a823bc9f-5f9a-4b5f-ac7a-c5f1b3c2c025 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 200 len: 1348 microversion: 2.1 time: 0.103014 Oct 04 19:12:15.223045 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3810/7625] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:15 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:16.247978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:16.248678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 5a75191d-a644-4094-8001-1229931b8b33] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:16.255415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:16.255897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:16.256337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:16.257022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:16.257474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:16.257899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:16.271482 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] HTTP exception thrown: Instance 5a75191d-a644-4094-8001-1229931b8b33 could not be found. Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Request method failure captured: Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 HTTP/1.1 Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIU9V1cZZqliH-NRpUd7tu7-0t7uboY2uCAFTly3X1by9sIk2I5Ek7v14tK4p-r1iaBF5fHBNmnnnCi_aNC3ExUKnK04-ImeTM50_dHVF_sEgv_gE1F6keV2mPkbYi2hZW08OcTu9dyDXR_0F5gqwl9k_az5enUi0WgkqUVYF0boA4E Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}] Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: f06df58bf04f41ab945925996c54cd47 Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 5a75191d-a644-4094-8001-1229931b8b33 could not be found. Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '5a75191d-a644-4094-8001-1229931b8b33'} Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a75191d-a644-4094-8001-1229931b8b33 could not be found. Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a75191d-a644-4094-8001-1229931b8b33 could not be found. Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:16.273073 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a75191d-a644-4094-8001-1229931b8b33 could not be found. Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Returning 404 to user: Instance 5a75191d-a644-4094-8001-1229931b8b33 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d977880-9bc3-42ba-97ca-1fb811bcd32e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33" status: 404 len: 111 microversion: 2.1 time: 0.031673 Oct 04 19:12:16.278058 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3816/7626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:16 2022] GET /compute/v2.1/servers/5a75191d-a644-4094-8001-1229931b8b33 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:12:16.283477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-61a8529a-2f16-423a-a029-043baf992420 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '.version_select at 0x7fd4d0a051f0>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:16.306301 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-61a8529a-2f16-423a-a029-043baf992420 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2145411459" status: 202 len: 0 microversion: 2.1 time: 0.026781 Oct 04 19:12:16.307015 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3811/7627] 10.222.0.18 () {58 vars in 1278 bytes} [Tue Oct 4 19:12:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2145411459 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:12:16.325376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74b89b8a-32ba-4e0d-8d11-452824ec3f92 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Action: 'create', calling method: .version_select at 0x7fd4d0a5c430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-721263988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuRBxy0jmT1s4dSIlWQXec3P5bY6JS+YdrIHP8RiZjvorU55GxT7twHvuOIimh2FnQXKwh3xitS2QS6xffEnXARmyN3XnYKoeuasqN6N3TxZVEcynSd7yM94bZVP5Ob8Q=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:16.341122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-74b89b8a-32ba-4e0d-8d11-452824ec3f92 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:12:16.347023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-74b89b8a-32ba-4e0d-8d11-452824ec3f92 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for user f06df58bf04f41ab945925996c54cd47 and project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:12:16.369331 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74b89b8a-32ba-4e0d-8d11-452824ec3f92 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.047900 Oct 04 19:12:16.369960 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3817/7628] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:12:16 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:16.420589 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1763479480", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-721263988", "networks": [{"uuid": "b7f97b6b-54a4-449d-93cc-9364398fc55a"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:16.475693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] validate_networks() for [('b7f97b6b-54a4-449d-93cc-9364398fc55a', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:12:16.845287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:12:16.845728 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:12:16.846216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:12:16.846644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:12:16.847098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:12:16.855797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:16.856295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:16.856745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:16.857603 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:16.858114 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:16.858555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:16.881116 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:12:16.886472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Getting quotas for user f06df58bf04f41ab945925996c54cd47 and project 9a502952b57c4e1ab2f2ad1380c0fb79. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:12:16.904818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:12:16.907508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:12:16.955250 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a8f684be-f123-4d87-aba2-ec5e0af5453e tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538635 Oct 04 19:12:16.955918 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3812/7629] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:12:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:12:16.967211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d4b388a4-71e7-43e9-b1ba-36bea24fa5a1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:16.967906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d4b388a4-71e7-43e9-b1ba-36bea24fa5a1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:17.024880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d4b388a4-71e7-43e9-b1ba-36bea24fa5a1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:17.032339 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d4b388a4-71e7-43e9-b1ba-36bea24fa5a1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1262 microversion: 2.1 time: 0.068467 Oct 04 19:12:17.033032 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3818/7630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:16 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:18.058273 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-53c14434-74e6-45b9-8e55-e6413e243463 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:18.058912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-53c14434-74e6-45b9-8e55-e6413e243463 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:18.068614 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53c14434-74e6-45b9-8e55-e6413e243463 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:18.069750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53c14434-74e6-45b9-8e55-e6413e243463 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:18.070226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53c14434-74e6-45b9-8e55-e6413e243463 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:18.071253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53c14434-74e6-45b9-8e55-e6413e243463 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:18.071856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53c14434-74e6-45b9-8e55-e6413e243463 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:18.072301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53c14434-74e6-45b9-8e55-e6413e243463 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:18.147334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-53c14434-74e6-45b9-8e55-e6413e243463 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:18.156961 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-53c14434-74e6-45b9-8e55-e6413e243463 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1332 microversion: 2.1 time: 0.104376 Oct 04 19:12:18.157711 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3813/7631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:18 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:19.181073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e870a86b-abbf-44f9-952a-ef8c80d1e10f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:19.181694 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e870a86b-abbf-44f9-952a-ef8c80d1e10f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:19.188979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e870a86b-abbf-44f9-952a-ef8c80d1e10f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:19.189471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e870a86b-abbf-44f9-952a-ef8c80d1e10f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:19.189910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e870a86b-abbf-44f9-952a-ef8c80d1e10f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:19.190618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e870a86b-abbf-44f9-952a-ef8c80d1e10f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:19.191260 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e870a86b-abbf-44f9-952a-ef8c80d1e10f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:19.191697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e870a86b-abbf-44f9-952a-ef8c80d1e10f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:19.323384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e870a86b-abbf-44f9-952a-ef8c80d1e10f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:19.331877 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e870a86b-abbf-44f9-952a-ef8c80d1e10f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1362 microversion: 2.1 time: 0.154666 Oct 04 19:12:19.332462 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3819/7632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:19 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:19.369126 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d27fa987-1a42-47a8-bf7b-03b6ce5b3794 req-a529422c-a5ba-48f3-bbfd-04dff40a7721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eea7deb-e05e-4ba7-a02a-1451339f48c4", "tag": "7425c251-c398-4662-ad81-373909bcc5bc"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:19.381043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d27fa987-1a42-47a8-bf7b-03b6ce5b3794 req-a529422c-a5ba-48f3-bbfd-04dff40a7721 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:19.381557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d27fa987-1a42-47a8-bf7b-03b6ce5b3794 req-a529422c-a5ba-48f3-bbfd-04dff40a7721 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:19.382027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d27fa987-1a42-47a8-bf7b-03b6ce5b3794 req-a529422c-a5ba-48f3-bbfd-04dff40a7721 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:19.393923 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d27fa987-1a42-47a8-bf7b-03b6ce5b3794 req-a529422c-a5ba-48f3-bbfd-04dff40a7721 service nova] Creating event network-changed:7425c251-c398-4662-ad81-373909bcc5bc for instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 on n-h2-850499-14 Oct 04 19:12:19.399340 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d27fa987-1a42-47a8-bf7b-03b6ce5b3794 req-a529422c-a5ba-48f3-bbfd-04dff40a7721 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035076 Oct 04 19:12:19.399947 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3814/7633] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:20.354339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb112b6d-a213-429d-91a4-ca9dec5344ae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:20.354940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb112b6d-a213-429d-91a4-ca9dec5344ae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:20.361753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb112b6d-a213-429d-91a4-ca9dec5344ae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:20.362240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb112b6d-a213-429d-91a4-ca9dec5344ae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:20.362711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb112b6d-a213-429d-91a4-ca9dec5344ae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:20.363441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb112b6d-a213-429d-91a4-ca9dec5344ae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:20.363902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb112b6d-a213-429d-91a4-ca9dec5344ae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:20.364331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb112b6d-a213-429d-91a4-ca9dec5344ae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:20.500003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb112b6d-a213-429d-91a4-ca9dec5344ae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:20.507720 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb112b6d-a213-429d-91a4-ca9dec5344ae tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1362 microversion: 2.1 time: 0.157296 Oct 04 19:12:20.508304 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3820/7634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:20 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:21.533226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62f6f1d4-d48f-40e3-a893-a207493c7f4f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:21.533974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-62f6f1d4-d48f-40e3-a893-a207493c7f4f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:21.540132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f6f1d4-d48f-40e3-a893-a207493c7f4f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:21.540655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f6f1d4-d48f-40e3-a893-a207493c7f4f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:21.541109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f6f1d4-d48f-40e3-a893-a207493c7f4f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:21.541811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f6f1d4-d48f-40e3-a893-a207493c7f4f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:21.542281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f6f1d4-d48f-40e3-a893-a207493c7f4f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:21.542721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f6f1d4-d48f-40e3-a893-a207493c7f4f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:21.671279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62f6f1d4-d48f-40e3-a893-a207493c7f4f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:21.680079 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-62f6f1d4-d48f-40e3-a893-a207493c7f4f tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1362 microversion: 2.1 time: 0.152581 Oct 04 19:12:21.680652 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3815/7635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:21 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:22.703075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3b9a6090-a10e-4b00-b3d3-8c62ee9f9dab tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:22.703709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3b9a6090-a10e-4b00-b3d3-8c62ee9f9dab tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:22.710862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b9a6090-a10e-4b00-b3d3-8c62ee9f9dab tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:22.711453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b9a6090-a10e-4b00-b3d3-8c62ee9f9dab tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:22.711896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b9a6090-a10e-4b00-b3d3-8c62ee9f9dab tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:22.712598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b9a6090-a10e-4b00-b3d3-8c62ee9f9dab tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:22.713054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b9a6090-a10e-4b00-b3d3-8c62ee9f9dab tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:22.713484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b9a6090-a10e-4b00-b3d3-8c62ee9f9dab tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:22.846139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3b9a6090-a10e-4b00-b3d3-8c62ee9f9dab tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:22.853906 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3b9a6090-a10e-4b00-b3d3-8c62ee9f9dab tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1362 microversion: 2.1 time: 0.154802 Oct 04 19:12:22.854473 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3821/7636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:22 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:23.877686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a4561d48-e0e6-468f-a201-33d066d2ab8b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:23.878231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a4561d48-e0e6-468f-a201-33d066d2ab8b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:23.885178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4561d48-e0e6-468f-a201-33d066d2ab8b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:23.885680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4561d48-e0e6-468f-a201-33d066d2ab8b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:23.886280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4561d48-e0e6-468f-a201-33d066d2ab8b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:23.887271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4561d48-e0e6-468f-a201-33d066d2ab8b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:23.887814 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4561d48-e0e6-468f-a201-33d066d2ab8b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:23.888313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a4561d48-e0e6-468f-a201-33d066d2ab8b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:24.016939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a4561d48-e0e6-468f-a201-33d066d2ab8b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:24.024730 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a4561d48-e0e6-468f-a201-33d066d2ab8b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1362 microversion: 2.1 time: 0.151292 Oct 04 19:12:24.025297 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3816/7637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:23 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:25.049379 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-01497651-285b-4187-b278-b63802d15877 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:25.049952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-01497651-285b-4187-b278-b63802d15877 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:25.056480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01497651-285b-4187-b278-b63802d15877 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:25.056982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01497651-285b-4187-b278-b63802d15877 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:25.057423 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01497651-285b-4187-b278-b63802d15877 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:25.058142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01497651-285b-4187-b278-b63802d15877 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:25.058601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01497651-285b-4187-b278-b63802d15877 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:25.059067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-01497651-285b-4187-b278-b63802d15877 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:25.198699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-01497651-285b-4187-b278-b63802d15877 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:25.206375 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-01497651-285b-4187-b278-b63802d15877 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1362 microversion: 2.1 time: 0.162027 Oct 04 19:12:25.206946 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3822/7638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:25 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:26.229720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8623896d-d886-4d31-99eb-7786973b2659 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:26.230374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8623896d-d886-4d31-99eb-7786973b2659 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:26.236769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8623896d-d886-4d31-99eb-7786973b2659 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:26.237277 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8623896d-d886-4d31-99eb-7786973b2659 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:26.237737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8623896d-d886-4d31-99eb-7786973b2659 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:26.238450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8623896d-d886-4d31-99eb-7786973b2659 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:26.238925 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8623896d-d886-4d31-99eb-7786973b2659 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:26.239390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8623896d-d886-4d31-99eb-7786973b2659 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:26.367477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8623896d-d886-4d31-99eb-7786973b2659 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:26.375198 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8623896d-d886-4d31-99eb-7786973b2659 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1362 microversion: 2.1 time: 0.149355 Oct 04 19:12:26.375780 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3817/7639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:26 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:26.580048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-fe5e2898-e1c4-4632-9130-a6419deeba3f req-b92ba571-d79f-4a37-b3a4-90a4aa8f4538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eea7deb-e05e-4ba7-a02a-1451339f48c4", "name": "network-vif-plugged", "status": "completed", "tag": "7425c251-c398-4662-ad81-373909bcc5bc"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:26.590653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fe5e2898-e1c4-4632-9130-a6419deeba3f req-b92ba571-d79f-4a37-b3a4-90a4aa8f4538 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:26.591177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fe5e2898-e1c4-4632-9130-a6419deeba3f req-b92ba571-d79f-4a37-b3a4-90a4aa8f4538 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:26.591646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-fe5e2898-e1c4-4632-9130-a6419deeba3f req-b92ba571-d79f-4a37-b3a4-90a4aa8f4538 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:26.603100 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-fe5e2898-e1c4-4632-9130-a6419deeba3f req-b92ba571-d79f-4a37-b3a4-90a4aa8f4538 service nova] Creating event network-vif-plugged:7425c251-c398-4662-ad81-373909bcc5bc for instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 on n-h2-850499-14 Oct 04 19:12:26.608020 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-fe5e2898-e1c4-4632-9130-a6419deeba3f req-b92ba571-d79f-4a37-b3a4-90a4aa8f4538 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031673 Oct 04 19:12:26.608788 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3823/7640] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:12:27.398972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-80729bfd-7b0f-4455-a351-768da66882ad tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:27.399631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-80729bfd-7b0f-4455-a351-768da66882ad tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:27.401661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:27.402479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:27.409646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80729bfd-7b0f-4455-a351-768da66882ad tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:27.410150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80729bfd-7b0f-4455-a351-768da66882ad tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:27.410604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80729bfd-7b0f-4455-a351-768da66882ad tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:27.412182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80729bfd-7b0f-4455-a351-768da66882ad tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:27.412182 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80729bfd-7b0f-4455-a351-768da66882ad tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:27.412453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-80729bfd-7b0f-4455-a351-768da66882ad tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:27.540107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-80729bfd-7b0f-4455-a351-768da66882ad tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:27.547845 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-80729bfd-7b0f-4455-a351-768da66882ad tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1362 microversion: 2.1 time: 0.152726 Oct 04 19:12:27.548818 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3818/7641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:27 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:28.568105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:28.573036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dbbe4b17-9c94-4801-9339-b860d0496dc3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:28.573743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dbbe4b17-9c94-4801-9339-b860d0496dc3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:28.580700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbe4b17-9c94-4801-9339-b860d0496dc3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:28.581190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbe4b17-9c94-4801-9339-b860d0496dc3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:28.581636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbe4b17-9c94-4801-9339-b860d0496dc3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:28.582327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbe4b17-9c94-4801-9339-b860d0496dc3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:28.582788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbe4b17-9c94-4801-9339-b860d0496dc3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:28.583252 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dbbe4b17-9c94-4801-9339-b860d0496dc3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:28.717342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dbbe4b17-9c94-4801-9339-b860d0496dc3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:28.725710 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dbbe4b17-9c94-4801-9339-b860d0496dc3 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1554 microversion: 2.1 time: 0.158602 Oct 04 19:12:28.726276 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3824/7642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:28 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:28.747701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb9ad7cc-06c6-4a4a-bd70-e5d5b7aa0ec2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:28.748341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb9ad7cc-06c6-4a4a-bd70-e5d5b7aa0ec2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:28.755372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9ad7cc-06c6-4a4a-bd70-e5d5b7aa0ec2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:28.755884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9ad7cc-06c6-4a4a-bd70-e5d5b7aa0ec2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:28.756349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9ad7cc-06c6-4a4a-bd70-e5d5b7aa0ec2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:28.757072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9ad7cc-06c6-4a4a-bd70-e5d5b7aa0ec2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:28.757553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9ad7cc-06c6-4a4a-bd70-e5d5b7aa0ec2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:28.758003 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb9ad7cc-06c6-4a4a-bd70-e5d5b7aa0ec2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:28.889097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cb9ad7cc-06c6-4a4a-bd70-e5d5b7aa0ec2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:28.897783 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb9ad7cc-06c6-4a4a-bd70-e5d5b7aa0ec2 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1554 microversion: 2.1 time: 0.153941 Oct 04 19:12:28.898373 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3819/7643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:28 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:30.396076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8d1dba2e-afd9-4bba-8d95-d7da0183d3b4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:30.398416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8d1dba2e-afd9-4bba-8d95-d7da0183d3b4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:30.405258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d1dba2e-afd9-4bba-8d95-d7da0183d3b4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:30.405747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d1dba2e-afd9-4bba-8d95-d7da0183d3b4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:30.406188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d1dba2e-afd9-4bba-8d95-d7da0183d3b4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:30.406909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d1dba2e-afd9-4bba-8d95-d7da0183d3b4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:30.407406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d1dba2e-afd9-4bba-8d95-d7da0183d3b4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:30.407842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8d1dba2e-afd9-4bba-8d95-d7da0183d3b4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:30.675555 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8d1dba2e-afd9-4bba-8d95-d7da0183d3b4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "POST /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283682 Oct 04 19:12:30.676197 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3825/7644] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 19:12:30 2022] POST /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:42.475344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cba5cd7b-c42d-477d-b8e1-c94e6eba6112 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:42.475872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cba5cd7b-c42d-477d-b8e1-c94e6eba6112 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:42.478715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:42.479403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:42.486264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cba5cd7b-c42d-477d-b8e1-c94e6eba6112 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:42.486769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cba5cd7b-c42d-477d-b8e1-c94e6eba6112 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:42.487327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cba5cd7b-c42d-477d-b8e1-c94e6eba6112 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:42.488553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cba5cd7b-c42d-477d-b8e1-c94e6eba6112 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:42.489029 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cba5cd7b-c42d-477d-b8e1-c94e6eba6112 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:42.489475 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cba5cd7b-c42d-477d-b8e1-c94e6eba6112 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:42.573375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-cba5cd7b-c42d-477d-b8e1-c94e6eba6112 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lazy-loading 'services' on Instance uuid 6eea7deb-e05e-4ba7-a02a-1451339f48c4 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:12:42.645427 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cba5cd7b-c42d-477d-b8e1-c94e6eba6112 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments/4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035" status: 202 len: 0 microversion: 2.1 time: 0.174360 Oct 04 19:12:42.646126 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3820/7645] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 19:12:42 2022] DELETE /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments/4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:12:42.652988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:42.653763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:42.658128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1c3f1bfd-3a19-4323-90b0-52fc3fe7234b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:42.661874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1c3f1bfd-3a19-4323-90b0-52fc3fe7234b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:42.674565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c3f1bfd-3a19-4323-90b0-52fc3fe7234b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:42.674565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c3f1bfd-3a19-4323-90b0-52fc3fe7234b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:42.674565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c3f1bfd-3a19-4323-90b0-52fc3fe7234b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:42.676759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c3f1bfd-3a19-4323-90b0-52fc3fe7234b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:42.676759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c3f1bfd-3a19-4323-90b0-52fc3fe7234b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:42.676759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c3f1bfd-3a19-4323-90b0-52fc3fe7234b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:42.713378 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1c3f1bfd-3a19-4323-90b0-52fc3fe7234b tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062264 Oct 04 19:12:42.713965 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3826/7646] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:42 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:43.727536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-35c72321-a1cc-4b55-b76a-1c62332dc9e4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:43.729917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-35c72321-a1cc-4b55-b76a-1c62332dc9e4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:43.736348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35c72321-a1cc-4b55-b76a-1c62332dc9e4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:43.736850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35c72321-a1cc-4b55-b76a-1c62332dc9e4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:43.737809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35c72321-a1cc-4b55-b76a-1c62332dc9e4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:43.738517 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35c72321-a1cc-4b55-b76a-1c62332dc9e4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:43.739017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35c72321-a1cc-4b55-b76a-1c62332dc9e4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:43.739462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-35c72321-a1cc-4b55-b76a-1c62332dc9e4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:43.771025 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-35c72321-a1cc-4b55-b76a-1c62332dc9e4 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048900 Oct 04 19:12:43.774582 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3821/7647] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:43 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:44.783178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a77471aa-f8af-4670-acef-5a938a670886 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:44.785289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a77471aa-f8af-4670-acef-5a938a670886 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:44.792344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a77471aa-f8af-4670-acef-5a938a670886 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:44.792839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a77471aa-f8af-4670-acef-5a938a670886 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:44.793286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a77471aa-f8af-4670-acef-5a938a670886 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:44.793997 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a77471aa-f8af-4670-acef-5a938a670886 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:44.794461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a77471aa-f8af-4670-acef-5a938a670886 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:44.794898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a77471aa-f8af-4670-acef-5a938a670886 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:44.827447 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a77471aa-f8af-4670-acef-5a938a670886 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048064 Oct 04 19:12:44.828038 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3827/7648] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:44 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:45.839584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dbe9435a-4121-4426-8309-71bb0b96d245 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:45.841975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dbe9435a-4121-4426-8309-71bb0b96d245 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:45.849700 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe9435a-4121-4426-8309-71bb0b96d245 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:45.850212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe9435a-4121-4426-8309-71bb0b96d245 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:45.850674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe9435a-4121-4426-8309-71bb0b96d245 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:45.851434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe9435a-4121-4426-8309-71bb0b96d245 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:45.851917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe9435a-4121-4426-8309-71bb0b96d245 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:45.852366 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dbe9435a-4121-4426-8309-71bb0b96d245 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:45.882445 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dbe9435a-4121-4426-8309-71bb0b96d245 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Oct 04 19:12:45.882977 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3822/7649] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:45 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:46.894494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2f8cae59-8c66-4956-ab42-572785570ac1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:46.896698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2f8cae59-8c66-4956-ab42-572785570ac1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:46.903594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f8cae59-8c66-4956-ab42-572785570ac1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:46.904090 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f8cae59-8c66-4956-ab42-572785570ac1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:46.904536 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f8cae59-8c66-4956-ab42-572785570ac1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:46.905241 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f8cae59-8c66-4956-ab42-572785570ac1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:46.905701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f8cae59-8c66-4956-ab42-572785570ac1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:46.906139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f8cae59-8c66-4956-ab42-572785570ac1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:46.936575 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2f8cae59-8c66-4956-ab42-572785570ac1 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046675 Oct 04 19:12:46.937138 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3828/7650] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:46 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:47.951164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-547781b5-3aed-479a-afa7-be45926ca46d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:47.953413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-547781b5-3aed-479a-afa7-be45926ca46d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:47.960861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-547781b5-3aed-479a-afa7-be45926ca46d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:47.961374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-547781b5-3aed-479a-afa7-be45926ca46d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:47.961834 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-547781b5-3aed-479a-afa7-be45926ca46d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:47.962553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-547781b5-3aed-479a-afa7-be45926ca46d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:47.963066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-547781b5-3aed-479a-afa7-be45926ca46d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:47.963521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-547781b5-3aed-479a-afa7-be45926ca46d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:47.993022 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-547781b5-3aed-479a-afa7-be45926ca46d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045881 Oct 04 19:12:47.993584 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3823/7651] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:47 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:12:48.004338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:48.004842 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:48.011594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:48.012089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:48.012530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:48.013225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:48.013689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:48.014119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:48.089328 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] HTTP exception thrown: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 is not attached to volume 4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Request method failure captured: Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments/4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035 HTTP/1.1 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIU9V1cZZqliH-NRpUd7tu7-0t7uboY2uCAFTly3X1by9sIk2I5Ek7v14tK4p-r1iaBF5fHBNmnnnCi_aNC3ExUKnK04-ImeTM50_dHVF_sEgv_gE1F6keV2mPkbYi2hZW08OcTu9dyDXR_0F5gqwl9k_az5enUi0WgkqUVYF0boA4E Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}] Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: f06df58bf04f41ab945925996c54cd47 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 is not attached to volume 4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'server_id': '6eea7deb-e05e-4ba7-a02a-1451339f48c4', 'id': '4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035'} Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035. Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 is not attached to volume 4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035 Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:48.090994 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:48.096169 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:12:48.096169 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:12:48.096169 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 is not attached to volume 4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035 Oct 04 19:12:48.096169 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:48.096169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Returning 404 to user: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 is not attached to volume 4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035 {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:12:48.096169 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-010c59a8-d4e8-430a-94e1-e8ae52397d30 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments/4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035" status: 404 len: 154 microversion: 2.1 time: 0.092224 Oct 04 19:12:48.096169 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3829/7652] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 19:12:47 2022] DELETE /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4/os-volume_attachments/4e7e22bb-77bd-4f19-8a6b-0fdeefcc5035 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:12:51.445840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7e79fa9e-8522-4d1a-8bcf-7b4a2dde7d69 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:51.446401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e79fa9e-8522-4d1a-8bcf-7b4a2dde7d69 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:51.455678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e79fa9e-8522-4d1a-8bcf-7b4a2dde7d69 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:51.456191 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e79fa9e-8522-4d1a-8bcf-7b4a2dde7d69 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:51.456647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e79fa9e-8522-4d1a-8bcf-7b4a2dde7d69 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:51.457410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e79fa9e-8522-4d1a-8bcf-7b4a2dde7d69 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:51.457903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e79fa9e-8522-4d1a-8bcf-7b4a2dde7d69 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:51.458329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7e79fa9e-8522-4d1a-8bcf-7b4a2dde7d69 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:51.485141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7e79fa9e-8522-4d1a-8bcf-7b4a2dde7d69 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:12:51.567206 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7e79fa9e-8522-4d1a-8bcf-7b4a2dde7d69 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 204 len: 0 microversion: 2.1 time: 0.124627 Oct 04 19:12:51.568063 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3824/7653] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:12:51 2022] DELETE /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:12:51.576807 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3fe696f7-8992-4711-82e4-bdd25f90b300 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:51.577663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3fe696f7-8992-4711-82e4-bdd25f90b300 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:51.585800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fe696f7-8992-4711-82e4-bdd25f90b300 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:51.586301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fe696f7-8992-4711-82e4-bdd25f90b300 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:51.586749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fe696f7-8992-4711-82e4-bdd25f90b300 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:51.587539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fe696f7-8992-4711-82e4-bdd25f90b300 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:51.588002 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fe696f7-8992-4711-82e4-bdd25f90b300 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:51.588439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3fe696f7-8992-4711-82e4-bdd25f90b300 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:51.725061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3fe696f7-8992-4711-82e4-bdd25f90b300 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:51.732942 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3fe696f7-8992-4711-82e4-bdd25f90b300 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1560 microversion: 2.1 time: 0.160355 Oct 04 19:12:51.733596 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3830/7654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:51 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:52.758461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-97fbaaad-108e-4fac-868f-50493a1b9845 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:52.759141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-97fbaaad-108e-4fac-868f-50493a1b9845 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:52.766143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97fbaaad-108e-4fac-868f-50493a1b9845 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:52.766657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97fbaaad-108e-4fac-868f-50493a1b9845 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:52.767153 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97fbaaad-108e-4fac-868f-50493a1b9845 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:52.767878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97fbaaad-108e-4fac-868f-50493a1b9845 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:52.768363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97fbaaad-108e-4fac-868f-50493a1b9845 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:52.768813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-97fbaaad-108e-4fac-868f-50493a1b9845 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:52.900588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-97fbaaad-108e-4fac-868f-50493a1b9845 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:52.908342 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-97fbaaad-108e-4fac-868f-50493a1b9845 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1560 microversion: 2.1 time: 0.154305 Oct 04 19:12:52.909437 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3825/7655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:52 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:53.932947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a06bda9-afd2-4ae3-b89f-a41fae1855ff tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:53.933564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a06bda9-afd2-4ae3-b89f-a41fae1855ff tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:53.940934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a06bda9-afd2-4ae3-b89f-a41fae1855ff tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:53.941429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a06bda9-afd2-4ae3-b89f-a41fae1855ff tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:53.941892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a06bda9-afd2-4ae3-b89f-a41fae1855ff tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:53.942592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a06bda9-afd2-4ae3-b89f-a41fae1855ff tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:53.943094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a06bda9-afd2-4ae3-b89f-a41fae1855ff tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:53.943509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a06bda9-afd2-4ae3-b89f-a41fae1855ff tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:54.007550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a06bda9-afd2-4ae3-b89f-a41fae1855ff tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06df58bf04f41ab945925996c54cd47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a502952b57c4e1ab2f2ad1380c0fb79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:54.019192 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a06bda9-afd2-4ae3-b89f-a41fae1855ff tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 200 len: 1518 microversion: 2.1 time: 0.089894 Oct 04 19:12:54.024634 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3831/7656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:53 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 1518 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:54.075831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-18d185fe-38dc-4d76-a72f-c76318a351d4 req-58bc39b5-b0be-4d47-92c6-293155a512bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eea7deb-e05e-4ba7-a02a-1451339f48c4", "name": "network-vif-deleted", "tag": "7425c251-c398-4662-ad81-373909bcc5bc"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:54.086085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-18d185fe-38dc-4d76-a72f-c76318a351d4 req-58bc39b5-b0be-4d47-92c6-293155a512bd service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:54.086594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-18d185fe-38dc-4d76-a72f-c76318a351d4 req-58bc39b5-b0be-4d47-92c6-293155a512bd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:54.087176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-18d185fe-38dc-4d76-a72f-c76318a351d4 req-58bc39b5-b0be-4d47-92c6-293155a512bd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:54.099643 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-18d185fe-38dc-4d76-a72f-c76318a351d4 req-58bc39b5-b0be-4d47-92c6-293155a512bd service nova] Creating event network-vif-deleted:7425c251-c398-4662-ad81-373909bcc5bc for instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 on n-h2-850499-14 Oct 04 19:12:54.104624 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-18d185fe-38dc-4d76-a72f-c76318a351d4 req-58bc39b5-b0be-4d47-92c6-293155a512bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034209 Oct 04 19:12:54.105287 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3826/7657] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:12:55.041847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:55.042457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] [instance: 6eea7deb-e05e-4ba7-a02a-1451339f48c4] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:55.049294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:55.049775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:55.050212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:55.050898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:55.051377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:55.051800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:55.065365 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] HTTP exception thrown: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 could not be found. Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Request method failure captured: Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 HTTP/1.1 Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIU9V1cZZqliH-NRpUd7tu7-0t7uboY2uCAFTly3X1by9sIk2I5Ek7v14tK4p-r1iaBF5fHBNmnnnCi_aNC3ExUKnK04-ImeTM50_dHVF_sEgv_gE1F6keV2mPkbYi2hZW08OcTu9dyDXR_0F5gqwl9k_az5enUi0WgkqUVYF0boA4E Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9a502952b57c4e1ab2f2ad1380c0fb79"}]}] Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 9a502952b57c4e1ab2f2ad1380c0fb79 Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1989069520 Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: f06df58bf04f41ab945925996c54cd47 Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestEncryptedCinderVolumes-1989069520-project Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 could not be found. Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '6eea7deb-e05e-4ba7-a02a-1451339f48c4'} Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 could not be found. Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 could not be found. Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:55.066871 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 could not be found. Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Returning 404 to user: Instance 6eea7deb-e05e-4ba7-a02a-1451339f48c4 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f4a5e5b6-a244-4688-bb5a-71cc7b7aa89d tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4" status: 404 len: 111 microversion: 2.1 time: 0.030456 Oct 04 19:12:55.071625 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3832/7658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:55 2022] GET /compute/v2.1/servers/6eea7deb-e05e-4ba7-a02a-1451339f48c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:12:55.078553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e038d5f0-a398-4bc0-926f-122a95bfc398 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] Calling method '.version_select at 0x7fd4d104de50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:55.099841 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e038d5f0-a398-4bc0-926f-122a95bfc398 tempest-TestEncryptedCinderVolumes-1989069520 tempest-TestEncryptedCinderVolumes-1989069520-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-721263988" status: 202 len: 0 microversion: 2.1 time: 0.026350 Oct 04 19:12:55.100709 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3827/7659] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 4 19:12:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-721263988 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:13:21.525294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ecb6b7ab-dcc5-42fb-aa1a-caa4ac2c7841 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'create', calling method: .version_select at 0x7fd4d098e040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1483380817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZdRCz9js3AdX55RQuct81JWgt+3AV9jK0vpIJ64k8NryqsViV5qZn2Zq1UdkKgGMMI2qDbtz46BNX1c65+cC+R1rrdAGQZBod+mzOxjKIee0x58u6WRl4YNL28Jo7LoQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:21.531973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=14 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:21.532612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=38 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:21.545703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ecb6b7ab-dcc5-42fb-aa1a-caa4ac2c7841 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Getting quotas for project edcf08712c3c4a16877a2a2b6a1ab2d2. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:13:21.551040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ecb6b7ab-dcc5-42fb-aa1a-caa4ac2c7841 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Getting quotas for user ff8d6c4c13984f7c8e099a6aab553774 and project edcf08712c3c4a16877a2a2b6a1ab2d2. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:13:21.573954 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ecb6b7ab-dcc5-42fb-aa1a-caa4ac2c7841 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052643 Oct 04 19:13:21.574552 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3833/7660] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:13:21 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:21.637355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-837568969", "imageRef": "a431b93f-0eb5-4951-b7be-12d2949f6025", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1483380817", "networks": [{"uuid": "1464267f-0f25-4474-9570-78538ee8ae2b"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:21.647599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:21.648256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:21.692932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] validate_networks() for [('1464267f-0f25-4474-9570-78538ee8ae2b', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:13:22.066561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:13:22.067036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:13:22.067531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:13:22.067961 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:13:22.068411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:13:22.077698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:22.078207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:22.078665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:22.079471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:22.079948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:22.080998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:22.097786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Getting quotas for project edcf08712c3c4a16877a2a2b6a1ab2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:13:22.103091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Getting quotas for user ff8d6c4c13984f7c8e099a6aab553774 and project edcf08712c3c4a16877a2a2b6a1ab2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:13:22.115952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:13:22.118319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a431b93f-0eb5-4951-b7be-12d2949f6025',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:13:22.163671 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bc2469fc-895c-4b72-b7f6-a5ab0f7361a6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530272 Oct 04 19:13:22.164322 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3828/7661] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:13:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:13:22.179993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-962ca6d0-6dbc-447b-8b72-d1a1121ab74b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:22.180740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-962ca6d0-6dbc-447b-8b72-d1a1121ab74b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:22.234509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-962ca6d0-6dbc-447b-8b72-d1a1121ab74b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:22.242747 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-962ca6d0-6dbc-447b-8b72-d1a1121ab74b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1258 microversion: 2.1 time: 0.071446 Oct 04 19:13:22.243414 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3834/7662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:22 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:23.268532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-500f703f-681d-4a14-acf9-884f396a7403 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:23.269301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-500f703f-681d-4a14-acf9-884f396a7403 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:23.276978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-500f703f-681d-4a14-acf9-884f396a7403 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:23.277747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-500f703f-681d-4a14-acf9-884f396a7403 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:23.278393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-500f703f-681d-4a14-acf9-884f396a7403 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:23.279169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-500f703f-681d-4a14-acf9-884f396a7403 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:23.279657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-500f703f-681d-4a14-acf9-884f396a7403 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:23.280109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-500f703f-681d-4a14-acf9-884f396a7403 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:23.344692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-500f703f-681d-4a14-acf9-884f396a7403 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:23.353111 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-500f703f-681d-4a14-acf9-884f396a7403 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1318 microversion: 2.1 time: 0.091286 Oct 04 19:13:23.354013 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3829/7663] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:23 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1318 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:24.376718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1c2288eb-228e-409a-a6d7-faef3f1292e9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:24.377310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1c2288eb-228e-409a-a6d7-faef3f1292e9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:24.389197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c2288eb-228e-409a-a6d7-faef3f1292e9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:24.390126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c2288eb-228e-409a-a6d7-faef3f1292e9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:24.390766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c2288eb-228e-409a-a6d7-faef3f1292e9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:24.391940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c2288eb-228e-409a-a6d7-faef3f1292e9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:24.393336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c2288eb-228e-409a-a6d7-faef3f1292e9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:24.394017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1c2288eb-228e-409a-a6d7-faef3f1292e9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:24.553334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1c2288eb-228e-409a-a6d7-faef3f1292e9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:24.562109 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1c2288eb-228e-409a-a6d7-faef3f1292e9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.189165 Oct 04 19:13:24.562901 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3835/7664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:24 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:25.584828 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-557fa04b-7034-4682-9241-5abb4c784737 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:25.585468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-557fa04b-7034-4682-9241-5abb4c784737 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:25.593208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557fa04b-7034-4682-9241-5abb4c784737 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:25.593796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557fa04b-7034-4682-9241-5abb4c784737 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:25.594256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557fa04b-7034-4682-9241-5abb4c784737 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:25.595023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557fa04b-7034-4682-9241-5abb4c784737 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:25.595504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557fa04b-7034-4682-9241-5abb4c784737 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:25.596453 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557fa04b-7034-4682-9241-5abb4c784737 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:25.736097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-557fa04b-7034-4682-9241-5abb4c784737 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:25.745050 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-557fa04b-7034-4682-9241-5abb4c784737 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.164369 Oct 04 19:13:25.746221 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3830/7665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:25 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:26.769349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-24bd38bc-fce9-42d3-b2c0-1302d3678344 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:26.770778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-24bd38bc-fce9-42d3-b2c0-1302d3678344 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:26.779113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24bd38bc-fce9-42d3-b2c0-1302d3678344 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:26.779984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24bd38bc-fce9-42d3-b2c0-1302d3678344 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:26.780644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24bd38bc-fce9-42d3-b2c0-1302d3678344 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:26.781858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24bd38bc-fce9-42d3-b2c0-1302d3678344 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:26.782533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24bd38bc-fce9-42d3-b2c0-1302d3678344 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:26.783218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-24bd38bc-fce9-42d3-b2c0-1302d3678344 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:26.932922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-24bd38bc-fce9-42d3-b2c0-1302d3678344 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:26.941738 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-24bd38bc-fce9-42d3-b2c0-1302d3678344 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.176557 Oct 04 19:13:26.942517 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3836/7666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:26 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:27.972429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ff608379-8d94-4e8a-91bc-6f3bf94e12a7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:27.973737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ff608379-8d94-4e8a-91bc-6f3bf94e12a7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:27.988117 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff608379-8d94-4e8a-91bc-6f3bf94e12a7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:27.988998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff608379-8d94-4e8a-91bc-6f3bf94e12a7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:27.989799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff608379-8d94-4e8a-91bc-6f3bf94e12a7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:27.991062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff608379-8d94-4e8a-91bc-6f3bf94e12a7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:27.991882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff608379-8d94-4e8a-91bc-6f3bf94e12a7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:27.992669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff608379-8d94-4e8a-91bc-6f3bf94e12a7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:28.154480 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ff608379-8d94-4e8a-91bc-6f3bf94e12a7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:28.162744 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ff608379-8d94-4e8a-91bc-6f3bf94e12a7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.199251 Oct 04 19:13:28.163621 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3831/7667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:27 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:29.186938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2d934505-cbf8-4ee7-810a-658081e7ecf9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:29.187660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2d934505-cbf8-4ee7-810a-658081e7ecf9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:29.212005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d934505-cbf8-4ee7-810a-658081e7ecf9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:29.212837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d934505-cbf8-4ee7-810a-658081e7ecf9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:29.213477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d934505-cbf8-4ee7-810a-658081e7ecf9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:29.214887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d934505-cbf8-4ee7-810a-658081e7ecf9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:29.215573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d934505-cbf8-4ee7-810a-658081e7ecf9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:29.216212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2d934505-cbf8-4ee7-810a-658081e7ecf9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:29.363352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2d934505-cbf8-4ee7-810a-658081e7ecf9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:29.371160 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2d934505-cbf8-4ee7-810a-658081e7ecf9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.188076 Oct 04 19:13:29.371671 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3837/7668] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:29 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:30.397493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-65f1ed82-c23d-47c6-b8db-26f24d998fa8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:30.399236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-65f1ed82-c23d-47c6-b8db-26f24d998fa8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:30.408341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65f1ed82-c23d-47c6-b8db-26f24d998fa8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:30.409033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65f1ed82-c23d-47c6-b8db-26f24d998fa8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:30.410208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65f1ed82-c23d-47c6-b8db-26f24d998fa8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:30.411135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65f1ed82-c23d-47c6-b8db-26f24d998fa8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:30.411684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65f1ed82-c23d-47c6-b8db-26f24d998fa8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:30.412203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-65f1ed82-c23d-47c6-b8db-26f24d998fa8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:30.561778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-65f1ed82-c23d-47c6-b8db-26f24d998fa8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:30.570766 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-65f1ed82-c23d-47c6-b8db-26f24d998fa8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.180741 Oct 04 19:13:30.571716 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3832/7669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:30 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:31.594528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ad8f41c6-3257-4191-8b65-678b5658de7a tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:31.595185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ad8f41c6-3257-4191-8b65-678b5658de7a tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:31.602701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8f41c6-3257-4191-8b65-678b5658de7a tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:31.603248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8f41c6-3257-4191-8b65-678b5658de7a tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:31.603693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8f41c6-3257-4191-8b65-678b5658de7a tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:31.604391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8f41c6-3257-4191-8b65-678b5658de7a tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:31.604852 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8f41c6-3257-4191-8b65-678b5658de7a tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:31.605285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ad8f41c6-3257-4191-8b65-678b5658de7a tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:31.743655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ad8f41c6-3257-4191-8b65-678b5658de7a tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:31.751371 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ad8f41c6-3257-4191-8b65-678b5658de7a tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.160681 Oct 04 19:13:31.751943 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3838/7670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:31 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:32.774799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ae42d0cc-eacc-4112-af5a-37119b389e58 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:32.775493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ae42d0cc-eacc-4112-af5a-37119b389e58 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:32.778193 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:32.778871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:32.785518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae42d0cc-eacc-4112-af5a-37119b389e58 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:32.785976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae42d0cc-eacc-4112-af5a-37119b389e58 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:32.786436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae42d0cc-eacc-4112-af5a-37119b389e58 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:32.787180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae42d0cc-eacc-4112-af5a-37119b389e58 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:32.787661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae42d0cc-eacc-4112-af5a-37119b389e58 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:32.788141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ae42d0cc-eacc-4112-af5a-37119b389e58 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:32.923952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ae42d0cc-eacc-4112-af5a-37119b389e58 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:32.932410 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ae42d0cc-eacc-4112-af5a-37119b389e58 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.161641 Oct 04 19:13:32.932994 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3833/7671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:32 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:33.955133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3b61ebc5-0289-4afc-9a6c-0ddaaee69ea4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:33.955750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3b61ebc5-0289-4afc-9a6c-0ddaaee69ea4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:33.957610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:33.963834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b61ebc5-0289-4afc-9a6c-0ddaaee69ea4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:33.964317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b61ebc5-0289-4afc-9a6c-0ddaaee69ea4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:33.964754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b61ebc5-0289-4afc-9a6c-0ddaaee69ea4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:33.965472 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b61ebc5-0289-4afc-9a6c-0ddaaee69ea4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:33.965925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b61ebc5-0289-4afc-9a6c-0ddaaee69ea4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:33.966356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3b61ebc5-0289-4afc-9a6c-0ddaaee69ea4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:34.094108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3b61ebc5-0289-4afc-9a6c-0ddaaee69ea4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:34.102412 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3b61ebc5-0289-4afc-9a6c-0ddaaee69ea4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.151427 Oct 04 19:13:34.103157 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3839/7672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:33 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:35.125274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-38b8091d-3432-4a6f-976d-4b157e58fd2b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:35.125916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-38b8091d-3432-4a6f-976d-4b157e58fd2b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:35.133460 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b8091d-3432-4a6f-976d-4b157e58fd2b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:35.133976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b8091d-3432-4a6f-976d-4b157e58fd2b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:35.134438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b8091d-3432-4a6f-976d-4b157e58fd2b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:35.135195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b8091d-3432-4a6f-976d-4b157e58fd2b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:35.135674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b8091d-3432-4a6f-976d-4b157e58fd2b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:35.136121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-38b8091d-3432-4a6f-976d-4b157e58fd2b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:35.269324 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-38b8091d-3432-4a6f-976d-4b157e58fd2b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:35.283889 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-38b8091d-3432-4a6f-976d-4b157e58fd2b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.162452 Oct 04 19:13:35.285205 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3834/7673] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:35 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:35.521430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-23d630c9-c281-40e4-8e22-ae508fd00ca6 req-d919102f-f967-4c3e-954e-fa7c6ac0d90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802a853e-74b0-4084-bca5-6c9b2897c55b", "tag": "f5f69694-b836-40e9-943c-113ed9edb829"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:35.545327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-23d630c9-c281-40e4-8e22-ae508fd00ca6 req-d919102f-f967-4c3e-954e-fa7c6ac0d90a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:35.546907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-23d630c9-c281-40e4-8e22-ae508fd00ca6 req-d919102f-f967-4c3e-954e-fa7c6ac0d90a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:35.547934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-23d630c9-c281-40e4-8e22-ae508fd00ca6 req-d919102f-f967-4c3e-954e-fa7c6ac0d90a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:35.560693 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-23d630c9-c281-40e4-8e22-ae508fd00ca6 req-d919102f-f967-4c3e-954e-fa7c6ac0d90a service nova] Creating event network-changed:f5f69694-b836-40e9-943c-113ed9edb829 for instance 802a853e-74b0-4084-bca5-6c9b2897c55b on n-h2-850499-14 Oct 04 19:13:35.565811 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-23d630c9-c281-40e4-8e22-ae508fd00ca6 req-d919102f-f967-4c3e-954e-fa7c6ac0d90a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053699 Oct 04 19:13:35.566444 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3840/7674] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:36.308610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-15566ae1-c1fd-4c47-a5c1-309e88ccec84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:36.309177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-15566ae1-c1fd-4c47-a5c1-309e88ccec84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:36.316729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15566ae1-c1fd-4c47-a5c1-309e88ccec84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:36.317243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15566ae1-c1fd-4c47-a5c1-309e88ccec84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:36.317707 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15566ae1-c1fd-4c47-a5c1-309e88ccec84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:36.318433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15566ae1-c1fd-4c47-a5c1-309e88ccec84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:36.318915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15566ae1-c1fd-4c47-a5c1-309e88ccec84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:36.319395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-15566ae1-c1fd-4c47-a5c1-309e88ccec84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:36.459422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-15566ae1-c1fd-4c47-a5c1-309e88ccec84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:36.467044 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-15566ae1-c1fd-4c47-a5c1-309e88ccec84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.162477 Oct 04 19:13:36.467741 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3835/7675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:36 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:37.492089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a879174-d228-41dc-91a8-9240920b31a8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:37.492893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a879174-d228-41dc-91a8-9240920b31a8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:37.499031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a879174-d228-41dc-91a8-9240920b31a8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:37.499520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a879174-d228-41dc-91a8-9240920b31a8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:37.499957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a879174-d228-41dc-91a8-9240920b31a8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:37.500646 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a879174-d228-41dc-91a8-9240920b31a8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:37.501098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a879174-d228-41dc-91a8-9240920b31a8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:37.501524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a879174-d228-41dc-91a8-9240920b31a8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:37.631080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a879174-d228-41dc-91a8-9240920b31a8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:37.638635 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a879174-d228-41dc-91a8-9240920b31a8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.152309 Oct 04 19:13:37.639257 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3841/7676] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:37 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:38.661471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fbec69f5-97b7-4428-b981-08eadbba382c tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:38.662106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fbec69f5-97b7-4428-b981-08eadbba382c tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:38.669027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbec69f5-97b7-4428-b981-08eadbba382c tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:38.669562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbec69f5-97b7-4428-b981-08eadbba382c tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:38.670023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbec69f5-97b7-4428-b981-08eadbba382c tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:38.670747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbec69f5-97b7-4428-b981-08eadbba382c tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:38.671251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbec69f5-97b7-4428-b981-08eadbba382c tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:38.671703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fbec69f5-97b7-4428-b981-08eadbba382c tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:38.802705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fbec69f5-97b7-4428-b981-08eadbba382c tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:38.810463 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fbec69f5-97b7-4428-b981-08eadbba382c tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.153005 Oct 04 19:13:38.811095 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3836/7677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:38 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:39.834011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-95497c7a-2df7-48d6-af92-5c890b1d0bb4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:39.834557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-95497c7a-2df7-48d6-af92-5c890b1d0bb4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:39.841477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95497c7a-2df7-48d6-af92-5c890b1d0bb4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:39.842074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95497c7a-2df7-48d6-af92-5c890b1d0bb4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:39.842516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95497c7a-2df7-48d6-af92-5c890b1d0bb4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:39.843363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95497c7a-2df7-48d6-af92-5c890b1d0bb4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:39.843819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95497c7a-2df7-48d6-af92-5c890b1d0bb4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:39.844236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-95497c7a-2df7-48d6-af92-5c890b1d0bb4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:39.977599 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-95497c7a-2df7-48d6-af92-5c890b1d0bb4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:39.985201 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-95497c7a-2df7-48d6-af92-5c890b1d0bb4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.155265 Oct 04 19:13:39.985762 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3842/7678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:39 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:41.008990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-557a1cf7-b8bb-401c-92c5-cbc1f79496c7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:41.009744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-557a1cf7-b8bb-401c-92c5-cbc1f79496c7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:41.016713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557a1cf7-b8bb-401c-92c5-cbc1f79496c7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:41.017228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557a1cf7-b8bb-401c-92c5-cbc1f79496c7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:41.017691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557a1cf7-b8bb-401c-92c5-cbc1f79496c7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:41.018420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557a1cf7-b8bb-401c-92c5-cbc1f79496c7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:41.018903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557a1cf7-b8bb-401c-92c5-cbc1f79496c7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:41.019374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-557a1cf7-b8bb-401c-92c5-cbc1f79496c7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:41.153501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-557a1cf7-b8bb-401c-92c5-cbc1f79496c7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:41.161363 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-557a1cf7-b8bb-401c-92c5-cbc1f79496c7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.156301 Oct 04 19:13:41.161948 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3837/7679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:41 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:42.184901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b0ae9eaa-901f-4fe5-be59-e142a1278677 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:42.185517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b0ae9eaa-901f-4fe5-be59-e142a1278677 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:42.192885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ae9eaa-901f-4fe5-be59-e142a1278677 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:42.193371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ae9eaa-901f-4fe5-be59-e142a1278677 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:42.193808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ae9eaa-901f-4fe5-be59-e142a1278677 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:42.194493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ae9eaa-901f-4fe5-be59-e142a1278677 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:42.195037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ae9eaa-901f-4fe5-be59-e142a1278677 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:42.195412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0ae9eaa-901f-4fe5-be59-e142a1278677 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:42.327977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b0ae9eaa-901f-4fe5-be59-e142a1278677 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:42.336279 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b0ae9eaa-901f-4fe5-be59-e142a1278677 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.155325 Oct 04 19:13:42.336861 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3843/7680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:42 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:43.026393 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-96460bc1-d1fb-421a-9209-c7ca832d96d5 req-9a51d92e-2621-4501-a691-c540fe488f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802a853e-74b0-4084-bca5-6c9b2897c55b", "name": "network-vif-plugged", "status": "completed", "tag": "f5f69694-b836-40e9-943c-113ed9edb829"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:43.037448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-96460bc1-d1fb-421a-9209-c7ca832d96d5 req-9a51d92e-2621-4501-a691-c540fe488f00 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:43.037945 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-96460bc1-d1fb-421a-9209-c7ca832d96d5 req-9a51d92e-2621-4501-a691-c540fe488f00 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:43.038400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-96460bc1-d1fb-421a-9209-c7ca832d96d5 req-9a51d92e-2621-4501-a691-c540fe488f00 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:43.050563 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-96460bc1-d1fb-421a-9209-c7ca832d96d5 req-9a51d92e-2621-4501-a691-c540fe488f00 service nova] Creating event network-vif-plugged:f5f69694-b836-40e9-943c-113ed9edb829 for instance 802a853e-74b0-4084-bca5-6c9b2897c55b on n-h2-850499-14 Oct 04 19:13:43.055881 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-96460bc1-d1fb-421a-9209-c7ca832d96d5 req-9a51d92e-2621-4501-a691-c540fe488f00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033266 Oct 04 19:13:43.056488 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3838/7681] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:43.358029 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-46856ea6-ff68-42ff-b90b-613875412062 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:43.358642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-46856ea6-ff68-42ff-b90b-613875412062 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:43.366155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46856ea6-ff68-42ff-b90b-613875412062 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:43.366642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46856ea6-ff68-42ff-b90b-613875412062 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:43.367121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46856ea6-ff68-42ff-b90b-613875412062 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:43.367827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46856ea6-ff68-42ff-b90b-613875412062 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:43.368285 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46856ea6-ff68-42ff-b90b-613875412062 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:43.368714 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46856ea6-ff68-42ff-b90b-613875412062 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:43.498758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-46856ea6-ff68-42ff-b90b-613875412062 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:43.506491 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-46856ea6-ff68-42ff-b90b-613875412062 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.152352 Oct 04 19:13:43.507091 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3844/7682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:43 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:44.531092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2993e2c9-cc08-4332-b977-9c85f33f6b0d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:44.531839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2993e2c9-cc08-4332-b977-9c85f33f6b0d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:44.538135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2993e2c9-cc08-4332-b977-9c85f33f6b0d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:44.538650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2993e2c9-cc08-4332-b977-9c85f33f6b0d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:44.539145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2993e2c9-cc08-4332-b977-9c85f33f6b0d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:44.539863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2993e2c9-cc08-4332-b977-9c85f33f6b0d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:44.540341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2993e2c9-cc08-4332-b977-9c85f33f6b0d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:44.540790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2993e2c9-cc08-4332-b977-9c85f33f6b0d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:44.677754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2993e2c9-cc08-4332-b977-9c85f33f6b0d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:44.685608 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2993e2c9-cc08-4332-b977-9c85f33f6b0d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1358 microversion: 2.1 time: 0.159714 Oct 04 19:13:44.686196 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3839/7683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:44 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:45.710883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c1c95dd0-d78d-4f2a-a23c-052a4c7a2fde tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:45.711461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c1c95dd0-d78d-4f2a-a23c-052a4c7a2fde tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:45.718292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1c95dd0-d78d-4f2a-a23c-052a4c7a2fde tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:45.719642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1c95dd0-d78d-4f2a-a23c-052a4c7a2fde tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:45.720106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1c95dd0-d78d-4f2a-a23c-052a4c7a2fde tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:45.720840 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1c95dd0-d78d-4f2a-a23c-052a4c7a2fde tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:45.721312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1c95dd0-d78d-4f2a-a23c-052a4c7a2fde tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:45.721750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c1c95dd0-d78d-4f2a-a23c-052a4c7a2fde tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:45.849516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c1c95dd0-d78d-4f2a-a23c-052a4c7a2fde tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:45.857264 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c1c95dd0-d78d-4f2a-a23c-052a4c7a2fde tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1548 microversion: 2.1 time: 0.151038 Oct 04 19:13:45.857843 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3845/7684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:45 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:45.880103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-eaf4da61-e7be-4738-aa98-29944c921379 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:45.880881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-eaf4da61-e7be-4738-aa98-29944c921379 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:45.887558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf4da61-e7be-4738-aa98-29944c921379 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:45.888071 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf4da61-e7be-4738-aa98-29944c921379 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:45.888530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf4da61-e7be-4738-aa98-29944c921379 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:45.889246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf4da61-e7be-4738-aa98-29944c921379 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:45.889719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf4da61-e7be-4738-aa98-29944c921379 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:45.890162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-eaf4da61-e7be-4738-aa98-29944c921379 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:46.024466 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-eaf4da61-e7be-4738-aa98-29944c921379 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:46.032277 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-eaf4da61-e7be-4738-aa98-29944c921379 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1548 microversion: 2.1 time: 0.156614 Oct 04 19:13:46.032850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3840/7685] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:45 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:46.054474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:46.059394 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:46.060160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Searching by: {'deleted': False, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2'} {{(pid=122332) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:13:46.065503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:46.066885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:46.067348 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:46.068075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:46.068525 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:46.068948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:46.092337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.multi_cell_list [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122332) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:13:46.118721 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10b38fdf-1ba3-4a4b-8864-305f0d6626c9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068499 Oct 04 19:13:46.119351 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3846/7686] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 19:13:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:46.131662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-55ad9a26-2f24-4459-ab45-b15d04ecb781 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:46.132305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-55ad9a26-2f24-4459-ab45-b15d04ecb781 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:46.138434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55ad9a26-2f24-4459-ab45-b15d04ecb781 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:46.139211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55ad9a26-2f24-4459-ab45-b15d04ecb781 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:46.139465 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55ad9a26-2f24-4459-ab45-b15d04ecb781 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:46.140177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55ad9a26-2f24-4459-ab45-b15d04ecb781 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:46.140658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55ad9a26-2f24-4459-ab45-b15d04ecb781 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:46.141111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55ad9a26-2f24-4459-ab45-b15d04ecb781 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:46.268297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-55ad9a26-2f24-4459-ab45-b15d04ecb781 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:46.276506 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-55ad9a26-2f24-4459-ab45-b15d04ecb781 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1548 microversion: 2.1 time: 0.149317 Oct 04 19:13:46.277077 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3841/7687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:46 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:47.824641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-20c967a5-3a8e-427d-a953-338f31e78afb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49dac130-20d4-4c95-9e53-49aad39ccb9d"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:47.827001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-20c967a5-3a8e-427d-a953-338f31e78afb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:47.833834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20c967a5-3a8e-427d-a953-338f31e78afb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:47.834333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20c967a5-3a8e-427d-a953-338f31e78afb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:47.834780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20c967a5-3a8e-427d-a953-338f31e78afb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:47.835516 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20c967a5-3a8e-427d-a953-338f31e78afb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:47.835981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20c967a5-3a8e-427d-a953-338f31e78afb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:47.836415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-20c967a5-3a8e-427d-a953-338f31e78afb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:48.103323 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-20c967a5-3a8e-427d-a953-338f31e78afb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282358 Oct 04 19:13:48.109501 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3847/7688] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 19:13:47 2022] POST /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:14:01.211270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:01.212151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=76 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:01.216254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ce836ee3-f74d-4476-8244-68aa6b53d873 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:01.216892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ce836ee3-f74d-4476-8244-68aa6b53d873 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:01.224357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce836ee3-f74d-4476-8244-68aa6b53d873 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:01.224866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce836ee3-f74d-4476-8244-68aa6b53d873 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:01.225329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce836ee3-f74d-4476-8244-68aa6b53d873 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:01.226048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce836ee3-f74d-4476-8244-68aa6b53d873 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:01.226526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce836ee3-f74d-4476-8244-68aa6b53d873 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:01.226991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ce836ee3-f74d-4476-8244-68aa6b53d873 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:01.355998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ce836ee3-f74d-4476-8244-68aa6b53d873 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:01.364812 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ce836ee3-f74d-4476-8244-68aa6b53d873 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1594 microversion: 2.1 time: 0.154945 Oct 04 19:14:01.365393 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3842/7689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:01 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:03.397545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:03.398863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:03.399872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:03.405036 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-86fb08c3-b643-4d68-bb3c-d90439fecd3b req-d7a456f2-8f48-4e4d-b731-6837e576cddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802a853e-74b0-4084-bca5-6c9b2897c55b", "tag": "f5f69694-b836-40e9-943c-113ed9edb829"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:03.419659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-86fb08c3-b643-4d68-bb3c-d90439fecd3b req-d7a456f2-8f48-4e4d-b731-6837e576cddf service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:03.420124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-86fb08c3-b643-4d68-bb3c-d90439fecd3b req-d7a456f2-8f48-4e4d-b731-6837e576cddf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:03.420812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-86fb08c3-b643-4d68-bb3c-d90439fecd3b req-d7a456f2-8f48-4e4d-b731-6837e576cddf service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:03.434754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-86fb08c3-b643-4d68-bb3c-d90439fecd3b req-d7a456f2-8f48-4e4d-b731-6837e576cddf service nova] Creating event network-changed:f5f69694-b836-40e9-943c-113ed9edb829 for instance 802a853e-74b0-4084-bca5-6c9b2897c55b on n-h2-850499-14 Oct 04 19:14:03.440317 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-86fb08c3-b643-4d68-bb3c-d90439fecd3b req-d7a456f2-8f48-4e4d-b731-6837e576cddf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045317 Oct 04 19:14:03.441445 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3848/7690] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:14:04.397565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-82ebc5d7-1347-4e06-abe5-2621a12e6321 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2040620257"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:04.398128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-82ebc5d7-1347-4e06-abe5-2621a12e6321 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:04.405302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82ebc5d7-1347-4e06-abe5-2621a12e6321 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:04.405810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82ebc5d7-1347-4e06-abe5-2621a12e6321 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:04.406482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82ebc5d7-1347-4e06-abe5-2621a12e6321 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:04.407237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82ebc5d7-1347-4e06-abe5-2621a12e6321 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:04.407714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82ebc5d7-1347-4e06-abe5-2621a12e6321 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:04.408159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-82ebc5d7-1347-4e06-abe5-2621a12e6321 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:04.539495 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.network.security_group_api [None req-82ebc5d7-1347-4e06-abe5-2621a12e6321 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Adding security group f5cfe50d-f357-4881-83e8-38e8e09d0d76 to port f5f69694-b836-40e9-943c-113ed9edb829 Oct 04 19:14:04.855521 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-82ebc5d7-1347-4e06-abe5-2621a12e6321 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/action" status: 202 len: 0 microversion: 2.1 time: 0.461823 Oct 04 19:14:04.856338 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3843/7691] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:14:04 2022] POST /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:14:04.864813 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9cec0533-0365-4853-9ba9-489713e789cf tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:04.865450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9cec0533-0365-4853-9ba9-489713e789cf tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:04.872019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cec0533-0365-4853-9ba9-489713e789cf tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:04.872532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cec0533-0365-4853-9ba9-489713e789cf tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:04.872989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cec0533-0365-4853-9ba9-489713e789cf tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:04.873904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cec0533-0365-4853-9ba9-489713e789cf tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:04.875388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cec0533-0365-4853-9ba9-489713e789cf tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:04.876105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9cec0533-0365-4853-9ba9-489713e789cf tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.065441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-6e25b9af-278d-473f-9879-2bda996d9deb req-b1ef3e29-f949-4dee-9046-f57eb49a11e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802a853e-74b0-4084-bca5-6c9b2897c55b", "tag": "f5f69694-b836-40e9-943c-113ed9edb829"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:05.070740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9cec0533-0365-4853-9ba9-489713e789cf tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:05.077223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6e25b9af-278d-473f-9879-2bda996d9deb req-b1ef3e29-f949-4dee-9046-f57eb49a11e9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.078001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6e25b9af-278d-473f-9879-2bda996d9deb req-b1ef3e29-f949-4dee-9046-f57eb49a11e9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.078440 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-6e25b9af-278d-473f-9879-2bda996d9deb req-b1ef3e29-f949-4dee-9046-f57eb49a11e9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.080419 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9cec0533-0365-4853-9ba9-489713e789cf tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1759 microversion: 2.1 time: 0.219727 Oct 04 19:14:05.081812 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3844/7692] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:04 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1759 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:05.090206 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-6e25b9af-278d-473f-9879-2bda996d9deb req-b1ef3e29-f949-4dee-9046-f57eb49a11e9 service nova] Creating event network-changed:f5f69694-b836-40e9-943c-113ed9edb829 for instance 802a853e-74b0-4084-bca5-6c9b2897c55b on n-h2-850499-14 Oct 04 19:14:05.095466 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-6e25b9af-278d-473f-9879-2bda996d9deb req-b1ef3e29-f949-4dee-9046-f57eb49a11e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235255 Oct 04 19:14:05.096542 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3849/7693] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:16:26.255138 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:16:26.257147 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:16:26.257544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:26.258293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=16 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:26.259149 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:16:26.259303 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:16:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/action (ip 10.222.0.18) !!! Oct 04 19:16:26.260925 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:16:26.261047 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:16:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/action (ip 10.222.0.18) !!! Oct 04 19:16:26.261997 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:16:26.262150 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:16:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/action (ip 10.222.0.18) !!! Oct 04 19:16:26.267662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6711eaf1-8345-480f-aeaf-fb942aa83d30 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:26.271047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6711eaf1-8345-480f-aeaf-fb942aa83d30 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:26.281267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6711eaf1-8345-480f-aeaf-fb942aa83d30 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:26.281780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6711eaf1-8345-480f-aeaf-fb942aa83d30 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:26.282248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6711eaf1-8345-480f-aeaf-fb942aa83d30 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:26.283000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6711eaf1-8345-480f-aeaf-fb942aa83d30 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:26.283492 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6711eaf1-8345-480f-aeaf-fb942aa83d30 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:26.283947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6711eaf1-8345-480f-aeaf-fb942aa83d30 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:26.357533 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6711eaf1-8345-480f-aeaf-fb942aa83d30 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/action" status: 202 len: 0 microversion: 2.1 time: 0.104038 Oct 04 19:16:26.361199 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3845/7694] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:16:26 2022] POST /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:16:26.364893 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10ce8cfd-1d4b-4064-b672-e66ecfbcf18f] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:16:26.366333 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:16:26.366931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:26.368186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:26.369619 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:16:26.369862 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:16:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b (ip 10.222.0.18) !!! Oct 04 19:16:26.373194 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:16:26.373572 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:16:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b (ip 10.222.0.18) !!! Oct 04 19:16:26.380403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1ab3044-647b-481d-adef-b628f0df0275 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:26.381857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1ab3044-647b-481d-adef-b628f0df0275 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:26.399531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1ab3044-647b-481d-adef-b628f0df0275 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:26.400025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1ab3044-647b-481d-adef-b628f0df0275 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:26.400473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1ab3044-647b-481d-adef-b628f0df0275 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:26.401177 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1ab3044-647b-481d-adef-b628f0df0275 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:26.401637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1ab3044-647b-481d-adef-b628f0df0275 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:26.402085 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1ab3044-647b-481d-adef-b628f0df0275 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:26.600716 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e1ab3044-647b-481d-adef-b628f0df0275 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:26.609042 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1ab3044-647b-481d-adef-b628f0df0275 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1761 microversion: 2.1 time: 0.246318 Oct 04 19:16:26.609613 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3850/7695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:26 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1761 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:27.637286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21bd8082-3011-4f21-9941-4bb6c0f6d28f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:27.638035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21bd8082-3011-4f21-9941-4bb6c0f6d28f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:27.647341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21bd8082-3011-4f21-9941-4bb6c0f6d28f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:27.647850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21bd8082-3011-4f21-9941-4bb6c0f6d28f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:27.648315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21bd8082-3011-4f21-9941-4bb6c0f6d28f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:27.649039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21bd8082-3011-4f21-9941-4bb6c0f6d28f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:27.649516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21bd8082-3011-4f21-9941-4bb6c0f6d28f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:27.649964 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21bd8082-3011-4f21-9941-4bb6c0f6d28f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:27.650697 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48972. Oct 04 19:16:27.655564 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48970. Oct 04 19:16:27.874417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-21bd8082-3011-4f21-9941-4bb6c0f6d28f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:27.883465 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21bd8082-3011-4f21-9941-4bb6c0f6d28f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1766 microversion: 2.1 time: 0.253420 Oct 04 19:16:27.884052 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3846/7696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:27 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1766 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:28.907677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-05a1cae1-1fa8-4471-a96e-447ff6f4e314 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:28.908224 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-05a1cae1-1fa8-4471-a96e-447ff6f4e314 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:28.922930 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48980. Oct 04 19:16:28.924388 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a1cae1-1fa8-4471-a96e-447ff6f4e314 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:28.924882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a1cae1-1fa8-4471-a96e-447ff6f4e314 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:28.925327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a1cae1-1fa8-4471-a96e-447ff6f4e314 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:28.926034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a1cae1-1fa8-4471-a96e-447ff6f4e314 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:28.926520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a1cae1-1fa8-4471-a96e-447ff6f4e314 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:28.927001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-05a1cae1-1fa8-4471-a96e-447ff6f4e314 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:28.933846 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [10ce8cfd-1d4b-4064-b672-e66ecfbcf18f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48978. Oct 04 19:16:29.068179 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-05a1cae1-1fa8-4471-a96e-447ff6f4e314 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:29.076436 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-05a1cae1-1fa8-4471-a96e-447ff6f4e314 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1759 microversion: 2.1 time: 0.172731 Oct 04 19:16:29.077006 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3851/7697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:28 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:13.226755 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:13.227594 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:13.284998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d907899-d660-4e68-9332-6800706febc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2040620257"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:13.285563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0d907899-d660-4e68-9332-6800706febc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:13.291608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d907899-d660-4e68-9332-6800706febc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:13.292115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d907899-d660-4e68-9332-6800706febc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:13.292574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d907899-d660-4e68-9332-6800706febc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:13.293282 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d907899-d660-4e68-9332-6800706febc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:13.293769 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d907899-d660-4e68-9332-6800706febc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:13.294217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0d907899-d660-4e68-9332-6800706febc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:13.427772 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.network.security_group_api [None req-0d907899-d660-4e68-9332-6800706febc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Removing security group f5cfe50d-f357-4881-83e8-38e8e09d0d76 from port f5f69694-b836-40e9-943c-113ed9edb829 Oct 04 19:18:13.748445 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0d907899-d660-4e68-9332-6800706febc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/action" status: 202 len: 0 microversion: 2.1 time: 0.523586 Oct 04 19:18:13.752226 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3847/7698] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:18:13 2022] POST /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:18:13.757014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:13.759377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=12 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:13.760853 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:18:13.761202 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:18:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 04 19:18:13.766875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-e22e45b2-5be9-4e0f-bc38-da2602a5a0ca req-4c25d4aa-12d3-4ad7-9ffe-5ff7e0c5b08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802a853e-74b0-4084-bca5-6c9b2897c55b", "tag": "f5f69694-b836-40e9-943c-113ed9edb829"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:13.781836 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e22e45b2-5be9-4e0f-bc38-da2602a5a0ca req-4c25d4aa-12d3-4ad7-9ffe-5ff7e0c5b08c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:13.783342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e22e45b2-5be9-4e0f-bc38-da2602a5a0ca req-4c25d4aa-12d3-4ad7-9ffe-5ff7e0c5b08c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:13.783990 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-e22e45b2-5be9-4e0f-bc38-da2602a5a0ca req-4c25d4aa-12d3-4ad7-9ffe-5ff7e0c5b08c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:13.805340 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-e22e45b2-5be9-4e0f-bc38-da2602a5a0ca req-4c25d4aa-12d3-4ad7-9ffe-5ff7e0c5b08c service nova] Creating event network-changed:f5f69694-b836-40e9-943c-113ed9edb829 for instance 802a853e-74b0-4084-bca5-6c9b2897c55b on n-h2-850499-14 Oct 04 19:18:13.827754 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-e22e45b2-5be9-4e0f-bc38-da2602a5a0ca req-4c25d4aa-12d3-4ad7-9ffe-5ff7e0c5b08c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072174 Oct 04 19:18:13.831844 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3852/7699] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:14.839256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e7b5af26-86c6-4e61-bf5b-16bdf46b0127 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:14.839811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e7b5af26-86c6-4e61-bf5b-16bdf46b0127 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:14.845821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7b5af26-86c6-4e61-bf5b-16bdf46b0127 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:14.846323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7b5af26-86c6-4e61-bf5b-16bdf46b0127 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:14.846778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7b5af26-86c6-4e61-bf5b-16bdf46b0127 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:14.847515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7b5af26-86c6-4e61-bf5b-16bdf46b0127 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:14.847993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7b5af26-86c6-4e61-bf5b-16bdf46b0127 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:14.848435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7b5af26-86c6-4e61-bf5b-16bdf46b0127 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:14.931042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-e7b5af26-86c6-4e61-bf5b-16bdf46b0127 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lazy-loading 'services' on Instance uuid 802a853e-74b0-4084-bca5-6c9b2897c55b {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:18:15.006544 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e7b5af26-86c6-4e61-bf5b-16bdf46b0127 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "DELETE /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments/49dac130-20d4-4c95-9e53-49aad39ccb9d" status: 202 len: 0 microversion: 2.1 time: 0.172874 Oct 04 19:18:15.008271 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3848/7700] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 19:18:14 2022] DELETE /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments/49dac130-20d4-4c95-9e53-49aad39ccb9d => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:18:15.018374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6834ed5e-e754-4ce3-8c43-8dab1fd43a00 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:15.020932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6834ed5e-e754-4ce3-8c43-8dab1fd43a00 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:15.030776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6834ed5e-e754-4ce3-8c43-8dab1fd43a00 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.031747 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6834ed5e-e754-4ce3-8c43-8dab1fd43a00 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.031886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6834ed5e-e754-4ce3-8c43-8dab1fd43a00 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.033384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6834ed5e-e754-4ce3-8c43-8dab1fd43a00 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.033920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6834ed5e-e754-4ce3-8c43-8dab1fd43a00 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.034430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6834ed5e-e754-4ce3-8c43-8dab1fd43a00 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.065985 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6834ed5e-e754-4ce3-8c43-8dab1fd43a00 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052664 Oct 04 19:18:15.066457 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3853/7701] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:18:15 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:15.843418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-fe4c21d9-ff5d-43cd-aa25-8202cea6781f req-491fe1d9-2257-4e11-972a-020d54471cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802a853e-74b0-4084-bca5-6c9b2897c55b", "tag": "f5f69694-b836-40e9-943c-113ed9edb829"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:15.854924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fe4c21d9-ff5d-43cd-aa25-8202cea6781f req-491fe1d9-2257-4e11-972a-020d54471cfc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.855450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fe4c21d9-ff5d-43cd-aa25-8202cea6781f req-491fe1d9-2257-4e11-972a-020d54471cfc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.855907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-fe4c21d9-ff5d-43cd-aa25-8202cea6781f req-491fe1d9-2257-4e11-972a-020d54471cfc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.867108 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-fe4c21d9-ff5d-43cd-aa25-8202cea6781f req-491fe1d9-2257-4e11-972a-020d54471cfc service nova] Creating event network-changed:f5f69694-b836-40e9-943c-113ed9edb829 for instance 802a853e-74b0-4084-bca5-6c9b2897c55b on n-h2-850499-14 Oct 04 19:18:15.871906 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-fe4c21d9-ff5d-43cd-aa25-8202cea6781f req-491fe1d9-2257-4e11-972a-020d54471cfc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032775 Oct 04 19:18:15.872506 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3849/7702] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:18:16.079480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-09cb9fa9-dae7-4454-afb4-1cd437a7c7f1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:16.081654 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-09cb9fa9-dae7-4454-afb4-1cd437a7c7f1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:16.089093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09cb9fa9-dae7-4454-afb4-1cd437a7c7f1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:16.089582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09cb9fa9-dae7-4454-afb4-1cd437a7c7f1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:16.090022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09cb9fa9-dae7-4454-afb4-1cd437a7c7f1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:16.090728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09cb9fa9-dae7-4454-afb4-1cd437a7c7f1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:16.091211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09cb9fa9-dae7-4454-afb4-1cd437a7c7f1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:16.091639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-09cb9fa9-dae7-4454-afb4-1cd437a7c7f1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:16.124540 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-09cb9fa9-dae7-4454-afb4-1cd437a7c7f1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049177 Oct 04 19:18:16.125113 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3854/7703] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:18:16 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:17.139022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4d25f972-a8b2-4a93-92a5-230232f5f398 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:17.141339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4d25f972-a8b2-4a93-92a5-230232f5f398 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:17.151035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d25f972-a8b2-4a93-92a5-230232f5f398 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:17.151554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d25f972-a8b2-4a93-92a5-230232f5f398 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:17.152022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d25f972-a8b2-4a93-92a5-230232f5f398 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:17.152760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d25f972-a8b2-4a93-92a5-230232f5f398 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:17.153241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d25f972-a8b2-4a93-92a5-230232f5f398 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:17.153747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4d25f972-a8b2-4a93-92a5-230232f5f398 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:17.184910 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4d25f972-a8b2-4a93-92a5-230232f5f398 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051099 Oct 04 19:18:17.185516 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3850/7704] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:18:17 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:18.197661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a0ae4b6-bff5-485c-88ac-2d82c5bcd6a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:18.199820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a0ae4b6-bff5-485c-88ac-2d82c5bcd6a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:18.206697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0ae4b6-bff5-485c-88ac-2d82c5bcd6a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:18.207212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0ae4b6-bff5-485c-88ac-2d82c5bcd6a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:18.207652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0ae4b6-bff5-485c-88ac-2d82c5bcd6a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:18.208347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0ae4b6-bff5-485c-88ac-2d82c5bcd6a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:18.208797 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0ae4b6-bff5-485c-88ac-2d82c5bcd6a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:18.209217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a0ae4b6-bff5-485c-88ac-2d82c5bcd6a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:18.239976 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a0ae4b6-bff5-485c-88ac-2d82c5bcd6a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046344 Oct 04 19:18:18.240550 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3855/7705] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:18:18 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:19.252959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-20de6578-107c-42fc-8f0c-0905412a8cfd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:19.255233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-20de6578-107c-42fc-8f0c-0905412a8cfd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:19.262320 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20de6578-107c-42fc-8f0c-0905412a8cfd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:19.262831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20de6578-107c-42fc-8f0c-0905412a8cfd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:19.263336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20de6578-107c-42fc-8f0c-0905412a8cfd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:19.264058 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20de6578-107c-42fc-8f0c-0905412a8cfd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:19.264538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20de6578-107c-42fc-8f0c-0905412a8cfd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:19.264987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-20de6578-107c-42fc-8f0c-0905412a8cfd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:19.299853 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-20de6578-107c-42fc-8f0c-0905412a8cfd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051016 Oct 04 19:18:19.300457 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3851/7706] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:18:19 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:20.313171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b0d926a8-563b-4942-a8c7-88c4174af209 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:20.315332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b0d926a8-563b-4942-a8c7-88c4174af209 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:20.322045 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0d926a8-563b-4942-a8c7-88c4174af209 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:20.322520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0d926a8-563b-4942-a8c7-88c4174af209 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:20.322975 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0d926a8-563b-4942-a8c7-88c4174af209 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:20.323679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0d926a8-563b-4942-a8c7-88c4174af209 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:20.324129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0d926a8-563b-4942-a8c7-88c4174af209 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:20.324553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b0d926a8-563b-4942-a8c7-88c4174af209 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:20.354219 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b0d926a8-563b-4942-a8c7-88c4174af209 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044985 Oct 04 19:18:20.354776 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3856/7707] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:18:20 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:18:20.365689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:20.366238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:20.373108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:20.373610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:20.374069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:20.374784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:20.375301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:20.375750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:20.452112 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] HTTP exception thrown: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b is not attached to volume 49dac130-20d4-4c95-9e53-49aad39ccb9d Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Request method failure captured: Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: request: DELETE /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments/49dac130-20d4-4c95-9e53-49aad39ccb9d HTTP/1.1 Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIXCFM8RQFTEQ7XgJJrxwHFQe9wnt-y5L9PvO52L48ERrUnRXamQ7CoURXIEoIUdenZA9WNUKAIY-xBmN0U4hc-HvXuSt-XXAfPWOMdr3bejmKeBkM-mRLg_x4q6K8eftdHEMutzq7GyytYel2zhCOH-8mQ4jlGG6cJ8EXl2TVSkn-c Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: edcf08712c3c4a16877a2a2b6a1ab2d2 Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}] Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: edcf08712c3c4a16877a2a2b6a1ab2d2 Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestMinimumBasicScenario-1329896769-project Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ff8d6c4c13984f7c8e099a6aab553774 Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestMinimumBasicScenario-1329896769-project Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b is not attached to volume 49dac130-20d4-4c95-9e53-49aad39ccb9d Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'server_id': '802a853e-74b0-4084-bca5-6c9b2897c55b', 'id': '49dac130-20d4-4c95-9e53-49aad39ccb9d'} Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 49dac130-20d4-4c95-9e53-49aad39ccb9d. Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b is not attached to volume 49dac130-20d4-4c95-9e53-49aad39ccb9d Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:18:20.453808 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:18:20.458443 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:18:20.458443 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:18:20.458443 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b is not attached to volume 49dac130-20d4-4c95-9e53-49aad39ccb9d Oct 04 19:18:20.458443 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:18:20.458443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Returning 404 to user: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b is not attached to volume 49dac130-20d4-4c95-9e53-49aad39ccb9d {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:18:20.458443 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1149b928-a8d4-4700-9eda-810d0e497c66 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "DELETE /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments/49dac130-20d4-4c95-9e53-49aad39ccb9d" status: 404 len: 154 microversion: 2.1 time: 0.093734 Oct 04 19:18:20.458443 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3852/7708] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 19:18:20 2022] DELETE /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b/os-volume_attachments/49dac130-20d4-4c95-9e53-49aad39ccb9d => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:18:23.708859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a07cc8cd-685d-445b-9ddf-ca13f9af15ea tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:23.709352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a07cc8cd-685d-445b-9ddf-ca13f9af15ea tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:23.716046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a07cc8cd-685d-445b-9ddf-ca13f9af15ea tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:23.716532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a07cc8cd-685d-445b-9ddf-ca13f9af15ea tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:23.716976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a07cc8cd-685d-445b-9ddf-ca13f9af15ea tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:23.717662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a07cc8cd-685d-445b-9ddf-ca13f9af15ea tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:23.718114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a07cc8cd-685d-445b-9ddf-ca13f9af15ea tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:23.718542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a07cc8cd-685d-445b-9ddf-ca13f9af15ea tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:23.744289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a07cc8cd-685d-445b-9ddf-ca13f9af15ea tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:18:23.826835 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a07cc8cd-685d-445b-9ddf-ca13f9af15ea tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "DELETE /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 204 len: 0 microversion: 2.1 time: 0.121603 Oct 04 19:18:23.831314 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3857/7709] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:18:23 2022] DELETE /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:18:23.836355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-33fafad4-dae3-4ef9-aeb3-4c64b5ac7d19 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:23.837002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-33fafad4-dae3-4ef9-aeb3-4c64b5ac7d19 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:23.844794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33fafad4-dae3-4ef9-aeb3-4c64b5ac7d19 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:23.845313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33fafad4-dae3-4ef9-aeb3-4c64b5ac7d19 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:23.845777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33fafad4-dae3-4ef9-aeb3-4c64b5ac7d19 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:23.846511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33fafad4-dae3-4ef9-aeb3-4c64b5ac7d19 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:23.847021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33fafad4-dae3-4ef9-aeb3-4c64b5ac7d19 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:23.847670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-33fafad4-dae3-4ef9-aeb3-4c64b5ac7d19 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:23.991151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-33fafad4-dae3-4ef9-aeb3-4c64b5ac7d19 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:23.999646 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-33fafad4-dae3-4ef9-aeb3-4c64b5ac7d19 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1554 microversion: 2.1 time: 0.167303 Oct 04 19:18:24.000231 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3853/7710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:23 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:25.022767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d1e6f4e1-0c9d-4b36-bce7-ef427fda3a98 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:25.024013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d1e6f4e1-0c9d-4b36-bce7-ef427fda3a98 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:25.031399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e6f4e1-0c9d-4b36-bce7-ef427fda3a98 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:25.031888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e6f4e1-0c9d-4b36-bce7-ef427fda3a98 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:25.032325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e6f4e1-0c9d-4b36-bce7-ef427fda3a98 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:25.033014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e6f4e1-0c9d-4b36-bce7-ef427fda3a98 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:25.033468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e6f4e1-0c9d-4b36-bce7-ef427fda3a98 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:25.033905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1e6f4e1-0c9d-4b36-bce7-ef427fda3a98 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:25.160296 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d1e6f4e1-0c9d-4b36-bce7-ef427fda3a98 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:25.167966 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d1e6f4e1-0c9d-4b36-bce7-ef427fda3a98 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1554 microversion: 2.1 time: 0.149439 Oct 04 19:18:25.168618 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3858/7711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:25 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:26.192742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8951d219-3b70-41c0-a9ee-95675dca8fc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:26.193474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8951d219-3b70-41c0-a9ee-95675dca8fc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:26.201491 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8951d219-3b70-41c0-a9ee-95675dca8fc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:26.202090 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8951d219-3b70-41c0-a9ee-95675dca8fc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:26.202799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8951d219-3b70-41c0-a9ee-95675dca8fc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:26.203770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8951d219-3b70-41c0-a9ee-95675dca8fc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:26.204315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8951d219-3b70-41c0-a9ee-95675dca8fc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:26.205007 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8951d219-3b70-41c0-a9ee-95675dca8fc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:26.344975 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8951d219-3b70-41c0-a9ee-95675dca8fc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:26.353425 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8951d219-3b70-41c0-a9ee-95675dca8fc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 200 len: 1554 microversion: 2.1 time: 0.164484 Oct 04 19:18:26.354006 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3854/7712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:26 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:26.613837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-523c4f50-6cee-4f04-a4fa-48b2c84387b8 req-13bcca4b-18d8-46e8-8bd0-29a991e620a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802a853e-74b0-4084-bca5-6c9b2897c55b", "name": "network-vif-deleted", "tag": "f5f69694-b836-40e9-943c-113ed9edb829"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:26.623839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-523c4f50-6cee-4f04-a4fa-48b2c84387b8 req-13bcca4b-18d8-46e8-8bd0-29a991e620a7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:26.624322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-523c4f50-6cee-4f04-a4fa-48b2c84387b8 req-13bcca4b-18d8-46e8-8bd0-29a991e620a7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:26.624753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-523c4f50-6cee-4f04-a4fa-48b2c84387b8 req-13bcca4b-18d8-46e8-8bd0-29a991e620a7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:26.637363 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-523c4f50-6cee-4f04-a4fa-48b2c84387b8 req-13bcca4b-18d8-46e8-8bd0-29a991e620a7 service nova] Creating event network-vif-deleted:f5f69694-b836-40e9-943c-113ed9edb829 for instance 802a853e-74b0-4084-bca5-6c9b2897c55b on n-h2-850499-14 Oct 04 19:18:26.642974 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-523c4f50-6cee-4f04-a4fa-48b2c84387b8 req-13bcca4b-18d8-46e8-8bd0-29a991e620a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088855 Oct 04 19:18:26.643878 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3859/7713] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:27.380481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:27.381106 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: 802a853e-74b0-4084-bca5-6c9b2897c55b] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:27.388636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.389143 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.389629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.390334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.390805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.391274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.404684 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] HTTP exception thrown: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b could not be found. Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Request method failure captured: Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b HTTP/1.1 Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIXCFM8RQFTEQ7XgJJrxwHFQe9wnt-y5L9PvO52L48ERrUnRXamQ7CoURXIEoIUdenZA9WNUKAIY-xBmN0U4hc-HvXuSt-XXAfPWOMdr3bejmKeBkM-mRLg_x4q6K8eftdHEMutzq7GyytYel2zhCOH-8mQ4jlGG6cJ8EXl2TVSkn-c Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: edcf08712c3c4a16877a2a2b6a1ab2d2 Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}] Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: edcf08712c3c4a16877a2a2b6a1ab2d2 Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestMinimumBasicScenario-1329896769-project Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: ff8d6c4c13984f7c8e099a6aab553774 Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestMinimumBasicScenario-1329896769-project Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b could not be found. Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '802a853e-74b0-4084-bca5-6c9b2897c55b'} Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b could not be found. Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b could not be found. Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:18:27.406226 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:18:27.411155 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:27.411155 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:18:27.411155 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:18:27.411155 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:18:27.411155 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:18:27.411155 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b could not be found. Oct 04 19:18:27.411155 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:18:27.411155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Returning 404 to user: Instance 802a853e-74b0-4084-bca5-6c9b2897c55b could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:18:27.411155 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-17f2dfda-4771-45a4-852e-0a5446664c2d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b" status: 404 len: 111 microversion: 2.1 time: 0.031295 Oct 04 19:18:27.411155 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3855/7714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:27 2022] GET /compute/v2.1/servers/802a853e-74b0-4084-bca5-6c9b2897c55b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:18:27.417652 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f05a4dd-ecb1-4f42-b661-1d91b0bf3955 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '.version_select at 0x7fd4d0bc0550>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:27.442160 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f05a4dd-ecb1-4f42-b661-1d91b0bf3955 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1483380817" status: 202 len: 0 microversion: 2.1 time: 0.029049 Oct 04 19:18:27.442753 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3860/7715] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 19:18:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1483380817 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:18:36.789530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b211ca35-76f3-4161-8d50-fb7a4e9fb460 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'create', calling method: .version_select at 0x7fd4d1140a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1591036471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBEAIrOHdbMw31yu3Y2UsYVPA5+9sYC8dJhc0ZuKM4+L4N7Y/OBI9FmCx8r81QkWM2t6edXFonbeFLzMYT7fdUrbc4iZ0VW/5jIpMeXm1s6Qwzl97MorZHBF3jd9INAMw=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:36.808025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b211ca35-76f3-4161-8d50-fb7a4e9fb460 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Getting quotas for project edcf08712c3c4a16877a2a2b6a1ab2d2. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:18:36.814844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b211ca35-76f3-4161-8d50-fb7a4e9fb460 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Getting quotas for user ff8d6c4c13984f7c8e099a6aab553774 and project edcf08712c3c4a16877a2a2b6a1ab2d2. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:18:36.843441 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b211ca35-76f3-4161-8d50-fb7a4e9fb460 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057967 Oct 04 19:18:36.844054 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3856/7716] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:18:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:36.895402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:36.900255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-611252340", "imageRef": "79c123ae-aa84-4cdf-8cdb-f18a9e803149", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1591036471", "networks": [{"uuid": "1464267f-0f25-4474-9570-78538ee8ae2b"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:36.953754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] validate_networks() for [('1464267f-0f25-4474-9570-78538ee8ae2b', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:18:37.370144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:18:37.370976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:18:37.371762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:18:37.372580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:18:37.373018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:18:37.382295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:37.382791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:37.383275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:37.384018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:37.384487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:37.384926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:37.402082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Getting quotas for project edcf08712c3c4a16877a2a2b6a1ab2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:18:37.407601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Getting quotas for user ff8d6c4c13984f7c8e099a6aab553774 and project edcf08712c3c4a16877a2a2b6a1ab2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:18:37.420918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:18:37.423569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79c123ae-aa84-4cdf-8cdb-f18a9e803149',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:18:37.471982 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1bda24ae-79e9-49d0-b42b-aff1d0d3f202 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578513 Oct 04 19:18:37.472946 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3861/7717] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:18:37.481274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:37.485672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-55aac77b-d271-494d-b6bb-7495ea7bddc3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:37.486310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-55aac77b-d271-494d-b6bb-7495ea7bddc3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:37.884112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-55aac77b-d271-494d-b6bb-7495ea7bddc3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:37.891287 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-55aac77b-d271-494d-b6bb-7495ea7bddc3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1258 microversion: 2.1 time: 0.410754 Oct 04 19:18:37.892079 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3857/7718] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:37 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1258 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:38.916754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-782ffe71-2f9c-472e-bb6b-1d2758605eb7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:38.917576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-782ffe71-2f9c-472e-bb6b-1d2758605eb7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:38.925721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782ffe71-2f9c-472e-bb6b-1d2758605eb7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:38.926732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782ffe71-2f9c-472e-bb6b-1d2758605eb7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:38.927527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782ffe71-2f9c-472e-bb6b-1d2758605eb7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:38.930722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782ffe71-2f9c-472e-bb6b-1d2758605eb7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:38.931450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782ffe71-2f9c-472e-bb6b-1d2758605eb7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:38.931883 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-782ffe71-2f9c-472e-bb6b-1d2758605eb7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:39.010832 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-782ffe71-2f9c-472e-bb6b-1d2758605eb7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:39.023739 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-782ffe71-2f9c-472e-bb6b-1d2758605eb7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1316 microversion: 2.1 time: 0.111434 Oct 04 19:18:39.037124 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3862/7719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:38 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1316 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:40.056367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a5eb67f1-c3ea-49de-a7e3-8d1e9a52ccc8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:40.057069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a5eb67f1-c3ea-49de-a7e3-8d1e9a52ccc8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:40.064537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5eb67f1-c3ea-49de-a7e3-8d1e9a52ccc8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:40.065600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5eb67f1-c3ea-49de-a7e3-8d1e9a52ccc8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:40.066066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5eb67f1-c3ea-49de-a7e3-8d1e9a52ccc8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:40.066793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5eb67f1-c3ea-49de-a7e3-8d1e9a52ccc8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:40.067308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5eb67f1-c3ea-49de-a7e3-8d1e9a52ccc8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:40.067753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a5eb67f1-c3ea-49de-a7e3-8d1e9a52ccc8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:40.213997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a5eb67f1-c3ea-49de-a7e3-8d1e9a52ccc8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:40.222381 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a5eb67f1-c3ea-49de-a7e3-8d1e9a52ccc8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.172138 Oct 04 19:18:40.239132 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3858/7720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:40 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:41.245934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b37e3ed7-b991-4c5a-9f1e-5cc368e03270 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:41.246917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b37e3ed7-b991-4c5a-9f1e-5cc368e03270 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:41.257938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b37e3ed7-b991-4c5a-9f1e-5cc368e03270 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:41.258748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b37e3ed7-b991-4c5a-9f1e-5cc368e03270 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:41.259641 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b37e3ed7-b991-4c5a-9f1e-5cc368e03270 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:41.260696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b37e3ed7-b991-4c5a-9f1e-5cc368e03270 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:41.261463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b37e3ed7-b991-4c5a-9f1e-5cc368e03270 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:41.262275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b37e3ed7-b991-4c5a-9f1e-5cc368e03270 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:41.677078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b37e3ed7-b991-4c5a-9f1e-5cc368e03270 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:41.685458 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b37e3ed7-b991-4c5a-9f1e-5cc368e03270 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.443566 Oct 04 19:18:41.686031 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3863/7721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:41 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:42.712916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-002f074c-065f-4c40-b5b8-ad554e8ecc39 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:42.714243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-002f074c-065f-4c40-b5b8-ad554e8ecc39 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:42.722034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002f074c-065f-4c40-b5b8-ad554e8ecc39 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:42.722543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002f074c-065f-4c40-b5b8-ad554e8ecc39 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:42.723160 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002f074c-065f-4c40-b5b8-ad554e8ecc39 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:42.723918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002f074c-065f-4c40-b5b8-ad554e8ecc39 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:42.724392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002f074c-065f-4c40-b5b8-ad554e8ecc39 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:42.724838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-002f074c-065f-4c40-b5b8-ad554e8ecc39 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:42.880187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-002f074c-065f-4c40-b5b8-ad554e8ecc39 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:42.890701 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-002f074c-065f-4c40-b5b8-ad554e8ecc39 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.182025 Oct 04 19:18:42.890701 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3859/7722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:42 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:18:43.912556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-037164b8-cb21-4f22-a9c3-c8bd7f505de3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:43.913854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-037164b8-cb21-4f22-a9c3-c8bd7f505de3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:43.917616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:43.928170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-037164b8-cb21-4f22-a9c3-c8bd7f505de3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:43.929463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-037164b8-cb21-4f22-a9c3-c8bd7f505de3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:43.929994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-037164b8-cb21-4f22-a9c3-c8bd7f505de3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:43.930837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-037164b8-cb21-4f22-a9c3-c8bd7f505de3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:43.931331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-037164b8-cb21-4f22-a9c3-c8bd7f505de3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:43.931769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-037164b8-cb21-4f22-a9c3-c8bd7f505de3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:44.088678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-037164b8-cb21-4f22-a9c3-c8bd7f505de3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:44.096415 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-037164b8-cb21-4f22-a9c3-c8bd7f505de3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.187720 Oct 04 19:18:44.096980 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3864/7723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:43 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:45.125266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6228f1e9-8834-4261-a201-ef3669cb87d5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:45.125944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6228f1e9-8834-4261-a201-ef3669cb87d5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:45.129984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:45.136621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6228f1e9-8834-4261-a201-ef3669cb87d5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:45.137131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6228f1e9-8834-4261-a201-ef3669cb87d5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:45.137591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6228f1e9-8834-4261-a201-ef3669cb87d5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:45.138356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6228f1e9-8834-4261-a201-ef3669cb87d5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:45.138831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6228f1e9-8834-4261-a201-ef3669cb87d5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:45.139300 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6228f1e9-8834-4261-a201-ef3669cb87d5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:45.294574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6228f1e9-8834-4261-a201-ef3669cb87d5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:45.306059 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6228f1e9-8834-4261-a201-ef3669cb87d5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.186633 Oct 04 19:18:45.310360 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3860/7724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:45 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:46.334799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a08fd4b5-45b4-4d23-bcae-1634db3b3533 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:46.335981 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a08fd4b5-45b4-4d23-bcae-1634db3b3533 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:46.343377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08fd4b5-45b4-4d23-bcae-1634db3b3533 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:46.343870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08fd4b5-45b4-4d23-bcae-1634db3b3533 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:46.344938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08fd4b5-45b4-4d23-bcae-1634db3b3533 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:46.346068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08fd4b5-45b4-4d23-bcae-1634db3b3533 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:46.346746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08fd4b5-45b4-4d23-bcae-1634db3b3533 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:46.347200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a08fd4b5-45b4-4d23-bcae-1634db3b3533 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:46.504517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a08fd4b5-45b4-4d23-bcae-1634db3b3533 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:46.512586 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a08fd4b5-45b4-4d23-bcae-1634db3b3533 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.181721 Oct 04 19:18:46.513169 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3865/7725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:46 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:47.536761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e5317f11-e5d0-4569-b786-afe5634e9943 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:47.537467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e5317f11-e5d0-4569-b786-afe5634e9943 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:47.544704 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5317f11-e5d0-4569-b786-afe5634e9943 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:47.545211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5317f11-e5d0-4569-b786-afe5634e9943 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:47.545669 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5317f11-e5d0-4569-b786-afe5634e9943 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:47.546386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5317f11-e5d0-4569-b786-afe5634e9943 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:47.546863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5317f11-e5d0-4569-b786-afe5634e9943 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:47.547587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5317f11-e5d0-4569-b786-afe5634e9943 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:47.700145 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e5317f11-e5d0-4569-b786-afe5634e9943 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:47.708183 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e5317f11-e5d0-4569-b786-afe5634e9943 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.175391 Oct 04 19:18:47.708972 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3861/7726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:47 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:47.814869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5736b2e0-a1bf-490b-82fc-9ddc4018a860 req-acdead04-998c-44c6-84c4-9a032e4a48ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faece42e-d740-46b6-898d-644cab66e4ce", "tag": "2f185c1c-527b-423f-9dff-51365b1c9f65"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:47.820955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:47.821877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:47.829347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5736b2e0-a1bf-490b-82fc-9ddc4018a860 req-acdead04-998c-44c6-84c4-9a032e4a48ce service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:47.829978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5736b2e0-a1bf-490b-82fc-9ddc4018a860 req-acdead04-998c-44c6-84c4-9a032e4a48ce service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:47.830541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5736b2e0-a1bf-490b-82fc-9ddc4018a860 req-acdead04-998c-44c6-84c4-9a032e4a48ce service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:47.841955 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5736b2e0-a1bf-490b-82fc-9ddc4018a860 req-acdead04-998c-44c6-84c4-9a032e4a48ce service nova] Creating event network-changed:2f185c1c-527b-423f-9dff-51365b1c9f65 for instance faece42e-d740-46b6-898d-644cab66e4ce on n-h1-850499-14 Oct 04 19:18:47.847406 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5736b2e0-a1bf-490b-82fc-9ddc4018a860 req-acdead04-998c-44c6-84c4-9a032e4a48ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037773 Oct 04 19:18:47.848070 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3866/7727] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:48.730629 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2c94ca9a-6b65-4140-aa11-5c89e5d93223 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:48.731301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2c94ca9a-6b65-4140-aa11-5c89e5d93223 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:48.733158 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:48.739224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c94ca9a-6b65-4140-aa11-5c89e5d93223 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:48.739724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c94ca9a-6b65-4140-aa11-5c89e5d93223 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:48.740208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c94ca9a-6b65-4140-aa11-5c89e5d93223 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:48.740916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c94ca9a-6b65-4140-aa11-5c89e5d93223 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:48.741973 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c94ca9a-6b65-4140-aa11-5c89e5d93223 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:48.742421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2c94ca9a-6b65-4140-aa11-5c89e5d93223 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:48.879068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2c94ca9a-6b65-4140-aa11-5c89e5d93223 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:48.887028 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2c94ca9a-6b65-4140-aa11-5c89e5d93223 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.160237 Oct 04 19:18:48.887611 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3862/7728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:48 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:49.912003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a440863f-3e99-4ef5-bb74-0c58612c46a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:49.912737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a440863f-3e99-4ef5-bb74-0c58612c46a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:49.919587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a440863f-3e99-4ef5-bb74-0c58612c46a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:49.920091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a440863f-3e99-4ef5-bb74-0c58612c46a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:49.920540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a440863f-3e99-4ef5-bb74-0c58612c46a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:49.921248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a440863f-3e99-4ef5-bb74-0c58612c46a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:49.921711 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a440863f-3e99-4ef5-bb74-0c58612c46a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:49.922417 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a440863f-3e99-4ef5-bb74-0c58612c46a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:50.061373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a440863f-3e99-4ef5-bb74-0c58612c46a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:50.070155 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a440863f-3e99-4ef5-bb74-0c58612c46a4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.163479 Oct 04 19:18:50.070731 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3867/7729] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:49 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:51.093598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6df5957-302e-4f5d-b40f-9e4c78f4da9b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:51.094238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f6df5957-302e-4f5d-b40f-9e4c78f4da9b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:51.101947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6df5957-302e-4f5d-b40f-9e4c78f4da9b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:51.102456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6df5957-302e-4f5d-b40f-9e4c78f4da9b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:51.102910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6df5957-302e-4f5d-b40f-9e4c78f4da9b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:51.103660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6df5957-302e-4f5d-b40f-9e4c78f4da9b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:51.104133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6df5957-302e-4f5d-b40f-9e4c78f4da9b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:51.104577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6df5957-302e-4f5d-b40f-9e4c78f4da9b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:51.239861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f6df5957-302e-4f5d-b40f-9e4c78f4da9b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:51.247760 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6df5957-302e-4f5d-b40f-9e4c78f4da9b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.157992 Oct 04 19:18:51.248349 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3863/7730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:51 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:52.270406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3f2328e6-48ed-498b-9168-8b6abfb536cc tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:52.271150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3f2328e6-48ed-498b-9168-8b6abfb536cc tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:52.278523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f2328e6-48ed-498b-9168-8b6abfb536cc tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:52.279050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f2328e6-48ed-498b-9168-8b6abfb536cc tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:52.279497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f2328e6-48ed-498b-9168-8b6abfb536cc tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:52.280211 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f2328e6-48ed-498b-9168-8b6abfb536cc tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:52.280673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f2328e6-48ed-498b-9168-8b6abfb536cc tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:52.281105 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3f2328e6-48ed-498b-9168-8b6abfb536cc tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:52.425788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3f2328e6-48ed-498b-9168-8b6abfb536cc tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:52.439987 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3f2328e6-48ed-498b-9168-8b6abfb536cc tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.173423 Oct 04 19:18:52.451043 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3868/7731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:52 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:52.567244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-24d08757-9f65-473f-9300-2e2f8c968ffa req-ed96370d-4ea1-4ca8-a76c-c15497d469ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faece42e-d740-46b6-898d-644cab66e4ce", "name": "network-vif-plugged", "status": "completed", "tag": "2f185c1c-527b-423f-9dff-51365b1c9f65"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:52.577355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24d08757-9f65-473f-9300-2e2f8c968ffa req-ed96370d-4ea1-4ca8-a76c-c15497d469ca service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:52.577865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24d08757-9f65-473f-9300-2e2f8c968ffa req-ed96370d-4ea1-4ca8-a76c-c15497d469ca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:52.578328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-24d08757-9f65-473f-9300-2e2f8c968ffa req-ed96370d-4ea1-4ca8-a76c-c15497d469ca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:52.591272 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-24d08757-9f65-473f-9300-2e2f8c968ffa req-ed96370d-4ea1-4ca8-a76c-c15497d469ca service nova] Creating event network-vif-plugged:2f185c1c-527b-423f-9dff-51365b1c9f65 for instance faece42e-d740-46b6-898d-644cab66e4ce on n-h1-850499-14 Oct 04 19:18:52.596700 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-24d08757-9f65-473f-9300-2e2f8c968ffa req-ed96370d-4ea1-4ca8-a76c-c15497d469ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093887 Oct 04 19:18:52.597321 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3864/7732] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:53.463994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f9bc9c8a-279e-4b2b-a56d-982afcdc2bc7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:53.464618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f9bc9c8a-279e-4b2b-a56d-982afcdc2bc7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:53.471793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bc9c8a-279e-4b2b-a56d-982afcdc2bc7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:53.472300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bc9c8a-279e-4b2b-a56d-982afcdc2bc7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:53.472750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bc9c8a-279e-4b2b-a56d-982afcdc2bc7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:53.473493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bc9c8a-279e-4b2b-a56d-982afcdc2bc7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:53.473949 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bc9c8a-279e-4b2b-a56d-982afcdc2bc7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:53.474386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f9bc9c8a-279e-4b2b-a56d-982afcdc2bc7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:53.608335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f9bc9c8a-279e-4b2b-a56d-982afcdc2bc7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:53.616279 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f9bc9c8a-279e-4b2b-a56d-982afcdc2bc7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1358 microversion: 2.1 time: 0.156888 Oct 04 19:18:53.616861 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3869/7733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:53 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:54.640675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3fda31c8-af75-4458-b87f-5ac1e97757e2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:54.641404 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3fda31c8-af75-4458-b87f-5ac1e97757e2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:54.647703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fda31c8-af75-4458-b87f-5ac1e97757e2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:54.648213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fda31c8-af75-4458-b87f-5ac1e97757e2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:54.649261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fda31c8-af75-4458-b87f-5ac1e97757e2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:54.649966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fda31c8-af75-4458-b87f-5ac1e97757e2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:54.650444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fda31c8-af75-4458-b87f-5ac1e97757e2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:54.650893 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3fda31c8-af75-4458-b87f-5ac1e97757e2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:54.781541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3fda31c8-af75-4458-b87f-5ac1e97757e2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:54.789462 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3fda31c8-af75-4458-b87f-5ac1e97757e2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1547 microversion: 2.1 time: 0.154214 Oct 04 19:18:54.790040 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3865/7734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:54 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:54.812552 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-19f6b3a5-abaf-44d8-af35-ce3b26faaa43 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:54.813176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-19f6b3a5-abaf-44d8-af35-ce3b26faaa43 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:54.820291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f6b3a5-abaf-44d8-af35-ce3b26faaa43 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:54.821370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f6b3a5-abaf-44d8-af35-ce3b26faaa43 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:54.821821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f6b3a5-abaf-44d8-af35-ce3b26faaa43 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:54.822579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f6b3a5-abaf-44d8-af35-ce3b26faaa43 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:54.823069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f6b3a5-abaf-44d8-af35-ce3b26faaa43 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:54.823511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-19f6b3a5-abaf-44d8-af35-ce3b26faaa43 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:54.956821 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-19f6b3a5-abaf-44d8-af35-ce3b26faaa43 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:54.965093 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-19f6b3a5-abaf-44d8-af35-ce3b26faaa43 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1547 microversion: 2.1 time: 0.156518 Oct 04 19:18:54.965660 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3870/7735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:54 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:54.987743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:54.992634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:54.993435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Searching by: {'deleted': False, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2'} {{(pid=122331) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:18:54.998855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:54.999414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:54.999879 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:55.000637 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:55.001120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:55.001576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:55.026736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.multi_cell_list [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:18:55.055398 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7994f6ca-4929-4248-b96a-813051f44d38 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.071089 Oct 04 19:18:55.056004 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3866/7736] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 4 19:18:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:55.068333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33909ccb-c8a8-4501-b33b-c957d84a4f48 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:55.069404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33909ccb-c8a8-4501-b33b-c957d84a4f48 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:55.077588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33909ccb-c8a8-4501-b33b-c957d84a4f48 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:55.078094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33909ccb-c8a8-4501-b33b-c957d84a4f48 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:55.078533 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33909ccb-c8a8-4501-b33b-c957d84a4f48 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:55.079291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33909ccb-c8a8-4501-b33b-c957d84a4f48 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:55.079754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33909ccb-c8a8-4501-b33b-c957d84a4f48 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:55.080190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33909ccb-c8a8-4501-b33b-c957d84a4f48 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:55.209517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-33909ccb-c8a8-4501-b33b-c957d84a4f48 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:55.218269 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33909ccb-c8a8-4501-b33b-c957d84a4f48 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1547 microversion: 2.1 time: 0.154344 Oct 04 19:18:55.218873 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3871/7737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:55 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:56.758725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0bf3dfcd-7f84-421a-974c-8473ef608ddb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7c9a7a7-3078-4430-a036-33f35014fec3"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:56.761678 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0bf3dfcd-7f84-421a-974c-8473ef608ddb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:56.769011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0bf3dfcd-7f84-421a-974c-8473ef608ddb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.769524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0bf3dfcd-7f84-421a-974c-8473ef608ddb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.769990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0bf3dfcd-7f84-421a-974c-8473ef608ddb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.770715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0bf3dfcd-7f84-421a-974c-8473ef608ddb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.771260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0bf3dfcd-7f84-421a-974c-8473ef608ddb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.771711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0bf3dfcd-7f84-421a-974c-8473ef608ddb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:57.023769 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0bf3dfcd-7f84-421a-974c-8473ef608ddb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268807 Oct 04 19:18:57.024405 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3867/7738] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 4 19:18:56 2022] POST /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:07.861843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b47c7220-67a9-40c3-a0e2-b1b026f5817d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:07.862457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b47c7220-67a9-40c3-a0e2-b1b026f5817d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:07.864745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=15 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:07.865424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=58 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:07.872196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b47c7220-67a9-40c3-a0e2-b1b026f5817d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:07.872692 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b47c7220-67a9-40c3-a0e2-b1b026f5817d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:07.873130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b47c7220-67a9-40c3-a0e2-b1b026f5817d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:07.873884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b47c7220-67a9-40c3-a0e2-b1b026f5817d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:07.874341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b47c7220-67a9-40c3-a0e2-b1b026f5817d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:07.874766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b47c7220-67a9-40c3-a0e2-b1b026f5817d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:08.018690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b47c7220-67a9-40c3-a0e2-b1b026f5817d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:08.029416 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b47c7220-67a9-40c3-a0e2-b1b026f5817d tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1593 microversion: 2.1 time: 0.171696 Oct 04 19:19:08.030010 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3872/7739] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:07 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1593 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:10.108747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:10.109981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=15 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:10.111506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:10.116046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-075d7e33-7754-48ad-9e8d-1a7fca9344f3 req-2730d19d-2f34-4fd5-9d43-2f809910e6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faece42e-d740-46b6-898d-644cab66e4ce", "tag": "2f185c1c-527b-423f-9dff-51365b1c9f65"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:10.128346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-075d7e33-7754-48ad-9e8d-1a7fca9344f3 req-2730d19d-2f34-4fd5-9d43-2f809910e6ca service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:10.128859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-075d7e33-7754-48ad-9e8d-1a7fca9344f3 req-2730d19d-2f34-4fd5-9d43-2f809910e6ca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:10.129327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-075d7e33-7754-48ad-9e8d-1a7fca9344f3 req-2730d19d-2f34-4fd5-9d43-2f809910e6ca service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:10.141908 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-075d7e33-7754-48ad-9e8d-1a7fca9344f3 req-2730d19d-2f34-4fd5-9d43-2f809910e6ca service nova] Creating event network-changed:2f185c1c-527b-423f-9dff-51365b1c9f65 for instance faece42e-d740-46b6-898d-644cab66e4ce on n-h1-850499-14 Oct 04 19:19:10.147297 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-075d7e33-7754-48ad-9e8d-1a7fca9344f3 req-2730d19d-2f34-4fd5-9d43-2f809910e6ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040298 Oct 04 19:19:10.147911 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3868/7740] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:11.139898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9a9af56b-df51-4377-a82a-5cd6ccda90d6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1266027166"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:11.140468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9a9af56b-df51-4377-a82a-5cd6ccda90d6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:11.147984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a9af56b-df51-4377-a82a-5cd6ccda90d6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:11.148484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a9af56b-df51-4377-a82a-5cd6ccda90d6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:11.148935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a9af56b-df51-4377-a82a-5cd6ccda90d6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:11.149656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a9af56b-df51-4377-a82a-5cd6ccda90d6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:11.150734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a9af56b-df51-4377-a82a-5cd6ccda90d6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:11.151205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9a9af56b-df51-4377-a82a-5cd6ccda90d6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:11.287589 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.network.security_group_api [None req-9a9af56b-df51-4377-a82a-5cd6ccda90d6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Adding security group 6076931c-7c6e-4ddc-8f07-57788977645a to port 2f185c1c-527b-423f-9dff-51365b1c9f65 Oct 04 19:19:11.614487 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9a9af56b-df51-4377-a82a-5cd6ccda90d6 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/action" status: 202 len: 0 microversion: 2.1 time: 0.478494 Oct 04 19:19:11.615451 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3873/7741] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:19:11 2022] POST /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:19:11.627079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e8eb56f3-8d0d-4a20-a3df-f4541c8f134b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:11.628499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e8eb56f3-8d0d-4a20-a3df-f4541c8f134b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:11.634903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8eb56f3-8d0d-4a20-a3df-f4541c8f134b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:11.635624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8eb56f3-8d0d-4a20-a3df-f4541c8f134b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:11.636186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8eb56f3-8d0d-4a20-a3df-f4541c8f134b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:11.637019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8eb56f3-8d0d-4a20-a3df-f4541c8f134b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:11.637597 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8eb56f3-8d0d-4a20-a3df-f4541c8f134b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:11.638146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e8eb56f3-8d0d-4a20-a3df-f4541c8f134b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:11.696540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-2822ea9b-efca-45e8-8444-12a8014317b9 req-e242a862-82e6-4db8-b614-74b6871c77ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faece42e-d740-46b6-898d-644cab66e4ce", "tag": "2f185c1c-527b-423f-9dff-51365b1c9f65"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:11.706462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2822ea9b-efca-45e8-8444-12a8014317b9 req-e242a862-82e6-4db8-b614-74b6871c77ff service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:11.706858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2822ea9b-efca-45e8-8444-12a8014317b9 req-e242a862-82e6-4db8-b614-74b6871c77ff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:11.707383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2822ea9b-efca-45e8-8444-12a8014317b9 req-e242a862-82e6-4db8-b614-74b6871c77ff service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:11.719391 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-2822ea9b-efca-45e8-8444-12a8014317b9 req-e242a862-82e6-4db8-b614-74b6871c77ff service nova] Creating event network-changed:2f185c1c-527b-423f-9dff-51365b1c9f65 for instance faece42e-d740-46b6-898d-644cab66e4ce on n-h1-850499-14 Oct 04 19:19:11.724793 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-2822ea9b-efca-45e8-8444-12a8014317b9 req-e242a862-82e6-4db8-b614-74b6871c77ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102282 Oct 04 19:19:11.726085 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3874/7742] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:11.812868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e8eb56f3-8d0d-4a20-a3df-f4541c8f134b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:11.821636 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e8eb56f3-8d0d-4a20-a3df-f4541c8f134b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1759 microversion: 2.1 time: 0.200811 Oct 04 19:19:11.822414 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3869/7743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:11 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1759 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:33.487203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:33.488037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=12 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:33.492278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-07676127-bc2f-4f7b-94f8-840189d3d797 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:33.494568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-07676127-bc2f-4f7b-94f8-840189d3d797 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:33.502005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07676127-bc2f-4f7b-94f8-840189d3d797 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:33.502495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07676127-bc2f-4f7b-94f8-840189d3d797 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:33.502938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07676127-bc2f-4f7b-94f8-840189d3d797 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:33.503653 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07676127-bc2f-4f7b-94f8-840189d3d797 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:33.504111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07676127-bc2f-4f7b-94f8-840189d3d797 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:33.504541 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07676127-bc2f-4f7b-94f8-840189d3d797 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:33.576208 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-07676127-bc2f-4f7b-94f8-840189d3d797 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/action" status: 202 len: 0 microversion: 2.1 time: 0.090896 Oct 04 19:19:33.576768 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3875/7744] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:19:33 2022] POST /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:19:33.585689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cdd1203c-f1b9-4d6c-9d48-aba4c591e6e1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:33.586397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cdd1203c-f1b9-4d6c-9d48-aba4c591e6e1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:33.588918 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:33.589712 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=8 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:33.596442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdd1203c-f1b9-4d6c-9d48-aba4c591e6e1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:33.596972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdd1203c-f1b9-4d6c-9d48-aba4c591e6e1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:33.597430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdd1203c-f1b9-4d6c-9d48-aba4c591e6e1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:33.598371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdd1203c-f1b9-4d6c-9d48-aba4c591e6e1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:33.599043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdd1203c-f1b9-4d6c-9d48-aba4c591e6e1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:33.599638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cdd1203c-f1b9-4d6c-9d48-aba4c591e6e1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:33.749819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cdd1203c-f1b9-4d6c-9d48-aba4c591e6e1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:33.759210 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cdd1203c-f1b9-4d6c-9d48-aba4c591e6e1 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1751 microversion: 2.1 time: 0.178057 Oct 04 19:19:33.759984 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3870/7745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:33 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:34.784257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a57589f-c07c-42d3-936e-e301832b3b84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:34.784907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a57589f-c07c-42d3-936e-e301832b3b84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:34.791006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a57589f-c07c-42d3-936e-e301832b3b84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:34.791493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a57589f-c07c-42d3-936e-e301832b3b84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:34.791932 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a57589f-c07c-42d3-936e-e301832b3b84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:34.792621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a57589f-c07c-42d3-936e-e301832b3b84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:34.793076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a57589f-c07c-42d3-936e-e301832b3b84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:34.793545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a57589f-c07c-42d3-936e-e301832b3b84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:34.938738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7a57589f-c07c-42d3-936e-e301832b3b84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:34.946822 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a57589f-c07c-42d3-936e-e301832b3b84 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.167913 Oct 04 19:19:34.947407 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3876/7746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:34 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:35.972050 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8037f0ca-9e73-4518-a1bd-7b034b796de9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:35.972743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8037f0ca-9e73-4518-a1bd-7b034b796de9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:35.980123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8037f0ca-9e73-4518-a1bd-7b034b796de9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:35.980635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8037f0ca-9e73-4518-a1bd-7b034b796de9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:35.981099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8037f0ca-9e73-4518-a1bd-7b034b796de9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:35.982876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8037f0ca-9e73-4518-a1bd-7b034b796de9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:35.983394 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8037f0ca-9e73-4518-a1bd-7b034b796de9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:35.983845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8037f0ca-9e73-4518-a1bd-7b034b796de9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:36.133919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8037f0ca-9e73-4518-a1bd-7b034b796de9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:36.143000 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8037f0ca-9e73-4518-a1bd-7b034b796de9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.175662 Oct 04 19:19:36.143586 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3871/7747] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:35 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:37.166092 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-73e76438-9239-4856-a8bf-4a07f78a1958 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:37.166707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-73e76438-9239-4856-a8bf-4a07f78a1958 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:37.174462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73e76438-9239-4856-a8bf-4a07f78a1958 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:37.174967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73e76438-9239-4856-a8bf-4a07f78a1958 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:37.175418 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73e76438-9239-4856-a8bf-4a07f78a1958 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:37.176116 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73e76438-9239-4856-a8bf-4a07f78a1958 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:37.176575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73e76438-9239-4856-a8bf-4a07f78a1958 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:37.177010 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-73e76438-9239-4856-a8bf-4a07f78a1958 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:37.317886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-73e76438-9239-4856-a8bf-4a07f78a1958 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:37.326211 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-73e76438-9239-4856-a8bf-4a07f78a1958 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.164058 Oct 04 19:19:37.326781 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3877/7748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:37 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:38.350168 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a96face7-9926-46e9-bd1e-f2cfa05728b3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:38.350798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a96face7-9926-46e9-bd1e-f2cfa05728b3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:38.357733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a96face7-9926-46e9-bd1e-f2cfa05728b3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:38.358236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a96face7-9926-46e9-bd1e-f2cfa05728b3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:38.358690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a96face7-9926-46e9-bd1e-f2cfa05728b3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:38.359432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a96face7-9926-46e9-bd1e-f2cfa05728b3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:38.359906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a96face7-9926-46e9-bd1e-f2cfa05728b3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:38.360349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a96face7-9926-46e9-bd1e-f2cfa05728b3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:38.505417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a96face7-9926-46e9-bd1e-f2cfa05728b3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:38.513714 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a96face7-9926-46e9-bd1e-f2cfa05728b3 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.167550 Oct 04 19:19:38.514293 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3872/7749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:38 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:39.538916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9feb2d0c-3926-4d35-9301-bdc12a41400b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:39.539565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9feb2d0c-3926-4d35-9301-bdc12a41400b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:39.546434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9feb2d0c-3926-4d35-9301-bdc12a41400b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:39.546872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9feb2d0c-3926-4d35-9301-bdc12a41400b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:39.547616 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9feb2d0c-3926-4d35-9301-bdc12a41400b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:39.548320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9feb2d0c-3926-4d35-9301-bdc12a41400b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:39.548782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9feb2d0c-3926-4d35-9301-bdc12a41400b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:39.549218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9feb2d0c-3926-4d35-9301-bdc12a41400b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:39.689531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9feb2d0c-3926-4d35-9301-bdc12a41400b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:39.698113 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9feb2d0c-3926-4d35-9301-bdc12a41400b tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.163177 Oct 04 19:19:39.698689 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3878/7750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:39 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:40.722845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1f212420-59f7-499a-887d-2c881cc168f0 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:40.723434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1f212420-59f7-499a-887d-2c881cc168f0 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:40.730302 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f212420-59f7-499a-887d-2c881cc168f0 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:40.730801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f212420-59f7-499a-887d-2c881cc168f0 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:40.731293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f212420-59f7-499a-887d-2c881cc168f0 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:40.732621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f212420-59f7-499a-887d-2c881cc168f0 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:40.733101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f212420-59f7-499a-887d-2c881cc168f0 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:40.733546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1f212420-59f7-499a-887d-2c881cc168f0 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:40.878443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1f212420-59f7-499a-887d-2c881cc168f0 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:40.886867 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1f212420-59f7-499a-887d-2c881cc168f0 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.168547 Oct 04 19:19:40.887458 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3873/7751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:40 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:41.911178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6784078b-a47e-4b0c-ae8b-3f6411ad0826 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:41.911790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6784078b-a47e-4b0c-ae8b-3f6411ad0826 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:41.917819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6784078b-a47e-4b0c-ae8b-3f6411ad0826 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:41.918314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6784078b-a47e-4b0c-ae8b-3f6411ad0826 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:41.918758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6784078b-a47e-4b0c-ae8b-3f6411ad0826 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:41.919476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6784078b-a47e-4b0c-ae8b-3f6411ad0826 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:41.919933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6784078b-a47e-4b0c-ae8b-3f6411ad0826 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:41.920361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6784078b-a47e-4b0c-ae8b-3f6411ad0826 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:42.066382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6784078b-a47e-4b0c-ae8b-3f6411ad0826 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:42.074699 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6784078b-a47e-4b0c-ae8b-3f6411ad0826 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.168288 Oct 04 19:19:42.075292 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3879/7752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:41 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:43.097999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9763ebe5-9d45-451e-8f79-0af5cd328555 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:43.098653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9763ebe5-9d45-451e-8f79-0af5cd328555 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:43.105553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9763ebe5-9d45-451e-8f79-0af5cd328555 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:43.106052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9763ebe5-9d45-451e-8f79-0af5cd328555 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:43.106504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9763ebe5-9d45-451e-8f79-0af5cd328555 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:43.107233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9763ebe5-9d45-451e-8f79-0af5cd328555 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:43.107705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9763ebe5-9d45-451e-8f79-0af5cd328555 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:43.108149 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9763ebe5-9d45-451e-8f79-0af5cd328555 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:43.252424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9763ebe5-9d45-451e-8f79-0af5cd328555 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:43.260616 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9763ebe5-9d45-451e-8f79-0af5cd328555 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.166553 Oct 04 19:19:43.261198 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3874/7753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:43 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:44.285062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7b1764b-f4ea-4354-adcf-af8bc88c521e tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:44.285676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b7b1764b-f4ea-4354-adcf-af8bc88c521e tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:44.292614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7b1764b-f4ea-4354-adcf-af8bc88c521e tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:44.293097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7b1764b-f4ea-4354-adcf-af8bc88c521e tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:44.293531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7b1764b-f4ea-4354-adcf-af8bc88c521e tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:44.294222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7b1764b-f4ea-4354-adcf-af8bc88c521e tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:44.294677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7b1764b-f4ea-4354-adcf-af8bc88c521e tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:44.295141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7b1764b-f4ea-4354-adcf-af8bc88c521e tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:44.444255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b7b1764b-f4ea-4354-adcf-af8bc88c521e tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:44.453377 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b7b1764b-f4ea-4354-adcf-af8bc88c521e tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.172534 Oct 04 19:19:44.454537 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3880/7754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:44 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:45.478045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fed5f0a0-b561-47de-8821-f2f31c1f579f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:45.479024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fed5f0a0-b561-47de-8821-f2f31c1f579f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:45.490186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed5f0a0-b561-47de-8821-f2f31c1f579f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:45.490820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed5f0a0-b561-47de-8821-f2f31c1f579f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:45.491311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed5f0a0-b561-47de-8821-f2f31c1f579f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:45.492034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed5f0a0-b561-47de-8821-f2f31c1f579f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:45.492512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed5f0a0-b561-47de-8821-f2f31c1f579f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:45.492952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fed5f0a0-b561-47de-8821-f2f31c1f579f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:45.643263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fed5f0a0-b561-47de-8821-f2f31c1f579f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:45.651920 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fed5f0a0-b561-47de-8821-f2f31c1f579f tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.178870 Oct 04 19:19:45.652510 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3875/7755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:45 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:46.676733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e61d0fc6-1e3a-413a-8f60-315cc9bac573 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:46.677378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e61d0fc6-1e3a-413a-8f60-315cc9bac573 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:46.684204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e61d0fc6-1e3a-413a-8f60-315cc9bac573 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:46.684689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e61d0fc6-1e3a-413a-8f60-315cc9bac573 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:46.685133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e61d0fc6-1e3a-413a-8f60-315cc9bac573 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:46.685820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e61d0fc6-1e3a-413a-8f60-315cc9bac573 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:46.686275 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e61d0fc6-1e3a-413a-8f60-315cc9bac573 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:46.686700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e61d0fc6-1e3a-413a-8f60-315cc9bac573 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:46.834172 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e61d0fc6-1e3a-413a-8f60-315cc9bac573 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:46.842478 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e61d0fc6-1e3a-413a-8f60-315cc9bac573 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.170515 Oct 04 19:19:46.843067 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3881/7756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:46 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:47.866924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-58326871-bb8f-4ab7-aa0e-6cc307e8d3eb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:47.867646 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-58326871-bb8f-4ab7-aa0e-6cc307e8d3eb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:47.874473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58326871-bb8f-4ab7-aa0e-6cc307e8d3eb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:47.875011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58326871-bb8f-4ab7-aa0e-6cc307e8d3eb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:47.875455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58326871-bb8f-4ab7-aa0e-6cc307e8d3eb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:47.876162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58326871-bb8f-4ab7-aa0e-6cc307e8d3eb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:47.876631 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58326871-bb8f-4ab7-aa0e-6cc307e8d3eb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:47.877650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-58326871-bb8f-4ab7-aa0e-6cc307e8d3eb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:48.021949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-58326871-bb8f-4ab7-aa0e-6cc307e8d3eb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:48.030497 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-58326871-bb8f-4ab7-aa0e-6cc307e8d3eb tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.167565 Oct 04 19:19:48.031091 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3876/7757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:47 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:49.056387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6f4d7990-8ed2-4f08-a32c-747773a21450 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:49.057009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6f4d7990-8ed2-4f08-a32c-747773a21450 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:49.064035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4d7990-8ed2-4f08-a32c-747773a21450 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:49.064559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4d7990-8ed2-4f08-a32c-747773a21450 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:49.065049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4d7990-8ed2-4f08-a32c-747773a21450 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:49.066369 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4d7990-8ed2-4f08-a32c-747773a21450 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:49.066880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4d7990-8ed2-4f08-a32c-747773a21450 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:49.067373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6f4d7990-8ed2-4f08-a32c-747773a21450 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:49.218798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6f4d7990-8ed2-4f08-a32c-747773a21450 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:49.229566 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6f4d7990-8ed2-4f08-a32c-747773a21450 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1756 microversion: 2.1 time: 0.176933 Oct 04 19:19:49.230155 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3882/7758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:49 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:50.257235 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df758887-4c23-43a7-9b92-8900d211b2f2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:50.257866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-df758887-4c23-43a7-9b92-8900d211b2f2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:50.264708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df758887-4c23-43a7-9b92-8900d211b2f2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:50.265210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df758887-4c23-43a7-9b92-8900d211b2f2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:50.265665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df758887-4c23-43a7-9b92-8900d211b2f2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:50.266372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df758887-4c23-43a7-9b92-8900d211b2f2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:50.266842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df758887-4c23-43a7-9b92-8900d211b2f2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:50.267336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-df758887-4c23-43a7-9b92-8900d211b2f2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:50.418010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-df758887-4c23-43a7-9b92-8900d211b2f2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:50.428869 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df758887-4c23-43a7-9b92-8900d211b2f2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1759 microversion: 2.1 time: 0.176151 Oct 04 19:19:50.429445 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3877/7759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:50 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:22.971151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-93d8eea3-b00a-4308-9e94-06c91bd85cfa tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1266027166"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:22.971793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-93d8eea3-b00a-4308-9e94-06c91bd85cfa tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:22.974677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=16 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:22.975350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:22.981063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d8eea3-b00a-4308-9e94-06c91bd85cfa tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:22.981603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d8eea3-b00a-4308-9e94-06c91bd85cfa tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:22.982053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d8eea3-b00a-4308-9e94-06c91bd85cfa tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:22.983315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d8eea3-b00a-4308-9e94-06c91bd85cfa tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:22.983777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d8eea3-b00a-4308-9e94-06c91bd85cfa tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:22.984209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-93d8eea3-b00a-4308-9e94-06c91bd85cfa tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:23.110443 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.network.security_group_api [None req-93d8eea3-b00a-4308-9e94-06c91bd85cfa tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Removing security group 6076931c-7c6e-4ddc-8f07-57788977645a from port 2f185c1c-527b-423f-9dff-51365b1c9f65 Oct 04 19:20:23.416692 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-93d8eea3-b00a-4308-9e94-06c91bd85cfa tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "POST /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/action" status: 202 len: 0 microversion: 2.1 time: 0.449548 Oct 04 19:20:23.421284 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3883/7760] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:20:22 2022] POST /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:20:23.425514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-eb0f6b0e-8857-43a2-835a-8e3266a06933 req-6fca9f09-aeb7-4faa-947e-0e2c1aa10da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faece42e-d740-46b6-898d-644cab66e4ce", "tag": "2f185c1c-527b-423f-9dff-51365b1c9f65"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:23.435953 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:20:23.436204 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:20:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 04 19:20:23.437685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=16 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:23.438987 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=48 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:23.440477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eb0f6b0e-8857-43a2-835a-8e3266a06933 req-6fca9f09-aeb7-4faa-947e-0e2c1aa10da8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:23.441336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eb0f6b0e-8857-43a2-835a-8e3266a06933 req-6fca9f09-aeb7-4faa-947e-0e2c1aa10da8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:23.441792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eb0f6b0e-8857-43a2-835a-8e3266a06933 req-6fca9f09-aeb7-4faa-947e-0e2c1aa10da8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:23.456420 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-eb0f6b0e-8857-43a2-835a-8e3266a06933 req-6fca9f09-aeb7-4faa-947e-0e2c1aa10da8 service nova] Creating event network-changed:2f185c1c-527b-423f-9dff-51365b1c9f65 for instance faece42e-d740-46b6-898d-644cab66e4ce on n-h1-850499-14 Oct 04 19:20:23.461789 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-eb0f6b0e-8857-43a2-835a-8e3266a06933 req-6fca9f09-aeb7-4faa-947e-0e2c1aa10da8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040246 Oct 04 19:20:23.462615 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3878/7761] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:24.645426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7c65247a-4d68-42aa-ab22-0b021e1d87c5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:24.645939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7c65247a-4d68-42aa-ab22-0b021e1d87c5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:24.652380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c65247a-4d68-42aa-ab22-0b021e1d87c5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:24.652867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c65247a-4d68-42aa-ab22-0b021e1d87c5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:24.653857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c65247a-4d68-42aa-ab22-0b021e1d87c5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:24.654572 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c65247a-4d68-42aa-ab22-0b021e1d87c5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:24.655076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c65247a-4d68-42aa-ab22-0b021e1d87c5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:24.655505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c65247a-4d68-42aa-ab22-0b021e1d87c5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:24.737927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-7c65247a-4d68-42aa-ab22-0b021e1d87c5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lazy-loading 'services' on Instance uuid faece42e-d740-46b6-898d-644cab66e4ce {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:20:24.811929 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7c65247a-4d68-42aa-ab22-0b021e1d87c5 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "DELETE /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments/f7c9a7a7-3078-4430-a036-33f35014fec3" status: 202 len: 0 microversion: 2.1 time: 0.171078 Oct 04 19:20:24.812547 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3884/7762] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 19:20:24 2022] DELETE /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments/f7c9a7a7-3078-4430-a036-33f35014fec3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:20:24.827617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-43eb0b7a-0ced-4b90-a16c-8b38942a26ec tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:24.830611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-43eb0b7a-0ced-4b90-a16c-8b38942a26ec tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:24.841508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43eb0b7a-0ced-4b90-a16c-8b38942a26ec tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:24.842360 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43eb0b7a-0ced-4b90-a16c-8b38942a26ec tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:24.843031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43eb0b7a-0ced-4b90-a16c-8b38942a26ec tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:24.843963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43eb0b7a-0ced-4b90-a16c-8b38942a26ec tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:24.844593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43eb0b7a-0ced-4b90-a16c-8b38942a26ec tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:24.845212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-43eb0b7a-0ced-4b90-a16c-8b38942a26ec tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:24.887403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-43eb0b7a-0ced-4b90-a16c-8b38942a26ec tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068229 Oct 04 19:20:24.888544 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3879/7763] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:20:24 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:25.478485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d64709ab-f8d1-4ce2-b8c2-843ad05f7d3c req-91595884-0dc4-4a18-8c4b-b1a1ad0698a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faece42e-d740-46b6-898d-644cab66e4ce", "tag": "2f185c1c-527b-423f-9dff-51365b1c9f65"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:25.493780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d64709ab-f8d1-4ce2-b8c2-843ad05f7d3c req-91595884-0dc4-4a18-8c4b-b1a1ad0698a5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:25.494910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d64709ab-f8d1-4ce2-b8c2-843ad05f7d3c req-91595884-0dc4-4a18-8c4b-b1a1ad0698a5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:25.495467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d64709ab-f8d1-4ce2-b8c2-843ad05f7d3c req-91595884-0dc4-4a18-8c4b-b1a1ad0698a5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:25.508144 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d64709ab-f8d1-4ce2-b8c2-843ad05f7d3c req-91595884-0dc4-4a18-8c4b-b1a1ad0698a5 service nova] Creating event network-changed:2f185c1c-527b-423f-9dff-51365b1c9f65 for instance faece42e-d740-46b6-898d-644cab66e4ce on n-h1-850499-14 Oct 04 19:20:25.514299 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d64709ab-f8d1-4ce2-b8c2-843ad05f7d3c req-91595884-0dc4-4a18-8c4b-b1a1ad0698a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039915 Oct 04 19:20:25.515066 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3885/7764] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:20:25.904584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5e1306ab-6562-44cb-b030-cfa2a5e2d0f4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:25.907951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5e1306ab-6562-44cb-b030-cfa2a5e2d0f4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:25.915361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e1306ab-6562-44cb-b030-cfa2a5e2d0f4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:25.916045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e1306ab-6562-44cb-b030-cfa2a5e2d0f4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:25.916508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e1306ab-6562-44cb-b030-cfa2a5e2d0f4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:25.917432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e1306ab-6562-44cb-b030-cfa2a5e2d0f4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:25.917915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e1306ab-6562-44cb-b030-cfa2a5e2d0f4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:25.918354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e1306ab-6562-44cb-b030-cfa2a5e2d0f4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:25.955569 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5e1306ab-6562-44cb-b030-cfa2a5e2d0f4 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058025 Oct 04 19:20:25.956168 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3880/7765] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:20:25 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:26.969690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fee4b90f-fde3-4428-94dd-52a332d9c7e8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:26.971976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fee4b90f-fde3-4428-94dd-52a332d9c7e8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:26.979232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fee4b90f-fde3-4428-94dd-52a332d9c7e8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:26.979929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fee4b90f-fde3-4428-94dd-52a332d9c7e8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:26.980364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fee4b90f-fde3-4428-94dd-52a332d9c7e8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:26.981070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fee4b90f-fde3-4428-94dd-52a332d9c7e8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:26.982186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fee4b90f-fde3-4428-94dd-52a332d9c7e8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:26.982621 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fee4b90f-fde3-4428-94dd-52a332d9c7e8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:27.012395 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fee4b90f-fde3-4428-94dd-52a332d9c7e8 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047688 Oct 04 19:20:27.013124 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3886/7766] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:20:26 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:28.025794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ae05b8f-e507-4175-9072-d75456b2dac9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:28.028020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ae05b8f-e507-4175-9072-d75456b2dac9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:28.034767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ae05b8f-e507-4175-9072-d75456b2dac9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:28.035378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ae05b8f-e507-4175-9072-d75456b2dac9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:28.035829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ae05b8f-e507-4175-9072-d75456b2dac9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:28.036549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ae05b8f-e507-4175-9072-d75456b2dac9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:28.037019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ae05b8f-e507-4175-9072-d75456b2dac9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:28.037459 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ae05b8f-e507-4175-9072-d75456b2dac9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:28.081627 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ae05b8f-e507-4175-9072-d75456b2dac9 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060007 Oct 04 19:20:28.082458 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3881/7767] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:20:28 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:29.095622 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4525c8e2-80ee-470c-8fc2-49831e074471 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:29.097837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4525c8e2-80ee-470c-8fc2-49831e074471 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:29.104214 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4525c8e2-80ee-470c-8fc2-49831e074471 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.104708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4525c8e2-80ee-470c-8fc2-49831e074471 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.105156 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4525c8e2-80ee-470c-8fc2-49831e074471 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.105862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4525c8e2-80ee-470c-8fc2-49831e074471 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.106347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4525c8e2-80ee-470c-8fc2-49831e074471 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.106762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4525c8e2-80ee-470c-8fc2-49831e074471 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.136495 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4525c8e2-80ee-470c-8fc2-49831e074471 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Oct 04 19:20:29.137076 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3887/7768] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:20:29 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:30.149375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bf39192c-e49f-42f2-bee4-766d0f9de667 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:30.151657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bf39192c-e49f-42f2-bee4-766d0f9de667 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:30.159297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf39192c-e49f-42f2-bee4-766d0f9de667 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:30.159809 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf39192c-e49f-42f2-bee4-766d0f9de667 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:30.160266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf39192c-e49f-42f2-bee4-766d0f9de667 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:30.160993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf39192c-e49f-42f2-bee4-766d0f9de667 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:30.161470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf39192c-e49f-42f2-bee4-766d0f9de667 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:30.161926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bf39192c-e49f-42f2-bee4-766d0f9de667 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:30.192645 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bf39192c-e49f-42f2-bee4-766d0f9de667 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047325 Oct 04 19:20:30.193224 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3882/7769] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 4 19:20:30 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:20:30.204101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:30.204701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:30.211860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:30.212351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:30.212791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:30.213505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:30.213957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:30.214383 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:30.293200 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] HTTP exception thrown: Instance faece42e-d740-46b6-898d-644cab66e4ce is not attached to volume f7c9a7a7-3078-4430-a036-33f35014fec3 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Request method failure captured: Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: request: DELETE /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments/f7c9a7a7-3078-4430-a036-33f35014fec3 HTTP/1.1 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIXCFM8RQFTEQ7XgJJrxwHFQe9wnt-y5L9PvO52L48ERrUnRXamQ7CoURXIEoIUdenZA9WNUKAIY-xBmN0U4hc-HvXuSt-XXAfPWOMdr3bejmKeBkM-mRLg_x4q6K8eftdHEMutzq7GyytYel2zhCOH-8mQ4jlGG6cJ8EXl2TVSkn-c Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: edcf08712c3c4a16877a2a2b6a1ab2d2 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}] Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: edcf08712c3c4a16877a2a2b6a1ab2d2 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestMinimumBasicScenario-1329896769-project Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ff8d6c4c13984f7c8e099a6aab553774 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestMinimumBasicScenario-1329896769-project Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance faece42e-d740-46b6-898d-644cab66e4ce is not attached to volume f7c9a7a7-3078-4430-a036-33f35014fec3 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'server_id': 'faece42e-d740-46b6-898d-644cab66e4ce', 'id': 'f7c9a7a7-3078-4430-a036-33f35014fec3'} Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f7c9a7a7-3078-4430-a036-33f35014fec3. Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faece42e-d740-46b6-898d-644cab66e4ce is not attached to volume f7c9a7a7-3078-4430-a036-33f35014fec3 Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:30.295485 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:30.302068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:20:30.302068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:20:30.302068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faece42e-d740-46b6-898d-644cab66e4ce is not attached to volume f7c9a7a7-3078-4430-a036-33f35014fec3 Oct 04 19:20:30.302068 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:20:30.302068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Returning 404 to user: Instance faece42e-d740-46b6-898d-644cab66e4ce is not attached to volume f7c9a7a7-3078-4430-a036-33f35014fec3 {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:20:30.302068 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e2ec2901-6c70-48aa-af02-a1bb6322a678 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "DELETE /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments/f7c9a7a7-3078-4430-a036-33f35014fec3" status: 404 len: 154 microversion: 2.1 time: 0.097112 Oct 04 19:20:30.302068 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3888/7770] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 4 19:20:30 2022] DELETE /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce/os-volume_attachments/f7c9a7a7-3078-4430-a036-33f35014fec3 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:20:33.574649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b43ef7ae-9f2f-4ecb-885e-9934f65cf5e7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:33.575837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b43ef7ae-9f2f-4ecb-885e-9934f65cf5e7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:33.583138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b43ef7ae-9f2f-4ecb-885e-9934f65cf5e7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:33.583651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b43ef7ae-9f2f-4ecb-885e-9934f65cf5e7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:33.584120 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b43ef7ae-9f2f-4ecb-885e-9934f65cf5e7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:33.584856 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b43ef7ae-9f2f-4ecb-885e-9934f65cf5e7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:33.585319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b43ef7ae-9f2f-4ecb-885e-9934f65cf5e7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:33.585767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b43ef7ae-9f2f-4ecb-885e-9934f65cf5e7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:33.611386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b43ef7ae-9f2f-4ecb-885e-9934f65cf5e7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:20:33.692895 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b43ef7ae-9f2f-4ecb-885e-9934f65cf5e7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "DELETE /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 204 len: 0 microversion: 2.1 time: 0.122035 Oct 04 19:20:33.693868 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3883/7771] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:20:33 2022] DELETE /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:20:33.702867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-74c54d0e-0e27-4307-bd32-12230aa4cf99 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:33.703691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-74c54d0e-0e27-4307-bd32-12230aa4cf99 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:33.711639 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c54d0e-0e27-4307-bd32-12230aa4cf99 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:33.712624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c54d0e-0e27-4307-bd32-12230aa4cf99 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:33.712624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c54d0e-0e27-4307-bd32-12230aa4cf99 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:33.713493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c54d0e-0e27-4307-bd32-12230aa4cf99 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:33.713728 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c54d0e-0e27-4307-bd32-12230aa4cf99 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:33.714163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-74c54d0e-0e27-4307-bd32-12230aa4cf99 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:33.860232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-74c54d0e-0e27-4307-bd32-12230aa4cf99 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:33.868569 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-74c54d0e-0e27-4307-bd32-12230aa4cf99 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1553 microversion: 2.1 time: 0.170285 Oct 04 19:20:33.869156 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3889/7772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:33 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:20:34.894059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bb129df6-dab7-4a04-b8d5-afc446fa39d7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:34.894940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bb129df6-dab7-4a04-b8d5-afc446fa39d7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:34.901780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb129df6-dab7-4a04-b8d5-afc446fa39d7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.902280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb129df6-dab7-4a04-b8d5-afc446fa39d7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.902736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb129df6-dab7-4a04-b8d5-afc446fa39d7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.904062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb129df6-dab7-4a04-b8d5-afc446fa39d7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.904531 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb129df6-dab7-4a04-b8d5-afc446fa39d7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.904974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bb129df6-dab7-4a04-b8d5-afc446fa39d7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:35.035521 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bb129df6-dab7-4a04-b8d5-afc446fa39d7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:35.043223 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bb129df6-dab7-4a04-b8d5-afc446fa39d7 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1553 microversion: 2.1 time: 0.153756 Oct 04 19:20:35.044289 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3884/7773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:34 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:36.068437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fbeade97-6786-4aa9-a767-dc398ce54bc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:36.069075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fbeade97-6786-4aa9-a767-dc398ce54bc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:36.078826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbeade97-6786-4aa9-a767-dc398ce54bc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:36.079357 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbeade97-6786-4aa9-a767-dc398ce54bc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:36.079793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbeade97-6786-4aa9-a767-dc398ce54bc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:36.080816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbeade97-6786-4aa9-a767-dc398ce54bc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:36.081331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbeade97-6786-4aa9-a767-dc398ce54bc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:36.081959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fbeade97-6786-4aa9-a767-dc398ce54bc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:36.237744 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fbeade97-6786-4aa9-a767-dc398ce54bc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8d6c4c13984f7c8e099a6aab553774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcf08712c3c4a16877a2a2b6a1ab2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:36.251614 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fbeade97-6786-4aa9-a767-dc398ce54bc2 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 200 len: 1553 microversion: 2.1 time: 0.186821 Oct 04 19:20:36.252789 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3890/7774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:36 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:36.353988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-a5fe3879-2d66-4289-aa06-c79d38919cb3 req-a9669d5f-5f40-4aac-a475-5c7ce6f26966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faece42e-d740-46b6-898d-644cab66e4ce", "name": "network-vif-deleted", "tag": "2f185c1c-527b-423f-9dff-51365b1c9f65"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:36.365857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a5fe3879-2d66-4289-aa06-c79d38919cb3 req-a9669d5f-5f40-4aac-a475-5c7ce6f26966 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:36.366512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a5fe3879-2d66-4289-aa06-c79d38919cb3 req-a9669d5f-5f40-4aac-a475-5c7ce6f26966 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:36.367115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-a5fe3879-2d66-4289-aa06-c79d38919cb3 req-a9669d5f-5f40-4aac-a475-5c7ce6f26966 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:36.379093 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-a5fe3879-2d66-4289-aa06-c79d38919cb3 req-a9669d5f-5f40-4aac-a475-5c7ce6f26966 service nova] Creating event network-vif-deleted:2f185c1c-527b-423f-9dff-51365b1c9f65 for instance faece42e-d740-46b6-898d-644cab66e4ce on n-h1-850499-14 Oct 04 19:20:36.384549 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-a5fe3879-2d66-4289-aa06-c79d38919cb3 req-a9669d5f-5f40-4aac-a475-5c7ce6f26966 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034883 Oct 04 19:20:36.385804 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3885/7775] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:37.276235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:37.276863 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] [instance: faece42e-d740-46b6-898d-644cab66e4ce] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:37.283757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:37.284245 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:37.284691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:37.285387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:37.285848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:37.286283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:37.302562 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] HTTP exception thrown: Instance faece42e-d740-46b6-898d-644cab66e4ce could not be found. Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Request method failure captured: Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce HTTP/1.1 Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIXCFM8RQFTEQ7XgJJrxwHFQe9wnt-y5L9PvO52L48ERrUnRXamQ7CoURXIEoIUdenZA9WNUKAIY-xBmN0U4hc-HvXuSt-XXAfPWOMdr3bejmKeBkM-mRLg_x4q6K8eftdHEMutzq7GyytYel2zhCOH-8mQ4jlGG6cJ8EXl2TVSkn-c Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: edcf08712c3c4a16877a2a2b6a1ab2d2 Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edcf08712c3c4a16877a2a2b6a1ab2d2"}]}] Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: edcf08712c3c4a16877a2a2b6a1ab2d2 Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1329896769 Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestMinimumBasicScenario-1329896769-project Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: ff8d6c4c13984f7c8e099a6aab553774 Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestMinimumBasicScenario-1329896769-project Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance faece42e-d740-46b6-898d-644cab66e4ce could not be found. Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'faece42e-d740-46b6-898d-644cab66e4ce'} Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faece42e-d740-46b6-898d-644cab66e4ce could not be found. Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faece42e-d740-46b6-898d-644cab66e4ce could not be found. Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:37.304110 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:20:37.309018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:37.309018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:37.309018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:37.309018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:20:37.309018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:20:37.309018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faece42e-d740-46b6-898d-644cab66e4ce could not be found. Oct 04 19:20:37.309018 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:20:37.309018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Returning 404 to user: Instance faece42e-d740-46b6-898d-644cab66e4ce could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:20:37.309018 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4a9970e5-3ff2-4a58-8334-a454fe86edcd tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce" status: 404 len: 111 microversion: 2.1 time: 0.033221 Oct 04 19:20:37.309018 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3891/7776] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:37 2022] GET /compute/v2.1/servers/faece42e-d740-46b6-898d-644cab66e4ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:20:37.315434 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-57bc3488-bf1d-462d-a9a5-7855ed86ba26 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] Calling method '.version_select at 0x7fd4d0b72550>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:37.336093 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-57bc3488-bf1d-462d-a9a5-7855ed86ba26 tempest-TestMinimumBasicScenario-1329896769 tempest-TestMinimumBasicScenario-1329896769-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1591036471" status: 202 len: 0 microversion: 2.1 time: 0.024824 Oct 04 19:20:37.336755 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3886/7777] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 4 19:20:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1591036471 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:20:46.756189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b148808d-74bd-4290-8ad8-a81bc4d3d3d3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'create', calling method: .version_select at 0x7fd4d0bfa4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-16317980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwBKPjtAB4i7UgCCBBLUjdlRE0xtEoUgVldWnKJZkt9TyhT1rzqq+TnR//9dgrN6sxPqE14OMzrsqUxZV8USrAGkG2Ujk33lCk5hXFKpweiV39L2xdQ+Fbgc2EynrC9TQ=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:46.773051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b148808d-74bd-4290-8ad8-a81bc4d3d3d3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:20:46.779795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-b148808d-74bd-4290-8ad8-a81bc4d3d3d3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for user 01a419fcbb7a4558add32361c96e387c and project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:20:46.804761 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b148808d-74bd-4290-8ad8-a81bc4d3d3d3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.215852 Oct 04 19:20:46.805101 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3892/7778] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:20:46 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:52.582665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:52.583461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:52.587722 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-800574008", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "d72bf3cf-9bb7-40ac-b0c5-fddf4a714081"}], "key_name": "tempest-TestNetworkAdvancedServerOps-16317980", "security_groups": [{"name": "tempest-secgroup-smoke-2097418830"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:52.725956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] validate_networks() for [('d72bf3cf-9bb7-40ac-b0c5-fddf4a714081', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:20:53.243363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:20:53.243817 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:20:53.244313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:20:53.244744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:20:53.245180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:20:53.258800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:53.259349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:53.259808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:53.260565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:53.261246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:53.261924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:53.282449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:20:53.287803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for user 01a419fcbb7a4558add32361c96e387c and project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:20:53.306852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:20:53.309496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:20:53.364830 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-22c50c7b-fdc9-4f0e-b6f8-f347c2c28417 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783854 Oct 04 19:20:53.366015 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3887/7779] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:20:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:20:53.374024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:53.380823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-253b448d-b0fa-48ba-8fe1-02aac364aa0a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:53.381944 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-253b448d-b0fa-48ba-8fe1-02aac364aa0a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:53.388505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:53.476134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-253b448d-b0fa-48ba-8fe1-02aac364aa0a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:53.487734 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-253b448d-b0fa-48ba-8fe1-02aac364aa0a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1264 microversion: 2.1 time: 0.114448 Oct 04 19:20:53.488921 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3893/7780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:53 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1264 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:20:54.512179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8afd9133-8490-4419-b52f-7f840ec2b0db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:54.512915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8afd9133-8490-4419-b52f-7f840ec2b0db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:54.520065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8afd9133-8490-4419-b52f-7f840ec2b0db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:54.520574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8afd9133-8490-4419-b52f-7f840ec2b0db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:54.521032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8afd9133-8490-4419-b52f-7f840ec2b0db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:54.521747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8afd9133-8490-4419-b52f-7f840ec2b0db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:54.522222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8afd9133-8490-4419-b52f-7f840ec2b0db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:54.522663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8afd9133-8490-4419-b52f-7f840ec2b0db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:54.591657 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8afd9133-8490-4419-b52f-7f840ec2b0db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:54.600063 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8afd9133-8490-4419-b52f-7f840ec2b0db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1316 microversion: 2.1 time: 0.092614 Oct 04 19:20:54.600704 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3888/7781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:54 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1316 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:55.626897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cbe699cd-5066-4d1f-b40d-18d462f04c4e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:55.628167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cbe699cd-5066-4d1f-b40d-18d462f04c4e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:55.637344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbe699cd-5066-4d1f-b40d-18d462f04c4e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:55.638135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbe699cd-5066-4d1f-b40d-18d462f04c4e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:55.638753 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbe699cd-5066-4d1f-b40d-18d462f04c4e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:55.639702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbe699cd-5066-4d1f-b40d-18d462f04c4e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:55.640351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbe699cd-5066-4d1f-b40d-18d462f04c4e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:55.640783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbe699cd-5066-4d1f-b40d-18d462f04c4e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:55.798458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cbe699cd-5066-4d1f-b40d-18d462f04c4e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:55.814369 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cbe699cd-5066-4d1f-b40d-18d462f04c4e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1390 microversion: 2.1 time: 0.193953 Oct 04 19:20:55.817148 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3894/7782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:55 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1390 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:56.262532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-8b260715-c0fa-4b88-862b-84068056d064 req-a160167e-a215-4a96-9cc1-1681917197fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b537cc6-db0d-49a8-ba26-1b4287efb288", "tag": "2480992b-3322-4df4-883d-5f4efd80cd9b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:56.276552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8b260715-c0fa-4b88-862b-84068056d064 req-a160167e-a215-4a96-9cc1-1681917197fc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:56.277085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8b260715-c0fa-4b88-862b-84068056d064 req-a160167e-a215-4a96-9cc1-1681917197fc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:56.278238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-8b260715-c0fa-4b88-862b-84068056d064 req-a160167e-a215-4a96-9cc1-1681917197fc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:56.295960 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-8b260715-c0fa-4b88-862b-84068056d064 req-a160167e-a215-4a96-9cc1-1681917197fc service nova] Creating event network-changed:2480992b-3322-4df4-883d-5f4efd80cd9b for instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 on n-h2-850499-14 Oct 04 19:20:56.301479 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-8b260715-c0fa-4b88-862b-84068056d064 req-a160167e-a215-4a96-9cc1-1681917197fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043814 Oct 04 19:20:56.302178 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3889/7783] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:56.839750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a03ad745-d5cb-47df-9b38-2d1625d230db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:56.841077 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a03ad745-d5cb-47df-9b38-2d1625d230db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:56.848146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a03ad745-d5cb-47df-9b38-2d1625d230db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:56.848693 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a03ad745-d5cb-47df-9b38-2d1625d230db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:56.849083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a03ad745-d5cb-47df-9b38-2d1625d230db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:56.849792 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a03ad745-d5cb-47df-9b38-2d1625d230db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:56.850258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a03ad745-d5cb-47df-9b38-2d1625d230db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:56.850695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a03ad745-d5cb-47df-9b38-2d1625d230db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:56.981843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a03ad745-d5cb-47df-9b38-2d1625d230db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:56.989472 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a03ad745-d5cb-47df-9b38-2d1625d230db tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1390 microversion: 2.1 time: 0.153636 Oct 04 19:20:56.990036 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3895/7784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:56 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:58.014352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34615c19-22a1-40e8-97cf-a56f639a7331 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:58.015089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34615c19-22a1-40e8-97cf-a56f639a7331 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:58.021274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34615c19-22a1-40e8-97cf-a56f639a7331 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:58.021779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34615c19-22a1-40e8-97cf-a56f639a7331 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:58.022238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34615c19-22a1-40e8-97cf-a56f639a7331 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:58.022940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34615c19-22a1-40e8-97cf-a56f639a7331 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:58.023435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34615c19-22a1-40e8-97cf-a56f639a7331 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:58.023882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34615c19-22a1-40e8-97cf-a56f639a7331 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:58.163118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34615c19-22a1-40e8-97cf-a56f639a7331 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:58.171088 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34615c19-22a1-40e8-97cf-a56f639a7331 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1390 microversion: 2.1 time: 0.162096 Oct 04 19:20:58.172598 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3890/7785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:58 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:59.194561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7c1e62eb-0367-4014-95eb-1178db7f5a68 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:59.195232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7c1e62eb-0367-4014-95eb-1178db7f5a68 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:59.201583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c1e62eb-0367-4014-95eb-1178db7f5a68 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:59.202073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c1e62eb-0367-4014-95eb-1178db7f5a68 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:59.202519 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c1e62eb-0367-4014-95eb-1178db7f5a68 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:59.203308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c1e62eb-0367-4014-95eb-1178db7f5a68 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:59.203774 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c1e62eb-0367-4014-95eb-1178db7f5a68 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:59.204204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c1e62eb-0367-4014-95eb-1178db7f5a68 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:59.337933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7c1e62eb-0367-4014-95eb-1178db7f5a68 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:59.346174 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7c1e62eb-0367-4014-95eb-1178db7f5a68 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1390 microversion: 2.1 time: 0.155703 Oct 04 19:20:59.346750 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3896/7786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:59 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:00.368842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-570b78b7-bcdd-4d9b-8afd-03b43b3b2f9e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:00.369474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-570b78b7-bcdd-4d9b-8afd-03b43b3b2f9e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:00.377230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-570b78b7-bcdd-4d9b-8afd-03b43b3b2f9e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:00.377740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-570b78b7-bcdd-4d9b-8afd-03b43b3b2f9e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:00.378202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-570b78b7-bcdd-4d9b-8afd-03b43b3b2f9e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:00.378921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-570b78b7-bcdd-4d9b-8afd-03b43b3b2f9e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:00.379427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-570b78b7-bcdd-4d9b-8afd-03b43b3b2f9e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:00.379878 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-570b78b7-bcdd-4d9b-8afd-03b43b3b2f9e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:00.514387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-570b78b7-bcdd-4d9b-8afd-03b43b3b2f9e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:00.522278 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-570b78b7-bcdd-4d9b-8afd-03b43b3b2f9e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1390 microversion: 2.1 time: 0.157272 Oct 04 19:21:00.522859 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3891/7787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:00 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:01.545353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-abf5a6ee-639e-4169-b2ac-9cf0cfedaac7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:01.545891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-abf5a6ee-639e-4169-b2ac-9cf0cfedaac7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:01.553079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abf5a6ee-639e-4169-b2ac-9cf0cfedaac7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:01.553763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abf5a6ee-639e-4169-b2ac-9cf0cfedaac7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:01.554225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abf5a6ee-639e-4169-b2ac-9cf0cfedaac7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:01.555083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abf5a6ee-639e-4169-b2ac-9cf0cfedaac7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:01.555523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abf5a6ee-639e-4169-b2ac-9cf0cfedaac7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:01.556019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-abf5a6ee-639e-4169-b2ac-9cf0cfedaac7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:01.689942 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-abf5a6ee-639e-4169-b2ac-9cf0cfedaac7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:01.697689 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-abf5a6ee-639e-4169-b2ac-9cf0cfedaac7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1390 microversion: 2.1 time: 0.156393 Oct 04 19:21:01.698340 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3897/7788] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:01 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:02.721509 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-52287d19-c822-4cce-b51c-fdfc1278b63b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:02.722161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-52287d19-c822-4cce-b51c-fdfc1278b63b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:02.729057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52287d19-c822-4cce-b51c-fdfc1278b63b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:02.729568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52287d19-c822-4cce-b51c-fdfc1278b63b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:02.730034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52287d19-c822-4cce-b51c-fdfc1278b63b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:02.730753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52287d19-c822-4cce-b51c-fdfc1278b63b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:02.731265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52287d19-c822-4cce-b51c-fdfc1278b63b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:02.731787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-52287d19-c822-4cce-b51c-fdfc1278b63b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:02.860291 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-52287d19-c822-4cce-b51c-fdfc1278b63b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:02.868008 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-52287d19-c822-4cce-b51c-fdfc1278b63b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1390 microversion: 2.1 time: 0.150460 Oct 04 19:21:02.868583 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3892/7789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:02 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:03.170978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-86eb0633-f187-44b5-b85b-deaf46c1b722 req-ebc98b08-8275-45ed-8e44-99efa0b4626d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b537cc6-db0d-49a8-ba26-1b4287efb288", "name": "network-vif-plugged", "status": "completed", "tag": "2480992b-3322-4df4-883d-5f4efd80cd9b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:03.182587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-86eb0633-f187-44b5-b85b-deaf46c1b722 req-ebc98b08-8275-45ed-8e44-99efa0b4626d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:03.183305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-86eb0633-f187-44b5-b85b-deaf46c1b722 req-ebc98b08-8275-45ed-8e44-99efa0b4626d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:03.184307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-86eb0633-f187-44b5-b85b-deaf46c1b722 req-ebc98b08-8275-45ed-8e44-99efa0b4626d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:03.197832 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-86eb0633-f187-44b5-b85b-deaf46c1b722 req-ebc98b08-8275-45ed-8e44-99efa0b4626d service nova] Creating event network-vif-plugged:2480992b-3322-4df4-883d-5f4efd80cd9b for instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 on n-h2-850499-14 Oct 04 19:21:03.203732 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-86eb0633-f187-44b5-b85b-deaf46c1b722 req-ebc98b08-8275-45ed-8e44-99efa0b4626d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036477 Oct 04 19:21:03.204351 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3898/7790] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:03.891636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-23bf4c30-9c5f-401f-8d5f-b1fca9791c57 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:03.892192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-23bf4c30-9c5f-401f-8d5f-b1fca9791c57 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:03.894307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:03.895163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:03.902020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23bf4c30-9c5f-401f-8d5f-b1fca9791c57 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:03.903110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23bf4c30-9c5f-401f-8d5f-b1fca9791c57 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:03.903575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23bf4c30-9c5f-401f-8d5f-b1fca9791c57 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:03.904332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23bf4c30-9c5f-401f-8d5f-b1fca9791c57 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:03.904816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23bf4c30-9c5f-401f-8d5f-b1fca9791c57 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:03.905266 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-23bf4c30-9c5f-401f-8d5f-b1fca9791c57 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:04.041243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-23bf4c30-9c5f-401f-8d5f-b1fca9791c57 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:04.051092 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-23bf4c30-9c5f-401f-8d5f-b1fca9791c57 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1390 microversion: 2.1 time: 0.163518 Oct 04 19:21:04.051679 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3893/7791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:03 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:05.071111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:05.076290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-048891ae-3e24-48be-85c4-1216f6e10a24 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:05.076991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-048891ae-3e24-48be-85c4-1216f6e10a24 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:05.083433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-048891ae-3e24-48be-85c4-1216f6e10a24 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:05.083921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-048891ae-3e24-48be-85c4-1216f6e10a24 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:05.084361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-048891ae-3e24-48be-85c4-1216f6e10a24 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:05.085050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-048891ae-3e24-48be-85c4-1216f6e10a24 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:05.085505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-048891ae-3e24-48be-85c4-1216f6e10a24 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:05.085931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-048891ae-3e24-48be-85c4-1216f6e10a24 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:05.215925 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-048891ae-3e24-48be-85c4-1216f6e10a24 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:05.223654 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-048891ae-3e24-48be-85c4-1216f6e10a24 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1563 microversion: 2.1 time: 0.153537 Oct 04 19:21:05.224223 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3899/7792] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:05 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:05.246750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-edf030db-6d8a-4466-853b-11ab9166af60 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:05.247420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-edf030db-6d8a-4466-853b-11ab9166af60 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:05.255474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edf030db-6d8a-4466-853b-11ab9166af60 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:05.255976 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edf030db-6d8a-4466-853b-11ab9166af60 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:05.256430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edf030db-6d8a-4466-853b-11ab9166af60 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:05.257144 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edf030db-6d8a-4466-853b-11ab9166af60 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:05.257616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edf030db-6d8a-4466-853b-11ab9166af60 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:05.258057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edf030db-6d8a-4466-853b-11ab9166af60 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:05.392435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-edf030db-6d8a-4466-853b-11ab9166af60 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:05.400206 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-edf030db-6d8a-4466-853b-11ab9166af60 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1563 microversion: 2.1 time: 0.157538 Oct 04 19:21:05.400783 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3894/7793] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:05 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:07.326154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1e65eb07-1d0e-45ff-a8a6-505ed991e7b9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:07.327018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1e65eb07-1d0e-45ff-a8a6-505ed991e7b9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:07.328581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-0e7a08bb-4557-429c-9e68-4c9172253774 req-b69ab204-8098-421b-a385-cde06646ca49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b537cc6-db0d-49a8-ba26-1b4287efb288", "tag": "2480992b-3322-4df4-883d-5f4efd80cd9b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:07.334212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e65eb07-1d0e-45ff-a8a6-505ed991e7b9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:07.334786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e65eb07-1d0e-45ff-a8a6-505ed991e7b9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:07.335345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e65eb07-1d0e-45ff-a8a6-505ed991e7b9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:07.336266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e65eb07-1d0e-45ff-a8a6-505ed991e7b9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:07.336732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e65eb07-1d0e-45ff-a8a6-505ed991e7b9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:07.337229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1e65eb07-1d0e-45ff-a8a6-505ed991e7b9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:07.339136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0e7a08bb-4557-429c-9e68-4c9172253774 req-b69ab204-8098-421b-a385-cde06646ca49 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:07.340219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0e7a08bb-4557-429c-9e68-4c9172253774 req-b69ab204-8098-421b-a385-cde06646ca49 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:07.341070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-0e7a08bb-4557-429c-9e68-4c9172253774 req-b69ab204-8098-421b-a385-cde06646ca49 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:07.355061 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-0e7a08bb-4557-429c-9e68-4c9172253774 req-b69ab204-8098-421b-a385-cde06646ca49 service nova] Creating event network-changed:2480992b-3322-4df4-883d-5f4efd80cd9b for instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 on n-h2-850499-14 Oct 04 19:21:07.360915 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-0e7a08bb-4557-429c-9e68-4c9172253774 req-b69ab204-8098-421b-a385-cde06646ca49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036707 Oct 04 19:21:07.362284 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3895/7794] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:07.489555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1e65eb07-1d0e-45ff-a8a6-505ed991e7b9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:07.500072 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1e65eb07-1d0e-45ff-a8a6-505ed991e7b9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1563 microversion: 2.1 time: 0.177828 Oct 04 19:21:07.500681 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3900/7795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:07 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:40.820024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:40.820715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=42 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:40.824981 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ac0e90f8-c98f-4881-99cb-644a40463d89 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:40.827367 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ac0e90f8-c98f-4881-99cb-644a40463d89 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:40.835112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac0e90f8-c98f-4881-99cb-644a40463d89 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:40.835620 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac0e90f8-c98f-4881-99cb-644a40463d89 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:40.836076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac0e90f8-c98f-4881-99cb-644a40463d89 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:40.836793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac0e90f8-c98f-4881-99cb-644a40463d89 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:40.837271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac0e90f8-c98f-4881-99cb-644a40463d89 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:40.837717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ac0e90f8-c98f-4881-99cb-644a40463d89 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:40.912966 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ac0e90f8-c98f-4881-99cb-644a40463d89 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action" status: 200 len: 24563 microversion: 2.1 time: 0.095013 Oct 04 19:21:40.913635 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3896/7796] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:21:40 2022] POST /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action => generated 24563 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:22:11.344362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=17 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:11.345118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=38 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:11.346564 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:22:11.346765 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:22:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action (ip 10.222.0.18) !!! Oct 04 19:22:11.354243 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc979133-cef6-4bb6-aa3a-20cbe42e6982 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:11.354780 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc979133-cef6-4bb6-aa3a-20cbe42e6982 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:11.365963 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc979133-cef6-4bb6-aa3a-20cbe42e6982 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:11.366485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc979133-cef6-4bb6-aa3a-20cbe42e6982 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:11.366931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc979133-cef6-4bb6-aa3a-20cbe42e6982 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:11.367661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc979133-cef6-4bb6-aa3a-20cbe42e6982 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:11.368152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc979133-cef6-4bb6-aa3a-20cbe42e6982 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:11.368587 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc979133-cef6-4bb6-aa3a-20cbe42e6982 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:11.435151 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc979133-cef6-4bb6-aa3a-20cbe42e6982 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action" status: 202 len: 0 microversion: 2.1 time: 0.092388 Oct 04 19:22:11.440672 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3901/7797] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:11 2022] POST /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:22:11.447110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ebec4945-b034-44e2-a459-98f9c28f4c7f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:11.448180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ebec4945-b034-44e2-a459-98f9c28f4c7f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:11.450747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:11.451522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:11.460583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebec4945-b034-44e2-a459-98f9c28f4c7f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:11.461093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebec4945-b034-44e2-a459-98f9c28f4c7f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:11.461550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebec4945-b034-44e2-a459-98f9c28f4c7f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:11.462271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebec4945-b034-44e2-a459-98f9c28f4c7f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:11.462744 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebec4945-b034-44e2-a459-98f9c28f4c7f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:11.463212 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebec4945-b034-44e2-a459-98f9c28f4c7f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:11.652357 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ebec4945-b034-44e2-a459-98f9c28f4c7f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:11.660243 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ebec4945-b034-44e2-a459-98f9c28f4c7f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1686 microversion: 2.1 time: 0.217573 Oct 04 19:22:11.660822 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3897/7798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:11 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1686 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:12.686992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5c57f0f6-9974-4d1e-9e42-4dc0791ae2e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:12.687768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5c57f0f6-9974-4d1e-9e42-4dc0791ae2e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:12.694619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c57f0f6-9974-4d1e-9e42-4dc0791ae2e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:12.695157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c57f0f6-9974-4d1e-9e42-4dc0791ae2e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:12.695603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c57f0f6-9974-4d1e-9e42-4dc0791ae2e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:12.696315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c57f0f6-9974-4d1e-9e42-4dc0791ae2e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:12.696777 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c57f0f6-9974-4d1e-9e42-4dc0791ae2e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:12.697209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5c57f0f6-9974-4d1e-9e42-4dc0791ae2e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:12.890262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5c57f0f6-9974-4d1e-9e42-4dc0791ae2e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:12.898083 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5c57f0f6-9974-4d1e-9e42-4dc0791ae2e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1666 microversion: 2.1 time: 0.216510 Oct 04 19:22:12.898670 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3902/7799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:12 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1666 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:14.005269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c27b5e43-ddfe-463d-aa31-bd9e70e3f82c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:14.007548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c27b5e43-ddfe-463d-aa31-bd9e70e3f82c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:14.014514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c27b5e43-ddfe-463d-aa31-bd9e70e3f82c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.015063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c27b5e43-ddfe-463d-aa31-bd9e70e3f82c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.015528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c27b5e43-ddfe-463d-aa31-bd9e70e3f82c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.016247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c27b5e43-ddfe-463d-aa31-bd9e70e3f82c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.016725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c27b5e43-ddfe-463d-aa31-bd9e70e3f82c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.017174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c27b5e43-ddfe-463d-aa31-bd9e70e3f82c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.087756 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c27b5e43-ddfe-463d-aa31-bd9e70e3f82c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action" status: 200 len: 32633 microversion: 2.1 time: 0.086945 Oct 04 19:22:14.088737 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3898/7800] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:13 2022] POST /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action => generated 32633 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:22:14.100614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d455b671-a3d5-49fe-a0f2-d2fb4a195f3a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:14.101130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d455b671-a3d5-49fe-a0f2-d2fb4a195f3a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:14.108380 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d455b671-a3d5-49fe-a0f2-d2fb4a195f3a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.108868 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d455b671-a3d5-49fe-a0f2-d2fb4a195f3a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.109320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d455b671-a3d5-49fe-a0f2-d2fb4a195f3a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.110014 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d455b671-a3d5-49fe-a0f2-d2fb4a195f3a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.110473 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d455b671-a3d5-49fe-a0f2-d2fb4a195f3a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.110903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d455b671-a3d5-49fe-a0f2-d2fb4a195f3a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.178298 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d455b671-a3d5-49fe-a0f2-d2fb4a195f3a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action" status: 202 len: 0 microversion: 2.1 time: 0.081405 Oct 04 19:22:14.179021 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3903/7801] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:14 2022] POST /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:22:14.188074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-08e14e1a-8b4d-4d4f-a785-3dab8c4199fb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:14.188808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08e14e1a-8b4d-4d4f-a785-3dab8c4199fb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:14.196105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08e14e1a-8b4d-4d4f-a785-3dab8c4199fb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.196621 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08e14e1a-8b4d-4d4f-a785-3dab8c4199fb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.197091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08e14e1a-8b4d-4d4f-a785-3dab8c4199fb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.197836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08e14e1a-8b4d-4d4f-a785-3dab8c4199fb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:14.198318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08e14e1a-8b4d-4d4f-a785-3dab8c4199fb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:14.198768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08e14e1a-8b4d-4d4f-a785-3dab8c4199fb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:14.332225 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-08e14e1a-8b4d-4d4f-a785-3dab8c4199fb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:14.340578 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-08e14e1a-8b4d-4d4f-a785-3dab8c4199fb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1673 microversion: 2.1 time: 0.156867 Oct 04 19:22:14.341137 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3899/7802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:14 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:15.366035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2a622615-0daa-4f10-81fe-449ed2ab7d1b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:15.366735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2a622615-0daa-4f10-81fe-449ed2ab7d1b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:15.373306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a622615-0daa-4f10-81fe-449ed2ab7d1b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:15.373528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a622615-0daa-4f10-81fe-449ed2ab7d1b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:15.373909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a622615-0daa-4f10-81fe-449ed2ab7d1b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:15.374608 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a622615-0daa-4f10-81fe-449ed2ab7d1b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:15.375096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a622615-0daa-4f10-81fe-449ed2ab7d1b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:15.375527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2a622615-0daa-4f10-81fe-449ed2ab7d1b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:15.509547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2a622615-0daa-4f10-81fe-449ed2ab7d1b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:15.517361 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2a622615-0daa-4f10-81fe-449ed2ab7d1b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1681 microversion: 2.1 time: 0.156472 Oct 04 19:22:15.518417 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3904/7803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:15 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:15.620829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-56630af2-47b1-49e0-9cad-d781bf21cce1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:15.623056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-56630af2-47b1-49e0-9cad-d781bf21cce1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:15.631297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56630af2-47b1-49e0-9cad-d781bf21cce1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:15.631826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56630af2-47b1-49e0-9cad-d781bf21cce1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:15.632297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56630af2-47b1-49e0-9cad-d781bf21cce1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:15.633040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56630af2-47b1-49e0-9cad-d781bf21cce1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:15.633525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56630af2-47b1-49e0-9cad-d781bf21cce1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:15.633979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-56630af2-47b1-49e0-9cad-d781bf21cce1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:15.706612 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-56630af2-47b1-49e0-9cad-d781bf21cce1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action" status: 200 len: 37042 microversion: 2.1 time: 0.089626 Oct 04 19:22:15.707604 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3900/7804] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:15 2022] POST /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288/action => generated 37042 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:22:16.714860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b3d921d-e340-42b8-904e-9ce8eb0aaae3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:16.715430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6b3d921d-e340-42b8-904e-9ce8eb0aaae3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:16.721714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-27017d3d-d4e6-4ccf-abcc-5132d966d3fb req-705f6fe8-4b39-4bae-bdcc-8c830592d85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b537cc6-db0d-49a8-ba26-1b4287efb288", "tag": "2480992b-3322-4df4-883d-5f4efd80cd9b"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:16.729514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b3d921d-e340-42b8-904e-9ce8eb0aaae3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:16.730015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b3d921d-e340-42b8-904e-9ce8eb0aaae3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:16.730661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b3d921d-e340-42b8-904e-9ce8eb0aaae3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:16.731665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b3d921d-e340-42b8-904e-9ce8eb0aaae3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:16.732356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b3d921d-e340-42b8-904e-9ce8eb0aaae3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:16.733017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b3d921d-e340-42b8-904e-9ce8eb0aaae3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:16.736838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-27017d3d-d4e6-4ccf-abcc-5132d966d3fb req-705f6fe8-4b39-4bae-bdcc-8c830592d85b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:16.737607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-27017d3d-d4e6-4ccf-abcc-5132d966d3fb req-705f6fe8-4b39-4bae-bdcc-8c830592d85b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:16.738240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-27017d3d-d4e6-4ccf-abcc-5132d966d3fb req-705f6fe8-4b39-4bae-bdcc-8c830592d85b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:16.750692 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-27017d3d-d4e6-4ccf-abcc-5132d966d3fb req-705f6fe8-4b39-4bae-bdcc-8c830592d85b service nova] Creating event network-changed:2480992b-3322-4df4-883d-5f4efd80cd9b for instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 on n-h2-850499-14 Oct 04 19:22:16.755875 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-27017d3d-d4e6-4ccf-abcc-5132d966d3fb req-705f6fe8-4b39-4bae-bdcc-8c830592d85b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038695 Oct 04 19:22:16.756845 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3901/7805] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:16.760667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6b3d921d-e340-42b8-904e-9ce8eb0aaae3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:22:16.857020 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6b3d921d-e340-42b8-904e-9ce8eb0aaae3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 204 len: 0 microversion: 2.1 time: 0.145781 Oct 04 19:22:16.857647 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3905/7806] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:22:16 2022] DELETE /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:22:16.867099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9bcb1391-5018-4634-8d12-fb8ab0c41cd1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:16.867836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9bcb1391-5018-4634-8d12-fb8ab0c41cd1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:16.874325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb1391-5018-4634-8d12-fb8ab0c41cd1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:16.874844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb1391-5018-4634-8d12-fb8ab0c41cd1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:16.875337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb1391-5018-4634-8d12-fb8ab0c41cd1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:16.876065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb1391-5018-4634-8d12-fb8ab0c41cd1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:16.876576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb1391-5018-4634-8d12-fb8ab0c41cd1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:16.877030 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9bcb1391-5018-4634-8d12-fb8ab0c41cd1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:17.014470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9bcb1391-5018-4634-8d12-fb8ab0c41cd1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:17.022901 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9bcb1391-5018-4634-8d12-fb8ab0c41cd1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1687 microversion: 2.1 time: 0.160501 Oct 04 19:22:17.023507 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3902/7807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:16 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:18.048906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-58cc1d1f-5f60-4d35-bc56-3bc929956baf tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:18.049563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-58cc1d1f-5f60-4d35-bc56-3bc929956baf tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:18.056288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58cc1d1f-5f60-4d35-bc56-3bc929956baf tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:18.056782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58cc1d1f-5f60-4d35-bc56-3bc929956baf tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:18.057237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58cc1d1f-5f60-4d35-bc56-3bc929956baf tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:18.057935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58cc1d1f-5f60-4d35-bc56-3bc929956baf tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:18.058398 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58cc1d1f-5f60-4d35-bc56-3bc929956baf tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:18.058831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-58cc1d1f-5f60-4d35-bc56-3bc929956baf tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:18.194373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-58cc1d1f-5f60-4d35-bc56-3bc929956baf tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:18.202470 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-58cc1d1f-5f60-4d35-bc56-3bc929956baf tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1687 microversion: 2.1 time: 0.158783 Oct 04 19:22:18.203053 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3906/7808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:18 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:19.226129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6b4533e4-1403-4608-a8b0-bbb0d2a7c9ef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:19.226718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-362c2a49-52c1-4d08-8127-0aae42bf2948 req-a669feb6-a18d-410c-b7bf-987dd61446ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b537cc6-db0d-49a8-ba26-1b4287efb288", "name": "network-vif-deleted", "tag": "2480992b-3322-4df4-883d-5f4efd80cd9b"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:19.227135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6b4533e4-1403-4608-a8b0-bbb0d2a7c9ef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:19.237095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b4533e4-1403-4608-a8b0-bbb0d2a7c9ef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:19.237667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-362c2a49-52c1-4d08-8127-0aae42bf2948 req-a669feb6-a18d-410c-b7bf-987dd61446ec service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:19.237869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b4533e4-1403-4608-a8b0-bbb0d2a7c9ef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:19.238148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-362c2a49-52c1-4d08-8127-0aae42bf2948 req-a669feb6-a18d-410c-b7bf-987dd61446ec service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:19.238418 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b4533e4-1403-4608-a8b0-bbb0d2a7c9ef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:19.238564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-362c2a49-52c1-4d08-8127-0aae42bf2948 req-a669feb6-a18d-410c-b7bf-987dd61446ec service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:19.239609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b4533e4-1403-4608-a8b0-bbb0d2a7c9ef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:19.240174 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b4533e4-1403-4608-a8b0-bbb0d2a7c9ef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:19.240731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6b4533e4-1403-4608-a8b0-bbb0d2a7c9ef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:19.263900 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-362c2a49-52c1-4d08-8127-0aae42bf2948 req-a669feb6-a18d-410c-b7bf-987dd61446ec service nova] Creating event network-vif-deleted:2480992b-3322-4df4-883d-5f4efd80cd9b for instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 on n-h2-850499-14 Oct 04 19:22:19.269951 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-362c2a49-52c1-4d08-8127-0aae42bf2948 req-a669feb6-a18d-410c-b7bf-987dd61446ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047481 Oct 04 19:22:19.270565 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3907/7809] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:19.321040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6b4533e4-1403-4608-a8b0-bbb0d2a7c9ef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:19.330409 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6b4533e4-1403-4608-a8b0-bbb0d2a7c9ef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 200 len: 1501 microversion: 2.1 time: 0.108048 Oct 04 19:22:19.331034 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3903/7810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:19 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 1501 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:20.355634 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:20.356338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 9b537cc6-db0d-49a8-ba26-1b4287efb288] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:20.363199 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:20.363687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:20.364125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:20.364820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:20.365277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:20.365709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:20.379845 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] HTTP exception thrown: Instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 could not be found. Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Request method failure captured: Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 HTTP/1.1 Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIeN8IpXRvunr76MaJcsy7gb5UP6P4wqRVf0JkFXuXKO2yf2pFEvJw8J88FNBXWWUdzOw2EIDCftvfvYY_kAe0UTJSv2yPFw5P2VL_L4-kqKLgsStF_OIK04o3eUaRuB3lR-bHSuVie82p8LaoF1Nxb20sOCbZAKQ5m9_sRAS24DjP0 Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2c351b5f6e644ae793a7cd81ce120f12 Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c351b5f6e644ae793a7cd81ce120f12"}]}] Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2c351b5f6e644ae793a7cd81ce120f12 Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestNetworkAdvancedServerOps-773175457-project Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 01a419fcbb7a4558add32361c96e387c Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestNetworkAdvancedServerOps-773175457-project Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 could not be found. Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '9b537cc6-db0d-49a8-ba26-1b4287efb288'} Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 could not be found. Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 could not be found. Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:22:20.381524 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 could not be found. Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Returning 404 to user: Instance 9b537cc6-db0d-49a8-ba26-1b4287efb288 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e74976ad-ed39-433c-a35b-ef34ce5ed570 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288" status: 404 len: 111 microversion: 2.1 time: 0.032503 Oct 04 19:22:20.389941 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3908/7811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:20 2022] GET /compute/v2.1/servers/9b537cc6-db0d-49a8-ba26-1b4287efb288 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:22:23.713006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-766f70c0-b2c4-435d-96dc-017d8831d900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '.version_select at 0x7fd4d1fccd30>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:23.741991 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-766f70c0-b2c4-435d-96dc-017d8831d900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-16317980" status: 202 len: 0 microversion: 2.1 time: 0.033145 Oct 04 19:22:23.743220 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3904/7812] 10.222.0.18 () {58 vars in 1278 bytes} [Tue Oct 4 19:22:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-16317980 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:22:23.774561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-89c6e1aa-77d7-484e-8718-a59c35928b12 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'create', calling method: .version_select at 0x7fd4d12d8790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1060140044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmcMiqvUEku/UPjGjBiYLiTDNNfKqlPosJ6DhiASY2PpYzA2Q+bhihLJQWnjMx9DSr1sgOTliImuk9fL8womW9uGGcK9Z0xRP3AFI5AskJJygDJvZUkZCApn/vzjtAOgg=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:23.793155 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-89c6e1aa-77d7-484e-8718-a59c35928b12 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:22:23.799964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-89c6e1aa-77d7-484e-8718-a59c35928b12 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for user 01a419fcbb7a4558add32361c96e387c and project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:22:23.832025 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-89c6e1aa-77d7-484e-8718-a59c35928b12 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.063301 Oct 04 19:22:23.832713 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3909/7813] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:22:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:29.767161 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1940220986", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "8c77e39e-acc6-4e22-bde2-5f00fbef64bd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1060140044", "security_groups": [{"name": "tempest-secgroup-smoke-46029766"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:29.780185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=34 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:29.893294 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] validate_networks() for [('8c77e39e-acc6-4e22-bde2-5f00fbef64bd', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:22:30.292934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:22:30.293413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:22:30.293910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:22:30.294340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:22:30.294780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:22:30.309005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:30.309715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:30.310197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:30.311033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:30.311524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:30.311980 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:30.331104 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:22:30.336525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for user 01a419fcbb7a4558add32361c96e387c and project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:22:30.350315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:22:30.352729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:22:30.403517 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1693b7dd-ef8a-4ef4-9140-0252904a17e3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.641223 Oct 04 19:22:30.411558 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3905/7814] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:22:29 2022] POST /compute/v2.1/servers => generated 404 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:22:30.417874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a8d3d63b-49e4-434c-9d45-a07f77d975fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:30.419267 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a8d3d63b-49e4-434c-9d45-a07f77d975fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:30.423122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:30.506619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a8d3d63b-49e4-434c-9d45-a07f77d975fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:30.523350 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a8d3d63b-49e4-434c-9d45-a07f77d975fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1267 microversion: 2.1 time: 0.109429 Oct 04 19:22:30.530524 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3910/7815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:30 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:31.558661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-50ad40f3-0280-486d-ae9b-e216de5b1f03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:31.559409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-50ad40f3-0280-486d-ae9b-e216de5b1f03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:31.569005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50ad40f3-0280-486d-ae9b-e216de5b1f03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:31.570018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50ad40f3-0280-486d-ae9b-e216de5b1f03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:31.570764 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50ad40f3-0280-486d-ae9b-e216de5b1f03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:31.571927 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50ad40f3-0280-486d-ae9b-e216de5b1f03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:31.572658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50ad40f3-0280-486d-ae9b-e216de5b1f03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:31.573365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-50ad40f3-0280-486d-ae9b-e216de5b1f03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:31.677933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-50ad40f3-0280-486d-ae9b-e216de5b1f03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:31.687563 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-50ad40f3-0280-486d-ae9b-e216de5b1f03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1327 microversion: 2.1 time: 0.134706 Oct 04 19:22:31.702983 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3906/7816] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:31 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1327 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:32.717376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e2a07821-3207-4c17-982b-3bb7036c534a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:32.718011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e2a07821-3207-4c17-982b-3bb7036c534a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:32.725056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a07821-3207-4c17-982b-3bb7036c534a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:32.725556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a07821-3207-4c17-982b-3bb7036c534a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:32.726009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a07821-3207-4c17-982b-3bb7036c534a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:32.726719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a07821-3207-4c17-982b-3bb7036c534a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:32.727212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a07821-3207-4c17-982b-3bb7036c534a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:32.727651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e2a07821-3207-4c17-982b-3bb7036c534a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:32.937588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e2a07821-3207-4c17-982b-3bb7036c534a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:32.945399 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e2a07821-3207-4c17-982b-3bb7036c534a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1391 microversion: 2.1 time: 0.232809 Oct 04 19:22:32.946064 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3911/7817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:32 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:33.311808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-632e849b-f3e9-4698-b9cb-179fcaa02524 req-491e08a1-0761-4f17-90d6-dae514193727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01add322-4cf3-4b0f-acca-93b95c7d3214", "tag": "07ae8e36-45fa-404e-87b4-60834ddd098f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:33.325391 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-632e849b-f3e9-4698-b9cb-179fcaa02524 req-491e08a1-0761-4f17-90d6-dae514193727 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:33.325912 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-632e849b-f3e9-4698-b9cb-179fcaa02524 req-491e08a1-0761-4f17-90d6-dae514193727 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:33.326412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-632e849b-f3e9-4698-b9cb-179fcaa02524 req-491e08a1-0761-4f17-90d6-dae514193727 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:33.341756 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-632e849b-f3e9-4698-b9cb-179fcaa02524 req-491e08a1-0761-4f17-90d6-dae514193727 service nova] Creating event network-changed:07ae8e36-45fa-404e-87b4-60834ddd098f for instance 01add322-4cf3-4b0f-acca-93b95c7d3214 on n-h2-850499-14 Oct 04 19:22:33.348030 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-632e849b-f3e9-4698-b9cb-179fcaa02524 req-491e08a1-0761-4f17-90d6-dae514193727 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040060 Oct 04 19:22:33.348807 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3907/7818] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:22:33.969019 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f6fbecda-cc73-4c7b-93be-592a8bf45c2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:33.970006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f6fbecda-cc73-4c7b-93be-592a8bf45c2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:33.977308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6fbecda-cc73-4c7b-93be-592a8bf45c2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:33.977800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6fbecda-cc73-4c7b-93be-592a8bf45c2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:33.978249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6fbecda-cc73-4c7b-93be-592a8bf45c2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:33.979081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6fbecda-cc73-4c7b-93be-592a8bf45c2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:33.979462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6fbecda-cc73-4c7b-93be-592a8bf45c2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:33.979922 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f6fbecda-cc73-4c7b-93be-592a8bf45c2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:34.200811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f6fbecda-cc73-4c7b-93be-592a8bf45c2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:34.210240 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f6fbecda-cc73-4c7b-93be-592a8bf45c2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1391 microversion: 2.1 time: 0.245189 Oct 04 19:22:34.210845 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3912/7819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:33 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:35.235685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e100c4f8-9d88-4e17-8710-067850c0d10f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:35.236464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e100c4f8-9d88-4e17-8710-067850c0d10f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:35.242920 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e100c4f8-9d88-4e17-8710-067850c0d10f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:35.243469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e100c4f8-9d88-4e17-8710-067850c0d10f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:35.243946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e100c4f8-9d88-4e17-8710-067850c0d10f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:35.244831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e100c4f8-9d88-4e17-8710-067850c0d10f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:35.245327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e100c4f8-9d88-4e17-8710-067850c0d10f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:35.245779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e100c4f8-9d88-4e17-8710-067850c0d10f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:35.382627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e100c4f8-9d88-4e17-8710-067850c0d10f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:35.391643 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e100c4f8-9d88-4e17-8710-067850c0d10f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1391 microversion: 2.1 time: 0.161358 Oct 04 19:22:35.392462 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3908/7820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:35 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:36.414487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9ce6fa41-e524-499e-b6d0-1cc273ad0510 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:36.415186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9ce6fa41-e524-499e-b6d0-1cc273ad0510 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:36.423041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce6fa41-e524-499e-b6d0-1cc273ad0510 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:36.423557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce6fa41-e524-499e-b6d0-1cc273ad0510 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:36.424102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce6fa41-e524-499e-b6d0-1cc273ad0510 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:36.424825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce6fa41-e524-499e-b6d0-1cc273ad0510 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:36.425293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce6fa41-e524-499e-b6d0-1cc273ad0510 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:36.425732 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9ce6fa41-e524-499e-b6d0-1cc273ad0510 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:36.657862 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9ce6fa41-e524-499e-b6d0-1cc273ad0510 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:36.666486 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9ce6fa41-e524-499e-b6d0-1cc273ad0510 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1391 microversion: 2.1 time: 0.255836 Oct 04 19:22:36.667660 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3913/7821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:36 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:37.694802 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d7b09a89-f9e4-44a7-9830-88fbb5d786d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:37.695469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d7b09a89-f9e4-44a7-9830-88fbb5d786d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:37.702397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b09a89-f9e4-44a7-9830-88fbb5d786d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:37.702910 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b09a89-f9e4-44a7-9830-88fbb5d786d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:37.703405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b09a89-f9e4-44a7-9830-88fbb5d786d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:37.704643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b09a89-f9e4-44a7-9830-88fbb5d786d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:37.705200 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b09a89-f9e4-44a7-9830-88fbb5d786d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:37.705655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b09a89-f9e4-44a7-9830-88fbb5d786d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:37.841358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d7b09a89-f9e4-44a7-9830-88fbb5d786d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:37.849755 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d7b09a89-f9e4-44a7-9830-88fbb5d786d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1391 microversion: 2.1 time: 0.159006 Oct 04 19:22:37.850331 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3909/7822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:37 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:38.872849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10442e12-4836-4962-b944-1b1d2f8bcd0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:38.873419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10442e12-4836-4962-b944-1b1d2f8bcd0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:38.880244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10442e12-4836-4962-b944-1b1d2f8bcd0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:38.880740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10442e12-4836-4962-b944-1b1d2f8bcd0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:38.881187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10442e12-4836-4962-b944-1b1d2f8bcd0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:38.881890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10442e12-4836-4962-b944-1b1d2f8bcd0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:38.882351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10442e12-4836-4962-b944-1b1d2f8bcd0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:38.882789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10442e12-4836-4962-b944-1b1d2f8bcd0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:39.015134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-10442e12-4836-4962-b944-1b1d2f8bcd0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:39.023176 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10442e12-4836-4962-b944-1b1d2f8bcd0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1391 microversion: 2.1 time: 0.154338 Oct 04 19:22:39.023774 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3914/7823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:38 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:39.494914 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-3e61ee71-05de-4bf9-a942-8d7d37a30fca req-eae8b1cc-15bc-4915-afc6-037333eb7438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01add322-4cf3-4b0f-acca-93b95c7d3214", "name": "network-vif-plugged", "status": "completed", "tag": "07ae8e36-45fa-404e-87b4-60834ddd098f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:39.505829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3e61ee71-05de-4bf9-a942-8d7d37a30fca req-eae8b1cc-15bc-4915-afc6-037333eb7438 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:39.506399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3e61ee71-05de-4bf9-a942-8d7d37a30fca req-eae8b1cc-15bc-4915-afc6-037333eb7438 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:39.506935 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-3e61ee71-05de-4bf9-a942-8d7d37a30fca req-eae8b1cc-15bc-4915-afc6-037333eb7438 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:39.519357 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-3e61ee71-05de-4bf9-a942-8d7d37a30fca req-eae8b1cc-15bc-4915-afc6-037333eb7438 service nova] Creating event network-vif-plugged:07ae8e36-45fa-404e-87b4-60834ddd098f for instance 01add322-4cf3-4b0f-acca-93b95c7d3214 on n-h2-850499-14 Oct 04 19:22:39.524489 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-3e61ee71-05de-4bf9-a942-8d7d37a30fca req-eae8b1cc-15bc-4915-afc6-037333eb7438 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033577 Oct 04 19:22:39.525103 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3910/7824] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:40.046612 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0e60a9b0-b908-464d-83cf-e9fa31f0318b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:40.047220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0e60a9b0-b908-464d-83cf-e9fa31f0318b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:40.055313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e60a9b0-b908-464d-83cf-e9fa31f0318b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:40.055805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e60a9b0-b908-464d-83cf-e9fa31f0318b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:40.056247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e60a9b0-b908-464d-83cf-e9fa31f0318b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:40.056962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e60a9b0-b908-464d-83cf-e9fa31f0318b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:40.057421 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e60a9b0-b908-464d-83cf-e9fa31f0318b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:40.057850 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0e60a9b0-b908-464d-83cf-e9fa31f0318b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:40.193554 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0e60a9b0-b908-464d-83cf-e9fa31f0318b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:40.201594 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0e60a9b0-b908-464d-83cf-e9fa31f0318b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1391 microversion: 2.1 time: 0.158994 Oct 04 19:22:40.202167 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3915/7825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:40 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:41.225615 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dd944502-e10a-4498-a5a5-3c4dc5f084f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:41.226348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dd944502-e10a-4498-a5a5-3c4dc5f084f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:41.228415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:41.229110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:41.236648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd944502-e10a-4498-a5a5-3c4dc5f084f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:41.237164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd944502-e10a-4498-a5a5-3c4dc5f084f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:41.237632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd944502-e10a-4498-a5a5-3c4dc5f084f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:41.238364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd944502-e10a-4498-a5a5-3c4dc5f084f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:41.238847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd944502-e10a-4498-a5a5-3c4dc5f084f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:41.239326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dd944502-e10a-4498-a5a5-3c4dc5f084f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:41.385042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dd944502-e10a-4498-a5a5-3c4dc5f084f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:41.393029 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dd944502-e10a-4498-a5a5-3c4dc5f084f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1564 microversion: 2.1 time: 0.171764 Oct 04 19:22:41.393616 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3911/7826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:41 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:41.416279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5883a94f-fbee-4311-b4ca-e39229765b85 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:41.416796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5883a94f-fbee-4311-b4ca-e39229765b85 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:41.418432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:41.420005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:41.427526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5883a94f-fbee-4311-b4ca-e39229765b85 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:41.428053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5883a94f-fbee-4311-b4ca-e39229765b85 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:41.428502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5883a94f-fbee-4311-b4ca-e39229765b85 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:41.429213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5883a94f-fbee-4311-b4ca-e39229765b85 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:41.429678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5883a94f-fbee-4311-b4ca-e39229765b85 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:41.430111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5883a94f-fbee-4311-b4ca-e39229765b85 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:41.574095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5883a94f-fbee-4311-b4ca-e39229765b85 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:41.582560 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5883a94f-fbee-4311-b4ca-e39229765b85 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1564 microversion: 2.1 time: 0.170421 Oct 04 19:22:41.583182 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3916/7827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:41 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:43.262399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-bb6fbb49-9a77-4c45-8c4e-7c643b5bd1db req-14a98da2-a813-49da-b4ed-0e3139c4553d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01add322-4cf3-4b0f-acca-93b95c7d3214", "tag": "07ae8e36-45fa-404e-87b4-60834ddd098f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:43.269720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7d29c48d-5a4c-4271-b68a-a0e0638e3676 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:43.270364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7d29c48d-5a4c-4271-b68a-a0e0638e3676 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:43.272929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:43.285960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bb6fbb49-9a77-4c45-8c4e-7c643b5bd1db req-14a98da2-a813-49da-b4ed-0e3139c4553d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:43.286468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bb6fbb49-9a77-4c45-8c4e-7c643b5bd1db req-14a98da2-a813-49da-b4ed-0e3139c4553d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:43.286905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-bb6fbb49-9a77-4c45-8c4e-7c643b5bd1db req-14a98da2-a813-49da-b4ed-0e3139c4553d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:43.290891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d29c48d-5a4c-4271-b68a-a0e0638e3676 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:43.291547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d29c48d-5a4c-4271-b68a-a0e0638e3676 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:43.292008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d29c48d-5a4c-4271-b68a-a0e0638e3676 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:43.292751 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d29c48d-5a4c-4271-b68a-a0e0638e3676 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:43.293226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d29c48d-5a4c-4271-b68a-a0e0638e3676 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:43.293672 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7d29c48d-5a4c-4271-b68a-a0e0638e3676 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:43.301093 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-bb6fbb49-9a77-4c45-8c4e-7c643b5bd1db req-14a98da2-a813-49da-b4ed-0e3139c4553d service nova] Creating event network-changed:07ae8e36-45fa-404e-87b4-60834ddd098f for instance 01add322-4cf3-4b0f-acca-93b95c7d3214 on n-h2-850499-14 Oct 04 19:22:43.306006 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-bb6fbb49-9a77-4c45-8c4e-7c643b5bd1db req-14a98da2-a813-49da-b4ed-0e3139c4553d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047847 Oct 04 19:22:43.306681 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3917/7828] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:43.560065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7d29c48d-5a4c-4271-b68a-a0e0638e3676 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:43.568509 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7d29c48d-5a4c-4271-b68a-a0e0638e3676 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1564 microversion: 2.1 time: 0.315096 Oct 04 19:22:43.579955 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3912/7829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:43 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1564 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:16.853878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:16.854769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=38 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:16.859318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-db2818e1-72a1-41b4-a3cd-2d62835d72a4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:16.861618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-db2818e1-72a1-41b4-a3cd-2d62835d72a4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:16.868498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db2818e1-72a1-41b4-a3cd-2d62835d72a4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:16.868987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db2818e1-72a1-41b4-a3cd-2d62835d72a4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:16.869432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db2818e1-72a1-41b4-a3cd-2d62835d72a4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:16.870125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db2818e1-72a1-41b4-a3cd-2d62835d72a4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:16.870585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db2818e1-72a1-41b4-a3cd-2d62835d72a4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:16.871038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-db2818e1-72a1-41b4-a3cd-2d62835d72a4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:16.945248 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-db2818e1-72a1-41b4-a3cd-2d62835d72a4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214/action" status: 200 len: 24574 microversion: 2.1 time: 0.093567 Oct 04 19:23:16.946082 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3918/7830] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:23:16 2022] POST /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214/action => generated 24574 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:23:55.723045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:55.723832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=36 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:55.729307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-36d45027-1d90-4fd4-aa32-6a93a01bed8a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:55.731599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-36d45027-1d90-4fd4-aa32-6a93a01bed8a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:55.738679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d45027-1d90-4fd4-aa32-6a93a01bed8a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:55.739220 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d45027-1d90-4fd4-aa32-6a93a01bed8a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:55.739685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d45027-1d90-4fd4-aa32-6a93a01bed8a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:55.740405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d45027-1d90-4fd4-aa32-6a93a01bed8a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:55.740887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d45027-1d90-4fd4-aa32-6a93a01bed8a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:55.741336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-36d45027-1d90-4fd4-aa32-6a93a01bed8a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:55.814865 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-36d45027-1d90-4fd4-aa32-6a93a01bed8a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214/action" status: 202 len: 0 microversion: 2.1 time: 0.093516 Oct 04 19:23:55.815667 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3913/7831] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:23:55 2022] POST /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:23:55.826140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ce190e3-82c1-4671-b2ad-cbb782e0fbc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:55.827074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8ce190e3-82c1-4671-b2ad-cbb782e0fbc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:55.829762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:55.830436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:55.843230 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ce190e3-82c1-4671-b2ad-cbb782e0fbc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:55.843746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ce190e3-82c1-4671-b2ad-cbb782e0fbc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:55.844197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ce190e3-82c1-4671-b2ad-cbb782e0fbc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:55.844908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ce190e3-82c1-4671-b2ad-cbb782e0fbc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:55.845364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ce190e3-82c1-4671-b2ad-cbb782e0fbc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:55.845794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ce190e3-82c1-4671-b2ad-cbb782e0fbc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:56.033941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8ce190e3-82c1-4671-b2ad-cbb782e0fbc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:56.041746 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8ce190e3-82c1-4671-b2ad-cbb782e0fbc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1674 microversion: 2.1 time: 0.220717 Oct 04 19:23:56.042647 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3919/7832] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:55 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1674 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:57.067930 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c36869fc-33d1-425c-8be6-a69e0222021d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:57.068651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c36869fc-33d1-425c-8be6-a69e0222021d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:57.075426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36869fc-33d1-425c-8be6-a69e0222021d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:57.076078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36869fc-33d1-425c-8be6-a69e0222021d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:57.076557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36869fc-33d1-425c-8be6-a69e0222021d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:57.077558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36869fc-33d1-425c-8be6-a69e0222021d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:57.078038 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36869fc-33d1-425c-8be6-a69e0222021d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:57.078485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c36869fc-33d1-425c-8be6-a69e0222021d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:57.213395 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c36869fc-33d1-425c-8be6-a69e0222021d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:57.221238 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c36869fc-33d1-425c-8be6-a69e0222021d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1679 microversion: 2.1 time: 0.159144 Oct 04 19:23:57.221803 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3914/7833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:57 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:58.247392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-22fa76d3-3c80-4acc-9cc5-130697fffd01 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:58.248009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-22fa76d3-3c80-4acc-9cc5-130697fffd01 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:58.255583 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fa76d3-3c80-4acc-9cc5-130697fffd01 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:58.256071 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fa76d3-3c80-4acc-9cc5-130697fffd01 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:58.256510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fa76d3-3c80-4acc-9cc5-130697fffd01 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:58.257207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fa76d3-3c80-4acc-9cc5-130697fffd01 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:58.257657 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fa76d3-3c80-4acc-9cc5-130697fffd01 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:58.258080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-22fa76d3-3c80-4acc-9cc5-130697fffd01 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:58.386933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-22fa76d3-3c80-4acc-9cc5-130697fffd01 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:58.394670 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-22fa76d3-3c80-4acc-9cc5-130697fffd01 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1679 microversion: 2.1 time: 0.151354 Oct 04 19:23:58.395791 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3920/7834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:58 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:59.419641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f289ad17-675e-437f-ba94-50da85fe3978 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:59.420279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f289ad17-675e-437f-ba94-50da85fe3978 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:59.427525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f289ad17-675e-437f-ba94-50da85fe3978 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:59.428083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f289ad17-675e-437f-ba94-50da85fe3978 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:59.428482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f289ad17-675e-437f-ba94-50da85fe3978 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:59.429205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f289ad17-675e-437f-ba94-50da85fe3978 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:59.430035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f289ad17-675e-437f-ba94-50da85fe3978 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:59.430503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f289ad17-675e-437f-ba94-50da85fe3978 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:59.564227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f289ad17-675e-437f-ba94-50da85fe3978 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:59.572136 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f289ad17-675e-437f-ba94-50da85fe3978 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1679 microversion: 2.1 time: 0.156463 Oct 04 19:23:59.572700 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3915/7835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:59 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:00.595811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-eaadd0f4-bc85-4320-ba70-1bf0f84dc4a9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:00.596429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-eaadd0f4-bc85-4320-ba70-1bf0f84dc4a9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:00.602739 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaadd0f4-bc85-4320-ba70-1bf0f84dc4a9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:00.603269 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaadd0f4-bc85-4320-ba70-1bf0f84dc4a9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:00.603712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaadd0f4-bc85-4320-ba70-1bf0f84dc4a9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:00.604403 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaadd0f4-bc85-4320-ba70-1bf0f84dc4a9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:00.604859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaadd0f4-bc85-4320-ba70-1bf0f84dc4a9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:00.605287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-eaadd0f4-bc85-4320-ba70-1bf0f84dc4a9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:00.734349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-eaadd0f4-bc85-4320-ba70-1bf0f84dc4a9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:00.743507 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-eaadd0f4-bc85-4320-ba70-1bf0f84dc4a9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1679 microversion: 2.1 time: 0.151695 Oct 04 19:24:00.744091 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3921/7836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:00 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:01.767311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-42ec3a9b-0aa5-4b93-a2f1-c92c7ce8f2c0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:01.767854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-42ec3a9b-0aa5-4b93-a2f1-c92c7ce8f2c0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:01.775438 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ec3a9b-0aa5-4b93-a2f1-c92c7ce8f2c0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:01.775949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ec3a9b-0aa5-4b93-a2f1-c92c7ce8f2c0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:01.776412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ec3a9b-0aa5-4b93-a2f1-c92c7ce8f2c0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:01.777131 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ec3a9b-0aa5-4b93-a2f1-c92c7ce8f2c0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:01.777610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ec3a9b-0aa5-4b93-a2f1-c92c7ce8f2c0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:01.778057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-42ec3a9b-0aa5-4b93-a2f1-c92c7ce8f2c0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:01.912862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-42ec3a9b-0aa5-4b93-a2f1-c92c7ce8f2c0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:01.920699 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-42ec3a9b-0aa5-4b93-a2f1-c92c7ce8f2c0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1679 microversion: 2.1 time: 0.157480 Oct 04 19:24:01.921277 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3916/7837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:01 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:02.944150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4bc9a2d3-20a9-45d6-9f4a-9e53eb40ca5b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:02.945474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4bc9a2d3-20a9-45d6-9f4a-9e53eb40ca5b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:02.952353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bc9a2d3-20a9-45d6-9f4a-9e53eb40ca5b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:02.952844 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bc9a2d3-20a9-45d6-9f4a-9e53eb40ca5b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:02.953287 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bc9a2d3-20a9-45d6-9f4a-9e53eb40ca5b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:02.953988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bc9a2d3-20a9-45d6-9f4a-9e53eb40ca5b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:02.954442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bc9a2d3-20a9-45d6-9f4a-9e53eb40ca5b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:02.954872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bc9a2d3-20a9-45d6-9f4a-9e53eb40ca5b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:03.090312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4bc9a2d3-20a9-45d6-9f4a-9e53eb40ca5b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:03.098030 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4bc9a2d3-20a9-45d6-9f4a-9e53eb40ca5b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1679 microversion: 2.1 time: 0.157836 Oct 04 19:24:03.099127 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3922/7838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:02 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:24:04.121846 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0c5bf728-e33b-44cd-b8da-7370cd49267c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:04.122508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0c5bf728-e33b-44cd-b8da-7370cd49267c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:04.129481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c5bf728-e33b-44cd-b8da-7370cd49267c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:04.130514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c5bf728-e33b-44cd-b8da-7370cd49267c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:04.130997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c5bf728-e33b-44cd-b8da-7370cd49267c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:04.131719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c5bf728-e33b-44cd-b8da-7370cd49267c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:04.132197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c5bf728-e33b-44cd-b8da-7370cd49267c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:04.132645 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0c5bf728-e33b-44cd-b8da-7370cd49267c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:04.262583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0c5bf728-e33b-44cd-b8da-7370cd49267c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:04.270527 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0c5bf728-e33b-44cd-b8da-7370cd49267c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1679 microversion: 2.1 time: 0.152669 Oct 04 19:24:04.271237 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3917/7839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:04 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:05.294334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c808de9-a27b-4bf7-addc-c1f0900b03b3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:05.294978 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4c808de9-a27b-4bf7-addc-c1f0900b03b3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:05.302970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c808de9-a27b-4bf7-addc-c1f0900b03b3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:05.303452 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c808de9-a27b-4bf7-addc-c1f0900b03b3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:05.303892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c808de9-a27b-4bf7-addc-c1f0900b03b3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:05.304610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c808de9-a27b-4bf7-addc-c1f0900b03b3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:05.305065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c808de9-a27b-4bf7-addc-c1f0900b03b3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:05.305490 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4c808de9-a27b-4bf7-addc-c1f0900b03b3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:05.474679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4c808de9-a27b-4bf7-addc-c1f0900b03b3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:05.482802 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c808de9-a27b-4bf7-addc-c1f0900b03b3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1679 microversion: 2.1 time: 0.192289 Oct 04 19:24:05.483422 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3923/7840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:05 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:06.508124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c486120-48b4-4dc2-accf-971dae7d60c6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:06.508756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1c486120-48b4-4dc2-accf-971dae7d60c6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:06.515675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c486120-48b4-4dc2-accf-971dae7d60c6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:06.516179 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c486120-48b4-4dc2-accf-971dae7d60c6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:06.516639 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c486120-48b4-4dc2-accf-971dae7d60c6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:06.517347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c486120-48b4-4dc2-accf-971dae7d60c6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:06.517820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c486120-48b4-4dc2-accf-971dae7d60c6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:06.518262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c486120-48b4-4dc2-accf-971dae7d60c6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:06.648163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1c486120-48b4-4dc2-accf-971dae7d60c6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:06.655991 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c486120-48b4-4dc2-accf-971dae7d60c6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1679 microversion: 2.1 time: 0.152502 Oct 04 19:24:06.656572 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3918/7841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:06 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:07.680104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dfbf3f50-1069-40e0-9518-9660ef1cdbe4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:07.680729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dfbf3f50-1069-40e0-9518-9660ef1cdbe4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:07.687740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfbf3f50-1069-40e0-9518-9660ef1cdbe4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:07.688167 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfbf3f50-1069-40e0-9518-9660ef1cdbe4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:07.688607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfbf3f50-1069-40e0-9518-9660ef1cdbe4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:07.689298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfbf3f50-1069-40e0-9518-9660ef1cdbe4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:07.689754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfbf3f50-1069-40e0-9518-9660ef1cdbe4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:07.690209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dfbf3f50-1069-40e0-9518-9660ef1cdbe4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:07.823147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dfbf3f50-1069-40e0-9518-9660ef1cdbe4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:07.830857 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dfbf3f50-1069-40e0-9518-9660ef1cdbe4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1682 microversion: 2.1 time: 0.154715 Oct 04 19:24:07.831463 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3924/7842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:07 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:42.056943 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4255335b-6a91-4131-a9d2-79fd87fe4900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:42.059194 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4255335b-6a91-4131-a9d2-79fd87fe4900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:42.061544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=12 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:42.062216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:42.068301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4255335b-6a91-4131-a9d2-79fd87fe4900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:42.068801 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4255335b-6a91-4131-a9d2-79fd87fe4900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:42.069253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4255335b-6a91-4131-a9d2-79fd87fe4900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.069962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4255335b-6a91-4131-a9d2-79fd87fe4900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:42.070432 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4255335b-6a91-4131-a9d2-79fd87fe4900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:42.070874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4255335b-6a91-4131-a9d2-79fd87fe4900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.143104 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4255335b-6a91-4131-a9d2-79fd87fe4900 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214/action" status: 200 len: 69046 microversion: 2.1 time: 0.090083 Oct 04 19:24:42.143787 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3919/7843] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:24:42 2022] POST /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214/action => generated 69046 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:24:59.445733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-25cb8d9c-d668-47e0-a6e7-db1a820bd41c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:59.447396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-25cb8d9c-d668-47e0-a6e7-db1a820bd41c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:59.449891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=12 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:59.450699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=36 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:59.457523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:59.458885 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:59.472469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25cb8d9c-d668-47e0-a6e7-db1a820bd41c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.472976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25cb8d9c-d668-47e0-a6e7-db1a820bd41c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.473432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25cb8d9c-d668-47e0-a6e7-db1a820bd41c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.474164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25cb8d9c-d668-47e0-a6e7-db1a820bd41c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.474624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25cb8d9c-d668-47e0-a6e7-db1a820bd41c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.475087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-25cb8d9c-d668-47e0-a6e7-db1a820bd41c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.507645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-25cb8d9c-d668-47e0-a6e7-db1a820bd41c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:24:59.572263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-90575a76-e9ff-40d4-ae40-a49c1d3a52b5 req-844ddae7-9947-4186-8701-5270840bd0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01add322-4cf3-4b0f-acca-93b95c7d3214", "tag": "07ae8e36-45fa-404e-87b4-60834ddd098f"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:59.584656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-90575a76-e9ff-40d4-ae40-a49c1d3a52b5 req-844ddae7-9947-4186-8701-5270840bd0cc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.585270 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-90575a76-e9ff-40d4-ae40-a49c1d3a52b5 req-844ddae7-9947-4186-8701-5270840bd0cc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.585653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-90575a76-e9ff-40d4-ae40-a49c1d3a52b5 req-844ddae7-9947-4186-8701-5270840bd0cc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.597619 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-90575a76-e9ff-40d4-ae40-a49c1d3a52b5 req-844ddae7-9947-4186-8701-5270840bd0cc service nova] Creating event network-changed:07ae8e36-45fa-404e-87b4-60834ddd098f for instance 01add322-4cf3-4b0f-acca-93b95c7d3214 on n-h2-850499-14 Oct 04 19:24:59.603249 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-90575a76-e9ff-40d4-ae40-a49c1d3a52b5 req-844ddae7-9947-4186-8701-5270840bd0cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155944 Oct 04 19:24:59.606830 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-25cb8d9c-d668-47e0-a6e7-db1a820bd41c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "DELETE /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 204 len: 0 microversion: 2.1 time: 0.164102 Oct 04 19:24:59.607396 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3920/7844] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:24:59.607591 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3925/7845] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:24:59 2022] DELETE /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:24:59.616866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-159c5c1d-c39e-4986-a274-2d26727276c7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:59.617609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-159c5c1d-c39e-4986-a274-2d26727276c7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:59.624719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-159c5c1d-c39e-4986-a274-2d26727276c7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.625246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-159c5c1d-c39e-4986-a274-2d26727276c7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.625717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-159c5c1d-c39e-4986-a274-2d26727276c7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.626456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-159c5c1d-c39e-4986-a274-2d26727276c7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.626940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-159c5c1d-c39e-4986-a274-2d26727276c7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.627422 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-159c5c1d-c39e-4986-a274-2d26727276c7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.781853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-159c5c1d-c39e-4986-a274-2d26727276c7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:59.790761 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-159c5c1d-c39e-4986-a274-2d26727276c7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1688 microversion: 2.1 time: 0.178157 Oct 04 19:24:59.802975 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3921/7846] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:59 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:00.816814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8241939f-11ce-472a-92f2-dbd248c74852 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:00.817523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8241939f-11ce-472a-92f2-dbd248c74852 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:00.824905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8241939f-11ce-472a-92f2-dbd248c74852 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:00.825395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8241939f-11ce-472a-92f2-dbd248c74852 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:00.825853 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8241939f-11ce-472a-92f2-dbd248c74852 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:00.826550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8241939f-11ce-472a-92f2-dbd248c74852 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:00.827030 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8241939f-11ce-472a-92f2-dbd248c74852 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:00.827471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8241939f-11ce-472a-92f2-dbd248c74852 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:00.972643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8241939f-11ce-472a-92f2-dbd248c74852 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:00.981199 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8241939f-11ce-472a-92f2-dbd248c74852 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1688 microversion: 2.1 time: 0.168686 Oct 04 19:25:00.981798 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3926/7847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:00 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:02.004221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d066c000-fb01-4f83-bec5-abdd27365aca tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:02.004863 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d066c000-fb01-4f83-bec5-abdd27365aca tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:02.012286 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d066c000-fb01-4f83-bec5-abdd27365aca tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:02.012805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d066c000-fb01-4f83-bec5-abdd27365aca tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:02.013278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d066c000-fb01-4f83-bec5-abdd27365aca tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:02.014046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d066c000-fb01-4f83-bec5-abdd27365aca tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:02.014556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d066c000-fb01-4f83-bec5-abdd27365aca tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:02.015056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d066c000-fb01-4f83-bec5-abdd27365aca tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:02.230502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d066c000-fb01-4f83-bec5-abdd27365aca tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:02.239657 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d066c000-fb01-4f83-bec5-abdd27365aca tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 200 len: 1570 microversion: 2.1 time: 0.239235 Oct 04 19:25:02.256971 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3922/7848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:01 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 1570 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:02.358208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-7cde0d29-d51c-4b9b-b85b-be75e710f16c req-16a1aa4b-3a9e-4bac-ba49-ed730d0d1817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01add322-4cf3-4b0f-acca-93b95c7d3214", "name": "network-vif-deleted", "tag": "07ae8e36-45fa-404e-87b4-60834ddd098f"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:02.369839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7cde0d29-d51c-4b9b-b85b-be75e710f16c req-16a1aa4b-3a9e-4bac-ba49-ed730d0d1817 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:02.370332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7cde0d29-d51c-4b9b-b85b-be75e710f16c req-16a1aa4b-3a9e-4bac-ba49-ed730d0d1817 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:02.370769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-7cde0d29-d51c-4b9b-b85b-be75e710f16c req-16a1aa4b-3a9e-4bac-ba49-ed730d0d1817 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:02.382599 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-7cde0d29-d51c-4b9b-b85b-be75e710f16c req-16a1aa4b-3a9e-4bac-ba49-ed730d0d1817 service nova] Creating event network-vif-deleted:07ae8e36-45fa-404e-87b4-60834ddd098f for instance 01add322-4cf3-4b0f-acca-93b95c7d3214 on n-h2-850499-14 Oct 04 19:25:02.388132 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-7cde0d29-d51c-4b9b-b85b-be75e710f16c req-16a1aa4b-3a9e-4bac-ba49-ed730d0d1817 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095107 Oct 04 19:25:02.388759 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3927/7849] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:03.265283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:03.265900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 01add322-4cf3-4b0f-acca-93b95c7d3214] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:03.273243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:03.273747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:03.274482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:03.275223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:03.275708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:03.276146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:03.289769 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] HTTP exception thrown: Instance 01add322-4cf3-4b0f-acca-93b95c7d3214 could not be found. Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Request method failure captured: Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 HTTP/1.1 Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIeN8IpXRvunr76MaJcsy7gb5UP6P4wqRVf0JkFXuXKO2yf2pFEvJw8J88FNBXWWUdzOw2EIDCftvfvYY_kAe0UTJSv2yPFw5P2VL_L4-kqKLgsStF_OIK04o3eUaRuB3lR-bHSuVie82p8LaoF1Nxb20sOCbZAKQ5m9_sRAS24DjP0 Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2c351b5f6e644ae793a7cd81ce120f12 Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c351b5f6e644ae793a7cd81ce120f12"}]}] Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2c351b5f6e644ae793a7cd81ce120f12 Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestNetworkAdvancedServerOps-773175457-project Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 01a419fcbb7a4558add32361c96e387c Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestNetworkAdvancedServerOps-773175457-project Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 01add322-4cf3-4b0f-acca-93b95c7d3214 could not be found. Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '01add322-4cf3-4b0f-acca-93b95c7d3214'} Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01add322-4cf3-4b0f-acca-93b95c7d3214 could not be found. Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01add322-4cf3-4b0f-acca-93b95c7d3214 could not be found. Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:25:03.291514 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01add322-4cf3-4b0f-acca-93b95c7d3214 could not be found. Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Returning 404 to user: Instance 01add322-4cf3-4b0f-acca-93b95c7d3214 could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-833ac570-1c01-4724-a687-997a44c395bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214" status: 404 len: 111 microversion: 2.1 time: 0.031676 Oct 04 19:25:03.296934 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3923/7850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:03 2022] GET /compute/v2.1/servers/01add322-4cf3-4b0f-acca-93b95c7d3214 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:25:07.185129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-64b5c7ca-ac9a-4b4a-8883-e523d18271f2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '.version_select at 0x7fd4d12d1790>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:07.190823 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64b5c7ca-ac9a-4b4a-8883-e523d18271f2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [fa0e5bf0-5cda-4994-9de5-118eac07f3bf] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:25:08.199789 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [None req-64b5c7ca-ac9a-4b4a-8883-e523d18271f2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [fa0e5bf0-5cda-4994-9de5-118eac07f3bf] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49968. Oct 04 19:25:08.219425 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-64b5c7ca-ac9a-4b4a-8883-e523d18271f2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1060140044" status: 202 len: 0 microversion: 2.1 time: 1.039348 Oct 04 19:25:08.220020 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3928/7851] 10.222.0.18 () {58 vars in 1284 bytes} [Tue Oct 4 19:25:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1060140044 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:25:08.248632 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0d23ff5f-57a2-4888-8361-87448d7c2fef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'create', calling method: .version_select at 0x7fd4d1d5b8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-95510960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjHRzjvA67FTXcc+GCAuL+zFZFaKQ3zfUq4VEwA1DWoOtUyVv7n4Zo2p0/2g9FsxA1/HUt4fohncg+sKAuublBh6Il8oVWYabRNB5HpDYVK1kHrvi5goz3gB9xwms0ZGg=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:08.268716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-0d23ff5f-57a2-4888-8361-87448d7c2fef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:25:08.273984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-0d23ff5f-57a2-4888-8361-87448d7c2fef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for user 01a419fcbb7a4558add32361c96e387c and project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:25:08.287586 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0d23ff5f-57a2-4888-8361-87448d7c2fef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [d9f288b1-1977-47eb-9b11-91ff29205328] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:25:09.295142 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [None req-0d23ff5f-57a2-4888-8361-87448d7c2fef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [d9f288b1-1977-47eb-9b11-91ff29205328] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49972. Oct 04 19:25:09.310690 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0d23ff5f-57a2-4888-8361-87448d7c2fef tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.065914 Oct 04 19:25:09.311330 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3924/7852] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:25:08 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:14.809546 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:14.814356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-112016600", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "0256f539-afb1-4601-9b3c-5a77c0d43a70"}], "key_name": "tempest-TestNetworkAdvancedServerOps-95510960", "security_groups": [{"name": "tempest-secgroup-smoke-1716806144"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:14.945881 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] validate_networks() for [('0256f539-afb1-4601-9b3c-5a77c0d43a70', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:25:15.477687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:25:15.478115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:25:15.478588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:25:15.479028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:25:15.479493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:25:15.490502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:15.491247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:15.491933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:15.492915 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:15.494352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:15.495048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:15.521736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:25:15.527497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for user 01a419fcbb7a4558add32361c96e387c and project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:25:15.552984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:25:15.556316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:25:15.606046 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [341c30fe-1904-4db6-9d54-58a18f82dfd3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:25:16.614222 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [341c30fe-1904-4db6-9d54-58a18f82dfd3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 50022. Oct 04 19:25:16.618258 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4bdaef1f-42d6-4933-9afd-06ab7f6e36e1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.810486 Oct 04 19:25:16.619183 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3929/7853] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:25:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:25:16.628606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=16 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:16.634095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-74bb215a-19f3-4922-a110-ec90d21b578f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:16.634756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-74bb215a-19f3-4922-a110-ec90d21b578f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:16.718606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-74bb215a-19f3-4922-a110-ec90d21b578f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:16.724926 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-74bb215a-19f3-4922-a110-ec90d21b578f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1264 microversion: 2.1 time: 0.098124 Oct 04 19:25:16.736284 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3925/7854] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:16 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1264 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:17.755061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-59fbf9c0-9864-4bb1-b967-5d18b0ada777 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:17.755871 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-59fbf9c0-9864-4bb1-b967-5d18b0ada777 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:17.762684 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59fbf9c0-9864-4bb1-b967-5d18b0ada777 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:17.763325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59fbf9c0-9864-4bb1-b967-5d18b0ada777 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:17.764157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59fbf9c0-9864-4bb1-b967-5d18b0ada777 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:17.764943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59fbf9c0-9864-4bb1-b967-5d18b0ada777 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:17.765784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59fbf9c0-9864-4bb1-b967-5d18b0ada777 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:17.766456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-59fbf9c0-9864-4bb1-b967-5d18b0ada777 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:17.860047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-59fbf9c0-9864-4bb1-b967-5d18b0ada777 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:17.873321 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-59fbf9c0-9864-4bb1-b967-5d18b0ada777 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1324 microversion: 2.1 time: 0.124057 Oct 04 19:25:17.876100 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3930/7855] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:17 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1324 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:18.900197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fa58ce3f-e6b9-41b2-b87d-f89934d7de73 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:18.900838 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fa58ce3f-e6b9-41b2-b87d-f89934d7de73 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:18.908530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa58ce3f-e6b9-41b2-b87d-f89934d7de73 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:18.909049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa58ce3f-e6b9-41b2-b87d-f89934d7de73 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:18.909512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa58ce3f-e6b9-41b2-b87d-f89934d7de73 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:18.910237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa58ce3f-e6b9-41b2-b87d-f89934d7de73 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:18.910716 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa58ce3f-e6b9-41b2-b87d-f89934d7de73 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:18.911192 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa58ce3f-e6b9-41b2-b87d-f89934d7de73 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:19.150206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fa58ce3f-e6b9-41b2-b87d-f89934d7de73 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:19.157883 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fa58ce3f-e6b9-41b2-b87d-f89934d7de73 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1390 microversion: 2.1 time: 0.262205 Oct 04 19:25:19.158455 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3926/7856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:18 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1390 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:19.357102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a8859288-bf87-4059-b18c-dd84c4f714e0 req-9752667f-d31b-4d85-b2cf-16d60492330c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ef5e22-ca22-4ee1-b0c8-7e600313dd08", "tag": "98f9c745-c283-4e72-9534-33c07d63f3ca"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:19.368859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a8859288-bf87-4059-b18c-dd84c4f714e0 req-9752667f-d31b-4d85-b2cf-16d60492330c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:19.369364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a8859288-bf87-4059-b18c-dd84c4f714e0 req-9752667f-d31b-4d85-b2cf-16d60492330c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:19.370012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a8859288-bf87-4059-b18c-dd84c4f714e0 req-9752667f-d31b-4d85-b2cf-16d60492330c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:19.381391 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a8859288-bf87-4059-b18c-dd84c4f714e0 req-9752667f-d31b-4d85-b2cf-16d60492330c service nova] Creating event network-changed:98f9c745-c283-4e72-9534-33c07d63f3ca for instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 on n-h2-850499-14 Oct 04 19:25:19.386569 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a8859288-bf87-4059-b18c-dd84c4f714e0 req-9752667f-d31b-4d85-b2cf-16d60492330c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033741 Oct 04 19:25:19.387266 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3931/7857] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:20.181691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-609c2c86-0b8a-42b5-86de-912339e40c11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:20.182329 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-609c2c86-0b8a-42b5-86de-912339e40c11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:20.189250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-609c2c86-0b8a-42b5-86de-912339e40c11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:20.189757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-609c2c86-0b8a-42b5-86de-912339e40c11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:20.190214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-609c2c86-0b8a-42b5-86de-912339e40c11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:20.190923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-609c2c86-0b8a-42b5-86de-912339e40c11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:20.191420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-609c2c86-0b8a-42b5-86de-912339e40c11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:20.191862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-609c2c86-0b8a-42b5-86de-912339e40c11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:20.321971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-609c2c86-0b8a-42b5-86de-912339e40c11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:20.329715 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-609c2c86-0b8a-42b5-86de-912339e40c11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1390 microversion: 2.1 time: 0.152679 Oct 04 19:25:20.330288 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3927/7858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:20 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:21.353859 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-99147de6-9d7e-4988-bcd7-59ee85638f3c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:21.354566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-99147de6-9d7e-4988-bcd7-59ee85638f3c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:21.360765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99147de6-9d7e-4988-bcd7-59ee85638f3c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:21.361257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99147de6-9d7e-4988-bcd7-59ee85638f3c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:21.361709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99147de6-9d7e-4988-bcd7-59ee85638f3c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:21.362410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99147de6-9d7e-4988-bcd7-59ee85638f3c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:21.362870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99147de6-9d7e-4988-bcd7-59ee85638f3c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:21.363332 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-99147de6-9d7e-4988-bcd7-59ee85638f3c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:21.494649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-99147de6-9d7e-4988-bcd7-59ee85638f3c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:21.502331 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-99147de6-9d7e-4988-bcd7-59ee85638f3c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1390 microversion: 2.1 time: 0.153624 Oct 04 19:25:21.502897 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3932/7859] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:21 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:22.525849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ddfe604-9427-40b8-b2de-1a7416ef3188 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:22.526486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ddfe604-9427-40b8-b2de-1a7416ef3188 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:22.533451 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ddfe604-9427-40b8-b2de-1a7416ef3188 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:22.533990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ddfe604-9427-40b8-b2de-1a7416ef3188 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:22.534452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ddfe604-9427-40b8-b2de-1a7416ef3188 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:22.535364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ddfe604-9427-40b8-b2de-1a7416ef3188 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:22.535780 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ddfe604-9427-40b8-b2de-1a7416ef3188 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:22.536233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ddfe604-9427-40b8-b2de-1a7416ef3188 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:22.749406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ddfe604-9427-40b8-b2de-1a7416ef3188 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:22.757362 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ddfe604-9427-40b8-b2de-1a7416ef3188 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1390 microversion: 2.1 time: 0.235367 Oct 04 19:25:22.757949 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3928/7860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:22 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1390 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:23.781274 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3ee3f256-9edc-4e04-b9b3-ef511bd232d5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:23.781931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3ee3f256-9edc-4e04-b9b3-ef511bd232d5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:23.788861 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee3f256-9edc-4e04-b9b3-ef511bd232d5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:23.789354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee3f256-9edc-4e04-b9b3-ef511bd232d5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:23.790345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee3f256-9edc-4e04-b9b3-ef511bd232d5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:23.791076 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee3f256-9edc-4e04-b9b3-ef511bd232d5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:23.791549 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee3f256-9edc-4e04-b9b3-ef511bd232d5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:23.791984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3ee3f256-9edc-4e04-b9b3-ef511bd232d5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:23.925047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3ee3f256-9edc-4e04-b9b3-ef511bd232d5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:23.932692 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3ee3f256-9edc-4e04-b9b3-ef511bd232d5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1390 microversion: 2.1 time: 0.155336 Oct 04 19:25:23.933279 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3933/7861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:23 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:24.956853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-53281769-4527-43c9-95de-3aa9f5552a27 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:24.957424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-53281769-4527-43c9-95de-3aa9f5552a27 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:24.965065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53281769-4527-43c9-95de-3aa9f5552a27 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:24.965634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53281769-4527-43c9-95de-3aa9f5552a27 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:24.966103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53281769-4527-43c9-95de-3aa9f5552a27 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:24.966862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53281769-4527-43c9-95de-3aa9f5552a27 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:24.967387 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53281769-4527-43c9-95de-3aa9f5552a27 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:24.967836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-53281769-4527-43c9-95de-3aa9f5552a27 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:25.103862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-53281769-4527-43c9-95de-3aa9f5552a27 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:25.111721 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-53281769-4527-43c9-95de-3aa9f5552a27 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1390 microversion: 2.1 time: 0.158841 Oct 04 19:25:25.112338 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3929/7862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:24 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:26.135522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8ecdead0-6602-49e6-a992-d24a557b02ac tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:26.136135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8ecdead0-6602-49e6-a992-d24a557b02ac tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:26.139033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:26.139835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:26.145900 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ecdead0-6602-49e6-a992-d24a557b02ac tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:26.146392 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ecdead0-6602-49e6-a992-d24a557b02ac tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:26.146839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ecdead0-6602-49e6-a992-d24a557b02ac tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:26.147629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ecdead0-6602-49e6-a992-d24a557b02ac tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:26.148091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ecdead0-6602-49e6-a992-d24a557b02ac tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:26.148522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8ecdead0-6602-49e6-a992-d24a557b02ac tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:26.280750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8ecdead0-6602-49e6-a992-d24a557b02ac tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:26.288558 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8ecdead0-6602-49e6-a992-d24a557b02ac tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1390 microversion: 2.1 time: 0.157081 Oct 04 19:25:26.289141 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3934/7863] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:26 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:26.495308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-872701d2-413c-44cf-bd95-a559aeef2a18 req-ca91037f-4ea8-4537-8831-dfb6702c7bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ef5e22-ca22-4ee1-b0c8-7e600313dd08", "name": "network-vif-plugged", "status": "completed", "tag": "98f9c745-c283-4e72-9534-33c07d63f3ca"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:26.504899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-872701d2-413c-44cf-bd95-a559aeef2a18 req-ca91037f-4ea8-4537-8831-dfb6702c7bfa service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:26.505409 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-872701d2-413c-44cf-bd95-a559aeef2a18 req-ca91037f-4ea8-4537-8831-dfb6702c7bfa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:26.506383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-872701d2-413c-44cf-bd95-a559aeef2a18 req-ca91037f-4ea8-4537-8831-dfb6702c7bfa service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:26.517376 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-872701d2-413c-44cf-bd95-a559aeef2a18 req-ca91037f-4ea8-4537-8831-dfb6702c7bfa service nova] Creating event network-vif-plugged:98f9c745-c283-4e72-9534-33c07d63f3ca for instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 on n-h2-850499-14 Oct 04 19:25:26.522515 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-872701d2-413c-44cf-bd95-a559aeef2a18 req-ca91037f-4ea8-4537-8831-dfb6702c7bfa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087121 Oct 04 19:25:26.523145 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3930/7864] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:27.312535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2cdb6cb1-696b-4b71-a82d-ccba2e9129f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:27.313109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2cdb6cb1-696b-4b71-a82d-ccba2e9129f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:27.320264 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2cdb6cb1-696b-4b71-a82d-ccba2e9129f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:27.320760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2cdb6cb1-696b-4b71-a82d-ccba2e9129f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:27.321201 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2cdb6cb1-696b-4b71-a82d-ccba2e9129f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:27.321902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2cdb6cb1-696b-4b71-a82d-ccba2e9129f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:27.322387 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2cdb6cb1-696b-4b71-a82d-ccba2e9129f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:27.322820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2cdb6cb1-696b-4b71-a82d-ccba2e9129f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:27.453940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2cdb6cb1-696b-4b71-a82d-ccba2e9129f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:27.462315 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2cdb6cb1-696b-4b71-a82d-ccba2e9129f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1390 microversion: 2.1 time: 0.153731 Oct 04 19:25:27.462881 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3935/7865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:27 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:28.482725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:28.488595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4923da28-6726-48ce-80cf-dfc96922b3af tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:28.489325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4923da28-6726-48ce-80cf-dfc96922b3af tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:28.496746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4923da28-6726-48ce-80cf-dfc96922b3af tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:28.497254 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4923da28-6726-48ce-80cf-dfc96922b3af tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:28.497711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4923da28-6726-48ce-80cf-dfc96922b3af tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:28.498421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4923da28-6726-48ce-80cf-dfc96922b3af tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:28.498896 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4923da28-6726-48ce-80cf-dfc96922b3af tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:28.499362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4923da28-6726-48ce-80cf-dfc96922b3af tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:28.629326 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4923da28-6726-48ce-80cf-dfc96922b3af tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:28.637026 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4923da28-6726-48ce-80cf-dfc96922b3af tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1561 microversion: 2.1 time: 0.155341 Oct 04 19:25:28.637593 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3931/7866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:28 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:28.659222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cbab020b-b120-4bac-8823-04ac85b6e12d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:28.659839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cbab020b-b120-4bac-8823-04ac85b6e12d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:28.667476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbab020b-b120-4bac-8823-04ac85b6e12d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:28.667973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbab020b-b120-4bac-8823-04ac85b6e12d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:28.668425 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbab020b-b120-4bac-8823-04ac85b6e12d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:28.669196 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbab020b-b120-4bac-8823-04ac85b6e12d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:28.669664 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbab020b-b120-4bac-8823-04ac85b6e12d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:28.670103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cbab020b-b120-4bac-8823-04ac85b6e12d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:28.804809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cbab020b-b120-4bac-8823-04ac85b6e12d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:28.812625 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cbab020b-b120-4bac-8823-04ac85b6e12d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1561 microversion: 2.1 time: 0.157255 Oct 04 19:25:28.813212 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3936/7867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:28 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:30.720569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bd6a309d-d94c-4156-99aa-84f69810d5b7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:30.721216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bd6a309d-d94c-4156-99aa-84f69810d5b7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:30.721811 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5f990f15-e078-4d20-9b11-7d46bf97cace req-b7762184-552c-4610-90be-c4d017628f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ef5e22-ca22-4ee1-b0c8-7e600313dd08", "tag": "98f9c745-c283-4e72-9534-33c07d63f3ca"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:30.724009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:30.727647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:30.731340 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd6a309d-d94c-4156-99aa-84f69810d5b7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:30.731849 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd6a309d-d94c-4156-99aa-84f69810d5b7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:30.732309 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd6a309d-d94c-4156-99aa-84f69810d5b7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:30.733041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd6a309d-d94c-4156-99aa-84f69810d5b7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:30.733686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd6a309d-d94c-4156-99aa-84f69810d5b7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:30.734221 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bd6a309d-d94c-4156-99aa-84f69810d5b7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:30.735457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5f990f15-e078-4d20-9b11-7d46bf97cace req-b7762184-552c-4610-90be-c4d017628f85 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:30.735984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5f990f15-e078-4d20-9b11-7d46bf97cace req-b7762184-552c-4610-90be-c4d017628f85 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:30.736427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5f990f15-e078-4d20-9b11-7d46bf97cace req-b7762184-552c-4610-90be-c4d017628f85 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:30.751712 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5f990f15-e078-4d20-9b11-7d46bf97cace req-b7762184-552c-4610-90be-c4d017628f85 service nova] Creating event network-changed:98f9c745-c283-4e72-9534-33c07d63f3ca for instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 on n-h2-850499-14 Oct 04 19:25:30.757130 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5f990f15-e078-4d20-9b11-7d46bf97cace req-b7762184-552c-4610-90be-c4d017628f85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039412 Oct 04 19:25:30.758042 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3937/7868] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:30.949837 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bd6a309d-d94c-4156-99aa-84f69810d5b7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:30.959527 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bd6a309d-d94c-4156-99aa-84f69810d5b7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1561 microversion: 2.1 time: 0.243913 Oct 04 19:25:30.971420 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3932/7869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:30 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1561 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:06.254815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=42 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:06.299895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79ddda5d-d1c3-474f-92e7-a4e1cb7bd93e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:06.302266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-79ddda5d-d1c3-474f-92e7-a4e1cb7bd93e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:06.308530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ddda5d-d1c3-474f-92e7-a4e1cb7bd93e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:06.309817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ddda5d-d1c3-474f-92e7-a4e1cb7bd93e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:06.310259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ddda5d-d1c3-474f-92e7-a4e1cb7bd93e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:06.310993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ddda5d-d1c3-474f-92e7-a4e1cb7bd93e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:06.311453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ddda5d-d1c3-474f-92e7-a4e1cb7bd93e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:06.311882 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79ddda5d-d1c3-474f-92e7-a4e1cb7bd93e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:06.385529 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-79ddda5d-d1c3-474f-92e7-a4e1cb7bd93e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08/action" status: 200 len: 24570 microversion: 2.1 time: 0.136891 Oct 04 19:26:06.386152 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3938/7870] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:26:06 2022] POST /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08/action => generated 24570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:26:45.134831 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:26:45.135539 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:26:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08/action (ip 10.222.0.18) !!! Oct 04 19:26:45.136048 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:45.136798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=38 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:45.140873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:45.143262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:45.151622 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:45.152136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:45.153111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:45.153829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:45.154306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:45.154752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:45.237074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:45.243515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Old instance type m1.heat2, new instance type m1.heat {{(pid=122331) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:26:45.250872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:26:45.251342 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:26:45.252125 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:26:45.252271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:26:45.252683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:26:45.315940 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c4009c8b-8ad3-48d0-956c-a6d690cb23f6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08/action" status: 202 len: 0 microversion: 2.1 time: 0.183410 Oct 04 19:26:45.316556 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3933/7871] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:26:45 2022] POST /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:26:45.325550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7c0d4b86-08d7-4d57-ac64-603d882f9603 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:45.326258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7c0d4b86-08d7-4d57-ac64-603d882f9603 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:45.329854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:45.330497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:45.335141 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c0d4b86-08d7-4d57-ac64-603d882f9603 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:45.335504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c0d4b86-08d7-4d57-ac64-603d882f9603 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:45.335950 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c0d4b86-08d7-4d57-ac64-603d882f9603 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:45.336662 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c0d4b86-08d7-4d57-ac64-603d882f9603 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:45.337128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c0d4b86-08d7-4d57-ac64-603d882f9603 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:45.337539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7c0d4b86-08d7-4d57-ac64-603d882f9603 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:45.479431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7c0d4b86-08d7-4d57-ac64-603d882f9603 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:45.487993 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7c0d4b86-08d7-4d57-ac64-603d882f9603 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1689 microversion: 2.1 time: 0.166975 Oct 04 19:26:45.488570 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3939/7872] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:45 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:46.515852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f67bf3b6-a128-4ec0-80d7-d4e568273618 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:46.516482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f67bf3b6-a128-4ec0-80d7-d4e568273618 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:46.524214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f67bf3b6-a128-4ec0-80d7-d4e568273618 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:46.524719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f67bf3b6-a128-4ec0-80d7-d4e568273618 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:46.525177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f67bf3b6-a128-4ec0-80d7-d4e568273618 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:46.525892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f67bf3b6-a128-4ec0-80d7-d4e568273618 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:46.526365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f67bf3b6-a128-4ec0-80d7-d4e568273618 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:46.526808 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f67bf3b6-a128-4ec0-80d7-d4e568273618 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:46.661115 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f67bf3b6-a128-4ec0-80d7-d4e568273618 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:46.669333 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f67bf3b6-a128-4ec0-80d7-d4e568273618 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1689 microversion: 2.1 time: 0.159494 Oct 04 19:26:46.669897 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3934/7873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:46 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:47.693454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-746ce7dd-810a-4417-8dd3-1bf4f8cb240d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:47.694073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-746ce7dd-810a-4417-8dd3-1bf4f8cb240d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:47.705404 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-746ce7dd-810a-4417-8dd3-1bf4f8cb240d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:47.705902 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-746ce7dd-810a-4417-8dd3-1bf4f8cb240d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:47.706350 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-746ce7dd-810a-4417-8dd3-1bf4f8cb240d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:47.707091 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-746ce7dd-810a-4417-8dd3-1bf4f8cb240d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:47.707556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-746ce7dd-810a-4417-8dd3-1bf4f8cb240d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:47.707994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-746ce7dd-810a-4417-8dd3-1bf4f8cb240d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:47.844237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-746ce7dd-810a-4417-8dd3-1bf4f8cb240d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:47.852064 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-746ce7dd-810a-4417-8dd3-1bf4f8cb240d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.162504 Oct 04 19:26:47.852632 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3940/7874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:47 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:48.875940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ea41aa53-ebe1-4c25-b37c-272ce0984faa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:48.876524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ea41aa53-ebe1-4c25-b37c-272ce0984faa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:48.883399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea41aa53-ebe1-4c25-b37c-272ce0984faa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:48.883911 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea41aa53-ebe1-4c25-b37c-272ce0984faa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:48.884371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea41aa53-ebe1-4c25-b37c-272ce0984faa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:48.885089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea41aa53-ebe1-4c25-b37c-272ce0984faa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:48.885568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea41aa53-ebe1-4c25-b37c-272ce0984faa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:48.886016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ea41aa53-ebe1-4c25-b37c-272ce0984faa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:49.015600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ea41aa53-ebe1-4c25-b37c-272ce0984faa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:49.023406 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ea41aa53-ebe1-4c25-b37c-272ce0984faa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.151518 Oct 04 19:26:49.023988 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3935/7875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:48 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:50.047492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2f9c2bb9-3de1-4338-b05e-7e9ac7756113 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:50.048114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2f9c2bb9-3de1-4338-b05e-7e9ac7756113 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:50.055523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9c2bb9-3de1-4338-b05e-7e9ac7756113 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:50.056015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9c2bb9-3de1-4338-b05e-7e9ac7756113 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:50.056460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9c2bb9-3de1-4338-b05e-7e9ac7756113 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:50.057160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9c2bb9-3de1-4338-b05e-7e9ac7756113 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:50.057619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9c2bb9-3de1-4338-b05e-7e9ac7756113 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:50.058057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2f9c2bb9-3de1-4338-b05e-7e9ac7756113 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:50.191543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2f9c2bb9-3de1-4338-b05e-7e9ac7756113 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:50.200245 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2f9c2bb9-3de1-4338-b05e-7e9ac7756113 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.155990 Oct 04 19:26:50.200843 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3941/7876] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:50 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:51.224543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d115471a-a415-4128-8764-8729c8d3405a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:51.225215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d115471a-a415-4128-8764-8729c8d3405a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:51.232082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d115471a-a415-4128-8764-8729c8d3405a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:51.232566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d115471a-a415-4128-8764-8729c8d3405a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:51.233020 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d115471a-a415-4128-8764-8729c8d3405a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:51.233747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d115471a-a415-4128-8764-8729c8d3405a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:51.234217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d115471a-a415-4128-8764-8729c8d3405a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:51.234660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d115471a-a415-4128-8764-8729c8d3405a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:51.368873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d115471a-a415-4128-8764-8729c8d3405a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:51.377347 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d115471a-a415-4128-8764-8729c8d3405a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.156728 Oct 04 19:26:51.377942 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3936/7877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:51 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:52.401411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-07f2e569-9fb2-46a1-aaa1-8e81d6f6e2ec tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:52.402268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-07f2e569-9fb2-46a1-aaa1-8e81d6f6e2ec tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:52.409450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e569-9fb2-46a1-aaa1-8e81d6f6e2ec tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:52.409947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e569-9fb2-46a1-aaa1-8e81d6f6e2ec tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:52.410424 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e569-9fb2-46a1-aaa1-8e81d6f6e2ec tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:52.411174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e569-9fb2-46a1-aaa1-8e81d6f6e2ec tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:52.411640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e569-9fb2-46a1-aaa1-8e81d6f6e2ec tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:52.412157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-07f2e569-9fb2-46a1-aaa1-8e81d6f6e2ec tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:52.555162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-07f2e569-9fb2-46a1-aaa1-8e81d6f6e2ec tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:52.563154 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-07f2e569-9fb2-46a1-aaa1-8e81d6f6e2ec tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.165681 Oct 04 19:26:52.564267 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3942/7878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:52 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:53.589069 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d372a7b-35b5-4c9c-8380-2cd1e8e773bd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:53.589807 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8d372a7b-35b5-4c9c-8380-2cd1e8e773bd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:53.597349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d372a7b-35b5-4c9c-8380-2cd1e8e773bd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:53.597861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d372a7b-35b5-4c9c-8380-2cd1e8e773bd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:53.598323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d372a7b-35b5-4c9c-8380-2cd1e8e773bd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:53.599070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d372a7b-35b5-4c9c-8380-2cd1e8e773bd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:53.599552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d372a7b-35b5-4c9c-8380-2cd1e8e773bd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:53.600000 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d372a7b-35b5-4c9c-8380-2cd1e8e773bd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:53.737699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d372a7b-35b5-4c9c-8380-2cd1e8e773bd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:53.745601 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8d372a7b-35b5-4c9c-8380-2cd1e8e773bd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.162039 Oct 04 19:26:53.746181 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3937/7879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:53 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:54.770083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0aa30edc-994d-4093-ae25-e983b76b2aae tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:54.770637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0aa30edc-994d-4093-ae25-e983b76b2aae tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:54.777518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa30edc-994d-4093-ae25-e983b76b2aae tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:54.778006 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa30edc-994d-4093-ae25-e983b76b2aae tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:54.778466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa30edc-994d-4093-ae25-e983b76b2aae tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:54.779193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa30edc-994d-4093-ae25-e983b76b2aae tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:54.779660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa30edc-994d-4093-ae25-e983b76b2aae tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:54.780095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0aa30edc-994d-4093-ae25-e983b76b2aae tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:54.914289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0aa30edc-994d-4093-ae25-e983b76b2aae tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:54.922261 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0aa30edc-994d-4093-ae25-e983b76b2aae tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.156729 Oct 04 19:26:54.922841 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3943/7880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:54 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:55.946743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0f095745-d4b4-4004-8579-f9ea291f87d4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:55.947413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0f095745-d4b4-4004-8579-f9ea291f87d4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:55.955770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f095745-d4b4-4004-8579-f9ea291f87d4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:55.956317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f095745-d4b4-4004-8579-f9ea291f87d4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:55.956779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f095745-d4b4-4004-8579-f9ea291f87d4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:55.957506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f095745-d4b4-4004-8579-f9ea291f87d4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:55.957984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f095745-d4b4-4004-8579-f9ea291f87d4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:55.958430 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0f095745-d4b4-4004-8579-f9ea291f87d4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:56.095008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0f095745-d4b4-4004-8579-f9ea291f87d4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:56.102853 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0f095745-d4b4-4004-8579-f9ea291f87d4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.160721 Oct 04 19:26:56.103455 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3938/7881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:55 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:57.126594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-893fcc47-33f3-4b36-8230-4e1cfded1ce5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:57.127236 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-893fcc47-33f3-4b36-8230-4e1cfded1ce5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:57.134308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-893fcc47-33f3-4b36-8230-4e1cfded1ce5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:57.134795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-893fcc47-33f3-4b36-8230-4e1cfded1ce5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:57.135270 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-893fcc47-33f3-4b36-8230-4e1cfded1ce5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:57.135964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-893fcc47-33f3-4b36-8230-4e1cfded1ce5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:57.136419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-893fcc47-33f3-4b36-8230-4e1cfded1ce5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:57.136872 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-893fcc47-33f3-4b36-8230-4e1cfded1ce5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:57.269524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-893fcc47-33f3-4b36-8230-4e1cfded1ce5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:57.277451 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-893fcc47-33f3-4b36-8230-4e1cfded1ce5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.154911 Oct 04 19:26:57.278034 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3944/7882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:57 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:58.302717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c99c0fea-0ba4-49ee-9168-52fd586d5692 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:58.303375 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c99c0fea-0ba4-49ee-9168-52fd586d5692 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:58.309659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c99c0fea-0ba4-49ee-9168-52fd586d5692 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:58.310165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c99c0fea-0ba4-49ee-9168-52fd586d5692 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:58.310624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c99c0fea-0ba4-49ee-9168-52fd586d5692 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:58.311369 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c99c0fea-0ba4-49ee-9168-52fd586d5692 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:58.311854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c99c0fea-0ba4-49ee-9168-52fd586d5692 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:58.312299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c99c0fea-0ba4-49ee-9168-52fd586d5692 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:58.445066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c99c0fea-0ba4-49ee-9168-52fd586d5692 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:58.452858 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c99c0fea-0ba4-49ee-9168-52fd586d5692 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.155172 Oct 04 19:26:58.453437 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3939/7883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:58 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:59.477150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e9cb4ba9-ca67-4575-ac2c-20c8c20973f9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:59.477765 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e9cb4ba9-ca67-4575-ac2c-20c8c20973f9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:59.483885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9cb4ba9-ca67-4575-ac2c-20c8c20973f9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:59.484376 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9cb4ba9-ca67-4575-ac2c-20c8c20973f9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:59.484824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9cb4ba9-ca67-4575-ac2c-20c8c20973f9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:59.485550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9cb4ba9-ca67-4575-ac2c-20c8c20973f9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:59.486012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9cb4ba9-ca67-4575-ac2c-20c8c20973f9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:59.486442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e9cb4ba9-ca67-4575-ac2c-20c8c20973f9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:59.621306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e9cb4ba9-ca67-4575-ac2c-20c8c20973f9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:59.630182 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e9cb4ba9-ca67-4575-ac2c-20c8c20973f9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1694 microversion: 2.1 time: 0.157102 Oct 04 19:26:59.630771 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3945/7884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:59 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:00.329843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-75bef96d-ce01-4726-9eb6-c4041a8f9365 req-175a1029-0fdc-4e1f-9221-eeadcc6241dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ef5e22-ca22-4ee1-b0c8-7e600313dd08", "name": "network-vif-unplugged", "status": "completed", "tag": "98f9c745-c283-4e72-9534-33c07d63f3ca"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:00.341853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-75bef96d-ce01-4726-9eb6-c4041a8f9365 req-175a1029-0fdc-4e1f-9221-eeadcc6241dc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:00.342558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-75bef96d-ce01-4726-9eb6-c4041a8f9365 req-175a1029-0fdc-4e1f-9221-eeadcc6241dc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:00.343091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-75bef96d-ce01-4726-9eb6-c4041a8f9365 req-175a1029-0fdc-4e1f-9221-eeadcc6241dc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:00.356885 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-75bef96d-ce01-4726-9eb6-c4041a8f9365 req-175a1029-0fdc-4e1f-9221-eeadcc6241dc service nova] Creating event network-vif-unplugged:98f9c745-c283-4e72-9534-33c07d63f3ca for instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 on n-h1-850499-14 Oct 04 19:27:00.362581 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [req-75bef96d-ce01-4726-9eb6-c4041a8f9365 req-175a1029-0fdc-4e1f-9221-eeadcc6241dc service nova] Instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122331) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:27:00.375027 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-75bef96d-ce01-4726-9eb6-c4041a8f9365 req-175a1029-0fdc-4e1f-9221-eeadcc6241dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049241 Oct 04 19:27:00.375905 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3940/7885] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:00.654407 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-49bc421d-ea15-427c-be77-e4ecb5f6be08 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:00.655047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-49bc421d-ea15-427c-be77-e4ecb5f6be08 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:00.662247 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49bc421d-ea15-427c-be77-e4ecb5f6be08 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:00.662734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49bc421d-ea15-427c-be77-e4ecb5f6be08 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:00.663206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49bc421d-ea15-427c-be77-e4ecb5f6be08 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:00.663965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49bc421d-ea15-427c-be77-e4ecb5f6be08 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:00.664409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49bc421d-ea15-427c-be77-e4ecb5f6be08 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:00.664839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-49bc421d-ea15-427c-be77-e4ecb5f6be08 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:00.810462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-49bc421d-ea15-427c-be77-e4ecb5f6be08 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:00.819016 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-49bc421d-ea15-427c-be77-e4ecb5f6be08 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1693 microversion: 2.1 time: 0.168212 Oct 04 19:27:00.819718 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3946/7886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:00 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:01.843654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba386ccc-8076-4bdd-b0d5-c72f8cbe97ed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:01.844288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba386ccc-8076-4bdd-b0d5-c72f8cbe97ed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:01.851284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba386ccc-8076-4bdd-b0d5-c72f8cbe97ed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:01.851787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba386ccc-8076-4bdd-b0d5-c72f8cbe97ed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:01.852243 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba386ccc-8076-4bdd-b0d5-c72f8cbe97ed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:01.852946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba386ccc-8076-4bdd-b0d5-c72f8cbe97ed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:01.853417 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba386ccc-8076-4bdd-b0d5-c72f8cbe97ed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:01.853857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba386ccc-8076-4bdd-b0d5-c72f8cbe97ed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:01.989781 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ba386ccc-8076-4bdd-b0d5-c72f8cbe97ed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:01.997605 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba386ccc-8076-4bdd-b0d5-c72f8cbe97ed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1691 microversion: 2.1 time: 0.158344 Oct 04 19:27:01.998193 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3941/7887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:01 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:02.390497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-52c4b59b-7533-45f3-ba6b-eb216b0ef69a req-03a7926d-9464-47ac-8a63-578f190b100a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ef5e22-ca22-4ee1-b0c8-7e600313dd08", "tag": "98f9c745-c283-4e72-9534-33c07d63f3ca"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:02.401229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-52c4b59b-7533-45f3-ba6b-eb216b0ef69a req-03a7926d-9464-47ac-8a63-578f190b100a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:02.401713 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-52c4b59b-7533-45f3-ba6b-eb216b0ef69a req-03a7926d-9464-47ac-8a63-578f190b100a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:02.402150 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-52c4b59b-7533-45f3-ba6b-eb216b0ef69a req-03a7926d-9464-47ac-8a63-578f190b100a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:02.414392 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-52c4b59b-7533-45f3-ba6b-eb216b0ef69a req-03a7926d-9464-47ac-8a63-578f190b100a service nova] Creating event network-changed:98f9c745-c283-4e72-9534-33c07d63f3ca for instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 on n-h1-850499-14 Oct 04 19:27:02.419757 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [req-52c4b59b-7533-45f3-ba6b-eb216b0ef69a req-03a7926d-9464-47ac-8a63-578f190b100a service nova] Instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-14', 'n-h1-850499-14'} {{(pid=122332) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:27:02.430777 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-52c4b59b-7533-45f3-ba6b-eb216b0ef69a req-03a7926d-9464-47ac-8a63-578f190b100a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043940 Oct 04 19:27:02.431370 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3947/7888] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:03.021317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-75994e79-ddb4-43c5-a036-ad74a1bc4404 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:03.021969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-75994e79-ddb4-43c5-a036-ad74a1bc4404 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:03.028898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75994e79-ddb4-43c5-a036-ad74a1bc4404 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:03.029416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75994e79-ddb4-43c5-a036-ad74a1bc4404 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:03.029887 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75994e79-ddb4-43c5-a036-ad74a1bc4404 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:03.030627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75994e79-ddb4-43c5-a036-ad74a1bc4404 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:03.031141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75994e79-ddb4-43c5-a036-ad74a1bc4404 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:03.031596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-75994e79-ddb4-43c5-a036-ad74a1bc4404 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:03.167331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-75994e79-ddb4-43c5-a036-ad74a1bc4404 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:03.176078 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-75994e79-ddb4-43c5-a036-ad74a1bc4404 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1691 microversion: 2.1 time: 0.158750 Oct 04 19:27:03.177003 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3942/7889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:03 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:04.204976 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45a8736d-230c-4056-8cbb-017978c52aad tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:04.205689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-45a8736d-230c-4056-8cbb-017978c52aad tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:04.211917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45a8736d-230c-4056-8cbb-017978c52aad tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:04.212412 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45a8736d-230c-4056-8cbb-017978c52aad tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:04.212858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45a8736d-230c-4056-8cbb-017978c52aad tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:04.213564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45a8736d-230c-4056-8cbb-017978c52aad tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:04.214028 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45a8736d-230c-4056-8cbb-017978c52aad tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:04.214469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-45a8736d-230c-4056-8cbb-017978c52aad tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:04.352282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-45a8736d-230c-4056-8cbb-017978c52aad tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:04.360073 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-45a8736d-230c-4056-8cbb-017978c52aad tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1688 microversion: 2.1 time: 0.160229 Oct 04 19:27:04.361290 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3948/7890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:04 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:04.383477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e5638a8b-b8d8-466b-b40d-2ed023cd4772 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:04.384033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e5638a8b-b8d8-466b-b40d-2ed023cd4772 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:04.390979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5638a8b-b8d8-466b-b40d-2ed023cd4772 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:04.391512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5638a8b-b8d8-466b-b40d-2ed023cd4772 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:04.391971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5638a8b-b8d8-466b-b40d-2ed023cd4772 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:04.392688 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5638a8b-b8d8-466b-b40d-2ed023cd4772 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:04.393169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5638a8b-b8d8-466b-b40d-2ed023cd4772 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:04.393617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e5638a8b-b8d8-466b-b40d-2ed023cd4772 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:04.452635 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e5638a8b-b8d8-466b-b40d-2ed023cd4772 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08/action" status: 204 len: 0 microversion: 2.1 time: 0.072920 Oct 04 19:27:04.453292 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3943/7891] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:27:04 2022] POST /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:27:04.461504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f5110326-e192-4f21-a638-25d50a6ffc32 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:04.462055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f5110326-e192-4f21-a638-25d50a6ffc32 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:04.468038 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5110326-e192-4f21-a638-25d50a6ffc32 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:04.468527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5110326-e192-4f21-a638-25d50a6ffc32 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:04.468969 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5110326-e192-4f21-a638-25d50a6ffc32 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:04.469671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5110326-e192-4f21-a638-25d50a6ffc32 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:04.470803 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5110326-e192-4f21-a638-25d50a6ffc32 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:04.471457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f5110326-e192-4f21-a638-25d50a6ffc32 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:04.686630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f5110326-e192-4f21-a638-25d50a6ffc32 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:04.694894 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f5110326-e192-4f21-a638-25d50a6ffc32 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1688 microversion: 2.1 time: 0.237219 Oct 04 19:27:04.695508 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3949/7892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:04 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:04.718150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f10df78c-504e-427d-b472-32e4c9f68827 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:04.718868 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f10df78c-504e-427d-b472-32e4c9f68827 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:04.725903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f10df78c-504e-427d-b472-32e4c9f68827 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:04.726416 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f10df78c-504e-427d-b472-32e4c9f68827 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:04.726882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f10df78c-504e-427d-b472-32e4c9f68827 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:04.727658 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f10df78c-504e-427d-b472-32e4c9f68827 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:04.728152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f10df78c-504e-427d-b472-32e4c9f68827 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:04.728656 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f10df78c-504e-427d-b472-32e4c9f68827 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:04.956535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f10df78c-504e-427d-b472-32e4c9f68827 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:04.964284 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f10df78c-504e-427d-b472-32e4c9f68827 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1688 microversion: 2.1 time: 0.250447 Oct 04 19:27:04.964862 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3944/7893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:04 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1688 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:05.988914 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8b39d1de-a0f0-4f64-8d5a-89f54bbb5fc9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:05.989559 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8b39d1de-a0f0-4f64-8d5a-89f54bbb5fc9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:05.996299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b39d1de-a0f0-4f64-8d5a-89f54bbb5fc9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:05.996789 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b39d1de-a0f0-4f64-8d5a-89f54bbb5fc9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:05.997229 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b39d1de-a0f0-4f64-8d5a-89f54bbb5fc9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:05.998164 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b39d1de-a0f0-4f64-8d5a-89f54bbb5fc9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:05.998627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b39d1de-a0f0-4f64-8d5a-89f54bbb5fc9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:05.999083 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8b39d1de-a0f0-4f64-8d5a-89f54bbb5fc9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:06.143708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8b39d1de-a0f0-4f64-8d5a-89f54bbb5fc9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:06.151521 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8b39d1de-a0f0-4f64-8d5a-89f54bbb5fc9 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1680 microversion: 2.1 time: 0.167436 Oct 04 19:27:06.152089 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3950/7894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:05 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:06.747274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-dd011597-0f1d-420c-b659-02f756efb52f req-0ddff121-4fca-40b9-8e4c-dd133f3257e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ef5e22-ca22-4ee1-b0c8-7e600313dd08", "name": "network-vif-plugged", "status": "completed", "tag": "98f9c745-c283-4e72-9534-33c07d63f3ca"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:06.758567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dd011597-0f1d-420c-b659-02f756efb52f req-0ddff121-4fca-40b9-8e4c-dd133f3257e9 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:06.759111 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dd011597-0f1d-420c-b659-02f756efb52f req-0ddff121-4fca-40b9-8e4c-dd133f3257e9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:06.759573 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-dd011597-0f1d-420c-b659-02f756efb52f req-0ddff121-4fca-40b9-8e4c-dd133f3257e9 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:06.771244 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-dd011597-0f1d-420c-b659-02f756efb52f req-0ddff121-4fca-40b9-8e4c-dd133f3257e9 service nova] Creating event network-vif-plugged:98f9c745-c283-4e72-9534-33c07d63f3ca for instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 on n-h1-850499-14 Oct 04 19:27:06.776403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-dd011597-0f1d-420c-b659-02f756efb52f req-0ddff121-4fca-40b9-8e4c-dd133f3257e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032992 Oct 04 19:27:06.777052 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3945/7895] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:30.342015 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3bdeb803-e141-40f2-bc17-aeddc583e40f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:30.344268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3bdeb803-e141-40f2-bc17-aeddc583e40f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:30.346488 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=24 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:30.347304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=70 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:30.353373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bdeb803-e141-40f2-bc17-aeddc583e40f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:30.353874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bdeb803-e141-40f2-bc17-aeddc583e40f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:30.354324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bdeb803-e141-40f2-bc17-aeddc583e40f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:30.355075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bdeb803-e141-40f2-bc17-aeddc583e40f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:30.355540 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bdeb803-e141-40f2-bc17-aeddc583e40f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:30.355977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3bdeb803-e141-40f2-bc17-aeddc583e40f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:30.416406 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3bdeb803-e141-40f2-bc17-aeddc583e40f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08/action" status: 200 len: 24577 microversion: 2.1 time: 0.078501 Oct 04 19:27:30.417061 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3951/7896] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:27:30 2022] POST /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08/action => generated 24577 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:27:37.549686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-3e376af1-cf4d-4b32-97d1-b0e62f5bdb17 req-5ae62c86-09db-4512-bc12-65584530a6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ef5e22-ca22-4ee1-b0c8-7e600313dd08", "tag": "98f9c745-c283-4e72-9534-33c07d63f3ca"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:37.557892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-98610129-3df9-4a2b-ad57-72344a20eea2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:37.558506 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-98610129-3df9-4a2b-ad57-72344a20eea2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:37.561638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=30 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:37.562412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:37.568507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98610129-3df9-4a2b-ad57-72344a20eea2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:37.569021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98610129-3df9-4a2b-ad57-72344a20eea2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:37.569479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98610129-3df9-4a2b-ad57-72344a20eea2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:37.570327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98610129-3df9-4a2b-ad57-72344a20eea2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:37.570806 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98610129-3df9-4a2b-ad57-72344a20eea2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:37.573747 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-98610129-3df9-4a2b-ad57-72344a20eea2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:37.579497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3e376af1-cf4d-4b32-97d1-b0e62f5bdb17 req-5ae62c86-09db-4512-bc12-65584530a6e8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:37.579497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3e376af1-cf4d-4b32-97d1-b0e62f5bdb17 req-5ae62c86-09db-4512-bc12-65584530a6e8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:37.579800 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-3e376af1-cf4d-4b32-97d1-b0e62f5bdb17 req-5ae62c86-09db-4512-bc12-65584530a6e8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:37.593892 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-3e376af1-cf4d-4b32-97d1-b0e62f5bdb17 req-5ae62c86-09db-4512-bc12-65584530a6e8 service nova] Creating event network-changed:98f9c745-c283-4e72-9534-33c07d63f3ca for instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 on n-h1-850499-14 Oct 04 19:27:37.600257 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-3e376af1-cf4d-4b32-97d1-b0e62f5bdb17 req-5ae62c86-09db-4512-bc12-65584530a6e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054522 Oct 04 19:27:37.600985 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3952/7897] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:37.601535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-98610129-3df9-4a2b-ad57-72344a20eea2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:27:37.699815 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-98610129-3df9-4a2b-ad57-72344a20eea2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "DELETE /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 204 len: 0 microversion: 2.1 time: 0.158832 Oct 04 19:27:37.701367 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3946/7898] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:27:37 2022] DELETE /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:27:37.710889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b48a7f3b-2e85-4b53-94fa-13155976147d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:37.711890 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b48a7f3b-2e85-4b53-94fa-13155976147d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:37.718629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b48a7f3b-2e85-4b53-94fa-13155976147d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:37.719397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b48a7f3b-2e85-4b53-94fa-13155976147d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:37.720128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b48a7f3b-2e85-4b53-94fa-13155976147d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:37.720913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b48a7f3b-2e85-4b53-94fa-13155976147d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:37.721581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b48a7f3b-2e85-4b53-94fa-13155976147d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:37.722218 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b48a7f3b-2e85-4b53-94fa-13155976147d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:37.918849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b48a7f3b-2e85-4b53-94fa-13155976147d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:37.927069 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b48a7f3b-2e85-4b53-94fa-13155976147d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1686 microversion: 2.1 time: 0.221376 Oct 04 19:27:37.927772 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3953/7899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:37 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1686 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:38.951735 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b783a7f4-d490-42ed-a36c-ae234e956f11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:38.952462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b783a7f4-d490-42ed-a36c-ae234e956f11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:38.959372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b783a7f4-d490-42ed-a36c-ae234e956f11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:38.959883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b783a7f4-d490-42ed-a36c-ae234e956f11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:38.960347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b783a7f4-d490-42ed-a36c-ae234e956f11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:38.961070 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b783a7f4-d490-42ed-a36c-ae234e956f11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:38.961548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b783a7f4-d490-42ed-a36c-ae234e956f11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:38.961993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b783a7f4-d490-42ed-a36c-ae234e956f11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:39.145338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b783a7f4-d490-42ed-a36c-ae234e956f11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:39.153184 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b783a7f4-d490-42ed-a36c-ae234e956f11 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1686 microversion: 2.1 time: 0.205726 Oct 04 19:27:39.153764 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3947/7900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:38 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1686 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:39.838037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-ae602815-96f7-4bb6-b540-4bfc0170dcb2 req-3302dd94-8737-4f09-9133-bc52d5884c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ef5e22-ca22-4ee1-b0c8-7e600313dd08", "name": "network-vif-deleted", "tag": "98f9c745-c283-4e72-9534-33c07d63f3ca"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:39.850027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ae602815-96f7-4bb6-b540-4bfc0170dcb2 req-3302dd94-8737-4f09-9133-bc52d5884c98 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:39.850509 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ae602815-96f7-4bb6-b540-4bfc0170dcb2 req-3302dd94-8737-4f09-9133-bc52d5884c98 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:39.850947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-ae602815-96f7-4bb6-b540-4bfc0170dcb2 req-3302dd94-8737-4f09-9133-bc52d5884c98 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:39.863619 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-ae602815-96f7-4bb6-b540-4bfc0170dcb2 req-3302dd94-8737-4f09-9133-bc52d5884c98 service nova] Creating event network-vif-deleted:98f9c745-c283-4e72-9534-33c07d63f3ca for instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 on n-h1-850499-14 Oct 04 19:27:39.872698 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-ae602815-96f7-4bb6-b540-4bfc0170dcb2 req-3302dd94-8737-4f09-9133-bc52d5884c98 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039033 Oct 04 19:27:39.873580 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3954/7901] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:40.178753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:40.179477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:40.186648 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:40.187443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:40.187904 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:40.188694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:40.189166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:40.189610 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:40.224019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:40.224540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:40.225039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:40.225515 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lazy-loading 'fault' on Instance uuid 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:27:40.268311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:40.276529 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f058010e-176e-4b65-be08-5c63712c2f7c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 200 len: 1354 microversion: 2.1 time: 0.102526 Oct 04 19:27:40.277108 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3948/7902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:40 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 1354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:41.301858 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:41.302561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 09ef5e22-ca22-4ee1-b0c8-7e600313dd08] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:41.309018 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:41.309504 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:41.309941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:41.310756 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:41.311250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:41.311680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:41.325620 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] HTTP exception thrown: Instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 could not be found. Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Request method failure captured: Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 HTTP/1.1 Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIeN8IpXRvunr76MaJcsy7gb5UP6P4wqRVf0JkFXuXKO2yf2pFEvJw8J88FNBXWWUdzOw2EIDCftvfvYY_kAe0UTJSv2yPFw5P2VL_L4-kqKLgsStF_OIK04o3eUaRuB3lR-bHSuVie82p8LaoF1Nxb20sOCbZAKQ5m9_sRAS24DjP0 Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2c351b5f6e644ae793a7cd81ce120f12 Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c351b5f6e644ae793a7cd81ce120f12"}]}] Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2c351b5f6e644ae793a7cd81ce120f12 Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestNetworkAdvancedServerOps-773175457-project Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 01a419fcbb7a4558add32361c96e387c Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestNetworkAdvancedServerOps-773175457-project Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 could not be found. Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '09ef5e22-ca22-4ee1-b0c8-7e600313dd08'} Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 could not be found. Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 could not be found. Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.327206 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 could not be found. Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Returning 404 to user: Instance 09ef5e22-ca22-4ee1-b0c8-7e600313dd08 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-10fd7a9f-a64e-429a-a1cd-cd49e079ea4d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08" status: 404 len: 111 microversion: 2.1 time: 0.032307 Oct 04 19:27:41.332627 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3955/7903] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:41 2022] GET /compute/v2.1/servers/09ef5e22-ca22-4ee1-b0c8-7e600313dd08 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:27:44.985004 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-904abd57-366f-4111-9c32-50a4ad86cd8d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '.version_select at 0x7fd4d1d5be50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:45.005942 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-904abd57-366f-4111-9c32-50a4ad86cd8d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-95510960" status: 202 len: 0 microversion: 2.1 time: 0.024567 Oct 04 19:27:45.007283 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3949/7904] 10.222.0.18 () {58 vars in 1278 bytes} [Tue Oct 4 19:27:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-95510960 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:27:45.033501 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ec22e4b6-60f2-4557-8c6b-2b11d183c94d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'create', calling method: .version_select at 0x7fd4d0b495e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-22800464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOztXtTNN/1JKSGZLcgdRXSAdBbmaguZREfHFxi+tODvKavLgBCHXsWUSbmlATq2UZPivTqn4na14UYRKrC81KVOnoGxOjqufqfk1k9K7zemUZt//juSx7H+msvnyAAQUA=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:45.051169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ec22e4b6-60f2-4557-8c6b-2b11d183c94d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:27:45.056300 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-ec22e4b6-60f2-4557-8c6b-2b11d183c94d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for user 01a419fcbb7a4558add32361c96e387c and project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:27:45.080522 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ec22e4b6-60f2-4557-8c6b-2b11d183c94d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050917 Oct 04 19:27:45.081133 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3956/7905] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:27:45 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:50.609842 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1100992606", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "a0566310-0909-4a48-81d8-ca5646cfc019"}], "key_name": "tempest-TestNetworkAdvancedServerOps-22800464", "security_groups": [{"name": "tempest-secgroup-smoke-1145394686"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:50.622368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:50.733118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] validate_networks() for [('a0566310-0909-4a48-81d8-ca5646cfc019', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:27:51.136844 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:27:51.137290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:27:51.137816 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:27:51.138248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:27:51.138679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:27:51.148083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:51.148572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:51.149035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:51.149787 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:51.150267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:51.150719 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:51.169068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:27:51.174385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for user 01a419fcbb7a4558add32361c96e387c and project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:27:51.187338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:27:51.189706 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:27:51.237750 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba9db6b9-0e6d-450d-a1b4-5408bfae1362 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.632249 Oct 04 19:27:51.244565 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3950/7906] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:27:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:27:51.249826 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c83a05de-b477-4e80-b9a3-f04d0eb4ae0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:51.250455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c83a05de-b477-4e80-b9a3-f04d0eb4ae0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:51.313033 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c83a05de-b477-4e80-b9a3-f04d0eb4ae0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:51.317320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=16 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:51.326770 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c83a05de-b477-4e80-b9a3-f04d0eb4ae0d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1265 microversion: 2.1 time: 0.080735 Oct 04 19:27:51.327511 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3957/7907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:51 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:52.352685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2df41bad-b16e-42c8-bf7c-dd68f9ba3e66 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:52.353986 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2df41bad-b16e-42c8-bf7c-dd68f9ba3e66 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:52.361796 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2df41bad-b16e-42c8-bf7c-dd68f9ba3e66 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:52.362317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2df41bad-b16e-42c8-bf7c-dd68f9ba3e66 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:52.362765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2df41bad-b16e-42c8-bf7c-dd68f9ba3e66 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:52.363743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2df41bad-b16e-42c8-bf7c-dd68f9ba3e66 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:52.364411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2df41bad-b16e-42c8-bf7c-dd68f9ba3e66 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:52.365079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2df41bad-b16e-42c8-bf7c-dd68f9ba3e66 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:52.479939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2df41bad-b16e-42c8-bf7c-dd68f9ba3e66 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:52.489184 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2df41bad-b16e-42c8-bf7c-dd68f9ba3e66 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1317 microversion: 2.1 time: 0.142761 Oct 04 19:27:52.489895 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3951/7908] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:52 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:53.518151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7a9dd0a-c0dc-4ec4-a3f7-862ff86e5b6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:53.518770 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b7a9dd0a-c0dc-4ec4-a3f7-862ff86e5b6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:53.527027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a9dd0a-c0dc-4ec4-a3f7-862ff86e5b6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:53.527523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a9dd0a-c0dc-4ec4-a3f7-862ff86e5b6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:53.527964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a9dd0a-c0dc-4ec4-a3f7-862ff86e5b6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:53.528878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a9dd0a-c0dc-4ec4-a3f7-862ff86e5b6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:53.529338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a9dd0a-c0dc-4ec4-a3f7-862ff86e5b6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:53.529768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a9dd0a-c0dc-4ec4-a3f7-862ff86e5b6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:53.740256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b7a9dd0a-c0dc-4ec4-a3f7-862ff86e5b6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:53.749364 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b7a9dd0a-c0dc-4ec4-a3f7-862ff86e5b6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1391 microversion: 2.1 time: 0.235949 Oct 04 19:27:53.749962 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3958/7909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:53 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1391 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:54.071354 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f9df7c43-4ce3-4edf-afa7-6d3ec87a68a4 req-92abb569-61b5-4dc2-90a4-1848f2cf1e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b744ea40-6707-4ce9-b2f3-9a171bc2c624", "tag": "8db62852-3296-47ec-9a9f-68576d3b7766"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:54.083128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f9df7c43-4ce3-4edf-afa7-6d3ec87a68a4 req-92abb569-61b5-4dc2-90a4-1848f2cf1e00 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:54.083681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f9df7c43-4ce3-4edf-afa7-6d3ec87a68a4 req-92abb569-61b5-4dc2-90a4-1848f2cf1e00 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:54.084152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f9df7c43-4ce3-4edf-afa7-6d3ec87a68a4 req-92abb569-61b5-4dc2-90a4-1848f2cf1e00 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:54.095997 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f9df7c43-4ce3-4edf-afa7-6d3ec87a68a4 req-92abb569-61b5-4dc2-90a4-1848f2cf1e00 service nova] Creating event network-changed:8db62852-3296-47ec-9a9f-68576d3b7766 for instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 on n-h2-850499-14 Oct 04 19:27:54.101202 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f9df7c43-4ce3-4edf-afa7-6d3ec87a68a4 req-92abb569-61b5-4dc2-90a4-1848f2cf1e00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034195 Oct 04 19:27:54.102135 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3952/7910] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:54.772783 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9df13aca-39aa-44ec-8d22-5e29ce128d92 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:54.773342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9df13aca-39aa-44ec-8d22-5e29ce128d92 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:54.780390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9df13aca-39aa-44ec-8d22-5e29ce128d92 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:54.780888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9df13aca-39aa-44ec-8d22-5e29ce128d92 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:54.781337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9df13aca-39aa-44ec-8d22-5e29ce128d92 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:54.782056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9df13aca-39aa-44ec-8d22-5e29ce128d92 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:54.782524 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9df13aca-39aa-44ec-8d22-5e29ce128d92 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:54.782973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9df13aca-39aa-44ec-8d22-5e29ce128d92 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:54.920805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9df13aca-39aa-44ec-8d22-5e29ce128d92 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:54.929318 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9df13aca-39aa-44ec-8d22-5e29ce128d92 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1391 microversion: 2.1 time: 0.160647 Oct 04 19:27:54.929889 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3959/7911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:54 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:55.954701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3805f48f-dc63-4397-ae96-ec06e50fa301 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:55.955477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3805f48f-dc63-4397-ae96-ec06e50fa301 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:55.962229 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3805f48f-dc63-4397-ae96-ec06e50fa301 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:55.962734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3805f48f-dc63-4397-ae96-ec06e50fa301 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:55.963223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3805f48f-dc63-4397-ae96-ec06e50fa301 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:55.963937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3805f48f-dc63-4397-ae96-ec06e50fa301 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:55.964415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3805f48f-dc63-4397-ae96-ec06e50fa301 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:55.964881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3805f48f-dc63-4397-ae96-ec06e50fa301 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:56.098544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3805f48f-dc63-4397-ae96-ec06e50fa301 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:56.106221 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3805f48f-dc63-4397-ae96-ec06e50fa301 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1391 microversion: 2.1 time: 0.157322 Oct 04 19:27:56.106794 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3953/7912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:55 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:57.129838 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2b14be2a-1723-4bc3-ba57-3777b5f358d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:57.130946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2b14be2a-1723-4bc3-ba57-3777b5f358d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:57.137733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b14be2a-1723-4bc3-ba57-3777b5f358d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:57.138220 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b14be2a-1723-4bc3-ba57-3777b5f358d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:57.138658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b14be2a-1723-4bc3-ba57-3777b5f358d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:57.139384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b14be2a-1723-4bc3-ba57-3777b5f358d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:57.139839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b14be2a-1723-4bc3-ba57-3777b5f358d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:57.140272 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2b14be2a-1723-4bc3-ba57-3777b5f358d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:57.275314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2b14be2a-1723-4bc3-ba57-3777b5f358d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:57.283041 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2b14be2a-1723-4bc3-ba57-3777b5f358d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1391 microversion: 2.1 time: 0.157076 Oct 04 19:27:57.283613 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3960/7913] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:57 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:27:58.309089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a0c87b03-d148-44b9-8cae-ab10384a363a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:58.309720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a0c87b03-d148-44b9-8cae-ab10384a363a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:58.315798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0c87b03-d148-44b9-8cae-ab10384a363a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:58.316328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0c87b03-d148-44b9-8cae-ab10384a363a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:58.316775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0c87b03-d148-44b9-8cae-ab10384a363a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:58.317477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0c87b03-d148-44b9-8cae-ab10384a363a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:58.317944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0c87b03-d148-44b9-8cae-ab10384a363a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:58.318382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a0c87b03-d148-44b9-8cae-ab10384a363a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:58.451275 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a0c87b03-d148-44b9-8cae-ab10384a363a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:58.461096 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a0c87b03-d148-44b9-8cae-ab10384a363a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1391 microversion: 2.1 time: 0.155975 Oct 04 19:27:58.461513 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3954/7914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:58 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:59.483948 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b3651d2a-9fd1-4ddb-bd1e-219de47336c3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:59.484571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b3651d2a-9fd1-4ddb-bd1e-219de47336c3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:59.491204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3651d2a-9fd1-4ddb-bd1e-219de47336c3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:59.491703 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3651d2a-9fd1-4ddb-bd1e-219de47336c3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:59.492149 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3651d2a-9fd1-4ddb-bd1e-219de47336c3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:59.492855 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3651d2a-9fd1-4ddb-bd1e-219de47336c3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:59.493316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3651d2a-9fd1-4ddb-bd1e-219de47336c3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:59.493750 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3651d2a-9fd1-4ddb-bd1e-219de47336c3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:59.628043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b3651d2a-9fd1-4ddb-bd1e-219de47336c3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:59.636300 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b3651d2a-9fd1-4ddb-bd1e-219de47336c3 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1391 microversion: 2.1 time: 0.156573 Oct 04 19:27:59.636872 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3961/7915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:59 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:00.659739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e7628fdf-c116-439a-9834-9f26a2a242fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:00.660378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e7628fdf-c116-439a-9834-9f26a2a242fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:00.667924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7628fdf-c116-439a-9834-9f26a2a242fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:00.668436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7628fdf-c116-439a-9834-9f26a2a242fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:00.668924 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7628fdf-c116-439a-9834-9f26a2a242fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:00.669686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7628fdf-c116-439a-9834-9f26a2a242fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:00.670167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7628fdf-c116-439a-9834-9f26a2a242fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:00.670616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e7628fdf-c116-439a-9834-9f26a2a242fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:00.801096 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e7628fdf-c116-439a-9834-9f26a2a242fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:00.809420 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e7628fdf-c116-439a-9834-9f26a2a242fc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1391 microversion: 2.1 time: 0.153666 Oct 04 19:28:00.809997 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3955/7916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:00 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:01.245618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5a827d5b-d4ac-44e6-ac7f-0fd6b45e17b2 req-31064f4c-8844-448a-a40d-da4e18df4577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b744ea40-6707-4ce9-b2f3-9a171bc2c624", "name": "network-vif-plugged", "status": "completed", "tag": "8db62852-3296-47ec-9a9f-68576d3b7766"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:01.251295 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:01.258125 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a827d5b-d4ac-44e6-ac7f-0fd6b45e17b2 req-31064f4c-8844-448a-a40d-da4e18df4577 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:01.258498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a827d5b-d4ac-44e6-ac7f-0fd6b45e17b2 req-31064f4c-8844-448a-a40d-da4e18df4577 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:01.258941 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5a827d5b-d4ac-44e6-ac7f-0fd6b45e17b2 req-31064f4c-8844-448a-a40d-da4e18df4577 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:01.274543 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5a827d5b-d4ac-44e6-ac7f-0fd6b45e17b2 req-31064f4c-8844-448a-a40d-da4e18df4577 service nova] Creating event network-vif-plugged:8db62852-3296-47ec-9a9f-68576d3b7766 for instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 on n-h2-850499-14 Oct 04 19:28:01.280371 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5a827d5b-d4ac-44e6-ac7f-0fd6b45e17b2 req-31064f4c-8844-448a-a40d-da4e18df4577 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038518 Oct 04 19:28:01.281233 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3962/7917] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:28:01.833163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5146218f-dbc8-4445-a577-0f82f9e64034 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:01.834427 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5146218f-dbc8-4445-a577-0f82f9e64034 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:01.836470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:01.837151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:01.844567 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5146218f-dbc8-4445-a577-0f82f9e64034 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:01.845084 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5146218f-dbc8-4445-a577-0f82f9e64034 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:01.845549 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5146218f-dbc8-4445-a577-0f82f9e64034 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:01.846279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5146218f-dbc8-4445-a577-0f82f9e64034 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:01.846758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5146218f-dbc8-4445-a577-0f82f9e64034 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:01.847238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5146218f-dbc8-4445-a577-0f82f9e64034 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:01.981682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5146218f-dbc8-4445-a577-0f82f9e64034 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:01.989842 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5146218f-dbc8-4445-a577-0f82f9e64034 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1391 microversion: 2.1 time: 0.160676 Oct 04 19:28:01.990427 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3956/7918] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:01 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:03.014032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8eed3080-7212-4345-97df-ce9fd569c407 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:03.015395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8eed3080-7212-4345-97df-ce9fd569c407 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:03.017445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:03.024397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8eed3080-7212-4345-97df-ce9fd569c407 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:03.024901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8eed3080-7212-4345-97df-ce9fd569c407 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:03.025354 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8eed3080-7212-4345-97df-ce9fd569c407 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:03.026100 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8eed3080-7212-4345-97df-ce9fd569c407 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:03.026568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8eed3080-7212-4345-97df-ce9fd569c407 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:03.027052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8eed3080-7212-4345-97df-ce9fd569c407 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:03.164109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8eed3080-7212-4345-97df-ce9fd569c407 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:03.172228 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8eed3080-7212-4345-97df-ce9fd569c407 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1562 microversion: 2.1 time: 0.162931 Oct 04 19:28:03.172793 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3963/7919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:03 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:03.194765 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e6b28365-0f7f-4ca3-bb82-8821ce4ffbed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:03.195429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e6b28365-0f7f-4ca3-bb82-8821ce4ffbed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:03.202413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6b28365-0f7f-4ca3-bb82-8821ce4ffbed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:03.202923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6b28365-0f7f-4ca3-bb82-8821ce4ffbed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:03.203485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6b28365-0f7f-4ca3-bb82-8821ce4ffbed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:03.204206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6b28365-0f7f-4ca3-bb82-8821ce4ffbed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:03.204687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6b28365-0f7f-4ca3-bb82-8821ce4ffbed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:03.205139 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e6b28365-0f7f-4ca3-bb82-8821ce4ffbed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:03.337503 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-e6b28365-0f7f-4ca3-bb82-8821ce4ffbed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:03.345561 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e6b28365-0f7f-4ca3-bb82-8821ce4ffbed tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1562 microversion: 2.1 time: 0.154674 Oct 04 19:28:03.346145 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3957/7920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:03 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:04.983114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e1f788a3-715c-45b7-808a-87fdf6357f87 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:04.983754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e1f788a3-715c-45b7-808a-87fdf6357f87 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:04.986132 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f52d6b67-90d5-4431-9cb2-6b1f4461ba97 req-674d0108-a9a3-49c7-8cf8-cdcdddbe8d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b744ea40-6707-4ce9-b2f3-9a171bc2c624", "tag": "8db62852-3296-47ec-9a9f-68576d3b7766"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:04.993159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1f788a3-715c-45b7-808a-87fdf6357f87 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:04.993926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1f788a3-715c-45b7-808a-87fdf6357f87 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:04.994145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1f788a3-715c-45b7-808a-87fdf6357f87 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:04.994823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1f788a3-715c-45b7-808a-87fdf6357f87 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:04.995498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1f788a3-715c-45b7-808a-87fdf6357f87 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:04.995937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e1f788a3-715c-45b7-808a-87fdf6357f87 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:04.997423 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f52d6b67-90d5-4431-9cb2-6b1f4461ba97 req-674d0108-a9a3-49c7-8cf8-cdcdddbe8d5c service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:04.997931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f52d6b67-90d5-4431-9cb2-6b1f4461ba97 req-674d0108-a9a3-49c7-8cf8-cdcdddbe8d5c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:04.998380 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f52d6b67-90d5-4431-9cb2-6b1f4461ba97 req-674d0108-a9a3-49c7-8cf8-cdcdddbe8d5c service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:05.010249 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f52d6b67-90d5-4431-9cb2-6b1f4461ba97 req-674d0108-a9a3-49c7-8cf8-cdcdddbe8d5c service nova] Creating event network-changed:8db62852-3296-47ec-9a9f-68576d3b7766 for instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 on n-h2-850499-14 Oct 04 19:28:05.016147 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f52d6b67-90d5-4431-9cb2-6b1f4461ba97 req-674d0108-a9a3-49c7-8cf8-cdcdddbe8d5c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034169 Oct 04 19:28:05.016849 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3958/7921] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:28:05.214353 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e1f788a3-715c-45b7-808a-87fdf6357f87 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:05.222584 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e1f788a3-715c-45b7-808a-87fdf6357f87 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1562 microversion: 2.1 time: 0.243338 Oct 04 19:28:05.223545 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3964/7922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:04 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:40.523662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:40.524428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=42 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:40.529997 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-55af2178-1a8a-43c6-87bb-074064c7efb7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:40.532338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-55af2178-1a8a-43c6-87bb-074064c7efb7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:40.544501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55af2178-1a8a-43c6-87bb-074064c7efb7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:40.545006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55af2178-1a8a-43c6-87bb-074064c7efb7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:40.545461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55af2178-1a8a-43c6-87bb-074064c7efb7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:40.546177 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55af2178-1a8a-43c6-87bb-074064c7efb7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:40.546649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55af2178-1a8a-43c6-87bb-074064c7efb7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:40.547127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-55af2178-1a8a-43c6-87bb-074064c7efb7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:40.614041 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-55af2178-1a8a-43c6-87bb-074064c7efb7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624/action" status: 200 len: 24566 microversion: 2.1 time: 0.092187 Oct 04 19:28:40.614698 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3959/7923] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:28:40 2022] POST /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624/action => generated 24566 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:29:19.394620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=5 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:19.395346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=38 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:19.399384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee56c4e0-86c2-4123-92b9-0e8c81c3a9f0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:19.406209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee56c4e0-86c2-4123-92b9-0e8c81c3a9f0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:19.406704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee56c4e0-86c2-4123-92b9-0e8c81c3a9f0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:19.407181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee56c4e0-86c2-4123-92b9-0e8c81c3a9f0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:19.432042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ee56c4e0-86c2-4123-92b9-0e8c81c3a9f0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Going to try to stop instance {{(pid=122332) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:29:19.475216 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee56c4e0-86c2-4123-92b9-0e8c81c3a9f0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624/action" status: 202 len: 0 microversion: 2.1 time: 0.082247 Oct 04 19:29:19.475830 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3965/7924] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:29:19 2022] POST /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:29:19.485280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-827bd3c3-94b8-4ea6-9a28-1a31d74d32e0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:19.485999 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-827bd3c3-94b8-4ea6-9a28-1a31d74d32e0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:19.488685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:19.489600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:19.496392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-827bd3c3-94b8-4ea6-9a28-1a31d74d32e0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:19.496903 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-827bd3c3-94b8-4ea6-9a28-1a31d74d32e0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:19.497361 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-827bd3c3-94b8-4ea6-9a28-1a31d74d32e0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:19.498079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-827bd3c3-94b8-4ea6-9a28-1a31d74d32e0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:19.498554 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-827bd3c3-94b8-4ea6-9a28-1a31d74d32e0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:19.499016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-827bd3c3-94b8-4ea6-9a28-1a31d74d32e0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:19.637023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-827bd3c3-94b8-4ea6-9a28-1a31d74d32e0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:19.644945 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-827bd3c3-94b8-4ea6-9a28-1a31d74d32e0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.164495 Oct 04 19:29:19.645453 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3960/7925] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:19 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:20.671543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5d94e293-ba2c-43b0-af8b-0f687ac1cd61 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:20.672249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5d94e293-ba2c-43b0-af8b-0f687ac1cd61 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:20.678762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d94e293-ba2c-43b0-af8b-0f687ac1cd61 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:20.679286 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d94e293-ba2c-43b0-af8b-0f687ac1cd61 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:20.679733 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d94e293-ba2c-43b0-af8b-0f687ac1cd61 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:20.680431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d94e293-ba2c-43b0-af8b-0f687ac1cd61 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:20.680891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d94e293-ba2c-43b0-af8b-0f687ac1cd61 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:20.681325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5d94e293-ba2c-43b0-af8b-0f687ac1cd61 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:20.812451 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5d94e293-ba2c-43b0-af8b-0f687ac1cd61 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:20.820086 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5d94e293-ba2c-43b0-af8b-0f687ac1cd61 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.154125 Oct 04 19:29:20.820655 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3966/7926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:20 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:21.843947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-603861a7-c042-47d9-a1f8-af730bb053bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:21.844617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-603861a7-c042-47d9-a1f8-af730bb053bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:21.851617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-603861a7-c042-47d9-a1f8-af730bb053bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:21.852124 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-603861a7-c042-47d9-a1f8-af730bb053bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:21.852576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-603861a7-c042-47d9-a1f8-af730bb053bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:21.853283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-603861a7-c042-47d9-a1f8-af730bb053bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:21.853753 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-603861a7-c042-47d9-a1f8-af730bb053bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:21.854195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-603861a7-c042-47d9-a1f8-af730bb053bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:21.984392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-603861a7-c042-47d9-a1f8-af730bb053bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:21.992097 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-603861a7-c042-47d9-a1f8-af730bb053bc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.152259 Oct 04 19:29:21.992667 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3961/7927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:21 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:23.016023 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ec6f5b2a-1997-4b34-88e6-6b80e540fc6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:23.016676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ec6f5b2a-1997-4b34-88e6-6b80e540fc6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:23.023580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6f5b2a-1997-4b34-88e6-6b80e540fc6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:23.024072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6f5b2a-1997-4b34-88e6-6b80e540fc6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:23.024517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6f5b2a-1997-4b34-88e6-6b80e540fc6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:23.025219 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6f5b2a-1997-4b34-88e6-6b80e540fc6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:23.025680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6f5b2a-1997-4b34-88e6-6b80e540fc6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:23.026110 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ec6f5b2a-1997-4b34-88e6-6b80e540fc6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:23.157568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ec6f5b2a-1997-4b34-88e6-6b80e540fc6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:23.165332 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ec6f5b2a-1997-4b34-88e6-6b80e540fc6f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.153324 Oct 04 19:29:23.165901 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3967/7928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:23 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:24.190298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-89986935-04f4-44c3-9c80-c5c9fb28eb2f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:24.190983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-89986935-04f4-44c3-9c80-c5c9fb28eb2f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:24.197830 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89986935-04f4-44c3-9c80-c5c9fb28eb2f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:24.198338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89986935-04f4-44c3-9c80-c5c9fb28eb2f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:24.198793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89986935-04f4-44c3-9c80-c5c9fb28eb2f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:24.199534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89986935-04f4-44c3-9c80-c5c9fb28eb2f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:24.200006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89986935-04f4-44c3-9c80-c5c9fb28eb2f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:24.200448 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-89986935-04f4-44c3-9c80-c5c9fb28eb2f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:24.329039 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-89986935-04f4-44c3-9c80-c5c9fb28eb2f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:24.336798 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-89986935-04f4-44c3-9c80-c5c9fb28eb2f tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.151101 Oct 04 19:29:24.337374 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3962/7929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:24 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:25.361204 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1d5b0cf1-e843-4fc3-836e-9e82cd24c05b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:25.361828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1d5b0cf1-e843-4fc3-836e-9e82cd24c05b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:25.368878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf1-e843-4fc3-836e-9e82cd24c05b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:25.369370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf1-e843-4fc3-836e-9e82cd24c05b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:25.369813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf1-e843-4fc3-836e-9e82cd24c05b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:25.370513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf1-e843-4fc3-836e-9e82cd24c05b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:25.370993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf1-e843-4fc3-836e-9e82cd24c05b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:25.371426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf1-e843-4fc3-836e-9e82cd24c05b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:25.506979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1d5b0cf1-e843-4fc3-836e-9e82cd24c05b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:25.515406 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1d5b0cf1-e843-4fc3-836e-9e82cd24c05b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.158215 Oct 04 19:29:25.515977 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3968/7930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:25 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:26.539264 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-95dd442b-4954-4b5c-b564-b41154bce148 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:26.539898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-95dd442b-4954-4b5c-b564-b41154bce148 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:26.546670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dd442b-4954-4b5c-b564-b41154bce148 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:26.547244 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dd442b-4954-4b5c-b564-b41154bce148 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:26.547686 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dd442b-4954-4b5c-b564-b41154bce148 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:26.548425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dd442b-4954-4b5c-b564-b41154bce148 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:26.549159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dd442b-4954-4b5c-b564-b41154bce148 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:26.549599 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-95dd442b-4954-4b5c-b564-b41154bce148 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:26.678682 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-95dd442b-4954-4b5c-b564-b41154bce148 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:26.686403 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-95dd442b-4954-4b5c-b564-b41154bce148 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.151082 Oct 04 19:29:26.687732 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3963/7931] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:26 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:29:27.710993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e6a9a5c8-495b-4101-808a-56f88b0f4275 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:27.711579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e6a9a5c8-495b-4101-808a-56f88b0f4275 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:27.720386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5c8-495b-4101-808a-56f88b0f4275 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:27.721075 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5c8-495b-4101-808a-56f88b0f4275 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:27.721325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5c8-495b-4101-808a-56f88b0f4275 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:27.722044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5c8-495b-4101-808a-56f88b0f4275 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:27.722505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5c8-495b-4101-808a-56f88b0f4275 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:27.722936 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5c8-495b-4101-808a-56f88b0f4275 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:27.857528 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e6a9a5c8-495b-4101-808a-56f88b0f4275 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:27.865298 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e6a9a5c8-495b-4101-808a-56f88b0f4275 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.158703 Oct 04 19:29:27.865869 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3969/7932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:27 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:28.888812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0894424d-90b8-45cd-a4f1-149d70dc2348 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:28.889469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0894424d-90b8-45cd-a4f1-149d70dc2348 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:28.895500 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0894424d-90b8-45cd-a4f1-149d70dc2348 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:28.896002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0894424d-90b8-45cd-a4f1-149d70dc2348 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:28.896456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0894424d-90b8-45cd-a4f1-149d70dc2348 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:28.897163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0894424d-90b8-45cd-a4f1-149d70dc2348 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:28.897636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0894424d-90b8-45cd-a4f1-149d70dc2348 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:28.898077 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0894424d-90b8-45cd-a4f1-149d70dc2348 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:29.028128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0894424d-90b8-45cd-a4f1-149d70dc2348 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:29.037072 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0894424d-90b8-45cd-a4f1-149d70dc2348 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.152347 Oct 04 19:29:29.037660 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3964/7933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:28 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:30.062290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-18a9e9cd-836b-4695-b1a4-74d5b5acf4b5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:30.062910 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-18a9e9cd-836b-4695-b1a4-74d5b5acf4b5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:30.069640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18a9e9cd-836b-4695-b1a4-74d5b5acf4b5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:30.070126 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18a9e9cd-836b-4695-b1a4-74d5b5acf4b5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:30.070568 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18a9e9cd-836b-4695-b1a4-74d5b5acf4b5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:30.071279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18a9e9cd-836b-4695-b1a4-74d5b5acf4b5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:30.071738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18a9e9cd-836b-4695-b1a4-74d5b5acf4b5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:30.072160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-18a9e9cd-836b-4695-b1a4-74d5b5acf4b5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:30.199909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-18a9e9cd-836b-4695-b1a4-74d5b5acf4b5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:30.208198 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-18a9e9cd-836b-4695-b1a4-74d5b5acf4b5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.150009 Oct 04 19:29:30.208773 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3970/7934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:30 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:31.231127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af70a817-db54-429e-a636-c86e90345106 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:31.231758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-af70a817-db54-429e-a636-c86e90345106 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:31.239372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af70a817-db54-429e-a636-c86e90345106 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:31.239883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af70a817-db54-429e-a636-c86e90345106 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:31.240370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af70a817-db54-429e-a636-c86e90345106 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:31.241080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af70a817-db54-429e-a636-c86e90345106 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:31.241552 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af70a817-db54-429e-a636-c86e90345106 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:31.241991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af70a817-db54-429e-a636-c86e90345106 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:31.726718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af70a817-db54-429e-a636-c86e90345106 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:31.735153 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-af70a817-db54-429e-a636-c86e90345106 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.507962 Oct 04 19:29:31.735751 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3965/7935] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:31 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:32.759256 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-81e0937d-e2a0-4ff4-9dba-49b3d2ab22a8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:32.759788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-81e0937d-e2a0-4ff4-9dba-49b3d2ab22a8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:32.768113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81e0937d-e2a0-4ff4-9dba-49b3d2ab22a8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:32.768604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81e0937d-e2a0-4ff4-9dba-49b3d2ab22a8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:32.769082 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81e0937d-e2a0-4ff4-9dba-49b3d2ab22a8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:32.769785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81e0937d-e2a0-4ff4-9dba-49b3d2ab22a8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:32.770253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81e0937d-e2a0-4ff4-9dba-49b3d2ab22a8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:32.770689 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-81e0937d-e2a0-4ff4-9dba-49b3d2ab22a8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:32.900114 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-81e0937d-e2a0-4ff4-9dba-49b3d2ab22a8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:32.907953 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-81e0937d-e2a0-4ff4-9dba-49b3d2ab22a8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.152709 Oct 04 19:29:32.908522 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3971/7936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:32 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:33.931873 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4e444ab7-c1d1-4bcd-9c26-5bf55b7b02e8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:33.932507 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4e444ab7-c1d1-4bcd-9c26-5bf55b7b02e8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:33.939570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e444ab7-c1d1-4bcd-9c26-5bf55b7b02e8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:33.940074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e444ab7-c1d1-4bcd-9c26-5bf55b7b02e8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:33.940530 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e444ab7-c1d1-4bcd-9c26-5bf55b7b02e8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:33.941240 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e444ab7-c1d1-4bcd-9c26-5bf55b7b02e8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:33.941715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e444ab7-c1d1-4bcd-9c26-5bf55b7b02e8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:33.942157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4e444ab7-c1d1-4bcd-9c26-5bf55b7b02e8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:34.075345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4e444ab7-c1d1-4bcd-9c26-5bf55b7b02e8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:34.083338 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4e444ab7-c1d1-4bcd-9c26-5bf55b7b02e8 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1691 microversion: 2.1 time: 0.155449 Oct 04 19:29:34.083912 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3966/7937] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:33 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:35.107250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6580e5c6-96d6-408e-855b-7de1bf950e03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:35.107865 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6580e5c6-96d6-408e-855b-7de1bf950e03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:35.114875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6580e5c6-96d6-408e-855b-7de1bf950e03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:35.115324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6580e5c6-96d6-408e-855b-7de1bf950e03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:35.115762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6580e5c6-96d6-408e-855b-7de1bf950e03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:35.116456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6580e5c6-96d6-408e-855b-7de1bf950e03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:35.116908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6580e5c6-96d6-408e-855b-7de1bf950e03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:35.117333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6580e5c6-96d6-408e-855b-7de1bf950e03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:35.250200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6580e5c6-96d6-408e-855b-7de1bf950e03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:35.257920 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6580e5c6-96d6-408e-855b-7de1bf950e03 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1668 microversion: 2.1 time: 0.154746 Oct 04 19:29:35.258491 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3972/7938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:35 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:36.353952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-08fd49a3-dd92-49fd-9c97-7fe8b1c59e43 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:36.356215 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-08fd49a3-dd92-49fd-9c97-7fe8b1c59e43 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:36.364008 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08fd49a3-dd92-49fd-9c97-7fe8b1c59e43 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:36.364526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08fd49a3-dd92-49fd-9c97-7fe8b1c59e43 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:36.364988 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08fd49a3-dd92-49fd-9c97-7fe8b1c59e43 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:36.365749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08fd49a3-dd92-49fd-9c97-7fe8b1c59e43 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:36.366232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08fd49a3-dd92-49fd-9c97-7fe8b1c59e43 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:36.366683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-08fd49a3-dd92-49fd-9c97-7fe8b1c59e43 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:36.428711 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-08fd49a3-dd92-49fd-9c97-7fe8b1c59e43 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624/action" status: 200 len: 38236 microversion: 2.1 time: 0.078630 Oct 04 19:29:36.430481 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3967/7939] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:29:36 2022] POST /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624/action => generated 38236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:29:36.441449 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7eb02c7f-f1a1-4968-978b-e9202bc36a3e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:36.448459 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eb02c7f-f1a1-4968-978b-e9202bc36a3e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:36.448954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eb02c7f-f1a1-4968-978b-e9202bc36a3e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:36.449402 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7eb02c7f-f1a1-4968-978b-e9202bc36a3e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:36.471835 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7eb02c7f-f1a1-4968-978b-e9202bc36a3e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Going to try to start instance {{(pid=122332) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:29:36.515149 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7eb02c7f-f1a1-4968-978b-e9202bc36a3e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624/action" status: 202 len: 0 microversion: 2.1 time: 0.077243 Oct 04 19:29:36.515768 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3973/7940] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:29:36 2022] POST /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:29:36.524784 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b1ca1793-3954-4820-b3e7-e7c73bf9c831 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:36.525826 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b1ca1793-3954-4820-b3e7-e7c73bf9c831 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:36.533436 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1ca1793-3954-4820-b3e7-e7c73bf9c831 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:36.534012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1ca1793-3954-4820-b3e7-e7c73bf9c831 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:36.534516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1ca1793-3954-4820-b3e7-e7c73bf9c831 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:36.535295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1ca1793-3954-4820-b3e7-e7c73bf9c831 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:36.535790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1ca1793-3954-4820-b3e7-e7c73bf9c831 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:36.536206 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b1ca1793-3954-4820-b3e7-e7c73bf9c831 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:36.713541 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b1ca1793-3954-4820-b3e7-e7c73bf9c831 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:36.723833 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b1ca1793-3954-4820-b3e7-e7c73bf9c831 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1677 microversion: 2.1 time: 0.202588 Oct 04 19:29:36.724612 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3968/7941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:36 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:29:37.748964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a7a928c1-551b-4fbb-99a1-32b5d5dbb02c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:37.749679 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a7a928c1-551b-4fbb-99a1-32b5d5dbb02c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:37.756867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7a928c1-551b-4fbb-99a1-32b5d5dbb02c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:37.757364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7a928c1-551b-4fbb-99a1-32b5d5dbb02c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:37.757812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7a928c1-551b-4fbb-99a1-32b5d5dbb02c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:37.758518 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7a928c1-551b-4fbb-99a1-32b5d5dbb02c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:37.759000 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7a928c1-551b-4fbb-99a1-32b5d5dbb02c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:37.759436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7a928c1-551b-4fbb-99a1-32b5d5dbb02c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:37.909268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a7a928c1-551b-4fbb-99a1-32b5d5dbb02c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:37.917034 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a7a928c1-551b-4fbb-99a1-32b5d5dbb02c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1677 microversion: 2.1 time: 0.172519 Oct 04 19:29:37.917599 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3974/7942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:37 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:38.941635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fe62f852-9ea4-44b8-be5f-410cdee58033 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:38.942290 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fe62f852-9ea4-44b8-be5f-410cdee58033 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:38.949203 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe62f852-9ea4-44b8-be5f-410cdee58033 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:38.949709 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe62f852-9ea4-44b8-be5f-410cdee58033 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:38.950181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe62f852-9ea4-44b8-be5f-410cdee58033 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:38.950891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe62f852-9ea4-44b8-be5f-410cdee58033 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:38.951874 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe62f852-9ea4-44b8-be5f-410cdee58033 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:38.952331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe62f852-9ea4-44b8-be5f-410cdee58033 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:39.085219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fe62f852-9ea4-44b8-be5f-410cdee58033 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:39.092929 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fe62f852-9ea4-44b8-be5f-410cdee58033 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1681 microversion: 2.1 time: 0.155272 Oct 04 19:29:39.093499 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3969/7943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:38 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:17.331315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-60b86c16-f1a8-435c-97e7-eb16f088f6d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:17.333439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-60b86c16-f1a8-435c-97e7-eb16f088f6d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:17.335760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=20 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:17.336411 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:17.342024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60b86c16-f1a8-435c-97e7-eb16f088f6d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:17.342529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60b86c16-f1a8-435c-97e7-eb16f088f6d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:17.343013 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60b86c16-f1a8-435c-97e7-eb16f088f6d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:17.343723 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60b86c16-f1a8-435c-97e7-eb16f088f6d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:17.344182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60b86c16-f1a8-435c-97e7-eb16f088f6d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:17.344610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-60b86c16-f1a8-435c-97e7-eb16f088f6d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:17.425727 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-60b86c16-f1a8-435c-97e7-eb16f088f6d7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624/action" status: 200 len: 62800 microversion: 2.1 time: 0.098438 Oct 04 19:30:17.426410 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3975/7944] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:30:17 2022] POST /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624/action => generated 62800 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:30:41.012721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fe12ef66-3a64-41d5-8dd8-03a41e06aa28 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:41.013495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fe12ef66-3a64-41d5-8dd8-03a41e06aa28 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:41.015334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:41.016373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=20 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:41.017053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=4 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:41.017196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=58 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:41.018937 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:30:41.019190 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:30:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 (ip 10.222.0.18) !!! Oct 04 19:30:41.020631 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 19:30:41.029089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe12ef66-3a64-41d5-8dd8-03a41e06aa28 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.029659 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe12ef66-3a64-41d5-8dd8-03a41e06aa28 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.030147 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe12ef66-3a64-41d5-8dd8-03a41e06aa28 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.030877 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe12ef66-3a64-41d5-8dd8-03a41e06aa28 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.031456 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe12ef66-3a64-41d5-8dd8-03a41e06aa28 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.031902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fe12ef66-3a64-41d5-8dd8-03a41e06aa28 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.060604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fe12ef66-3a64-41d5-8dd8-03a41e06aa28 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:30:41.116048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-5bc67263-463e-454b-b161-402aaf74cccf req-f6bf6c89-118a-49d4-ba65-18bbc8cf534a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b744ea40-6707-4ce9-b2f3-9a171bc2c624", "tag": "8db62852-3296-47ec-9a9f-68576d3b7766"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:41.129165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5bc67263-463e-454b-b161-402aaf74cccf req-f6bf6c89-118a-49d4-ba65-18bbc8cf534a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.129943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5bc67263-463e-454b-b161-402aaf74cccf req-f6bf6c89-118a-49d4-ba65-18bbc8cf534a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.130511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-5bc67263-463e-454b-b161-402aaf74cccf req-f6bf6c89-118a-49d4-ba65-18bbc8cf534a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.142700 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-5bc67263-463e-454b-b161-402aaf74cccf req-f6bf6c89-118a-49d4-ba65-18bbc8cf534a service nova] Creating event network-changed:8db62852-3296-47ec-9a9f-68576d3b7766 for instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 on n-h2-850499-14 Oct 04 19:30:41.148124 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-5bc67263-463e-454b-b161-402aaf74cccf req-f6bf6c89-118a-49d4-ba65-18bbc8cf534a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138079 Oct 04 19:30:41.149250 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3976/7945] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:41.158631 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fe12ef66-3a64-41d5-8dd8-03a41e06aa28 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 204 len: 0 microversion: 2.1 time: 0.150524 Oct 04 19:30:41.159497 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3970/7946] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:30:41 2022] DELETE /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:30:41.168681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-90ebc7b7-1525-4161-9542-cea74d67f17e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:41.169405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-90ebc7b7-1525-4161-9542-cea74d67f17e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:41.176499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90ebc7b7-1525-4161-9542-cea74d67f17e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.177004 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90ebc7b7-1525-4161-9542-cea74d67f17e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.177453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90ebc7b7-1525-4161-9542-cea74d67f17e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.178178 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90ebc7b7-1525-4161-9542-cea74d67f17e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:41.178655 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90ebc7b7-1525-4161-9542-cea74d67f17e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:41.179120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-90ebc7b7-1525-4161-9542-cea74d67f17e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:41.319561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-90ebc7b7-1525-4161-9542-cea74d67f17e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:41.327534 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-90ebc7b7-1525-4161-9542-cea74d67f17e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1687 microversion: 2.1 time: 0.163585 Oct 04 19:30:41.328108 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3977/7947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:41 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:30:42.351730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1e51d370-2247-46d7-a8e4-90dbddd56da2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:42.352482 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1e51d370-2247-46d7-a8e4-90dbddd56da2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:42.359604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e51d370-2247-46d7-a8e4-90dbddd56da2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:42.360110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e51d370-2247-46d7-a8e4-90dbddd56da2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:42.360569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e51d370-2247-46d7-a8e4-90dbddd56da2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:42.361288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e51d370-2247-46d7-a8e4-90dbddd56da2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:42.361761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e51d370-2247-46d7-a8e4-90dbddd56da2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:42.362205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1e51d370-2247-46d7-a8e4-90dbddd56da2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:42.499093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-1e51d370-2247-46d7-a8e4-90dbddd56da2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:42.507358 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1e51d370-2247-46d7-a8e4-90dbddd56da2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1687 microversion: 2.1 time: 0.160067 Oct 04 19:30:42.507934 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3971/7948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:42 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:43.532408 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c09ac901-bb08-4c4a-ada5-54e62d483430 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:43.533037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c09ac901-bb08-4c4a-ada5-54e62d483430 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:43.542782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c09ac901-bb08-4c4a-ada5-54e62d483430 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:43.542782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c09ac901-bb08-4c4a-ada5-54e62d483430 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:43.542782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c09ac901-bb08-4c4a-ada5-54e62d483430 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:43.543346 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c09ac901-bb08-4c4a-ada5-54e62d483430 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:43.543758 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c09ac901-bb08-4c4a-ada5-54e62d483430 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:43.544193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c09ac901-bb08-4c4a-ada5-54e62d483430 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:43.614021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c09ac901-bb08-4c4a-ada5-54e62d483430 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:43.623505 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c09ac901-bb08-4c4a-ada5-54e62d483430 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 200 len: 1500 microversion: 2.1 time: 0.095343 Oct 04 19:30:43.624102 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3978/7949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:43 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 1500 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:43.701972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-502dd716-7528-4ce5-aa17-9b875c34ab0d req-dbfd97aa-c6bf-4cc9-ae14-132be0f70643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b744ea40-6707-4ce9-b2f3-9a171bc2c624", "name": "network-vif-deleted", "tag": "8db62852-3296-47ec-9a9f-68576d3b7766"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:43.713776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-502dd716-7528-4ce5-aa17-9b875c34ab0d req-dbfd97aa-c6bf-4cc9-ae14-132be0f70643 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:43.714947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-502dd716-7528-4ce5-aa17-9b875c34ab0d req-dbfd97aa-c6bf-4cc9-ae14-132be0f70643 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:43.715481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-502dd716-7528-4ce5-aa17-9b875c34ab0d req-dbfd97aa-c6bf-4cc9-ae14-132be0f70643 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:43.726685 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-502dd716-7528-4ce5-aa17-9b875c34ab0d req-dbfd97aa-c6bf-4cc9-ae14-132be0f70643 service nova] Creating event network-vif-deleted:8db62852-3296-47ec-9a9f-68576d3b7766 for instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 on n-h2-850499-14 Oct 04 19:30:43.731873 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-502dd716-7528-4ce5-aa17-9b875c34ab0d req-dbfd97aa-c6bf-4cc9-ae14-132be0f70643 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125948 Oct 04 19:30:43.732475 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3972/7950] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:44.649829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:44.650435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: b744ea40-6707-4ce9-b2f3-9a171bc2c624] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:44.657313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:44.657798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:44.658238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:44.659489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:44.659946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:44.660370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:44.673707 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] HTTP exception thrown: Instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 could not be found. Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Request method failure captured: Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 HTTP/1.1 Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIeN8IpXRvunr76MaJcsy7gb5UP6P4wqRVf0JkFXuXKO2yf2pFEvJw8J88FNBXWWUdzOw2EIDCftvfvYY_kAe0UTJSv2yPFw5P2VL_L4-kqKLgsStF_OIK04o3eUaRuB3lR-bHSuVie82p8LaoF1Nxb20sOCbZAKQ5m9_sRAS24DjP0 Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 2c351b5f6e644ae793a7cd81ce120f12 Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c351b5f6e644ae793a7cd81ce120f12"}]}] Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 2c351b5f6e644ae793a7cd81ce120f12 Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestNetworkAdvancedServerOps-773175457-project Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 01a419fcbb7a4558add32361c96e387c Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestNetworkAdvancedServerOps-773175457-project Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 could not be found. Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': 'b744ea40-6707-4ce9-b2f3-9a171bc2c624'} Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 could not be found. Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 could not be found. Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:30:44.676008 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 could not be found. Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Returning 404 to user: Instance b744ea40-6707-4ce9-b2f3-9a171bc2c624 could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0cbbd7bc-ae0f-4403-986d-3cb3507f2969 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624" status: 404 len: 111 microversion: 2.1 time: 0.031546 Oct 04 19:30:44.681544 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3979/7951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:44 2022] GET /compute/v2.1/servers/b744ea40-6707-4ce9-b2f3-9a171bc2c624 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:30:48.015289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-63d70c81-0ee2-4e61-acdf-0340b7708fc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '.version_select at 0x7fd4d11ede50>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:48.046253 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-63d70c81-0ee2-4e61-acdf-0340b7708fc0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-22800464" status: 202 len: 0 microversion: 2.1 time: 0.035325 Oct 04 19:30:48.047022 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3973/7952] 10.222.0.18 () {58 vars in 1278 bytes} [Tue Oct 4 19:30:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-22800464 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:30:48.081148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4903f456-7ce5-4bd5-b6fa-192835b2465b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'create', calling method: .version_select at 0x7fd4d0b9e8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1747105220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjMC5gNdd4/xvuejA5VgQ/6Adh7clvRzZ5QIWHLNfyHR3sHbhbVXF/rxBmZFOyt2/+AJNvITY2+J8aN82hOVKDTrlRIkuIaBir0ZK5Y7zEFM6SqmAc+RWqftwOZgyDQ3w=="}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:48.098817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-4903f456-7ce5-4bd5-b6fa-192835b2465b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:30:48.104026 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-4903f456-7ce5-4bd5-b6fa-192835b2465b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for user 01a419fcbb7a4558add32361c96e387c and project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'key_pairs'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:30:48.127429 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4903f456-7ce5-4bd5-b6fa-192835b2465b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050136 Oct 04 19:30:48.127977 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3980/7953] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:30:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:54.088295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1481522340", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "networks": [{"uuid": "5d041729-15c9-4121-8a8e-e0448f731147"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1747105220", "security_groups": [{"name": "tempest-secgroup-smoke-1765707861"}]}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:54.107040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:54.263850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.network.neutron [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] validate_networks() for [('5d041729-15c9-4121-8a8e-e0448f731147', None, None, None, None, None)] {{(pid=122331) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:30:55.040504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:30:55.040915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image limits 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:30:55.041440 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Flavor pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:30:55.041876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Image pref 0:0:0 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:30:55.042310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.virt.hardware [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:30:55.052159 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:55.052671 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:55.053135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:55.053894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:55.054368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:55.055046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:55.072825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:30:55.078155 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Getting quotas for user 01a419fcbb7a4558add32361c96e387c and project 2c351b5f6e644ae793a7cd81ce120f12. Resources: {'cores', 'instances', 'ram'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:30:55.090761 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Going to run 1 instances... {{(pid=122331) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:30:55.093251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:30:55.142521 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-00595dbe-9f62-4394-84e5-aaac4b33bebc tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.058967 Oct 04 19:30:55.143543 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3974/7954] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:30:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:30:55.152439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=16 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:55.156751 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-45842268-539a-4648-ab7c-6b72d02cffe2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:55.157659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-45842268-539a-4648-ab7c-6b72d02cffe2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:55.216263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-45842268-539a-4648-ab7c-6b72d02cffe2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:55.225072 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-45842268-539a-4648-ab7c-6b72d02cffe2 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1267 microversion: 2.1 time: 0.074372 Oct 04 19:30:55.225925 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3981/7955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:55 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:30:56.250770 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d7b45c04-9108-4e42-81e4-8e2108d8454d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:56.253443 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d7b45c04-9108-4e42-81e4-8e2108d8454d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:56.262015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b45c04-9108-4e42-81e4-8e2108d8454d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:56.262845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b45c04-9108-4e42-81e4-8e2108d8454d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:56.263598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b45c04-9108-4e42-81e4-8e2108d8454d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:56.264245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b45c04-9108-4e42-81e4-8e2108d8454d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:56.264718 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b45c04-9108-4e42-81e4-8e2108d8454d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:56.265476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d7b45c04-9108-4e42-81e4-8e2108d8454d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:56.344717 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d7b45c04-9108-4e42-81e4-8e2108d8454d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:56.358800 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d7b45c04-9108-4e42-81e4-8e2108d8454d tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1319 microversion: 2.1 time: 0.112710 Oct 04 19:30:56.360108 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3975/7956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:56 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1319 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:57.383397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4a98691b-3e2d-47e1-b93b-f26effbbd2dd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:57.384054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4a98691b-3e2d-47e1-b93b-f26effbbd2dd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:57.391462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a98691b-3e2d-47e1-b93b-f26effbbd2dd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:57.391954 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a98691b-3e2d-47e1-b93b-f26effbbd2dd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:57.392968 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a98691b-3e2d-47e1-b93b-f26effbbd2dd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:57.393678 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a98691b-3e2d-47e1-b93b-f26effbbd2dd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:57.394142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a98691b-3e2d-47e1-b93b-f26effbbd2dd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:57.394575 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4a98691b-3e2d-47e1-b93b-f26effbbd2dd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:57.526310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4a98691b-3e2d-47e1-b93b-f26effbbd2dd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:57.534091 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4a98691b-3e2d-47e1-b93b-f26effbbd2dd tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1393 microversion: 2.1 time: 0.154752 Oct 04 19:30:57.534762 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3982/7957] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:57 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:57.851984 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-4aab032d-d5f4-469c-8a26-64c27cf78f54 req-a55daaa5-108b-4295-902e-57dc2d9227b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f795eb7-d5f8-4715-9bce-d67ee9e91cbc", "tag": "765d773a-6a4e-4125-80ac-a1ac04efbe0d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:57.863433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4aab032d-d5f4-469c-8a26-64c27cf78f54 req-a55daaa5-108b-4295-902e-57dc2d9227b1 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:57.864222 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4aab032d-d5f4-469c-8a26-64c27cf78f54 req-a55daaa5-108b-4295-902e-57dc2d9227b1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:57.864675 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-4aab032d-d5f4-469c-8a26-64c27cf78f54 req-a55daaa5-108b-4295-902e-57dc2d9227b1 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:57.876109 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-4aab032d-d5f4-469c-8a26-64c27cf78f54 req-a55daaa5-108b-4295-902e-57dc2d9227b1 service nova] Creating event network-changed:765d773a-6a4e-4125-80ac-a1ac04efbe0d for instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc on n-h2-850499-14 Oct 04 19:30:57.881817 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-4aab032d-d5f4-469c-8a26-64c27cf78f54 req-a55daaa5-108b-4295-902e-57dc2d9227b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033902 Oct 04 19:30:57.882425 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3976/7958] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:30:58.559191 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe43fffb-1d96-4f18-bbf7-9b6b4b917867 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:58.559814 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fe43fffb-1d96-4f18-bbf7-9b6b4b917867 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:58.566699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe43fffb-1d96-4f18-bbf7-9b6b4b917867 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:58.567225 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe43fffb-1d96-4f18-bbf7-9b6b4b917867 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:58.567674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe43fffb-1d96-4f18-bbf7-9b6b4b917867 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:58.568406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe43fffb-1d96-4f18-bbf7-9b6b4b917867 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:58.568993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe43fffb-1d96-4f18-bbf7-9b6b4b917867 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:58.569471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe43fffb-1d96-4f18-bbf7-9b6b4b917867 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:58.703132 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-fe43fffb-1d96-4f18-bbf7-9b6b4b917867 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:58.711419 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fe43fffb-1d96-4f18-bbf7-9b6b4b917867 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1393 microversion: 2.1 time: 0.156144 Oct 04 19:30:58.711987 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3983/7959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:58 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:59.735108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-93957f82-3ed3-43f9-ad8c-c31512e86ae0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:59.736526 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-93957f82-3ed3-43f9-ad8c-c31512e86ae0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:59.742723 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93957f82-3ed3-43f9-ad8c-c31512e86ae0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:59.743261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93957f82-3ed3-43f9-ad8c-c31512e86ae0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:59.743715 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93957f82-3ed3-43f9-ad8c-c31512e86ae0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:59.744419 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93957f82-3ed3-43f9-ad8c-c31512e86ae0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:59.744891 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93957f82-3ed3-43f9-ad8c-c31512e86ae0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:59.745332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-93957f82-3ed3-43f9-ad8c-c31512e86ae0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:59.876725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-93957f82-3ed3-43f9-ad8c-c31512e86ae0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:59.884844 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-93957f82-3ed3-43f9-ad8c-c31512e86ae0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1393 microversion: 2.1 time: 0.154872 Oct 04 19:30:59.885420 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3977/7960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:59 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:00.908618 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-67334f62-dbfd-4e6b-8d1e-5463f5ae0deb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:00.909235 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-67334f62-dbfd-4e6b-8d1e-5463f5ae0deb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:00.915590 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67334f62-dbfd-4e6b-8d1e-5463f5ae0deb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:00.916080 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67334f62-dbfd-4e6b-8d1e-5463f5ae0deb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:00.916522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67334f62-dbfd-4e6b-8d1e-5463f5ae0deb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:00.917213 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67334f62-dbfd-4e6b-8d1e-5463f5ae0deb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:00.917669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67334f62-dbfd-4e6b-8d1e-5463f5ae0deb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:00.918095 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-67334f62-dbfd-4e6b-8d1e-5463f5ae0deb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:01.052553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-67334f62-dbfd-4e6b-8d1e-5463f5ae0deb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:01.060420 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-67334f62-dbfd-4e6b-8d1e-5463f5ae0deb tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1393 microversion: 2.1 time: 0.156237 Oct 04 19:31:01.061383 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3984/7961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:00 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:02.084786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-11432990-4cda-43c6-80d7-8fc9ae5654f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:02.085413 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-11432990-4cda-43c6-80d7-8fc9ae5654f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:02.092540 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11432990-4cda-43c6-80d7-8fc9ae5654f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:02.093297 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11432990-4cda-43c6-80d7-8fc9ae5654f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:02.093518 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11432990-4cda-43c6-80d7-8fc9ae5654f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:02.094237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11432990-4cda-43c6-80d7-8fc9ae5654f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:02.094714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11432990-4cda-43c6-80d7-8fc9ae5654f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:02.095238 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-11432990-4cda-43c6-80d7-8fc9ae5654f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:02.239023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-11432990-4cda-43c6-80d7-8fc9ae5654f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:02.246848 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-11432990-4cda-43c6-80d7-8fc9ae5654f7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1393 microversion: 2.1 time: 0.166175 Oct 04 19:31:02.247570 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3978/7962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:02 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:03.270439 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b129a05e-0bb6-4604-9a60-ec8d602a2221 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:03.271254 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b129a05e-0bb6-4604-9a60-ec8d602a2221 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:03.277956 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b129a05e-0bb6-4604-9a60-ec8d602a2221 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:03.278446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b129a05e-0bb6-4604-9a60-ec8d602a2221 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:03.278928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b129a05e-0bb6-4604-9a60-ec8d602a2221 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:03.279650 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b129a05e-0bb6-4604-9a60-ec8d602a2221 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:03.280115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b129a05e-0bb6-4604-9a60-ec8d602a2221 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:03.280550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b129a05e-0bb6-4604-9a60-ec8d602a2221 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:03.413433 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b129a05e-0bb6-4604-9a60-ec8d602a2221 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:03.421224 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b129a05e-0bb6-4604-9a60-ec8d602a2221 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1393 microversion: 2.1 time: 0.154672 Oct 04 19:31:03.421804 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3985/7963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:03 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:04.263661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-06000f89-4227-421f-905a-26e7350e7f17 req-f050f5f3-672c-4dee-9403-626cc06937ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f795eb7-d5f8-4715-9bce-d67ee9e91cbc", "name": "network-vif-plugged", "status": "completed", "tag": "765d773a-6a4e-4125-80ac-a1ac04efbe0d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:04.273752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-06000f89-4227-421f-905a-26e7350e7f17 req-f050f5f3-672c-4dee-9403-626cc06937ab service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:04.274262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-06000f89-4227-421f-905a-26e7350e7f17 req-f050f5f3-672c-4dee-9403-626cc06937ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:04.274710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-06000f89-4227-421f-905a-26e7350e7f17 req-f050f5f3-672c-4dee-9403-626cc06937ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:04.286356 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-06000f89-4227-421f-905a-26e7350e7f17 req-f050f5f3-672c-4dee-9403-626cc06937ab service nova] Creating event network-vif-plugged:765d773a-6a4e-4125-80ac-a1ac04efbe0d for instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc on n-h2-850499-14 Oct 04 19:31:04.291529 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-06000f89-4227-421f-905a-26e7350e7f17 req-f050f5f3-672c-4dee-9403-626cc06937ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157515 Oct 04 19:31:04.292198 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3979/7964] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:04.445111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-00304df8-4753-4139-9aad-f8933153cbf4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:04.445909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-00304df8-4753-4139-9aad-f8933153cbf4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:04.452734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00304df8-4753-4139-9aad-f8933153cbf4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:04.453232 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00304df8-4753-4139-9aad-f8933153cbf4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:04.453851 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00304df8-4753-4139-9aad-f8933153cbf4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:04.455308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00304df8-4753-4139-9aad-f8933153cbf4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:04.455768 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00304df8-4753-4139-9aad-f8933153cbf4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:04.456203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-00304df8-4753-4139-9aad-f8933153cbf4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:04.592547 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-00304df8-4753-4139-9aad-f8933153cbf4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:04.600860 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-00304df8-4753-4139-9aad-f8933153cbf4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1393 microversion: 2.1 time: 0.159956 Oct 04 19:31:04.601437 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3986/7965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:04 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:05.620959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:05.621752 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:05.626611 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8d751dab-d808-483f-857d-7acf615bc67b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:05.627374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8d751dab-d808-483f-857d-7acf615bc67b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:05.634450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d751dab-d808-483f-857d-7acf615bc67b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:05.634983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d751dab-d808-483f-857d-7acf615bc67b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:05.635433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d751dab-d808-483f-857d-7acf615bc67b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:05.636140 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d751dab-d808-483f-857d-7acf615bc67b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:05.636612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d751dab-d808-483f-857d-7acf615bc67b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:05.637056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8d751dab-d808-483f-857d-7acf615bc67b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:05.769344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8d751dab-d808-483f-857d-7acf615bc67b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:05.777019 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8d751dab-d808-483f-857d-7acf615bc67b tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1393 microversion: 2.1 time: 0.157034 Oct 04 19:31:05.777584 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3980/7966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:05 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:06.801207 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:06.858874 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8a68f572-b984-4758-b036-fbc84c6c2119 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:06.859643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8a68f572-b984-4758-b036-fbc84c6c2119 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:06.866168 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a68f572-b984-4758-b036-fbc84c6c2119 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:06.866668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a68f572-b984-4758-b036-fbc84c6c2119 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:06.867397 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a68f572-b984-4758-b036-fbc84c6c2119 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:06.868115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a68f572-b984-4758-b036-fbc84c6c2119 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:06.868586 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a68f572-b984-4758-b036-fbc84c6c2119 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:06.869079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8a68f572-b984-4758-b036-fbc84c6c2119 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:07.006462 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8a68f572-b984-4758-b036-fbc84c6c2119 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:07.014519 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8a68f572-b984-4758-b036-fbc84c6c2119 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1565 microversion: 2.1 time: 0.218194 Oct 04 19:31:07.015130 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3987/7967] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:06 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1565 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:07.037315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-04e755a8-3ac1-4172-8a61-516d73ab8b05 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:07.037944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-04e755a8-3ac1-4172-8a61-516d73ab8b05 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:07.044763 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e755a8-3ac1-4172-8a61-516d73ab8b05 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:07.045231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e755a8-3ac1-4172-8a61-516d73ab8b05 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:07.045680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e755a8-3ac1-4172-8a61-516d73ab8b05 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:07.046397 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e755a8-3ac1-4172-8a61-516d73ab8b05 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:07.046869 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e755a8-3ac1-4172-8a61-516d73ab8b05 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:07.047602 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-04e755a8-3ac1-4172-8a61-516d73ab8b05 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:07.182164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-04e755a8-3ac1-4172-8a61-516d73ab8b05 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:07.190424 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-04e755a8-3ac1-4172-8a61-516d73ab8b05 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1565 microversion: 2.1 time: 0.156974 Oct 04 19:31:07.191005 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3981/7968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:07 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:08.763063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f7ce24d3-7e54-4b12-b10c-471679d02a04 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:08.763691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f7ce24d3-7e54-4b12-b10c-471679d02a04 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:08.765269 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f787bc2c-73ab-45b2-bc82-25693727818c req-befcab01-e300-4fdc-8e5a-b05fcaf35734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f795eb7-d5f8-4715-9bce-d67ee9e91cbc", "tag": "765d773a-6a4e-4125-80ac-a1ac04efbe0d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:08.771553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce24d3-7e54-4b12-b10c-471679d02a04 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:08.772054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce24d3-7e54-4b12-b10c-471679d02a04 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:08.772494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce24d3-7e54-4b12-b10c-471679d02a04 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:08.773517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce24d3-7e54-4b12-b10c-471679d02a04 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:08.774012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce24d3-7e54-4b12-b10c-471679d02a04 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:08.774442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f7ce24d3-7e54-4b12-b10c-471679d02a04 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:08.778319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f787bc2c-73ab-45b2-bc82-25693727818c req-befcab01-e300-4fdc-8e5a-b05fcaf35734 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:08.779105 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f787bc2c-73ab-45b2-bc82-25693727818c req-befcab01-e300-4fdc-8e5a-b05fcaf35734 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:08.779788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f787bc2c-73ab-45b2-bc82-25693727818c req-befcab01-e300-4fdc-8e5a-b05fcaf35734 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:08.792445 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f787bc2c-73ab-45b2-bc82-25693727818c req-befcab01-e300-4fdc-8e5a-b05fcaf35734 service nova] Creating event network-changed:765d773a-6a4e-4125-80ac-a1ac04efbe0d for instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc on n-h2-850499-14 Oct 04 19:31:08.798448 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f787bc2c-73ab-45b2-bc82-25693727818c req-befcab01-e300-4fdc-8e5a-b05fcaf35734 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037269 Oct 04 19:31:08.799931 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3982/7969] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:08.917741 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f7ce24d3-7e54-4b12-b10c-471679d02a04 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:08.926360 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f7ce24d3-7e54-4b12-b10c-471679d02a04 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1565 microversion: 2.1 time: 0.167444 Oct 04 19:31:08.926986 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3988/7970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:08 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:44.216635 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:44.217408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=38 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:44.221995 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6d1a4bde-5fa3-45bd-8d4c-1968f397c216 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:44.224343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6d1a4bde-5fa3-45bd-8d4c-1968f397c216 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:44.231749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d1a4bde-5fa3-45bd-8d4c-1968f397c216 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:44.232256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d1a4bde-5fa3-45bd-8d4c-1968f397c216 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:44.232714 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d1a4bde-5fa3-45bd-8d4c-1968f397c216 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:44.233428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d1a4bde-5fa3-45bd-8d4c-1968f397c216 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:44.233908 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d1a4bde-5fa3-45bd-8d4c-1968f397c216 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:44.234353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6d1a4bde-5fa3-45bd-8d4c-1968f397c216 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:44.311443 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6d1a4bde-5fa3-45bd-8d4c-1968f397c216 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action" status: 200 len: 24572 microversion: 2.1 time: 0.097008 Oct 04 19:31:44.312084 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3983/7971] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:31:44 2022] POST /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action => generated 24572 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:32:23.355435 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:32:23.356375 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action (ip 10.222.0.18) !!! Oct 04 19:32:23.356695 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:23.357469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=42 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:23.361839 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-21a3c237-3a76-45d7-9a6f-f1a5e6fe898e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:23.362381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-21a3c237-3a76-45d7-9a6f-f1a5e6fe898e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:23.370786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a3c237-3a76-45d7-9a6f-f1a5e6fe898e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.371304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a3c237-3a76-45d7-9a6f-f1a5e6fe898e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.371749 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a3c237-3a76-45d7-9a6f-f1a5e6fe898e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.372453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a3c237-3a76-45d7-9a6f-f1a5e6fe898e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.372917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a3c237-3a76-45d7-9a6f-f1a5e6fe898e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.373351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21a3c237-3a76-45d7-9a6f-f1a5e6fe898e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.398298 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-21a3c237-3a76-45d7-9a6f-f1a5e6fe898e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lazy-loading 'flavor' on Instance uuid 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:32:23.463793 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-21a3c237-3a76-45d7-9a6f-f1a5e6fe898e tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.110789 Oct 04 19:32:23.464685 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3989/7972] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:32:23 2022] POST /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:32:23.473442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ff7e9aab-302f-44a8-846a-0203423315fa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:23.474263 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ff7e9aab-302f-44a8-846a-0203423315fa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:23.476991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:23.478178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:23.486433 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff7e9aab-302f-44a8-846a-0203423315fa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.486979 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff7e9aab-302f-44a8-846a-0203423315fa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.487461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff7e9aab-302f-44a8-846a-0203423315fa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.488207 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff7e9aab-302f-44a8-846a-0203423315fa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.488685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff7e9aab-302f-44a8-846a-0203423315fa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.489136 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff7e9aab-302f-44a8-846a-0203423315fa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.630043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ff7e9aab-302f-44a8-846a-0203423315fa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:23.638471 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ff7e9aab-302f-44a8-846a-0203423315fa tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1692 microversion: 2.1 time: 0.169507 Oct 04 19:32:23.639061 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3984/7973] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:23 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:24.663960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b8981de-c791-46c5-9a21-8ff7feb39de5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:24.664665 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6b8981de-c791-46c5-9a21-8ff7feb39de5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:24.670808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b8981de-c791-46c5-9a21-8ff7feb39de5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:24.671607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b8981de-c791-46c5-9a21-8ff7feb39de5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:24.672055 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b8981de-c791-46c5-9a21-8ff7feb39de5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:24.672745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b8981de-c791-46c5-9a21-8ff7feb39de5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:24.673203 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b8981de-c791-46c5-9a21-8ff7feb39de5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:24.673632 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b8981de-c791-46c5-9a21-8ff7feb39de5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:24.809506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6b8981de-c791-46c5-9a21-8ff7feb39de5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:24.817439 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6b8981de-c791-46c5-9a21-8ff7feb39de5 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1692 microversion: 2.1 time: 0.159389 Oct 04 19:32:24.818001 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3990/7974] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:24 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:25.841457 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bdf7c09b-bede-4500-a1f4-a27ad76f22e4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:25.842095 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bdf7c09b-bede-4500-a1f4-a27ad76f22e4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:25.850731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf7c09b-bede-4500-a1f4-a27ad76f22e4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:25.851271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf7c09b-bede-4500-a1f4-a27ad76f22e4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:25.851739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf7c09b-bede-4500-a1f4-a27ad76f22e4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:25.852462 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf7c09b-bede-4500-a1f4-a27ad76f22e4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:25.852944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf7c09b-bede-4500-a1f4-a27ad76f22e4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:25.853398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bdf7c09b-bede-4500-a1f4-a27ad76f22e4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:25.989036 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bdf7c09b-bede-4500-a1f4-a27ad76f22e4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:25.996958 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bdf7c09b-bede-4500-a1f4-a27ad76f22e4 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1675 microversion: 2.1 time: 0.159451 Oct 04 19:32:25.997549 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3985/7975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:25 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:27.090142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1f3be67a-49b5-4982-b07b-0ad255769c10 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:27.092487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1f3be67a-49b5-4982-b07b-0ad255769c10 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:27.099489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f3be67a-49b5-4982-b07b-0ad255769c10 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:27.099987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f3be67a-49b5-4982-b07b-0ad255769c10 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:27.100434 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f3be67a-49b5-4982-b07b-0ad255769c10 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.101681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f3be67a-49b5-4982-b07b-0ad255769c10 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:27.102148 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f3be67a-49b5-4982-b07b-0ad255769c10 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:27.102585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1f3be67a-49b5-4982-b07b-0ad255769c10 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.164573 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1f3be67a-49b5-4982-b07b-0ad255769c10 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action" status: 200 len: 36682 microversion: 2.1 time: 0.078184 Oct 04 19:32:27.165474 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3991/7976] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:32:27 2022] POST /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action => generated 36682 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:32:27.177685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-21ee33c6-a10b-4928-b25c-ede417f92721 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:27.178317 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-21ee33c6-a10b-4928-b25c-ede417f92721 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:27.185812 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21ee33c6-a10b-4928-b25c-ede417f92721 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:27.186321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21ee33c6-a10b-4928-b25c-ede417f92721 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:27.186782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21ee33c6-a10b-4928-b25c-ede417f92721 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.187529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21ee33c6-a10b-4928-b25c-ede417f92721 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:27.188013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21ee33c6-a10b-4928-b25c-ede417f92721 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:27.188469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-21ee33c6-a10b-4928-b25c-ede417f92721 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.262738 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-21ee33c6-a10b-4928-b25c-ede417f92721 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.088349 Oct 04 19:32:27.263709 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3986/7977] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:32:27 2022] POST /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:32:27.272929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c4846a69-af3b-4411-840c-1faa1fc689b6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:27.273796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c4846a69-af3b-4411-840c-1faa1fc689b6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:27.282510 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4846a69-af3b-4411-840c-1faa1fc689b6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:27.282778 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4846a69-af3b-4411-840c-1faa1fc689b6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:27.283216 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4846a69-af3b-4411-840c-1faa1fc689b6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.284250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4846a69-af3b-4411-840c-1faa1fc689b6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:27.284715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4846a69-af3b-4411-840c-1faa1fc689b6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:27.285147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c4846a69-af3b-4411-840c-1faa1fc689b6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.437985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c4846a69-af3b-4411-840c-1faa1fc689b6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:27.447477 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c4846a69-af3b-4411-840c-1faa1fc689b6 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1681 microversion: 2.1 time: 0.179478 Oct 04 19:32:27.448076 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3992/7978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:27 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:28.479493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7a588c5b-2aac-451b-a373-3eccabd02cc7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:28.480210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7a588c5b-2aac-451b-a373-3eccabd02cc7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:28.486821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a588c5b-2aac-451b-a373-3eccabd02cc7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:28.487364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a588c5b-2aac-451b-a373-3eccabd02cc7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:28.487852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a588c5b-2aac-451b-a373-3eccabd02cc7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:28.488579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a588c5b-2aac-451b-a373-3eccabd02cc7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:28.489059 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a588c5b-2aac-451b-a373-3eccabd02cc7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:28.489511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7a588c5b-2aac-451b-a373-3eccabd02cc7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:28.627957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7a588c5b-2aac-451b-a373-3eccabd02cc7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:28.636787 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7a588c5b-2aac-451b-a373-3eccabd02cc7 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1681 microversion: 2.1 time: 0.162524 Oct 04 19:32:28.637373 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3987/7979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:28 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:29.661499 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-afad1606-90c9-45eb-a5a0-69c6e0ee28c1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:29.662120 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-afad1606-90c9-45eb-a5a0-69c6e0ee28c1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:29.669446 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afad1606-90c9-45eb-a5a0-69c6e0ee28c1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:29.669938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afad1606-90c9-45eb-a5a0-69c6e0ee28c1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:29.670431 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afad1606-90c9-45eb-a5a0-69c6e0ee28c1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:29.671360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afad1606-90c9-45eb-a5a0-69c6e0ee28c1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:29.671825 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afad1606-90c9-45eb-a5a0-69c6e0ee28c1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:29.672257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-afad1606-90c9-45eb-a5a0-69c6e0ee28c1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:29.814144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-afad1606-90c9-45eb-a5a0-69c6e0ee28c1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:29.822076 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-afad1606-90c9-45eb-a5a0-69c6e0ee28c1 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1684 microversion: 2.1 time: 0.164665 Oct 04 19:32:29.822732 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3993/7980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:29 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:29.929748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ed887320-9859-4fed-9f0f-0df5a3003890 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:29.932123 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ed887320-9859-4fed-9f0f-0df5a3003890 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:29.940734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed887320-9859-4fed-9f0f-0df5a3003890 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:29.941197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed887320-9859-4fed-9f0f-0df5a3003890 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:29.941663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed887320-9859-4fed-9f0f-0df5a3003890 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:29.942381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed887320-9859-4fed-9f0f-0df5a3003890 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:29.942851 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed887320-9859-4fed-9f0f-0df5a3003890 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:29.943318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ed887320-9859-4fed-9f0f-0df5a3003890 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:30.011918 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ed887320-9859-4fed-9f0f-0df5a3003890 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "POST /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action" status: 200 len: 36682 microversion: 2.1 time: 0.085997 Oct 04 19:32:30.012580 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3988/7981] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:32:29 2022] POST /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc/action => generated 36682 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:32:31.035573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c55ad78-3103-4e55-b28d-7b6f97c500fe tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:31.036312 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c55ad78-3103-4e55-b28d-7b6f97c500fe tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:31.042947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-ce40d54b-e9c3-47f0-ba54-3cbeed1ca6f2 req-3845c164-1888-4c70-ad12-40855de56806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f795eb7-d5f8-4715-9bce-d67ee9e91cbc", "tag": "765d773a-6a4e-4125-80ac-a1ac04efbe0d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:31.043697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c55ad78-3103-4e55-b28d-7b6f97c500fe tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.044195 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c55ad78-3103-4e55-b28d-7b6f97c500fe tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.044635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c55ad78-3103-4e55-b28d-7b6f97c500fe tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.045341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c55ad78-3103-4e55-b28d-7b6f97c500fe tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.045795 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c55ad78-3103-4e55-b28d-7b6f97c500fe tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.046498 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c55ad78-3103-4e55-b28d-7b6f97c500fe tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.055010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ce40d54b-e9c3-47f0-ba54-3cbeed1ca6f2 req-3845c164-1888-4c70-ad12-40855de56806 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.055776 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ce40d54b-e9c3-47f0-ba54-3cbeed1ca6f2 req-3845c164-1888-4c70-ad12-40855de56806 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.056338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-ce40d54b-e9c3-47f0-ba54-3cbeed1ca6f2 req-3845c164-1888-4c70-ad12-40855de56806 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.068065 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-ce40d54b-e9c3-47f0-ba54-3cbeed1ca6f2 req-3845c164-1888-4c70-ad12-40855de56806 service nova] Creating event network-changed:765d773a-6a4e-4125-80ac-a1ac04efbe0d for instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc on n-h2-850499-14 Oct 04 19:32:31.073613 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-ce40d54b-e9c3-47f0-ba54-3cbeed1ca6f2 req-3845c164-1888-4c70-ad12-40855de56806 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035400 Oct 04 19:32:31.073834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c55ad78-3103-4e55-b28d-7b6f97c500fe tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:32:31.074824 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3989/7982] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:31.170008 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c55ad78-3103-4e55-b28d-7b6f97c500fe tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 204 len: 0 microversion: 2.1 time: 0.137796 Oct 04 19:32:31.171895 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3994/7983] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:32:31 2022] DELETE /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:32:31.181089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f6a43823-6de3-46e4-bc29-4b208cc18945 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:31.182150 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f6a43823-6de3-46e4-bc29-4b208cc18945 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:31.189186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a43823-6de3-46e4-bc29-4b208cc18945 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.189694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a43823-6de3-46e4-bc29-4b208cc18945 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.190374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a43823-6de3-46e4-bc29-4b208cc18945 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.191363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a43823-6de3-46e4-bc29-4b208cc18945 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.191845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a43823-6de3-46e4-bc29-4b208cc18945 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.192298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f6a43823-6de3-46e4-bc29-4b208cc18945 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.330009 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f6a43823-6de3-46e4-bc29-4b208cc18945 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:31.338720 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f6a43823-6de3-46e4-bc29-4b208cc18945 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1690 microversion: 2.1 time: 0.161905 Oct 04 19:32:31.339335 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3990/7984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:31 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:32:32.364927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2ac19ee0-e152-4a62-9d7f-52a2b73f2412 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:32.365529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2ac19ee0-e152-4a62-9d7f-52a2b73f2412 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:32.373189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac19ee0-e152-4a62-9d7f-52a2b73f2412 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:32.373686 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac19ee0-e152-4a62-9d7f-52a2b73f2412 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:32.374129 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac19ee0-e152-4a62-9d7f-52a2b73f2412 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:32.374831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac19ee0-e152-4a62-9d7f-52a2b73f2412 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:32.375464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac19ee0-e152-4a62-9d7f-52a2b73f2412 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:32.375934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2ac19ee0-e152-4a62-9d7f-52a2b73f2412 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:32.513962 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2ac19ee0-e152-4a62-9d7f-52a2b73f2412 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:32.524611 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2ac19ee0-e152-4a62-9d7f-52a2b73f2412 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1690 microversion: 2.1 time: 0.164545 Oct 04 19:32:32.525206 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3995/7985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:32 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:33.549452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-39b67ce4-2e78-4388-aaa4-18ecdb609e2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:33.550087 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-39b67ce4-2e78-4388-aaa4-18ecdb609e2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:33.557732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39b67ce4-2e78-4388-aaa4-18ecdb609e2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:33.558241 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39b67ce4-2e78-4388-aaa4-18ecdb609e2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:33.558697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39b67ce4-2e78-4388-aaa4-18ecdb609e2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:33.560190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39b67ce4-2e78-4388-aaa4-18ecdb609e2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:33.560674 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39b67ce4-2e78-4388-aaa4-18ecdb609e2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:33.561729 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-39b67ce4-2e78-4388-aaa4-18ecdb609e2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:33.786028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-39b67ce4-2e78-4388-aaa4-18ecdb609e2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a419fcbb7a4558add32361c96e387c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c351b5f6e644ae793a7cd81ce120f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:33.794184 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-39b67ce4-2e78-4388-aaa4-18ecdb609e2a tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 200 len: 1571 microversion: 2.1 time: 0.249072 Oct 04 19:32:33.794762 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3991/7986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:33 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 1571 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:33.821870 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-8e6062a6-07c5-4006-afb6-9f53d9aee289 req-d2b2ead2-5bcd-4e64-bc4a-f3618eafa3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f795eb7-d5f8-4715-9bce-d67ee9e91cbc", "name": "network-vif-deleted", "tag": "765d773a-6a4e-4125-80ac-a1ac04efbe0d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:33.837265 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8e6062a6-07c5-4006-afb6-9f53d9aee289 req-d2b2ead2-5bcd-4e64-bc4a-f3618eafa3b4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:33.837875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8e6062a6-07c5-4006-afb6-9f53d9aee289 req-d2b2ead2-5bcd-4e64-bc4a-f3618eafa3b4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:33.838339 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-8e6062a6-07c5-4006-afb6-9f53d9aee289 req-d2b2ead2-5bcd-4e64-bc4a-f3618eafa3b4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:33.853779 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-8e6062a6-07c5-4006-afb6-9f53d9aee289 req-d2b2ead2-5bcd-4e64-bc4a-f3618eafa3b4 service nova] Creating event network-vif-deleted:765d773a-6a4e-4125-80ac-a1ac04efbe0d for instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc on n-h2-850499-14 Oct 04 19:32:33.858749 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-8e6062a6-07c5-4006-afb6-9f53d9aee289 req-d2b2ead2-5bcd-4e64-bc4a-f3618eafa3b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040572 Oct 04 19:32:33.859395 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3996/7987] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:34.819301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:34.820566 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] [instance: 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:34.827344 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:34.827853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:34.828311 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:34.829025 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:34.829508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:34.829956 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:34.846138 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] HTTP exception thrown: Instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc could not be found. Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Request method failure captured: Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc HTTP/1.1 Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIeN8IpXRvunr76MaJcsy7gb5UP6P4wqRVf0JkFXuXKO2yf2pFEvJw8J88FNBXWWUdzOw2EIDCftvfvYY_kAe0UTJSv2yPFw5P2VL_L4-kqKLgsStF_OIK04o3eUaRuB3lR-bHSuVie82p8LaoF1Nxb20sOCbZAKQ5m9_sRAS24DjP0 Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 2c351b5f6e644ae793a7cd81ce120f12 Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c351b5f6e644ae793a7cd81ce120f12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2c351b5f6e644ae793a7cd81ce120f12"}]}] Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 2c351b5f6e644ae793a7cd81ce120f12 Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-773175457 Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestNetworkAdvancedServerOps-773175457-project Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 01a419fcbb7a4558add32361c96e387c Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestNetworkAdvancedServerOps-773175457-project Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc could not be found. Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '0f795eb7-d5f8-4715-9bce-d67ee9e91cbc'} Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc could not be found. Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc could not be found. Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:32:34.847840 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc could not be found. Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Returning 404 to user: Instance 0f795eb7-d5f8-4715-9bce-d67ee9e91cbc could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-462217e4-52ef-4115-83ee-6e6c69ca3df0 tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc" status: 404 len: 111 microversion: 2.1 time: 0.033913 Oct 04 19:32:34.853670 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3992/7988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:34 2022] GET /compute/v2.1/servers/0f795eb7-d5f8-4715-9bce-d67ee9e91cbc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:32:37.896197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9580c22-ba3d-4580-a5e6-a4b4e096178c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] Calling method '.version_select at 0x7fd4d0b1bd30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:37.923293 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9580c22-ba3d-4580-a5e6-a4b4e096178c tempest-TestNetworkAdvancedServerOps-773175457 tempest-TestNetworkAdvancedServerOps-773175457-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1747105220" status: 202 len: 0 microversion: 2.1 time: 0.035805 Oct 04 19:32:37.924270 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3997/7989] 10.222.0.18 () {58 vars in 1284 bytes} [Tue Oct 4 19:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1747105220 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:32:49.398339 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=18 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:49.399118 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:49.610445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3b2562e6-1cb4-4751-9575-cb5aa222bf82 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Action: 'create', calling method: .version_select at 0x7fd4d1c20670>, body: {"keypair": {"name": "tempest-TestShelveInstance-315913487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrrlCKeUFyw86T4pPSvUnRpalwg0TAZ8QukbpJQoM39C5LJDiA4Yt1BZ6L+WY+O1NsxnKt+sZyd4fS65FiM381+WrncNS7HaXWa4M66EJh2dcNTyMAaTTqEl7DmVtR+9w=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:49.626737 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3b2562e6-1cb4-4751-9575-cb5aa222bf82 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Getting quotas for project 798e3c2964f04344b4314468b70aeeba. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:32:49.632958 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-3b2562e6-1cb4-4751-9575-cb5aa222bf82 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Getting quotas for user 169ad294f3624feb8332b0d832f3c132 and project 798e3c2964f04344b4314468b70aeeba. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:32:49.659808 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3b2562e6-1cb4-4751-9575-cb5aa222bf82 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.267462 Oct 04 19:32:49.660414 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3993/7990] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:32:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:50.693152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:50.693896 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:50.698102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-239413263", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-315913487", "security_groups": [{"name": "tempest-secgroup-smoke-128668658"}], "networks": [{"uuid": "f708371d-af10-4643-9074-6fc94f97d4c4"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:50.933303 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] validate_networks() for [('f708371d-af10-4643-9074-6fc94f97d4c4', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:32:51.404715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:32:51.405318 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:32:51.405894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:32:51.406377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:32:51.407176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:32:51.416147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:51.416712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:51.417255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:51.418057 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:51.418578 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:51.419127 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:51.436829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Getting quotas for project 798e3c2964f04344b4314468b70aeeba. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:32:51.442475 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Getting quotas for user 169ad294f3624feb8332b0d832f3c132 and project 798e3c2964f04344b4314468b70aeeba. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:32:51.455791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:32:51.458193 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:32:51.507749 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3cc45712-f88e-44e4-8c17-fa8320fd430b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.816343 Oct 04 19:32:51.508400 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3998/7991] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:32:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:32:51.519783 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0fb018ed-6040-4bb5-9921-07efa9dffb07 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:51.520429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0fb018ed-6040-4bb5-9921-07efa9dffb07 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:51.645811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0fb018ed-6040-4bb5-9921-07efa9dffb07 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:51.653512 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0fb018ed-6040-4bb5-9921-07efa9dffb07 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1245 microversion: 2.1 time: 0.137642 Oct 04 19:32:51.654214 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3994/7992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:51 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1245 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:32:52.678117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c598ac84-f11a-47e3-863b-75bf7a9db059 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:52.679288 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c598ac84-f11a-47e3-863b-75bf7a9db059 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:52.687302 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c598ac84-f11a-47e3-863b-75bf7a9db059 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:52.687806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c598ac84-f11a-47e3-863b-75bf7a9db059 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:52.688257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c598ac84-f11a-47e3-863b-75bf7a9db059 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:52.689209 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c598ac84-f11a-47e3-863b-75bf7a9db059 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:52.689683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c598ac84-f11a-47e3-863b-75bf7a9db059 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:52.690118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c598ac84-f11a-47e3-863b-75bf7a9db059 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:52.760315 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c598ac84-f11a-47e3-863b-75bf7a9db059 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:52.768729 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c598ac84-f11a-47e3-863b-75bf7a9db059 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1297 microversion: 2.1 time: 0.095342 Oct 04 19:32:52.769347 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 3999/7993] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:52 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:53.794923 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5ba40068-2007-4b5d-aa4b-4208e91e405e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:53.795596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5ba40068-2007-4b5d-aa4b-4208e91e405e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:53.803584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ba40068-2007-4b5d-aa4b-4208e91e405e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:53.804033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ba40068-2007-4b5d-aa4b-4208e91e405e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:53.804496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ba40068-2007-4b5d-aa4b-4208e91e405e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:53.805224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ba40068-2007-4b5d-aa4b-4208e91e405e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:53.805922 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ba40068-2007-4b5d-aa4b-4208e91e405e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:53.806377 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5ba40068-2007-4b5d-aa4b-4208e91e405e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:54.021525 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5ba40068-2007-4b5d-aa4b-4208e91e405e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:54.031241 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5ba40068-2007-4b5d-aa4b-4208e91e405e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1370 microversion: 2.1 time: 0.241524 Oct 04 19:32:54.031947 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3995/7994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:53 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:54.314184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a0c8babb-75aa-446c-82c7-f24168810806 req-dd815566-536e-471b-933b-4ca0a025b075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103277ca-ad7d-4312-9fa5-51cbca0cb7ab", "tag": "1bab892e-c3fa-48d2-a47f-095e60eec7c2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:54.325810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a0c8babb-75aa-446c-82c7-f24168810806 req-dd815566-536e-471b-933b-4ca0a025b075 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:54.326428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a0c8babb-75aa-446c-82c7-f24168810806 req-dd815566-536e-471b-933b-4ca0a025b075 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:54.327477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a0c8babb-75aa-446c-82c7-f24168810806 req-dd815566-536e-471b-933b-4ca0a025b075 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:54.340119 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a0c8babb-75aa-446c-82c7-f24168810806 req-dd815566-536e-471b-933b-4ca0a025b075 service nova] Creating event network-changed:1bab892e-c3fa-48d2-a47f-095e60eec7c2 for instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab on n-h2-850499-14 Oct 04 19:32:54.345928 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a0c8babb-75aa-446c-82c7-f24168810806 req-dd815566-536e-471b-933b-4ca0a025b075 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035976 Oct 04 19:32:54.346809 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4000/7995] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:55.056628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-240a3006-a4e3-4261-85a9-1e86441b996d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:55.057257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-240a3006-a4e3-4261-85a9-1e86441b996d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:55.064405 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-240a3006-a4e3-4261-85a9-1e86441b996d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:55.064921 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-240a3006-a4e3-4261-85a9-1e86441b996d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:55.065374 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-240a3006-a4e3-4261-85a9-1e86441b996d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:55.066092 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-240a3006-a4e3-4261-85a9-1e86441b996d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:55.066591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-240a3006-a4e3-4261-85a9-1e86441b996d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:55.067060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-240a3006-a4e3-4261-85a9-1e86441b996d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:55.210584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-240a3006-a4e3-4261-85a9-1e86441b996d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:55.218614 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-240a3006-a4e3-4261-85a9-1e86441b996d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1370 microversion: 2.1 time: 0.166408 Oct 04 19:32:55.219228 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3996/7996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:55 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:56.242122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-63eb0ba4-e7fc-4c87-b20c-f5b4809c2fe8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:56.242782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-63eb0ba4-e7fc-4c87-b20c-f5b4809c2fe8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:56.249998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63eb0ba4-e7fc-4c87-b20c-f5b4809c2fe8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:56.250485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63eb0ba4-e7fc-4c87-b20c-f5b4809c2fe8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:56.250929 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63eb0ba4-e7fc-4c87-b20c-f5b4809c2fe8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:56.251640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63eb0ba4-e7fc-4c87-b20c-f5b4809c2fe8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:56.252094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63eb0ba4-e7fc-4c87-b20c-f5b4809c2fe8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:56.252521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-63eb0ba4-e7fc-4c87-b20c-f5b4809c2fe8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:56.385934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-63eb0ba4-e7fc-4c87-b20c-f5b4809c2fe8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:56.393731 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-63eb0ba4-e7fc-4c87-b20c-f5b4809c2fe8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1370 microversion: 2.1 time: 0.155909 Oct 04 19:32:56.394472 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4001/7997] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:56 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:57.417178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba3ad209-0514-417b-bac4-43d7e5a4e0e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:57.417820 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba3ad209-0514-417b-bac4-43d7e5a4e0e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:57.425080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba3ad209-0514-417b-bac4-43d7e5a4e0e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:57.425593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba3ad209-0514-417b-bac4-43d7e5a4e0e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:57.426057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba3ad209-0514-417b-bac4-43d7e5a4e0e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:57.426779 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba3ad209-0514-417b-bac4-43d7e5a4e0e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:57.427293 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba3ad209-0514-417b-bac4-43d7e5a4e0e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:57.427742 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba3ad209-0514-417b-bac4-43d7e5a4e0e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:57.633883 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ba3ad209-0514-417b-bac4-43d7e5a4e0e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:57.641679 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba3ad209-0514-417b-bac4-43d7e5a4e0e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1370 microversion: 2.1 time: 0.228454 Oct 04 19:32:57.642260 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3997/7998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:57 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:58.664845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-46be010b-0c75-45cb-ad34-ac13a7c7620b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:58.665492 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-46be010b-0c75-45cb-ad34-ac13a7c7620b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:58.673032 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46be010b-0c75-45cb-ad34-ac13a7c7620b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:58.673542 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46be010b-0c75-45cb-ad34-ac13a7c7620b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:58.673992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46be010b-0c75-45cb-ad34-ac13a7c7620b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:58.674709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46be010b-0c75-45cb-ad34-ac13a7c7620b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:58.675208 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46be010b-0c75-45cb-ad34-ac13a7c7620b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:58.675648 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46be010b-0c75-45cb-ad34-ac13a7c7620b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:58.808696 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-46be010b-0c75-45cb-ad34-ac13a7c7620b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:58.816452 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-46be010b-0c75-45cb-ad34-ac13a7c7620b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1370 microversion: 2.1 time: 0.156038 Oct 04 19:32:58.817020 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4002/7999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:58 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:59.840210 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8c1ddb3f-5490-4716-b79d-efa3eb470f45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:59.840845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8c1ddb3f-5490-4716-b79d-efa3eb470f45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:59.848109 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c1ddb3f-5490-4716-b79d-efa3eb470f45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:59.848720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c1ddb3f-5490-4716-b79d-efa3eb470f45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:59.849242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c1ddb3f-5490-4716-b79d-efa3eb470f45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:59.849962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c1ddb3f-5490-4716-b79d-efa3eb470f45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:59.850477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c1ddb3f-5490-4716-b79d-efa3eb470f45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:59.851006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8c1ddb3f-5490-4716-b79d-efa3eb470f45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:59.981287 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8c1ddb3f-5490-4716-b79d-efa3eb470f45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:59.989090 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8c1ddb3f-5490-4716-b79d-efa3eb470f45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1370 microversion: 2.1 time: 0.153145 Oct 04 19:32:59.989663 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3998/8000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:59 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:00.655290 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-807bac53-e604-4d98-9d64-615b470a4f5f req-f2c988d0-7d3c-477a-971d-e07bad0fcd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103277ca-ad7d-4312-9fa5-51cbca0cb7ab", "name": "network-vif-plugged", "status": "completed", "tag": "1bab892e-c3fa-48d2-a47f-095e60eec7c2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:00.665607 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-807bac53-e604-4d98-9d64-615b470a4f5f req-f2c988d0-7d3c-477a-971d-e07bad0fcd9a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:00.666101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-807bac53-e604-4d98-9d64-615b470a4f5f req-f2c988d0-7d3c-477a-971d-e07bad0fcd9a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:00.666573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-807bac53-e604-4d98-9d64-615b470a4f5f req-f2c988d0-7d3c-477a-971d-e07bad0fcd9a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:00.679098 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-807bac53-e604-4d98-9d64-615b470a4f5f req-f2c988d0-7d3c-477a-971d-e07bad0fcd9a service nova] Creating event network-vif-plugged:1bab892e-c3fa-48d2-a47f-095e60eec7c2 for instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab on n-h2-850499-14 Oct 04 19:33:00.684077 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-807bac53-e604-4d98-9d64-615b470a4f5f req-f2c988d0-7d3c-477a-971d-e07bad0fcd9a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032798 Oct 04 19:33:00.684709 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4003/8001] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:01.012850 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-986d9171-75ba-4709-85da-752225787bfa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:01.013488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-986d9171-75ba-4709-85da-752225787bfa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:01.020403 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-986d9171-75ba-4709-85da-752225787bfa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:01.020909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-986d9171-75ba-4709-85da-752225787bfa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:01.021368 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-986d9171-75ba-4709-85da-752225787bfa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:01.022088 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-986d9171-75ba-4709-85da-752225787bfa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:01.022560 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-986d9171-75ba-4709-85da-752225787bfa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:01.023031 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-986d9171-75ba-4709-85da-752225787bfa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:01.155740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-986d9171-75ba-4709-85da-752225787bfa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:01.163968 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-986d9171-75ba-4709-85da-752225787bfa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1370 microversion: 2.1 time: 0.155013 Oct 04 19:33:01.164534 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 3999/8002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:01 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:02.185089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:02.185860 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:02.190699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-21d461a3-a3dd-41c0-9a71-452ac7e3495c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:02.191429 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-21d461a3-a3dd-41c0-9a71-452ac7e3495c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:02.198481 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d461a3-a3dd-41c0-9a71-452ac7e3495c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:02.198982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d461a3-a3dd-41c0-9a71-452ac7e3495c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:02.199416 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d461a3-a3dd-41c0-9a71-452ac7e3495c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:02.200108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d461a3-a3dd-41c0-9a71-452ac7e3495c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:02.200561 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d461a3-a3dd-41c0-9a71-452ac7e3495c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:02.200987 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-21d461a3-a3dd-41c0-9a71-452ac7e3495c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:02.335943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-21d461a3-a3dd-41c0-9a71-452ac7e3495c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:02.343699 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-21d461a3-a3dd-41c0-9a71-452ac7e3495c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1370 microversion: 2.1 time: 0.159547 Oct 04 19:33:02.344274 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4004/8003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:02 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:03.367026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-366c661e-4277-46e4-80ba-766b4b1b9b3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:03.367664 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-366c661e-4277-46e4-80ba-766b4b1b9b3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:03.369558 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:03.375989 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-366c661e-4277-46e4-80ba-766b4b1b9b3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:03.376504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-366c661e-4277-46e4-80ba-766b4b1b9b3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:03.376963 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-366c661e-4277-46e4-80ba-766b4b1b9b3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:03.377687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-366c661e-4277-46e4-80ba-766b4b1b9b3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:03.378164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-366c661e-4277-46e4-80ba-766b4b1b9b3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:03.378617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-366c661e-4277-46e4-80ba-766b4b1b9b3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:03.516871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-366c661e-4277-46e4-80ba-766b4b1b9b3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:03.525530 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-366c661e-4277-46e4-80ba-766b4b1b9b3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1555 microversion: 2.1 time: 0.162538 Oct 04 19:33:03.526115 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4000/8004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:03 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:03.547938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-9c90818e-cadd-452b-ba4e-bc2d3854ced2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:03.548556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-9c90818e-cadd-452b-ba4e-bc2d3854ced2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:03.555441 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c90818e-cadd-452b-ba4e-bc2d3854ced2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:03.556041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c90818e-cadd-452b-ba4e-bc2d3854ced2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:03.556485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c90818e-cadd-452b-ba4e-bc2d3854ced2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:03.557190 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c90818e-cadd-452b-ba4e-bc2d3854ced2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:03.557643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c90818e-cadd-452b-ba4e-bc2d3854ced2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:03.558072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-9c90818e-cadd-452b-ba4e-bc2d3854ced2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:03.690477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-9c90818e-cadd-452b-ba4e-bc2d3854ced2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:03.698418 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-9c90818e-cadd-452b-ba4e-bc2d3854ced2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1555 microversion: 2.1 time: 0.154736 Oct 04 19:33:03.699018 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4005/8005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:03 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:05.647939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-2e3bfbd6-ae36-4fc7-9053-2b4e7fe30708 req-6a589b57-0ad0-490d-ae79-40455c1445e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103277ca-ad7d-4312-9fa5-51cbca0cb7ab", "tag": "1bab892e-c3fa-48d2-a47f-095e60eec7c2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:05.658641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2e3bfbd6-ae36-4fc7-9053-2b4e7fe30708 req-6a589b57-0ad0-490d-ae79-40455c1445e8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:05.659280 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2e3bfbd6-ae36-4fc7-9053-2b4e7fe30708 req-6a589b57-0ad0-490d-ae79-40455c1445e8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:05.659788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-2e3bfbd6-ae36-4fc7-9053-2b4e7fe30708 req-6a589b57-0ad0-490d-ae79-40455c1445e8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:05.672613 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-2e3bfbd6-ae36-4fc7-9053-2b4e7fe30708 req-6a589b57-0ad0-490d-ae79-40455c1445e8 service nova] Creating event network-changed:1bab892e-c3fa-48d2-a47f-095e60eec7c2 for instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab on n-h2-850499-14 Oct 04 19:33:05.677702 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-2e3bfbd6-ae36-4fc7-9053-2b4e7fe30708 req-6a589b57-0ad0-490d-ae79-40455c1445e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033540 Oct 04 19:33:05.678307 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4001/8006] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:42.629814 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:35:42.630687 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10ce8cfd-1d4b-4064-b672-e66ecfbcf18f] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:35:42.631244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:42.632009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=36 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:42.633081 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:35:42.633244 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab/action (ip 10.222.0.18) !!! Oct 04 19:35:42.635398 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:35:42.635529 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab/action (ip 10.222.0.18) !!! Oct 04 19:35:42.637293 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:35:42.637417 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab/action (ip 10.222.0.18) !!! Oct 04 19:35:42.642139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a4e2eb0c-737c-4d19-9822-20af27a64d4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:42.642669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a4e2eb0c-737c-4d19-9822-20af27a64d4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:42.659938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e2eb0c-737c-4d19-9822-20af27a64d4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:42.660428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e2eb0c-737c-4d19-9822-20af27a64d4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:42.660867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e2eb0c-737c-4d19-9822-20af27a64d4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:42.661573 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e2eb0c-737c-4d19-9822-20af27a64d4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:42.662065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e2eb0c-737c-4d19-9822-20af27a64d4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:42.662495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a4e2eb0c-737c-4d19-9822-20af27a64d4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:42.688517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-a4e2eb0c-737c-4d19-9822-20af27a64d4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lazy-loading 'flavor' on Instance uuid 103277ca-ad7d-4312-9fa5-51cbca0cb7ab {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:35:42.875465 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a4e2eb0c-737c-4d19-9822-20af27a64d4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "POST /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab/action" status: 202 len: 0 microversion: 2.1 time: 0.247145 Oct 04 19:35:42.876150 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4006/8007] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:35:42 2022] POST /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:35:42.882685 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:35:42.883537 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:35:42.884156 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:42.884962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=38 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:42.886549 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:35:42.886750 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab (ip 10.222.0.18) !!! Oct 04 19:35:42.887758 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:35:42.887913 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab (ip 10.222.0.18) !!! Oct 04 19:35:42.888930 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:35:42.889058 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab (ip 10.222.0.18) !!! Oct 04 19:35:42.894299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-34975fb0-db96-46db-8fdb-7d8141f9437f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:42.895060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-34975fb0-db96-46db-8fdb-7d8141f9437f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:42.909962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34975fb0-db96-46db-8fdb-7d8141f9437f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:42.910476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34975fb0-db96-46db-8fdb-7d8141f9437f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:42.910931 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34975fb0-db96-46db-8fdb-7d8141f9437f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:42.911681 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34975fb0-db96-46db-8fdb-7d8141f9437f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:42.912151 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34975fb0-db96-46db-8fdb-7d8141f9437f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:42.912593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-34975fb0-db96-46db-8fdb-7d8141f9437f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:43.049308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-34975fb0-db96-46db-8fdb-7d8141f9437f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:43.057291 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-34975fb0-db96-46db-8fdb-7d8141f9437f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.176404 Oct 04 19:35:43.057910 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4002/8008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:42 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:44.083479 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f88376c6-9990-4efb-9655-7d00cfa78c19 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:44.084103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f88376c6-9990-4efb-9655-7d00cfa78c19 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:44.094396 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f88376c6-9990-4efb-9655-7d00cfa78c19 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:44.094897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f88376c6-9990-4efb-9655-7d00cfa78c19 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:44.095372 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f88376c6-9990-4efb-9655-7d00cfa78c19 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:44.096073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f88376c6-9990-4efb-9655-7d00cfa78c19 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:44.096529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f88376c6-9990-4efb-9655-7d00cfa78c19 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:44.096955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f88376c6-9990-4efb-9655-7d00cfa78c19 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:44.101161 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 50904. Oct 04 19:35:44.101858 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [10ce8cfd-1d4b-4064-b672-e66ecfbcf18f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 50906. Oct 04 19:35:44.235485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f88376c6-9990-4efb-9655-7d00cfa78c19 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:44.243387 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f88376c6-9990-4efb-9655-7d00cfa78c19 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.165525 Oct 04 19:35:44.243995 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4007/8009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:44 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:45.267385 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9d5692f1-7786-4e55-913f-9221c8a0c5f0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:45.268017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9d5692f1-7786-4e55-913f-9221c8a0c5f0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:45.280827 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 50910. Oct 04 19:35:45.282246 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d5692f1-7786-4e55-913f-9221c8a0c5f0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:45.282762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d5692f1-7786-4e55-913f-9221c8a0c5f0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:45.283248 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d5692f1-7786-4e55-913f-9221c8a0c5f0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:45.284002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d5692f1-7786-4e55-913f-9221c8a0c5f0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:45.284484 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d5692f1-7786-4e55-913f-9221c8a0c5f0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:45.285014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9d5692f1-7786-4e55-913f-9221c8a0c5f0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:45.303137 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 50912. Oct 04 19:35:45.427488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9d5692f1-7786-4e55-913f-9221c8a0c5f0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:45.436200 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9d5692f1-7786-4e55-913f-9221c8a0c5f0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.172738 Oct 04 19:35:45.436992 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4003/8010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:45 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:46.459673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-1371b618-eb41-4650-b6aa-ea8b8c4ca1e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:46.460292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-1371b618-eb41-4650-b6aa-ea8b8c4ca1e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:46.467174 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1371b618-eb41-4650-b6aa-ea8b8c4ca1e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:46.467668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1371b618-eb41-4650-b6aa-ea8b8c4ca1e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:46.468113 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1371b618-eb41-4650-b6aa-ea8b8c4ca1e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:46.468813 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1371b618-eb41-4650-b6aa-ea8b8c4ca1e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:46.469273 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1371b618-eb41-4650-b6aa-ea8b8c4ca1e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:46.469715 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-1371b618-eb41-4650-b6aa-ea8b8c4ca1e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:46.599964 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-1371b618-eb41-4650-b6aa-ea8b8c4ca1e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:46.608231 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-1371b618-eb41-4650-b6aa-ea8b8c4ca1e3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.152488 Oct 04 19:35:46.608797 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4008/8011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:46 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:47.632223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-916e9364-a6f7-4551-bfdf-cf89d5d476b4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:47.632970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-916e9364-a6f7-4551-bfdf-cf89d5d476b4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:47.642741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-916e9364-a6f7-4551-bfdf-cf89d5d476b4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:47.643271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-916e9364-a6f7-4551-bfdf-cf89d5d476b4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:47.643725 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-916e9364-a6f7-4551-bfdf-cf89d5d476b4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:47.644445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-916e9364-a6f7-4551-bfdf-cf89d5d476b4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:47.644915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-916e9364-a6f7-4551-bfdf-cf89d5d476b4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:47.645353 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-916e9364-a6f7-4551-bfdf-cf89d5d476b4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:47.787519 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-916e9364-a6f7-4551-bfdf-cf89d5d476b4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:47.796074 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-916e9364-a6f7-4551-bfdf-cf89d5d476b4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.167514 Oct 04 19:35:47.796676 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4004/8012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:47 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:48.820979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0ebd2746-63c2-4121-900b-f982aaed9485 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:48.821529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0ebd2746-63c2-4121-900b-f982aaed9485 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:48.828849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ebd2746-63c2-4121-900b-f982aaed9485 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:48.829333 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ebd2746-63c2-4121-900b-f982aaed9485 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:48.829773 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ebd2746-63c2-4121-900b-f982aaed9485 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:48.830456 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ebd2746-63c2-4121-900b-f982aaed9485 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:48.830911 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ebd2746-63c2-4121-900b-f982aaed9485 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:48.831362 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0ebd2746-63c2-4121-900b-f982aaed9485 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:48.962047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0ebd2746-63c2-4121-900b-f982aaed9485 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:48.970382 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0ebd2746-63c2-4121-900b-f982aaed9485 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.153551 Oct 04 19:35:48.970970 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4009/8013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:48 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:49.994024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b932e055-f123-47b9-91e9-979f65d3801d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:49.994663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b932e055-f123-47b9-91e9-979f65d3801d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:50.001862 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b932e055-f123-47b9-91e9-979f65d3801d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:50.002383 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b932e055-f123-47b9-91e9-979f65d3801d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:50.002847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b932e055-f123-47b9-91e9-979f65d3801d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:50.003606 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b932e055-f123-47b9-91e9-979f65d3801d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:50.004089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b932e055-f123-47b9-91e9-979f65d3801d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:50.004542 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b932e055-f123-47b9-91e9-979f65d3801d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:50.140668 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b932e055-f123-47b9-91e9-979f65d3801d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:50.148652 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b932e055-f123-47b9-91e9-979f65d3801d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.158547 Oct 04 19:35:50.149246 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4005/8014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:49 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:35:51.173069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c0982897-3be7-4aaa-a1e6-6b48840f929a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:51.173691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c0982897-3be7-4aaa-a1e6-6b48840f929a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:51.180712 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0982897-3be7-4aaa-a1e6-6b48840f929a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:51.181205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0982897-3be7-4aaa-a1e6-6b48840f929a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:51.181676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0982897-3be7-4aaa-a1e6-6b48840f929a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:51.183159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0982897-3be7-4aaa-a1e6-6b48840f929a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:51.183628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0982897-3be7-4aaa-a1e6-6b48840f929a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:51.184064 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c0982897-3be7-4aaa-a1e6-6b48840f929a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:51.316222 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c0982897-3be7-4aaa-a1e6-6b48840f929a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:51.324103 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c0982897-3be7-4aaa-a1e6-6b48840f929a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.155199 Oct 04 19:35:51.324678 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4010/8015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:51 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:52.347890 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0e633ab1-115d-48dc-9858-3f9ee3e70d74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:52.348516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0e633ab1-115d-48dc-9858-3f9ee3e70d74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:52.355536 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e633ab1-115d-48dc-9858-3f9ee3e70d74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:52.356033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e633ab1-115d-48dc-9858-3f9ee3e70d74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:52.356486 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e633ab1-115d-48dc-9858-3f9ee3e70d74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:52.357190 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e633ab1-115d-48dc-9858-3f9ee3e70d74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:52.357662 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e633ab1-115d-48dc-9858-3f9ee3e70d74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:52.358101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0e633ab1-115d-48dc-9858-3f9ee3e70d74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:52.492624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0e633ab1-115d-48dc-9858-3f9ee3e70d74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:52.500335 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0e633ab1-115d-48dc-9858-3f9ee3e70d74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.156360 Oct 04 19:35:52.500907 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4006/8016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:52 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:35:53.524202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2db01778-19ae-4a4a-9978-97f962666b28 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:53.524816 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2db01778-19ae-4a4a-9978-97f962666b28 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:53.532413 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2db01778-19ae-4a4a-9978-97f962666b28 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:53.532897 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2db01778-19ae-4a4a-9978-97f962666b28 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:53.533337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2db01778-19ae-4a4a-9978-97f962666b28 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:53.534024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2db01778-19ae-4a4a-9978-97f962666b28 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:53.534482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2db01778-19ae-4a4a-9978-97f962666b28 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:53.534907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2db01778-19ae-4a4a-9978-97f962666b28 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:53.667760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2db01778-19ae-4a4a-9978-97f962666b28 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:53.675716 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2db01778-19ae-4a4a-9978-97f962666b28 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.155414 Oct 04 19:35:53.676305 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4011/8017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:53 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:54.699819 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7aac2f6d-e32d-475f-82cf-c8aeb5fc56aa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:54.700382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7aac2f6d-e32d-475f-82cf-c8aeb5fc56aa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:54.707199 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7aac2f6d-e32d-475f-82cf-c8aeb5fc56aa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:54.707701 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7aac2f6d-e32d-475f-82cf-c8aeb5fc56aa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:54.708152 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7aac2f6d-e32d-475f-82cf-c8aeb5fc56aa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:54.708854 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7aac2f6d-e32d-475f-82cf-c8aeb5fc56aa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:54.709322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7aac2f6d-e32d-475f-82cf-c8aeb5fc56aa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:54.709758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7aac2f6d-e32d-475f-82cf-c8aeb5fc56aa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:54.844600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7aac2f6d-e32d-475f-82cf-c8aeb5fc56aa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:54.852284 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7aac2f6d-e32d-475f-82cf-c8aeb5fc56aa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1701 microversion: 2.1 time: 0.156558 Oct 04 19:35:54.852851 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4007/8018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:54 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:55.878314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b2d4c640-47e8-4f27-8a74-b123fd647ff9 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:55.878928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b2d4c640-47e8-4f27-8a74-b123fd647ff9 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:55.886128 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2d4c640-47e8-4f27-8a74-b123fd647ff9 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:55.886784 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2d4c640-47e8-4f27-8a74-b123fd647ff9 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:55.887271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2d4c640-47e8-4f27-8a74-b123fd647ff9 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:55.887985 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2d4c640-47e8-4f27-8a74-b123fd647ff9 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:55.888480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2d4c640-47e8-4f27-8a74-b123fd647ff9 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:55.888940 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b2d4c640-47e8-4f27-8a74-b123fd647ff9 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:56.023281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b2d4c640-47e8-4f27-8a74-b123fd647ff9 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:56.032707 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b2d4c640-47e8-4f27-8a74-b123fd647ff9 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1701 microversion: 2.1 time: 0.159888 Oct 04 19:35:56.033282 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4012/8019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:55 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:57.057827 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3a50bf78-9995-4492-a4f4-0dcc672adab7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:57.058452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3a50bf78-9995-4492-a4f4-0dcc672adab7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:57.065546 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a50bf78-9995-4492-a4f4-0dcc672adab7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:57.066047 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a50bf78-9995-4492-a4f4-0dcc672adab7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:57.066684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a50bf78-9995-4492-a4f4-0dcc672adab7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:57.067421 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a50bf78-9995-4492-a4f4-0dcc672adab7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:57.067897 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a50bf78-9995-4492-a4f4-0dcc672adab7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:57.068338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3a50bf78-9995-4492-a4f4-0dcc672adab7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:57.205343 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3a50bf78-9995-4492-a4f4-0dcc672adab7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:57.213255 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3a50bf78-9995-4492-a4f4-0dcc672adab7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1701 microversion: 2.1 time: 0.159808 Oct 04 19:35:57.213866 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4008/8020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:57 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:57.485237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-c23e3456-1d98-4cfc-a700-d1f62adc92ef req-daf24f35-3ac8-42a9-ab56-b81b4d342ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103277ca-ad7d-4312-9fa5-51cbca0cb7ab", "name": "network-vif-plugged", "status": "completed", "tag": "1bab892e-c3fa-48d2-a47f-095e60eec7c2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:57.497822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c23e3456-1d98-4cfc-a700-d1f62adc92ef req-daf24f35-3ac8-42a9-ab56-b81b4d342ae5 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:57.498320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c23e3456-1d98-4cfc-a700-d1f62adc92ef req-daf24f35-3ac8-42a9-ab56-b81b4d342ae5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:57.498763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-c23e3456-1d98-4cfc-a700-d1f62adc92ef req-daf24f35-3ac8-42a9-ab56-b81b4d342ae5 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:57.510029 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-c23e3456-1d98-4cfc-a700-d1f62adc92ef req-daf24f35-3ac8-42a9-ab56-b81b4d342ae5 service nova] Creating event network-vif-plugged:1bab892e-c3fa-48d2-a47f-095e60eec7c2 for instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab on n-h2-850499-14 Oct 04 19:35:57.515820 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-c23e3456-1d98-4cfc-a700-d1f62adc92ef req-daf24f35-3ac8-42a9-ab56-b81b4d342ae5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033943 Oct 04 19:35:57.516476 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4013/8021] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:58.237835 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5a704011-3c73-4f55-bcf3-aa42a20e661a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:58.238469 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5a704011-3c73-4f55-bcf3-aa42a20e661a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:58.245881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a704011-3c73-4f55-bcf3-aa42a20e661a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:58.246382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a704011-3c73-4f55-bcf3-aa42a20e661a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:58.246860 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a704011-3c73-4f55-bcf3-aa42a20e661a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:58.247593 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a704011-3c73-4f55-bcf3-aa42a20e661a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:58.248063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a704011-3c73-4f55-bcf3-aa42a20e661a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:58.248502 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5a704011-3c73-4f55-bcf3-aa42a20e661a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:58.377384 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5a704011-3c73-4f55-bcf3-aa42a20e661a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:58.385337 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5a704011-3c73-4f55-bcf3-aa42a20e661a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1701 microversion: 2.1 time: 0.151329 Oct 04 19:35:58.386372 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4009/8022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:58 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:59.409834 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0762e0a2-d1a0-4b1f-be26-edd2109644a6 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:59.410558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0762e0a2-d1a0-4b1f-be26-edd2109644a6 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:59.417677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0762e0a2-d1a0-4b1f-be26-edd2109644a6 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:59.418169 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0762e0a2-d1a0-4b1f-be26-edd2109644a6 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:59.418610 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0762e0a2-d1a0-4b1f-be26-edd2109644a6 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:59.419344 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0762e0a2-d1a0-4b1f-be26-edd2109644a6 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:59.420061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0762e0a2-d1a0-4b1f-be26-edd2109644a6 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:59.420484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0762e0a2-d1a0-4b1f-be26-edd2109644a6 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:59.560047 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0762e0a2-d1a0-4b1f-be26-edd2109644a6 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:59.567838 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0762e0a2-d1a0-4b1f-be26-edd2109644a6 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1701 microversion: 2.1 time: 0.162271 Oct 04 19:35:59.568406 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4014/8023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:59 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:00.592363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c11a37cf-e62b-4e48-8f0c-3544a2cdd926 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:00.592946 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c11a37cf-e62b-4e48-8f0c-3544a2cdd926 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:00.599800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11a37cf-e62b-4e48-8f0c-3544a2cdd926 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:00.600307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11a37cf-e62b-4e48-8f0c-3544a2cdd926 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:00.600947 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11a37cf-e62b-4e48-8f0c-3544a2cdd926 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:00.601797 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11a37cf-e62b-4e48-8f0c-3544a2cdd926 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:00.602279 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11a37cf-e62b-4e48-8f0c-3544a2cdd926 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:00.602730 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c11a37cf-e62b-4e48-8f0c-3544a2cdd926 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:00.744278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c11a37cf-e62b-4e48-8f0c-3544a2cdd926 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:00.766560 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c11a37cf-e62b-4e48-8f0c-3544a2cdd926 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1696 microversion: 2.1 time: 0.178451 Oct 04 19:36:00.768006 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4010/8024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:00 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:01.790406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-350f043e-a81f-4453-aa71-4073257e827d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:01.792187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-350f043e-a81f-4453-aa71-4073257e827d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:01.800635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-350f043e-a81f-4453-aa71-4073257e827d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:01.800635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-350f043e-a81f-4453-aa71-4073257e827d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:01.801051 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-350f043e-a81f-4453-aa71-4073257e827d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:01.802035 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-350f043e-a81f-4453-aa71-4073257e827d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:01.802737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-350f043e-a81f-4453-aa71-4073257e827d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:01.803427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-350f043e-a81f-4453-aa71-4073257e827d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:01.962133 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-350f043e-a81f-4453-aa71-4073257e827d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:01.971173 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-350f043e-a81f-4453-aa71-4073257e827d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1696 microversion: 2.1 time: 0.184754 Oct 04 19:36:01.972085 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4015/8025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:01 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:02.997676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4a2b82f3-762e-4a7b-a0a9-4754eb1cdead tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:02.998363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4a2b82f3-762e-4a7b-a0a9-4754eb1cdead tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:03.008520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a2b82f3-762e-4a7b-a0a9-4754eb1cdead tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:03.009705 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a2b82f3-762e-4a7b-a0a9-4754eb1cdead tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:03.010845 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a2b82f3-762e-4a7b-a0a9-4754eb1cdead tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:03.011636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a2b82f3-762e-4a7b-a0a9-4754eb1cdead tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:03.012127 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a2b82f3-762e-4a7b-a0a9-4754eb1cdead tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:03.012587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4a2b82f3-762e-4a7b-a0a9-4754eb1cdead tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:03.193822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4a2b82f3-762e-4a7b-a0a9-4754eb1cdead tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:03.204054 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4a2b82f3-762e-4a7b-a0a9-4754eb1cdead tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1696 microversion: 2.1 time: 0.211295 Oct 04 19:36:03.206115 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4011/8026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:02 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1696 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:04.229706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-33428ab0-d008-489e-9637-d3eb92bead74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:04.230708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-33428ab0-d008-489e-9637-d3eb92bead74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:04.237326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33428ab0-d008-489e-9637-d3eb92bead74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:04.237829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33428ab0-d008-489e-9637-d3eb92bead74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:04.238526 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33428ab0-d008-489e-9637-d3eb92bead74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:04.239775 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33428ab0-d008-489e-9637-d3eb92bead74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:04.240244 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33428ab0-d008-489e-9637-d3eb92bead74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:04.240913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-33428ab0-d008-489e-9637-d3eb92bead74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:04.389538 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-33428ab0-d008-489e-9637-d3eb92bead74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:04.402579 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-33428ab0-d008-489e-9637-d3eb92bead74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1696 microversion: 2.1 time: 0.177507 Oct 04 19:36:04.403209 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4016/8027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:04 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:05.427250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f4d1a599-312b-418a-ac9a-891157b8dc2d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:05.429582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f4d1a599-312b-418a-ac9a-891157b8dc2d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:05.439399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4d1a599-312b-418a-ac9a-891157b8dc2d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:05.440390 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4d1a599-312b-418a-ac9a-891157b8dc2d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:05.441078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4d1a599-312b-418a-ac9a-891157b8dc2d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:05.442289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4d1a599-312b-418a-ac9a-891157b8dc2d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:05.444122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4d1a599-312b-418a-ac9a-891157b8dc2d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:05.444555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f4d1a599-312b-418a-ac9a-891157b8dc2d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:05.638045 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f4d1a599-312b-418a-ac9a-891157b8dc2d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:05.648345 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f4d1a599-312b-418a-ac9a-891157b8dc2d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1696 microversion: 2.1 time: 0.225643 Oct 04 19:36:05.653631 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4012/8028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:05 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:06.674628 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6e0ffaf1-1664-408c-8b9a-356683b73b52 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:06.676184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6e0ffaf1-1664-408c-8b9a-356683b73b52 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:06.683391 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0ffaf1-1664-408c-8b9a-356683b73b52 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:06.683885 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0ffaf1-1664-408c-8b9a-356683b73b52 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:06.684635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0ffaf1-1664-408c-8b9a-356683b73b52 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:06.686562 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0ffaf1-1664-408c-8b9a-356683b73b52 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:06.687570 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0ffaf1-1664-408c-8b9a-356683b73b52 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:06.688342 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6e0ffaf1-1664-408c-8b9a-356683b73b52 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:06.845328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6e0ffaf1-1664-408c-8b9a-356683b73b52 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:06.853403 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6e0ffaf1-1664-408c-8b9a-356683b73b52 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1696 microversion: 2.1 time: 0.182623 Oct 04 19:36:06.854031 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4017/8029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:06 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:07.880792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0a24beeb-f039-4ca8-96aa-98cdfb7592ed tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:07.881477 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0a24beeb-f039-4ca8-96aa-98cdfb7592ed tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:07.893650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a24beeb-f039-4ca8-96aa-98cdfb7592ed tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:07.894146 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a24beeb-f039-4ca8-96aa-98cdfb7592ed tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:07.894598 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a24beeb-f039-4ca8-96aa-98cdfb7592ed tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:07.895363 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a24beeb-f039-4ca8-96aa-98cdfb7592ed tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:07.895833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a24beeb-f039-4ca8-96aa-98cdfb7592ed tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:07.896272 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0a24beeb-f039-4ca8-96aa-98cdfb7592ed tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:08.060768 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0a24beeb-f039-4ca8-96aa-98cdfb7592ed tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:08.071762 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0a24beeb-f039-4ca8-96aa-98cdfb7592ed tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1696 microversion: 2.1 time: 0.194806 Oct 04 19:36:08.073991 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4013/8030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:07 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:09.100352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cddfabb8-6fa1-4d16-a718-e3195742fc22 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:09.101086 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cddfabb8-6fa1-4d16-a718-e3195742fc22 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:09.108592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cddfabb8-6fa1-4d16-a718-e3195742fc22 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:09.109102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cddfabb8-6fa1-4d16-a718-e3195742fc22 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:09.109545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cddfabb8-6fa1-4d16-a718-e3195742fc22 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:09.110276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cddfabb8-6fa1-4d16-a718-e3195742fc22 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:09.110735 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cddfabb8-6fa1-4d16-a718-e3195742fc22 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:09.111210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cddfabb8-6fa1-4d16-a718-e3195742fc22 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:09.260901 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cddfabb8-6fa1-4d16-a718-e3195742fc22 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:09.268891 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cddfabb8-6fa1-4d16-a718-e3195742fc22 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1696 microversion: 2.1 time: 0.172604 Oct 04 19:36:09.269796 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4018/8031] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:09 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:10.296348 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-3ec0490d-d189-432b-8186-5034be249090 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:10.296991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-3ec0490d-d189-432b-8186-5034be249090 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:10.303990 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ec0490d-d189-432b-8186-5034be249090 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:10.304676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ec0490d-d189-432b-8186-5034be249090 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:10.305043 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ec0490d-d189-432b-8186-5034be249090 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:10.305803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ec0490d-d189-432b-8186-5034be249090 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:10.306288 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ec0490d-d189-432b-8186-5034be249090 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:10.306741 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-3ec0490d-d189-432b-8186-5034be249090 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:10.437178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-3ec0490d-d189-432b-8186-5034be249090 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:10.446395 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-3ec0490d-d189-432b-8186-5034be249090 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1696 microversion: 2.1 time: 0.154817 Oct 04 19:36:10.447477 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4014/8032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:10 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:11.470565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0d90a879-c514-4063-ad9e-e14a8a7c0bc7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:11.471210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0d90a879-c514-4063-ad9e-e14a8a7c0bc7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:11.478248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d90a879-c514-4063-ad9e-e14a8a7c0bc7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:11.479305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d90a879-c514-4063-ad9e-e14a8a7c0bc7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:11.479752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d90a879-c514-4063-ad9e-e14a8a7c0bc7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:11.480461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d90a879-c514-4063-ad9e-e14a8a7c0bc7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:11.480934 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d90a879-c514-4063-ad9e-e14a8a7c0bc7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:11.481419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0d90a879-c514-4063-ad9e-e14a8a7c0bc7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:11.617745 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0d90a879-c514-4063-ad9e-e14a8a7c0bc7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:11.627202 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0d90a879-c514-4063-ad9e-e14a8a7c0bc7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1678 microversion: 2.1 time: 0.160637 Oct 04 19:36:11.627807 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4019/8033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:11 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:12.651778 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ba55e825-2a6c-48f0-bebb-8ec918c48b11 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:12.652420 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ba55e825-2a6c-48f0-bebb-8ec918c48b11 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:12.659349 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba55e825-2a6c-48f0-bebb-8ec918c48b11 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:12.659861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba55e825-2a6c-48f0-bebb-8ec918c48b11 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:12.660327 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba55e825-2a6c-48f0-bebb-8ec918c48b11 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:12.661046 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba55e825-2a6c-48f0-bebb-8ec918c48b11 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:12.661563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba55e825-2a6c-48f0-bebb-8ec918c48b11 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:12.662017 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ba55e825-2a6c-48f0-bebb-8ec918c48b11 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:12.789649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ba55e825-2a6c-48f0-bebb-8ec918c48b11 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:12.798216 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ba55e825-2a6c-48f0-bebb-8ec918c48b11 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1678 microversion: 2.1 time: 0.150991 Oct 04 19:36:12.798802 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4015/8034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:12 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:13.821448 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d1fd12af-8bbc-4762-b4c4-ffce015297eb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:13.822106 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d1fd12af-8bbc-4762-b4c4-ffce015297eb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:13.824986 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=29 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:13.830294 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1fd12af-8bbc-4762-b4c4-ffce015297eb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:13.830791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1fd12af-8bbc-4762-b4c4-ffce015297eb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:13.831268 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1fd12af-8bbc-4762-b4c4-ffce015297eb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:13.831970 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1fd12af-8bbc-4762-b4c4-ffce015297eb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:13.832435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1fd12af-8bbc-4762-b4c4-ffce015297eb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:13.832873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d1fd12af-8bbc-4762-b4c4-ffce015297eb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:13.836988 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:13.968991 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d1fd12af-8bbc-4762-b4c4-ffce015297eb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:13.976810 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d1fd12af-8bbc-4762-b4c4-ffce015297eb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1621 microversion: 2.1 time: 0.159266 Oct 04 19:36:13.977403 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4020/8035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:13 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1621 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:14.000341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7846c8f3-9188-4a17-8be4-042474f32803 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:14.000962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7846c8f3-9188-4a17-8be4-042474f32803 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:14.003710 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=29 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:14.009076 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7846c8f3-9188-4a17-8be4-042474f32803 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:14.009612 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7846c8f3-9188-4a17-8be4-042474f32803 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:14.010065 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7846c8f3-9188-4a17-8be4-042474f32803 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:14.010777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7846c8f3-9188-4a17-8be4-042474f32803 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:14.011341 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7846c8f3-9188-4a17-8be4-042474f32803 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:14.011727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7846c8f3-9188-4a17-8be4-042474f32803 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:14.016261 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=85 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:14.098665 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7846c8f3-9188-4a17-8be4-042474f32803 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122331) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:36:14.165499 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7846c8f3-9188-4a17-8be4-042474f32803 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "POST /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab/action" status: 202 len: 0 microversion: 2.1 time: 0.168709 Oct 04 19:36:14.166905 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4016/8036] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:36:13 2022] POST /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:36:14.175009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-61a15cb1-c287-42c6-adf0-55b1f31dbdfc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:14.175626 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-61a15cb1-c287-42c6-adf0-55b1f31dbdfc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:14.181873 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61a15cb1-c287-42c6-adf0-55b1f31dbdfc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:14.182363 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61a15cb1-c287-42c6-adf0-55b1f31dbdfc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:14.183181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61a15cb1-c287-42c6-adf0-55b1f31dbdfc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:14.183786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61a15cb1-c287-42c6-adf0-55b1f31dbdfc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:14.184419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61a15cb1-c287-42c6-adf0-55b1f31dbdfc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:14.184931 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-61a15cb1-c287-42c6-adf0-55b1f31dbdfc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:14.329253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-61a15cb1-c287-42c6-adf0-55b1f31dbdfc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:14.342322 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-61a15cb1-c287-42c6-adf0-55b1f31dbdfc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1629 microversion: 2.1 time: 0.171041 Oct 04 19:36:14.342919 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4021/8037] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:14 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1629 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:15.366402 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f92c794-6e0b-424c-a044-dc6b653871df tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:15.367068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f92c794-6e0b-424c-a044-dc6b653871df tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:15.374034 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f92c794-6e0b-424c-a044-dc6b653871df tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:15.374547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f92c794-6e0b-424c-a044-dc6b653871df tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:15.375035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f92c794-6e0b-424c-a044-dc6b653871df tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:15.375760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f92c794-6e0b-424c-a044-dc6b653871df tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:15.376242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f92c794-6e0b-424c-a044-dc6b653871df tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:15.376690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f92c794-6e0b-424c-a044-dc6b653871df tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:15.545861 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f92c794-6e0b-424c-a044-dc6b653871df tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:15.554933 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f92c794-6e0b-424c-a044-dc6b653871df tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.192400 Oct 04 19:36:15.555507 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4017/8038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:15 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:15.632307 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-04d92ca4-404e-4309-a451-5866a7520f77 req-447f1918-7212-4d15-b5b0-6025848c76b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103277ca-ad7d-4312-9fa5-51cbca0cb7ab", "name": "network-vif-unplugged", "status": "completed", "tag": "1bab892e-c3fa-48d2-a47f-095e60eec7c2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:15.642087 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-04d92ca4-404e-4309-a451-5866a7520f77 req-447f1918-7212-4d15-b5b0-6025848c76b4 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:15.642579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-04d92ca4-404e-4309-a451-5866a7520f77 req-447f1918-7212-4d15-b5b0-6025848c76b4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:15.643124 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-04d92ca4-404e-4309-a451-5866a7520f77 req-447f1918-7212-4d15-b5b0-6025848c76b4 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:15.655114 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-04d92ca4-404e-4309-a451-5866a7520f77 req-447f1918-7212-4d15-b5b0-6025848c76b4 service nova] Creating event network-vif-unplugged:1bab892e-c3fa-48d2-a47f-095e60eec7c2 for instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab on n-h2-850499-14 Oct 04 19:36:15.660242 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-04d92ca4-404e-4309-a451-5866a7520f77 req-447f1918-7212-4d15-b5b0-6025848c76b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104815 Oct 04 19:36:15.660863 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4022/8039] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:36:16.580056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-520aca35-7597-44ae-a83d-0ddbe9666e90 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:16.580694 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-520aca35-7597-44ae-a83d-0ddbe9666e90 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:16.589211 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-520aca35-7597-44ae-a83d-0ddbe9666e90 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:16.589727 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-520aca35-7597-44ae-a83d-0ddbe9666e90 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:16.590187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-520aca35-7597-44ae-a83d-0ddbe9666e90 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:16.590916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-520aca35-7597-44ae-a83d-0ddbe9666e90 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:16.591446 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-520aca35-7597-44ae-a83d-0ddbe9666e90 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:16.591900 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-520aca35-7597-44ae-a83d-0ddbe9666e90 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:16.734892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-520aca35-7597-44ae-a83d-0ddbe9666e90 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:16.751792 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-520aca35-7597-44ae-a83d-0ddbe9666e90 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.175571 Oct 04 19:36:16.752393 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4018/8040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:16 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:17.781511 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-445cc4ba-314b-424c-90f9-55ad596bf7b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:17.782166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-445cc4ba-314b-424c-90f9-55ad596bf7b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:17.789726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-445cc4ba-314b-424c-90f9-55ad596bf7b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:17.790226 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-445cc4ba-314b-424c-90f9-55ad596bf7b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:17.791681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-445cc4ba-314b-424c-90f9-55ad596bf7b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:17.791681 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-445cc4ba-314b-424c-90f9-55ad596bf7b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:17.792325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-445cc4ba-314b-424c-90f9-55ad596bf7b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:17.792325 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-445cc4ba-314b-424c-90f9-55ad596bf7b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:17.957888 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-445cc4ba-314b-424c-90f9-55ad596bf7b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:17.969965 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-445cc4ba-314b-424c-90f9-55ad596bf7b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.193570 Oct 04 19:36:17.980407 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4023/8041] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:17 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:18.994372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-056901e7-34d3-4320-80b0-49eca0a5f177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:18.995687 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-056901e7-34d3-4320-80b0-49eca0a5f177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:19.003522 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056901e7-34d3-4320-80b0-49eca0a5f177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:19.004412 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056901e7-34d3-4320-80b0-49eca0a5f177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:19.005110 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056901e7-34d3-4320-80b0-49eca0a5f177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:19.006236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056901e7-34d3-4320-80b0-49eca0a5f177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:19.006977 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056901e7-34d3-4320-80b0-49eca0a5f177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:19.007651 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-056901e7-34d3-4320-80b0-49eca0a5f177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:19.181928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-056901e7-34d3-4320-80b0-49eca0a5f177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:19.191089 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-056901e7-34d3-4320-80b0-49eca0a5f177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.200628 Oct 04 19:36:19.191888 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4019/8042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:18 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:36:20.216282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-705061e9-0889-4870-b0d1-7ac95f49b6d4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:20.216895 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-705061e9-0889-4870-b0d1-7ac95f49b6d4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:20.223983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-705061e9-0889-4870-b0d1-7ac95f49b6d4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:20.224324 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-705061e9-0889-4870-b0d1-7ac95f49b6d4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:20.224762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-705061e9-0889-4870-b0d1-7ac95f49b6d4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:20.225466 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-705061e9-0889-4870-b0d1-7ac95f49b6d4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:20.225920 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-705061e9-0889-4870-b0d1-7ac95f49b6d4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:20.226345 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-705061e9-0889-4870-b0d1-7ac95f49b6d4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:20.384068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-705061e9-0889-4870-b0d1-7ac95f49b6d4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:20.393436 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-705061e9-0889-4870-b0d1-7ac95f49b6d4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.181205 Oct 04 19:36:20.394139 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4024/8043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:20 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:21.419347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-519e6bc4-527a-48c9-a175-f7c328468e33 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:21.421692 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-519e6bc4-527a-48c9-a175-f7c328468e33 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:21.428458 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519e6bc4-527a-48c9-a175-f7c328468e33 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:21.428962 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519e6bc4-527a-48c9-a175-f7c328468e33 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:21.429426 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519e6bc4-527a-48c9-a175-f7c328468e33 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:21.430164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519e6bc4-527a-48c9-a175-f7c328468e33 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:21.430652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519e6bc4-527a-48c9-a175-f7c328468e33 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:21.431164 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-519e6bc4-527a-48c9-a175-f7c328468e33 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:21.602985 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-519e6bc4-527a-48c9-a175-f7c328468e33 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:21.611747 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-519e6bc4-527a-48c9-a175-f7c328468e33 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.197637 Oct 04 19:36:21.612434 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4020/8044] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:21 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:22.639443 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ecf5621-ddbe-4e0c-9570-94a75b2dc75b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:22.640843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5ecf5621-ddbe-4e0c-9570-94a75b2dc75b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:22.649430 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecf5621-ddbe-4e0c-9570-94a75b2dc75b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:22.650984 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecf5621-ddbe-4e0c-9570-94a75b2dc75b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:22.652088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecf5621-ddbe-4e0c-9570-94a75b2dc75b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:22.653669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecf5621-ddbe-4e0c-9570-94a75b2dc75b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:22.654829 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecf5621-ddbe-4e0c-9570-94a75b2dc75b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:22.655864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5ecf5621-ddbe-4e0c-9570-94a75b2dc75b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:22.809674 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5ecf5621-ddbe-4e0c-9570-94a75b2dc75b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:22.818695 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ecf5621-ddbe-4e0c-9570-94a75b2dc75b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.184761 Oct 04 19:36:22.819700 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4025/8045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:22 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:23.845242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-044344f8-c426-458d-ae32-2bd5da792392 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:23.846619 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-044344f8-c426-458d-ae32-2bd5da792392 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:23.854499 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044344f8-c426-458d-ae32-2bd5da792392 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:23.855437 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044344f8-c426-458d-ae32-2bd5da792392 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:23.856196 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044344f8-c426-458d-ae32-2bd5da792392 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:23.857185 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044344f8-c426-458d-ae32-2bd5da792392 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:23.857998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044344f8-c426-458d-ae32-2bd5da792392 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:23.859026 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-044344f8-c426-458d-ae32-2bd5da792392 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:24.018186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-044344f8-c426-458d-ae32-2bd5da792392 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:24.026586 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-044344f8-c426-458d-ae32-2bd5da792392 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.186607 Oct 04 19:36:24.027195 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4021/8046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:23 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:25.051478 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c6db3a12-6674-41bf-9bc5-bc1c37649135 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:25.052142 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c6db3a12-6674-41bf-9bc5-bc1c37649135 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:25.059687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6db3a12-6674-41bf-9bc5-bc1c37649135 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:25.060173 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6db3a12-6674-41bf-9bc5-bc1c37649135 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:25.060613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6db3a12-6674-41bf-9bc5-bc1c37649135 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:25.061301 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6db3a12-6674-41bf-9bc5-bc1c37649135 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:25.061760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6db3a12-6674-41bf-9bc5-bc1c37649135 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:25.062184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6db3a12-6674-41bf-9bc5-bc1c37649135 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:25.194609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c6db3a12-6674-41bf-9bc5-bc1c37649135 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:25.202368 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c6db3a12-6674-41bf-9bc5-bc1c37649135 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.154775 Oct 04 19:36:25.202944 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4026/8047] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:25 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:26.225762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-af13551b-d5d5-4227-89a2-890b1288a513 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:26.226415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-af13551b-d5d5-4227-89a2-890b1288a513 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:26.234370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af13551b-d5d5-4227-89a2-890b1288a513 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:26.234882 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af13551b-d5d5-4227-89a2-890b1288a513 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:26.235372 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af13551b-d5d5-4227-89a2-890b1288a513 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:26.236093 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af13551b-d5d5-4227-89a2-890b1288a513 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:26.236564 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af13551b-d5d5-4227-89a2-890b1288a513 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:26.237005 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-af13551b-d5d5-4227-89a2-890b1288a513 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:26.374929 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-af13551b-d5d5-4227-89a2-890b1288a513 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:26.382885 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-af13551b-d5d5-4227-89a2-890b1288a513 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.161025 Oct 04 19:36:26.383495 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4022/8048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:26 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:27.406790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-80abb8d1-85e3-4d09-8dc0-497771313e79 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:27.407457 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-80abb8d1-85e3-4d09-8dc0-497771313e79 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:27.414336 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80abb8d1-85e3-4d09-8dc0-497771313e79 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:27.414833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80abb8d1-85e3-4d09-8dc0-497771313e79 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:27.415328 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80abb8d1-85e3-4d09-8dc0-497771313e79 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:27.416041 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80abb8d1-85e3-4d09-8dc0-497771313e79 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:27.416506 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80abb8d1-85e3-4d09-8dc0-497771313e79 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:27.416980 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-80abb8d1-85e3-4d09-8dc0-497771313e79 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:27.554801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-80abb8d1-85e3-4d09-8dc0-497771313e79 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:27.563335 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-80abb8d1-85e3-4d09-8dc0-497771313e79 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.160475 Oct 04 19:36:27.563921 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4027/8049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:27 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:36:28.588067 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9f8da8ab-6f49-4203-a220-f3b804adcef3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:28.588749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9f8da8ab-6f49-4203-a220-f3b804adcef3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:28.596445 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8da8ab-6f49-4203-a220-f3b804adcef3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:28.596954 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8da8ab-6f49-4203-a220-f3b804adcef3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:28.597414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8da8ab-6f49-4203-a220-f3b804adcef3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:28.598365 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8da8ab-6f49-4203-a220-f3b804adcef3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:28.598756 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8da8ab-6f49-4203-a220-f3b804adcef3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:28.599271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9f8da8ab-6f49-4203-a220-f3b804adcef3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:28.739739 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9f8da8ab-6f49-4203-a220-f3b804adcef3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:28.748401 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9f8da8ab-6f49-4203-a220-f3b804adcef3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.164824 Oct 04 19:36:28.748974 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4023/8050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:28 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:29.774566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-36008952-56c6-4bd0-b393-72093febdcba tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:29.775630 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-36008952-56c6-4bd0-b393-72093febdcba tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:29.786096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36008952-56c6-4bd0-b393-72093febdcba tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:29.786658 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36008952-56c6-4bd0-b393-72093febdcba tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:29.787360 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36008952-56c6-4bd0-b393-72093febdcba tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:29.788137 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36008952-56c6-4bd0-b393-72093febdcba tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:29.788597 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36008952-56c6-4bd0-b393-72093febdcba tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:29.789027 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-36008952-56c6-4bd0-b393-72093febdcba tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:29.927867 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-36008952-56c6-4bd0-b393-72093febdcba tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:29.936460 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-36008952-56c6-4bd0-b393-72093febdcba tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.169115 Oct 04 19:36:29.937038 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4028/8051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:29 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:30.960392 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b10cbd10-4cf5-4591-91a8-e2f627c247f2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:30.961016 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b10cbd10-4cf5-4591-91a8-e2f627c247f2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:30.968616 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b10cbd10-4cf5-4591-91a8-e2f627c247f2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:30.969122 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b10cbd10-4cf5-4591-91a8-e2f627c247f2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:30.969574 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b10cbd10-4cf5-4591-91a8-e2f627c247f2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:30.970295 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b10cbd10-4cf5-4591-91a8-e2f627c247f2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:30.970767 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b10cbd10-4cf5-4591-91a8-e2f627c247f2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:30.971237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b10cbd10-4cf5-4591-91a8-e2f627c247f2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:31.104670 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b10cbd10-4cf5-4591-91a8-e2f627c247f2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:31.112533 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b10cbd10-4cf5-4591-91a8-e2f627c247f2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.156017 Oct 04 19:36:31.113128 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4024/8052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:30 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:32.139442 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee24098d-a5c1-4a6a-bb61-4d2700cdc17e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:32.140001 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ee24098d-a5c1-4a6a-bb61-4d2700cdc17e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:32.147059 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee24098d-a5c1-4a6a-bb61-4d2700cdc17e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:32.147576 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee24098d-a5c1-4a6a-bb61-4d2700cdc17e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:32.148022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee24098d-a5c1-4a6a-bb61-4d2700cdc17e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:32.148734 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee24098d-a5c1-4a6a-bb61-4d2700cdc17e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:32.149189 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee24098d-a5c1-4a6a-bb61-4d2700cdc17e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:32.149611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee24098d-a5c1-4a6a-bb61-4d2700cdc17e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:32.288382 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ee24098d-a5c1-4a6a-bb61-4d2700cdc17e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:32.296548 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee24098d-a5c1-4a6a-bb61-4d2700cdc17e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.161551 Oct 04 19:36:32.297131 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4029/8053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:32 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:36:33.321154 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4f2df08e-94f9-4b6a-b724-58d9607ae38d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:33.321799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4f2df08e-94f9-4b6a-b724-58d9607ae38d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:33.328644 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f2df08e-94f9-4b6a-b724-58d9607ae38d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:33.329142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f2df08e-94f9-4b6a-b724-58d9607ae38d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:33.329595 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f2df08e-94f9-4b6a-b724-58d9607ae38d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:33.330308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f2df08e-94f9-4b6a-b724-58d9607ae38d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:33.330791 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f2df08e-94f9-4b6a-b724-58d9607ae38d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:33.331262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4f2df08e-94f9-4b6a-b724-58d9607ae38d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:33.466049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4f2df08e-94f9-4b6a-b724-58d9607ae38d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:33.475450 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4f2df08e-94f9-4b6a-b724-58d9607ae38d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.158986 Oct 04 19:36:33.476935 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4025/8054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:33 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:34.502815 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-79b6872d-df0e-4f4d-beb6-49cc1d605592 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:34.503445 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-79b6872d-df0e-4f4d-beb6-49cc1d605592 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:34.510435 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79b6872d-df0e-4f4d-beb6-49cc1d605592 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:34.510939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79b6872d-df0e-4f4d-beb6-49cc1d605592 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:34.511419 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79b6872d-df0e-4f4d-beb6-49cc1d605592 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:34.512135 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79b6872d-df0e-4f4d-beb6-49cc1d605592 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:34.512604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79b6872d-df0e-4f4d-beb6-49cc1d605592 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:34.513043 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-79b6872d-df0e-4f4d-beb6-49cc1d605592 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:34.652003 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-79b6872d-df0e-4f4d-beb6-49cc1d605592 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:34.660350 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-79b6872d-df0e-4f4d-beb6-49cc1d605592 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.162073 Oct 04 19:36:34.660943 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4030/8055] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:34 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:35.694676 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-dc174e7e-5c95-438c-88b4-e6c69d6a4866 req-f880097c-32c5-4543-a3bb-1468c1f27403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103277ca-ad7d-4312-9fa5-51cbca0cb7ab", "name": "network-vif-plugged", "status": "completed", "tag": "1bab892e-c3fa-48d2-a47f-095e60eec7c2"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:35.700165 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-40aa62f5-5726-47be-81e4-de3a9755161c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:35.703625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-40aa62f5-5726-47be-81e4-de3a9755161c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:35.717782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa62f5-5726-47be-81e4-de3a9755161c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:35.718289 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa62f5-5726-47be-81e4-de3a9755161c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:35.718749 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa62f5-5726-47be-81e4-de3a9755161c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:35.719495 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa62f5-5726-47be-81e4-de3a9755161c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:35.719968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa62f5-5726-47be-81e4-de3a9755161c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:35.720408 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-40aa62f5-5726-47be-81e4-de3a9755161c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:35.725094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dc174e7e-5c95-438c-88b4-e6c69d6a4866 req-f880097c-32c5-4543-a3bb-1468c1f27403 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:35.725799 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dc174e7e-5c95-438c-88b4-e6c69d6a4866 req-f880097c-32c5-4543-a3bb-1468c1f27403 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:35.726748 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dc174e7e-5c95-438c-88b4-e6c69d6a4866 req-f880097c-32c5-4543-a3bb-1468c1f27403 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:35.740882 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-dc174e7e-5c95-438c-88b4-e6c69d6a4866 req-f880097c-32c5-4543-a3bb-1468c1f27403 service nova] Creating event network-vif-plugged:1bab892e-c3fa-48d2-a47f-095e60eec7c2 for instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab on n-h2-850499-14 Oct 04 19:36:35.747335 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-dc174e7e-5c95-438c-88b4-e6c69d6a4866 req-f880097c-32c5-4543-a3bb-1468c1f27403 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056783 Oct 04 19:36:35.749279 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4031/8056] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:35.887103 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-40aa62f5-5726-47be-81e4-de3a9755161c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:35.898227 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-40aa62f5-5726-47be-81e4-de3a9755161c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.214985 Oct 04 19:36:35.899107 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4026/8057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:35 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:36.923889 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f28ca1f0-b859-4d28-9bf1-27563aa6bf78 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:36.924585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f28ca1f0-b859-4d28-9bf1-27563aa6bf78 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:36.931659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f28ca1f0-b859-4d28-9bf1-27563aa6bf78 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:36.932151 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f28ca1f0-b859-4d28-9bf1-27563aa6bf78 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:36.932592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f28ca1f0-b859-4d28-9bf1-27563aa6bf78 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:36.933283 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f28ca1f0-b859-4d28-9bf1-27563aa6bf78 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:36.933738 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f28ca1f0-b859-4d28-9bf1-27563aa6bf78 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:36.934166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f28ca1f0-b859-4d28-9bf1-27563aa6bf78 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:37.084680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f28ca1f0-b859-4d28-9bf1-27563aa6bf78 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:37.093134 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f28ca1f0-b859-4d28-9bf1-27563aa6bf78 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1687 microversion: 2.1 time: 0.173893 Oct 04 19:36:37.093716 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4032/8058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:36 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:38.117487 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ec5a45e-bdd3-4df2-9766-6f15e6e515dc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:38.118543 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ec5a45e-bdd3-4df2-9766-6f15e6e515dc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:38.126239 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5a45e-bdd3-4df2-9766-6f15e6e515dc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:38.126760 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5a45e-bdd3-4df2-9766-6f15e6e515dc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:38.127245 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5a45e-bdd3-4df2-9766-6f15e6e515dc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:38.127972 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5a45e-bdd3-4df2-9766-6f15e6e515dc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:38.128449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5a45e-bdd3-4df2-9766-6f15e6e515dc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:38.128899 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ec5a45e-bdd3-4df2-9766-6f15e6e515dc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:38.262555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ec5a45e-bdd3-4df2-9766-6f15e6e515dc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:38.274987 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ec5a45e-bdd3-4df2-9766-6f15e6e515dc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1674 microversion: 2.1 time: 0.162167 Oct 04 19:36:38.275615 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4027/8059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:38 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:26.314089 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=25 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:26.315527 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=69 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:26.319532 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:26.320442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:26.322334 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c3d4567e-3e58-442e-8958-1378b0f424be tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:26.322847 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c3d4567e-3e58-442e-8958-1378b0f424be tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:26.331165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3d4567e-3e58-442e-8958-1378b0f424be tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:26.331801 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3d4567e-3e58-442e-8958-1378b0f424be tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:26.332262 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3d4567e-3e58-442e-8958-1378b0f424be tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.333828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3d4567e-3e58-442e-8958-1378b0f424be tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:26.334277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3d4567e-3e58-442e-8958-1378b0f424be tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:26.334719 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c3d4567e-3e58-442e-8958-1378b0f424be tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.366594 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c3d4567e-3e58-442e-8958-1378b0f424be tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:38:26.385916 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-f0279b63-4d4c-48cb-8063-dbbf3525cb94 req-f04ef455-ea67-4762-bbc3-4682e4063397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103277ca-ad7d-4312-9fa5-51cbca0cb7ab", "tag": "1bab892e-c3fa-48d2-a47f-095e60eec7c2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:26.396142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f0279b63-4d4c-48cb-8063-dbbf3525cb94 req-f04ef455-ea67-4762-bbc3-4682e4063397 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:26.396643 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f0279b63-4d4c-48cb-8063-dbbf3525cb94 req-f04ef455-ea67-4762-bbc3-4682e4063397 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:26.397085 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-f0279b63-4d4c-48cb-8063-dbbf3525cb94 req-f04ef455-ea67-4762-bbc3-4682e4063397 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.409347 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-f0279b63-4d4c-48cb-8063-dbbf3525cb94 req-f04ef455-ea67-4762-bbc3-4682e4063397 service nova] Creating event network-changed:1bab892e-c3fa-48d2-a47f-095e60eec7c2 for instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab on n-h2-850499-14 Oct 04 19:38:26.417122 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-f0279b63-4d4c-48cb-8063-dbbf3525cb94 req-f04ef455-ea67-4762-bbc3-4682e4063397 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101514 Oct 04 19:38:26.418866 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4028/8060] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:26.456064 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c3d4567e-3e58-442e-8958-1378b0f424be tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "DELETE /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 204 len: 0 microversion: 2.1 time: 0.143511 Oct 04 19:38:26.456064 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4033/8061] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:38:26 2022] DELETE /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:38:26.466721 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-638add22-9861-42a9-aee8-a8ffc4c6219e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:26.467537 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-638add22-9861-42a9-aee8-a8ffc4c6219e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:26.476214 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-638add22-9861-42a9-aee8-a8ffc4c6219e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:26.476805 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-638add22-9861-42a9-aee8-a8ffc4c6219e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:26.477698 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-638add22-9861-42a9-aee8-a8ffc4c6219e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.478572 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-638add22-9861-42a9-aee8-a8ffc4c6219e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:26.479113 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-638add22-9861-42a9-aee8-a8ffc4c6219e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:26.479562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-638add22-9861-42a9-aee8-a8ffc4c6219e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.667356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-638add22-9861-42a9-aee8-a8ffc4c6219e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:26.676470 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-638add22-9861-42a9-aee8-a8ffc4c6219e tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.214840 Oct 04 19:38:26.677056 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4029/8062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:26 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:27.701467 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bb2a6c6c-4c75-4f80-b9b9-53f260b0b6b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:27.702187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bb2a6c6c-4c75-4f80-b9b9-53f260b0b6b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:27.710096 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb2a6c6c-4c75-4f80-b9b9-53f260b0b6b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:27.710617 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb2a6c6c-4c75-4f80-b9b9-53f260b0b6b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:27.711102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb2a6c6c-4c75-4f80-b9b9-53f260b0b6b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:27.711810 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb2a6c6c-4c75-4f80-b9b9-53f260b0b6b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:27.712271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb2a6c6c-4c75-4f80-b9b9-53f260b0b6b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:27.712700 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bb2a6c6c-4c75-4f80-b9b9-53f260b0b6b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:27.981351 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bb2a6c6c-4c75-4f80-b9b9-53f260b0b6b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:27.989525 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bb2a6c6c-4c75-4f80-b9b9-53f260b0b6b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1680 microversion: 2.1 time: 0.292156 Oct 04 19:38:27.990353 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4034/8063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:27 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1680 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:29.013793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3aa687c6-0b01-452d-a559-1b958a932d34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:29.014577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3aa687c6-0b01-452d-a559-1b958a932d34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:29.022240 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aa687c6-0b01-452d-a559-1b958a932d34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:29.022905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aa687c6-0b01-452d-a559-1b958a932d34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:29.023494 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aa687c6-0b01-452d-a559-1b958a932d34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:29.024170 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aa687c6-0b01-452d-a559-1b958a932d34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:29.024666 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aa687c6-0b01-452d-a559-1b958a932d34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:29.025108 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3aa687c6-0b01-452d-a559-1b958a932d34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:29.052547 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-05121132-5832-45bf-854f-3409ebd21b8e req-43188ed4-2b2e-4b13-82f3-fd3f4f0ce92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103277ca-ad7d-4312-9fa5-51cbca0cb7ab", "name": "network-vif-deleted", "tag": "1bab892e-c3fa-48d2-a47f-095e60eec7c2"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:29.062800 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-05121132-5832-45bf-854f-3409ebd21b8e req-43188ed4-2b2e-4b13-82f3-fd3f4f0ce92a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:29.063745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-05121132-5832-45bf-854f-3409ebd21b8e req-43188ed4-2b2e-4b13-82f3-fd3f4f0ce92a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:29.064204 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-05121132-5832-45bf-854f-3409ebd21b8e req-43188ed4-2b2e-4b13-82f3-fd3f4f0ce92a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:29.076331 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-05121132-5832-45bf-854f-3409ebd21b8e req-43188ed4-2b2e-4b13-82f3-fd3f4f0ce92a service nova] Creating event network-vif-deleted:1bab892e-c3fa-48d2-a47f-095e60eec7c2 for instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab on n-h2-850499-14 Oct 04 19:38:29.081933 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-05121132-5832-45bf-854f-3409ebd21b8e req-43188ed4-2b2e-4b13-82f3-fd3f4f0ce92a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088512 Oct 04 19:38:29.082847 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4030/8064] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:29.100052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3aa687c6-0b01-452d-a559-1b958a932d34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:29.107943 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3aa687c6-0b01-452d-a559-1b958a932d34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 200 len: 1330 microversion: 2.1 time: 0.098238 Oct 04 19:38:29.108522 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4035/8065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:29 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:30.133604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:30.134251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 103277ca-ad7d-4312-9fa5-51cbca0cb7ab] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:30.140493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:30.141002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:30.141464 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:30.142186 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:30.142661 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:30.143133 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:30.156825 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] HTTP exception thrown: Instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab could not be found. Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Request method failure captured: Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab HTTP/1.1 Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIpcvlcmZWacPbZ4TXOwnGsyCv0S8msY2NHIjlbgMuq_VAnuiIv6ExHvdJwjRlfrpbgFymaZpw-yNOlZ5KTMGHDLMfec92E-G3G67DjeHZlJAjAG7cMw2AQPErZTomkigFylZmxhVQ-3ihmHMGsezTKe-9eoVcj4kCEYF7CGuN859ig Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 798e3c2964f04344b4314468b70aeeba Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestShelveInstance-354624551 Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_798e3c2964f04344b4314468b70aeeba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/798e3c2964f04344b4314468b70aeeba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/798e3c2964f04344b4314468b70aeeba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/798e3c2964f04344b4314468b70aeeba"}]}] Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestShelveInstance-354624551 Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 798e3c2964f04344b4314468b70aeeba Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestShelveInstance-354624551 Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestShelveInstance-354624551-project Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 169ad294f3624feb8332b0d832f3c132 Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestShelveInstance-354624551-project Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab could not be found. Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '103277ca-ad7d-4312-9fa5-51cbca0cb7ab'} Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab could not be found. Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab could not be found. Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:38:30.158447 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:38:30.164097 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:38:30.164097 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:38:30.164097 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:38:30.164097 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:38:30.164097 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:38:30.164097 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab could not be found. Oct 04 19:38:30.164097 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:38:30.164097 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Returning 404 to user: Instance 103277ca-ad7d-4312-9fa5-51cbca0cb7ab could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:38:30.164097 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-e0b3cdce-43bd-482a-98df-18d9f9b6ff0c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab" status: 404 len: 111 microversion: 2.1 time: 0.032133 Oct 04 19:38:30.164097 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4031/8066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:30 2022] GET /compute/v2.1/servers/103277ca-ad7d-4312-9fa5-51cbca0cb7ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:38:30.317846 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5ba9630f-e773-4f30-bd52-48365d215177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '.version_select at 0x7fd4d11aa5e0>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:30.342496 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5ba9630f-e773-4f30-bd52-48365d215177 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-315913487" status: 202 len: 0 microversion: 2.1 time: 0.028807 Oct 04 19:38:30.344525 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4036/8067] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 19:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-315913487 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:38:30.366991 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b89beef5-121a-4965-9658-0a623fc06314 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Action: 'create', calling method: .version_select at 0x7fd4d2554790>, body: {"keypair": {"name": "tempest-TestShelveInstance-778039780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpBvFlPaNIZwOnh26Ve1Xt0hSpiAbt3EROI8OK+zPLFtYNMLX1+q9lgTjxNhC/xu7HdVrTCHZhMaQ+VfEKIUYb8uuEDgx+gBM6FkS2OfwXSW89YmeVkgdeb0nQpiBcC9Q=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:30.382771 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b89beef5-121a-4965-9658-0a623fc06314 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Getting quotas for project 798e3c2964f04344b4314468b70aeeba. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:38:30.391591 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-b89beef5-121a-4965-9658-0a623fc06314 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Getting quotas for user 169ad294f3624feb8332b0d832f3c132 and project 798e3c2964f04344b4314468b70aeeba. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:38:30.417104 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b89beef5-121a-4965-9658-0a623fc06314 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.054529 Oct 04 19:38:30.417892 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4032/8068] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:38:30 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:46.677917 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:46.678671 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:46.683624 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1654403842", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-778039780", "security_groups": [{"name": "tempest-secgroup-smoke-254682745"}], "networks": [{"uuid": "f708371d-af10-4643-9074-6fc94f97d4c4"}], "block_device_mapping_v2": [{"uuid": "c3d2c5fe-8186-4d67-a3a9-587aac63ef5a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:46.797794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] validate_networks() for [('f708371d-af10-4643-9074-6fc94f97d4c4', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:38:47.207460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:38:47.207884 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:38:47.208361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:38:47.208769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:38:47.209185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:38:47.217965 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:47.218447 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:47.220020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:47.220020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:47.220263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:47.220645 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:47.242317 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Getting quotas for project 798e3c2964f04344b4314468b70aeeba. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:38:47.247601 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Getting quotas for user 169ad294f3624feb8332b0d832f3c132 and project 798e3c2964f04344b4314468b70aeeba. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:38:47.305995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:38:47.308165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3d2c5fe-8186-4d67-a3a9-587aac63ef5a',volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:38:47.433819 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [341c30fe-1904-4db6-9d54-58a18f82dfd3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:38:48.442469 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [341c30fe-1904-4db6-9d54-58a18f82dfd3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51384. Oct 04 19:38:48.446693 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d82a9cfa-e56a-42a8-95f2-fb9646e3c306 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.770680 Oct 04 19:38:48.447394 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4037/8069] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:38:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:38:48.458745 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dc84f168-3edd-492b-96c2-d1578808bdce tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:48.459410 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dc84f168-3edd-492b-96c2-d1578808bdce tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:48.462444 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=12 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:48.463319 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=4 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:48.463855 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:48.519677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dc84f168-3edd-492b-96c2-d1578808bdce tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:48.527772 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dc84f168-3edd-492b-96c2-d1578808bdce tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1088 microversion: 2.1 time: 0.071786 Oct 04 19:38:48.535239 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4033/8070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:48 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:49.551053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-88c4816a-5f85-489a-b9d6-a71bac99ac74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:49.551603 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-88c4816a-5f85-489a-b9d6-a71bac99ac74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:49.566517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c4816a-5f85-489a-b9d6-a71bac99ac74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.567139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c4816a-5f85-489a-b9d6-a71bac99ac74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.567507 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c4816a-5f85-489a-b9d6-a71bac99ac74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.568223 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c4816a-5f85-489a-b9d6-a71bac99ac74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.568690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c4816a-5f85-489a-b9d6-a71bac99ac74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.569161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-88c4816a-5f85-489a-b9d6-a71bac99ac74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.642458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-88c4816a-5f85-489a-b9d6-a71bac99ac74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:49.652159 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-88c4816a-5f85-489a-b9d6-a71bac99ac74 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1194 microversion: 2.1 time: 0.106001 Oct 04 19:38:49.652823 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4038/8071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:49 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:50.676371 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-62f14989-3453-4a16-97e6-70b18917e88a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:50.676928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-62f14989-3453-4a16-97e6-70b18917e88a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:50.684917 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f14989-3453-4a16-97e6-70b18917e88a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:50.685548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f14989-3453-4a16-97e6-70b18917e88a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:50.686078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f14989-3453-4a16-97e6-70b18917e88a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:50.687010 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f14989-3453-4a16-97e6-70b18917e88a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:50.687575 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f14989-3453-4a16-97e6-70b18917e88a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:50.688099 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-62f14989-3453-4a16-97e6-70b18917e88a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:50.838857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-62f14989-3453-4a16-97e6-70b18917e88a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:50.846936 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-62f14989-3453-4a16-97e6-70b18917e88a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1271 microversion: 2.1 time: 0.174580 Oct 04 19:38:50.847944 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4034/8072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:50 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:51.020314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-2538c9fc-0170-48a1-b345-188109373b0e req-99634f83-3014-46b5-862a-aee84357ea26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "988c1eb2-44a4-43ae-8801-bcc10fac14aa", "tag": "8d2f65d7-9ac0-434f-9b37-a96b444a2451"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:51.032828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2538c9fc-0170-48a1-b345-188109373b0e req-99634f83-3014-46b5-862a-aee84357ea26 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:51.033543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2538c9fc-0170-48a1-b345-188109373b0e req-99634f83-3014-46b5-862a-aee84357ea26 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:51.034205 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-2538c9fc-0170-48a1-b345-188109373b0e req-99634f83-3014-46b5-862a-aee84357ea26 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:51.047243 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-2538c9fc-0170-48a1-b345-188109373b0e req-99634f83-3014-46b5-862a-aee84357ea26 service nova] Creating event network-changed:8d2f65d7-9ac0-434f-9b37-a96b444a2451 for instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa on n-h2-850499-14 Oct 04 19:38:51.052916 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-2538c9fc-0170-48a1-b345-188109373b0e req-99634f83-3014-46b5-862a-aee84357ea26 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037499 Oct 04 19:38:51.053607 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4039/8073] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:38:51.869969 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-44045baf-36dc-4584-a53f-bbb327245478 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:51.870689 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-44045baf-36dc-4584-a53f-bbb327245478 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:51.877655 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44045baf-36dc-4584-a53f-bbb327245478 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:51.878169 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44045baf-36dc-4584-a53f-bbb327245478 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:51.878627 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44045baf-36dc-4584-a53f-bbb327245478 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:51.879414 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44045baf-36dc-4584-a53f-bbb327245478 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:51.879892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44045baf-36dc-4584-a53f-bbb327245478 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:51.880336 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-44045baf-36dc-4584-a53f-bbb327245478 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:52.021183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-44045baf-36dc-4584-a53f-bbb327245478 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:52.029418 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-44045baf-36dc-4584-a53f-bbb327245478 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1271 microversion: 2.1 time: 0.163285 Oct 04 19:38:52.030125 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4035/8074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:51 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:53.055584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-947b1d5c-29ae-4803-8a21-10260e82b646 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:53.056282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-947b1d5c-29ae-4803-8a21-10260e82b646 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:53.062497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-947b1d5c-29ae-4803-8a21-10260e82b646 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:53.062993 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-947b1d5c-29ae-4803-8a21-10260e82b646 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:53.063432 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-947b1d5c-29ae-4803-8a21-10260e82b646 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:53.064122 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-947b1d5c-29ae-4803-8a21-10260e82b646 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:53.064577 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-947b1d5c-29ae-4803-8a21-10260e82b646 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:53.065005 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-947b1d5c-29ae-4803-8a21-10260e82b646 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:53.199228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-947b1d5c-29ae-4803-8a21-10260e82b646 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:53.207058 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-947b1d5c-29ae-4803-8a21-10260e82b646 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1271 microversion: 2.1 time: 0.157087 Oct 04 19:38:53.207642 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4040/8075] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:53 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:54.230996 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-adf0c39f-430d-4266-818f-3fa3cae3c203 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:54.231654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-adf0c39f-430d-4266-818f-3fa3cae3c203 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:54.239321 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adf0c39f-430d-4266-818f-3fa3cae3c203 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:54.239839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adf0c39f-430d-4266-818f-3fa3cae3c203 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:54.240307 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adf0c39f-430d-4266-818f-3fa3cae3c203 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:54.241022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adf0c39f-430d-4266-818f-3fa3cae3c203 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:54.241494 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adf0c39f-430d-4266-818f-3fa3cae3c203 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:54.241932 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-adf0c39f-430d-4266-818f-3fa3cae3c203 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:54.379346 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-adf0c39f-430d-4266-818f-3fa3cae3c203 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:54.387545 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-adf0c39f-430d-4266-818f-3fa3cae3c203 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1271 microversion: 2.1 time: 0.160460 Oct 04 19:38:54.388144 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4036/8076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:54 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:55.411180 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4fefd2dc-d8ca-413d-bf7c-76c60c947b45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:55.411845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4fefd2dc-d8ca-413d-bf7c-76c60c947b45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:55.418857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fefd2dc-d8ca-413d-bf7c-76c60c947b45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:55.419663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fefd2dc-d8ca-413d-bf7c-76c60c947b45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:55.420154 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fefd2dc-d8ca-413d-bf7c-76c60c947b45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:55.420880 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fefd2dc-d8ca-413d-bf7c-76c60c947b45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:55.421337 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fefd2dc-d8ca-413d-bf7c-76c60c947b45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:55.421916 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4fefd2dc-d8ca-413d-bf7c-76c60c947b45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:55.554894 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4fefd2dc-d8ca-413d-bf7c-76c60c947b45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:55.562601 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4fefd2dc-d8ca-413d-bf7c-76c60c947b45 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.155347 Oct 04 19:38:55.563189 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4041/8077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:55 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:56.586511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-6e5d3f0c-8b7e-4c86-a617-5a01cba472fd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:56.587184 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-6e5d3f0c-8b7e-4c86-a617-5a01cba472fd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:56.594166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5d3f0c-8b7e-4c86-a617-5a01cba472fd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:56.594677 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5d3f0c-8b7e-4c86-a617-5a01cba472fd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:56.595202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5d3f0c-8b7e-4c86-a617-5a01cba472fd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:56.595926 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5d3f0c-8b7e-4c86-a617-5a01cba472fd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:56.596407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5d3f0c-8b7e-4c86-a617-5a01cba472fd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:56.597584 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-6e5d3f0c-8b7e-4c86-a617-5a01cba472fd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:56.729607 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-6e5d3f0c-8b7e-4c86-a617-5a01cba472fd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:56.737466 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-6e5d3f0c-8b7e-4c86-a617-5a01cba472fd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.155118 Oct 04 19:38:56.738044 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4037/8078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:56 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:57.759754 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-46bb748a-5202-47bd-973a-8ec225ea7728 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:57.760304 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-46bb748a-5202-47bd-973a-8ec225ea7728 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:57.763061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:57.763926 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:57.770212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46bb748a-5202-47bd-973a-8ec225ea7728 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.770698 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46bb748a-5202-47bd-973a-8ec225ea7728 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.771165 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46bb748a-5202-47bd-973a-8ec225ea7728 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.771854 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46bb748a-5202-47bd-973a-8ec225ea7728 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:57.772310 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46bb748a-5202-47bd-973a-8ec225ea7728 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:57.772736 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-46bb748a-5202-47bd-973a-8ec225ea7728 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:57.902159 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-46bb748a-5202-47bd-973a-8ec225ea7728 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:57.910347 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-46bb748a-5202-47bd-973a-8ec225ea7728 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.154769 Oct 04 19:38:57.910913 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4042/8079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:57 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:58.933832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f20a9132-e599-4f65-bf5b-0dc14265ded5 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:58.934468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f20a9132-e599-4f65-bf5b-0dc14265ded5 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:58.937304 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:58.943750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20a9132-e599-4f65-bf5b-0dc14265ded5 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:58.944296 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20a9132-e599-4f65-bf5b-0dc14265ded5 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:58.944789 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20a9132-e599-4f65-bf5b-0dc14265ded5 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:58.945520 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20a9132-e599-4f65-bf5b-0dc14265ded5 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:58.946035 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20a9132-e599-4f65-bf5b-0dc14265ded5 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:58.946485 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f20a9132-e599-4f65-bf5b-0dc14265ded5 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:59.078939 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f20a9132-e599-4f65-bf5b-0dc14265ded5 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:59.086719 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f20a9132-e599-4f65-bf5b-0dc14265ded5 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.156840 Oct 04 19:38:59.087334 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4038/8080] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:58 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:39:00.110326 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c2214b9d-07d4-4716-b147-530d7de55c63 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:00.110946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c2214b9d-07d4-4716-b147-530d7de55c63 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:00.118399 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2214b9d-07d4-4716-b147-530d7de55c63 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:00.118886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2214b9d-07d4-4716-b147-530d7de55c63 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:00.119356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2214b9d-07d4-4716-b147-530d7de55c63 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:00.120046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2214b9d-07d4-4716-b147-530d7de55c63 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:00.120502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2214b9d-07d4-4716-b147-530d7de55c63 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:00.120933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c2214b9d-07d4-4716-b147-530d7de55c63 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:00.248484 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c2214b9d-07d4-4716-b147-530d7de55c63 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:00.256256 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c2214b9d-07d4-4716-b147-530d7de55c63 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.150055 Oct 04 19:39:00.256825 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4043/8081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:00 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:01.279570 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7c203eca-f53c-4ff6-aae6-69b68b11cde0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:01.280205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7c203eca-f53c-4ff6-aae6-69b68b11cde0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:01.287089 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c203eca-f53c-4ff6-aae6-69b68b11cde0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:01.287605 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c203eca-f53c-4ff6-aae6-69b68b11cde0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:01.288062 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c203eca-f53c-4ff6-aae6-69b68b11cde0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:01.288777 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c203eca-f53c-4ff6-aae6-69b68b11cde0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:01.289252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c203eca-f53c-4ff6-aae6-69b68b11cde0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:01.289699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7c203eca-f53c-4ff6-aae6-69b68b11cde0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:01.425734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7c203eca-f53c-4ff6-aae6-69b68b11cde0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:01.433500 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7c203eca-f53c-4ff6-aae6-69b68b11cde0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.157848 Oct 04 19:39:01.434084 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4039/8082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:01 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:02.455649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6b9ea8ec-5bf9-4f88-a8dd-4f0cf515ac09 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:02.456266 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6b9ea8ec-5bf9-4f88-a8dd-4f0cf515ac09 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:02.463176 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b9ea8ec-5bf9-4f88-a8dd-4f0cf515ac09 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:02.463663 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b9ea8ec-5bf9-4f88-a8dd-4f0cf515ac09 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:02.464107 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b9ea8ec-5bf9-4f88-a8dd-4f0cf515ac09 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:02.464794 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b9ea8ec-5bf9-4f88-a8dd-4f0cf515ac09 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:02.465250 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b9ea8ec-5bf9-4f88-a8dd-4f0cf515ac09 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:02.465677 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6b9ea8ec-5bf9-4f88-a8dd-4f0cf515ac09 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:02.598595 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6b9ea8ec-5bf9-4f88-a8dd-4f0cf515ac09 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:02.606604 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6b9ea8ec-5bf9-4f88-a8dd-4f0cf515ac09 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.154759 Oct 04 19:39:02.607239 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4044/8083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:02 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:03.630565 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-fa2b697a-5054-4a80-8361-6c064ef678bd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:03.631218 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-fa2b697a-5054-4a80-8361-6c064ef678bd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:03.638265 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa2b697a-5054-4a80-8361-6c064ef678bd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:03.638775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa2b697a-5054-4a80-8361-6c064ef678bd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:03.639260 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa2b697a-5054-4a80-8361-6c064ef678bd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:03.640052 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa2b697a-5054-4a80-8361-6c064ef678bd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:03.640580 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa2b697a-5054-4a80-8361-6c064ef678bd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:03.641057 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-fa2b697a-5054-4a80-8361-6c064ef678bd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:03.771308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-fa2b697a-5054-4a80-8361-6c064ef678bd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:03.779069 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-fa2b697a-5054-4a80-8361-6c064ef678bd tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.152989 Oct 04 19:39:03.779642 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4040/8084] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:03 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:04.802903 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-44bd0776-1c2a-4235-bef9-34220cd2b2d2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:04.803465 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-44bd0776-1c2a-4235-bef9-34220cd2b2d2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:04.810306 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44bd0776-1c2a-4235-bef9-34220cd2b2d2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:04.810790 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44bd0776-1c2a-4235-bef9-34220cd2b2d2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:04.811259 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44bd0776-1c2a-4235-bef9-34220cd2b2d2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:04.811951 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44bd0776-1c2a-4235-bef9-34220cd2b2d2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:04.812406 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44bd0776-1c2a-4235-bef9-34220cd2b2d2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:04.812828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-44bd0776-1c2a-4235-bef9-34220cd2b2d2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:04.945644 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-44bd0776-1c2a-4235-bef9-34220cd2b2d2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:04.953413 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-44bd0776-1c2a-4235-bef9-34220cd2b2d2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.155033 Oct 04 19:39:04.954004 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4045/8085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:04 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:05.976538 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-27774fe3-75c6-4dbf-98aa-9164c27684b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:05.977163 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-27774fe3-75c6-4dbf-98aa-9164c27684b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:05.984006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27774fe3-75c6-4dbf-98aa-9164c27684b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:05.984504 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27774fe3-75c6-4dbf-98aa-9164c27684b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:05.984949 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27774fe3-75c6-4dbf-98aa-9164c27684b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:05.985653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27774fe3-75c6-4dbf-98aa-9164c27684b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:05.986129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27774fe3-75c6-4dbf-98aa-9164c27684b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:05.986569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-27774fe3-75c6-4dbf-98aa-9164c27684b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:06.115278 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-27774fe3-75c6-4dbf-98aa-9164c27684b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:06.123061 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-27774fe3-75c6-4dbf-98aa-9164c27684b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.150494 Oct 04 19:39:06.123638 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4041/8086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:05 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:06.411898 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-a9d0ebcd-2712-4960-b0dd-fb15f0ff4adb req-e244dfad-e20e-4138-8762-4b80f97f109a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "988c1eb2-44a4-43ae-8801-bcc10fac14aa", "name": "network-vif-plugged", "status": "completed", "tag": "8d2f65d7-9ac0-434f-9b37-a96b444a2451"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:06.423206 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a9d0ebcd-2712-4960-b0dd-fb15f0ff4adb req-e244dfad-e20e-4138-8762-4b80f97f109a service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:06.423697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a9d0ebcd-2712-4960-b0dd-fb15f0ff4adb req-e244dfad-e20e-4138-8762-4b80f97f109a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:06.424147 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-a9d0ebcd-2712-4960-b0dd-fb15f0ff4adb req-e244dfad-e20e-4138-8762-4b80f97f109a service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:06.436130 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-a9d0ebcd-2712-4960-b0dd-fb15f0ff4adb req-e244dfad-e20e-4138-8762-4b80f97f109a service nova] Creating event network-vif-plugged:8d2f65d7-9ac0-434f-9b37-a96b444a2451 for instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa on n-h2-850499-14 Oct 04 19:39:06.442095 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-a9d0ebcd-2712-4960-b0dd-fb15f0ff4adb req-e244dfad-e20e-4138-8762-4b80f97f109a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 Oct 04 19:39:06.443202 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4046/8087] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:39:07.146825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-8ea05507-e9e4-49a9-b371-a3f5651e6ba0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:07.147529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-8ea05507-e9e4-49a9-b371-a3f5651e6ba0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:07.154481 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ea05507-e9e4-49a9-b371-a3f5651e6ba0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:07.155011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ea05507-e9e4-49a9-b371-a3f5651e6ba0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:07.155468 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ea05507-e9e4-49a9-b371-a3f5651e6ba0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:07.156183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ea05507-e9e4-49a9-b371-a3f5651e6ba0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:07.156654 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ea05507-e9e4-49a9-b371-a3f5651e6ba0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:07.157094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-8ea05507-e9e4-49a9-b371-a3f5651e6ba0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:07.289498 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-8ea05507-e9e4-49a9-b371-a3f5651e6ba0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:07.297575 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-8ea05507-e9e4-49a9-b371-a3f5651e6ba0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1259 microversion: 2.1 time: 0.155255 Oct 04 19:39:07.298157 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4042/8088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:07 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:08.321730 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c41a084d-5a66-4741-aaa6-14a54e632347 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:08.323104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c41a084d-5a66-4741-aaa6-14a54e632347 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:08.331817 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41a084d-5a66-4741-aaa6-14a54e632347 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:08.332321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41a084d-5a66-4741-aaa6-14a54e632347 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:08.332763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41a084d-5a66-4741-aaa6-14a54e632347 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:08.333503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41a084d-5a66-4741-aaa6-14a54e632347 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:08.333958 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41a084d-5a66-4741-aaa6-14a54e632347 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:08.334381 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c41a084d-5a66-4741-aaa6-14a54e632347 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:08.465691 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c41a084d-5a66-4741-aaa6-14a54e632347 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:08.474220 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c41a084d-5a66-4741-aaa6-14a54e632347 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1444 microversion: 2.1 time: 0.157708 Oct 04 19:39:08.474791 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4047/8089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:08 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:08.496178 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-0ac9d8e8-892c-4906-957e-80f8d238ebb1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:08.496815 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-0ac9d8e8-892c-4906-957e-80f8d238ebb1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:08.503720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac9d8e8-892c-4906-957e-80f8d238ebb1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:08.504231 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac9d8e8-892c-4906-957e-80f8d238ebb1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:08.504690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac9d8e8-892c-4906-957e-80f8d238ebb1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:08.505406 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac9d8e8-892c-4906-957e-80f8d238ebb1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:08.505884 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac9d8e8-892c-4906-957e-80f8d238ebb1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:08.506352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-0ac9d8e8-892c-4906-957e-80f8d238ebb1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:08.637957 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-0ac9d8e8-892c-4906-957e-80f8d238ebb1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:08.646278 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-0ac9d8e8-892c-4906-957e-80f8d238ebb1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1444 microversion: 2.1 time: 0.153957 Oct 04 19:39:08.646861 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4043/8090] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:08 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:10.590422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d82d6d6f-a4d4-41fa-bf54-cf1c0ac3bdd9 req-1d0b1fcb-e1be-411f-84d5-4b8a130b250e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "988c1eb2-44a4-43ae-8801-bcc10fac14aa", "tag": "8d2f65d7-9ac0-434f-9b37-a96b444a2451"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:10.600788 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d82d6d6f-a4d4-41fa-bf54-cf1c0ac3bdd9 req-1d0b1fcb-e1be-411f-84d5-4b8a130b250e service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:10.601361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d82d6d6f-a4d4-41fa-bf54-cf1c0ac3bdd9 req-1d0b1fcb-e1be-411f-84d5-4b8a130b250e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:10.601892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d82d6d6f-a4d4-41fa-bf54-cf1c0ac3bdd9 req-1d0b1fcb-e1be-411f-84d5-4b8a130b250e service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:10.613021 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d82d6d6f-a4d4-41fa-bf54-cf1c0ac3bdd9 req-1d0b1fcb-e1be-411f-84d5-4b8a130b250e service nova] Creating event network-changed:8d2f65d7-9ac0-434f-9b37-a96b444a2451 for instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa on n-h2-850499-14 Oct 04 19:39:10.618037 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d82d6d6f-a4d4-41fa-bf54-cf1c0ac3bdd9 req-1d0b1fcb-e1be-411f-84d5-4b8a130b250e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031482 Oct 04 19:39:10.619263 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4048/8091] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:07.689369 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:41:07.690209 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:41:07.691063 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=24 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:07.692128 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=60 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:07.693203 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:41:07.693381 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:41:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa/action (ip 10.222.0.18) !!! Oct 04 19:41:07.695365 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:41:07.695496 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:41:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa/action (ip 10.222.0.18) !!! Oct 04 19:41:07.697117 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:41:07.697260 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:41:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa/action (ip 10.222.0.18) !!! Oct 04 19:41:07.704596 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5e0af8bd-df99-481a-b1ff-dacbd523e228 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:07.705180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5e0af8bd-df99-481a-b1ff-dacbd523e228 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:07.718898 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e0af8bd-df99-481a-b1ff-dacbd523e228 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:07.719442 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e0af8bd-df99-481a-b1ff-dacbd523e228 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:07.719905 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e0af8bd-df99-481a-b1ff-dacbd523e228 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:07.720626 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e0af8bd-df99-481a-b1ff-dacbd523e228 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:07.721101 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e0af8bd-df99-481a-b1ff-dacbd523e228 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:07.721548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5e0af8bd-df99-481a-b1ff-dacbd523e228 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:07.746684 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.objects.instance [None req-5e0af8bd-df99-481a-b1ff-dacbd523e228 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lazy-loading 'flavor' on Instance uuid 988c1eb2-44a4-43ae-8801-bcc10fac14aa {{(pid=122331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:41:07.818142 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5e0af8bd-df99-481a-b1ff-dacbd523e228 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "POST /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa/action" status: 202 len: 0 microversion: 2.1 time: 0.130442 Oct 04 19:41:07.818751 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4044/8092] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:41:07 2022] POST /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:41:07.825309 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10ce8cfd-1d4b-4064-b672-e66ecfbcf18f] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:41:07.826119 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:41:07.826709 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:07.827480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=56 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:07.828840 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:41:07.828998 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:41:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa (ip 10.222.0.18) !!! Oct 04 19:41:07.835237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-0b0f18e5-c713-4ef6-aa42-eae90433613d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:07.835946 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-0b0f18e5-c713-4ef6-aa42-eae90433613d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:07.845935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b0f18e5-c713-4ef6-aa42-eae90433613d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:07.846426 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b0f18e5-c713-4ef6-aa42-eae90433613d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:07.846864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b0f18e5-c713-4ef6-aa42-eae90433613d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:07.847604 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b0f18e5-c713-4ef6-aa42-eae90433613d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:07.848061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b0f18e5-c713-4ef6-aa42-eae90433613d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:07.848493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-0b0f18e5-c713-4ef6-aa42-eae90433613d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:07.988436 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-0b0f18e5-c713-4ef6-aa42-eae90433613d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:07.996968 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-0b0f18e5-c713-4ef6-aa42-eae90433613d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.173569 Oct 04 19:41:07.997542 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4049/8093] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:07 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:09.026216 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-cb5a739b-0faa-4954-8010-cdfe3239b0b0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:09.026944 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-cb5a739b-0faa-4954-8010-cdfe3239b0b0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:09.035703 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5a739b-0faa-4954-8010-cdfe3239b0b0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:09.036233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5a739b-0faa-4954-8010-cdfe3239b0b0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:09.036683 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5a739b-0faa-4954-8010-cdfe3239b0b0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:09.037398 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5a739b-0faa-4954-8010-cdfe3239b0b0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:09.037865 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5a739b-0faa-4954-8010-cdfe3239b0b0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:09.038298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-cb5a739b-0faa-4954-8010-cdfe3239b0b0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:09.046728 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51502. Oct 04 19:41:09.047511 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51500. Oct 04 19:41:09.184018 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-cb5a739b-0faa-4954-8010-cdfe3239b0b0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:09.192011 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-cb5a739b-0faa-4954-8010-cdfe3239b0b0 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.174678 Oct 04 19:41:09.192609 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4045/8094] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:09 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:10.215955 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b3685a17-ca88-40ae-bf5d-aac7d4aa0d41 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:10.216505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b3685a17-ca88-40ae-bf5d-aac7d4aa0d41 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:10.231101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3685a17-ca88-40ae-bf5d-aac7d4aa0d41 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:10.231596 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3685a17-ca88-40ae-bf5d-aac7d4aa0d41 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:10.232040 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3685a17-ca88-40ae-bf5d-aac7d4aa0d41 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:10.232743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3685a17-ca88-40ae-bf5d-aac7d4aa0d41 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:10.233210 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3685a17-ca88-40ae-bf5d-aac7d4aa0d41 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:10.233643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b3685a17-ca88-40ae-bf5d-aac7d4aa0d41 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:10.236879 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [10ce8cfd-1d4b-4064-b672-e66ecfbcf18f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51506. Oct 04 19:41:10.243937 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51508. Oct 04 19:41:10.373887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b3685a17-ca88-40ae-bf5d-aac7d4aa0d41 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:10.381701 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b3685a17-ca88-40ae-bf5d-aac7d4aa0d41 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.169762 Oct 04 19:41:10.382272 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4050/8095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:10 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:11.404811 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-feccb3af-b2f3-43d0-b127-27b1461ca672 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:11.405474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-feccb3af-b2f3-43d0-b127-27b1461ca672 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:11.412345 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feccb3af-b2f3-43d0-b127-27b1461ca672 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:11.412852 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feccb3af-b2f3-43d0-b127-27b1461ca672 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:11.413308 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feccb3af-b2f3-43d0-b127-27b1461ca672 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:11.414024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feccb3af-b2f3-43d0-b127-27b1461ca672 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:11.414497 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feccb3af-b2f3-43d0-b127-27b1461ca672 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:11.414942 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-feccb3af-b2f3-43d0-b127-27b1461ca672 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:11.547138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-feccb3af-b2f3-43d0-b127-27b1461ca672 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:11.555079 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-feccb3af-b2f3-43d0-b127-27b1461ca672 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.154192 Oct 04 19:41:11.555661 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4046/8096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:11 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:12.578849 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-8bc66e29-c784-4daa-b624-7085db090efb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:12.579503 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-8bc66e29-c784-4daa-b624-7085db090efb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:12.586625 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bc66e29-c784-4daa-b624-7085db090efb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:12.586979 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bc66e29-c784-4daa-b624-7085db090efb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:12.587427 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bc66e29-c784-4daa-b624-7085db090efb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:12.588161 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bc66e29-c784-4daa-b624-7085db090efb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:12.588620 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bc66e29-c784-4daa-b624-7085db090efb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:12.589050 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-8bc66e29-c784-4daa-b624-7085db090efb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:12.728145 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-8bc66e29-c784-4daa-b624-7085db090efb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:12.736591 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-8bc66e29-c784-4daa-b624-7085db090efb tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.161765 Oct 04 19:41:12.737178 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4051/8097] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:12 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:13.760843 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-edfc0941-5758-41ef-9581-dbe5dceda5b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:13.761523 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-edfc0941-5758-41ef-9581-dbe5dceda5b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:13.768276 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfc0941-5758-41ef-9581-dbe5dceda5b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:13.768788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfc0941-5758-41ef-9581-dbe5dceda5b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:13.769250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfc0941-5758-41ef-9581-dbe5dceda5b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:13.769974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfc0941-5758-41ef-9581-dbe5dceda5b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:13.770452 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfc0941-5758-41ef-9581-dbe5dceda5b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:13.770902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-edfc0941-5758-41ef-9581-dbe5dceda5b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:13.900355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-edfc0941-5758-41ef-9581-dbe5dceda5b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:13.908131 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-edfc0941-5758-41ef-9581-dbe5dceda5b7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.152059 Oct 04 19:41:13.908707 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4047/8098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:13 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:14.932166 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7a2d81d8-41ce-41ef-b774-da8eb3a8e0bf tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:14.932755 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7a2d81d8-41ce-41ef-b774-da8eb3a8e0bf tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:14.939722 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a2d81d8-41ce-41ef-b774-da8eb3a8e0bf tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:14.940212 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a2d81d8-41ce-41ef-b774-da8eb3a8e0bf tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:14.940660 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a2d81d8-41ce-41ef-b774-da8eb3a8e0bf tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:14.941359 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a2d81d8-41ce-41ef-b774-da8eb3a8e0bf tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:14.941823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a2d81d8-41ce-41ef-b774-da8eb3a8e0bf tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:14.942249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7a2d81d8-41ce-41ef-b774-da8eb3a8e0bf tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:15.079565 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7a2d81d8-41ce-41ef-b774-da8eb3a8e0bf tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:15.087341 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7a2d81d8-41ce-41ef-b774-da8eb3a8e0bf tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.159070 Oct 04 19:41:15.088457 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4052/8099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:14 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:16.112285 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-dffcf448-03f0-410b-9ebd-45187fb600fa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:16.112919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-dffcf448-03f0-410b-9ebd-45187fb600fa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:16.119818 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dffcf448-03f0-410b-9ebd-45187fb600fa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:16.120553 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dffcf448-03f0-410b-9ebd-45187fb600fa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:16.120782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dffcf448-03f0-410b-9ebd-45187fb600fa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:16.121496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dffcf448-03f0-410b-9ebd-45187fb600fa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:16.121970 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dffcf448-03f0-410b-9ebd-45187fb600fa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:16.122415 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-dffcf448-03f0-410b-9ebd-45187fb600fa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:16.285892 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-dffcf448-03f0-410b-9ebd-45187fb600fa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:16.294366 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-dffcf448-03f0-410b-9ebd-45187fb600fa tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.185669 Oct 04 19:41:16.294932 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4048/8100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:16 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:41:17.319535 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bd8fd943-c5c0-4313-90b8-bcc13351524f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:17.320136 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bd8fd943-c5c0-4313-90b8-bcc13351524f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:17.327828 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd8fd943-c5c0-4313-90b8-bcc13351524f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:17.328320 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd8fd943-c5c0-4313-90b8-bcc13351524f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:17.328762 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd8fd943-c5c0-4313-90b8-bcc13351524f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:17.329464 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd8fd943-c5c0-4313-90b8-bcc13351524f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:17.329919 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd8fd943-c5c0-4313-90b8-bcc13351524f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:17.330349 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bd8fd943-c5c0-4313-90b8-bcc13351524f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:17.462566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bd8fd943-c5c0-4313-90b8-bcc13351524f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:17.471346 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bd8fd943-c5c0-4313-90b8-bcc13351524f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.157425 Oct 04 19:41:17.471965 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4053/8101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:17 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:18.496313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-517f1f06-ad5f-49fa-85d8-53841233925b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:18.497023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-517f1f06-ad5f-49fa-85d8-53841233925b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:18.504130 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-517f1f06-ad5f-49fa-85d8-53841233925b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:18.504653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-517f1f06-ad5f-49fa-85d8-53841233925b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:18.505121 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-517f1f06-ad5f-49fa-85d8-53841233925b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:18.505853 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-517f1f06-ad5f-49fa-85d8-53841233925b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:18.506333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-517f1f06-ad5f-49fa-85d8-53841233925b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:18.506775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-517f1f06-ad5f-49fa-85d8-53841233925b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:18.651318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-517f1f06-ad5f-49fa-85d8-53841233925b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:18.659500 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-517f1f06-ad5f-49fa-85d8-53841233925b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.167602 Oct 04 19:41:18.660091 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4049/8102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:18 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:19.684073 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-de42ce04-9253-4f5e-94ad-9e72d96bcf23 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:19.684690 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-de42ce04-9253-4f5e-94ad-9e72d96bcf23 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:19.691857 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de42ce04-9253-4f5e-94ad-9e72d96bcf23 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:19.692352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de42ce04-9253-4f5e-94ad-9e72d96bcf23 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:19.692805 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de42ce04-9253-4f5e-94ad-9e72d96bcf23 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:19.693532 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de42ce04-9253-4f5e-94ad-9e72d96bcf23 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:19.693994 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de42ce04-9253-4f5e-94ad-9e72d96bcf23 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:19.694415 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-de42ce04-9253-4f5e-94ad-9e72d96bcf23 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:19.828486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-de42ce04-9253-4f5e-94ad-9e72d96bcf23 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:19.836841 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-de42ce04-9253-4f5e-94ad-9e72d96bcf23 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.157089 Oct 04 19:41:19.837534 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4054/8103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:19 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:20.861041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-22185e40-fd9b-4ee7-ba29-1c5c00fe2b49 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:20.861587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-22185e40-fd9b-4ee7-ba29-1c5c00fe2b49 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:20.868746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22185e40-fd9b-4ee7-ba29-1c5c00fe2b49 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:20.869262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22185e40-fd9b-4ee7-ba29-1c5c00fe2b49 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:20.870283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22185e40-fd9b-4ee7-ba29-1c5c00fe2b49 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:20.871037 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22185e40-fd9b-4ee7-ba29-1c5c00fe2b49 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:20.871524 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22185e40-fd9b-4ee7-ba29-1c5c00fe2b49 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:20.871974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-22185e40-fd9b-4ee7-ba29-1c5c00fe2b49 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:21.013195 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-22185e40-fd9b-4ee7-ba29-1c5c00fe2b49 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:21.021340 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-22185e40-fd9b-4ee7-ba29-1c5c00fe2b49 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.164294 Oct 04 19:41:21.021934 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4050/8104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:20 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:22.045313 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-b7a7e3f9-fae0-4c86-bbcd-e15f617431a3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:22.046117 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-b7a7e3f9-fae0-4c86-bbcd-e15f617431a3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:22.053331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a7e3f9-fae0-4c86-bbcd-e15f617431a3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:22.053824 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a7e3f9-fae0-4c86-bbcd-e15f617431a3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:22.054278 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a7e3f9-fae0-4c86-bbcd-e15f617431a3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:22.055007 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a7e3f9-fae0-4c86-bbcd-e15f617431a3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:22.055470 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a7e3f9-fae0-4c86-bbcd-e15f617431a3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:22.055918 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-b7a7e3f9-fae0-4c86-bbcd-e15f617431a3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:22.197966 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-b7a7e3f9-fae0-4c86-bbcd-e15f617431a3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:22.206745 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-b7a7e3f9-fae0-4c86-bbcd-e15f617431a3 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.165877 Oct 04 19:41:22.207360 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4055/8105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:22 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:23.092548 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-54145660-603c-4c79-8cd6-e68221a82e62 req-99308b7d-cbad-4d94-a6d0-07c529054b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "988c1eb2-44a4-43ae-8801-bcc10fac14aa", "name": "network-vif-unplugged", "status": "completed", "tag": "8d2f65d7-9ac0-434f-9b37-a96b444a2451"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:23.103331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-54145660-603c-4c79-8cd6-e68221a82e62 req-99308b7d-cbad-4d94-a6d0-07c529054b3b service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:23.103832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-54145660-603c-4c79-8cd6-e68221a82e62 req-99308b7d-cbad-4d94-a6d0-07c529054b3b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:23.104318 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-54145660-603c-4c79-8cd6-e68221a82e62 req-99308b7d-cbad-4d94-a6d0-07c529054b3b service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:23.118550 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.compute.server_external_events [req-54145660-603c-4c79-8cd6-e68221a82e62 req-99308b7d-cbad-4d94-a6d0-07c529054b3b service nova] Unable to find a host for instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa. Dropping event network-vif-unplugged {{(pid=122331) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 19:41:23.119498 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-54145660-603c-4c79-8cd6-e68221a82e62 req-99308b7d-cbad-4d94-a6d0-07c529054b3b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.119153 Oct 04 19:41:23.120657 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4051/8106] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 121 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 19:41:23.230347 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7ccf6274-fe0d-4f92-83fa-40e5d2167770 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:23.231052 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7ccf6274-fe0d-4f92-83fa-40e5d2167770 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:23.237899 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ccf6274-fe0d-4f92-83fa-40e5d2167770 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:23.238395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ccf6274-fe0d-4f92-83fa-40e5d2167770 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:23.238845 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ccf6274-fe0d-4f92-83fa-40e5d2167770 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:23.239580 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ccf6274-fe0d-4f92-83fa-40e5d2167770 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:23.240046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ccf6274-fe0d-4f92-83fa-40e5d2167770 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:23.240482 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7ccf6274-fe0d-4f92-83fa-40e5d2167770 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:23.372341 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-7ccf6274-fe0d-4f92-83fa-40e5d2167770 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:23.380583 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7ccf6274-fe0d-4f92-83fa-40e5d2167770 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1510 microversion: 2.1 time: 0.154700 Oct 04 19:41:23.381162 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4056/8107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:23 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:23.403638 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-92ed92c0-2238-4850-9f5c-f9c15eb8d84a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:23.404251 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-92ed92c0-2238-4850-9f5c-f9c15eb8d84a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:23.410183 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92ed92c0-2238-4850-9f5c-f9c15eb8d84a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:23.410680 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92ed92c0-2238-4850-9f5c-f9c15eb8d84a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:23.411162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92ed92c0-2238-4850-9f5c-f9c15eb8d84a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:23.411866 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92ed92c0-2238-4850-9f5c-f9c15eb8d84a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:23.412335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92ed92c0-2238-4850-9f5c-f9c15eb8d84a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:23.412772 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-92ed92c0-2238-4850-9f5c-f9c15eb8d84a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:23.443793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-92ed92c0-2238-4850-9f5c-f9c15eb8d84a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122331) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:41:23.513807 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-92ed92c0-2238-4850-9f5c-f9c15eb8d84a tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "POST /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa/action" status: 202 len: 0 microversion: 2.1 time: 0.113902 Oct 04 19:41:23.514346 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4052/8108] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:41:23 2022] POST /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:41:23.522973 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-2eab75dd-2cf6-4ab5-8746-852628b2178c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:23.523798 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-2eab75dd-2cf6-4ab5-8746-852628b2178c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:23.531054 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2eab75dd-2cf6-4ab5-8746-852628b2178c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:23.531555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2eab75dd-2cf6-4ab5-8746-852628b2178c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:23.532011 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2eab75dd-2cf6-4ab5-8746-852628b2178c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:23.532726 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2eab75dd-2cf6-4ab5-8746-852628b2178c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:23.533292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2eab75dd-2cf6-4ab5-8746-852628b2178c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:23.533767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-2eab75dd-2cf6-4ab5-8746-852628b2178c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:23.687514 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-2eab75dd-2cf6-4ab5-8746-852628b2178c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:23.696366 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-2eab75dd-2cf6-4ab5-8746-852628b2178c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1518 microversion: 2.1 time: 0.177545 Oct 04 19:41:23.696955 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4057/8109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:23 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:24.721512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-659b37aa-f16c-468c-a887-bffb42d032e7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:24.722262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-659b37aa-f16c-468c-a887-bffb42d032e7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:24.728634 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-659b37aa-f16c-468c-a887-bffb42d032e7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:24.730100 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-659b37aa-f16c-468c-a887-bffb42d032e7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:24.731022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-659b37aa-f16c-468c-a887-bffb42d032e7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:24.731829 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-659b37aa-f16c-468c-a887-bffb42d032e7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:24.732381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-659b37aa-f16c-468c-a887-bffb42d032e7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:24.732902 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-659b37aa-f16c-468c-a887-bffb42d032e7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:24.875508 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-659b37aa-f16c-468c-a887-bffb42d032e7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:24.884609 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-659b37aa-f16c-468c-a887-bffb42d032e7 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1520 microversion: 2.1 time: 0.167760 Oct 04 19:41:24.885987 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4053/8110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:24 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:25.910277 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6c4d5e9c-c2aa-4936-8831-804c0ade58f4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:25.910927 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6c4d5e9c-c2aa-4936-8831-804c0ade58f4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:25.918046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c4d5e9c-c2aa-4936-8831-804c0ade58f4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:25.918786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c4d5e9c-c2aa-4936-8831-804c0ade58f4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:25.919261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c4d5e9c-c2aa-4936-8831-804c0ade58f4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:25.919992 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c4d5e9c-c2aa-4936-8831-804c0ade58f4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:25.920453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c4d5e9c-c2aa-4936-8831-804c0ade58f4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:25.920887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6c4d5e9c-c2aa-4936-8831-804c0ade58f4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:26.061271 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6c4d5e9c-c2aa-4936-8831-804c0ade58f4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:26.069205 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6c4d5e9c-c2aa-4936-8831-804c0ade58f4 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1520 microversion: 2.1 time: 0.163101 Oct 04 19:41:26.069795 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4058/8111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:25 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:27.094129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a552c761-7b11-40ee-a800-f1e597963edc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:27.094758 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a552c761-7b11-40ee-a800-f1e597963edc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:27.101792 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a552c761-7b11-40ee-a800-f1e597963edc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:27.102298 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a552c761-7b11-40ee-a800-f1e597963edc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:27.102757 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a552c761-7b11-40ee-a800-f1e597963edc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:27.103501 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a552c761-7b11-40ee-a800-f1e597963edc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:27.104609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a552c761-7b11-40ee-a800-f1e597963edc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:27.105053 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a552c761-7b11-40ee-a800-f1e597963edc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:27.258078 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a552c761-7b11-40ee-a800-f1e597963edc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:27.267248 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a552c761-7b11-40ee-a800-f1e597963edc tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1520 microversion: 2.1 time: 0.176785 Oct 04 19:41:27.267777 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4054/8112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:27 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:28.291864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a7e8009a-2338-403c-ba99-e5713d54f275 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:28.292582 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a7e8009a-2338-403c-ba99-e5713d54f275 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:28.300034 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7e8009a-2338-403c-ba99-e5713d54f275 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:28.300521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7e8009a-2338-403c-ba99-e5713d54f275 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:28.300959 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7e8009a-2338-403c-ba99-e5713d54f275 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:28.301661 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7e8009a-2338-403c-ba99-e5713d54f275 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:28.302118 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7e8009a-2338-403c-ba99-e5713d54f275 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:28.302545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a7e8009a-2338-403c-ba99-e5713d54f275 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:28.440081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a7e8009a-2338-403c-ba99-e5713d54f275 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:28.451813 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a7e8009a-2338-403c-ba99-e5713d54f275 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1520 microversion: 2.1 time: 0.164504 Oct 04 19:41:28.452400 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4059/8113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:28 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:29.476213 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d32e774d-3ed7-4e48-ba56-3cd9b85a2e5c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:29.476839 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d32e774d-3ed7-4e48-ba56-3cd9b85a2e5c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:29.485399 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d32e774d-3ed7-4e48-ba56-3cd9b85a2e5c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:29.485909 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d32e774d-3ed7-4e48-ba56-3cd9b85a2e5c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:29.486364 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d32e774d-3ed7-4e48-ba56-3cd9b85a2e5c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:29.487219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d32e774d-3ed7-4e48-ba56-3cd9b85a2e5c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:29.487699 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d32e774d-3ed7-4e48-ba56-3cd9b85a2e5c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:29.488138 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d32e774d-3ed7-4e48-ba56-3cd9b85a2e5c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:29.648299 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d32e774d-3ed7-4e48-ba56-3cd9b85a2e5c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:29.658549 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d32e774d-3ed7-4e48-ba56-3cd9b85a2e5c tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.186107 Oct 04 19:41:29.659380 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4055/8114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:29 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:30.683461 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3a01cb24-a092-49af-a874-9f449b6bec97 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:30.684335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3a01cb24-a092-49af-a874-9f449b6bec97 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:30.691642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a01cb24-a092-49af-a874-9f449b6bec97 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.692031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a01cb24-a092-49af-a874-9f449b6bec97 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.692476 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a01cb24-a092-49af-a874-9f449b6bec97 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.693183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a01cb24-a092-49af-a874-9f449b6bec97 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.693642 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a01cb24-a092-49af-a874-9f449b6bec97 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.694707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3a01cb24-a092-49af-a874-9f449b6bec97 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.849020 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3a01cb24-a092-49af-a874-9f449b6bec97 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:30.857714 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3a01cb24-a092-49af-a874-9f449b6bec97 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.178814 Oct 04 19:41:30.858310 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4060/8115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:30 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:30.892157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-be2cbbe4-a6be-4bf1-a868-de554e05ba09 req-328c9490-0c5a-4b30-a1d6-892ccc36b4da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "988c1eb2-44a4-43ae-8801-bcc10fac14aa", "tag": "8d2f65d7-9ac0-434f-9b37-a96b444a2451"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:30.903208 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-be2cbbe4-a6be-4bf1-a868-de554e05ba09 req-328c9490-0c5a-4b30-a1d6-892ccc36b4da service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.903720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-be2cbbe4-a6be-4bf1-a868-de554e05ba09 req-328c9490-0c5a-4b30-a1d6-892ccc36b4da service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.904176 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-be2cbbe4-a6be-4bf1-a868-de554e05ba09 req-328c9490-0c5a-4b30-a1d6-892ccc36b4da service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.915896 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-be2cbbe4-a6be-4bf1-a868-de554e05ba09 req-328c9490-0c5a-4b30-a1d6-892ccc36b4da service nova] Creating event network-changed:8d2f65d7-9ac0-434f-9b37-a96b444a2451 for instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa on n-h1-850499-14 Oct 04 19:41:30.921479 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-be2cbbe4-a6be-4bf1-a868-de554e05ba09 req-328c9490-0c5a-4b30-a1d6-892ccc36b4da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033047 Oct 04 19:41:30.922154 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4056/8116] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:31.882123 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-cf758d83-df43-43cb-b681-f663cbba9ef2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:31.882673 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-cf758d83-df43-43cb-b681-f663cbba9ef2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:31.890611 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf758d83-df43-43cb-b681-f663cbba9ef2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:31.891263 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf758d83-df43-43cb-b681-f663cbba9ef2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:31.891708 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf758d83-df43-43cb-b681-f663cbba9ef2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:31.892414 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf758d83-df43-43cb-b681-f663cbba9ef2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:31.892869 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf758d83-df43-43cb-b681-f663cbba9ef2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:31.893292 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-cf758d83-df43-43cb-b681-f663cbba9ef2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:32.047072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-cf758d83-df43-43cb-b681-f663cbba9ef2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:32.055145 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-cf758d83-df43-43cb-b681-f663cbba9ef2 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.177037 Oct 04 19:41:32.072662 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4061/8117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:31 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:33.085724 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d73eeafd-9d5e-4fd9-b28f-8520ff81e038 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:33.086370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d73eeafd-9d5e-4fd9-b28f-8520ff81e038 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:33.092653 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73eeafd-9d5e-4fd9-b28f-8520ff81e038 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:33.093157 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73eeafd-9d5e-4fd9-b28f-8520ff81e038 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:33.093617 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73eeafd-9d5e-4fd9-b28f-8520ff81e038 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:33.094328 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73eeafd-9d5e-4fd9-b28f-8520ff81e038 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:33.094804 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73eeafd-9d5e-4fd9-b28f-8520ff81e038 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:33.095284 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d73eeafd-9d5e-4fd9-b28f-8520ff81e038 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:33.226652 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d73eeafd-9d5e-4fd9-b28f-8520ff81e038 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:33.234561 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d73eeafd-9d5e-4fd9-b28f-8520ff81e038 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.154004 Oct 04 19:41:33.235172 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4057/8118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:33 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:34.258539 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e910a81f-e72a-47c1-8985-172752170963 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:34.259182 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e910a81f-e72a-47c1-8985-172752170963 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:34.266806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e910a81f-e72a-47c1-8985-172752170963 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:34.267322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e910a81f-e72a-47c1-8985-172752170963 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:34.267761 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e910a81f-e72a-47c1-8985-172752170963 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:34.268454 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e910a81f-e72a-47c1-8985-172752170963 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:34.268905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e910a81f-e72a-47c1-8985-172752170963 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:34.269352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e910a81f-e72a-47c1-8985-172752170963 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:34.400248 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e910a81f-e72a-47c1-8985-172752170963 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:34.408084 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e910a81f-e72a-47c1-8985-172752170963 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.153424 Oct 04 19:41:34.408659 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4062/8119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:34 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:35.432306 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-7f892824-d618-452c-b7a0-016bf219ff3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:35.432693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-7f892824-d618-452c-b7a0-016bf219ff3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:35.440435 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f892824-d618-452c-b7a0-016bf219ff3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:35.440950 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f892824-d618-452c-b7a0-016bf219ff3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:35.442019 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f892824-d618-452c-b7a0-016bf219ff3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:35.442750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f892824-d618-452c-b7a0-016bf219ff3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:35.443247 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f892824-d618-452c-b7a0-016bf219ff3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:35.443690 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-7f892824-d618-452c-b7a0-016bf219ff3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:35.589217 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-7f892824-d618-452c-b7a0-016bf219ff3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:35.592867 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:35.599346 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-7f892824-d618-452c-b7a0-016bf219ff3d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.171441 Oct 04 19:41:35.599948 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4058/8120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:35 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:36.622469 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4596e0fe-a8bb-4fd2-abd0-3a489bc6838b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:36.623119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4596e0fe-a8bb-4fd2-abd0-3a489bc6838b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:36.629957 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4596e0fe-a8bb-4fd2-abd0-3a489bc6838b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:36.630444 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4596e0fe-a8bb-4fd2-abd0-3a489bc6838b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:36.630887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4596e0fe-a8bb-4fd2-abd0-3a489bc6838b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:36.631649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4596e0fe-a8bb-4fd2-abd0-3a489bc6838b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:36.632109 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4596e0fe-a8bb-4fd2-abd0-3a489bc6838b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:36.632543 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4596e0fe-a8bb-4fd2-abd0-3a489bc6838b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:36.763905 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4596e0fe-a8bb-4fd2-abd0-3a489bc6838b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:36.771659 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4596e0fe-a8bb-4fd2-abd0-3a489bc6838b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.153813 Oct 04 19:41:36.772243 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4063/8121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:36 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:37.795906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ebff8930-76a8-4323-bbb2-fd7f33420362 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:37.796488 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ebff8930-76a8-4323-bbb2-fd7f33420362 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:37.799242 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:37.806259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebff8930-76a8-4323-bbb2-fd7f33420362 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:37.806774 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebff8930-76a8-4323-bbb2-fd7f33420362 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:37.807267 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebff8930-76a8-4323-bbb2-fd7f33420362 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:37.807993 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebff8930-76a8-4323-bbb2-fd7f33420362 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:37.808470 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebff8930-76a8-4323-bbb2-fd7f33420362 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:37.808919 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ebff8930-76a8-4323-bbb2-fd7f33420362 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:37.941335 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ebff8930-76a8-4323-bbb2-fd7f33420362 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:37.949630 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ebff8930-76a8-4323-bbb2-fd7f33420362 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.158332 Oct 04 19:41:37.950210 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4059/8122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:37 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:38.973746 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a9a00f1e-7c7c-4e72-902a-aa07e7e7b72f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:38.974437 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-a9a00f1e-7c7c-4e72-902a-aa07e7e7b72f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:38.977144 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=31 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:38.983299 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a00f1e-7c7c-4e72-902a-aa07e7e7b72f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:38.983793 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a00f1e-7c7c-4e72-902a-aa07e7e7b72f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:38.984238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a00f1e-7c7c-4e72-902a-aa07e7e7b72f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:38.984977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a00f1e-7c7c-4e72-902a-aa07e7e7b72f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:38.985438 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a00f1e-7c7c-4e72-902a-aa07e7e7b72f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:38.985875 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-a9a00f1e-7c7c-4e72-902a-aa07e7e7b72f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:38.988497 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=91 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:39.117389 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-a9a00f1e-7c7c-4e72-902a-aa07e7e7b72f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:39.125257 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a9a00f1e-7c7c-4e72-902a-aa07e7e7b72f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.155683 Oct 04 19:41:39.125835 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4064/8123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:38 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:40.149014 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-692e307c-7b59-413a-83d8-e28b2745814f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:40.149636 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-692e307c-7b59-413a-83d8-e28b2745814f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:40.156628 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-692e307c-7b59-413a-83d8-e28b2745814f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:40.157134 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-692e307c-7b59-413a-83d8-e28b2745814f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:40.157588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-692e307c-7b59-413a-83d8-e28b2745814f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:40.158301 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-692e307c-7b59-413a-83d8-e28b2745814f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:40.159022 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-692e307c-7b59-413a-83d8-e28b2745814f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:40.159467 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-692e307c-7b59-413a-83d8-e28b2745814f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:40.291952 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-692e307c-7b59-413a-83d8-e28b2745814f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:40.300014 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-692e307c-7b59-413a-83d8-e28b2745814f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.155055 Oct 04 19:41:40.300577 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4060/8124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:40 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:41.309098 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-984444c6-d16b-49e8-8c8b-f55435f8d79e req-25c07ed4-184c-4be9-8b37-1bac3e60f075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "988c1eb2-44a4-43ae-8801-bcc10fac14aa", "name": "network-vif-plugged", "status": "completed", "tag": "8d2f65d7-9ac0-434f-9b37-a96b444a2451"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:41.323232 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d2b6b0d6-139f-4b01-b321-22d9a3e45b34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:41.323870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d2b6b0d6-139f-4b01-b321-22d9a3e45b34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:41.329643 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-984444c6-d16b-49e8-8c8b-f55435f8d79e req-25c07ed4-184c-4be9-8b37-1bac3e60f075 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:41.330139 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-984444c6-d16b-49e8-8c8b-f55435f8d79e req-25c07ed4-184c-4be9-8b37-1bac3e60f075 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:41.330584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-984444c6-d16b-49e8-8c8b-f55435f8d79e req-25c07ed4-184c-4be9-8b37-1bac3e60f075 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:41.337795 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2b6b0d6-139f-4b01-b321-22d9a3e45b34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:41.338785 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2b6b0d6-139f-4b01-b321-22d9a3e45b34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:41.339237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2b6b0d6-139f-4b01-b321-22d9a3e45b34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:41.339978 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2b6b0d6-139f-4b01-b321-22d9a3e45b34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:41.340461 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2b6b0d6-139f-4b01-b321-22d9a3e45b34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:41.340915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d2b6b0d6-139f-4b01-b321-22d9a3e45b34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:41.344829 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-984444c6-d16b-49e8-8c8b-f55435f8d79e req-25c07ed4-184c-4be9-8b37-1bac3e60f075 service nova] Creating event network-vif-plugged:8d2f65d7-9ac0-434f-9b37-a96b444a2451 for instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa on n-h1-850499-14 Oct 04 19:41:41.351493 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-984444c6-d16b-49e8-8c8b-f55435f8d79e req-25c07ed4-184c-4be9-8b37-1bac3e60f075 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046387 Oct 04 19:41:41.352321 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4065/8125] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:41.476332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d2b6b0d6-139f-4b01-b321-22d9a3e45b34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:41.485131 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d2b6b0d6-139f-4b01-b321-22d9a3e45b34 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.165754 Oct 04 19:41:41.485748 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4061/8126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:41 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:42.509420 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-02a9e2aa-be1c-47d4-abed-76cf0e867743 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:42.510121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-02a9e2aa-be1c-47d4-abed-76cf0e867743 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:42.516558 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02a9e2aa-be1c-47d4-abed-76cf0e867743 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:42.517049 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02a9e2aa-be1c-47d4-abed-76cf0e867743 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:42.517486 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02a9e2aa-be1c-47d4-abed-76cf0e867743 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:42.518181 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02a9e2aa-be1c-47d4-abed-76cf0e867743 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:42.518637 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02a9e2aa-be1c-47d4-abed-76cf0e867743 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:42.519088 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-02a9e2aa-be1c-47d4-abed-76cf0e867743 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:42.654820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-02a9e2aa-be1c-47d4-abed-76cf0e867743 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:42.663387 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-02a9e2aa-be1c-47d4-abed-76cf0e867743 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1576 microversion: 2.1 time: 0.158934 Oct 04 19:41:42.663979 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4066/8127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:42 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:41:43.688691 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-2ed8c1cf-6a92-4065-aead-5cc745251309 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:43.689257 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-2ed8c1cf-6a92-4065-aead-5cc745251309 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:43.696040 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed8c1cf-6a92-4065-aead-5cc745251309 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:43.696544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed8c1cf-6a92-4065-aead-5cc745251309 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:43.697305 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed8c1cf-6a92-4065-aead-5cc745251309 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:43.698400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed8c1cf-6a92-4065-aead-5cc745251309 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:43.698871 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed8c1cf-6a92-4065-aead-5cc745251309 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:43.699337 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-2ed8c1cf-6a92-4065-aead-5cc745251309 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:43.833608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-2ed8c1cf-6a92-4065-aead-5cc745251309 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:43.842188 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-2ed8c1cf-6a92-4065-aead-5cc745251309 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1563 microversion: 2.1 time: 0.157543 Oct 04 19:41:43.842779 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4062/8128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:43 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:57.589864 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=5 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:57.593937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=7 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:57.595108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=24 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:57.595704 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=13 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:57.599095 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:42:57.599807 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:42:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa (ip 10.222.0.18) !!! Oct 04 19:42:57.603006 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5ebf1937-487f-4dd7-bdc4-f384cec6593c req-c6466610-776b-4b17-8fd4-61615b52fbef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "988c1eb2-44a4-43ae-8801-bcc10fac14aa", "tag": "8d2f65d7-9ac0-434f-9b37-a96b444a2451"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:57.611682 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-65edb511-06a8-453b-930d-b2f9f7616e4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:57.612228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-65edb511-06a8-453b-930d-b2f9f7616e4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:57.623424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5ebf1937-487f-4dd7-bdc4-f384cec6593c req-c6466610-776b-4b17-8fd4-61615b52fbef service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:57.623953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5ebf1937-487f-4dd7-bdc4-f384cec6593c req-c6466610-776b-4b17-8fd4-61615b52fbef service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:57.624411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5ebf1937-487f-4dd7-bdc4-f384cec6593c req-c6466610-776b-4b17-8fd4-61615b52fbef service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:57.625521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65edb511-06a8-453b-930d-b2f9f7616e4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:57.626017 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65edb511-06a8-453b-930d-b2f9f7616e4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:57.626455 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65edb511-06a8-453b-930d-b2f9f7616e4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:57.627188 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65edb511-06a8-453b-930d-b2f9f7616e4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:57.627647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65edb511-06a8-453b-930d-b2f9f7616e4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:57.628074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-65edb511-06a8-453b-930d-b2f9f7616e4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:57.637063 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5ebf1937-487f-4dd7-bdc4-f384cec6593c req-c6466610-776b-4b17-8fd4-61615b52fbef service nova] Creating event network-changed:8d2f65d7-9ac0-434f-9b37-a96b444a2451 for instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa on n-h1-850499-14 Oct 04 19:42:57.642361 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5ebf1937-487f-4dd7-bdc4-f384cec6593c req-c6466610-776b-4b17-8fd4-61615b52fbef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050520 Oct 04 19:42:57.643207 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4063/8129] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:57.670483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-65edb511-06a8-453b-930d-b2f9f7616e4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:42:57.757618 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-65edb511-06a8-453b-930d-b2f9f7616e4d tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "DELETE /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 204 len: 0 microversion: 2.1 time: 0.169588 Oct 04 19:42:57.759456 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4067/8130] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:42:57 2022] DELETE /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:42:57.768108 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d5d870de-9e87-403d-a2b9-91c8ebb201e8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:57.769180 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d5d870de-9e87-403d-a2b9-91c8ebb201e8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:57.775624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d870de-9e87-403d-a2b9-91c8ebb201e8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:57.776271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d870de-9e87-403d-a2b9-91c8ebb201e8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:57.776959 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d870de-9e87-403d-a2b9-91c8ebb201e8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:57.777913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d870de-9e87-403d-a2b9-91c8ebb201e8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:57.778588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d870de-9e87-403d-a2b9-91c8ebb201e8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:57.779259 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d5d870de-9e87-403d-a2b9-91c8ebb201e8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:57.919983 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d5d870de-9e87-403d-a2b9-91c8ebb201e8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:57.928301 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d5d870de-9e87-403d-a2b9-91c8ebb201e8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.164376 Oct 04 19:42:57.928883 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4064/8131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:57 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:58.952395 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dce01bc1-dcbd-4754-8f17-f5ba3b3845b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:58.953513 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dce01bc1-dcbd-4754-8f17-f5ba3b3845b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:58.961706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dce01bc1-dcbd-4754-8f17-f5ba3b3845b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:58.962200 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dce01bc1-dcbd-4754-8f17-f5ba3b3845b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:58.962763 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dce01bc1-dcbd-4754-8f17-f5ba3b3845b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:58.963364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dce01bc1-dcbd-4754-8f17-f5ba3b3845b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:58.963823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dce01bc1-dcbd-4754-8f17-f5ba3b3845b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:58.964258 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dce01bc1-dcbd-4754-8f17-f5ba3b3845b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:59.101352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dce01bc1-dcbd-4754-8f17-f5ba3b3845b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:59.109682 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dce01bc1-dcbd-4754-8f17-f5ba3b3845b1 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1569 microversion: 2.1 time: 0.161562 Oct 04 19:42:59.110267 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4068/8132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:58 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:59.940906 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-991b79a2-d350-4a50-bc9f-5c5d27c881e3 req-b8c37001-d510-47cc-bcb1-f435c6321557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "988c1eb2-44a4-43ae-8801-bcc10fac14aa", "name": "network-vif-deleted", "tag": "8d2f65d7-9ac0-434f-9b37-a96b444a2451"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:59.951711 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-991b79a2-d350-4a50-bc9f-5c5d27c881e3 req-b8c37001-d510-47cc-bcb1-f435c6321557 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:59.952205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-991b79a2-d350-4a50-bc9f-5c5d27c881e3 req-b8c37001-d510-47cc-bcb1-f435c6321557 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:59.952647 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-991b79a2-d350-4a50-bc9f-5c5d27c881e3 req-b8c37001-d510-47cc-bcb1-f435c6321557 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:59.969780 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-991b79a2-d350-4a50-bc9f-5c5d27c881e3 req-b8c37001-d510-47cc-bcb1-f435c6321557 service nova] Creating event network-vif-deleted:8d2f65d7-9ac0-434f-9b37-a96b444a2451 for instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa on n-h1-850499-14 Oct 04 19:42:59.975321 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-991b79a2-d350-4a50-bc9f-5c5d27c881e3 req-b8c37001-d510-47cc-bcb1-f435c6321557 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038087 Oct 04 19:42:59.975938 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4065/8133] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:00.135718 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-96a9aeb0-9290-4a46-9854-e0ee150987c8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:00.136257 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-96a9aeb0-9290-4a46-9854-e0ee150987c8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:00.143356 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96a9aeb0-9290-4a46-9854-e0ee150987c8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:00.143887 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96a9aeb0-9290-4a46-9854-e0ee150987c8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:00.144314 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96a9aeb0-9290-4a46-9854-e0ee150987c8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:00.145012 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96a9aeb0-9290-4a46-9854-e0ee150987c8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:00.145477 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96a9aeb0-9290-4a46-9854-e0ee150987c8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:00.145909 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-96a9aeb0-9290-4a46-9854-e0ee150987c8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:00.214009 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-96a9aeb0-9290-4a46-9854-e0ee150987c8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:00.222581 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-96a9aeb0-9290-4a46-9854-e0ee150987c8 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1219 microversion: 2.1 time: 0.090879 Oct 04 19:43:00.223988 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4069/8134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:00 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:01.247679 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-9c6a4d96-9005-4e81-8c64-8961901ea869 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:01.248473 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-9c6a4d96-9005-4e81-8c64-8961901ea869 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:01.256471 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c6a4d96-9005-4e81-8c64-8961901ea869 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:01.257023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c6a4d96-9005-4e81-8c64-8961901ea869 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:01.257493 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c6a4d96-9005-4e81-8c64-8961901ea869 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:01.258258 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c6a4d96-9005-4e81-8c64-8961901ea869 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:01.258746 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c6a4d96-9005-4e81-8c64-8961901ea869 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:01.259237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-9c6a4d96-9005-4e81-8c64-8961901ea869 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:01.322534 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-9c6a4d96-9005-4e81-8c64-8961901ea869 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:01.330659 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-9c6a4d96-9005-4e81-8c64-8961901ea869 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1219 microversion: 2.1 time: 0.087441 Oct 04 19:43:01.331474 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4066/8135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:01 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:02.355053 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-678d2eb3-9287-45e8-9c58-e14f2f291167 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:02.355779 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-678d2eb3-9287-45e8-9c58-e14f2f291167 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:02.362819 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-678d2eb3-9287-45e8-9c58-e14f2f291167 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:02.363253 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-678d2eb3-9287-45e8-9c58-e14f2f291167 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:02.363702 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-678d2eb3-9287-45e8-9c58-e14f2f291167 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:02.364410 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-678d2eb3-9287-45e8-9c58-e14f2f291167 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:02.364891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-678d2eb3-9287-45e8-9c58-e14f2f291167 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:02.365321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-678d2eb3-9287-45e8-9c58-e14f2f291167 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:02.430024 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-678d2eb3-9287-45e8-9c58-e14f2f291167 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:02.443036 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-678d2eb3-9287-45e8-9c58-e14f2f291167 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1219 microversion: 2.1 time: 0.092104 Oct 04 19:43:02.443787 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4070/8136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:02 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:03.467915 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-acd4b5ac-d278-4e35-9dfc-684f63781f3b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:03.468544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-acd4b5ac-d278-4e35-9dfc-684f63781f3b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:03.475649 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd4b5ac-d278-4e35-9dfc-684f63781f3b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:03.476166 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd4b5ac-d278-4e35-9dfc-684f63781f3b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:03.476663 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd4b5ac-d278-4e35-9dfc-684f63781f3b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:03.477424 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd4b5ac-d278-4e35-9dfc-684f63781f3b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:03.477907 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd4b5ac-d278-4e35-9dfc-684f63781f3b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:03.478355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-acd4b5ac-d278-4e35-9dfc-684f63781f3b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:03.548041 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-acd4b5ac-d278-4e35-9dfc-684f63781f3b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:03.558389 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-acd4b5ac-d278-4e35-9dfc-684f63781f3b tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1219 microversion: 2.1 time: 0.095029 Oct 04 19:43:03.559001 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4067/8137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:03 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:04.583111 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:04.584487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:04.592079 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:04.592891 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:04.593571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:04.594321 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:04.594886 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:04.595520 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:04.635796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:04.635796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:04.635796 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:04.636740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.objects.instance [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lazy-loading 'fault' on Instance uuid 988c1eb2-44a4-43ae-8801-bcc10fac14aa {{(pid=122332) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:43:04.695759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169ad294f3624feb8332b0d832f3c132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798e3c2964f04344b4314468b70aeeba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:04.704812 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-261f4ead-b1ac-4dba-af2f-b9d8ce03e659 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 200 len: 1178 microversion: 2.1 time: 0.125631 Oct 04 19:43:04.705848 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4071/8138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:04 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 1178 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:05.729825 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:05.730388 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] [instance: 988c1eb2-44a4-43ae-8801-bcc10fac14aa] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:05.737563 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:05.738332 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:05.739098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:05.740401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:05.740401 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:05.740790 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:05.754380 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] HTTP exception thrown: Instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa could not be found. Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Request method failure captured: Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa HTTP/1.1 Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIpcvlcmZWacPbZ4TXOwnGsyCv0S8msY2NHIjlbgMuq_VAnuiIv6ExHvdJwjRlfrpbgFymaZpw-yNOlZ5KTMGHDLMfec92E-G3G67DjeHZlJAjAG7cMw2AQPErZTomkigFylZmxhVQ-3ihmHMGsezTKe-9eoVcj4kCEYF7CGuN859ig Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 798e3c2964f04344b4314468b70aeeba Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestShelveInstance-354624551 Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_798e3c2964f04344b4314468b70aeeba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/798e3c2964f04344b4314468b70aeeba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/798e3c2964f04344b4314468b70aeeba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/798e3c2964f04344b4314468b70aeeba"}]}] Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestShelveInstance-354624551 Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 798e3c2964f04344b4314468b70aeeba Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestShelveInstance-354624551 Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestShelveInstance-354624551-project Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 169ad294f3624feb8332b0d832f3c132 Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestShelveInstance-354624551-project Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa could not be found. Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '988c1eb2-44a4-43ae-8801-bcc10fac14aa'} Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa could not be found. Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa could not be found. Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:05.756734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:43:05.761734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:05.761734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:05.761734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:05.761734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:43:05.761734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:43:05.761734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa could not be found. Oct 04 19:43:05.761734 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:43:05.761734 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Returning 404 to user: Instance 988c1eb2-44a4-43ae-8801-bcc10fac14aa could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:43:05.761734 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1d5091e8-3ead-47eb-9622-43893f40b326 tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa" status: 404 len: 111 microversion: 2.1 time: 0.032434 Oct 04 19:43:05.761734 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4068/8139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:05 2022] GET /compute/v2.1/servers/988c1eb2-44a4-43ae-8801-bcc10fac14aa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:43:05.936831 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-a331c89b-ec22-4ed0-89b5-ea002103459f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] Calling method '.version_select at 0x7fd4d1207940>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:05.964618 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-a331c89b-ec22-4ed0-89b5-ea002103459f tempest-TestShelveInstance-354624551 tempest-TestShelveInstance-354624551-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-778039780" status: 202 len: 0 microversion: 2.1 time: 0.032227 Oct 04 19:43:05.969924 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4072/8140] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 19:43:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-778039780 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:43:24.642449 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=12 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:24.643378 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=24 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:24.863822 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-df895f72-9017-41ad-8b29-5efc9df6a31d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Action: 'create', calling method: .version_select at 0x7fd4d1a33700>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-45450242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7g25ukkizN6gnBe4XEFQPg6B+OCEYeU8IIKVXwRQKINqPqTD+qTtJb8FZKHr2lrGr1WJA/koA+5VmQbYM4XXlOac6ljmZxVtRtcgSk+maaGcmtA9JsUG5Cm7qCAhV+cQ=="}} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:24.882511 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-df895f72-9017-41ad-8b29-5efc9df6a31d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Getting quotas for project 374cc88606ea4ce1a3d258103d711132. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:43:24.889024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.quota [None req-df895f72-9017-41ad-8b29-5efc9df6a31d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Getting quotas for user 437ec22f371c47c5899719e3becaca1d and project 374cc88606ea4ce1a3d258103d711132. Resources: {'key_pairs'} {{(pid=122331) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:43:24.924769 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-df895f72-9017-41ad-8b29-5efc9df6a31d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.287516 Oct 04 19:43:24.925483 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4069/8141] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 4 19:43:24 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:43:25.932474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:25.933276 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:25.937374 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-408139734", "imageRef": "acd24e6c-2248-4327-9505-66fea04436b8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-45450242", "security_groups": [{"name": "tempest-secgroup-smoke-2085405892"}], "networks": [{"uuid": "124f7ba8-cee6-4233-8441-7082205ebb64"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:26.050378 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] validate_networks() for [('124f7ba8-cee6-4233-8441-7082205ebb64', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:43:26.464556 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:43:26.465068 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:43:26.465566 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:43:26.466255 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:43:26.466743 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:43:26.476531 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:26.477121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:26.477651 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:26.478483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:26.479025 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:26.479471 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:26.498377 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Getting quotas for project 374cc88606ea4ce1a3d258103d711132. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:43:26.504550 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Getting quotas for user 437ec22f371c47c5899719e3becaca1d and project 374cc88606ea4ce1a3d258103d711132. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:43:26.519335 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:43:26.522331 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acd24e6c-2248-4327-9505-66fea04436b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:43:26.573768 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-021344a7-1da8-475e-8511-5e3ec437d6fa tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.643176 Oct 04 19:43:26.574618 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4073/8142] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:43:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:43:26.588027 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-757f6121-4e16-49f1-b8e0-67d341625de2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:26.588788 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-757f6121-4e16-49f1-b8e0-67d341625de2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:26.649236 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-757f6121-4e16-49f1-b8e0-67d341625de2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:26.657714 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-757f6121-4e16-49f1-b8e0-67d341625de2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1246 microversion: 2.1 time: 0.075853 Oct 04 19:43:26.658590 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4070/8143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:26 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:27.685729 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-548168e9-7629-4127-bd6a-ea24b5619274 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:27.687217 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-548168e9-7629-4127-bd6a-ea24b5619274 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:27.694705 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-548168e9-7629-4127-bd6a-ea24b5619274 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:27.695237 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-548168e9-7629-4127-bd6a-ea24b5619274 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:27.695680 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-548168e9-7629-4127-bd6a-ea24b5619274 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:27.696640 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-548168e9-7629-4127-bd6a-ea24b5619274 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:27.697282 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-548168e9-7629-4127-bd6a-ea24b5619274 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:27.698046 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-548168e9-7629-4127-bd6a-ea24b5619274 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:27.982785 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-548168e9-7629-4127-bd6a-ea24b5619274 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:27.992303 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-548168e9-7629-4127-bd6a-ea24b5619274 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1298 microversion: 2.1 time: 0.312216 Oct 04 19:43:27.992893 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4074/8144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:27 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1298 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:29.018407 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-4ce7982f-4efa-4427-bf5d-9bc8f998b014 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:29.019013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-4ce7982f-4efa-4427-bf5d-9bc8f998b014 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:29.026738 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ce7982f-4efa-4427-bf5d-9bc8f998b014 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:29.027352 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ce7982f-4efa-4427-bf5d-9bc8f998b014 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:29.027810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ce7982f-4efa-4427-bf5d-9bc8f998b014 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:29.028544 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ce7982f-4efa-4427-bf5d-9bc8f998b014 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:29.029024 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ce7982f-4efa-4427-bf5d-9bc8f998b014 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:29.029479 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-4ce7982f-4efa-4427-bf5d-9bc8f998b014 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:29.247782 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-4ce7982f-4efa-4427-bf5d-9bc8f998b014 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:29.255670 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-4ce7982f-4efa-4427-bf5d-9bc8f998b014 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1372 microversion: 2.1 time: 0.241477 Oct 04 19:43:29.256251 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4071/8145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:29 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1372 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:29.492609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-aa704c15-2d26-448c-9381-9369e91600e1 req-35a74cc4-159b-485c-b704-3ea135923b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa1c8d3-669a-467c-98ee-8eadecff72ee", "tag": "e346e1ad-e15a-4ad1-a49a-82f001efe31d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:29.504130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-aa704c15-2d26-448c-9381-9369e91600e1 req-35a74cc4-159b-485c-b704-3ea135923b07 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:29.505261 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-aa704c15-2d26-448c-9381-9369e91600e1 req-35a74cc4-159b-485c-b704-3ea135923b07 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:29.505791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-aa704c15-2d26-448c-9381-9369e91600e1 req-35a74cc4-159b-485c-b704-3ea135923b07 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:29.517991 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-aa704c15-2d26-448c-9381-9369e91600e1 req-35a74cc4-159b-485c-b704-3ea135923b07 service nova] Creating event network-changed:e346e1ad-e15a-4ad1-a49a-82f001efe31d for instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee on n-h2-850499-14 Oct 04 19:43:29.523930 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-aa704c15-2d26-448c-9381-9369e91600e1 req-35a74cc4-159b-485c-b704-3ea135923b07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106635 Oct 04 19:43:29.525057 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4075/8146] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:30.279382 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f3cb00a5-3713-4bd5-9a55-31977fe7c5d3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:30.280042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f3cb00a5-3713-4bd5-9a55-31977fe7c5d3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:30.287556 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3cb00a5-3713-4bd5-9a55-31977fe7c5d3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:30.288079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3cb00a5-3713-4bd5-9a55-31977fe7c5d3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:30.288555 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3cb00a5-3713-4bd5-9a55-31977fe7c5d3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:30.289450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3cb00a5-3713-4bd5-9a55-31977fe7c5d3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:30.290083 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3cb00a5-3713-4bd5-9a55-31977fe7c5d3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:30.290529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-f3cb00a5-3713-4bd5-9a55-31977fe7c5d3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:30.428951 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f3cb00a5-3713-4bd5-9a55-31977fe7c5d3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:30.437048 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f3cb00a5-3713-4bd5-9a55-31977fe7c5d3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1372 microversion: 2.1 time: 0.161614 Oct 04 19:43:30.437628 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4072/8147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:30 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:31.461791 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-3c0fc837-dd5b-4864-b5e5-4cc52fdd9f7d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:31.462502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-3c0fc837-dd5b-4864-b5e5-4cc52fdd9f7d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:31.469545 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c0fc837-dd5b-4864-b5e5-4cc52fdd9f7d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:31.470042 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c0fc837-dd5b-4864-b5e5-4cc52fdd9f7d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:31.470522 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c0fc837-dd5b-4864-b5e5-4cc52fdd9f7d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:31.471289 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c0fc837-dd5b-4864-b5e5-4cc52fdd9f7d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:31.471752 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c0fc837-dd5b-4864-b5e5-4cc52fdd9f7d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:31.472183 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-3c0fc837-dd5b-4864-b5e5-4cc52fdd9f7d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:31.608952 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-3c0fc837-dd5b-4864-b5e5-4cc52fdd9f7d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:31.616626 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-3c0fc837-dd5b-4864-b5e5-4cc52fdd9f7d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1372 microversion: 2.1 time: 0.159662 Oct 04 19:43:31.617194 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4076/8148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:31 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:32.640358 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-bbf41804-5f5d-48f3-a1e7-6901b06e6571 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:32.641733 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-bbf41804-5f5d-48f3-a1e7-6901b06e6571 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:32.649535 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbf41804-5f5d-48f3-a1e7-6901b06e6571 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:32.650049 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbf41804-5f5d-48f3-a1e7-6901b06e6571 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:32.650512 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbf41804-5f5d-48f3-a1e7-6901b06e6571 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:32.651323 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbf41804-5f5d-48f3-a1e7-6901b06e6571 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:32.651836 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbf41804-5f5d-48f3-a1e7-6901b06e6571 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:32.652283 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-bbf41804-5f5d-48f3-a1e7-6901b06e6571 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:32.793322 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-bbf41804-5f5d-48f3-a1e7-6901b06e6571 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:32.801522 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-bbf41804-5f5d-48f3-a1e7-6901b06e6571 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1372 microversion: 2.1 time: 0.165210 Oct 04 19:43:32.802204 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4073/8149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:32 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:33.824629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6223f36b-cf6f-4c54-a87a-0a436031d2b2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:33.825249 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6223f36b-cf6f-4c54-a87a-0a436031d2b2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:33.832061 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6223f36b-cf6f-4c54-a87a-0a436031d2b2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:33.832551 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6223f36b-cf6f-4c54-a87a-0a436031d2b2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:33.832995 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6223f36b-cf6f-4c54-a87a-0a436031d2b2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:33.833699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6223f36b-cf6f-4c54-a87a-0a436031d2b2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:33.834160 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6223f36b-cf6f-4c54-a87a-0a436031d2b2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:33.834588 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6223f36b-cf6f-4c54-a87a-0a436031d2b2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:33.979592 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-6223f36b-cf6f-4c54-a87a-0a436031d2b2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:33.987333 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6223f36b-cf6f-4c54-a87a-0a436031d2b2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1372 microversion: 2.1 time: 0.166705 Oct 04 19:43:33.987924 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4077/8150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:33 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:35.011600 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-662bec08-a651-48e2-a02a-d796d8474721 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:35.012226 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-662bec08-a651-48e2-a02a-d796d8474721 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:35.019202 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-662bec08-a651-48e2-a02a-d796d8474721 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:35.019708 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-662bec08-a651-48e2-a02a-d796d8474721 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:35.020167 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-662bec08-a651-48e2-a02a-d796d8474721 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:35.020881 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-662bec08-a651-48e2-a02a-d796d8474721 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:35.021356 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-662bec08-a651-48e2-a02a-d796d8474721 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:35.021832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-662bec08-a651-48e2-a02a-d796d8474721 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:35.152832 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-662bec08-a651-48e2-a02a-d796d8474721 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:35.160507 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-662bec08-a651-48e2-a02a-d796d8474721 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1372 microversion: 2.1 time: 0.152817 Oct 04 19:43:35.161078 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4074/8151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:35 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:36.184352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f17af35d-d25a-4552-a5d6-788f4fb3787f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:36.185121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f17af35d-d25a-4552-a5d6-788f4fb3787f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:36.193706 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f17af35d-d25a-4552-a5d6-788f4fb3787f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:36.194766 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f17af35d-d25a-4552-a5d6-788f4fb3787f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:36.195228 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f17af35d-d25a-4552-a5d6-788f4fb3787f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:36.195930 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f17af35d-d25a-4552-a5d6-788f4fb3787f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:36.196385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f17af35d-d25a-4552-a5d6-788f4fb3787f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:36.196812 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f17af35d-d25a-4552-a5d6-788f4fb3787f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:36.332740 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f17af35d-d25a-4552-a5d6-788f4fb3787f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:36.340508 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f17af35d-d25a-4552-a5d6-788f4fb3787f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1372 microversion: 2.1 time: 0.160281 Oct 04 19:43:36.341087 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4078/8152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:36 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:43:37.363262 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-59eb868a-914d-4a3d-9fd0-262f197c5b1f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:37.364051 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-59eb868a-914d-4a3d-9fd0-262f197c5b1f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:37.367237 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=6 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:37.373072 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eb868a-914d-4a3d-9fd0-262f197c5b1f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:37.373587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eb868a-914d-4a3d-9fd0-262f197c5b1f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:37.374042 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eb868a-914d-4a3d-9fd0-262f197c5b1f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:37.374766 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eb868a-914d-4a3d-9fd0-262f197c5b1f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:37.375274 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eb868a-914d-4a3d-9fd0-262f197c5b1f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:37.375720 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-59eb868a-914d-4a3d-9fd0-262f197c5b1f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:37.483833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-9908f539-9574-40af-8f28-4cac074d0d17 req-23d86aef-a170-44d7-b631-a8eb6dce1d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa1c8d3-669a-467c-98ee-8eadecff72ee", "name": "network-vif-plugged", "status": "completed", "tag": "e346e1ad-e15a-4ad1-a49a-82f001efe31d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:37.490483 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:37.491187 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:37.497280 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9908f539-9574-40af-8f28-4cac074d0d17 req-23d86aef-a170-44d7-b631-a8eb6dce1d07 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:37.498031 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9908f539-9574-40af-8f28-4cac074d0d17 req-23d86aef-a170-44d7-b631-a8eb6dce1d07 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:37.498669 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-9908f539-9574-40af-8f28-4cac074d0d17 req-23d86aef-a170-44d7-b631-a8eb6dce1d07 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:37.511031 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-9908f539-9574-40af-8f28-4cac074d0d17 req-23d86aef-a170-44d7-b631-a8eb6dce1d07 service nova] Creating event network-vif-plugged:e346e1ad-e15a-4ad1-a49a-82f001efe31d for instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee on n-h2-850499-14 Oct 04 19:43:37.513968 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-59eb868a-914d-4a3d-9fd0-262f197c5b1f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:37.516955 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-9908f539-9574-40af-8f28-4cac074d0d17 req-23d86aef-a170-44d7-b631-a8eb6dce1d07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037486 Oct 04 19:43:37.517786 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4079/8153] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:43:37.523428 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-59eb868a-914d-4a3d-9fd0-262f197c5b1f tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1372 microversion: 2.1 time: 0.164016 Oct 04 19:43:37.524078 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4075/8154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:37 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:38.548319 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-bbad1f45-e7f9-410b-859b-8a13c7943a20 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:38.549021 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-bbad1f45-e7f9-410b-859b-8a13c7943a20 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:38.555998 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbad1f45-e7f9-410b-859b-8a13c7943a20 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:38.556493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbad1f45-e7f9-410b-859b-8a13c7943a20 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:38.556939 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbad1f45-e7f9-410b-859b-8a13c7943a20 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:38.557687 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbad1f45-e7f9-410b-859b-8a13c7943a20 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:38.558134 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbad1f45-e7f9-410b-859b-8a13c7943a20 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:38.558564 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-bbad1f45-e7f9-410b-859b-8a13c7943a20 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:38.688764 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-bbad1f45-e7f9-410b-859b-8a13c7943a20 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:38.696961 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-bbad1f45-e7f9-410b-859b-8a13c7943a20 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1372 microversion: 2.1 time: 0.154063 Oct 04 19:43:38.697528 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4080/8155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:38 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:39.719810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-d71aecfe-7f86-4d04-be36-4086ff31d57b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:39.720347 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-d71aecfe-7f86-4d04-be36-4086ff31d57b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:39.727228 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d71aecfe-7f86-4d04-be36-4086ff31d57b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:39.727732 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d71aecfe-7f86-4d04-be36-4086ff31d57b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:39.728187 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d71aecfe-7f86-4d04-be36-4086ff31d57b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:39.728894 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d71aecfe-7f86-4d04-be36-4086ff31d57b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:39.729362 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d71aecfe-7f86-4d04-be36-4086ff31d57b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:39.729798 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-d71aecfe-7f86-4d04-be36-4086ff31d57b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:39.864080 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-d71aecfe-7f86-4d04-be36-4086ff31d57b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:39.873536 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-d71aecfe-7f86-4d04-be36-4086ff31d57b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1558 microversion: 2.1 time: 0.157712 Oct 04 19:43:39.874143 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4076/8156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:39 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:39.896104 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-f96335af-02a1-4fcf-8da0-a17f4cfbb714 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:39.896721 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-f96335af-02a1-4fcf-8da0-a17f4cfbb714 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:39.903534 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96335af-02a1-4fcf-8da0-a17f4cfbb714 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:39.904048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96335af-02a1-4fcf-8da0-a17f4cfbb714 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:39.904656 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96335af-02a1-4fcf-8da0-a17f4cfbb714 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:39.905468 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96335af-02a1-4fcf-8da0-a17f4cfbb714 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:39.906037 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96335af-02a1-4fcf-8da0-a17f4cfbb714 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:39.906364 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-f96335af-02a1-4fcf-8da0-a17f4cfbb714 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:40.041530 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-f96335af-02a1-4fcf-8da0-a17f4cfbb714 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:40.049490 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-f96335af-02a1-4fcf-8da0-a17f4cfbb714 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1558 microversion: 2.1 time: 0.157200 Oct 04 19:43:40.050341 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4081/8157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:39 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:41.719061 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-344c3129-535a-41c1-8002-04ddbcc8f391 req-c3015124-ba49-42e0-9fbb-f4cabe99babe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa1c8d3-669a-467c-98ee-8eadecff72ee", "tag": "e346e1ad-e15a-4ad1-a49a-82f001efe31d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:41.729252 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-344c3129-535a-41c1-8002-04ddbcc8f391 req-c3015124-ba49-42e0-9fbb-f4cabe99babe service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.729750 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-344c3129-535a-41c1-8002-04ddbcc8f391 req-c3015124-ba49-42e0-9fbb-f4cabe99babe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.730197 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-344c3129-535a-41c1-8002-04ddbcc8f391 req-c3015124-ba49-42e0-9fbb-f4cabe99babe service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.742022 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-344c3129-535a-41c1-8002-04ddbcc8f391 req-c3015124-ba49-42e0-9fbb-f4cabe99babe service nova] Creating event network-changed:e346e1ad-e15a-4ad1-a49a-82f001efe31d for instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee on n-h2-850499-14 Oct 04 19:43:41.747312 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-344c3129-535a-41c1-8002-04ddbcc8f391 req-c3015124-ba49-42e0-9fbb-f4cabe99babe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086590 Oct 04 19:43:41.747917 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4077/8158] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:18.528024 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10ce8cfd-1d4b-4064-b672-e66ecfbcf18f] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:46:18.529009 n-d-850499-14 devstack@n-api.service[122332]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:46:18.529843 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:18.530585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=42 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:18.531646 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:46:18.531941 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee/action (ip 10.222.0.18) !!! Oct 04 19:46:18.532947 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:46:18.533083 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee/action (ip 10.222.0.18) !!! Oct 04 19:46:18.534254 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:46:18.534383 n-d-850499-14 devstack@n-api.service[122332]: Tue Oct 4 19:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee/action (ip 10.222.0.18) !!! Oct 04 19:46:18.539697 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fa6322d0-024e-4828-a8c5-b780d664f131 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-908757100"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:18.541977 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fa6322d0-024e-4828-a8c5-b780d664f131 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:18.556238 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa6322d0-024e-4828-a8c5-b780d664f131 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:18.556737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa6322d0-024e-4828-a8c5-b780d664f131 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:18.557338 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa6322d0-024e-4828-a8c5-b780d664f131 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:18.557908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa6322d0-024e-4828-a8c5-b780d664f131 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:18.558373 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa6322d0-024e-4828-a8c5-b780d664f131 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:18.558806 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fa6322d0-024e-4828-a8c5-b780d664f131 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:18.765745 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fa6322d0-024e-4828-a8c5-b780d664f131 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "POST /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee/action" status: 202 len: 0 microversion: 2.1 time: 0.239618 Oct 04 19:46:18.766396 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4082/8159] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:46:18 2022] POST /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 19:46:26.276334 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:46:26.277166 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:46:26.277786 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:26.278608 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=38 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:26.280514 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:46:26.280514 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:46:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 04 19:46:26.282725 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:46:26.282906 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:46:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 04 19:46:26.284742 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:46:26.284876 n-d-850499-14 devstack@n-api.service[122331]: Tue Oct 4 19:46:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 04 19:46:26.396355 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-eba38d87-6fa3-4948-a033-350b1e3060e6 req-b087cdbb-3240-42c1-b088-78bcb6229683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa1c8d3-669a-467c-98ee-8eadecff72ee", "name": "network-vif-plugged", "status": "completed", "tag": "e346e1ad-e15a-4ad1-a49a-82f001efe31d"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:26.407066 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eba38d87-6fa3-4948-a033-350b1e3060e6 req-b087cdbb-3240-42c1-b088-78bcb6229683 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:26.407562 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eba38d87-6fa3-4948-a033-350b1e3060e6 req-b087cdbb-3240-42c1-b088-78bcb6229683 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:26.408011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-eba38d87-6fa3-4948-a033-350b1e3060e6 req-b087cdbb-3240-42c1-b088-78bcb6229683 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:26.418002 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-eba38d87-6fa3-4948-a033-350b1e3060e6 req-b087cdbb-3240-42c1-b088-78bcb6229683 service nova] Creating event network-vif-plugged:e346e1ad-e15a-4ad1-a49a-82f001efe31d for instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee on n-h2-850499-14 Oct 04 19:46:26.424853 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-eba38d87-6fa3-4948-a033-350b1e3060e6 req-b087cdbb-3240-42c1-b088-78bcb6229683 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150212 Oct 04 19:46:26.425439 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4078/8160] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:37.466675 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1907460451", "imageRef": "111a016c-623b-479b-b9f5-9e7a5bc9a61d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-45450242", "security_groups": [{"name": "tempest-secgroup-smoke-2085405892"}], "networks": [{"uuid": "124f7ba8-cee6-4233-8441-7082205ebb64"}]}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:37.477327 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:37.478103 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:37.498842 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [8cb343a1-3068-44cb-8e83-08b0547a03d1] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52070. Oct 04 19:46:37.499856 n-d-850499-14 devstack@n-api.service[122332]: INFO oslo.messaging._drivers.impl_rabbit [-] [10ce8cfd-1d4b-4064-b672-e66ecfbcf18f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52068. Oct 04 19:46:37.586094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.network.neutron [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] validate_networks() for [('124f7ba8-cee6-4233-8441-7082205ebb64', None, None, None, None, None)] {{(pid=122332) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:46:38.007593 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Flavor limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:46:38.008056 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Image limits 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:46:38.008589 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Flavor pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:46:38.009044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Image pref 0:0:0 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:46:38.009460 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.virt.hardware [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122332) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:46:38.018221 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:38.018707 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:38.019197 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:38.019928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:38.020390 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:38.020820 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:38.037063 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Getting quotas for project 374cc88606ea4ce1a3d258103d711132. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:46:38.042585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.quota [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Getting quotas for user 437ec22f371c47c5899719e3becaca1d and project 374cc88606ea4ce1a3d258103d711132. Resources: {'cores', 'instances', 'ram'} {{(pid=122332) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:46:38.055633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Going to run 1 instances... {{(pid=122332) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:46:38.058093 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='111a016c-623b-479b-b9f5-9e7a5bc9a61d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122332) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:46:38.104782 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-7205524a-6262-4eaf-9fa0-991f943b37bf tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.642270 Oct 04 19:46:38.105441 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4083/8161] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 4 19:46:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:46:38.116012 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:38.116821 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:38.122650 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-f7415b84-2df4-4937-919f-4992129c6ac7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:38.125583 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-f7415b84-2df4-4937-919f-4992129c6ac7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:38.138640 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52086. Oct 04 19:46:38.139487 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52088. Oct 04 19:46:38.187992 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-f7415b84-2df4-4937-919f-4992129c6ac7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:38.195615 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-f7415b84-2df4-4937-919f-4992129c6ac7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1247 microversion: 2.1 time: 0.081872 Oct 04 19:46:38.196850 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4079/8162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:38 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1247 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:46:39.220119 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-dc6c9a54-97ae-4ba0-83c8-8d3ed0593fa2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:39.221405 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-dc6c9a54-97ae-4ba0-83c8-8d3ed0593fa2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:39.228809 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc6c9a54-97ae-4ba0-83c8-8d3ed0593fa2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:39.229297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc6c9a54-97ae-4ba0-83c8-8d3ed0593fa2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:39.229960 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc6c9a54-97ae-4ba0-83c8-8d3ed0593fa2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:39.230659 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc6c9a54-97ae-4ba0-83c8-8d3ed0593fa2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:39.231153 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc6c9a54-97ae-4ba0-83c8-8d3ed0593fa2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:39.231584 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-dc6c9a54-97ae-4ba0-83c8-8d3ed0593fa2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:39.312947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-dc6c9a54-97ae-4ba0-83c8-8d3ed0593fa2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:39.323758 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-dc6c9a54-97ae-4ba0-83c8-8d3ed0593fa2 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1307 microversion: 2.1 time: 0.108493 Oct 04 19:46:39.324934 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4084/8163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:39 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:40.348281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-5f854dc4-e410-41f3-915c-23e8c5961963 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:40.348928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-5f854dc4-e410-41f3-915c-23e8c5961963 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:40.360936 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f854dc4-e410-41f3-915c-23e8c5961963 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:40.361455 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f854dc4-e410-41f3-915c-23e8c5961963 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:40.361913 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f854dc4-e410-41f3-915c-23e8c5961963 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:40.362641 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f854dc4-e410-41f3-915c-23e8c5961963 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:40.363142 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f854dc4-e410-41f3-915c-23e8c5961963 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:40.363588 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-5f854dc4-e410-41f3-915c-23e8c5961963 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:40.447822 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-4f39aedd-b43c-4712-9baa-b8f922156329 req-b4789fa9-2807-4f3f-b4dc-c6edfadba20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa1c8d3-669a-467c-98ee-8eadecff72ee", "name": "network-vif-unplugged", "status": "completed", "tag": "e346e1ad-e15a-4ad1-a49a-82f001efe31d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:40.496921 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4f39aedd-b43c-4712-9baa-b8f922156329 req-b4789fa9-2807-4f3f-b4dc-c6edfadba20d service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:40.498614 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4f39aedd-b43c-4712-9baa-b8f922156329 req-b4789fa9-2807-4f3f-b4dc-c6edfadba20d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:40.501688 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-4f39aedd-b43c-4712-9baa-b8f922156329 req-b4789fa9-2807-4f3f-b4dc-c6edfadba20d service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:40.525133 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-4f39aedd-b43c-4712-9baa-b8f922156329 req-b4789fa9-2807-4f3f-b4dc-c6edfadba20d service nova] Creating event network-vif-unplugged:e346e1ad-e15a-4ad1-a49a-82f001efe31d for instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee on n-h2-850499-14 Oct 04 19:46:40.531582 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-5f854dc4-e410-41f3-915c-23e8c5961963 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:40.533627 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-4f39aedd-b43c-4712-9baa-b8f922156329 req-b4789fa9-2807-4f3f-b4dc-c6edfadba20d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089253 Oct 04 19:46:40.537424 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4085/8164] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:40.540796 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-5f854dc4-e410-41f3-915c-23e8c5961963 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.197974 Oct 04 19:46:40.542192 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4080/8165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:40 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:41.570938 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4728506a-6f0a-4d88-af73-d2fb3098e97c tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:41.571737 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4728506a-6f0a-4d88-af73-d2fb3098e97c tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:41.578140 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4728506a-6f0a-4d88-af73-d2fb3098e97c tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:41.578636 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4728506a-6f0a-4d88-af73-d2fb3098e97c tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:41.579130 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4728506a-6f0a-4d88-af73-d2fb3098e97c tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:41.579827 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4728506a-6f0a-4d88-af73-d2fb3098e97c tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:41.580279 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4728506a-6f0a-4d88-af73-d2fb3098e97c tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:41.580701 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4728506a-6f0a-4d88-af73-d2fb3098e97c tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:41.749808 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4728506a-6f0a-4d88-af73-d2fb3098e97c tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:41.757992 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4728506a-6f0a-4d88-af73-d2fb3098e97c tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.192030 Oct 04 19:46:41.762594 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4086/8166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:41 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:42.782872 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-ff803d6f-2ce1-44c5-b7d2-ac6201bf821d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:42.784315 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-ff803d6f-2ce1-44c5-b7d2-ac6201bf821d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:42.792516 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff803d6f-2ce1-44c5-b7d2-ac6201bf821d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:42.793033 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff803d6f-2ce1-44c5-b7d2-ac6201bf821d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:42.793496 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff803d6f-2ce1-44c5-b7d2-ac6201bf821d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:42.794227 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff803d6f-2ce1-44c5-b7d2-ac6201bf821d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:42.794994 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff803d6f-2ce1-44c5-b7d2-ac6201bf821d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:42.795450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-ff803d6f-2ce1-44c5-b7d2-ac6201bf821d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:42.949736 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-ff803d6f-2ce1-44c5-b7d2-ac6201bf821d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:42.958529 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-ff803d6f-2ce1-44c5-b7d2-ac6201bf821d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.180537 Oct 04 19:46:42.959677 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4081/8167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:42 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:46:43.981837 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e5ba45c5-bba6-4352-9c66-1ae7a399b28a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:43.984912 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e5ba45c5-bba6-4352-9c66-1ae7a399b28a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:43.993121 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ba45c5-bba6-4352-9c66-1ae7a399b28a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:43.994185 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ba45c5-bba6-4352-9c66-1ae7a399b28a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:43.994893 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ba45c5-bba6-4352-9c66-1ae7a399b28a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:43.995906 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ba45c5-bba6-4352-9c66-1ae7a399b28a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:43.996619 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ba45c5-bba6-4352-9c66-1ae7a399b28a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:43.997297 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e5ba45c5-bba6-4352-9c66-1ae7a399b28a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:44.141760 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e5ba45c5-bba6-4352-9c66-1ae7a399b28a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:44.150325 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e5ba45c5-bba6-4352-9c66-1ae7a399b28a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.172362 Oct 04 19:46:44.150907 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4087/8168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:43 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:45.174135 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c2c58c76-cdd6-4f56-85d3-1e06fce0c1a3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:45.174799 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c2c58c76-cdd6-4f56-85d3-1e06fce0c1a3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:45.181870 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2c58c76-cdd6-4f56-85d3-1e06fce0c1a3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:45.182489 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2c58c76-cdd6-4f56-85d3-1e06fce0c1a3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:45.182948 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2c58c76-cdd6-4f56-85d3-1e06fce0c1a3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:45.183685 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2c58c76-cdd6-4f56-85d3-1e06fce0c1a3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:45.184162 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2c58c76-cdd6-4f56-85d3-1e06fce0c1a3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:45.184604 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c2c58c76-cdd6-4f56-85d3-1e06fce0c1a3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:45.322091 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c2c58c76-cdd6-4f56-85d3-1e06fce0c1a3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:45.329801 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c2c58c76-cdd6-4f56-85d3-1e06fce0c1a3 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.160128 Oct 04 19:46:45.330373 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4082/8169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:45 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:46.352848 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-5b7f29e5-2d5e-4029-a282-4fcb814e8b8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:46.353502 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-5b7f29e5-2d5e-4029-a282-4fcb814e8b8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:46.361192 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b7f29e5-2d5e-4029-a282-4fcb814e8b8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:46.361699 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b7f29e5-2d5e-4029-a282-4fcb814e8b8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:46.362152 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b7f29e5-2d5e-4029-a282-4fcb814e8b8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:46.362876 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b7f29e5-2d5e-4029-a282-4fcb814e8b8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:46.363422 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b7f29e5-2d5e-4029-a282-4fcb814e8b8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:46.363866 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-5b7f29e5-2d5e-4029-a282-4fcb814e8b8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:46.496672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-5b7f29e5-2d5e-4029-a282-4fcb814e8b8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:46.504846 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-5b7f29e5-2d5e-4029-a282-4fcb814e8b8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.155966 Oct 04 19:46:46.505412 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4088/8170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:46 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:47.528971 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-79eb8ae1-5766-4aec-a9a4-766f649354c4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:47.531224 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-79eb8ae1-5766-4aec-a9a4-766f649354c4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:47.541023 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79eb8ae1-5766-4aec-a9a4-766f649354c4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:47.541676 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79eb8ae1-5766-4aec-a9a4-766f649354c4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:47.542250 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79eb8ae1-5766-4aec-a9a4-766f649354c4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:47.543079 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79eb8ae1-5766-4aec-a9a4-766f649354c4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:47.543624 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79eb8ae1-5766-4aec-a9a4-766f649354c4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:47.544141 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-79eb8ae1-5766-4aec-a9a4-766f649354c4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:47.705748 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-79eb8ae1-5766-4aec-a9a4-766f649354c4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:47.713674 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-79eb8ae1-5766-4aec-a9a4-766f649354c4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.189407 Oct 04 19:46:47.714253 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4083/8171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:47 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:46:48.738555 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4983f9be-70af-4085-b3b2-728118dbb1ca tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:48.739370 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-4983f9be-70af-4085-b3b2-728118dbb1ca tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:48.742305 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:48.743070 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell0:SELECT=6 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:48.750062 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4983f9be-70af-4085-b3b2-728118dbb1ca tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:48.750569 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4983f9be-70af-4085-b3b2-728118dbb1ca tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:48.751102 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4983f9be-70af-4085-b3b2-728118dbb1ca tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:48.751769 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4983f9be-70af-4085-b3b2-728118dbb1ca tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:48.752242 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4983f9be-70af-4085-b3b2-728118dbb1ca tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:48.752683 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-4983f9be-70af-4085-b3b2-728118dbb1ca tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:48.894074 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-4983f9be-70af-4085-b3b2-728118dbb1ca tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:48.902493 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4983f9be-70af-4085-b3b2-728118dbb1ca tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.167982 Oct 04 19:46:48.903452 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4089/8172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:48 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:49.924937 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-47040c61-d1f3-415b-a6e9-0b7665698e8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:49.925577 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-47040c61-d1f3-415b-a6e9-0b7665698e8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:49.927529 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell0:SELECT=2 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:49.934230 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47040c61-d1f3-415b-a6e9-0b7665698e8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:49.934743 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47040c61-d1f3-415b-a6e9-0b7665698e8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:49.935233 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47040c61-d1f3-415b-a6e9-0b7665698e8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:49.935953 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47040c61-d1f3-415b-a6e9-0b7665698e8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:49.936428 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47040c61-d1f3-415b-a6e9-0b7665698e8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:49.936876 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-47040c61-d1f3-415b-a6e9-0b7665698e8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:50.068998 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-47040c61-d1f3-415b-a6e9-0b7665698e8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:50.078455 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-47040c61-d1f3-415b-a6e9-0b7665698e8a tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.157246 Oct 04 19:46:50.086418 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4084/8173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:49 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:50.609386 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-d93f419c-4d1c-46bc-8ac8-8fb0da6c954d req-95ee3b5e-ddb2-41e7-ba47-3e071ca87be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1321fd-d8d2-45dd-b38a-5af0bf27458f", "tag": "b427444e-4385-46e0-96ea-397dc8819097"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:50.628672 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d93f419c-4d1c-46bc-8ac8-8fb0da6c954d req-95ee3b5e-ddb2-41e7-ba47-3e071ca87be8 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:50.629371 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d93f419c-4d1c-46bc-8ac8-8fb0da6c954d req-95ee3b5e-ddb2-41e7-ba47-3e071ca87be8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:50.630097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-d93f419c-4d1c-46bc-8ac8-8fb0da6c954d req-95ee3b5e-ddb2-41e7-ba47-3e071ca87be8 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:50.645343 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-d93f419c-4d1c-46bc-8ac8-8fb0da6c954d req-95ee3b5e-ddb2-41e7-ba47-3e071ca87be8 service nova] Creating event network-changed:b427444e-4385-46e0-96ea-397dc8819097 for instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f on n-h1-850499-14 Oct 04 19:46:50.650328 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-d93f419c-4d1c-46bc-8ac8-8fb0da6c954d req-95ee3b5e-ddb2-41e7-ba47-3e071ca87be8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045574 Oct 04 19:46:50.652738 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4090/8174] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:51.105002 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-64982ef5-bc44-4adb-ac85-138d2f806a89 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:51.105571 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-64982ef5-bc44-4adb-ac85-138d2f806a89 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:51.112429 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64982ef5-bc44-4adb-ac85-138d2f806a89 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:51.112940 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64982ef5-bc44-4adb-ac85-138d2f806a89 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:51.113400 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64982ef5-bc44-4adb-ac85-138d2f806a89 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:51.114112 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64982ef5-bc44-4adb-ac85-138d2f806a89 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:51.114587 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64982ef5-bc44-4adb-ac85-138d2f806a89 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:51.115060 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-64982ef5-bc44-4adb-ac85-138d2f806a89 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:51.248331 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-64982ef5-bc44-4adb-ac85-138d2f806a89 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:51.256404 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-64982ef5-bc44-4adb-ac85-138d2f806a89 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.155375 Oct 04 19:46:51.256970 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4085/8175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:51 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:52.279629 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-806ed100-0667-4563-8c4e-26e1a5bab498 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:52.280892 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-806ed100-0667-4563-8c4e-26e1a5bab498 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:52.288097 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-806ed100-0667-4563-8c4e-26e1a5bab498 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:52.288668 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-806ed100-0667-4563-8c4e-26e1a5bab498 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:52.289186 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-806ed100-0667-4563-8c4e-26e1a5bab498 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:52.289971 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-806ed100-0667-4563-8c4e-26e1a5bab498 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:52.290557 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-806ed100-0667-4563-8c4e-26e1a5bab498 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:52.291081 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-806ed100-0667-4563-8c4e-26e1a5bab498 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:52.425759 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-806ed100-0667-4563-8c4e-26e1a5bab498 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:52.433905 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-806ed100-0667-4563-8c4e-26e1a5bab498 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.158698 Oct 04 19:46:52.434483 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4091/8176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:52 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:53.456731 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-b2a4673a-8f1b-4ecc-8342-5546cbb9d0e1 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:53.457373 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-b2a4673a-8f1b-4ecc-8342-5546cbb9d0e1 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:53.464313 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2a4673a-8f1b-4ecc-8342-5546cbb9d0e1 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:53.464847 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2a4673a-8f1b-4ecc-8342-5546cbb9d0e1 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:53.465312 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2a4673a-8f1b-4ecc-8342-5546cbb9d0e1 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:53.466032 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2a4673a-8f1b-4ecc-8342-5546cbb9d0e1 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:53.466513 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2a4673a-8f1b-4ecc-8342-5546cbb9d0e1 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:53.466974 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-b2a4673a-8f1b-4ecc-8342-5546cbb9d0e1 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:53.602803 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-b2a4673a-8f1b-4ecc-8342-5546cbb9d0e1 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:53.610744 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-b2a4673a-8f1b-4ecc-8342-5546cbb9d0e1 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.158002 Oct 04 19:46:53.611352 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4086/8177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:53 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:54.634609 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-c6d4a6ca-7958-41a8-8058-e44dee026ebe tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:54.635352 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-c6d4a6ca-7958-41a8-8058-e44dee026ebe tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:54.642823 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6d4a6ca-7958-41a8-8058-e44dee026ebe tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:54.643343 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6d4a6ca-7958-41a8-8058-e44dee026ebe tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:54.643782 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6d4a6ca-7958-41a8-8058-e44dee026ebe tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:54.644480 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6d4a6ca-7958-41a8-8058-e44dee026ebe tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:54.644935 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6d4a6ca-7958-41a8-8058-e44dee026ebe tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:54.645361 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-c6d4a6ca-7958-41a8-8058-e44dee026ebe tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:54.775293 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-c6d4a6ca-7958-41a8-8058-e44dee026ebe tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:54.783519 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-c6d4a6ca-7958-41a8-8058-e44dee026ebe tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.153921 Oct 04 19:46:54.784095 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4092/8178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:54 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:54.992966 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b793ddbb-5bc4-4530-a1f4-1e61757218f6 req-745bf4b1-51f0-46cb-bec8-9662539d5265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1321fd-d8d2-45dd-b38a-5af0bf27458f", "name": "network-vif-plugged", "status": "completed", "tag": "b427444e-4385-46e0-96ea-397dc8819097"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:55.005450 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b793ddbb-5bc4-4530-a1f4-1e61757218f6 req-745bf4b1-51f0-46cb-bec8-9662539d5265 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:55.005933 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b793ddbb-5bc4-4530-a1f4-1e61757218f6 req-745bf4b1-51f0-46cb-bec8-9662539d5265 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:55.006381 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b793ddbb-5bc4-4530-a1f4-1e61757218f6 req-745bf4b1-51f0-46cb-bec8-9662539d5265 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:55.018079 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b793ddbb-5bc4-4530-a1f4-1e61757218f6 req-745bf4b1-51f0-46cb-bec8-9662539d5265 service nova] Creating event network-vif-plugged:b427444e-4385-46e0-96ea-397dc8819097 for instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f on n-h1-850499-14 Oct 04 19:46:55.023300 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b793ddbb-5bc4-4530-a1f4-1e61757218f6 req-745bf4b1-51f0-46cb-bec8-9662539d5265 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033949 Oct 04 19:46:55.023923 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4087/8179] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:55.807065 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-ee80fd60-94aa-4a31-87da-3a2a4e5ee116 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:55.807647 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-ee80fd60-94aa-4a31-87da-3a2a4e5ee116 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:55.814937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee80fd60-94aa-4a31-87da-3a2a4e5ee116 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:55.815463 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee80fd60-94aa-4a31-87da-3a2a4e5ee116 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:55.815907 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee80fd60-94aa-4a31-87da-3a2a4e5ee116 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:55.816613 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee80fd60-94aa-4a31-87da-3a2a4e5ee116 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:55.817078 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee80fd60-94aa-4a31-87da-3a2a4e5ee116 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:55.817512 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-ee80fd60-94aa-4a31-87da-3a2a4e5ee116 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:55.949493 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-ee80fd60-94aa-4a31-87da-3a2a4e5ee116 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:55.957761 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-ee80fd60-94aa-4a31-87da-3a2a4e5ee116 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1373 microversion: 2.1 time: 0.154734 Oct 04 19:46:55.958337 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4093/8180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:55 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:56.982425 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-c58fb4f4-f495-4b00-8beb-4eb83df07585 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:56.983740 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-c58fb4f4-f495-4b00-8beb-4eb83df07585 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:56.990074 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58fb4f4-f495-4b00-8beb-4eb83df07585 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:56.990579 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58fb4f4-f495-4b00-8beb-4eb83df07585 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:56.991082 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58fb4f4-f495-4b00-8beb-4eb83df07585 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:56.991794 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58fb4f4-f495-4b00-8beb-4eb83df07585 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:56.992271 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58fb4f4-f495-4b00-8beb-4eb83df07585 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:56.992713 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-c58fb4f4-f495-4b00-8beb-4eb83df07585 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:57.131068 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-c58fb4f4-f495-4b00-8beb-4eb83df07585 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:57.138833 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-c58fb4f4-f495-4b00-8beb-4eb83df07585 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1558 microversion: 2.1 time: 0.161616 Oct 04 19:46:57.139437 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4088/8181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:56 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:57.161521 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-94ff6cfc-1fb6-4440-a9bc-54b3e217952d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:57.162157 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-94ff6cfc-1fb6-4440-a9bc-54b3e217952d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:57.168967 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94ff6cfc-1fb6-4440-a9bc-54b3e217952d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:57.169450 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94ff6cfc-1fb6-4440-a9bc-54b3e217952d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:57.170162 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94ff6cfc-1fb6-4440-a9bc-54b3e217952d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:57.171581 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94ff6cfc-1fb6-4440-a9bc-54b3e217952d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:57.172044 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94ff6cfc-1fb6-4440-a9bc-54b3e217952d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:57.172474 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-94ff6cfc-1fb6-4440-a9bc-54b3e217952d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:57.300776 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-94ff6cfc-1fb6-4440-a9bc-54b3e217952d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:57.308579 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-94ff6cfc-1fb6-4440-a9bc-54b3e217952d tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1558 microversion: 2.1 time: 0.150871 Oct 04 19:46:57.309161 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4094/8182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:57 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:59.227386 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-bd4aa01f-42b4-4060-a13f-d02afa9321df req-bc4ce029-a154-4290-a66f-00e37f37edfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1321fd-d8d2-45dd-b38a-5af0bf27458f", "tag": "b427444e-4385-46e0-96ea-397dc8819097"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:59.238011 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bd4aa01f-42b4-4060-a13f-d02afa9321df req-bc4ce029-a154-4290-a66f-00e37f37edfd service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:59.238528 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bd4aa01f-42b4-4060-a13f-d02afa9321df req-bc4ce029-a154-4290-a66f-00e37f37edfd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:59.239310 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-bd4aa01f-42b4-4060-a13f-d02afa9321df req-bc4ce029-a154-4290-a66f-00e37f37edfd service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:59.251057 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-bd4aa01f-42b4-4060-a13f-d02afa9321df req-bc4ce029-a154-4290-a66f-00e37f37edfd service nova] Creating event network-changed:b427444e-4385-46e0-96ea-397dc8819097 for instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f on n-h1-850499-14 Oct 04 19:46:59.256257 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-bd4aa01f-42b4-4060-a13f-d02afa9321df req-bc4ce029-a154-4290-a66f-00e37f37edfd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032602 Oct 04 19:46:59.257005 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4089/8183] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:38.170742 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:38.171523 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=60 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:38.226385 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-11b796d6-80f2-4c85-9adb-985aa54258a4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-550515659"}} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:38.228841 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-11b796d6-80f2-4c85-9adb-985aa54258a4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:38.234982 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11b796d6-80f2-4c85-9adb-985aa54258a4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:38.235495 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11b796d6-80f2-4c85-9adb-985aa54258a4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:38.235947 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11b796d6-80f2-4c85-9adb-985aa54258a4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:38.236649 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11b796d6-80f2-4c85-9adb-985aa54258a4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:38.237115 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11b796d6-80f2-4c85-9adb-985aa54258a4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:38.237553 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-11b796d6-80f2-4c85-9adb-985aa54258a4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:38.603940 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-11b796d6-80f2-4c85-9adb-985aa54258a4 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "POST /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f/action" status: 202 len: 0 microversion: 2.1 time: 0.435330 Oct 04 19:48:38.604672 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4095/8184] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 4 19:48:38 2022] POST /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 19:48:43.685211 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 19:48:43.688044 n-d-850499-14 devstack@n-api.service[122331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 19:48:43.688557 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_api:SELECT=24 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:43.689833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG dbcounter [-] [122331] Writing DB stats nova_cell1:SELECT=52 {{(pid=122331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:43.700411 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-738879c6-8fc6-4d35-998e-69a50acad8cb req-d2e03725-15f7-4431-be5b-fe8791ce9ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1321fd-d8d2-45dd-b38a-5af0bf27458f", "name": "network-vif-plugged", "status": "completed", "tag": "b427444e-4385-46e0-96ea-397dc8819097"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:43.718055 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-738879c6-8fc6-4d35-998e-69a50acad8cb req-d2e03725-15f7-4431-be5b-fe8791ce9ada service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:43.718938 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-738879c6-8fc6-4d35-998e-69a50acad8cb req-d2e03725-15f7-4431-be5b-fe8791ce9ada service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:43.719660 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-738879c6-8fc6-4d35-998e-69a50acad8cb req-d2e03725-15f7-4431-be5b-fe8791ce9ada service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:43.741591 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-738879c6-8fc6-4d35-998e-69a50acad8cb req-d2e03725-15f7-4431-be5b-fe8791ce9ada service nova] Creating event network-vif-plugged:b427444e-4385-46e0-96ea-397dc8819097 for instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f on n-h1-850499-14 Oct 04 19:48:43.750352 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-738879c6-8fc6-4d35-998e-69a50acad8cb req-d2e03725-15f7-4431-be5b-fe8791ce9ada service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068333 Oct 04 19:48:43.752103 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4090/8185] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:53.587281 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_api:SELECT=2 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:53.588384 n-d-850499-14 devstack@n-api.service[122332]: DEBUG dbcounter [-] [122332] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:53.593877 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-fe531473-53de-43cb-9e25-96cd09e2dca5 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:53.594571 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fe531473-53de-43cb-9e25-96cd09e2dca5 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:53.603579 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe531473-53de-43cb-9e25-96cd09e2dca5 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:53.604635 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe531473-53de-43cb-9e25-96cd09e2dca5 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:53.605184 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe531473-53de-43cb-9e25-96cd09e2dca5 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:53.606022 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe531473-53de-43cb-9e25-96cd09e2dca5 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:53.606633 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe531473-53de-43cb-9e25-96cd09e2dca5 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:53.607198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-fe531473-53de-43cb-9e25-96cd09e2dca5 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:53.608386 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [55435367-de27-449f-8a4d-6960491fa1c8] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52378. Oct 04 19:48:53.609993 n-d-850499-14 devstack@n-api.service[122331]: INFO oslo.messaging._drivers.impl_rabbit [-] [954a1eb6-68d1-42d4-a463-38aca2991f0a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52376. Oct 04 19:48:53.641537 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-fe531473-53de-43cb-9e25-96cd09e2dca5 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Going to try to terminate instance {{(pid=122332) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:48:53.659472 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-5d10741f-1f80-41c6-8890-714d7f4e62d6 req-56439641-6ff4-49d5-a162-706aafe97e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1321fd-d8d2-45dd-b38a-5af0bf27458f", "tag": "b427444e-4385-46e0-96ea-397dc8819097"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:53.670775 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5d10741f-1f80-41c6-8890-714d7f4e62d6 req-56439641-6ff4-49d5-a162-706aafe97e46 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:53.671762 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5d10741f-1f80-41c6-8890-714d7f4e62d6 req-56439641-6ff4-49d5-a162-706aafe97e46 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:53.672219 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-5d10741f-1f80-41c6-8890-714d7f4e62d6 req-56439641-6ff4-49d5-a162-706aafe97e46 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:53.684431 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-5d10741f-1f80-41c6-8890-714d7f4e62d6 req-56439641-6ff4-49d5-a162-706aafe97e46 service nova] Creating event network-changed:b427444e-4385-46e0-96ea-397dc8819097 for instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f on n-h1-850499-14 Oct 04 19:48:53.689749 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-5d10741f-1f80-41c6-8890-714d7f4e62d6 req-56439641-6ff4-49d5-a162-706aafe97e46 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101979 Oct 04 19:48:53.690427 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4091/8186] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:53.724812 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-fe531473-53de-43cb-9e25-96cd09e2dca5 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 204 len: 0 microversion: 2.1 time: 0.139606 Oct 04 19:48:53.725408 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4096/8187] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:48:53 2022] DELETE /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:48:53.734490 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-592b7ce6-3ab6-4940-bc92-71818777cab0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:53.735338 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-592b7ce6-3ab6-4940-bc92-71818777cab0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:53.742576 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-592b7ce6-3ab6-4940-bc92-71818777cab0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:53.743205 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-592b7ce6-3ab6-4940-bc92-71818777cab0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:53.743793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-592b7ce6-3ab6-4940-bc92-71818777cab0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:53.744561 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-592b7ce6-3ab6-4940-bc92-71818777cab0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:53.745098 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-592b7ce6-3ab6-4940-bc92-71818777cab0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:53.745609 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-592b7ce6-3ab6-4940-bc92-71818777cab0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:53.998810 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-592b7ce6-3ab6-4940-bc92-71818777cab0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:54.006992 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-592b7ce6-3ab6-4940-bc92-71818777cab0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1682 microversion: 2.1 time: 0.276698 Oct 04 19:48:54.007621 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4092/8188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:53 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1682 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:48:55.030428 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-d700a077-00d4-475a-94a4-3fba3b1966b7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:55.031163 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-d700a077-00d4-475a-94a4-3fba3b1966b7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:55.038517 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d700a077-00d4-475a-94a4-3fba3b1966b7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:55.039069 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d700a077-00d4-475a-94a4-3fba3b1966b7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:55.039505 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d700a077-00d4-475a-94a4-3fba3b1966b7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:55.040202 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d700a077-00d4-475a-94a4-3fba3b1966b7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:55.040667 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d700a077-00d4-475a-94a4-3fba3b1966b7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:55.041101 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-d700a077-00d4-475a-94a4-3fba3b1966b7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:55.174786 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-d700a077-00d4-475a-94a4-3fba3b1966b7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:55.185111 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-d700a077-00d4-475a-94a4-3fba3b1966b7 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1682 microversion: 2.1 time: 0.159000 Oct 04 19:48:55.185701 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4097/8189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:55 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:55.735107 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-b5fa5c9e-b79f-465d-b2b4-be45ad62217e req-0138b7c3-ee20-477f-94d3-c8bd5a537586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1321fd-d8d2-45dd-b38a-5af0bf27458f", "name": "network-vif-unplugged", "status": "completed", "tag": "b427444e-4385-46e0-96ea-397dc8819097"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:55.749028 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b5fa5c9e-b79f-465d-b2b4-be45ad62217e req-0138b7c3-ee20-477f-94d3-c8bd5a537586 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:55.749831 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b5fa5c9e-b79f-465d-b2b4-be45ad62217e req-0138b7c3-ee20-477f-94d3-c8bd5a537586 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:55.750625 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-b5fa5c9e-b79f-465d-b2b4-be45ad62217e req-0138b7c3-ee20-477f-94d3-c8bd5a537586 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:55.763546 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-b5fa5c9e-b79f-465d-b2b4-be45ad62217e req-0138b7c3-ee20-477f-94d3-c8bd5a537586 service nova] Creating event network-vif-unplugged:b427444e-4385-46e0-96ea-397dc8819097 for instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f on n-h1-850499-14 Oct 04 19:48:55.769944 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-b5fa5c9e-b79f-465d-b2b4-be45ad62217e req-0138b7c3-ee20-477f-94d3-c8bd5a537586 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039872 Oct 04 19:48:55.771592 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4093/8190] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:56.222316 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-e4a72762-fbb0-4f00-9fb6-2a8dd0544d92 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:56.222933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-e4a72762-fbb0-4f00-9fb6-2a8dd0544d92 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:56.230913 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4a72762-fbb0-4f00-9fb6-2a8dd0544d92 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:56.231489 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4a72762-fbb0-4f00-9fb6-2a8dd0544d92 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:56.231933 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4a72762-fbb0-4f00-9fb6-2a8dd0544d92 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:56.232638 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4a72762-fbb0-4f00-9fb6-2a8dd0544d92 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:56.233094 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4a72762-fbb0-4f00-9fb6-2a8dd0544d92 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:56.233945 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-e4a72762-fbb0-4f00-9fb6-2a8dd0544d92 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:56.303606 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-e4a72762-fbb0-4f00-9fb6-2a8dd0544d92 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:56.308021 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [req-d97cf975-7764-49eb-9338-d93632c3ef33 req-2e208345-5acf-4635-a368-95e5e8db54ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1321fd-d8d2-45dd-b38a-5af0bf27458f", "name": "network-vif-deleted", "tag": "b427444e-4385-46e0-96ea-397dc8819097"}]} {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:56.314376 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-e4a72762-fbb0-4f00-9fb6-2a8dd0544d92 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 200 len: 1496 microversion: 2.1 time: 0.096033 Oct 04 19:48:56.315104 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4098/8191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:56 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 1496 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:56.320281 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d97cf975-7764-49eb-9338-d93632c3ef33 req-2e208345-5acf-4635-a368-95e5e8db54ab service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:56.320857 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d97cf975-7764-49eb-9338-d93632c3ef33 req-2e208345-5acf-4635-a368-95e5e8db54ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:56.321376 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [req-d97cf975-7764-49eb-9338-d93632c3ef33 req-2e208345-5acf-4635-a368-95e5e8db54ab service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:56.334388 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.compute.server_external_events [req-d97cf975-7764-49eb-9338-d93632c3ef33 req-2e208345-5acf-4635-a368-95e5e8db54ab service nova] Creating event network-vif-deleted:b427444e-4385-46e0-96ea-397dc8819097 for instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f on n-h1-850499-14 Oct 04 19:48:56.340096 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [req-d97cf975-7764-49eb-9338-d93632c3ef33 req-2e208345-5acf-4635-a368-95e5e8db54ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036915 Oct 04 19:48:56.340948 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4094/8192] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:48:57.344767 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:57.345308 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 4f1321fd-d8d2-45dd-b38a-5af0bf27458f] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:57.353291 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:57.353878 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:57.354322 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:57.355067 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:57.355529 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:57.356072 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:57.372799 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.wsgi [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] HTTP exception thrown: Instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f could not be found. Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Request method failure captured: Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: request: GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f HTTP/1.1 Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: Accept: application/json Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: Accept-Encoding: identity Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: Connection: close Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: Content-Length: 0 Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: Content-Type: application/json Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: Host: 10.222.0.18 Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: Openstack-System-Scope: None Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: User-Agent: python-urllib3/1.26.12 Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Auth-Token: gAAAAABjPIzX3lC77b2kEO-1r5MHpBsJNU9VwCZ9VTMlwIZTl2Uj0QQyVA2ICuXXAFORkkrxzrgC3UNq1XB97hLs--IM8oO9tx-OFQcVB9cZBhYW8qlhpuDri0DxqTW9eUyHrjo1TkitBonoB9WyAGz-nqU0IrqM9WcJ-1fUuxG9o0UoNWuvJbI Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Id: None Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Domain-Name: None Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Identity-Status: Confirmed Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Is-Admin-Project: True Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Id: default Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Domain-Name: Default Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Id: 374cc88606ea4ce1a3d258103d711132 Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Project-Name: tempest-TestSnapshotPattern-1206627297 Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Role: reader,member Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Roles: reader,member Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_374cc88606ea4ce1a3d258103d711132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/374cc88606ea4ce1a3d258103d711132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/374cc88606ea4ce1a3d258103d711132"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/374cc88606ea4ce1a3d258103d711132"}]}] Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant: tempest-TestSnapshotPattern-1206627297 Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Id: 374cc88606ea4ce1a3d258103d711132 Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-Tenant-Name: tempest-TestSnapshotPattern-1206627297 Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-User: tempest-TestSnapshotPattern-1206627297-project Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Id: default Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-User-Domain-Name: Default Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-User-Id: 437ec22f371c47c5899719e3becaca1d Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: X-User-Name: tempest-TestSnapshotPattern-1206627297-project Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: method: > Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: exception: Instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f could not be found. Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: action_args: {'id': '4f1321fd-d8d2-45dd-b38a-5af0bf27458f'} Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f could not be found. Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f could not be found. Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:48:57.374458 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:48:57.380928 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:57.380928 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:48:57.380928 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:48:57.380928 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:48:57.380928 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:48:57.380928 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f could not be found. Oct 04 19:48:57.380928 n-d-850499-14 devstack@n-api.service[122332]: ERROR nova.api.openstack.wsgi Oct 04 19:48:57.380928 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Returning 404 to user: Instance 4f1321fd-d8d2-45dd-b38a-5af0bf27458f could not be found. {{(pid=122332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:48:57.380928 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-6ca1dccc-68a6-4998-857d-e517753be3eb tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f" status: 404 len: 111 microversion: 2.1 time: 0.035172 Oct 04 19:48:57.380928 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4099/8193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:57 2022] GET /compute/v2.1/servers/4f1321fd-d8d2-45dd-b38a-5af0bf27458f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:48:58.782928 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-1c175cdc-f82e-490e-81b2-67685d950796 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:58.783568 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1c175cdc-f82e-490e-81b2-67685d950796 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:58.790631 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-65052732-7d8a-497b-9b22-9675b37f965b req-0cb9f30a-02c9-42cc-a3c1-488c2fcde2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa1c8d3-669a-467c-98ee-8eadecff72ee", "tag": "e346e1ad-e15a-4ad1-a49a-82f001efe31d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:58.803333 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c175cdc-f82e-490e-81b2-67685d950796 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:58.803598 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-65052732-7d8a-497b-9b22-9675b37f965b req-0cb9f30a-02c9-42cc-a3c1-488c2fcde2b7 service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:58.803859 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c175cdc-f82e-490e-81b2-67685d950796 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:58.803983 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-65052732-7d8a-497b-9b22-9675b37f965b req-0cb9f30a-02c9-42cc-a3c1-488c2fcde2b7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:58.804325 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c175cdc-f82e-490e-81b2-67685d950796 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:58.804453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-65052732-7d8a-497b-9b22-9675b37f965b req-0cb9f30a-02c9-42cc-a3c1-488c2fcde2b7 service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:58.805056 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c175cdc-f82e-490e-81b2-67685d950796 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:58.805793 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c175cdc-f82e-490e-81b2-67685d950796 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:58.806256 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-1c175cdc-f82e-490e-81b2-67685d950796 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:58.815382 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-65052732-7d8a-497b-9b22-9675b37f965b req-0cb9f30a-02c9-42cc-a3c1-488c2fcde2b7 service nova] Creating event network-changed:e346e1ad-e15a-4ad1-a49a-82f001efe31d for instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee on n-h2-850499-14 Oct 04 19:48:58.821070 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-65052732-7d8a-497b-9b22-9675b37f965b req-0cb9f30a-02c9-42cc-a3c1-488c2fcde2b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034568 Oct 04 19:48:58.821861 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4100/8194] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:58.835474 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-1c175cdc-f82e-490e-81b2-67685d950796 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Going to try to terminate instance {{(pid=122331) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:48:58.922684 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-1c175cdc-f82e-490e-81b2-67685d950796 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 204 len: 0 microversion: 2.1 time: 0.144772 Oct 04 19:48:58.923795 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4095/8195] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 4 19:48:58 2022] DELETE /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:48:58.933171 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-069d69b6-157d-4ad4-a7cd-0c8a77656c52 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:58.934198 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.compute.api [None req-069d69b6-157d-4ad4-a7cd-0c8a77656c52 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122332) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:58.940833 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-069d69b6-157d-4ad4-a7cd-0c8a77656c52 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:58.941585 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-069d69b6-157d-4ad4-a7cd-0c8a77656c52 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:58.942908 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-069d69b6-157d-4ad4-a7cd-0c8a77656c52 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:58.943563 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-069d69b6-157d-4ad4-a7cd-0c8a77656c52 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:58.944487 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-069d69b6-157d-4ad4-a7cd-0c8a77656c52 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:58.944937 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [None req-069d69b6-157d-4ad4-a7cd-0c8a77656c52 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:59.103048 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.policy [None req-069d69b6-157d-4ad4-a7cd-0c8a77656c52 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122332) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:59.110884 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-069d69b6-157d-4ad4-a7cd-0c8a77656c52 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1682 microversion: 2.1 time: 0.182058 Oct 04 19:48:59.111556 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4101/8196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:58 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:00.142441 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-a9f2bb82-49db-4c78-8d33-21c80f9b1192 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:00.143181 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-a9f2bb82-49db-4c78-8d33-21c80f9b1192 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:00.153505 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f2bb82-49db-4c78-8d33-21c80f9b1192 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:00.154015 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f2bb82-49db-4c78-8d33-21c80f9b1192 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:00.154476 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f2bb82-49db-4c78-8d33-21c80f9b1192 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:00.155223 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f2bb82-49db-4c78-8d33-21c80f9b1192 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:00.155693 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f2bb82-49db-4c78-8d33-21c80f9b1192 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:00.156129 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-a9f2bb82-49db-4c78-8d33-21c80f9b1192 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:00.320833 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.policy [None req-a9f2bb82-49db-4c78-8d33-21c80f9b1192 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437ec22f371c47c5899719e3becaca1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374cc88606ea4ce1a3d258103d711132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122331) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:00.328950 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-a9f2bb82-49db-4c78-8d33-21c80f9b1192 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 200 len: 1564 microversion: 2.1 time: 0.190823 Oct 04 19:49:00.329524 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4096/8197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:00 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:00.836146 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [req-dabd4311-d732-4759-bc1d-99dbfd339959 req-ad9600f0-a7c3-47fc-9568-2c57a85bf6cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa1c8d3-669a-467c-98ee-8eadecff72ee", "name": "network-vif-deleted", "tag": "e346e1ad-e15a-4ad1-a49a-82f001efe31d"}]} {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:00.846453 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dabd4311-d732-4759-bc1d-99dbfd339959 req-ad9600f0-a7c3-47fc-9568-2c57a85bf6cc service nova] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:00.846943 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dabd4311-d732-4759-bc1d-99dbfd339959 req-ad9600f0-a7c3-47fc-9568-2c57a85bf6cc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:00.847409 n-d-850499-14 devstack@n-api.service[122332]: DEBUG oslo_concurrency.lockutils [req-dabd4311-d732-4759-bc1d-99dbfd339959 req-ad9600f0-a7c3-47fc-9568-2c57a85bf6cc service nova] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:00.859574 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.compute.server_external_events [req-dabd4311-d732-4759-bc1d-99dbfd339959 req-ad9600f0-a7c3-47fc-9568-2c57a85bf6cc service nova] Creating event network-vif-deleted:e346e1ad-e15a-4ad1-a49a-82f001efe31d for instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee on n-h2-850499-14 Oct 04 19:49:00.864369 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [req-dabd4311-d732-4759-bc1d-99dbfd339959 req-ad9600f0-a7c3-47fc-9568-2c57a85bf6cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032575 Oct 04 19:49:00.865042 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4102/8198] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 4 19:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:01.354697 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '>' {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:01.355330 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.compute.api [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] [instance: 3aa1c8d3-669a-467c-98ee-8eadecff72ee] Fetching instance by UUID {{(pid=122331) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:01.362334 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:01.362875 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:01.363370 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:01.364094 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Acquiring lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:01.364569 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:01.365013 n-d-850499-14 devstack@n-api.service[122331]: DEBUG oslo_concurrency.lockutils [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Lock "c347de46-5030-4dd1-93a8-9ebc81c486f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:01.378859 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.wsgi [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] HTTP exception thrown: Instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee could not be found. Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Request method failure captured: Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: request: GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee HTTP/1.1 Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: Accept: application/json Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: Accept-Encoding: identity Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: Connection: close Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: Content-Length: 0 Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: Content-Type: application/json Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: Host: 10.222.0.18 Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: Openstack-System-Scope: None Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: User-Agent: python-urllib3/1.26.12 Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Auth-Token: gAAAAABjPIzX3lC77b2kEO-1r5MHpBsJNU9VwCZ9VTMlwIZTl2Uj0QQyVA2ICuXXAFORkkrxzrgC3UNq1XB97hLs--IM8oO9tx-OFQcVB9cZBhYW8qlhpuDri0DxqTW9eUyHrjo1TkitBonoB9WyAGz-nqU0IrqM9WcJ-1fUuxG9o0UoNWuvJbI Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Id: None Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Domain-Name: None Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Identity-Status: Confirmed Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Is-Admin-Project: True Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Id: default Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Domain-Name: Default Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Id: 374cc88606ea4ce1a3d258103d711132 Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Project-Name: tempest-TestSnapshotPattern-1206627297 Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Role: reader,member Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Roles: reader,member Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_374cc88606ea4ce1a3d258103d711132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/374cc88606ea4ce1a3d258103d711132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/374cc88606ea4ce1a3d258103d711132"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/374cc88606ea4ce1a3d258103d711132"}]}] Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant: tempest-TestSnapshotPattern-1206627297 Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Id: 374cc88606ea4ce1a3d258103d711132 Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-Tenant-Name: tempest-TestSnapshotPattern-1206627297 Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-User: tempest-TestSnapshotPattern-1206627297-project Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Id: default Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-User-Domain-Name: Default Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-User-Id: 437ec22f371c47c5899719e3becaca1d Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: X-User-Name: tempest-TestSnapshotPattern-1206627297-project Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: method: > Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: exception: Instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee could not be found. Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: action_args: {'id': '3aa1c8d3-669a-467c-98ee-8eadecff72ee'} Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: {{(pid=122331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee could not be found. Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee could not be found. Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:49:01.381253 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:49:01.386754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:49:01.386754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:49:01.386754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:49:01.386754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:49:01.386754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:49:01.386754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee could not be found. Oct 04 19:49:01.386754 n-d-850499-14 devstack@n-api.service[122331]: ERROR nova.api.openstack.wsgi Oct 04 19:49:01.386754 n-d-850499-14 devstack@n-api.service[122331]: DEBUG nova.api.openstack.wsgi [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Returning 404 to user: Instance 3aa1c8d3-669a-467c-98ee-8eadecff72ee could not be found. {{(pid=122331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:49:01.386754 n-d-850499-14 devstack@n-api.service[122331]: INFO nova.api.openstack.requestlog [None req-06befd99-1fac-4037-95b3-0caa4de31bb0 tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee" status: 404 len: 111 microversion: 2.1 time: 0.031918 Oct 04 19:49:01.386754 n-d-850499-14 devstack@n-api.service[122331]: [pid: 122331|app: 0|req: 4097/8199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:01 2022] GET /compute/v2.1/servers/3aa1c8d3-669a-467c-98ee-8eadecff72ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:49:01.556485 n-d-850499-14 devstack@n-api.service[122332]: DEBUG nova.api.openstack.wsgi [None req-4c2b9d5d-10f6-46f3-b434-1d07db6f636b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] Calling method '.version_select at 0x7fd4d0b8dd30>' {{(pid=122332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:01.579422 n-d-850499-14 devstack@n-api.service[122332]: INFO nova.api.openstack.requestlog [None req-4c2b9d5d-10f6-46f3-b434-1d07db6f636b tempest-TestSnapshotPattern-1206627297 tempest-TestSnapshotPattern-1206627297-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-45450242" status: 202 len: 0 microversion: 2.1 time: 0.027684 Oct 04 19:49:01.584806 n-d-850499-14 devstack@n-api.service[122332]: [pid: 122332|app: 0|req: 4103/8200] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 4 19:49:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-45450242 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)